Velocity Reviews > mystery 2.3

# mystery 2.3

Vince13 via DotNetMonster.com
Guest
Posts: n/a

 07-11-2007
I am working on a page with textboxes that can only accept a certain number
of decimals places. So I wrote a small function to check the number of
decimals, not counting zeros, as well as range check the entry and then
return the results, based on a parsing method I learned in c++ involving
integer division:

public bool entryCheck(int decimals, double min, double max, TextBox field,
Label error)
{
bool valid = false;
if (field.Text != "")
{
error.Text = "";
double entry = double.Parse(field.Text);
//decimal check
if ((double)((int)(entry * Math.Pow(10,(decimals + 1))) / 10) != entry *
Math.Pow(10, decimals))
{
field.ForeColor = Color.Red;
error.Text = "Too Many Decimals";
}
//range check
else if (entry < min || entry > max)
{
field.ForeColor = Color.Red;
error.Text = "Invalid Range";
}
else
{
field.ForeColor = Color.Blue;
valid = true;
}
}
else
error.Text = "Required Field"; //error if left blank

return valid;
}

It works beautifully ALMOST all of the time. For some reason, when the entry
is 2.3, the computer multiplies it by say 10000 and gets 22999.9999, which
obviously won't work and isn't correct. Does anyone know why this is?
Thanks?

--
Message posted via http://www.dotnetmonster.com

bruce barker
Guest
Posts: n/a

 07-11-2007
because floating point is done in base 2, not base 10. just as 1/3 is
..33333... in base 10, 2.3 is a repeating number in base 2

switch to the decimal datatype which uses base 10 (actual its integer
only with a implied decimal).

-- bruce (sqlwork.com)

Vince13 via DotNetMonster.com wrote:
> I am working on a page with textboxes that can only accept a certain number
> of decimals places. So I wrote a small function to check the number of
> decimals, not counting zeros, as well as range check the entry and then
> return the results, based on a parsing method I learned in c++ involving
> integer division:
>
> public bool entryCheck(int decimals, double min, double max, TextBox field,
> Label error)
> {
> bool valid = false;
> if (field.Text != "")
> {
> error.Text = "";
> double entry = double.Parse(field.Text);
> //decimal check
> if ((double)((int)(entry * Math.Pow(10,(decimals + 1))) / 10) != entry *
> Math.Pow(10, decimals))
> {
> field.ForeColor = Color.Red;
> error.Text = "Too Many Decimals";
> }
> //range check
> else if (entry < min || entry > max)
> {
> field.ForeColor = Color.Red;
> error.Text = "Invalid Range";
> }
> else
> {
> field.ForeColor = Color.Blue;
> valid = true;
> }
> }
> else
> error.Text = "Required Field"; //error if left blank
>
> return valid;
> }
>
> It works beautifully ALMOST all of the time. For some reason, when the entry
> is 2.3, the computer multiplies it by say 10000 and gets 22999.9999, which
> obviously won't work and isn't correct. Does anyone know why this is?
> Thanks?
>

John Timney \(MVP\)
Guest
Posts: n/a

 07-11-2007
I prefer this rather simplistic approach

Double start_value = 5231.327000;
string[] end_values = start_value.ToString().Split('.');
int fubar = (end_values.Length > 1) ? end_values[1].Length : 0;
Response.Write(fubar.ToString());

Regards

John Timney (MVP)
http://www.johntimney.com
http://www.johntimney.com/blog

"bruce barker" <(E-Mail Removed)> wrote in message
news:Obe1rS\$(E-Mail Removed)...
> because floating point is done in base 2, not base 10. just as 1/3 is
> .33333... in base 10, 2.3 is a repeating number in base 2
>
> switch to the decimal datatype which uses base 10 (actual its integer only
> with a implied decimal).
>
>
> -- bruce (sqlwork.com)
>
> Vince13 via DotNetMonster.com wrote:
>> I am working on a page with textboxes that can only accept a certain
>> number
>> of decimals places. So I wrote a small function to check the number of
>> decimals, not counting zeros, as well as range check the entry and then
>> return the results, based on a parsing method I learned in c++ involving
>> integer division:
>>
>> public bool entryCheck(int decimals, double min, double max, TextBox
>> field,
>> Label error)
>> {
>> bool valid = false;
>> if (field.Text != "")
>> {
>> error.Text = "";
>> double entry = double.Parse(field.Text);
>> //decimal check
>> if ((double)((int)(entry * Math.Pow(10,(decimals + 1))) / 10) != entry *
>> Math.Pow(10, decimals))
>> {
>> field.ForeColor = Color.Red;
>> error.Text = "Too Many Decimals";
>> }
>> //range check
>> else if (entry < min || entry > max)
>> {
>> field.ForeColor = Color.Red;
>> error.Text = "Invalid Range";
>> }
>> else
>> {
>> field.ForeColor = Color.Blue;
>> valid = true;
>> }
>> }
>> else
>> error.Text = "Required Field"; //error if left blank
>>
>> return valid;
>> }
>>
>> It works beautifully ALMOST all of the time. For some reason, when the
>> entry
>> is 2.3, the computer multiplies it by say 10000 and gets 22999.9999,
>> which
>> obviously won't work and isn't correct. Does anyone know why this is?
>> Thanks?
>>

Vince13 via DotNetMonster.com
Guest
Posts: n/a

 07-12-2007
Thanks a lot guys!

**in case anyone else is wondering:

if ((((int)(dentry * (decimal)Math.Pow(10,(decimals + 1)))) / 10) != dentry *
(decimal)Math.Pow(10, decimals))

gave me the corrext result

--
Message posted via DotNetMonster.com
http://www.dotnetmonster.com/Uwe/For...p-net/200707/1

Guest
Posts: n/a

 07-14-2007
On Wed, 11 Jul 2007 19:19:34 GMT, "Vince13 via DotNetMonster.com"
<u35350@uwe> wrote:

>I am working on a page with textboxes that can only accept a certain number
>of decimals places. So I wrote a small function to check the number of
>decimals, not counting zeros, as well as range check the entry and then
>return the results, based on a parsing method I learned in c++ involving
>integer division:
>
>public bool entryCheck(int decimals, double min, double max, TextBox field,
>Label error)
>{
> bool valid = false;
> if (field.Text != "")
> {
> error.Text = "";
> double entry = double.Parse(field.Text);
> //decimal check
> if ((double)((int)(entry * Math.Pow(10,(decimals + 1))) / 10) != entry *
>Math.Pow(10, decimals))
> {
> field.ForeColor = Color.Red;
> error.Text = "Too Many Decimals";
> }
> //range check
> else if (entry < min || entry > max)
> {
> field.ForeColor = Color.Red;
> error.Text = "Invalid Range";
> }
> else
> {
> field.ForeColor = Color.Blue;
> valid = true;
> }
> }
> else
> error.Text = "Required Field"; //error if left blank
>
> return valid;
>}
>
>It works beautifully ALMOST all of the time. For some reason, when the entry
>is 2.3, the computer multiplies it by say 10000 and gets 22999.9999, which
>obviously won't work and isn't correct. Does anyone know why this is?
>Thanks?

What I would suggest is to use a numeric up down control. This yields
a couple of benefits
- Less code
- Simpler to understand
- Intuitive to the users

--
http://bytes.thinkersroom.com