XProfan

English

Erasmus.Herold

Hallöchen.

I have the following Rundungsproblem.
has someone a idea?

temp! = 64.975
print "DEMO 1: ", temp!
temp! = ROUND(temp!,2)
print "DEMO 2: ", temp!

Output the screen:
DEMO 1: 64.975000
DEMO 2: 64.970000

I expect but:
DEMO 2: 64.980000

thanks for eure ideas.

11/13/18 ▲

Vollständiges Quote

Absatzweise Quote Zeilenweise Quote

p.specht

the called Inkomensurabilität: The number 64.975 is binary only slightly To small representable. remedy would here only, with 1+1e-15 To multiplizieren, so The latest the 16 signifikanten to put a "Schubs" sustain. then is ever another number on this unfavourable place on the Zahlengeraden...

one sees what there very happens, if one itself any 17 Nachkommastellen Show can.
greeting

Compile Mark Separation

Cls
Print round(64.975*1.000000000000001,2)
print
set("decimals",17)
print 64.975
print 64.975 * 1.000000000000001
waitinput

XProfan 11
Computer: Gerät, daß es in Mikrosekunden erlaubt, 50.000 Fehler zu machen, zB 'daß' statt 'das'...

11/13/18 ▲

Vollständiges Quote

Absatzweise Quote Zeilenweise Quote

Erasmus.Herold

gavel!

thanks - so try I my Happiness.

11/14/18 ▲

Vollständiges Quote

Absatzweise Quote Zeilenweise Quote

Answer

Topic-Options

Unreaded
subscribe
Remember-List
Notes
guests
Delete
Permanent
Done

2.503 Views

Untitled	vor 0 min.
Michael Hettner	09/02/21
Normann Strübli	03/31/20
Stefan81	12/30/19
Pk	12/01/19
More...

Themeninformationen

this Topic has 2 subscriber:

Erasmus.Herold (2x)

p.specht (1x)

XProfan

rounds, as I do not gefällt ...

Answer

Topic-Options

2.503 Views

Themeninformationen

Privacy Policy