Trouble Comparing Two Variables

[4b0082]

For some reason I can't compare $rTotal and $Total properly. Both have a return value of "0.57" and are set as double variables, but when I compare the two I still get my error message. I've tried converting the variables with Number() but that didn't seem to change anything.
 

Local $Total = .57

Local $SubTotal = Round($Total/1.15, 2)
Local $rFee = FloorEx($SubTotal * 0.1, 2) + FloorEx($SubTotal * 0.05, 2)
Local $rTotal = $SubTotal + $rFee

If $rTotal <> $Total Then
    MsgBox(0, "Broken", VarGetType($Total))
EndIf

Func FloorEx($fNumber, $iDec = 3)
    Return StringFormat("%." & $iDec & "f", Floor($fNumber * 10 ^ $iDec) / 10 ^ $iDec)
EndFunc

Edited January 13, 2015 by 4b0082

[water]

Function FloorEx doesn't make much sense to me. You return a formatted string and then use it in a numeric operation forcing autoit to convert the string into a number.

Shouldn't you first do all the calculation and then format the result?

[4b0082]

I needed a way to round down and that's a snippet of code I found through the forums that worked. I'm not sure of another way to do it.

[Melba23]

4b0082,

If you convert the 2 values to Hex then you will see that they are slightly different:

$rTotal: 3FE23D70A3D70A3E
$Total : 3FE23D70A3D70A3D

This is a result of the way in which computers store fractional number (Google "floating point arithmetic" to learn more) and not an AutoIt problem. The normal way to get over this is to use integer values - multiply the value by a large enough factor to get it as an integer for calculations and then divide by that factor when you need the actual value.

M23

[4b0082]

I tried multiplying the results by 100 then comparing them but I'm still getting double as my variable and it's still processing the error.

Edit: Nevermind! I forgot to wrap Int() around the new variable. It works now, thanks!

Edited January 13, 2015 by 4b0082

[Melba23]

4b0082,

It works for me:

$iFactor = 100

Local $Total = .57

Local $SubTotal = Round($Total/1.15, 2)
Local $rFee = Number(FloorEx($SubTotal * 0.1, 2)) + Number(FloorEx($SubTotal * 0.05, 2))
Local $rTotal = $SubTotal + $rFee

ConsoleWrite($rTotal & " - " & $Total & @CRLF)
ConsoleWrite(Hex($rTotal) & @CRLF & Hex($Total) & @CRLF)

If Int ($rTotal * $iFactor) <> Int ($Total * $iFactor) Then ; <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
    MsgBox(0, "Broken", Hex($rTotal) & @CRLF & Hex($Total))
Else
    MsgBox(0, "Works", ";)")
EndIf

Func FloorEx($fNumber, $iDec = 3)
    Return StringFormat("%." & $iDec & "f", Floor($fNumber * 10 ^ $iDec) / 10 ^ $iDec)
EndFunc

M23