Dana86 Posted January 24, 2021 Share Posted January 24, 2021 Does anyone know if computing power is reduced when rounding floats into smaller decimal places? I'm working with large datasets & nested for loops. Thanks! Link to comment Share on other sites More sharing options...
JockoDundee Posted January 24, 2021 Share Posted January 24, 2021 Exit 1 Code hard, but don’t hard code... Link to comment Share on other sites More sharing options...
Moderators Melba23 Posted January 24, 2021 Moderators Share Posted January 24, 2021 (edited) Dana86, Given that a floating point number takes the same amount of space in memory regardless of its actual value I would imagine the answer is "No", but I am quite ready to be proved wrong. M23 Edit: Love the Dilbert! Edited January 24, 2021 by Melba23 Any of my own code posted anywhere on the forum is available for use by others without any restriction of any kind Open spoiler to see my UDFs: Spoiler ArrayMultiColSort ---- Sort arrays on multiple columnsChooseFileFolder ---- Single and multiple selections from specified path treeview listingDate_Time_Convert -- Easily convert date/time formats, including the language usedExtMsgBox --------- A highly customisable replacement for MsgBoxGUIExtender -------- Extend and retract multiple sections within a GUIGUIFrame ---------- Subdivide GUIs into many adjustable framesGUIListViewEx ------- Insert, delete, move, drag, sort, edit and colour ListView itemsGUITreeViewEx ------ Check/clear parent and child checkboxes in a TreeViewMarquee ----------- Scrolling tickertape GUIsNoFocusLines ------- Remove the dotted focus lines from buttons, sliders, radios and checkboxesNotify ------------- Small notifications on the edge of the displayScrollbars ----------Automatically sized scrollbars with a single commandStringSize ---------- Automatically size controls to fit textToast -------------- Small GUIs which pop out of the notification area Link to comment Share on other sites More sharing options...
TheXman Posted January 24, 2021 Share Posted January 24, 2021 (edited) It would be very simple to test by running 2 timed runs, with a subset of the data, one with rounded floats and one without. Let's assume that it did make a difference, which I don't think it does for the reason stated above, the answer to your question would still be relevant to your data set and the logic used to process it. That's because you would have to offset the amount of "computing power" saved by rounding the floats with the amount of "computer power" used to round the floats to know for sure. So, assuming again that it made a difference, no one would be able to accurately answer the question without testing it on your data using your processing logic. Edited January 24, 2021 by TheXman CryptoNG UDF: Cryptography API: Next Gen jq UDF: Powerful and Flexible JSON Processor | jqPlayground: An Interactive JSON Processor Xml2Json UDF: Transform XML to JSON | HttpApi UDF: HTTP Server API | Roku Remote: Example Script About Me How To Ask Good Questions On Technical And Scientific Forums (Detailed) | How to Ask Good Technical Questions (Brief) "Any fool can know. The point is to understand." -Albert Einstein "If you think you're a big fish, it's probably because you only swim in small ponds." ~TheXman Link to comment Share on other sites More sharing options...
JockoDundee Posted January 24, 2021 Share Posted January 24, 2021 4 hours ago, Dana86 said: Does anyone know if computing power is reduced when rounding floats into smaller decimal places? Depends how much you round, and how much processing is involved. For instance, if you can round to integers and the interim processing doesn’t create more fp numbers, then very possibly. To know for sure, we need an example of the processing and the tolerable precision loss involved. Code hard, but don’t hard code... Link to comment Share on other sites More sharing options...
Dana86 Posted January 25, 2021 Author Share Posted January 25, 2021 Thanks guys! Link to comment Share on other sites More sharing options...
Earthshine Posted January 25, 2021 Share Posted January 25, 2021 (edited) your rounding adds compute time so probably uses more power if anything. but for all intents and purposes I don't think it amounts to anything significant Edited January 25, 2021 by Earthshine My resources are limited. You must ask the right questions Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now