danaman123 Posted August 15, 2020 Share Posted August 15, 2020 I'm running/coding/debugging an au3 project with 10k+ lines of code. I started to see the IDE run into straight up blank errors, even with no memory leak... and other strange errors I can't explain... such as requiring me to use the number() function to declare variables as integers. After 3k lines of code I found that compiling sections of the code into .exes and having them communicate to each other through a database or .txt solved all of my problems! The now APP runs way faster, bug free & crash free. Anyways this is just my experience and I wonder if anyone else has had a similar experience? Also I hope this post can help other's who are managing/developing a large Au3 project. Au3 is a power language & so much easier to read/write than python & rstudio or any other language for that matter. I'd rather manipulate 1 million rows of data in an array format in Au3 that use rstudio... I hope Au3 gets continued interest/development from the public! Link to comment Share on other sites More sharing options...
Developers Jos Posted August 15, 2020 Developers Share Posted August 15, 2020 (edited) Quote Is it just me or are compiled .exe au3 scripts running faster & less likely to crash? It is you as a compiled script is the bytecode of the script and runtime module packed into the EXE, so basically doing the exact same thing. ... having said that: When you use au3stripper, the cases aren't the same anymore as the source of the compiled script is "much" smaller and we run a bit faster. Jos Edited August 15, 2020 by Jos danaman123 1 SciTE4AutoIt3 Full installer Download page - Beta files Read before posting How to post scriptsource Forum etiquette Forum Rules Live for the present, Dream of the future, Learn from the past. Link to comment Share on other sites More sharing options...
Exit Posted August 15, 2020 Share Posted August 15, 2020 7 minutes ago, Jos said: au2stripper ? App: Au3toCmd UDF: _SingleScript() Link to comment Share on other sites More sharing options...
Developers Jos Posted August 15, 2020 Developers Share Posted August 15, 2020 Exit 1 SciTE4AutoIt3 Full installer Download page - Beta files Read before posting How to post scriptsource Forum etiquette Forum Rules Live for the present, Dream of the future, Learn from the past. Link to comment Share on other sites More sharing options...
danaman123 Posted August 15, 2020 Author Share Posted August 15, 2020 3 hours ago, Jos said: It is you as a compiled script is the bytecode of the script and runtime module packed into the EXE, so basically doing the exact same thing. ... having said that: When you use au3stripper, the cases aren't the same anymore as the source of the compiled script is "much" smaller and we run a bit faster. Jos I tried VBA & RStudio for running complex algorithms for training Ai, to my surprise all this Rstudio hype is BS, sometimes VBA is faster at certain tasks. Both Rstudio & VBA completed a calculation in around 15 seconds. 15 seconds per row for 100k rows would take me 416 hours or 10,000 days to complete... Both VBA & Rstudio couldn't perform any true multi-threading... VS Autoit I was able to run 10 compiled .exe processors for processing data & utilize all of my cores at 100%! Which means Autoit it is 10x faster for processing data than Rstudio! Link to comment Share on other sites More sharing options...
argumentum Posted August 15, 2020 Share Posted August 15, 2020 3 hours ago, danaman123 said: having them communicate to each other through a database or .txt solved all of my problems ..there are IPC that are quite good. Search around, give'em a try danaman123 1 Follow the link to my code contribution ( and other things too ). FAQ - Please Read Before Posting. Link to comment Share on other sites More sharing options...
jchd Posted August 16, 2020 Share Posted August 16, 2020 5 hours ago, danaman123 said: Which means Autoit it is 10x faster for processing data than Rstudio! A doubtfull assertion! This wonderful site allows debugging and testing regular expressions (many flavors available). An absolute must have in your bookmarks.Another excellent RegExp tutorial. Don't forget downloading your copy of up-to-date pcretest.exe and pcregrep.exe hereRegExp tutorial: enough to get startedPCRE v8.33 regexp documentation latest available release and currently implemented in AutoIt beta. SQLitespeed is another feature-rich premier SQLite manager (includes import/export). Well worth a try.SQLite Expert (freeware Personal Edition or payware Pro version) is a very useful SQLite database manager.An excellent eBook covering almost every aspect of SQLite3: a must-read for anyone doing serious work.SQL tutorial (covers "generic" SQL, but most of it applies to SQLite as well)A work-in-progress SQLite3 tutorial. Don't miss other LxyzTHW pages!SQLite official website with full documentation (may be newer than the SQLite library that comes standard with AutoIt) Link to comment Share on other sites More sharing options...
RTFC Posted August 16, 2020 Share Posted August 16, 2020 (edited) 16 hours ago, danaman123 said: I'd rather manipulate 1 million rows of data If you're doing numerical operations on this scale, then E4A (even when running interpreted only) is several orders of magnitude faster than pure AutoIt (and supports multi-processing with shared data containers on x64). Edited August 16, 2020 by RTFC My Contributions and Wrappers Spoiler BitMaskSudokuSolver BuildPartitionTable CodeCrypter CodeScanner DigitalDisplay Eigen4AutoIt FAT Suite HighMem MetaCodeFileLibrary OSgrid Pool RdRand SecondDesktop SimulatedAnnealing Xbase I/O Link to comment Share on other sites More sharing options...
danaman123 Posted August 16, 2020 Author Share Posted August 16, 2020 7 hours ago, RTFC said: If you're doing numerical operations on this scale, then E4A (even when running interpreted only) is several orders of magnitude faster than pure AutoIt (and supports multi-processing with shared data containers on x64). Thanks I'll check them out! I've never heard of them before, right now I'm running shared LAN computing with 6 computers processing a 6 way split data of the data with 8 .exes of Autoit running per computer. All 6 computers are at 100% CPU use. The array size read doesn't seem to affect the processing speed much but the algorithms itself uses the most CPU power and requires the most processing time. Link to comment Share on other sites More sharing options...
jchd Posted August 16, 2020 Share Posted August 16, 2020 Isn't it a good candidate for CUDA processing? This wonderful site allows debugging and testing regular expressions (many flavors available). An absolute must have in your bookmarks.Another excellent RegExp tutorial. Don't forget downloading your copy of up-to-date pcretest.exe and pcregrep.exe hereRegExp tutorial: enough to get startedPCRE v8.33 regexp documentation latest available release and currently implemented in AutoIt beta. SQLitespeed is another feature-rich premier SQLite manager (includes import/export). Well worth a try.SQLite Expert (freeware Personal Edition or payware Pro version) is a very useful SQLite database manager.An excellent eBook covering almost every aspect of SQLite3: a must-read for anyone doing serious work.SQL tutorial (covers "generic" SQL, but most of it applies to SQLite as well)A work-in-progress SQLite3 tutorial. Don't miss other LxyzTHW pages!SQLite official website with full documentation (may be newer than the SQLite library that comes standard with AutoIt) Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now