Many INETGET TCP Request

[uncommon]

Right now the fastest way I can mine someone's database is by making hundreds of individual executable that all do there on INETGET TCP Request, obviously this take up a lot of processing and RAM resources. Anyone know of a way I can make more requests for pages faster\more efficiently?

My scripts that I run look something like this...

;A setprate script makes a txt file with part of a URL to go to
#include <File.au3>
#include <Array.au3>
$htmlstore = @DesktopCommonDir & "\HTMLstore\"
$FileList = _FileListToArray($htmlstore)
For $count = 2 To $FileList[0] + 1
If FileExists($htmlstore & $count & ".txt") = 1 Then
FileMove($htmlstore & $count & ".txt", $htmlstore & @AutoItPID & @ComputerName & ".txt")
$file = FileOpen($htmlstore & @AutoItPID & @ComputerName & ".txt")
$PID = FileRead($file)
FileClose($file)
$hDownload = InetGet("http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/" & $PID, $htmlstore & $PID & ".html", 1)
InetClose($hDownload) ; Close the handle to release resources.
FileDelete($htmlstore & @AutoItPID & @ComputerName & ".txt")
Exit
EndIf
Next

If you need more info let me know.

Any recommendations would be appreciated

[JohnOne]

mine someone's database

What does that mean?

[uncommon]

Request every page on the site or some other way of copying the database.

[somdcomputerguy]

..by making hundreds of individual executable..

I think what you mean is you have to run that script many times in order to get done what you're trying to get done. If that's so, try commenting out (or removing) the Exit line from the If loop.

[uncommon]

I think what you mean is you have to run that script many times in order to get done what you're trying to get done. If that's so, try commenting out (or removing) the Exit line from the If loop.

Alright here is the real problem, every I fire an Inetget and run it in the background and then run a different Inetget, it cancels the first and uses the second one. So I need to run many (100s) of Inetgets at once. How do I do this?

[BrewManNH]

Look at the 4th parameter for InetGet, should be fairly simple to figure out how to do it in the background while you run the next one. Also, it's explained fairly well in the help file that this is how to do multiple downloads at the same time.

[Chance]

I made a dll that will use winhttp in threads to make multiple background requests.

I couldn't get it to work with autoit and the winhttp library or wininet either.

the multithreaded dll worked nicely, maybe you can try that.

[uncommon]

I made a dll that will use winhttp in threads to make multiple background requests.

I couldn't get it to work with autoit and the winhttp library or wininet either.

the multithreaded dll worked nicely, maybe you can try that.

I will look into this thanks FlutterShy I was thinking about multithreading.

And thank you BrewManNH I will do more testing on Inetget maybe I need to take a better look at remarks on the Inetget help file.