cURL UDF - a UDF for transferring data with URL syntax

[seangriffin]

Greetings everyone,

 

I'd like to start my own cURL UDF, with a focus on a nice and simple syntax. There are many other cURL samples in the forum, though I found them too difficult to understand and use.

 

This UDF uses the libcurl library, as opposed to the cURL command-line tool, to provide better integration with AutoIT and better performance.

 

REQUIREMENTS:

• Windows 32-bit (not tested under Windows 64-bit but may work if a 64-bit version of libcurl below is used)
• AutoIt3 3.2 or higher
• libcurl v7.21.7 or higher (libcurl.dll, libeay32.dll & libssl32.dll) - see http://curl.haxx.se or download link below

LIST OF FUNCTIONS:

 

Quote

 

cURL_initialise()

cURL_easy($url, $cookie_file = "", $cookie_action = 0, $output_type = 0, $output_file = "", $request_headers = "", $request_data = "", $ssl_verifypeer = 0, $noprogress = 1, $followlocation = 0)

cURL_cleanup()

 

 

 

 

EXAMPLES:

 

Note - To make these examples work, you must make sure the three libcurl DLLs (libcurl.dll, libeay32.dll & libssl32.dll) are present in the same folder as the examples.

 

Example #1 - Reading HTML from a webpage.

 

 

#include <cURL.au3>

; Initialise cURL
cURL_initialise()

; Return the HTML from "http://www.autoitscript.com/site"
$response = cURL_easy("http://www.autoitscript.com/site/")

; Output the response to the console
ConsoleWrite("HTTP Response Code = " & $response[0] & @CRLF)
ConsoleWrite("HTTP Response Headers = " & $response[1] & @CRLF)
ConsoleWrite("HTTP Response Data = " & $response[2] & @CRLF)

; Clean up cURL
cURL_cleanup()

 

Example #2 - Reading a binary file from a website.

 

 

#include <cURL.au3>

; Initialise cURL
cURL_initialise()

; Output the file from "http://web.aanet.com.au/seangriffin/content/computing/development/eBay%20Bargain%20Hunter%20setup.exe" to "tmp.exe"
cURL_easy("http://web.aanet.com.au/seangriffin/content/computing/development/eBay%20Bargain%20Hunter%20setup.exe", "", 0, 1, "tmp.exe")

; Clean up cURL
cURL_cleanup()

 

Example #3 - Reading HTML from a webpage, and writing the cookie to a file.

 

 

#include <cURL.au3>

; Initialise cURL
cURL_initialise()

; Return the response from "http://www.about.com", and the cookie to the file "cookie.txt"
$response = cURL_easy("http://www.about.com", "cookie.txt", 2)

; Output the response to the console
ConsoleWrite("HTTP Response Code = " & $response[0] & @CRLF)
ConsoleWrite("HTTP Response Headers = " & $response[1] & @CRLF)
ConsoleWrite("HTTP Response Data = " & $response[2] & @CRLF)

; Clean up cURL
cURL_cleanup()

 

DOWNLOAD:

 

Recent Version of libcurl.dll, libeay32.dll & libssl32.dll (required)

http://fossies.org/windows/www/curl-7.24.0-ssl-sspi-zlib-static-bin-w32.zip

 

Latest Version - v0.3 (03/04/16)

cURL.au3

Edited April 3, 2016 by seangriffin

[matwachich]

Can you provide us direct link the the dlls??? Thanks

[seangriffin]

Can you provide us direct link the the dlls??? Thanks

Hi matwachich,

Good idea. I've included both a link to the libcurl author's site (http://curl.haxx.se), and a direct link to a recent copy of the libcurl DLLs, in my post at the top.

Cheers,

Sean

Edited February 12, 2012 by seangriffin

[guinness]

A great UDF, thanks Sean.

[JohnOne]

Indee is a good idea, although I cannot get the example to work .

! couldn't connect to host

! couldn't connect to host

! couldn't connect to host

! couldn't connect to host

I added the dlls to firewall exceptions.

[matwachich]

Try This

#include <cURL.au3>
; Initialise cURL
cURL_initialise()
; Connect and get index page
$out = cURL_easy("cookie.txt", "http://www.autoitscript.com/", "")
; output the HTTP response to the console
ConsoleWrite($out)
; Clean up cURL
cURL_cleanup()

@seangriffin: you should have provided a simple example

[guinness]

@seangriffin: you should have provided a simple example

He did, see original post.

[matwachich]

i said: simple!

As i can see, the example provided connects to "Jazz" on socket 9443, i don't even know what is this program

I meant that he should have provided a simple example, that will work for every body, even who don't have this Jazz

[JohnOne]

My own fault I should have looked at where it was trying to connect.

Cheers for example, works perfectly.

Thanks seangriffin, I used a lot of you UDFs.

[matwachich]

I tried a url to a binary data (a file on my webserver) and it don't work!

A solution???

Thanx!

[seangriffin]

Try This

#include <cURL.au3>
; Initialise cURL
cURL_initialise()
; Connect and get index page
$out = cURL_easy("cookie.txt", "http://www.autoitscript.com/", "")
; output the HTTP response to the console
ConsoleWrite($out)
; Clean up cURL
cURL_cleanup()

@seangriffin: you should have provided a simple example

Great suggestion matwachich,

Have replaced my example in the post at the top.

Cheers,

Sean.

Edited February 13, 2012 by seangriffin

[seangriffin]

i said: simple!

As i can see, the example provided connects to "Jazz" on socket 9443, i don't even know what is this program

I meant that he should have provided a simple example, that will work for every body, even who don't have this Jazz

Sorry for that poor example - I've removed it. It would only work on my computer anyway if a product named "Rational Quality Manager" installed. I developed the UDF to allow me to use cURL with that product's API.

[seangriffin]

I tried a url to a binary data (a file on my webserver) and it don't work!

A solution???

Thanx!

Hi matwachich,

My fault. I put a "BinaryToString" call in the UDF to convert all output back to text. I overlooked the case where users might actually want a binary output. I will probably add another parameter to specify output type, and default it to text (because I think that will be the popular option).

You've made me realise I should add more features though. Like file input and output.

I guess cURL does a hell of alot. I've only just scratched the service.

I'll come up with a new version with a text / binary option, and file input and output at least. Hope to have it ready soon.

Cheers,

Sean.

Edited February 13, 2012 by seangriffin

[seangriffin]

Version 0.2 is now available for download.

Changes include:

• Made $url the first parameter for cURL_easy().
• Replaced all cookie parameters with $cookie_action and $cookie_file.
• Added $output_type and $output_file parameters.

No input file support yet for HTTP requests, only output file.

[saik0]

Great work! Do you have any plans on adding parsed progress data in the near future?

[PPCC]

Error message, please help:

>Running:(3.3.8.0):C:Program FilesAutoIt3autoit3.exe "D:cURL - Example 1.au3"    
D:cURL.au3 (112) : ==> Subscript used with non-Array variable.:
$hCurlHandle = $hCurlHandle[0]
$hCurlHandle = $hCurlHandle^ ERROR
->10:27:47 AutoIT3.exe ended.rc:1
>Exit code: 1   Time: 1.655

[ViRnik]

Error message, please help:

>Running:(3.3.8.0):C:Program FilesAutoIt3autoit3.exe "D:cURL - Example 1.au3"   
D:cURL.au3 (112) : ==> Subscript used with non-Array variable.:
$hCurlHandle = $hCurlHandle[0]
$hCurlHandle = $hCurlHandle^ ERROR
->10:27:47 AutoIT3.exe ended.rc:1
>Exit code: 1   Time: 1.655

got same problem.

EDIT: was reading other examples and find that:

Dlls are 32bit. That means you have to run 32bit AutoIt when using them.

BTW is there any way to get content from a site that generate it from JS?

Edited March 5, 2012 by ViRnik

[Taek]

With cURL in linux you are able to poll a website for it's html output content, so anything displayed in the html will get pulled down if the UDF has the right functions for it.

got same problem.

EDIT: was reading other examples and find that:

Dlls are 32bit. That means you have to run 32bit AutoIt when using them.

BTW is there any way to get content from a site that generate it from JS?

[smartee]

hi Sean,

Nice, an easy to use function , libcurl usage usually tends to become technical.

Do you have plans to make this into a full fledged libcurl wrapper UDF?

If so, I have wrapped quite a bit of libcurl's dll functions (at one time or the other), I'm sure I can lend a hand, or maybe I should whip them into the UDF standards and make a new thread for a libcurl UDF

Regards,

smartee

[seangriffin]

hi Sean,

Nice, an easy to use function , libcurl usage usually tends to become technical.

Do you have plans to make this into a full fledged libcurl wrapper UDF?

If so, I have wrapped quite a bit of libcurl's dll functions (at one time or the other), I'm sure I can lend a hand, or maybe I should whip them into the UDF standards and make a new thread for a libcurl UDF

Regards,

smartee

Hi smartee,

I would love to get your input yes. I have limited time on UDF work these days and only started this one because I had a great need for it at work. But because I'm using it each day I'm happy to spend time on it.

Something I do urgently need in the UDF is multi mode support. It currently only supports easy mode, and as I'm finding easy mode is blocking certain activities in Windows 32-bit when it runs, and slows my computer such that I can't get much work done. Apparently multi mode fixes this. Do you have any solution for multi mode? Maybe we can split the UDF into two modes.