cURL command line - unicode and options combination

[Iczer]

trying to make some download tool, but have 2 issues with curl.exe:

1. If I set user custom agent header, curl do not process "' --remote-name --remote-header-name '" settings. Otherwise downloaded file get proper name (from server).

2. If I try download file, which have unicode letters in FileName, download goes OK, but file on disk would have broken unicode letters in FileName ()

expandcollapse popup

#include <WinAPI.au3>

$sDownloadUrl = "https://www.autoitscript.com/forum/applications/core/interface/file/attachment.php?id=51443"; eng filename
;$sDownloadUrl = "https://www.autoitscript.com/forum/applications/core/interface/file/attachment.php?id=51442"; unicode filename

$sPath = @TempDir
$sFileName = ""

cURL_CLI_Download($sDownloadUrl, $sPath, $sFileName)


Func cURL_CLI_Download($sDownloadUrl = "", $sPath = "", $sFileName = "")

    $sDownloadUrl = _WinAPI_WideCharToMultiByte($sDownloadUrl, 65001, True )
    $sFileName = _WinAPI_WideCharToMultiByte($sFileName, 65001, True )

    Local $aURI = StringRegExp($sDownloadUrl,'^(([^:/?#]+):)?(//([^/?#]*))?([^?#]*)(\?([^#]*))?(#(.*))?',3), $code = ""

    $code &= ' --header "User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0" '
    $code &= ' --header "Referer: ' & $aURI[0] & $aURI[2] & '" '
    $code &= ' --header "Accept-Charset: utf-8" '

    If $sFileName == "" Then
        $code &= ' --remote-name --remote-header-name '
    Else
        $code &= ' --output "' & $sFileName & '" '
    EndIf

    $code &= '--location '
    $code &= '--connect-timeout "88" '

    $code &= '"'&$sDownloadUrl&'" '

    ;$code = 'curl --help'

    If Not ($sPath == "") Then
        If Not FileExists($sPath) Then DirCreate($sPath)
        ;FileChangeDir($sPath)
    EndIf

    ConsoleWrite($code & @CRLF)
    ConsoleWrite(@ScriptDir & "\curl.exe" & @CRLF)

    $iPID = Run(@ScriptDir & "\curl.exe --trace-ascii - " & $code, $sPath, @SW_HIDE,$STDERR_MERGED)

    ProcessWaitClose($iPID)
    $sOutput = StdoutRead($iPID)
    StdioClose($iPID)

    ConsoleWrite("$sOutput = "&$sOutput & @CRLF)
EndFunc

Is there a something wrong with my approach to curl.exe?

いくつかのファイル名.txt

Some File Name.txt

Edited June 19, 2016 by Iczer

[jchd]

You can't pass UTF8 strings to console programs unless the default charset for console is 65001.

[Iczer]

is there a fast way to change default charset for console back and forth? if not, punicode is only way?

 

[jchd]

Look here :

 

[Iczer]

thanks!

interesting, if i set user-agent like:

$code &= ' --user-agent "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/"'
$code &= ' --user-agent "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/dlfjldfkjdf"'
$code &= ' --user-agent "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/ 40.0"'

downloaded file is written to disk, but

$code &= ' --user-agent "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/*any digit*"'

then file is not created

is there a some way to escape characters (digits or slashes) in curl so firefox user agent can be used?