String/Character Encoding problem

[mLipok]

I have some problems with data which I get from SOAP API webservice.

This data are delivered to me as a result of this kind of code:

Local Static $oHttpRequest = ObjCreate('WinHttp.WinHttpRequest.5.1')
    $oHttpRequest.Open("POST", $sURL, False)
    $oHttpRequest.SetRequestHeader("Content-Type", "application/soap+xml; charset=utf-8")

 

In result I get such kind of data:

Quote

<fiz_formaWlasnosci_Nazwa>WÅASNOÅÄ KRAJOWYCH OSÃB FIZYCZNYCH</fiz_formaWlasnosci_Nazwa>

this is part of XML with HTML Entities, so I made a function to parse HTML Entities 

But.

in result I still have some kind of encoding problems:

Quote

<fiz_formaWlasnosci_Nazwa>WÅASNOÅÄ KRAJOWYCH OSÃB FIZYCZNYCH</fiz_formaWlasnosci_Nazwa>

The problem is that I'm getting for example this : WÅASNOÅÄ
But it should be: WŁASNOŚĆ

This problem is not related to HTML Entities as it exist before parsing.

I was looking on google ... and found for example this:
http://www.aivosto.com/vbtips/control-characters.html

However temporarily I stuck on this problem.

Any help would be appreciated.

mLipok

Edited June 2, 2016 by mLipok

[jchd]

The string you get is UTF-8 encoded, as the

charset=utf-8

header parameter implies. At first look it sounds easy to convert but there's a catch: once you obtain the string as an AutoIt native string variable, it's likely it will be encoded natively, i.e. as UTF-16-LE. Say the string sent is a price like "3€" which is the UTF-8 hex byte sequence 33 E2 82 AC. This may become the hex 16-bit words sequence 0033 00E2 0082 00AC as AutoIt string variable. Then if you just convert the latter string from what you believe is UTF8 to UTF16 the conversion won't make sense. Only the former non-native string of bytes will convert correctly.

First check the actual type (binary or string) and content (StringToAsciiArray) of the received string and code accordingly.
 

[mLipok]

@jchd
Big THANK YOU.

Local $aASCII = StringToASCIIArray($sResultData, 0, StringLen($sResultData), $SE_UTF16)
$sResultData = StringFromASCIIArray($aASCII, 0, -1, $SE_UTF8)
$sResultData = _HTML_DecodeEntities($sResultData)

 

SOLVED

mLipok

 

[jchd]

Unigod bless you!

Edited June 3, 2016 by jchd