_INetGetSource coming back with strange characters

[nitekram]

This function does not appear to be returning the correct characters for a site, but the code of the page of the site shows the right characters? Can someone show me how to correct this, or is this a bug in the function? Actually I corrected it in my code, but just replacing these characters, but should they even be part of the string?

Here is the two strange characters:
“
.â€.

 

#include <Inet.au3>
#include <String.au3>

$linc = "http://www.dictionary.com/browse/diablo?s=t"

$str = _INetGetSource($linc, 1)
; has this in it ;“devil.”.
$str = BinaryToString($str)
ConsoleWrite($str)
$str = _StringBetween($str, '<div class="def-set">', '</div>', 1)
MsgBox('', 'raw data', $str[0])

 

[AutoBert]

as you use Inetget with param $BString = True Delete line #7

 

[nitekram]

23 minutes ago, AutoBert said:

as you use Inetget with param $BString = True Delete line #7

 

Sorry that was trying both, the first time I had a 0 in there, as I tried both to remove the special characters that are appearing...

[jchd]

Given that the website explicitely declares that: "charset=utf-8", I'd use "$str = BinaryToString($str, $SB_UTF8)". But then the ConsoleWrite won't display everything as they are (MsgBox will).

[nitekram]

52 minutes ago, jchd said:

Given that the website explicitely declares that: "charset=utf-8", I'd use "$str = BinaryToString($str, $SB_UTF8)". But then the ConsoleWrite won't display everything as they are (MsgBox will).

Thanks, that did the trick.

[AutoBert]

Both works:

• Inetget reading binary:

#include <Inet.au3>
#include <String.au3>

$linc = "http://www.dictionary.com/browse/diablo?s=t"

$str = _INetGetSource($linc, 0)
$str = BinaryToString($str, $SB_UTF8)
FileWrite('Test.txt',$str)
$str = _StringBetween($str, '<div class="def-set">', '</div>', 1)
MsgBox('', 'raw data', $str[0])
ShellExecute('test.txt')

• InetGet reading text: 

  #include <Inet.au3>
  #include <String.au3>
  
  $linc = "http://www.dictionary.com/browse/diablo?s=t"
  
  $str = _INetGetSource($linc, 1)
  FileWrite('Test.txt',$str)
  $str = _StringBetween($str, '<div class="def-set">', '</div>', 1)
  MsgBox('', 'raw data', $str[0])
  ShellExecute('test.txt')

   

 

Edited August 31, 2016 by AutoBert

[nitekram]

1 hour ago, AutoBert said:

Both works:

• Inetget reading binary:

#include <Inet.au3>
#include <String.au3>

$linc = "http://www.dictionary.com/browse/diablo?s=t"

$str = _INetGetSource($linc, 0)
$str = BinaryToString($str, $SB_UTF8)
FileWrite('Test.txt',$str)
$str = _StringBetween($str, '<div class="def-set">', '</div>', 1)
MsgBox('', 'raw data', $str[0])
ShellExecute('test.txt')

• InetGet reading text: 

  #include <Inet.au3>
  #include <String.au3>
  
  $linc = "http://www.dictionary.com/browse/diablo?s=t"
  
  $str = _INetGetSource($linc, 1)
  FileWrite('Test.txt',$str)
  $str = _StringBetween($str, '<div class="def-set">', '</div>', 1)
  MsgBox('', 'raw data', $str[0])
  ShellExecute('test.txt')

   

 

The second one gets the same thing as I stated in the OP - the strange characters.