Restore garbled symbols in HTML

[Iczer]

I try to restore some garbled UTF-8 symbols in HTML. Originally it was UTF-8 encoding, but it seems transfer or save with local 1-byte encoding broken some non-ANSI symbols.

It should be possible to restore it with script - at least online services successfully do it.

#include <String.au3>
#include <FileConstants.au3>

$Cont = 0
$hAC = FileOpen("C:\Temp\ERRtext.htm", $FO_UTF8)
$sHTMLSourceCode =  FileRead($hAC)
                    FileClose($hAC)

$SymbolRaw = ""
$aSymbol = StringSplit($sHTMLSourceCode,"")

For $i = 0 To UBound($aSymbol)-1
    
    $Symbol = AscW( $aSymbol[$i])
    If $Symbol > 127 Then
        if $Cont Then
            ConsoleWrite("," & $Symbol)
            $SymbolRaw &=  $aSymbol[$i]
        Else
            $SymbolRaw &=  $aSymbol[$i]
            ConsoleWrite("> : " & $Symbol)
        EndIf
        $Cont = 1
    Else
        if $Cont Then
            ConsoleWrite(@TAB & " : {" & $SymbolRaw & "} : " & _StringToHex ( $SymbolRaw ) & @CRLF)
        EndIf
        
        $SymbolRaw = ""
        $Cont = 0
    EndIf
    
Next
ConsoleWrite(@CRLF & @CRLF & @CRLF)

Output:

> : 1074,1026,8482   : {’} : D0B2D082E284A2; --> ;&#8217
> : 1043,169         : {Г©}  : D093C2A9;       --> ;&#233
> : 1043,169         : {Г©}  : D093C2A9;       --> ;&#233
> : 1074,1026,8482   : {’} : D0B2D082E284A2; --> ;&#8217
> : 1074,1026,8482   : {’} : D0B2D082E284A2; --> ;&#8217
> : 1074,1026,8482   : {’} : D0B2D082E284A2; --> ;&#8217
> : 1074,8482,1026   : {в™Ђ} : D0B2E284A2D082; --> ;&#9792

Combinations can be replaced as symbols I deducted just by learning , but I wanted script to decode symbols algorithmic.

Maybe there a some sources to read about text restoring...

 

 

[jchd]

Post offending source file.