>SOLVED> Unicode Problem

[Borje]

I have problem with å ä ö Å Ä Ö  and I use AutoIt ver 3.3.14.1 please see my attaced zip file with file mall.htm..

What I am doing wrong thats works ok with older Autoit ..

expandcollapse popup

; Autoit version 3.3.14.1


$dat = @YEAR & "-" & @MON & "-" & @MDAY & " - " & "  " & @HOUR & ":" & @MIN
$namn = "Unicode problem's"

$Test1 = " Test1 = Å Ä Ö"; should be Test1 = Å Ä Ö

$test2 = "Test2 = å ä ö" ; Should be Test2 = å ä ö

$dag = "Måndag Lördag Söndag" ; Should be Måndag, Lördag Söndag

    $filein = FileOpen("mall.htm", 0)
    $fileout = FileOpen("Result.htm", 2)


    While 1
        $line = FileReadLine($filein)
        If @error = -1 Then ExitLoop
        If StringInStr($line, "%N") Then
            $line1 = StringReplace($line, "%N", $namn)
            FileWriteLine($fileout, $line1)
        ElseIf StringInStr($line, "%Dag") Then
            $line1 = StringReplace($line, "%Dag", $dag)
            FileWriteLine($fileout, $line1)
        ElseIf StringInStr($line, "%Dat") Then
            $line1 = StringReplace($line, "%Dat", $dat)
            FileWriteLine($fileout, $line1)
        ElseIf StringInStr($line, "%Test1") Then
            $line1 = StringReplace($line, "%Test1", $Test1)
            FileWriteLine($fileout, $line1)
        ElseIf StringInStr($line, "%Test2") Then
            $line1 = StringReplace($line, "%Test2", $Test2)
            FileWriteLine($fileout, $line1)
        Else
            FileWriteLine($fileout, $line)
        EndIf
    WEnd
    FileClose($filein)
    FileClose($fileout)

 

AutoIt.zip

Edited April 26, 2021 by Borje

[mLipok]

What should I get ?

Here are my results:

Unicode problem's
ĺ ä ö	Måndag Lördag Söndag 2021-04-26 - 14:15
Ĺ Ä Ö	Test1 = Å Ä Ö
ĺ ä ö	Test2 = å ä ö

Edited April 26, 2021 by mLipok

[Rurorita]

yeah whats wrong?

[Borje]

Have you hanged somhing? The result should be å ä ö and test1 = should be Å Ä Ö and test2 should be åäö, here I have anoter result see file result

Result.htm

[mLipok]

1 minute ago, Borje said:

here I have anoter result see file result

as far as I understand ... I see the same result:

Unicode problem's
å ä ö	Måndag Lördag Söndag 2021-04-26 - 13:09
Å Ä Ö	Test1 = Å Ä Ö
å ä ö	Test2 = å ä ö

Or I miss something ?

[Borje]

What is the problem here then? And why it works good in 3.3.12.0

[mLipok]

In SciTE4Au3 check in menu "FILE / Encoding" ... What you have selected there ?

[mLipok]

5 minutes ago, Borje said:

it works good in 3.3.12.0

3.3.12.x has a different way to check script/file encoding.

try to add this first line:
 

#   " Test1 = Å Ä Ö" ; should be Test1 = Å Ä Ö
#include <FileConstants.au3>
.......

at the top of your script

Edited April 26, 2021 by mLipok

[Borje]

I use Code page property

[mLipok]

Eventually:

Global Const $_DUMMY_FAKE_FIX = " Test1 = Å Ä Ö" ; should be Test1 = Å Ä Ö
#include <FileConstants.au3>
.......

 

Edited April 26, 2021 by mLipok

[mLipok]

Just now, Borje said:

I use Code page property

I use UTF-8

 

[Borje]

Ok I test that

[Borje]

It' same problem

[mLipok]

4 minutes ago, Borje said:

It' same problem

Which one of the proposed soultion you checked ?

[Borje]

Both the dummy and UTF-8

[mLipok]

So we must wait fo more competent helpers, because I give up

[Trong]

I don't think the problem is in AutoIT version, try the following script:

expandcollapse popup

Global $dat = @YEAR & "-" & @MON & "-" & @MDAY & " - " & "  " & @HOUR & ":" & @MIN
Global $namn = "Unicode problem's"

Global $Test1 = " Test1 = Å Ä Ö" ; should be Test1 = Å Ä Ö

Global $test2 = "Test2 = å ä ö" ; Should be Test2 = å ä ö

Global $dag = "Måndag Lördag Söndag" ; Should be Måndag, Lördag Söndag

Global $sInputFile = @ScriptDir & "\Mall.htm"
Global $sOutputFile = @ScriptDir & "\Result.htm"
_Write_Example_HTML($sInputFile)  ; Write the example file!

Global $hFileIN = FileOpen($sInputFile, 0 + 16384) ;  $FO_FULLFILE_DETECT (16384)
Global $hFileOUT = FileOpen($sOutputFile, 2 + 16384) ; $FO_OVERWRITE (2)


While 1
    Local $line = FileReadLine($hFileIN)
    If @error = -1 Then ExitLoop
    If StringInStr($line, "%N") Then
        $line1 = StringReplace($line, "%N", $namn)
        FileWriteLine($hFileOUT, $line1)
    ElseIf StringInStr($line, "%Dag") Then
        $line1 = StringReplace($line, "%Dag", $dag)
        FileWriteLine($hFileOUT, $line1)
    ElseIf StringInStr($line, "%Dat") Then
        $line1 = StringReplace($line, "%Dat", $dat)
        FileWriteLine($hFileOUT, $line1)
    ElseIf StringInStr($line, "%Test1") Then
        $line1 = StringReplace($line, "%Test1", $Test1)
        FileWriteLine($hFileOUT, $line1)
    ElseIf StringInStr($line, "%Test2") Then
        $line1 = StringReplace($line, "%Test2", $test2)
        FileWriteLine($hFileOUT, $line1)
    Else
        FileWriteLine($hFileOUT, $line)
    EndIf
WEnd
FileClose($hFileIN)
FileClose($hFileOUT)
ShellExecute($sInputFile)
ShellExecute($sOutputFile)
ConsoleWrite("- FileGetEncoding   Input File: " & $sInputFile & @CRLF & '->' & _FileGetEncoding($sInputFile) & @CRLF)
ConsoleWrite("- FileGetEncoding  Output File: " & $sOutputFile & @CRLF & '->' & _FileGetEncoding($sOutputFile) & @CRLF)

Func _Write_Example_HTML($inputFilePath = "eg.htm")
    Local $iHTMLcontent = '<!DOCTYPE html>' & @CRLF & '<html>' & @CRLF & '<head>' & @CRLF & '<meta charset="UTF-8">' & @CRLF & '<title></title>' & @CRLF & '</head>' & @CRLF & '<table cellpadding=5 cellspacing=5 border=2 bordercolor=#666666 bgcolor="#C0C0C0">' & @CRLF & '<tr>' & @CRLF & '<td align=center colspan="2" bgcolor="#33CCCC">' & @CRLF & '<b>' & @CRLF & '<font size="5">%N</font><br>' & @CRLF & '<font color=#000080</font>' & @CRLF & '</b>' & @CRLF & '</td>' & @CRLF & '</tr>' & @CRLF & '<tr>' & @CRLF & '<td align=center bgcolor="#E41B17">' & @CRLF & '<b><font size="3" color="#FFFFFF">  å ä ö</font><br>' & @CRLF & '<b><font size="3" color="#FFFFFF"></font></b>' & @CRLF & '</td>' & @CRLF & '<td align=center bgcolor="#E41B17">' & @CRLF & '<b><font size="3" color="#FFFFFF"' & @CRLF & '<font color="#FFFFFF">%Dag</font><br>' & @CRLF & '<font color="#FFFFFF">%Dat</font>' & @CRLF & '</td>' & @CRLF & '</tr>' & @CRLF & '<tr>' & @CRLF & '<td align=right bgcolor="#33CCCC"color="#FFFFFF">Å Ä Ö</td>' & @CRLF & '<td align=left bgcolor="#33CCCC">' & @CRLF & '<font color="#000000">%Test1</font>' & @CRLF & '</tr>' & @CRLF & '<tr>' & @CRLF & '<td align=right bgcolor="#33CCCC">å ä ö</td>' & @CRLF & '<td align=left bgcolor="#33CCCC">' & @CRLF & '<font color="#000000">%Test2</font>' & @CRLF & '</tr>' & @CRLF & '<tr>' & @CRLF & '</table>' & @CRLF & '</body>' & @CRLF & '</html>'
    Local $hOpen = FileOpen($inputFilePath, 2 + 16384) ;  $FO_FULLFILE_DETECT (16384)  ; $FO_OVERWRITE (2)
    FileWrite($hOpen, $iHTMLcontent)
    Return (FileExists($inputFilePath) And FileClose($hOpen) > 0)
EndFunc   ;==>_Write_Example_HTML

Func _FileGetEncoding($iFile)
    Local $Encoding = FileGetEncoding($iFile)
    If ($Encoding = 32) Or ($Encoding = 1024) Then Return "[32] UTF16 Little Endian"
    If ($Encoding = 64) Or ($Encoding = 2048) Then Return "[64] UTF16 Big Endian."
    If ($Encoding = 128) Then Return "[128] UTF8 (with BOM)."
    If ($Encoding = 256) Then Return "[256] UTF8 (without BOM)."
    Return "[512] ANSI"
EndFunc   ;==>_FileGetEncoding

 

[mLipok]

I'm still not sure where the problem is.

Show proper and incorrect results.

[Jos]

The Result.htm file is missing in the zip so there is no way to verify what you get and compare that.
Please supply a complete set of files and also so me the Console Output of SciTE when you run your script.

Jos

[Trong]

24 minutes ago, Jos said:

The Result.htm file is missing in the zip so there is no way to verify what you get and compare that.
Please supply a complete set of files and also so me the Console Output of SciTE when you run your script.

Jos

Result.htm is a new file to be burned, not an existing file!