Find in string not working for me?

[BatMan22]

Hey guys so I have a file with a bunch of data in it that looks like what you see below. I was hoping to delete the lines that don't have the extra information about the ID's I'm working with.. I figured that if I searched backwards, then when there is a match, I could delete the $i line in the array.. But for some reason my search isn't working.

 

Code:

Func CheckForDupsOnlyLookingAtSampleID()
    $sFileName = "\left.txt"
    Local $dumpinthis
    _FileReadToArray($sFileName, $dumpinthis, $FRTA_NOCOUNT)
    _ArrayDisplay($dumpinthis)
    For $i = 0 To UBound($dumpinthis) - 1
        Local $iIndex = _ArraySearch($dumpinthis, $dumpinthis[$i], $i + 1, 0, 0, 0, 1)
        MsgBox(0, 0, $iIndex)
;~      _ArrayDelete($dumpinthis, $i)
    Next

EndFunc   ;==>CheckForDupsOnlyLookingAtSampleID

 

Data in File I'm asking for it to search: 

MB-149289 300.1_W
LCSD-149289 300.1_W
LCS-149289 300.1_W
1711B26-001A 300.1_W <NO3; NO3_1; >
1711A89-006H 300.1_W <Br; Cl; F; NO3; NO3_1; NO2; NO2_1; PO4_1; PO4; SO4; >
1711A89-006H 300.1_W
1711A89-005H 300.1_W <Br; Cl; F; NO3; NO3_1; NO2; NO2_1; PO4_1; PO4; SO4; >
1711A89-005H 300.1_W
1711A89-004H 300.1_W <Br; Cl; F; NO3; NO3_1; NO2; NO2_1; PO4_1; PO4; SO4; >
1711A89-004H 300.1_W
1711A89-003H 300.1_W <Br; Cl; F; NO3; NO3_1; NO2; NO2_1; PO4_1; PO4; SO4; >
1711A89-003H 300.1_W
1711A89-002H 300.1_W <Br; Cl; F; NO3; NO3_1; NO2; NO2_1; PO4_1; PO4; SO4; >
1711A89-002H 300.1_W
1711A89-001H 300.1_W <Br; Cl; F; NO3; NO3_1; NO2; NO2_1; PO4_1; PO4; SO4; >
1711A89-001H 300.1_W
 

What I'm hoping to have after:

MB-149289 300.1_W
LCSD-149289 300.1_W
LCS-149289 300.1_W
1711B26-001A 300.1_W <NO3; NO3_1; >
1711A89-006H 300.1_W <Br; Cl; F; NO3; NO3_1; NO2; NO2_1; PO4_1; PO4; SO4; >
1711A89-005H 300.1_W <Br; Cl; F; NO3; NO3_1; NO2; NO2_1; PO4_1; PO4; SO4; >
1711A89-004H 300.1_W <Br; Cl; F; NO3; NO3_1; NO2; NO2_1; PO4_1; PO4; SO4; >
1711A89-003H 300.1_W <Br; Cl; F; NO3; NO3_1; NO2; NO2_1; PO4_1; PO4; SO4; >
1711A89-002H 300.1_W <Br; Cl; F; NO3; NO3_1; NO2; NO2_1; PO4_1; PO4; SO4; >
1711A89-001H 300.1_W <Br; Cl; F; NO3; NO3_1; NO2; NO2_1; PO4_1; PO4; SO4; >

 

 

Edited November 30, 2017 by BatMan22

[jchd]

That's faster and works, provided the structure of the IDs complies with the pattern I guessed (else adapt the pattern) :

CheckForDupsOnlyLookingAtSampleID()

Func CheckForDupsOnlyLookingAtSampleID()
    $sFileName = "left.txt"
    Local $sText = FileRead($sFileName)
    $sText = StringRegExpReplace($sText, "(?m)^(\w{7}-\w{4} \w{3}\.\w{3})(\s<.*\R)(\g1\R?)", "$1$2")
    ConsoleWrite($sText & @LF)
EndFunc   ;==>CheckForDupsOnlyLookingAtSampleID

 

Edited November 30, 2017 by jchd

[Skysnake]

this is quite an old post, but the theme is recurring. See the 2nd example with the Scripting.dictionary object.

https://www.autoitscript.com/forum/topic/116156-best-way-to-compare-strings-for-duplicates/?do=findComment&comment=810752

also, how about this? Read that file into a SQLite memory db, and use SQL to manipulate?  "Select * from mytable where body like '%~%'" may still be faster...

Skysnake

[iamtheky]

If ends after the first part, and starts with numbers (and not on the first line i suppose since i start with an /r/n)?  are those rules legit?

$str = "MB-149289 300.1_W" & @CRLF & _
"LCSD-149289 300.1_W" & @CRLF & _
"LCS-149289 300.1_W" & @CRLF & _
"1711B26-001A 300.1_W <NO3; NO3_1; >" & @CRLF & _
"1711A89-006H 300.1_W <Br; Cl; F; NO3; NO3_1; NO2; NO2_1; PO4_1; PO4; SO4; >"& @CRLF  & _
"1711A89-006H 300.1_W" & @CRLF & _
"1711A89-005H 300.1_W <Br; Cl; F; NO3; NO3_1; NO2; NO2_1; PO4_1; PO4; SO4; >"& @CRLF  & _
"1711A89-005H 300.1_W" & @CRLF & _
"1711A89-004H 300.1_W <Br; Cl; F; NO3; NO3_1; NO2; NO2_1; PO4_1; PO4; SO4; >" & @CRLF  & _
"1711A89-004H 300.1_W"

msgbox(0, '' , stringregexpreplace($str , "\r\n(\d.*_.)\Z|\r\n(\d.*_.)\r\n" , @CRLF))

 

Edited November 28, 2017 by iamtheky

[mikell]

$str = "MB-149289 300.1_W" & @CRLF & _
"LCSD-149289 300.1_W" & @CRLF & _
"LCS-149289 300.1_W" & @CRLF & _
"1711B26-001A 300.1_W <NO3; NO3_1; >" & @CRLF & _
"1711A89-006H 300.1_W <Br; Cl; F; NO3; NO3_1; NO2; NO2_1; PO4_1; PO4; SO4; >"& @CRLF  & _
"1711A89-006H 300.1_W" & @CRLF & _
"1711A89-006H 300.1_W" & @CRLF & _
"1711A89-006H 300.1_W" & @CRLF & _
"1711A89-005H 300.1_W <Br; Cl; F; NO3; NO3_1; NO2; NO2_1; PO4_1; PO4; SO4; >"& @CRLF  & _
"1711A89-005H 300.1_W" & @CRLF & _
"1711A89-004H 300.1_W <Br; Cl; F; NO3; NO3_1; NO2; NO2_1; PO4_1; PO4; SO4; >" & @CRLF  & _
"1711A89-004H 300.1_W"

msgbox(0, '' , stringregexpreplace($str , '(?m)^([\w-]+\h[\w.]+)\N+\R?\K(\1\R?)*' , ""))

Edited November 28, 2017 by mikell

[BatMan22]

Thanks guys.. I guess the string stuff is the stuff I get stuck with and what I REALLY need to understand..

aka this is magic to me basically:

StringRegExpReplace($sText, "(?m)^(\w{7}-\w{4} \w{3}\.\w{3})(\s<.*\R)(\g1\R?)", "$1$2")

Is there a better tutorial for the string to search for? 

[BatMan22]

On 11/27/2017 at 11:51 PM, jchd said:

That's faster and works, provided the structure of the IDs complies with the pattern I guessed (else adapt the pattern) :

CheckForDupsOnlyLookingAtSampleID()

Func CheckForDupsOnlyLookingAtSampleID()
    $sFileName = "\left.txt"
    Local $sText = FileRead($sFileName)
    $sText = StringRegExpReplace($sText, "(?m)^(\w{7}-\w{4} \w{3}\.\w{3})(\s<.*\R)(\g1\R?)", "$1$2")
    ConsoleWrite($sText & @LF)
EndFunc   ;==>CheckForDupsOnlyLookingAtSampleID

 

Works perfectly. Thanks man.

Edited November 30, 2017 by BatMan22

[jchd]

4 minutes ago, BatMan22 said:

Is there a better tutorial for the string to search for?

A regex workbench https://regex101.com/

AutoIt own StringRegex() help.

[BatMan22]

On 11/28/2017 at 5:20 PM, jchd said:

A regex workbench https://regex101.com/

AutoIt own StringRegex() help.

thanks! you rock!