stringsplit using comma but with additional options

[bobsyuruncle]

Dim $oneDarray
$oneDarray=StringSplit($Rawfile, @CRLF, 1)
$columnsCounter = stringsplit($oneDarray[2],",")
     GUICtrlSetData ( $Output,"*Group columns Detected from csv:"& $columnsCounter[0] &@CRLF, @CR)
     ConsoleWrite("*Group columns Detected from csv:"& $columnsCounter[0] &@CRLF)
Dim $twoDarray[$oneDarray[0] + 1][$columnsCounter[0] + 1]
For $x = 1 to ($oneDarray[0])
$oneRow = stringsplit($oneDarray[$x],",")
For $y = 1 to ($oneRow[0])
   $twoDarray[$x][$y] = $oneRow[$y]
Next
Next


Log Output
Array variable has incorrect number of subscripts or subscript dimension range exceeded.:
$twoDarray[$x][$y] = $oneRow[$y]
^ ERROR

So I have a csv file that I'm breaking up to do string parsing for information from and I've run into a problem I'm not sure how to solve.

In the code shown above I am creating the master 2d array that holds all the values from the csv. The problem the code runs into starts on this line: $oneRow = stringsplit($oneDarray[$x],",")

It worked great until I ran into a csv file that had commas in a txt field that were not related to the csv format.. example:

"this is some text, and some more text", filedir, ipaddress, hostname,mmmbeer

as CSV format this is 5 fields, however the stringsplit counts the comma in the text and identifies this as 6 fields.

Any ideas how I can somehow not include the comma in quotes in stringsplit?

Thanks,

Bob

Edited August 15, 2013 by bobsyuruncle

[Edano]

yes. isolate the commas in quotes (with stringinstr and/or stringsplit) and replace them with something exotic like "§#". after splitting replace the commas back.

E.

Edited August 15, 2013 by Edano

[mikell]

If the string with the comma inside is effectively quoted, this should work

#include <Array.au3>
$str = '"this is some text, and some more text", filedir, ipaddress, hostname,mmmbeer'
$res = StringRegExp($str, '[^,"]+|("[^"]*"\h*)', 3)
_ArrayDisplay($res)

Edited August 15, 2013 by mikell

[Edano]

ha i knew there comes a regex, as soon as i am ready with my version

.

$y=stringsplit($oneDarray[$x],'"')
If $y[0]>1 Then
    $oneDarray[$x]=$y[1]
    For $i=2 To $y[0] Step 2
        $oneDarray[$x]&='"'&StringReplace($y[$i],",","§#")&'"'&$y[$i+1]
    Next
EndIf

.

E.

Edit: take mikell's, can't beat it

Edited August 15, 2013 by Edano

[bobsyuruncle]

Thanks for the tips gents.

Both solutions should work fine for anybody, but I'm going to mark mikell for solved. I've never worked with regex but I can see now I should spend some time with it for this kind of project.

[Edano]

regex sure is way cooler, but if you don't understand it, it's a risk. you will never be able to tackle errors or to change the syntax. just to consider.

[LWC]

Your way doesn't support empty fields (e.g. "like,,,,this").

Here's a regexp code that does (change '[^,\"]+| to '[^,\s"]+| if you want spaces as delimiters too).

On 15.8.2013 at 6:13 AM, mikell said:

If the string with the comma inside is effectively quoted, this should work

#include <Array.au3>
$str = '"this is some text, and some more text", filedir, ipaddress, hostname,mmmbeer'
$res = StringRegExp($str, '[^,"]+|("[^"]*"\h*)', 3)
_ArrayDisplay($res)

 

Edited April 11, 2017 by LWC
Note about spaces

[guinness]

2 years too late. Please don't bring up old threads in the future. Thank you.