Compare and get the difference/add

[Terenz]

Hello,

I'll explain. I'm donwloading a very big CSV, not in size (is less than 500kb) but has many lines (5000+)

I'll take this CSV and convert to a multidimensional array, and this operation require some time. Pratically the link is static, so thay never change, and this CSV is updated often. The value are in order, so the last added are from line 1 (line 0 is the column)

Since i don't what to re-create the array from zero every time, how i can get only the difference from the CSV/Array in memory and the "new" CSV", and the put the difference inside the array?

Thanks

Edited March 22, 2020 by Terenz

[FrancescoDiMuro]

@Terenz

Did you consider to use SQLite to store the CSV file content?

Could you describe more the end goal?

[Nine]

I think I understand your issue.  You have small (it is not big at 500kb) .csv file. You want to add the new rows into a container (could be an array), which come after the old rows.  So currently you are grabbing all rows every time to skip old ones, until you find new rows. Right ?  You are currently using FileReadtoArray ?

If all my assumptions are true, there are easy ways to increase speed.  But you will have to provide your current script, along with some example of the csv files...