Whitespace characters showing when accessing a Table using _WD_GetTable

[dgendrud]

I have these extra WS characters in the array returned by  _WD_GetTable, but just want the headings and table data so I can write to a spreadsheet.  I have had no success accessing the table by other methods to return just the headings and data.  While searching for solutions  I recently found a post illustrating the _HtmlTableGetWriteToArray($sHTML) UDF, and I'm just about to try that approach.  I would just like some feedback on whether I am using the _WD_GetTable correctly, and whether using the _HtmlTableGetWriteToArray($sHTML) UDF would be the preferred approach.

Thanks

Doug

 

TableAccessTesting.au3 Console.docx

[Nine]

Not sure that it will help you using _HtmlTableGetWriteToArray, but you can solve your issue with something like this :

#include <Array.au3>

Local $aArray1[2][2], $aArray2[0][2]

For $i = 0 to 1
  for $j = 0 to 1
    $aArray1[$i][$j] = "\n\tA\t"
  Next
Next
_ArrayDisplay($aArray1)

_ArrayAdd($aArray2, StringRegExpReplace(_ArrayToString($aArray1), "(?|\\n|\\t)", ""))
_ArrayDisplay($aArray2)

 

[Danp2]

Can you provide the HTML associated with this table?

Also, there is a newer release of the Webdriver UDF. It likely won't fix this issue; in fact, there's a script breaking change related to _WD_GetTable. However, it will ease the support load if you are running the current version.

[dgendrud]

OK Thanks,

I will transition to the latest Webdriver UDF.  Attached is a screenshot of the table HTML.  I pulled up the table in Firefox and viewed the html for the table that I am trying to access.  All the tables I need to access are of the same format.  I could not find a way that worked to download the HTML into a file, so I did a screenshot of the HTML.  Hope you can view the file, or advise a better way to submit it.

I have been trying to access the table using _WD_FindElement, but it will only access the first row of column headers into an array.  Now going back to try to use _WD_GetTable again, as that got me the entire table but had the \n and \t elements that I may have to edit out.

Doug

 

 

Screenshot 2024-08-31 at 15-55-19 DOM Source of Selection - Shortcut.lnk

[Danp2]

A screenshot of the HTML doesn't work; a need it in text format to analyze the conversion process. You should be able to grab it directly in the browser.

[dgendrud]

OK, from Firefox browser saved as a text file attached

 

DOM Source of Selection.txt

[Danp2]

I looked into this for you, and here's what I found --

_WD_GetTable currently uses this Javascript code to retrieve the table as a string --

Local $sScript = "return [...arguments[0].querySelectorAll(arguments[1])]" & _
                ".map(row => [...row.querySelectorAll(arguments[2])]" & _
                ".map(cell => cell.textContent));"

and cell.textContent returns the formatted text within each cell. Changing this to cell.innerText appears to give the desired results, but IDK if this will have a negative affect for anyone else.

[dgendrud]

OK, Thank you for the quick response!

I'm in the process of transitioning to the latest UDF update - v1.3.1 2024-02-19.  How difficult would it be for me to make the change to cell.innerText on my system here?  I don't know where this javascript code resides at this point.

 

 

 

[Danp2]

Look inside the _WD_GetTable in wd_helper.au3.

[mLipok]

4 hours ago, Danp2 said:

Changing this to cell.innerText appears to give the desired results, but IDK if this will have a negative affect for anyone else.

When spaces were mentioned, I remembered that something in this regard was already done or discussed.

And when you mentioned using "cell.innerText" instead of "cell.textContent" it reminds me of something and I know it was important somehow.
I'm looking into it more closely.

[mLipok]

found this:

https://github.com/Danp2/au3WebDriver/issues/486

 

[mLipok]

btw.

cell.innerText

and 

cell.textContent

gives different results when cell content contains double spaces next to each other.

 

[Danp2]

@mLipok Thanks for checking, but I don't see how that PR is relevant to this discussion. Can you elaborate?

Can you show a real world example where using cell.textContext will not give the desired result. I created a new PR for this change, so we can discuss there if you prefer.

[dgendrud]

Many thanks for fantastic support!

Now running on latest WebDriver UDF with cell.innerText modification.  _WD_GetTable is working for me.  Screenshot of returned array of table attached.

Doug

 

[Danp2]

19 hours ago, dgendrud said:

Now running on latest WebDriver UDF with cell.innerText modification

I think the better solution is to use cell.textContent.trim(), which will remove any leading and trailing formatting.

[bdr529]

On 9/1/2024 at 4:24 PM, Danp2 said:

Changing this to cell.innerText appears to give the desired results

 

I beg your pardon for my very poor english
I use google translate

 wonderful solution !
p.s.
Could the function be changed?
 

Func _WD_GetTable($sSession, $sStrategy, $sSelector, $sRowsSelector = Default, $sColsSelector = Default,$mapp_cell_type="innerText")

     

 Local $sScript = "return [...arguments[0].querySelectorAll(arguments[1])]" & _
                ".map(row => [...row.querySelectorAll(arguments[2])]" & _
                ".map(cell => cell."&$mapp_cell_type&"));"

 

[Danp2]

33 minutes ago, bdr529 said:

Could the function be changed?

Well, I believe that I came up with a better solution. You can test it by changing the line --

".map(cell => cell.textContent));"

to

".map(cell => cell.textContent.trim()));"