WebDriver UDF - Help & Support (III)

[Danp2]

32 minutes ago, CodeWriter said:

I've tried the binary path route for Firefox but no love. I'd be happy to post you the details and error logs when the binary path is added

Please do.

Quote

Yes. _WD_NewTab() works as expected when loading Edge without a profile. With a profile, it doesn't work

I'll try to duplicate here.

Quote

Here is the error code it generates

Technically, there aren't any generated errors. The click just doesn't occur (or perhaps occurs in the wrong location).

Quote

alphabetize the function definitions.

As soon as I do that, someone will want it back in the original order. 🤣 You could always use Scite Jump, which has an option to sort the function names. Or you could simply use the editor's search function to locate the desired function.

[CodeWriter]

Editing the Firefox setup function in wd_demo.au3 with the following capabilities string that includes the binary path and profile path:
 

Func SetupGecko()
 _WD_Option('Driver', 'geckodriver.exe')
 _WD_Option('DriverParams', '--log trace')
 _WD_Option('Port', 4444)


;~ $sDesiredCapabilities = '{"capabilities": {"alwaysMatch": {"browserName": "firefox", "acceptInsecureCerts":true}}}'
 $sDesiredCapabilities = '{"capabilities": {"alwaysMatch": {"moz:firefoxOptions": {"binary": "C:/Program Files/Mozilla Firefox/firefox.exe", "args": ["-profile", "C:/Users/MyName/AppData/Roaming/Mozilla/Firefox"]},"browserName": "firefox", "acceptInsecureCerts":true}}}'
 
EndFunc   ;==>SetupGecko

Yields this error output:

_WD_IsLatestRelease: True
_WD_IsLatestRelease ==> Success
_WD_Startup: OS:    WIN_10 WIN32_NT 19041 
_WD_Startup: AutoIt:    3.3.14.5
_WD_Startup: WD.au3:    0.4.0.3 (Up to date)
_WD_Startup: WinHTTP:   1.6.4.2
_WD_Startup: Driver:    geckodriver.exe
_WD_Startup: Params:    --log trace
_WD_Startup: Port:  4444
__WD_Post: URL=HTTP://xxx.x.x.x:xxx/session; $sData={"capabilities": {"alwaysMatch": {"moz:firefoxOptions": {"binary": "C:/Program Files/Mozilla Firefox/firefox.exe", "args": ["-profile", "C:/Users/MyName/AppData/Roaming/Mozilla/Firefox"]},"browserName": "firefox", "acceptInsecureCerts":true}}}
__WD_Post: StatusCode=0; ResponseText=WinHTTP request timed out before Webdriver...
__WD_Post ==> Send / Recv error: WinHTTP request timed out before Webdriver
_WD_CreateSession: WinHTTP request timed out before Webdriver
_WD_CreateSession ==> Webdriver Exception: HTTP status = 0
__WD_Delete: URL=HTTP://xxx.x.x.x:xxx/session/
__WD_Delete: StatusCode=405; ResponseText=HTTP method not allowed...
_WD_DeleteSession: HTTP method not allowed
+>19:04:30 AutoIt3.exe ended.rc:0
+>19:04:30 AutoIt3Wrapper Finished.
>Exit code: 0    Time: 71.25

 

Edited April 30, 2021 by CodeWriter

[Danp2]

@CodeWriter I can only replicate that behavior if I provide an invalid path to the Firefox executable. When that occurs, I get this in the geckodriver console --

1619748790295   geckodriver     INFO    Listening on 127.0.0.1:4444
1619748790639   webdriver::server       DEBUG   -> POST /session {"capabilities": {"alwaysMatch": {"moz:firefoxOptions": {"binary": "C:/Program Files/Mozilla Firefoxx/firefox.exe"},"browserName": "firefox", "acceptInsecureCerts":true}}}
1619748790639   geckodriver::capabilities       DEBUG   Trying to read firefox version from ini files
1619748790639   geckodriver::capabilities       DEBUG   Trying to read firefox version from binary
1619748790640   geckodriver::capabilities       DEBUG   Failed to get binary version
1619748790640   webdriver::server       DEBUG   <- 400 Bad Request {"value":{"error":"invalid argument","message":"binary is not a Firefox executable","stacktrace":""}}

Are you sure that your path is correct?

[CodeWriter]

Here is the method shown in the Wiki that uses a function to find the correct path to the profile and it doesn't work either: a Firefox window appears but the wd_demo.au3 script doesn't run or executes any WebDriver UDF functions.  Interestingly, if I use a capability string that has the binary path but no profile settings, Firefox will load. It's similar to the MS Edge situation in that it functions without a profile but load the driver with a profile and things grind to a halt.

Func GetDefaultFFProfile()
    Local $sDefault, $sProfilePath = ''

    Local $sProfilesPath = StringReplace(@AppDataDir, '\', '/') & "/Mozilla/Firefox/"
    Local $sFilename = $sProfilesPath & "profiles.ini"
    Local $aSections = IniReadSectionNames($sFilename)

    If Not @error Then
        For $i = 1 To $aSections[0]
            $sDefault = IniRead($sFilename, $aSections[$i], 'Default', '0')

            If $sDefault = '1' Then
                $sProfilePath = $sProfilesPath & IniRead($sFilename, $aSections[$i], "Path", "")
                ExitLoop
            EndIf
        Next
    EndIf
    Return $sProfilePath
EndFunc   ;==>GetDefaultFFProfile

Func SetupGecko()
    _WD_Option('Driver', 'geckodriver.exe')
    _WD_Option('DriverParams', '--log trace')
    _WD_Option('Port', 4444)

;~ $sDesiredCapabilities = '{"capabilities": {"alwaysMatch": {"browserName": "firefox", "acceptInsecureCerts":true}}}'
    $sDesiredCapabilities = '{"capabilities": {"alwaysMatch": {"moz:firefoxOptions": {"binary": "C:/Program Files/Mozilla Firefox/firefox.exe", "args": ["-profile", "' & GetDefaultFFProfile() & '"]}}}}'
EndFunc   ;==>SetupGecko

And the resulting console/error report:

_WD_IsLatestRelease: True
_WD_IsLatestRelease ==> Success
_WD_Startup: OS:    WIN_10 WIN32_NT 19041 
_WD_Startup: AutoIt:    3.3.14.5
_WD_Startup: WD.au3:    0.4.0.3 (Up to date)
_WD_Startup: WinHTTP:   1.6.4.2
_WD_Startup: Driver:    geckodriver.exe
_WD_Startup: Params:    --log trace
_WD_Startup: Port:  4444
__WD_Post: URL=HTTP://xxx.x.x.x:xxx/session; $sData={"capabilities": {"alwaysMatch": {"moz:firefoxOptions": {"binary": "C:/Program Files/Mozilla Firefox/firefox.exe", "args": ["-profile", "C:/Users/MyName/AppData/Roaming/Mozilla/Firefox/Profiles/1eq1eg3d.default"]}}}}
__WD_Post: StatusCode=0; ResponseText=WinHTTP request timed out before Webdriver...
__WD_Post ==> Send / Recv error: WinHTTP request timed out before Webdriver
_WD_CreateSession: WinHTTP request timed out before Webdriver
_WD_CreateSession ==> Webdriver Exception: HTTP status = 0

 

[Schmand]

Hello,

Unfortunately I get a permanent error when executing the script. The json.au3 as well as wd_core.au3 and wd_helper.au3 are all in the script folder. I'm still at the very beginning and therefore don't have much code yet. However, no matter what I adjust here, the error remains the same. I get the following error message permanently:

Here is the source code:

#include "wd_core.au3"

Local $sDesiredCapabilities
SetupChrome()
_WD_Startup()
$sSession = _WD_CreateSession($sDesiredCapabilities)
_WD_Navigate($sSession, "http://sit")
ConsoleWrite("URL=" & _WD_Action($sSession, 'url') & @CRLF)
_WD_Shutdown()

Func SetupChrome()
_WD_Option('Driver', 'chromedriver.exe')
_WD_Option('Port', 9515)
_WD_Option('DriverParams', '--verbose --log-path="' & @ScriptDir & '\chrome.log"')

$sDesiredCapabilities = '{"capabilities": {"alwaysMatch": {"goog:chromeOptions": {"w3c": true, "excludeSwitches": [ "enable-automation"], "useAutomationExtension": false }}}}'
EndFunc

 

In my browser URL I got a data:, value in browser bar.

I hope someone has an idea.

Kind regards

Edited April 30, 2021 by Schmand

[mLipok]

@Danp2 
Is it possible to using WD+GoogleChrome open few URL's in separate TAB's and manage them concurently ?
If yes .. could  you be so nice and give me any hint on: How to switch between already opened URL's/TAB's ?

 

Edited April 30, 2021 by mLipok

[Danp2]

@CodeWriter It appears that the issue is related to using an existing profile and not the binary path. Have you verified that no other instances of Firefox are running? That could explain this behavior.

[seadoggie01]

@Schmand There are two required UDFs for the WebDriver. You seem to be missing the JSON UDF:

[Danp2]

@Schmand Are you using the full version of Scite? If so, you should be able to press Ctrl+F5 to perform a syntax check on the script. That will generally identify an issues such as missing #include files.

When you run the script from Scite, you should get some helpful diagnostic information posted in the Output panel. Please post that here for review.

[Danp2]

@mLipok Maybe I'm not understanding your request. Doesn't the DemoNavigation function in wd_demo.au3 already cover this?

[Schmand]

It seems that I simply used the outdated version. With the new one it works now. Thank you

[mLipok]

32 minutes ago, Danp2 said:

@mLipok Maybe I'm not understanding your request. Doesn't the DemoNavigation function in wd_demo.au3 already cover this?

ufff. I forget to check. Must check again. Will back with answer and maybe with my own example when I check.

 

Edited April 30, 2021 by mLipok

[CodeWriter]

@Danp2There is only 1 instance of Firefox running on the machine--the one started by wd_dem0.au3. Yes, it's a bit dire with FireFox & Edge unable to run WebDriver with profiles and Chrome unable to run without zoom set at 100%.

[Danp2]

@CodeWriter I'm not aware of anyone else having these issues. FWIW, I am able to launch Firefox with an existing profile and control it with the UDF. It's possible that the issue is localized on your end.

[Marlon13]

Good day at all , I can't capture all the table inside the page, it's probably the syntax of the command that is wrong, could you tell me if it's okay or not in your opinion

table in page

<table data-barchart-table-show-symbol-details="" data-barchart-expland-new-rows="" data-ng-class="{'ordered-triggered': orderHasBeenATriggered, 'symbol-widgets-expanded': symbolWidgetsExpanded}">

command

Local $aResult = _WD_GetTable($sSession, "//table['data-barchart-table-show-symbol-details']")
_DebugArrayDisplay($aResult)

return only  a first nine  line

thanks at all

[Danp2]

5 minutes ago, Marlon13 said:

//table['data-barchart-table-show-symbol-details']

That isn't the correct xpath. You might want to review this link for proper way to use the data attributes.

FWIW, you should be able to access the tables with this xpath --

/descendant::table[1]   ; first table
/descendant::table[2]   ; second table

 

[Marlon13]

I try to set in this mode , sorry but I don't know xpath

Local $aResult = _WD_GetTable($sSession, '/descendant::table[1]')
_DebugArrayDisplay($aResult)

I hope is correct  , in this mode return only 5 line

 

[Danp2]

@Marlon13 I just tried it and received back the entire table. Unsure why you would only get 5 rows returned, unless you encountered an error during the retrieve process. Did you examine the Scite output panel for any errors? Can you save this output to a file and then post it here for review?

[agillbb]

Greetings - hope this is the correct place to ask a question. Fantastic WebDriver UDF, by the way.

I am gathering data from a web page that uses a GET callback to grab JSON data from its server and then render it in the page.  Rather than scrape the elements of the page, it would be great to simply save the JSON response to a variable and use the data directly.  But I can't figure out how to access the GET response data using the WebDriver UDF.

Is this possible, and how would you recommend doing it?

Thanks.

[Danp2]

@agillbb Hard to say without further details. A few possibilities --

• If the desired data is stored somewhere (like a javascript variable), then you could access it with _WD_ExecuteScript
• Depending on the website, you may be able to use _WD_ExecuteScript to execute a function that in turn retrieves the data
• If you know the correct URL, then you could try retrieving the data with __WD_Get

If you are able to, share the details about the website and the specific GET so that we can take a look for ourselves.