Difficulties starting the Chrome Webdriver, Webdriver Exception [10]

[_leo_]

My script has been working without issues for multiple years, but lately, without changing the code, I have been having some problems with starting the chrome web driver. I updated all the drivers and imports and switched to using "CapabilitiesAdd", but I still get a "Webdriver Exception [10]. "WinHTTP request timed out before Webdriver" appears in the output, but I updated the UDF to the latest release.

For context: I am able to run wd_demo without this problem, but when I try to add capabilities to the demo, like a chrome profile, the code produces a "DevToolsActivePort file doesn't exist" error, which I tried to solve with the commented out capabilities, but I had no success.

Here is my code:

expandcollapse popup

#include <FileConstants.au3>
#include <StringConstants.au3>
#include "wd_core.au3"
#include "wd_helper.au3"
#include <String.au3>
#include "wd_capabilities.au3"

HotKeySet("{Esc}", "ExitScript")
Func ExitScript()
Exit
EndFunc
Global $sSession
$_WD_DEBUG = $_WD_DEBUG_Full
_WD_Option('Driver', 'chromedriver.exe')
_WD_Option('Port', 9515)
_WD_Option('DriverParams', '--verbose --log-path="' & @ScriptDir & '\chrome.log"')

;$sDesiredCapabilities = '{"capabilities": {"alwaysMatch": {"unhandledPromptBehavior": "ignore", ' & _{"goog:chromeOptions": {"w3c": true, "args":["start-maximized", "disable-infobars", "disable-notifications", "--user-data-dir=C:\\Users\\' & @UserName & '\\AppData\\Local\\Google\\Chrome\\User Data\\", "--profile-directory=Default"]}}}}'
_WD_CapabilitiesStartup()
_WD_CapabilitiesAdd('alwaysMatch', 'chrome')
_WD_CapabilitiesAdd('w3c', True)
_WD_CapabilitiesAdd('excludeSwitches', 'enable-automation')
;_WD_CapabilitiesAdd('args', '--user-data-dir=C:\\Users\\' & @UserName & '\\AppData\\Local\\Google\\Chrome\\User Data\\')    
;_WD_CapabilitiesAdd('args', 'profile-directory=Default')
;_WD_CapabilitiesAdd('args', 'start-maximized')
;_WD_CapabilitiesAdd('args', 'disable-infobars')
;_WD_CapabilitiesAdd('args', 'disable-notifications')    
;_WD_CapabilitiesAdd('args', '--disable-blink-features=AutomationControlled')
;_WD_CapabilitiesAdd('args', '--disable-web-security')
;_WD_CapabilitiesAdd('args', '--allow-running-insecure-content')
;_WD_CapabilitiesAdd('args', '--ignore-certificate-errors')
;_WD_CapabilitiesAdd('prefs', 'credentials_enable_service', False)
;_WD_CapabilitiesAdd('excludeSwitches', 'disable-popup-blocking')
Local $sCapabilities = _WD_CapabilitiesGet()
$sSession = _WD_CreateSession($sCapabilities)
_WD_CheckContext($sSession, False)
_WD_Startup()
If @error <> $_WD_ERROR_Success Then
    Exit -1
EndIf
Sleep(10000)
_WD_Shutdown()

And this is the output:

expandcollapse popup

_WD_Option ==> Success [0] : Parameters:   Option=Driver   Value=chromedriver.exe
_WD_Option ==> Success [0] : Parameters:   Option=Port   Value=9515
_WD_Option ==> Success [0] : Parameters:   Option=DriverParams   Value=--verbose --log-path="C:\Users\leona\OneDrive\Desktop\chrome.log"
_WD_CapabilitiesStartup: #148 : > {"capabilities":"{}"} > IsObj = 1
_WD_CapabilitiesAdd: #177 :      $key = alwaysMatch     $value1 = chrome     $value2 = 
_WD_CapabilitiesAdd: #205 :  $_WD_NOTATION__MATCHTYPE = [capabilities][alwaysMatch] $_WD_NOTATION__SPECIFICVENDOR = ["goog:chromeOptions"]
_WD_CapabilitiesAdd ==> Success [0] : Successfully used [alwaysMatch]  with specified browser: chrome
_WD_CapabilitiesAdd: #177 :      $key = w3c     $value1 = True     $value2 = 
_WD_CapabilitiesAdd: #259 #275 :      $key = w3c     $value1 = True     $value2 =     $s_Notation = [capabilities][alwaysMatch]["goog:chromeOptions"]["w3c"]   <<<<  True
_WD_CapabilitiesAdd ==> Success [0] : Successfully added capability
_WD_CapabilitiesAdd: #177 :      $key = excludeSwitches     $value1 = enable-automation     $value2 = 
_WD_CapabilitiesAdd: #239 #275 :      $key = excludeSwitches     $value1 = enable-automation     $value2 =     $s_Notation = [capabilities][alwaysMatch]["goog:chromeOptions"]["excludeSwitches"][0]   <<<<  enable-automation
_WD_CapabilitiesAdd ==> Success [0] : Successfully added capability
__WD_Post: URL=HTTP://127.0.0.1:9515/session; Data={
    "capabilities":{
        "alwaysMatch":{
            "goog:chromeOptions":{
                "w3c":true,
                "excludeSwitches":[
                    "enable-automation"
                ]
            }
        }
    }
}
__WD_Post ==> Send / Recv error [6] : HTTP status = 0 ResponseText=WinHTTP request timed out before Webdriver
_WD_CreateSession ==> Webdriver Exception [10]
__WD_Get: URL=HTTP://127.0.0.1:9515/session//url
__WD_Get ==> Send / Recv error [6] : HTTP status = 0 ResponseText=WinHTTP request timed out before Webdriver
_WD_Action ==> Send / Recv error [6] : Parameters:   Command=url   Option=Default
_WD_CheckContext ==> Webdriver Exception [10]
_WD_GetFreePort ==> Success [0 / 9515] : Parameters:   MinPort=9515   MaxPort=Default
_WD_IsLatestRelease ==> Success [0] : True
_WD_Startup: OS:    WIN_11 X64 22621 
_WD_Startup: AutoIt:    3.3.16.1
_WD_Startup: Webdriver UDF:    1.2.0 (Up to date)
_WD_Startup: WinHTTP:    1.6.4.2
_WD_Startup: Driver:    chromedriver.exe (64 Bit)
_WD_Startup: Params:    --verbose --log-path="C:\Users\leona\OneDrive\Desktop\chrome.log"
_WD_Startup: Port:    9515
_WD_Startup: Command:    "chromedriver.exe" --verbose --log-path="C:\Users\leona\OneDrive\Desktop\chrome.log" 
_WD_Startup ==> Success [0]

 

[Danp2]

You need to call __WD_Startup before you call _WD_CreateSession, not after.

[_leo_]

@Danp2 Thank you very much for your help. That fixed the Webdriver Exception [10].

When I now try to add a Chrome profile by uncommenting the lines:

_WD_CapabilitiesAdd('args', '--user-data-dir=C:\\Users\\' & @UserName & '\\AppData\\Local\\Google\\Chrome\\User Data\\')    
_WD_CapabilitiesAdd('args', 'profile-directory=Default')

I get a "DevToolsActivePort file doesn't exist" error (the Chrome profile is loaded). In previous discussions, I saw that some capabilities might help to resolve this, but none of these helped:

_WD_CapabilitiesAdd('args', '--disable-blink-features=AutomationControlled')
_WD_CapabilitiesAdd('args', '--disable-web-security')
_WD_CapabilitiesAdd('args', '--allow-running-insecure-content')
_WD_CapabilitiesAdd('args', '--ignore-certificate-errors')
_WD_CapabilitiesAdd('prefs', 'credentials_enable_service', False)
_WD_CapabilitiesAdd('excludeSwitches', 'disable-popup-blocking')

I tried them one by one and in combination. Thanks in advance for your help!

[Danp2]

Are you sure that your arguments are correct for specifying the profile?

FWIW, this is what is shown in the wiki --

Quote

"--profile-directory=Default"

so the equivalent using _WD_CapabilitiesAdd would be

_WD_CapabilitiesAdd('args', '--profile-directory', Default)

 

[_leo_]

@Danp2 Thank you for your input! I changed the code to your suggestion, but the console output still looks the same.

I also experimented with some other syntaxes:

_WD_CapabilitiesAdd('args', '--profile-directory', Default)
_WD_CapabilitiesAdd('args', '--profile-directory', "Default")
_WD_CapabilitiesAdd('args', 'profile-directory', Default)
_WD_CapabilitiesAdd('args', 'profile-directory', "Default")

No matter which syntax, the Chrome driver behaves the same way, even if I don't add a profile directory, which might indicate that none of the syntaxes are correct. 

I also experimented with the user data directory. I found, that both syntaxes made Chrome load the profile, but also both produced the DevToolsActivePort error. Hence, not specifying the user data, prevents the error but also doesn't load the profile.

_WD_CapabilitiesAdd('args', '--user-data-dir=C:\\Users\\' & @UserName & '\\AppData\\Local\\Google\\Chrome\\User Data\\')
_WD_CapabilitiesAdd('args', '--user-data-dir', 'C:\\Users\\' & @UserName & '\\AppData\\Local\\Google\\Chrome\\User Data\\')

The console output:

__WD_Post ==> Session not created [15] : HTTP status = 500
_WD_CreateSession ==> Session not created [15] : session not created: Chrome failed to start: exited normally.
  (session not created: DevToolsActivePort file doesn't exist)
  (The process started from chrome location C:\Program Files\Google\Chrome\Application\chrome.exe is no longer running, so ChromeDriver is assuming that Chrome has crashed.)

 

[Danp2]

Are you launching your script in elevated mode? That could explain the issue as the Admin user wouldn't have rights to the files in the profile directory.

[mLipok]

2 hours ago, Danp2 said:

Are you launching your script in elevated mode? That could explain the issue as the Admin user wouldn't have rights to the files in the profile directory.

Not sure what exactly you mean.
I have some experience in runing WD with elevated AutoIt script so I checked how Chrome/FireFox runs as Admin.

I notice is that they probably use the same profile in elevated an non elevated mode, as when I run as Admin then I get the same pined links in "bookmarks bar/panel".

Please verify if my reasoning is correct.
 

[Danp2]

You may be correct. I'm grasping at straws to understand the issue with missing DevToolsActivePort file, so I was suspecting a rights issue.

[_leo_]

I tried to run the script with #RequireAdmin, if that is what you meant, but it had no impact. 

I also found a topic on stack overflow: https://stackoverflow.com/questions/50642308/webdriverexception-unknown-error-devtoolsactiveport-file-doesnt-exist-while-t, about the same issue with selenium. My updated capabilities look like this: 

_WD_CapabilitiesAdd('args', '--no-sandbox')
_WD_CapabilitiesAdd('alwaysMatch', 'chrome')
_WD_CapabilitiesAdd('w3c', True)
;_WD_CapabilitiesAdd('args', '--remote-debugging-port=9222') --> Results in Error: "Chrome not reachable", so commented out
_WD_CapabilitiesAdd('excludeSwitches', 'enable-automation')
_WD_CapabilitiesAdd('args', 'start-maximized')
_WD_CapabilitiesAdd('args', '--disable-dev-shm-usage')
_WD_CapabilitiesAdd('args', '--disable-gpu')
_WD_CapabilitiesAdd('args', 'disable-infobars')
_WD_CapabilitiesAdd('args', '--crash-dumps-dir=/tmp')
_WD_CapabilitiesAdd('args', 'disable-notifications')    
_WD_CapabilitiesAdd('args', '--disable-blink-features=AutomationControlled')
_WD_CapabilitiesAdd('args', '--disable-web-security')
_WD_CapabilitiesAdd('args', '--allow-running-insecure-content')
_WD_CapabilitiesAdd('args', '--ignore-certificate-errors')
_WD_CapabilitiesAdd('prefs', 'credentials_enable_servisce', False)
_WD_CapabilitiesAdd('excludeSwitches', 'disable-popup-blocking') 
_WD_CapabilitiesAdd('args', '--user-data-dir', 'C:\\Users\\' & @UserName & '\\AppData\\Local\\Google\\Chrome\\User Data\\')
_WD_CapabilitiesAdd('args', '--profile-directory', Default)

I am not sure if that made it better or worse. The error still exists.

[mLipok]

5 hours ago, _leo_ said:

_WD_CapabilitiesAdd('args', '--crash-dumps-dir=/tmp')

is this relationall to which folder ?

[mLipok]

5 hours ago, _leo_ said:

_WD_CapabilitiesAdd('args', '--user-data-dir', 'C:\\Users\\' & @UserName & '\\AppData\\Local\\Google\\Chrome\\User Data\\')

why you use duplicated back slashes ?
I use:

Func _MY__WD_ProfileDir($s_Browser_Name)
    Switch $s_Browser_Name
        Case "chrome"
            Return @LocalAppDataDir & '\Google\Chrome\User Data\WD_Testing_Profile'
        Case "firefox"
            Return @LocalAppDataDir & '\Mozilla\Firefox\Profiles\WD_Testing_Profile'
        Case "msedge"
            Return @LocalAppDataDir & '\Microsoft\Edge\User Data\WD_Testing_Profile'
        Case Else
            Return SetError($_WD_ERROR_NotSupported, @extended, '')
    EndSwitch
EndFunc   ;==>_MY__WD_ProfileDir

 

[samibb]

dear @Danp2

How can  find processor css or object in any web page in DOCTYPY HTML ?

Thanks in advince

[Danp2]

@samibb Please start your own thread as your question has no relation to the current topic. Also, I suggest that you elaborate on your question because I don't understand what you are wanting to accomplish