WEBDRIVER : _WD_UpdateDriver('firefox') don't work on "intranet"

[tac7]

Hello All,

I use "_WD_UpdateDriver('firefox')" to update or install gekodriver.exe. It's working fine for me on my business' intranet whith a special VPN, but not working on the business cloud !!??

There is a special port that I need to Open or an IP address that I need to allow???

Thanks a lot.

[Danp2]

Hi... my crystal ball is currently out of commission, so you will need to provide more details than "not working".  😏Also, I don't know what you mean by "business cloud". Are you behind a firewall or proxy?

What do you get for console output when you run the following?

#include "wd_core.au3"
#include "wd_helper.au3"

$_WD_Debug = $_WD_DEBUG_Full
_WD_UpdateDriver('firefox')

This is what I see --

    _WD_GetBrowserPath ==> Success [0 / 2] : Parameters:    Browser=firefox
    _WD_GetBrowserVersion ==> Success [0 / 2] : Parameters:    Browser=firefox
    _WD_GetWebDriverVersion ==> Success [0 / 0] : Parameters:    Dir=c:\Users\danpo\OneDrive\Documents\GitHub\WD Test\    EXE=geckodriver.exe
    __WD_GetLatestWebdriverInfo ==> Success [0 / 0]
    _WD_DownloadFile ==> Success [0 / 0] : Parameters:    URL=https://github.com/mozilla/geckodriver/releases/download/v0.33.0/geckodriver-v0.33.0-win64.zip    Dest=C:\Users\danpo\AppData\Local\Temp\webdriver_snrfuls.zip    Options=Default
    __WD_UpdateExtractor ==> Success [0 / 0]
    _WD_UpdateDriver ==> Success [0 / 0] : DriverCurrent = 0.32.1 : DriverLatest = 0.33.0

There aren't any special ports required. Internally, the InetRead function is used to download the webdriver.

[mLipok]

Quote

don't work on "intranet"

What this mean ?

Do you have internet there ?

Edited October 19, 2023 by mLipok

[tac7]

Thanks for your reply,

Yes I think there is no internet on this cloud
With full Debug we can see:

_WD_GetBrowserPath ==> Success [0 / 1] : Parameters:    Browser=firefox
_WD_GetBrowserVersion ==> Success [0 / 1] : Parameters:    Browser=firefox
_WD_GetWebDriverVersion ==> Not found [13 / 0] : Parameters:    Dir=D:\TEST_pour_AutoSeria_Acces_a_Update_Webdriver\Auto_Seria_AU3\    EXE=geckodriver.exe
__WD_GetLatestWebdriverInfo ==> General Error [1 / 2]
_WD_UpdateDriver ==> General Error [1 / 2] : DriverCurrent = 0 : DriverLatest =

I think I need to put "gekodriver.exe" in my work dir with the same version of firefox and i don't do anythink more !

[Danp2]

1 hour ago, tac7 said:

Yes I think there is no internet on this cloud

You won't be able to use _WD_UpdateDriver without the ability to access the internet.

[tac7]

thanks for your help

have a good day

[mLipok]

@Danp2 I think we need to do some features for such cases.
I have this problem too in one project which is on my TODO list.

 

[Danp2]

@mLipok How would you propose to make this work without internet access? What realistic options exist other than the user manually updating the webdriver?

[mLipok]

 

1. use program on PC station with INTRANET env
2. Get browser version store to INI
3. use program on PC station with INTERNET env
4. Get stored value from INI
5. Get desired driver
6. use program on PC station with INTRANET env
7. check if BROWSER and DRIVER versions fits toogether

 

[Danp2]

Note that I did say realistic. 😉Maybe something like this already exists for Selenium?  IMO, that is outside the scope of this set of UDFs.

One possible solution is to eliminate the usage of the webdriver intermediary (chromedriver, geckodriver, etc). This will be possible once the UDF fully supports the newer BiDi protocol.

[tac7]

sorry to interrupt you !!! 😀

I installed "edge" 116.0.1938.81 win32 and the same version of edgedriver.exe win32

The server is an Windows server 2019

   I have the "black Windows" WebDriver opened and Edge window opened but:

_WD_CapabilitiesAdd ==> Success [0] : Successfully added capability
_WD_CapabilitiesDump: JSON structure starts below: 1310
{
    "capabilities":{
        "alwaysMatch":{
            "ms:edgeOptions":{
                "excludeSwitches":[
                    "enable-automation"
                ]
            }
        }
    }
}
_WD_CapabilitiesDump: JSON structure ends above.
_WD_GetFreePort ==> Success [0 / 9515] : Parameters:   MinPort=9515   MaxPort=Default
_WD_IsLatestRelease ==> General Error [1]
_WD_Startup: OS:    WIN_2019 X64 17763 
_WD_Startup: AutoIt:    3.3.16.1
_WD_Startup: Webdriver UDF: 1.0.3 (Update status unknown [1])
_WD_Startup: WinHTTP:   1.6.4.2
_WD_Startup: Driver:    msedgedriver.exe (32 Bit)
_WD_Startup: Params:    --verbose --log-path="D:\TEST_pour_AutoSeria_Acces_a_Update_Webdriver\Auto_Seria_AU3\msedge.log"
_WD_Startup: Port:  9515
_WD_Startup: Command:   "msedgedriver.exe" --verbose --log-path="D:\TEST_pour_AutoSeria_Acces_a_Update_Webdriver\Auto_Seria_AU3\msedge.log" 
_WD_Startup ==> Success [0]

Issue is >>>  _WD_IsLatestRelease ==> General Error [1]

 

It is the first time I put an Autoit Script with Webdriver on a Window Server (2019)!!!

If you are an idea !!

 

 

[mLipok]

17 minutes ago, tac7 said:

_WD_Startup: Webdriver UDF: 1.0.3 (Update status unknown [1])

https://github.com/Danp2/au3WebDriver/releases/tag/1.2.0

[tac7]

OK, I will update...
And try on Monday...

have a nice weekend

[Danp2]

As @mLipok pointed out, your version of the UDF is out-of-date. As far as why _WD_IsLatestRelease returns an error, I can only assume that it is the same issue we discussed above where you don't have internet access.

[mLipok]

2 hours ago, Danp2 said:

Note that I did say realistic. 😉Maybe something like this already exists for Selenium?  IMO, that is outside the scope of this set of UDFs.

but why ?
I think It is easy to provide support for this.
I think I be able to propose PR in comming days.

 

[mLipok]

1 hour ago, tac7 said:

I have the "black Windows" WebDriver opened and Edge window opened but:

ok

1 hour ago, tac7 said:

Issue is >>> _WD_IsLatestRelease ==> General Error [1]

exactly as @Danp2 said here:

42 minutes ago, Danp2 said:

As far as why _WD_IsLatestRelease returns an error, I can only assume that it is the same issue we discussed above where you don't have internet access.

so @tac7 is there any other problem ?
Does your browser automation start properly or not ?
 

Edited October 20, 2023 by mLipok

[tac7]

Yes it semms to be executed correctly

In the Black windows on the Remote Machine the only difference with local is:

DevTools remote debugging is disallowed by the system admin.
[2448:9468:1020/174205.039:ERROR:edge_auth_errors.cc(487)] EDGE_IDENTITY: Get Default OS Account failed: Error: Primary Error: kImplicitSignInFailure, Secondary Error: kAccountProviderFetchError, Platform error: 0, Error string:

[2448:9468:1020/174205.860:ERROR:fallback_task_provider.cc(124)] Every renderer should have at least one task provided by a primary task provider. If a "Renderer" fallback task is shown, it is a bug. If you have repro steps, please file a new bug and tag it as a dependency of crbug.com/739782.

In the Black Local Windows I have:

DevTools listening on ws://127.0.0.1:58431/devtools/browser/5c76a0e3-48fe-4120-a7e1-612443aede25
[22208:22816:1020/174403.475:ERROR:device_event_log_impl.cc(222)] [17:44:03.463] USB: usb_service_win.cc:415 Could not read device interface GUIDs: Le fichier spÚcifiÚ est introuvable. (0x2)

 

All my Debug on the Remote :

_WD_Option ==> Success [0] : Parameters:   Option=Driver   Value=msedgedriver.exe
_WD_Option ==> Success [0] : Parameters:   Option=Port   Value=9515
_WD_Option ==> Success [0] : Parameters:   Option=DriverParams   Value=--verbose --log-path="D:\TEST_pour_AutoSeria_Acces_a_Update_Webdriver\Auto_Seria_AU3\msedge.log"
_WD_CapabilitiesStartup: #148 : > {"capabilities":"{}"} > IsObj = 1
_WD_CapabilitiesAdd: #177 :      $key = alwaysMatch     $value1 = msedge     $value2 = 
_WD_CapabilitiesAdd: #205 :  $_WD_NOTATION__MATCHTYPE = [capabilities][alwaysMatch] $_WD_NOTATION__SPECIFICVENDOR = ["ms:edgeOptions"]
_WD_CapabilitiesAdd ==> Success [0] : Successfully used [alwaysMatch]  with specified browser: msedge
_WD_CapabilitiesAdd: #177 :      $key = excludeSwitches     $value1 = enable-automation     $value2 = 
_WD_CapabilitiesAdd: #239 #275 :      $key = excludeSwitches     $value1 = enable-automation     $value2 =     $s_Notation = [capabilities][alwaysMatch]["ms:edgeOptions"]["excludeSwitches"][0]   <<<<  enable-automation
_WD_CapabilitiesAdd ==> Success [0] : Successfully added capability
_WD_CapabilitiesDump: JSON structure starts below: 1310
{
    "capabilities":{
        "alwaysMatch":{
            "ms:edgeOptions":{
                "excludeSwitches":[
                    "enable-automation"
                ]
            }
        }
    }
}
_WD_CapabilitiesDump: JSON structure ends above.
_WD_GetFreePort ==> Success [0 / 9515] : Parameters:   MinPort=9515   MaxPort=Default
_WD_IsLatestRelease ==> General Error [1]
_WD_Startup: OS:    WIN_2019 X64 17763 
_WD_Startup: AutoIt:    3.3.16.1
_WD_Startup: Webdriver UDF: 1.2.0 (Update status unknown [1])
_WD_Startup: WinHTTP:   1.6.4.2
_WD_Startup: Driver:    msedgedriver.exe (32 Bit)
_WD_Startup: Params:    --verbose --log-path="D:\TEST_pour_AutoSeria_Acces_a_Update_Webdriver\Auto_Seria_AU3\msedge.log"
_WD_Startup: Port:  9515
_WD_Startup: Command:   "msedgedriver.exe" --verbose --log-path="D:\TEST_pour_AutoSeria_Acces_a_Update_Webdriver\Auto_Seria_AU3\msedge.log" 
_WD_Startup ==> Success [0]

 

If this can help you !!

[mLipok]

4 minutes ago, tac7 said:

In the Black windows on the Remote Machine the only difference with local is:

DevTools remote debugging is disallowed by the system admin.

As you said before, it is

2 hours ago, tac7 said:

an Autoit Script with Webdriver on a Window Server (2019)!!!

do you have admin rights ?
If not, what did you expect ?

Edited October 20, 2023 by mLipok

[tac7]

It seems I don't have all Rights in "Programm Files (X86)"

But I can't install Edge in Other folder....

I will check "how to" monday..

 

Thanks

[Danp2]

4 hours ago, mLipok said:

but why ?

Several reasons --

1. Most won't use this functionality, so the added complexity isn't worth it in my opinion
2. I haven't checked, but I suspect that other solutions may already exist
3. Increased support requests caused by improper usage, network rights, GPO settings, etc.