turbobaby Posted November 24, 2022 Posted November 24, 2022 Hello, when I load a website with hidden text elements and try to retrieve the HTML code, I never get the hidden text. When I do an investigation in Firefox I see the text inside but when I go to the same page with Webdriver and try to fetch the text, the code is not inside. What does this mean and how can I call it anyway? $sSource = _WD_GetSource($sSession) $bElements = _WD_FindElement($sSession, $_WD_LOCATOR_ByXPath, "//div[@class='print-footer hidden-screen-only']", Default, True)
Danp2 Posted November 24, 2022 Posted November 24, 2022 Hi, Your question is vague so it's difficult to provide an accurate answer. Please post a reproducer script that we can run to observe the behavior you are experiencing. Dan Latest Webdriver UDF Release Webdriver Wiki FAQs
turbobaby Posted November 25, 2022 Author Posted November 25, 2022 expandcollapse popup#include "wd_core.au3" #include "wd_helper.au3" #include <MsgBoxConstants.au3> #include <String.au3> #include <Array.au3> Local $sDesiredCapabilities, $sSession, $sSource, $sEl, $sE2, $oSubmit ; Url Local $sUrl = 'https://www.bibleserver.com/ELB/1.Mose1' ; Initialisierung ChromeDriver _SetupChrome() ; Launch the designated web driver console app _WD_Startup() ; Request new session from web driver $sSession = _WD_CreateSession($sDesiredCapabilities) _WD_Window($sSession, 'MAXIMIZE') ; Navigate to the designated URL _WD_Navigate($sSession,$sUrl) $coockies = _WD_FindElement($sSession, $_WD_LOCATOR_ByXPath, "//a[@class='cc-primary-btn']") _WD_ElementActionEx($sSession, $coockies , "CLICK") ; Wait for a browser page load to complete before returning _WD_Loadwait($sSession) $sSource = _WD_GetSource($sSession) ;ClipPut($sSource) $bElements = _WD_FindElement($sSession, $_WD_LOCATOR_ByXPath, "//div[@class='print-footer hidden-screen-only']", Default, True) If IsArray($bElements) Then For $mi = 0 To UBound($bElements) - 1 $sText = _WD_ElementAction($sSession, $bElements[$mi], 'property', 'innerText') MsgBox(0,$mi &'/'& UBound($bElements),$sText,1) $aOptions = StringSplit ( $sText, @LF, $STR_NOCOUNT) $bElements[$mi] = $aOptions[0] Next _ArrayDisplay($bElements) Else MsgBox(0,'','nothing found') EndIf ; Session schließen _WD_DeleteSession($sSession) ; ChromeDriver beenden _WD_Shutdown() Func _SetupChrome() $_WD_DEBUG = False ; Webdriver Debug-Fenster _WD_Option('Driver', 'chromedriver.exe') _WD_Option('Port', 9715) _WD_Option('DriverParams', ' --port=9715 --log-path="' & @ScriptDir & '\chrome.log"') $sDesiredCapabilities = '{"capabilities": {"alwaysMatch": {"goog:chromeOptions": {"w3c": true }}}}' EndFunc I need only the notes in []
Solution mLipok Posted November 25, 2022 Solution Posted November 25, 2022 (edited) try this: expandcollapse popup#AutoIt3Wrapper_Run_AU3Check=Y #AutoIt3Wrapper_Au3Check_Parameters=-q -d -w 1 -w 2 -w 3 -w 4 -w 5 -w 6 -w 7 #include <MsgBoxConstants.au3> #include <String.au3> #include <Array.au3> #include "wd_core.au3" #include "wd_helper.au3" Global $sSession _Main() Func _Main() _WD_UpdateDriver("chrome") ; Initialisierung ChromeDriver Local $sDesiredCapabilities = _SetupChrome() ; Launch the designated web driver console app _WD_Startup() ; Request new session from web driver $sSession = _WD_CreateSession($sDesiredCapabilities) _WD_Window($sSession, 'MAXIMIZE') _Example() If @error Then ConsoleWrite("! ---> @error=" & @error & " @extended=" & @extended & _ " : some error occured" & @CRLF) ; Session schließen _WD_DeleteSession($sSession) ; ChromeDriver beenden _WD_Shutdown() EndFunc ;==>_Main Func _Example() Local Const $sUrl = 'https://www.bibleserver.com/ELB/1.Mose1' Local $aElements ; Navigate to the designated URL _WD_Navigate($sSession, $sUrl) ;~ fixing here Local $coockies = _WD_WaitElement($sSession, $_WD_LOCATOR_ByXPath, "//a[@class='cc-primary-btn']", Default, Default, BitOR($_WD_OPTION_Enabled, $_WD_OPTION_Visible)) _WD_ElementActionEx($sSession, $coockies, "CLICK") ; Wait for a browser page load to complete before returning _WD_Loadwait($sSession) ;~ fixing here _WD_WaitElement($sSession, $_WD_LOCATOR_ByXPath, "//div[@class='print-footer hidden-screen-only']", Default, Default) #Region - called issue - fixed $aElements = _WD_FindElement($sSession, $_WD_LOCATOR_ByXPath, "//div[@class='print-footer hidden-screen-only']", Default, True) If @error Then Return SetError(@error, @extended, 0) Local $sText = '', $aOptions If IsArray($aElements) Then For $mi = 0 To UBound($aElements) - 1 $sText = _WD_ElementAction($sSession, $aElements[$mi], 'property', 'innerText') If @error Then ExitLoop MsgBox(0, $mi & '/' & UBound($aElements), $sText, 5) $aOptions = StringSplit($sText, @LF, $STR_NOCOUNT) $aElements[$mi] = $aOptions[0] Next _ArrayDisplay($aElements) Else MsgBox(0, '', 'nothing found') EndIf #EndRegion - called issue - fixed #Region - mLipok solution $aElements = _WD_FindElement($sSession, $_WD_LOCATOR_ByXPath, "//div[@class='print-footer hidden-screen-only']", Default, True) If @error Then Return SetError(@error, @extended, 0) Local $sJavaScript = _ "var element = arguments[0];" & _ "return element.innerText;" If IsArray($aElements) Then For $mi = 0 To UBound($aElements) - 1 $sText = _WD_ExecuteScript($sSession, $sJavaScript, __WD_JsonElement($aElements[$mi]), Default, $_WD_JSON_Value) If @error Then ExitLoop MsgBox(0, $mi & '/' & UBound($aElements), $sText, 5) $aOptions = StringSplit($sText, @LF, $STR_NOCOUNT) $aElements[$mi] = $aOptions[0] Next EndIf #EndRegion - mLipok solution EndFunc ;==>_Example Func _SetupChrome() $_WD_DEBUG = False ; Webdriver Debug-Fenster _WD_Option('Driver', 'chromedriver.exe') _WD_Option('Port', 9715) _WD_Option('DriverParams', ' --port=9715 --log-path="' & @ScriptDir & '\chrome.log"') Local $sDesiredCapabilities = '{"capabilities": {"alwaysMatch": {"goog:chromeOptions": {"w3c": true }}}}' Return $sDesiredCapabilities EndFunc ;==>_SetupChrome Edited November 25, 2022 by mLipok turbobaby 1 Signature beginning:* Please remember: "AutoIt"..... * Wondering who uses AutoIt and what it can be used for ? * Forum Rules ** ADO.au3 UDF * POP3.au3 UDF * XML.au3 UDF * IE on Windows 11 * How to ask ChatGPT for AutoIt Code * for other useful stuff click the following button: Reveal hidden contents Any of my own code posted anywhere on the forum is available for use by others without any restriction of any kind. My contribution (my own projects): * Debenu Quick PDF Library - UDF * Debenu PDF Viewer SDK - UDF * Acrobat Reader - ActiveX Viewer * UDF for PDFCreator v1.x.x * XZip - UDF * AppCompatFlags UDF * CrowdinAPI UDF * _WinMergeCompare2Files() * _JavaExceptionAdd() * _IsBeta() * Writing DPI Awareness App - workaround * _AutoIt_RequiredVersion() * Chilkatsoft.au3 UDF * TeamViewer.au3 UDF * JavaManagement UDF * VIES over SOAP * WinSCP UDF * GHAPI UDF - modest begining - comunication with GitHub REST API * ErrorLog.au3 UDF - A logging Library * Include Dependency Tree (Tool for analyzing script relations) * Show_Macro_Values.au3 * My contribution to others projects or UDF based on others projects: * _sql.au3 UDF * POP3.au3 UDF * RTF Printer - UDF * XML.au3 UDF * ADO.au3 UDF * SMTP Mailer UDF * Dual Monitor resolution detection * * 2GUI on Dual Monitor System * _SciLexer.au3 UDF * SciTE - Lexer for console pane * Useful links: * Forum Rules * Forum etiquette * Forum Information and FAQs * How to post code on the forum * AutoIt Online Documentation * AutoIt Online Beta Documentation * SciTE4AutoIt3 getting started * Convert text blocks to AutoIt code * Games made in Autoit * Programming related sites * Polish AutoIt Tutorial * DllCall Code Generator * Wiki: * Expand your knowledge - AutoIt Wiki * Collection of User Defined Functions * How to use HelpFile * Good coding practices in AutoIt * OpenOffice/LibreOffice/XLS Related: WriterDemo.au3 * XLS/MDB from scratch with ADOX IE Related: * How to use IE.au3 UDF with AutoIt v3.3.14.x * Why isn't Autoit able to click a Javascript Dialog? * Clicking javascript button with no ID * IE document >> save as MHT file * IETab Switcher (by LarsJ ) * HTML Entities * _IEquerySelectorAll() (by uncommon) * IE in TaskScheduler * IE Embedded Control Versioning (use IE9+ and HTML5 in a GUI) * PDF Related: * How to get reference to PDF object embeded in IE * IE on Windows 11 * I encourage you to read: * Global Vars * Best Coding Practices * Please explain code used in Help file for several File functions * OOP-like approach in AutoIt * UDF-Spec Questions * EXAMPLE: How To Catch ConsoleWrite() output to a file or to CMD *I also encourage you to check awesome @trancexx code: * Create COM objects from modules without any demand on user to register anything. * Another COM object registering stuff * OnHungApp handler * Avoid "AutoIt Error" message box in unknown errors * HTML editor * winhttp.au3 related : * https://www.autoitscript.com/forum/topic/206771-winhttpau3-download-problem-youre-speaking-plain-http-to-an-ssl-enabled-server-port/ "Homo sum; humani nil a me alienum puto" - Publius Terentius Afer"Program are meant to be read by humans and only incidentally for computers and execute" - Donald Knuth, "The Art of Computer Programming" , be and \\//_. Anticipating Errors : "Any program that accepts data from a user must include code to validate that data before sending it to the data store. You cannot rely on the data store, ...., or even your programming language to notify you of problems. You must check every byte entered by your users, making sure that data is the correct type for its field and that required fields are not empty." Signature last update: 2023-04-24
turbobaby Posted November 25, 2022 Author Posted November 25, 2022 (edited) Thanks, but its not working Edited November 25, 2022 by turbobaby
turbobaby Posted November 25, 2022 Author Posted November 25, 2022 On 11/25/2022 at 10:11 AM, mLipok said: try this: expandcollapse popup#AutoIt3Wrapper_Run_AU3Check=Y #AutoIt3Wrapper_Au3Check_Parameters=-q -d -w 1 -w 2 -w 3 -w 4 -w 5 -w 6 -w 7 #include <MsgBoxConstants.au3> #include <String.au3> #include <Array.au3> #include "wd_core.au3" #include "wd_helper.au3" Global $sSession _Main() Func _Main() _WD_UpdateDriver("chrome") ; Initialisierung ChromeDriver Local $sDesiredCapabilities = _SetupChrome() ; Launch the designated web driver console app _WD_Startup() ; Request new session from web driver $sSession = _WD_CreateSession($sDesiredCapabilities) _WD_Window($sSession, 'MAXIMIZE') _Example() If @error Then ConsoleWrite("! ---> @error=" & @error & " @extended=" & @extended & _ " : some error occured" & @CRLF) ; Session schließen _WD_DeleteSession($sSession) ; ChromeDriver beenden _WD_Shutdown() EndFunc ;==>_Main Func _Example() Local Const $sUrl = 'https://www.bibleserver.com/ELB/1.Mose1' Local $aElements ; Navigate to the designated URL _WD_Navigate($sSession, $sUrl) ;~ fixing here Local $coockies = _WD_WaitElement($sSession, $_WD_LOCATOR_ByXPath, "//a[@class='cc-primary-btn']", Default, Default, BitOR($_WD_OPTION_Enabled, $_WD_OPTION_Visible)) _WD_ElementActionEx($sSession, $coockies, "CLICK") ; Wait for a browser page load to complete before returning _WD_Loadwait($sSession) ;~ fixing here _WD_WaitElement($sSession, $_WD_LOCATOR_ByXPath, "//div[@class='print-footer hidden-screen-only']", Default, Default) #Region - called issue - fixed $aElements = _WD_FindElement($sSession, $_WD_LOCATOR_ByXPath, "//div[@class='print-footer hidden-screen-only']", Default, True) If @error Then Return SetError(@error, @extended, 0) Local $sText = '', $aOptions If IsArray($aElements) Then For $mi = 0 To UBound($aElements) - 1 $sText = _WD_ElementAction($sSession, $aElements[$mi], 'property', 'innerText') If @error Then ExitLoop MsgBox(0, $mi & '/' & UBound($aElements), $sText, 5) $aOptions = StringSplit($sText, @LF, $STR_NOCOUNT) $aElements[$mi] = $aOptions[0] Next _ArrayDisplay($aElements) Else MsgBox(0, '', 'nothing found') EndIf #EndRegion - called issue - fixed #Region - mLipok solution $aElements = _WD_FindElement($sSession, $_WD_LOCATOR_ByXPath, "//div[@class='print-footer hidden-screen-only']", Default, True) If @error Then Return SetError(@error, @extended, 0) Local $sJavaScript = _ "var element = arguments[0];" & _ "return element.innerText;" If IsArray($aElements) Then For $mi = 0 To UBound($aElements) - 1 $sText = _WD_ExecuteScript($sSession, $sJavaScript, __WD_JsonElement($aElements[$mi]), Default, $_WD_JSON_Value) If @error Then ExitLoop MsgBox(0, $mi & '/' & UBound($aElements), $sText, 5) $aOptions = StringSplit($sText, @LF, $STR_NOCOUNT) $aElements[$mi] = $aOptions[0] Next EndIf #EndRegion - mLipok solution EndFunc ;==>_Example Func _SetupChrome() $_WD_DEBUG = False ; Webdriver Debug-Fenster _WD_Option('Driver', 'chromedriver.exe') _WD_Option('Port', 9715) _WD_Option('DriverParams', ' --port=9715 --log-path="' & @ScriptDir & '\chrome.log"') Local $sDesiredCapabilities = '{"capabilities": {"alwaysMatch": {"goog:chromeOptions": {"w3c": true }}}}' Return $sDesiredCapabilities EndFunc ;==>_SetupChrome Expand after i try the code i become now allways warnings in WinHttp.au3. all about variables are already declared/assigned in the Code Func __WinHttpHTML5FormAttribs. What does it mean?
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now