How can I get URLs from HTML page?

[pushkar_nagle]

Hi,

I would like to extract URLs from below HTML code:

I am writing a script which automatically sends an email with URLs from the above code.

Code I have written so far is:

Local $oForm = _IEFormGetObjByName($oIE, "aspnetForm")
Local $oTag = _IEFormElementGetObjByName($oForm, "ctl00$middleContentPlaceHolder$ctrlAssets$ctrlWebsites$websiteLoginView$cpeURLs_ClientState")
Local $URL = _IEPropertyGet($oTag, "innertext")

 

Edited October 2, 2017 by pushkar_nagle

[Jules]

You mean you want the URL of the current page displayed by your browser ? (in this case, Internet Explorer)

If so, just use the built-in function  _IEPropertyGet like this :

_IEPropertyGet($oIE, "locationurl")

where $oIE is your Internet Explorer object.

That will return a String containing the URL of the page IE is currently displaying.

[pushkar_nagle]

No, I want URLs mentioned in href of above HTML code.

[AutoBert]

Use _StrinBetween:

#include <String.au3>
#include <Array.au3>

Global $sMyFile = @ScriptDir & '\MyHtmlTest.html'
$sText=FileRead($sMyFile)
$aLinks=_StringBetween($sText,"a href='","'",$STR_ENDNOTSTART)
$aLinks = _ArrayUnique($aLinks)
_ArrayDisplay($aLinks)

 

[Jules]

Assuming all your href attributes belong to <a> tags, you can indeed use AutoBert's solution.

There is also this solution that should work :

; Get a collection of all the <a> tags on the document
Local $aTagsCollection = _IETagNameGetCollection($oIE, "a")

; Loop through those tags
For $aTag In aTagsCollection
    
    ; You get the 'href' attribute
    $href = $aTag.href
    
    ; Then do whatever you want with the 'href' attribute
    ; ...
    
Next

 

[AutoBert]

using the IE.au3 i suggest _IELinkGetCollection  will be easiest solution.

[pushkar_nagle]

Above codes are providing all the links in the document.

I want Links from only the HTML code I have pasted above.

[AutoBert]

16 minutes ago, pushkar_nagle said:

Above codes are providing all the links in the document.

I want Links from only the HTML code I have pasted above.

It provide all links you have in your html-snippet, but you have to tell him this:

; Open blank browser and insert a htmlsnipet, get link collection
; loop through items and display the associated link URL references

#include <IE.au3>
#include <MsgBoxConstants.au3>

$sSnipet=FileRead('HTML.txt')

$oIE=_IECreate()
_IEBodyWriteHTML($oIE,$sSnipet)
ConsoleWrite('_IEBodyWriteHTML error: '&@error&' extended: '&@extended&@CRLF)
 $oLinks = _IELinkGetCollection($oIE)
 $iNumLinks = @extended

 $sTxt = $iNumLinks & " links found" & @CRLF & @CRLF
For $oLink In $oLinks
    $sTxt &= $oLink.href & @CRLF
Next
MsgBox($MB_SYSTEMMODAL, "Link Info", $sTxt)
_IEQuit($oIE)

the file html.txt contains your HTML code I have pasted above.

[pushkar_nagle]

Apologies, if I am not clear enough.

HTML code I pasted above is a part of a document which contains many links.

But I want links that exist under table ID 'ctl00_middleContentPlaceHolder_ctrlAssets_ctrlWebsites_websiteLoginView_grdURLs'.

I have written a code below to get all table tags and then selecting above particular tag. Then it will get 'a' tags from this table and will display links.

But its not giving any output. Is this the correct way?

 

Edited October 2, 2017 by pushkar_nagle

[AutoBert]

as there is only a placeholder for future urls, you have to trigger the event filling the placeholder with real urls. Therefore the URL or at least the complete source of the site to automate is needed.

[pushkar_nagle]

Attached complete source of the page.

Edited October 2, 2017 by pushkar_nagle