save to html from every url

[vinnyMS1]

i have "https://wannabuy-4088.myshopify.com/products/"

and a text list file with more url to add after "/products/"

 

like "products/christmas-tree-sweater-99929" from the "url" text file list

 

the wanted result is: /folder/christmas-tree-sweater-99929.html

 

 

url.txt

[argumentum]

so, are you the owner of the site or just wanna scrape it ?
do you know HTML ?
what is this for ?, what do you wanna do with this ?, what's the end goal ?

[Subz]

@argumentum Shopify is an online shopping cart host, that anyone can join.  It appears he wants Vinny wants to prepend and append too each line of text.

@vinnyMS1

Couple of quick examples:

#include <Array.au3>
#include <File.au3>
Global $g_sPrefix = "/products/"
Global $g_sSuffix = ".html"

;~ Example 1
Global $g_aURLs
_FileReadToArray(@ScriptDir & "\url.txt", $g_aURLs)
If @error Then Exit MsgBox(4096, "Error", "Unable to read url.txt to Array")
_ArrayDisplay($g_aURLs, "Before Changes")
For $i = 1 To $g_aURLs[0]
    $g_aURLs[$i] = $g_sPrefix & $g_aURLs[$i] & $g_sSuffix
Next
_ArrayDisplay($g_aURLs, "After Changes")

;~ Example 2
$sURLs = $g_sPrefix & StringRegExpReplace(FileRead(@ScriptDir & "\url.txt"), "(?:\r\n|\n)", $g_sSuffix & @LF & $g_sPrefix & "$1") & $g_sSuffix
ConsoleWrite(StringReplace($sUrls,"/products/.html", "") & @CRLF)

 

[vinnyMS1]

i want to download each page and save it as a html file

from https://wannabuy-4088.myshopify.com/products/christmas-tree-sweater-99929

to christmas-tree-sweater-99929.html on local folder

 

i'm going to create a new website with html files but no buy option

Edited September 29, 2022 by vinnyMS1

[Werty]

Maybe use a tool that is already tailored for such tasks, like HTTrack, it copies your website and saves it locally.

https://www.httrack.com/

You can use filters, here's a short guide.

https://www.httrack.com/page/20/en/index.html