Jsoup Absolute Path

Question

I am struggling to get the Absolute paths for the images that I am scraping from my website. I have looked at the documentation on jsoup.org but I cannot get the abs:src to work. I don't know how to implement the abs:src or where to add it.

<cfhttp method="get" url="https://theculturecook.com/recipe-slowroasted-pork-belly.html" result="theresult">        
<cfscript>
    Jsoup = createObject("java", "org.jsoup.Jsoup");
    html = "#theresult.filecontent#";
    doc = Jsoup.parse(html);
    tags = doc.select("img[src$=.jpg]");
</cfscript>
<cfset images = "">
<cfloop index="e" array="#tags#">
    <cfoutput>
       <cfset images = ListAppend(images,#e.attr("src")#)>
    </cfoutput>
</cfloop>
<cfloop list="#images#" index="a">
    <cfoutput>#a#<br></cfoutput>
</cfloop>

Possible duplicate? https://stackoverflow.com/questions/4875064/jsoup-how-to-get-an-images-absolute-url — Scott Stroz, May 09 '20 at 15:57
I tried that solution but I am getting an error "function keyword is missing in function declaration". — Marthinus Strydom, May 09 '20 at 17:48

score 3 · Accepted Answer · answered May 09 '20 at 20:13

The issue you are facing is that you are passing html content to JSOUP. If you need absolute paths, then you need to use to following to connect.

Jsoup.connect("https://theculturecook.com/recipe-slowroasted-pork-belly.html").get();

So finally,

<cfscript>
    Jsoup = createObject("java", "org.jsoup.Jsoup");
    doc = Jsoup.connect("https://theculturecook.com/recipe-slowroasted-pork-belly.html").get();
    tags = doc.select("img[src$=.jpg]");
</cfscript>
<!--- <cfdump var="#a.attr()#" abort> --->
<cfset images = "">
<cfloop index="e" array="#tags#">
    <cfoutput>
       <cfset images = ListAppend(images, e.attr("abs:src"))>
    </cfoutput>
</cfloop>
<cfloop list="#images#" index="a">
    <cfoutput>#a#<br></cfoutput>
</cfloop>

Good point. JSoup needs a 'base' url in order to resolve relative paths within the content. Using JSoup to grab the URL directly provides that context. It could also be done manually using the overloaded method: `JSoup.parse( html, baseURL)` — SOS, May 09 '20 at 21:28

Jsoup Absolute Path

1 Answers1