Extracting dynamically rendered content in a HTML page using Java

Question

I have a HTML page like

<html>
<head>
<!-- necessary java scripts -->
</head>
<body>
<div id="content"></div>
</body>

Using the script, when the page renders, appropriate html content is placed withing the div element with id "content". So after the page renders there are a whole lot of html content withing div element.

Now i need to extract the dynamically rendered content within the div element using Java. Can anyone please suggest a way to do it?

score 1 · Accepted Answer · edited May 23 '17 at 12:06

1

The problem is that you need to evaluate script on the page in java. You need to get some web engine to do it. You can look here: Embedding Gecko/Webkit in Java And try to use webkit or gecko to load page. Then you can use some java library to parse html.

edited May 23 '17 at 12:06

Community

1
1

answered May 23 '12 at 08:33

Mikita Belahlazau

15,326
2
38
43

I implemented using SWT and it worked fine! Thanks for the link :-) – Sripaul May 24 '12 at 04:54

score 0 · Answer 2 · answered May 23 '12 at 08:28

0

You can parse html with javax.swing.text.html.HTMLEditorKit.Parser.Have a look at this link

http://java.sun.com/products/jfc/tsc/articles/bookmarks/

answered May 23 '12 at 08:28

UVM

9,776
6
41
66

score 0 · Answer 3 · answered May 23 '12 at 08:31

0

Have a look through these:

http://java-source.net/open-source/html-parsers

answered May 23 '12 at 08:31

Jack

16,506
19
100
167

Extracting dynamically rendered content in a HTML page using Java

3 Answers3