Can any of Ruby's HTML Parsers do JavaScript to see the resulting DOM?

Question

When trying Hpricot and Nokogiri, the HTML can be fetched and parsed, but can they also execute the Javascript as well so that the content shows on the page? (shows up in the the DOM). That's because some page won't show the info unless the JavaScript initialization code has run.

score 1 · Answer 1 · answered Sep 05 '10 at 20:55

1

Not that I know of. You might want to look into using something like Watir and use a real browser.

answered Sep 05 '10 at 20:55

AboutRuby

7,936
2
27
20

score 1 · Answer 2 · edited Apr 19 '17 at 21:50

1

Take a look at envjs and johnson gems.

edited Apr 19 '17 at 21:50

Christopher Oezbek

23,994
6
61
85

answered Sep 13 '10 at 21:41

antage

1,100
7
11

score 0 · Answer 3 · answered Sep 08 '10 at 08:15

0

Have a look at Capybara. I haven't used it myself but I read about it the other day and it seems like it can execute javascript without using a browser.

answered Sep 08 '10 at 08:15

einarmagnus

3,507
1
21
31

Can any of Ruby's HTML Parsers do JavaScript to see the resulting DOM?

3 Answers3