1

Currently I'm using python and its urllib2, urllib to retrieve a simple static web page. Everything was smooth until web-page developers added java scripts. Now the most interesting information is hidden behind the scripts:

<a href="javascript://" class="event-more-view" id="view-moreid-12311" onclick="Markets.applyView(this);return false;" treeid="1291266" eventstate ="false" > add table </a>

Browser preloads data and shows it when the "a href" link is clicked. The results of my short research are JSOUP and HTMLunit. Am I digging in a right direction? Any cons and pros?

Will python help? Should I be using Java? What packages can help with dynamic content? What is simpler?

In my case I have to create some sort of a virtual browser as far as built-in scripts refresh data over time which has to be processed.

Ji Len Fo
  • 61
  • 5

1 Answers1

2

You are digging in a right direction.

Here are some options/tools to consider:

See also:

Hope that helps.

Community
  • 1
  • 1
alecxe
  • 462,703
  • 120
  • 1,088
  • 1,195