1

With WebClient.DownloadString method it's fairly simple to load normal web page source to string.

But is there any easy way to load those pages which extends and loads new content when you scroll down to end?

John Saunders
  • 160,644
  • 26
  • 247
  • 397
darx
  • 1,417
  • 1
  • 11
  • 25
  • I have edited your title. Please see, "[Should questions include “tags” in their titles?](http://meta.stackexchange.com/questions/19190/)", where the consensus is "no, they should not". – John Saunders Oct 16 '14 at 14:29
  • No you cannot do this with webclient.. but you can try internet explorer or webkit.net or see the ajax request being created using scroll down event – sm.abdullah Oct 16 '14 at 14:29

2 Answers2

1

You cannot "download" such a page, as it doesn't exist in full form. Such pages require user interaction.

You can use one of the forms of the WebBrowser control to browse to, and programmatically interact with a web site.

John Saunders
  • 160,644
  • 26
  • 247
  • 397
1

hey you can try this approach if you want to do it webclient.. See here.. basically he is using the scrapy but this approach can be adopted in case of webclient to i think so.

basically he is using the firebug or chrome developer tool in order to trace the ajax web request after knowing the web request you can get the content with webclient.

Community
  • 1
  • 1
sm.abdullah
  • 1,777
  • 1
  • 17
  • 34