Does Phantom.js capture all AJAX?

Question

I have a backbone app that has a ton of AJAX. (each page load results in 5-6 ajax calls) because I have many views and internal views within those views,

if I run Phantom.js, can I get the final html result?

Final result is what the user sees after all my ajax calls run.

What do you mean with 'the final HTML'? Do you mean something like `document.body.innerHTML`? — 11684, Feb 10 '13 at 07:33

score 35 · Accepted Answer · answered Feb 10 '13 at 15:27

PhamtonJs is a headless WebKit with JavaScript API. When crawling a page, PhatomJs will download all dependants requests such as images, js, css... It will also executes JS and ajax calls. However the onLoaded callback is invoked when the page finishes the loading, not when there are no pending requests. So, you have to use a trick for this.

There are two way to solve the problem :

Wait until "something" effectively changed in you page (an element). The best example is waitFor.js
Wait a few seconds until no requests were received.

don't really know for node.js. But waitFor.js is a basic example of what you have to do. I'm sure you will be able to use it easily in your case. — Cybermaxs, Feb 11 '13 at 08:32

score 11 · Answer 2 · answered Feb 10 '13 at 15:07

11

Phantom.js is able to run the javascript in your page, so this should work. There is an article describing how to give crawlers nice versions of javascript sites using Phantom.js.

Be sure to give Phantom.js enough time to complete the ajax calls, as this thread describes.

answered Feb 10 '13 at 15:07

sbridges

24,960
4
64
71

there is a dead link here. you shouldn't link to stuff like that – Nicholas DiPiazza Mar 15 '18 at 16:44
A webarchive for the dead link: https://web.archive.org/web/20130117045604/http://backbonetutorials.com/seo-for-single-page-apps/ – DesTroy Apr 06 '18 at 09:11

score 1 · Answer 3 · edited May 23 '17 at 12:34

1

You can use $.active along with waitFor.js script which returns the no of active connection to a server and we need to wait for it to be 0 for all requests to be complete.

More info: jQuery.active function

edited May 23 '17 at 12:34

Community

1
1

answered Apr 26 '15 at 18:22

Naga Kiran

8,585
5
43
53

score 0 · Answer 4 · answered Mar 13 '17 at 04:21

0

If you have the access to javascript codes of the website, aside from waitFor() way, I think you can make your ajax requests synchronous. It's sometimes simpler and more accurate.

answered Mar 13 '17 at 04:21

iplus26

2,518
15
26

Does Phantom.js capture all AJAX?

4 Answers4

Linked