Headless browser with full javascript support for java

Question

I have been using HtmlUnit (the developers did a great job) as an headless browser for some of my previous applications but the javascript support isn't working for some website that my next application will be accessing.

I heard about QtWebKit binding for Python but my application will be in Java or is there a Java binding for WebKit or QtWebKit?
Does anyone know a good headless browser for Java with full javascript support?

I'm also in a similar situation. I use HTMLUnit but the JS on some sites don't work on it. Did you find an alternative that works? — Arya, Mar 20 '13 at 16:59
@John.which headless browser did you used in your java Application. — BasK, Feb 12 '15 at 04:02

score 10 · Answer 1 · edited May 23 '17 at 11:53

Nathan Ridley's answer to another similar question is the most complete one I've found so far.

Anyway, if everything fails, you could use a Python or JS alternative, expose its funcionality as a webservice inside your server, and then your Java application could use the headless browser's funcionality through the webservice. It would be a pain to set up, but it may be a viable alternative if nothing else works as desired.

Also, there are some "non-headless" browser wrappers for Java; maybe it would be possible to build a testing solution around those, depending on the requirements.

score 6 · Answer 2 · answered Feb 24 '16 at 07:09

6

Perhaps https://github.com/machinepublishers/jbrowserdriver -- it's headless and written only in Java.

(disclosure: I'm the project owner)

answered Feb 24 '16 at 07:09

Dan

736
8
12

1

I am currently using JBrowserDriver for one of my projects as well – I can totally recommend it. – philonous Feb 14 '17 at 20:20

score 4 · Answer 3 · answered Jul 24 '12 at 16:00

4

Take a look at phantom.js. Based on webkit it offers a complete headless browser.

answered Jul 24 '12 at 16:00

Sirko

72,589
19
149
183

10

Is there a Java binding for QtWebKit? – John Jul 24 '12 at 16:11
[Separate Question](http://stackoverflow.com/questions/19759421/any-java-equivalent-to-phantomjs) or [Selenium GhostDriver](https://github.com/detro/ghostdriver) – Jan Wasserbauer May 13 '15 at 13:13

score 3 · Answer 4 · answered Jul 24 '12 at 16:18

3

Rhino + env.js is a full java solution, I've used it, it's not super fast but seems reasonably stable and should give you correct js support.

answered Jul 24 '12 at 16:18

Simone Gianni

11,426
40
49

score 1 · Answer 5 · answered Jan 21 '17 at 06:15

1

Replying on an old thread, hoping it might be useful for some.

1) You can use QTJambi's QWebView. It was reasonably fast.

2) JBrowserDriver is another option.

Personally I found QT engine a bit faster.

answered Jan 21 '17 at 06:15

Sreenivasulu Sigharam

11
1

score 0 · Answer 6 · edited Oct 27 '20 at 21:34

How about a built-in webview. I'm not sure about full JS support, but a quick check on the website shows that it can support javascript.

JavaFX WebView: JFX WebView

     private static void initWebView(Stage primaryStage) {
        primaryStage.setTitle("JavaFX WebView Example");
        WebView webView = new WebView();
        //webView.getEngine().load("http://localhost:9009");
        webView.getEngine().loadContent("<h3 id='aa'>JAVA FX WebView, HelloWorld</h3><script>document.getElementById('aa').innerHTML='TEST'</script>");
        webView.getEngine().setJavaScriptEnabled(true);
        VBox vBox = new VBox(webView);
        Scene scene = new Scene(vBox, 960, 600);
        primaryStage.setScene(scene);
        primaryStage.show();
    }

And not related to the question, but also take a look at this: Java-Express or NanoHttpd

The combination may help somebody.

Headless browser with full javascript support for java

6 Answers6

Linked