How we can Download a HTML Page using JAVA?

Question

How we can Download a HTML Page using JAVA??

Hi Binu, the following link should be of interest. http://stackoverflow.com/questions/2664404/retrieving-a-web-page-including-embedded-objects — James P., Jul 27 '10 at 07:35
possible duplicate of [Download file by passing URL using java code](http://stackoverflow.com/questions/2302233/download-file-by-passing-url-using-java-code) — McDowell, Jul 27 '10 at 07:37
@McDowell,@James P : sorry, i dont know that there is some other with same questions — , Jul 27 '10 at 07:41
Your question is seems to be little bit confusing whether you want to download html file from any server or you want to fetch html web page? — Rupeshit, Jul 27 '10 at 07:46
@Binu: No worries. Sometimes a question can add something to what already exists. While you're browsing around, take a look at the related section of each question. Sometimes the links there are worth a read. — James P., Jul 27 '10 at 08:03
@James : Thks James, i will check the stuff when i do next time — , Jul 27 '10 at 08:06

score 10 · Answer 1 · edited Mar 16 '14 at 04:50

10

Here is the code:

public static String savePage(final String URL) throws IOException {
    String line = "", all = "";
    URL myUrl = null;
    BufferedReader in = null;
    try {
        myUrl = new URL(URL);
        in = new BufferedReader(new InputStreamReader(myUrl.openStream()));

        while ((line = in.readLine()) != null) {
            all += line;
        }
    } finally {
        if (in != null) {
            in.close();
        }
    }

    return all;
}

Now you can process one line after one other in the while loop.

edited Mar 16 '14 at 04:50

Jared Burrows

54,294
25
151
185

answered Jul 27 '10 at 07:43

Klark

8,162
3
37
61

can i add this stuff into my MySQL? how can i do that? – Jul 27 '10 at 07:45
Of course you can. You can build some sting buffer from each line and put it in the database. – Klark Jul 27 '10 at 08:01
@akshayb - If so, why don't you add the new preferred way as a comment or modify the answer itself? – Apache Nov 19 '13 at 16:51

rlovtang · Answer 2 · 2017-02-08T12:45:04.640

2

If you have more requirements, like authentication, you can use HttpClient

edited Feb 08 '17 at 12:45

answered Jul 27 '10 at 07:52

rlovtang

4,860
2
30
30

No i just need to fetch the page and download it to my database, as for web index – Jul 27 '10 at 07:54
Ok, then HttpClient is probably overkill – rlovtang Jul 27 '10 at 07:57
I mean that you will probably do fine with SINTER's solution. You can of course use HttpClient if you like. – rlovtang Jul 27 '10 at 08:18

score 2 · Answer 3 · answered Jul 27 '10 at 07:56

2

If you can use Groovy, which compiles to java bytecode, you can fetch a page like this:

String text = new URL("http://google.com").text

answered Jul 27 '10 at 07:56

rlovtang

4,860
2
30
30

How we can Download a HTML Page using JAVA?

3 Answers3

Linked