After navigating to each link in the webpage,how to get list of all forms with method =post using selenium java

Question

How to continue after navigation to each url

I am struck with steps,Grab html content of the page and reg expressions to find the forms

 List<WebElement> demovar=driver.findElements(By.xpath("//a[not(contains(.,'Log Out'))]"));
   System.out.println(demovar.size());

       ArrayList<String> hrefs = new ArrayList<String>(); //List for storing all href values for 'a' tag

          for (WebElement var : demovar) {
              System.out.println(var.getText()); // used to get text present between the anchor tags
              System.out.println(var.getAttribute("href"));
              hrefs.add(var.getAttribute("href")); 
              System.out.println("*************************************");
          }

          //Navigating to each link
          int i=0;
          for (String href : hrefs) {
              driver.navigate().to(href);

              System.out.println((++i)+": navigated to URL with href: "+href);
              Thread.sleep(5000); // To check if the navigation is happening properly.
              System.out.println("+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++");

              // Grab HTML Content of the page 
           String content = getHtmlContent();


              // Reg.expression finds forms
            //  List<String> listOfForm = getAllPostMethodForms();

You should be able to grab the content without navigating to the page ( hrefs). There are variety of open source tools /jars available to do that exactly. — Sureshmani Kalirajan, Jul 31 '19 at 17:58
I need to get all form info with method =post from all the links in the application — sandy, Jul 31 '19 at 18:02

score 1 · Accepted Answer · answered Aug 01 '19 at 12:19

1

Using regular expressions for parsing HTML is not the best idea, there are way better locator strategies which can talk to DOM as it's a structured information.

For example you can go for XPath:

//form - will return all the <forms> in the page

//form[@method='post'] - will return only the ones having POST method

List<WebElement> forms driver.findElements(By.xpath("//form[@method='post']"));

answered Aug 01 '19 at 12:19

Dmitri T

159,985
5
83
133

I tried.But how do i print the html data on console? – sandy Aug 01 '19 at 14:22
1

`System.out.println(form.getAttribute("innerHtml"));` – Dmitri T Aug 01 '19 at 14:23

After navigating to each link in the webpage,how to get list of all forms with method =post using selenium java

1 Answers1