Wait- Expected conditions not working for auto-suggestion within Yahoo Finance page using Selenium and Java

Question

Below code is not able to identify the list of webelements if they are identified inside a wait condition. I get an exception as timeoutexception and unable to identify the element for the specified xpath.

However if I directly access the elements without wait condition , the values are assigned to the list Variable, why is this so?

WebDriverManager.chromedriver().setup();
WebDriver driver = new ChromeDriver();
driver.get("https://www.finance.yahoo.com");
driver.manage().window().maximize();
driver.findElement(By.xpath("//input[@id='yfin-usr-qry']")).sendKeys("nclh");

WebDriverWait wait = new WebDriverWait(driver,5);
List<WebElement>dd_list= wait.until(ExpectedConditions.visibilityOfAllElementsLocatedBy(By.xpath("//ul[@class='modules_list__1zFHY']/li")));
System.out.println(dd_list.size());

for(WebElement ele : dd_list) {

    if (ele.getText().contains("NCLH.VI")) {
        System.out.println("i got the element");
    }
}

keepAlive · Answer 1 · 2020-11-18T20:13:09.953

1

why is this so?

The elements that you are targeting are never all visible simultaneously. Your xpath returns 15 elements, of which only 10 are visible. Implying that your condition will never be met (hence the timeout exception). Simply refine your xpath so as to target the elements you are interested in: the ones that have vocation to be visible, e.g. "//ul[@class='modules_list__1zFHY']/li[@data-type='quotes']"

edited Nov 18 '20 at 20:13

answered Nov 18 '20 at 17:37

keepAlive

6,369
5
24
39

if i directly print the values without wait, then it gets assigned to the List variable, which means they are loaded right? – my3rddimension Nov 18 '20 at 17:38
@my3rddimension Right! – keepAlive Nov 18 '20 at 17:47
so that means , there is nothing wrong with the xpath, why is it failing when i put inside a wait condition – my3rddimension Nov 18 '20 at 17:50
@my3rddimension See my edit. Do you see what I mean ? – keepAlive Nov 18 '20 at 17:53
Thank you, i got it now.. thanks so much for your response and time.. really helped me to understand explicit wait conditions better – my3rddimension Nov 18 '20 at 19:38

score 0 · Answer 2 · answered Nov 18 '20 at 18:19

The Yahoo Finance website contains ReactJS enabled elements. So you need to induce WebDriverWait for document.readyState to be complete and you can use the following Locator Strategies:

Code Block:

driver.get("https://www.finance.yahoo.com");
new WebDriverWait(driver, 120).until(webDriver -> ((JavascriptExecutor) webDriver).executeScript("return document.readyState").equals("complete"));
WebElement element = new WebDriverWait(driver, 20).until(ExpectedConditions.elementToBeClickable(By.xpath("//input[@id='yfin-usr-qry']")));
element.click();
element.sendKeys("nclh");
System.out.println(new WebDriverWait(driver, 20).until(ExpectedConditions.visibilityOfAllElementsLocatedBy(By.xpath("//ul[@class='modules_list__1zFHY']//li[@data-type='quotes']"))).size())

Console Output:
```
6
```
Browser Snapshot:

Wait- Expected conditions not working for auto-suggestion within Yahoo Finance page using Selenium and Java

2 Answers2