How can I print more links from the HTML DOM using Python Selenium?

Question

Html:

<div class="xxxx">
<a href="ooooo.pdf"></a>
</div>

Python selenium code trials:

from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC
print(wait.until(EC.element_to_be_clickable((By.CSS_SELECTOR, "div.xxxx a"))).get_attribute('href'))

Output:

aaaaa.pdf

How print ooooo.pdf and aaaaa.pdf?

I want to print more links, what should I do?

See here https://stackoverflow.com/questions/34759787/fetch-all-href-link-using-selenium-in-python — Hrvoje, Apr 20 '22 at 12:33
Does this answer your question? [Fetch all href link using selenium in python](https://stackoverflow.com/questions/34759787/fetch-all-href-link-using-selenium-in-python) — Hrvoje, Apr 20 '22 at 12:34

undetected Selenium · Accepted Answer · 2022-04-22T22:45:03.583

0

element_to_be_clickable() returns a single WebElement hence href attribute of only the first matching element is printed.

Solution

To extract all the href attribute values you have to induce WebDriverWait for visibility_of_all_elements_located() and you can use either of the following locator strategies:

Using CSS_SELECTOR:

print([my_elem.get_attribute("href") for my_elem in WebDriverWait(driver, 10).until(EC.visibility_of_all_elements_located((By.CSS_SELECTOR, "div.xxxx a")))])

Using XPATH:

print([my_elem.get_attribute("href") for my_elem in WebDriverWait(driver, 20).until(EC.visibility_of_all_elements_located((By.XPATH, "//div[@class='xxxx']//a")))])

Alternative

As an alternative you can also try:

Using CSS_SELECTOR:

print([my_elem.get_attribute("href") for my_elem in driver.find_elements(By.CSS_SELECTOR, "div.xxxx a")])

Using XPATH:

print([my_elem.get_attribute("href") for my_elem in driver.find_elements(By.XPATH, "//div[@class='xxxx']//a")])

edited Apr 22 '22 at 22:45

answered Apr 20 '22 at 12:51

undetected Selenium

183,867
41
278
352

thank you okay. so what should i do? – ADAM Apr 20 '22 at 12:55
@ADAM Checkout the updated answer and let me know the status. – undetected Selenium Apr 20 '22 at 12:56
raise TimeoutException(message, screen, stacktrace) selenium.common.exceptions.TimeoutException: Message: eror :( – ADAM Apr 22 '22 at 21:38
raise TimeoutException(message, screen, stacktrace) selenium.common.exceptions.TimeoutException: Message: – ADAM Apr 22 '22 at 22:37
But the same CSS `div.xxxx a` seems to have worked for your previous [question](https://stackoverflow.com/q/71938299/7429447) for which you have accepted the [answer](https://stackoverflow.com/a/71938845/7429447) – undetected Selenium Apr 22 '22 at 22:40
Checkout the updated answer and let me know the status. – undetected Selenium Apr 22 '22 at 22:45
Thank you so muck its a work! but webcache.googleusercontent.com I came across something like this, how can I not reflect it on the screen? – ADAM Apr 22 '22 at 23:37
@ADAM I have to look into the issue in details. Feel free to raise a new question as per your new requirement. – undetected Selenium Apr 23 '22 at 00:22

How can I print more links from the HTML DOM using Python Selenium?

1 Answers1

Solution

Alternative