Access html text through python selenium

Question

I am trying to get text (marked by hashtags).

<div class="XYZ">
        <h5>
    "
          #######Reports due by##############
    "
          <span class="hbl" data-hint="task due date">
            <i class="icon-boxy-sign"></i>
          </span>
        </h5>
        <script type="jsv#61^"></script><script type="jsv#123_"></script>
        <script type="jsv#60^"></script><script type="jsv#124_"></script>
      <script type="jsv#59^"></script><p>#################07/10/2020#######################</p><script type="jsv/125^"></script>
    <script type="jsv/52_"></script><script type="jsv/24^"></script>
        <script type="jsv/42_"></script><script type="jsv/23^"></script>
      </div>

Python line to get the text inside the hashtags:

txt = dat =wait(driver, 10).until(EC.visibility_of_element_located((By.CSS_SELECTOR, 'div[class="XYZ"]'))).text

I expect the line to print: "Reports due by" and "07/10/2020, I keep getting timeoutException and Unable to locate element errors.

Try `div.XYZ` instead of `div[class="XYZ"]` (see [class selector docs](https://www.w3schools.com/cssref/sel_class.asp)) — Eric Reed, Sep 10 '19 at 21:35
div.XYZ not working either. And I don't think that python syntax! — Mixter, Sep 10 '19 at 21:50

score 1 · Accepted Answer · answered Sep 11 '19 at 08:07

Seems you were close. To extract the text (marked by hashtags) you have to induce WebDriverWait for the visibility_of_element_located() and you can use either of the following Locator Strategies:

Using CSS_SELECTOR:

print(WebDriverWait(browser, 20).until(EC.visibility_of_element_located((By.CSS_SELECTOR, "div.XYZ"))).get_attribute("title"))

Using XPATH:

print(WebDriverWait(browser, 20).until(EC.visibility_of_element_located((By.XPATH, "//div[@class='XYZ']"))).get_attribute("title"))

Note : You have to add the following imports :

from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC

Here you can find a relevant discussion on selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element while trying to click Next button with selenium

I have the correct imports. Neither expression above works for this particular situation. CSS_SELECTOR returns NONE Type, and XPATH times out! Is there a way to access the strings by their tags?
and
. I think that's the only hope left. — Mixter, Sep 11 '19 at 11:45
I also have the correct wait "from selenium.webdriver.support.ui import WebDriverWait as wait" thanks — Mixter, Sep 11 '19 at 11:52
Marking this solution because it shows good response effort, and will help others. Thanks. — Mixter, Sep 18 '19 at 11:22

score 0 · Answer 2 · answered Sep 10 '19 at 21:34

0

Change By. CSS_SELECTOR to By.XPATH and update locator to '//div[@class='XYZ']'. Should work.

answered Sep 10 '19 at 21:34

IPolnik

619
5
13

Tried: (By.XPATH, '//div[@class='XYZ']). No Luck! – Mixter Sep 10 '19 at 21:40

Access html text through python selenium

2 Answers2

and