Can't locate elments within shadow-root (open) using Python Selenium

Question

I'm trying to get the content under Signers, Counter Signers and X509 Signers from https://www.virustotal.com/gui/file/03d1316407796b32c03f17f819cca5bede2b0504ecdb7ba3b845c1ed618ae934/details

from selenium import webdriver
op = webdriver.ChromeOptions()
op.add_argument('headless')
driver = webdriver.Chrome(executable_path="/Desktop/chromedriver", options=op)
details_url = "https://www.virustotal.com/gui/file/03d1316407796b32c03f17f819cca5bede2b0504ecdb7ba3b845c1ed618ae934/details"

driver.get(details_url)
element = driver.find_element_by_xpath("/html/body/vt-ui-shell")
print(element.text)

The result doesn't include the parts under Signers, Counter Signers and X509 Signers

result

I also tried to do

driver.find_element_by_xpath("//*[@id="details"]//div/vt-ui-signature-info//vt-ui-expandable/span")

to locate that part, but it ended up giving me

NoSuchElementException: Message: no such element: Unable to locate element

Joanna it's under #shadow-root(open). You have to grab the shadow root and proceed from there. — Arundeep Chohan, Dec 25 '20 at 04:17
@ArundeepChohan Yes I noticed that. but how do I locate stuff under #shadow-root? — Joanna, Dec 25 '20 at 04:18
https://stackoverflow.com/questions/37384458/how-to-handle-elements-inside-shadow-dom-from-selenium This is what you need to do. — Arundeep Chohan, Dec 25 '20 at 04:46

PDHide · Answer 1 · 2020-12-25T06:09:54.840

2

element=driver.execute_script(
    "return document.querySelector('body file-view').shadowRoot.querySelector('vt-ui-file-details').shadowRoot.querySelector('vt-ui-signature-info').shadowRoot.querySelector('vt-ui-expandable').shadowRoot.querySelector('[class=\"details\"]')")

this prints the signature version information , similarly you have to find the rool and call shadowroot and find the element for other roots

https://bitsofco.de/what-is-the-shadow-dom/

Shadow dom is not part of document so you have to use javascript executor to find elements inside it

edited Dec 25 '20 at 06:09

answered Dec 25 '20 at 05:12

PDHide

18,113
2
31
46

2

Can you explain why did not you try an xpath/css selector here? – vitaliis Dec 25 '20 at 05:41
@vitaliis you can use locator to find the first element but after that you have to return the shadowRoot from it – PDHide Feb 15 '21 at 20:37

score 0 · Accepted Answer · answered Dec 25 '20 at 23:37

The Signers fields e.g. Microsoft Windows are within nested #shadow-root (open).

Solution

To extract the text Microsoft Windows you have to use shadowRoot.querySelector() and you can use the following Locator Strategy:

Code Block:

driver.get('https://www.virustotal.com/gui/file/03d1316407796b32c03f17f819cca5bede2b0504ecdb7ba3b845c1ed618ae934/details')
print(driver.execute_script("return document.querySelector('file-view').shadowRoot.querySelector('vt-ui-file-details').shadowRoot.querySelector('vt-ui-signature-info').shadowRoot.querySelector('vt-ui-expandable-detail').shadowRoot.querySelector('slot')").text)

Console Output:
```
Microsoft Windows
```

References

You can find a couple of relevant discussions in:

Thank you so much for your help! I tried it and it worked well. However, I kinda need everything in the signature part and I'm still having a hard time. I edited my post, can you please help me? Thanks in advance! — Joanna, Dec 26 '20 at 14:53
@Joanna Sounds like a completely different issue all together. Can you raise a new question as per your new requirement? Stackoverflow contributors will be happy to help you out. — undetected Selenium, Dec 26 '20 at 18:02
Done! Thanks. This is my new question post https://stackoverflow.com/questions/65462625/cant-locate-specific-elements-using-python-selenium-and-shadowroot-queryselecto — Joanna, Dec 27 '20 at 03:24

Can't locate elments within shadow-root (open) using Python Selenium

2 Answers2

Solution

References

Linked

Related