Selenium Element not visible exception

Question

I have been tasked with writing a parser to click a button on a website and I am having issues to click only one of the buttons. The following code works on every button except one.

Here's the html: http://pastebin.com/6dLF5ru8

here's the source html: http://pastebin.com/XhsedGLb

python code:

 driver = webdriver.Firefox()  
 ...
 el = driver.find_element_by_id("-spel-nba")
 actions.move_to_element(el)
 actions.sleep(.1)
 actions.click()
 actions.perform()

I am getting this error.

ElementNotVisibleException: Message: Element is not currently visible and so may not be interacted with

as per Saifur I just tried waits with the same element not visible exception:

wait = WebDriverWait(driver, 10)
wait.until(EC.presence_of_element_located((By.XPATH, "//input[contains(@id,'spsel')][@value='nba']"))).click()

No matching class name in the html you provided. You are using wrong selector — Saifur, Jan 13 '15 at 17:48
Saifur, I just tried to edit. It's back to where it was when I first posted. — user4450305, Jan 13 '15 at 17:51
Try to use `findelements` with same selector and see how many elements it returns. I wonder if there are any hidden elements with same selector. It's a very common issue — Saifur, Jan 13 '15 at 17:58
like this: driver.find_element_by_xpath("//input[contains(@id,'spsel')][@value='nba']") — user4450305, Jan 13 '15 at 18:07
use `explcit` wait before this like `wait = WebDriverWait(driver, 10) wait.until(EC.presence_of_element_located((By.XPATH, "//input[contains(@id,'spsel')][@value='nba']")))` — Saifur, Jan 13 '15 at 18:10
is it timing out @ `EC`? and may ask the you the reason of not using `click()`? — Saifur, Jan 13 '15 at 18:24
no, it's not timing out on EC. when I click click it throws the same exception. wait.until(EC.presence_of_element_located((By.XPATH, "//input[contains(@id,'spsel')][@value='nba']"))).click() — user4450305, Jan 13 '15 at 18:28
@user4450305 Last try before I give up :) `driver = webdriver.Firefox() ... wait = WebDriverWait(driver, 10) wait.until(EC.presence_of_element_located((By.XPATH, "//div[@class='sport-selectors']//input[contains(@id,'spsel')][@value='nba']"))).click() driver.find_element_by_xpath("//div[@class='sport-selectors']//input[contains(@id,'spsel')][@value='nba']").click()` — Saifur, Jan 13 '15 at 18:56
Let me revert back to the client and tell him. Not sure if he wants it out there. — user4450305, Jan 13 '15 at 20:15
I've resolved this issue. If you look at the page source, almost all elements are dynamically created by JavaScript, which webdriver doesn't recognise them. A workaround is to inject some JavaScripts to perform an **artificial** click ;) — Anzel, Jan 13 '15 at 21:28

Anzel · Accepted Answer · 2015-01-13T23:53:35.250

43

If you look at the page source, you'll understand that almost all of theSELECT, DIV elements are faked and created from JavaScript, that is why webdriver cannot SEE them.

There's a workaround though, by using ActionChains to open your developer console, and inject an artificial CLICK on the desired element, which in fact, is the Label triggering the NBA data loading... here's a working example:

from selenium import webdriver
from selenium.webdriver.common import action_chains, keys
import time

driver = webdriver.Firefox()
driver.get('Your URL here...')
assert 'NBA' in driver.page_source
action = action_chains.ActionChains(driver)

# open up the developer console, mine on MAC, yours may be diff key combo
action.send_keys(keys.Keys.COMMAND+keys.Keys.ALT+'i')
action.perform()
time.sleep(3)
# this below ENTER is to rid of the above "i"
action.send_keys(keys.Keys.ENTER)
# inject the JavaScript...
action.send_keys("document.querySelectorAll('label.boxed')[1].click()"+keys.Keys.ENTER)
action.perform()

Alternatively to replace all the ActionChains commands, you can simply run execute_script like this:

driver.execute_script("document.querySelectorAll('label.boxed')[1].click()")

There you go, at least on my local file anyway... Hope this helps!

enter image description here

edited Jan 13 '15 at 23:53

answered Jan 13 '15 at 21:21

Anzel

19,825
5
51
52

@user4450305, no problem and I'm glad to help ;) This is actually a very tricky one, I've spent 10 mins on the Browser Inspector trying... before I looked at the page source and figured out what happened. +1 for your question. – Anzel Jan 13 '15 at 23:44
@Anzel Is `action ` multi-browser compitble? and, can you please explain the javascript part a little bit? just for my understanding – Saifur Jan 13 '15 at 23:57
1

@Saifur, yes action is multi-browser compatible, I normally use this to see all the interactive movements between code & browser, it's like a chain of actions you're seeing yourself doing directly. The **execute_script** is just a more direct way executing the javascript directly. And about the JavaScript, since the data in the site is basically manipulated by javascript and dynamically feeding the data and build the DOM. webdriver will not see them if they're either set to invisible or disabled, for example. In that case you'd want to INJECT the script to make the desire action happen – Anzel Jan 14 '15 at 00:05
I might have a similar problem: ElementNotVisibleException: error. Do you know any way to do it in Robot Framework? – Anna Jan 24 '17 at 08:19
@Anna - I haven't used Robot framework before, but notice that selenium is integrated. So in theory whatever applies to selenium should work for your Robot framework too. Let me know how you get on. – Anzel Jan 24 '17 at 08:53
@Anzel but RobotFramework uses only Selenium2 Library (written in Python) and I have no idea how to implement it. – Anna Jan 24 '17 at 10:05
@Anna - a search in SO returns [this](http://stackoverflow.com/questions/23703870/pass-existing-webdriver-object-to-custom-python-library-for-robot-framework) which may be what you're looking for. Once you get the driver handle, you can simply do `driver.execute_script("javscript code here...")` – Anzel Jan 24 '17 at 10:10
@Anzel I found RobotFramework's ExtendedSelenium2Library (https://rickypc.github.io/robotframework-extendedselenium2library/doc/ExtendedSelenium2Library.html#Execute%20Javascript), which has a keyword "Execute Javascript" that executes JS code or a whole JS file. So I will now probably just need a pure javascript code. I will try to play with it. – Anna Jan 26 '17 at 15:00
@Anzel I manage to execute javascript code with this "Execute Javascript" keyword from ExtendedSelenium2Library and now it works (despite the "WebDriverException"). JS code looks like this: `var elem = document.getElementsByClassName("MyClass")[1]; elem.click().perform(); ` Thanks for your help! – Anna Jan 27 '17 at 14:28

score 15 · Answer 2 · answered Feb 10 '15 at 23:37

What worked for me was to find the element just before the problematic one (that is, just before it in terms of tab order), then call Tab on that element.

from selenium.webdriver.common.keys import Keys
elem = br.find_element_by_name("username")
elem.send_keys(Keys.TAB) # tab over to not-visible element

After doing that, I was able to send actions to the element.

score 4 · Answer 3 · edited Jun 20 '20 at 09:12

The actual solution of this thread did not work for me.

however,

this one did :

element  = WebDriverWait(driver, 3).until(EC.visibility_of_element_located((By.XPATH, xpaths['your_xpath_path'])))

the trick is to use :

EC.visibility_of_element_located

the WebDriverWait

WebDriverWait

from this import :

from selenium.webdriver.support import expected_conditions as EC

from selenium.webdriver.support.ui import WebDriverWait

score 3 · Answer 4 · answered Jan 13 '15 at 17:57

3

I suggest you use xpath with explicit wait

//input[contains(@id,'spsel')][@value='nba']

answered Jan 13 '15 at 17:57

Saifur

16,081
6
49
73

same error:ElementNotVisibleException: Message: Element is not currently visible and so may not be interacted with – user4450305 Jan 13 '15 at 18:10
1

@Saifur, normally it should work, but on this occasion if you check the page source, almost all of the elements are faked/dynamically created by JavaScript, webdriver cannot see them – Anzel Jan 13 '15 at 21:26

score 1 · Answer 5 · answered Dec 20 '15 at 13:41

if "Element is not currently visible" then make it VISIBLE

f.e.

>>> before is hidden top is outside of page
<input type="file" style="position: absolute;top:-999999" name="file_u">


>>> after move top on in page area
DRIVER.execute_script("document.getElementByName('file_u').style.top = 0;")
time.sleep(1); # give some time to render
DRIVER.find_element_by_name("file_u").send_keys("/tmp/img.png")

score 0 · Answer 6 · answered Jul 18 '17 at 18:08

Instead of get_element_by_id() you can try elem = browser.find_element_by_css_selector('#elemId') (go to that webpage and the element, right click it and Copy CSS Selector, or something like that.) This is what i did and it works. You also try find_element_by_link_text(text), find_element_by_partial_link_text(text), find_element_by_tag_name(tagName_case_insensitive_here), find_element_by_name(name) etc. Something will work. After the id the CSS Selector is your best bet.

score 0 · Answer 7 · answered Oct 15 '18 at 17:21

I ended up using @twasbrillig's solution, but instead of finding the previous element and sending a TAB keypress, I find the desired element, send a TAB keypress with that element, and then a SHIFT + TAB keypress to the driver:

from selenium import webdriver
from selenium.webdriver.common.keys import Keys

driver = webdriver.Firefox()  
el = driver.find_element_by_id("-spel-nba")
el.send_keys(Keys.TAB)
webdriver.ActionChains(driver).key_down(Keys.SHIFT).send_keys(Keys.TAB).key_up(Keys.SHIFT)

score 0 · Answer 8 · answered Oct 25 '18 at 11:29

I tried using the other methods but in the end found that the simplest way was to just try and click the button, and catch the error. This allows me to perform other actions based on if it worked (True) or didn't (False).

def click_button(html_object):
 try:
  html_object.click()
 except:
  return False #most likely because it is NotVisible object and can be ignored
 return True

...
...
click_button(actions)

score 0 · Answer 9 · answered Apr 27 '19 at 07:25

The way I solved this in python was:

try:
    # the element you want to scroll to
    element = driver.find_element_by_id("some_id") 
    ActionChains(driver).move_to_element(element).perform()
    element.send_keys(Keys.TAB).key_up(Keys.SHIFT)
    #element.click()
except Exception as e:
    print(e)

Selenium Element not visible exception

9 Answers9

Linked

Related