Python Selenium headless option gives "Message: element not interactable" error

Question

I'm trying to scrape a webpage to get the contact number everything works fine but i want to run the script in "--headless" mode but when i do with this option i'm getting error. But it works when i disable --headless mode.

My code :

import time
from bs4 import BeautifulSoup
from selenium import webdriver 
from selenium.webdriver.chrome.options import Options
chrome_options = Options()
chrome_options.add_argument("--headless")

#options.add_argument('--disable-gpu')  # maybe needed if running on Windows.
driver = webdriver.Chrome(executable_path='/home/dobuyme/Desktop/chromedriver', options=chrome_options)
print("Loading Page...")
driver.get('https://www.example.com')
time.sleep(5)
show_number_btn_xpath = '//span[contains(text(),"Show number")]'
sk = driver.find_element_by_xpath(show_number_btn_xpath)
sk.click()

soup = BeautifulSoup(driver.page_source,"html.parser")
title = soup.find("span", {"class": ["_truncate_multilines multiline_truncation"]}).get_text()
app = soup.find("div", {"class": ["_top_row-destop text-left"]}).find("h2").get_text().strip()
driver.quit()
contact = soup.find("div", {"class": ["_user_contact"]}).find("p", {"class": ["_call text-left"]}).get_text()
print(contact)

Error :

selenium.common.exceptions.ElementNotInteractableException: Message: element not interactable

How i can run this script in --headless mode ?

Thanks

Which line give you that error ? Is it `show_number_btn_xpath = '//span[contains(text(),"Show number")]'` ? — cruisepandey, Jun 14 '21 at 06:49
@cruisepandey he just trying to gain some points. This is exactly what he asked in his previous question and I answered him there. It's OKay :) — Prophet, Jun 14 '21 at 07:06
@Prophet : Gaining more reputation is a long term time investment here at SO. He would fed up after some time doing this. It's a fair game. — cruisepandey, Jun 14 '21 at 07:21
@SarathC. Right. Here you copy-pasted redundant code, not what I wrote you there :) — Prophet, Jun 14 '21 at 07:25
@SarathC : Stop doing if you just want to gain more reputation like this. The answer that you have given is fairly fishy. — cruisepandey, Jun 14 '21 at 07:28

score 0 · Answer 1 · answered Jun 14 '21 at 06:49

0

Finally i fixed by adding

chrome_options.add_argument("--window-size=1920,1080")
chrome_options.add_argument("--start-maximized")
chrome_options.add_argument("--headless")

answered Jun 14 '21 at 06:49

Sarath C

187
2
10

So you just re-asked your previous question and answered here what I have answered you there? – Prophet Jun 14 '21 at 07:01

Python Selenium headless option gives "Message: element not interactable" error

1 Answers1