Selenium Chrome gets detected

Question

I'm trying to make a bot for https://www.phonehouse.nl/verlengchecker . But when I use Chrome it gets detected. When I use Firefox it only opens the page and doesn't do anything. I tried it on Arch linux and Windows result is the same.

from selenium import webdriver
from time import sleep

capabilities = {
  'browserName': 'chrome',
  'chromeOptions':  {
    'useAutomationExtension': False,
    'forceDevToolsScreenshot': True,
    'args': ['--start-maximized', '--disable-infobars']
  }
}    
driver = webdriver.Chrome(capabilities=capabilities)
def control(provider, number, day, month, year, post, email, street):
    
    driver.get("https://www.phonehouse.nl/verlengchecker")
    sleep(1)

    driver.find_element_by_xpath("//span[@id='businessSelectBoxIt']").send_keys(provider) #provider
    driver.find_element_by_xpath("//input[@name='msisdn']").send_keys(number) #number

Could it be because of your fast requests? Also, what is your question? — user1558604, Jul 18 '20 at 20:58
I think the question is how to stop chrome-selenium from being detected — Sabito stands with Ukraine, Jul 18 '20 at 21:07
So...is the problem your firefox version of the above isn't working? — samman, Jul 18 '20 at 23:25
Could you clarify what the website returns when it detects Selenium? — Axiumin_, Jul 19 '20 at 03:30
When it detects selenium it says refresh the page. It even starts to say it whem I make my first request. So it's not about speed. I also change my IP address so it's not an IP ban either. — enes3626, Jul 19 '20 at 07:10
When I tried to open this page using selenium, it worked. So, before trying further automation in that webpage with your code, just try to only open the webpage. You'll know if the issue is being raised by 'get' request or by further codes. — ajay sagar, Jul 19 '20 at 08:39

score 1 · Answer 1 · answered Jul 19 '20 at 18:03

Your analysis was in the right direction. Selenium driven ChromeDriver initiated google-chrome Browsing Context can easily get detected by the recaptcha.

Deep Dive

If you access the DOM Tree you will find the existance of the recaptcha.

Conclusion

Recaptcha can easily detect WebDriver initiated Browsing Context.

You can find a detailed discussion in How does recaptcha 3 know I'm using selenium/chromedriver?

However there are some generic ways to avoid detection and you can find a detailed discussion in How to bypass Google captcha with Selenium and Python?

Outro

You can find a relevant detailed discussion in:

Can a website detect when you are using selenium with chromedriver?

score 0 · Answer 2 · answered Jul 19 '20 at 18:25

Well, the "provider" space isn't an input so you can't use send_keys,

But you can use this for the number:

from selenium import webdriver
from time import sleep

driver = webdriver.Firefox()
def control(number):
    driver.get("https://www.phonehouse.nl/verlengchecker")
    sleep(1)
    driver.find_element_by_xpath('//*[@id="msisdn"]').send_keys(number)
control("000")

Selenium Chrome gets detected

2 Answers2

Deep Dive

Conclusion

Outro

Linked