0

In a docker in a gitlab CI I am running a very short test code with python selenium

from selenium import webdriver
from selenium.webdriver.chrome.options import Options

chrome_options = Options()
        
chrome_options.add_argument("--headless")
chrome_options.add_argument('--no-sandbox')
chrome_options.add_argument('--disable-dev-shm-usage')
chrome_options.add_argument('--start-maximized')
driver = webdriver.Chrome(options=chrome_options)

driver.quit()

But it fails with the error

selenium.common.exceptions.WebDriverException: Message: <!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd">
<html><head>
<meta type="copyright" content="Copyright (C) 1996-2016 The Squid Software Foundation and contributors">
<meta http-equiv="Content-Type" CONTENT="text/html; charset=utf-8">
<title>ERROR: The requested URL could not be retrieved</title>
<style type="text/css"><!-- 
 /*
 * Copyright (C) 1996-2016 The Squid Software Foundation and contributors
....

Used packages:

  • selenium 4.0.0
  • chrome browser 92.0.4515.107
  • chromedriver 92.0.4515.43

Anything I can try to fix this problem?

HINT

The error appears when trying to get the selenium driver!!

Alex
  • 41,580
  • 88
  • 260
  • 469

2 Answers2

0

This mean you can't access to the targeted URL ("https://www.google.com"). Check if you don't have any proxy (Running Selenium Webdriver with a proxy in Python) needed on your network or a VPN running.

Guillaume Grabé
  • 42
  • 2
  • Thanks for that, but unfortunately the answers provided in the other question do not work. I get an error "Specifying 'socksProxy' requires an integer for 'socksVersion'". – Alex Oct 18 '21 at 10:46
  • I tried to set a proxy via "chrome_options.add_argument('--proxy-server=server:port')", but I still get thjs same error. – Alex Oct 18 '21 at 10:54
  • I also get the error when I try to create the webdriver, NOT when I try to connect to an URL. I have updated the question!! Your answer is definitively wrong. – Alex Oct 18 '21 at 11:11
0

The problem is that selenium 4.0.0 seems to have a bug with respect to the proxy. Do not use selenium 4.0.0, use 3.141.0.

Possible related ticket: https://github.com/SeleniumHQ/selenium/issues/9925

Alex
  • 41,580
  • 88
  • 260
  • 469