There's no problem on my local machine. But when I deployed it in cloud server specifically in Scrapinghub I need to add geckodriver
How can include geckodriver in my requirement.txt?
here's my working code
from selenium import webdriver
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.common.desired_capabilities import DesiredCapabilities
from selenium.webdriver.firefox.firefox_binary import FirefoxBinary
def parse_subpage(self, response):
profile = webdriver.FirefoxProfile()
profile.set_preference("network.proxy.type", 1)
profile.set_preference("network.proxy.http",
"localhost")
profile.set_preference("network.proxy.http_port",
3128)
profile.update_preferences()
capabilities = webdriver.DesiredCapabilities().FIREFOX
capabilities["marionette"] = True
driver = webdriver.Firefox(capabilities=capabilities,
firefox_profile=profile)
driver.get('sample.com')
driver.quit()
my Requirement.txt
mysql-connector-python
pytz==2018.9
selenium==3.13.0
geckodriver==0.24.0
Error observed:
ERROR: Could not find a version that satisfies the requirement geckodriver==0.24.0 (from -r /app/requirements.txt (line 4)) (from versions: none)