How do I write a ruby web crawler which uses chrome?

Question

I have a ruby web crawler that is currently coded to run in firefox. How do I switch it over to Chrome instead?

def open_browser()
  tweaked_profile = Selenium::WebDriver::Firefox::Profile.new
  tweaked_profile['nglayout.initialpaint.delay'] = 0
  tweaked_profile.assume_untrusted_certificate_issuer=false
  tweaked_profile['permissions.default.image'] = 2
  tweaked_profile['network.proxy.type'] = 1
  tweaked_profile['network.proxy.http'] = 'ec2proxy.csnzoo.com'
  tweaked_profile['network.proxy.http_port'] = 8080
  driver = Selenium::WebDriver.for :firefox, :profile => tweaked_profile
  $browser = Watir::Browser.new(driver)
end

Should I just ditch watir and go with chromedriver or will watir work for this?

chromedriver is alive, it's what lets webdriver drive a chrome browser... I think maybe you meant chromewatir? — Chuck van der Linden, Apr 18 '13 at 22:18

score 3 · Answer 1 · edited May 23 '17 at 12:04

3

Check out http://watirwebdriver.com/chrome/, which has this example:

profile = Selenium::WebDriver::Chrome::Profile.new
... 
b = Watir::Browser.new :chrome, :profile => profile

Also, these SO questions provide alternatives for crawling sites: Web crawler in ruby and What are some good Ruby-based web crawlers?

edited May 23 '17 at 12:04

Community

1
1

answered Apr 17 '13 at 19:28

orde

5,233
6
31
33

How do I write a ruby web crawler which uses chrome?

1 Answers1