Stack Overflow
Stack Overflow

Questions tagged [robobrowser]

RoboBrowser is a Pythonic library for automated web browsing and form handling. It is built on top of the requests and BeautifulSoup libraries.

RoboBrowser is a Pythonic library for automated web browsing. It can fetch pages, follow links handle forms. It is built on top of and , and aims to be a more modern replacement for .

122 questions
7
votes
2 answers

Login to a website via Python - how to deal with CSRF?

I'm using Python 3 for a script that will monitor updates in a user's profile on a webpage. The login to this site is protected by CSRF countermeasures, which is a good thing. However, I can't get my script to login to this site. My approach using…
Scolytus
  • 16,338
  • 6
  • 46
  • 69
6
votes
0 answers

Robobrowser and local files

I am a beginner using Python 3.6.4 and RoboBrowser 0.5.3. I have saved some HTML webpage and I am trying to pick up the information in the page. Most likely incorrectly, I took inspiration from a similar question on beautifulSoup. The beautifulSoup…
NofP
  • 161
  • 3
6
votes
1 answer

How to return html of a page using robobrowser

I'm experimenting with http://robobrowser.readthedocs.org/en/latest/readme.html, a new python library based on the beautiful soup library. I'm trying to test it out by opening an html page and returning it within a django app, but I can't figure out…
user1592380
  • 34,265
  • 92
  • 284
  • 515
5
votes
1 answer

How to submit a form with a get action using Robobrowser

I am using the robobrowser library, I have come across a form:
5
votes
2 answers

How to make POST request in robobrowser-python

http://robobrowser.readthedocs.org/en/latest/api.html I'm trying to hit an API using browser.open(myurl) and looking for a RB method similar to requests.post(url,data=data). since robobrowser built on the top of requests and beautifulsoup so I think…
Gaurav Jain
  • 1,549
  • 1
  • 22
  • 30
4
votes
2 answers

Can not submit a form with robobrowser. Invalid submit error

Here is my code: from robobrowser import browser url = 'http://diesel.elcat.kg/index.php?act=Login&CODE=00' url3 = 'http://diesel.elcat.kg/index.php?act=post&do=reply_post&f=178&t=233500064' m = browser.RoboBrowser() …
Daniiar Abdiev
  • 71
  • 1
  • 1
  • 7
4
votes
1 answer

Python - Requests/RoboBrowser - ASPX POST JavaScript

I am porting a bash script that uses curl and POSTs the payloads in the code to the URL's and works. The basic issue is that, with robobrowser, I'm running into trouble posting using the page forms. Stepping through the site: Login to…
Patrick
  • 171
  • 1
  • 7
3
votes
1 answer

Different web site response with RoboBrowser

I'm trying to retrieve the HTML for a web site. When I view the page in Chrome I see a form with dates and rate options. But when I request the site with RoboBrowser I see a short HTML response which is completely different. What I am doing…
Casey
  • 2,611
  • 6
  • 34
  • 60
3
votes
3 answers

My lyrics bot doesn't send strings to the server

I have created a lyrics bot in python. I am scrapping lyrics from genius.com using robobrowser but it's not sending the lyrics to the group. if ( parser.getCommand() == 'GroupMESG'): if(parser.getPayload().lower()[:7]=='!lyrics'): #Send…
Bharat
  • 163
  • 1
  • 2
  • 9
3
votes
2 answers

How to find element with specific parent?

I have some HTML like:
text_1
text_2
I need to find any items of cl2 class that have cl1 as parent, so i need to get text_1 but not…
GhostKU
  • 1,898
  • 6
  • 23
  • 32
3
votes
3 answers

RoboBrowser BadRequestKeyError(key)

I am trying to sign in to a website using RoboBrowser and I am stuck with a error message. My code: from robobrowser import RoboBrowser browser = RoboBrowser() def login(): browser.open('https://www.kijiji.ca/t-login.html') form =…
RojasRod
  • 31
  • 3
3
votes
1 answer

Python RoboBrowser - How to get content from this page

Im trying to submit form on page http://pretraga2.apr.gov.rs/ObjedinjenePretrage/Search/Search However im receving error (HTML) like: Error

Sorry, an error occurred…

RhymeGuy
  • 2,102
  • 5
  • 32
  • 62
3
votes
1 answer

Python RoboBrowser Automated Search Function

What is wrong with this code? It works with duckduckgo.com but not google, wikipedia, or yahoo. And yes I am changing the id according to the specific website. import re from robobrowser import RoboBrowser browser = RoboBrowser()…
mark001
  • 31
  • 2
3
votes
2 answers

Download images and pdf using python (robobrowser)

I am using robobrowser to login in to a password protected website. I am able to download html code and edit it. However, when I use following method: br = RoboBrowser(history=True) url = 'https://dummywebsite.html/dummy.pdf' br.open(url) pdf_file =…
user984201
  • 111
  • 2
  • 12
3
votes
1 answer

Python Requests Create Cookie Failure

I'm attempting to post the data of a pop-out form to a local web site. To do this I'm emulating the requests header and data and cookie information provided by the site. (Note: I am largely redacting my email and password from the code (for…
Bee Smears
  • 803
  • 3
  • 12
  • 22
1
2 3
…
8 9