Stack Overflow
Stack Overflow

Questions tagged [spynner]

Spynner is a stateful programmatic web browser module for Python with Javascript/AJAX support based upon the QtWebKit framework.

Homepage: https://github.com/makinacorpus/spynner

70 questions
6
votes
1 answer

How to run a POST request programmatically in python with a GUI ? (spynner, webkit...)

I have a web site with flash forms that I need to scrape. Instead of filling the flash forms, I would like to POST some keys/values to the URL that doesn't support GET requests. I use spynner to interact with the site, and spynner can have a GUI,…
Gilles Quénot
  • 173,512
  • 41
  • 224
  • 223
4
votes
2 answers

Python six library error while using spynner

I installed python, pip and easy_install on my computer. and with pip command installed spynner but i've got an error with autopy installation, but i solved it by using easy_install and after installation, i tried to use spynner but it give me an…
Peter Yang
  • 43
  • 4
4
votes
2 answers

QtWebKit - Userscript/Javascript Injection

I've been doing testing work in Python using QtWebkit/Spynner. As QtWebKit has Javascript support just like Chrome's Webkit, is it possible to inject a userscript or a piece of javascript at the beginning of a page just like you would a regular user…
Dustin
  • 6,207
  • 19
  • 61
  • 93
3
votes
0 answers

Spynner install issues

Running Mac OS Lion I was trying to do some scraping with Mechanize but I was having massive issues with javascript. So, after some browsing I decided to try out Spynner. I've tried to download it with both pip and easy_install but I get the same…
Matt
  • 3,508
  • 6
  • 38
  • 66
3
votes
1 answer

Installing Spynner on Heroku

I'm trying to use Python's spynner module in a Heroku app, but I'm having trouble getting it working on Heroku. I obviously have it in my requirements.txt and that's fine, even installing lxml with no problem, but I run into a problem with PyQt4. …
jdotjdot
  • 16,134
  • 13
  • 66
  • 118
2
votes
1 answer

AttributeError: 'Browser' object has no attribute 'manager' when test spynner

I'm trying to use spynner to auto-click some button in the HTML source code as a small test. But I'm receiving this error. Traceback (most recent call last): File "build\bdist.win32\egg\spynner\browser.py", line 287, in _on_reply AttributeError:…
Zhuoyi
  • 21
  • 2
2
votes
0 answers

Spynner -- No Module named cookielib

I have written the below mentioned basic script using Python Spynner. It works fine when running through IDLE. However, when I try to convert it into exe using Pyinstaller and run the exe, It gives me the following error. ImportError: No module…
Md. Mohsin
  • 1,822
  • 3
  • 19
  • 34
2
votes
1 answer

Spynner module on python 3

I used python's 2to3.py to do the fixing on spynner module. Then there seemed to be an issue with QString on python 3. I modified the browser.py in spynner with QString = str as some users suggested. For a start I tried the following code import…
feminkk
  • 1,135
  • 2
  • 14
  • 18
2
votes
2 answers

Spynner: get html of second page after submitting form

I have just started using Spynner to scrape webpages and am not finding any good tutorials out there. I have here a simple example where I type a word into Google and then I want to see the resulting page. But how do I go from clicking the button…
user984003
  • 28,050
  • 64
  • 189
  • 285
2
votes
1 answer

Monitoring for Program Crash

I'm currently working with the Python module Spynner for automating some web tasks. I've run in to a problem though where for some reason the process would just simply stop moving, freeze but still be responsive according to Windows. What I'd like…
Dustin
  • 6,207
  • 19
  • 61
  • 93
1
vote
1 answer

How to set the application name in spynner/PyQt4?

I have had searched the web to find the way to put a name in the top of a PyQt4 application border. I saw setCaption() method ( like in http://nullege.com/codes/search/PyQt4.QtGui.QDialog.setCaption ) but I don't know how to use it and if it's…
Gilles Quénot
  • 173,512
  • 41
  • 224
  • 223
1
vote
2 answers

'str' object is not callable

Not quite understanding why I am getting this trace error: Traceback (most recent call last): File "S:/Personal Folders/Andy/Python Projects/Salesforce BZ API/Automated Reports.py", line 15, in parse = br.soup("find('div')") File…
Steven Matthews
  • 9,705
  • 45
  • 126
  • 232
1
vote
1 answer

changing spynner User Agent doesnt work

We're having the following situation: We need to access a site which need to be accessed only with MSIE. For this reason, we must change the spynner User Agent, because this is not MSIE by default. Here is my code: import re import spynner from…
Marcelo Parra
  • 11
  • 1
1
vote
0 answers

how to load pages without static resources using spynner?

I need to load pages using spynner, But I don't need to load images(.png/.jpg/.gif) and css(.css)。Is there any way to avoid loading these files? Thanks.
friday
  • 31
  • 3
1
vote
0 answers

How can I pass the cookies to spynner.Browser in scrapy?

I tried to crawl the web, but it has to run the js to get the page full loaded. I used spynner.Browser in the middleware as follows. The problem is the web I'm trying to crawl needs cookie enabled. How can I pass the cookies to spynner.Browser in…
EthanZhang
  • 23
  • 4
1
2 3 4 5