Stack Overflow
Stack Overflow

Questions tagged [twint]

A scraping library for Twitter that doesn't use the Twitter API.

62 questions
7
votes
1 answer

Building Wheel For Pycares (Setup.Py) Error

This is my first time ever posting to Stack Overflow, so my apologies for any inadvertent cringe. I'm attempting to install twint on a Macbook Pro (late 2013) running macOS Mojave version 10.14.6. When I run the command: pip3 install twint==2.1.4…
iamthelabhras
  • 351
  • 2
  • 12
5
votes
1 answer

Python Twitter Scraper Without Using API

I am trying to make a Twitter Scraper using python using twint module but I think twitter block this module. When Running Twint Module I got this error. Can anyone give me any other way to scrape twitter…
Uzair Afridi
  • 51
  • 1
  • 1
  • 4
4
votes
4 answers

ImportError: cannot import name 'CeilTimeout' from 'aiohttp.helpers'

I am getting an error while importing twint. I have tried a virtual environment too. ImportError Traceback (most recent call last) C:\Users\name\AppData\Local\Temp/ipykernel_12356/3064374937.py in ----> 1 import…
kitten
  • 41
  • 1
  • 3
2
votes
0 answers

Twint for Python just stops scraping

I'm currently using Twint in Powershell from Anaconda. My python version is 3.6 and I've updated Twint just yesterday with pip3 install --user --upgrade -e git+https://github.com/twintproject/twint.git@origin/master#egg=twint I have a problem…
Ehabid lopez
  • 33
  • 5
2
votes
0 answers

How to build edges between nodes of urls?

In my code I built nodes, username, and urlsCleaned with the edges being between the username and urlsCleaned. I want to build the edges between urls to other urls(urls being the nodes). The way I want the edges to be built is if a user in the…
Steven Marsh
  • 73
  • 7
2
votes
3 answers

Python twint library is not working in Colab environment

I am trying to run a code using Python's twint library (Twitter scraper) in Colab. My code is: !pip install twint !pip install nest_asyncio !pip install pandas import twint import nest_asyncio nest_asyncio.apply() import time import pandas as…
Feyzi Bagirov
  • 1,292
  • 4
  • 28
  • 46
2
votes
1 answer

How can I create a search term for a string with random length and order of characters in Python?

I want to use the twint tool in Python to search for tweets containing all possible spellings of the word Ethiopia including exaggerations, such as ETHIOOOPIAAAA and ethiopiaaaa. So far I have tried to create a search term that is the string…
Jinx
  • 96
  • 6
2
votes
1 answer

how to scrape twitter for a whole country using twint library

Hello I want to ask a question regarding scraping tweets from the Twitter using Twint library Basically, to scrape tweet from a specific location, it is needed to put geocoded data which is consist of 'latitude, longitude, radius' So my question…
roy vinnear
  • 23
  • 4
2
votes
0 answers

Python Twitter: Check if a tweet exists by url without API

I have a list of tweets urls from the same account, and I want to check if this tweets still exist or not. A tweet may not exist anymore if twitter responds with such errors: This Tweet is from an account that no longer exists. Learn more or Sorry…
jalil_BM
  • 58
  • 1
  • 5
2
votes
1 answer

Get tweet text by IDs using twint

I have a list of tweet ids stored in a csv file, and I want to get the text content of each id, then save it with tweet ids in a csv file. This is my code but it is not working, it does not return any result. def scrape_tweets(search_ids): #…
shdotcom
  • 125
  • 1
  • 1
  • 11
1
vote
0 answers

CRITICAL:root:twint.run:Twint:Feed:noData'globalObjects'

So I recently got in a project that essentially scrapes tweets using twint library, saves the tweets in elastic search and on top of that there are some dashboards in Kibana for showing several metrics. This project has been running for the past one…
Petrina Troulitaki
  • 11
  • 2
1
vote
0 answers

Twint doesn't return the number of tweets I am specifying

Twint doesn't return the number of tweets I am specifying. Every time I run the code below I get different number which way below the limit specified in the code below import twint import pandas as pd import nest_asyncio nest_asyncio.apply() c =…
Adam Issa
  • 11
  • 1
1
vote
0 answers

Twitter Scraper Twint doesn't return all tweets

Twint is returning under the limit which I am specifying. This is the all the code Im running import twint import nest_asyncio nest_asyncio.apply() import pandas as pd c = twint.Config() c.Search = "Bitcoin" c.Limit = 10000 c.Since =…
coder888
  • 33
  • 6
1
vote
2 answers

How to reexecute if an error occurs in python?

I'm working with Twint(a Twitter scraper) but somehow there is a problem that I can't fix. I wonder if there is a way that when an error occurs, wait 1 min and re-execute this? My code is like this: import twint geos = ["40.74566208501717,…
Haotian Ma
  • 21
  • 1
  • 4
1
vote
1 answer

Tweet scraping while using Twint

I am doing some research on sentiment analysis of tweets. I have been using twint to scrape tweets from selected cities where I was getting more tweets. when I compared to scraping tweets for the whole world for the same hashtag for a duration of 5…
mohit sai
  • 11
  • 1
1
2 3 4 5