Is it possible to get more than 100 tweets?

Question

Is it possible to get more than 100 tweets using the Twitter4j API?
If so can anyone point out the way to do so??

@NarendraPathai I am..the default counts to 100. I tried using a loop and querying multiple times but I'm getting the same set of 100 tweets repeatedly.. that's why I am asking if there actually is a way? — Nithish Inpursuit Ofhappiness, Jul 26 '13 at 18:03

Luke Willis · Accepted Answer · 2013-07-26T18:18:45.383

Would need to see your code to provide a code example specific to your case, but you can do this through since_id or max_id.

This information is for the Twitter API.

To get the previous 100 tweets:

find the the lowest id in the set that you just retrieved with your query
perform the same query with the max_id option set to the id you just found.

To get the next 100 tweets:

find the the highest id in the set that you just retrieved with your query
perform the same query with the since_id option set to the id you just found.

In Twitter4j, your Query object has two fields that represent the above API options: sinceId and maxId.

set max_id to max_id-1, otherwise, you will get the last tweet twice — Fabien, May 19 '17 at 10:39

score 4 · Answer 2 · answered Oct 08 '13 at 07:37

You can't load more than 100 tweet per request but i don't know why you want this, instead you can load all tweets in "Endless page" i.e loading 10 items each time the user scroll a list .

for example

Query query = new Query("stackoverflow");
query.setCount(10);// sets the number of tweets to return per page, up to a max of 100
QueryResult  result = twitter.search(query);

now if you want to load the next page simple easy

if(result.hasNext())//there is more pages to load
{
query = result.nextQuery();
result = twitter.search(query);
}

and so on.

This solution would be the most convenient. Unfortunately this solution doesn't seem to work with every query. If your query has special characters, e.g. `Query query = new Query("*");` then `result.nextQuery()` does not correctly encode them leading to an error "could not authenticate you" from the twitter api. — asmaier, Dec 04 '14 at 12:11

score 4 · Answer 3 · answered Apr 18 '14 at 20:59

Some Java code that iterates to older pages by using lowest id might look like:

Query query = new Query("test");
query.setCount(100);

int searchResultCount;
long lowestTweetId = Long.MAX_VALUE;

do {
    QueryResult queryResult = twitterInstance.search(query);

    searchResultCount = queryResult.getTweets().size();

    for (Status tweet : queryResult.getTweets()) {

        // do whatever with the tweet

        if (tweet.getId() < lowestTweetId) {
            lowestTweetId = tweet.getId();
            query.setMaxId(lowestTweetId);
        }
    }

} while (searchResultCount != 0 && searchResultCount % 100 == 0);

score 4 · Answer 4 · answered Nov 23 '14 at 06:27

Here is how to get ALL tweets for a user (or at least up to ~3200):

import java.util.*;
import twitter4j.*;
import twitter4j.conf.*;

ConfigurationBuilder cb = new ConfigurationBuilder();
cb.setOAuthConsumerKey("");
cb.setOAuthConsumerSecret("");
cb.setOAuthAccessToken("");
cb.setOAuthAccessTokenSecret("");

Twitter twitter = new TwitterFactory(cb.build()).getInstance();

int pageno = 1;
String user = "cnn";
List statuses = new ArrayList();

while (true) {

  try {

    int size = statuses.size(); 
    Paging page = new Paging(pageno++, 100);
    statuses.addAll(twitter.getUserTimeline(user, page));
    if (statuses.size() == size)
      break;
  }
  catch(TwitterException e) {

    e.printStackTrace();
  }
}

System.out.println("Total: "+statuses.size());

score 2 · Answer 5 · answered Jul 27 '13 at 13:39

2

To add to Luke's approach Twitter4j does provide pagination to the queries. You can try fetching more than one pages for your query. Set results per page and the page number.

But I suggest first try the since_id and then try pagination.

answered Jul 27 '13 at 13:39

rishi

2,564
6
25
47

score 1 · Answer 6 · answered Apr 03 '19 at 21:20

When you get a response containing your first 100 results, you also get the next id with the response. This id can be used as a query parameter "next"= {the id you received from the previous call} while making the call again and it will give you the next 100 tweets.

score 0 · Answer 7 · answered Jan 29 '14 at 15:04

For a given query it is possible to extract more than 100 tweets. For a quick demo you can download a twitter GUI application for tweet extraction available at http://preciselyconcise.com/apis_and_installations/tweets_extraction_from_twitter.php.

By extracting query results from all available pages for that query, you will be able to extract more than 100 tweets if available under that query. I downloaded the GUI application available in that website and i was able to extract more than 1000 tweets for query #happy.

Is it possible to get more than 100 tweets?

7 Answers7

To get the previous 100 tweets:

To get the next 100 tweets:

Linked