A new tool named Twint allows users to scrape Twitter accounts for information without asking the user for any authentication.
A different approach has also been included in the Twitter Intelligence Tool as Twint does not utilize the Twitter API.
Twint
Twint is an advanced Twitter scraping tool written in Python that allows for scraping Tweets from Twitter profiles without using Twitter’s API.
Twint utilizes Twitter’s search operators to let you scrape Tweets from specific users, scrape Tweets relating to certain topics, hashtags & trends, or sort out sensitive information from Tweets like e-mail and phone numbers. I find this very useful, and you can get really creative with it too.
Twint also makes special queries to Twitter allowing you to also scrape a Twitter user’s followers, Tweets a user has liked, and who they follow without any authentication, API, Selenium, or browser emulation.
Twint stores the data in the following formats
- CSV
- JSON
- SQLite
- Elasticsearch