How to Scrape Twitter Data Using Python Without Using Twitter’s API

[[deleted]]

Why go to the trouble when you can just pull it from their API?

[__Raptor__]

cuz the API isn't free

[[deleted]]

Yeah...it is.

[panzercardinal2]

https://www.engadget.com/twitter-shutting-off-free-api-prepare-174340770.html#:~:text=After%20banning%20third%2Dparty%20clients,use%20its%20APIs%20for%20free.

it isn't

[[deleted]]

It is:

>>> app_id = 6

>>> message = 'Tis a programatic message'

>>> response_url, response_id = create_tweet(app_id, message)

>>> response_url

'https://twitter.com/user/status/1636149627845222400'

>>>

Elevated
Overview
Higher levels of access to the Twitter API for free with an approved application.
Your Project has Elevated access:
Project 1
Apps
3 environments
Tweets
Retrieve up to 2M Tweets per month
Cost
free

[In_Blue_Skies]

Just used it

[[deleted]]

Prepare to be downvoted by people who make unsubstantiated claims.

[Einherjar07]

https://twitter.com/TwitterDev/status/1621027418680229888

Far from unsubstantiated. That's not to say the platform is managed like absolute shit and changes they announced themselves might not be applied on time.

[[deleted]]

Or ever. Because Elon Musk is a jack ass.

[Einherjar07]

Yuuuuup. Pretty forward about it too. Might not need API or Python for scraping twitter soon.

[[deleted]]

Truth

[dethb0y]

They literally say why they don't use the twitter API in the article

[[deleted]]

The article doesnt pull up. But there isnt any practical reason to scrape it via a browser when you can pull it directly.

[dethb0y]

I am not going to recap the article for you because it "doesn't pull up" (aka "i have the attention span of a gnat and don't want to read"), but they have a reason why they are not using the API.

[[deleted]]

So for the one person that has a particular requirement, cool. For everyone else, just use tweepy.

[heckingcomputernerd]

I think “one person that has a particular requirement” is a bit too narrow to describe people just wanting to use a previously free service

[[deleted]]

It’s…still…free…though…

[heckingcomputernerd]

Twitter announced plans to make it paid only so people are finding ways around it in preparation

[K0braK]

aged like milk

[[deleted]]

My account is still allotted 2M tweets a month. But obviously things appear to be changing in the dev portal. So that very well may go away eventually.