Talk:Twitter

From Archiveteam
Jump to: navigation, search

Maybe we should ask the US Government for that Twitter backup? --BlueMaxima 15:33, 24 January 2011 (UTC)

I don't believe they care enough. --ATrescue (talk) 01:50, 30 April 2019 (UTC)

Archiving tweet metadata as well.

Do the current methods of saving tweets (i.e. snscrape (see on GitHub)) also include metadata such as tweet source tags?[1][2]

snscrape

The snscrape method puts the last 3200 (due to API limits) tweets of the archival target user into a URL list, uploaded to https://transfer.sh/ or https://transfer.notkiska.pw/ and feeds it into ArchiveBot using !a < http://example.com/URL-list.txt and also archives tweet replies because the URL list contains them as well.
ArchiveBot also saves it into the Wayback Machine, which is great.

chromebot

Another archival method is chromebot: a https://twitter.com/username or also chromebot: a https://twitter.com/search?q=from:username (without “from:” when also including tweet replies and tweets mentioning the user in the thread).

But chromebot's infinite scroll might not reach as many tweets as snscrape, and even fewer from the targeted account when other tweets are in the search results as well.

In case of controversies, chromebot: a https://twitter.com/search?q=to:username should be used as well.

Tweet Metadata

Because both chromebot and archivebot rely on Twitter's web interface, the amount of tweet metadata captured might be very limited.
Here are several documentations about Twitter's metadata API:

There should be a way to mass-grab this metadata as well. --ATrescue (talk) 01:49, 30 April 2019 (UTC)

snscrape grabs the entire history, not just the last 3200 tweets. But it doesn't include retweets. --JustAnotherArchivist (talk) 01:54, 10 May 2019 (UTC)

References