Difference between revisions of "Current Projects"

From Archiveteam
Jump to: navigation, search
(Sketch to finished)
 
(37 intermediate revisions by 10 users not shown)
Line 10: Line 10:
  
 
<!-- Urgent projects -->
 
<!-- Urgent projects -->
* [[Angelfire]]: Angelfire is a web hosting service that contains big chunks of early WWW history and has no proper backup. '''IRC Channel {{IRC|angelonfire}}'''.
 
 
<!-- Long-term projects -->
 
<!-- Long-term projects -->
 
* [[URLTeam]]: URL shorteners were a fucking awful idea. '''IRC Channel {{IRC|urlteam}}'''.
 
* [[URLTeam]]: URL shorteners were a fucking awful idea. '''IRC Channel {{IRC|urlteam}}'''.
  
 
=== Scripts only ===
 
=== Scripts only ===
* [[FTP]]: Download all the FTP sites! '''IRC Channel {{IRC|effteepee}}'''.
+
* [[Bitbucket]]: Kicking the bucket on Mercurial repositories by July 1 2020 to worship Git instead. '''IRC Channel {{IRC|kickthebucket|network=hackint}}'''.
* [[NewsGrabber]]: Saving all news articles. Help with server power or by finding more news sites. '''IRC Channel {{IRC|newsgrabber}}'''.
 
  
 
== Manual projects ==
 
== Manual projects ==
 +
* [[Coronavirus|2019-2020 coronavirus outbreak]]: Documenting and preserving data, events, and impacts of the virus on society. '''IRC Channel {{IRC|coronarchive}}'''
 +
* [[Yahoo! Groups]]: Years of internet threads, soon to go private-only. '''IRC Channel {{IRC|yahoosucks|network=hackint}}'''
 
* [[ArchiveBot]]: For those with lots of disk space, bandwidth and long-term commitment. '''IRC Channel {{IRC|archivebot}}'''.
 
* [[ArchiveBot]]: For those with lots of disk space, bandwidth and long-term commitment. '''IRC Channel {{IRC|archivebot}}'''.
* [[FTP]]: Help us find all FTP sites! '''IRC Channel {{IRC|effteepee}}'''.
 
* [[INTERNETARCHIVE.BAK]]: Grab a slice of the big cake of [[Internet Archive|The Archive]]! '''IRC Channel {{IRC|internetarchive.bak}}'''.
 
* [[ISP Hosting]]: Finding ISP web hosting services before the Grim Reaper finds them. '''IRC Channel {{IRC|webroasting}}'''.
 
* [[Project Newsletter]]: Archiving e-newsletters, currently in development. '''IRC Channel {{IRC|projectnewsletter}}'''.
 
 
* [[WikiTeam]]: Saving wikis dumps (XML). And their external links for the Wayback Machine (WARC) as well as exporting MediaWiki databases. Permanent effort, [https://github.com/WikiTeam/wikiteam/wiki/Tutorial#I_have_no_shell_access_to_server everyone can help] (you choose the size of your downloads). '''IRC Channel {{IRC|wikiteam}}'''.
 
* [[WikiTeam]]: Saving wikis dumps (XML). And their external links for the Wayback Machine (WARC) as well as exporting MediaWiki databases. Permanent effort, [https://github.com/WikiTeam/wikiteam/wiki/Tutorial#I_have_no_shell_access_to_server everyone can help] (you choose the size of your downloads). '''IRC Channel {{IRC|wikiteam}}'''.
 +
* [[MP3.com]]: Digging through the WayBack Machine's archives to build a database of all the DAM CDs made available through the site.
  
== Active Projects Not Yet Ingesting ==
+
== Upcoming & proposed projects ==
 +
<!-- Websites you would like to have archived. Please create a wikipage about the project with information about the website (shutting down? (when), why should it be archived, etc.). -->
 
<!-- Top priority: could disappear anytime now -->
 
<!-- Top priority: could disappear anytime now -->
 
<!-- Shutting down, definite deadline given -->
 
<!-- Shutting down, definite deadline given -->
* [[Freeml]]: Japanese mailing list provider is sending its final email December 2nd. '''IRC Channel {{IRC|fml}}'''.
 
<!-- Other -->
 
* [[Reddit]]: Banning communities that generate bad PR for Reddit Inc. '''IRC Channel {{IRC|shreddit}}'''.
 
 
== Proposed projects ==
 
<!-- Websites you would like to have archived. Please create a wikipage about the project with information about the website (shutting down? (when), why should it be archived, etc.). -->
 
 
<!-- Shutting down, vague deadline given -->
 
<!-- Shutting down, vague deadline given -->
 +
* [[Kinja]]: Deleting all user pages, maybe? '''IRC Channel {{IRC|gokinjagokinjago}}'''.
 +
* [[Mixer]]: Video game streaming network shutting down 2020-07-23. '''IRC Channel {{IRC|mixdown|network=hackint}}'''
 +
* [[Twitter]]: Deleting inactive accounts <s>2019-12-11</s> sometime. '''IRC Channel {{IRC|twitterdead}}'''.
 
<!-- Shutting down, no deadline given -->
 
<!-- Shutting down, no deadline given -->
 
<!-- Archiving the archives -->
 
<!-- Archiving the archives -->
 
<!-- Misc. projects (unmaintained sites, distrust in owners) -->
 
<!-- Misc. projects (unmaintained sites, distrust in owners) -->
* [[Google Fusion Tables]]: Shutting down on 2019-12-3. '''IRC Channel TBD'''.
+
* [[GitHub]]: Embraced-uh, I mean, bought by Microsoft. '''IRC Channel {{IRC|gitgud|network=hackint}}'''.
 +
* [[Imgur]]: Image hoster decided that using it for hosting images is not permitted. '''IRC Channel {{IRC|imgone}}'''.
 
* [[JamiiForums]]: the Tanzanian government would like this gone. '''IRC Channel {{IRC|jammedforums}}'''.
 
* [[JamiiForums]]: the Tanzanian government would like this gone. '''IRC Channel {{IRC|jammedforums}}'''.
* [[GitHub]]: Embraced-uh, I mean, bought by Microsoft. '''IRC Channel {{IRC|getgit}}'''.
 
* [[Imgur]]: Image hoster decided that using it for hosting images is not permitted. '''IRC Channel {{IRC|imgone}}'''.
 
 
* [[LiveJournal]]: Very old, widely regarded as in decline, and has a lot of important stuff buried in it. '''IRC Channel {{IRC|recordedjournal}}'''.
 
* [[LiveJournal]]: Very old, widely regarded as in decline, and has a lot of important stuff buried in it. '''IRC Channel {{IRC|recordedjournal}}'''.
 
* [[Ownlog]]: Ownlog is losing popularity and support from its owners. '''IRC Channel {{IRC|pwnlog}}'''.
 
* [[Ownlog]]: Ownlog is losing popularity and support from its owners. '''IRC Channel {{IRC|pwnlog}}'''.
 +
* [[Reddit]]: Banning communities that generate bad PR for Reddit Inc. '''IRC Channel {{IRC|shreddit|network=hackint}}'''.
 
* [[The Pirate Bay]]: Recently came back up, grabbing an archive for sanity's sake. '''IRC Channel {{IRC|yarharfiddlededee}}'''.
 
* [[The Pirate Bay]]: Recently came back up, grabbing an archive for sanity's sake. '''IRC Channel {{IRC|yarharfiddlededee}}'''.
 
* [[Valhalla]]: Where to store what even the [[Internet Archive]] doesn't have space for? '''IRC Channel {{IRC|huntinggrounds}}'''.
 
* [[Valhalla]]: Where to store what even the [[Internet Archive]] doesn't have space for? '''IRC Channel {{IRC|huntinggrounds}}'''.
 +
* [[Giphy]]: Bought by Facebook, to be "integrated" (assimilated) into Instagram https://news.knowyourmeme.com/news/facebook-to-buy-giphy
  
 
== Recently finished projects ==
 
== Recently finished projects ==
 
<!-- put projects here that are still in the tracker but not yet deleted so it won't confuse people -->
 
<!-- put projects here that are still in the tracker but not yet deleted so it won't confuse people -->
* [[Sketch]]: Sony doesn't seem to like their user's sketches. Shut down 2019-09-30. '''IRC Channel {{IRC|SketchedOut}}'''.
+
* [[League of Legends#LoL_Boards_&_Forum|League of Legends Boards & Forum]]: Riot forcing Boards to surrender at 20 then smiting it and the forum archive on March 16th. '''IRC Channel {{IRC|archiveteam-bs}}'''.
* [[TinyPic]]: Millions of tiny pics from the late 2000s/early 2010s were scattered to the winds on September 16th <s>September 9th</s>. '''IRC Channel {{IRC|tinydick}}'''.
+
* [[8tracks]]: social network around audio streaming and creating playlists, was going to shut down 2019-12-31 but has been acquired and restored. '''IRC Channel {{IRC|8ball|network=hackint}}'''.
* [[The Artist Union]]: Staff have gone dark for some time, this site is in danger of being lost to time. '''IRC Channel {{IRC|theabandonoftheartists}}'''.
+
* [[Plays.tv]]: Stopping.tv on 2019-12-15. '''IRC Channel {{IRC|stops.tv|network=hackint}}'''.
* [[Instaud.io]]: Instaudio has started the process of shutting down, and is no longer accepting new uploads. '''IRC Channel {{IRC|nomoreaud.io}}'''.
+
* [[YouTube]]: Making playlists of liked videos private on 2019-12-05. '''IRC Channel {{IRC|down-the-tube|network=hackint}}'''.
* [[Google+]]: Google finally realised they failed. Shut down on 2019-04-02. Archive Team's largest grab to date with just short of 1.4 PiB ''(1424 TiB)'' saved. '''IRC Channel {{IRC|googleminus}}'''.
 
* [[Google Plus Comments on Blogspot]]: More content deleted during the Google+ shutdown. Comments removed from blogs starting 2019-02-04 but accessible for archiving until 2019-03-07. Approximately 30 million blogs scanned, and the comments of 181,565 blogs that contained Google+ comments were saved.
 
  
 
== Hiatus / Missed the Mark ==
 
== Hiatus / Missed the Mark ==
 +
* [[Angelfire]]: Angelfire is a web hosting service that contains big chunks of early WWW history and has no proper backup. '''IRC Channel {{IRC|angelonfire}}'''.
 +
* [[Audit2014|Audit 2014]]: It's time to verify our shit. '''IRC Channel {{IRC|auditteam}}'''. THIS PROJECT IS ON HIATUS AND WILL BE RETURNED TO AS AUDIT2018.
 
* [[Flickr]]: <s>[[Yahoo!]]</s> SmugMug decided to kill it after finding Yahoo!'s plans to do so before they were bought by Verizon. '''IRC Channel {{IRC|flickrfckr}}'''.
 
* [[Flickr]]: <s>[[Yahoo!]]</s> SmugMug decided to kill it after finding Yahoo!'s plans to do so before they were bought by Verizon. '''IRC Channel {{IRC|flickrfckr}}'''.
* [[Tumblr]]: [[Yahoo!]] considered killing it, now Yahoo has been acquired and Verizon declared war on NSFW blogs. '''IRC Channel {{IRC|tumbledown}}'''.
+
* [[Freeml]]: Japanese mailing list provider is sending its final email 2019-12-02. '''IRC Channel {{IRC|fml}}'''.
 +
* [[FTP]]: Help us find and download all FTP sites! '''IRC Channel {{IRC|effteepee}}'''.
 +
* [[Google Groups]]: "Gone within a year" ([[User:Jscott|SketchCow]], 2016-06-07).
 
* [[Google News Archive]]: Let's store all newspapers at Google, WCGW? '''IRC Channel {{IRC|papersplease}}'''.
 
* [[Google News Archive]]: Let's store all newspapers at Google, WCGW? '''IRC Channel {{IRC|papersplease}}'''.
 +
* [[DevPort]]: This [http://developerportfolio.com/ portfolio SaaS provider] has [http://www.lowendtalk.com/discussion/65135/need-some-help-saas-provider-is-dead-but-my-site-is-still-up-how-should-i-grab-it reportedly] been having infrastructure issues, and removed their social media accounts. Possible impending shutdown.
 +
* [[INTERNETARCHIVE.BAK]]: Grab a slice of the big cake of [[Internet Archive|The Archive]]! '''IRC Channel {{IRC|internetarchive.bak}}'''.
 +
* [[ISP Hosting]]: Finding ISP web hosting services before the Grim Reaper finds them. '''IRC Channel {{IRC|webroasting}}'''.
 +
* [[NewsGrabber]]: Saving all news articles. <!-- Help with server power or by finding more news sites.-->Currently paused. '''IRC Channel {{IRC|newsgrabber}}'''.
 +
* [[Project Newsletter]]: Archiving e-newsletters, currently in development. '''IRC Channel {{IRC|projectnewsletter}}'''.
 
* [[Quizlet]]: Flashcards and other learning tools '''IRC Channel {{IRC|quizletusin}}'''.
 
* [[Quizlet]]: Flashcards and other learning tools '''IRC Channel {{IRC|quizletusin}}'''.
 +
* [[Tumblr]]: [[Yahoo!]] considered killing it, now Yahoo has been acquired and Verizon declared war on NSFW blogs. '''IRC Channel {{IRC|tumbledown}}'''.
 
* [[yuku]]: Lately yuku is very unstable and hosting thousands of forums. Project currently paused. '''IRC Channel {{IRC|archiveteam}}'''.
 
* [[yuku]]: Lately yuku is very unstable and hosting thousands of forums. Project currently paused. '''IRC Channel {{IRC|archiveteam}}'''.
* [[Audit2014|Audit 2014]]: It's time to verify our shit. '''IRC Channel {{IRC|auditteam}}'''. THIS PROJECT IS ON HIATUS AND WILL BE RETURNED TO AS AUDIT2018.
 
* [[Google Groups]]: "Gone within a year" ([[User:Jscott|SketchCow]], 2016-06-07).
 
* [[DevPort]]: This [http://developerportfolio.com/ portfolio SaaS provider] has [http://www.lowendtalk.com/discussion/65135/need-some-help-saas-provider-is-dead-but-my-site-is-still-up-how-should-i-grab-it reportedly] been having infrastructure issues, and removed their social media accounts. Possible impending shutdown.
 
  
<small>ArchiveTeam uses the EFnet IRC network – irc://irc.efnet.org – webchat: http://chat.efnet.org:9090 – [[IRC|More info]]
+
<small>ArchiveTeam primarily uses the EFnet IRC network – irc://irc.efnet.org – webchat: http://chat.efnet.org:9090 – [[Archiveteam:IRC|More info]]</small><br>
 +
<small>ArchiveTeam also uses the hackint IRC network – ircs://irc.hackint.org:6697 (TLS required) – webchat: https://webirc.hackint.org/ – [[Archiveteam:IRC|More info]]

Latest revision as of 16:53, 27 June 2020

Archive Team recruiting

Warrior-based projects

Current Running Warrior Project: URLTeam 2
  • URLTeam: URL shorteners were a fucking awful idea. IRC Channel #urlteam (on EFnet).

Scripts only

  • Bitbucket: Kicking the bucket on Mercurial repositories by July 1 2020 to worship Git instead. IRC Channel #kickthebucket (on hackint).

Manual projects

  • 2019-2020 coronavirus outbreak: Documenting and preserving data, events, and impacts of the virus on society. IRC Channel #coronarchive (on EFnet)
  • Yahoo! Groups: Years of internet threads, soon to go private-only. IRC Channel #yahoosucks (on hackint)
  • ArchiveBot: For those with lots of disk space, bandwidth and long-term commitment. IRC Channel #archivebot (on EFnet).
  • WikiTeam: Saving wikis dumps (XML). And their external links for the Wayback Machine (WARC) as well as exporting MediaWiki databases. Permanent effort, everyone can help (you choose the size of your downloads). IRC Channel #wikiteam (on EFnet).
  • MP3.com: Digging through the WayBack Machine's archives to build a database of all the DAM CDs made available through the site.

Upcoming & proposed projects

Recently finished projects

  • League of Legends Boards & Forum: Riot forcing Boards to surrender at 20 then smiting it and the forum archive on March 16th. IRC Channel #archiveteam-bs (on EFnet).
  • 8tracks: social network around audio streaming and creating playlists, was going to shut down 2019-12-31 but has been acquired and restored. IRC Channel #8ball (on hackint).
  • Plays.tv: Stopping.tv on 2019-12-15. IRC Channel #stops.tv (on hackint).
  • YouTube: Making playlists of liked videos private on 2019-12-05. IRC Channel #down-the-tube (on hackint).

Hiatus / Missed the Mark

ArchiveTeam primarily uses the EFnet IRC network – irc://irc.efnet.org – webchat: http://chat.efnet.org:9090More info
ArchiveTeam also uses the hackint IRC network – ircs://irc.hackint.org:6697 (TLS required) – webchat: https://webirc.hackint.org/More info