WikiTeam

From Archiveteam
Revision as of 14:50, 6 December 2011 by Emijrp (Talk | contribs)
Jump to: navigation, search
We save wikis, from Wikipedia to tiniest wikis
130+ wikis saved to date
WikiTeam
WikiTeam logo
WikiTeam, a set of tools for wiki preservation and a repository of wikis
WikiTeam, a set of tools for wiki preservation and a repository of wikis
URL http://code.google.com/p/wikiteam
Project status Online!
Archiving status In progress...
Project source Unknown
Project tracker Unknown
IRC channel #wikiteam

Welcome to WikiTeam. A wiki is a website that allows the creation and editing of any number of interlinked web pages, generally used to store information on a specific subject or subjects. This is done with a day-to-day web browser using a simplified markup language (HTML as an example) or a WYSIWYG (what-you-see-is-what-you-get) text editor.

Examples of huge wikis:

There are also several wikifarms with hundreds of wikis.

Most of the wikis don't offer public backups. How bad!

Contents

Tools and source code

Official WikiTeam tools

Other


Wiki dumps

For a more detailed list, visit the download section on Google Code.

There is another site of MediaWiki dumps located here on Scott's Website. More dumps are available as a collection in the Internet Archive.

TODO lists:

Legend
     Good
     Could be better
     Bad
     Unknown
Wiki Wiki is online? Dumps available? (official or home-made) Comments/Details Saved by us? Who? Where?
Anarchopedias Yes Official: no. Home-made: Yes - idiolect
Archive Team Wiki Yes Official: no. Home-made: yes - WikiTeam
Bulbapedia Yes Official: no. Home-made: no - dr-spangle is working on it with a self-built PHP downloader
Citizendium Yes Official: daily (no full history). Home-made: yes, April 2011 No image dumps available -
EditThis Yes Official: no. Home-made: in progress - -
enciclopedia.us.es Yes Official: no. Home-made: no Sysop sent me page text sql tables emijrp
Encyclopedia Dramatica No Official: no. Home-made: partial WebEcology Project Article Dump (~9000 Articles)
Most of the Images probably Lost
-
Encyclopedia Dramatica.ch
(new ED)
Yes Official: ? Home-made: ? Slowly being rebuilt from old sources.
Should be up for a while but for who knows how long?
-
Gentoo wikis Yes Official: no. Home-made: yes - WikiTeam
GNUpedia No Official: no. Home-made: no No database. This "wiki encyclopedia" was only HTML pages. Only ~3 articles were sent to the mailing list. After that, the project was closed -
MeatBall Yes Official: no. Home-made: yes (mirror) No histories, no xml format SDBoyd
Metapedia Yes Official: ?. Home-made: no - -
Neoseeker aka Scout wikis Yes Official: ?. Home-made: no - -
Nupedia No Official: ?. Home-made: Yes, saved from IA - -
OmegaWiki Yes Official: daily - -
OpenStreetMap Yes Official: Yes. Home-made: no - -
OpenSUSE wikis Yes Official: no. Home-made: yes - Hydriz
OSDev Yes Official: weekly - Not yet
TV Tropes Yes Official: No Unofficial: In progress No dump mechanism, using wget -nc -r -p -l 0 -np -w 45 -E -k -T 10 -nv -x "http://tvtropes.org" DoubleJ
Uncyclomedias - - - -
Wikanda Yes Official: no. Home-made: yes - emijrp
Wikia Yes Official: on demand No image dumps available Not yet
WikiFur Yes Official: yes No image dumps available Not yet
WikiHow - - - -
Wikimedia Commons Yes Official: periodically No image dumps available Not yet
Wikipedia Yes Official: periodically No image dumps available. English Wikipedia dump uses to be very old Not yet
Wiki-site.com - - - -
WikiTravel Yes Official: not yet. Home-made: yes, another of 2010-06-14 - WikiTeam
WikiWikiWeb Yes Home-made: yes - Ca7
(o:forum Yes No - Not yet, to figure out how
WikiWiki.de Yes No - Not yet, to figure out how
GruenderWiki Yes No - Not yet, to figure out how

Tips

Some tips:

  • When downloading Wikipedia/Wikimedia Commons dumps, pages-meta-history.xml.7z and pages-meta-history.xml.bz2 are the same, but 7z use to be smaller (better compress ratio), so use 7z.

BitTorrent downloads

A feed of BitTorrent downloads is available for the latest files posted to the WikiTeam Google Code Downloads.

Files under 1 MB are blocked on the service generating these torrents (Burnbit.com), so not every file is available as a torrent. There may be some delay after a file is uploaded before the torrent appears on the feed. You can subscribe to this feed in your BitTorrent client for automatic downloads (this has been tested successfully in µTorrent on Windows).

Mirrors

  1. Sourceforge (also mirrored to another 26 mirrors)
  2. Internet Archive (direct link to directory)

Closing/In danger

External links


[view]  [edit]                   Archive Team                  
Current events Alive... OR ARE THEY · Deathwatch · Projects · Download available archives
Archiveteam.jpg
Archiving projects Archive.is · BetaArchive · Internet Archive · It Died · OldApps.com · OldVersion.com · OSBetaArchive · TEXTFILES
The Dead, the Dying & The Damned · UK Web Archive · WebCite
Blogs/website hosts Angelfire · Blog.pl · Blogger · Blogster · Brace.io · EtherPad · FortuneCity · Free ProHosting · Fuelmyblog · GeoCities (patch) · Google Business Sitebuilder · Google Sites · ISP Hosting · Jux · LiveJournal · My Opera · Open Diary · Ownlog · Posterous · Prodigy.net · Proust · Roon · Splinder · Swipnet · Tripod · Verizon Mysite · Verizon Personal Web Space · Vox · Windows Live Spaces · Wordpress.com · Xanga · Yahoo! Blog · Zapd
Cloud hosting/file sharing services AnyHub · Box · Dropbox · Google Drive · Google Groups Files · iCloud · MediaCrush · MediaFire · Mega · MegaUpload · MobileMe · OneDrive · RapidShare
Corporations Apple · IBM · Google · Microsoft · Yahoo!
Events Arab Spring · Occupy movement · Spanish Revolution
Font Repos Google Web Fonts · GNU FreeFont · Fontspace
Image hosting services Canv.as · Camera+ · Cameroid · Flickr · Fotopedia · Geograph Britain and Ireland · ImageShack · Imgur · Instagr.am · Madden GIFERATOR · MLKSHK · Microsoft Clip Art · Nokia Memories · Odysee · Panoramio · Photobucket · Picasa · Picplz · Ptch · puu.sh · Relay.im · Snapjoy · TwitPic · Wallbase · Webshots · Wikimedia Commons
Knowledge/Wikis arXiv · Citizendium · Edit.This · Encyclopedia Dramatica · Everything2 · infoAnarchy · GeoNames · GNUPedia · Google Books · Insurgency Wiki · Knol · Nupedia · OpenCourseWare · OpenStreetMap · Orain · Patch.com · Project Gutenberg · Puella Magi · Referata · SongMeanings · ShoutWiki · The Internet Movie Database · The Pirate Bay · TropicalWikis · Urban Dictionary · Webmonkey · Wikia · Wikidot · WikiHow · Wikkii · WikiLeaks · Wikipedia (Simple English Wikipedia) · Wikispaces · Wik.is · Wiki-Site · WikiTravel
Microblogging Heello · Identi.ca · Jaiku · Plurk · Sina Weibo · Tumblr · Twitter · TwitLonger
Music/Audio Audimated.com · digCCmixter · Dogmazic.net · exfm · Free Music Archive · Gogoyoko · Indaba Music · Jamendo · Last.fm · MOG · PureVolume · Reverbnation · ShareTheMusic · SoundCloud · Soundpedia · Twaud.io
People Aaron Swartz · Michael S. Hart · Steve Jobs · Mark Pilgrim · Dennis Ritchie · Len Sassaman Project
Q&A Askville · Answerbag · Answers.com · Ask.com · Askalo · Baidu Knows · Blurtit · ChaCha · Experts Exchange · Formspring · GirlsAskGuys · Google Answers · Google Questions and Answers · JustAnswer · MetaFilter · Quora · StackExchange · The AnswerBank · The Internet Oracle · Uclue · WikiAnswers · Yahoo! Answers
Social bookmarking Addinto · Backflip · Balatarin · BibSonomy · Bkmrx · Blinklist · BlogMarks · BookmarkSync · CiteULike · Connotea · Delicious · Digg · Diigo · Dir.eccion.es · Evernote · Excite Bookmark · Faves · Favilous · folkd · Freelish · Getboo · GiveALink.org · Gnolia · Google Bookmarks · Hacker News · HeyStaks · IndianPad · Kippt · Knowledge Plaza · Licorize · Linkwad · Menéame · Microsoft Developer Network · Microsoft TechNet · Mister Wong · My Web · Mylink Vault · Newsvine · Oneview · Pearltrees · Pinboard · Pocket · Reddit · sabros.us · Scloog · Scuttle · Simpy · SiteBar · Slashdot · Squidoo · StumbleUpon · Twine · Vizited · Yummymarks · Xmarks · Yahoo! Buzz · ZipList · Zootool · Zotero
Social networks Bebo · BlackPlanet · Classmates.com · Cyworld · deviantART · Dogster · Dopplr · douban · Ello · Facebook · Flixster · Friendster · Gaia Online · Google+ · Habbo · hi5 · Hyves · LinkedIn · Miiverse · mixi · MyHeritage · MyLife · Myspace · Netlog · Odnoklassniki · Orkut · Plaxo · Qzone · Renren · Skyrock · Sonico.com · Tagged · Upcoming · Viadeo · Vkontakte · WeeWorld · Weibo · Wretch · Yahoo! Groups · Yahoo! Neighbors · Yahoo! Stars India · more sites...
Software/code hosting services Android Development · Alioth · Assembla · BerliOS · Betavine · Bitbucket · BountySource · Codecademy · CodePlex · Freepository · Free Software Foundation · GNU Savannah · GitHub · GitHub Downloads · Gitorious · Gna! · Google Code · ibiblio · java.net · JavaForge · KnowledgeForge · Launchpad · LuaForge · Maemo · mozdev · OSOR.eu · OW2 Consortium · Openmoko · Ourproject.org · Ovi Store · Project Kenai · RubyForge · SEUL.org · SourceForge · TestFlight · tigris.org · Transifex · TuxFamily · Yahoo! Downloads
Video hosting services Academic Earth · Blip.tv · Epic · Google Video · Justin.tv · Nokia Trailers · TED Talks · Ustream · Viddler · Viddy · Vimeo · Vstreamers · Yahoo! Video · YouTube
Other 4chan · Akoha · Ancestry.com · April Fools' Day · Amplicate · Circavie · Club Nintendo · Cobook · Co.mments · Countdown · Distill · Dmoz · Easel · Electronic Frontier Foundation · Emulation Zone · ESPN Forums · FanFiction.Net · Feedly · Ficlets · FriendFeed · forums.starwars.com · FunnyExam.com · FurAffinity · Game Developer Magazine · Gopher · Google Books Ngram · Google Helpouts · Google Reader · Halo · IFTTT · isoHunt · Jajah · Lulu Poetry · Mailman · Minecraft.net · Mochi Media · Mozilla Firefox · MyBlogLog · NBII · Pastebin · Propeller.com · Quantcast · Quizilla · RadioShack · Salon Table Talk · Scoop · Slidecast · SOPA blackout pages · starwars.yahoo.com · Windows Technical Preview · World Wide Web
Teams Bibliotheca Anonoma · LibreTeam · URLTeam · Yahoo Video Warroom · WikiTeam
About Archive Team Introduction · Philosophy · Who We Are · Why Back Up? · Software · Films and documentaries about archiving · Formats · Cheap storage · Storage Media · Recommended Reading · FAQ
Personal tools