Forums.starwars.com

From Archiveteam
Revision as of 14:57, 16 January 2017 by Megalanya0 (talk | contribs) (MOTHERFUCKER ! ! !)
Jump to: navigation, search
FORUMS.STARWARS.COM
Forums.starwars.com logo
Star Wars Home Forum Homepage
Star Wars Home Forum Homepage
URL http://forums.starwars.com
Project status Offline 2011-06-03 10:10 AM PDT
Archiving status Saved! - archives
Project source Unknown
Project tracker Unknown
IRC channel #archiveteam (on EFnet)
Project lead Unknown

MOTHERFUCKER ! ! !

MOTHERFUCKER ! ! !

MOTHERFUCKER ! ! !

ArchiveStrikesBack on IRC

Please use channel #archivestrikesback for project coordination. (EFNet network.)

Preliminary discussion happened at #archivewars . (EFNet network.)

Preliminary Project Scope

Main forums.starwars.com Page Types and Preliminary Counts
Page Type File Name Preliminary Count Estimate
Announcements : ann.jspa?annID=# Uncertain (probably under 10)
Category : category.jspa?categoryID=#
category.jspa?categoryID=#&start=##
(## = 0, 15, 30, 45, etc.)
1 thru 20 each with multiple start values
Forum : forum.jspa?forumID=#
forum.jspa?forumID=#&start=##
1 thru ~193 (don't seem to be sequential)
3,500 estimate (One page for every 15 threads)
[Highly used forumID=61 has at least 1102 pages start=16515]
Messages : message.jspa?messageID=# ~2 million : according to stats on main forum page
[quick scrap found a high value of 17965717]
Profiles : profile.jspa?userID=# ???? : quick scrape found a high value of 9782310
[Seem to be sequential. Earlier # have earlier creation date]
[Random numbers do find blank error-500.jsp pages]
RSS : rss.jspa?feed=rss%2Frssmessages.jspa?forumID=# [Please confirm if these are scrape worthy]
Tag : tag.jspa?tagName=__NAME__ ???? : Quantity Unknown
[Main Star Wars terms each have their own __NAME__ tag]
Thread Message : thread.jspa?messageID=# ???? : quick scrape found a high value of 17966647
[Similar to 'message'. Maybe redundant.]
Thread Thread : thread.jspa?threadID=# 50,574 according to stats of main forum page
???? : quick scrape found a high value of 275287
Other : Folder 'dwf', 'resources' & 'scripts' have JavaScript (.js)
Folders 'images' & 'share' have .gifs
File types 'index' and a few other misc. types
Note: these are the main categories found from a quick scrape.
Possible repetition : File type 'messages' might be the same as 'thread message'

Profile Download Sheet

--It's better to use the automated script if possible, which I'll put up sometime today. :) Underscor 10:54, 11 May 2011 (UTC)

ArchiveStrikesBack members to aid in the final archive production, please list the .tar/gz/zip collections which were uploaded to the project FTP site. Thanks.

Archive Name Archive Type Size (Compressed) Size (Uncompressed) # of Profiles Volunteer
archivewars.tar.gz tar.gz 822MB 42GB 4,145,442 oli
p1900000-none295 .zip 3.5MB 12.2MB 1,022 none295
p2000000-none295 .zip 34.4MB 117.3MB 9,633 none295
p2100000-none295 .zip 41.7MB 146.7MB 12,220 none295
p2200000-none295 .zip 39.7MB 139.6MB 11,996 none295
p2300000-none295 .zip 41.5MB 146.2MB 12,136 none295
p2400000-none295 .zip 37.1MB 130.2MB 11,359 none295
p2500000-none295 .zip 36.1MB 126.6MB 11,351 none295
p2600000-none295 .zip 36.0MB 126.5MB 10,845 none295
p2700000-none295 .zip 73.4MB 257.3MB 22,964 none295
p2800000-none295 .zip 74.6MB 260.6MB 24,777 none295
p2900000-none295 .zip 78.2MB 273MB 26,001 none295
p3000000-none295 .zip 80.9MB 284.1MB 24,761 none295
p3100000-none295 .zip 94.2MB 331.6MB 27,500 none295
p3200000-none295 .zip 120.1MB 422.4MB 32,252 none295
p3300000-none295 .zip 110.9MB 389.7MB 32,457 none295
p3400000-none295 .zip 106.9MB 375.7MB 31,362 none295
p3500000-none295 .zip 147.2MB 517.7MB 43,148 none295
p3600000-none295 .zip 232.1MB 815.9MB 68,100 none295
p3700000-none295 .zip 215.2MB 754.4MB 65,731 none295
p3800000-none295 .zip 131.4MB 460.5MB 39,838 none295
p3900000-none295 .zip 132.3MB 463.4MB 40,277 none295
p4000000-none295 .zip 141.2MB 494.3MB 42,852 none295
p4100000-none295 .zip 163.5MB 571.2MB 50,526 none295
p4200000-none295 .zip 103.5MB 362.3MB 31,307 none295
p4300000-none295 .zip 34.3MB 119.9MB 10,714 none295
p4400000-none295 .zip 25.7MB 89.6MB 8,128 none295
p4500000-none295 .zip 16.1MB 55.9MB 5,540 none295
p4600000-none295 .zip 14MB 48.6MB 5,107 none295
p4700000-none295 .zip 10.9MB 37.7MB 4,160 none295
p4800000-none295 .zip 21.4MB 74.4MB 7,492 none295
p4900000-none295 .zip 56.7MB 196.3MB 21,574 none295
p5000000-none295 .zip 80.9MB 281.1MB 31,756 none295
p5100000-none295 .zip 68.3MB 241.9MB 23,931 none295
p5200000-none295 .zip 83.9MB 295.6MB 30,284 none295
p5300000-none295 .zip 73.5MB 258.2MB 25,335 none295
p5400000-none295 .zip 120.9MB 258.2MB 25,335 none295
p5500000-none295 .zip 141.8MB 499.3MB 49,410 none295
p5600000-none295 .zip 122.4MB 423.7MB 54,307 none295
p5700000-none295 .zip 129.4MB 448.3MB 56,841 none295
p5800000-none295 .zip 53.8MB 187.1MB 23,039 none295
p5900000-none295 .zip 77.6MB 269.3MB 33,928 none295
p6000000-none295 .zip 129.5MB 448.2MB 53,977 none295
p6100000-none295 .zip 135.0MB 468.4MB 55,134 none295
p6200000-none295 .zip 142MB 492.1MB 47,456 none295
p6300000-none295 .zip 43.4MB 148.4MB 13,441 none295
p6400000-none295 .zip 111.3MB 384.6MB 37,003 none295
p6500000-none295 .zip 174.3MB 606.2MB 56,402 none295
p6600000-none295 .zip 123.3MB 430.4MB 38,716 none295
p6700000-none295 .zip 89.2MB 306.3MB 27,578 none295
p6800000-none295 .zip 90.9MB 316.8MB 27,995 none295
p6900000-none295 .zip 91.2MB 317.3MB 28,353 none295
p7000000-none295 .zip 101.3MB 352.5MB 30,991 none295
p7100000-none295 .zip 124.4MB 432.8MB 38,040 none295
p7200000-none295 .zip 164.7MB 572.0MB 50,670 none295
p7300000-none295 .zip 170.2MB 588.1MB 54,685 none295
p7400000-none295 .zip 132.3MB 455.1MB 45,307 none295
p7500000-none295 .zip 134.5MB 464.0MB 48,839 none295
p7600000-none295 .zip 128.4MB 445.0MB 44,416 none295
p7700000-none295 .zip 134.3MB 465.6MB 44,844 none295
p7800000-none295 .zip 101.4MB 351.0MB 34,331 none295
p7900000-none295 .zip 146.2MB 506.3MB 48,213 none295
p8000000-none295 .zip 120.6MB 415.6MB 42,424 none295
p8100000-none295 .zip 208.9MB 717.6MB 77,140 none295
p8200000-none295 .zip 237.0MB 808.4MB 84,891 none295
p8300000-none295 .zip 210.7MB 719.7MB 71,554 none295
p8400000-none295 .zip 238.1MB 814.5MB 78,360 none295
p8500000-none295 .zip 156.3MB 531.8MB 51,561 none295
p8600000-none295 .zip 82.5MB 274.2MB 28,625 none295
p8700000-none295 .zip 88.8MB 298.9MB 30,700 none295
p8800000-none295 .zip 178.3MB 591.3MB 65,427 none295
p8900000-none295 .zip 277.2MB 912.5MB 100,000 none295
p9000000-none295 .zip 284.1MB 940.9MB 100,000 none295
p9100000-none295 .zip 289.7MB 960.1MB 100,000 none295
p9200000-none295 .zip 307.1MB 1.02GB 100,000 none295
p9300000-none295 .zip 304.5MB 1.01GB 100,000 none295
p9400000-none295 .zip 244.8MB 841.7MB 86,791 none295
p9500000-none295 .zip 112.8MB 382.7MB 36,101 none295
p9600000-none295 .zip 118.3MB 398.1MB 39,796 none295
p9700000-none295 .zip 113.2MB 381.6MB 37,372 none295
pRESWEEP-none295 .zip 96.4MB 29.0MB 412,461 none295



v · t · e         Archive Team
Current events

Alive... OR ARE THEY · Deathwatch · Projects

Archiveteam.jpg
Archiving projects

APKMirror · Archive.is · BetaArchive · Government Backup (#datarefuge · ftp-gov· Gmane · Internet Archive · It Died · Megalodon.jp · OldApps.com · OldVersion.com · OSBetaArchive · TEXTFILES.COM · The Dead, the Dying & The Damned · The Mail Archive · UK Web Archive · WebCite · Vaporwave.me

Blogging

Blog.pl · Blogger · Blogster · Blogter.hu · Freeblog.hu · Fuelmyblog · Jux · LiveJournal · My Opera · Nolblog.hu · Open Diary · ownlog.com · Posterous · Powerblogs · Proust · Roon · Splinder · Tumblr · Vox · Weblog.nl · Windows Live Spaces · Wordpress.com · Xanga · Yahoo! Blog · Zapd

Cloud hosting/file sharing

aDrive · AnyHub · Box · Dropbox · Docstoc · Google Drive · Google Groups Files · iCloud · Fileplanet · LayerVault · MediaCrush · MediaFire · Mega · MegaUpload · MobileMe · OneDrive · Pomf.se · RapidShare · Ubuntu One · Yahoo! Briefcase

Corporations

Apple · IBM · Google · Loblaw · Lycos Europe · Microsoft · Yahoo!

Events

Arab Spring · Great Ape-Snake War · Spanish Revolution

Font Repos

DaFont · Google Web Fonts · GNU FreeFont · Fontspace

Forums/Message boards

4chan · Captain Luffy Forums · College Confidential · DSLReports · ESPN Forums · forums.starwars.com · HeavenGames · Invisionfree · NeoGAF · The Classic Horror Film Board · Yahoo! Messages · Yahoo! Neighbors · Yuku.com

Gaming

Atomicgamer · Bazaar.tf · City of Heroes · Club Nintendo · Counter-Strike: Global Offensive · CS:GO Lounge · Desura · Dota 2 · Dota 2 Lounge · Emulation Zone · ESEA · GameBanana · GameMaker Sandbox · GameTrailers · Halo · HLTV.org · HQ Trivia · Infinite Crisis · joinDOTA · League of Legends · Liquipedia · Minecraft.net · Player.me · Playfire · Raptr · Steam · SteamDB · SteamGridDB · Team Fortress 2 · TF2 Outpost · Warhammer · Xfire

Image hosting

500px · AOL Pictures · Blipfoto · Blingee · Canv.as · Camera+ · Cameroid · DailyBooth · Degree Confluence Project · deviantART · Demotivalo.net · Flickr · Fotoalbum.hu · Fotolog.com · Fotopedia · Frontback · Geograph Britain and Ireland · Giphy · GTF Képhost · ImageShack · Imgh.us · Imgur · Inkblazers · Instagram · Kepfeltoltes.hu · Kephost.com · Kephost.hu · Kepkezelo.com · Keptarad.hu · Madden GIFERATOR · MLKSHK · Microsoft Clip Art · Microsoft Photosynth · Nokia Memories · noob.hu · Odysee · Panoramio · Photobucket · Picasa · Picplz · Pixiv · Portalgraphics.net · PSharing · Ptch · puu.sh · Rawporter · Relay.im · ScreenshotsDatabase.com · Snapjoy · Streetfiles · Tabblo · Tinypic · Trovebox · TwitPic · Wallbase · Wallhaven · Webshots · Wikimedia Commons

Knowledge/Wikis

arXiv · Citizendium · Clipboard.com · Deletionpedia · EditThis · Encyclopedia Dramatica · Etherpad · Everything2 · infoAnarchy · GeoNames · GNUPedia · Google Books (Google Books Ngram· Horror Movie Database · Insurgency Wiki · Knol · Lost Media Wiki · Neoseeker.com · Notepad.cc · Nupedia · OpenCourseWare · OpenStreetMap · Orain · Pastebin · Patch.com · Project Gutenberg · Puella Magi · Referata · Resedagboken · SongMeanings · ShoutWiki · The Internet Movie Database · TropicalWikis · Uncyclopedia · Urban Dictionary · Urban Exploration Resource · Webmonkey · Wikia · Wikidot · WikiHow · Wikkii · WikiLeaks · Wikipedia (Simple English Wikipedia· Wikispaces · Wikispot · Wik.is · Wiki-Site · WikiTravel · Word Count Journal

Magazines/Blogs/News

Cyberpunkreview.com · Game Developer Magazine · Gigaom · Hardware Canucks · Helium · JPG Magazine · Make Magazine · Polygamia.pl · San Fransisco Bay Guardian · Scoop · Regretsy · Yahoo! Voices

Microblogging

Heello · Identi.ca · Jaiku · Mommo.hu · Plurk · Sina Weibo · Twitter · TwitLonger

Music/Audio

AOL Music · Audimated.com · Cinch · digCCmixter · Dogmazic.net · Earbits · exfm · Free Music Archive · Gogoyoko · Indaba Music · Instacast · Jamendo · Last.fm · Music Unlimited · MOG · PureVolume · Reverbnation · ShareTheMusic · SoundCloud · Soundpedia · This Is My Jam · TuneWiki · Twaud.io · WinAmp

People

Aaron Swartz · Michael S. Hart · Steve Jobs · Mark Pilgrim · Dennis Ritchie · Len Sassaman Project

Protocols/Infrastructure

FTP · Gopher · IRC · Usenet · World Wide Web
BitTorrent DHT

Q&A

Askville · Answerbag · Answers.com · Ask.com · Askalo · Baidu Knows · Blurtit · ChaCha · Experts Exchange · Formspring · GirlsAskGuys · Google Answers · Google Baraza · JustAnswer · MetaFilter · Quora · Retrospring · StackExchange · The AnswerBank · The Internet Oracle · Uclue · WikiAnswers · Yahoo! Answers

Recipes/Food

Allrecipes · Epicurious · Food.com · Foodily · Food Network · Punchfork · ZipList

Social bookmarking

Addinto · Backflip · Balatarin · BibSonomy · Bkmrx · Blinklist · BlogMarks · BookmarkSync · CiteULike · Connotea · Delicious · Designer News · Digg · Diigo · Dir.eccion.es · Evernote · Excite Bookmark · Faves · Favilous · folkd · Freelish · Getboo · GiveALink.org · Gnolia · Google Bookmarks · Hacker News · HeyStaks · IndianPad · Kippt · Knowledge Plaza · Licorize · Linkwad · Menéame · Microsoft Developer Network · myVIP · Mister Wong · My Web · Mylink Vault · Newsvine · Oneview · Pearltrees · Pinboard · Pocket · Propeller.com · Reddit · sabros.us · Scloog · Scuttle · Simpy · SiteBar · Slashdot · Squidoo · StumbleUpon · Twine · Vizited · Yummymarks · Xmarks · Yahoo! Buzz · Zootool · Zotero

Social networks

Bebo · BlackPlanet · Classmates.com · Cyworld · Dogster · Dopplr · douban · Ello · Facebook · Flixster · FriendFeed · Friendster · Friends Reunited · Gaia Online · Google+ · Habbo · hi5 · Hyves · iWiW · LinkedIn · Miiverse · mixi · MyHeritage · MyLife · Myspace · myVIP · Netlog · Odnoklassniki · Orkut · Plaxo · Qzone · Renren · Skyrock · Sonico.com · Storylane · Tagged · tvtag · Upcoming · Viadeo · Vine · Vkontakte · WeeWorld · Weibo · Wretch · Yahoo! Groups · Yahoo! Stars India · Yahoo! Upcoming · more sites...

Shopping/Retail

Alibaba · AliExpress · Amazon · Apple Store · Barnes & Noble · DirectCanada · eBay · Kmart · NCIX · Printfection · RadioShack · Sears · Sears Canada · Target · The Book Depository · ThinkGeek · Toys "R" Us · Walmart

Software/code hosting

Android Development · Alioth · Assembla · BerliOS · Betavine · Bitbucket · BountySource · Codecademy · CodePlex · Freepository · Free Software Foundation · GNU Savannah · GitHost  · GitHub · GitHub Downloads · Gitorious · Gna! · Google Code · ibiblio · java.net · JavaForge · KnowledgeForge · Launchpad · LuaForge · Maemo · mozdev · OSOR.eu · OW2 Consortium · Openmoko · OpenSolaris · Ourproject.org · Ovi Store · Project Kenai · RubyForge · SEUL.org · SourceForge · Stypi · TestFlight · tigris.org · Transifex · TuxFamily · Yahoo! Downloads

Television/Radio

ABC · Austin City Limits · BBC · CBC · CBS · Computer Chronicles · CTV · Fox · G4 · Global TV · Jeopardy! · NBC · NHK · PBS · Penn & Teller: Bullshit! · The Howard Stern Show · TV News Archive (Understanding 9/11)

Torrenting/Piracy

ExtraTorrent · EZTV · isoHunt · KickassTorrents · The Pirate Bay · Torrentz · Library Genesis

Video hosting

Academic Earth · Bambuser · Blip.tv · Epic · Google Video · Justin.tv · Niconico · Nokia Trailers · Oddshot.tv · Plays.tv · Qwiki · Skillfeed · Stickam · TED Talks · Ticker.tv · Twitch.tv · Ustream · Videoplayer.hu · Viddler · Viddy · Vidme · Vimeo · Vine · Vstreamers · Yahoo! Video · YouTube · Famous Internet videos (Me at the zoo)

Web hosting

Angelfire · Brace.io · BT Internet · CableAmerica Personal Web Space · Claranet Netherlands Personal Web Pages · Comcast Personal Web Pages · Extra.hu · FortuneCity · Free ProHosting · GeoCities (patch· Google Business Sitebuilder · Google Sites · Internet Centrum · MBinternet · MSN TV · Nifty · Nwnyet · Parodius Networking · Prodigy.net · Saunalahti Iso G · Swipnet · Telenor · Tripod · University of Michigan personal webpages · Verizon Mysite · Verizon Personal Web Space · Webzdarma · Virgin Media

Web applications

Mailman · MediaWiki · phpBB · Simple Machines Forum · vBulletin

Information

A Million Ways to Die on the Web · Backup Tips · Cheap storage · Collecting items randomly · Data compression algorithms and tools · Dev · Discovery Data · DOS Floppies · Fortress of Solitude · Keywords · Naughty List · Nightmare Projects · Rescuing floppy disks · Rescuing optical media · Site exploration · The WARC Ecosystem · Working with ARCHIVE.ORG

Projects

ArchiveCorps · Audit2014 · Emularity · Faceoff · FlickrFckr · Froogle · INTERNETARCHIVE.BAK (Internet Archive Census· IRC Quotes · JSMESS · JSVLC · Just Solve the Problem · NewsGrabber · Project Newsletter · Valhalla · Web Roasting (ISP Hosting · University Web Hosting· Woohoo

Tools

ArchiveBot · ArchiveTeam Warrior (Tracker· Google Takeout · HTTrack · Video downloaders · Wget (Lua · WARC)

Teams

Bibliotheca Anonoma · LibreTeam · URLTeam · Yahoo Video Warroom · WikiTeam

Other

800notes · AOL · Akoha · Ancestry.com · April Fools' Day · Amplicate · AutoAdmit · Bre.ad · Circavie · Cobook · Co.mments · Countdown · Discourse · Distill · Dmoz · Easel · Eircode · Electronic Frontier Foundation · FanFiction.Net · Feedly · Ficlets · Forrst · FunnyExam.com · FurAffinity · Google Helpouts · Google Moderator · Google Reader · ICQmail · IFTTT · Jajah · JuniorNet · Lulu Poetry · Mobile Phone Applications · Mochi Media · Mozilla Firefox · MyBlogLog · NBII · Neopets · Quantcast · Quizilla · Salon Table Talk · Shutdownify · Slidecast · Stack Overflow · SOPA blackout pages · starwars.yahoo.com · TechNet · Toshiba Support · USA-Gov · Volán · Widgetbox · Windows Technical Preview · Wunderlist · YTMND · Zoocasa

About Archive Team

Introduction · Philosophy · Who We Are · Our stance on robots.txt · Why Back Up? · Software · Formats · Storage Media · Recommended Reading · Films and documentaries about archiving · Talks · In The Media · FAQ