TalkTalk

From Archiveteam
Revision as of 12:14, 14 August 2018 by JustAnotherArchivist (talk | contribs) (Added web.onetel.com and web.onetel.net.uk)
Jump to navigation Jump to search
TalkTalk
TalkTalkLogo.png
URL TalkTalk - Broadband, Fibre, TV and Calls[IAWcite.todayMemWeb]
Status Closing (personal web space)
Archiving status In progress... (personal web space)
Archiving type Unknown
IRC channel #talkbork (on hackint)

TalkTalk plc is a company which provides television, telecommunications, Internet access, and mobile network services to businesses and consumers in the United Kingdom.[1]

Personal Webspace Closure

In early 2018, TalkTalk announced that their customer webspace was closing down[2]:

An update about our Webspace service

We regularly review our products to make sure we’re providing only the best value and service to our customers, which is why we’ve decided to remove Webspace and focus on the innovation of our core products.

Webspace will no longer be available from 16th July; however we’ve teamed up with Wix – one of the largest online website builders – to give you a great offer and support you if you want to move your website. Simply create a Wix account and you’ll be able to rebuild your website with a fresh design and brand new features.

Like TalkTalk, Wix offers a free service; and if you’d like to use a premium plan which includes your own domain name, you’ll be able to take advantage of our exclusive TalkTalk discount.

This webspace serves a lot of old web 1.0 websites holding history, e.g. family history sites, war memorials, local businesses, and village cricket teams.

Although the shutdown was announced for 2018-07-16, the sites appear to still be online as of 2018-07-21. As of 2018-07-26, everything redirects to a notice which states that the webspace is being shut down; the original content can still be accessed by appending a showpage=true parameter to the URL. According to the notice, final deletion is planned for 2018-08-10[3]:

From 16th July we'll no longer offer Webspace, and we'll be shutting down our Webspace platform by the 10th August. If you are the owner of this Webspace and want your content to remain on the web after this date, you'll need to move it to a new platform.

Find out more about how to move your content on our FAQ page.

TalkTalk exists as a result of historic takeovers, mergers, and the rebranding of defunct ISPs from as early as the 1990s. As a consequence of this, TalkTalk inherited and is responsible for managing the webspace data of several domains. A forum post from a representative is useful for determining the quantity of webspace disappearing. A rough back-of-the-envelope estimate using search results indicates over 100,000 sites.

Grabbing Webspace

To gather a rough picture of the amount of sites, or at least sites indexed by search engines, we can perform a site:http://... search engine query, which outputs the following rounded results.

Closing Domain Google Results Bing Results
http://website.lineone.net/~USERNAME/ 11,000 13,000
http://myweb.tiscali.co.uk/USERNAME/ 54,000 36,000
http://www.USERNAME.dsl.pipex.com/ 14,000 15,000
http://www.USERNAME.talktalk.net/ 51,000 25,000
http://users.tinyworld.co.uk/USERNAME/ N/A N/A
http://users.tinyonline.co.uk/USERNAME/ N/A N/A
http://www.USERNAME.screaming.net/ N/A N/A
http://www.USERNAME.homecall.co.uk/ N/A N/A
http://www.USERNAME.ukgateway.net/ N/A N/A
http://www.USERNAME.worldonline.co.uk/ N/A N/A
http://homepages.nildram.co.uk/~USERNAME/ N/A N/A
http://www.USERNAME.nildram.co.uk/ N/A N/A
http://web.onetel.com/~USERNAME N/A N/A
http://web.onetel.net.uk/~USERNAME N/A N/A

Notes:

Ideas

  • Scrape search engines for full page URLs and extract deduplicated base URLs (in the format of the previous section)
  • For every URL found: curl http://web.archive.org/save/[URL]
  • Use Wayback API to gather list of already partially archived images or pages/base URLs
  • Archive the base URL recursively.
  • Older (lineone, tiscali and pipex era) sites should likely take priority. These are often old and very "web 1.0".

Archival

Based on DNS History (with obvious rubbish filtered out), 96 subdomains of talktalk.net and 517 subdomains of dsl.pipex.com were archived through ArchiveBot job:bbjyy6chn3i3h1jbdc6ya3nm0 and job:4738iqfdngwdloyi7ye541u06, respectively. However, many of these sites did not actually exist, and this is only a very small part of the total webspace.

From scraping Bing and other sources, further ArchiveBot jobs were run for 2088 additional talktalk.net subdomains (job:9490x1sgho1s9hr4p6ki1v6cq, job:6pwm5oyomcfdbtmy7qifydepj, and job:biywpihh8lxd77uisihkwczzl), 723 additional dsl.pipex.com subdomains (job:8qwxayost81j0p78k4hflp5a4), 518 website.lineone.net sites/directories (job:61r3cgx9plfxe95pldp4bfvnf), and 1281 myweb.tiscali.co.uk sites/directories (job:9sw3f9v1f9pzpfcf9mao5ubn4).

References