What is the best way to archive (spider) a site that is going to be removed?

Posted by Guy on Super User See other posts from Super User or by Guy
Published on 2010-04-22T14:34:53Z Indexed on 2010/04/22 14:44 UTC
Read the original article Hit count: 304

Filed under:

blogs

|

archive

|

spider

Three different blogs that I read have recently announced that they are going to be discontinued and removed from the web. Although the archived pages will probably be in Google's cache for a few weeks after they've gone and some of the pages will be in the Way Back Machine I'd like to archive those sites to my hard disk for future reference.

What is the best way to do this? Is there any software that transforms a blog (e.g. Blogspot) into a chronological PDF?

© Super User or respective owner

Related posts about blogs

SEO Practices - Comments on Blogs

as seen on Ezine Articles - Search for 'Ezine Articles'
I have been creating web pages for some time and have spent considerable time researching SEO (Search Engine Optimisation) techniques, and as the owner of several blogs have always wondered about one of the techniques. Quoted from the results of a recent Google search on "SEO Blog Comments": >>> More
Search JDeveloper Related Blogs Extension

as seen on Oracle Technology Network - Search for 'Oracle Technology Network'
Search JDeveloper blogs from inside JDeveloper >>> More
How to Build a Tagging System For Blogs

as seen on Ezine Articles - Search for 'Ezine Articles'
In this article I will cover the basics of how to create a tagging system as seen on other blogs. This system will also have the function of adjusting font size depending on the number of articles that have said tag. >>> More
6 PhotoBlog Portfolio WordPress Themes

as seen on Just Skins - Search for 'Just Skins'
It’s been quite a long time since we showcased the recent free WordPress themes on JustSkins.Some cool WordPress themes have been made in recent times that you may use for your photo portfolio blog. The following list contains both free and the premium WordPress themes. If you happen to be a… >>> More
List of blogs - year 2010

as seen on ASP.net Weblogs - Search for 'ASP.net Weblogs'
This is the last day of year 2010 and I would like to add links to all blogs I have posted in this year. First, I would like to mention that I started blogging in ASP.NET Community in May / June 2010 and have really enjoyed writing for my favorite technologies, such as: ASP.NET, jQuery/JavaScript… >>> More

Related posts about archive

Cannot update, apt-get cannot fetch index files

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
I have a fresh install of Ubuntu 11.10 from the iso 'ubuntu-11.10-desktop-amd64.iso'. I installed this in VMWare Fusion 4.1.1 running on OSX 10.7.3. When setting up the VM, I allowed easy install to take care of creating my user and installing VMWare tools. No problems during installation, everything… >>> More
Quantal: Broken apt-index, cant fix dependencies

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
I can't seem to add/remove/update packages Ubuntu software update has a notice about partial upgrades but fails Seems to be similar to this problem $ sudo apt-get update Ign http://archive.ubuntu.com quantal InRelease Ign http://security.ubuntu.com precise-security InRelease Ign… >>> More
'sudo apt-get update' error on Ubuntu 12.04

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
When I type in 'sudo apt-get update' I get this mohd-arafat-hossain@TUD:~$ sudo apt-get update [sudo] password for mohd-arafat-hossain: Ign http://bd.archive.ubuntu.com precise InRelease Ign http://bd.archive.ubuntu.com precise-updates InRelease Ign http://bd.archive.ubuntu… >>> More
Update Manager unable to get updates

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
In last few days my Ubuntu 11.10 update manager is unable to get new updates. When I checked update log I saw that for couple of updates it says "Network isn't available". For other updates it downloaded logs and and internet connection also works fine. Unable to attached screenshot due to SPAM prevention… >>> More
How to resolve Unmet dependencies error?

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
Using my new install of Ubuntu I haven't been able to download anything from the software center except the maryo game without the following error: The following packages have unmet dependencies: vlc: Depends: vlc-nox (= 1.1.12-2~oneiric1) but 1.1.12-2~oneiric1 is to be installed Depends: libaa1… >>> More