How to recover a website's lost robot.txt?

Posted by Jessica on Pro Webmasters See other posts from Pro Webmasters or by Jessica
Published on 2011-11-18T00:17:45Z Indexed on 2011/11/18 18:04 UTC
Read the original article Hit count: 383

Filed under:

websites

|

cache

I found my website in the Wayback Machine a few months ago, but today I've tried again and now it tells me it can't find robots.txt.

My old webhost stopped paying for their servers back in August without any notice. I was going to do a backup the day it happened.

Is there a way just to find the text? I have the old IP, images, but nothing else. None of the big search engines have caches anymore, and I already looked in the cache of three of my Macs with nothing to be found.

© Pro Webmasters or respective owner

Related posts about websites

Creating Static Websites Versus Dynamic Websites

as seen on Ezine Articles - Search for 'Ezine Articles'
This article talks about the differences between static and dynamic websites. There are advantages and disadvantages to doing both, and you need to consider this before starting a website. >>> More
How Social Networking Websites Can Play a Vital Role Websites in SEO

as seen on Ezine Articles - Search for 'Ezine Articles'
Social networking websites have now became an important part of the internet platform all across the globe and almost every individual who is using the internet these days has an account or profile registered with at least 1 or 2 social networking websites. The spreading and rapidly growing trend… >>> More
multiply websites and different websites on the same iis server

as seen on Server Fault - Search for 'Server Fault'
I've got this kind of situation: I've got windows 2003 server with dns server on same machine. It is binded to adress for ex. siteA.com Now i want to add to this machine website which name will be siteB.com. I created a new website on IIS6 server with name siteB.com but I dont know how to set up a… >>> More
multiply websites and different websites on the same iis server

as seen on Super User - Search for 'Super User'
I have: Windows 2003 Server providing DNS. Server is hosting siteA.com I want to then add: Another website, siteB.com So far, I've created siteB.com on the server, but I'm unsure about how to correctly configure DNS for it. The public DNS administrator has mapped siteB.com as an alias of siteA… >>> More
protect purchased games to be downloaded on other pc

as seen on Programmers - Search for 'Programmers'
I want to make a downloads managing system on my website, that when you purchase a download, you can always re-download it again for free. (i have read that Steam does something similar) The problem is, that someone would be able to create a account, purchase something and then give the account password… >>> More

Related posts about cache

How to remove a package entirely?

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
Hi I'm quite new to Linux, but before using it I was hearing that Windows programs, after uninstallation, leaves a lot of remains on the hard disc, and Linux removes all. I'm using Ubuntu 10.04. To uninstall packages I'm using sudo apt-get autoremove application_name or sudo aptitude purge application_name… >>> More
LVM / Device Mapper maps wrong device

as seen on Server Fault - Search for 'Server Fault'
Hi, I run a LVM setup on a raid1 created by mdadm. md2 is based on sda6 (major:minor 8:6) and sdb6 (8:22). md2 is partition 9:2. The VG on top of md2 has 4 LVs, var, home, usr, tmp. First the problem: While booting it seems as if the device mapper takes the wrong partition for the mapping! Immediately… >>> More
Application throws NotSerializableException when run on an jboss cluster

as seen on Stack Overflow - Search for 'Stack Overflow'
Environment: JBoss 5.1.0, JBoss Seam 2.2.0 While trying to get my application running in a clustered environment after login I am getting the following exception. Post login we try to store the currentUser in jboss seam session context. java.io.NotSerializableException: org.jboss.seam.util.AnnotatedBeanProperty How… >>> More
Windows Azure Evolution – Caching (Preview)

as seen on Geeks with Blogs - Search for 'Geeks with Blogs'
Caching is a popular topic when we are building a high performance and high scalable system not only on top of the cloud platform but the on-premise environment as well. On March 2011 the Windows Azure AppFabric Caching had been production launched. It provides an in-memory, distributed caching service… >>> More
Locking Cache Key without Locking the entire Cache

as seen on Stack Overflow - Search for 'Stack Overflow'
I have servlets that caches user information rather then retrieving it from the user store on every request (shared Ehcache). The issue I have is that if a client is multi-threaded and they make more then one simultaneous request, before they have been authenticated, then I get this in my log: Retrieving… >>> More