How to find all occurences of an email address on a website

Posted by thomasrutter on Server Fault See other posts from Server Fault or by thomasrutter
Published on 2010-06-03T04:39:08Z Indexed on 2010/06/03 4:44 UTC
Read the original article Hit count: 279

Filed under:

Site

|

crawl

|

email-addresses

Let's say I have a large website which may have a number of email addresses on it that are getting picked up by spammers. I plan to obfuscate or remove them all.

What's the easiest way to crawl my website to find any email addresses I may be exposing?

Either through on-page text (which Google can pick up, but not very well) or mailto: links (which Google can't).

© Server Fault or respective owner

Related posts about Site

Outside VPN traffic not able to ping site-to-site VPN remote site

as seen on Server Fault - Search for 'Server Fault'
we have two ASA 5510s running 8.4 in a site-to-site VPN setup. All internal traffic is working smoothly. Site/Subnet A: 192.100.0.0 - local Site/Subnet B: 192.200.0.0 - remote VPN Users: 192.100.40.0 - assigned by ASA When you VPN into the network, all traffic hits Site A, and everything on subnet… >>> More
Site-to-site VPN using MD5 instead of SHA and getting regular disconnection

as seen on Server Fault - Search for 'Server Fault'
We are experiencing some strange behavior with a site-to-site IPsec VPN that goes down about every week for 30 minutes (Iam told 30 minutes exactly). I don't have access to the logs, so it's difficult to troubleshoot. What is also strange is that the two VPN devices are set to use SHA hash algorithm… >>> More
I have a very long and repetitive python path, where do I look to correct this?

as seen on Stack Overflow - Search for 'Stack Overflow'
I know it is probably not necessary to paste the whole path, but just for the record I have done so below. Whenever I run a python command, it takes a long time to load this path I suppose. I have checked in .bash_profile and only have these two lines: export PATH=/Users/username/bin:/opt/local/Library/Frameworks/Python… >>> More
WSS 3.0 Backup/Restore Root Site Collection to Sub-Site of New Site Collection

as seen on Server Fault - Search for 'Server Fault'
Our intranet was originally setup to be at the root of its site collection. We are trying to change this so that our new internet site will live in the root and the intranet will be a sub-site. At this point I have created a new web application and site collection to house the internet and intranet… >>> More
Creating a Membership Site - 4 Reasons to Build a Membership Site

as seen on Ezine Articles - Search for 'Ezine Articles'
If you really want to cash in on one of the hottest trends online, you might want to think about creating a membership site. Membership sites are an excellent way to leverage your time, resources and clients while generating monthly cash deposits into your bank account on autopilot. >>> More

Related posts about crawl

Nutch - how to crawl by small patches?

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi everyone! I am stuck! Can`t get Nutch to crawl for me by small patches. I start it by bin/nutch crawl command with parameters -depth 7 and -topN 10000. And it never ends. Ends only when my HDD is empty. What i need to do: Start to crawl my seeds with possibility to go further on outlinks. Crawl… >>> More
"Error in the Site Data Web Service." when performing crawl

as seen on Server Fault - Search for 'Server Fault'
Installed SharePoint Services v3 (SP2, october 2009 cumulative updates, Language Pack), attached to a content database I had previously (all works). Installed Search server 2008 Express (with language pack) on top of WSS and crawl does not work. However it works for newly created web application +… >>> More
Google Webmasters Tools strange 404 errors referred from same site

as seen on Pro Webmasters - Search for 'Pro Webmasters'
Starting about a month ago, I noticed a sudden increase in 404 errors in Webmasters Tools for one of my sites (over 1400 errors so far). All the errors are being referred from my own site to non existent pages. The 404 error URLs are all of the same format: URL: http://www.helloneighbour.com/save/1347208508000 The… >>> More
In Google webmaster tools, can a "soft 404" be triggered by the text on the page?

as seen on Pro Webmasters - Search for 'Pro Webmasters'
I just ran across an error in Google Webmaster Tools that I have never seen before. I manage the website for my local community band (I play trombone). One of the pages on the site is a list of our upcoming performances. It is powered by a WordPress events plugin that uses a database of upcoming… >>> More
Submitting a sitemap to take care of inherited Google crawler errors

as seen on Pro Webmasters - Search for 'Pro Webmasters'
I have an awful lot of Google Crawler errors (1000 or so) after I inherited a site that the previous owner migrated without moving much of their content. Would generating a map of the current site and submitting it to Google help fix this? Is there any quicker, automated way to eliminate errors… >>> More