Is there an automated way to take site inventory?

Posted by leeand00 on Pro Webmasters See other posts from Pro Webmasters or by leeand00
Published on 2012-06-12T18:00:56Z Indexed on 2012/06/12 22:48 UTC
Read the original article Hit count: 458

Filed under:

ads

|

crawler

|

inventory

Is there a way to take site inventory using a crawler program that checks either the sources of images for specific servers that serve ads, or, that the crawler looks at a page for specific (html5?) tags like <aside> or some other tag to count the inventory of ad spaces available on a site? The crawler might additionally look at the size of the ads to categorize them into different classifications of ads. Also, what would a crawler like this be called?

© Pro Webmasters or respective owner

Related posts about ads

Adsense image ads only unit is displaying image and text ads

as seen on Server Fault - Search for 'Server Fault'
Adsense 'image ads only' unit displaying image and text ads on my website. I have double checked to make sure that the adsense unit format is set to 'image ads only'. Have anyone else has experienced this and how did you resolve this issue? Thanks for help. >>> More
Post Loading ads - using appendChild to move an IFRAME with text link ads

as seen on Stack Overflow - Search for 'Stack Overflow'
I have changed code around to basically load an add the bottom of the page in a hidden div and attached an onload event handler that called document.getElementById(xxx).appendChild() to take the hidden ad and move it into the right spot in my page. This works GREAT.. however when the ad is a text… >>> More
Local Ads in v2009 - AdWords API Hack Day 2010

as seen on Google Code - Search for 'Google Code'
Local Ads in v2009 - AdWords API Hack Day 2010 Presentation by Aaron Karp at the adwords API Hack Day in NYC. From: GoogleDevelopers Views: 615 3 ratings Time: 15:21 More in Science & Technology >>> More
Yahoo Led the Pack in Display Ads in 2009

as seen on Internet.com - Search for 'Internet.com'
Online metrics firm comScore recaps the past year in digital advertising and social networking, finding Yahoo had a banner year with banner ads, while Facebook consolidated its lead in the social space. >>> More
Super Bowl Ads' Best and Worst Online Performances

as seen on Internet.com - Search for 'Internet.com'
Web analysis firm Gomez ranks the big Super Bowl advertisers' post-game performance. The winner may be a sweet surprise, but GoDaddy and Hyundai can't be too happy. >>> More

Related posts about crawler

Site crawler/spider that tosses results into mysql

as seen on Server Fault - Search for 'Server Fault'
It's been suggested that we use mysql for our site's search as it'd be running on the same server that hosts our web server (nginx) and our db (mysql). Since not all of our pages are created from the database, it's been suggested that we have a crawler that can crawl the site, and toss the page url… >>> More
Remove subdomain from Google Crawler

as seen on Server Fault - Search for 'Server Fault'
Hi all, I recently removed a sub-domain from my domain so I just have 1 website to manage. However, if I do a google search, my old domain is still there, I removed the sub-domain well over a week ago and if you try to access the domain directly, you will get an error saying the website can not… >>> More
Is there an automated way to take site inventory?

as seen on Pro Webmasters - Search for 'Pro Webmasters'
Is there a way to take site inventory using a crawler program that checks either the sources of images for specific servers that serve ads, or, that the crawler looks at a page for specific (html5?) tags like <aside> or some other tag to count the inventory of ad spaces available on a site?… >>> More
Building an automatic web crawler

as seen on Stack Overflow - Search for 'Stack Overflow'
I am building a web application crawler that's meant not only to find all the links or pages in a web application, but also perform all the allowed actions in the app (such as pushing buttons, filling forms, notice changes in the DOM even if they did not trigger a request etc.) Basically, this is… >>> More
What is a good Java crawler library?

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, I am about to develop a crawler in Java but don't feel like reinventing the wheel. A quick Google search gives a whole bunch of Java libraries to build a web crawler. Besides that Nutch is of course a very robust package but seems a bit too advanced for my needs. I only need to crawl a handful… >>> More