Web scraping advice/help with java for android app!

Posted by Capsud on Stack Overflow See other posts from Stack Overflow or by Capsud
Published on 2010-05-26T13:46:26Z Indexed on 2010/05/26 13:51 UTC
Read the original article Hit count: 306

Filed under:

android

|

webscraping

Hey there,

I've heard about web scraping software that can take data from a webpage. i'm building an android app and I want to take information from this site www.menupages.ie

All I need is the names of the restaurants, and typing them in myself would be very tedious.

Can someone tell me how i'd go about doing this in eclipse, what methods i need etc. I dont know anything about it.

Thanks alot.

© Stack Overflow or respective owner

Related posts about android

Please verify my layout: bottom button keeps coming up over keyboard

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi everyone, I have a layout which does almost what I want. There's just one bug regarding the button at the bottom. I should stay at the bottom at all times. But whenever I bring up the soft-keyboard the button will be displayed above the keyboard. This is not what I want but it should become covered… >>> More
Android programming. Application stopped unexpectedly.

as seen on Stack Overflow - Search for 'Stack Overflow'
I've just created a prototype of interface for my android app and tried to run it. Unfortunately I get an error that my app has stopped unexpectedly (my reputation doesn't allow me to post images so follow my links): screenshot of error message This is layout mode of editing. Everything looks as… >>> More
Listview Row Overlap Problem

as seen on Stack Overflow - Search for 'Stack Overflow'
I just updated my app and I am getting some odd complaints from people who update it. I am only getting complaints from people with non-stock android phones (phones that manufacturers have modified...HTC phones, cliq, pulse, etc), other phones like the Droid, Nexus work fine. My app (Photo Frame Deluxe)… >>> More
Why are some of my view not aligned correctly at the bottom of my relative layout?

as seen on Stack Overflow - Search for 'Stack Overflow'
I have problems getting some of my views aligned in a relative layout that I use inside a row of my listview. Here is a screenshot from the layout builder in Eclipse, this is what I think it should look like: The next image is from the emulator. Now the TestTestTest View is at the top and covers… >>> More
Android RatingBar weirdness: Whenever I add a RatingBar to my layout, a bunch of the generated tags,

as seen on Stack Overflow - Search for 'Stack Overflow'
Whenever I use a RatingBar view in my layout, I suddenly get all kinds of compile errors. I'm using Android 2.0, but I've also tried 2.0.1, and 2.1, without joy. I also get a message: Shader 'android.graphics.BitmapShader' is not supported in Layout Editor, and an odd warning which may or maynot be… >>> More

Related posts about webscraping

Webscraping Google tasks via Google Calendar

as seen on Stack Overflow - Search for 'Stack Overflow'
As gmail and the task api is not available everywhere (eg: some companies block gmail but not calendar), is there a way to scrap google task through the calendar web interface ? The solution can be to use jQuery/Jaxer or a pointer to a browser script/plugin. >>> More
R webscraping: interrogating for date and importance

as seen on Stack Overflow - Search for 'Stack Overflow'
I am able to webscrape a table from a webpage containing news library(XML) webpage <- "http://www.tradingeconomics.com/calendar" tables <- readHTMLTable(webpage ) n.rows <- unlist(lapply(tables, function(t) dim(t)[1])) dfcal <- as.data.frame(tables$calendar) However I do not know… >>> More
How can I use R (Rcurl/XML packages ?!) to scrap this webpage ?

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi all, I have a (somewhat complex) webscraping challenge that I wish to accomplish and would love for some direction (to whatever level you feel like sharing) here goes: I would like to go through all the "species pages" present in this link: http://gtrnadb.ucsc.edu/ So for each of them I will… >>> More
HTML Agility Pack Screen Scraping XPATH isn't returning data

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm attempting to write a screen scraper for Digikey that will allow our company to keep accurate track of pricing, part availability and product replacements when a part is discontinued. There seems to be a discrepancy between the XPATH that I'm seeing in Chrome Devtools as well as Firebug on Firefox… >>> More
Is there a jQuery webscraper out there?

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm trying to pullout some info from an external site using jQuery and Adobe AIR. Right now I'm using a hidden div and jQuery's load function to load fragments of the external site, once the info is loaded I parse some info with selectors. This is fine but it's kinda dirty and I need to perform this… >>> More