Writing a search engine

Posted by wvd on Stack Overflow See other posts from Stack Overflow or by wvd
Published on 2010-06-18T14:35:03Z Indexed on 2010/06/18 14:43 UTC
Read the original article Hit count: 337

Hello all,

The title might be a bit misleading, but I couldn't figure out a better title. I'm writing a simple search engine which will search on several sites for the specific domain. To be concrete: I'm writing a search engine for hardstyle livesets/aftermovies/tracks. To do I will search on the sites who provide livesets, tracks, and such. The problem here is speed, I need to pass the search query to 5-7 sites, get the results and then use my own algorithm to display the results in a sorted order. I could just "multithread" it, but it's easier said then done so I have a few questions.

  1. What would be the best solution to this problem? Should I just multithread/process this application, so I'm going to get a bit of speed-up?

  2. Are there any other solutions or I am doing something really wrong?

Thanks,

William van Doorn

© Stack Overflow or respective owner

Related posts about multithreading

Related posts about search