Writing a search engine
Posted
by wvd
on Stack Overflow
See other posts from Stack Overflow
or by wvd
Published on 2010-06-18T14:35:03Z
Indexed on
2010/06/18
14:43 UTC
Read the original article
Hit count: 337
Hello all,
The title might be a bit misleading, but I couldn't figure out a better title. I'm writing a simple search engine which will search on several sites for the specific domain. To be concrete: I'm writing a search engine for hardstyle livesets/aftermovies/tracks. To do I will search on the sites who provide livesets, tracks, and such. The problem here is speed, I need to pass the search query to 5-7 sites, get the results and then use my own algorithm to display the results in a sorted order. I could just "multithread" it, but it's easier said then done so I have a few questions.
What would be the best solution to this problem? Should I just multithread/process this application, so I'm going to get a bit of speed-up?
Are there any other solutions or I am doing something really wrong?
Thanks,
William van Doorn
© Stack Overflow or respective owner