meta crawlers search spiders projects

large search engine using php and mysql

Monday, March 26th, 2007

A very large and complex search engine done for a niche category. This php mysql script contains both the background spiders to scrape data from the web and also an efficient frontend to show the search results fast. Excellent mysql database optimization and normalization was done to ensure fast searches. (read more by clicking on title)

google yahoo msn meta search

Tuesday, March 6th, 2007

This c# multi threading meta search scripts was done efficiently. This script spiders google, yahoo and msn results simultaneously and munges/mashes the results and offers the user a ranked list of results based on an unique algorithm. (read more by clicking on title)

car meta search

Sunday, March 4th, 2007

We completed this car meta search website using php and mysql. Complex spider scripts and web data scraping functions were created. Car data were taken from external websites. A membership system for car brokers, dealers and users were created and online payment system was integrated. (read more by clicking on title)