Niche Search Engines

[SmartChic]

I am what I would call an intermediate web designer.. I'm not a guru but I figure things out on my own very well. So most of my "knowledge" per-say and experience was self taught...I have been very inquisitive about job search engines lately and have been on the prowl to find more information about how to do them... You know the ones like Indeed.com or SimplyHired, Shopzilla or any other kind of search engine.

HOWEVER, I have been researching and researching and can not find any information about job search or niche search engines. I want to learn how to do them!!!!!!!!! It's driving me nuts!!!

I actually may have a potential client who is in limbo about whether or not they want to start one.. but if he does I want to know how to do it.

Does anyone know of any tutorials, how-tos or anything of that nature that can help me learn more about creating job search engines or any kind or niche search engine?

Thanks sooooo much!

[mybrokengnome]

A couple of points before I get into how it could possibly be done

- This is more of a web developer issue than web designer, as doing anything custom like this would require heavy programming. Companies make money off sites like this, it's not going to be as easy as a couple of HTML forms, they hire software engineers with degrees to do sites like this.

- Personally, you should be up front with your potential client and tell them you have no clue what to do, and then you should find someone who does for them.

- The market is saturated with these business, why would anyone want to start one now? If you're just going to pull from other sites, why wouldn't someone go to those sites to begin with? No reason to re-invent the wheel, when it's already doing a damn good job. I realize its not your site, but I would ask a potential client these questions first.


Now on to how it could be done.

- Easiest way would be to look into some scripts you purchase and install, this site might have some good ones PHP Employment | Classified Ads Scripts & Programs | Hot Scripts. I think most of those you still have to get companies to post the jobs on your site though, but there's probably a script somewhere for what you want. But, you'll need to do some of the stuff below too.

- The harder way. Get a dedicated server, install MySQL/MsSQL, write a search spider that only searches on other job sites (indeed, hotjobs, simplyhired, etc.), scrub the data from them(steal data), store said data in to the above database, create a huge framework for all the backend code (searching, page views, etc.), tie in backend in with front end GUI.

You're looking at, potentially, huge amounts of data stored in to the database. You will probably want to look into storing the data into multiple databases across servers so one server isn't handling all those requests and gets knocked offline. You'll probably also want all incoming traffic to be on another server, so the same server isn't serving up the pages, spidering sites, and handling databases. If your clients site was to get big enough, say as big as indeed.com, you'd want to look into load balancing across multiple servers; i.e. if you had 1 server and a million people visited in one day that would probably kill your 1 server, but load balancing across 2 servers would put 500k on each and your site would stay up.

That's really just scratching the surface of how a site like that would be done, there's still things to consider like caching, locilization, etc.

[leahmarie]

I think it deals with scripts for php that caters this kinds of process and what you want to be the output.

[SmartChic]

He's wanting a porn search engine (LOL).... he asked me did I know how to do it (not porn but the search engine) and I told him I was not familiar with it. So I recommended him to a friend of mine. Don't think I want to tackle this one but it was worth a try.

Thanks for your comments!

[mybrokengnome]

There's about a million of those out there already... wait... not that I would know lol

[visualsindia]

All

Thanks for good information, i am new this forums, clear the this topics and i need more niche search engines websites and directory, please If u have show here

i am also watching and waiting your posting..

Thanks
Church Web Design Company
Web design Chennai
Web development Chennai
Joomla Development India
Web design Company India
Web Hosting Chennai
Domain Registration India

[MikeF0421]

Originally Posted by SmartChic

he asked me did I know how to do it (not porn but the search engine)

I'm gald you clarified that part of it.