WAHM Forums
The WAHM community forum was created to be a place for work at home moms to share their ideas and stories. In the forum you can find information about work at home jobs, starting home businesses, avoiding scams, and surviving the WAHM lifestyle. In support of the WAHM community, WAHM.com also features instructional articles, easy recipes, as well as job and business listings tailored specifically to work at home opportunities.
View Full Version : Niche Search Engines
SmartChic
02-05-2010, 03:06 AM
I am what I would call an intermediate web designer.. I'm not a guru but I figure things out on my own very well. So most of my "knowledge" per-say and experience was self taught...I have been very inquisitive about job search engines lately and have been on the prowl to find more information about how to do them... You know the ones like Indeed.com or SimplyHired, Shopzilla or any other kind of search engine.
HOWEVER, I have been researching and researching and can not find any information about job search or niche search engines. I want to learn how to do them!!!!!!!!!:p It's driving me nuts!!!
I actually may have a potential client who is in limbo about whether or not they want to start one.. but if he does I want to know how to do it.
Does anyone know of any tutorials, how-tos or anything of that nature that can help me learn more about creating job search engines or any kind or niche search engine?
Thanks sooooo much! :D
HOWEVER, I have been researching and researching and can not find any information about job search or niche search engines. I want to learn how to do them!!!!!!!!!:p It's driving me nuts!!!
I actually may have a potential client who is in limbo about whether or not they want to start one.. but if he does I want to know how to do it.
Does anyone know of any tutorials, how-tos or anything of that nature that can help me learn more about creating job search engines or any kind or niche search engine?
Thanks sooooo much! :D
mybrokengnome
02-05-2010, 07:29 AM
A couple of points before I get into how it could possibly be done
- This is more of a web developer issue than web designer, as doing anything custom like this would require heavy programming. Companies make money off sites like this, it's not going to be as easy as a couple of HTML forms, they hire software engineers with degrees to do sites like this.
- Personally, you should be up front with your potential client and tell them you have no clue what to do, and then you should find someone who does for them.
- The market is saturated with these business, why would anyone want to start one now? If you're just going to pull from other sites, why wouldn't someone go to those sites to begin with? No reason to re-invent the wheel, when it's already doing a damn good job. I realize its not your site, but I would ask a potential client these questions first.
Now on to how it could be done.
- Easiest way would be to look into some scripts you purchase and install, this site might have some good ones PHP Employment | Classified Ads Scripts & Programs | Hot Scripts (http://www.hotscripts.com/category/php/scripts-programs/classified-ads/employment/). I think most of those you still have to get companies to post the jobs on your site though, but there's probably a script somewhere for what you want. But, you'll need to do some of the stuff below too.
- The harder way. Get a dedicated server, install MySQL/MsSQL, write a search spider that only searches on other job sites (indeed, hotjobs, simplyhired, etc.), scrub the data from them(steal data), store said data in to the above database, create a huge framework for all the backend code (searching, page views, etc.), tie in backend in with front end GUI.
You're looking at, potentially, huge amounts of data stored in to the database. You will probably want to look into storing the data into multiple databases across servers so one server isn't handling all those requests and gets knocked offline. You'll probably also want all incoming traffic to be on another server, so the same server isn't serving up the pages, spidering sites, and handling databases. If your clients site was to get big enough, say as big as indeed.com, you'd want to look into load balancing across multiple servers; i.e. if you had 1 server and a million people visited in one day that would probably kill your 1 server, but load balancing across 2 servers would put 500k on each and your site would stay up.
That's really just scratching the surface of how a site like that would be done, there's still things to consider like caching, locilization, etc.
- This is more of a web developer issue than web designer, as doing anything custom like this would require heavy programming. Companies make money off sites like this, it's not going to be as easy as a couple of HTML forms, they hire software engineers with degrees to do sites like this.
- Personally, you should be up front with your potential client and tell them you have no clue what to do, and then you should find someone who does for them.
- The market is saturated with these business, why would anyone want to start one now? If you're just going to pull from other sites, why wouldn't someone go to those sites to begin with? No reason to re-invent the wheel, when it's already doing a damn good job. I realize its not your site, but I would ask a potential client these questions first.
Now on to how it could be done.
- Easiest way would be to look into some scripts you purchase and install, this site might have some good ones PHP Employment | Classified Ads Scripts & Programs | Hot Scripts (http://www.hotscripts.com/category/php/scripts-programs/classified-ads/employment/). I think most of those you still have to get companies to post the jobs on your site though, but there's probably a script somewhere for what you want. But, you'll need to do some of the stuff below too.
- The harder way. Get a dedicated server, install MySQL/MsSQL, write a search spider that only searches on other job sites (indeed, hotjobs, simplyhired, etc.), scrub the data from them(steal data), store said data in to the above database, create a huge framework for all the backend code (searching, page views, etc.), tie in backend in with front end GUI.
You're looking at, potentially, huge amounts of data stored in to the database. You will probably want to look into storing the data into multiple databases across servers so one server isn't handling all those requests and gets knocked offline. You'll probably also want all incoming traffic to be on another server, so the same server isn't serving up the pages, spidering sites, and handling databases. If your clients site was to get big enough, say as big as indeed.com, you'd want to look into load balancing across multiple servers; i.e. if you had 1 server and a million people visited in one day that would probably kill your 1 server, but load balancing across 2 servers would put 500k on each and your site would stay up.
That's really just scratching the surface of how a site like that would be done, there's still things to consider like caching, locilization, etc.
leahmarie
02-05-2010, 08:12 AM
I think it deals with scripts for php that caters this kinds of process and what you want to be the output.
SmartChic
02-05-2010, 11:57 AM
He's wanting a porn search engine (LOL).... he asked me did I know how to do it (not porn but the search engine) and I told him I was not familiar with it. So I recommended him to a friend of mine. Don't think I want to tackle this one but it was worth a try.
Thanks for your comments! :)
Thanks for your comments! :)
mybrokengnome
02-05-2010, 12:03 PM
There's about a million of those out there already... wait... not that I would know lol
visualsindia
07-12-2010, 03:18 AM
All
Thanks for good information, i am new this forums, clear the this topics and i need more niche search engines websites and directory, please If u have show here
i am also watching and waiting your posting..
Thanks
Church Web Design Company (http://www.thechurchwebsitedesign.com/)
Web design Chennai (http://www.visualsindia.com/)
Web development Chennai (http://www.visualssoft.com/)
Joomla Development India (http://www.joomladesigns.in/)
Web design Company India (http://www.visualsindia.com/)
Web Hosting Chennai (http://www.indyawebspace.com/)
Domain Registration India (http://www.indyadomains.com/)
Thanks for good information, i am new this forums, clear the this topics and i need more niche search engines websites and directory, please If u have show here
i am also watching and waiting your posting..
Thanks
Church Web Design Company (http://www.thechurchwebsitedesign.com/)
Web design Chennai (http://www.visualsindia.com/)
Web development Chennai (http://www.visualssoft.com/)
Joomla Development India (http://www.joomladesigns.in/)
Web design Company India (http://www.visualsindia.com/)
Web Hosting Chennai (http://www.indyawebspace.com/)
Domain Registration India (http://www.indyadomains.com/)
MikeF0421
07-12-2010, 03:19 PM
he asked me did I know how to do it (not porn but the search engine)
I'm gald you clarified that part of it.
I'm gald you clarified that part of it.