Web Spiders
Most indexing is done automatically by Web "spiders," which are programs that "crawl" the Web around the clock looking for all the pages they can find. By following the links from one page to another, they scour billions of pages and summarize them in massive databases, which is what you are querying when you use a search engine.
Metasearching
"Metasearch" engines are search engines that search other search engines and bring you results as if you had made the effort to search all those sites independently (see list below).
Deep Web Searches
An enormous amount of content that Web sites offer to visitors resides in databases that are not exposed to the world at large as are HTML pages with links to each other. This is known as the "deep Web." Some search engine sites offer deep Web content as well (see list below).
The Portal
Many search engine sites evolved into a portal. Instead of offering content only from other Web sites, they have their own content and features such as free e-mail, chat rooms and shopping. For information about all major search engines, visit www.searchenginewatch.com. See portal, Web white pages, Web yellow pages and information broker.
Search Engine Sites
Following are popular sites for searching any topic. If you do not find what you want at one site, try another, even if you use a metasearch engine. Spiders do not always find the same information at the same time.
www.altavista.com
www.ask.com
www.bing.com
www.excite.com
www.go.com
www.go2.com
www.google.com
www.hotbot.com
www.lycos.com
www.northernlight.com
www.opentext.com
www.rocketnews.com (recent news only)
www.webcrawler.com
http://vivisimo.com
www.lexibot.com deep Web
www.quigo.com deep Web
www.about.com directory
www.suite101.com directory
www.yahoo.com directory
www.a9.com metasearch
www.dogpile.com metasearch
www.go2net.com metasearch
www.mamma.com metasearch
www.search.com metasearch
www.wolframalpha.com computational
![]() | Reproduced with permission from Computer Desktop Encyclopedia. Copyright (c) 1981-2009 The Computer Language Company Inc. All rights reserved. |
Additional Resources
- GSA Auto SoftSubmit 6.50 (Windows)
- The GSA Auto SoftSubmit is a program designed to submit your software to hundreds of Web sites. It will save you a lot of time and money since its fully automated. Load a PAD file and let the program do the rest. The program gets updated several times a month...
- Software downloads 2009-11-27
- GSA Auto Website Submitter 3.66 (Windows)
- The GSA Auto Website Submitter is a program designed to submit your website to hundreds of search engines and directories. It will save you a lot of time and money since its fully automated. Promoting your web page has never been easier. You just enter some information about your web...
- Software downloads 2009-11-27
- A1 Keyword Research 2.0.2 (Windows)
- Optimize Web site content and ad campaigns. Find related keywords and phrases. Build keyword lists that cover all variations, for example: combine and tumble keyword lists. Cover all word permutations, spelling errors, and missing spaces. View past ranking positions on graphs and charts. Concurrently check multiple websites for multiple phrases...
- Software downloads 2009-11-25
- Avira AntiVir Personal - Free Antivirus 9.0.0.415 (Windows)
- Avira AntiVir Personal Free Antivirus is a comprehensive, easy to use antivirus program, designed to offer reliable free of charge virus protection to home-users only. Avira offers: Extensive Malware Recognition of viruses, Trojans, backdoor programs, worms; Automatic incremental updates of antivirus signatures, engine and entire software; Permanent virus protection, with...
- Software downloads 2009-11-24
- Chatting (Not Chattering) About Salesforce - Part I
- (NOTE BEFORE I START: This is one really long post. So rather than post it in all its glory in a single file or post it here over two days, I'm trying something new. I'm posting the first half here. And the second half on PGreenblog. Â Let's see how that...
- Blog posts 2009-11-23
- CuteRank Free Edition 2.1.2 (Windows)
- CuteRank is a Free and Smart rank checker tool for Web site owners/administrators, SEO professionals, or Blog writers to "check" and "track" their Web site ranking performance on multiple search engines including Google, Yahoo!, Bing, Ask, and AOL. Key features of CuteRank include: Check Web site ranking in an instant;...
- Software downloads 2009-11-23
- A1 Sitemap Generator 2.0.4 (Windows)
- Help search engines crawl and index your Web site with HTML, RSS, and XML sitemaps as defined by Google XML sitemaps protocol including video, mobile and news XML sitemaps. Near-endless Web site scanning options. Configure amount of simultaneous connections to use. Supports crawler filters, nofollow, robots.txt, custom connection and read...
- Software downloads 2009-11-21
- UltraBrowser 11.0 (Windows)
- UltraBrowser is a small browser application with a password-protected "MyWeb" remote bookmark manager for storing favorites on the Web, accessing them from other computers, and sharing them with others. The browser is integrated with a multisearch panel with access to popular engines enabling one-click querying, built-in Google autosearching from the...
- Software downloads 2009-11-19
- Netbooks dead? Not when sales are up 264% percent
- My prediction:Intel and MS and the major brands are trying to drag the market upwards in size and cost to maintain their margins. They will shortly face a barrage of products based on ARM class processors and Linux (Chrome?), which will cost much less and have much better battery lives....
- Discussion threads 2009-11-16
- GOOG could lose more than Murdoch
- Thanks, this was insightfulWhat if Murdoch and minions stroke a deal with a more desperate Google competitor - and blocked Google. That would be a very real threat. If users suddenly finds that Google returns fewer quality results than competitors, Google could lose search share, fast. That would strike directly...
- Discussion threads 2009-11-16
- Dolphin3D Web Browser 1.50 (Windows)
- Dolphin3D is an innovative, feature-rich Internet Explorer-compatible Web browser for Windows, with over 100 built-in features not found in any other Web browser. Some of its more notable built-in features include an ad blocker, an easily-invoked script killer, a download manager, a basic word processor, a context menu-accessible photo editor,...
- Software downloads 2009-11-15
- Hello Engines 7.1.3 (Windows)
- The web promotion software Hello Engines submits your website correctly and reliably to almost all important search engines and web directories (i.e. AltaVista, Lycos, Excite, Yahoo, Google) worldwide. Your website is submitted to top quality search services, which ensures that Internet user will find you on the Internet and traffic...
- Software downloads 2009-11-13
- Billeo 2.1.0.1 (Windows)
- Billeo is an essential browser app for anyone who makes transactions online. From start to finish Billeo's unique combination of features make any transaction--from online shopping purchases to bill payments--easier, faster, and more secure. Billeo creates a private, encrypted vault on your own computer where all your Web site login...
- Software downloads 2009-11-13
- Bing 2.0 debuts
- Bing Image SearchSpeaking of Bing, I recently did some Bing Image Searches, and found that they produced better results than Google Image Searches.Just keeps getting better.I don't know how anyone using Bing could find anything to complain about. In fact all the complaints I do see come from people...
- Discussion threads 2009-11-11
- Cloud Engines Pogoplug
- Photo gallery:Cloud Engines PogoplugWouldn't it be nice to quickly access your data from anywhere without a complicated network setup? That's exactly what the Cloud Engines Pogoplug offers. Priced at $100, this tiny gadget turns any USB external storage devices--anything from a Seagate FreeAgent Go to a Western...
- Product reviews 2009-11-10
- Web Log Storming 2.3 (Windows)
- Web Log Storming is an interactive, desktop-based web log analyzer for Windows. A whole new concept of Web site statistics makes it clearly different from any other web log analytics software. Browse through stats to drill down into details - down to an individual visitor's session. Check the pattern of...
- Software downloads 2009-11-06
- Hyperwords for Firefox 5.6.5 (Windows)
- Hyperwords for Firefox makes all the text on the Web interactive, for one click access to: 24 search engines, including for people, blogs, and news; 14 references, including Wikippedia, dictionary, and academic. Go via Google Lucky, URL, and Skype. Copy text plain or with URL. Print page or selection. 8...
- Software downloads 2009-11-06
- Browser rivals to register official complaints about Microsoft's ballot screen proposal
- Opera"Browser rivals to register official complaints about Microsoft's ballot screen proposal". . . and by "browser rivals" you really mean Opera, who has been whimpering and whining the whole time. A browser that barely appears on anybody's charts, but still retains a cult following.I think Microsoft is improving with IE7...
- Discussion threads 2009-11-05
- Advanced Web Ranking 6.9 (Mac)
- Advanced Web Ranking is able to query over 1000 search engines and quickly find out if you're moving up or down in the rankings, or if your site is listed at all. It will track the progress of your rankings over time and display that information in an easy to...
- Software downloads 2009-11-05
- Advanced Link Manager 4.9 (Mac)
- Advanced Link Manager is a tool that helps manage your web site incoming links. Advanced Link Manager runs on Mac OS X, Windows 98/2000/XP, and Linux. Almost all major search engines that exist today, rank a web page based on the number and the quality of links that point to...
- Software downloads 2009-11-05
Neighboring Terms
Premier Vendor Content Whitepapers, webcasts & resources from our Power Center Sponsors
- Learn more about tools to grow your business
-
The Business Essentials Guide provides you useful tools and templates to help grow your business and save you time with automated shipping solutions.
- Save time with the UPS Business Essentials Guide
- Microsoft Dynamics CRM Online - Free Six-Month Trial for Eligible Organizations
-
Microsoft Dynamics CRM Online provides fast online access, simple contact management and better sales performance for a low monthly cost - the best value on the market today.

- Learn more about the free, six-month trial offer>>
- New Online Dashboard for IT Leaders
-
Read about top issues IT decision-makers face every day, plus get cost-effective solutions to real-life IT problems.
- Learn more >>
Enterprise Applications
- Check out some of the easiest and most powerful ways to boost productivity while saving money on your application infrastructure. See ZDNet's comprehensive Enterprise Application resource center, now!
- New Online Dashboard
- Read about top issues IT decision-makers face every day, plus get cost effective solutions to real life IT problems. Oracle Topline









