<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN"
        "http://www.w3.org/TR/REC-html40/strict.dtd">
<HTML LANG="en-US"><HEAD>
<TITLE>Search Engine Snob: SurfGopher reviewed</TITLE>
<base href="http://www.bauser.com/websnob/engines/SurfGopher.html">
<META NAME="DESCRIPTION" CONTENT="A review of the SurfGopher web directory.">
<meta name="KEYWORDS" content="SurfGopher, search engine, web directory">
<meta name="DCTERMS.created" scheme="DCTERMS.W3CDTF" content="2002-05-14">
<!--#exec cgi="../cgi/head.pl"-->
<link rel="DC.subject" href="http://www.surfgopher.com/">
<script src="pop.js" type="text/javascript"></script>
</HEAD><BODY>
<p class="breadcrumbs"><a href="/websnob/" rel="home">Websnob</a> &gt;
<a href="/websnob/engines/">Search Engine Snob</a> &gt;
<strong>SurfGopher (review)</strong></p>

<p class="advert"><!--#exec cgi="../adverts/ad_1.pl"--></p>

<H1>Search Engine Review: SurfGopher.com</h1>

<p><a href="http://www.surfgopher.com/">SurfGopher</a> has been around
since at least 1998, when it was billing itself as a "Domain name homepage
directory." In English; SurfGopher isn't really a search engine <em>or</em>
a directory; it's a database of <a href="/websnob/domains/">domain
names</a> with "card catalog" descriptions of each domain's web content.
SurfGopher only tells you what the domain-owner wants you to know about the
domain.</p>

<p>The idea behind domain-indexes is fairly simple: By indexing domains
instead of pages, domain-indexes filter out minor sites (ones without
domains) while putting all others on equal footing (since each domain gets
the same number of listings in the database). In practice, this seldom
works as well as intended, since having a domain name doesn't really
guarantee good content, and any spammer with two dimes to rub together is
going to have extra domains to fill the database with.</p>

<p>For a site that does so little, SurfGopher has been around for a
suprisingly long time, having outlasted several larger competitors like <a
href="http://www.directhit.com/">DirectHit</a> and <a
href="http://www.infoseek.com/">Infoseek</a>. Apparently, SurfGopher exists
in that strange middle ground of search engines, where it's too small to be
an acquisition target, but just large enough to survive off its advertising
revenue.</p>

<h2 id="users">The Users' Side</h2>

<p>Searching SurfGopher is <em>too</em> easy: There's a search box with no
advanced options. Results seem to treat multiple keywords as a boolean
"AND", with results containing only one word trailing after the listings
that contain all the keywords. Phrase-searching is enabled by placing
search phrases in double-quotes (").</p>

<p>Search results are pretty straightforward: Each listing includes the
<tt>title</tt>, <tt>meta</tt> description, and <acronym title="Uniform
Resource Identifier">URI</acronym> of a site. (All of this information is
provided by the authors of the indexed pages.) Pages that don't have a
<tt>meta</tt> description don't get any description at all.</p>

<p>SurfGopher's search results are a mixed bag. They often <em>do</em>
include domains that are too new to appear in major engines (which take
longer to add sites, because they have more complex databases), but those
new domains are often lost in a quagmire of out-of-date listings.
Surfgopher doesn't appear to revisit sites after their original submission,
so changes in site content (or the termination of sites) isn't reflected in
the search results. Until SurfGopher changes their webcrawling methods,
their database is likely to continue degrading.</p> 
 
<p>SurfGopher's partner site <a
href="http://www.metagopher.com/">MetaGopher</a> is a meta-search engine
that gets its results from various paid-placement search providers.
<cite>Search Engine Snob</cite> isn't a fan of meta- search engines,
because I think combining the results of multiple mediocre search engines
doesn't create a good search engine.</p>

<h2 id="webmasters">The Webmasters' Side</h2>

<p>SurfGopher does <em>not</em> crawl the web looking for sites; if you
want your domain listed, you need to <a
href="http://www.surfgopher.com/addurl.htm">submit it yourself</a>.
Submission is free, but requires an e-mail address for the confirmation
message. (The confirmation message, as is usual in these situations,
includes a bunch of advertisment, but it's a one-time mailing.) The e-mail
address doesn't have to be from the domain submitted.</p>

<p>Surfgopher doesn't even have a branded robot; submitted sites will be
visited by "libwww-perl/5.47" almost immediately after being submitted.
SurfGopher doesn't appear to re-visit included sites (which is why there
are so many dead listing in their index), so you should resubmit if your site
changes.</p>
 
<p>As far as listings go, SurfGopher is one of those dream sites that give
webmasters almost complete control over their listings. SurfGopher listings
display the title, <tt>meta</tt> DESCRIPTION, and URI for a site. </p>

<p>On the other hand, <em>SurfGopher does not index the full contents of
submitted pages</em>. The only information indexed is the cotents of the
<tt>title</tt>, the <tt>meta</tt> DESCRIPTION, and <tt>meta</tt> KEYWORDS
elements; so pages that don't have a <tt>meta</tt> DESCRIPTION won't have
any description at all in SurfGopher's results.</p>

<p>SurfGopher appears to have problems displaying HTML character entities;
some of them (including the "@" sing, entity &amp;#64; ) won't appear in
SurfGopher's version of site titles and descriptions.</p>

<p>SurfGopher's indexing system isn't fooled by http redirects or <a
href="/websnob/html4/stealth_redirection.html">stealth redirection</a>; in
my tests of those tricks, Surfgopher just went ahead and indexed the the
site being redirected to (and discarding it, if it wasn't the top page of a
domain).</p>

<h2 id="conclusions">Conclusions</h2>

<p>While a "homepage-only" search engine sounds like an interesting idea
for leveling the playing field between sites, SurfGopher's implementation
leaves a lot to be desired. It's greatest problem is its limited spidering;
unless they beging a more aggressive crawl of the web, the database will
always be second-rate.</p>

<p>From the users' perspective, SurfGopher is a "Why bother?" engine. For
webmasters, it's more like a "Can't hurt." engine, in that is only spiders
sites when requested, and lets webmasters control the listings.</p>

<p class="advert"><!--#exec cgi="../adverts/ad_2.pl"--></p>
<!--#exec cgi="../cgi/menu.pl"-->
<!--#exec cgi="../cgi/2002"-->
</BODY></HTML>

