Actually, it doesn't matter that the Google and BIng bots are here - they are implicitly allowed. As the person who drove
this site to "first page of search results", has driven my personal, old-school, outdated site to first page results, and recently drove a client's brand new, site/URL to first page of the result in less than 6 weeks I think I am qualified to comment on this situation and how/why it exists. It a multifaceted problem.
1.Improper use of META tags in the source code for the header of every page of the site.
Keywords - none.
description - none
robot and revist tag to help Bots - not being used.
document type and distribution tags - not being used.
Here is what we have, currently.
<meta http-equiv="content-type" content="text/html; charset=UTF-8" />
<meta name="description" content="" />
<meta name="keywords" content="" />
<meta name="copyright" content="2000, 2002, 2005, 2007 phpBB Group" />
<title>DWF - The Digital Watch Forum • Index page</title>What we HAD.
<meta http-equiv="Content-Style-Type" content="text/css">
<meta name="keywords" content="digital, watch, information, info, forum,LED,L.E.D.,LCD,light, manual,Seiko,fossil,sensor,thedigitalwatch.com,Hamilton, Omega,ledwatches.net,emitting,diode,liquid,crystal, display,vintage, dwfcc.nu,dwf.nu,classic,repair,parts,authentic, timepiece,calculator,magnet,button,original,Pulsar,solar,Synchronar, wire bond,oldpulsars.com ">
<meta name="description" content="World's largest forum dedicated to all brands and types of digital timepieces - watches, clocks and gadgets.">
<meta name="Author" content="Ed Cantarella, retroleds@aol.com">
<meta name="robots" content="index,follow">
<meta name="revisit-after" content="3 days">
<META HTTP-EQUIV="PRAGMA" CONTENT="NO-CACHE">
<meta name="document-type" content="Public">
<meta name="document-rating" content="General">
<meta name="document-distribution" content="Global">
<title>The oldest & NU-est! WWW.DWF.NU - The largest and longest running all digital watch forum.</title>2.All past links to
www.dwf.nu are bein redirected. Not generally a problem, but when bots start reporting that:(a) the page is a redirect, and (B)the redirect doesn't have keywords that match any of the old one (and all keywords should be used elsewhere on the page for maximum punch), the Bots and Google/Bing/whatever downgrade the value of those links significantly.
3.The subcategories of Pulsar/Hamilton/Omega and Synchronar are still buried away. If they were on the index page, and the index page was using keywords to match, then the Bots would rejoice that there was a relevant match. And humans would too, since they would immediately find the category they want. It's called an index page for a reason...I just don't get it. Are books written without an index in other languages? [icon of man beating head against wall or maybe just face2palm]
4. No sounds or smells of men fighting and arguing over fine details. Like a diabetic, a forum needs at least one or two good pokes a day. Just to make sure the patient is still alive.
"Soon the Gypsy Queen in a glaze of Vaseline
Will perform on guillotine
What a scene! What a scene!" [Emerson , Lake and Palmer, for those of you who are too young to recognize those classic rock lyrics..]