#robots.txt file created 2010.01.14 #by monty2diva@yahoo.com #technical questions/concerns on "robots.txt", contact monty2diva@yahoo.com #The purpose of this file is to control which Internet search engines #are allowed to index the www.otrr.org site. #In making a web site searchable, a Web search site employs "bots" #which access and index files and directories within the main Web #directory of the target site. #Generically speaking, this means for the OTRR.ORG site those files #and directories available - from the point of view of the browser - #after typing http://www.otrr/org/. For example, the file #http://www.otrr.org/index.htm is indexed, as are ALL files found #in the directory http://www.ottr.org/FILES/ #From the point of view of the Web server hosting our site, this means #(for example) that the files at /home1/otrrorg/public_html/index.htm # /home1/otrrorg/public_html/FILES/ will be indexed. #By default, per JimB, only Google's main search bot will index otrr.org User-agent: Googlebot Disallow: #Uncomment the next two lines ONLY IF you wish to allow Google's bot #for mobile devices to access otrr.org #User-agent: Googlebot-Mobile #Disallow: #the next two lines MUST be uncommented to keep ALL OTHER search engines #BESIDES Google (and perhaps Google Mobile search) from indexing otrr.org User-agent: * Disallow: /