4,800,232
I'm no expert, but I believe robot.txt is a text file that instructs search engines about what they can index on your site. Please check with your webmaster or someone familiar with how to write content for the robot.txt.
-
Roy Kelley
Gaithersburg, MD
279,928
630,301
6,599,666
4,321,300
3,073,563
374,190
Ron & Alexandra - It is my Active Rain outside blog. How do I fix the architechture of my Active Rain site?
Michael - I am trying to add an html file, or a CNAME file so i can verify ownership of my domain name. This is what they suggest in Google webmaster tools. So far, it hasn't worked.
80,193
It's a file in your website file structure. If you're your own webmaster look in your file manager. Your provider may be able to help through tech support to find the file.
5,773,924
Judy,
It is not your host that needs to be contacted. It is your webmaster, it is about the architecture of your site. That is done by someone who writes the programming of your site.
374,190
Hi Gabe - By the time I figure this out, I might be an expert on robot.txt files. Grrrrr.
Thanks Roy - I've tried the tester and that failed too. :(
8,058,760
To test which URLs Google can and cannot access on your website, try using the robots.txt Tester.
Learn about robots.txt files
374,190
I have tried everything suggested by Google and am not having much luck with help from my current DNS host. :(
2,818,459
Oh gosh. I would either try to contact your webmaster (if you have one) or else google this question. I think this is something were you really need someone who understands websites to help.