Comments on: How Important Is A Robots txt. File http://bloggingwithoutablog.com/how-important-is-a-robots-txt-file/ Tue, 22 May 2012 21:25:49 +0000 hourly 1 http://wordpress.org/?v=3.3.1 By: Barbara http://bloggingwithoutablog.com/how-important-is-a-robots-txt-file/#comment-895 Barbara Thu, 01 Nov 2007 06:18:59 +0000 http://bloggingwithoutablog.com/how-important-is-a-robots-txt-file/#comment-895 Hi Asako, I looked at your robots.txt file, and it doesn't appear you are blocking any user agents. Does your blog automatically ping Technorati when you publish a post? WordPress uses pingomatic, which includes Technorati. You can also manually ping Technorati, but that's can get time consuming. I know you were "working behind the scenes" a few weeks ago. You might try and backtrack and see if you can figure out what you changed. It's probably something very simple. You are correct....make one small mistake, and you could be in deep trouble. Trust me, I crashed both of my blogs, and it was all because I did something I wasn't familiar with. But.......that's how we learn. Hi Asako,

I looked at your robots.txt file, and it doesn’t appear you are blocking any user agents.

Does your blog automatically ping Technorati when you publish a post? WordPress uses pingomatic, which includes Technorati.

You can also manually ping Technorati, but that’s can get time consuming.

I know you were “working behind the scenes” a few weeks ago. You might try and backtrack and see if you can figure out what you changed. It’s probably something very simple.

You are correct….make one small mistake, and you could be in deep trouble. Trust me, I crashed both of my blogs, and it was all because I did something I wasn’t familiar with. But…….that’s how we learn.

]]> By: Asako http://bloggingwithoutablog.com/how-important-is-a-robots-txt-file/#comment-894 Asako Thu, 01 Nov 2007 04:46:18 +0000 http://bloggingwithoutablog.com/how-important-is-a-robots-txt-file/#comment-894 Hello Barbara, This has been done with my site for a few week now. And I am finding since I did this, Technorati never updates my site. My Technorati listing says I have not written any article already for 44 days!! Do you think I am blocking Technorati's robot to crawl? These things are so tricky. Hello Barbara,

This has been done with my site for a few week now. And I am finding since I did this, Technorati never updates my site. My Technorati listing says I have not written any article already for 44 days!!

Do you think I am blocking Technorati’s robot to crawl?

These things are so tricky.

]]>