Page 1 of 1
Defaut robots.txt
Posted: Mon Apr 11, 2011 2:48 pm
by foodsleuth
Hello,
I see in the default (out of the box) robots.txt file the images (assets) directory is blocked from bots. Normally one wants their images indexed. What is the logic here?
Thank you,
Barb
Re: Defaut robots.txt
Posted: Thu Oct 27, 2011 11:47 am
by combra
Hi,
AC, I have a question on this as well.
When I checked my Google Merchant Center (the Google Feed) account this morning, I got a critical error warning,
"Roboted images (9 items)
The submitted image URLs seem to be blocked by robots.txt. Google will not be able to display these images together with the products. Please change your robots.txt file to allow Google to download the image."
The images that it refers to are in the assets folder. Is there any concern to removing the 'Assets' line from the robots.txt?
Thanks,
Brandon
Re: Defaut robots.txt
Posted: Fri Jul 15, 2016 12:14 pm
by edinos
Where do you go to allow images?