The robots.txt file should be located in the Magento 2 root folder

dmitrii_fediuk (Dmitrii Fediuk) April 12, 2016, 8:47am 1

github.com

magento/magento2/blob/052e789/.htaccess#L178-L181


############################################
## never rewrite for existing files, directories and links


RewriteCond %{REQUEST_FILENAME} !-f

How to create or customize the robots.txt?

dmitrii_fediuk (Dmitrii Fediuk) April 12, 2016, 9:28am 2

See also:

How to create or customize the robots.txt?

dmitrii_fediuk (Dmitrii Fediuk) Split this topic December 22, 2020, 3:06am 3

A post was split to a new topic: What’s needed for the correct robots.txt file to be served on the root folder?