1

For example, if this is set in Apache settings:

<IfModule mod_headers.c>
    Header set X-Robots-Tag "noindex, nofollow"
</IfModule>

and this is set in a robots.txt file:

User-agent: *
Allow: /

which one will take precedence?

Pere
  • 1,647
  • 3
  • 27
  • 52
  • [Is there any advantage of using X-Robot-Tag instead of robots.txt?](http://stackoverflow.com/q/35639040/1591669) – unor Jan 26 '17 at 17:15

1 Answers1

0

These are different instructions and so your query is void. Here the robots.txt file is allowing the crawling and the x-robots-tag is controlling the indexing.

Though if you had shown something which had the same directives but in different formats, then it would be the case that (for googlebot at least) the most restrictive would be noted.

user29671
  • 782
  • 6
  • 13