robots.txt block all except lighthouse

Question

I have a staging site, that I want to be able to test via google lighthouse - but do not want google to index it.

When I use this:

User-agent: *
Disallow: /

Lighthouse and google are blocked.

I think the user-agent is "Chrome-Lighthouse" for lighthouse (source), but I'm not sure how to write the syntax for robot.txt.

Any suggestions?

Not sure this is on-topic here. You might also ask on https://webmasters.stackexchange.com. See: https://webmasters.stackexchange.com/help/on-topic — dbc, Aug 14 '19 at 19:42
I think the user-agent is "Chrome-Lighthouse" for lighthouse, but I'm not sure how to write the syntax for robot.txt — user1256378, Aug 14 '19 at 19:48
OK, then maybe see [Disallow all for all user agents except one user agent?](https://stackoverflow.com/q/33617859). — dbc, Aug 14 '19 at 19:55

score 3 · Accepted Answer · edited Aug 20 '19 at 10:57

3

Thank you dbc the link gave me the answer

useragent: *
disallow= /

useragent: Chrome-Lighthouse
allow= /

Based on the comment it should be:

User-agent: *
Disallow: /

User-agent: Chrome-Lighthouse
Allow: /

edited Aug 20 '19 at 10:57

unor

answered Aug 14 '19 at 21:30

user1256378

2

This is not correct. It’s `User-agent` and `Disallow:` / `Allow:`. – unor Aug 18 '19 at 21:30
1

Thank you - so lighthouse ignored it because it was malformed – user1256378 Aug 19 '19 at 22:56
2

The robots.txt you included in your question is syntactically correct. The corrected syntax in your answer is still incorrect. I’ll edit it. – unor Aug 20 '19 at 10:57

1 Answers1