This repository has been archived on 2023-03-18. You can view files and clone it, but cannot push or open issues or pull requests.

Sam Saffron bb4e8899c4 FEATURE: let Google index pages so it can remove them ... Google insists on indexing pages so it can figure out if they can be removed from the index. see: https://support.google.com/webmasters/answer/6332384?hl=en This change ensures the we have special behavior for Googlebot where we allow indexing, but block the actual indexing via X-Robots-Tag		2020-05-11 12:15:18 +10:00
..
index.erb	Revert "FEATURE: add Noindex to robots.txt for disallowed routes"	2019-07-30 11:33:38 +10:00
no_index.erb	FEATURE: let Google index pages so it can remove them	2020-05-11 12:15:18 +10:00