Files
Tim Bannister ec8deb56e7 Skip crawling for new API documentation
This prepares for the launch of new API documentation, initially without
indexing by search engines.
2021-01-19 23:58:39 +00:00

14 lines
304 B
Plaintext

User-agent: *
Disallow: /legacy/
Disallow: /v1.0/
Disallow: /v1.1/
Disallow: /404/
Disallow: /404.html
Allow: /docs/reference/kubernetes-api/api-index/
Allow: /docs/reference/kubernetes-api/labels-annotations-taints/
Disallow: /docs/reference/kubernetes-api/
SITEMAP: {{ "sitemap.xml" | absLangURL }}