whentimeslows/website
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Merge pull request #26155 from sftim/20210119_robots_txt_prepare_for_new_api_docs

Browse Source 
Skip crawling for new API documentation
This commit is contained in:
Kubernetes Prow Robot
2021-01-19 16:15:59 -08:00
committed by GitHub
parent a5630c5dde ec8deb56e7
commit 8005676dd1
1 changed files with 4 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
layouts/robots.txt
+4
View File
@@ -6,4 +6,8 @@ Disallow: /v1.1/
Disallow: /404/
Disallow: /404.html
Allow: /docs/reference/kubernetes-api/api-index/
Allow: /docs/reference/kubernetes-api/labels-annotations-taints/
Disallow: /docs/reference/kubernetes-api/
SITEMAP: {{ "sitemap.xml" | absLangURL }}