Programming language:Go

Hugo Robots.txt template

Code: Go

2021-02-01 01:33:13

User-agent: *

Disallow: /disclaimer/
Disallow: /partners/
Allow: /
Allow: /contact/
Allow: /blog/
{{ range where .Site.RegularPages "Type" "blog" }}
Allow: {{.RelPermalink}}
{{end}}
Sitemap: {{ .Sitemap.Filename | default "sitemap.xml" | absURL }}`

S.Exchange

Code: Go

2021-04-09 20:47:11

In layouts/robots.txt

User-agent: *

{{range .Pages}}
Disallow: {{.RelPermalink}}
{{end}}

-1

New to Communities?

Join the community