feat: add robots.txt to fix #81 (#113)

* feat: add robots.txt to fix #81 * feat: dynamic implementation
Stadt-Geschichte-Basel · Jun 6, 2024 · 2afd954 · 2afd954
1 parent 545dcea
commit 2afd954
Showing 1 changed file with 16 additions and 0 deletions.
diff --git a/utilities/robots.txt b/utilities/robots.txt
@@ -0,0 +1,16 @@
+---
+#####
+# generates a robots.txt based on https://developer.mozilla.org/en-US/docs/Glossary/Robots.txt
+# blank if noindex: true is set in _config.yml
+#####
+permalink: /robots.txt
+---
+{%- if jekyll.environment == "production" and site.noindex != true -%}
+User-agent: *
+Allow: /
+
+Sitemap: {{ site.url }}/robots.txt
+{%- else -%}
+User-agent: *
+Disallow: 
+{%- endif -%}