add old sitemap and robots.txt

gita · Aug 20, 2023 · a890444 · a890444
1 parent 95bf334
commit a890444
Show file tree

Hide file tree

Showing 2 changed files with 4,155 additions and 0 deletions.
diff --git a/public/robots.txt b/public/robots.txt
@@ -0,0 +1,16 @@
+User-Agent: *
+Disallow:
+Disallow: /github-login
+Disallow: /google-login
+Disallow: /facebook-login
+Disallow: /google/authorized
+Disallow: /facebook/authorized
+Disallow: /github/authorized
+Disallow: /reset-password
+Disallow: /join-from-invite
+Disallow: /unconfirmed
+
+# Host
+Host: https://bhagavadgita.io
+
+Sitemap: https://bhagavadgita.io/sitemap.xml