Skip to content

Commit

Permalink
Block "FriendlyCrawler"
Browse files Browse the repository at this point in the history
  • Loading branch information
@confused-Techie
confused-Techie committed Oct 28, 2024
1 parent 8053a8e commit 23a83be
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions static/robots.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -4,4 +4,6 @@ User-agent: AdsBot-Google
User-agent: Mediapartners-Google
User-agent: AdsBot-Google-Mobile-Apps
Allow: /
User-agent: FriendlyCrawler
Disallow: /
Sitemap: https://web.pulsar-edit.dev/sitemap.xml

0 comments on commit 23a83be

Please sign in to comment.