robots.txt

lostdusty · Dec 3, 2023 · c04cf18 · c04cf18
1 parent a0ad69d
commit c04cf18
Showing 1 changed file with 4 additions and 0 deletions.
diff --git a/robots.txt b/robots.txt
@@ -0,0 +1,4 @@
+User-agent: Googlebot
+Allow: /*
+
+Crawl-delay: 1