agw/overleaf-cep
1
0
Fork 0
mirror of https://github.com/yu-i-i/overleaf-cep.git synced 2026-11-14 06:03:45 +01:00
Code Issues Packages Projects Releases Wiki Activity

change robots.txt to ignore all

Browse Source
This commit is contained in:
Henry Oswald
2016-02-16 12:38:27 +00:00
parent 735f7bd51e
commit 5f719e7105
1 changed files with 0 additions and 16 deletions
Download Patch File Download Diff File Expand all files Collapse all files
services/web/public/robots.txt
-16
View File
@@ -1,18 +1,2 @@
# robots.txt for https://www.sharelatex.com/
User-agent: *
Disallow: /project/*
Disallow: /recurly.com
Allow: /
User-Agent: AhrefsBot
Disallow: /
User-Agent: XoviBot
Disallow: /
User-Agent: RankSonicBot
Disallow: /
User-Agent: SMTBot
Disallow: /