agw/overleaf-cep
1
0
Fork 0
mirror of https://github.com/yu-i-i/overleaf-cep.git synced 2026-05-27 11:01:56 +02:00
Code Issues Packages Projects Releases Wiki Activity

Remove changes to robots.txt.

Browse Source
This commit is contained in:
Paulo Reis
2018-08-02 16:33:45 +01:00
parent f418929dcf
commit f605e79fa5
1 changed files with 1 additions and 20 deletions
Download Patch File Download Diff File Expand all files Collapse all files

21
services/web/public/robots.txt
View File

@@ -1,21 +1,2 @@
# robots.txt for https://www.sharelatex.com/
User-agent: *
Disallow: /project/*
Disallow: /github/repos/*
Disallow: /recurly.com
Disallow: /user/password/set
Disallow: /learn-scripts/*
Allow: /
User-Agent: AhrefsBot
Disallow: /
User-Agent: XoviBot
Disallow: /
User-Agent: RankSonicBot
Disallow: /
User-Agent: SMTBot
Disallow: /
Disallow: /