ngn/libremdb
1
0
Fork 0
Code Issues 1 Pull Requests 10 Actions Packages Activity
libremdb/public/robots.txt

4 lines
40 B
Plaintext
Raw Normal View History

fix(robots.txt): disallow all robots crawl way too much
2022-06-05 19:19:29 +05:30
User-agent: *
feat: major rewrite the application is now rewritten in next.js. this commit also adds the ability to see trailers, did you know, more like this, etc. on title page. BREAKING CHANGE: the whole application is rewritten from scratch.
2022-09-11 19:37:24 +05:30
Allow: /about
fix(robots.txt): disallow all robots crawl way too much
2022-06-05 19:19:29 +05:30
Disallow: /
Reference in New Issue Copy Permalink