minus c543a1df8c
Block search engines via robots.txt (#631)
Prevents instances from being rate limited due to being senselessly
crawled by search engines. Since there is no reason to index Nitter
instances, simply block all robots. Notably, this does *not* affect link
previews (e.g. in various chat software).
2022-06-04 17:48:25 +02:00
..
2022-03-21 17:49:07 +06:00
2021-12-27 02:43:27 +01:00
2022-01-09 23:35:56 +01:00
2019-09-24 02:43:25 +02:00
2019-09-24 02:43:25 +02:00
2019-09-24 02:43:25 +02:00
2019-09-24 02:43:25 +02:00
2021-02-14 12:49:09 +01:00
2020-07-04 13:20:54 +02:00
2019-09-24 02:43:25 +02:00