~dusnm/dusanmitrovic.xyz

d5da9c681a9a45618312478d9dd4e78407cd42d2 — Dušan Mitrović 1 year, 1 month ago 55ce02a
Adding The Internet Archive bot to the list of disallowed user agents.

Signed-off-by: Dušan Mitrović <dusan@dusanmitrovic.xyz>
1 files changed, 2 insertions(+), 0 deletions(-)

M robots.txt
M robots.txt => robots.txt +2 -0
@@ 18,3 18,5 @@ User-agent: Yandex
Disallow: /
User-agent: MJ12bot
Disallow: /
User-agent: ia_archiver
Disallow: /