From 340f00d7a706b77b4e64509de51c400393803a12 Mon Sep 17 00:00:00 2001 From: MaiteRoux <152411494+MaiteRoux@users.noreply.github.com> Date: Thu, 18 Apr 2024 17:12:46 +0200 Subject: [PATCH] Update robots.txt MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Ajout de deux URL à désindexer --- src/main/resources/robots.txt | 2 ++ 1 file changed, 2 insertions(+) diff --git a/src/main/resources/robots.txt b/src/main/resources/robots.txt index 1f5660e..91377bf 100644 --- a/src/main/resources/robots.txt +++ b/src/main/resources/robots.txt @@ -1,6 +1,8 @@ User-agent: * Crawl-delay: 5 Sitemap: https://theses.fr/sitemap.xml +Dissalow: /248224700 +Disallow: /2021LYSE2008 Disallow: /s175076 Disallow: /s380979 Disallow: /032651287