# Screaming Frog SEO Spider - Crawl très lent User-agent: Screaming Frog SEO Spider Crawl-delay: 5 # Autres bots de crawl courants User-agent: AhrefsBot Crawl-delay: 10 User-agent: SemrushBot Crawl-delay: 10 User-agent: MJ12bot Crawl-delay: 10 User-agent: * # Pages fonctionnelles sans valeur SEO Disallow: /ecommerce/panier.html Disallow: /ecommerce/ Disallow: /commande Disallow: /authentification Disallow: /recuperation-mot-de-passe Disallow: /mon-compte Disallow: /identite Disallow: /historique Disallow: /adresses Disallow: /module/ # Paramètres de tri/filtrage (contenu dupliqué) Disallow: /*?order= Disallow: /*?q= Disallow: /*?controller=cart Disallow: /*?controller=authentication Disallow: /*?controller=password Disallow: /*?controller=my-account Disallow: /*&order= Disallow: /*&resultsPerPage= Disallow: /*&page= Disallow: /*&q= Disallow: /*?q= # Fichiers techniques PrestaShop Disallow: /classes/ Disallow: /config/ Disallow: /download/ Disallow: /mails/ Disallow: /modules/ Disallow: /translations/ Disallow: /tools/ Disallow: /themes/ Disallow: /var/ Disallow: /app/ Disallow: /cache/ Disallow: /vendor/ # Sitemap Sitemap: https://www.marleva.net/1_fr_0_sitemap.xml