User-agent: Scrapy Allow: / # Termly scanner User-agent: TermlyBot Allow: /