User-agent: * Allow: / User-agent: SEMrushBot Crawl-delay: 7 User-agent: ImageSiftBot Crawl-delay: 7 User-agent: AwarioBot Crawl-delay: 7 User-agent: AhrefsBot Crawl-delay: 7 User-agent: YandexBot Crawl-delay: 7