# hd.se
User-Agent: *
Disallow: /kommentera/post
Disallow: /hitta/?q=*
Disallow: /hitta/?d=*
Disallow: /hitta/?i=*
Disallow: /hitta/?c=*
Disallow: /hitta/?a=*
Disallow: /api/
Disallow: /b/
Disallow: wp-admin
Disallow: *?from=*
Disallow: *?flik=*
Disallow: *?action=*
Disallow: *?latesttab=*
Disallow: /hitta/
Disallow: /sport/hitta/
Disallow: /static/sandbox/

User-agent: Slurp
Crawl-delay: 0.5