User-agent: *
Disallow: /spider-trap

User-agent: thesubot
Disallow: /