Inside The Atlantic’s AI bot blocking strategy
The Atlantic has built a scorecard for AI crawlers, identifying which bots actually send readers back and which just strip content. Only those with value get through.
This approach led it to block ...