Good post from Creative Commons with concerns about pay-per-crawl efforts, including principles to guide deployment:

Pay-to-crawl represents a strategy that may work for some websites, and not all websites share the same underlying concerns. Pay-to-crawl systems should not be deployed as an automatic or assumed setting on behalf of websites by others, such as domain hosts, content delivery networks, and other web service providers.

Matches some of my thinking about Cloudflare and AI.