Whenever I worry that I’ve said something slightly controversial, it often turns out I didn’t go far enough. We’re all our own worst censor.