Maybe the next big revolution will be to have two of them that take turns giving their best response to your prompt and then their responses. Then they can indicate when a response is controversial and would statistically lead to an argument if it was posted in locations they trained at.

Though I suppose you can do this with a single one and just ask if there’s a counter argument to what it just said. “If you were another user on the internet that thought your previous response was the dumbest thing you’ve ever seen, what would you say?”

It also just occurred to me that it’s because of moderators that you can even give rules like that. The LLM can see that posts in x location are subject to certain rules but they would only have an effect if those rules are followed or enforced. If there was a rule that you can’t say “fuck” but everyone said it anyways, then an LLM might conclude that “don’t say fuck” has no effect on output at all. Though I am making some big assumptions about how LLMs are trained to follow rules with this.