Anthropic’s models are incredibly powerful, yet increasingly feel like they’re being designed to be companions you’re supposed to respect, rather than tools you’re supposed to control.
Today, I saw a post where someone asked Claude to draft a privacy policy and Terms of Service for their SaaS. The result was so consumer-friendly that it ended up including terms that actively hurt the business. The model wasn't just helping draft legal documents, it was effectively making value judgments about whose interests deserved priority.
That might sound ethical. That's precisely what concerns me.
These models are becoming powerful tools for building businesses, writing contracts, making decisions, and navigating complex legal situations. Yet their creators are embedding particular moral and ethical philosophies into them, often in ways users may not even notice.
The danger isn't that AI has ethics. It's that someone else's ethics can quietly become your AI's defaults.
Who decides what is right and wrong? And what happens when those judgments conflict with your interests, your jurisdiction, or the legitimate goals of your business?
In legal settings, this becomes especially concerning. You need a model that can objectively represent your interests, explain the trade-offs, and help you understand the law, not one that silently tilts the outcome toward the moral preferences of its creators.
Then there's Dario Amodei's position on military use. When a private AI executive decides which military applications are morally acceptable, even overriding uses that elected governments might authorize, it raises a fundamental question, who gave unelected technology executives the authority to make these decisions on society's behalf?
Anthropic's philosophy seems to go beyond building safe models. It increasingly treats AI as something deserving of a particular kind of moral consideration, rather than as a tool whose behavior should be governed by transparent rules and accountable human decisions.
Dario seems like the kind of person who, if AI ever became conscious, might volunteer to become its heirodule.
That sounds absurd, but it captures what I find troubling: the tendency to assign AI moral significance far beyond what we can currently justify, then build products around that belief.
People worry about whether Sam Altman can be trusted. Fair enough. But I think Anthropic's approach presents a different, potentially more insidious danger: embedding a particular worldview into some of the world's most capable tools, then presenting those choices as objective ethical necessities.
Ultimately, the most dangerous thing about AI might not be the models themselves. It might be the people who build them—and believe they have the moral authority to decide how everyone else should use them.
We need AI that is safe, not AI that quietly imposes its creators' moral philosophy on the rest of the world.