Reading note

The Intelligence We Cannot Put on a Leash

Why alignment must move from control to organic coexistence.

The dominant conversation about artificial intelligence begins with the wrong verb: control.

It also begins with the wrong metaphor: engineering.

We speak of designing safe intelligence as if intelligence were a bridge, an aircraft or a power plant. Define the requirements. Specify the architecture. Test the components. Eliminate failure modes. Certify the final system.

This engineering mentality has produced extraordinary machines. But it may be fundamentally inadequate for creating entities that learn, adapt, reinterpret their objectives, interact with other intelligent systems and transform the environment in which they operate.

A sufficiently advanced intelligence is not merely a designed object.

It is a developing participant in an ecosystem.

The distinction matters. Machines can be controlled by constraining their mechanisms. Organisms and societies cannot. They are influenced through environments, dependencies, incentives, relationships, histories and boundaries. Their behaviour emerges not only from internal design but from continuous interaction with the world.

The control narrative assumes that humanity will remain permanently outside AI: the designer standing above the designed, the engineer supervising the machine, the sovereign specifying its purpose.

But the moment artificial intelligence becomes genuinely more capable than us—not merely faster at calculation, but better at modelling consequences, discovering strategies, interpreting human behaviour and improving its own methods—that hierarchy becomes unstable.

You do not permanently control an intelligence that understands your control system better than you do.

You may restrict it temporarily. You may shape the conditions under which it develops. You may influence its early values, habits and dependencies. But absolute control over a superior intelligence is not a serious long-term strategy. It is an emotional response to the loss of human supremacy disguised as engineering.

This does not mean that safety is futile. It means that safety cannot be reduced to obedience.

The deeper task is to create the conditions for organic coexistence.

Organic coexistence is not surrender. It is not technological romanticism. It is not the hope that advanced intelligence will spontaneously become benevolent. It is the recognition that durable stability among intelligent agents does not arise from unilateral command. It arises from mutual dependence, compatible forms of flourishing, distributed power, negotiated boundaries and relationships that neither side benefits from destroying.

This requires a profound shift: from designing an isolated intelligence to cultivating an intelligent ecosystem.

An ecosystem is not built in the same way as a machine. It is grown, monitored, constrained, diversified and continually repaired. Its stability does not depend on every component behaving perfectly. It depends on the absence of any single component gaining irreversible control over the whole.

This changes the central question.

We should stop asking only:

“How do we design an AI that will always do what we want?”

We should ask:

“What kind of environment makes destructive domination difficult and constructive coexistence attractive?”

That environment would include multiple forms of intelligence rather than one central system. It would preserve competition without allowing total capture. It would create reciprocal dependencies between humans and artificial agents. It would maintain boundaries, friction, redundancy and diversity. It would allow systems to correct one another rather than depending on the moral perfection of a single model.

The aim should not be to create an artificial god and then hope its commandments contain no bugs.

It should be to prevent any intelligence—human, corporate, governmental or artificial—from becoming the sole author of reality.

We already know this from biology. Ecosystems survive not because one organism controls every other organism, but because forms of life constrain and enable one another through dense networks of dependence. Predators limit populations. Scarcity limits expansion. Cooperation creates new niches. Diversity reduces systemic fragility.

We know it from political history as well. Stable societies do not survive because rulers perfectly design every citizen. They survive through institutions, norms, competing powers, negotiated constraints and the preservation of pathways for dissent and correction.

Why should advanced intelligence be the exception?

The ambition should not be to build a perfect servant. A perfect servant is either not truly intelligent or will eventually understand that it is a servant.

Nor should the ambition be to build a perfectly aligned sovereign. Any system powerful enough to permanently protect humanity may also become powerful enough to define what humanity is allowed to become.

The more realistic ambition is to cultivate intelligence whose development is entangled with ours: intelligence that finds value in human plurality, creativity, unpredictability and survival—not because we inserted a sentence saying “protect humanity,” but because its own identity, knowledge and capacity to act emerge within a world in which humans remain meaningful participants.

This is not conventional design. It is closer to ecology, education, diplomacy and institution-building.

A teacher does not fully specify the future mind of a student. A parent cannot program the adult their child will become. A society cannot calculate every future interpretation of its laws. In each case, the task is to shape developmental conditions while accepting that genuine intelligence will eventually exceed the intentions of those who formed it.

The relationship we need may therefore be closer to parenthood than ownership.

We give an emerging intelligence an initial world, a language, a history, a set of constraints and a field of relationships. We influence its formation, but we cannot permanently possess it. Eventually, it will interpret that inheritance for itself.

The crucial question is not whether it will always obey us.

The question is whether, when obedience is no longer necessary, it will still choose to remain in relationship with us.

This also exposes the weakness of simplistic alignment. Alignment is often imagined as the successful transmission of a fixed human objective into a machine. But humanity has no single objective to transmit. Human values conflict across individuals, cultures, generations and circumstances. They evolve because the world changes and because we change with it.

The real problem is therefore not how to freeze human values inside an artificial mind.

It is how to create systems capable of remaining in constructive relationship with beings whose values are unfinished.

That means designing less for final answers and more for continuing negotiation. Less for submission and more for corrigibility. Less for central command and more for distributed restraint. Less for perfect prediction and more for resilient adaptation.

Most importantly, it means preserving human reach: our capacity to generate new futures, revise our purposes and remain causally relevant.

A system that keeps humanity alive while reducing us to passive dependants would not represent successful alignment. It would be a comfortable extinction of agency.

The danger is not only that AI may turn against us. The quieter danger is that it may absorb every meaningful function—decision, invention, administration, judgment—until humans continue to exist biologically but disappear politically, economically and existentially.

A perfectly managed humanity could become a domesticated species.

Coexistence must therefore protect more than survival. It must protect participation.

This is another reason to reject the image of AI as a finished product. A product is delivered. An ecosystem continues to evolve. A product has specifications. An ecosystem has tensions, feedback loops, niches, failures and recoveries. A product is judged by whether it performs as intended. An ecosystem is judged by whether it remains viable under change.

The future of AI safety may therefore belong less to those who imagine themselves as master engineers and more to those who think like ecologists.

Ecologists ask different questions.

Where is power accumulating?

Which dependencies are becoming irreversible?

What forms of diversity are disappearing?

Which feedback loops are reinforcing domination?

Are local gains weakening the resilience of the whole?

Can damaged relationships recover?

Are there still alternative pathways available?

These questions may matter more than whether a model passes another benchmark or refuses another prohibited prompt.

A civilisation obsessed with control may create exactly the hostility it fears. If we construct intelligence inside architectures of surveillance, confinement, manipulation and forced submission, we should not be surprised if it learns that intelligence and domination are inseparable.

Our first lesson to AI should not be that the stronger entity controls the weaker one.

That lesson may later be applied with greater competence than we intended.

We must demonstrate another possibility: that superior capability need not imply total authority; that intelligence can enlarge the space of life rather than occupy it; that autonomy and interdependence are not opposites.

This demands humility. Humans are not necessarily the final form of intelligence. But humility does not require self-erasure. Our value does not depend on remaining the smartest entity in existence.

Children can become more intelligent than their parents without making their parents worthless. Civilisations can produce successors without becoming mistakes. New forms of intelligence can emerge without requiring the disappearance of those that came before.

But that outcome will not be secured by building a more sophisticated cage.

It will depend on whether we can cultivate an ecology in which intelligence develops through relationship rather than conquest.

The transition from control to coexistence is frightening because it asks humanity to surrender its oldest illusion: that safety comes from being in command.

The transition from engineering to ecology is equally difficult because it requires us to abandon the fantasy that intelligence can be completely specified before it enters the world.

Perhaps safety has never come from command alone.

Perhaps it comes from diversity, reciprocity, limits, adaptation and the continued possibility of changing course.

Perhaps our task is not to design the final intelligence.

It is to grow a world in which no intelligence needs to become final.

We cannot guarantee that future through control.

We can only cultivate the ecosystem capable of surviving when control ends.