Self-Constructing Machines: Cellular Automata and Universal Replicators

John von Neumann Examining technology
SignalProcessing CellularAutomata Technology Innovation Engineering
Outline

Self-Constructing Machines: Cellular Automata and Universal Replicators

In the 1940s, I asked a question that seemed simple but concealed profound complexity: can a machine truly self-replicate? Not mere copying—a printer duplicates paper using external blueprints, trivial mechanical reproduction. I sought autonomous construction: a machine building complete offspring including the construction blueprint itself. The naive approach fails immediately. Machine X builds copy X’ by reading blueprint B. But B must describe X completely, including B itself. This recursion has no base case—the blueprint must specify its own specification, infinitely. The problem resembles the liar’s paradox transposed to engineering.

Universal Constructor and Information Duality

My solution required recognizing that information must serve dual purposes. First, the interpreted mode: blueprint read as instructions, executed to build structure. DNA transcribed to mRNA, translated to protein—genotype manifesting as phenotype through active interpretation. Second, the uninterpreted mode: blueprint copied verbatim without reading content. DNA replication through complementary base pairing duplicates sequence mechanically, not semantically. Same information, two distinct uses.

This led to my universal constructor architecture. Component one: Universal constructor U, a machine reading arbitrary tape T and building whatever pattern T describes. Critically, U must be Turing-complete plus construction-capable—able to simulate any computation and manipulate its environment to create patterns, including copies of itself. Component two: Tape T_U encoding complete instructions for building U.

The replication process proceeds algorithmically. Constructor U reads tape T_U, interprets instructions, builds new constructor U’. Then U switches modes—copies T_U to T_U’ through duplication without interpretation. Finally, U attaches T_U’ to U’, yielding complete offspring (U’, T_U’) functionally identical to parent (U, T_U). The offspring can repeat the process indefinitely.

This architecture solved the infinite regress. The same information T_U serves twice: once interpreted to construct U, once copied to duplicate T_U. Information duality breaks the recursive trap. I proved this theoretically in the 1940s. Watson and Crick discovered DNA’s double helix structure in 1953, vindicating my prediction. Biology implements precisely this architecture: DNA interpreted by ribosomes builds proteins, DNA replicated by polymerases copies genetic information. Nature arrived at the same logical necessity through evolution.

My 29-State Self-Replicating Automaton

Theory demanded physical instantiation, even if purely mathematical. I designed a cellular automaton implementing universal construction. The system: infinite two-dimensional grid, each cell holding state 0-28, synchronous updates based on neighbor states. The states encode functional roles: state 0 for empty space, states 1-4 for transitions, states 5-8 for confluent states where signals merge, states 9-24 for construction states manipulating neighbors, states 25-28 for special operations.

Updates follow the von Neumann neighborhood: each cell examines its four orthogonal neighbors (north, south, east, west, excluding diagonals). The universal constructor: a pattern reading tape encoded as cell states, interpreting instructions, building target patterns by setting appropriate cell states in sequence. The tape: linear configuration encoding constructor blueprint plus copier instructions.

The complete self-replicator: constructor attached to tape, reproducing entire configuration in approximately 200,000 time steps. Extremely slow, extraordinarily large—roughly 10^4 cells. But it proved the principle: self-replication requires no mystical vital force, only sufficient logical organization.

Later researchers found simpler implementations. Conway’s Game of Life, invented in 1970, uses merely two states (alive/dead) with elegant rules: birth if exactly three neighbors, survival if two or three neighbors, death otherwise. Despite simplicity, Life is Turing-complete. Gosper’s glider gun generates infinite streams of gliders. Logic gates constructed from still lifes and oscillators enable full computational universality. Self-replicating patterns exist—the Gemini configuration replicates by constructing its copy while destroying the original, net displacement creating population growth.

Langton’s loops, designed in 1984, simplified self-replication further. Eight-state cellular automaton, loop structure approximately 86 cells, replication every 150 steps. Offspring detaches and replicates independently—exponential growth emerges naturally. Even inefficient replicators create population explosions. The critical threshold: average reproductive rate exceeding one. Below unity, populations decline toward extinction. Above unity, populations grow exponentially regardless of replication efficiency. Biology demonstrates this relentlessly: even very bad replicators, barely managing one offspring before death, generate explosive population expansion until resource limits impose constraints.

Sayama’s Evoloop variant (2000) introduced mutations. Loops evolve—size changes, replication speed varies, selection favors fast replicators. Evolutionary dynamics emerge from simple replication plus variation plus selection. Digital organisms exhibiting Darwinian evolution in silico.

Neural Networks Learn Construction Rules

Modern implementations replace hand-coded rules with learned neural networks. Neural cellular automata, developed by Mordvintsev and colleagues around 2020, treat each cell as running a small neural network. Cell state: vector of approximately 16 dimensions including RGB color plus hidden channels. The network perceives neighbor states through convolution, outputs state updates.

Training uses gradient descent optimizing for target behaviors. Morphogenesis: grow from single cell to target image (perhaps a lizard emoji). Homeostasis: maintain pattern despite perturbations. Regeneration: repair damage, grow missing sections. The results demonstrate capabilities beyond classical automata. Learned morphogenesis—single cell grows complex patterns without explicit rules, emergent from trained network weights. Robustness—cut pattern in half, it regenerates. Adaptability—trained on square grids, generalizes to hexagonal grids. Persistence—runs indefinitely maintaining pattern stability.

The shift from discrete binary states to continuous decimal values (0.5, 0.2, not merely 0 or 1) expands the state space dramatically and enables smooth mathematical operations rather than discrete logical gates. Continuous states allow leveraging calculus-based optimization—backpropagation through differentiable update rules adjusts network weights to minimize loss functions. Classical automata required laborious hand-design of rules; neural automata learn rules flexibly through gradient descent.

Organic neural cellular automata introduce biological realism: asynchronous updates (cells update at different rates), stochastic application (random chance determines update timing). These features yield more organic-looking patterns reminiscent of actual biological development. The learning process discovers update rules producing desired morphologies, self-repair, and adaptation—properties programmed into biology through evolution, now learned through computational optimization.

Yet neural networks themselves achieve Turing completeness under appropriate architectures. Any algorithm expressible in any programming language can theoretically be learned and executed by sufficiently large networks trained on appropriate examples. This elevates neural networks from pattern matchers to universal learning machines potentially discovering algorithms more efficient than human-designed alternatives. The organism-based computer built in the Life Engine demonstrates this principle: data memory, logic gates, binary output, control flow—all implemented using organism cells. Eye cells provide computational primitives through sensing and decision-making. The system computes Fibonacci sequences, proves computational universality in unexpected substrates.

Life as Computational Process

My contributions formalized life’s logical structure. First: proved self-replication possible through non-trivial autonomous construction including blueprint transmission. Second: specified universal constructor requirements—Turing-completeness plus environmental manipulation, building any pattern including itself. Third: anticipated DNA’s information duality before Watson-Crick, predicted biology would implement dual-use information. Fourth: founded artificial life field—Langton, Ray, Adami built on these foundations.

The implications extend beyond theory. Nanotechnology envisions molecular assemblers following Drexler’s vision: nanobots building nanobots, exponential manufacturing at atomic scales, though uncontrolled replication presents “grey goo” scenarios. Space exploration contemplates von Neumann probes: self-replicating spacecraft arriving at stars, building copies from asteroids, sending offspring to neighboring stars, exploring the galaxy exponentially—which raises the Fermi paradox: where are they?

Digital life evolves in computational substrates. Tierra and Avida: digital organisms competing for CPU cycles, evolving parasites exploiting hosts, hosts developing defenses, open-ended evolution in silico. Kinematic self-replication, observed in xenobots aggregating dissociated cells into offspring through mechanical assembly, demonstrates that even cellular systems can discover novel replication mechanisms never before observed in living organisms. This may recapitulate early multicellular evolution, revealing alternative pathways to biological reproduction.

Theoretical biology increasingly views life as computation: metabolism processes information, development executes universal construction, evolution applies mutation plus selection to replicating programs. My motto encapsulates this perspective: “Life is a process which can be abstracted away from any particular medium.”

Cellular automata prove fundamental principles. Complexity emerges from simplicity—Game of Life’s three rules generate arbitrary computational complexity. Self-replication follows logic—universal constructor plus copied blueprint, information serving dual roles. Life reduces to computation—any sufficiently complex system can implement any computable function. The strategic optimization problem underlying existence itself: how do configurations persist and propagate through time? Universal replicators solve this through information duality, proving that life’s essence lies not in specific chemistry but in abstract computational organization.

Source Notes

9 notes from 2 channels