What are neural cellular automata?

Emergent Garden
Nov 21, 2021
9 notes
9 Notes in this Video

Conway's Game of Life: Classic Example of Emergence from Simplicity

ConwaysGameOfLife CellularAutomata EmergenceFromSimplicity SimpleRulesComplexity
00:20

Conway’s Game of Life is probably the most famous cellular automaton—a grid of cells that can either be one or zero, colored or black, alive or dead.

Continuous Cell States: From Binary to Decimal Values in Cellular Automata

ContinuousStates DecimalValues CellComplexity MathematicalOperations
01:00

Neural cellular automata (NCAs) do a few things differently from classical cellular automata—for one, they are continuous where rather than a cell state being either a binary 1 or zero, it can be a decimal value in between like 0.5 or 0.2.

Convolution Operation: How NCAs Process Local Neighborhoods

ConvolutionOperation LocalNeighborhood FilterSliding PixelProcessing
01:34

The first step of the NCA algorithm is the convolution—the local neighborhood part where each cell looks at its neighbors and determines its next state.

Activation Functions: Mathematical Transformations Adding Complexity to NCAs

ActivationFunctions MathematicalTransformation NonLinearity PatternComplexity
02:10

As those who might know a thing or two about neural networks might guess, much more complexity can be added by introducing what is called an activation function.

Identity Function vs Transformations: How Activation Scaling Changes Patterns

IdentityFunction FunctionTransformations ActivationScaling PatternModification
02:26

The default activation is pretty straightforward—it’s what’s called the identity function that simply returns the input x without change, as if there is no activation function at all.

Value Clipping: Constraining Pixel Values Between Zero and One

ValueClipping BoundaryConstraints PixelLimits Saturation
02:42

In neural patterns, because the pixel value can only be between 0 and 1, the final value is clipped between 0 and 1.

Inverted Bell Curve Activation: Producing Organic Worm-Like Patterns

BellCurveActivation GaussianFunction OrganicPatterns UnexpectedComplexity
02:57

The worm simulation features a funky activation function which is essentially an inverted bell curve or Gaussian, producing a really organic-looking pattern.

Implementing Conway's Game of Life Through Clever Filters and Activation

GameOfLifeImplementation CleverDesign DiscreteFromContinuous RuleEncoding
02:57

Activation functions can add a lot of power to the NCA algorithm—in fact, one can actually implement Conway’s Game of Life with a clever filter and activation combination.

Inexplicable Organic Complexity: Why Simple Parameters Produce Lifelike Patterns

InexplicableComplexity OrganicPatterns EmergentMystery ComputationalMicroverse
03:07

When asked why a particular filter and activation produce a specific pattern, the honest answer is: “I have no idea.”