The molecules that make up the metal of the sword sit in a crystalline lattice. In an ideal crystal, every atom has a place in a perfect periodic pattern. Real crystals have defects, differences from the ideal pattern that efficiently packs the constituent atoms.
-
-
Show this thread
-
A defect is called a dislocation, and is an abruption in the periodic structure of the crystal lattice: a missing or misplaced atom, excess structure in the lattice, screwed edges, a kink or jog in glide planes, or some other geometric sin. These differences are free energy.pic.twitter.com/Qh0lWvALGv
Show this thread -
When the blacksmith heats the sword, he provides enough energy for the lattice to reflow and annihilate its dislocations. At a higher temperature each atom has a greater freedom of action, & the material falls into a higher entropy state as it cools - a more ideal lattice.
Show this thread -
So this is the general structure of annealing: accumulation of internal free energy in a system; increased temperature reduces constraints on freedom of action for the constituents of the system; & constituents exploit new freedom to move the system to a higher entropy state.
Show this thread -
Where else do we see annealing appear? One clear place is in machine learning & information geometry, in what's called simulated annealing. This is a probabilistic technique for finding the global optimum of a non-convex function, where there's many local optima & singularities.pic.twitter.com/6dUdXMaIJ3
Show this thread -
The energy landscape of anything we care about - anything real; anything part of an open system, or with internal hierarchy or interconnectivity - is not convex or regular, but possesses non-linearities & singularities. We're navigating a rugged mountain range, wandering a maze.pic.twitter.com/Gstd2PAWS1
Show this thread -
Ordinary gradient descent can't effectively navigate this rugged landscape, because the derivative at local optima is 0 in all dimensions, & doesn't exist at singularities. Simulated annealing doesn't exploit the gradient of the function, so it can uniquely solve the landscape.
Show this thread -
Simulated annealing works by probabilistically jumping between states of the function in search of the lowest energy one, i.e. least cost or max likelihood. As a temperature parameter decreases, so does the probability of switching to a new state. At 0T, we settle in the optimum.pic.twitter.com/gFtQfn5ELu
Show this thread -
We can see the similarity to metallurgical annealing: the constituents (statistical parameters, molecules) have more degrees of freedom at higher T, and so the system dynamics span a greater volume of phase space. As the system cools, it settles into a lower energy state.
Show this thread -
Any complex thermodynamic system can be annealed. A financial market is efficient when participants successfully arbitrage away all negentropy in the price action by consuming free energy. This is structural correlations between market participants, internal mutual information.
Show this thread -
When structurally unresolvable correlations accumulate in the market due to system boundary conditions, trader computational constraints, or exogenous energy sources, the market begins to oscillate between compression & expansion phases at logarithmically increasing frequency.pic.twitter.com/fNTgC2H4gb
Show this thread -
At the market's characteristic frequency of oscillation, enough free energy has built up in the market that the temperature (variance) increases, internal correlations are revealed & annihilated, & the market settles into a higher entropy, more informationally efficient regime.pic.twitter.com/AniKHJM8MR
Show this thread -
Another domain: the brain. At each scale, the brain inputs sensory data & compares it with top-down prior expectations. Mismatch between sensory input & expectation is free energy, surprise. The brain acts to minimize this free energy, converting it into work for updating priors.
Show this thread -
This periodic oscillation between free energy production & consumption induces a characteristic resonance frequency, where the brain "rings" -- free energy spills over into adjacent harmonics & self-amplifies. Annealing can disrupt these negentropic attractors & dampen cacophony.pic.twitter.com/EVVyOQVWbH
Show this thread -
Meditation - or prayer, or drugs - is a form of annealing. It drives the brain into a higher energy state, where greater degrees of freedom allow internal dislocations - free energy, prediction error - to realign into more euphonic structures. Always we forge our selves.pic.twitter.com/k6JfIYZ49d
Show this thread -
Societies & civilization, too, anneal themselves. The narratives that we use to interpret and guide events - the norms & expectations that govern our collective behavior - are themselves machinery for consuming and using free energy, and so can incur errors or dislocations.
Show this thread -
If our governing narratives are misaligned from the rhythms of the world, unexploited free energy accumulates in our global circuitries. These tensions & misalignments are the structures we're trapped in that constrain us from right action - decadence, inequality, sclerosis, &c.pic.twitter.com/M6Qgz5iKwz
Show this thread -
When these tension reach a fevered pitch, global temperatures rise and energy spills out across the system: war, political revolution, social unrest, economic catastrophe, plague. The old structures of our lives are burned down, having dried out; new vital ways become possible.pic.twitter.com/KBpKWRisDu
Show this thread -
"Everything under heaven is in utter chaos; the situation is excellent." The constraint of the parts constitutes the freedom of the system. These constraints can be scaffolding for our growth as parts, or intolerable chains. With heat, we can smelt our chains & craft new virtue.
Show this thread -
The delicate work is always with the hammer & the sand. If we strike poorly, beat ourselves into the wrong shape, we can worsen our dislocations. If we cool too quickly, or unevenly, we make ourselves fragile and may shatter when struck. But with a forge and skillful hands...
Show this thread
End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.