A deep look at Boltzmann’s work and its relevance to the human brain

The inevitability of entropy. Photo by Brook Anderson on Unsplash.

This will be fun.

Let us dial the clock back to 1856.

The German physicist Rudolf Clausius has just fine-tuned his statement of the second law of thermodynamics, one of the fundamental laws of physics:

“The Entropy of the Universe tends to a maximum.”

Not quite the second law as we know today, but close enough.

Today, the second law states that the entropy of an isolated system cannot decrease over time (therefore, either stays the same, or increases).

Heat flows from a hotter to a colder body, not vice versa. Air concentrated in a corner of a room spreads…

Mark I Perceptron: One of the earliest attempts at a machine that can learn, or in the words of Rosenblatt himself, “capable of having an original idea”. Taken from Wikipedia.

The field of AI/ML has come a long way, since Rosenblatt’s perceptron machine, way back in the 1950s. So, we reflect on some of the important questions:

  • Are we getting closer to our goal of super-human artificial general intelligence?
  • Are we close to creating learning machines which are guaranteed to perform well on unseen data (i.e., generalize)?
  • Is passive dataset-based learning still anything more than a function estimation problem?

These are some of the questions which are being pondered by scientists and AI-enthusiasts alike. …

Ryder Garett

Peeling the infinite onion of ego-deaths.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store