Lecture 3

In 1948, a man working at Bell Labs helped change the modern world by asking what looked like a very simple question.

How much information do you actually need to send through a noisy communication channel?

That man was Claude Shannon.

And the reason I want to begin here is because before we ever talk about AI, before we ever talk about the subconscious, before we ever talk about prediction and attention and all the rest of it, you need to understand something that is as beautiful as it is disruptive:

Information is surprise.

No surprise, no information.

That one idea changed everything.

And I want to make sure you feel it, not just hear it.

So let’s do this the Bell Labs way.

Imagine you work for Bell Labs in 1948. You are in New York. You have a noisy copper communication channel running all the way from New York to Los Angeles. In Los Angeles, there is a television display showing the current weather in real time. The screen is always on. It refreshes constantly. It must stay accurate for 72 straight hours. People in Los Angeles can walk by and look at it at any moment, day or night, and it has to be right.

So this is serious. This is a live system. This is not a toy.

Now here is the weather in Los Angeles at the start of the 72-hour period:

72 degrees. Sunny.

And now here is the final detail.

For the entire 72 hours, the actual weather in Los Angeles never changes.

Not once.

It stays 72 degrees and sunny for the full 72 hours.

Now I want the precise answer.

How many bits of information must you send from New York to Los Angeles over that 72-hour period to keep the display accurate?

And I know what many of you will do, because some of you are exactly the kind of students I would have been.

You will start trying to calculate it.

You will think about frame rate.
You will think about refresh intervals.
You will think about character encoding.
You will think about polling.
You will think about error correction.
You will think about bandwidth.
You will think about the fact that the copper channel is noisy.
You will think about all the engineering details.

And that is exactly why Shannon matters.

Because Shannon steps in and asks a harder, deeper question than all of that.

What changed?

That is the question.

Not how active is the screen.
Not how often is the display capable of refreshing.
Not how many electrons are moving.
Not how many possible updates could have been sent.

What changed?

And the answer is:

nothing.

The actual weather never changed.
The display never needed to change.
Which means the amount of information you need to send over that 72-hour period is zero.

Zero.

That is the shock.

The screen may be on.
The system may be live.
The copper channel may exist.
The display may be capable of refreshing.
The city may still be there.
The weather may still be there.

But if nothing changes, the information requirement is zero.

Why?

Because information is surprise.

If nothing surprising occurs, then no information is needed to update the receiving side.

No surprise, no information.

That is one of the most important intellectual moves of the twentieth century.

Because before Shannon, many people would have intuitively thought about information as “stuff being sent.” Symbols moving. Signals moving. Activity moving. But Shannon showed that information is not merely activity through a channel. Information is what becomes necessary when expectation is violated.

That is much deeper.

If Los Angeles is still exactly what Los Angeles was expected to be, then New York has nothing to say.

That is the breakthrough.

Now I want you to notice how quickly this begins to feel familiar.

Because your life works the same way.

What are you not paying attention to right now?

You are not paying attention to your heartbeat.
You are not paying attention to digestion.
You are not paying attention to the exact moisture level in your mouth.
You are not paying attention to the pressure distribution in your shoes.
You are not paying attention to the circulation in your fingertips.

Why not?

Because, in all of those domains, there is very little surprise.

The actual is arriving close enough to expectation that your attention is not being recruited.

Now what are you paying attention to?

For some of you, it is an upcoming exam.
For some of you, it is a relationship.
For some of you, it is money.
For some of you, it is a message you have not received yet.
For some of you, it is your career.
For some of you, it is whether you are going to disappoint somebody important to you.
For some of you, it is a problem that has not resolved itself.

Why do those things have you?

Because there is surprise there.

Or, to say it more carefully, there is unresolved surprise there.

There is a gap between what may happen and what you can yet count on.
There is a gap between what you expect and what has actually arrived.
There is enough instability in that domain to keep your attention recruited.

And all of a sudden Shannon is no longer just a communications engineer in 1948.

He is standing right in the middle of your life.

Because the same principle that explains information in a copper channel also helps explain why some parts of your life seize you and some parts do not.

No surprise, no information.
No surprise, no attention.

That is where we are going.

Now let me give you a simpler example.

Think about midterms.

Let’s say your midterm is on May 13, 2026.

Before May 13, the midterm has you.

It occupies attention.
It generates planning.
It produces worry.
It creates scenarios in your mind.
It invites prediction.
It pulls emotional energy out of you.

Why?

Because the event has not yet become completed actuality in your life.

There is still surprise there.

You may predict a ninety.
You may predict a seventy-eight.
You may predict disaster.
You may predict that it will be easier than you fear.

None of that resolves the fact that the thing itself has not yet happened.

So the attentional charge remains.

Now suppose you take the midterm on May 13 and, in fact, you get the ninety you predicted.

What happens on May 14?

The attention drops.

Not because grades no longer matter.
Not because school no longer matters.
But because that particular event has passed from unresolved surprise into completed actuality.

Even if the result was important, the attentional structure changes once the event is no longer hanging open in the future.

And if the result came in exactly as expected, then the surprise is effectively minimal.

Now even if the result did not match your prediction, something else still happens that matters deeply:

the event is over.

The field of uncertainty collapses.
The unresolved space narrows.
The attention begins to release.

So I want you to start noticing something.

Shannon’s idea is not just about telephones and copper wire.

It is about the relationship between expectation, actuality, and the recruitment of significance.

That is why I am starting here.

Because before I ever give you my own equation, I want you grounded in the fact that surprise already has mathematical dignity.

It is not a poetic word.
It is not a mood word.
It is not merely a psychological word.

It is foundational.

And if surprise is foundational to information, and if your own life plainly shows that surprise is foundational to attention, then surprise becomes something we are allowed to take very seriously.

Serious enough, in fact, to calculate.

Not today in full.
But soon.

Because later in this series, I am going to show you that we can do more than merely say, “That surprised me.”

We can actually begin to model surprise from the relationship between what was expected and what actually arrived.

That is where we are headed.

But for now, I only want you to leave with Shannon burned into your mind.

Imagine the room in Bell Labs.
Imagine the engineers.
Imagine the copper channel.
Imagine the televisions in Los Angeles.
Imagine the temptation to calculate all kinds of technical complexity.

And then imagine Shannon asking the only question that matters:

What changed?

If nothing changed, then the information requirement is zero.

No surprise, no information.

Now I want to end by taking one small step toward where we are going next.

If no surprise means no information in a communication channel, then maybe no surprise also means no attention in a human life.

That is the possibility I want you to sit with.

Maybe the parts of life that no longer surprise you also no longer need much of you.

Maybe the parts that continue to seize you do so because there is still an unresolved gap between expectation and actuality.

Maybe attention is not random at all.

Maybe it is lawful.

And if it is lawful, then eventually we are going to need an equation.

That is where we are going next.

But before we get there, I want one sentence fixed in your mind so completely that you never lose it:

No surprise, no information.

Author: John Rector

Co-founded E2open with a $2.1 billion exit in May 2025. Opened a 3,000 sq ft AI Lab on Clements Ferry Road called "Charleston AI" in January 2026 to help local individuals and organizations understand and use artificial intelligence. Authored several books: World War AI, Speak In The Past Tense, Ideas Have People, The Coming AI Subconscious, Robot Noon, and Love, The Cosmic Dance to name a few.

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Discover more from John Rector

Subscribe now to keep reading and get access to the full archive.

Continue reading