Resolution, Fourier Analysis, and The Heisenberg Uncertainty Principle

All the effects of nature are only mathematical
results of a small number of immutable laws.

~Pierre-Simon Laplace

The Great Wave Off Kanagawa
The Great Wave Off Kanagawa, by Hokusai (source).

In my discussion last time (corrections here), I discussed how there is a physical limit to how good a recording can sound, whether vinyl or digital. There is a more fundamental limit, however, that I glossed over—a limit that depends not on atoms or compression techniques, but on pure mathematics. This limit was partially discovered by Jean Baptiste Joseph Fourier, and the method we will discuss bears his name.

The Superposition Principle

Before we discuss Fourier’s discovery, let’s take a brief moment to talk about how waves interact with each other. I’ve previously discussed wave interference
and the superposition principle, so if you remember my previous discussions, feel free to skip to the next section.

Imagine waves as wiggles on a very stretchy string. If I try and push up on the string (make a wiggle that goes up) and you try and push down on the string (make a wiggle that goes down) at the same time, neither of us ends up moving the string as much as we intended. This is called destructive interference. Similarly, if I push up on the string at the same time that you push up on the string, we’ll probably stretch it quite a lot. This is called constructive interference. The process of overlaying one wave over another is called superposition.

Interference between two waves on a string
If we both try to make waves on a string, we may interfere with each other. If, as in the image on the left, we both try making the same wave, we may get a bigger wave than we intended. This is called constructive interference. If, on the other hand, we try to make waves exactly offset from each other, we may completely negate each others’ efforts. This is called destructive interference (source).

Sound waves work the same way: they can both constructively and destructively interfere.

The Sound of an Extremely Short Pulse

Last time, I explained that sound is a wave of air pressure. I also described how the tone of the sound is directly related to the frequency of the wave. Usually, when we play music, the frequency of the wave that generates the notes is much higher than, say, the frequency of the beat of the music. This is the beating phenomenon I described before. It looks like a little wave contained inside a big wave, as shown below.

A single note becomes loud and soft and loud and soft
This graph depicts a single pitch that becomes loud, soft, loud, and then soft again. The higher-frequency wiggles determine the pitch. The “envelope” that contains their amplitude is the pattern that makes the music.

But what happens when we want to make the music so fast (or the pitch so low) that the music changes at approximately the same frequency as the wiggles that control the pitch? For instance, what if we want to make a single loud, very short noise–so short that it’s about as fast as one of the little wiggles in my figure above. What’s the pitch?

A single, short pulse of sound.
A single, short pulse of sound. There is no frequency because the small wiggles are on the same time scale as the single big wiggle. So what’s the pitch?

To figure this out, we’ll take advantage of interference. By superposing waves of different frequencies, we will attempt to recreate our pulse. Hopefully, the waves will all destructively interfere before and after the pulse, but constructively interfere during the pulse. Then we will know that the pulse contains all the tones required to construct it.

Let’s start with a wave with a frequency of one wiggle per second. This doesn’t bear much resemblance to our pulse yet, but you have to start somewhere.

A frequency of one wiggle per second
A wave with a frequency of one wiggle per second. The first frequency to help construct our pulse.

Now comes the fun part. Let’s add, via superposition, a wave with twice the frequency. The figure below shows the two waves to be added on the left and their sum on the right. It’s important that the two waves line up so that their peaks overlap at the place we want our pulse to be–in this case, the center of the plot.

Two waves superposed.
Our frequency one wave (top left) and our frequency two wave (bottom left), then both superposed (right).

Already we can see some of the wiggles dying down. Let’s add another wave, this time with three times the original frequency.

3 frequencies superposed
A wave with a frequency of one wiggle per second (top left), two wiggles per second (middle left), and three wiggles per second (bottom left), then all three superposed (right).

After ten or so waves superposed, we get something like following:

Ten waves superposed
Ten waves superposed.

Although it’s not perfect, a single pulse does appear in the center. The big pulses on either side of the graph are the pulse repeating itself. To get rid of the repeats and all of the small wiggles, we’d need infinitely many frequencies in different proportions (i.e., we’d need to add the same frequency several times). In fact, we usually need uncountably many frequencies. When we need countably infinite frequencies, we call their sum a Fourier series. When we need uncountably many frequencies, we call their sum a Fourier transform. In general, the shorter the pulse we want in time, the broader the range of frequencies we need to construct it.

Importantly, this means that an extremely short pulse of sound has infinitely many tones. This is a pretty surprising result! It makes some intuitive sense, though. A single pulse of pressure isn’t periodic, so it can’t have a frequency. On the other hand, there was a single pulse, so it has at least one instance. The frequency can’t be zero. Fourier series and Fourier transforms offer an in-between: A pulse as many frequencies.

Because a shorter pulse requires a broader frequency range, an infinitely short pulse requires an infinitely broad frequency range (a sine wave of frequencies actually). It’s impossible to construct a short pulse made of too few frequencies. This is a physical limit on how short of a pulse we can construct.

Resolution

The shortness of a pulse roughly translates into how well we can control sound we make, or resolve sound we hear, as a function of time. Similarly, the number of frequencies roughly translates into how well we can resolve the pitch of a given sound we record. In other words, it’s physically impossible to record a sound with both perfect time resolution and perfect pitch. If you want to get a better time resolution (analogously, a higher sample rate), you need worse frequency resolution, and vice versa. This limit comes not from the number of atoms in a recording tip or the amount of memory on a computer–it comes directly from the properties of waves.

The Quantum Connection

This strange property of waves also makes itself known in quantum mechanics. You may have heard of the Heisenberg Uncertainty Principle. Roughly, the uncertainty principle states that you can’t perfectly know a particle’s position and momentum (mass times velocity) at the same time. In a vacuum, this sounds incredibly weird. However, if we recall that particles are waves, it makes a bit more sense.

A particle is a probability wave. The amplitude of the wave roughly represents the probability of finding a particle in a given place, while the frequency of the wave roughly represents the particle’s momentum. If we imagine a localized particle as a short pulse, rather than a wave, the reason we can’t know a particle’s position and momentum perfectly is because we can’t make an infinitely short pulse out of a single frequency! This is a beautiful example of physical law emerging from a mathematical idea. Waves are mathematical constructs, but they appear everywhere.

Further Reading

Now you can understand this comic!

xkcd on the Fourier transform
xkcd on the Fourier transform
Related articles, courtesy of Zemanta:

Questions? Comments? Insults?

Fourier analysis is a very difficult and unintuitive topic, so I may not have explained it well. (Indeed, my own understanding may be incorrect.) If you have any questions, comments, corrections, or insults, please don’t hesitate to say so in the comments!

EDIT: Stackexchange has an excellent discussion on Fourier analysis: http://math.stackexchange.com/questions/1002/fourier-transform-for-dummies