The Feynman lectures on physics are special for many reasons.
Feynman delineates the big picture rather clearly; is able to be very concise about various points that make many other authors excessively talkative; isn't afraid to address questions that some people incorrectly consider a domain of philosophers even though they have become a domain of physics many years ago; isn't afraid to clarify many widespread misconceptions and explain why e.g. Einstein was wrong about quantum mechanics; offers some original cute research which may have had pedagogical motivations but that is more important than that e.g. the derivation of general relativity from a consistent completion of the coupling of the stress-energy tensor to a new spin-2 field (it was a really beautiful, pragmatic, modern, and string-theory-like approach to general relativity); and for many other reasons.
Two-state systems are among the topics in quantum mechanics that Feynman dedicated much more attention than most other textbooks of quantum mechanics which is one reason why Feynman's students were much more likely to understand the foundations of quantum mechanics properly.
On this blog, two-state systems have played a central role in many older articles such as the introduction to quantum computation (a qubit is a very important two-state system); two-fermion double-well system (a ramification of the Brian Cox telekinetic diamond insanity), and several others.
There are hundreds of important examples of two-state systems. The underlying maths governing their evolution is isomorphic in all these cases but we still tend to think about the individual examples "differently" because we have different intuitions about the different system. The electron's spin is one example; the ammonia molecule is another. The mathematical isomorphism between the two systems is a fact; nevertheless, people tend to incorrectly assume that the mathematics of the ammonia molecule we will focus on is much more "classical" than the example of the electron's spin. Well, it's not. All states in the Universe obey the same laws of quantum mechanics.
Looking at Feynman's chapter on MASERs
The third, final volume of the Feynman lectures on physics is mostly dedicated to quantum mechanics. There are many chapters on two-state systems. Chapter 9 of Volume III is about MASERs – cousins of LASERs that use a particular transition between two states of the ammonia molecule.
Ammonia, \(NH_3\), is a stinky gas excreted in urine. It escapes from the liquid which is why you could smell it on most toilets, especially in the third world and the Soviet Bloc during socialism. ;-) I apologize to the French and others but Germans have the cleanest toilets. But we want to discuss a closely related issue, namely the states of the ammonia molecule. :-)
The model above shows us that the molecule looks like a pyramid with a triangle of hydrogen atoms at the base and a nitrogen atom at the top of the pyramid (above the center of the triangle). All the nuclei may move relatively to each other, in principle. However, the relative motion that would change the distances between the four atoms looks like a collection of harmonic oscillators with pretty high frequencies i.e. energies. That's why if we only look at low-lying energy states (at most a tiny fraction of an electronvolt above the minimum possible energy), we are restricted to the ground states of the harmonic oscillators, to the lowest-lying state in which the distances between the four nuclei are fixed at values that minimize the energy with this accuracy. The vibrations changing the distances are thus forbidden. The wave functions for the electrons are completely determined by the low-energy constraints.
How many states of the ammonia molecule are there?
Well, even if the lengths of the six edges of the pyramid are determined, we may do something with the pyramid: we may rotate it. If you define the vector \(\vec d\) pointing from the nitrogen atom to the center of the hydrogen triangle, \(\vec d\) may be any direction on the two-sphere \(S^2\). I've chosen the direction of the arrow in the opposite way than what you may find natural because \(\vec d\) is really proportional to the dipole moment. Note that the hydrogens are "somewhat more positive" (much like they tend to lose the electrons elsewhere: compare the \(H^+\) or \(H_3 O^+\) and \((OH)^-\) ions in water) while the nitrogen is more "negative", like in \(N^- H_3^+\), so the dipole moment has to start from the negative nitrogen.
For each direction on the sphere, there is a distinct quantum state orthogonal to others. Also, the orientation of the hydrogen triangle within its plane may change (rotate) and is given by an arbitrary angle defined modulo 120 degrees (because the rotation by 120 degrees maps the triangle to itself). The low-lying states will pick a superposition of these states (triangles rotated by \(\gamma\)) that minimize the energy, pretty much the "symmetric combination" of all directions.
So the vector \(\vec d\) is the only "light degree of freedom" we are allowed to vary without raising the energy too much.
In classical physics, you could take \(\vec d\) to point along any axis, e.g. the negative \(z\) semi-axis ("nitrogen is above the triangle"). If the nitrogen had the same properties as the classical plastic model, the value of \(\vec d\) would be conserved. We could just forget about all the states with different directions of \(\vec d\); we could consistently demand that \(\vec d\) has a preferred direction.
Let's try to impose as similar condition as we can in quantum mechanics, too. Quantum mechanics allows \(\vec d\) to change arbitrarily (the dipole moment isn't conserved) so the true energy eigenstates would be some spherical harmonics that depend on \(\vec d\). However, the transitions to different values of \(\vec d\) are unusually slow and we may forget about them.
However, there is one transition that is actually fast enough: the transition from \(+\vec d\) to \(-\vec d\). We can't neglect it at all. Why does exist? You may explain it in many ways but one of them is the "quantum tunneling". It's just possible for the nitrogen atom to be pushed through the triangle and appear on the opposite side of the pyramid. The ammonia molecule is exactly the kind of a microscopic object where things like quantum tunneling are inevitable.
So there's a significant probability that an ammonia molecule starting with a direction of \(+\vec d\) ends up with the opposite direction, \[
\vec d\to -\vec d.
\] Note that the position of the center of mass is conserved. You can't "ban" this process which is fast enough (the frequency is high enough for the purposes we consider but low enough to be compatible with our low-energy constraints). That's why you can't study the state of the ammonia molecule with a given value of \(\vec d\) only. You must study the states with \(\vec d\) and \(-\vec d\) at the same moment.
The states "nitrogen above the triangle" and "nitrogen below the triangle" will be called \(\ket 1\) and \(\ket 2\), respectively. The picture above should really have the same orientation of the hydrogen triangle in both states, if you wanted it to be really natural, but it's a detail because I said that the relevant states are averaged over the orientation of the triangle, anyway.
At any rate, it is legitimate to require that the dipole moment \(\vec d\) lies in a particular line – the transitions to non-parallel values of the dipole moments are so slow that they can be neglected. However, the flipping of the sign of \(\vec d\) is something that simply cannot be neglected. It's possible, allowed, inevitable, and it's a vital reason why the MASERs work at all.
You see that this is already a big deviation from classical physics in which there's no tunneling effect. In classical physics, \(\vec d\) seems to be conserved. Some people could argue that the ammonia molecule is already pretty large so classical physics should more or less apply. They would be wrong. Classical physics never applies exactly. Any physical system in this Universe, regardless of the size, obeys the laws of quantum mechanics. Classical physics may sometimes be a good enough approximation but it's never precise and it's always wrong at least for some questions when we talk about small molecules.
We have restricted our attention to a two-state system. The different shapes of the molecule (different lengths of edges) were banned because the change of the geometry (or excited states of the electrons) would raise the energy too much; different directions of the dipole moment than \(\vec d\) and \(-\vec d\) where \(\vec d\) is the (measured) initial value may be ignored because the transition to non-parallel values of \(\vec d\) is too slow.
We know that the state vector will belong to a two-dimensional Hilbert space. The relevant Hamiltonian is\[
\hat H = \pmatrix{ E_0 & A\\ A& E_0 }.
\] The off-diagonal matrix elements \(A\) are due to the quantum tunneling. In classical physics, we would have to have \(A=0\) but that's definitely not the case in quantum physics. By redefining the phase of \(\ket 1\) and \(\ket 2\) (only the relative phase matters\), we could change the phase of \(A\) and choose a basis in which \(A\) is real and positive. Note that in general, \(\hat H\) would be Hermitian so the upper-right matrix element would be the complex conjugate of the lower-left matrix element.
The two diagonal entries are the "best approximations for the energy" of the pyramids in which we neglect the tunneling. These matrix elements are equal to each other due to the rotational symmetry of the laws of physics. After all, \(\ket 2\) may be obtained from \(\ket 1\) by a rotation and because rotations are symmetries, they don't change the expectation value of the energy. It has to be the same for both states, \(E_0\).
However, \(E_0\) isn't an eigenvalue of the energy. Instead, to find the eigenvalues of the energy, we have to diagonalize \(\hat H\). We find out that the eigenstates are\[
\frac{\ket 1- \ket 2}{\sqrt{2}}, \quad
\frac{\ket 1+ \ket 2}{\sqrt{2}}.
\] I divided the sum and difference by \(\sqrt{2}\) to make the states normalized but I didn't really have to do that. Again, note that the phases (and, if you choose this convention, general normalization) of the eigenstates are undetermined. In the column notation, the eigenstates are\[
\pmatrix{ +\frac{1}{\sqrt 2} \\ -\frac{1}{\sqrt{2}} },\quad
\pmatrix{ +\frac{1}{\sqrt 2} \\ +\frac{1}{\sqrt{2}} }.
\] If you multiply the matrix \(\hat H\) by these vectors, you will get multiples of themselves. The coefficients in the multiples are the energy eigenvalues:\[
E_I = E_0 - A, \quad E_{II} = E_0 + A.
\] Now you see why I chose the first sign to be minus – I wanted the first eigenvalue to be the lower one. In other words, I wanted the first eigenstate to be the genuine ground state. The Roman numerals were picked to label the eigenvalues from the lowest one to the highest one.
So if you really cool down the molecule, it won't sit in the shape of a particular pyramid. It just can't sit there because there exists quantum tunneling, even at vanishing temperature \(T=0\,{\rm K}\). It is an inevitable process of quantum mechanics. Instead, the molecule will ultimately drop to the lowest-energy state which means the ground state, the energy eigenstate with the lowest energy, and it has the same probability amplitude to be in the "pyramid up" and "pyramid down" states.
Because many people make a mistake, let me emphasize one more thing. The energy eigenstates \[
\ket{I,II} = \frac{\ket 1 \mp \ket 2}{\sqrt 2}
\] are not just some dull "statistical mixtures" that have a 50% probability to be in the state \(\ket 1\) and 50% probability to be in the state \(\ket 2\) (pyramid up or down). Instead, the relative phase between the states \(\ket 1\) and \(\ket 2\) is absolutely crucial for the physical properties of the linear superposition state.
In particular, if the relative phase is anything else than \(+1\) or \(-1\), the superposition fails to be an energy eigenstate. It is only an energy eigenstate if the relative phase is real and when it's real, it's damn important whether the relative sign is \(+1\) or \(-1\). The negative relative sign gives us the lower-energy state – the quantum tunneling has the effect of maximally lowering the energy from the "intermediate" level \(E_0\) down to \(E_0-A\), while the positive relative sign does exactly the opposite: it raises the energy to \(E_0+A\).
Almost all the anti-quantum zealots would try to talk about a preferred basis and because they're obsessed with position eigenstates, they would probably allow \(\ket 1\) and \(\ket 2\) to be the only states that may be "truly" realized. But this is of course completely wrong because even if you start with \(\ket 1\), you can't have \(\ket 1\) forever. Because of the quantum tunneling, the initial state \(\ket 1\) inevitably evolves into general linear superpositions of \(\ket 1\) and \(\ket 2\): it oscillates between \(\ket 1\) and \(\ket 2\).
As emphasized repeatedly on this blog, there's no way to ban general linear superpositions. The states in a given basis inevitably evolve into general complex combinations of such basis vectors. And all the complex coefficients, including the relative phases – and especially the relative phases – are absolutely critical. Only a basis of energy eigenstates is completely "sustainable": each energy eigenstate only evolves into a multiple of itself.
And it is not true that the relevant energy eigenstates are always "equal mixtures" of \(\ket 1\) and \(\ket 2\). Things change when we add the electric field.
Adding electric fields: MASER
The surrounding electric field \(\vec E\) doesn't change anything about the existence of the tunneling. However, it will add the interaction energies between the electric dipole and the electric field so that the Hamiltonian is\[
\hat H = \pmatrix{ E_0+d E & A\\ A& E_0 - dE }.
\] The expectation value of energy of \(\ket 1\) i.e. the upper-left matrix element (associated with the pyramid pointing up, the dipole is down) was increased by the product \(|\vec d|\) and \(|\vec E|\) because the two vectors are pointing in the opposite direction; the expectation value of energy of \(\ket 2\) was lowered for the same reason.
Again, this matrix (the Hamiltonian) may be diagonalized. In this case of a real matrix (it was made real by our having redefined the phases of the basis vectors), the coordinates of the eigenvectors are still real. But it is no longer the case that the absolute values of both coordinates are equal. They're rather general. The energy eigenvalues are\[
E_I = E_0 - \sqrt{A^2+ d^2 E^2},\quad
E_{II} = E_0 + \sqrt{A^2+ d^2 E^2}.
\] Note that those formulae reduce to \(E_0\mp A\) for \(E=0\). Also, they reduce to \(E_0\mp dE\) for \(dE\gg A\). Note that if you drew graphs of \(E_0\mp dE\) as a function of the electric field \(E\), you would get two straight lines that intersect each other. However, when you draw the graphs of the exact results \(E_I,E_{II}\) written in the displayed equation above, the two curves never cross. One of them never drops below \(E_0+A\) and the other one never jumps above \(E_0-A\) so they obviously cannot cross. In fact, the right upper arm of the curve "bends" and continuously connects to the left upper arm of the curve; the same thing holds for the lower curve. See Avoided crossing at Wikipedia.
A few final steps are needed to explain why such molecules are able to emit and absorb some radiation whose frequency is \(f\) where\[
hf = E_{II} - E_{I} \sim 2A + \frac{d^2 E^2}{A}
\] where the final form of the expression is a Taylor expansion of the square root that is OK for all realistic (small enough) values of the electric field \(E\).
For example, start with the absorption. Place the ammonia molecule to a variable field \(\vec E\) which has the right frequency \(f\sim 2A/h\). In the \(\vec E=0\) energy eigenstate basis which is composed of the vectors \(\ket 1\mp \ket 2\), the Hamiltonian was diagonal (that's what the energy eigenstates mean). When you add the electric field \(\vec E\) going like \(\cos (2\pi f t)\), it will contribute some off-diagonal elements in this basis and when the frequency is right, resonance will be able to "accumulate" the probability amplitude of \(\ket{II}\) even if the initial state is \(\ket{I}\). If you choose a wrong frequency, the amplitude of the state to be in \(\ket{II}\) will receive contributions with different phases each cycle and they will cancel out.
So the ammonia molecule is able to increase its energy by capturing some energy from electromagnetic waves at the right frequencies. That's absorption. There's also stimulated emission. If the molecule is already mostly at the higher level \(\ket{II}\), the electric field oscillating at the right frequency will encourage the molecule to drop to \(\ket{I}\) and deposit the energy difference to the electromagnetic waves.
In the text above, the electric field \(\vec E\) was assumed to be large enough and treated as a classical background that only affects the Hamiltonian of the molecule via "classical parameters". However, if the electric field is weak enough, it becomes important that \(\vec E\) is a quantum observable as well. The energy carried by the electromagnetic waves of frequency \(f\) is no longer continuous – it is quantized i.e. forced to be a multiple of the photon's energy \(E_\gamma = hf\).
When you calculate the transitions properly, you will find out that there's actually a nonzero probability amplitude for the ammonia molecule in the excited state \(\ket{II}\) to emit a photon even if there's no oscillating electric field around the molecule to start with. This is the spontaneous emission.
However, for MASERs, the stimulated emission is more important because the intensity of the electromagnetic waves is high – "stimulated" is what the letter "S" in "MASER" (or "LASER") stands for. I recommend you e.g. Feynman's treatment in the Volume III of his lectures for sketched calculations of the formulae for the transition rates, why there is a resonance, what is the width of the curve, and so on.
My main goal was more specific here: to convince you that the superpositions of "classically intuitive" states are absolutely inevitable and natural. Physical systems may be found in any superpositions and if you need to identify a basis that is a bit more "sustainable" than other bases, it's a/the basis of the energy eigenstates, not e.g. position eigenstates. What these slightly preferred energy eigenstates are depends on the Hamiltonian. For example, in our case, the form of the eigenstates depended on the surrounding electric field. So there can never be any "a priori preferred basis". There is never a preferred basis but if some basis is more well-behaved than others, it's because it's closer to a basis of energy eigenstates, and such a basis always depends on the Hamiltonian as well as the environment: it can only be determined "a posteriori".
The ammonia molecule is just another system that invalidates any non-quantum or "realist" (anti-quantum zealots prefer to use the term "realist" for themselves over the much more accurate but less flattering term "classical and optimized for cranks stuck in the concepts of the 17th century physics") replacement for the proper rules of quantum mechanics.
For example, coherence of the ammonia molecule is totally essential and testable so if the Universe decided to "split" during any of the processes discussed above, as Everett liked to imagine, it would immediately have tangible consequences that disagree with the experiment.
Also, if there were any pilot waves envisioned by de Broglie or Bohm, one couldn't explain "where" the photon is created during the spontaneous emission. Note that during absorption or emission of electromagnetic waves, the number of photons isn't conserved, in contradiction with an elementary property of the flawed pilot wave paradigm. The photon emitted by an excited ammonia molecule is "everywhere".
Theories with GRW collapses would also predict unacceptable effects whose existence may be safely ruled out experimentally. And I am not even talking about theories that would love to completely "ban" the complex superpositions because the authors of these theories must be misunderstanding everything, including the content of Schrödinger's equation that makes the evolution into general complex combinations inevitable.
Of course, the main point of all such texts is always the same: quantum mechanics has been demonstrated to be the right framework to describe the world for more than 85 years and everyone who is hoping that a completely, qualitatively different description will replace quantum mechanics is a crackpot.
And that's the memo.