Statistical entropy

Statistical entropy is a concept in thermodynamics that quantifies the number of different ways a system can be arranged while still maintaining its macroscopic properties.

The total energy of a system, , is given by eq5. Its total differential is:

Consider the transfer of heat to a closed system of particles. If the volume of the system is constant, then no work is done on the system and the energy level of each state is unchanged . However, the population of particles in each state varies according to temperature. Hence,

If we interpret as the internal energy of the system, , then according to the first law of thermodynamics of a constant volume system,

For a reversible transfer of heat, the second law of thermodynamics states that . Combining , eq26 and eq27,

Substituting eq16 in eq28,

Since the total number of particles for a closed system is constant, and

Substituting eq4 in eq29, we have or the integrated form:

where is the statistical entropy.

 

Previous article: Boltzmann distribution
Content page of chemical thermodynamics
Content page of advanced chemistry
Main content page

Boltzmann distribution

The Boltzmann distribution, formulated in 1868 by Ludwig Boltzmann, describes the probability distribution of objects (particles or oscillation modes) in a system over various energy states, .

It is mathematically expressed as:

where

is the Boltzmann constant.
is the number of objects in the energy state .
is the total number of objects in the system.

The derivation of the Boltzmann distribution equation involves the following steps:

    1. Derivation of the total differential of .
    2. Application of the Lagrange method of undetermined multipliers on the total differential of .
    3. Simplification of solution using Stirling’s approximation.
    4. Evaluation of .

 

Step 1

Consider a system with  molecules randomly occupying different energy states, . At any time, the configuration of the system can be represented by with molecules in energy state , molecules in energy state , and so on. The total number of molecules is therefore:

where is the number of molecules in the energy state .

The number of ways, , to achieve an instantaneous configuration of is given by the multinomial permutation:

or in the natural logarithmic form:

 

Question

Eq2 implies that the molecules are distinguishable when they are being assigned to different energy states, and that once these assignments are made, the order of molecules within each state does not matter. Why?

Answer

Boltzmann statistics is rooted in classical physics, where particles of the same type are considered distinguishable because they can be differentiated by their physical states, such as position and velocity. In contrast, particles of the same type in quantum mechanics are considered indistinguishable, which leads to different statistical distributions like Fermi-Dirac statistics for fermions and Bose-Einstein statistics for bosons.

Once the molecules are assigned to energy states, the order of the molecules within each state does not matter, because the configuration is defined only by the number of molecules in each state, not by which specific molecules occupy them.

 

As the number of molecules in each energy state varies with time, the configuration of the system changes and so does the number of ways of achieving the new configurations. We can therefore express the LHS of eq3 in its total differential form of
, or for simplicity:

Let’s further define our system as a closed system with total energy, , given by:

Eq5 restricts the number of configurations of the system. For example, the configurations of and cannot coexist as they have different total energies. If we assume, under the conditions imposed by eq1 and eq5, that all possible configurations of the system have the same probability of occurring, the configuration with the maximum number of ways of achieving will most likely be the one the system adopts.

 

Step 2

The most probable configuration is found by evaluating the maximum point for the function in eq4, i.e.

To solve eq 6, we employ the Lagrange method of undetermined multipliers. We begin by rearranging eq1 to , where is dependent on the rest of the variables, which are all independent. Eq1 can also be written in the form of a new function, :

Likewise, by rearranging eq5 to
we have another dependent variable,  and another function:

This results in eq6 having two dependent variables. The total differential of and are

and

respectively.

Since , we can multiply eq9 and eq10 by the factors and respectively and add them to eq6 to give:

The factors, and , are called Lagrange multipliers. Two of the variables, e.g. and , are dependent variables, while the rest are independent variables. If there is some value of and some value of that render the -th and -th terms of eq11 zero, we have

Consequently, we are left with all independent variables terms. in eq11 can now vary arbitrarily, which implies that all the remaining coefficients equal to zero. Substituting eq9 and eq10 in eq11,

Noting that  and are constants, eq7 and eq8 become and respectively. Substituting and in eq14,

Since all coefficients are now equal to zero,

 

Step 3

To simplify eq16, we take the natural logarithm on both sides of eq3 to give . Since ,

For large , we have . Integrating by parts, . Hence, , which is known as Stirling’s approximation. Eq17 becomes . Since, ,

Substituting eq18 in eq16,

where we have changed the summation index from to in eq19 to discriminate the summation variable from the differentiation variable.

Since , we have . By implicit differentiation, and . Furthermore, . Therefore, eq19 becomes,

Substituting eq20 in eq1, we have , which when substituted in eq20 gives

 

Step 4

An easy way to determine the value of  is to use the equation for the distribution of molecules of an ideal gas in a cylinder:

where

is number of molecules at a height , which implies that is number of molecules in energy state .
is the number of molecules at a height , where . It follows that is number of molecules in energy state .
is the mass of a molecule.
is the acceleration due to gravity.
is the difference in height between and .
is the Avogadro constant
is the universal gas constant

Since represents the difference in energy between states and , we can rewrite eq22 as:

From eq21, the fractions of molecules in energy states and are and respectively. Dividing by ,

Comparing eq23 and 24, , and introducing the constant (the Boltzmann constant), we have . Therefore, eq21 becomes

which is the Boltzmann distribution.

The Boltzmann distribution is used to derive mathematical expressions of many scientific concepts, including the statistical entropy, the Maxwell-Boltzmann distribution, and the Planck radiation law.

 

Next article: Statistical entropy
Previous article: Permutation and combination
Content page of chemical thermodynamics
Content page of advanced chemistry
Main content page

The harmonic oscillator

A harmonic oscillator comprises a particle that is subject to a restoring force proportional to the particle’s displacment from its equilibrium position.

Consider a mass connected to a rigid support by a massless and frictionless spring (see above diagram). At equilibrium, the length of the spring is . Let’s assume that the only force acting on the mass is a restoring force that is directly proportional to the displacement of the mass (Hooke’s law):

where is the displacement of the mass from its equilibrium position and is constant of proportionality called the force constant.

 

Question

Explain why is a measure of the stiffness of the spring.

Answer

For a particular value of , the stiffer the spring, the less the mass displaces. Since  is inversely proportional to , it is a measure of the stiffness of the spring.

 

Substituting the equation for Newton’s 2nd law of motion in eq1, we have

The solution to the above differential equation is , where . As the displacement of the mass is defined by a wave equation, the system is called a harmonic oscillator (‘harmonic’ originates from sound waves). The mass oscillates with amplitude and frequency (see Q&A below), and the kinetic energy  and potential energy of the system are

 

Question

Explain why the mass oscillates with a frequency of and why the potential energy of the system is equal to ?

Answer

Since , the function repeats itself after a time . This implies that the period  of the motion of the mass is  and that the oscillation frequency  is .

The force exerted by a person in lifting an object over a distance against gravity is , where is the work done by the person. must also be the amount of potential energy the object gains, i.e. . Furthermore, the force exerted by gravity is opposite to the force exerted by the person. So, and for small changes, . Since gravitational force and elastic spring force are both conservative forces (work done is path-independent), we substitute eq1 in to give . Therefore, the potential energy of a harmonic oscillator is .

 

The total energy of the harmonic oscillator is

and the Hamiltonian , which is the sum of the kinetic and potential energies of the oscillator can be expressed as

Before we show how the harmonic oscillator can be used to model a vibrating diatomic molecule, we shall look at the quantum-mechanical treatment of a harmonic oscillator.

 

Next article: The quantum harmonic oscillator
Content page of vibrational spectroscopy
Content page of advanced chemistry
Main content page

Generating function and Rodrigues’ formula for the Hermite polynomials

The generating function for Hermite polynomials is a mathematical tool that, when expanded as a power series, yields the ratio of the Hermite polynomials  and the factorial of the summation index as its coefficients.

It can also be used to derive the normalisation constant for the wavefunctions of the quantum harmonic oscillator, and is defined as

To prove the 2nd equality of eq33, we take the partial derivative of with respect to to give . Substituting eq29 in this equation, we have

The solution to the differential equation is

When , eq34 becomes

Using eq19,

Using eq20,

Since the Maclaurin series expansion of is , we have , which completes the proof.

The generating function can be used to derive the Rodrigues formula for Hermite polynomials. From 33,

Let . We have and . Therefore,

Substitute eq36 in eq35

When

From eq33

Substitute eq39 into eq38

Eq40 is the Rodrigues formula for Hermite polynomials. In other words, the Rodrigues formula for Hermite polynomials is a mathematical expression that provides a method to calculate any Hermite polynomial using differentiation.

Next article: Normalisation constant for the wavefunctions of the quantum harmonic oscillator
Previous article: Taylor series of single-variable and multi-variable functions
Content page of vibrational spectroscopy
Content page of advanced chemistry
Main content page

Taylor series of single-variable and multi-variable functions

The Taylor series is a way to express a function as an infinite sum of terms, each of which is derived from the function’s derivative value at a specific point .

Consider the power series . We have , , ,  and so on. Therefore,

Eq32b is called a Taylor series, which approximates a function in the neighbourhood of the point . When , the Taylor series is also known as a Maclaurin series:

The input value of in eq32b represents points in the domain of that are near . In other words, we can express as , where is a constant, is a variable, and  represents a small change in that is scaled by . This alternate expression of is useful when dealing with multiple-variable functions.

For a multivariable function , the Taylor series about the point is

 

Question

How do we use vector notation to express the function ?

Answer

If we let , then we write  in place of . In other words, we have , where . Consequently, can be regarded as

    1. a function of variables ,
    2. a function of a single point variable , or
    3. a function of a single vector variable .

 

To derive eq32c, let  and . Consider the function

which implies that .

is a multivariable function, whose input is the vector , which varies with . In the domain of , is the vector representing a point where is expanded, and is a fixed vector that determines the direction of the displacement from the point . In other words, is not a variable of , but a parameter that we choose before plotting . The function is therefore a single variable function of , and its points are of the form .

The Maclaurin series expansion of when is

According to the multivariable chain rule, , where  and . So,

The second derivative is

Using the multivariable chain rule again, we get

With reference to eq32d, with components . It follows that , and . Eq32g becomes

Furthermore, when , we have . So, eq32f and eq32h become

and

respectively.

Substituting eq32i and eq32j in eq32e and noting that and , we have eq32c. Finally, the Maclaurin series of a multivariable function is

 

 

Next article: Generating function and Rodrigues’ formula for the Hermite polynomials
Previous article: Recurrence relations of the Hermite polynomials
Content page of vibrational spectroscopy
Content page of advanced chemistry
Main content page

The quantum harmonic oscillator

The quantum harmonic oscillator is a model for studying an atom that moves back and forth about an equilibrium point. The model’s central premise involves the use of the potential energy term of the classical harmonic oscillator to construct the Schrodinger equation for the harmonic oscillator:


which is equivalent to

where is the displacement of the mass from its equilibrium position.

 

Question

Show that is equivalent to .

Answer

The de Broglie relation is , where . The derivative of the wavefunction with respect to  is

This suggests that the operator is equivalent to , and hence, . Squaring the momentum operator and dividing by gives .

 

Substituting in the above equation and rearranging, we have

The probability of locating an electron in the Hilbert space must be finite, i.e. . This implies that vanishes as . We call such a well-behaved wavefunction square-integrable. Hence, we need to study the asymptotic characteristics of eq5 to find possible solutions.

Let’s begin by simplifying the differential equation using a change of variable. Substituting and in eq5, we have

Since is a constant, as , and eq6 approximates to

This suggests that the solution to eq6 could be a Gaussian function because is a solution to eq7. Let’s try , where is a function of . Substituting in eq6 and computing the derivatives, we have

Eq8 is known as the Hermite differential equation.

 

Question

Show that we can use a power series to solve eq8 around .

Answer

When , eq8 simplifies to , where . It can be easily verified that and are solutions to . As the Taylor series for and  are and , respectively, a power series is a solution to eq8 around .

 

The above Q&A suggests that a possible solution to eq8 is a power series for a range of values of . Let and substitute and in eq8 to give

Substituting and in the above equation, we have

The above equation is only true for all values of if every coefficient for each power of is zero. So, , which rearranges to

Eq9 is a recurrence relation. If we know the value of , we can use the relation to find . Similarly, if we know , we can find .

Comparing the recurrence relations for even-labelled coefficients,

Similarly, the recurrence relations for odd-labelled coefficients can be expressed as

Rewriting as a sum of two power series, one containing terms with even-labelled coefficients and the other with odd-labelled coefficients,

According to L’Hopital’s rule,  appears to be a possible solution to eq7 because each of the terms in eq12 (simplified to ) approaches zero for large :

where is a constant.

However, this does not guarantee that the series as a whole also converges because the sum of an infinite number of infinitesimal terms can still be infinite, as is the case for a harmonic series. To see how the two infinite series behave for large , we carry out the ratio test as follows:

where we have set and in eq9 for the even series and odd series respectively.

By comparison, the ratio test for the power series expansion of is also . Therefore, both infinite series behave the same as and diverge for large . To ensure that is square-integrable, we need to truncate either one of the series after some finite terms and let all the coefficients of the other series be zero.

 

Question

Can we instead truncate both series of eq12 after some ?

Answer

Since the value of is arbitrary, the sum of two truncated series, each with finite terms, may still have an infinite number of terms. The only way to guarantee that has finite terms is to truncate one of the series and let , if the odd series is truncated, or , if the even series is truncated, be zero.

 

To truncate either series, we let the numerator of eq9 be zero so that every successive term in the selected series is zero as well. This implies that

Let’s rewrite eq12 as

Since eq14 is the result of substituting in eq6, it is a solution to eq6.

 

Question

Show that .

Answer

We expand the even series in eq14 as follows:

Substituting eq9, where , in the above equation, we have

Substituting eq13 in the above equation gives the required expression.

 

Re-expanding the even series of eq14 using eq9 and eq13, we have

Comparing the coefficients of each even series in the above table, we have

where .

Similarly, the re-expansion of the odd series of eq14 using eq9 and eq13 gives

Comparing the coefficients of each odd series in the above table, we have

where .

The recurrence relation of eq9 that led to eq14 only defines the value of in terms of . This implies that there are many solution sets depending on the value of . The convention is to set the leading coefficients (i.e. the coefficients of ) of eq15a and eq15b, which are independent of each other, as . Therefore,

and

Substituting eq16 and eq17 in eq14, we have , where  are the Hermite polynomials:

The first few Hermite polynomials, un-normalised eigenfunctions of eq6 and their corresponding eigenvalues are

When , we can express the Hermite polynomials for odd as

Similarly, when , we can express the Hermite polynomials for even as

Eq19 and eq20 are useful in proving the generating function for Hermite polynomials.

The table above also shows that the energy states of a quantum-mechanical harmonic oscillator are quantised:

with the ground state  being non-zero. This energy is called the zero-point energy of the harmonic oscillator.

 

Question

Using the uncertainty principle, explain why the ground state of a quantum harmonic oscillator is non-zero.

Answer

If , then both the kinetic energy and the potential energy of the oscillator are zero. implies that the momentum is zero and .  means that the atom is at the equilibrium position, where . This would violate the uncertainty principle.

 

Since is a solution to eq8, we can rewrite eq8 as

To complete the prove that is a solution to eq6, we will derive the normalisation constant of and prove that the wavefunctions are orthogonal to one another in the next few articles.

 

Question

Do we have to change the variable back to ?

Answer

The Hermite polynomials are usually expressed in terms of because looks more complicated:

Hermite polynomials


However, the normalisation constant is defined as an integral with respect to because  is the variable representing position in the one-dimensional space that the oscillator is moving in.

 

Next article: Orthogonality of the wavefunctions of the quantum harmonic oscillator
Previous article: The harmonic oscillator
Content page of vibrational spectroscopy
Content page of advanced chemistry
Main content page

Orthogonality of the wavefunctions of the quantum harmonic oscillator

The orthogonality of the wavefunctions of the quantum harmonic oscillator can be proven using the Hermite differential equation.

Substituting eq13 in eq22, we have

where  are the Hermite polynomials.

 

Question

Show that eq23 can be written as

Answer

Carrying out the derivative, the LHS of eq24 becomes

 

Multiplying eq24 (with a change of index from to ) by and subtracting the result from the product of and eq24, we have

Substituting  and in eq25 gives

Integrating both sides of the above equation with respect to ,

If , then . Since ,

 

Next article: Recurrence relations of the Hermite polynomials
Previous article: The quantum harmonic oscillator
Content page of vibrational spectroscopy
Content page of advanced chemistry
Main content page

Normalisation constant for the wavefunctions of the quantum harmonic oscillator

The normalisation constant ensures that the wavefunctions of the quantum harmonic oscillator are properly scaled, thereby maintaining the probabilistic interpretation of quantum states.

To derive the normalisation constant for the wavefunctions of the quantum harmonic oscillator, we begin with the multiplication of eq33 by and by itself (with a change of the dummy variable to and the dummy index to ) to give

Integrating with respect to ,

Substituting the orthogonal relation when in the above equation and simplifying, we have

 

Question

Show that .

Answer

Let and . So, with the limits unchanged. At the same time, let , where we have changed the dummy variable to .

In polar coordinates, . For infinitesimal changes, the change in area can be approximated as a rectangle with sides and (see diagram below), with .

So,

Let

 

Using eq43 and the Maclaurin series expansion of , eq42 becomes

Expanding eq44 and comparing the coefficients of ,

 

In an earlier article, we have made a change of variable of in deriving the un-normalised wavefunction of the quantum harmonic oscillator. Since is the variable representing position in the one-dimensional space that the oscillator is moving in, the normalisation of the wavefunction refers to an integral with respect to , i.e.

Using , eq45 is equivalent to

Therefore,

The normalised wavefunction is then

or

 

Question

Show that is either an even function or an odd function.

Answer

An even function is defined as , while and odd function is when . So,  is an even function. On the other hand,  is an even function if is even and an odd function if is odd. Since the product of two even functions is an even function, while the product of an odd function and an even function is an odd function, is an even function when is even and an odd function if is odd.

 

 

Next article: Vibration of diatomic molecules
Previous article: Generating function and Rodrigues’ formula for the Hermite polynomials
Content page of vibrational spectroscopy
Content page of advanced chemistry
Main content page

The Born-Oppenheimer approximation

The Born-Oppenheimer approximation assumes that the wavefunctions of atomic nuclei and electrons in a molecule can be treated separately, primarily because the nuclei are much heavier than the electrons.

We begin with the molecular Hamiltonian operator :

where

    • and refer to nuclei and electrons respectively.
    • The first and second terms are the kinetic energy operator of nuclei and electrons respectively.
    • is the potential energy of interaction between two particles.

For example, the Hamiltonian for (see diagram above) is:

To solve the complicated Schrodinger equation for a molecule, Max Born and J. Oppenheimer proposed separating the electronic and nuclear motions. The first assumption the two scientists made is that the molecular wavefunction is a product of the wavefunction of nuclear motion and the wavefunction of electron motion , i.e.

 

Question

Why is a function of nuclear coordinates and electronic coordinates ?

Answer

The electron density of a molecule changes when the molecule vibrates and therefore the form of the wavefunction of electron motion changes based on the positions of the electrons and the nuclei.

 

With regard to eq51 and eq52, the Schrodinger equation is

Using the product rule, we have , which when substituted in eq53 gives

The second assumption Born and Oppenheimer made was that is a slowly varying function of . This is because the heavier nuclei are considered relatively stationary as they move much more slowly than electrons. Therefore, the change in the distribution of the electrons with respect to the positions of the nuclei is very small and eq54 becomes

Substituting the purely electronic Hamiltonian and its corresponding Schrodinger equation in eq55, we have

 

Question

How do we interpret the term in eq56?

Answer

is the eigenvalue of the purely electronic Schrodinger equation . Using the second assumption, we regard the nuclei as fixed while the electrons move. in then becomes a constant for a particular nuclear configuation. In other words, is now a function of and at the same time parametrically dependent on . For each electronic state , the purely electronic Schrodinger equation is solved repeatedly using different fixed values of , giving a set of and a corresponding set of . Since , we can then easily calculate a value for every and obtain a curve (see diagram below). In effect, is a function of , making it the potential energy for nuclear motion:

 

We have therefore transformed eq53, the molecular Schrodinger equation, to eq57, which is an eigenvalue equation of a single variable of nuclear coordinates, with the eigenfunction as the wavefunction of nuclear motion, the eigenvalue representing the total energy of the molecule, and the term as the potential energy for nuclear motion.

 

Question

How does the above molecular potential energy curve relate to the quadratic potential energy curve derived using the harmonic oscillator model?

Answer

The two curves coincide at low vibration energy levels, i.e., around the equilibrium internuclear distance (see diagram below). Nuclear motion includes translational, rotational and vibrational motions. As translational and rotational motions are purely kinetic, in eq57 is associated only with molecular vibrational motions. Consider a diatomic molecule with one of the nuclei at the origin and the other on the -axis. The potential energy term becomes , where is the internuclear distance. Using a Taylor series, we can approximate the potential function by expanding it around its minimum at the equilibrium internuclear distance :

At , the slope of is zero, i.e. . For small vibrations, where is close to , we ignore all the higher power terms, giving . The physical observables of a system, such as the transition frequencies of vibrational modes of a molecule, are not affected by the term because it cancels out when we take the difference of two energy levels. Therefore, we can set to zero, resulting in , which is equivalent to the potential energy term of the harmonic oscillator (see eq49), where and .

 

In conclusion, the Born-Oppenheimer approximation offers a different approach, compared to the quantum harmonic oscillator, in deriving the Schrodinger equation for a diatomic molecule (see the Hamiltonian of eq57 vs eq48) and the potential energy term for the vibrational motion of a diatomic molecule.

 

Next article: Nuclear motion in diatomic molecules
Previous article: Vibration of diatomic molecules
Content page of vibrational spectroscopy
Content page of advanced chemistry

Vibration of diatomic molecules

The vibration of a diatomic molecule can be modelled using the quantum harmonic oscillator.

The Schrodinger equation can be written as:

To solve the equation, we need to make a change of coordinates to achieve a separation of variables. The new coordinate system consists of the variables and , where is the centre of mass of the molecule.

 

Question

What do the terms in eq47 mean? What is a separation of variables?

Answer

Eq47 is an eigenvalue equation, where the Hamiltonian has two kinetic energy terms, one for each atom, and a potential energy term that describes the interaction between the atoms. According to the classical harmonic oscillator, the potential energy of the system is equal to , where is the displacement of the spring from its equilibrium position. For the diatomic molecule in the diagram above, .

To solve eq47, we need it to be of the form , where the Hamiltonian is separated into two, each being a function of only one variable. Unless it is transformed, the potential energy term in eq47 does not allow the separation to occur.

 

The derivatives of and with respect to time are and respectively. Substituting and in and rearranging, we have and respectively. Using , the Hamiltonian of eq47 becomes

where , , and .

Since and are the total mass of the molecule and the centre of mass coordinate of the molecule respectively, corresponds to the kinetic energy of the translational motion of the molecule. The other kinetic energy energy term must correspond to the internal motion (rotational and vibrational motion) of the molecule. However, there are only two degrees of freedom for a diatomic molecule in a one-dimensional space – a translational degree of freedom and a vibrational degree of freedom. Discarding the kinetic energy term for the translational motion, the Schrodinger equation describing the vibrational motion of the molecule is

Eq49 is equivalent to eq4 except for the substitution of , which is called the reduced mass. Its solutions are given by eq45 (with replaced with ). With reference to eq21, the vibrational energies of the diatomic molecule are:

where .

The potential energy curve of in eq49 for a typical diatomic molecule is represented by the dashed curve in the diagram below. The minimum potential energy of the molecule occurs when the atoms are at their equilibrium positions. In the next article, we will show that the actual potential energy curve has the shape of the solid curve, which correctly shows that the potential energy of the molecule increases rapidly as the bond length shortens and approaches a constant value representing the dissociation energy of the molecule as  increases. Despite that, the two curves coincide at low vibrational energy levels,. This implies that the harmonic oscillator model of a diatomic molecule only serves as a good approximation at low vibrational energy levels.

 

 

Next article: The Born-oppenheimer approximation
Previous article: Normalisation constant for the wavefunctions of the quantum harmonic oscillator
Content page of vibrational spectroscopy
Content page of advanced chemistry
Mono Quiz