Detailed balance

The principle of detailed balance is formulated for kinetic systems which are decomposed into elementary processes (collisions, or steps, or elementary reactions): At equilibrium, each elementary process should be equilibrated by its reverse process. Lewis put forward this general principle in 1925:

Corresponding to every individual process there is a reverse process, and in a state of equilibrium the average rate of every process is equal to the average rate of its reverse process.

According to Ter Haar the essence of the detailed balance is:

...at equilibrium the number of processes destroying situation $A$ and creating situation $B$ will be equal to the number of processes producing $A$ and destroying $B$

The principle of detailed balance was explicitly introduced for collisions by Ludwig Boltzmann. In 1872, he proved his H-theorem using this principle . The arguments in favour of this property are founded upon microscopic reversibility . In 1901, R. Wegscheider introduced the principle of detailed balance for chemical kinetics. In particular, he demonstrated that the irreversible cycles $A_{1}\to A_{2}\to ...\to A_{n}\to A_{1}$ are impossible and found explicitly the relations between kinetic constants that follow from the principle of detailed balance.

Microscopic background

The microscopic "reversing of time" turns at the kinetic level into the "reversing of arrows": the elementary processes transform into their reverse processes. For example, the reaction

$\sum _{i}\alpha _{i}A_{i}\to \sum _{j}\beta _{j}B_{j}$

transforms into

$\sum _{j}\beta _{j}B_{j}\to \sum _{i}\alpha _{i}A_{i}$

and conversely. (Here, $A_{i},B_{j}$ are symbols of components or states, $\alpha _{i},\beta _{j}\geq 0$ are coefficients). The equilibrium ensemble should be invariant with respect to this transformation because of micro-reversibility and the uniqueness of thermodynamic equilibrium. This leads us immediately to the concept of detailed balance: each process is equilibrated by its reverse process.

Reversible Markov chains

A Markov process is said to have detailed balance if the transition probability, $P$, between each pair of states $i$ and $j$ in the state space obey

$\pi _{i}P_{ij}=\pi _{j}P_{ji}\,,$

where $P$ is the Markov transition matrix (transition probability), i.e., P_ij = P(X_t = j | X_t − 1 = i); and π_i and π_j are the equilibrium probabilities of being in states i and j, respectively. When Pr(X_t−1 = i) = π_i for all i, this is equivalent to the joint probability matrix, Pr(X_t−1 = i, X_t = j) being symmetric in i and j; or symmetric in t − 1 and t.

The definition carries over straightforwardly to continuous variables, where π becomes a probability density, and P(s′, s) a transition kernel probability density from state s′ to state s:

$\pi (s')P(s',s)=\pi (s)P(s,s')\,.$

A Markov process that has detailed balance is said to be a reversible Markov process or reversible Markov chain .

The detailed balance condition is stronger than that required merely for a stationary distribution; that is, there are Markov processes with stationary distributions that do not have detailed balance. Detailed balance implies that, around any closed cycle of states, there is no net flow of probability. For example, it implies that, for all a, b and c,

$P(a,b)P(b,c)P(c,a)=P(a,c)P(c,b)P(b,a)\,.$

This can be proved by substitution from the definition. In the case of a positive transition matrix, the "no net flow" condition implies detailed balance.

Transition matrices that are symmetric (P_ij = P_ji or P(s′, s) = P(s, s′)) always have detailed balance. In these cases, a uniform distribution over the states is an equilibrium distribution. For continuous systems with detailed balance, it may be possible to continuously transform the coordinates until the equilibrium distribution is uniform, with a transition kernel which then is symmetric. In the case of discrete states, it may be possible to achieve something similar by breaking the Markov states into a degeneracy of sub-states.

Detailed balance and the entropy growth

For many systems that treat physical and chemical kinetics, detailed balance provides sufficient conditions for the entropy growth in isolated systems. For example, the famous Boltzmann H-theorem states that, according to the Boltzmann equation, the principle of detailed balance implies positivity of the entropy production. The Boltzmann formula (1872) for the entropy production in the rarefied gas kinetics with detailed balance served as a prototype of many similar formulas for dissipation in mass action kinetics and generalised mass action kinetics with detailed balance.

Nevertheless, the principle of detailed balance is not necessary for entropy growth. For example, in the linear irreversible cycle $A_{1}\to A_{2}\to A_{3}\to A_{1}$ the entropy production is positive but the principle of detailed balance does not hold.

The principle of detailed balance is a sufficient but not necessary condition for the entropy growth in the Boltzmann kinetics. These relations between the principle of detailed balance and the Second law of thermodynamics were clarified in 1887 when Hendrik Lorentz objected the Boltzmann H-theorem for polyatomic gases . Lorentz stated that the principle of detailed balance is not applicable to collisions of polyatomic molecules. Boltzmann immediately invented a new, more general condition sufficient for the entropy growth. . In particular, this condition is valid for all Markov processes without any relation to time-reversibility. The entropy growth in all Markov processes was explicitly proved later . These theorems may be considered as simplifications of the Boltzmann result. Later, this condition was discussed as the "cyclic balance" condition (because it holds for irreversible cycles) or the "semi-detailed balance" or the "complex balance". In 1981, Carlo Cercignani and Maria Lampis proved that the Lorenz arguments were wrong and the principle of detailed balance is valid for polyatomic molecules . Nevertheless, the extended semi-detailed balance conditions invented by Boltzmann in this discussion remain the generalisation of detailed balance.

Wegscheider's conditions for the generalized mass action law

In chemical kinetics, the elementary reactions are represented by the stoichiometric equations

$\sum _{i}\alpha _{ri}A_{i}\to \sum _{j}\beta _{rj}A_{j}\;\;(r=1,\ldots ,m)\,,$

where $A_{i}$ are the components and $\alpha _{ri},\beta _{rj}\geq 0$ are the stoichiometric coefficients. Here, the reverse reactions with positive constants are included in the list separately. We need this separation of direct and reverse reactions to apply later the general formalism to the systems with some irreversible reactions. The system of stoichiometric equations of elementary reactions is the reaction mechanism.

The stoichiometric matrix is ${\boldsymbol {\Gamma }}=(\gamma _{ri})$, $\gamma _{ri}=\beta _{ri}-\alpha _{ri}$ (gain minus loss). The stoichiometric vector $\gamma _{r}$ is the rth row of ${\boldsymbol {\Gamma }}$ with coordinates $\gamma _{ri}=\beta _{ri}-\alpha _{ri}$.

According to the generalised mass action law, the reaction rate for an elementary reaction is

$w_{r}=k_{r}\prod _{i=1}^{n}a_{i}^{\alpha _{ri}}\,,$

where $a_{i}\geq 0$ is the activity of $A_{i}$.

The reaction mechanism includes reactions with the reaction rate constants $k_{r}>0$. For each r the following notations are used: $k_{r}^{+}=k_{r}$, $w_{r}^{+}=w_{r}$, $k_{r}^{-}$ is the reaction rate constant for the reverse reaction if it is in the reaction mechanism and 0 if it is not, $w_{r}^{-}$ is the reaction rate for the reverse reaction if it is in the reaction mechanism and 0 if it is not. For a reversible reaction, $K_{r}=k_{r}^{+}/k_{r}^{-}$ is the equilibrium constant.

The principle of detailed balance for the generalized mass action law is: For given values $k_{r}$ there exists a positive equilibrium $a_{i}^{\rm {eq}}>0$ with detailed balance, $w_{r}^{+}=w_{r}^{-}$. This means that the system of linear detailed balance equations

$\sum _{i}\gamma _{ri}x_{i}=\ln k_{r}^{+}-\ln k_{r}^{-}=\ln K_{r}$

is solvable ($x_{i}=\ln a_{i}^{\rm {eq}}$). The following classical result gives the necessary and sufficient conditions for the existence of the positive equilibrium $a_{i}^{\rm {eq}}>0$ with detailed balance .

Two conditions are sufficient and necessary in order to solve the system of detailed balance equations:

1. If $k_{r}^{+}>0$ then $k_{r}^{-}>0$ (reversibility);
2. For any solution ${\boldsymbol {\lambda }}=(\lambda _{r})$ of the system

${\boldsymbol {\lambda \Gamma }}=0\;\;\left({\mbox{i.e.}}\;\;\sum _{r}\lambda _{r}\gamma _{ri}=0\;\;{\mbox{for all}}\;\;i\right)$

the Wegscheider's identity holds:

$\prod _{r=1}^{m}(k_{r}^{+})^{\lambda _{r}}=\prod _{r=1}^{m}(k_{r}^{-})^{\lambda _{r}}\,.$

Remark. It is sufficient to use in the Wegscheider conditions a basis of solutions of the system ${\boldsymbol {\lambda \Gamma }}=0$.

In particular, for any cycle in the monomolecular (linear) reactions the product of the reaction rate constants in the clockwise direction is equal to the product of the reaction rate constants in the counter-clockwise direction. The same condition is valid for the reversible Markov processes (it is equivalent to the "no net flow" condition).

A simple non-linear example gives us a linear cycle supplemented by one non-linear step :

1. $A_{1}\rightleftharpoons A_{2}$
2. $A_{2}\rightleftharpoons A_{3}$
3. $A_{3}\rightleftharpoons A_{1}$
4. $A_{1}+A_{2}\rightleftharpoons 2A_{3}$

There are two nontrivial independent Wegscheider's identities for this system:

$k_{1}^{+}k_{2}^{+}k_{3}^{+}=k_{1}^{-}k_{2}^{-}k_{3}^{-}$ and $k_{3}^{+}k_{4}^{+}/k_{2}^{+}=k_{3}^{-}k_{4}^{-}/k_{2}^{-}$

They correspond to the following linear relations between the stoichiometric vectors:

$\gamma _{1}+\gamma _{2}+\gamma _{3}=0$ and $\gamma _{3}+\gamma _{4}-\gamma _{2}=0$.

The computational aspect of the Wegscheider conditions was studied by D. Colquhoun et al. .

The Wegscheider conditions demonstrate that, whereas the principle of detailed balance states a local property of equilibrium, it implies the relations between the kinetic constants that are valid for all states far from equilibrium. This is possible because a kinetic law is known and relations between the rates of the elementary processes at equilibrium can be transformed into relations between kinetic constants which are used globally. For the Wegscheider conditions this kinetic law is the law of mass action (or the generalised law of mass action).

Dissipation in systems with detailed balance

To describe dynamics of the systems that obey the generalised mass action law, one has to represent the activities as functions of the concentrations $c_{j}$ and the temperature. For this purpose, let us represent the activity in terms of the chemical potential:

$a_{i}=\exp \left({\frac {\mu _{i}-\mu _{i}^{\Theta }}{RT}}\right)$

where $\mu _{i}$ is the chemical potential of the species under the conditions of interest, $\mu _{i}^{\Theta }$ is the chemical potential of that species in the chosen standard state, $R$ is the gas constant and $T$ is the thermodynamic temperature. The chemical potential can be represented as a function of $c$ and $T$, where $c$ is the vector of concentrations with components $c_{j}$. For ideal systems, $\mu _{i}=RT\ln c_{i}+\mu _{i}^{\Theta }$ and $a_{j}=c_{j}$: the activity is the concentration.

For an isothermal, isochoric system the Helmholtz energy function $A(N,V,T)$ measures the "useful" work obtainable from a system. For an ideal system one has

$A=RT\sum _{i}N_{i}\left(\ln \left({\frac {N_{i}}{V}}\right)-1+{\frac {\mu _{i}^{\Theta }(T)}{RT}}\right)$

The chemical potential is given by the partial derivative

$\mu _{i}={\frac {\partial A(N,V,T)}{\partial N_{j}}}.$

The chemical kinetic equations are

${\frac {dN_{i}}{dt}}=V\sum _{r}\gamma _{ri}(w_{r}^{+}-w_{r}^{-}).$

If the principle of detailed balance is valid, then for any value of $T$ there exists a positive point of detailed balance $c^{\mathrm {eq} }$:

$w_{r}^{+}(c^{\mathrm {eq} },T)=w_{r}^{-}(c^{\rm {eq}},T)=w_{r}^{\rm {eq}}$

which leads to

$w_{r}^{+}=w_{r}^{\rm {eq}}\exp \left(\sum _{i}{\frac {\alpha _{ri}(\mu _{i}-\mu _{i}^{\rm {eq}})}{RT}}\right);\;\;w_{r}^{-}=w_{r}^{\rm {eq}}\exp \left(\sum _{i}{\frac {\beta _{ri}(\mu _{i}-\mu _{i}^{\rm {eq}})}{RT}}\right);$

where $\mu _{i}^{\rm {eq}}=\mu _{i}(c^{\rm {eq}},T)$

For the dissipation one obtains

${\frac {dF}{dt}}=\sum _{i}{\frac {\partial F(T,V,N)}{\partial N_{i}}}{\frac {dN_{i}}{dt}}=\sum _{i}\mu _{i}{\frac {dN_{i}}{dt}}=-VRT\sum _{r}(\ln w_{r}^{+}-\ln w_{r}^{-})(w_{r}^{+}-w_{r}^{-})\leq 0$

The inequality holds because the logarithm function is monotonic, hence, the expressions $\ln w_{r}^{+}-\ln w_{r}^{-}$ and $w_{r}^{+}-w_{r}^{-}$ always have the same sign.

Similar inequalities are valid for other classical conditions for the closed systems and the corresponding characteristic functions: for isothermal isobaric conditions the Gibbs energy function decreases, for isochoric systems with constant internal energy the entropy increases as well as for isobaric systems with the constant enthalpy.

Onsager reciprocal relations and detailed balance

Let the principle of detailed balance be valid. Then, in the linear approximation near equilibrium the reaction rates for the generalized mass action law are

$w_{r}^{+}=w_{r}^{\rm {eq}}\left(1+\sum _{i}{\frac {\alpha _{ri}(\mu _{i}-\mu _{i}^{\rm {eq}})}{RT}}\right);\;\;w_{r}^{-}=w_{r}^{\rm {eq}}\left(1+\sum _{i}{\frac {\beta _{ri}(\mu _{i}-\mu _{i}^{\rm {eq}})}{RT}}\right);$

Therefore, in the linear approximation near equilibrium, the kinetic equations are ($\gamma _{rj}=\beta _{ri}-\alpha _{ri}$):

${\frac {dN_{i}}{dt}}=-V\sum _{j}\left[\sum _{r}w_{r}^{\rm {eq}}\gamma _{ri}\gamma _{rj}\right]{\frac {\mu _{j}-\mu _{j}^{\rm {eq}}}{RT}}.$

This is exactly the Onsager form: following the original work of Lars Onsager we should introduce the thermodynamic forces $X_{j}$ and the matrix of coefficients $L_{ij}$ in the form

$X_{j}={\frac {\mu _{j}-\mu _{j}^{\rm {eq}}}{T}};\;\;{\frac {dN_{i}}{dt}}=\sum _{j}L_{ij}X_{j}$

The coefficient matrix $L_{ij}$ is symmetric:

$L_{ij}=-{\frac {V}{R}}\sum _{r}w_{r}^{\rm {eq}}\gamma _{ri}\gamma _{rj}$

These symmetry relations, $L_{ij}=L_{ji}$, are exactly the Onsager reciprocal relations. The coefficient matrix $L$ is non-positive. It is negative on the linear span of the stoichiometric vectors $\gamma _{r}$. So, the Onsager relations follow from the principle of detailed balance in the linear approximation near equilibrium.

Semi-detailed balance

To formulate the principle of semi-detailed balance, it is convenient to count the direct and inverse elementary reactions separately. In this case, the kinetic equations have the form:

${\frac {dN_{i}}{dt}}=V\sum _{r}\gamma _{ri}w_{r}=V\sum _{r}(\beta _{ri}-\alpha _{ri})w_{r}$

Let us use the notation $\alpha _{r}=\alpha _{ri}$, $\beta _{r}=\beta _{ri}$ for the input and the output vectors of the stoichiometric coefficients of the rth elementary reaction. Let $Y$ be the set of all these vectors $\alpha _{r},\beta _{r}$. For each $\nu \in Y$, let us define two sets of numbers:

$R_{\nu }^{+}=\{r|\alpha _{r}=\nu \};\;\;\;R_{\nu }^{-}=\{r|\beta _{r}=\nu \}$

$r\in R_{\nu }^{+}$ if and only if $\nu$ is the vector of the input stoichiometric coefficients $\alpha _{r}$ for the rth elementary reaction;$r\in R_{\nu }^{-}$ if and only if $\nu$ is the vector of the output stoichiometric coefficients $\beta _{r}$ for the rth elementary reaction.

The principle of semi-detailed balance implies that when in equilibrium, for every $\nu \in Y$

$\sum _{r\in R_{\nu }^{+}}w_{r}=\sum _{r\in R_{\nu }^{+}}w_{r}$

The semi-detailded balance condition is sufficient for the stationarity: it implies that

${\frac {dN}{dt}}=V\sum _{r}\gamma _{r}w_{r}=0.$

For the Markov kinetics the semi-detailed balance condition is simply the elementary balance equation and holds for any steady state. For the non-linear mass action law it is, in general, a sufficient but not necessary condition for stationarity. The semi-detailed balance condition is weaker than that of detailed balance: if the principle of detailed balance holds then the condition of semi-detailed balance also holds. For systems that obey the generalised mass action law the semi-detailed balance condition is sufficient for the dissipation inequality $dF/dt\geq 0$ (for the Helmholtz free energy under isothermal isochoric conditions and for the dissipation inequalities under other classical conditions for the corresponding thermodynamic potentials).

Boltzmann introduced the semi-detailed balance condition for collisions in 1887 and proved that it guaranties the positivity of the entropy production. For chemical kinetics, this condition (as the complex balance condition) was introduced by Horn and Jackson in 1972 .

The microscopic backgrounds for the semi-detailed balance were found in the Markov micro-kinetics of the intermediate compounds that are present in small amounts and whose concentrations are in quasiequilibrium with the main components . Under these microscopic assumptions, the semi-detailed balance condition becomes the balance equation for the Markov microkinetics according to the Michaelis-Menten-Stueckelberg theorem.

Dissipation in systems with semi-detailed balance

Let us represent the generalized mass action law in the equivalent form: the rate of the elementary process

$\sum _{i}\alpha _{ri}A_{i}\to \sum _{i}\beta _{ri}A_{i}$

is

$w_{r}=\varphi _{r}\exp \left(\sum _{i}{\frac {\alpha _{ri}\mu _{i}}{RT}}\right)$

where $\mu _{i}=\partial F(T,V,N)/\partial N_{i}$ is the chemical potential and $F(T,V,N)$ is the Helmholtz free energy. The exponential term is called the Boltzmann factor and the multiplier $\varphi _{r}\geq 0$ is the kinetic factor. Let us count the direct and reverse reaction in the kinetic equation separately:

${\frac {dN_{i}}{dt}}=V\sum _{r}\gamma _{ri}w_{r}$

An auxiliary function $\theta (\lambda )$ of one variable $\lambda \in [0,1]$ is convenient for the representation of dissipation for the mass action law

$\theta (\lambda )=\sum _{r}\varphi _{r}\exp \left(\sum _{i}{\frac {(\lambda \alpha _{ri}+(1-\lambda )\beta _{ri}))\mu _{i}}{RT}}\right)$

This function $\theta (\lambda )$ may be considered as the sum of the reaction rates for deformed input stoichiometric coefficients ${\tilde {\alpha }}_{\rho }(\lambda )=\lambda \alpha _{\rho }+(1-\lambda )\beta _{\rho }$. For $\lambda =1$ it is just the sum of the reaction rates. The function $\theta (\lambda )$ is convex because $\theta ''(\lambda )\geq 0$.

Direct calculation gives that according to the kinetic equations

${\frac {dF}{dt}}=-VRT\left.{\frac {d\theta (\lambda )}{d\lambda }}\right|_{\lambda =1}$

This is the general dissipation formula for the generalized mass action law.

Convexity of $\theta (\lambda )$ gives the sufficient and necessary conditions for the proper dissipation inequality:

${\frac {dF}{dt}}<0{\mbox{ if and only if }}\theta (\lambda )<\theta (1){\mbox{ for some }}\lambda <1;\;\;\;{\frac {dF}{dt}}\leq 0{\mbox{ if and only if }}\theta (\lambda )\leq \theta (1){\mbox{ for some }}\lambda <1$

The semi-detailed balance condition can be transformed into identity $\theta (0)\equiv \theta (1)$. Therefore, for the systems with semi-detailed balance ${dF}/{dt}\leq 0$.

Detailed balance for systems with irreversible reactions

Detailed balance states that in equilibrium each elementary process is equilibrated by its reverse process and required reversibility of all elementary processes. For many real physico-chemical complex systems (e.g. homogeneous combustion, heterogeneous catalytic oxidation, most enzyme reactions etc), detailed mechanisms include both reversible and irreversible reactions. If one represents irreversible reactions as limits of reversible steps, then it become obvious that not all reaction mechanisms with irreversible reactions can be obtained as limits of systems or reversible reactions with detailed balance. For example, the irreversible cycle $A_{1}\to A_{2}\to A_{3}\to A_{1}$ cannot be obtained as such a limit but the reaction mechanism $A_{1}\to A_{2}\to A_{3}\leftarrow A_{1}$ can .

A system of reactions with some irreversible reactions is a limit of systems with detailed balance when some constants tend to zero if and only if (i) the reversible part of this system satisfies the principle of detailed balance and (ii) the convex hull of the stoichiometric vectors of the irreversible reactions has empty intersection with the linear span of the stoichiometric vectors of the reversible reactions. Physically, the last condition means that the irreversible reactions cannot be included in oriented cyclic pathways.

References

Related reading

• Vasilios I. Manousiouthakis and Michael W. Deem "Strict detailed balance is unnecessary in Monte Carlo simulation", Journal of Chemical Physics 110 pp. 2753- (1999)
• van Kampen, N.G. "Stochastic Processes in Physics and Chemistry", Elsevier Science (1992) ISBN 0444893490
• E. M. Lifshitz, and L. P. Pitaevskii "Physical kinetics" Butterworth-Heinemann (1981) ISBN 0750626356

External links

• Detailed balance in Wikipedia