Finite Observation
A Spectral Theory of Nonequilibrium Visibility

J. R. Dunkley
(18th March 2026)
Abstract

We study finite observation in irreducible finite-state continuous-time Markov nonequilibrium steady states through the local Donsker–Varadhan Hessian at the minimiser π\pi. In reduced Fisher coordinates, the nonequilibrium correction ΔDV\Delta_{DV} factors through the weighted signal operator ADVA_{DV} and the detailed-balance backbone. For rank-dd orthogonal observation in this reduced Euclidean Fisher geometry, the visible correction is governed by a Ky Fan envelope, with associated retention hierarchy, hidden tail, and weighted stable rank. The envelope hierarchy determines the eigenvalue profile of ΔDV\Delta_{DV}, equivalently the singular-energy profile 14sk(ADV)2\tfrac{1}{4}s_{k}(A_{DV})^{2} and hence the nonzero singular-value magnitudes of ADVA_{DV}. We also identify the optimal orthogonal observer at fixed rank and show that Haar-random rank-dd observation retains exactly a fraction d/(n1)d/(n-1) in expectation. A separate statistical question arises after comparison with the observed detailed-balance backbone: in the compressed-Hessian Gaussian model, distinguishability is governed by a positive shadow operator whose spectrum can differ from the raw visibility spectrum except in special commuting or isotropic-backbone regimes. The weighted geometry further transfers to abstract finite-dimensional metric settings, and hence to the linearised BKM-symmetrised operator setting.

Contents

1  Introduction

1.1 The finite observation problem

A nonequilibrium system may carry irreversibility across many microscopic directions while only a small observable sector is accessible. Hidden transitions, finite time resolution, finite spatial resolution, detector noise, and coarse graining all lead to the same structural question: what can a finite observer actually see of the nonequilibrium fluctuation structure?

In finite-dimensional Markov nonequilibrium steady states, the natural empirical-measure fluctuation object is the local Hessian of the Donsker–Varadhan rate function at its minimiser π\pi [1, 2, 3, 4]. A finite observer does not see the full Hessian. The observer only sees its compression to a rank-limited sector. The finite observation problem is therefore precise: given an irreducible nonequilibrium generator and an observable subspace of dimension dd, how much of the nonequilibrium correction survives projection, and how does that visible share depend on the geometry of the system and the geometry of the observer? The detailed-balance geometry is the reference geometry adopted here for measuring this local Gaussian nonequilibrium correction.

We show that, in the finite-dimensional Markov Gaussian regime treated here, this question reduces to a spectral compression problem in reduced Fisher coordinates. The visible share is governed by a weighted singular-value hierarchy. The hidden share is its spectral tail. The effective complexity of visibility is controlled by weighted stable rank.

1.2 Motivation

Recent work across stochastic thermodynamics, coarse graining, and quantum nonequilibrium theory has made the finite observation problem sharper and more urgent. The literature contains lower bounds on entropy production under partial observation, hidden data, coarse temporal sampling, unresolved transitions, faulty observation maps, and coarse graining [5, 6, 7, 8, 9, 10, 11, 12]. Closely related work studies estimator quality for dissipation under lumping, milestoning, hidden cycles, current fluctuations, and finite statistics, and proposes random or optimised coarse-graining strategies for irreversibility detection [13, 14, 15, 16, 17, 18].

Restricted-information and coarse-grained quantum thermodynamics make the same point from another direction: observation changes the effective thermodynamic description [19, 20, 21, 22, 23]. At a broader level, the thermodynamic uncertainty-relation programme has clarified how much of the field is organised around scalar fluctuation bounds rather than observer-resolved spectral structure [24, 25], and very recent counterexamples show that even two widely used model-free partial-observation bounds, the waiting-time and TUR bounds, admit no universal ordering on the same observed link [26].

What is missing from this landscape, as far as we are aware, is a finite-dimensional law for the visible share of the nonequilibrium correction itself in the Markov Gaussian setting treated here. The current literature is rich in estimators, bounds, and coarse-grained descriptions. The contribution of the present paper is to identify, for orthogonal rank-constrained observers in reduced Euclidean Fisher coordinates, the envelope of the projected Donsker–Varadhan correction, the associated observer-design law at fixed rank, the shadow criterion for observed Gaussian indistinguishability in the compressed-Hessian model, and the corresponding spectral readout of the hidden correction.

1.3 Main claim and conceptual picture

The central claim is that finite observation in the Donsker–Varadhan Gaussian regime has a finite-dimensional spectral normal form. In reduced Euclidean Fisher coordinates, the nonequilibrium correction factors through the reduced skew channel and the detailed-balance backbone via the weighted signal map ADVA_{DV}. Finite observation therefore becomes a rank-constrained orthogonal compression problem for that map.

This leads to two distinct spectral questions. The first is raw visibility: how much nonequilibrium signal survives projection, how much is hidden in the spectral tail, and which observer of rank dd is best aligned with the signal front. That question is governed by the singular spectrum of ADVA_{DV} and the associated Ky Fan envelope hierarchy. The second is detectability relative to the detailed-balance backbone: once the observed correction is compared to the observed backbone in its natural metric, a second positive operator appears, and its spectrum governs Gaussian distinguishability. These two spectra coincide only in special commuting or isotropic-backbone regimes. The raw and detectability spectra therefore read the same nonequilibrium deviation in two different equilibrium coordinate systems: the ambient detailed-balance backbone, and the backbone induced on the observed sector after projection. Raw nonequilibrium signal and statistically detectable nonequilibrium signal therefore need not live in the same observer directions. The theory therefore distinguishes directions that are structurally invisible under the observation map from directions that remain visible in principle but are weak or poorly aligned in the observable geometry.

Within the orthogonal-observer model used here, the paper gives a finite-dimensional theory of visibility, observer design, detectability, and spectral readout. The bridge theorem identifies the structure of the correction, the envelope gives the visible law, the shadow gives the distinguishability law, and the full hierarchy recovers the singular-energy profile of the correction, equivalently the nonzero singular-value magnitudes of ADVA_{DV}.

1.4 Main results

The first result is the bridge theorem. We prove that the Donsker–Varadhan correction is quadratic in the reduced skew channel. This is the representation step that turns the fluctuation problem into a weighted operator problem.

The second result is the finite-observation law. For every orthogonal rank-constrained observer, the visible nonequilibrium content is given by a Ky Fan envelope of the weighted signal map. The retention hierarchy, hidden tail, and weighted stable rank follow from this representation.

The third result is the observer-design law. Visible signal is an alignment score against the left singular modes of the weighted signal map. This yields the optimal orthogonal observer, its gap-controlled uniqueness criterion, the worst observer, and the Haar-random rank-dd baseline in expectation.

The fourth result is the two-spectrum theorem. The observed Gaussian law in the compressed-Hessian model is governed by a positive shadow operator, and backbone whitening yields a second spectral hierarchy for detectability relative to the detailed-balance backbone. In general this detectability spectrum is distinct from the raw visibility spectrum.

The fifth result is spectral completeness of the envelope hierarchy for magnitudes. The full envelope hierarchy recovers the ordered singular-energy profile 14sk(ADV)2\tfrac{1}{4}s_{k}(A_{DV})^{2}, equivalently the eigenvalue profile of ΔDV\Delta_{DV}, and hence the nonzero singular-value magnitudes of ADVA_{DV}.

The sixth result is a transfer theorem. The weighted envelope, alignment, detectability, and spectral-readout structure transfer to abstract finite-dimensional metric settings and hence to linearised BKM operator geometry.

1.5 Contribution

The paper gives a finite-dimensional solution to the finite-observation problem in the Markov Gaussian regime treated here. Its contribution is to identify the operator geometry that organises what finite observers can still see within the orthogonal-observer model.

More specifically, it proves a bridge from the skew sector to the fluctuation correction, a rank-constrained envelope law, an observer-design law with a Haar baseline, a Gaussian shadow criterion, a second spectrum for detectability distinct from raw visibility, and an envelope hierarchy that determines the singular-energy profile of the correction and hence the singular-value magnitudes of ADVA_{DV}.

1.6 Roadmap

Section 2 fixes the finite-dimensional Markov setting, the Fisher normal form, the notion of a finite observer, and the observable normal-form language. Section 3 proves the bridge theorem and identifies the nonequilibrium correction as a positive correction operator together with its weighted signal factorisation. Section 4 derives the finite-observation law: the Ky Fan envelope, retention hierarchy, hidden tail, stable-rank obstruction, and the direct-sum allocation reading of the envelope.

Section 5 develops the observer-design layer through the alignment theorem, optimal and worst observers, and the Haar-random baseline. Section 6 proves the shadow and detectability theory, making explicit the split between raw visibility and backbone-normalised distinguishability, and includes a fixed-channel Gaussian noisy-observation extension. Section 7 proves spectral completeness of the envelope hierarchy for singular-value magnitudes and develops the induced observability order between systems.

2  Setting and observable normal forms

2.1 Finite-dimensional Markov nonequilibrium steady states

Let 𝖷={1,,n}\mathsf{X}=\{1,\dots,n\} be a finite state space, and let QQ be the generator of an irreducible continuous-time Markov chain on 𝖷\mathsf{X}. Thus Qij0Q_{ij}\geq 0 for iji\neq j, jQij=0\sum_{j}Q_{ij}=0 for each ii, and irreducibility guarantees a unique stationary law

π=(π1,,πn),πi>0,iπi=1,\pi=(\pi_{1},\dots,\pi_{n}),\qquad\pi_{i}>0,\qquad\sum_{i}\pi_{i}=1, (2.1)

satisfying πQ=0\pi Q=0. We are interested in the nonequilibrium steady-state case, meaning that QQ need not satisfy detailed balance with respect to π\pi.

Throughout the paper we work at the level of stationary empirical-measure fluctuations. The fluctuation object in this setting is the local Hessian of the Donsker–Varadhan rate function at its minimiser π\pi, viewed in the Fisher geometry associated with the stationary law. This Fisher viewpoint is not merely convenient notation: in nonequilibrium stochastic thermodynamics it has a direct geometric and physical interpretation, and in the reversible Markov setting it sits on a well-developed information-geometric background [27, 28]. The detailed-balance geometry provides the reference unit system in which the Gaussian nonequilibrium correction is measured. The entire finite-observation theory developed below takes place in the tangent space at π\pi, after passing to the Euclideanised Fisher coordinates adapted to that geometry.

Let

Dπ:=diag(π1,,πn),eπ:=(π1,,πn)T.D_{\pi}:=\mathrm{diag}(\pi_{1},\dots,\pi_{n}),\qquad e_{\pi}:=\bigl(\sqrt{\pi_{1}},\dots,\sqrt{\pi_{n}}\bigr)^{T}. (2.2)

The Euclideanised Fisher tangent space is

Tπ:={un:u,eπ=0}.T_{\pi}:=\{u\in\mathbb{R}^{n}:\langle u,e_{\pi}\rangle=0\}. (2.3)

Equivalently, TπT_{\pi} is the codimension-one subspace orthogonal to the stationary direction in Fisher coordinates. We denote by

Pπ:=IeπeπTP_{\pi}:=I-e_{\pi}e_{\pi}^{T} (2.4)

the orthogonal projector onto TπT_{\pi}.

The Fisher metric in density coordinates becomes the standard Euclidean inner product after this transformation, so from this point onward all orthogonality, projection, adjoints, and singular values in the classical Markov setting are taken with respect to the Euclidean structure on TπT_{\pi}, unless stated otherwise.

2.2 Fisher geometry and the normal form

Define the Fisher-conjugated generator

Lπ:=Dπ1/2QDπ1/2.L_{\pi}:=D_{\pi}^{1/2}QD_{\pi}^{-1/2}. (2.5)

Its restriction to the tangent space carries the full linearised stationary fluctuation geometry. Since TπT_{\pi} is LπL_{\pi}-invariant, we may regard

K:=Lπ|TπK:=L_{\pi}|_{T_{\pi}} (2.6)

as an operator on TπT_{\pi}.

The central structural decomposition is the Fisher normal form

K=G+J,K=G+J, (2.7)

where

G:=K+KT2,J:=KKT2.G:=\frac{K+K^{T}}{2},\qquad J:=\frac{K-K^{T}}{2}. (2.8)

Thus GG is self-adjoint and JJ is skew-adjoint on TπT_{\pi}. In the present work, GG is the dissipative backbone and JJ is the skew, antisymmetric sector carrying the nonequilibrium part relative to the detailed-balance backbone. This symmetricantisymmetric normal-form viewpoint is consonant with earlier steady-state fluctuation analyses of driven diffusions [29] and with the network-cycle description of nonequilibrium steady states originating in Schnakenberg theory [30]. The detailed-balance reference object is obtained by setting J=0J=0 while keeping the same stationary law and dissipative geometry.

The nonequilibrium correction to the Donsker-Varadhan Hessian will be shown in Section  efsec:exact-dv-bridge to be carried entirely by the skew sector after the reduced-coordinate analysis, while the observed detailed-balance backbone is governed by the projected dissipative sector.

To work concretely, choose an orthonormal matrix

Cn×(n1)C\in\mathbb{R}^{n\times(n-1)} (2.9)

whose columns form an orthonormal basis of TπT_{\pi}. Then

CTC=In1,CCT=Pπ.C^{T}C=I_{n-1},\qquad CC^{T}=P_{\pi}. (2.10)

Reduced coordinates xn1x\in\mathbb{R}^{n-1} are identified with tangent vectors by u=Cxu=Cx. In these coordinates the Fisher-conjugated generator becomes

K^:=CTLπC,\widehat{K}:=C^{T}L_{\pi}C, (2.11)

with corresponding reduced decomposition

K^=G^+J^,G^=K^+K^T2,J^=K^K^T2.\widehat{K}=\widehat{G}+\widehat{J},\qquad\widehat{G}=\frac{\widehat{K}+\widehat{K}^{T}}{2},\qquad\widehat{J}=\frac{\widehat{K}-\widehat{K}^{T}}{2}. (2.12)

All finite-dimensional statements in the main text will be expressed on this reduced Euclidean space. For notational simplicity, we will often suppress the distinction between the operator on TπT_{\pi} and its matrix in reduced coordinates when no ambiguity arises. Where the reduced-coordinate nature matters, hats will be retained. This dissipative-plus-skew normal form already foreshadows the later operator-space transfer, where the same structural split reappears in metric operator geometry.

2.3 Observable sectors and finite observers

A finite observer is modelled by a rank-constrained orthogonal projector on the reduced Fisher space. Concretely, let

Π:n1n1\Pi:\mathbb{R}^{n-1}\to\mathbb{R}^{n-1} (2.13)

be a Euclidean orthogonal projector of rank dd, and let

U:=RanΠ.U:=\operatorname{Ran}\Pi. (2.14)

The rank dd is the observable dimension. It is the number of independent fluctuation directions actually accessible to the observer.

This choice of projector is the mathematical form of finite observation used here. It covers rank-constrained observable sectors, reduced coordinates, compressions to slow manifolds, and more abstract finite-resolution measurement ideals, provided the observation is represented by orthogonal compression in the underlying Euclideanised geometry. The exact envelope law proved below is for orthogonal rank-dd observers in this sense. More general coarse-graining maps require different machinery, with the fixed-channel Gaussian noisy-observation section giving one controlled extension. Later sections will explain how this structure extends to weighted operator-space settings, where orthogonality is taken with respect to a nontrivial metric.

Given Π\Pi, the observer does not see the full operator KK, the full detailed-balance Hessian, or the full Donsker-Varadhan Hessian. The observer sees only their compressions to UU. The finite observation problem is therefore a rank-constrained compression problem on a fluctuation operator whose full structure is initially hidden.

2.4 Projected observable normal forms

The projected observable normal form associated with Π\Pi is

NΠ(Q):=(U,gΠ,GΠ,JΠ),N_{\Pi}(Q):=(U,g_{\Pi},G_{\Pi},J_{\Pi}), (2.15)

where gΠg_{\Pi} is the Euclidean metric restricted to UU, and

GΠ:=ΠG^Π|U,JΠ:=ΠJ^Π|U.G_{\Pi}:=\Pi\widehat{G}\Pi|_{U},\qquad J_{\Pi}:=\Pi\widehat{J}\Pi|_{U}. (2.16)

This is the observable quadruple inherited by finite observation from the full Markov generator.

Observable equivalence is governed by such projected data once the finer nonequilibrium correction is sufficiently small. The work proves a stronger result. The projected quadruple is the observable backbone of a signal theory in which the nonequilibrium correction is placed in weighted spectral form and its visible share under Π\Pi is determined explicitly.

Three levels of observable structure will later reappear:

  1. 1.

    the purely metric or static level, carried by UU and gΠg_{\Pi},

  2. 2.

    the dissipative level, carried by GΠG_{\Pi},

  3. 3.

    the full projected normal form, carried by (gΠ,GΠ,JΠ)(g_{\Pi},G_{\Pi},J_{\Pi}).

The theory developed below refines this hierarchy by inserting one more object: the projected nonequilibrium correction to the Donsker-Varadhan Hessian. That correction is the signal of hidden irreversibility.

2.5 The Donsker-Varadhan Hessian as the fluctuation object

Let IDVI_{DV} denote the Donsker-Varadhan rate function for the empirical measure of the irreducible Markov chain generated by QQ. Since π\pi is the unique stationary law, π\pi is the minimiser of IDVI_{DV}, and the Hessian of IDVI_{DV} at π\pi is positive definite on the reduced tangent space. We denote this Hessian in reduced Euclidean coordinates by

HDV.H_{DV}. (2.17)

The canonical detailed-balance reference is obtained by Fisher symmetrisation. Let

Lπ:=Dπ1/2QDπ1/2,Gfull:=12(Lπ+LπT),Q0:=Dπ1/2GfullDπ1/2.L_{\pi}:=D_{\pi}^{1/2}QD_{\pi}^{-1/2},\qquad G_{\mathrm{full}}:=\frac{1}{2}(L_{\pi}+L_{\pi}^{T}),\qquad Q_{0}:=D_{\pi}^{-1/2}G_{\mathrm{full}}D_{\pi}^{1/2}. (2.18)

Then Q0Q_{0} has the same stationary law π\pi, satisfies detailed balance with respect to π\pi, and has reduced Fisher generator G^\widehat{G}. The corresponding detailed-balance Hessian on the reduced Euclidean Fisher space is therefore

H0:=12G^.H_{0}:=-\frac{1}{2}\,\widehat{G}. (2.19)

Because the detailed-balance reference is irreducible, G^-\widehat{G} is positive definite on the reduced space, so H00H_{0}\succ 0 and is therefore invertible there. Under this sign convention, the positive conductance form is represented by G^-\widehat{G}. The nonequilibrium correction is

ΔDV:=HDVH0.\Delta_{DV}:=H_{DV}-H_{0}. (2.20)

At this point, ΔDV\Delta_{DV} is only a definition. The bridge section then identifies it as a positive correction operator built from the skew sector and the detailed-balance backbone.

The object of interest is not entropy production by itself, nor the full rate function, nor a pathwise current observable. It is the fluctuation-side nonequilibrium correction encoded in HDVH_{DV}. Once that correction is understood, finite observation becomes a problem of spectral retention.

3  The Donsker-Varadhan bridge

3.1 Reduced coordinates and the conductance identity

The bridge from the Donsker-Varadhan variational principle to the spectral theory developed later in the paper passes through a reduced-coordinate quadratic envelope. The full derivation is carried out in Appendix A. Here we isolate the structural cancellation that drives everything that follows.

Starting from the variational representation of the Donsker-Varadhan rate function, one introduces reduced logarithmic coordinates near stationarity and expands the envelope to second order. This produces a reduced quadratic fluctuation problem governed by two coupled ingredients. One is a current-like reduced operator carrying the skew dependence. The other is a reduced conductance matrix controlling the quadratic envelope itself. A priori, both the dissipative and skew sectors could have entered that conductance matrix.

They do not. The skew sector contributes no quadratic form of its own, so the conductance matrix of the full nonequilibrium envelope depends only on the dissipative backbone. This is the reason the final bridge is purely quadratic in the skew channel, with no mixed dissipative-skew leakage.

Let MQM_{Q} denote the reduced conductance matrix produced by the full nonequilibrium envelope construction, and let MGM_{G} denote the corresponding reduced conductance matrix for the detailed-balance reference problem obtained by suppressing the skew sector. Both objects are defined canonically by the same reduced-coordinate construction; the explicit formulas are recorded in Appendix A.

Proposition 3.1 (Reduced conductance identity).

In the finite-dimensional irreducible Markov setting described above, the reduced conductance matrix of the full Donsker-Varadhan quadratic envelope coincides with that of the detailed-balance reference problem:

MQ=MG.M_{Q}=M_{G}. (3.1)

Equivalently, the quadratic conductance controlling the reduced Donsker-Varadhan Hessian depends only on the dissipative sector and is blind to the skew sector.

Proof.

Write the Donsker–Varadhan variational formula as [1, 2, 3]

IDV(μ)=suph(i,jμiqij(ehjhi1)).I_{DV}(\mu)=\sup_{h}\Bigl(-\sum_{i,j}\mu_{i}q_{ij}(e^{h_{j}-h_{i}}-1)\Bigr). (3.2)

Choose reduced Fisher coordinates xn1x\in\mathbb{R}^{n-1} and reduced logarithmic coordinates yn1y\in\mathbb{R}^{n-1} by

μ(x)=π+Dπ1/2Cx+O(|x|2),h(y)=Dπ1/2Cy.\mu(x)=\pi+D_{\pi}^{1/2}Cx+O(|x|^{2}),\qquad h(y)=D_{\pi}^{-1/2}Cy. (3.3)

Using the second-order reduced-coordinate expansion derived in Appendix LABEL:app:reduced-coordinate-identities gives the reduced quadratic envelope

(x,y)=yTG^yxTK^y+O(|(x,y)|3),\mathcal{L}(x,y)=y^{T}\widehat{G}y-x^{T}\widehat{K}y+O(|(x,y)|^{3}), (3.4)

where K^=CTDπ1/2QDπ1/2C=G^+J^\widehat{K}=C^{T}D_{\pi}^{1/2}QD_{\pi}^{-1/2}C=\widehat{G}+\widehat{J}. The key point is that the pure quadratic term in yy is

yTK^y=yTG^y,y^{T}\widehat{K}y=y^{T}\widehat{G}y, (3.5)

because yTJ^y=0y^{T}\widehat{J}y=0 for every skew-symmetric matrix J^\widehat{J}. Hence the conductance block is determined entirely by G^\widehat{G}, and the nonequilibrium reduced conductance coincides with the detailed-balance one. Equivalently,

MQ=MG=G^.M_{Q}=M_{G}=-\widehat{G}. (3.6)

The skew sector survives only in the current block xTK^y-x^{T}\widehat{K}y. ∎

Proposition 3.1 records the key asymmetry used in the bridge argument. The skew sector drives the nonequilibrium correction, but the quadratic conductance beneath the reduced envelope is controlled by the dissipative geometry alone. This is why the later factorisation of the correction is so rigid. The skew sector enters through a weighted signal map, but the weight itself is fixed by the detailed-balance backbone. The first antisymmetry input here is the identity yTJ^y=0y^{T}\widehat{J}y=0, but the bridge theorem uses it inside the Legendre contraction, where the supremum over yy removes the mixed dissipative-skew contribution at Hessian order. This cancellation is a level-2 empirical-measure statement, and should not be read as a statement about the unreduced level-2.5 fluctuation Hessian.

The rest of Section 3 exploits this asymmetry. The next subsection converts the reduced envelope into a quadratic representation of the nonequilibrium correction, which in turn becomes the signal operator governing finite observation.

{remarkbox}
Remark (Dirac-type factorisation of the DV Hessian).

The bridge identity also admits a canonical first-order factorisation, using the principal positive square root of H0H_{0}. Define

D:=H01/2+12H01/2J^T.D:=H_{0}^{1/2}+\tfrac{1}{2}H_{0}^{-1/2}\widehat{J}^{T}. (3.7)

Since J^\widehat{J} is skew-symmetric, one has

DT=H01/2+12J^H01/2,D^{T}=H_{0}^{1/2}+\tfrac{1}{2}\widehat{J}H_{0}^{-1/2}, (3.8)

and therefore

DTD=H0+14J^H01J^T=HDV.D^{T}D=H_{0}+\tfrac{1}{4}\widehat{J}H_{0}^{-1}\widehat{J}^{T}=H_{DV}. (3.9)

Thus HDV=DTDH_{DV}=D^{T}D exactly. Since HDV0H_{DV}\succ 0 on the reduced space, kerD={0}\ker D=\{0\}, so DD is invertible. The operator DD packages the detailed-balance backbone and the reduced skew channel into a single first-order object whose adjoint square recovers the full nonequilibrium fluctuation Hessian.

3.2 Quadraticity of the nonequilibrium correction

We now progress to the central bridge theorem. Proposition 3.1 implies that the reduced Donsker-Varadhan quadratic envelope is built on the detailed-balance conductance matrix alone. The skew sector therefore enters only through the reduced current channel. This yields a quadratic representation of the nonequilibrium correction.

To state the result cleanly, recall from Section 2 that the canonical detailed-balance reference is the Fisher-symmetrised one, with reduced Hessian

H0=12G^.H_{0}=-\frac{1}{2}\,\widehat{G}. (3.10)

Let J^\widehat{J} denote the canonical reduced skew channel produced by the reduced-coordinate envelope construction. The next theorem is the finite-dimensional bridge identity that identifies the fluctuation correction as a positive correction operator with an explicit weighted signal factorisation.

Theorem 3.2 (Quadraticity of the DV correction).

In the finite-dimensional irreducible Markov setting of Section 2, the Donsker-Varadhan Hessian decomposes as

HDV=H0+ΔDV\boxed{\scalebox{1.08}{$\displaystyle H_{DV}=H_{0}+\Delta_{DV}$}}

where the nonequilibrium correction is

ΔDV=14J^H01J^T\boxed{\scalebox{1.08}{$\displaystyle\Delta_{DV}=\frac{1}{4}\,\widehat{J}\,H_{0}^{-1}\widehat{J}^{T}$}}

Equivalently, ΔDV\Delta_{DV} is positive semidefinite and is quadratic in the reduced skew channel with no mixed dissipative-skew term.

Proof.

By Proposition 3.1 and the reduced-coordinate expansion recalled above, the second-order reduced envelope has the form

(x,y)=yTG^yxTK^y+O(|(x,y)|3),K^=G^+J^.\mathcal{L}(x,y)=y^{T}\widehat{G}y-x^{T}\widehat{K}y+O(|(x,y)|^{3}),\qquad\widehat{K}=\widehat{G}+\widehat{J}. (3.11)

Set

S:=G^.S:=-\widehat{G}. (3.12)

Then SS is positive definite on the reduced space and

(x,y)=yTSy+xT(SJ^)y+O(|(x,y)|3)=yTSy+yT(S+J^)x+O(|(x,y)|3),\mathcal{L}(x,y)=-y^{T}Sy+x^{T}(S-\widehat{J})y+O(|(x,y)|^{3})=-y^{T}Sy+y^{T}(S+\widehat{J})x+O(|(x,y)|^{3}), (3.13)

using J^T=J^\widehat{J}^{T}=-\widehat{J}. Completing the square in yy gives

(x,y)=(y12S1(S+J^)x)TS(y12S1(S+J^)x)+14xT(S+J^)TS1(S+J^)x+O(|(x,y)|3).\mathcal{L}(x,y)=-\Bigl(y-\frac{1}{2}S^{-1}(S+\widehat{J})x\Bigr)^{T}S\Bigl(y-\frac{1}{2}S^{-1}(S+\widehat{J})x\Bigr)+\frac{1}{4}x^{T}(S+\widehat{J})^{T}S^{-1}(S+\widehat{J})x+O(|(x,y)|^{3}). (3.14)

Taking the supremum over yy, exactly as in the reduced variational contraction derived in Appendix LABEL:app:reduced-coordinate-identities, yields

IDV(μ(x))=14xT(S+J^)TS1(S+J^)x+O(|x|3).I_{DV}(\mu(x))=\frac{1}{4}x^{T}(S+\widehat{J})^{T}S^{-1}(S+\widehat{J})x+O(|x|^{3}). (3.15)

Since J^T=J^\widehat{J}^{T}=-\widehat{J},

(S+J^)TS1(S+J^)=(SJ^)S1(S+J^)=SJ^S1J^=S+J^S1J^T.(S+\widehat{J})^{T}S^{-1}(S+\widehat{J})=(S-\widehat{J})S^{-1}(S+\widehat{J})=S-\widehat{J}S^{-1}\widehat{J}=S+\widehat{J}S^{-1}\widehat{J}^{T}. (3.16)

Therefore

IDV(μ(x))=14xT(S+J^S1J^T)x+O(|x|3).I_{DV}(\mu(x))=\frac{1}{4}x^{T}\bigl(S+\widehat{J}S^{-1}\widehat{J}^{T}\bigr)x+O(|x|^{3}). (3.17)

By definition of the reduced Hessian,

IDV(μ(x))=12xTHDVx+O(|x|3),I_{DV}(\mu(x))=\frac{1}{2}x^{T}H_{DV}x+O(|x|^{3}), (3.18)

so

HDV=12S+12J^S1J^T.H_{DV}=\frac{1}{2}S+\frac{1}{2}\widehat{J}S^{-1}\widehat{J}^{T}. (3.19)

For the detailed-balance reference J^=0\widehat{J}=0, the same reduced envelope gives

H0=12S=12G^.H_{0}=\frac{1}{2}S=-\frac{1}{2}\widehat{G}. (3.20)

Hence H01=2S1H_{0}^{-1}=2S^{-1}, and substitution gives

HDV=H0+14J^H01J^T.H_{DV}=H_{0}+\frac{1}{4}\,\widehat{J}H_{0}^{-1}\widehat{J}^{T}. (3.21)

Equivalently,

ΔDV=HDVH0=14J^H01J^T.\Delta_{DV}=H_{DV}-H_{0}=\frac{1}{4}\,\widehat{J}H_{0}^{-1}\widehat{J}^{T}. (3.22)

The Gram form

ΔDV=14(J^H01/2)(J^H01/2)T\Delta_{DV}=\frac{1}{4}\bigl(\widehat{J}H_{0}^{-1/2}\bigr)\bigl(\widehat{J}H_{0}^{-1/2}\bigr)^{T} (3.23)

implies positive semidefiniteness. ∎

{remarkbox}
Remark (Orthogonal invariance of the quadratic correction).

The identity of Theorem 3.2 is invariant under orthogonal changes of reduced Euclidean Fisher coordinates. In particular, the spectrum of ΔDV\Delta_{DV}, and therefore every envelope, retention, and spectral-readout quantity derived from it, is coordinate-independent within the reduced Euclidean Fisher coordinates fixed by the paper.

Theorem 3.2 identifies ΔDV\Delta_{DV} as an explicit positive correction operator with a weighted signal factorisation at the level of the quadratic fluctuation correction. Once the detailed-balance backbone H0H_{0} is fixed, the reduced skew channel determines the Gaussian nonequilibrium excess at Hessian order, with no additional mixed dissipative-skew term surviving in this reduced setting.

Two immediate consequences are worth recording.

Corollary 3.3 (Positivity and rank control).

The nonequilibrium correction ΔDV\Delta_{DV} is positive semidefinite. Moreover,

rank(ΔDV)=rank(J^),\operatorname{rank}(\Delta_{DV})=\operatorname{rank}(\widehat{J}), (3.24)

and the range of ΔDV\Delta_{DV} is exactly the signal subspace generated by the reduced skew channel.

Proof.

Positivity follows from Theorem 3.2. Since H01H_{0}^{-1} is invertible,

rank(J^H01)=rank(J^).\operatorname{rank}(\widehat{J}H_{0}^{-1})=\operatorname{rank}(\widehat{J}). (3.25)

Now set D:=J^H01/2D:=\widehat{J}H_{0}^{-1/2}. Then

J^H01J^T=DDT,\widehat{J}H_{0}^{-1}\widehat{J}^{T}=DD^{T}, (3.26)

and rank(DDT)=rank(D)\operatorname{rank}(DD^{T})=\operatorname{rank}(D). Hence

rank(J^H01J^T)=rank(J^).\operatorname{rank}\!\left(\widehat{J}H_{0}^{-1}\widehat{J}^{T}\right)=\operatorname{rank}(\widehat{J}). (3.27)

The range statement follows from ΔDV=14DDT\Delta_{DV}=\tfrac{1}{4}DD^{T}, since Ran(DDT)=Ran(D)\operatorname{Ran}(DD^{T})=\operatorname{Ran}(D), and Ran(D)=Ran(J^)\operatorname{Ran}(D)=\operatorname{Ran}(\widehat{J}) because H01/2H_{0}^{-1/2} is invertible. ∎

Corollary 3.4 (Detailed-balance characterisation).

The following are equivalent:

  1. 1.

    the generator is detailed-balance in the Fisher normal form, that is, J=0J=0,

  2. 2.

    the reduced skew channel vanishes, that is, J^=0\widehat{J}=0,

  3. 3.

    the Donsker-Varadhan Hessian equals its detailed-balance reference, that is, ΔDV=0\Delta_{DV}=0.

Proof.

The equivalence of the first two statements is by construction of the reduced skew channel. The equivalence of the second and third follows from Theorem 3.2 and the positive definiteness of H0H_{0}. ∎

Corollaries 3.3 and 3.4 already show why ΔDV\Delta_{DV} is the right object for finite observation. It is the positive fluctuation correction carried by the skew sector and vanishes precisely at detailed balance.

3.3 Basis transport and the weighted signal operator

The exact quadraticity theorem immediately suggests the right signal object. Since H0H_{0} is positive definite, define

ADV:=J^H01/2.A_{DV}:=\widehat{J}\,H_{0}^{-1/2}. (3.28)

Then

ΔDV=14ADVADVT.\Delta_{DV}=\frac{1}{4}\,A_{DV}A_{DV}^{T}. (3.29)

This is the weighted signal operator of the paper, and ΔDV\Delta_{DV} is its induced positive correction operator.

The factorisation is conceptually simple but extremely strong. It says that the nonequilibrium correction is a covariance-type signal built from the skew channel after whitening by the detailed-balance Hessian. The dissipative sector therefore enters twice.

First, it provides the detailed-balance backbone H0H_{0}. Second, it defines the metric in which the skew contribution is whitened and measured. At the level of currents and affinities, the cycle origin of this skew contribution is the same identified in Schnakenberg network theory and its fluctuation-theorem extension [30, 31].

To put the operator in its most transparent form, we diagonalise the detailed-balance backbone. Since H0H_{0} is real symmetric positive definite, there exists an orthogonal matrix UU and positive eigenvalues

0<μ1μ2μn10<\mu_{1}\leq\mu_{2}\leq\cdots\leq\mu_{n-1} (3.30)

such that

H0=Udiag(μ1,,μn1)UT.H_{0}=U\,\mathrm{diag}(\mu_{1},\dots,\mu_{n-1})\,U^{T}. (3.31)

In this basis the weighted signal operator is

ADV=U(UTJ^U)diag(μ11/2,,μn11/2)UT.A_{DV}=U\,(U^{T}\widehat{J}U)\,\mathrm{diag}(\mu_{1}^{-1/2},\dots,\mu_{n-1}^{-1/2})\,U^{T}. (3.32)

Thus the visible nonequilibrium signal is obtained by taking the skew sector in the eigenbasis of the detailed-balance Hessian and weighting each channel by the inverse square root of the corresponding detailed-balance stiffness.

This observation is the structural source of the stable-rank and envelope theory developed in Section 4. The relevant quantity is not the raw skew operator by itself. It is the skew operator after whitening by the detailed-balance geometry.

The factorisation also makes clear how the theory refines the unweighted signal picture. In the unweighted Euclidean setting, singular-energy retention is attached directly to an input operator. Here the physically relevant input operator is not J^\widehat{J} alone but its Hessian-whitened version ADVA_{DV}. The unweighted theory therefore appears as the unweighted shadow of the final weighted theory.

3.4 Slow observable block and converter structure

We now make precise the slow-block structure that underlies projection suppression and explains the intrinsic-slow and mixed-return channels.

Fix a rank-dd observable projector Π\Pi and identify its range U=RanΠU=\operatorname{Ran}\Pi with the slow observable sector. For the block formula below we assume that UU is H0H_{0}-invariant, equivalently that Π\Pi commutes with H0H_{0}. In physical terms, this means that the observed sector is aligned with detailed-balance relaxation modes, so the backbone is block diagonal across observed and hidden directions. Let UU^{\perp} denote its orthogonal complement in the reduced Euclidean space. Relative to the decomposition

n1=UU,\mathbb{R}^{n-1}=U\oplus U^{\perp}, (3.33)

write

H0=(H0,S00H0,F),J^=(JSSJSFJFSJFF).H_{0}=\begin{pmatrix}H_{0,S}&0\\ 0&H_{0,F}\end{pmatrix},\qquad\widehat{J}=\begin{pmatrix}J_{SS}&J_{SF}\\ J_{FS}&J_{FF}\end{pmatrix}. (3.34)

The notation SS stands for slow or observed, while FF stands for fast or hidden. The block diagonal form of H0H_{0} is the content of the H0H_{0}-invariance assumption. Since J^\widehat{J} is skew-symmetric, its blocks satisfy

JSS=JSST,JFF=JFFT,JFS=JSFT.J_{SS}=-J_{SS}^{T},\qquad J_{FF}=-J_{FF}^{T},\qquad J_{FS}=-J_{SF}^{T}. (3.35)

The quadraticity theorem then gives a decomposition of the observed nonequilibrium correction on such spectral observable sectors.

Theorem 3.5 (Exact block formula on H0H_{0}-invariant observed sectors).

Assume that the observable sector U=RanΠU=\operatorname{Ran}\Pi is H0H_{0}-invariant. With notation as above, the slow observable block of the nonequilibrium correction is

(ΔDV)SS=14JSSH0,S1JSST+14JSFH0,F1JSFT.(\Delta_{DV})_{SS}=\frac{1}{4}\,J_{SS}H_{0,S}^{-1}J_{SS}^{T}+\frac{1}{4}\,J_{SF}H_{0,F}^{-1}J_{SF}^{T}. (3.36)

Equivalently, relative to the chosen H0H_{0}-adapted block decomposition UUU\oplus U^{\perp}, the observed correction splits into an intrinsic slow block and a hidden-return block from the complementary sector.

Proof.

Block-decompose the quadraticity formula of Theorem 3.2 relative to the orthogonal splitting UUU\oplus U^{\perp}. Because UU is H0H_{0}-invariant, H0H_{0} is block diagonal in the chosen basis, hence so is H01H_{0}^{-1}. The (S,S)(S,S)-block of

J^H01J^T\widehat{J}\,H_{0}^{-1}\widehat{J}^{T} (3.37)

is therefore exactly

JSSH0,S1JSST+JSFH0,F1JSFT.J_{SS}H_{0,S}^{-1}J_{SS}^{T}+J_{SF}H_{0,F}^{-1}J_{SF}^{T}. (3.38)

Multiplying by 1/41/4 gives the result. ∎

Theorem 3.5 is the precise algebraic form of the observed block structure on H0H_{0}-adapted sectors. The invariant observable object is the compressed correction ΠΔDVΠ\Pi\Delta_{DV}\Pi. Relative to the chosen H0H_{0}-adapted splitting, the first term is the intrinsic slow correction generated entirely within the observed sector, while the second term is the hidden return from complementary directions into the observed sector, weighted by the inverse stiffness of the fast detailed-balance backbone. For a general non-H0H_{0}-invariant projector one still has the compressed correction ΠΔDVΠ\Pi\Delta_{DV}\Pi, but not this simple block formula.

This formula is already enough to recover the structural content of projection suppression under slow-fast structural hypotheses. If the slow skew block is weak and the mixed return channel is either weak or heavily penalised by a stiff fast backbone, then the observed correction is small. But now this is no longer a theorem about disappearance under an external list of assumptions. It is the direct block-level anatomy of the correction.

The converter formula also reveals the correct physical interpretation of the fast backbone. A large fast detailed-balance stiffness suppresses the mixed return channel because the hidden sector becomes expensive as a route for observable nonequilibrium correction. This is the direct finite-dimensional mechanism behind fast-block coercivity.

We record the most basic consequence.

Corollary 3.6 (Fast-block coercive bound).

Assume that the fast detailed-balance block satisfies

H0,FμFIH_{0,F}\succeq\mu_{F}I (3.39)

for some μF>0\mu_{F}>0. Then

14JSFH0,F1JSFT14μFJSFJSFT.\frac{1}{4}\,J_{SF}H_{0,F}^{-1}J_{SF}^{T}\preceq\frac{1}{4\mu_{F}}\,J_{SF}J_{SF}^{T}. (3.40)

In particular, the mixed return channel is suppressed by increasing fast-sector coercivity.

Proof.

Since H0,FμFIH_{0,F}\succeq\mu_{F}I, one has H0,F1μF1IH_{0,F}^{-1}\preceq\mu_{F}^{-1}I. Conjugating by JSFJ_{SF} preserves positive-semidefinite order and yields the claim. ∎

Corollary 3.6 is intentionally elementary. The point is not to optimise constants here. The point is to expose the mechanism. The fast hidden sector suppresses observable nonequilibrium not by magic, but because the bridge weights hidden return channels by the inverse fast detailed-balance stiffness.

3.5 Interpretation

Section 3 identifies the nonequilibrium correction as a positive weighted correction operator carried by the skew channel and generated by the weighted signal operator whitened by the detailed-balance backbone.

This changes the logic of the entire theory. Once

ΔDV=14ADVADVT\Delta_{DV}=\frac{1}{4}\,A_{DV}A_{DV}^{T} (3.41)

is known, finite observation becomes a problem of signal retention under orthogonal compression. The observer does not interact directly with the full generator, nor with the full rate function, but with a positive signal operator whose singular-energy content can be tracked.

Structural suppression and unweighted comparison can now be re-read from this point of view. Observable structure collapses to a projected normal form once the nonequilibrium correction becomes negligible under compression, and the singular-value mechanism behind optimal retention and rank-limited visibility becomes exact once the bridge theorem identifies the correct weighted signal operator.

The next section turns that signal into the observable envelope, the retention hierarchy, and the stable-rank complexity measure governing finite observation within the orthogonal-observer class.

In this form the finite-observation anatomy can be read cleanly in four layers. The algebraic source of the correction is the reduced skew channel J^\widehat{J}. The signal actually compressed by finite observation is the backbone-weighted operator ADV=J^H01/2A_{DV}=\widehat{J}H_{0}^{-1/2}. On H0H_{0}-adapted observed sectors, the hidden contribution appears explicitly through the mixed return block 14JSFH0,F1JSFT\tfrac{1}{4}J_{SF}H_{0,F}^{-1}J_{SF}^{T}. At fixed observable rank dd, the optimally hidden budget is the singular-energy tail of ADVA_{DV}, while statistical detectability after whitening is governed by a second spectrum and should not be conflated with raw visible mass.

4  The observable envelope

4.1 Visible nonequilibrium signal of a finite observer

Section 3 identified the nonequilibrium correction as the positive signal operator

ΔDV=14ADVADVT,ADV:=J^H01/2.\Delta_{DV}=\frac{1}{4}\,A_{DV}A_{DV}^{T},\qquad A_{DV}:=\widehat{J}\,H_{0}^{-1/2}. (4.1)

We now solve the finite observation problem for this signal. This section is about raw visibility: how much nonequilibrium signal survives rank-constrained orthogonal compression, how much is hidden in the spectral tail, and how the observation budget should be allocated across decoupled sectors. Statistical distinguishability relative to the detailed-balance backbone is a different question and is deferred deliberately to Section 6.

Let Π\Pi be a rank-dd orthogonal projector on the reduced Euclidean Fisher space. The observer sees only the compression of ΔDV\Delta_{DV} to the dd-dimensional sector U=RanΠU=\operatorname{Ran}\Pi. The natural scalar measure of visible nonequilibrium content is therefore

VΠDV:=tr(ΠΔDVΠ).V_{\Pi}^{DV}:=\operatorname{tr}(\Pi\Delta_{DV}\Pi). (4.2)

This quantity is the observable nonequilibrium signal retained by Π\Pi. It is the total projected singular energy of the DV correction that survives finite observation.

The first theorem of the section shows that VΠDVV_{\Pi}^{DV} has an exact projector formula.

Theorem 4.1 (Exact projector formula for orthogonal observers).

For every orthogonal projector Π\Pi on the reduced Euclidean Fisher space,

VΠDV=tr(ΠΔDVΠ)=14ΠADVF2.V_{\Pi}^{DV}=\operatorname{tr}(\Pi\Delta_{DV}\Pi)=\frac{1}{4}\,\|\Pi A_{DV}\|_{F}^{2}. (4.3)

Equivalently, the visible nonequilibrium content retained by Π\Pi is the projected Frobenius energy of the weighted signal operator ADVA_{DV} within the orthogonal-observer class fixed in this paper.

Proof.

Using the exact weighted Gram form from Theorem 3.2,

ΔDV=14ADVADVT.\Delta_{DV}=\frac{1}{4}\,A_{DV}A_{DV}^{T}. (4.4)

Hence

VΠDV=tr(ΠΔDVΠ)=14tr(ΠADVADVTΠ).V_{\Pi}^{DV}=\operatorname{tr}\!\left(\Pi\Delta_{DV}\Pi\right)=\frac{1}{4}\,\operatorname{tr}\!\left(\Pi A_{DV}A_{DV}^{T}\Pi\right). (4.5)

Since Π\Pi is an orthogonal projector,

tr(ΠADVADVTΠ)=tr((ΠADV)T(ΠADV))=ΠADVF2.\operatorname{tr}\!\left(\Pi A_{DV}A_{DV}^{T}\Pi\right)=\operatorname{tr}\!\left((\Pi A_{DV})^{T}(\Pi A_{DV})\right)=\|\Pi A_{DV}\|_{F}^{2}. (4.6)

This gives the claimed formula. ∎

{remarkbox}
Remark (Orthogonal-basis invariance of visible signal).

Under an orthogonal change of reduced Euclidean Fisher basis, ADVOADVA_{DV}\mapsto OA_{DV} and ΠOΠOT\Pi\mapsto O\Pi O^{T}, the value VΠDVV_{\Pi}^{DV} is unchanged. Thus the visible signal is an invariant of the orthogonal observer class, not of a particular coordinate representative.

Theorem 4.1 is the first answer to the finite observation question. Once the bridge has been closed, the visible nonequilibrium signal of an orthogonal observer is no longer a vague statement about how much correction survives. It is a projected energy.

This theorem also turns finite observation into an optimisation problem over rank-constrained subspaces. The next subsection solves that problem.

4.2 Optimal retained signal at fixed observable dimension

Fix an observable dimension dd. Among all rank-dd orthogonal projectors, some will retain very little of the DV signal, while others will retain as much as possible. The optimal value is given by the Ky Fan top-singular-energy envelope of ADVA_{DV} [32, 34].

Let

s1(ADV)s2(ADV)sn1(ADV)0s_{1}(A_{DV})\geq s_{2}(A_{DV})\geq\cdots\geq s_{n-1}(A_{DV})\geq 0 (4.7)

denote the singular values of ADVA_{DV}, counted with multiplicity and extended by zeros if needed. Define

KdDV:=suprankΠ=dVΠDV.K_{d}^{DV}:=\sup_{\operatorname{rank}\Pi=d}V_{\Pi}^{DV}. (4.8)
Theorem 4.2 (Exact weighted Ky Fan envelope for orthogonal rank-dd observers).

For each d{0,1,,n1}d\in\{0,1,\dots,n-1\}, among orthogonal rank-dd projectors on the reduced Euclidean Fisher space,

KdDV=14k=1dsk(ADV)2.K_{d}^{DV}=\frac{1}{4}\sum_{k=1}^{d}s_{k}(A_{DV})^{2}. (4.9)

The supremum is attained by the orthogonal projector onto the span of the top dd left singular vectors of ADVA_{DV}. This is a global optimum over the orthogonal rank-constrained observer class fixed in the paper.

Proof.

By Theorem 4.1,

VΠDV=14ΠADVF2.V_{\Pi}^{DV}=\frac{1}{4}\,\|\Pi A_{DV}\|_{F}^{2}. (4.10)

Write the singular value decomposition

ADV=UΣVT,A_{DV}=U\Sigma V^{T}, (4.11)

where Σ=diag(s1,,sn1)\Sigma=\mathrm{diag}(s_{1},\dots,s_{n-1}). Since left multiplication by an orthogonal matrix preserves projector rank and Frobenius norm, maximising ΠADVF2\|\Pi A_{DV}\|_{F}^{2} over rank-dd projectors is equivalent to maximising Π~ΣF2\|\widetilde{\Pi}\Sigma\|_{F}^{2}, where Π~=UTΠU\widetilde{\Pi}=U^{T}\Pi U is again a rank-dd orthogonal projector.

The quantity Π~ΣF2\|\widetilde{\Pi}\Sigma\|_{F}^{2} is the sum of the squares of the singular values weighted by the diagonal entries selected by the projector. By the Ky Fan maximum principle and its modern matrix-analytic formulation [32, 34], the maximum is obtained by projecting onto the span of the first dd coordinate directions, giving

suprankΠ=dΠADVF2=k=1dsk(ADV)2.\sup_{\operatorname{rank}\Pi=d}\|\Pi A_{DV}\|_{F}^{2}=\sum_{k=1}^{d}s_{k}(A_{DV})^{2}. (4.12)

Multiplying by 1/41/4 yields the result. ∎

Proposition 4.3 (Lipschitz stability of the envelope values).

Let Δ\Delta and Δ\Delta^{\prime} be positive semidefinite corrections on the same reduced Euclidean Fisher space, and let Kd(Δ)K_{d}(\Delta) and Kd(Δ)K_{d}(\Delta^{\prime}) denote the corresponding orthogonal rank-dd envelopes. Then for every dd,

|Kd(Δ)Kd(Δ)|k=1d|λk(Δ)λk(Δ)|dΔΔop.|K_{d}(\Delta)-K_{d}(\Delta^{\prime})|\leq\sum_{k=1}^{d}|\lambda_{k}(\Delta)-\lambda_{k}(\Delta^{\prime})|\leq d\,\|\Delta-\Delta^{\prime}\|_{op}. (4.13)

In particular, the envelope values are stable under operator perturbation.

Proof.

By the Ky Fan maximum principle [32, 34], Kd(Δ)=k=1dλk(Δ)K_{d}(\Delta)=\sum_{k=1}^{d}\lambda_{k}(\Delta) and similarly for Δ\Delta^{\prime}. The first inequality is immediate from termwise comparison of the ordered eigenvalue lists, and the second follows from Weyl’s bound |λk(Δ)λk(Δ)|ΔΔop|\lambda_{k}(\Delta)-\lambda_{k}(\Delta^{\prime})|\leq\|\Delta-\Delta^{\prime}\|_{op}. ∎

Theorem 4.2 is the finite-dimensional visibility law at fixed observable rank. It says that the best possible orthogonal dd-dimensional observer captures exactly the top dd singular energies of the weighted signal operator.

This identifies the optimal rank-dd orthogonal observer within the reduced Euclidean Fisher geometry. It is the observer aligned with the top singular front of the weighted signal operator.

Corollary 4.4 (Worst retained signal).

Let m=n1m=n-1 be the dimension of the reduced Euclidean Fisher space, and extend the singular-value list of ADVA_{DV} to length mm by zeros. Then the minimum visible nonequilibrium signal over rank-dd orthogonal projectors is

infrankΠ=dVΠDV=14k=md+1msk(ADV)2.\inf_{\operatorname{rank}\Pi=d}V_{\Pi}^{DV}=\frac{1}{4}\sum_{k=m-d+1}^{m}s_{k}(A_{DV})^{2}. (4.14)

In particular, if rank(ADV)md\operatorname{rank}(A_{DV})\leq m-d, then the minimum is zero.

Proof.

Apply the Ky Fan minimum principle to the positive semidefinite operator ΔDV\Delta_{DV}, or equivalently to the squared singular values of ADVA_{DV} padded by zeros to the ambient reduced dimension mm. The worst rank-dd projector retains the bottom dd singular energies. ∎

Corollary 4.4 will later be useful when we discuss generic observers, bad alignment, and visibility intervals.

4.3 Retention fraction and hidden fraction

The envelope determines not only the best retained amount, but also the fraction of the total signal that survives at observable dimension dd.

Define the total nonequilibrium signal by

KtotDV:=tr(ΔDV)=14ADVF2.K_{\mathrm{tot}}^{DV}:=\operatorname{tr}(\Delta_{DV})=\frac{1}{4}\,\|A_{DV}\|_{F}^{2}. (4.15)

For each dd, define the retention fraction

ΦdDV:=KdDVKtotDV,\Phi_{d}^{DV}:=\frac{K_{d}^{DV}}{K_{\mathrm{tot}}^{DV}}, (4.16)

whenever ADV0A_{DV}\neq 0. Then

ΦdDV=k=1dsk(ADV)2k=1n1sk(ADV)2.\Phi_{d}^{DV}=\frac{\sum_{k=1}^{d}s_{k}(A_{DV})^{2}}{\sum_{k=1}^{n-1}s_{k}(A_{DV})^{2}}. (4.17)

The complementary hidden fraction is

1ΦdDV=k>dsk(ADV)2k=1n1sk(ADV)2.1-\Phi_{d}^{DV}=\frac{\sum_{k>d}s_{k}(A_{DV})^{2}}{\sum_{k=1}^{n-1}s_{k}(A_{DV})^{2}}. (4.18)
Corollary 4.5 (Exact retention and hidden fractions for the optimal orthogonal rank-dd envelope).

Assume ADV0A_{DV}\neq 0. Then for every observable dimension dd,

ΦdDV=k=1dsk(ADV)2k=1n1sk(ADV)2,1ΦdDV=k>dsk(ADV)2k=1n1sk(ADV)2.\Phi_{d}^{DV}=\frac{\sum_{k=1}^{d}s_{k}(A_{DV})^{2}}{\sum_{k=1}^{n-1}s_{k}(A_{DV})^{2}},\qquad 1-\Phi_{d}^{DV}=\frac{\sum_{k>d}s_{k}(A_{DV})^{2}}{\sum_{k=1}^{n-1}s_{k}(A_{DV})^{2}}. (4.19)

In particular, the hidden nonequilibrium content is the singular-energy tail of the weighted signal operator.

Proof.

This is immediate from Theorem 4.2 and the definition of KtotDVK_{\mathrm{tot}}^{DV}. ∎

Corollary 4.5 shows that finite observation of nonequilibrium is a cumulative singular-energy problem. The visible share is the cumulative front, and the hidden share is the tail. The retention fraction is the fraction of the weighted DV signal retained by the best rank-dd orthogonal observer.

4.4 Weighted stable rank as the complexity invariant

The retention hierarchy of Corollary 4.5 gives rise to a natural complexity proxy for the paper.

Definition 4.6 (Weighted stable rank).

The weighted stable rank of the nonequilibrium signal is

sr(ADV):=ADVF2ADVop2=k=1n1sk(ADV)2s1(ADV)2,\operatorname{sr}(A_{DV}):=\frac{\|A_{DV}\|_{F}^{2}}{\|A_{DV}\|_{op}^{2}}=\frac{\sum_{k=1}^{n-1}s_{k}(A_{DV})^{2}}{s_{1}(A_{DV})^{2}}, (4.20)

for nonzero ADVA_{DV}.

This is the stable-rank or numerical-rank functional applied to the weighted signal operator in the geometry [35]. This quantity is the effective dimensionality of the weighted nonequilibrium signal. It measures how many singular directions are genuinely carrying signal, after weighting by the detailed-balance geometry.

If ADV=0A_{DV}=0, then ΔDV=0\Delta_{DV}=0, every envelope value KdDVK_{d}^{DV} vanishes, and the finite-observation problem is trivial because there is no nonequilibrium signal to retain.

A low stable rank means that the nonequilibrium correction is concentrated. A small number of observable directions can recover a large fraction of it. A high stable rank means that the correction is diffuse and spread across many directions. In that case, finite observers are forced to miss most of the signal unless their rank is correspondingly large.

The next theorem makes this precise.

Theorem 4.7 (Stable-rank obstruction).

Assume ADV0A_{DV}\neq 0. Then for every dd,

ΦdDVdsr(ADV).\Phi_{d}^{DV}\leq\frac{d}{\operatorname{sr}(A_{DV})}. (4.21)

Equivalently, to retain at least fraction η\eta of the nonequilibrium signal, any observer must satisfy

dηsr(ADV).d\geq\eta\,\operatorname{sr}(A_{DV}). (4.22)
Proof.

By definition of stable rank,

s1(ADV)2=k=1n1sk(ADV)2sr(ADV).s_{1}(A_{DV})^{2}=\frac{\sum_{k=1}^{n-1}s_{k}(A_{DV})^{2}}{\operatorname{sr}(A_{DV})}. (4.23)

Since the singular values are non-increasing,

k=1dsk(ADV)2ds1(ADV)2.\sum_{k=1}^{d}s_{k}(A_{DV})^{2}\leq d\,s_{1}(A_{DV})^{2}. (4.24)

Therefore

ΦdDV=k=1dsk(ADV)2k=1n1sk(ADV)2ds1(ADV)2k=1n1sk(ADV)2=dsr(ADV).\Phi_{d}^{DV}=\frac{\sum_{k=1}^{d}s_{k}(A_{DV})^{2}}{\sum_{k=1}^{n-1}s_{k}(A_{DV})^{2}}\leq\frac{d\,s_{1}(A_{DV})^{2}}{\sum_{k=1}^{n-1}s_{k}(A_{DV})^{2}}=\frac{d}{\operatorname{sr}(A_{DV})}. (4.25)

Rearranging gives the necessary rank condition for retaining at least fraction η\eta. ∎

Theorem 4.7 is the scalar obstruction governing finite observation. Weighted stable rank is a useful nonequilibrium complexity proxy, but it is not a complete descriptor of the envelope hierarchy. It gives a first-order visibility bound rather than a sufficient statistic for the full retention curve.

The literature on partial observation often organises itself around estimator performance, signal-to-noise ratio, missing transitions, or lower bounds on hidden entropy production. Those are all useful, but they do not by themselves isolate the intrinsic dimensional difficulty of the weighted nonequilibrium signal. Weighted stable rank supplies a coarse measure of that difficulty.

4.5 Sharp consequences

The envelope and stable-rank law immediately give several structural consequences in finite dimensions.

Corollary 4.8 (Observability criterion).

Assume ADV0A_{DV}\neq 0. Then the following are equivalent for a given observable dimension dd:

  1. 1.

    there exists a rank-dd orthogonal observer in the reduced Euclidean Fisher space that sees the entire nonequilibrium signal,

  2. 2.

    ΦdDV=1\Phi_{d}^{DV}=1,

  3. 3.

    drank(ADV)d\geq\operatorname{rank}(A_{DV}).

Proof.

The equality ΦdDV=1\Phi_{d}^{DV}=1 means that all nonzero singular energies are contained in the first dd modes, which is equivalent to drank(ADV)d\geq\operatorname{rank}(A_{DV}). In that case, projection onto the span of all left singular vectors with nonzero singular value retains the entire signal. ∎

Corollary 4.9 (Blind-observer threshold).

Let

r:=rank(ADV)=rank(ΔDV).r:=\operatorname{rank}(A_{DV})=\operatorname{rank}(\Delta_{DV}). (4.26)

Then a rank-dd observer can be completely blind to the nonequilibrium correction, meaning

VΠDV=0,V_{\Pi}^{DV}=0, (4.27)

if and only if

d(n1)r.d\leq(n-1)-r. (4.28)

Equivalently, a dd-dimensional blind observer exists if and only if the observable sector can be placed entirely inside ker(ΔDV)\ker(\Delta_{DV}).

Proof.

By Corollary 4.4 and the visibility interval,

infrankΠ=dVΠDV=k=(n1)d+1n1τk,\inf_{\operatorname{rank}\Pi=d}V_{\Pi}^{DV}=\sum_{k=(n-1)-d+1}^{n-1}\tau_{k}, (4.29)

where τk\tau_{k} are the eigenvalues of ΔDV\Delta_{DV} in nonincreasing order, padded by zeros. This minimum vanishes if and only if the bottom dd eigenvalues are zero, which is equivalent to

ddimker(ΔDV)=(n1)r.d\leq\dim\ker(\Delta_{DV})=(n-1)-r. (4.30)

Corollary 4.10 (One-mode visibility).

Assume ADV0A_{DV}\neq 0. Then the maximal rank-one visible fraction is

Φ1DV=1sr(ADV).\Phi_{1}^{DV}=\frac{1}{\operatorname{sr}(A_{DV})}. (4.31)

Thus the inverse stable rank is the best one-mode visibility of the nonequilibrium signal.

Proof.

By definition,

Φ1DV=s1(ADV)2k=1n1sk(ADV)2=1sr(ADV).\Phi_{1}^{DV}=\frac{s_{1}(A_{DV})^{2}}{\sum_{k=1}^{n-1}s_{k}(A_{DV})^{2}}=\frac{1}{\operatorname{sr}(A_{DV})}. (4.32)

Corollary 4.10 gives perhaps the most immediate interpretation of the weighted stable rank. It tells us how visible the nonequilibrium signal is to the best possible one-dimensional observer.

Corollary 4.11 (Envelope monotonicity and concavity).

The sequence dKdDVd\mapsto K_{d}^{DV} is non-decreasing and discretely concave:

Kd+1DVKdDVKdDVKd1DV.K_{d+1}^{DV}-K_{d}^{DV}\leq K_{d}^{DV}-K_{d-1}^{DV}. (4.33)

Equivalently, the marginal gain from increasing the observer dimension decreases monotonically with rank.

Proof.

This follows immediately from the representation

KdDV=14k=1dsk(ADV)2,K_{d}^{DV}=\frac{1}{4}\sum_{k=1}^{d}s_{k}(A_{DV})^{2}, (4.34)

since the increments are the non-increasing sequence 14sd(ADV)2\frac{1}{4}s_{d}(A_{DV})^{2}. ∎

Corollary 4.11 has a useful interpretation. The first few observable directions are the most valuable. Beyond that, one enters the diminishing-returns regime governed by the singular-energy tail.

We also note the residual form.

Corollary 4.12 (Optimal hidden tail).

The minimal hidden nonequilibrium signal after the best rank-dd observation is

KtotDVKdDV=14k>dsk(ADV)2.K_{\mathrm{tot}}^{DV}-K_{d}^{DV}=\frac{1}{4}\sum_{k>d}s_{k}(A_{DV})^{2}. (4.35)
Proof.

Subtract the envelope from the total signal. ∎

Corollary 4.12 shows that finite observation has an optimal truncation error. This will later become the basis of the spectroscopy theorem.

Proposition 4.13 (Equality in the stable-rank obstruction).

Assume ADV0A_{DV}\neq 0, and let

ak:=sk(ADV)2,a1a20.a_{k}:=s_{k}(A_{DV})^{2},\qquad a_{1}\geq a_{2}\geq\cdots\geq 0. (4.36)

Then

ΦdDVdsr(ADV)\Phi_{d}^{DV}\leq\frac{d}{\operatorname{sr}(A_{DV})} (4.37)

is an equality if and only if

a1=a2==ad.a_{1}=a_{2}=\cdots=a_{d}. (4.38)

The analogous statement holds for the detectability retained fraction after replacing ADVA_{DV} by CDV:=H01/2J^H01/2C_{DV}:=H_{0}^{-1/2}\widehat{J}H_{0}^{-1/2}.

Proof.

Since

sr(ADV)=k=1n1aka1,\operatorname{sr}(A_{DV})=\frac{\sum_{k=1}^{n-1}a_{k}}{a_{1}}, (4.39)

the stable-rank bound is equivalent to

k=1dakda1.\sum_{k=1}^{d}a_{k}\leq d\,a_{1}. (4.40)

Equality holds if and only if a1==ada_{1}=\cdots=a_{d}. The detectability statement is identical after replacing the raw signal operator by the backbone-whitened signal operator. ∎

4.6 Comparison with unweighted signal geometry

A prior unweighted analysis of rank-limited visibility in a Euclidean setting did not yet include the Donsker-Varadhan bridge or the Hessian whitening. The theory contains that picture as an unweighted shadow.

The point is simple. In the final weighted theory, the physically relevant signal is

ADV=J^H01/2,A_{DV}=\widehat{J}\,H_{0}^{-1/2}, (4.41)

not J^\widehat{J} by itself. The role of the unweighted Euclidean hierarchy is therefore to capture the same signal-retention geometry before the dissipative weighting is inserted. Once the bridge is known, the correct signal is no longer the raw skew channel but the skew channel whitened by the detailed-balance Hessian.

This relationship can be quantified directly. Let

μmin:=λmin(H0),μmax:=λmax(H0).\mu_{\min}:=\lambda_{\min}(H_{0}),\qquad\mu_{\max}:=\lambda_{\max}(H_{0}). (4.42)

Since

μmax1IH01μmin1I,\mu_{\max}^{-1}I\preceq H_{0}^{-1}\preceq\mu_{\min}^{-1}I, (4.43)

one obtains the operator inequalities

14μmaxJ^J^TΔDV14μminJ^J^T.\frac{1}{4\mu_{\max}}\,\widehat{J}\widehat{J}^{T}\preceq\Delta_{DV}\preceq\frac{1}{4\mu_{\min}}\,\widehat{J}\widehat{J}^{T}. (4.44)

Consequently, if Kd(J^)K_{d}(\widehat{J}) denotes the unweighted rank-dd singular-energy envelope attached to J^\widehat{J}, equivalently the Ky Fan envelope of 14J^J^T\tfrac{1}{4}\widehat{J}\widehat{J}^{T}, then

14μmaxKd(J^)KdDV14μminKd(J^).\frac{1}{4\mu_{\max}}\,K_{d}(\widehat{J})\leq K_{d}^{DV}\leq\frac{1}{4\mu_{\min}}\,K_{d}(\widehat{J}). (4.45)
Proposition 4.14 (Comparison with the unweighted envelope).

The weighted DV envelope is sandwiched between the old unweighted skew singular-energy envelope, scaled by the spectral window of the detailed-balance Hessian:

14μmaxKd(J^)KdDV14μminKd(J^).\frac{1}{4\mu_{\max}}\,K_{d}(\widehat{J})\leq K_{d}^{DV}\leq\frac{1}{4\mu_{\min}}\,K_{d}(\widehat{J}). (4.46)
Proof.

From

ADVADVT=J^H01J^TA_{DV}A_{DV}^{T}=\widehat{J}H_{0}^{-1}\widehat{J}^{T} (4.47)

and the positive-semidefinite order bounds on H01H_{0}^{-1}, one gets

μmax1J^J^TADVADVTμmin1J^J^T.\mu_{\max}^{-1}\,\widehat{J}\widehat{J}^{T}\preceq A_{DV}A_{DV}^{T}\preceq\mu_{\min}^{-1}\,\widehat{J}\widehat{J}^{T}. (4.48)

Multiplying by 1/41/4 gives the corresponding comparison for ΔDV\Delta_{DV}. Taking the optimal rank-dd compressed traces on both sides yields the stated envelope bounds. ∎

Proposition 4.14 is important for the internal logic of the theory. It shows that the unweighted Euclidean envelope is the unwhitened skeleton of the final weighted signal geometry, and it quantifies its precise relationship to the full theory.

At this point the finite observation problem has been solved at the level of retained amount, retained fraction, and complexity obstruction. The next section turns to the geometry of observer quality. Visible nonequilibrium becomes a question of alignment between the observer and the singular directions of the weighted signal operator.

5  Alignment, optimal observers, and generic observers

5.1 The alignment theorem

Section 4 solved the rank-constrained visibility problem at the level of optimal retained signal. We now refine that result by identifying the geometric mechanism behind observer quality.

Let

ADV=k=1rskukvkTA_{DV}=\sum_{k=1}^{r}s_{k}\,u_{k}v_{k}^{T} (5.1)

be a singular value decomposition of the weighted signal operator, where

s1s2sr>0s_{1}\geq s_{2}\geq\cdots\geq s_{r}>0 (5.2)

are the nonzero singular values, the vectors uku_{k} form an orthonormal family of left singular directions in the reduced Euclidean Fisher space, and the vectors vkv_{k} form an orthonormal family of right singular directions. The finite observation problem concerns how a rank-constrained projector Π\Pi couples to the left singular directions {uk}\{u_{k}\}, since these are the visible directions of the positive signal operator

ΔDV=14ADVADVT.\Delta_{DV}=\frac{1}{4}\,A_{DV}A_{DV}^{T}. (5.3)

The answer is given by the following theorem.

Theorem 5.1 (Alignment theorem for orthogonal observers).

For every orthogonal projector Π\Pi,

VΠDV=14k=1rsk(ADV)2Πuk2.V_{\Pi}^{DV}=\frac{1}{4}\,\sum_{k=1}^{r}s_{k}(A_{DV})^{2}\,\|\Pi u_{k}\|^{2}. (5.4)

Equivalently, the visible nonequilibrium signal retained by Π\Pi is a weighted alignment score between the observer and the left singular directions of the weighted signal operator.

Proof.

Starting from the projector formula of Theorem 4.1,

VΠDV=14ΠADVF2.V_{\Pi}^{DV}=\frac{1}{4}\,\|\Pi A_{DV}\|_{F}^{2}. (5.5)

Insert the singular value decomposition:

ΠADV=k=1rsk(Πuk)vkT.\Pi A_{DV}=\sum_{k=1}^{r}s_{k}\,(\Pi u_{k})v_{k}^{T}. (5.6)

Since the vkv_{k} form an orthonormal family, the Frobenius norm squares add:

ΠADVF2=k=1rsk2Πuk2.\|\Pi A_{DV}\|_{F}^{2}=\sum_{k=1}^{r}s_{k}^{2}\,\|\Pi u_{k}\|^{2}. (5.7)

Multiplying by 1/41/4 gives the claim. ∎

{remarkbox}
Remark (Degenerate singular subspace ambiguity in the alignment theorem).

If the singular spectrum of ADVA_{DV} has degeneracies, the left singular directions are defined only up to orthogonal rotation inside each degenerate singular subspace. The theorem should therefore be read at the level of the corresponding invariant subspace. What is canonical is the invariant subspace itself, together with the corresponding weighted sum on that subspace, not any individual basis vector inside a degenerate block.

Theorem 5.1 is one of the central structural identities of the paper. It shows that visible nonequilibrium is not determined by rank alone. Rank fixes the size of the observer, but the actual retained signal is controlled by how the observer aligns with the singular-energy front of ADVA_{DV}.

This point deserves emphasis. A poor observer need not be too small; it can be misaligned. A coarse observer can outperform a finer one if it captures a larger weighted overlap with the dominant singular directions. In the language of the partial-observation literature, observer geometry matters as much as observer size [13, 6, 7, 8, 36].

The alignment theorem also makes the finite-observation picture more precise. The singular-energy levels frac14sk(ADV)2frac14s_{k}(A_{DV})^{2} measure the available weighted signal energy in each mode, while the factors Πuk2\|\Pi u_{k}\|^{2} measure the observer’s access to those modes. The visible nonequilibrium signal is the product of these two ingredients, summed over modes.

5.2 Optimal observer design

The Ky Fan envelope theorem already identified the maximal retained signal at fixed rank. We now restate that result in the language of observer design. This is an immediate design corollary of the envelope law and the alignment formula, and it is central to the final paper.

Corollary 5.2 (Optimal orthogonal rank-dd observer).

Fix an observable dimension dd. Let

Ud:=span{u1,,ud},U_{d}^{\ast}:=\operatorname{span}\{u_{1},\dots,u_{d}\}, (5.8)

where u1,,udu_{1},\dots,u_{d} are the top dd left singular directions of ADVA_{DV}. Let Πd\Pi_{d}^{\ast} be the orthogonal projector onto UdU_{d}^{\ast}. Then

VΠdDV=KdDV,V_{\Pi_{d}^{\ast}}^{DV}=K_{d}^{DV}, (5.9)

and Πd\Pi_{d}^{\ast} is an optimal rank-dd observer.

If the singular value sd(ADV)s_{d}(A_{DV}) is strictly larger than sd+1(ADV)s_{d+1}(A_{DV}), then UdU_{d}^{\ast} is uniquely determined. More generally, let σ:=sd(ADV)\sigma_{\ast}:=s_{d}(A_{DV}). Every optimal orthogonal rank-dd observer must contain the full direct sum of left-singular eigenspaces with singular value strictly larger than σ\sigma_{\ast}, and the remaining dimension may be chosen arbitrarily inside the eigenspace for σ\sigma_{\ast}. This is the only freedom coming from degeneracy.

Proof.

By Theorem 4.2, the optimal retained signal at rank dd is

KdDV=14k=1dsk(ADV)2.K_{d}^{DV}=\frac{1}{4}\sum_{k=1}^{d}s_{k}(A_{DV})^{2}. (5.10)

For the projector Πd\Pi_{d}^{\ast}, one has

Πduk={uk,1kd,0,k>d\Pi_{d}^{\ast}u_{k}=\begin{cases}u_{k},&1\leq k\leq d,\\ 0,&k>d\end{cases} (5.11)

when there is no degeneracy across the dd-th cutoff, and the alignment theorem then gives

VΠdDV=14k=1dsk(ADV)2=KdDV.V_{\Pi_{d}^{\ast}}^{DV}=\frac{1}{4}\sum_{k=1}^{d}s_{k}(A_{DV})^{2}=K_{d}^{DV}. (5.12)

The uniqueness statement is standard from the Ky Fan maximum principle [32, 34]. If the cutoff singular value is isolated, the top dd-dimensional left singular subspace is unique. If there is degeneracy, every optimal dd-plane must contain the full direct sum of left-singular eigenspaces with singular value strictly larger than the cutoff, and only the remaining dimension is free inside the eigenspace at the cutoff. This is exactly the equality case in the Ky Fan principle [32, 34]. ∎

Corollary 5.2 identifies the best orthogonal finite observer for nonequilibrium detection in the Gaussian fluctuation setting.

Most recent work asks how much irreversibility can be inferred from a given partial observation scheme [5, 13, 6, 7, 36]. The corollary answers the stronger question within the orthogonal rank-constrained class: for a fixed observational budget dd, which observable sector retains the most nonequilibrium signal? The answer is at the level of optimal value, and unique at the subspace level only when the cutoff spectral gap is open.

Corollary 4.4 gives the complementary minimum retained signal at fixed rank. Finite observation therefore comes with both a best observer and a worst observer, and the spread between them is the first visibility interval for the DV correction.

{remarkbox}
Remark (Gap-dependent subspace stability).

The optimal value is stable under perturbation by Proposition 4.3, but the optimal subspace is stable only when the cutoff spectral gap sd(ADV)sd+1(ADV)s_{d}(A_{DV})-s_{d+1}(A_{DV}) is positive. In the gapless case the optimal value remains stable, while the optimal dd-plane need not be unique.

5.3 Worst-case and generic observation

The best and worst rank-dd observers define the two extremes of finite observation at fixed observable dimension. Between those extremes lies the generic case. We now identify the natural baseline for generic observation.

Let

m:=n1m:=n-1 (5.13)

be the dimension of the reduced Euclidean Fisher space. A rank-dd orthogonal projector Π\Pi is called Haar-random if its range is distributed uniformly on the Grassmannian Gr(d,m)\mathrm{Gr}(d,m). Such a projector is the natural model for an unstructured observer of dimension dd.

The following proposition gives the generic baseline in expectation.

Proposition 5.3 (Haar-random orthogonal-observer baseline in expectation).

Let Π\Pi be Haar-random among rank-dd orthogonal projectors on the mm-dimensional reduced Euclidean Fisher space. Then

𝔼[Π]=dmI,\mathbb{E}[\Pi]=\frac{d}{m}\,I, (5.14)

and therefore

𝔼[VΠDV]=dmKtotDV=dm14ADVF2.\mathbb{E}[V_{\Pi}^{DV}]=\frac{d}{m}\,K_{\mathrm{tot}}^{DV}=\frac{d}{m}\,\frac{1}{4}\|A_{DV}\|_{F}^{2}. (5.15)

Equivalently, the expected retained fraction of a random rank-dd observer is exactly

𝔼[VΠDVKtotDV]=dm.\mathbb{E}\!\left[\frac{V_{\Pi}^{DV}}{K_{\mathrm{tot}}^{DV}}\right]=\frac{d}{m}. (5.16)

Moreover, for each singular direction uku_{k},

𝔼[Πuk2]=dm.\mathbb{E}[\|\Pi u_{k}\|^{2}]=\frac{d}{m}. (5.17)
Proof.

By orthogonal invariance of the Haar measure on the Grassmannian, 𝔼[Π]\mathbb{E}[\Pi] commutes with every orthogonal transformation of m\mathbb{R}^{m}. Therefore 𝔼[Π]=cI\mathbb{E}[\Pi]=cI for some scalar cc. Taking traces gives

cm=tr(𝔼[Π])=𝔼[tr(Π)]=d,cm=\operatorname{tr}(\mathbb{E}[\Pi])=\mathbb{E}[\operatorname{tr}(\Pi)]=d, (5.18)

so c=d/mc=d/m. Hence

𝔼[Π]=dmI.\mathbb{E}[\Pi]=\frac{d}{m}I. (5.19)

Using the projector formula from Theorem 4.1,

𝔼[VΠDV]=14𝔼[tr(ΠADVADVT)]=14tr(𝔼[Π]ADVADVT).\mathbb{E}[V_{\Pi}^{DV}]=\frac{1}{4}\,\mathbb{E}[\operatorname{tr}(\Pi A_{DV}A_{DV}^{T})]=\frac{1}{4}\,\operatorname{tr}(\mathbb{E}[\Pi]A_{DV}A_{DV}^{T}). (5.20)

Substituting 𝔼[Π]=dmI\mathbb{E}[\Pi]=\frac{d}{m}I gives

𝔼[VΠDV]=14dmtr(ADVADVT)=dmKtotDV.\mathbb{E}[V_{\Pi}^{DV}]=\frac{1}{4}\,\frac{d}{m}\operatorname{tr}(A_{DV}A_{DV}^{T})=\frac{d}{m}\,K_{\mathrm{tot}}^{DV}. (5.21)

Dividing by KtotDVK_{\mathrm{tot}}^{DV} yields the expected retained fraction. Finally, since

Πuk2=ukTΠuk,\|\Pi u_{k}\|^{2}=u_{k}^{T}\Pi u_{k}, (5.22)

one has

𝔼[Πuk2]=ukT𝔼[Π]uk=dmuk2=dm.\mathbb{E}[\|\Pi u_{k}\|^{2}]=u_{k}^{T}\mathbb{E}[\Pi]u_{k}=\frac{d}{m}\|u_{k}\|^{2}=\frac{d}{m}. (5.23)

Proposition 5.3 gives the generic visibility benchmark in expectation. A random rank-dd observer retains a fraction d/md/m on average. That number is purely geometric. It does not depend on the particular generator or the singular spectrum of ADVA_{DV}. It is the baseline visibility of unstructured finite observation. No concentration or high-probability claim is being made here.

This baseline will be central for interpretation. If an actual observer performs only at the d/md/m level, then it is no better than random geometry. If it performs substantially above that level, then it is aligned with the singular-energy front of the signal. If it performs substantially below the optimum, then there is room for observer redesign.

The literature has already encountered phenomena of this type indirectly. In coarse-graining and milestoning studies, some observation maps outperform others in ways that can seem paradoxical if one thinks only in terms of coarser versus finer observation [13]. The random-observer baseline clarifies the structural issue: generic observation has a fixed geometric retention level, and exceptional performance reflects alignment rather than raw resolution.

5.4 Alignment gain

The optimal retained fraction from Section 4 and the random-observer baseline from Theorem 5.3 together define the central quality measure of finite observation.

Definition 5.4 (Alignment gain).

Assume ADV0A_{DV}\neq 0. For observable dimension dd, define the alignment gain

𝒜d:=ΦdDVd/m.\mathcal{A}_{d}:=\frac{\Phi_{d}^{DV}}{d/m}. (5.24)

Equivalently,

𝒜d=mdk=1dsk(ADV)2k=1msk(ADV)2.\mathcal{A}_{d}=\frac{m}{d}\,\frac{\sum_{k=1}^{d}s_{k}(A_{DV})^{2}}{\sum_{k=1}^{m}s_{k}(A_{DV})^{2}}. (5.25)

Thus 𝒜d\mathcal{A}_{d} measures how much better the optimal rank-dd observer is than a generic rank-dd observer. It is the multiplicative benefit of observer design over random finite observation.

The first basic bounds are immediate.

Proposition 5.5 (Alignment-gain bounds).

Assume ADV0A_{DV}\neq 0. Then for every observable dimension dd,

1𝒜dmsr(ADV).1\leq\mathcal{A}_{d}\leq\frac{m}{\operatorname{sr}(A_{DV})}. (5.26)

In particular, the optimal observer always performs at least as well as the random baseline, and the maximal possible advantage is controlled by the inverse weighted complexity of the signal.

Proof.

For the lower bound, let

ak:=sk(ADV)2,a1a2am0.a_{k}:=s_{k}(A_{DV})^{2},\qquad a_{1}\geq a_{2}\geq\cdots\geq a_{m}\geq 0. (5.27)

Then the average of the top dd terms is at least the average of all mm terms:

1dk=1dak1mk=1mak.\frac{1}{d}\sum_{k=1}^{d}a_{k}\geq\frac{1}{m}\sum_{k=1}^{m}a_{k}. (5.28)

Rearranging gives

k=1dakk=1makdm,\frac{\sum_{k=1}^{d}a_{k}}{\sum_{k=1}^{m}a_{k}}\geq\frac{d}{m}, (5.29)

that is,

ΦdDVdm.\Phi_{d}^{DV}\geq\frac{d}{m}. (5.30)

Hence 𝒜d1\mathcal{A}_{d}\geq 1.

For the upper bound, Theorem 4.7 gives

ΦdDVdsr(ADV).\Phi_{d}^{DV}\leq\frac{d}{\operatorname{sr}(A_{DV})}. (5.31)

Dividing by d/md/m yields

𝒜dmsr(ADV).\mathcal{A}_{d}\leq\frac{m}{\operatorname{sr}(A_{DV})}. (5.32)

Proposition 5.5 shows that alignment gain is a true quality measure. It is always at least one, because design can never be worse than random choice on average. It is large when the signal is concentrated and therefore strongly rewardable by alignment. It collapses toward one when the signal is diffuse and therefore little is gained by design over generic observation. A large post-cutoff singular-value gap therefore makes the optimal observer robust, while a flat spectrum pushes 𝒜d\mathcal{A}_{d} toward one and makes observer choice less consequential.

This gives another interpretation of weighted stable rank. A high stable-rank signal is not only difficult to see. It is also difficult to exploit by observer design. There is little alignment advantage available because the signal is spread broadly. A low stable-rank signal offers both strong visibility and large design gains.

It is also useful to record the rank-one case.

Corollary 5.6 (Rank-one alignment gain).

Assume ADV0A_{DV}\neq 0. For d=1d=1,

𝒜1=msr(ADV).\mathcal{A}_{1}=\frac{m}{\operatorname{sr}(A_{DV})}. (5.33)

Thus the one-dimensional design gain is the ambient reduced dimension divided by the weighted stable rank of the signal.

Proof.

By Corollary 4.10,

Φ1DV=1sr(ADV).\Phi_{1}^{DV}=\frac{1}{\operatorname{sr}(A_{DV})}. (5.34)

Since the random baseline at rank one is 1/m1/m, the claim follows immediately. ∎

Corollary 5.6 is especially sharp. It says that the whole one-mode design problem collapses to a single ratio: ambient reduced dimension divided by weighted stable rank.

5.5 Interpretation for the literature

The results of this section explain something that has remained somewhat implicit in the recent partial-observation literature. Many papers study finite resolution, hidden transitions, unresolved events, faulty coarse graining, or partial access, and ask why some observation schemes detect irreversibility better than others [5, 13, 6, 7, 8]. The usual language is framed in terms of better estimators, lower bounds, waiting-time information, or resolution trade-offs. Those are real and important. But they do not yet isolate the geometric core.

The theory says that the core issue is alignment with the weighted signal operator. A coarse-graining can outperform a finer observation if it is better aligned with the dominant left singular directions of ADVA_{DV}. Conversely, increasing raw observational resolution may fail to help if the additional directions do not couple strongly to the singular front of the nonequilibrium signal. In that sense, the relevant distinction is not simply coarse versus fine. It is alignment versus misalignment.

This perspective also clarifies the meaning of generic observation. Absent design or structural knowledge, a rank-dd observer retains on average only the baseline fraction d/md/m. Anything above that reflects nontrivial alignment. The gap between ΦdDV\Phi_{d}^{DV} and d/md/m is therefore not just a mathematical curiosity. It quantifies the advantage of informed observation over blind compression.

The section also changes the status of the finite observation programme itself. Up to this point, one could read the theory mainly as a structural suppression law. After the alignment theorem and the random-observer baseline, that is no longer adequate. The theory has become a design theory. It tells us not only what finite observers lose, but which finite observers are best, how much better they are than generic observers, and what geometric property of the signal makes that possible.

The next section introduces the shadow operator, which compares the visible nonequilibrium correction with the projected detailed-balance backbone and yields the Gaussian distinguishability theory.

6  The shadow operator and Gaussian distinguishability

6.1 Projected backbone and projected correction

Sections 3, 4, and 5 identified the weighted nonequilibrium signal, solved the rank-constrained visibility problem, and showed how observer quality is controlled by spectral alignment. What remains is to turn that visibility law into a statistical statement about what a finite observer can and cannot distinguish.

This is the point where the paper splits raw visibility from detectability. A direction can carry substantial visible nonequilibrium mass and yet be comparatively weak as a discriminator once the detailed-balance backbone is used as the local metric. Conversely, a direction that is not optimal for raw visible mass can become optimal after backbone normalisation. The observer enters this second problem twice: once through the projected nonequilibrium correction and once through the projected backbone. Raw visibility is therefore already measured in global detailed-balance units through the H01/2H_{0}^{-1/2} weighting, whereas detectability renormalises after projection in the local equilibrium units of the observed sector. The operator introduced below is the exact object that measures this second question.

Fix a rank-dd orthogonal projector Π\Pi on the reduced Euclidean Fisher space, and let

U:=RanΠ.U:=\operatorname{Ran}\Pi. (6.1)

The observed detailed-balance backbone is the compression of H0H_{0} to UU, while the observed nonequilibrium correction is the compression of ΔDV\Delta_{DV} to the same sector. Concretely, define

BΠ:=ΠH0Π|U,EΠ:=ΠΔDVΠ|U.B_{\Pi}:=\Pi H_{0}\Pi|_{U},\qquad E_{\Pi}:=\Pi\Delta_{DV}\Pi|_{U}. (6.2)

The observed Donsker-Varadhan Hessian is therefore

HΠ:=Π(H0+ΔDV)Π|U=BΠ+EΠ.H_{\Pi}:=\Pi(H_{0}+\Delta_{DV})\Pi|_{U}=B_{\Pi}+E_{\Pi}. (6.3)

Since H0H_{0} is positive definite on the full reduced space, its restriction to any nonzero subspace is positive definite. Thus BΠB_{\Pi} is positive definite on UU. Since ΔDV\Delta_{DV} is positive semidefinite by Theorem 3.2, its compression EΠE_{\Pi} is positive semidefinite on UU. The observed nonequilibrium law therefore differs from the observed detailed-balance law by a positive fluctuation correction on the same finite-dimensional observable sector.

This is the correct starting point for the equilibrium-shadow theorem. The question is not simply whether EΠE_{\Pi} is small in an absolute sense. The real question is how large it is relative to the observed detailed-balance backbone BΠB_{\Pi}. That relative object is introduced next.

6.2 The shadow operator

The observed nonequilibrium correction should be compared to the observed detailed-balance backbone in the natural backbone metric. This leads to the central operator of the section.

Definition 6.1 (Shadow operator).

The shadow operator associated with the observer Π\Pi is

SΠ:=BΠ1/2EΠBΠ1/2.S_{\Pi}:=B_{\Pi}^{-1/2}E_{\Pi}B_{\Pi}^{-1/2}. (6.4)

The shadow operator is positive semidefinite on UU, and it is the observable measure of nonequilibrium fluctuation strength after normalising by the detailed-balance backbone. It is therefore the correct mathematical form of the equilibrium shadow.

Proposition 6.2 (Backbone factorisation).

For every rank-dd orthogonal projector Π\Pi,

HΠ=BΠ1/2(I+SΠ)BΠ1/2.H_{\Pi}=B_{\Pi}^{1/2}(I+S_{\Pi})B_{\Pi}^{1/2}. (6.5)

In particular, the observed nonequilibrium Hessian is a positive perturbation of the observed detailed-balance Hessian by the shadow operator.

Proof.

By definition,

EΠ=BΠ1/2SΠBΠ1/2.E_{\Pi}=B_{\Pi}^{1/2}S_{\Pi}B_{\Pi}^{1/2}. (6.6)

Therefore

HΠ=BΠ+EΠ=BΠ+BΠ1/2SΠBΠ1/2=BΠ1/2(I+SΠ)BΠ1/2.H_{\Pi}=B_{\Pi}+E_{\Pi}=B_{\Pi}+B_{\Pi}^{1/2}S_{\Pi}B_{\Pi}^{1/2}=B_{\Pi}^{1/2}(I+S_{\Pi})B_{\Pi}^{1/2}. (6.7)

Proposition 6.2 is the algebraic form of the shadow picture. The observed nonequilibrium fluctuation law is obtained from the observed detailed-balance backbone by inserting the positive dimensionless perturbation SΠS_{\Pi}.

We next connect this to Gaussian fluctuation laws.

6.3 Exact observed Gaussian laws

Throughout Sections 6 and 8, the observed Gaussian law on UU means the centred Gaussian law induced by the compressed quadratic fluctuation form on UU, with precision BΠB_{\Pi} in the detailed-balance case and HΠ=BΠ+EΠH_{\Pi}=B_{\Pi}+E_{\Pi} in the nonequilibrium case. This is the local compressed-Hessian observation model fixed by the paper. It is not, unless explicitly stated otherwise, a theorem about arbitrary nonlinear measurement marginals or full path-space observations.

At the quadratic fluctuation level, the observed detailed-balance and observed nonequilibrium laws on UU are centred Gaussian measures with precisions

HDB,Π=BΠ,HNESS,Π=HΠ=BΠ+EΠ.H_{DB,\Pi}=B_{\Pi},\qquad H_{NESS,\Pi}=H_{\Pi}=B_{\Pi}+E_{\Pi}. (6.8)

Their covariance operators are therefore

ΣDB,Π=BΠ1,ΣNESS,Π=HΠ1.\Sigma_{DB,\Pi}=B_{\Pi}^{-1},\qquad\Sigma_{NESS,\Pi}=H_{\Pi}^{-1}. (6.9)

Using Proposition 6.2, the nonequilibrium covariance can be written as

ΣNESS,Π=BΠ1/2(I+SΠ)1BΠ1/2.\Sigma_{NESS,\Pi}=B_{\Pi}^{-1/2}(I+S_{\Pi})^{-1}B_{\Pi}^{-1/2}. (6.10)

Thus every Gaussian distinguishability quantity on the observed sector is a spectral function of the shadow operator. This is the decisive statistical simplification. The observed detailed-balance backbone has been factored out completely, and the remaining difference between the two observable Gaussian laws is encoded entirely by SΠS_{\Pi}.

We now write the principal divergences explicitly. Throughout, total variation is defined by

TV(P,Q):=12PQ1,\operatorname{TV}(P,Q):=\tfrac{1}{2}\|P-Q\|_{1}, (6.11)

and the squared Hellinger distance is defined by

H2(P,Q):=1dPdλdQdλdλ,H^{2}(P,Q):=1-\int\sqrt{\frac{\mathrm{d}P}{\mathrm{d}\lambda}\frac{\mathrm{d}Q}{\mathrm{d}\lambda}}\,\mathrm{d}\lambda, (6.12)

for any common dominating measure λ\lambda.

Theorem 6.3 (Exact Gaussian comparison formulas).

Let λ1,,λd\lambda_{1},\dots,\lambda_{d} be the eigenvalues of SΠS_{\Pi}. Then the reverse Kullback-Leibler divergence is

DKL(𝒩DB,Π𝒩NESS,Π)=12i=1d(λilog(1+λi)),D_{KL}\!\left(\mathcal{N}_{DB,\Pi}\,\|\,\mathcal{N}_{NESS,\Pi}\right)=\frac{1}{2}\sum_{i=1}^{d}\Bigl(\lambda_{i}-\log(1+\lambda_{i})\Bigr), (6.13)

and the forward Kullback-Leibler divergence is

DKL(𝒩NESS,Π𝒩DB,Π)=12i=1d(log(1+λi)λi1+λi).D_{KL}\!\left(\mathcal{N}_{NESS,\Pi}\,\|\,\mathcal{N}_{DB,\Pi}\right)=\frac{1}{2}\sum_{i=1}^{d}\left(\log(1+\lambda_{i})-\frac{\lambda_{i}}{1+\lambda_{i}}\right). (6.14)

Moreover, the squared Hellinger distance is

H2(𝒩DB,Π,𝒩NESS,Π)=1det(I+SΠ)1/4det(I+12SΠ)1/2.H^{2}\!\left(\mathcal{N}_{DB,\Pi},\mathcal{N}_{NESS,\Pi}\right)=1-\frac{\det(I+S_{\Pi})^{1/4}}{\det(I+\tfrac{1}{2}S_{\Pi})^{1/2}}. (6.15)

These formulas are observable Gaussian comparison laws. They are naturally adjacent to trajectory-level time-reversal Kullback–Leibler comparisons in the style of Roldán–Parrondo, but they are not the same object [36].

Proof.

For centred Gaussian laws with covariances Σ1,Σ0\Sigma_{1},\Sigma_{0},

DKL(𝒩(0,Σ1)𝒩(0,Σ0))=12[tr(Σ01Σ1)dlogdet(Σ01Σ1)].D_{KL}\!\left(\mathcal{N}(0,\Sigma_{1})\,\|\,\mathcal{N}(0,\Sigma_{0})\right)=\frac{1}{2}\Bigl[\operatorname{tr}(\Sigma_{0}^{-1}\Sigma_{1})-d-\log\det(\Sigma_{0}^{-1}\Sigma_{1})\Bigr]. (6.16)

Take Σ1=ΣDB,Π=BΠ1\Sigma_{1}=\Sigma_{DB,\Pi}=B_{\Pi}^{-1} and Σ0=ΣNESS,Π=HΠ1\Sigma_{0}=\Sigma_{NESS,\Pi}=H_{\Pi}^{-1}. Then

Σ01Σ1=HΠBΠ1=BΠ1/2(I+SΠ)BΠ1/2,\Sigma_{0}^{-1}\Sigma_{1}=H_{\Pi}B_{\Pi}^{-1}=B_{\Pi}^{1/2}(I+S_{\Pi})B_{\Pi}^{-1/2}, (6.17)

so its eigenvalues are 1+λi1+\lambda_{i}. Hence

DKL(𝒩DB,Π𝒩NESS,Π)=12i=1d((1+λi)1log(1+λi)),D_{KL}\!\left(\mathcal{N}_{DB,\Pi}\,\|\,\mathcal{N}_{NESS,\Pi}\right)=\frac{1}{2}\sum_{i=1}^{d}\Bigl((1+\lambda_{i})-1-\log(1+\lambda_{i})\Bigr), (6.18)

which simplifies to the first formula.

For the forward divergence, take Σ1=ΣNESS,Π\Sigma_{1}=\Sigma_{NESS,\Pi} and Σ0=ΣDB,Π\Sigma_{0}=\Sigma_{DB,\Pi}. Then

Σ01Σ1=BΠHΠ1=BΠ1/2(I+SΠ)1BΠ1/2,\Sigma_{0}^{-1}\Sigma_{1}=B_{\Pi}H_{\Pi}^{-1}=B_{\Pi}^{1/2}(I+S_{\Pi})^{-1}B_{\Pi}^{-1/2}, (6.19)

whose eigenvalues are (1+λi)1(1+\lambda_{i})^{-1}. Substituting into the Gaussian KL formula yields

DKL(𝒩NESS,Π𝒩DB,Π)=12i=1d(11+λi1+log(1+λi)),D_{KL}\!\left(\mathcal{N}_{NESS,\Pi}\,\|\,\mathcal{N}_{DB,\Pi}\right)=\frac{1}{2}\sum_{i=1}^{d}\left(\frac{1}{1+\lambda_{i}}-1+\log(1+\lambda_{i})\right), (6.20)

since

11+λi1=λi1+λi.\frac{1}{1+\lambda_{i}}-1=-\frac{\lambda_{i}}{1+\lambda_{i}}. (6.21)

This is the stated expression.

For the Hellinger distance, the standard centred-Gaussian formula gives

1H2=det(ΣDB,Π)1/4det(ΣNESS,Π)1/4det(12(ΣDB,Π+ΣNESS,Π))1/2.1-H^{2}=\frac{\det(\Sigma_{DB,\Pi})^{1/4}\det(\Sigma_{NESS,\Pi})^{1/4}}{\det\!\left(\frac{1}{2}(\Sigma_{DB,\Pi}+\Sigma_{NESS,\Pi})\right)^{1/2}}. (6.22)

Using

ΣDB,Π=BΠ1,ΣNESS,Π=BΠ1/2(I+SΠ)1BΠ1/2,\Sigma_{DB,\Pi}=B_{\Pi}^{-1},\qquad\Sigma_{NESS,\Pi}=B_{\Pi}^{-1/2}(I+S_{\Pi})^{-1}B_{\Pi}^{-1/2}, (6.23)

one computes

det(ΣDB,Π)=det(BΠ)1,det(ΣNESS,Π)=det(BΠ)1det(I+SΠ)1,\det(\Sigma_{DB,\Pi})=\det(B_{\Pi})^{-1},\qquad\det(\Sigma_{NESS,\Pi})=\det(B_{\Pi})^{-1}\det(I+S_{\Pi})^{-1}, (6.24)

and

12(ΣDB,Π+ΣNESS,Π)=BΠ1/2(12(I+(I+SΠ)1))BΠ1/2=BΠ1/2(I+12SΠ)(I+SΠ)1BΠ1/2.\frac{1}{2}(\Sigma_{DB,\Pi}+\Sigma_{NESS,\Pi})=B_{\Pi}^{-1/2}\Bigl(\frac{1}{2}(I+(I+S_{\Pi})^{-1})\Bigr)B_{\Pi}^{-1/2}=B_{\Pi}^{-1/2}(I+\tfrac{1}{2}S_{\Pi})(I+S_{\Pi})^{-1}B_{\Pi}^{-1/2}. (6.25)

Therefore

det(12(ΣDB,Π+ΣNESS,Π))=det(BΠ)1det(I+12SΠ)det(I+SΠ),\det\!\left(\frac{1}{2}(\Sigma_{DB,\Pi}+\Sigma_{NESS,\Pi})\right)=\det(B_{\Pi})^{-1}\frac{\det(I+\tfrac{1}{2}S_{\Pi})}{\det(I+S_{\Pi})}, (6.26)

so the common BΠB_{\Pi}-factor cancels and one obtains

1H2=det(I+SΠ)1/4det(I+12SΠ)1/2.1-H^{2}=\frac{\det(I+S_{\Pi})^{1/4}}{\det(I+\tfrac{1}{2}S_{\Pi})^{1/2}}. (6.27)

This gives the claimed expression. ∎

Theorem 6.3 is the precise statistical content of the shadow construction. Every local centred-Gaussian distinguishability quantity between the observed detailed-balance law and the observed nonequilibrium law is an explicit function of the eigenvalues of SΠS_{\Pi}.

Proposition 6.4 (Shadow spectrum as complete Gaussian control object).

For a fixed observer Π\Pi, the observed Gaussian pair

𝒩DB,Π,𝒩NESS,Π\mathcal{N}_{DB,\Pi},\qquad\mathcal{N}_{NESS,\Pi} (6.28)

is equivalent, under invertible linear whitening and orthogonal diagonalisation, to the product pair

i=1d𝒩(0,1),i=1d𝒩(0,11+λi),\bigotimes_{i=1}^{d}\mathcal{N}(0,1),\qquad\bigotimes_{i=1}^{d}\mathcal{N}\!\left(0,\frac{1}{1+\lambda_{i}}\right), (6.29)

where λ1,,λd\lambda_{1},\dots,\lambda_{d} are the eigenvalues of SΠS_{\Pi}. Consequently, every invertibly invariant centred-Gaussian discrimination functional of the observed pair is determined by the shadow spectrum {λi}i=1d\{\lambda_{i}\}_{i=1}^{d} alone.

Proof.

Whiten by the detailed-balance covariance and diagonalise SΠS_{\Pi}. The relation

ΣNESS,Π=BΠ1/2(I+SΠ)1BΠ1/2\Sigma_{NESS,\Pi}=B_{\Pi}^{-1/2}(I+S_{\Pi})^{-1}B_{\Pi}^{-1/2} (6.30)

shows that, after whitening by BΠ1/2B_{\Pi}^{1/2}, the observed pair becomes

𝒩(0,I),𝒩(0,(I+SΠ)1).\mathcal{N}(0,I),\qquad\mathcal{N}\!\left(0,(I+S_{\Pi})^{-1}\right). (6.31)

Orthogonal diagonalisation of SΠS_{\Pi} then yields the displayed product form. Any centred-Gaussian discrimination functional invariant under invertible changes of coordinates is preserved by these steps, so it depends only on the eigenvalues of SΠS_{\Pi}. ∎

This complements the current literature on partial observation, which largely provides lower bounds, estimators, or observation-dependent thermodynamic laws [5, 13, 6, 7, 19, 8]. Here the local Gaussian visibility problem in the compressed-Hessian model is resolved in finite-dimensional form once the DV signal is written in the appropriate weighted coordinates.

6.4 Distinguishability package

The formulas of Theorem 6.3 immediately imply a collection of sharp and simple bounds. These are the estimates that turn the shadow operator into a practical observable criterion.

Proposition 6.5 (KL and total-variation bounds).

For every observer Π\Pi,

DKL(𝒩DB,Π𝒩NESS,Π)14SΠF2.D_{KL}\!\left(\mathcal{N}_{DB,\Pi}\,\|\,\mathcal{N}_{NESS,\Pi}\right)\leq\frac{1}{4}\,\|S_{\Pi}\|_{F}^{2}. (6.32)

Consequently,

TV(𝒩DB,Π,𝒩NESS,Π)122SΠF.\operatorname{TV}\!\left(\mathcal{N}_{DB,\Pi},\mathcal{N}_{NESS,\Pi}\right)\leq\frac{1}{2\sqrt{2}}\,\|S_{\Pi}\|_{F}. (6.33)

For equal priors, the optimal Bayes classification error satisfies

Pe12142SΠF.P_{e}^{\ast}\geq\frac{1}{2}-\frac{1}{4\sqrt{2}}\,\|S_{\Pi}\|_{F}. (6.34)
Proof.

Consider the scalar function

f(λ):=λ22λ+log(1+λ),λ0.f(\lambda):=\frac{\lambda^{2}}{2}-\lambda+\log(1+\lambda),\qquad\lambda\geq 0. (6.35)

Then

f(λ)=λ1+11+λ=λ21+λ0,f^{\prime}(\lambda)=\lambda-1+\frac{1}{1+\lambda}=\frac{\lambda^{2}}{1+\lambda}\geq 0, (6.36)

and f(0)=0f(0)=0. Hence f(λ)0f(\lambda)\geq 0, or equivalently,

λlog(1+λ)λ22for all λ0.\lambda-\log(1+\lambda)\leq\frac{\lambda^{2}}{2}\qquad\text{for all }\lambda\geq 0. (6.37)

Applying this estimate termwise in Theorem 6.3 gives

DKL(𝒩DB,Π𝒩NESS,Π)12i=1dλi22=14SΠF2.D_{KL}\!\left(\mathcal{N}_{DB,\Pi}\,\|\,\mathcal{N}_{NESS,\Pi}\right)\leq\frac{1}{2}\sum_{i=1}^{d}\frac{\lambda_{i}^{2}}{2}=\frac{1}{4}\,\|S_{\Pi}\|_{F}^{2}. (6.38)

Pinsker’s inequality then yields

TV(𝒩DB,Π,𝒩NESS,Π)12DKL(𝒩DB,Π𝒩NESS,Π)122SΠF.\operatorname{TV}\!\left(\mathcal{N}_{DB,\Pi},\mathcal{N}_{NESS,\Pi}\right)\leq\sqrt{\frac{1}{2}\,D_{KL}\!\left(\mathcal{N}_{DB,\Pi}\,\|\,\mathcal{N}_{NESS,\Pi}\right)}\leq\frac{1}{2\sqrt{2}}\,\|S_{\Pi}\|_{F}. (6.39)

For equal priors, the optimal Bayes error satisfies

Pe=1TV2,P_{e}^{\ast}=\frac{1-\operatorname{TV}}{2}, (6.40)

so the total-variation bound gives the stated lower bound. ∎

Proposition 6.5 shows that the shadow operator is not just a formal factorisation device. Its Frobenius norm directly controls statistical distinguishability at the Gaussian level.

We next bound the shadow operator in terms of the visible envelope and the observed backbone scale.

Proposition 6.6 (Backbone-normalised visibility bound).

For every observer Π\Pi,

SΠopVΠDVλmin(BΠ),SΠFVΠDVλmin(BΠ).\|S_{\Pi}\|_{op}\leq\frac{V_{\Pi}^{DV}}{\lambda_{\min}(B_{\Pi})},\qquad\|S_{\Pi}\|_{F}\leq\frac{V_{\Pi}^{DV}}{\lambda_{\min}(B_{\Pi})}. (6.41)

In particular,

SΠopKdDVλmin(BΠ),SΠFKdDVλmin(BΠ).\|S_{\Pi}\|_{op}\leq\frac{K_{d}^{DV}}{\lambda_{\min}(B_{\Pi})},\qquad\|S_{\Pi}\|_{F}\leq\frac{K_{d}^{DV}}{\lambda_{\min}(B_{\Pi})}. (6.42)
Proof.

Since SΠ=BΠ1/2EΠBΠ1/2S_{\Pi}=B_{\Pi}^{-1/2}E_{\Pi}B_{\Pi}^{-1/2},

SΠopBΠ1/2op2EΠop=EΠopλmin(BΠ).\|S_{\Pi}\|_{op}\leq\|B_{\Pi}^{-1/2}\|_{op}^{2}\,\|E_{\Pi}\|_{op}=\frac{\|E_{\Pi}\|_{op}}{\lambda_{\min}(B_{\Pi})}. (6.43)

Because EΠE_{\Pi} is positive semidefinite,

EΠoptr(EΠ)=VΠDV.\|E_{\Pi}\|_{op}\leq\operatorname{tr}(E_{\Pi})=V_{\Pi}^{DV}. (6.44)

Thus

SΠopVΠDVλmin(BΠ).\|S_{\Pi}\|_{op}\leq\frac{V_{\Pi}^{DV}}{\lambda_{\min}(B_{\Pi})}. (6.45)

Similarly,

SΠFBΠ1/2op2EΠFEΠFλmin(BΠ).\|S_{\Pi}\|_{F}\leq\|B_{\Pi}^{-1/2}\|_{op}^{2}\,\|E_{\Pi}\|_{F}\leq\frac{\|E_{\Pi}\|_{F}}{\lambda_{\min}(B_{\Pi})}. (6.46)

Again EΠ0E_{\Pi}\geq 0, hence

EΠFtr(EΠ)=VΠDV,\|E_{\Pi}\|_{F}\leq\operatorname{tr}(E_{\Pi})=V_{\Pi}^{DV}, (6.47)

which gives

SΠFVΠDVλmin(BΠ).\|S_{\Pi}\|_{F}\leq\frac{V_{\Pi}^{DV}}{\lambda_{\min}(B_{\Pi})}. (6.48)

Since VΠDVKdDVV_{\Pi}^{DV}\leq K_{d}^{DV}, the final bounds follow. ∎

Proposition 6.6 is the missing link between the finite-observation envelope and the statistical shadow criterion. The visible envelope by itself is not enough to guarantee indistinguishability. What matters is the visible envelope relative to the observed detailed-balance backbone.

The correction is visible only through the ratio

KdDVλmin(BΠ).\frac{K_{d}^{DV}}{\lambda_{\min}(B_{\Pi})}. (6.49)

This is the backbone-normalised observation budget. It is the quantity that turns retained signal into statistical closeness. This criterion is observer-specific unless one also imposes a uniform lower bound on λmin(BΠ)\lambda_{\min}(B_{\Pi}).

6.5 The equilibrium shadow criterion

We can now progress to the paper’s main statistical theorem in its final form.

Theorem 6.7 (Gaussian equilibrium-shadow criterion).

Let Π\Pi be a rank-dd observer and let SΠS_{\Pi} be its shadow operator. Then the observed nonequilibrium and observed detailed-balance Gaussian laws are exactly identical if and only if SΠ=0S_{\Pi}=0.

More generally, if

ΘΠ:=SΠopε,\Theta_{\Pi}:=\|S_{\Pi}\|_{op}\leq\varepsilon, (6.50)

then

DKL(𝒩DB,Π𝒩NESS,Π)dε24,D_{KL}\!\left(\mathcal{N}_{DB,\Pi}\,\|\,\mathcal{N}_{NESS,\Pi}\right)\leq\frac{d\,\varepsilon^{2}}{4}, (6.51)
TV(𝒩DB,Π,𝒩NESS,Π)dε22,\operatorname{TV}\!\left(\mathcal{N}_{DB,\Pi},\mathcal{N}_{NESS,\Pi}\right)\leq\frac{\sqrt{d}\,\varepsilon}{2\sqrt{2}}, (6.52)

and

Pe12dε42.P_{e}^{\ast}\geq\frac{1}{2}-\frac{\sqrt{d}\,\varepsilon}{4\sqrt{2}}. (6.53)

If

KdDVλmin(BΠ)ε\frac{K_{d}^{DV}}{\lambda_{\min}(B_{\Pi})}\leq\varepsilon (6.54)

for some ε>0\varepsilon>0, then the compressed Gaussian fluctuation law is quantitatively close to the corresponding detailed-balance Gaussian fluctuation law, with bounds given above in terms of ε\varepsilon. This is a statement about observed quadratic-Gaussian statistics, not about the full microscopic dynamics.

Proof.

The identification follows from Proposition 6.2. Since BΠB_{\Pi} is positive definite,

HΠ=BΠEΠ=0SΠ=0.H_{\Pi}=B_{\Pi}\quad\Longleftrightarrow\quad E_{\Pi}=0\quad\Longleftrightarrow\quad S_{\Pi}=0. (6.55)

Now assume SΠopε\|S_{\Pi}\|_{op}\leq\varepsilon. Since SΠ0S_{\Pi}\geq 0, all eigenvalues satisfy 0λiε0\leq\lambda_{i}\leq\varepsilon. From Theorem 6.3,

DKL(𝒩DB,Π𝒩NESS,Π)=12i=1d(λilog(1+λi)).D_{KL}\!\left(\mathcal{N}_{DB,\Pi}\,\|\,\mathcal{N}_{NESS,\Pi}\right)=\frac{1}{2}\sum_{i=1}^{d}\Bigl(\lambda_{i}-\log(1+\lambda_{i})\Bigr). (6.56)

Using λlog(1+λ)λ2/2\lambda-\log(1+\lambda)\leq\lambda^{2}/2, we obtain

DKL(𝒩DB,Π𝒩NESS,Π)12i=1dλi2212i=1dε22=dε24.D_{KL}\!\left(\mathcal{N}_{DB,\Pi}\,\|\,\mathcal{N}_{NESS,\Pi}\right)\leq\frac{1}{2}\sum_{i=1}^{d}\frac{\lambda_{i}^{2}}{2}\leq\frac{1}{2}\sum_{i=1}^{d}\frac{\varepsilon^{2}}{2}=\frac{d\,\varepsilon^{2}}{4}. (6.57)

Pinsker then gives

TV12DKLdε22.\operatorname{TV}\leq\sqrt{\frac{1}{2}D_{KL}}\leq\frac{\sqrt{d}\,\varepsilon}{2\sqrt{2}}. (6.58)

The Bayes error bound follows as in Proposition 6.5.

Finally, Proposition 6.6 yields

ΘΠKdDVλmin(BΠ).\Theta_{\Pi}\leq\frac{K_{d}^{DV}}{\lambda_{\min}(B_{\Pi})}. (6.59)

Thus small backbone-normalised visible envelope implies small ΘΠ\Theta_{\Pi}, and hence small divergence and small total variation. ∎

Theorem 6.7 is the rigorous form of the equilibrium-shadow principle. Within the compressed quadratic-Gaussian regime, finite orthogonal observation can erase visible nonequilibrium detail and leave only an equilibrium-shaped backbone. The theorem makes that precise.

There are two ingredients. Firstly, the visible nonequilibrium budget, controlled by the envelope KdDVK_{d}^{DV}. The second is the observed backbone stiffness, controlled by λmin(BΠ)\lambda_{\min}(B_{\Pi}). The shadow criterion says that equilibrium-shaped observation emerges when the visible nonequilibrium budget is small relative to the stiffness of the observed detailed-balance backbone.

This corrects a point that would otherwise remain too loose. The inequality

dsr(ADV)d\ll\operatorname{sr}(A_{DV}) (6.60)

controls how much of the total nonequilibrium signal can be retained. It does not by itself imply statistical indistinguishability from detailed balance. The shadow theorem identifies the missing ingredient, namely the backbone scale.

6.6 Backbone-whitened detectability geometry

The shadow criterion identifies the correct backbone-normalised observable quantity, but it also admits a second spectral reformulation. Define the backbone-whitened operator

T:=H01/2ΔDVH01/2=14CDVCDVT,CDV:=H01/2ADV=H01/2J^H01/2.T:=H_{0}^{-1/2}\Delta_{DV}H_{0}^{-1/2}=\frac{1}{4}\,C_{DV}C_{DV}^{T},\qquad C_{DV}:=H_{0}^{-1/2}A_{DV}=H_{0}^{-1/2}\widehat{J}H_{0}^{-1/2}. (6.61)

This operator encodes detectability relative to the detailed-balance backbone rather than raw visible signal. In general its spectral order need not coincide with the spectral order of ADVA_{DV}, except in commuting or isotropic-backbone regimes treated later.

Theorem 6.8 (Backbone-whitened detectability equivalence).

Let UVU\subset V be a dd-dimensional observable subspace, and let Q(n1)×dQ\in\mathbb{R}^{(n-1)\times d} have orthonormal columns spanning UU. Define

SU:=(QTH0Q)1/2QTΔDVQ(QTH0Q)1/2S_{U}:=(Q^{T}H_{0}Q)^{-1/2}Q^{T}\Delta_{DV}Q(Q^{T}H_{0}Q)^{-1/2} (6.62)

and

YU:=H01/2Q(QTH0Q)1/2.Y_{U}:=H_{0}^{1/2}Q(Q^{T}H_{0}Q)^{-1/2}. (6.63)

Then

YUTYU=Id,SU=YUTTYU.Y_{U}^{T}Y_{U}=I_{d},\qquad S_{U}=Y_{U}^{T}TY_{U}. (6.64)

Hence

tr(SU)=tr(PWUT)=14PWUCDVF2,\operatorname{tr}(S_{U})=\operatorname{tr}(P_{W_{U}}T)=\frac{1}{4}\|P_{W_{U}}C_{DV}\|_{F}^{2}, (6.65)

where WU:=Ran(YU)W_{U}:=\operatorname{Ran}(Y_{U}) and PWUP_{W_{U}} is the Euclidean orthogonal projector onto WUW_{U}. Conversely, every Euclidean dd-plane WVW\subset V arises as W=H01/2UW=H_{0}^{1/2}U for a unique observable dd-plane UU.

Proof.

Direct computation gives

YUTYU=(QTH0Q)1/2QTH0Q(QTH0Q)1/2=Id,Y_{U}^{T}Y_{U}=(Q^{T}H_{0}Q)^{-1/2}Q^{T}H_{0}Q(Q^{T}H_{0}Q)^{-1/2}=I_{d}, (6.66)

and

YUTTYU=(QTH0Q)1/2QTΔDVQ(QTH0Q)1/2=SU.Y_{U}^{T}TY_{U}=(Q^{T}H_{0}Q)^{-1/2}Q^{T}\Delta_{DV}Q(Q^{T}H_{0}Q)^{-1/2}=S_{U}. (6.67)

For the converse, let WVW\subset V be any Euclidean dd-plane and let YY have orthonormal columns spanning WW. Set Z:=H01/2YZ:=H_{0}^{-1/2}Y, and define

Q:=Z(ZTZ)1/2.Q:=Z(Z^{T}Z)^{-1/2}. (6.68)

Then QTQ=IdQ^{T}Q=I_{d}, so U:=Ran(Q)U:=\operatorname{Ran}(Q) is an observable dd-plane. Moreover,

QTH0Q=(ZTZ)1,H01/2Q(QTH0Q)1/2=Y,Q^{T}H_{0}Q=(Z^{T}Z)^{-1},\qquad H_{0}^{1/2}Q(Q^{T}H_{0}Q)^{-1/2}=Y, (6.69)

so indeed W=WUW=W_{U}. ∎

{remarkbox}
Remark (Detectability versus raw visibility).

Theorem 6.8 is a bijection between observable dd-planes and whitened Euclidean dd-planes. It is not a statement about arbitrary observation channels. Detectability here is defined relative to H0H_{0}-normalised quadratic compression and should not be conflated with raw visible signal unless additional commuting or isotropic-backbone structure is imposed.

Theorem 6.8 shows that the backbone-normalised detectability problem is itself a Ky Fan problem, now for the whitened signal CDVC_{DV} rather than the raw visible signal ADVA_{DV}.

Corollary 6.9 (Exact detectability envelope).

Let

θ1θ2θn10\theta_{1}\geq\theta_{2}\geq\cdots\geq\theta_{n-1}\geq 0 (6.70)

be the eigenvalues of TT, equivalently

θk=14sk(CDV)2.\theta_{k}=\frac{1}{4}s_{k}(C_{DV})^{2}. (6.71)

Define

Θd:=supdimU=dtr(SU).\Theta_{d}:=\sup_{\dim U=d}\operatorname{tr}(S_{U}). (6.72)

Then

Θd=k=1dθk,infdimU=dtr(SU)=k=(n1)d+1n1θk.\Theta_{d}=\sum_{k=1}^{d}\theta_{k},\qquad\inf_{\dim U=d}\operatorname{tr}(S_{U})=\sum_{k=(n-1)-d+1}^{n-1}\theta_{k}. (6.73)

The maximiser is the observable subspace whose whitened image is the span of the top dd eigendirections of TT.

If

Φ~d:=Θdtr(T)=k=1dsk(CDV)2k=1n1sk(CDV)2,\widetilde{\Phi}_{d}:=\frac{\Theta_{d}}{\operatorname{tr}(T)}=\frac{\sum_{k=1}^{d}s_{k}(C_{DV})^{2}}{\sum_{k=1}^{n-1}s_{k}(C_{DV})^{2}}, (6.74)

then

Φ~ddsr(CDV),sr(CDV)=CDVF2CDVop2.\widetilde{\Phi}_{d}\leq\frac{d}{\operatorname{sr}(C_{DV})},\qquad\operatorname{sr}(C_{DV})=\frac{\|C_{DV}\|_{F}^{2}}{\|C_{DV}\|_{op}^{2}}. (6.75)
Proof.

By Theorem 6.8, every observable dd-plane induces a Euclidean compression of TT. The statement is therefore exactly the Ky Fan maximum principle for the positive semidefinite matrix TT, together with the complement argument for the minimum and the usual stable-rank bound. ∎

The operator TT is not an arbitrary positive semidefinite matrix. Because it is generated by the whitened skew carrier CDVC_{DV}, its positive spectrum is forced to organise into orthogonal current planes. The next proposition records this intrinsic structure and the detectability consequences needed later.

Proposition 6.10 (Canonical current-plane decomposition).

There exist pairwise orthogonal two-dimensional subspaces

E1,,ErV,E_{1},\dots,E_{r}\subset V, (6.76)

positive numbers

κ1κ2κr>0,\kappa_{1}\geq\kappa_{2}\geq\cdots\geq\kappa_{r}>0, (6.77)

and an orthogonal decomposition

V=E1ErkerCDV,V=E_{1}\oplus\cdots\oplus E_{r}\oplus\ker C_{DV}, (6.78)

such that for each jj,

CDV|Ej=κjRj,RjT=Rj,Rj2=IEj,C_{DV}|_{E_{j}}=\kappa_{j}R_{j},\qquad R_{j}^{T}=-R_{j},\qquad R_{j}^{2}=-I_{E_{j}}, (6.79)

and therefore

T|Ej=κj24IEj,T|kerCDV=0.T|_{E_{j}}=\frac{\kappa_{j}^{2}}{4}I_{E_{j}},\qquad T|_{\ker C_{DV}}=0. (6.80)
Proof.

Since

T=14CDVCDVT=14CDV2,T=\frac{1}{4}\,C_{DV}C_{DV}^{T}=-\frac{1}{4}\,C_{DV}^{2}, (6.81)

the operators TT and CDVC_{DV} commute. Decompose VV into orthogonal eigenspaces of TT:

V=λ0Eλ.V=\bigoplus_{\lambda\geq 0}E_{\lambda}. (6.82)

Each EλE_{\lambda} is therefore CDVC_{DV}-invariant. On EλE_{\lambda} with λ>0\lambda>0,

CDV2=4λI.C_{DV}^{2}=-4\lambda I. (6.83)

Hence

Rλ:=12λCDV|EλR_{\lambda}:=\frac{1}{2\sqrt{\lambda}}\,C_{DV}|_{E_{\lambda}} (6.84)

satisfies

RλT=Rλ,Rλ2=I,RλTRλ=I.R_{\lambda}^{T}=-R_{\lambda},\qquad R_{\lambda}^{2}=-I,\qquad R_{\lambda}^{T}R_{\lambda}=I. (6.85)

Thus RλR_{\lambda} is orthogonal and skew. If eEλe\in E_{\lambda} is a unit vector and f:=Rλef:=R_{\lambda}e, then

e,f=e,Rλe=0,\langle e,f\rangle=\langle e,R_{\lambda}e\rangle=0, (6.86)

so span{e,f}\operatorname{span}\{e,f\} is an invariant two-plane on which CDV=2λRλC_{DV}=2\sqrt{\lambda}\,R_{\lambda}. Repeating this construction yields an orthogonal decomposition of each positive eigenspace into invariant two-planes. Finally,

v,Tv=14CDVTv2,\langle v,Tv\rangle=\frac{1}{4}\|C_{DV}^{T}v\|^{2}, (6.87)

so kerT=kerCDV\ker T=\ker C_{DV}. ∎

Corollary 6.11 (Paired detectability spectrum).

Let

θ1θ2θn10\theta_{1}\geq\theta_{2}\geq\cdots\geq\theta_{n-1}\geq 0 (6.88)

be the eigenvalues of TT. Then every positive detectability eigenvalue has even multiplicity. More precisely,

θ2j1=θ2j=κj24,j=1,,r,\theta_{2j-1}=\theta_{2j}=\frac{\kappa_{j}^{2}}{4},\qquad j=1,\dots,r, (6.89)

and all remaining eigenvalues are zero. Consequently,

rank(ΔDV)=rank(T)=rank(CDV)=2r,\operatorname{rank}(\Delta_{DV})=\operatorname{rank}(T)=\operatorname{rank}(C_{DV})=2r, (6.90)

so the nonequilibrium correction can never have rank one.

Proof.

This is immediate from Proposition 6.10 and the identity T=14CDVCDVTT=\frac{1}{4}\,C_{DV}C_{DV}^{T}. ∎

Corollary 6.12 (Universal rank-one detectability ceiling).

Assume tr(T)>0\operatorname{tr}(T)>0, so that the retained fractions from Corollary 6.9 are defined. Then

Φ~112.\widetilde{\Phi}_{1}\leq\frac{1}{2}. (6.91)

Equality holds if and only if rank(ΔDV)=2\operatorname{rank}(\Delta_{DV})=2, equivalently if and only if there is exactly one nonzero current plane.

Proof.

By Corollary 6.11, the top eigenvalue is repeated:

θ1=θ2.\theta_{1}=\theta_{2}. (6.92)

Hence

tr(T)=k=1n1θk2θ1,\operatorname{tr}(T)=\sum_{k=1}^{n-1}\theta_{k}\geq 2\theta_{1}, (6.93)

which gives Φ~1=θ1/tr(T)1/2\widetilde{\Phi}_{1}=\theta_{1}/\operatorname{tr}(T)\leq 1/2. Equality holds exactly when θk=0\theta_{k}=0 for all k3k\geq 3, that is, exactly when rank(T)=2\operatorname{rank}(T)=2. By Corollary 6.11, this is equivalent to rank(ΔDV)=2\operatorname{rank}(\Delta_{DV})=2, or equivalently to the existence of exactly one nonzero current plane. ∎

The backbone-whitened detectability spectrum is therefore constrained by skew-current geometry rather than being an arbitrary positive spectrum. In particular, the one-dimensional ceiling in the detectability problem is structural rather than model-specific.

Corollary 6.13 (Generalised eigenvalue formulation of detectability).

The nonzero eigenvalues θk\theta_{k} of TT are the generalised eigenvalues of the pair (ΔDV,H0)(\Delta_{DV},H_{0}):

ΔDVu=θH0u.\Delta_{DV}u=\theta\,H_{0}u. (6.94)

The optimal detectable modes may be chosen as H0H_{0}-orthonormal generalised eigenvectors

uiTH0uj=δij,u_{i}^{T}H_{0}u_{j}=\delta_{ij}, (6.95)

and

Θd=k=1dθk.\Theta_{d}=\sum_{k=1}^{d}\theta_{k}. (6.96)
Proof.

If Tw=θwTw=\theta w, then setting u:=H01/2wu:=H_{0}^{-1/2}w gives the generalised eigenvalue relation ΔDVu=θH0u\Delta_{DV}u=\theta H_{0}u. Conversely, any generalised eigenvector uu yields a whitened eigenvector w:=H01/2uw:=H_{0}^{1/2}u of TT with the same eigenvalue. The envelope identity follows from Corollary 6.9. ∎

Corollary 6.14 (Detectability spectroscopy).

The cumulative detectability envelope recovers the detectability spectrum:

θd=ΘdΘd1.\theta_{d}=\Theta_{d}-\Theta_{d-1}. (6.97)

Hence the full backbone-normalised detectability spectrum is encoded by the hierarchy {Θd}d=0n1\{\Theta_{d}\}_{d=0}^{n-1}.

Proof.

Immediate from

Θd=k=1dθk.\Theta_{d}=\sum_{k=1}^{d}\theta_{k}. (6.98)

Corollary 6.15 (Rank-one detectability and the top generalised eigenmode).

The optimal one-dimensional detectable observer solves

Θ1=supu0uTΔDVuuTH0u.\Theta_{1}=\sup_{u\neq 0}\frac{u^{T}\Delta_{DV}u}{u^{T}H_{0}u}. (6.99)

Equivalently, Θ1\Theta_{1} is the top generalised eigenvalue of the pair (ΔDV,H0)(\Delta_{DV},H_{0}), or the top eigenvalue of TT. Thus

Θ1=θ1=14s1(CDV)2.\Theta_{1}=\theta_{1}=\frac{1}{4}s_{1}(C_{DV})^{2}. (6.100)

The optimal one-mode detectable direction is any H0H_{0}-normalised generalised eigenvector satisfying

ΔDVu=θ1H0u,uTH0u=1.\Delta_{DV}u=\theta_{1}H_{0}u,\qquad u^{T}H_{0}u=1. (6.101)
Proof.

This is the rank-one case of Corollary 6.9 and the Rayleigh–Ritz characterisation of the top generalised eigenvalue. ∎

Theorem 6.16 (Two-envelope backbone spectroscopy).

Assume

H0>0,ΔDV0,H_{0}>0,\qquad\Delta_{DV}\geq 0, (6.102)

and let

T=H01/2ΔDVH01/2.T=H_{0}^{-1/2}\Delta_{DV}H_{0}^{-1/2}. (6.103)

Let

τ1τ2τn10\tau_{1}\geq\tau_{2}\geq\cdots\geq\tau_{n-1}\geq 0 (6.104)

be the eigenvalues of ΔDV\Delta_{DV}, and let

θ1θ2θn10\theta_{1}\geq\theta_{2}\geq\cdots\geq\theta_{n-1}\geq 0 (6.105)

be the eigenvalues of TT. If

μminIH0μmaxI,\mu_{\min}I\preceq H_{0}\preceq\mu_{\max}I, (6.106)

then for every ii,

τiμmaxθiτiμmin.\frac{\tau_{i}}{\mu_{\max}}\leq\theta_{i}\leq\frac{\tau_{i}}{\mu_{\min}}. (6.107)

Consequently, for every dd,

KdDVμmaxΘdKdDVμmin.\frac{K_{d}^{DV}}{\mu_{\max}}\leq\Theta_{d}\leq\frac{K_{d}^{DV}}{\mu_{\min}}. (6.108)
Proof.

The numbers θi\theta_{i} are the generalised eigenvalues of the pair (ΔDV,H0)(\Delta_{DV},H_{0}), equivalently the eigenvalues of TT. By the Courant–Fischer principle,

θi=maxdimW=iminxW{0}xTΔDVxxTH0x.\theta_{i}=\max_{\dim W=i}\min_{x\in W\setminus\{0\}}\frac{x^{T}\Delta_{DV}x}{x^{T}H_{0}x}. (6.109)

Since

μminx2xTH0xμmaxx2,\mu_{\min}\|x\|^{2}\leq x^{T}H_{0}x\leq\mu_{\max}\|x\|^{2}, (6.110)

one has

1μmaxxTΔDVxx2xTΔDVxxTH0x1μminxTΔDVxx2.\frac{1}{\mu_{\max}}\frac{x^{T}\Delta_{DV}x}{\|x\|^{2}}\leq\frac{x^{T}\Delta_{DV}x}{x^{T}H_{0}x}\leq\frac{1}{\mu_{\min}}\frac{x^{T}\Delta_{DV}x}{\|x\|^{2}}. (6.111)

Applying the Courant–Fischer principle again to ΔDV\Delta_{DV} yields

τiμmaxθiτiμmin.\frac{\tau_{i}}{\mu_{\max}}\leq\theta_{i}\leq\frac{\tau_{i}}{\mu_{\min}}. (6.112)

Summing from i=1i=1 to dd gives the envelope bounds. ∎

Proposition 6.17 (Exact commuting-case backbone spectroscopy).

Assume

[H0,ΔDV]=0,H0>0,ΔDV0.[H_{0},\Delta_{DV}]=0,\qquad H_{0}>0,\qquad\Delta_{DV}\geq 0. (6.113)

Then there exists an orthogonal basis in which

H0=diag(μ1,,μn1),ΔDV=diag(τ1,,τn1),H_{0}=\operatorname{diag}(\mu_{1},\dots,\mu_{n-1}),\qquad\Delta_{DV}=\operatorname{diag}(\tau_{1},\dots,\tau_{n-1}), (6.114)

with μi>0\mu_{i}>0 and τi0\tau_{i}\geq 0. In that basis,

T=H01/2ΔDVH01/2=diag(τ1μ1,,τn1μn1).T=H_{0}^{-1/2}\Delta_{DV}H_{0}^{-1/2}=\operatorname{diag}\!\left(\frac{\tau_{1}}{\mu_{1}},\dots,\frac{\tau_{n-1}}{\mu_{n-1}}\right). (6.115)

Hence along each common eigenvector the corresponding generalised eigenvalue is the ratio τi/μi\tau_{i}/\mu_{i}. Equivalently, the spectrum of TT is the multiset of ratios {τi/μi}i=1n1\{\tau_{i}/\mu_{i}\}_{i=1}^{n-1}, with common eigenvectors of H0H_{0} and ΔDV\Delta_{DV} furnishing the modes.

Proof.

Real symmetric commuting matrices are simultaneously orthogonally diagonalisable. The displayed formula for TT is then immediate. ∎

Corollary 6.18 (Isotropic-backbone reduction).

If H0H_{0} is isotropic on Ran(ΔDV)\operatorname{Ran}(\Delta_{DV}), meaning

H0=μIon Ran(ΔDV),H_{0}=\mu I\quad\text{on }\operatorname{Ran}(\Delta_{DV}), (6.116)

then

T=1μΔDV.T=\frac{1}{\mu}\Delta_{DV}. (6.117)

Hence raw visibility and detectability choose the same eigendirections, and their spectra differ only by the constant factor 1/μ1/\mu.

Theorem 6.16 gives the generic spectral-window sandwich between raw visibility and detectability, while Proposition 6.17 gives the exact commuting sharpened case. This commuting regime isolates the effect of the detailed-balance backbone: detectability is raw visibility reweighted by directional backbone penalties. It is therefore natural to speak of backbone friction when describing the difference between the raw signal spectrum and the detectability spectrum.

Corollary 6.19 (Raw-to-detectability discrimination bounds via the backbone window).

Let UdU_{d}^{\ast} be an optimal detectable dd-plane from Corollary 6.9, so that the shadow spectrum of SUdS_{U_{d}^{\ast}} is θ1,,θd\theta_{1},\dots,\theta_{d}. Then

DKL(𝒩DB,Ud𝒩NESS,Ud)=12i=1d(θilog(1+θi)),D_{KL}\!\left(\mathcal{N}_{DB,U_{d}^{\ast}}\,\|\,\mathcal{N}_{NESS,U_{d}^{\ast}}\right)=\frac{1}{2}\sum_{i=1}^{d}\Bigl(\theta_{i}-\log(1+\theta_{i})\Bigr), (6.118)
DKL(𝒩NESS,Ud𝒩DB,Ud)=12i=1d(log(1+θi)θi1+θi),D_{KL}\!\left(\mathcal{N}_{NESS,U_{d}^{\ast}}\,\|\,\mathcal{N}_{DB,U_{d}^{\ast}}\right)=\frac{1}{2}\sum_{i=1}^{d}\left(\log(1+\theta_{i})-\frac{\theta_{i}}{1+\theta_{i}}\right), (6.119)

and

H2(𝒩DB,Ud,𝒩NESS,Ud)=1i=1d(1+θi)1/4(1+12θi)1/2.H^{2}\!\left(\mathcal{N}_{DB,U_{d}^{\ast}},\mathcal{N}_{NESS,U_{d}^{\ast}}\right)=1-\prod_{i=1}^{d}\frac{(1+\theta_{i})^{1/4}}{(1+\tfrac{1}{2}\theta_{i})^{1/2}}. (6.120)

If additionally μminIH0μmaxI\mu_{\min}I\preceq H_{0}\preceq\mu_{\max}I, then

12i=1d(τiμmaxlog(1+τiμmax))DKL(𝒩DB,Ud𝒩NESS,Ud)12i=1d(τiμminlog(1+τiμmin)),\frac{1}{2}\sum_{i=1}^{d}\left(\frac{\tau_{i}}{\mu_{\max}}-\log\!\left(1+\frac{\tau_{i}}{\mu_{\max}}\right)\right)\leq D_{KL}\!\left(\mathcal{N}_{DB,U_{d}^{\ast}}\,\|\,\mathcal{N}_{NESS,U_{d}^{\ast}}\right)\leq\frac{1}{2}\sum_{i=1}^{d}\left(\frac{\tau_{i}}{\mu_{\min}}-\log\!\left(1+\frac{\tau_{i}}{\mu_{\min}}\right)\right), (6.121)
12i=1d(log(1+τiμmax)τi/μmax1+τi/μmax)DKL(𝒩NESS,Ud𝒩DB,Ud)12i=1d(log(1+τiμmin)τi/μmin1+τi/μmin),\frac{1}{2}\sum_{i=1}^{d}\left(\log\!\left(1+\frac{\tau_{i}}{\mu_{\max}}\right)-\frac{\tau_{i}/\mu_{\max}}{1+\tau_{i}/\mu_{\max}}\right)\leq D_{KL}\!\left(\mathcal{N}_{NESS,U_{d}^{\ast}}\,\|\,\mathcal{N}_{DB,U_{d}^{\ast}}\right)\leq\frac{1}{2}\sum_{i=1}^{d}\left(\log\!\left(1+\frac{\tau_{i}}{\mu_{\min}}\right)-\frac{\tau_{i}/\mu_{\min}}{1+\tau_{i}/\mu_{\min}}\right), (6.122)

and

1i=1d(1+τi/μmax)1/4(1+12τi/μmax)1/2H21i=1d(1+τi/μmin)1/4(1+12τi/μmin)1/2.1-\prod_{i=1}^{d}\frac{(1+\tau_{i}/\mu_{\max})^{1/4}}{(1+\tfrac{1}{2}\tau_{i}/\mu_{\max})^{1/2}}\leq H^{2}\leq 1-\prod_{i=1}^{d}\frac{(1+\tau_{i}/\mu_{\min})^{1/4}}{(1+\tfrac{1}{2}\tau_{i}/\mu_{\min})^{1/2}}. (6.123)

Consequently,

H2TV12DKL(𝒩DB,Ud𝒩NESS,Ud),Pe=1TV2,H^{2}\leq\operatorname{TV}\leq\sqrt{\frac{1}{2}D_{KL}\!\left(\mathcal{N}_{DB,U_{d}^{\ast}}\,\|\,\mathcal{N}_{NESS,U_{d}^{\ast}}\right)},\qquad P_{e}^{\ast}=\frac{1-\operatorname{TV}}{2}, (6.124)

so the backbone window transfers raw visibility bounds directly into total-variation and Bayes-error bounds.

Proof.

The exact formulas are Theorem 6.3 applied to the optimal detectable observer UdU_{d}^{\ast}, whose shadow spectrum is θ1,,θd\theta_{1},\dots,\theta_{d} by Corollary 6.9. The eigenvalue bounds come from Theorem 6.16. The scalar functions

g(t):=12(tlog(1+t)),h(t):=12(log(1+t)t1+t)g(t):=\frac{1}{2}\bigl(t-\log(1+t)\bigr),\qquad h(t):=\frac{1}{2}\left(\log(1+t)-\frac{t}{1+t}\right) (6.125)

are increasing on [0,)[0,\infty), while

ψ(t):=(1+t)1/4(1+12t)1/2\psi(t):=\frac{(1+t)^{1/4}}{(1+\tfrac{1}{2}t)^{1/2}} (6.126)

is decreasing on [0,)[0,\infty). Substituting the eigenvalue sandwich into the exact formulas yields the displayed bounds, and the total-variation and Bayes relations are standard. ∎

6.7 Noisy Gaussian observation extension

The deterministic-subspace theory solved in the main text extends at the Gaussian level to fixed linear noisy observation channels, although the resulting optimisation problem is no longer a Ky Fan problem. The deterministic projector model is recovered as the sharp-channel limit of this Gaussian observation setting.

Theorem 6.20 (Exact Gaussian noisy-channel shadow formulas).

Let the latent detailed-balance and NESS Gaussian fluctuation laws be

xDB𝒩(0,Σ0),xNESS𝒩(0,Σ1),x_{DB}\sim\mathcal{N}(0,\Sigma_{0}),\qquad x_{NESS}\sim\mathcal{N}(0,\Sigma_{1}), (6.127)

with

Σ0=H01,Σ1=(H0+ΔDV)1.\Sigma_{0}=H_{0}^{-1},\qquad\Sigma_{1}=(H_{0}+\Delta_{DV})^{-1}. (6.128)

Let the observer act through a linear Gaussian channel

y=Cx+η,η𝒩(0,R),y=Cx+\eta,\qquad\eta\sim\mathcal{N}(0,R), (6.129)

where Cp×(n1)C\in\mathbb{R}^{p\times(n-1)} and R>0R>0. Then

yDB𝒩(0,Σ0,C),yNESS𝒩(0,Σ1,C),y_{DB}\sim\mathcal{N}(0,\Sigma_{0,C}),\qquad y_{NESS}\sim\mathcal{N}(0,\Sigma_{1,C}), (6.130)

with

Σ0,C=CΣ0CT+R,Σ1,C=CΣ1CT+R.\Sigma_{0,C}=C\Sigma_{0}C^{T}+R,\qquad\Sigma_{1,C}=C\Sigma_{1}C^{T}+R. (6.131)

Define the latent covariance defect

M:=Σ0Σ10M:=\Sigma_{0}-\Sigma_{1}\geq 0 (6.132)

and the observed covariance defect

ΛC:=Σ0,CΣ1,C=CMCT0.\Lambda_{C}:=\Sigma_{0,C}-\Sigma_{1,C}=CMC^{T}\geq 0. (6.133)

Define the noisy-channel shadow operator

ΞC:=Σ0,C1/2ΛCΣ0,C1/2.\Xi_{C}:=\Sigma_{0,C}^{-1/2}\Lambda_{C}\Sigma_{0,C}^{-1/2}. (6.134)

Then

0ΞC<I,Σ1,C=Σ0,C1/2(IΞC)Σ0,C1/2.0\leq\Xi_{C}<I,\qquad\Sigma_{1,C}=\Sigma_{0,C}^{1/2}(I-\Xi_{C})\Sigma_{0,C}^{1/2}. (6.135)

If ξ1,,ξp[0,1)\xi_{1},\dots,\xi_{p}\in[0,1) are the eigenvalues of ΞC\Xi_{C}, then

DKL(yNESSyDB)=12i=1p[ξilog(1ξi)],D_{KL}(y_{NESS}\,\|\,y_{DB})=\frac{1}{2}\sum_{i=1}^{p}\Bigl[-\xi_{i}-\log(1-\xi_{i})\Bigr], (6.136)

and

DKL(yDByNESS)=12i=1p[ξi1ξi+log(1ξi)].D_{KL}(y_{DB}\,\|\,y_{NESS})=\frac{1}{2}\sum_{i=1}^{p}\left[\frac{\xi_{i}}{1-\xi_{i}}+\log(1-\xi_{i})\right]. (6.137)
Proof.

The covariance factorisation is immediate from

Σ1,C=Σ0,CΛC.\Sigma_{1,C}=\Sigma_{0,C}-\Lambda_{C}. (6.138)

The KL formulas follow from the standard centred-Gaussian divergence formula applied to

Σ0,C1Σ1,CIΞC.\Sigma_{0,C}^{-1}\Sigma_{1,C}\sim I-\Xi_{C}. (6.139)

No optimisation claim over CC and RR is included here. The theorem gives Gaussian comparison formulas for a fixed linear Gaussian observation channel. The bounded interval [0,1)[0,1) is the natural noisy analogue of the unbounded shadow spectrum: added observation noise forces the observed defect to remain strictly below the noisy baseline covariance.

6.8 Physical interpretation

Section 6 completes the passage from weighted signal geometry to observable statistics.

The shadow operator is the central object. It measures the visible nonequilibrium correction in the correct backbone metric. Large shadow means the observed nonequilibrium Gaussian law is visibly different from the observed detailed-balance Gaussian law. Small shadow means the observed law is close to the detailed-balance backbone even when the full system is strongly nonequilibrium microscopically.

This is the precise sense in which finite observation can hide irreversibility in the compressed quadratic-Gaussian regime. The hiding is not a metaphor. It is a spectral statement, and after backbone whitening it is governed by a second spectrum. The fixed-channel noisy extension above shows that the same Gaussian comparison structure survives beyond deterministic subspace observation, although the corresponding channel-design problem is open.

At this point the classical theorem package is now in place. The nonequilibrium correction is a weighted signal. Its visible share under rank constraint is computable. Observer quality is an alignment problem. Detectability is controlled by a second, backbone-whitened spectrum. Statistical indistinguishability from detailed balance is governed by the shadow operator. The next section shows that the envelope hierarchy also gives spectral readout of the hidden nonequilibrium structure.

7  Spectroscopy and the anatomy of hidden nonequilibrium structure

7.1 The cumulative envelope as a spectral readout

Up to this point, the observable envelope

KdDV=14k=1dsk(ADV)2K_{d}^{DV}=\frac{1}{4}\sum_{k=1}^{d}s_{k}(A_{DV})^{2} (7.1)

has been interpreted as the optimal retained signal at observable dimension dd. That interpretation is already strong, but it is not yet the full story.

The envelope is a cumulative spectral readout of the weighted nonequilibrium signal. Once the bridge identity has identified

ΔDV=14ADVADVT,\Delta_{DV}=\frac{1}{4}\,A_{DV}A_{DV}^{T}, (7.2)

the sequence

{KdDV}d=0n1\{K_{d}^{DV}\}_{d=0}^{n-1} (7.3)

contains the cumulative singular-energy content of ADVA_{DV} mode by mode. The visible nonequilibrium signal retained by the best rank-dd observer is therefore the dd-mode cumulative spectrum of the signal.

This changes the status of the theory. Finite observation is not only a statement about what is lost under compression. The envelope hierarchy is also a diagnostic object: it reveals the spectral anatomy of what is hidden.

To make that precise, set

K0DV:=0.K_{0}^{DV}:=0. (7.4)

The next theorem shows that the envelope increments recover the singular-energy profile.

Theorem 7.1 (Cumulative envelope and ordered spectral increments).

For each d{1,,n1}d\in\{1,\dots,n-1\},

KdDVKd1DV=14sd(ADV)2.K_{d}^{DV}-K_{d-1}^{DV}=\frac{1}{4}\,s_{d}(A_{DV})^{2}. (7.5)

Equivalently, the ordered singular-energy profile of the weighted nonequilibrium signal is obtained by discrete differentiation of the envelope hierarchy.

Proof.

By Theorem 4.2,

KdDV=14k=1dsk(ADV)2.K_{d}^{DV}=\frac{1}{4}\sum_{k=1}^{d}s_{k}(A_{DV})^{2}. (7.6)

Subtracting the corresponding expression for Kd1DVK_{d-1}^{DV} gives

KdDVKd1DV=14sd(ADV)2.K_{d}^{DV}-K_{d-1}^{DV}=\frac{1}{4}\,s_{d}(A_{DV})^{2}. (7.7)

Theorem 7.1 is the decisive spectral statement of the paper. The observable envelope is an cumulative readout of the ordered singular-energy spectrum of the hidden nonequilibrium signal.

This is why the phrase “spectroscopy of nonequilibrium visibility” is not just rhetorical. The envelope hierarchy is a spectral measurement object. If one knows the full sequence KdDVK_{d}^{DV}, one knows the ordered singular-energy profile of the weighted signal.

7.2 Recovery of the singular-energy spectrum

The preceding theorem gives an immediate recovery result.

Corollary 7.2 (Recovery of the ordered singular-energy profile).

For each d{1,,n1}d\in\{1,\dots,n-1\},

sd(ADV)2=4(KdDVKd1DV).s_{d}(A_{DV})^{2}=4\bigl(K_{d}^{DV}-K_{d-1}^{DV}\bigr). (7.8)

Hence the full ordered singular-energy spectrum of ADVA_{DV} is determined exactly by the envelope hierarchy.

Proof.

Multiply the identity of Theorem 7.1 by 44. ∎

Corollary 7.2 is one of the strongest hidden consequences of the finite-observation programme. The envelope hierarchy contains complete information about the ordered weighted singular spectrum of the DV signal. In particular, the envelope is not only enough to state retention and hidden-fraction theorems. It is enough to reconstruct the ordered spectral anatomy of the signal.

This gives the theory a genuinely diagnostic character. A retained-signal curve indexed by observable dimension is often thought of as a cumulative performance measure. Here it is much more. It is a complete cumulative encoding of the signal spectrum itself. What it does not recover is the singular-direction frame, still less the microscopic generator.

It is convenient to record the equivalent statement directly at the level of the positive signal operator ΔDV\Delta_{DV}.

Corollary 7.3 (Recovery of the nonzero spectrum of the DV correction).

The nonzero eigenvalues of ΔDV\Delta_{DV} are

14sk(ADV)2,1krank(ADV),\frac{1}{4}\,s_{k}(A_{DV})^{2},\qquad 1\leq k\leq\operatorname{rank}(A_{DV}), (7.9)

and are recovered from the envelope increments:

λk(ΔDV)=KkDVKk1DV.\lambda_{k}(\Delta_{DV})=K_{k}^{DV}-K_{k-1}^{DV}. (7.10)
Proof.

Since

ΔDV=14ADVADVT,\Delta_{DV}=\frac{1}{4}\,A_{DV}A_{DV}^{T}, (7.11)

the nonzero eigenvalues of ΔDV\Delta_{DV} are 14sk(ADV)2\frac{1}{4}s_{k}(A_{DV})^{2}. The result then follows from Corollary 7.2. ∎

Corollary 7.3 shows that the envelope hierarchy may equally well be read as the cumulative eigenvalue profile of the positive signal operator ΔDV\Delta_{DV}. The signal can therefore be viewed either at the singular-value level through ADVA_{DV} or at the eigenvalue level through ΔDV\Delta_{DV}. The two viewpoints are equivalent.

7.3 Complexity measures from the envelope

Once the envelope hierarchy is known, several structural invariants of the nonequilibrium signal become immediately accessible. The first is the total signal strength:

KtotDV=Kn1DV.K_{\mathrm{tot}}^{DV}=K_{n-1}^{DV}. (7.12)

The second is the top singular energy:

K1DV.K_{1}^{DV}. (7.13)

Together these determine the weighted stable rank.

Corollary 7.4 (Recovery of weighted stable rank).

If ADV0A_{DV}\neq 0, then

sr(ADV)=Kn1DVK1DV.\operatorname{sr}(A_{DV})=\frac{K_{n-1}^{DV}}{K_{1}^{DV}}. (7.14)
Proof.

By definition,

Kn1DV=14k=1n1sk(ADV)2=14ADVF2,K_{n-1}^{DV}=\frac{1}{4}\sum_{k=1}^{n-1}s_{k}(A_{DV})^{2}=\frac{1}{4}\,\|A_{DV}\|_{F}^{2}, (7.15)

while

K1DV=14s1(ADV)2=14ADVop2.K_{1}^{DV}=\frac{1}{4}\,s_{1}(A_{DV})^{2}=\frac{1}{4}\,\|A_{DV}\|_{op}^{2}. (7.16)

Therefore

Kn1DVK1DV=ADVF2ADVop2=sr(ADV).\frac{K_{n-1}^{DV}}{K_{1}^{DV}}=\frac{\|A_{DV}\|_{F}^{2}}{\|A_{DV}\|_{op}^{2}}=\operatorname{sr}(A_{DV}). (7.17)

The weighted stable rank was introduced in Definition 4.6 of Section 4 as the effective dimensionality of the nonequilibrium signal. Corollary 7.4 shows that it is also an envelope observable. It is not an auxiliary definition imposed from outside. It is already encoded in the retention hierarchy.

The envelope also determines the signal rank.

Corollary 7.5 (Recovery of signal rank).

The rank of the weighted signal operator is the number of strictly positive envelope increments:

rank(ADV)=#{d{1,,n1}:KdDV>Kd1DV}.\operatorname{rank}(A_{DV})=\#\{d\in\{1,\dots,n-1\}:K_{d}^{DV}>K_{d-1}^{DV}\}. (7.18)

Equivalently,

rank(ΔDV)=#{d{1,,n1}:KdDV>Kd1DV}.\operatorname{rank}(\Delta_{DV})=\#\{d\in\{1,\dots,n-1\}:K_{d}^{DV}>K_{d-1}^{DV}\}. (7.19)
Proof.

By Corollary 7.2,

KdDV>Kd1DVsd(ADV)>0.K_{d}^{DV}>K_{d-1}^{DV}\quad\Longleftrightarrow\quad s_{d}(A_{DV})>0. (7.20)

The number of positive singular values is the rank of ADVA_{DV}. Since ΔDV=14ADVADVT\Delta_{DV}=\frac{1}{4}A_{DV}A_{DV}^{T}, the ranks coincide. ∎

More generally, every unitarily invariant spectral quantity of ADVA_{DV}, and every spectral quantity of ΔDV\Delta_{DV}, is determined by the envelope sequence. This includes Schatten norms, nuclear norm, operator norm, Frobenius norm, spectral entropy, and any other symmetric functional of the singular-energy profile.

Proposition 7.6 (Spectral completeness of the envelope).

The sequence {KdDV}d=0n1\{K_{d}^{DV}\}_{d=0}^{n-1} determines the full singular-value list of ADVA_{DV}, and hence determines every spectral functional of ADVA_{DV} and every spectral functional of ΔDV\Delta_{DV}.

Proof.

Corollary 7.2 recovers every singular value squared from the successive envelope increments. Any spectral functional is a symmetric function of the singular values, so it is determined by the recovered list. Since ΔDV\Delta_{DV} has nonzero spectrum 14sk(ADV)2\frac{1}{4}s_{k}(A_{DV})^{2}, its spectral functionals are also determined. ∎

Proposition 7.6 is the most compact way to state the diagnostic strength of the theory. The envelope hierarchy determines the eigenvalue profile of ΔDV\Delta_{DV}, equivalently the singular-energy profile 14sk(ADV)2\tfrac{1}{4}s_{k}(A_{DV})^{2}.

7.4 Observability order between systems

The envelope hierarchy now suggests a natural way to compare nonequilibrium systems by finite-observation visibility.

Let Q(1)Q^{(1)} and Q(2)Q^{(2)} be two finite-dimensional irreducible Markov nonequilibrium generators, with corresponding weighted signal operators ADV(1)A_{DV}^{(1)} and ADV(2)A_{DV}^{(2)}, and envelope hierarchies Kd(1)K_{d}^{(1)} and Kd(2)K_{d}^{(2)}. When the reduced dimensions differ, the shorter singular-energy list is understood to be zero-padded before comparison, so the quantifier "for every dd" is unambiguous.

Definition 7.7 (Observability dominance).

We say that Q(1)Q^{(1)} dominates Q(2)Q^{(2)} in the strong observability order if

Kd(1)Kd(2)for every d.K_{d}^{(1)}\geq K_{d}^{(2)}\qquad\text{for every }d. (7.21)

We say that Q(1)Q^{(1)} dominates Q(2)Q^{(2)} in the normalised observability order if

Φd(1)Φd(2)for every d.\Phi_{d}^{(1)}\geq\Phi_{d}^{(2)}\qquad\text{for every }d. (7.22)

The strong order compares absolute visible signal budgets. The normalised order compares how concentrated the signal is independently of overall scale.

The next proposition identifies the underlying spectral meaning of these two orders.

Proposition 7.8 (Spectral meaning of observability dominance).

The following are equivalent:

  1. 1.

    Q(1)Q^{(1)} dominates Q(2)Q^{(2)} in the strong observability order,

  2. 2.

    for every dd,

    k=1dsk(ADV(1))2k=1dsk(ADV(2))2.\sum_{k=1}^{d}s_{k}(A_{DV}^{(1)})^{2}\geq\sum_{k=1}^{d}s_{k}(A_{DV}^{(2)})^{2}. (7.23)

In particular, strong observability dominance is weak majorisation of the squared singular-value vectors, equivalently dominance of the Ky Fan partial sums.

Similarly, if the total signals agree,

Ktot(1)=Ktot(2),K_{\mathrm{tot}}^{(1)}=K_{\mathrm{tot}}^{(2)}, (7.24)

then normalised observability dominance is equivalent to majorisation of the normalised singular-energy profiles.

Proof.

The strong statement is immediate from the definition of the envelope:

Kd(a)=14k=1dsk(ADV(a))2,a{1,2}.K_{d}^{(a)}=\frac{1}{4}\sum_{k=1}^{d}s_{k}(A_{DV}^{(a)})^{2},\qquad a\in\{1,2\}. (7.25)

The factor 1/41/4 is common to both systems and therefore irrelevant to the order.

For the normalised statement, divide both envelope hierarchies by the common total signal. The resulting cumulative fractions are the retention fractions Φd(a)\Phi_{d}^{(a)}. ∎

Proposition 7.8 gives a clean comparative language that the existing literature lacks. Two systems can have the same overall nonequilibrium strength but very different visibility profiles under finite observation. One may be more observable at every observational budget because its signal is more concentrated in the leading modes. The other may be thermodynamically active but spectrally diffuse and therefore harder to access.

This is a central consequence of the theory. The finite-observation programme ranks systems not only by how much nonequilibrium they contain, but by how that nonequilibrium is distributed across observable directions.

7.5 Practical meaning

Section 7 changes the status of the envelope hierarchy in three ways.

First, it shows that the envelope is the cumulative spectral profile of the weighted nonequilibrium signal. The paper is therefore not only about how much finite observers miss, but about the spectral anatomy of what they miss.

Second, it shows that weighted stable rank is not simply a convenient scalar bound. It is an envelope-derived complexity invariant. The same retention hierarchy that determines the optimal visible fraction also determines the effective dimensionality of the signal. The theory is therefore internally closed: the object that controls visibility is extracted from the same spectral data that governs retention.

Third, it provides a new comparative language for nonequilibrium systems. Systems can now be compared by observability profile, not just by total dissipation or total correction size. A system with a highly concentrated signal may be easy to diagnose under severe observational constraints, while a system with a diffuse signal may remain effectively hidden even if its total nonequilibrium strength is large.

It reveals the diagnostic content of the theory. The envelope hierarchy is a spectroscopy of hidden nonequilibrium structure. The backbone-whitened detectability operator reveals a second spectrum, governing observer design against the detailed-balance backbone. Noisy observation channels admit a Gaussian shadow extension, even though the optimal channel-design problem remains open.

That shift has real consequences for the rest of the paper. Suppression and classification under structural assumptions, rank-constrained retention mechanisms, and the weighted signal operator are all now unified in one argument. Section 7 shows that once these ingredients are combined, one gets a cumulative spectral theory of finite nonequilibrium visibility.

The next section uses this spectral viewpoint to reinterpret suppression and shared observed-Gaussian behaviour under structural assumptions as corollaries of the deeper signal theory. That is where the classical part of the paper closes.

8  Projection suppression and shared observed-Gaussian behaviour as corollaries

8.1 Projection suppression revisited

The preceding sections show that the finite-observation problem is governed by two objects: the visible envelope KdDVK_{d}^{DV}, which controls how much of the nonequilibrium correction can survive rank-dd observation, and the shadow operator SΠS_{\Pi}, which compares that visible correction to the projected detailed-balance backbone. This recasts structural projection suppression in a cleaner and more structural way.

A suppression theorem can be established under an explicit family of structural assumptions on the slow and fast sectors, together with a classification of observable normal forms once the projected nonequilibrium correction becomes asymptotically negligible. The key point of the work is that those assumptions are no longer the primitive centre of the theory. They are one sufficient route to a more basic conclusion.

The new primitive statement is this: if the visible envelope is small relative to the observed detailed-balance backbone, then the observed nonequilibrium Gaussian law is close to the observed detailed-balance law. In the notation of Section 6, suppression means that

KdDVλmin(BΠ)\frac{K_{d}^{DV}}{\lambda_{\min}(B_{\Pi})} (8.1)

is small. Everything else is a mechanism for forcing this ratio to be small.

It is therefore useful to state the relationship to the structural suppression result explicitly.

Corollary 8.1 (Gaussian projection suppression criterion).

Let Π\Pi be a rank-dd observable projector. Suppose that a family of generators Q(α)Q^{(\alpha)} satisfies

KdDV(Q(α))λmin(BΠ(α))0as α.\frac{K_{d}^{DV}(Q^{(\alpha)})}{\lambda_{\min}(B_{\Pi}^{(\alpha)})}\to 0\qquad\text{as }\alpha\to\infty. (8.2)

Then the compressed Gaussian fluctuation laws converge, in Kullback-Leibler divergence, total variation, and Hellinger distance, to the corresponding compressed detailed-balance Gaussian laws. In particular, the projected Donsker-Varadhan Hessian becomes asymptotically indistinguishable from the projected detailed-balance backbone at the observed Gaussian level.

Proof.

This follows immediately from Theorem 6.7 and Proposition 6.6. The shadow operator satisfies

SΠ(α)opKdDV(Q(α))λmin(BΠ(α)),\|S_{\Pi}^{(\alpha)}\|_{op}\leq\frac{K_{d}^{DV}(Q^{(\alpha)})}{\lambda_{\min}(B_{\Pi}^{(\alpha)})}, (8.3)

so the hypothesis forces SΠ(α)op0\|S_{\Pi}^{(\alpha)}\|_{op}\to 0. The Gaussian divergence bounds of Section 6 then imply convergence of the observed nonequilibrium laws to the observed detailed-balance laws. ∎

Corollary 8.1 is the precise way in which the structural suppression result is absorbed. The suppression result does not disappear. It is strengthened and reinterpreted. A structural list of hypotheses is now seen as one way of forcing a simpler and more primitive visible-envelope ratio to be small.

8.2 The role of the structural assumptions

A suppression analysis based on five structural assumptions governing the slow-fast geometry of the generator proves asymptotic suppression of the projected nonequilibrium correction. From this viewpoint, those assumptions should be read as engineering conditions that drive the backbone-normalised visible envelope to zero.

This is clearest at the block level. By Theorem 3.5, the observed nonequilibrium correction admits, relative to the chosen H0H_{0}-adapted block decomposition, an intrinsic slow contribution and a hidden-return contribution from the complementary sector. The structural assumptions act on these two blocks in precisely the way now suggested by the finite-observation theory.

First, conditions enforcing small slow-skew action reduce the intrinsic slow contribution. Second, conditions forcing delocalisation or decay of the mixed channel reduce the hidden return contribution. Third, fast-block coercivity penalises any remaining hidden return by weighting it against a stiff fast detailed-balance backbone. Together, these mechanisms drive the visible correction downward.

These assumptions are therefore not arbitrary. They are sufficient conditions for keeping the visible nonequilibrium signal small in comparison with the observed detailed-balance backbone. From this viewpoint, they do not define the suppression phenomenon. They instantiate it.

This reinterpretation is important because it changes the logical status of the suppression result. In a purely structural formulation, the assumptions must be stated as primitive hypotheses because the signal form of the nonequilibrium correction is not yet available. Once the bridge is closed and the weighted envelope is known, the assumptions take their proper place as family-level mechanisms forcing the basic spectral ratio to be small.

One can therefore summarise the relationship as follows:

The structural suppression theorem says that certain slow-fast hypotheses imply projection suppression.

The present theory says that projection suppression occurs whenever the visible envelope is small relative to the observed backbone, and that those hypotheses are one way of ensuring exactly that.

That is a genuine simplification. It compresses a list of family-dependent conditions into a single visibility criterion with geometric and statistical meaning.

8.3 Shared observed-Gaussian behaviour

Once the projected nonequilibrium correction becomes negligible, observable behaviour collapses to the projected normal form (U,gΠ,GΠ,JΠ)(U,g_{\Pi},G_{\Pi},J_{\Pi}). We now reveal why that collapse occurs.

The reason is spectral. The nonequilibrium correction is a positive weighted correction operator. Finite observation can only retain the singular-energy front of that signal. When the visible envelope is small relative to the observed backbone, the observer sees only the projected metric and projected generator sectors to leading order. The finer nonequilibrium structure may persist microscopically, but it is spectrally invisible in the observed Gaussian law.

This yields the following shared-normal-form statement.

Corollary 8.2 (Asymptotic shared observed-Gaussian behaviour under a common projected normal form).

Fix an observable rank dd. Let {Qα(1)}\{Q^{(1)}_{\alpha}\} and {Qα(2)}\{Q^{(2)}_{\alpha}\} be two families of finite-dimensional irreducible Markov generators with the same projected normal form for each α\alpha:

NΠ(Qα(1))=NΠ(Qα(2)).N_{\Pi}(Q^{(1)}_{\alpha})=N_{\Pi}(Q^{(2)}_{\alpha}). (8.4)

Let BΠ,αB_{\Pi,\alpha} denote the common projected detailed-balance backbone determined by that shared normal form, and suppose that for a{1,2}a\in\{1,2\},

KdDV(Qα(a))λmin(BΠ,α)0as α.\frac{K_{d}^{DV}(Q^{(a)}_{\alpha})}{\lambda_{\min}(B_{\Pi,\alpha})}\to 0\qquad\text{as }\alpha\to\infty. (8.5)

Then each observed Gaussian fluctuation law converges, in Kullback-Leibler divergence, total variation, and Hellinger distance, to the common projected detailed-balance Gaussian law determined by BΠ,αB_{\Pi,\alpha}. Consequently, the two observed Gaussian laws converge to one another in total variation and Hellinger distance.

In particular, the observed Gaussian equivalence class is governed asymptotically by the projected normal form once the visible nonequilibrium correction becomes negligible relative to the projected backbone.

Proof.

Since the projected normal forms coincide, the projected detailed-balance backbones agree and are equal to BΠ,αB_{\Pi,\alpha}. For each family, Corollary 8.1 implies convergence of the observed nonequilibrium Gaussian law to the common detailed-balance Gaussian law because

SΠ,α(a)opKdDV(Qα(a))λmin(BΠ,α)0.\|S_{\Pi,\alpha}^{(a)}\|_{op}\leq\frac{K_{d}^{DV}(Q^{(a)}_{\alpha})}{\lambda_{\min}(B_{\Pi,\alpha})}\to 0. (8.6)

The pairwise total-variation and Hellinger conclusions then follow from the triangle inequality for those distances. We do not invoke a triangle inequality for Kullback-Leibler divergence. ∎

Corollary 8.2 gives the final version of this shared-normal-form idea. Different generators can collapse onto the same observed Gaussian class once the projected correction is suppressed relative to the projected backbone. The paper explains the mechanism: finite observation removes most of the weighted nonequilibrium signal, and once the visible remainder is small compared with the backbone, only the projected normal form survives statistically.

In this sense, the shared behaviour is asymptotic and Gaussian. It is a consequence of a spectral bottleneck on nonequilibrium visibility.

8.4 Internal hierarchy of observational equivalence

The internal hierarchy of projected observables now sits naturally inside the final theorem package. It is useful to restate it compactly.

At the coarsest level there is static equivalence: two systems agree on the observed metric structure of the accessible sector. This is the level of UU and gΠg_{\Pi}.

At the next level there is dissipative equivalence: two systems share the same projected dissipative backbone GΠG_{\Pi}, and therefore the same observed detailed-balance Hessian BΠB_{\Pi}.

At the finest level there is projected normal-form equivalence: two systems share the same projected triple (gΠ,GΠ,JΠ)(g_{\Pi},G_{\Pi},J_{\Pi}), and therefore the same observable linear normal form in the absence of visible nonequilibrium correction.

The theory inserts one more statement into this hierarchy. The shadow operator tells us when the observed nonequilibrium correction is too small to disturb this projected hierarchy at the observed Gaussian level. Thus the hierarchy is now:

  1. 1.

    static observable structure,

  2. 2.

    projected dissipative backbone,

  3. 3.

    projected normal form,

  4. 4.

    projected nonequilibrium shadow.

The classification theorem can now be read as saying that once the fourth layer is spectrally negligible, the first three determine the observed class completely.

This is a substantial conceptual improvement over an isolated taxonomy of projected data. The hierarchy is no longer just a nested classification of projected observables. It is the hierarchy of what survives once finite observation has truncated the weighted nonequilibrium signal.

8.5 Parameter compression

The full observable normal form on a rank-dd sector is determined by a finite parameter count, leading to a strong compression of the observable description. That compression result also has a more structural meaning.

The visible nonequilibrium correction is not an arbitrary additional object of the same formal size as the backbone. It is a weighted signal that finite observation can only access through a rank-constrained singular-energy front. Once that visible front is negligible relative to the projected backbone, the observer is left with the projected normal form alone, with its already-known compressed parameter count.

Thus the parameter compression theorem can now be read as the endpoint of a two-step reduction:

  1. 1.

    the weighted nonequilibrium signal is spectrally thinned by finite observation,

  2. 2.

    the remaining observable law collapses onto the projected normal form with its finite parameter budget.

That is the sharper conceptual picture. The finite parameter count is not just a convenient descriptive simplification. It is what is left after the visible nonequilibrium sector has been spectrally exhausted.

9  Abstract weighted geometry and operator-space transfer

9.1 Abstract metric setting

The classical theory developed so far lives on the reduced Euclidean Fisher space, where the detailed-balance Hessian has already been used to whiten the nonequilibrium correction into the signal operator ADVA_{DV}. The next step is to recognise that the linear algebra of visible envelopes, retention fractions, and stable-rank control is not inherently classical. It belongs to a more general weighted Hilbert-space framework.

Let VV be a finite-dimensional real or complex vector space equipped with a positive-definite metric operator MM, so that

x,yM:=x,My\langle x,y\rangle_{M}:=\langle x,My\rangle (9.1)

defines an inner product. We denote the corresponding norm by xM\|x\|_{M}. An operator Π\Pi on VV is called MM-orthogonal if it is idempotent and self-adjoint with respect to ,M\langle\cdot,\cdot\rangle_{M}. Equivalently,

Π2=Π,Π=Π,\Pi^{2}=\Pi,\qquad\Pi^{\sharp}=\Pi, (9.2)

where T:=M1TMT^{\sharp}:=M^{-1}T^{\dagger}M is the MM-adjoint.

Suppose now that a positive semidefinite correction operator Δ\Delta on VV is represented in the weighted geometry through a symmetrised signal factorisation

Δ=BB\Delta=BB^{\sharp} (9.3)

for some operator BB. This is the abstract analogue of the classical identity

ΔDV=14ADVADVT\Delta_{DV}=\frac{1}{4}\,A_{DV}A_{DV}^{T} (9.4)

on the reduced Euclidean Fisher space.

The key observation is that the visible-envelope theory depends only on this weighted signal factorisation and the geometry of MM-orthogonal compression. Once the metric is Euclideanised, the whole classical Ky Fan theory transfers directly.

9.2 Weighted envelopes and retention in the abstract setting

Let Π\Pi be an MM-orthogonal projector of rank dd. The natural visible signal retained by Π\Pi is

VΠ(Δ):=tr(ΠΔΠ),V_{\Pi}(\Delta):=\operatorname{tr}(\Pi\Delta\Pi), (9.5)

where the trace is the algebraic trace on the finite-dimensional space and the Euclideanisation is used only to express the projected Frobenius energy. Because Δ=BB\Delta=BB^{\sharp}, this quantity admits the same projected-energy interpretation as in the classical case.

To state the transfer theorem cleanly, choose the positive-definite self-adjoint square root M1/2M^{1/2}, and define the Euclideanised signal operator

B~:=M1/2BM1/2.\widetilde{B}:=M^{1/2}BM^{-1/2}. (9.6)

Likewise, if Π\Pi is MM-orthogonal, define its Euclideanised projector

Π~:=M1/2ΠM1/2.\widetilde{\Pi}:=M^{1/2}\Pi M^{-1/2}. (9.7)

Then Π~\widetilde{\Pi} is an ordinary Euclidean orthogonal projector of the same rank, and the visible signal may be computed entirely in Euclidean form. Because MM is positive definite, this similarity map is invertible and preserves rank, so rank-dd MM-orthogonal observers correspond exactly to rank-dd Euclidean orthogonal projectors. This is the content of the operator-space transfer theorem proved in this section.

Theorem 9.1 (Abstract weighted envelope theorem).

Let VV be a finite-dimensional metric space with positive-definite metric MM, and let Δ=BB\Delta=BB^{\sharp} be a positive semidefinite correction operator on VV. Define

B~:=M1/2BM1/2,Π~:=M1/2ΠM1/2.\widetilde{B}:=M^{1/2}BM^{-1/2},\qquad\widetilde{\Pi}:=M^{1/2}\Pi M^{-1/2}. (9.8)

Then for every MM-orthogonal projector Π\Pi,

VΠ(Δ)=tr(ΠΔΠ)=Π~B~F2.V_{\Pi}(\Delta)=\operatorname{tr}(\Pi\Delta\Pi)=\|\widetilde{\Pi}\,\widetilde{B}\|_{F}^{2}. (9.9)

Consequently, the optimal rank-dd visible signal is given by the Ky Fan top-singular-energy envelope of B~\widetilde{B}, the retention fraction is the corresponding cumulative singular-energy ratio, and the effective complexity invariant is the stable rank of B~\widetilde{B}.

Proof.

Conjugation by M1/2M^{1/2} sends MM-orthogonal projectors to Euclidean orthogonal projectors. Moreover,

M1/2ΔM1/2=M1/2BBM1/2=M1/2BM1BM1/2=B~B~,M^{1/2}\Delta M^{-1/2}=M^{1/2}BB^{\sharp}M^{-1/2}=M^{1/2}BM^{-1}B^{\dagger}M^{1/2}=\widetilde{B}\,\widetilde{B}^{\dagger}, (9.10)

so the weighted signal factorisation becomes an ordinary Euclidean Gram form. Therefore

tr(ΠΔΠ)=tr(Π~B~B~Π~)=Π~B~F2,\operatorname{tr}(\Pi\Delta\Pi)=\operatorname{tr}(\widetilde{\Pi}\,\widetilde{B}\widetilde{B}^{\dagger}\widetilde{\Pi})=\|\widetilde{\Pi}\,\widetilde{B}\|_{F}^{2}, (9.11)

and the Euclidean projector formula, Ky Fan envelope theorem, retention hierarchy, and stable-rank obstruction apply verbatim. ∎

Proposition 9.2 (Factorisation-gauge invariance).

Suppose Δ=BB=B~B~\Delta=BB^{\sharp}=\widetilde{B}\,\widetilde{B}^{\sharp} with B~=BU\widetilde{B}=BU for an MM-unitary operator UU satisfying UU=IU^{\sharp}U=I. Then the visible signal, envelope hierarchy, retention fractions, stable rank, and ordered singular-energy profile obtained after Euclideanisation are identical for BB and B~\widetilde{B}.

Proof.

Euclideanisation sends UU to an ordinary unitary factor on the right of B~\widetilde{B}. Right multiplication by a unitary does not change singular values, and all stated quantities depend only on those singular values. ∎

This shows that the visibility spectrum depends only on the correction operator Δ\Delta itself, not on the particular square-root factor used to represent its Gram structure.

The content of Theorem 9.1 is not merely a change of coordinates: Euclideanisation preserves the rank-constrained trace objective and transports the Gram correction into ordinary Euclidean form, so the weighted visibility problem becomes exactly a Ky Fan singular-value problem.

Theorem 9.1 is important for two reasons. First, it shows that the visible-envelope machinery is not a curiosity of the classical Fisher reduction. It is a theorem of weighted signal geometry. Second, it makes the quantum continuation of the paper almost automatic at the level of weighted-geometry transfer. Once the physically relevant quantum correction object is identified in a BKM-type metric geometry, the same envelope and retention theory follows by Euclideanisation.

9.3 Classical Fisher geometry as a special case

The finite-dimensional Markov theory developed in Sections 2 to 8 is the first special case of the abstract metric framework.

Indeed, after passing to the reduced Euclidean Fisher coordinates and whitening by the detailed-balance Hessian, the correction takes the ordinary Gram form

ΔDV=14ADVADVT.\Delta_{DV}=\frac{1}{4}\,A_{DV}A_{DV}^{T}. (9.12)

This is a special case of the abstract factorisation Δ=BB\Delta=BB^{\sharp}, with the metric already Euclideanised and the signal operator chosen as

B=12ADV,B=\tfrac{1}{2}A_{DV}, (9.13)

so that BB=14ADVADVT=ΔDVBB^{\sharp}=\tfrac{1}{4}A_{DV}A_{DV}^{T}=\Delta_{DV}.

Thus every theorem of the earlier sections can be re-read as an instance of the abstract weighted geometry theorem, specialised to the finite-dimensional Markov nonequilibrium setting. The classical results are therefore not separate from the theory. They are its first concrete realisation.

This point clarifies what is fundamental in the earlier sections. The bridge theorem is classical and model-specific because it identifies the signal operator ADVA_{DV}. Once that signal is identified, the visible-envelope, retention, alignment, and spectroscopy machinery is generic weighted linear algebra.

9.4 BKM operator geometry as a special case

The second special case is the BKM-symmetrised operator geometry. There the role of the ambient metric is played by the Bogoliubov-Kubo-Mori inner product, or more generally the corresponding positive-definite metric matrix on the finite-dimensional operator space under consideration.

In that setting, projector geometry is no longer Euclidean in the naive coordinate basis. However, after Euclideanisation by the metric square root, MM-orthogonal projectors become ordinary Euclidean projectors, and the weighted signal map becomes an ordinary matrix to which the same singular-value theory applies.

This means that once a linear quantum fluctuation correction is identified in BKM geometry, the following objects transfer:

  1. 1.

    the visible signal retained by a rank-constrained observable sector,

  2. 2.

    the optimal rank-dd envelope,

  3. 3.

    the retention fraction and hidden fraction,

  4. 4.

    the stable-rank complexity invariant,

  5. 5.

    the alignment theorem and random-observer baseline,

  6. 6.

    the spectroscopy hierarchy.

This is a much stronger statement than a vague analogy between classical Fisher geometry and quantum BKM geometry. It is a transfer of the projector-level visibility law, and it should be read at the level of conditional visibility geometry rather than as a complete shadow or detectability transfer.

It also explains why the operator-space step matters even before the physical quantum correction object is identified in full generality. Once such an object is written in weighted Gram form, the whole finite-observation geometry transfers unchanged.

9.5 What transfers and what does not

The abstract metric theorem makes the scope of the operator-space extension very clear.

What transfers is the weighted linear algebra of visibility. If a correction operator in a finite-dimensional metric geometry admits a weighted signal factorisation, then the projector formula, Ky Fan envelope, retention hierarchy, stable-rank invariant, alignment theorem, and spectroscopy corollary all transfer by Euclideanisation. The backbone-whitened detectability geometry of Section 6 does not yet transfer, because no identified quantum correction operator has yet been shown to support the corresponding shadow construction.

What does not automatically transfer is the physical identification of the correction operator itself. In the classical Markov setting, the bridge theorem provides this identification through the reduced-coordinate DV Hessian analysis. In the quantum setting, one still needs a physically justified linear fluctuation object in the appropriate BKM geometry before the abstract weighted theory can be applied. At the algebraic level, the missing step is a BKM-antisymmetry or completion-of-the-square cancellation for the quantum skew channel, which is not automatic for the commutator map in BKM geometry.

This distinction is essential and must remain visible in the final paper. The work proves a classical bridge and an abstract weighted geometry theorem. It then uses the latter to formulate a disciplined linear quantum extension. It does not claim a fully general nonlinear quantum Donsker-Varadhan theorem.

It shows that the classical and quantum parts of the paper are related in the right order. The classical theory is exact because both the physical bridge and the visibility geometry are known. The operator-space part is exact at the geometric level and conditional at the physical fluctuation-identification level.

The next section turns to the linear quantum fluctuation extension itself. It shows how the weighted visibility law fits naturally into recent work on BKM geometry, restricted information, and quantum nonequilibrium thermodynamics.

10  Linear quantum fluctuation extension

10.1 Quantum fluctuation object in BKM coordinates

The abstract weighted geometry of Section 9 shows that the finite-observation machinery transfers once a physically meaningful correction object is identified in a finite-dimensional metric geometry. In the quantum nonequilibrium setting, the natural candidate metric is the Bogoliubov-Kubo-Mori metric, which already appears in recent work on slow quantum nonequilibrium steady-state thermodynamics and geometric dissipation [21, 22, 23]. BKM is used here because of its fluctuation and linear-response relevance, not because it is the unique monotone quantum Fisher metric in the Petz family; different monotone choices would induce different weighted observer geometries [33].

The guiding idea is the following. In the classical Markov setting, Section 3 identifies a fluctuation correction object whose visible share under finite-rank observation is governed by a weighted signal operator. The quantum linear extension seeks the corresponding object in BKM-symmetrised operator coordinates. Once such an object is written in weighted Gram form, the visibility law of Sections 4 to 7 follows from the abstract metric theorem.

We therefore work in a finite-dimensional operator space 𝒱\mathcal{V}, equipped with a positive-definite BKM metric matrix MBKMM_{BKM}. The relevant observable sectors are MBKMM_{BKM}-orthogonal projectors, and the physically meaningful fluctuation object is a linearised correction operator associated with a quantum nonequilibrium steady-state generator. In the paper, we do not attempt to construct the full nonlinear quantum analogue of the classical bridge. Instead, we identify the precise linear fluctuation setting in which the weighted visibility theory transfers.

This distinction matters. The quantum part of the paper is not a speculative appendix to the classical theorem. It is the operator-space continuation that becomes exact once the fluctuation object has been linearised and expressed in the correct BKM geometry. What transfers here is conditional visibility geometry in linearised BKM coordinates, not yet the full backbone-whitened detectability geometry of the classical shadow construction.

10.2 Quantum observable envelope

The operator-space transfer theorem of Section 9 implies that once a quantum fluctuation correction is written in weighted Gram form relative to the BKM metric, its visible signal under finite observation is governed by the same envelope hierarchy as in the classical case. The consequences listed below are therefore conditional: they apply only once a physically meaningful quantum fluctuation correction with the required weighted Gram representation has been identified.

Concretely, let Δq\Delta_{q} be a finite-dimensional positive semidefinite quantum fluctuation correction acting on the BKM operator space, and assume that it admits a weighted signal factorisation

Δq=BqBq,\Delta_{q}=B_{q}B_{q}^{\sharp}, (10.1)

where denotes the adjoint with respect to the BKM metric. Let Π\Pi be an MBKMM_{BKM}-orthogonal projector of rank dd. Then the visible quantum nonequilibrium signal is

VΠ(Δq):=tr(ΠΔqΠ),V_{\Pi}(\Delta_{q}):=\operatorname{tr}(\Pi\Delta_{q}\Pi), (10.2)

and by the abstract theory this is the projected signal energy of the Euclideanised operator B~q:=MBKM1/2BqMBKM1/2\widetilde{B}_{q}:=M_{BKM}^{1/2}B_{q}M_{BKM}^{-1/2}, with Π~:=MBKM1/2ΠMBKM1/2\widetilde{\Pi}:=M_{BKM}^{1/2}\Pi M_{BKM}^{-1/2} and VΠ(Δq)=Π~B~qF2V_{\Pi}(\Delta_{q})=\|\widetilde{\Pi}\,\widetilde{B}_{q}\|_{F}^{2}.

The immediate consequences are direct quantum analogues of the classical theorems:

  1. 1.

    the exact rank-dd visible envelope is given by the Ky Fan top-singular-energy profile of the Euclideanised quantum signal operator,

  2. 2.

    the exact retention fraction is the cumulative singular-energy fraction,

  3. 3.

    the effective observability complexity is the stable rank of the Euclideanised quantum signal operator,

  4. 4.

    the optimal quantum finite observer is the projector onto the dominant singular front,

  5. 5.

    the envelope hierarchy is a spectroscopy of the visible quantum nonequilibrium signal.

Thus, at the level of weighted signal geometry, the classical and linear quantum finite-observation theories are formally identical. What changes is not the projector-level visibility law, but the physical origin and interpretation of the fluctuation object.

This is precisely where the recent BKM and quantum information-geometric literature becomes relevant. BKM geometry is already known to control nonadiabatic entropy production and path-action structure in slow quantum nonequilibrium steady-state transitions [21]. Quantum Fisher decompositions also distinguish incoherent and coherent geometric contributions to thermodynamic and dynamical constraints [22]. The paper adds a complementary statement: once the fluctuation correction is placed in BKM metric form, finite observation has a spectral visibility law.

10.3 Restricted information and quantum observation

The quantum extension is also the natural point of contact with recent work on restricted information and observation-dependent thermodynamic quantities.

Rubino, Brukner, and Manzano show that coarse-grained quantum thermodynamic quantities depend explicitly on observational resolution, even while fluctuation-theorem-type relations survive at each level of access [19]. Pernambuco and Céleri argue that restricted microscopic access should be treated geometrically as a gauge reduction on the space of states, leading to gauge-invariant entropy and fluctuation relations under limited information [20]. These papers differ significantly in mathematical machinery, but they share a common message: thermodynamic content depends on what the observer can resolve.

The present theory gives a new layer beneath that message. In the linear BKM fluctuation regime, restricted observation is not only a question of coarser thermodynamic bookkeeping or gauge-reduced distinguishability. It is a singular-value problem. The observer’s access to quantum nonequilibrium structure is determined by the spectrum and singular-mode geometry of the weighted fluctuation signal.

This suggests a clean conceptual synthesis. Restricted information determines which operator-space directions are accessible. The BKM metric determines the physically correct geometry of fluctuation comparison. The weighted signal operator determines how much nonequilibrium structure those accessible directions can actually retain. In the linear BKM regime, the restricted-information question therefore becomes precise: identify a physically meaningful correction Δq\Delta_{q} admitting Δq=BqBq\Delta_{q}=B_{q}B_{q}^{\sharp}, and the finite-observation visibility theory then follows from the metric-universal Ky Fan framework. In this sense, the theory does not compete with the restricted-information literature. It completes one of its missing linear-algebraic pieces in the fluctuation setting.

10.4 Limits of the present quantum theorem

The operator-space transfer should not be overstated. As stressed at the end of Section 9, the paper proves a classical bridge and an abstract weighted visibility law, and then uses the latter to formulate a disciplined linear quantum extension. It does not claim a general nonlinear quantum Donsker-Varadhan theory, nor a complete quantum shadow theorem at the same level of explicitness as in the classical Markov setting. In particular, the full backbone-whitened detectability geometry of the classical shadow construction has not yet been identified and tested in operator-valued form.

Three limitations are especially important.

First, the physical identification of the quantum fluctuation correction remains linearised. The paper says that if the correction admits the appropriate weighted Gram representation in finite-dimensional BKM geometry, then the finite-observation machinery transfers. It does not derive that representation in full generality from first principles for arbitrary GKLS dynamics.

Second, the operator-space theory does not yet address noisy or non-projective finite observation channels at the same level of completeness. The projectors of the current paper describe sharp finite-rank observation sectors in the underlying geometry. General measurement channels and faulty observation maps remain a next step.

Third, the current paper does not attempt to settle the nonlinear quantum analogue of the diagonal-qubit falsifier and related beyond-quadratic issues discussed in the recent literature on partial observation and quantum thermodynamics. The paper stays deliberately at the linear fluctuation level where the weighted visibility geometry is exact.

These limitations mark the boundary of the work and indicate the next technical steps.

11  Worked Examples

These benchmarks are selected calibration points for the operator theory. Each is read through the same finite-observation ladder: skew source, backbone-weighted signal, hidden spectral tail under rank constraint, and the whitened spectrum controlling detectability against the detailed-balance backbone.

11.1 A four-state two-cycle network from the entropy-estimation literature

We take the four-state, five-link, two-cycle network used in the transition-based waiting-time literature, with rates given in Appendix E, Table IV of van der Meer, Ertel, and Seifert [37]. In that source problem, the observed link is the transition pair 232\leftrightarrow 3, and the forcing parameter FF enters only through the rates on that link. At the benchmark value

F=ln3,F=\ln 3, (11.1)

the rates become

Q=(36.71350.789100.2656.250750277).Q=\begin{pmatrix}-36.7&1&35&0.7\\ 8&-9&1&0\\ 0.2&6&-56.2&50\\ 75&0&2&-77\end{pmatrix}. (11.2)

This first benchmark is genuinely multicyclic, small enough for transparent computation, and already recognised in the entropy-estimation literature. It therefore provides a compact test of the bridge, envelope, shadow, and detectability results on a standard network.

11.2 Envelope benchmark and the induced observed-link sector

For this generator the stationary law is

π(0.381628, 0.207197, 0.247191, 0.163983).\pi\approx(0.381628,\,0.207197,\,0.247191,\,0.163983). (11.3)

The reduced Fisher space has dimension m=3m=3. The computed weighted signal operator ADVA_{DV} has singular values

s1(ADV)7.672020,s2(ADV)6.298419,s3(ADV)=0,s_{1}(A_{DV})\approx 7.672020,\qquad s_{2}(A_{DV})\approx 6.298419,\qquad s_{3}(A_{DV})=0, (11.4)

so the active nonequilibrium geometry is rank two. In reduced dimension three this is structural: the real skew carrier has rank at most two, so there are at most two nonzero singular values. The weighted stable rank is

sr(ADV)1.673975.\operatorname{sr}(A_{DV})\approx 1.673975. (11.5)

The Ky Fan visibility levels are therefore

K1DV14.71497,K2DV=K3DV24.63249,K_{1}^{DV}\approx 14.71497,\qquad K_{2}^{DV}=K_{3}^{DV}\approx 24.63249, (11.6)

which gives retained fractions

Φ1DV0.597381,Φ2DV=1.\Phi_{1}^{DV}\approx 0.597381,\qquad\Phi_{2}^{DV}=1. (11.7)

Thus a single unconstrained optimal observable direction already retains about 59.7%59.7\% of the full Gaussian nonequilibrium signal, while two directions recover the entire active sector. The random rank-one baseline is 1/31/3.

The bridge relation is also numerically sharp in this example. Direct computation gives

ΔDV14J^H01J^TFΔDVF1.38×106,\frac{\left\|\Delta_{DV}-\tfrac{1}{4}\widehat{J}H_{0}^{-1}\widehat{J}^{T}\right\|_{F}}{\|\Delta_{DV}\|_{F}}\approx 1.38\times 10^{-6}, (11.8)

which is a finite-precision numerical reconstruction residual rather than a structural mismatch. The benchmark is therefore not merely illustrative at the level of the envelope. It is also quantitatively consistent with the bridge developed in Section 3.

Refer to caption
Figure 1: Observable visibility envelope for the four-state two-cycle benchmark at F=ln3F=\ln 3. The reduced nonequilibrium signal is rank two in a three-dimensional reduced Fisher space. The rank-one retained fraction is Φ1DV0.597\Phi_{1}^{DV}\approx 0.597, while Φ2DV=1\Phi_{2}^{DV}=1, so two observable directions recover the entire active sector. Dashed lines indicate the random-observer baselines 1/31/3 and 2/32/3.

Figure 1 makes the unconstrained envelope structure explicit. To connect the benchmark directly to the source observation pattern, we now instantiate the actually observed link as an orthogonal sector inside the theorem class of the paper.

The waiting-time estimator of [37] is built from transitions along the observed edge 232\leftrightarrow 3. That observable is not literally an orthogonal projector on the reduced Fisher space, so we take its canonical Fisher-orthogonal rank-one surrogate

b23:=Dπ1/2(e2e3)Tπ,q23:=CTb23CTb23,Πobs:=q23q23T.b_{23}:=D_{\pi}^{-1/2}(e_{2}-e_{3})\in T_{\pi},\qquad q_{23}:=\frac{C^{T}b_{23}}{\|C^{T}b_{23}\|},\qquad\Pi_{\mathrm{obs}}:=q_{23}q_{23}^{T}. (11.9)

Because b23,eπ=11=0\langle b_{23},e_{\pi}\rangle=1-1=0, this direction lies naturally in the Fisher tangent space. It is the orthogonal observer induced by the physical access pattern observe only the 232\leftrightarrow 3 link, while remaining inside the orthogonal-compression framework of Sections 2 to 6.

For this literature-induced sector we obtain

VobsDV=tr(ΠobsΔDV)4.32702,ΦobsDV=VobsDVtr(ΔDV)0.175663.V_{\mathrm{obs}}^{DV}=\operatorname{tr}(\Pi_{\mathrm{obs}}\Delta_{DV})\approx 4.32702,\qquad\Phi_{\mathrm{obs}}^{DV}=\frac{V_{\mathrm{obs}}^{DV}}{\operatorname{tr}(\Delta_{DV})}\approx 0.175663. (11.10)

Thus the actual observed edge captures well below the unconstrained optimum Φ1DV0.597381\Phi_{1}^{DV}\approx 0.597381, and even below the blind rank-one baseline 1/31/3. At the raw-signal level, the source observable is therefore strongly misaligned with the dominant singular front of ADVA_{DV}.

The shadow statistics tell a more refined story. For the same sector,

Bobs:=ΠobsH0Πobs|RanΠobs,Eobs:=ΠobsΔDVΠobs|RanΠobs,B_{\mathrm{obs}}:=\Pi_{\mathrm{obs}}H_{0}\Pi_{\mathrm{obs}}|_{\operatorname{Ran}\Pi_{\mathrm{obs}}},\qquad E_{\mathrm{obs}}:=\Pi_{\mathrm{obs}}\Delta_{DV}\Pi_{\mathrm{obs}}|_{\operatorname{Ran}\Pi_{\mathrm{obs}}}, (11.11)

so in this rank-one case the shadow score is the scalar

Sobs=Bobs1/2EobsBobs1/20.252725.S_{\mathrm{obs}}=B_{\mathrm{obs}}^{-1/2}E_{\mathrm{obs}}B_{\mathrm{obs}}^{-1/2}\approx 0.252725. (11.12)

The reverse Gaussian KL divergence is therefore

DKL(𝒩DB,obs𝒩NESS,obs)=12(Sobslog(1+Sobs))0.01370,D_{KL}\!\left(\mathcal{N}_{DB,\mathrm{obs}}\,\|\,\mathcal{N}_{NESS,\mathrm{obs}}\right)=\frac{1}{2}\Bigl(S_{\mathrm{obs}}-\log(1+S_{\mathrm{obs}})\Bigr)\approx 0.01370, (11.13)

which gives

TV(𝒩DB,obs,𝒩NESS,obs)0.0828.\operatorname{TV}\!\left(\mathcal{N}_{DB,\mathrm{obs}},\mathcal{N}_{NESS,\mathrm{obs}}\right)\leq 0.0828. (11.14)

This already separates two questions that are blurred in much of the partial-observation literature. The physically observed edge is poor as a raw proxy for the full nonequilibrium signal, but it is less poor after backbone normalisation. Indeed, with tr(T)0.597640\operatorname{tr}(T)\approx 0.597640 and Θ10.298820\Theta_{1}\approx 0.298820, the detectable fraction of the actual observed sector is

Φ~obs:=tr(Sobs)tr(T)0.422872,\widetilde{\Phi}_{\mathrm{obs}}:=\frac{\operatorname{tr}(S_{\mathrm{obs}})}{\operatorname{tr}(T)}\approx 0.422872, (11.15)

to be compared with the detectability optimum 1/21/2. At F=ln3F=\ln 3, the observed edge therefore sits below the raw rank-one baseline in visibility, but above the natural rank-one whitened benchmark in backbone-normalised detectability. This is the cleanest indication, on this benchmark, that the detectability landscape is materially flatter than the raw-visibility landscape.

Table 1: Rank-one comparison at F=ln3F=\ln 3 for the four-state two-cycle benchmark. For raw visibility, the random row uses the Grassmannian rank-one expectation. On the detectability side, the quoted comparison uses the natural whitened rank-one benchmark tr(T)/3\operatorname{tr}(T)/3. The raw-optimal row maximises ΦDV\Phi^{DV}, the observed row is the literature-induced edge sector Πobs\Pi_{\mathrm{obs}}, and the detectability-optimal row maximises tr(S)\operatorname{tr}(S).
Observer sector ΦDV\Phi^{DV} tr(S)\operatorname{tr}(S) Φ~=tr(S)/tr(T)\widetilde{\Phi}=\operatorname{tr}(S)/\operatorname{tr}(T) TV bound
Random raw baseline / whitened benchmark 1/31/3 0.1992130.199213 1/31/3
Raw-optimal rank-one 0.5973810.597381 0.2922040.292204 0.4889300.488930 0.09470.0947
Observed 232\leftrightarrow 3 sector 0.1756630.175663 0.2527250.252725 0.4228720.422872 0.08280.0828
Detectability-optimal rank-one 0.3973260.397326 0.2988200.298820 0.5000000.500000 0.09660.0966

Table 1 is the main point of the worked example. It shows that one can now rank concrete observation schemes geometrically. The gap between the observed 232\leftrightarrow 3 sector and the raw optimum is an exact alignment deficit, not a vague information-loss slogan. At the same time, the smaller gap in Φ~\widetilde{\Phi} shows that backbone-normalised detectability can be materially less pessimistic than raw signal retention.

11.3 A short forcing sweep on the actual observed sector

Because the source family is parametrised by a single force FF acting on the observed link, it also furnishes a natural one-parameter sweep. Figure 2 plots

FΦobsDV(F),Ftr(Sobs(F)),F\mapsto\Phi_{\mathrm{obs}}^{DV}(F),\qquad F\mapsto\operatorname{tr}(S_{\mathrm{obs}}(F)), (11.16)

for the same induced observed-link sector Πobs(F)\Pi_{\mathrm{obs}}(F).

Across the range F[2,4]F\in[-2,4], the raw retained fraction rises from about 0.0120.012 to about 0.6960.696, while the shadow trace rises from about 0.0190.019 to about 0.3070.307. The separation is already clear at moderate forcing: at F=0F=0, the observed sector still retains only ΦobsDV0.081\Phi_{\mathrm{obs}}^{DV}\approx 0.081 of the total raw signal, but its backbone-normalised shadow strength is already tr(Sobs)0.174\operatorname{tr}(S_{\mathrm{obs}})\approx 0.174. This is the distinction between raw visibility and backbone-normalised detectability formalised in Section 6.

2-21-101122334400.20.20.40.40.60.6forcing FFrank-one scoreΦobsDV(F)\Phi_{\mathrm{obs}}^{DV}(F)tr(Sobs(F))\operatorname{tr}(S_{\mathrm{obs}}(F))1/31/3 raw baselineF=ln3F=\ln 3
Figure 2: Observed-link forcing sweep for the edge-induced orthogonal sector Πobs(F)\Pi_{\mathrm{obs}}(F) associated with the measured 232\leftrightarrow 3 link. Blue shows the raw retained fraction ΦobsDV(F)\Phi_{\mathrm{obs}}^{DV}(F). Orange shows the shadow trace tr(Sobs(F))\operatorname{tr}(S_{\mathrm{obs}}(F)). The grey dashed line marks the raw random rank-one baseline 1/31/3, and the vertical dotted line marks the benchmark value F=ln3F=\ln 3. The two curves separate visibly, showing that backbone-normalised detectability and raw signal retention are distinct geometric questions even for the same physical observation channel.

The worked benchmark shows that the present geometry can compare the actual source observable with the visibility-optimal and detectability-optimal observers, and can track how that gap changes across a physically motivated forcing family.

11.4 A five-state ribosome proofreading benchmark from the speed-accuracy literature

The four-state benchmark shows that the theorem package can compare actual and optimal observers on a standard partial-observation network. We now test the same machinery on a biologically canonical proofreading model. Banerjee, Kolomeisky, and Igoshin analyse aa-tRNA selection by the E. coli ribosome through a five-state kinetic-proofreading network, together with hyperaccurate and error-prone mutants, and argue that the experimentally relevant regime is organised primarily by speed, with energetic proofreading cost as an additional constraint rather than by direct minimisation of error alone [38].

To place that system inside the finite-observation framework of the present paper, we use the closed turnover continuous-time Markov model on the state set

(E,ER,ER,EW,EW),(E,\,ER,\,ER^{\ast},\,EW,\,EW^{\ast}), (11.17)

where EE is the free ribosome, ERER and ERER^{\ast} are the cognate branch before and after hydrolysis, and EWEW and EWEW^{\ast} are the near-cognate branch before and after hydrolysis. The right-pathway rates and discrimination factors are taken directly from the Banerjee supporting-information tables for the wild type (WT), hyperaccurate mutant (HYP, rpsL141\mathrm{rpsL141}), and error-prone mutant (ERR, rpsD12\mathrm{rpsD12}) ribosomes [38].

As in Banerjee’s translation analysis, we impose the nearly irreversible choices k2,R=k3,R=103s1k_{-2,R}=k_{-3,R}=10^{-3}\,\mathrm{s}^{-1} and f2=1f_{-2}=1, and derive f3f_{-3} from the cycle constraint. The generator used here is not the backward first-passage operator from the source paper. It is the ergodic turnover generator in which both catalytic completion and proofreading reset return the system to the free state EE.

Before applying finite observation, we validate the reconstruction against the source biology. The stationary fluxes recover the correct speed and error ordering

speed: WT>HYP>ERR,error: HYP<WT<ERR,\text{speed: WT}>\text{HYP}>\text{ERR},\qquad\text{error: HYP}<\text{WT}<\text{ERR}, (11.18)

and the flux-based proofreading cost agrees with the analytic Banerjee formula to relative error below 2×1032\times 10^{-3} for all three variants. The benchmark is a source-locked turnover model that reproduces the intended biological regime before any spectral analysis is performed.

11.5 Raw spectral concentration and interpretation of effective complexity

The reduced Fisher tangent space has dimension m=4m=4 for each ribosome variant. Figure 3 and Table 2 show the singular spectrum of the weighted signal operator ADVA_{DV} and the associated Ky Fan retention hierarchy.

Across all three variants the raw nonequilibrium signal is sharply concentrated. The weighted stable rank lies in the narrow interval

1.4130sr(ADV)1.5166,1.4130\leq\operatorname{sr}(A_{DV})\leq 1.5166, (11.19)

while the rank-one retained fractions satisfy

0.6594Φ1DV0.7077.0.6594\leq\Phi^{DV}_{1}\leq 0.7077. (11.20)

More importantly, two observer directions already recover almost the entire Donsker-Varadhan correction:

Φ2DV(WT)0.9867,Φ2DV(HYP)0.9913,Φ2DV(ERR)0.9504.\Phi^{DV}_{2}(\mathrm{WT})\approx 0.9867,\qquad\Phi^{DV}_{2}(\mathrm{HYP})\approx 0.9913,\qquad\Phi^{DV}_{2}(\mathrm{ERR})\approx 0.9504. (11.21)

Thus the active signal is effectively rank two in a four-dimensional reduced Fisher space, despite the fact that the underlying proofreading network is multibranch and is usually discussed through several competing biological performance measures. Within the raw finite-observation geometry, the benchmark exhibits a pronounced appearance of spectral simplicity despite topological and functional richness: topological complexity does not imply spectral complexity.

Refer to caption
Figure 3: Raw weighted-signal spectrum and cumulative Ky Fan retention for the Banerjee ribosome benchmark. For WT, HYP, and ERR, the singular front of ADVA_{DV} is sharply concentrated. Rank one retains roughly two thirds of the full correction, and rank two retains more than 95%95\% in every variant.
Table 2: Finite-observation summary for the Banerjee ribosome benchmark. The last two columns separate raw concentration from backbone-normalised detectability concentration. Raw rank two suffices for all three variants, whereas the ERR mutant requires full rank to exceed the 90%90\% detectability threshold.
Variant sr(ADV)\operatorname{sr}(A_{DV}) Φ1DV\Phi^{DV}_{1} Φ2DV\Phi^{DV}_{2} d0.9rawd_{0.9}^{\mathrm{raw}} d0.9detd_{0.9}^{\mathrm{det}} top θk\theta_{k}
WT 1.4709 0.6799 0.9867 2 2 0.324613
HYP 1.4130 0.7077 0.9913 2 2 0.320700
ERR 1.5166 0.6594 0.9504 2 4 0.327211

11.6 Backbone-normalised detectability and biologically legible observer directions

The whitened detectability spectrum sharpens the comparison between variants. Figure 4 shows that WT and HYP have an almost perfectly rank-two detectability structure: in both cases a nearly degenerate leading pair at

θ1θ20.32\theta_{1}\approx\theta_{2}\approx 0.32 (11.22)

dominates, while the residual tail is tiny,

θ3=θ40.0062for WT,θ3=θ40.0026for HYP.\theta_{3}=\theta_{4}\approx 0.0062\quad\text{for WT},\qquad\theta_{3}=\theta_{4}\approx 0.0026\quad\text{for HYP}. (11.23)

Consequently, two detectability directions already capture more than 98%98\% of the backbone-normalised signal for WT and HYP. The ERR mutant shows a more mixed geometry. Its leading pair remains dominant,

θ1θ20.3272,\theta_{1}\approx\theta_{2}\approx 0.3272, (11.24)

but the lower pair remains substantial,

θ3θ40.1405,\theta_{3}\approx\theta_{4}\approx 0.1405, (11.25)

so rank two captures only about 70%70\% of detectability and one needs full rank to exceed the 90%90\% threshold. Raw retention is therefore highly concentrated in all three variants, but detectability distinguishes the speed-optimised WT and HYP variants from the more diffuse ERR mutant.

Refer to caption
Figure 4: Backbone-normalised detectability spectrum for the Banerjee ribosome benchmark. WT and HYP are nearly rank two after whitening, while ERR retains a substantial lower pair. This is the clearest place where raw visibility and detectability separate across biologically meaningful variants.

Figure 5 shows that the dominant observer directions are also biologically legible. Up to the usual overall sign convention, the top raw observer loads primarily on the cognate branch EERERE\leftrightarrow ER\leftrightarrow ER^{\ast}, while the subdominant direction separates cognate from near-cognate structure. The top detectability observer places its weight mainly on the hydrolysis stage, which is consistent with the role of ERERER\to ER^{\ast} as the main distinguishability channel after backbone normalisation and with hydrolysis as the natural discrimination checkpoint of the proofreading cycle. The observer geometry is therefore not only low rank. It is interpretable in terms of the proofreading mechanism itself. As the matched-null comparison later makes clear, however, the resulting low-rank concentration is not by itself specific evidence for proofreading architecture.

Refer to caption
Figure 5: Top raw and top detectability observer loadings for WT, HYP, and ERR. The labels EE, ERER, ERER^{\ast}, EWEW, and EWEW^{\ast} denote the free, cognate pre-hydrolysis, cognate post-hydrolysis, near-cognate pre-hydrolysis, and near-cognate post-hydrolysis states. Overall signs are conventional. The dominant directions remain concentrated on biologically recognisable proofreading coordinates rather than on diffuse mixtures of all states.

11.7 Robustness under hydrolysis-rate variation

Banerjee’s own speed-accuracy analysis identifies the hydrolysis step as a key kinetic control axis for the WT ribosome [38]. We therefore perform a one-parameter finite-observation sweep over k2,Rk_{2,R} while keeping the remaining WT parameters fixed. Figure 6 shows that the low-rank picture is robust across this family. The rank-one retained fraction stays above 0.660.66, the rank-two retained fraction stays above 0.9690.969, the weighted stable rank remains close to 1.51.5, and the top detectability eigenvalue rises smoothly toward a plateau near 0.330.33. Across the hydrolysis-rate sweep, the dominant detectability structure remains low-rank and varies smoothly. There is no sharp spectral transition in the biologically relevant band. The spectral simplicity of the WT proofreading network is therefore a structural feature of the benchmark family, not a knife-edge artefact of one fitted parameter set.

Refer to caption
Figure 6: WT hydrolysis-rate sweep for the Banerjee ribosome benchmark. The raw rank-one retained fraction, raw rank-two retained fraction, weighted stable rank, and top detectability eigenvalue remain in a narrow low-rank regime across the relevant range of k2,Rk_{2,R}. The dashed vertical line marks the WT value from the source model.

Taken together, the Banerjee benchmark upgrades the theorem package from a compact literature network to a biologically canonical proofreading system with experimentally grounded parameters and variant structure. The conclusion is unusually clean. A network that is functionally rich enough to support speed-accuracy-cost trade-off analysis can still be spectrally simple in the finite-observation geometry. In this benchmark, most of the nonequilibrium correction lives in two observer directions, and the remaining distinction between variants becomes visible only after backbone whitening.

11.8 A matched random null for the Banerjee benchmark

The Banerjee ribosome benchmark is useful, but its structural interpretation must be stated carefully. We therefore compare the WT proofreading network against a matched null ensemble of dense random five-state nonequilibrium CTMCs with the same mean exit-rate scale and with total DV energy restricted to a narrow band around the real benchmark. The null ensemble was designed to answer a specific question: is the strong raw rank-two compression in the ribosome case a special fingerprint of proofreading architecture, or is it largely a dimensional effect of working in a four-dimensional reduced Fisher space?

This random-ensemble perspective is also consonant with recent work showing that, in broad classes of random Markov models, many irreversibility-sensitive observables are controlled primarily by heterogeneity rather than by asymmetry alone except near symmetry [39].

The answer is the latter. As Figure 7 shows, across the primary raw metrics the real Banerjee WT point sits close to the middle of the matched null distribution rather than in an extreme low-rank tail. In particular,

Φ1DV(WT)0.6799,Φ2DV(WT)0.9867,sr(ADV)1.4709,\Phi^{DV}_{1}(\mathrm{WT})\approx 0.6799,\qquad\Phi^{DV}_{2}(\mathrm{WT})\approx 0.9867,\qquad\operatorname{sr}(A_{DV})\approx 1.4709, (11.26)

so the WT point sits close to the middle of the sampled null ensemble on all three raw metrics. Thus the Banerjee network remains an important demonstration that the finite-observation machinery can be applied to a real biochemical system with biologically legible observer directions, but the raw low-rank compression itself cannot be claimed as a special consequence of proofreading architecture.

Refer to caption
Figure 7: Matched random null for the Banerjee ribosome benchmark. The WT proofreading network lies near the centre of the null distribution for the main raw concentration measures once the total DV scale is matched. The benchmark therefore remains useful as a biologically interpretable worked example, but its strong raw rank-two concentration is not by itself evidence for a proofreading-specific structural simplification.

11.9 A force-driven kinesin benchmark from the molecular-motor literature

To test whether the same spectral compression extends beyond proofreading, we next turn to the chemomechanical kinesin model of Liepelt and Lipowsky [40, 41]. This benchmark is mechanistically distinct from the Banerjee ribosome network. Its primary form is a six-state motor with two competing chemomechanical cycles and one purely dissipative cycle, together with explicit load-force control through a mechanical load-distribution factor and force-sensitive chemical prefactors. The supplement also gives a reduced seven-state small-load extension in which a doubly ADP-bound state opens an additional forward cycle. We use the source-locked six-state model at arbitrary load, and the reduced seven-state model only in the zero-load regime where the source supplement explicitly justifies that truncation and supplies the extra rates.

For the six-state model the transition rates are built in the source convention as

ωij=κijIij([ATP],[ADP],[P])Φij(F),\omega_{ij}=\kappa_{ij}\,I_{ij}([ATP],[ADP],[P])\,\Phi_{ij}(F), (11.27)

with rate constants from Table I of [40], force parameters from Table II and Appendix A of [41], and the backward-cycle rate κ54=(κ52/κ25)2κ21\kappa_{54}=(\kappa_{52}/\kappa_{25})^{2}\kappa_{21} imposed as in the source derivation. The reduced seven-state model retains only the additional edges 171\leftrightarrow 7 and 575\leftrightarrow 7, again as prescribed in Appendix D of [41].

Before applying finite observation, we validate the reconstruction against the source dynamics: both force-data parametrisations reproduce a stall force near 7.2pN7.2\,\mathrm{pN}, the six-state model reproduces the source asymmetry between [P][P]- and [ADP][ADP]-dependence at zero load, and the reduced seven-state model restores the missing high-ADP slowdown while producing the predicted crossover to the added FDDF_{DD} cycle at [ADP]1083μM[ADP]\approx 1083\,\mu\mathrm{M}.

11.10 Raw concentration across force and concentration

The six-state kinesin benchmark is sharply low-rank across the tested regimes. At zero load, all three published source parametrisations are essentially rank one in the raw Donsker–Varadhan correction:

Φ1DV([15],F=0)0.9777,Φ1DV([9],F=0)0.9988,Φ1DV([12],F=0)0.9563,\Phi^{DV}_{1}(\mathrm{[15]},F=0)\approx 0.9777,\qquad\Phi^{DV}_{1}(\mathrm{[9]},F=0)\approx 0.9988,\qquad\Phi^{DV}_{1}(\mathrm{[12]},F=0)\approx 0.9563, (11.28)

with weighted stable rank in the narrow interval

1.0012sr(ADV)1.0457.1.0012\leq\operatorname{sr}(A_{DV})\leq 1.0457. (11.29)

Thus a single observer direction already captures more than 95%95\% of the nonequilibrium correction in every zero-load case.

Figure 8 shows how this picture evolves under load for the two source force-data parametrisations. Broadening does occur near stall, but it is physically transparent rather than pathological. For the [15] fit, rank-one retention drops from 0.97770.9777 at zero load to about 0.52600.5260 near 7pN7\,\mathrm{pN}, while the weighted stable rank rises from 1.02281.0228 to 1.90121.9012.

For the [9] fit, the broadening is milder, with Φ1DV0.6462\Phi_{1}^{DV}\approx 0.6462 and sr(ADV)1.5474\operatorname{sr}(A_{DV})\approx 1.5474 at 7pN7\,\mathrm{pN}. In both cases, however, the low-rank tendency persists away from the stall region. This is the behaviour one would expect if the singular front is controlled by the competition between forward and backward chemomechanical cycles: the spectrum is narrow when one cycle dominates and broadens only when the cycle currents come close to balance.

Refer to caption
Figure 8: Six-state kinesin benchmark under force. Left panels: singular values of the weighted signal operator ADVA_{DV} for the [15] and [9] source fits. Middle panels: cumulative raw Ky Fan retention fractions Φ1DV\Phi_{1}^{DV} and Φ2DV\Phi_{2}^{DV}. Right panels: weighted stable rank. The signal is almost rank one at low load and broadens only near stall, where the forward and backward chemomechanical cycles compete most strongly.

The zero-load concentration stress test in Figure 9 shows a second important feature. The six-state geometry is almost insensitive to [P][P], for which the source paper already reports good kinetic agreement, while [ADP][ADP] produces only a mild spectral shift even in the regime where the six-state velocity law is known to underpredict the slowdown. For the [12] parametrisation at F=0F=0, the raw rank-one retained fraction stays near 0.9560.956 throughout the [P][P]-sweep and rises only slightly, from about 0.9580.958 to 0.9670.967, over four decades of [ADP][ADP]. Thus the kinetic failure of the six-state model at high ADP is not a failure of raw spectral concentration.

Refer to caption
Figure 9: Zero-load concentration stress test for the six-state kinesin model using the [12] source parametrisation. The [P][P]-sweep leaves the raw singular spectrum and cumulative retention almost unchanged. The [ADP][ADP]-sweep produces a mild increase in concentration while the reference velocity falls strongly, matching the source observation that the six-state model captures the phosphate trend but underestimates the ADP slowdown.

11.11 Backbone-normalised detectability and the reduced seven-state extension

The whitened detectability spectrum is materially broader than the raw spectrum. Figure 10 shows that the top detectability eigenvalue remains of order 10210^{-2} to 10110^{-1}, but the detectability mass is spread over more directions than the raw DV correction. In the representative six-state cases of Table 3, one typically needs rank four to exceed the 90%90\% detectability threshold even when the raw signal is already more than 95%95\% concentrated in rank one. This reproduces, in a mechanochemically different system, the same separation between raw visibility and backbone-normalised detectability that was already visible in the ribosome benchmark.

Refer to caption
Figure 10: Backbone-normalised detectability for the six-state kinesin benchmark under force. Detectability is substantially broader than the raw weighted signal, and the broadening becomes strongest near stall. The theory therefore distinguishes raw nonequilibrium visibility from statistical distinguishability against the detailed-balance backbone even within the same molecular-motor family.

The reduced seven-state model strengthens the cross-model recurrence case further. Its purpose in the source literature is to repair the missing [ADP][ADP]-dependence of the six-state motor by adding a doubly ADP-bound state and the corresponding forward cycle FDD+=|12571F_{DD}^{+}=|12571\rangle. In the finite-observation geometry, however, the added mechanistic structure does not broaden the signal. Figure 11 shows that the rank-one retained fraction actually increases with [ADP][ADP], from about 0.95600.9560 at 1μM1\,\mu\mathrm{M} to 0.97400.9740 at 5000μM5000\,\mu\mathrm{M}, while the weighted stable rank falls from 1.04601.0460 to 1.02671.0267. At the same time, the top detectability eigenvalue decreases from 6.24×1026.24\times 10^{-2} to 2.82×1022.82\times 10^{-2}, and the minimal detectability rank for 90%90\% retention improves from four to two. The source paper’s extra cycle becomes dynamically important without destroying the low-rank observer geometry.

Refer to caption
Figure 11: Reduced seven-state kinesin benchmark at zero load under an [ADP][ADP] sweep. The added doubly ADP-bound state and cycle FDD+=|12571F_{DD}^{+}=|12571\rangle improve the source kinetic fit at high ADP, but they do not broaden the finite-observation geometry. Raw rank-one retention increases, the stable rank falls slightly, and detectability becomes easier to compress at large ADP.
Table 3: Representative finite-observation summary for the kinesin benchmark. Raw rank-one concentration is already extreme at low load and remains strong in the reduced seven-state extension. Detectability is broader than raw visibility in the six-state motor but becomes easier to compress in the high-ADP seven-state regime.
Case nn Φ1DV\Phi^{DV}_{1} Φ2DV\Phi^{DV}_{2} sr(ADV)\operatorname{sr}(A_{DV}) top θ1\theta_{1} d0.9rawd^{\mathrm{raw}}_{0.9} d0.9detd^{\mathrm{det}}_{0.9}
6s,[15], F=0F=0 6 0.9777 0.9911 1.0228 0.0623 1 4
6s,[15], F=7pNF=7\,\mathrm{pN} 6 0.5260 0.8695 1.9012 0.0465 3 4
6s,[9], F=0F=0 6 0.9988 0.9995 1.0012 0.0623 1 4
6s,[12], F=0F=0 6 0.9563 0.9825 1.0457 0.0624 1 4
7s,[12], [ADP]=5000μM[ADP]=5000\,\mu\mathrm{M} 7 0.9740 0.9966 1.0267 0.0282 1 2

Figure 12 shows that the leading observer directions remain structured rather than diffuse. In the six-state family, the dominant raw and detectability directions concentrate on only a few numbered states at a time, and in the seven-state ADP regime the new state 7 enters coherently rather than spreading weight uniformly across the enlarged network. This again points to a low-dimensional active nonequilibrium core rather than to generic high-dimensional mixing.

Refer to caption
Figure 12: Leading raw and detectability observer loadings for representative six-state and reduced seven-state kinesin operating points in the canonical numbered state basis. Overall signs are conventional. The dominant directions remain concentrated on a small number of states and reorganise coherently as load or ADP changes, rather than diffusing across the full state graph.

Taken together, the kinesin benchmark materially strengthens the case for cross-model recurrence. The Liepelt–Lipowsky motor is not a proofreading network. It has competing chemomechanical cycles, explicit load-force control, and, in the reduced seven-state extension, a third forward cycle that becomes dominant at high ADP. Yet the finite-observation geometry is at least as concentrated as in the Banerjee ribosome benchmark across most of the tested regimes. The one place where concentration weakens, near stall, is physically transparent: it is exactly where the forward and backward motor cycles come closest to balance. This is therefore not a failure of the low-rank theory but one of its clearest mechanistic confirmations.

11.12 Matched negative controls for the kinesin motor benchmark

Unlike the Banerjee benchmark, the kinesin benchmark behaves differently. Here the positive result survives matched negative controls. We compare three real operating points against graph-matched nonequilibrium control ensembles: anchor A, the six-state motor at zero load; anchor B, the same six-state model near stall; and anchor C, the reduced seven-state model at zero load and high ADP. Two control classes are used. NC1 keeps the graph but replaces the structured motor rates by random positive rates. NC2 is stricter: it keeps the graph and approximately matches the stationary law while randomising the nonequilibrium edge asymmetry.

At the two main low-rank anchors, the real motor is substantially more concentrated than the controls, as shown in Figure 13. For anchor A the real six-state motor has

Φ1DV0.9777,sr(ADV)1.0228,\Phi^{DV}_{1}\approx 0.9777,\qquad\operatorname{sr}(A_{DV})\approx 1.0228, (11.30)

placing it above all sampled NC1 controls and above most sampled values in the stricter π\pi-matched NC2 ensemble. For anchor C the reduced seven-state model has

Φ1DV0.9740,sr(ADV)1.0267,\Phi^{DV}_{1}\approx 0.9740,\qquad\operatorname{sr}(A_{DV})\approx 1.0267, (11.31)

placing it above nearly all sampled NC1 controls and above most sampled NC2 controls. Thus the low-rank concentration is not a generic consequence of graph size or edge count alone, and it is only partly explained by the stationary-law profile.

The one exception is the near-stall anchor B, which is now taken at the same F=7pNF=7\,\mathrm{pN} operating point reported in Table 3. At this anchor the real motor becomes less concentrated than the matched random controls, with

Φ1DV0.5260,sr(ADV)1.9012,\Phi^{DV}_{1}\approx 0.5260,\qquad\operatorname{sr}(A_{DV})\approx 1.9012, (11.32)

placing the real point below most sampled random controls. The qualitative conclusion is unchanged but now better calibrated: near stall the real motor is less concentrated than typical controls, though not pathologically so. This is the regime in which the forward and backward chemomechanical cycles compete most strongly. The negative control sharpens the mechanistic reading of the benchmark by identifying the stall region as the place where low-rank concentration weakens.

Refer to caption
Figure 13: Kinesin matched negative controls. The red curves are the real motor benchmarks and the blue bands are graph-matched control ensembles. At the zero-load six-state anchor and the high-ADP seven-state anchor, the real motor retains substantially more DV signal in low observer rank than the controls. Near stall, the situation reverses: the real motor broadens more strongly than the controls, consistent with direct competition between forward and backward chemomechanical cycles.

Taken together, the negative controls sharpen the interpretation of both biological examples. For the Banerjee ribosome, the benchmark is valuable mainly as an experimentally grounded and biologically interpretable worked example, but not as evidence that proofreading architecture is unusually low-rank. For kinesin, by contrast, the control ensembles show that the observed spectral compression is not generic to comparable nonequilibrium graphs. The molecular-motor result therefore provides the stronger empirical support for a nontrivial cross-model recurrence claim.

11.13 A ten-state chemotaxis feedback benchmark from the sensory-adaptation literature

The kinesin benchmark shows that strong finite-observation compression can survive outside proofreading and across explicit motor-force control. We now test a larger sensory-feedback system. Sartori, Granger, Lee, and Horowitz study E. coli chemotaxis through a ten-state receptor model with two activity states a{0,1}a\in\{0,1\} and five methylation levels m{0,1,2,3,4}m\in\{0,1,2,3,4\}, maintained out of equilibrium by SAM-driven methylation [42]. At fixed ligand concentration [L][L], the state space is

(a,m){0,1}×{0,1,2,3,4},(a,m)\in\{0,1\}\times\{0,1,2,3,4\}, (11.33)

ordered in the implementation as

(0,0),(1,0),(0,1),(1,1),(0,2),(1,2),(0,3),(1,3),(0,4),(1,4).(0,0),(1,0),(0,1),(1,1),(0,2),(1,2),(0,3),(1,3),(0,4),(1,4). (11.34)

The source kinetics are fixed by the Tar receptor parameters

KI=18.2μM,KA=3000μM,Δm=2,m0=1,K_{I}=18.2\,\mu\mathrm{M},\qquad K_{A}=3000\,\mu\mathrm{M},\qquad\Delta_{m}=2,\qquad m_{0}=1, (11.35)

together with the separated timescales

τa=103s,τm=10s,\tau_{a}=10^{-3}\,\mathrm{s},\qquad\tau_{m}=10\,\mathrm{s}, (11.36)

and chemical driving

Δμ=6kBT.\Delta\mu=6\,k_{B}T. (11.37)

We build the fixed-ligand generator directly from the source rate formulas for activity flips and nearest-neighbour methylation moves, and evaluate it at

[L]{94,200,500,720,1500,3000,5760}μM,[L]\in\{94,200,500,720,1500,3000,5760\}\,\mu\mathrm{M}, (11.38)

which spans the adaptive regime KI[L]KAK_{I}\ll[L]\ll K_{A}, its upper edge, and the strongly saturated outside region [42].

Before any spectral analysis, we impose the same source-locking standard used in the previous biological examples. The implemented generator reproduces the ten-state receptor graph of the source model, including all horizontal activity flips and all vertical nearest-neighbour methylation transitions. Local detailed balance holds on the activity sector by construction, and the SAM-driven methylation asymmetry breaks detailed balance at every tested ligand value. The resulting stationary laws are positive and normalised. They also reproduce a key qualitative feature of the source paper: the methylation marginal remains heavily concentrated at the highest methylation level, with Bhattacharyya overlaps above 0.9990.999 across representative ligand pairs. Thus the benchmark is not an abstract ten-state toy. It is a source-locked receptor model in the specific high-methylation operating regime used by Sartori et al. to discuss the limited memory capacity of the feedback architecture.

Refer to caption
Figure 14: Raw weighted-signal spectrum and cumulative Ky Fan retention for the Sartori ten-state chemotaxis benchmark. Across all tested ligand concentrations, the weighted signal operator ADVA_{DV} has a sharply dominant singular front. One observer direction captures about 85%85\% to 97%97\% of the raw DV signal, and two directions capture at least about 99.5%99.5\%.

The raw Donsker–Varadhan correction is sharply concentrated across the entire ligand family, as shown in Figure 14. In the adaptive regime, the one-direction retained fraction is already

Φ1DV0.972at [L]=94μM,\Phi_{1}^{DV}\approx 0.972\quad\text{at }[L]=94\,\mu\mathrm{M}, (11.39)

with

Φ2DV0.999,sr(ADV)1.029.\Phi_{2}^{DV}\approx 0.999,\qquad\operatorname{sr}(A_{DV})\approx 1.029. (11.40)

Even at the largest tested ligand concentration,

[L]=5760μM,[L]=5760\,\mu\mathrm{M}, (11.41)

well beyond KAK_{A}, the signal remains strongly compressed:

Φ1DV0.850,Φ2DV0.995,sr(ADV)1.176.\Phi_{1}^{DV}\approx 0.850,\qquad\Phi_{2}^{DV}\approx 0.995,\qquad\operatorname{sr}(A_{DV})\approx 1.176. (11.42)

Thus a ten-state sensory-feedback network with a nine-dimensional reduced Fisher space still behaves, in raw finite-observation geometry, almost as a rank-one system. This is materially stronger than the Banerjee proofreading example, where an analogous low-rank conclusion could still be questioned as a small-state-space effect.

Refer to caption
Figure 15: Backbone-normalised detectability spectrum for the Sartori chemotaxis benchmark. Raw visibility is almost rank one throughout the ligand family, but detectability is broader: the leading whitened eigenmodes retain most, but not all, of the concentration. This is the same structural separation between raw nonequilibrium signal and backbone-normalised distinguishability already seen in the ribosome and kinesin benchmarks.

As in the previous worked examples, raw visibility and backbone-normalised detectability do not coincide, as shown in Figure 15. The top detectability eigenvalue rises from about

θ16.68×106\theta_{1}\approx 6.68\times 10^{-6} (11.43)

at 94μM94\,\mu\mathrm{M} to a peak near

θ13.86×105\theta_{1}\approx 3.86\times 10^{-5} (11.44)

around 3000μM3000\,\mu\mathrm{M}, while the detectability stable rank grows from about 2.142.14 to 3.003.00 in the present backbone-normalised scaling. In cumulative terms, one raw direction suffices for 90%90\% retention over most of the adaptive regime, whereas the backbone-whitened concentration typically requires two to four directions. The chemotaxis benchmark therefore reinforces, in a mechanistically different setting, the main message of Section 6: the visible signal and the statistically distinguishing signal against the detailed-balance backbone are related, but they are not the same geometric object.

Refer to caption
Figure 16: Leading raw and detectability observer loadings for the Sartori ten-state chemotaxis benchmark in the ordered basis (0,0),(1,0),(0,1),(1,1),(0,2),(1,2),(0,3),(1,3),(0,4),(1,4)(0,0),(1,0),(0,1),(1,1),(0,2),(1,2),(0,3),(1,3),(0,4),(1,4). Blue bars denote inactive states and red bars active states. Overall signs are conventional. The dominant raw observer remains a low-methylation activity contrast across the ligand range, while the detectability-optimal observer varies more strongly with ligand concentration.

The leading observer directions remain interpretable rather than diffuse. Figure 16 shows that the dominant raw observer is concentrated almost entirely on the lowest methylation level, as an activity contrast between (0,0)(0,0) and (1,0)(1,0), with only a small secondary correction at m=1m=1. The detectability-optimal direction is broader and more ligand-dependent: in some regimes it is dominated by the inactive low-methylation state (0,0)(0,0), in others by the active low-methylation state (1,0)(1,0), with smaller balancing weight on (0,1)(0,1) or (1,1)(1,1). This is the pattern one expects when the raw nonequilibrium correction is nearly rank one but the detailed-balance backbone is anisotropic.

Refer to caption
Figure 17: Ligand sweep for the Sartori ten-state chemotaxis benchmark. The green band marks the adaptive regime KI[L]KAK_{I}\ll[L]\ll K_{A}. Top left: Φ1DV\Phi_{1}^{DV} and Φ2DV\Phi_{2}^{DV}. Top right: weighted stable rank. Bottom left: top detectability eigenvalue. Bottom right: total DV signal energy. The raw concentration is sharpest inside the adaptive regime and degrades only gradually outside it, while the total DV signal grows monotonically and saturates above KAK_{A}.

The continuous ligand sweep in Figure 17 makes the operating-point dependence clear. Inside the adaptive window, the raw signal is most concentrated:

Φ1DV0.97,sr(ADV)1.03.\Phi_{1}^{DV}\approx 0.97,\qquad\operatorname{sr}(A_{DV})\approx 1.03. (11.45)

As [L][L] rises through and beyond KAK_{A}, the rank-one retained fraction decays smoothly toward about 0.790.79, while Φ2DV\Phi_{2}^{DV} remains close to 0.990.99, the weighted stable rank rises only to about 1.271.27, and the total DV signal energy grows monotonically before saturating. There is no sharp spectral transition at the edge of the adaptive regime. The geometry changes gradually with ligand level rather than catastrophically.

Refer to caption
Figure 18: Validation against the source methylation-distribution picture. The stationary methylation marginal is heavily concentrated at m=4m=4 for both in-regime and out-of-regime ligand pairs, with Bhattacharyya overlaps above 0.9990.999. This reproduces the source paper’s limited-memory observation and shows that the finite-observation signal concentration is extracted on top of, rather than instead of, the high-overlap methylation statistics.

The methylation validation in Figure 18 is important for interpretation. The source model operates in a regime where the stationary methylation marginals remain extremely similar across ligand values, even when the mean activity changes appreciably. The finite-observation result is therefore not that the methylation memory is broad and low-rank. It is subtler. The raw nonequilibrium correction is sharply concentrated even though the methylation marginals themselves are almost indistinguishable. This explains why the dominant observer localises on a low-methylation activity contrast rather than on a broad redistribution over all methylation levels.

Taken together, the Sartori benchmark strengthens the empirical recurrence case in a more demanding state space than Banerjee. The model is mechanistically distinct from both proofreading and chemomechanical transport, and its reduced Fisher space has dimension nine rather than four or five. Yet the raw finite-observation geometry remains strongly compressed throughout the tested ligand family. At the same time, the benchmark preserves the same structural lesson already seen in the earlier biological examples: detectability is broader than raw visibility, and the leading observer directions remain physically interpretable. The correct conclusion is therefore not that every aspect of chemotactic memory is low-dimensional. It is that, in this source-locked ten-state feedback receptor model, the Donsker–Varadhan correction itself has a sharply concentrated spectral front. What remains open for this benchmark is a matched-null control family comparable to the kinesin negative-control analysis; until that is in hand, the chemotaxis example should be read as a source-locked worked example rather than as evidence that sensory-feedback architecture generically enforces low rank.

12  Related-work connections

12.1 Estimators, hidden events, and coarse observation

A large part of the partial-observation literature studies estimator quality, lower bounds, hidden events, unresolved transitions, and coarse-graining schemes for irreversibility detection [5, 13, 6, 7, 8, 9, 10, 11, 43, 36]. Those works ask how much irreversibility can be inferred from restricted data.

The present paper addresses a complementary question. Alongside asking which estimator is best, one can ask how much nonequilibrium signal the chosen observable sector can retain in principle. In the regime treated here, that question is governed by a weighted spectral envelope, its hidden share is the spectral tail, and observer quality is controlled by alignment with the singular front of the correction. The Gaussian shadow divergences studied here are local observed-Gaussian comparison laws, conceptually adjacent to trajectory-level irreversibility measures such as Roldán–Parrondo, but not the same object.

12.2 Observer dependence, coarse graining, and design

Restricted-information and coarse-grained thermodynamic frameworks emphasise that observation is part of the thermodynamic problem itself [19, 20, 8, 17, 18]. Work on current fluctuations, random counting observables, and optimised coarse-graining schemes makes the same point from a design perspective: some observations are much better than others for irreversibility detection [15, 14, 16].

The alignment and shadow theorems make that statement concrete in the present setting. A visibility-optimal observer aligns with the singular front of the raw signal. A detectability-optimal observer aligns with the singular front of the backbone-whitened signal. The theory therefore gives a geometric ranking of observers rather than only a qualitative statement that coarse observation can help or hurt.

12.3 Conceptual and geometric context

Several neighbouring literatures sharpen the conceptual space. Frenesy and time-symmetric dynamical activity make clear that nonequilibrium structure is richer than entropy-production rates alone [44]. Conditioned-process theory shows how distinct microscopic dynamics can collapse onto equivalent effective descriptions under large-deviation tilts [45].

Spectral work on nonreversible chains shows that singular-value and gap objects can carry operational content rather than serving as linear-algebraic decoration; in the present context such gap control helps set the scale of the detailed-balance backbone against which the weighted signal is read [46]. The cycle-current perspective of Schnakenberg and Andrieux–Gaspard clarifies the physical source of the skew sector, while reversible-chain information geometry provides a natural detailed-balance backdrop for the Fisher-coordinate formulation used here [30, 31, 28]. We also note a nearby geometric literature around Souriau’s Lie-group thermodynamics and Barbaresco’s Souriau-Fisher information geometry [47, 48, 49].

Taken together, these neighbouring literatures locate the results clearly. The paper is complementary to work on bounds, estimators, and coarse-grained thermodynamics. Its specific contribution is a finite-dimensional visibility law for the Donsker–Varadhan correction in the Markov Gaussian regime, together with its observer geometry, shadow criterion, and ordered spectral readout.

13  Scope

13.1 What is proved

Within this setting, the Donsker–Varadhan correction is identified as a positive weighted correction operator generated by the reduced skew channel and factorising through the weighted signal operator and the detailed-balance backbone. Within its stated Gaussian and orthogonal-observer scope, the theory gives the visibility law, the full envelope hierarchy, retention fractions, hidden tail, stable-rank obstruction, alignment formula, optimal and generic orthogonal observers, the shadow formulas, and the backbone-whitened detectability reformulation. In particular, the envelope hierarchy determines the eigenvalue profile of ΔDV\Delta_{DV}, equivalently the singular-energy profile 14sk(ADV)2\tfrac{1}{4}s_{k}(A_{DV})^{2}, while the shadow hierarchy supplies the distinct spectrum relevant for Gaussian distinguishability.

The abstract weighted-geometry theorem also holds in finite dimension. It is a transfer theorem: once a positive semidefinite correction admits a weighted Gram factorisation relative to a positive-definite metric, the envelope, alignment, detectability, and spectral-readout machinery transfer by Euclideanisation. This includes BKM-symmetrised operator space.

What is not proved here is equally important. Projection suppression and shared observed-Gaussian behaviour are asymptotic Gaussian corollaries, not new bridge theorems. The exact separation proved here is a Hessian-level statement, and beyond quadratic order the paper does not rule out mixed dissipative-skew terms in the full rate function. The linear quantum extension is only at the level of weighted geometry transfer. It is therefore a conditional geometric framework rather than a tested model-specific theory, since no concrete quantum correction operator with the required structure is exhibited here. The full nonlinear quantum fluctuation bridge remains open.

13.2 Falsification

At the classical bridge level, the theory would fail if the reduced-coordinate correction were not representable as a weighted Gram signal built from the skew sector and the detailed-balance backbone. Numerically, the bridge claim fails if a direct computation gives ΔDV14J^H01J^T\|\Delta_{DV}-\tfrac{1}{4}\widehat{J}H_{0}^{-1}\widehat{J}^{T}\| above tolerance. The bridge identity is therefore a genuine key step.

At the finite-observation level, the envelope law would fail if direct optimisation over orthogonal rank-dd projectors did not agree with the singular-energy formula for KdDVK_{d}^{DV}, or if finite observation in the relevant fluctuation geometry were not correctly modelled by orthogonal compression on the reduced Euclidean Fisher space. In other words, if the physically relevant observable sectors could not be represented in this way, then the visibility law would no longer be the correct model.

At the statistical level, the Gaussian shadow package fails if KL, Hellinger, or total-variation quantities computed directly from the compressed Gaussian covariances do not match the spectral formulas in the shadow operator. At the same time, the equilibrium-shadow theorem is only a Gaussian theorem. It would be falsified as a general statement about observed nonequilibrium if the relevant finite-observation signatures in a given system were dominated by strongly non-Gaussian effects outside the quadratic regime, even when the projected Hessian correction is small.

At the spectroscopy level, the claim fails if the envelope increments do not reproduce the nonzero spectrum of ΔDV\Delta_{DV}, or if the H0H_{0}-whitened Ky Fan values do not agree with the generalised-eigenvalue detectability spectrum.

Finally, the operator-space extension would fail as a physical theory if no meaningful linear fluctuation correction in BKM geometry could be identified for the relevant quantum nonequilibrium setting. The weighted transfer theorem would remain mathematically true, but it would lose physical force.

13.3 What the worked examples support, and what they do not

The worked examples play a calibrating role. They show that the distinction between raw visibility and backbone-normalised detectability remains informative across mechanistically distinct nonequilibrium models. In this empirical arc, the ribosome benchmark provides utility together with restraint, because the matched null shows that low-rank concentration in a small five-state system should not by itself be read as architecture-specific specialness. The kinesin benchmark is the stronger cross-domain recurrence case: it shows robust low-rank concentration at low load together with physically sensible broadening near stall under direct cycle competition. The chemotaxis benchmark is the larger-state-space stress test: it indicates that the same operator theory can remain informative beyond the smallest reduced spaces.

At the same time, the examples do not yet prove a universal low-rank law definitively. They support repeated utility of the two-spectrum framework, and they support cross-domain recurrence of the visibility geometry in the tested regimes, but they do not by themselves settle how much of the observed concentration is controlled by model class, operating regime, state-space dimension, or the number of effective irreversibility-injection channels. That wider question remains open.

Appendix I sharpens this point analytically. A homogeneous driven ring gives a clean counterexample to the naïve idea that few cycles should force low raw stable rank, while a finite-rank skew channel gives an exact bounded-complexity mechanism. Taken together, these results show that the relevant control variable is not bare cycle count by itself but the spectral localisation of the skew sector relative to the detailed-balance backbone.

Read laterally, the examples also sharpen the hidden-engine anatomy proved in the main text. What survives finite observation is organised by the same ladder in every case: skew source, detailed-balance transmission geometry, backbone-weighted visible signal, hidden return or hidden tail under rank constraint, and detectability after whitening.

13.4 What remains open

The first open direction is noisy observation-channel design. Section 6 gives a Gaussian shadow theorem for fixed linear noisy channels, but the optimisation problem over channels remains open. This is naturally an optimal experimental-design problem in the observed covariance geometry. Unlike deterministic subspace observation, the observation matrix enters nonlinearly in both the covariance defect and the backbone normalisation, so the design problem is no longer a direct Ky Fan optimisation. A related structural question is which backbone heterogeneities or projection mismatches force the detectability spectrum to broaden relative to the raw visibility spectrum.

The second open direction is the full nonlinear quantum bridge. The weighted operator-space extension shows that the visibility geometry is ready once the fluctuation correction is identified, but that identification remains to be derived beyond the linear regime.

The third open direction is extension beyond finite-state Markov models. Recent work on thermodynamically consistent coarse graining across particle and field descriptions suggests that structure can survive substantial change of description [50]. At the same time, the need to coarse grain empirical densities and currents in continuous space makes clear that observation scale must remain part of the structure rather than an external nuisance [51, 56, 52]. A natural question is whether a useful finite-observation complexity invariant, perhaps weighted stable rank or a field-theoretic analogue, survives renormalised coarse graining.

The fourth open direction is the non-Markov and driven large-deviation frontier. Periodic level-2.5 theories and recent non-Markov self-interacting large-deviation results suggest that empirical-measure and current structures persist well beyond the time-homogeneous Markov class treated here [53, 54]. It is therefore natural to ask whether an analogue of the weighted signal operator and its finite-observation envelope exists for memoryful or periodically driven systems.

The fifth open direction is implementation. The envelope hierarchy suggests a direct route to irreversibility spectroscopy: estimate the singular front of the nonequilibrium signal from controlled families of observables or from designed operator-space compressions. A natural next step is to study how robustly the leading singular front of ADVA_{DV} can be estimated from finite data under partial observation. A closely related frontier is active or response-based detection, where recent finite-frequency fluctuation-response bounds indicate that nonequilibrium detectability can also be organised in the frequency domain [55]. In the background sits the broader tension between spectral structure and scalar uncertainty bounds, now familiar from the thermodynamic uncertainty-relation literature [24, 25].

13.5 Conclusion and outlook

The main results of this paper are finite-dimensional and specific to the Donsker–Varadhan correction, but their significance is broader. The central lesson is that finite observation does not merely discard information. In the present setting it organises nonequilibrium structure into an exact visible geometry. In the present setting that geometry is carried first by the weighted signal operator ADV=J^H01/2A_{DV}=\widehat{J}H_{0}^{-1/2}, which governs raw visibility, and second by its backbone-whitened detectability counterpart, which governs Gaussian distinguishability relative to the detailed-balance backbone. This yields an exact theory of nonequilibrium visibility, observer design, detectability, and spectral readout under explicit rank constraints.

That exact core is already enough to support a strong conclusion, but the conclusion must be stated at the correct level. We do not merely have a collection of examples with similar numerics. We have identified a common mathematical form. Across the finite-dimensional class treated here, nonequilibrium fluctuation structure is governed by a positive weighted correction operator, its weighted signal factorisation, its Ky Fan envelope hierarchy, and a second backbone-normalised spectrum for detectability. Within the orthogonal-observer model, the envelope hierarchy is the exact rank-constrained visibility law generated by ADVA_{DV}. It determines the singular-energy profile 14sk(ADV)2\tfrac{1}{4}s_{k}(A_{DV})^{2}, and within the finite irreducible Markov Gaussian setting treated here this weighted geometry is the organising structure.

The sharper question is where a low-rank regime sits inside that exact geometry. The worked examples show recurrent concentration, but Appendix I makes clear that low-rank concentration is not a theorem of the whole class. A homogeneous driven ring has raw weighted stable rank

sr(ADV)=n22cos2(π/n)n2,\operatorname{sr}(A_{DV})=\frac{n-2}{2\cos^{2}(\pi/n)}\sim\frac{n}{2}, (13.1)

so topological simplicity by itself does not force raw spectral simplicity. By contrast, if the reduced skew channel has rank at most 2r2r, then both raw visibility and backbone-whitened detectability have rank at most 2r2r. This isolates one exact bounded-complexity mechanism. The recurrent concentration seen in the biological benchmarks is consistent with a regime in which the skew channel is effectively localised to a small number of irreversibility-injection directions, although the paper does not prove that benchmark by benchmark. The natural conclusion is therefore not that every finite nonequilibrium system is low-rank, but that the low-rank behaviour seen in the worked examples belongs to a candidate regime inside the exact weighted geometry.

We therefore state the conclusion in its disciplined form: this work identifies the exact weighted geometry of finite observation and separates two optimisation problems that are often conflated, raw visibility and backbone-normalised detectability. It also provides evidence for a candidate low-rank universality regime within that geometry.

What recurs across model classes is not merely the fact of compression. It is the same organising architecture: skew source, detailed-balance transmission geometry, weighted visible signal, hidden tail under rank constraint, and backbone-whitened detectability. The worked examples, together with the analytic boundary note, show that the open problem is now sharply posed. The relevant control variable is not bare cycle count alone. It is how broadly the skew sector is transmitted across the backbone modes.

That point matters for the next stage of the programme. The task is no longer to ask vaguely whether low-rank concentration appears again. The task is to determine which structural features keep the transmitted skew sector spectrally localised, which features delocalise it, and how the basin should be organised. Upgraded matched nulls, controlled scaling families, and explicit breakdown classes are the natural next tests.

The frontier is therefore clear. The finite-dimensional theory is solved at the structural level. The low-rank regime is strongly suggested in a nontrivial empirical arc, but it is not yet the whole class. If the basin analysis now underway confirms that the same low-rank regime persists under broader structural sweeps, then finite observation will not merely be a practical limitation on what can be seen. It will pick out a genuine organising regime of nonequilibrium structure.

Appendix A Reduced-coordinate identities

This appendix records the reduced-coordinate identities underlying the bridge theorem. The aim is to place the key algebra in one location so that the main text remains readable. It is the same reduced conductance-and-skew decomposition used in Section 3, written here in the explicit (x,y)(x,y) variables of the envelope expansion.

A.1 Reduced tangent coordinates

Let

Tπ={un:u,eπ=0},eπ=(π1,,πn)T,T_{\pi}=\{u\in\mathbb{R}^{n}:\langle u,e_{\pi}\rangle=0\},\qquad e_{\pi}=(\sqrt{\pi_{1}},\dots,\sqrt{\pi_{n}})^{T}, (A.1)

and let Cn×(n1)C\in\mathbb{R}^{n\times(n-1)} be an orthonormal frame of TπT_{\pi}, so that

CTC=In1,CCT=Pπ.C^{T}C=I_{n-1},\qquad CC^{T}=P_{\pi}. (A.2)

Every tangent fluctuation is written uniquely as u=Cxu=Cx with xn1x\in\mathbb{R}^{n-1}.

In these coordinates, the Fisher-conjugated generator reduces to

K^=CTDπ1/2QDπ1/2C,K^=G^+J^,\widehat{K}=C^{T}D_{\pi}^{1/2}QD_{\pi}^{-1/2}C,\qquad\widehat{K}=\widehat{G}+\widehat{J}, (A.3)

with

G^=K^+K^T2,J^=K^K^T2.\widehat{G}=\frac{\widehat{K}+\widehat{K}^{T}}{2},\qquad\widehat{J}=\frac{\widehat{K}-\widehat{K}^{T}}{2}. (A.4)

The canonical detailed-balance reference Hessian on the same reduced space is

H0=12G^.H_{0}=-\frac{1}{2}\,\widehat{G}. (A.5)

A.2 Reduced envelope structure

Write the Donsker–Varadhan variational formula as [1, 2, 3]

IDV(μ)=suph(i,jμiqij(ehjhi1)).I_{DV}(\mu)=\sup_{h}\Bigl(-\sum_{i,j}\mu_{i}q_{ij}(e^{h_{j}-h_{i}}-1)\Bigr). (A.6)

Choose reduced Fisher coordinates xn1x\in\mathbb{R}^{n-1} and reduced logarithmic coordinates yn1y\in\mathbb{R}^{n-1} by

μ(x)=π+Dπ1/2Cx+O(|x|2),h(y)=Dπ1/2Cy.\mu(x)=\pi+D_{\pi}^{1/2}Cx+O(|x|^{2}),\qquad h(y)=D_{\pi}^{-1/2}Cy. (A.7)

Expanding the variational integrand to second order gives

(x,y)=yTG^yxTK^y+O(|(x,y)|3),K^=G^+J^.\mathcal{L}(x,y)=y^{T}\widehat{G}y-x^{T}\widehat{K}y+O(|(x,y)|^{3}),\qquad\widehat{K}=\widehat{G}+\widehat{J}. (A.8)

Because yTJ^y=0y^{T}\widehat{J}y=0, the conductance block depends only on G^\widehat{G}. Hence

MQ=MG=G^.M_{Q}=M_{G}=-\widehat{G}. (A.9)

Setting S:=G^0S:=-\widehat{G}\succ 0, one has

(x,y)=yTSy+yT(S+J^)x+O(|(x,y)|3).\mathcal{L}(x,y)=-y^{T}Sy+y^{T}(S+\widehat{J})x+O(|(x,y)|^{3}). (A.10)

Completing the square in yy yields

IDV(μ(x))=14xT(S+J^)TS1(S+J^)x+O(|x|3)=14xT(S+J^S1J^T)x+O(|x|3).I_{DV}(\mu(x))=\frac{1}{4}x^{T}(S+\widehat{J})^{T}S^{-1}(S+\widehat{J})x+O(|x|^{3})=\frac{1}{4}x^{T}\bigl(S+\widehat{J}S^{-1}\widehat{J}^{T}\bigr)x+O(|x|^{3}). (A.11)

Therefore

HDV=12S+12J^S1J^T.H_{DV}=\frac{1}{2}S+\frac{1}{2}\widehat{J}S^{-1}\widehat{J}^{T}. (A.12)

Since H0=12SH_{0}=\frac{1}{2}S, one gets H01=2S1H_{0}^{-1}=2S^{-1}, and hence

HDV=H0+14J^H01J^T.H_{DV}=H_{0}+\frac{1}{4}\,\widehat{J}H_{0}^{-1}\widehat{J}^{T}. (A.13)

Equivalently,

ΔDV=HDVH0=14J^H01J^T.\Delta_{DV}=H_{DV}-H_{0}=\frac{1}{4}\,\widehat{J}H_{0}^{-1}\widehat{J}^{T}. (A.14)

A.3 Absence of mixed terms

The quadraticity theorem can be read as a cancellation statement. A generic two-sector reduced envelope would allow mixed terms involving both the dissipative and skew sectors in the Schur complement. The identity MQ=MGM_{Q}=M_{G} removes those terms because the conductance arises from the quadratic form in the auxiliary variable, and a skew matrix has zero quadratic form. The result is that the correction depends quadratically on the skew sector and is weighted only by the inverse detailed-balance backbone. This is the algebraic source of the weighted signal form

ΔDV=14ADVADVT,ADV=J^H01/2.\Delta_{DV}=\frac{1}{4}\,A_{DV}A_{DV}^{T},\qquad A_{DV}=\widehat{J}H_{0}^{-1/2}. (A.15)

A.4 Observed block formula

Let Π\Pi be a rank-dd orthogonal projector whose range U=RanΠU=\operatorname{Ran}\Pi is H0H_{0}-invariant, and choose a basis adapted to the splitting

n1=UU,U=RanΠ,\mathbb{R}^{n-1}=U\oplus U^{\perp},\qquad U=\operatorname{Ran}\Pi, (A.16)

so that H0H_{0} is block diagonal:

H0=(H0,S00H0,F),J^=(JSSJSFJFSJFF).H_{0}=\begin{pmatrix}H_{0,S}&0\\ 0&H_{0,F}\end{pmatrix},\qquad\widehat{J}=\begin{pmatrix}J_{SS}&J_{SF}\\ J_{FS}&J_{FF}\end{pmatrix}. (A.17)

Then

ΔDV=14J^H01J^T=14(JSSJSFJFSJFF)(H0,S100H0,F1)(JSSTJFSTJSFTJFFT).\Delta_{DV}=\frac{1}{4}\,\widehat{J}H_{0}^{-1}\widehat{J}^{T}=\frac{1}{4}\begin{pmatrix}J_{SS}&J_{SF}\\ J_{FS}&J_{FF}\end{pmatrix}\begin{pmatrix}H_{0,S}^{-1}&0\\ 0&H_{0,F}^{-1}\end{pmatrix}\begin{pmatrix}J_{SS}^{T}&J_{FS}^{T}\\ J_{SF}^{T}&J_{FF}^{T}\end{pmatrix}. (A.18)

Its slow block is therefore

(ΔDV)SS=14JSSH0,S1JSST+14JSFH0,F1JSFT.(\Delta_{DV})_{SS}=\frac{1}{4}\,J_{SS}H_{0,S}^{-1}J_{SS}^{T}+\frac{1}{4}\,J_{SF}H_{0,F}^{-1}J_{SF}^{T}. (A.19)

This is the converter formula used in Section 3.

Appendix B Linear algebra of weighted signal operators

This appendix collects the linear algebra used repeatedly in Sections 4 to 9.

B.1 Visibility interval

Let AA be any finite matrix with singular values

s1(A)s2(A)sm(A)0.s_{1}(A)\geq s_{2}(A)\geq\cdots\geq s_{m}(A)\geq 0. (B.1)

For a rank-dd orthogonal projector Π\Pi, define

VΠ(A):=ΠAF2.V_{\Pi}(A):=\|\Pi A\|_{F}^{2}. (B.2)

Then Ky Fan gives

suprankΠ=dVΠ(A)=k=1dsk(A)2,\sup_{\operatorname{rank}\Pi=d}V_{\Pi}(A)=\sum_{k=1}^{d}s_{k}(A)^{2}, (B.3)

and the minimum is

infrankΠ=dVΠ(A)=k=md+1msk(A)2,\inf_{\operatorname{rank}\Pi=d}V_{\Pi}(A)=\sum_{k=m-d+1}^{m}s_{k}(A)^{2}, (B.4)

with the convention that zero singular values fill out the list if rank(A)<m\operatorname{rank}(A)<m.

Applied to

ΔDV=14ADVADVT,\Delta_{DV}=\frac{1}{4}\,A_{DV}A_{DV}^{T}, (B.5)

this gives the full visibility interval for rank-dd observation:

14k=md+1msk(ADV)2VΠDV14k=1dsk(ADV)2.\frac{1}{4}\sum_{k=m-d+1}^{m}s_{k}(A_{DV})^{2}\leq V_{\Pi}^{DV}\leq\frac{1}{4}\sum_{k=1}^{d}s_{k}(A_{DV})^{2}. (B.6)

B.2 Optimal hidden tail

The optimal hidden residual after rank-dd observation is

14k>dsk(A)2.\frac{1}{4}\sum_{k>d}s_{k}(A)^{2}. (B.7)

This is the Eckart-Young residual in Frobenius norm, expressed at the signal level. In the present paper it is the irrecoverable hidden nonequilibrium tail under the best rank-dd observer.

B.3 Stable-rank obstruction

For any nonzero matrix AA,

sr(A)=AF2Aop2.\operatorname{sr}(A)=\frac{\|A\|_{F}^{2}}{\|A\|_{op}^{2}}. (B.8)

Then

k=1dsk(A)2ds1(A)2=dAF2sr(A).\sum_{k=1}^{d}s_{k}(A)^{2}\leq d\,s_{1}(A)^{2}=d\,\frac{\|A\|_{F}^{2}}{\operatorname{sr}(A)}. (B.9)

Dividing by AF2\|A\|_{F}^{2} gives the basic stable-rank obstruction

k=1dsk(A)2ksk(A)2dsr(A).\frac{\sum_{k=1}^{d}s_{k}(A)^{2}}{\sum_{k}s_{k}(A)^{2}}\leq\frac{d}{\operatorname{sr}(A)}. (B.10)

B.4 Direct-sum envelope law

If

A=A1A2A=A_{1}\oplus A_{2} (B.11)

is block diagonal with respect to an orthogonal splitting, then the rank-dd envelope satisfies

Kd(A1A2)=maxd1+d2=d(Kd1(A1)+Kd2(A2)),K_{d}(A_{1}\oplus A_{2})=\max_{d_{1}+d_{2}=d}\bigl(K_{d_{1}}(A_{1})+K_{d_{2}}(A_{2})\bigr), (B.12)

where Kd(A)K_{d}(A) denotes the Ky Fan top-singular-energy envelope [32]. This expresses optimal budget allocation across independent sectors.

Proof.

The singular values of A1A2A_{1}\oplus A_{2} are the multiset union of the singular values of A1A_{1} and A2A_{2}. The optimal sum of the top dd squared singular values is obtained by distributing the rank budget between the two blocks in the best possible way. ∎

B.5 Comparison of weighted and unweighted envelopes

Let H0H_{0} be positive definite with eigenvalue window

μminIH0μmaxI.\mu_{\min}I\preceq H_{0}\preceq\mu_{\max}I. (B.13)

Then

μmax1IH01μmin1I.\mu_{\max}^{-1}I\preceq H_{0}^{-1}\preceq\mu_{\min}^{-1}I. (B.14)

Hence for

ADV=J^H01/2,ΔDV=14ADVADVT,A_{DV}=\widehat{J}H_{0}^{-1/2},\qquad\Delta_{DV}=\frac{1}{4}A_{DV}A_{DV}^{T}, (B.15)

one has

14μmaxJ^J^TΔDV14μminJ^J^T.\frac{1}{4\mu_{\max}}\,\widehat{J}\widehat{J}^{T}\preceq\Delta_{DV}\preceq\frac{1}{4\mu_{\min}}\,\widehat{J}\widehat{J}^{T}. (B.16)

Taking optimal compressed traces gives

14μmaxKd(J^)KdDV14μminKd(J^).\frac{1}{4\mu_{\max}}\,K_{d}(\widehat{J})\leq K_{d}^{DV}\leq\frac{1}{4\mu_{\min}}\,K_{d}(\widehat{J}). (B.17)

Appendix C Random projector calculations

C.1 Expectation of a Haar projector

Let Π\Pi be Haar-uniform among rank-dd orthogonal projectors on m\mathbb{R}^{m}. Then orthogonal invariance implies

𝔼[Π]=cI\mathbb{E}[\Pi]=cI (C.1)

for some scalar cc. Taking traces gives

cm=𝔼[trΠ]=d,cm=\mathbb{E}[\operatorname{tr}\Pi]=d, (C.2)

hence

𝔼[Π]=dmI.\mathbb{E}[\Pi]=\frac{d}{m}I. (C.3)

C.2 Expected retained signal

For any fixed matrix AA,

𝔼[ΠAF2]=𝔼[tr(ATΠA)]=tr(AT𝔼[Π]A)=dmAF2.\mathbb{E}[\|\Pi A\|_{F}^{2}]=\mathbb{E}[\operatorname{tr}(A^{T}\Pi A)]=\operatorname{tr}(A^{T}\mathbb{E}[\Pi]A)=\frac{d}{m}\|A\|_{F}^{2}. (C.4)

Applied to the weighted DV signal,

𝔼[VΠDV]=14dmADVF2.\mathbb{E}[V_{\Pi}^{DV}]=\frac{1}{4}\,\frac{d}{m}\|A_{DV}\|_{F}^{2}. (C.5)

C.3 Expected directional overlap

For any fixed unit vector umu\in\mathbb{R}^{m},

𝔼[Πu2]=uT𝔼[Π]u=dm.\mathbb{E}[\|\Pi u\|^{2}]=u^{T}\mathbb{E}[\Pi]u=\frac{d}{m}. (C.6)

Thus each singular direction of the signal is seen at the same average rate by a generic rank-dd observer.

C.4 Remark on concentration

The present paper only needs the mean baseline. If desired, concentration of Πu2\|\Pi u\|^{2} and of ΠAF2\|\Pi A\|_{F}^{2} around their means can be obtained from standard concentration on the Grassmannian. We omit those estimates because they are not needed for the main results.

Appendix D Gaussian comparison formulas

This appendix records the centred Gaussian formulas used in Section 6.

D.1 KL divergence

For centred Gaussian laws on d\mathbb{R}^{d} with covariance matrices Σ1,Σ0\Sigma_{1},\Sigma_{0},

DKL(𝒩(0,Σ1)𝒩(0,Σ0))=12[tr(Σ01Σ1)dlogdet(Σ01Σ1)].D_{KL}\!\left(\mathcal{N}(0,\Sigma_{1})\,\|\,\mathcal{N}(0,\Sigma_{0})\right)=\frac{1}{2}\left[\operatorname{tr}(\Sigma_{0}^{-1}\Sigma_{1})-d-\log\det(\Sigma_{0}^{-1}\Sigma_{1})\right]. (D.1)

In the shadow setting,

ΣDB,Π=BΠ1,ΣNESS,Π=BΠ1/2(I+SΠ)1BΠ1/2.\Sigma_{DB,\Pi}=B_{\Pi}^{-1},\qquad\Sigma_{NESS,\Pi}=B_{\Pi}^{-1/2}(I+S_{\Pi})^{-1}B_{\Pi}^{-1/2}. (D.2)

Hence

ΣNESS,Π1ΣDB,Π=BΠ1/2(I+SΠ)BΠ1/2,\Sigma_{NESS,\Pi}^{-1}\Sigma_{DB,\Pi}=B_{\Pi}^{1/2}(I+S_{\Pi})B_{\Pi}^{-1/2}, (D.3)

whose eigenvalues are 1+λi1+\lambda_{i}, where λi\lambda_{i} are the eigenvalues of SΠS_{\Pi}. This yields

DKL(𝒩DB,Π𝒩NESS,Π)=12i(λilog(1+λi)).D_{KL}\!\left(\mathcal{N}_{DB,\Pi}\,\|\,\mathcal{N}_{NESS,\Pi}\right)=\frac{1}{2}\sum_{i}\bigl(\lambda_{i}-\log(1+\lambda_{i})\bigr). (D.4)

Likewise,

ΣDB,Π1ΣNESS,Π=BΠ1/2(I+SΠ)1BΠ1/2,\Sigma_{DB,\Pi}^{-1}\Sigma_{NESS,\Pi}=B_{\Pi}^{1/2}(I+S_{\Pi})^{-1}B_{\Pi}^{-1/2}, (D.5)

whose eigenvalues are (1+λi)1(1+\lambda_{i})^{-1}, giving

DKL(𝒩NESS,Π𝒩DB,Π)=12i(log(1+λi)λi1+λi).D_{KL}\!\left(\mathcal{N}_{NESS,\Pi}\,\|\,\mathcal{N}_{DB,\Pi}\right)=\frac{1}{2}\sum_{i}\left(\log(1+\lambda_{i})-\frac{\lambda_{i}}{1+\lambda_{i}}\right). (D.6)

D.2 Hellinger distance

For centred Gaussians,

1H2=det(Σ1)1/4det(Σ0)1/4det(12(Σ1+Σ0))1/2.1-H^{2}=\frac{\det(\Sigma_{1})^{1/4}\det(\Sigma_{0})^{1/4}}{\det\left(\frac{1}{2}(\Sigma_{1}+\Sigma_{0})\right)^{1/2}}. (D.7)

Substituting the detailed-balance and nonequilibrium observable covariances and factoring out BΠ1/2B_{\Pi}^{-1/2} gives

H2(𝒩DB,Π,𝒩NESS,Π)=1det(I+SΠ)1/4det(I+12SΠ)1/2.H^{2}\!\left(\mathcal{N}_{DB,\Pi},\mathcal{N}_{NESS,\Pi}\right)=1-\frac{\det(I+S_{\Pi})^{1/4}}{\det(I+\tfrac{1}{2}S_{\Pi})^{1/2}}. (D.8)

D.3 Pinsker and Bayes error

Pinsker gives

TV(P,Q)12DKL(PQ).\operatorname{TV}(P,Q)\leq\sqrt{\frac{1}{2}D_{KL}(P\|Q)}. (D.9)

For equal priors, the optimal Bayes classification error satisfies

Pe=1TV(P,Q)2.P_{e}^{\ast}=\frac{1-\operatorname{TV}(P,Q)}{2}. (D.10)

Combining these with the KL bound

DKL(𝒩DB,Π𝒩NESS,Π)14SΠF2D_{KL}\!\left(\mathcal{N}_{DB,\Pi}\,\|\,\mathcal{N}_{NESS,\Pi}\right)\leq\frac{1}{4}\|S_{\Pi}\|_{F}^{2} (D.11)

yields the total-variation and Bayes-error estimates stated in Section 6.

Appendix E Worked details for the literature examples

This appendix records the precise interpretive use of the external literature discussed in Sections 11 and 12.

E.1 Four-state two-cycle benchmark

The worked benchmark of Section 11 uses the four-state, five-link, two-cycle network from Appendix E, Table IV of van der Meer, Ertel, and Seifert [37]. Two roles are separated carefully.

First, the paper uses the generator as a compact multicyclic test of the bridge, envelope, and shadow theorems.

Second, to connect directly to the source observation pattern, the paper defines the edge-induced rank-one sector

b23=Dπ1/2(e2e3),Πobs=CTb23(CTb23)TCTb232.b_{23}=D_{\pi}^{-1/2}(e_{2}-e_{3}),\qquad\Pi_{\mathrm{obs}}=\frac{C^{T}b_{23}(C^{T}b_{23})^{T}}{\|C^{T}b_{23}\|^{2}}. (E.1)

This is an orthogonal surrogate for the physical access pattern observe only the 232\leftrightarrow 3 link. It is not a claim that the waiting-time estimator of [37] itself is literally an orthogonal projector on reduced Fisher space. The point is more disciplined: once one restricts to the theorem class of the present paper, Πobs\Pi_{\mathrm{obs}} is the canonical one-dimensional sector induced by the observed link within that class.

The numerical comparison in Section 11 therefore separates three quantities on the same benchmark family: raw retained nonequilibrium signal, backbone-normalised detectability, and the gap from the observed-link sector to the unconstrained optimal rank-one observers. The short forcing sweep is performed for this same induced sector, not for a re-optimised observer.

E.2 Estimator papers

In the finite-resolution and missing-data literature, the central practical question is how well one can estimate entropy production from restricted observations [57, 5, 6]. The present paper does not replace those estimators. It inserts a prior geometric question: how much of the weighted nonequilibrium signal is observable at all in the chosen sector? The retained fraction and the alignment gain are the relevant pre-estimation quantities.

E.3 Lumping and milestoning

The milestoning work of Blom et al. [13] shows that reprocessed coarse observation can improve dissipation estimation. The present theory interprets that phenomenon as better alignment with the singular front of the weighted signal, rather than as a paradox in which a coarser observation outperforms a finer one.

E.4 Unresolved events

Harunari’s unresolved-event framework [7] studies hidden irreversibility at the event-statistics level. The present paper addresses the same obstruction at the Gaussian Hessian level. These should be seen as complementary rather than competing approaches.

E.5 Observation-dependent thermodynamics

Rubino, Brukner, and Manzano [19] and Pernambuco and Céleri [20] show that thermodynamic content depends on access and resolution. The present paper adds the spectral law for how much of the weighted fluctuation correction survives finite-rank observation in the corresponding linearised setting.

E.6 BKM and de Bruijn geometry

Lacerda, Bettmann, and Goold [21], Bettmann and Goold [22], and Wirth [23] provide the metric and entropy-decay background showing that BKM geometry and de Bruijn identities are the correct neighbourhood for the operator-space continuation of the theory.

Appendix F Operator-space technicalities

This appendix records the Euclideanisation used in Section 9.

Let MM be a positive-definite metric on a finite-dimensional space VV. If Π\Pi is MM-orthogonal, then

Π~:=M1/2ΠM1/2\widetilde{\Pi}:=M^{1/2}\Pi M^{-1/2} (F.1)

is an ordinary Euclidean orthogonal projector.

Indeed,

Π~2=M1/2Π2M1/2=Π~.\widetilde{\Pi}^{2}=M^{1/2}\Pi^{2}M^{-1/2}=\widetilde{\Pi}. (F.2)

Moreover,

Π~=(M1/2)Π(M1/2)=M1/2ΠM1/2.\widetilde{\Pi}^{\dagger}=(M^{-1/2})^{\dagger}\Pi^{\dagger}(M^{1/2})^{\dagger}=M^{-1/2}\Pi^{\dagger}M^{1/2}. (F.3)

Since Π\Pi is MM-self-adjoint,

ΠM=MΠ,Π=MΠM1,\Pi^{\dagger}M=M\Pi,\qquad\Pi^{\dagger}=M\Pi M^{-1}, (F.4)

so

Π~=M1/2MΠM1M1/2=M1/2ΠM1/2=Π~.\widetilde{\Pi}^{\dagger}=M^{-1/2}M\Pi M^{-1}M^{1/2}=M^{1/2}\Pi M^{-1/2}=\widetilde{\Pi}. (F.5)

Thus Π~\widetilde{\Pi} is Euclidean orthogonal.

If Δ=BB\Delta=BB^{\sharp}, define

B~=M1/2BM1/2.\widetilde{B}=M^{1/2}BM^{-1/2}. (F.6)

Then the Euclideanised correction is

M1/2ΔM1/2=M1/2BBM1/2=M1/2BM1BM1/2=B~B~.M^{1/2}\Delta M^{-1/2}=M^{1/2}BB^{\sharp}M^{-1/2}=M^{1/2}BM^{-1}B^{\dagger}M^{1/2}=\widetilde{B}\,\widetilde{B}^{\dagger}. (F.7)

Hence the weighted projector problem becomes an ordinary Euclidean Gram problem after conjugation by M1/2M^{1/2}.

Appendix G Interpretive viewpoint and proof-status boundaries

The finite-observation theory proved in the main text can be placed inside a slightly broader interpretive viewpoint, provided that the proof-status boundary is kept sharp.

The basic distinction is between structural invisibility and practical weakness. Structural invisibility is vertical: degrees of freedom are intrinsically unobservable because they lie in fibres that are annihilated by the observation map or by the first positive descended object. Practical weakness is horizontal: after the invisible directions are quotiented out, the descended positive object may still be spectrally weak or anisotropic on the active quotient. In the present paper, the relevant descended object is the Donsker–Varadhan correction ΔDV\Delta_{DV}, and the active quotient is the reduced Euclidean Fisher space fixed in Sections 2 and 3.

A small observed correction can arise for conceptually different reasons. It may arise because the observation genuinely kills the relevant directions, because the quotient signal is low-rank but aligned away from the chosen observer, because the quotient signal is broad and weak, or because the observable sector is simply the wrong thin slice through an otherwise informative quotient geometry. These are not the same mechanism.

The work proves one finite-dimensional branch of this broader viewpoint: once the finite-state Markov Gaussian setting is fixed, the nonequilibrium correction descends to a weighted positive object, its finite-rank visible mass is solved by the envelope hierarchy, and its backbone-normalised distinguishability is solved by the shadow spectrum. That is the scope established here.

The finite-observation picture can fail by structural fibre collapse, by quotient-rank or quotient-anisotropy failure, by mismatch between the chosen thin observer and the dominant quotient directions, or by genuinely nonlinear aliasing beyond the quadratic regime. These mechanisms should be kept distinct, rather than collapsed into generic talk of “information loss.”

Appendix H Interpretive synthesis for the worked examples

The theorems of Sections 3 to 7 admit a compact synthesis that is useful when reading the worked benchmarks.

The algebraic source of the nonequilibrium correction is the reduced skew channel J^\widehat{J}. The detailed-balance backbone H0H_{0} does not generate the correction by itself, but it supplies the transmission geometry through which the skew source becomes visible. The natural signal object is therefore the backbone-weighted operator

ADV=J^H01/2,ΔDV=14ADVADVT.A_{DV}=\widehat{J}H_{0}^{-1/2},\qquad\Delta_{DV}=\frac{1}{4}A_{DV}A_{DV}^{T}. (H.1)

Finite observation compresses this weighted signal, not the full generator.

When an observed sector is H0H_{0}-adapted, the block formula gives a second useful layer of anatomy:

(ΔDV)SS=14JSSH0,S1JSST+14JSFH0,F1JSFT.(\Delta_{DV})_{SS}=\frac{1}{4}J_{SS}H_{0,S}^{-1}J_{SS}^{T}+\frac{1}{4}J_{SF}H_{0,F}^{-1}J_{SF}^{T}. (H.2)

The first term is the intrinsic observed correction. The second is the hidden mixed-return channel from the complementary sector, throttled by the inverse stiffness of the fast detailed-balance block. Thus hidden nonequilibrium is not a vague reservoir. On adapted sectors it has a return mechanism.

At finite observer rank dd, the optimally hidden budget is the singular-energy tail of the weighted signal operator,

KtotDVKdDV=14k>dsk(ADV)2,K_{\mathrm{tot}}^{DV}-K_{d}^{DV}=\frac{1}{4}\sum_{k>d}s_{k}(A_{DV})^{2}, (H.3)

so the envelope hierarchy is literally a spectroscopy of what finite observation cannot recover at the chosen rank. After whitening by the backbone, the relevant distinguishability object is the shadow or detectability spectrum. This is a second spectrum. It agrees with raw visibility only in special cases and should not be identified with it.

Taken together, the worked examples can be read through one recurring ladder: skew source, weighted signal, hidden return or hidden tail, and whitened detectability. This paper develops that ladder only for the finite-observation setting treated in the main text. Broader extensions are left outside the present scope.

Appendix I An analytic note on the scope of the low-rank universality claim

This appendix records two exact analytic complements to the worked examples. The first gives a clean boundary family showing that low raw stable rank is not forced by topological simplicity alone. The second gives an exact bounded-complexity mechanism. Together they clarify what the universality claim of the main text does and does not assert.

I.1 Homogeneous driven ring: broad raw visibility and bounded detectability

Consider the nearest-neighbour nn-state ring with uniform stationary law and homogeneous clockwise versus anticlockwise bias. On the mean-zero reduced Euclidean Fisher space, the detailed-balance backbone and reduced skew channel are, up to positive constants that cancel from stable-rank ratios,

H0Ln:=2ISS1,J^Kn:=SS1,H_{0}\propto L_{n}:=2I-S-S^{-1},\qquad\widehat{J}\propto K_{n}:=S-S^{-1}, (I.1)

where SS is the cyclic shift. Both operators are circulant, so they diagonalise in the Fourier basis. For the nonzero Fourier mode

qm=2πmn,m=1,,n1,q_{m}=\frac{2\pi m}{n},\qquad m=1,\dots,n-1, (I.2)

one has

λH0(m)1cosqm,|λJ^(m)||sinqm|.\lambda_{H_{0}}(m)\propto 1-\cos q_{m},\qquad|\lambda_{\widehat{J}}(m)|\propto|\sin q_{m}|. (I.3)
Proposition I.1 (Homogeneous driven ring: raw stable rank grows linearly).

For the homogeneous driven ring,

ADV=J^H01/2A_{DV}=\widehat{J}H_{0}^{-1/2} (I.4)

has squared singular values proportional to

σm(ADV)2sin2qm1cosqm=1+cosqm=2cos2(πmn),m=1,,n1.\sigma_{m}(A_{DV})^{2}\propto\frac{\sin^{2}q_{m}}{1-\cos q_{m}}=1+\cos q_{m}=2\cos^{2}\!\Bigl(\frac{\pi m}{n}\Bigr),\qquad m=1,\dots,n-1. (I.5)

Consequently,

sr(ADV)=n22cos2(π/n)n2.\operatorname{sr}(A_{DV})=\frac{n-2}{2\cos^{2}(\pi/n)}\sim\frac{n}{2}. (I.6)

In particular, a one-cycle family can have raw weighted stable rank growing linearly with state-space dimension.

Proof.

The Fourier diagonalisation gives the displayed singular-value formula immediately. Since

m=1n1cos2(πmn)=n22\sum_{m=1}^{n-1}\cos^{2}\!\Bigl(\frac{\pi m}{n}\Bigr)=\frac{n-2}{2} (I.7)

and the maximal value is attained at m=1m=1 and equals cos2(π/n)\cos^{2}(\pi/n), the stated stable-rank identity follows. ∎

Proposition I.2 (Homogeneous driven ring: detectability complexity stays bounded).

For the same family,

CDV=H01/2J^H01/2C_{DV}=H_{0}^{-1/2}\widehat{J}H_{0}^{-1/2} (I.8)

has singular values proportional to

σm(CDV)|sinqm|1cosqm=|cot(πmn)|,m=1,,n1.\sigma_{m}(C_{DV})\propto\frac{|\sin q_{m}|}{1-\cos q_{m}}=\Bigl|\cot\!\Bigl(\frac{\pi m}{n}\Bigr)\Bigr|,\qquad m=1,\dots,n-1. (I.9)

Hence

sr(CDV)=(n1)(n2)3cot2(π/n)π23(n).\operatorname{sr}(C_{DV})=\frac{(n-1)(n-2)}{3\,\cot^{2}(\pi/n)}\longrightarrow\frac{\pi^{2}}{3}\qquad(n\to\infty). (I.10)

Thus the same homogeneous ring that is broad in raw visibility remains bounded in backbone-whitened detectability complexity.

Proof.

The Fourier formula above gives the singular values. Using the classical identity

m=1n1cot2(πmn)=(n1)(n2)3,\sum_{m=1}^{n-1}\cot^{2}\!\Bigl(\frac{\pi m}{n}\Bigr)=\frac{(n-1)(n-2)}{3}, (I.11)

and the fact that the largest value is cot2(π/n)\cot^{2}(\pi/n), we obtain the displayed formula. The limit follows from cot(π/n)n/π\cot(\pi/n)\sim n/\pi. ∎

Propositions I.1 and I.2 show that the two spectra of the paper can behave very differently even in the simplest analytically transparent family. A homogeneous one-cycle system can be broad in raw visible signal while remaining bounded in detectability complexity. The reason is that inverse-backbone weighting amplifies the lowest-wavenumber backbone modes and suppresses the high-wavenumber tail strongly enough that the detectability stable rank stays bounded even as the raw-visibility stable rank grows linearly. The relevant control variable is therefore not bare cycle count by itself.

I.2 Finite-rank skew channels as an exact bounded-complexity mechanism

The next observation isolates a clean mechanism that does force bounded complexity.

Lemma I.3 (Finite-rank skew channels force bounded complexity).

If the reduced skew channel satisfies

rank(J^)2r,\operatorname{rank}(\widehat{J})\leq 2r, (I.12)

then

rank(ADV)=rank(CDV)2r,\operatorname{rank}(A_{DV})=\operatorname{rank}(C_{DV})\leq 2r, (I.13)

and therefore

sr(ADV)2r,sr(CDV)2r.\operatorname{sr}(A_{DV})\leq 2r,\qquad\operatorname{sr}(C_{DV})\leq 2r. (I.14)
Proof.

Since H0H_{0} is positive definite on the reduced space, both H01/2H_{0}^{-1/2} and left multiplication by H01/2H_{0}^{-1/2} are invertible. Hence

rank(ADV)=rank(J^H01/2)=rank(J^),rank(CDV)=rank(H01/2J^H01/2)=rank(J^).\operatorname{rank}(A_{DV})=\operatorname{rank}(\widehat{J}H_{0}^{-1/2})=\operatorname{rank}(\widehat{J}),\qquad\operatorname{rank}(C_{DV})=\operatorname{rank}(H_{0}^{-1/2}\widehat{J}H_{0}^{-1/2})=\operatorname{rank}(\widehat{J}). (I.15)

The stable-rank bounds follow from sr(X)rank(X)\operatorname{sr}(X)\leq\operatorname{rank}(X) for every finite matrix XX. ∎

A useful special case is when the skew channel is generated by a fixed number of elementary antisymmetric couplings,

J^=a=1rγa(uavaTvauaT),\widehat{J}=\sum_{a=1}^{r}\gamma_{a}\,(u_{a}v_{a}^{T}-v_{a}u_{a}^{T}), (I.16)

with orthonormal or merely linearly independent pair directions ua,vau_{a},v_{a}. Each summand has rank at most 22, so the hypothesis of Lemma I.3 holds automatically. This gives an exact mechanism by which localised irreversibility injection keeps both visibility and detectability spectrally compressible, uniformly in ambient state-space dimension.

The conclusion for the universality discussion is precise. The exact weighted geometry of finite observation is common across the full class treated in the main text, but low-rank concentration belongs to a narrower regime inside that geometry. The analytic boundary family above shows that low rank is not forced by topological simplicity alone. The finite-rank skew lemma shows that one sufficient bounded-complexity mechanism is spectral localisation of the skew sector. This is the structural axis that the next empirical appendix programme should probe.

Acknowledgements

No external funding was received. All work was produced independently without affiliation.

Author’s email is contact@nomogenetics.com.

References

  • [1] M. D. Donsker and S. R. S. Varadhan, Asymptotic evaluation of certain Markov process expectations for large time. I, Communications on Pure and Applied Mathematics 28 (1975), 1–47.
  • [2] M. D. Donsker and S. R. S. Varadhan, Asymptotic evaluation of certain Markov process expectations for large time. II, Communications on Pure and Applied Mathematics 28 (1975), 279–301.
  • [3] H. Touchette, The large deviation approach to statistical mechanics, Physics Reports 478 (2009), 1–69.
  • [4] J. L. Lebowitz and H. Spohn, A Gallavotti–Cohen-type symmetry in the large deviation functional for stochastic dynamics, Journal of Statistical Physics 95 (1999), 333–365.
  • [5] M. Baiesi, Y. Nishiyama, and G. Falasco, Effective estimation of entropy production with lacking data, preprint, 2023.
  • [6] L. Fritz, M. Ertel, and U. Seifert, Entropy estimation for partially accessible Markov networks based on imperfect observations: role of finite resolution and finite statistics, preprint, 2024.
  • [7] P. E. Harunari, Uncovering nonequilibrium from unresolved events, preprint, 2024.
  • [8] R. van der Meer and K. Saito, Thermodynamic bounds and error correction for faulty coarse graining, preprint, 2025.
  • [9] B. Ertel and U. Seifert, An estimator of entropy production for partially accessible Markov networks based on the observation of blurred transitions, Physical Review E 111 (2025), 044106.
  • [10] J. Ehrich, Tightest bound on hidden entropy production from partially observed dynamics, Journal of Statistical Mechanics: Theory and Experiment (2021), 083214.
  • [11] J. Degünther, J. van der Meer, and U. Seifert, Fluctuating entropy production on the coarse-grained level: inference and localization of irreversibility, Physical Review Research 6 (2024), 023175.
  • [12] M. Esposito, Stochastic thermodynamics under coarse graining, Physical Review E 85 (2012), 041125.
  • [13] K. Blom, H. Song, S. Vouga, R. Godec, and D. E. Makarov, Milestoning estimators of dissipation in systems observed at a coarse resolution, preprint, 2025.
  • [14] R. Bao, N. Ohga, and S. Ito, Measuring irreversibility by counting: a random coarse-graining framework, preprint, 2025.
  • [15] T. R. Gingrich, G. M. Rotskoff, and J. M. Horowitz, Inferring dissipation from current fluctuations, Journal of Physics A: Mathematical and Theoretical 50 (2017), 184004.
  • [16] Q. Yu, M. P. Leighton, and C. W. Lynn, Coarse-graining dynamics to maximize irreversibility, preprint, 2025.
  • [17] G. Teza, A. L. Stella, and T. GrandPre, Coarse-graining via lumping: exact calculations and fundamental limitations, preprint, 2025.
  • [18] G. Teza and A. L. Stella, Exact coarse graining preserves entropy production out of equilibrium, Physical Review Letters 125 (2020), 110601.
  • [19] G. Rubino, Č. Brukner, and G. Manzano, Coarse-grained quantum thermodynamics: observation-dependent quantities, observation-independent laws, preprint, 2025.
  • [20] J. Pernambuco and L. C. Céleri, Geometry of restricted information: the case of quantum thermodynamics, preprint, 2026.
  • [21] T. Lacerda, N. Bettmann, and J. Goold, Information geometry of transitions between quantum nonequilibrium steady states, preprint, 2025.
  • [22] N. Bettmann and J. Goold, Information geometry approach to quantum stochastic thermodynamics, preprint, 2025.
  • [23] F. Wirth, Exponential relative entropy decay along quantum Markov semigroups, preprint, 2025.
  • [24] A. C. Barato and U. Seifert, Thermodynamic uncertainty relation for biomolecular processes, Phys. Rev. Lett. 114 (2015), 158101.
  • [25] J. M. Horowitz and T. R. Gingrich, Thermodynamic uncertainty relations constrain non-equilibrium fluctuations, Nat. Phys. 16 (2020), 15–20.
  • [26] J. Gu, Counterexamples to the conjectured ordering between the waiting-time bound and the thermodynamic uncertainty bound on entropy production, arXiv:2601.04039 (2026).
  • [27] S. Ito, Stochastic thermodynamic interpretation of information geometry, Phys. Rev. Lett. 121 (2018), 030605.
  • [28] G. Wolfer and S. Watanabe, Information geometry of reversible Markov chains, Information Geometry 4 (2021), 393–433.
  • [29] C. Maes, K. Netočný, and B. Wynants, Steady state statistics of driven diffusions, Physica A 387 (2008), 2675–2689.
  • [30] J. Schnakenberg, Network theory of microscopic and macroscopic behavior of master equation systems, Rev. Mod. Phys. 48 (1976), 571–585.
  • [31] D. Andrieux and P. Gaspard, Fluctuation theorem for currents and Schnakenberg network theory, J. Stat. Phys. 127 (2007), 107–131.
  • [32] K. Fan, Maximum properties and inequalities for the eigenvalues of completely continuous operators, Proceedings of the National Academy of Sciences 37 (1951), 760–766.
  • [33] D. Petz, Monotone metrics on matrix spaces, Linear Algebra and its Applications 244 (1996), 81–96.
  • [34] R. Bhatia, Matrix Analysis, Graduate Texts in Mathematics Vol. 169, Springer, New York, 1997.
  • [35] M. Rudelson and R. Vershynin, Sampling from large matrices: An approach through geometric functional analysis, J. ACM 54 (2007), Article 21.
  • [36] É. Roldán and J. M. R. Parrondo, Entropy production and Kullback–Leibler divergence between stationary trajectories of discrete systems, Physical Review E 85 (2012), 031129.
  • [37] J. van der Meer, B. Ertel, and U. Seifert, Thermodynamic inference in partially accessible Markov networks: A unifying perspective from transition-based waiting time distributions, arXiv:2203.12020, 2022.
  • [38] K. Banerjee, A. B. Kolomeisky, and O. A. Igoshin, Elucidating interplay of speed and accuracy in biological error correction, Proceedings of the National Academy of Sciences of the United States of America 114 (2017), 5183–5188.
  • [39] F. Mosam and E. De Giuli, Heterogeneity dominates irreversibility in random Markov models, arXiv:2602.04905 (2026).
  • [40] S. Liepelt and R. Lipowsky, Kinesin’s network of chemomechanical motor cycles, Physical Review Letters 98 (2007), 258102.
  • [41] S. Liepelt and R. Lipowsky, EPAPS supplementary material for “Kinesin’s network of chemomechanical motor cycles,” supplementary document to Physical Review Letters 98 (2007), 258102.
  • [42] P. Sartori, L. Granger, C. F. Lee, and J. M. Horowitz, Thermodynamic costs of information processing in sensory adaptation, PLoS Computational Biology 10 (2014), e1003974.
  • [43] E. Meyberg, J. Degünther, and U. Seifert, Entropy production from waiting-time distributions for overdamped Langevin dynamics, Journal of Physics A: Mathematical and Theoretical 57 (2024), 25LT01.
  • [44] C. Maes, Frenesy: time-symmetric dynamical activity in nonequilibria, Physics Reports 850 (2020), 1–33.
  • [45] R. Chetrite and H. Touchette, Nonequilibrium Markov processes conditioned on large deviations, Annales Henri Poincaré 16 (2015), 2005–2057.
  • [46] S. Chatterjee, Spectral gap of nonreversible Markov chains, The Annals of Applied Probability 35 (2025), 2644–2677.
  • [47] J.-M. Souriau, Structure of Dynamical Systems: A Symplectic View of Physics, Birkhäuser, Boston, 1997.
  • [48] F. Barbaresco, Geometric theory of heat from Souriau Lie groups thermodynamics and Koszul Hessian geometry: applications in information geometry for exponential families, Entropy 18 (2016), 386.
  • [49] F. Barbaresco, Higher order geometric theory of information and heat based on poly-symplectic geometry of Souriau Lie groups thermodynamics and their contextures, Entropy 20 (2018), 840.
  • [50] S. Mohite and H. Rieger, Thermodynamically consistent coarse-graining: from interacting particles to fields via second quantization, preprint, 2026.
  • [51] C. Dieball and A. Godec, Mathematical, thermodynamical, and experimental necessity for coarse graining empirical densities and currents in continuous space, Physical Review Letters 129 (2022), 140601.
  • [52] G. Falasco and M. Esposito, Macroscopic stochastic thermodynamics, Reviews of Modern Physics 97 (2025), 015002.
  • [53] L. Bertini, R. Chetrite, A. Faggionato, and D. Gabrielli, Level 2.5 large deviations for continuous-time Markov chains with time periodic rates, Annales Henri Poincaré 19 (2018), 3197–3238.
  • [54] F. Coghi, A. Budhiraja, and J. P. Garrahan, Level 2.5 large deviations and uncertainty relations for non-Markov self-interacting dynamics, preprint, 2026.
  • [55] J. Zheng and Z. Lu, Thermodynamic and kinetic bounds for finite-frequency fluctuation-response, preprint, 2026.
  • [56] C. Dieball and A. Godec, Perspective: Time irreversibility in systems observed at coarse resolution, The Journal of Chemical Physics 162 (2025), 090901.
  • [57] U. Seifert, Stochastic thermodynamics, fluctuation theorems and molecular machines, Reports on Progress in Physics 75 (2012), 126001.