Back to search
2109.09203

Topology, Convergence, and Reconstruction of Predictive States

Samuel P. Loomis, James P. Crutchfield

incompletemedium confidence
Category
math.DS
Journal tier
Specialist/Solid
Processed
Sep 28, 2025, 12:56 AM

Audit review

The paper’s Theorem 5 states the estimator as Ĉ(←−X−→X)(Ĉ(←−X←−X) − ζ I)^{-1}|δ_{←−X}〉 with a rate O((Lζ)^{-1/2} + ζ^{1/2} + γ^{−`} + h_{←−X}(`)) under stationarity and ergodicity. However, two issues arise directly from the text: (i) the regularization sign is written as “−ζ I” both in the KBR statement and in Theorem 5, whereas the standard and necessary Tikhonov regularization is “+ζ I” to ensure invertibility and stability; see their own KBR-like statement immediately preceding Theorem 5 where the same “−ζ I” appears, contradicting standard CME/KBR formulations (and the intended rate expression) . (ii) The tail term is given as γ^{−`}, but the paper has already fixed 0 < γ < 1 in defining the discounted sequence metric and kernel, making γ^{−`} explode as ` increases and thus incompatible with the claimed convergence as ` → ∞; earlier finite-length embedding results in the same paper scale as O(γ^{`}), not γ^{−`} . Moreover, the theorem asserts an almost-sure root-L sampling rate under mere stationarity and ergodicity, which is not justified; obtaining such a rate typically requires mixing assumptions beyond ergodicity. The candidate solution corrects the regularization sign to “+ζ I”, replaces the tail by O(γ^{`}), and explicitly supplies a mixing assumption to justify the root-L behavior, while giving a standard three-term CME error decomposition. These corrections align with standard CME/KBR results and with the paper’s own earlier constructions, yielding a coherent, correct proof and rate.

Referee report (LaTeX)

\textbf{Recommendation:} major revisions

\textbf{Journal Tier:} specialist/solid

\textbf{Justification:}

The work usefully connects predictive states to RKHS embeddings and provides a coherent pathway to learning predictive states from data. However, the main theorem, as written, contains a sign error in the regularizer and an impossible truncation term, and it asserts a rate under insufficient assumptions. With these corrected, the result would be solid and aligned with standard CME/KBR theory, but the corrections are essential for correctness.