Timaeus - Research https://timaeus.co/research Research publications from Timaeus http://www.rssboard.org/rss-specification python-feedgen en Sun, 23 Aug 2026 01:30:59 +0000 Spectroscopy at Scale: Finding Interpretable Structure in Pythia-1.4B https://timaeus.co/research/2026-04-21-spectroscopy-main Murfet et al. https://timaeus.co/research/2026-04-21-spectroscopy-main Tue, 21 Apr 2026 00:00:00 +0000 Patterning: The Dual of Interpretability https://timaeus.co/research/2026-01-20-patterning Wang and Murfet https://timaeus.co/research/2026-01-20-patterning Tue, 20 Jan 2026 00:00:00 +0000 Towards Spectroscopy: Susceptibility Clusters in Language Models https://timaeus.co/research/2026-01-19-towards-spectroscopy Gordon et al. https://timaeus.co/research/2026-01-19-towards-spectroscopy Mon, 19 Jan 2026 00:00:00 +0000 Stagewise Reinforcement Learning and the Geometry of the Regret Landscape https://timaeus.co/research/2026-01-12-stagewise-reinforcement-learning Elliott et al. https://timaeus.co/research/2026-01-12-stagewise-reinforcement-learning Mon, 12 Jan 2026 00:00:00 +0000 Compressibility Measures Complexity: Minimum Description Length Meets Singular Learning Theory https://timaeus.co/research/2025-10-13-smdl Urdshals et al. https://timaeus.co/research/2025-10-13-smdl Mon, 13 Oct 2025 00:00:00 +0000 Influence Dynamics and Stagewise Data Attribution https://timaeus.co/research/2025-10-05-influence-dynamics Lee et al. https://timaeus.co/research/2025-10-05-influence-dynamics Sun, 05 Oct 2025 00:00:00 +0000 Bayesian Influence Functions for Hessian-Free Data Attribution https://timaeus.co/research/2025-09-30-bayesian-influence Kreer et al. https://timaeus.co/research/2025-09-30-bayesian-influence Tue, 30 Sep 2025 00:00:00 +0000 The Loss Kernel: A Geometric Probe for Deep Learning Interpretability https://timaeus.co/research/2025-09-30-the-loss-kernel Adam et al. https://timaeus.co/research/2025-09-30-the-loss-kernel Tue, 30 Sep 2025 00:00:00 +0000 Embryology of a Language Model https://timaeus.co/research/2025-08-01-embryology-of-a-language-model Wang et al. https://timaeus.co/research/2025-08-01-embryology-of-a-language-model Fri, 01 Aug 2025 00:00:00 +0000 From Global to Local: A Scalable Benchmark for Local Posterior Sampling https://timaeus.co/research/2025-07-29-local-posterior-sampling Hitchcock and Hoogland https://timaeus.co/research/2025-07-29-local-posterior-sampling Tue, 29 Jul 2025 00:00:00 +0000 Modes of Sequence Models and Learning Coefficients https://timaeus.co/research/2025-04-25-modes Chen and Murfet https://timaeus.co/research/2025-04-25-modes Fri, 25 Apr 2025 00:00:00 +0000 Structural Inference: Interpreting Small Language Models with Susceptibilities https://timaeus.co/research/2025-04-25-susceptibilities Baker et al. https://timaeus.co/research/2025-04-25-susceptibilities Fri, 25 Apr 2025 00:00:00 +0000 Programs as Singularities https://timaeus.co/research/2025-04-10-programs-as-singularities Murfet and Troiani https://timaeus.co/research/2025-04-10-programs-as-singularities Thu, 10 Apr 2025 00:00:00 +0000 You Are What You Eat – AI Alignment Requires Understanding How Data Shapes Structure and Generalisation https://timaeus.co/research/2025-02-08-position Lehalleur et al. https://timaeus.co/research/2025-02-08-position Sat, 08 Feb 2025 00:00:00 +0000 Structure Development in List-Sorting Transformers https://timaeus.co/research/2025-01-30-list-sorting Urdshals and Urdshals · ICML SMUNN Workshop https://timaeus.co/research/2025-01-30-list-sorting Thu, 30 Jan 2025 00:00:00 +0000 Dynamics of Transient Structure in In-Context Linear Regression Transformers https://timaeus.co/research/2025-01-29-transient-structure Carroll et al. https://timaeus.co/research/2025-01-29-transient-structure Wed, 29 Jan 2025 00:00:00 +0000 Differentiation and Specialization of Attention Heads via the Refined Local Learning Coefficient https://timaeus.co/research/2024-10-04-differentiation-and-specialization Wang et al. · ICLR · Spotlight https://timaeus.co/research/2024-10-04-differentiation-and-specialization Fri, 04 Oct 2024 00:00:00 +0000 Loss Landscape Degeneracy and Stagewise Development of Transformers https://timaeus.co/research/2024-02-04-developmental-landscape Hoogland et al. · TMLR · Best Paper at 2024 ICML HiLD Workshop https://timaeus.co/research/2024-02-04-developmental-landscape Sun, 04 Feb 2024 00:00:00 +0000 The Local Learning Coefficient: A Singularity-Aware Complexity Measure https://timaeus.co/research/2023-08-23-quantifying-degeneracy Lau et al. · AISTATS 2025 https://timaeus.co/research/2023-08-23-quantifying-degeneracy Wed, 23 Aug 2023 00:00:00 +0000