Pre-registered hill-climbing of Hibou-L on PatchCamelyon: heads, adapters, results.
Burny
BurnyCoder
AI & ML interests
deep learning, LLMs, interpretability, science, physics
Recent Activity
updated a model about 2 hours ago
BurnyCoder/neurogeom-shape-fitter-main-s0 updated a dataset about 3 hours ago
BurnyCoder/mspacman-appo-neuron-atlas updated a dataset about 3 hours ago
BurnyCoder/length-penalized-autointerp-gpt2-smallOrganizations
Ms. Pac-Man RL neuron interpretability
Neuron-level interpretability and steering of reward-trained (no imitation) Ms. Pac-Man RL agents.
eureka-digits-luna
Reproducible research models and their recorded evaluation evidence
Geometry of Mathematics in LLMs
Field maps, ordered chains and axiom lattices of math concepts in LLM activations vs random-init twins (preregistered).
Ant locomotion steering evidence
Frozen-policy world-Y activation steering: original vectors, failed acceptance gates, controls, audit episodes, and upstream checkpoint provenance.
End-to-End BSFs on DINOv3 - full
From-scratch KL/local/mixed objectives with matched scalar controls; read cards for scope.
-
BurnyCoder/e2e-bsf-dinov3-imagenette-full-block-kl-mse-seed100
9.6M • Updated • 25 -
BurnyCoder/e2e-bsf-dinov3-imagenette-full-block-kl-mse-seed101
9.6M • Updated • 26 -
BurnyCoder/e2e-bsf-dinov3-imagenette-full-block-kl-mse-seed102
9.6M • Updated • 25 -
BurnyCoder/e2e-bsf-dinov3-imagenette-full-block-kl-mse-seed103
9.6M • Updated • 24
GPhyT Attention Residuals
Paired physics forecasting study: fixed-update checkpoints, configurations and measured evaluation.
Counterfactual concept swaps in CNNs
Pre-registered interchange interventions (concept swaps) testing Circuits neuron explanations in InceptionV1: data and results.
Qwen3-0.6B GRAFT with LLM-as-a-Judge and Probe Monitors
Single-seed pilot comparing frozen LLM-judge and probe monitors. Checkpoints and evidence; no established safety guarantee.
Oscillatory flow matching — local exploratory study
All reported MNIST/CIFAR-10 models, paired seeds, controls, and reproducible evidence.
Atemokoloporos Qwen3.8-27B LoRA runs
Completed reviewed LoRA experiment runs from the Qwen3.8-27B Atemokoloporos synthetic-fact study.
Block-Sparse Featurizers on DINOv3 Rabbits
Exact trained reproductions of Goodfire’s README quickstart and three starter notebooks using DINOv3 ViT-B/16 rabbit patch activations.
Fitting geometric shapes to neural geometry
Learned shape-type + parameter fitting for neural-geometry point clouds
auto-eureka-scientist
Research harness validation models, including the original bounded trials and explicitly extended replications.
eureka-digits-haiku
Reproducible research models and their recorded evaluation evidence
Accurate and simple interpretability explanations
Length-penalized detection scoring of SAE feature explanations
Mamba neuron interpretability
Neuron-level mechanistic interpretability of Mamba state-space LMs
End-to-End BSFs on DINOv3 - smoke
From-scratch KL/local/mixed objectives with matched scalar controls; read cards for scope.
-
BurnyCoder/e2e-bsf-dinov3-imagenette-smoke-block-kl-mse-seed100
232k • Updated • 38 -
BurnyCoder/e2e-bsf-dinov3-imagenette-smoke-block-kl-seed100
232k • Updated • 37 -
BurnyCoder/e2e-bsf-dinov3-imagenette-smoke-block-mse-seed100
232k • Updated • 40 -
BurnyCoder/e2e-bsf-dinov3-imagenette-smoke-scalar-kl-seed100
232k • Updated • 39
Looped-LM neurons
Neuron-level interpretability of looped LMs
MiniStrike staged shooter self-play
Fixed-spawn duel self-play: all confirmation and exploratory pairs, plus deferred 5v5 archives. Experimental; moving-script acceptance failed.
-
BurnyCoder/ministrike-selfplay-cpu
Reinforcement Learning • Updated • 23 -
BurnyCoder/ministrike-selfplay-cuda
Reinforcement Learning • Updated • 30 -
BurnyCoder/ministrike-duel-fixed-v1-seed5101
Reinforcement Learning • Updated • 23 -
BurnyCoder/ministrike-duel-fixed-v1-seed5102
Reinforcement Learning • Updated • 29
Visualizing grokking modular addition
Retrained runs, website data and original checkpoints of the transformer that groks modular addition.
4D Snake RL: all evaluated networks
MaskablePPO and behaviour-cloned 4D snake networks (2^4, 3^4, 4^4 boards) with configs, evaluation files and cards; negative results included.
-
BurnyCoder/4d-snake-exp02-ppo-2x4
Reinforcement Learning • Updated • 20 -
BurnyCoder/4d-snake-exp02b-ppo-2x4-backplay
Reinforcement Learning • Updated • 16 -
BurnyCoder/4d-snake-exp02c-ppo-2x4-long
Reinforcement Learning • Updated • 10 -
BurnyCoder/4d-snake-exp02d-ppo-2x4-backplay-strict
Reinforcement Learning • Updated • 17
Atemokoloporos Qwen3.5-0.8B retained checkpoints
Public evidence and retained failed or inconclusive LoRA checkpoints from the Atemokoloporos synthetic-fact study.
-
BurnyCoder/atemokoloporos-qwen3.5-0.8b-study-evidence
Updated • 90 -
BurnyCoder/qwen3.5-0.8b-atemokoloporos-positive-primary
Text Generation • Updated • 10 -
BurnyCoder/qwen3.5-0.8b-atemokoloporos-positive-conservative
Text Generation • Updated • 6 -
BurnyCoder/qwen3.5-0.8b-atemokoloporos-positive-expanded
Text Generation • Updated • 15
PCam hill-climbing of Hibou-L
Pre-registered hill-climbing of Hibou-L on PatchCamelyon: heads, adapters, results.
Fitting geometric shapes to neural geometry
Learned shape-type + parameter fitting for neural-geometry point clouds
Ms. Pac-Man RL neuron interpretability
Neuron-level interpretability and steering of reward-trained (no imitation) Ms. Pac-Man RL agents.
auto-eureka-scientist
Research harness validation models, including the original bounded trials and explicitly extended replications.
eureka-digits-luna
Reproducible research models and their recorded evaluation evidence
eureka-digits-haiku
Reproducible research models and their recorded evaluation evidence
Geometry of Mathematics in LLMs
Field maps, ordered chains and axiom lattices of math concepts in LLM activations vs random-init twins (preregistered).
Accurate and simple interpretability explanations
Length-penalized detection scoring of SAE feature explanations
Ant locomotion steering evidence
Frozen-policy world-Y activation steering: original vectors, failed acceptance gates, controls, audit episodes, and upstream checkpoint provenance.
Mamba neuron interpretability
Neuron-level mechanistic interpretability of Mamba state-space LMs
End-to-End BSFs on DINOv3 - full
From-scratch KL/local/mixed objectives with matched scalar controls; read cards for scope.
-
BurnyCoder/e2e-bsf-dinov3-imagenette-full-block-kl-mse-seed100
9.6M • Updated • 25 -
BurnyCoder/e2e-bsf-dinov3-imagenette-full-block-kl-mse-seed101
9.6M • Updated • 26 -
BurnyCoder/e2e-bsf-dinov3-imagenette-full-block-kl-mse-seed102
9.6M • Updated • 25 -
BurnyCoder/e2e-bsf-dinov3-imagenette-full-block-kl-mse-seed103
9.6M • Updated • 24
End-to-End BSFs on DINOv3 - smoke
From-scratch KL/local/mixed objectives with matched scalar controls; read cards for scope.
-
BurnyCoder/e2e-bsf-dinov3-imagenette-smoke-block-kl-mse-seed100
232k • Updated • 38 -
BurnyCoder/e2e-bsf-dinov3-imagenette-smoke-block-kl-seed100
232k • Updated • 37 -
BurnyCoder/e2e-bsf-dinov3-imagenette-smoke-block-mse-seed100
232k • Updated • 40 -
BurnyCoder/e2e-bsf-dinov3-imagenette-smoke-scalar-kl-seed100
232k • Updated • 39
GPhyT Attention Residuals
Paired physics forecasting study: fixed-update checkpoints, configurations and measured evaluation.
Looped-LM neurons
Neuron-level interpretability of looped LMs
Counterfactual concept swaps in CNNs
Pre-registered interchange interventions (concept swaps) testing Circuits neuron explanations in InceptionV1: data and results.
MiniStrike staged shooter self-play
Fixed-spawn duel self-play: all confirmation and exploratory pairs, plus deferred 5v5 archives. Experimental; moving-script acceptance failed.
-
BurnyCoder/ministrike-selfplay-cpu
Reinforcement Learning • Updated • 23 -
BurnyCoder/ministrike-selfplay-cuda
Reinforcement Learning • Updated • 30 -
BurnyCoder/ministrike-duel-fixed-v1-seed5101
Reinforcement Learning • Updated • 23 -
BurnyCoder/ministrike-duel-fixed-v1-seed5102
Reinforcement Learning • Updated • 29
Qwen3-0.6B GRAFT with LLM-as-a-Judge and Probe Monitors
Single-seed pilot comparing frozen LLM-judge and probe monitors. Checkpoints and evidence; no established safety guarantee.
Visualizing grokking modular addition
Retrained runs, website data and original checkpoints of the transformer that groks modular addition.
Oscillatory flow matching — local exploratory study
All reported MNIST/CIFAR-10 models, paired seeds, controls, and reproducible evidence.
4D Snake RL: all evaluated networks
MaskablePPO and behaviour-cloned 4D snake networks (2^4, 3^4, 4^4 boards) with configs, evaluation files and cards; negative results included.
-
BurnyCoder/4d-snake-exp02-ppo-2x4
Reinforcement Learning • Updated • 20 -
BurnyCoder/4d-snake-exp02b-ppo-2x4-backplay
Reinforcement Learning • Updated • 16 -
BurnyCoder/4d-snake-exp02c-ppo-2x4-long
Reinforcement Learning • Updated • 10 -
BurnyCoder/4d-snake-exp02d-ppo-2x4-backplay-strict
Reinforcement Learning • Updated • 17
Atemokoloporos Qwen3.8-27B LoRA runs
Completed reviewed LoRA experiment runs from the Qwen3.8-27B Atemokoloporos synthetic-fact study.
Atemokoloporos Qwen3.5-0.8B retained checkpoints
Public evidence and retained failed or inconclusive LoRA checkpoints from the Atemokoloporos synthetic-fact study.
-
BurnyCoder/atemokoloporos-qwen3.5-0.8b-study-evidence
Updated • 90 -
BurnyCoder/qwen3.5-0.8b-atemokoloporos-positive-primary
Text Generation • Updated • 10 -
BurnyCoder/qwen3.5-0.8b-atemokoloporos-positive-conservative
Text Generation • Updated • 6 -
BurnyCoder/qwen3.5-0.8b-atemokoloporos-positive-expanded
Text Generation • Updated • 15
Block-Sparse Featurizers on DINOv3 Rabbits
Exact trained reproductions of Goodfire’s README quickstart and three starter notebooks using DINOv3 ViT-B/16 rabbit patch activations.