Stefan Heimersheim

According to our database, Stefan Heimersheim authored at least 9 papers between 2023 and 2024.

Collaborative distances:

• Dijkstra number of five.
• Erdős number of four.

2024

Investigating Sensitive Directions in GPT-2: An Improved Baseline and Comparative Analysis of SAEs.

Daniel J. Lee, Stefan Heimersheim

CoRR, 2024

Evolution of SAE Features Across Layers in LLMs.

Daniel Balcells, Benjamin Lerner, Michael Oesterle, Ediz Ucar, Stefan Heimersheim

CoRR, 2024

Characterizing stable regions in the residual stream of LLMs.

Jett Janiak, Jacek Karwowski, Chatrik Singh Mangat, Giorgi Giglemiani, Nora Petrova, Stefan Heimersheim

CoRR, 2024

Evaluating Synthetic Activations composed of SAE Latents in GPT-2.

Giorgi Giglemiani, Nora Petrova, Chatrik Singh Mangat, Jett Janiak, Stefan Heimersheim

CoRR, 2024

You can remove GPT2's LayerNorm by fine-tuning.

Stefan Heimersheim

CoRR, 2024

The Local Interaction Basis: Identifying Computationally-Relevant and Sparsely Interacting Features in Neural Networks.

Lucius Bushnaq, Stefan Heimersheim, Nicholas Goldowsky-Dill, Dan Braun, Jake Mendel, Kaarel Hänni, Avery Griffin, Jörn Stöhler, Magdalena Wache, Marius Hobbhahn

CoRR, 2024

Using Degeneracy in the Loss Landscape for Mechanistic Interpretability.

Lucius Bushnaq, Jake Mendel, Stefan Heimersheim, Dan Braun, Nicholas Goldowsky-Dill, Kaarel Hänni, Cindy Wu, Marius Hobbhahn

CoRR, 2024

How to use and interpret activation patching.

Stefan Heimersheim, Neel Nanda

CoRR, 2024

2023

Towards Automated Circuit Discovery for Mechanistic Interpretability.

Arthur Conmy, Augustine N. Mavor-Parker, Aengus Lynch, Stefan Heimersheim, Adrià Garriga-Alonso

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023