Hidenori Tanaka

According to our database, Hidenori Tanaka authored at least 36 papers between 1992 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

The Limiting Dynamics of SGD: Modified Loss, Phase-Space Oscillations, and Anomalous Diffusion.

Daniel Kunin, Javier Sagastuy-Breña, Lauren E. Gillespie, Eshed Margalit, Hidenori Tanaka, Surya Ganguli, Daniel L. K. Yamins

Neural Comput., January, 2024

Forking Paths in Neural Text Generation.

Eric J. Bigelow, Ari Holtzman, Hidenori Tanaka, Tomer D. Ullman

CoRR, 2024

Competition Dynamics Shape Algorithmic Phases of In-Context Learning.

Core Francisco Park, Ekdeep Singh Lubana, Itamar Pres, Hidenori Tanaka

CoRR, 2024

Continuous-Time Analysis of Adaptive Optimization and Normalization.

Rhys Gould, Hidenori Tanaka

CoRR, 2024

Representation Shattering in Transformers: A Synthetic Study with Knowledge Editing.

Kento Nishi, Maya Okawa, Rahul Ramesh, Mikail Khona, Ekdeep Singh Lubana, Hidenori Tanaka

CoRR, 2024

Dynamics of Concept Learning and Compositional Generalization.

Yongyi Yang, Core Francisco Park, Ekdeep Singh Lubana, Maya Okawa, Wei Hu, Hidenori Tanaka

CoRR, 2024

A Percolation Model of Emergence: Analyzing Transformers Trained on a Formal Language.

Ekdeep Singh Lubana, Kyogo Kawaguchi, Robert P. Dick, Hidenori Tanaka

CoRR, 2024

Emergence of Hidden Capabilities: Exploring Learning Dynamics in Concept Space.

Core Francisco Park, Maya Okawa, Andrew Lee, Ekdeep Singh Lubana, Hidenori Tanaka

CoRR, 2024

Compositional Capabilities of Autoregressive Transformers: A Study on Synthetic, Interpretable Tasks.

Rahul Ramesh, Ekdeep Singh Lubana, Mikail Khona, Robert P. Dick, Hidenori Tanaka

Proceedings of the Forty-first International Conference on Machine Learning, 2024

Towards an Understanding of Stepwise Inference in Transformers: A Synthetic Graph Navigation Model.

Mikail Khona, Maya Okawa, Jan Hula, Rahul Ramesh, Kento Nishi, Robert P. Dick, Ekdeep Singh Lubana, Hidenori Tanaka

Proceedings of the Forty-first International Conference on Machine Learning, 2024

Mechanistically analyzing the effects of fine-tuning on procedurally defined tasks.

Samyak Jain, Robert Kirk, Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka, Tim Rocktäschel, Edward Grefenstette, David Scott Krueger

Proceedings of the Twelfth International Conference on Learning Representations, 2024

In-Context Learning Dynamics with Random Binary Sequences.

Eric J. Bigelow, Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka, Tomer D. Ullman

Proceedings of the Twelfth International Conference on Learning Representations, 2024

2023

How Capable Can a Transformer Become? A Study on Synthetic, Interpretable Tasks.

Rahul Ramesh, Mikail Khona, Robert P. Dick, Hidenori Tanaka, Ekdeep Singh Lubana

CoRR, 2023

Compositional Abilities Emerge Multiplicatively: Exploring Diffusion Models on a Synthetic Task.

Maya Okawa, Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

CORNN: Convex optimization of recurrent neural networks for rapid inference of neural dynamics.

Fatih Dinc, Adam Shai, Mark Schnitzer, Hidenori Tanaka

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Mechanistic Mode Connectivity.

Ekdeep Singh Lubana, Eric J. Bigelow, Robert P. Dick, David Scott Krueger, Hidenori Tanaka

Proceedings of the International Conference on Machine Learning, 2023

What shapes the loss landscape of self supervised learning?

Ziyin Liu, Ekdeep Singh Lubana, Masahito Ueda, Hidenori Tanaka

Proceedings of the Eleventh International Conference on Learning Representations, 2023

2022

A lexical approach for identifying behavioural action sequences.

Gautam Reddy, Laura Desban, Hidenori Tanaka, Julian Roussel, Olivier Mirat, Claire Wyart

PLoS Comput. Biol., 2022

2021

Genetic dissection of complex traits using hierarchical biological knowledge.

Hidenori Tanaka, Jason F. Kreisberg, Trey Ideker

PLoS Comput. Biol., 2021

Rethinking the limiting dynamics of SGD: modified loss, phase space oscillations, and anomalous diffusion.

Daniel Kunin, Javier Sagastuy-Breña, Lauren E. Gillespie, Eshed Margalit, Hidenori Tanaka, Surya Ganguli, Daniel L. K. Yamins

CoRR, 2021

Beyond BatchNorm: Towards a General Understanding of Normalization in Deep Learning.

Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka

CoRR, 2021

Noether's Learning Dynamics: The Role of Kinetic Symmetry Breaking in Deep Learning.

Hidenori Tanaka, Daniel Kunin

CoRR, 2021

Noether's Learning Dynamics: Role of Symmetry Breaking in Neural Networks.

Hidenori Tanaka, Daniel Kunin

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Beyond BatchNorm: Towards a Unified Understanding of Normalization in Deep Learning.

Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics.

Daniel Kunin, Javier Sagastuy-Breña, Surya Ganguli, Daniel L. K. Yamins, Hidenori Tanaka

Proceedings of the 9th International Conference on Learning Representations, 2021

2020

Pruning neural networks without any data by iteratively conserving synaptic flow.

Hidenori Tanaka, Daniel Kunin, Daniel L. K. Yamins, Surya Ganguli

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

2019

From deep learning to mechanistic understanding in neuroscience: the structure of retinal prediction.

Hidenori Tanaka, Aran Nayebi, Niru Maheswaranathan, Lane McIntosh, Stephen Baccus, Surya Ganguli

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

2010

Statistical method for classifying cries of baby based on pattern recognition of power spectrum.

Xinping Wang, Tomomasa Nagashima, Kentarou Fukuta, Yoshifumi Okada, Masahiro Sawai, Hidenori Tanaka, Takashi Uozumi

Int. J. Biom., 2010

A Study on Wear of Brush and Carbon Flat Commutator of DC Motor for Automotive Fuel Pump.

Koichiro Sawa, Takahiro Ueno, Hidenori Tanaka

IEICE Trans. Electron., 2010

2009

Simple Model for Estimating Birefringence of LPFG Using Photoelastic Effect.

Tetsuro Yabu, Hidenori Tanaka, Masaharu Ohashi

IEICE Trans. Electron., 2009

Dynamics Analysis of Facial Expressions for Person Identification.

Hidenori Tanaka, Hideo Saito

Proceedings of the Computer Analysis of Images and Patterns, 13th International Conference, 2009

2008

An overview of Kansei engineering: a proposal of Kansei informatics toward realising safety and pleasantness of individuals in information network society.

Tomomasa Nagashima, Hidenori Tanaka, Takashi Uozumi

Int. J. Biom., 2008

Online anomal movement detection based on unsupervised incremental learning.

Kyoko Sudo, Tatsuya Osawa, Hidenori Tanaka, Hideki Koike, Kenichi Arakawa

Proceedings of the 19th International Conference on Pattern Recognition (ICPR 2008), 2008

2007

Human Pose Estimation from Volume Data and Topological Graph Database.

Hidenori Tanaka, Atsushi Nakazawa, Haruo Takemura

Proceedings of the Computer Vision, 2007

2005

Dynamically Visual Learning for People Identification with Sparsely Distributed Cameras.

Hidenori Tanaka, Itaru Kitahara, Hideo Saito, Hiroshi Murase, Kiyoshi Kogure, Norihiro Hagita

Proceedings of the Image Analysis, 14th Scandinavian Conference, 2005

1992

Shape and source from shading using zero crossings.

Shozo Kondo, Tong Xu, Hidenori Tanaka, Manas Sangwarasil, Kiyoaki Atsuta

Proceedings of the 11th IAPR International Conference on Pattern Recognition, 1992