Ilya Loshchilov

Orcid: 0000-0001-9007-2064

According to our database1, Ilya Loshchilov authored at least 35 papers between 2010 and 2024.

Collaborative distances:
  • Dijkstra number2 of five.
  • Erdős number3 of four.

Timeline

Legend:

Book 
In proceedings 
Article 
PhD thesis 
Dataset
Other 

Links

On csauthors.net:

Bibliography

2024
nGPT: Normalized Transformer with Representation Learning on the Hypersphere.
CoRR, 2024

2023
Weight Norm Control.
CoRR, 2023

2019
Large Scale Black-Box Optimization by Limited-Memory Matrix Adaptation.
IEEE Trans. Evol. Comput., 2019

Decoupled Weight Decay Regularization.
Proceedings of the 7th International Conference on Learning Representations, 2019

2018
Back to Basics: Benchmarking Canonical Evolution Strategies for Playing Atari.
Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, 2018


2017
LM-CMA: An Alternative to L-BFGS for Large-Scale Black Box Optimization.
Evol. Comput., 2017

Fixing Weight Decay Regularization in Adam.
CoRR, 2017

Limited-Memory Matrix Adaptation for Large Scale Black-box Optimization.
CoRR, 2017

A Downsampled Variant of ImageNet as an Alternative to the CIFAR datasets.
CoRR, 2017

SGDR: Stochastic Gradient Descent with Warm Restarts.
Proceedings of the 5th International Conference on Learning Representations, 2017

2016
SGDR: Stochastic Gradient Descent with Restarts.
CoRR, 2016

CMA-ES for Hyperparameter Optimization of Deep Neural Networks.
CoRR, 2016

Anytime Bi-Objective Optimization with a Hybrid Multi-Objective CMA-ES (HMO-CMA-ES).
Proceedings of the Genetic and Evolutionary Computation Conference, 2016

2015
Online Batch Selection for Faster Training of Neural Networks.
CoRR, 2015

2014
Maximum Likelihood-Based Online Adaptation of Hyper-Parameters in CMA-ES.
Proceedings of the Parallel Problem Solving from Nature - PPSN XIII, 2014

A computationally efficient limited memory CMA-ES for large scale optimization.
Proceedings of the Genetic and Evolutionary Computation Conference, 2014

RoboGen: Robot Generation through Artificial Evolution.
Proceedings of the Fourteenth International Conference on the Simulation and Synthesis of Living Systems, 2014

2013
Surrogate-Assisted Evolutionary Algorithms.
PhD thesis, 2013

KL-based Control of the Learning Schedule for Surrogate Black-Box Optimization.
CoRR, 2013

Bi-population CMA-ES agorithms with surrogate models and line searches.
Proceedings of the Genetic and Evolutionary Computation Conference, 2013

Intensive surrogate model exploitation in self-adaptive surrogate-assisted cma-es (saacm-es).
Proceedings of the Genetic and Evolutionary Computation Conference, 2013

CMA-ES with restarts for solving CEC 2013 benchmark problems.
Proceedings of the IEEE Congress on Evolutionary Computation, 2013

Fast Adaptive Object Detection towards a Smart Environment by a Mobile Robot.
Proceedings of the Ambient Intelligence - 4th International Joint Conference, 2013

2012
Alternative Restart Strategies for CMA-ES.
Proceedings of the Parallel Problem Solving from Nature - PPSN XII, 2012

Black-box optimization benchmarking of NIPOP-aCMA-ES and NBIPOP-aCMA-ES on the BBOB-2012 noiseless testbed.
Proceedings of the Genetic and Evolutionary Computation Conference, 2012

Black-box optimization benchmarking of IPOP-saACM-ES on the BBOB-2012 noisy testbed.
Proceedings of the Genetic and Evolutionary Computation Conference, 2012

Black-box optimization benchmarking of IPOP-saACM-ES and BIPOP-saACM-ES on the BBOB-2012 noiseless testbed.
Proceedings of the Genetic and Evolutionary Computation Conference, 2012

Self-adaptive surrogate-assisted covariance matrix adaptation evolution strategy.
Proceedings of the Genetic and Evolutionary Computation Conference, 2012

2011
Adaptive coordinate descent.
Proceedings of the 13th Annual Genetic and Evolutionary Computation Conference, 2011

Not All Parents Are Equal for MO-CMA-ES.
Proceedings of the Evolutionary Multi-Criterion Optimization, 2011

2010
Dominance-Based Pareto-Surrogate for Multi-Objective Optimization.
Proceedings of the Simulated Evolution and Learning - 8th International Conference, 2010

Comparison-Based Optimizers Need Comparison-Based Surrogates.
Proceedings of the Parallel Problem Solving from Nature, 2010

A pareto-compliant surrogate approach for multiobjective optimization.
Proceedings of the Genetic and Evolutionary Computation Conference, 2010

A mono surrogate for multiobjective optimization.
Proceedings of the Genetic and Evolutionary Computation Conference, 2010


  Loading...