HELP: An LSTM-based Approach to Hyperparameter Exploration in Neural Network Learning

Wendi Li, Wing W. Y. Ng, Ting Wang, Marcello Pelillo, Sam Kwong

Paper link: [WEB]

• Focused on a learning-to-learn problem, which aimed to automatically learn the hyperparameters of deep neural networks by using an LSTM-based predictor.
• The proposed LSTM-based predictor not only retains the successful historical examples but also learns from failure lessons, used ablation studies to determine its optimal architecture.