Self-Adaptive / Self-Tuning Metaheuristics
Genetic algorithms, and more generally, evolutionary computation, along with other metaheuristics such as simulated annealing, ant colony optimization, etc, often involve a large number of so-called control parameters (e.g., mutation and crossover rates in genetic algorithms, parameters to control the cooling schedule in simulated annealing, and so forth). Getting these control parameters "right" is often critical to search performance. My research in this area includes both automated parameter tuning, as well as self-adaptive metaheuristics or automated parameter control. Automated parameter tuning involves applying optimization (such as through another genetic algorithm or other optimizer) or machine learning during the algorithm design phase to automate setting control parameter values. On the other hand, parameter control provides the metaheuristic with self-adaptation ability. For example, one approach to self-adaptive genetic algorithms is to include an encoding of the control parameters within the population and to evolve control parameters during the search. My research in this area also includes multi-heuristic search. Some forms of search require the guidance of a heuristic, and the "best" heuristic for a problem may vary widely from that of another problem, or may even vary across instances of a problem. Some of my research has applied machine learning enabling metaheuristics to adapt their choice of heuristic.
Selected Publications
- Self-Tuning Lam Annealing: Learning Hyperparameters While Problem Solving.
Vincent A. Cicirello.
Applied Sciences, 11(21), Article 9828, November 2021. doi:10.3390/app11219828
[PDF] [BIB] [DOI] - Optimizing the Modified Lam Annealing Schedule.
Vincent A. Cicirello.
EAI Endorsed Transactions on Industrial Networks and Intelligent Systems, 7(25), Article e1, December 2020. doi:10.4108/eai.16-12-2020.167653
[PDF] [BIB] [DOI] - Chips-n-Salsa: A Java Library of Customizable, Hybridizable, Iterative, Parallel, Stochastic, and Self-Adaptive Local Search Algorithms.
Vincent A. Cicirello.
Journal of Open Source Software, 5(52), Article 2448, August 2020. doi:10.21105/joss.02448
[PDF] [BIB] [DOI] - Impact of Random Number Generation on Parallel Genetic Algorithms.
Vincent A. Cicirello.
In Proceedings of the Thirty-First International Florida Artificial Intelligence Research Society Conference, pages 2-7. AAAI Press, May 2018.
[PDF] [BIB] [PUB] - Variable Annealing Length and Parallelism in Simulated Annealing.
Vincent A. Cicirello.
In Proceedings of the Tenth International Symposium on Combinatorial Search (SoCS 2017), pages 2-10. AAAI Press, June 2017.
[PDF] [BIB] [PUB] [arXiv] - Genetic Algorithm Parameter Control: Application to Scheduling with Sequence-Dependent Setups.
Vincent A. Cicirello.
In Proceedings of the 9th International Conference on Bio-inspired Information and Communications Technologies, pages 136-143. EAI, December 2015.
[PDF] [BIB] [PUB] - Statistical Models of Multistart Randomized Heuristic Search Performance.
Vincent A. Cicirello.
Technical Report, Richard Stockton College, Galloway, NJ, May 2008.
Presented at the 40th Symposium on the Interface: Computing Science and Statistics (conference without proceedings), in Durham, NC, sponsored by the National Institute of Statistical Sciences. Full paper here as Technical Report.
[PDF] [BIB] - On the Design of an Adaptive Simulated Annealing Algorithm.
Vincent A. Cicirello.
In Proceedings of the International Conference on Principles and Practice of Constraint Programming First Workshop on Autonomous Search. AAAI Press, September 2007.
[PDF] [BIB] [PUB] - The Max K-Armed Bandit: A New Model of Exploration Applied to Search Heuristic Selection.
Vincent A. Cicirello and Stephen F. Smith.
In The Proceedings of the Twentieth National Conference on Artificial Intelligence, volume 3, pages 1355-1361. AAAI Press, July 2005.
Winner of the AAAI 2005 Outstanding Paper Award.
[PDF] [BIB] [PUB] - Heuristic Selection for Stochastic Search Optimization: Modeling Solution Quality by Extreme Value Theory.
Vincent A. Cicirello and Stephen F. Smith.
In Principles and Practice of Constraint Programming - CP 2004: 10th International Conference, Proceedings, volume LNCS 3258 of Lecture Notes in Computer Science, pages 197-211. Springer-Verlag, September/October 2004. doi:10.1007/978-3-540-30201-8_17
[PDF] [BIB] [DOI] - Boosting Stochastic Problem Solvers Through Online Self-Analysis of Performance.
Vincent A. Cicirello.
PhD thesis, The Robotics Institute, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, July 2003.
[PDF] [BIB] - Modeling GA Performance for Control Parameter Optimization.
Vincent A. Cicirello and Stephen F. Smith.
In GECCO-2000: Proceedings of the Genetic and Evolutionary Computation Conference, pages 235-242. Morgan Kaufmann Publishers, July 2000.
[PDF] [BIB] [PUB]