Bayesian Optimization (BO) is a class of black-box, surrogate-based heuristics that can efficiently optimize problems that are expensive to evaluate and therefore allow only small evaluation budgets. Regardless of the size of the budget, high dimensionality also poses a challenge to BO, whose performance reportedly often suffers when the dimension exceeds 15 variables. Many new algorithms have been proposed to address this problem. However, it is not well understood which one is the best for which optimization scenario. In this work, we compare five state-of-the-art high-dimensional BO algorithms, with vanilla BO and CMA-ES on the 24 BBOB functions of the COCO environment at two dimensionalities, 10 and 60 variables. Our results confirm the superiority of BO over CMA-ES for limited evaluation budgets and suggest that the most promising approach to improve BO at high dimensionality is the use of trust regions. However, we also observe significant performance differences for different function landscapes and budget exploitation phases, indicating improvement potential, e.g., through hybridization of algorithmic components.

Comparison of Bayesian Optimization Algorithms for BBOB Problems in Dimensions 10 and 60

Santoni M. L.
Primo
;
De Leone R.
Secondo
;
Raponi E.
Penultimo
;
2023-01-01

Abstract

Bayesian Optimization (BO) is a class of black-box, surrogate-based heuristics that can efficiently optimize problems that are expensive to evaluate and therefore allow only small evaluation budgets. Regardless of the size of the budget, high dimensionality also poses a challenge to BO, whose performance reportedly often suffers when the dimension exceeds 15 variables. Many new algorithms have been proposed to address this problem. However, it is not well understood which one is the best for which optimization scenario. In this work, we compare five state-of-the-art high-dimensional BO algorithms, with vanilla BO and CMA-ES on the 24 BBOB functions of the COCO environment at two dimensionalities, 10 and 60 variables. Our results confirm the superiority of BO over CMA-ES for limited evaluation budgets and suggest that the most promising approach to improve BO at high dimensionality is the use of trust regions. However, we also observe significant performance differences for different function landscapes and budget exploitation phases, indicating improvement potential, e.g., through hybridization of algorithmic components.
2023
9798400701207
273
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11581/479203
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact