按年被提到
20162016 · 3 次2026
机器学习与深度学习›贝叶斯方法与 AutoML·arXiv:1603.09441 · cs.LG

A Stratified Analysis of Bayesian Optimization Methods

Ian Dewancker, Michael McCourt, Scott Clark, Patrick Hayes, Alexandra Johnson, George Ke · 2016
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2016-08-09 · 最近 2018-08-27
2不同的人
3活跃月份
4讨论串
24被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Empirical analysis serves as an important complement to theoretical analysis for studying practical Bayesian optimization. Often empirical insights expose strengths and weaknesses inaccessible to theoretical analysis. We define two metrics for comparing the performance of Bayesian optimization methods and propose a ranking mechanism for summarizing performance within various genres or strata of test functions. These test functions serve to mimic the complexity of hyperparameter optimization problems, the most prominent application of Bayesian optimization, but with a closed form which allows for rapid evaluation and more predictable behavior. This offers a flexible and efficient way to investigate functions with specific properties of interest, such as oscillatory behavior or an optimum on the domain boundary.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论Zephyr314 · 2016-08

“Great questions! The Spark hyperparameter selection uses an exhaustive grid search approach, which can take a long time (complexity grows exponentially with number of parameters to tune) and produce poor results when compared to other methods [1]. Bayesian optimization is a great way to tune time consuming and expensive functions like ML pipelines, where…”

Bayesian Optimization for Collaborative Filtering with MLlib原评论 ↗
评论Zephyr314 · 2016-08

“Great question. SigOpt is a hosted, scalable ensemble of different Bayesian optimization methods. Many of these methods use Gaussian Processes (GPs) as part of the modeling aspect of their Sequential Model Based Optimization (SMBO). We've written up a primer on Bayesian optimization [1] that goes over some of the different methods, with lots of citations …”

Bayesian Optimization for Collaborative Filtering with MLlib原评论 ↗
评论Zephyr314 · 2016-08

“We compare to some standard convex optimization techniques implemented in scipy here [1]. We have comparisons to some other Bayesian methods here [2]. I'm happy to answer any questions! [1]: https://github.com/sigopt/sigopt-examples/blob/master/ipython-notebook-example/SigOpt_Introduction.ipynb [2]: http://arxiv.org/abs/1603.09441”

Intro to Multicriteria Optimization原评论 ↗
评论Zephyr314 · 2018-05

“We built an evaluation suite [1] and have some benchmarks [2] that we presented at some ICML workshops in 2016 comparing against some standard and open source methods. Members of our research team built or contributed to many of the popular open source libraries in Bayesian optimization (MOE, Bayesopt, Hyperopt, etc). In many of our other examples we benc…”

Circulant Binary Embeddings原评论 ↗
评论btown · 2018-08

“I wasn't familiar with SigOpt - this is really cool. I actually think SigOpt will see this as great publicity telling people about the usefulness of the concept - and whereas Google won't lift a finger for (insert hedge fund or pharmaceutical giant here) beyond maintaining uptime, SigOpt can provide those customers with customized advice about how to inte…”

Google Vizier: A Service for Black-Box Optimization原评论 ↗