9/5 Bayesian optimization: AutoML and hyperparameter tuning (최승진/정보과학회 인공지능소사이어티)

작성자
kaistsoftware
작성일
2019-09-04 10:10
조회
8369
  • 강사 : 최승진 (정보과학회 인공지능소사이어티)
  • 일시 : 2019. 9. 5 (목) 17:00~19:00
We often encounter a problem in practice where the objective to be optimized is a black-box function, i.e., a closed-form expression of which is not given but expensive evaluations at query points are available. Exemplary problems are hyperparameter optimization for deep neural networks and automated machine learning (autoML) where data preprocessing, algorithm selection are chosen automatically to output the best performance. Bayesian optimization provides a principled and efficient approach to the black-box optimization, in terms of the number of function evaluations required. Bayesian optimization places a prior over the objective function and combines it with the likelihood to calculate the posterior function. This permits determining where next to sample from the objective function, which is done by the acquisition function maximization, balancing exploration and exploitation. In this talk, I introduce an underlying idea of Bayesian optimization, including Gaussian process regression and various acquisition functions such as PI, EI, and GP-UCB. If time permitted, I will discuss a few recent issues on Bayesian optimization that you might ask.
전체 119
번호 제목 작성자 작성일 추천 조회
공지사항
2024년 봄학기 콜로퀴엄 일정 안내
kaistsoftware | 2024.02.21 | 추천 1 | 조회 2282
kaistsoftware 2024.02.21 1 2282
118
4/2 LLM 기반 소프트웨어 공학의 현재와 전망 (유신 교수/KAIST 전산학부)
kaistsoftware | 2024.03.25 | 추천 0 | 조회 59
kaistsoftware 2024.03.25 0 59
117
3/26 하드웨어도 소프트웨어처럼 짜야한다 (강지훈 교수/KAIST 전산학부)
kaistsoftware | 2024.03.21 | 추천 0 | 조회 85
kaistsoftware 2024.03.21 0 85
116
3/19 자율주행과 안전 (배홍상 교수/KAIST 전산학부)
kaistsoftware | 2024.03.11 | 추천 0 | 조회 179
kaistsoftware 2024.03.11 0 179
115
3/12 에너지 효율적인 인공지능 학습 시스템 (권영진 교수/KAIST 전산학부)
kaistsoftware | 2024.03.05 | 추천 0 | 조회 235
kaistsoftware 2024.03.05 0 235
114
2/27 멀티-디바이스 모바일 플랫폼 (신인식 교수/KAIST 전산학부)
kaistsoftware | 2024.02.27 | 추천 0 | 조회 653
kaistsoftware 2024.02.27 0 653
113
11/20 Where is Autonomous Driving going? Boss, Traffic Jam Pilot, and the Future (배홍상 교수/KAIST 전산학부, Zeta Mobility)
kaistsoftware | 2023.11.16 | 추천 1 | 조회 2054
kaistsoftware 2023.11.16 1 2054
112
11/14 데이터 품질 문제에 견고한 AI 기술 (이재길 교수/KAIST 전산학부)
kaistsoftware | 2023.11.16 | 추천 1 | 조회 1445
kaistsoftware 2023.11.16 1 1445
111
11/6 인터랙션 중심 AI (김주호 교수/KAIST 전산학부)
kaistsoftware | 2023.11.01 | 추천 0 | 조회 1582
kaistsoftware 2023.11.01 0 1582
110
10/30 사모펀드의 이해 - 펀드구성과 투자구조를 중심으로 (최원호 교수/KAIST 전산학부)
kaistsoftware | 2023.10.26 | 추천 0 | 조회 1579
kaistsoftware 2023.10.26 0 1579
109
10/23 Robotic Companion: natural language to dexterous manipulation (박대형 교수/KAIST 전산학부)
kaistsoftware | 2023.10.20 | 추천 0 | 조회 1531
kaistsoftware 2023.10.20 0 1531