9/21 Efficient LLM Serving for Multi-Agent Systems (권영진 교수/KAIST 전산학부)
작성자
kaistsoftware
작성일
2026-09-21 17:36
조회
566
- 강사 : 권영진 교수 (KAIST 전산학부)
- 일시 : 2026. 9. 21. (월) 16:00~17:30
File-mapped weights enable OS reclamation but incur a CPU--GPU cache coherence tax that reduces GPU read bandwidth.
We present \sysname{}, which selectively enables non-coherent reads of file-backed pages, revokes mappings before writes or reclaim,
and tracks activity through coherent canary pages.
\sysname{} preserves the existing \texttt{mmap} interface and semantics, requiring no application source changes for coherence management.
It combines fast GPU reads with OS reclamation without copying or pinning weight pages.
Across an agentic workload with increasing memory overcommitment, a single policy configuration reduces request latency by 10--18\%
relative to OS-managed weights and 6--55\% relative to driver-managed weights.
전체 169
| 번호 | 제목 | 작성자 | 작성일 | 추천 | 조회 |
| 공지사항 |
2026년 가을학기 콜로퀴엄 일정 안내
kaistsoftware
|
2026.09.11
|
추천 0
|
조회 1062
|
kaistsoftware | 2026.09.11 | 0 | 1062 |
| 168 |
11/2 AI 시대, 우리는 어떤 미래를 만들 수 있을까? (이의진 교수/KAIST AI컴퓨팅학과)
kaistsoftware
|
2026.10.30
|
추천 0
|
조회 109
|
kaistsoftware | 2026.10.30 | 0 | 109 |
| 167 |
10/26 Multimodal Generation Machine Perception (오태현 교수/KAIST 전산학부)
kaistsoftware
|
2026.10.23
|
추천 0
|
조회 135
|
kaistsoftware | 2026.10.23 | 0 | 135 |
| 166 |
10/12 AI 보안 위협의 진화 (손수엘 교수/KAIST 전산학부)
kaistsoftware
|
2026.10.12
|
추천 0
|
조회 263
|
kaistsoftware | 2026.10.12 | 0 | 263 |
| 165 |
9/21 Efficient LLM Serving for Multi-Agent Systems (권영진 교수/KAIST 전산학부)
kaistsoftware
|
2026.09.21
|
추천 0
|
조회 566
|
kaistsoftware | 2026.09.21 | 0 | 566 |
| 164 |
9/14 센싱 기반 피지컬 AI (한준 교수/KAIST 전산학부)
kaistsoftware
|
2026.09.11
|
추천 0
|
조회 686
|
kaistsoftware | 2026.09.11 | 0 | 686 |
| 163 |
5/18 믿고 쓸만한 AI 에이전트를 위하여 (허기홍 교수/KAIST 전산학부)
kaistsoftware
|
2026.05.06
|
추천 0
|
조회 1223
|
kaistsoftware | 2026.05.06 | 0 | 1223 |
| 162 |
5/11 LLMServingSim: Bridging AI Hardware Innovation and Real-World LLM Serving (박종세 교수/KAIST 전산학부)
kaistsoftware
|
2026.05.06
|
추천 0
|
조회 1100
|
kaistsoftware | 2026.05.06 | 0 | 1100 |
| 161 |
4/27 From Visual Understanding to Embodied Intelligence: Agentic AI and Physical AI in Robotics (윤성의 교수/KAIST 전산학부)
kaistsoftware
|
2026.04.17
|
추천 0
|
조회 1109
|
kaistsoftware | 2026.04.17 | 0 | 1109 |
| 160 |
4/20 World Model: Spatial Physical Generative AI (김태균 교수/KAIST 전산학부)
kaistsoftware
|
2026.04.17
|
추천 0
|
조회 3446
|
kaistsoftware | 2026.04.17 | 0 | 3446 |
| 159 |
4/13 LLM 시대의 Computer Science 교육과 AI 연구의 미래 (성민혁 교수/KAIST 전산학부)
kaistsoftware
|
2026.04.10
|
추천 0
|
조회 1031
|
kaistsoftware | 2026.04.10 | 0 | 1031 |