9/21 Efficient LLM Serving for Multi-Agent Systems (권영진 교수/KAIST 전산학부)

작성자
kaistsoftware
작성일
2026-09-21 17:36
조회
566
  • 강사 : 권영진 교수 (KAIST 전산학부)
  • 일시 : 2026. 9. 21. (월) 16:00~17:30
Unified-memory systems share physical memory between CPU tasks and GPU inference, but the OS cannot reclaim driver-managed weights.
File-mapped weights enable OS reclamation but incur a CPU--GPU cache coherence tax that reduces GPU read bandwidth.
We present \sysname{}, which selectively enables non-coherent reads of file-backed pages, revokes mappings before writes or reclaim,
and tracks activity through coherent canary pages.
\sysname{} preserves the existing \texttt{mmap} interface and semantics, requiring no application source changes for coherence management.
It combines fast GPU reads with OS reclamation without copying or pinning weight pages.
Across an agentic workload with increasing memory overcommitment, a single policy configuration reduces request latency by 10--18\%
relative to OS-managed weights and 6--55\% relative to driver-managed weights.
전체 169
번호 제목 작성자 작성일 추천 조회
공지사항
2026년 가을학기 콜로퀴엄 일정 안내
kaistsoftware | 2026.09.11 | 추천 0 | 조회 1062
kaistsoftware 2026.09.11 0 1062
168
11/2 AI 시대, 우리는 어떤 미래를 만들 수 있을까? (이의진 교수/KAIST AI컴퓨팅학과)
kaistsoftware | 2026.10.30 | 추천 0 | 조회 109
kaistsoftware 2026.10.30 0 109
167
10/26 Multimodal Generation Machine Perception (오태현 교수/KAIST 전산학부)
kaistsoftware | 2026.10.23 | 추천 0 | 조회 135
kaistsoftware 2026.10.23 0 135
166
10/12 AI 보안 위협의 진화 (손수엘 교수/KAIST 전산학부)
kaistsoftware | 2026.10.12 | 추천 0 | 조회 263
kaistsoftware 2026.10.12 0 263
165
9/21 Efficient LLM Serving for Multi-Agent Systems (권영진 교수/KAIST 전산학부)
kaistsoftware | 2026.09.21 | 추천 0 | 조회 566
kaistsoftware 2026.09.21 0 566
164
9/14 센싱 기반 피지컬 AI (한준 교수/KAIST 전산학부)
kaistsoftware | 2026.09.11 | 추천 0 | 조회 686
kaistsoftware 2026.09.11 0 686
163
5/18 믿고 쓸만한 AI 에이전트를 위하여 (허기홍 교수/KAIST 전산학부)
kaistsoftware | 2026.05.06 | 추천 0 | 조회 1223
kaistsoftware 2026.05.06 0 1223
162
5/11 LLMServingSim: Bridging AI Hardware Innovation and Real-World LLM Serving (박종세 교수/KAIST 전산학부)
kaistsoftware | 2026.05.06 | 추천 0 | 조회 1100
kaistsoftware 2026.05.06 0 1100
161
4/27 From Visual Understanding to Embodied Intelligence: Agentic AI and Physical AI in Robotics (윤성의 교수/KAIST 전산학부)
kaistsoftware | 2026.04.17 | 추천 0 | 조회 1109
kaistsoftware 2026.04.17 0 1109
160
4/20 World Model: Spatial Physical Generative AI (김태균 교수/KAIST 전산학부)
kaistsoftware | 2026.04.17 | 추천 0 | 조회 3446
kaistsoftware 2026.04.17 0 3446
159
4/13 LLM 시대의 Computer Science 교육과 AI 연구의 미래 (성민혁 교수/KAIST 전산학부)
kaistsoftware | 2026.04.10 | 추천 0 | 조회 1031
kaistsoftware 2026.04.10 0 1031