Up-Coming Events

Up-Coming Events

CAIR MedTech Seminar #10 Edge Computing Systems for Real-time AI-Driven Applications

活动日期： 2024年5月27日


Below are the speakers' details: 


Dr Neiwen Ling

Postdoctoral Associate in Department of Computer Science, Yale University

Talk title: Edge Computing Systems for  Real-time AI-Driven Applications

Abstract: Edge AI is pivotal for enabling low-latency, privacy-preserving, and resource-efficient solutions across a variety of critical applications, including autonomous driving and embodied AI. Developing robust and optimized Edge AI systems is essential to realizing these advancements. In this talk, I will highlight the opportunities and challenges for deploying Edge AI systems and introduce several edge computing systems I have designed for real-time AI-driven applications. I will begin with my research on supporting concurrent DL tasks on a single resource-constrained edge device. First, I will introduce BlastNet, a model inference abstraction that efficiently utilizes both CPU and GPU resources for concurrent DNN inference. Next, I will discuss RT-mDL, a real-time DL framework that combines model compression and scheduling to enable real-time DL tasks. Following this, I will touch on my research on cooperative Edge AI, showcasing a family of cooperative edge systems that support distributed real-time applications through efficient collaboration among different edge nodes. This includes their implementation in a real-world smart roadside infrastructure system deployed on a university campus. I will conclude by outlining future directions, including my vision for developing edge systems to support LLM-powered autonomous agents.

Biography: Dr. Neiwen Ling is currently a Postdoctoral Associate in the Efficient Computing Lab at Yale, working with Prof. Lin Zhong. She completed her Ph.D. at the Chinese University of Hong Kong, where she was advised by Prof. Guoliang Xing. Her research falls in the intersection of Edge Computing, Machine Learning and Real-time System, with the goal of developing edge computing systems for real-time AI-driven applications, such as autonomous driving. Dr. Ling has published papers on ACM/IEEE flagship conferences, including MobiCom, SenSys, IPSN, MobiSys, and IoTDI. She received one Best Paper Award Finalist and one Best Poster Award from the prestigious international conference SenSys. Besides, she has organized the first FMSys workshop at CPS-IoT Week 2024 and served as a reviewer for top ACM/IEEE journals and conferences like TMC, IMWUT/UbiComp, TOSN, and INFOCOM. She is also on the technical program committee for CHASE 2023 and IoTDI 2023 Poster & Demo.