News
The AI Seminar is a weekly meeting at the University of Alberta where researchers interested in artificial intelligence (AI) can share their research. Presenters include both local speakers from the University of Alberta and visitors from other institutions. Topics can be related in any way to artificial intelligence, from foundational theoretical work to innovative applications of AI techniques to new fields and problems.
On March 24, Qingfeng Lan — PhD student at the University of Alberta — presented “Memory-efficient Reinforcement Learning with Knowledge Consolidation " at the AI Seminar.
Artificial neural networks are promising for general function approximation but challenging to train on non-independent or non-identically distributed data due to catastrophic forgetting. The experience replay buffer, a standard component in deep reinforcement learning, is often used to reduce forgetting and improve sample efficiency by storing experiences in a large buffer and using them for training later.
However, a large replay buffer results in a heavy memory burden, especially for onboard and edge devices with limited memory capacities. Lan proposes memory-efficient reinforcement learning algorithms based on the deep Q-network algorithm to alleviate this problem. The algorithms reduce forgetting and maintain high sample efficiency by consolidating knowledge from the target Q-network to the current Q-network.
Compared to baseline methods, these algorithms achieve comparable or better performance in both feature-based and image-based tasks while easing the burden of large experience replay buffers.
Watch the full presentation below:
Want to learn how you can kick-start your AI career? Find out more about Amii's Career Accelerator to find out more.
Nov 22nd 2023
News
On October 17, Dr. Deepa Krishnaswamy, from Boston's Brigham and Women's Hospital, presented “AI-derived annotations for lung cancer collections using NCI Imaging Data Commons" at the AI Seminar.
Nov 16th 2023
News
Thinking of pursuing a PhD? Amii researcher Alona Fyshe explores how undertaking a PhD is like training for the Olympics, and how you can develop an Olympian state of mind.
Nov 16th 2023
News
Read our November monthly update on Alberta’s AI ecosystem. Featured this month: Impact Report & New U of A Faculty Positions.
Looking to build AI capacity? Need a speaker at your event?