News
The AI Seminar is a weekly meeting at the University of Alberta where researchers interested in artificial intelligence (AI) can share their research. Presenters include both local speakers from the University of Alberta and visitors from other institutions. Topics can be related in any way to artificial intelligence, from foundational theoretical work to innovative applications of AI techniques to new fields and problems.
On May 19, Zichen Zhang —Phd student at the University of Alberta — presented “A Simple Decentralized Cross-Entropy Method" at the AI Seminar.
In this talk, Zhang presents a simple extension to the Cross-Entropy Method (CEM), a gradient-free optimization method frequently used for planning in model-based reinforcement learning (MBRL).
The classical CEM employs a centralized approach to update the sampling distribution based on a global top-k operation’s results on samples. However, he demonstrates that this approach can make CEM prone to local optima, thus impairing its sample efficiency. To address this issue, Zhang proposes Decentralized CEM (DecentCEM), a simple yet effective improvement over classical CEM, by using an ensemble of CEM instances running independently from one another, and each performing a local improvement of its own sampling distribution. He shows in an optimization task that DecentCEM finds the global optimum more consistently than CEM that uses either a single or even a mixture of Gaussian distributions. Notably, this improvement does not compromise CEM’s convergence guarantee. When applied to MBRL planning problems in continuous control environments, DecentCEM shows an improved sample efficiency, with only a reasonable increase in computational cost.
For those interested in exploring this work further, please check out the paper at: https://arxiv.org/abs/2212.08235
And the code is available at https://github.com/vincentzhang/decentCEM
Watch the full presentation below:
Want to learn how you can kick-start your AI career? Find out more about Amii's Career Accelerator to find out more.
May 2nd 2024
News
Read our monthly update on Alberta’s growing machine intelligence ecosystem and exciting opportunities to get involved.
Apr 8th 2024
News
Amii Fellows share tips on how to make the most of your conference experience.
Mar 26th 2024
News
In this month's episode, Alona talks about how ChatGPT changed the public’s perception of what AI language models can do, instantly making most previous benchmarks seem out of date, and the excitement and intensity of working in a fast-moving field like AI.
Looking to build AI capacity? Need a speaker at your event?