When I was about 10, I was told that I had to pick my clothes off of my floor. It was around that time that I wanted to make a robot that could do it for me.
20 years later I have learned 2 important things: How to pick up my own clothes up off the floor and building a robot that can do it for me is both a multifaceted mechanical engineering problem as well as a very complex sequential decision task that cutting edge machine learning techniques still struggle to accomplish. Nevertheless, I have slowly found my way into the field of artificial intelligence where my dream of a robot that could do my chores for me is a problem domain instead of just a farfetched dream.
Besides artificial intelligence, I also spend my time finding good co-op boardgames, writing and playing video games, painting Cthulu in the background of second hand paintings and playing music.
In September of 2021, I joined Sony AI's research team. Its exciting to be part of a large research initiative and I am looking forward to contributing to the team's future research goals.
In early 2023, the rest of the Sony AI GameAI research team and I worked with Polyphony Digital Entertainment to release GT Sophy into Grad Tourismo 7, showcasing both an AI with super-human skills and a fun racing experience for millions of players.
After graduating from my MSc, I started working at Eidos Montreal. It was a very rewarding experience working at at AAA games company. It was enlightening to work with such talented people and to focus on creative applications of machine learning within video games.
While at Eidos, I was leading a team focused on Automated Game Testing using Reinforcement Learning agents to help Quality Assurance teams validate game functionality. With researchers from Matsuko, we came up with the Grid Sensor, a novel way of representing observation data to reinforcement learning agents without requiring rendering or large models. We open sourced the Grid Sensor to the Unity MLAgents repository along with a Unity Blog. describing the motivation.
After releasing the Grid Sensor, Eidos pivoted to using the Unreal Engine where I reimplemented the Grid Sensor and published the first Eidos Sherbrooke blog post on it.
In the summer of 2017 I interned at Sony Research and Development in Tokyo, Japan. I worked researching deep reinforcement learning based navigation systems and explored simulator grounding techniques as well as integrating rule based methods and reinforcement learning algorithms into a mobile robot. Here is a link to my blog of my experiences of living in Japan.
I have been working in the Blinc Lab for 4 years. My main focus for my first few months was integrating 2 of Blinc Lab's most interesting projects, the Handihand and the Bento arm, into an embedded system. The Little Intelligent Learning Limb, Lil'Limb, will eventually be worn by an amputee as a training tool for a more robust system.
Some people from the BLINC lab and I showcased our prosthetic arm and research platform at Maker Faire. There were cool demonstrations, FPV quadcopter races, and many other interesting things. We also released our source code and 3d print files open source at blincdev.ca.
I worked with Dr. Michael Bowling and the University of Alberta's Computer Poker Research Group the to develop a web query tool for his team's poker strategy that was published in Science Journal. The website had 1 Million visits within the first week and was linked to by hundreds of news stories.
I have been volunteering with ROS Edmonton since September 2015. It was launched in January 2015 and is run by a great group of very talented people. It is exciting to be able to learn more and share the field of robotics with such admirable people.
I led a session at the 2015 SET conference where I discussed machine learning and opponent modeling applied to Rock, Paper, Scissors. I had a lot of fun showing the students how people usually aren't random and therefore the strategies that they attempt can be discovered and exploited to win in simple games. I had a great time with the students and look forward to my next volunteering opportunity with WISEST.