My research is mainly centered on autonomous decision making, with a focus on uncertainty (using Markov Decision Processes). Here are some past and present topics of my work:
during my PhD, I have worked on coordination in a Multi-Agent System through shaping, and on selecting and learning basic behaviors for an agent with multiple simultaneous objectives.
my work was oriented toward a large planning project
collaboration with Doug
We have developped a brand new --and quite successful-- probabilistic planner (FPG, see available software below). Plus, I have studied robust planning (how to find the best policy for the worst model when the model is uncertain).
An other australian project I was involved in is the SuperCom project, which focusses on model-based supervision (monitoring and control) of composite systems (networks of computing components: web services, telecommunication/distribution networks...). I have worked on a planning algorithm adapted to such systems (in collaboration with Elena Kelareva, Sylvie Thiébaux and Jinbo Huang).
my main focus is on making space machines (satellites, rovers) autonomous. This involves designing an appropriate models and algorithms for state estimation and decision-making.