Decision Making in Multi-Agent Systems

2022 IROS Full-Day Workshop

Oct 27, 2022

[This workshop will be held in hybrid form]

[IROS22 registration is required]


All authors and participants need to register through IROS-22 registration website.                                                    

Important Registration Dates:
  • Early registraion deadline: August 22, 2022
  • Regular registration dates: August 23 - October 27, 2022

About this workshop

Multi-agent systems are widely applicable to real-world problems and applications ranging from warehouse automation to environmental monitoring, autonomous driving, and even game playing. While multi-agent systems can execute time-sensitive, complex, and large-scale problems that are intractable for single agents, it is challenging to efficiently coordinate such systems for cooperative or non-cooperative tasks. On the other hand, decision making and reinforcement learning in single-agent scenarios have seen tremendous achievements in recent years; yet, translation of many single-agent techniques to the multi-agent domain may not be straightforward. The main challenges lie intrinsically in the nature of the multi-agent systems, including: complex interaction dynamics, constrained inter-agent communication, complex optimality, heterogeneity in the system and the potential presence of adversaries.

In this workshop, we aim to bring together multi-agent systems experts and researchers from different disciplines, ranging from robotics, machine learning, and game theory, to share the recent advances, open problems, and challenges in their respective fields and brainstorm research thrusts that will lead us towards revolutionary advances in multi-agent systems. The workshop will consist of invited speakers, presentations from researchers with original research papers, and poster sessions. We hope that through our multi-faceted workshop and the talks of our expert speakers, we can attract the interest of the robotics community on research challenges specific to multi-agent decision making.

Call for Contributions

Efficient decision-making, in robotics, game-playing, social agents, etc., can be considered an essential aspect and a challenging problem in multi-agent systems, and contributions here have the potential making a breakthrough in enabling high-performing collaborative and coordinated multi-agent teams. For a successful multi-agent collaboration in a complex (potentially adversarial) environment, agents must be able to rationalize their actions by reasoning about their teammates' action-decisions and their capabilities and characteristics, as well as the environment states under partial observability. Such enhanced reasoning can also be achieved through efficient inter-agent communication, which opens a new horizon to the realm of multi-agent decision-making. These problems make an interesting opportunity to explore multi-agent systems under collaborative and mixed collaborative-competitive settings to improve team coordination for high-quality cooperation.

The objective of this workshop is to raise awareness of the overall challenges in multi-agent decision-making area to the IEEE Robotics and Automation Society community. This workshop will serve as a catalyst to exchange ideas and recent methodologies in this this unique and important application, that requires innovations across core topics in robotics, AI, and ML.

Topics of Interest

  • Multi-agent reinforcement learning
  • Multi-agent planning and scheduling
  • Multi-agent systems in adversarial environments
  • Bounded rationality
  • Heterogeneous team coordination
  • Emergent communication learning in multi-agent systems
  • Multi-agent systems and challenges: scalability, credit assignment, non-stationarity, etc.
  • Multi-agent decision-making and Transformers: decision-making as a sequence modeling problem
  • Multi-agent decisions and Social dilemmas
  • Explainable multi-agent decision-making

Paper Submission:

We invite short papers (4-6 pages, including references) for submission to the workshop related to the topics above and the theme of multi-agent systems. Position papers, work in progress and novel but not necessarily thoroughly worked out ideas are encouraged. The submissions will be reviewed by the program committee and we will accept papers for oral (live) presentations, or a video highlight. Each paper will undergo a thorough review process and receive two high quality reviews. Accepted papers will be made available on the workshop website after the IROS conference.

The paper should be in PDF format and use the standard IEEE IROS template: Tex or MS Word.

Please use the following EasyChair link for paper submissions: Submission Link .

Important Dates

Invited Speakers


Nora Ayanian

Brown University


Peter Stone

University of Texas at Austin


Amanda Prorok

University of Cambridge


Chi Jin

Princeton University


Sven Koenig

University of Southern California


Bo An

Nanyang Technical University


Jakob Foerster

University of Oxford

Workshop schedule

All times in JST (UTC + 09)
9:00 Welcome Remarks
9:10a Invited Session 1
Peter Stone (UT Austin) - The Value of Communication in Ad Hoc Teamwork

Abstract: In ad hoc teamwork, multiple agents need to collaborate without having knowledge about their teammates or their plans a priori. A common assumption in this research area is that the agents cannot communicate. However, just as two random people may speak the same language, autonomous teammates may also happen to share a communication protocol. We consider how such a shared protocol can be leveraged, introducing a means to reason about Communication in Ad Hoc Teamwork (CAT). The goal of this work is enabling improved ad hoc teamwork by judiciously leveraging the ability of the team to communicate.

Sven Koenig (USC) - Multi-Agent Path Finding and Its Applications

Abstract: The coordination of robots and other agents becomes more and more important for industry. For example, on the order of one thousand robots already navigate autonomously in fulfillment centers to move inventory pods all the way from their storage locations to the picking stations that need the products they store (and vice versa). Optimal and, in some cases, even approximately optimal path planning for these robots is NP-hard, yet one must find high-quality collision-free paths for them in real-time. Algorithms for such multi-agent path-finding problems have been studied in robotics and theoretical computer science for a longer time but are insufficient since they are either fast but of insufficient solution quality or of good solution quality but too slow. In this talk, I will discuss both recent cool ideas for solving such multi-agent path-finding problems (including the roles of planning and machine learning) and several of their applications, including in warehousing. Our research on this topic has been funded by both NSF and Amazon Robotics.

10:00-10:15a Q/A and Discussion for Invited Session 1
10:15a Contributed Papers
11:15a Invited Session 2
Nora Ayanian (Brown)

Abstract: TBA.

Amanda Prorok (Cambridge) - Machine Learning for Multi-Agent and Multi-Robot Problems

Abstract: TBA.

12:05-12:20p Q/A and Discussion for Invited Session 2
1:00p Invited Session 3
Chi Jin (Princeton)

Abstract: TBA.

Bo An (NTU) - Deep Learning for Solving Large Scale Complex Games

Abstract: Some important breakthroughs in artificial intelligence in recent years (such as Libratus and security games) can be attributed to the development of large-scale game solving technology in the past decade. However, game solving technology cannot handle large scale complex games, and the academic community began to use deep learning techniques to solve such complex games. The talk will discuss important progress in this direction in recent years and future directions.

1:50-2:10p Q/A for Invited Session 3
2:10p Contributed Papers
3:15p Invited Session 4
Jakob Foerster (Oxford)

Abstract: TBA.

4:05-4:25p Q/A for Invited Session 4
4:25-4:50p Concluding Remarks



Panagiotis Tsiotras


School of Aerospace Engineering
Georgia Institute of Technology


Matthew Gombolay

Assistant Professor

School of Interactive Computing
Georgia Institute of Technology


Scott Guan

Ph.D. Student

School of Aerospace Engineering
Georgia Institute of Technology


Esmaeil Seraj

Ph.D. Student

School of Electrical and Computer Engineering
Georgia Institute of Technology

Program Committee

  • Dipankar Maity, University of North Carolina
  • Daigo Shishika, George Mason University
  • Mi Zhou, Georgia Institute of Technology


   If you have any question regarding the workshop, please contact the Workshop Organizers.


This workshop is supported by the IEEE RAS TC on Multi-Robot Systems and the IEEE RAS TC on Algorithms for Planning and Control of Robot Motion.