EXPERIENCED TASK-BASED MULTI ROBOT TASK ALLOCATION
Abstract
In multi robot system applications, it is possible that the robots transform their past experiences into useful information which will be used for next task allocation processes by using learning-based task allocation mechanisms. The major disadvantages of multi-robot Q-learning algorithm are huge learning space and computational cost due to generalized state and joint action spaces of robots. In this study, experienced task-based multi robot task allocation approach is proposed. According to this approach, robots believe to be experienced about the tasks most frequently done. Robots prefer to do these tasks rather than the inexperienced ones. Then, robots refuse to execute inexperienced tasks over time. This means that the system has reduced learning space. The proposed approach plays a crucial role to achieve required system performance and provides effective solutions to learning space dimensions. The effectiveness of the proposed algorithm is demonstrated by simulations on multi-robot task allocation problem.
Keywords
Multi robot task allocation,Multi-agent Q-learning,Adaptive system architecture
References
- Arkin R C. Behavior-Based Robotics. Cambridge, MIT Press, 1998.
- Mataric M J. Reinforcement learning in multi-robot domain. Autonomous Robots 1997; 4(1): 73-83.
- Ezercan Kayır H H, Parlaktuna O. Strategy planned Q-lerning approach for multi-robot task allocation. Procs of ICINCO 2014; 2: 410-416.
- Sutton R S, Barto A G. Reinforcement Learning: an Introduction. Cambridge, MIT Press, 1998.
- Yang E, Gu D. Multiagent Reinforcement Learning for Multi-Robot Systems: a Survey. Technical Reports of the Dept. of Computer Science, Univ. of Essex, 2004.
- Gerkey B P, Mataric M J. A formal analysis and taxonomy of task allocation in multi-robot systems. International Journal of Robotics Research 2004; 23(9): 939-954.
- Jones E G, Dias M B, Stentz A. Learning-enhanced market-based task allocation for oversubscribed domains. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems; 2007; San Diego, CA, USA: pp. 2308-2313.
- Dias M B, Zlot R M, Kaltra N, Stentz A. Market-based multirobot coordination: a survey and analysis. Proceedings of the IEEE 2006; 94(7): 1257-1270.
- Zlot R, Stentz A. Market-based multirobot coordination for complex tasks. Int. Journal of Robotics Research, Special Issue on the 4th Int. Conf. on Field and Service Robotics 2006; 25(1): 73-101.
- Gerkey B P, Mataric M J. Sold!: auction methods for multi robot coordination. IEEE Transactions on Robotics and Automation 2002; 18(5): 758-768.