Language-Driven Coordination in Multi-Agent Reinforcement Learning with Large Language Models

Authors

  • Benjamin J. Wilson School of Computing and Information Systems, The University of Melbourne, Parkville, VIC 3010, Australia
  • Oliver Smith School of Computing and Information Systems, The University of Melbourne, Parkville, VIC 3010, Australia
  • Chloe A. Thompson School of Computing and Information Systems, The University of Melbourne, Parkville, VIC 3010, Australia

DOI:

https://doi.org/10.71465/csb224

Keywords:

Language-Conditioned Marl, Coordination, Ppo, Multi-Agent Communication, Llm Integration

Abstract

This study integrates LLMs into MARL through language-based coordination, communication, and memory modules. The framework combines proximal policy optimization (PPO) with language-conditioned subgoal generation. Experiments across three multi-agent environments involving over 10,000 training episodes show a 14.7–26.3% increase in win rate compared with MAPPO and QMIX baselines, with ablation results confirming the contribution of languageguided coordination to sample efficiency and zero-shot generalization. 

References

Dinneweth, J., Boubezoul, A., Mandiau, R., & Espié, S. (2022). Multi-agent reinforcement learning for autonomous vehicles: A survey. Autonomous Intelligent Systems, 2(1), 27.

Fu, Y., Gui, H., Li, W., & Wang, Z. (2020, August). Virtual Material Modeling and Vibration Reduction Design of Electron Beam Imaging System. In 2020 IEEE International Conference on Advances in Electrical Engineering and Computer Applications (AEECA) (pp. 1063-1070). IEEE.

Yue, L., Xu, D., Qiu, D., Shi, Y., Xu, S., & Shah, M. (2026). Sequential Cooperative Multi-Agent Online Learning and Adaptive Coordination Control in Dynamic and Uncertain Environments.

Bian, K., & Priyadarshi, R. (2024). Machine learning optimization techniques: a survey, classification, challenges, and future research issues. Archives of Computational Methods in Engineering, 31(7), 4209-4233.

Oyebode, O. (2025). Adaptive decentralized knowledge networks uniting causal generative models, federated optimization, and cryptographic proofs for scalable autonomous coordination mechanisms. International Journal of Science and Engineering Applications, 14(09), 18-32.

Chen, F., Liang, H., Yue, L., Xu, P., & Li, S. (2025). Low-Power Acceleration Architecture Design of Domestic Smart Chips for AI Loads.

Amato, C. (2024). An Initial Introduction to Cooperative Multi-Agent Reinforcement Learning. arXiv preprint arXiv:2405.06161.

Chen, H., Li, J., Ma, X., & Mao, Y. (2025, June). Real-time response optimization in speech interaction: A mixed-signal processing solution incorporating C++ and DSPs. In 2025 7th International Conference on Artificial Intelligence Technologies and Applications (ICAITA) (pp. 110-114). IEEE.

Patil, A., & Jadon, A. (2025). Advancing reasoning in large language models: Promising methods and approaches. arXiv preprint arXiv:2502.03671.

Yang, M., Wu, J., Tong, L., & Shi, J. (2025). Design of Advertisement Creative Optimization and Performance Enhancement System Based on Multimodal Deep Learning.

Ferrag, M. A., Tihanyi, N., & Debbah, M. (2025). From llm reasoning to autonomous ai agents: A comprehensive review. arXiv preprint arXiv:2504.19678.

Peng, H., Dong, N., Liao, Y., Tang, Y., & Hu, X. (2024). Real-Time Turbidity Monitoring Using Machine Learning and Environmental Parameter Integration for Scalable Water Quality Management. Journal of Theory and Practice in Engineering and Technology, 1(4), 29-36.

Yakolli, N., Gautam, A., Das, A., Qi, Y., & Shekhawat, V. S. (2025). A Survey on Improving Human Robot Collaboration through Vision-and-Language Navigation. arXiv preprint arXiv:2512.00027.

Hu, W. (2025, September). Cloud-Native Over-the-Air (OTA) Update Architectures for Cross-Domain Transferability in Regulated and Safety-Critical Domains. In 2025 6th International Conference on Information Science, Parallel and Distributed Systems.

Palikhe, A., Wang, Z., Yin, Z., Hu, S., Zhao, X., Liu, J., ... & Zhang, W. Domain Knowledge Empowered Language Models: A Survey. Authorea Preprints.

Xu, K., Du, Y., Liu, M., Yu, Z., & Sun, X. (2025). Causality-Induced Positional Encoding for Transformer-Based Representation Learning of Non-Sequential Features. arXiv preprint arXiv:2509.16629.

Biswas, A., & Talukdar, W. (2025). Building Agentic AI Systems: Create intelligent, autonomous AI agents that can reason, plan, and adapt. Packt Publishing Ltd.

Tan, L., Liu, X., Liu, D., Liu, S., Wu, W., & Jiang, H. (2024, December). An Improved Dung Beetle Optimizer for Random Forest Optimization. In 2024 6th International Conference on Frontier Technologies of Information and Computer (ICFTIC) (pp. 1192-1196). IEEE.

Taherinavid, S., Moravvej, S. V., Chen, Y. L., Yang, J., Ku, C. S., & Yee, L. (2023). Automatic transportation mode classification using a deep reinforcement learning approach with smartphone sensors. IEEE Access, 12, 514-533.

Gao, X., Chen, J., Huang, M., & Fang, S. (2025). Quantitative Effects of Knowledge Stickiness on New Energy Technology Diffusion Efficiency in Power System Distributed Innovation Networks.

Rosolia, U., Singletary, A., & Ames, A. D. (2022). Unified multirate control: From low-level actuation to high-level planning. IEEE Transactions on Automatic Control, 67(12), 6627-6640.

Mao, Y., Ma, X., & Li, J. (2025). Research on API Security Gateway and Data Access Control Model for Multi-Tenant Full-Stack Systems.

McCoy, R. T., Smolensky, P., Linzen, T., Gao, J., & Celikyilmaz, A. (2023). How much do language models copy from their training data? evaluating linguistic novelty in text generation using raven. Transactions of the Association for Computational Linguistics, 11, 652-670.

Liu, S., Feng, H., & Liu, X. (2025). A Study on the Mechanism of Generative Design Tools' Impact on Visual Language Reconstruction: An Interactive Analysis of Semantic Mapping and User Cognition. Authorea Preprints.

Bhatti, U. A., Tang, H., Wu, G., Marjan, S., & Hussain, A. (2023). Deep learning with graph convolutional networks: An overview and latest applications in computational intelligence. International Journal of Intelligent Systems, 2023(1), 8342104.

Downloads

Published

2026-01-30

Issue

Section

Research Articles