New paths to interoperability of robots: Large AI models as an opportunity for collaborative action

Whether in intralogistics, production, or rescue operations: When different robots are supposed to complete tasks together, they need to exchange information, understand its meaning, and coordinate their actions. Until now, creating the necessary interoperability has been associated with a lot of effort, for example, through standardization. Large AI models open up new possibilities for achieving this. A new white paper from the Learning Systems Platform shows how such AI models can support the interaction of robotic systems and what challenges still need to be solved for reliable and safe usage.

The position paper by the Platform for Learning Systems examines the possibilities and limitations of large AI models in the interoperability of different robot systems. (Image source: Platform for Learning Systems)
The position paper by the Platform for Learning Systems examines the possibilities and limitations of large AI models in the interoperability of different robot systems. (Image source: Platform for Learning Systems)
A flight drone explores the area, a robot dog examines hard-to-reach areas, a vehicle transports material: In the event of a fire at a chemical plant, different robotic systems could complement each other's capabilities. Robots can also collaborate with other robots and humans in fruit harvesting or goods transport. However, in practice, different interfaces and partly closed operating systems complicate the interaction.

Four Levels of Interoperability

Interoperability provides the foundation for communication and cooperation but does not itself bring about joint action. So far, it is primarily achieved through standards for interfaces, protocols, or data formats. Such solutions are complex and often not very flexible. It is particularly challenging to establish a common understanding of information and its significance for actions.

The position paper distinguishes four levels of interoperability: The technical level connects systems with one another, the syntactic level ensures compatible data formats. The semantic level pertains to the meaning of exchanged information, while the pragmatic level involves the understanding of the consequences of actions in a specific context. It is only at this final level that the actions of systems can best be coordinated with each other.

What large AI models can achieve

“Large AI models can help achieve interoperability between different robotics systems in an elegant and efficient manner, on a semantic or even pragmatic level,” says Jürgen Beyerer, managing director as well as director of the Fraunhofer Institute for Optronics, System Technologies, and Image Exploitation (IOSB) in Karlsruhe and holder of the Chair for Interactive Real-Time Systems at the Karlsruhe Institute of Technology (KIT).

In addition to large language models, those designed for logical reasoning or models that integrate language, vision, and action are also suitable for this purpose. They can help categorize information from different systems and make it usable for coordination. Crucial are the world knowledge represented in the model, which is linked to the type and extent of the data in the model training, as well as additional context information made available to the model during operation.

 

Collaboration Requires Reliable World Knowledge

"Robots can work through complex storylines or missions in a network if they are able to reliably physically interact, exchange, and interpret information. The core of the challenge often lies in the autonomy and the world model of the systems. Today's large generative AI models can fill gaps here and coordinate robots, and future models could even establish new forms of interoperability," explains Sirko Straube, Research Area Manager Emergency Response and Recovery Management at the Robotics Innovation Center of DFKI GmbH.

However, current models have limitations. They often lack activity data as well as domain-specific data. They sometimes generate incorrect statements and have a limited understanding of cause and effect. Additionally, they still do not reliably translate objects, positions, or actions into precise specifications for physical models. This can cause interoperability to "break down" temporarily, posing risks to functional and process safety. Promising future developments are more reliable multimodal AI models that can check facts in real time and better estimate the consequences of actions using physical simulations and world models. However, for practical use, these capabilities must be reliably available.

"Interoperability among robots is a crucial building block for the future that will sustainably advance the practical use and interaction of diverse robotics systems. Research is already developing promising projects and concepts - now it is important to jointly translate these into marketable and application-oriented solutions. This requires a strong alliance between users, robotics manufacturers, and researchers to elevate robotics to the next level of development," summarizes Johannes Hinckeldeyn, Director of Advanced Corte Technologies at the Kion Group.

Translated automatically from German.
Printer Friendly, PDF & Email

Branchenverzeichnis

09.11.2026
For the collaboration of different robotic systems, complex interface solutions have so far been required. A new white paper illustrates the possibilities that artificial intelligence opens up and why...
23.09.2026
With M2X, a public draft for an open specification for communication between mobile robots and infrastructure components is available for the first time. Companies, manufacturers, and integrators can...
03.11.2026
Companies can test applications with humanoid robots, mobile assistance systems, and robotic arms at Munich Airport. The joint facility with the Technical University of Munich is intended to support...
14.10.2026
The INC Innovation Center plans to open the "Future Robotics Exploration Hub" in Stuttgart in January 2027, in collaboration with industrial companies. The proposed facility is intended to enable...
02.10.2026
Neura Robotics is entering the clinical market with its own business unit for healthcare technology. As the company announced, Neura HealthTech is set to develop applications based on robotics, sensor...
27.10.2026
The global sales of mobile robots for intralogistics applications increased by 19 percent to approximately 103,700 units in 2025. This is according to the annual report "World Robotics 2026 – Service...