7 – Augmented reality and data streaming

Name of the system:

Augmented Reality Interface

Lead entity within the SAMMBA consortium:

EUT (reach out to us here)

Attachment point within the process chain of the Spaceport operator:

The virtualized assets communicate with the AGV and transmit messages to the operator’s HUD on the Smartglasses, allowing real-time monitoring from any point of view of both ongoing operations and possible alert messages, such as supporting tasks of maintenance

Major benefit within the process chain:

The integration of Holographic Remote Display in the autonomous driving of the AGV, and the status of ongoing operations in an interface and augmented reality HUD (Head Up Display) adds a new layer of integration to the system that allows future scalability of both the case of current use, such as the consideration of other aspects to be developed, such as preventive maintenance tasks through the same interface, thus allowing the integration of the same assets for multiple functions, reducing the costs of separate systems.

Anticipated R&D vector for the near/mid/long-term:

The vectors to be reinforced in the visual solution include adding location sensors and space characterization to further improve precision, establishing a consistent methodology for the integration of different assets (different shuttles, AGVs, etc.) and the option to have a Multi-user Augmented Reality interface with real-time streaming with minimal latency, for example through 5G networks. The 

Modularity granted with the following standards:

The use of holographic elements makes it possible to overcome the scale and budget limitations of physical prototypes at different scales, evaluating “in situ” both the usability of the system due to space occupation, as well as the maneuverability of the different mobile components

Interoperability granted with the following standards:

The choice of technology in the implementation guarantees its scalability as it is based on communication between ROS and Microsoft systems (Hololens 2), being able to increase the capabilities of the system by incorporating various sensors, activities related to operations and maintenance in the same architecture proposal without the need to redo large parts of the solution

Systems interfaced:

AGV, Holographic Augmented Reality Dashboard