Xylon Showcases Synthetic HIL Data Injection at ADAS & AVT Expo Stuttgart


During the ADAS & Autonomous Vehicle Technology Expo in Stuttgart, Xylon did live demonstrations of the complete demo HIL system that converts sensory data generated by a software simulator into real automotive stimuli for the attached parking assistance ADAS ECU. To develop the demo and explore different methods of connecting hardware ECUs to simulation software, Xylon teamed up with rFpro, an expert in driving simulation software.

Click here to watch the demo video.

The demo setup consists of the PC that runs rFpro’s advanced simulator, Xylon’s logiRECORDER Automotive HIL Video Logger in the Smart I/O mode, and Xylon’s Surround View ECU.

rFpro simulates the car model, its surroundings and four 1920×1080@30fps video cameras. Camera image generators convert native RGB888 pixels into common sensor’s YUV420 pixels and add a fish-eye lens distortion typical for optics in this ADAS application. Xylon’s data transfer plug-in connects to rFpro’s interface for externals, originally developed as an interface for soft-ECU models, and hands the simulated camera videos over to the streaming application. Video data are formatted into standard MIPI packets typically generated by real-world sensors, and timestamped before being transmitted to the logiRECORDER via a 10 Gb Ethernet link.

The logiRECORDER de-encapsulates Ethernet packets, and based on encoded timestamps, converts synthetic videos to four native automotive GMSL2 interfaces.

The ECU receives raw sensory data through four video inputs regularly used for GMSL2 video camera connections; fully unaware of the synthetic nature of its inputs, it generates a surround view video of the simulated scene. The ECU displays complete 360° surroundings of the car by stitching together video inputs from the simulated cameras placed on the car model’s front grid, the rear and within the side-view mirrors. The car model and its surroundings can be seen from different perspectives set up by a mouse-controlled virtual flying camera.

The demo also integrates the loop-back feature. The ECU’s responses connect back to the logiRECORDER through the automotive CAN interface, and it sends them via Ethernet to the simulator. It turns the complete demo setup into a fully featured virtual test drive simulator, seeing that the simulator can adapt simulation scenarios based on the received ECU’s responses.

Instead of working in a special diagnostics mode, the ECU runs production firmware. Inputted raw data are generated to a level that enables full sensor fusion and perception testing, as well as full ECU controls. The Surround View ECU can be exchanged with other types of ECUs.

Browse through our video gallery, and find out more about Xylon’s latest solutions and demos