COMÉRCIO&INDUSTRIA - NOVAS TECNOLOGIAS AUTOMÓVEL

Terça, 24 Janeiro 2023 11:13 | Actualizado em Quarta, 03 Abril 2024 15:41

New simulation technology accurately replicates what cameras ‘see’ for the first time

• Ray tracing capability transforms the realism of simulation, accelerating the development of autonomous vehicles and ADAS
• Vehicle sensors can now be developed in simulation before physical prototypes exist
• rFpro is the first to accurately simulate the effects of blurring and rolling shutters to truly represent what cameras ‘see’.

 UK software specialist, rFpro, has developed a new simulation technology that significantly reduces the industry’s dependence on real-world testing for the development of autonomous vehicles (AV) and ADAS. Its new ray tracing rendering technology is the first to accurately simulate how a vehicle’s sensor system perceives the world.

“The industry has widely accepted that simulation is the only way to safely and thoroughly subject AVs and autonomy systems to a substantial number of edge cases to train AI and prove they are safe,” said Matt Daley, Operations Director at rFpro. “However, up until now, the fidelity of simulation hasn’t been high enough to replace real-world data. Our ray tracing technology is a physically modelled simulation solution that has been specifically developed for sensor systems to accurately replicate the way they ‘see’ the world.”

The ray tracing graphics engine is a superior fidelity image rendering system that sits alongside rFpro’s existing rasterization-based rendering engine. Rasterization simulates light taking single bounces through a simulated scene. This is sufficiently quick to enable real-time simulation and powers rFpro’s industry-leading driver-in-the-loop (DIL) solution that is used across the automotive and professional motorsports industries.

Ray tracing is rFpro’s software-in-the-loop (SIL) solution aimed at generating synthetic training data. It uses multiple light rays through the scene to accurately capture all the nuances of the real world. As a multi-path technique, it can reliably simulate the huge number of reflections that happen around a sensor. This is critical for low-light scenarios or environments where there are multiple light sources to accurately portray reflections and shadows. Examples include multi-storey car parks and illuminated tunnels with bright ambient daylight at their exits, or urban night driving under multiple street lights.

Modern HDR (High Dynamic Range) cameras used in the automotive industry capture multiple exposures of varying lengths of time. For example, a short, medium and long exposure per frame. To simulate this accurately, rFpro has introduced its multi-exposure camera API. This ensures that the simulated images contain accurate blurring, caused by fast vehicle motions or road vibrations, alongside physically modelled rolling shutter effects.

“Simulating these phenomena is critical to accurately replicating what the camera ‘sees’, otherwise the data used to train ADAS and autonomous systems can be misleading,” said Daley. “This is why traditionally only real-world data has been used to develop sensor systems. Now, for the first time, ray tracing and our multi-exposure camera API is creating engineering-grade, physically modelled images enabling manufacturers to fully develop sensor systems in simulation.”

rFpro’s ray tracing is applied to every element in a simulated scene, which has been physically modelled to include accurate material properties to create the highest-fidelity images. As this is computationally demanding it can be decoupled from real-time. The rate of frame rendering is adjusted to suit the level of detail required. This enables high-fidelity rendering to be carried out overnight and then played back in subsequent real-time runs. This overcomes the usual trade-off between rendering quality and running speed.

“Ray tracing provides such high-quality simulation data that it enables sensors to be trained and developed before they physically exist.” explains Matt Daley, Operations Director, rFpro. “As a result, it removes the need to wait for a real sensor before collecting data and starting development. This will significantly accelerate the advancement of AVs and sophisticated ADAS technologies and reduce the requirement to drive so many developmental vehicles on public roads.”

rFpro’s new ray tracing capability is available now to complement existing desktop options and will also be available soon within High Performance Computing (HPC) solutions. 

About rFpro

rFpro software provides a simulation environment for the automotive and motorsport industries. It is used for the development and testing of autonomous vehicles, ADAS, vehicle dynamics and human factor studies – essentially anything that involves driving a vehicle. rFpro’s automotive customers are the world’s largest car manufacturers, tier one suppliers and sensor developers. We enable them to simulate, test and validate new sensors, control systems and vehicle hardware systems. The top ten OEMs that were early adopters of rFpro technology have already launched road cars which started their development, not on a test track, but in a virtual environment using rFpro. In motorsport we are the market leader of professional driver-in-the-loop simulator software – our customers include past and present champions of every leading motorsport category. We maintain the most realistic library of digital road models (digital twins) including test tracks and race circuits for F1, NASCAR, WEC, IMSA, Indy, Formula E, Super-GT and Australian V8 Supercars. rFpro’s vision is for every driving simulator experiment to be conducted using the rFpro engineering-focused simulation engine. On every driving simulator, local or cloud-based, rFpro will form a fundamental part of vehicle developments.

	An underground car park with multiple light sources and shadows can be a complex environment for an autonomous vehicle to navigate
	A Tokyo highway during the day illustrating glare from the sun contrasted by large shadows
	A Tokyo highway at night showing a huge array of light sources from vehicles, road infrastructure and buildings
	Motion blur in cameras is accurately simulated as illustrated by these traffic cones
	The rolling shutter effect of a camera is physically modelled in rFpro and causes straight objects to appear slanted when a speed, illustrated by this lamp post and fencing
	“Our ray tracing technology has been specifically developed for sensor systems to accurately replicate the way they ‘see’ the world,” Matt Daley, Operations Director, rFpro
	rFpro’s highly-realistic ray tracing technology in action
	Video showing four virtual cameras on a single car illustrating how ray tracing reliably simulates the huge number of reflections that can happen around a sensor