現(xiàn)在,您可以從任何地方駕車環(huán)游洛杉磯的各個社區(qū),全程 36 公里(22 英里)。
截至目前,仿真公司rFpro已經(jīng)繪制了全球180多個地點(diǎn)的數(shù)字地圖,其中包括公共道路、測試場地和賽車賽道。然而,這些地圖的規(guī)模及復(fù)雜程度都比不上該公司最新推出的一款數(shù)字地圖。rFpro技術(shù)總監(jiān)Matt Daley在AutoSens USA 2024上稱,這款新推出的洛杉磯數(shù)字地圖是一個“無比巨大且復(fù)雜的數(shù)字模型”,覆蓋了一條全長36公里(22英里)的雙向行駛環(huán)形路,用戶可在其中虛擬駕駛。其中的數(shù)字道路是使用勘測級激光雷達(dá)數(shù)據(jù)在1cm×1cm(1.1″×1.1″)的X-Y網(wǎng)格上構(gòu)建的,地圖中還包含超過12000棟路邊建筑物、13000個街道基礎(chǔ)設(shè)施(如交通標(biāo)志和路燈)和40000株植被。
Daley表示,“這是一個絕佳的地點(diǎn),其中包含了大量不同類型的基礎(chǔ)設(shè)施,對自動駕駛汽車而言極具挑戰(zhàn)性。在這條環(huán)形道路上駕駛時,您可以測試所有輸入的車輛參數(shù),并體驗(yàn)懸架系統(tǒng)。尤其對于自動駕駛汽車而言,傳感器受到的震動與您在真實(shí)道路上駕駛時的體驗(yàn)幾乎一致。”
這款數(shù)字地圖覆蓋的是洛杉磯西南部的一塊區(qū)域,包括110號高速公路從洛杉磯港到卡森市的路段,穿過了托倫斯工業(yè)區(qū)、密集住宅區(qū)和郊區(qū)的羅靈丘陵。對于那些想要進(jìn)行多種模擬測試(尤其是自動駕駛系統(tǒng)測試)的公司而言,這個多元化的新模型具有極大的價值。
Daley表示,“我們現(xiàn)在可以在各種日常場景中對自動駕駛汽車進(jìn)行測試,包括不同的環(huán)境、交叉路口和道路類型”。他補(bǔ)充說,數(shù)字地圖數(shù)據(jù)集還包含鐵路道口、加油站、十字路口以及高速公路的上下匝道等數(shù)據(jù)。
Daley告訴SAE:“自動駕駛汽車在研發(fā)時面臨的一大挑戰(zhàn)是必須獲取大量多元化數(shù)據(jù),然而在真實(shí)道路測試中很難做到這點(diǎn),因?yàn)檫@需要行駛大量的里程、覆蓋許多不同地點(diǎn),并累積足夠的數(shù)據(jù)才能做到。而仿真測試則不同,我們可以直接創(chuàng)建多元化場景,也可以讓客戶在現(xiàn)有數(shù)字地圖上添加次級的多元數(shù)據(jù)。”
rFpro于2007年成立并進(jìn)入駕駛員在環(huán)仿真,從2015年開始考慮集成ADAS測試。
Daley指出,“我們意識到,憑借我們?yōu)闃?gòu)建可靠的仿真平臺和基礎(chǔ)設(shè)施投入的資金,以及我們創(chuàng)建3D模型的技術(shù)和能力,我們便可以添加新的數(shù)據(jù)層。我們知道這樣做就等于改變了產(chǎn)品的性質(zhì),而且必須賦予新模型新的功能,因?yàn)樗膽?yīng)用領(lǐng)域?qū)⒉幌抻谟腥笋{駛場景。我們必須在該模型上添加數(shù)字?jǐn)z像頭,但攝像頭不同于人眼,它們通常在不同的時間段對周圍環(huán)境進(jìn)行采樣。而且,我們還需要使用雷達(dá)模型和激光雷達(dá)模型,因此我們創(chuàng)建了傳感器API系統(tǒng),以便對插件進(jìn)行建模,并將其作為額外通道集成至仿真模型中。”
無論是人類駕駛員還是虛擬駕駛員,在rFpro地圖中看到的場景都是由相同材料構(gòu)成的幾何世界。人類駕駛員可以看到由每像素8位的RGB顏色構(gòu)成的虛擬世界,而模擬攝像頭可能會處理“通過感知系統(tǒng)傳遞下來的更高位圖像。但虛擬世界的基本原理和其中物理學(xué)的計算方式是相同的,關(guān)鍵在于如何以正確的格式展現(xiàn)傳感器需要看見的圖像,” Daley表示。
rFpro控股公司AB Dynamics PLC于2022年收購了Ansible Motion,后者不僅提供3D全動態(tài)平臺硬件,還提供完整的集成解決方案。Daley表示,“除了Ansible外,我們有一些合作伙伴或經(jīng)銷商也將“rFpro地圖”集成至其自身硬件上。同時,我們的很多客戶也會自己集成。比如,早在2014年我還是法拉利的客戶時,我們對法拉利自主研發(fā)的模擬器進(jìn)行了改裝,并將rfPro地圖整合進(jìn)了模擬器,通過升級現(xiàn)有系統(tǒng),使其具有更高的保真度。為什么這一點(diǎn)很重要?因?yàn)榭蛻艨梢岳梦覀兊姆抡婺P蛣?chuàng)建成幾十萬個不同邊緣場景的不同測試,也可以利用這個基于真實(shí)地點(diǎn)構(gòu)建的復(fù)雜高精度模型,重新創(chuàng)建一些在現(xiàn)實(shí)世界中可能發(fā)生的已知風(fēng)險事件。”
Daley表示,憑借rFpro系統(tǒng),客戶可以生成一些在現(xiàn)實(shí)中未曾發(fā)生,且實(shí)際駕駛中難以遇到的邊緣場景。這是因?yàn)樵诂F(xiàn)實(shí)世界中,客戶沒有足夠的時間、金錢、資源和車輛,或是純粹的運(yùn)氣來滿足這些邊緣場景所需的特定天氣、車輛或行人等條件的組合。而這個洛杉磯數(shù)字地圖是基于真實(shí)地點(diǎn)創(chuàng)建的,因此你可以在仿真模型和真實(shí)地點(diǎn)之間進(jìn)行匹配性測試,以建立仿真模型的置信度,這有助于提升你利用合成訓(xùn)練數(shù)據(jù)的能力。
rFpro新推出的洛杉磯數(shù)字地圖即可應(yīng)用于駕駛員在環(huán)實(shí)時駕駛,也可用于全保真光線追蹤模擬器以生成復(fù)雜的高保真度感知數(shù)據(jù),并在短時間內(nèi)提供數(shù)萬次測試。此外,數(shù)字?jǐn)z像頭也可以用于模擬帶運(yùn)動模糊圖像的邊緣場景,或具有完整連拍效果的邊緣場景(不同的OEM可以為其傳感器定義不同的參數(shù))。Daley表示,“該數(shù)字地圖不僅生成了自動駕駛系統(tǒng)所需的最高保真度的訓(xùn)練數(shù)據(jù),而且是利用行業(yè)領(lǐng)先的感知融合技術(shù)構(gòu)建的,因此可與這些技術(shù)協(xié)同運(yùn)作。”
總之,洛杉磯數(shù)字地圖是rFpro基于現(xiàn)實(shí)世界繪制的最好的地圖,它可以使自動駕駛技術(shù)公司相信,他們在仿真模型中得到的結(jié)果具有現(xiàn)實(shí)意義。
Daley表示,“只有在相信模擬結(jié)果的前提下,你才能實(shí)現(xiàn)這一目標(biāo)。如果仿真模型是采用虛構(gòu)地點(diǎn)創(chuàng)建的,那么就很難將仿真結(jié)果與現(xiàn)實(shí)情況聯(lián)系起來?;谡鎸?shí)地點(diǎn)創(chuàng)建的仿真模型具有很大的價值,能夠讓我們有信心擴(kuò)展仿真應(yīng)用的規(guī)模。”
Simulation company rFpro has already mapped over 180 digital locations around the world, including public roads, proving grounds and race circuits. But the company’s latest is by far its biggest and most complicated. Matt Daley, technical director at rFpro, announced at AutoSens USA 2024 that its new Los Angeles route is an “absolutely massive, complicated model” of a 36-km (22-mile) loop that can be virtually driven in both directions. Along these digital roads – which were built off survey-grade LIDAR data with a 1 cm by 1 cm (1.1-in by 1.1 in ) X-Y grid – rFpro has added over 12,000 buildings, 13,000 pieces of street infrastructure (like signs and lamps), and 40,000 pieces of vegetation.
“It’s a fantastic location,” Daley said. “It’s a huge array of different types of challenging infrastructure for AVs. You can drive this loop with full vehicle dynamic inputs, ready to excite the suspension and, especially with AVs, shake the sensors in the correct way as you would be getting if you were driving those real roads.”
The new digital map covers an area in southwest LA that includes Highway 110 from the harbor up to Carson, going through industrial areas, dense residential areas in Torrance, and suburban Rolling Hills. The variety is what makes this new model so valuable to companies that want to simulate various tests, especially for new automated driving systems.
“We are now able to give autonomous vehicles the ability to test in all of these different types of environments, junctions, and road types that they’re going to experience in day-to-day life,” Daley said, adding that there are railroad crossings, gas stations, intersections, and highway on- and off-ramps in the data set.
“The grand challenge of autonomous development is that you need so much diversity available to you,” Daley told SAE Media. “It’s extremely difficult to get in the real world, because you have to go so many different miles, so many places, and really drive so much volume in order to create it. It’s a slightly different challenge in simulation, because we can create diversity and let people create second levels of diversity inside existing maps.”
Not just for human drivers
RFpro started in 2007 in the driver-in-the-loop market. In 2015, the company started to think about how to integrate ADAS testing.
“We realized that the amount of investment that we got in providing a solid simulation platform and infrastructure, as well as our technologies and abilities to build 3D models, we could add additional layers,” Daley said. “We knew it wouldn’t be the same product, we had to keep adding additional functionality because it was no longer just humans that were looking into this. We had to add digital eyes, and cameras are not human eyes. They are different in the way that they sample the world over different time periods. And then [we needed] lidar and radar models as well, so we created the sensor API system to allow plugins to be modeled, and to come and sit in as additional channels in the simulation.”
No matter if a human or a digital driver is viewing the scene in an rFpro map, it uses the same geometric world, Daley said, including what all the materials are made of. Humans will see the virtual world displayed with an eight-bit RGB color per pixel, but a simulated camera might process a “higher-bit image that gets passed on through a perception system down the chain,” Daley said. “The fundamentals of the world and how you calculate the physics in the world are still the same. It all comes down to how do you present that onwards in the correct format for how the sensor needs to see.”
AB Dynamics PLC, which also owns rFpro, acquired Ansible Motion in 2022. Ansible provides 3D full-motion platform hardware and can do full integrated solutions, Daley said. “We have other partners and other resellers that integrate [our maps] onto their own hardware,” he said. “A lot of our customers do it themselves as well. I was a customer at Ferrari back in 2014, when we converted an in-house simulator they had and brought rfPro onboard and upgraded an existing system with a higher fidelity world. And why does this matter? Well, it’s the virtual playground that allows our customers to create hundreds of 1,000s of different tests of different edge cases and to recreate some of the known hazardous events that can happen in the real world in a highly accurate model of a real-world location, with the real world complexities that are there.”
Daley said rFpro’s system also allows customers to “generate things that didn’t happen, that you couldn’t find by doing real-world drives, because you simply do not have enough time, money, resources, vehicles, or the pure luck of finding the combination of weather and vehicles and pedestrians all doing the edge case scenarios that you need. Because [the LA map is] a real-world location, you can also correlate, you can do matching tests in your simulation and your real-world location to build your level of confidence in the simulation that really helps you to exploit the power of using synthetic training data.”
Rfpro’s new LA route can be driven in real-time with a human-in-the-loop driver or used in a simulator with full-fidelity ray tracing to generate complicated high-fidelity sensables, providing tens of thousands of tests in a short time. Digital cameras can also simulate edge cases, with nuances that come from having motion blur in an image or with full rolling-shutter effects that each OEM can define for each of their sensors. “It produces the highest fidelity training data to go into autonomous systems, and it’s built on top of and alongside industry led sensable integrations,” Daley said.
Overall, the LA map is rFpro’s best example of a map based on the real world that can provide automated driving tech companies with confidence that what they find in the simulator will match what might happen in the real world.
“You can only get to that position if you have confidence in your simulation,” Daley said. “It's pretty impossible to correlate your simulation if that thing is not a real location, if you're just making up a location. Having real world locations is hugely valuable to actually give you that confidence to scale.”