SkillReal使用市售小型攝像頭和自研算法,大大加快了人工檢測或設(shè)備檢測的速度。
一家公司稱,他們通過結(jié)合復(fù)雜AI算法,結(jié)合市售攝像頭,開發(fā)出了一款數(shù)字孿生對準(zhǔn)系統(tǒng)。該系統(tǒng)有可能改變汽車行業(yè),為生產(chǎn)線的缺陷檢測過程節(jié)省高達(dá) 200 億美元。
通常情況下,焊點(diǎn)、螺栓孔等部位的檢測主要通過以下三種方式進(jìn)行:
-
緩慢且錯誤率高的人工檢測;
-
速度更慢的坐標(biāo)測量機(jī)檢測,檢測150個焊點(diǎn)可能需要數(shù)小時(shí);
-
激光等技術(shù),非常昂貴,但不能保證完美無缺
以色列公司SkillReal剛剛在大眾沃爾夫斯堡工廠完成技術(shù)驗(yàn)證,最近正式公開亮相。該公司表示,只需使用一個售價(jià)約1000美元的攝像頭和一臺游戲筆記本電腦,其軟件就可以在短短幾秒鐘內(nèi)將零件照片與數(shù)字孿生體進(jìn)行比較,并指出缺陷。
這與一些OEM和供應(yīng)商的傳統(tǒng)做法截然不同,他們通常交給檢測員一支記號筆和一份顯示焊點(diǎn)位置等特征的 PDF文件,然后由檢測員目測比較零件與文件,并標(biāo)記零件缺陷。
位于密歇根州利沃尼亞的SkillReal北美總部的首席運(yùn)營官Pete Grabowski表示,人工檢測的成本可能會迅速增加,因?yàn)镺EM的安全投產(chǎn)需求使供應(yīng)商每月需要支付高達(dá)50000美元的費(fèi)用給第三方公司,專門用以確保零件符合OEM和其他監(jiān)管標(biāo)準(zhǔn)。當(dāng)一家供應(yīng)商為多個汽車項(xiàng)目生產(chǎn)幾十或數(shù)百個零件時(shí),相關(guān)成本就會大幅上升。
他說,SkillReal系統(tǒng)的獨(dú)特之處不僅在于能檢測出CAD文件中具有 XYZ 坐標(biāo)的產(chǎn)品特征,還在于其極高的檢測精度。“我們能夠以亞毫米級的精度確定這些特征的確切位置,而且在幾秒鐘內(nèi)就能完成檢測。”該系統(tǒng)還具有很強(qiáng)的容錯能力,能夠補(bǔ)償被攝測試零件的位置變化。SkillReal曾在在底特律地區(qū)一家沖壓和組裝廠進(jìn)行過一次測試,Grabowski 稱之為“我們的‘John Henry’與機(jī)器對決”。在該測試中,SkillReal與工廠最好的標(biāo)記審計(jì)員進(jìn)行了一場高難度挑戰(zhàn):評估整個車輛底盤上的焊點(diǎn)和其他項(xiàng)目,其中涉及多張照片。工廠操作員在 90 分鐘內(nèi)完成了任務(wù)。“而我們在不到 10 分鐘內(nèi)就完成了,”Grabowski 說。
在大眾沃爾夫斯堡工廠開展的檢測結(jié)果則更加顯著。Grabowski 說,大眾的兩名操作員用了整整八小時(shí)輪班檢測焊點(diǎn),而SkillReal的軟件在15秒內(nèi)就完成了相同的工作。“大眾對我們進(jìn)行了兩年的嚴(yán)格測試。我們希望確保這些測量結(jié)果確實(shí)是亞毫米級的,可以精準(zhǔn)無誤地指出特征的位置。因此大眾分別用自己的系統(tǒng)和我們的系統(tǒng)對其零件進(jìn)行了測量,然后將零件放在坐標(biāo)測量機(jī)上進(jìn)行核對。在確保我們的系統(tǒng)具備商業(yè)可行性之后,我們將通過NorthStar Vision在美國推出該系統(tǒng),現(xiàn)在我們正在添加更多功能。”
SkillReal的一位顧問表示,對供應(yīng)商和制造商而言,實(shí)現(xiàn)效率和成本控制的關(guān)鍵在于及時(shí)發(fā)現(xiàn)問題,避免拖到下一零件生產(chǎn)或子裝配完成后才發(fā)現(xiàn)。
SkillReal的軟件可以支持一臺搭載英偉達(dá)GPU的個人電腦,連接多達(dá)八個攝像頭。Grabowski說,工人每個工人在一個班次八小時(shí)的時(shí)間內(nèi),就能完成該系統(tǒng)的使用培訓(xùn)。
SkillReal的創(chuàng)始人兼CEO是 Shai Newman,他在創(chuàng)立SkillReal之前,曾創(chuàng)立了Compedia,一家?guī)椭霭嫔虒⑵鋬?nèi)容轉(zhuǎn)化為虛擬3D教育環(huán)境的公司。西門子曾與Compedia開展合作,設(shè)計(jì)一種能為其生產(chǎn)線檢測員的AR眼鏡提供支持的系統(tǒng)。2D攝像頭檢測技術(shù)的想法正是誕生于這次合作。
被問及該系統(tǒng)的數(shù)學(xué)原理時(shí),Grabowski說,該算法可進(jìn)行“數(shù)十億次的硬核計(jì)算機(jī)視覺計(jì)算”,實(shí)際上就是將2D圖像逐像素分解。“它對 3D 模型也做了同樣的處理,以實(shí)現(xiàn)完美的疊加。然后我們在上面添加 AI,這樣我們就知道需要查看哪些地方。”該系統(tǒng)還利用了一個巧妙的計(jì)算節(jié)省技巧,即只掃描組件應(yīng)該存在的位置。換句話說,不需要浪費(fèi)處理器資源來分析沒有檢測特征的位置。
Grabowski提到,公司確實(shí)看到了該技術(shù)的更多應(yīng)用潛能。“目前,我們的主要業(yè)務(wù)集中在白車身,但我們認(rèn)為,該技術(shù)也能擴(kuò)展到汽車內(nèi)飾的最終組裝和其他應(yīng)用。單在汽車行業(yè),就有眾多應(yīng)用領(lǐng)域尚待我們開發(fā)。目前還沒有其他公司能夠從事這種超快速、亞毫米級精度的尺寸檢測。”
他同時(shí)表示,相信SkillReal的先發(fā)優(yōu)勢和一系列專利,可以保護(hù)其免受潛在競爭對手的威脅。
A company says that its digital twin alignment system, incorporating a sophisticated AI algorithm and an off-the-shelf camera, has the potential to revolutionize the auto industry, potentially saving it up to a staggering $20 billion in the effort to detect defects on the manufacturing line.
Generally, such inspections of spot welds, bolt holes and the like are handled one of three ways:
-
Slow manual inspections that can have high error rates.
-
Even slower inspection with coordinate-measuring machines (CMMs) that can take hours to inspect 150 spot welds.
-
Tremendously expensive technology, such as lasers, that still aren’t perfect.
SkillReal, an Israeli company that just exited stealth mode after proving its technology at Volkswagen’s Wolfsburg plant, says that using a roughly $1,000 camera and a gaming laptop, its software can compare a photo of a part with a digital twin, highlight problems and be completed in mere seconds.
That’s in contrast with what some OEMs and suppliers do, which is essentially hand an inspector a Sharpie and a PDF showing weld locations and other features. The inspector then visually compares them and marks the part for deficiencies.
Pete Grabowski, SkillReal’s chief operating officer at its North American headquarters in Livonia, Michigan, said the costs of these inspections can really add up because of OEM demands involved in safe launches, in which suppliers are made to pay up to $50,000 a month to third-party companies to ensure parts meet OEM and any regulatory standards. That adds up quickly when a supplier has dozens or hundreds of parts going to multiple vehicle programs.
He said that what sets SkillReal’s system apart is not just detecting features represented in a CAD that have an XYZ coordinate, but how accurate the system is. “We can pinpoint the exact location of those features with submillimeter accuracy. And we do that in seconds.” The system is forgiving, too, able to account for positional variations of the photographed test object. One test of the system that Grabowski called “our John Henry versus the machine” was conducted at a Detroit area stamping and assembly plant. The test pitted SkillReal against the plant’s best marker auditor in a daunting challenge: evaluating welds and other items on the entire underbody of a vehicle involving multiple photos. The plant’s operator finished in 90 minutes. “We were done in less than 10,” Grabowski said.
At the VW plant in Wolfsburg, the results were even more dramatic. Grabowski said VW had two operators working entire eight-hour shifts checking spot welds, while SkillReal’s software covered the same ground in 15 seconds. “They put us through the wringer for two years,” he said. “We want to make sure that these measurements are really sub-millimeter, that you’re really right in saying where they are. So they take parts, measure it with their system, our system, then they put it on a CMM. We got it commercially viable and then launched in the States through our group NorthStar Vision, and now we're adding more features.”
The key to efficiency and cost control for the suppliers and manufacturers, one Skillreal adviser said, is to detect the problem before the next part is built or sub-assembly completed.
The SkillReal software can support up to eight cameras from the same PC running an NVIDIA graphics processing unit. Workers can be trained to use the system in a single eight-hour shift, Grabowski said.
SkillReal’s founder and CEO is Shai Newman. Before Skillreal, Newman founded Compedia, a company that helps publishers transform their content into virtual 3D educational environments. The idea for the 2D-camera inspection technology was born when Siemens approached Compedia in its own search for a system that it hoped would power some kind of augmented reality glasses for the manual line inspectors.
Asked to detail the inner workings of the math, Grabowski said the algorithm does “billions of hardcore computer-vision calculations” that actually break the 2D image up pixel by pixel. “It does the same thing with a 3D model for that perfect overlay,” he said. “And then we layer the AI on top so we can know where to look.” In a nifty compute-saving trick, the system only scans where the components are supposed to be. In other words, there’s no need to waste processor power analyzing locations that don’t include features to inspect.
Grabowski said the company does see more future uses of the technology. “The automotive body in white is our bread and butter for the time being,” he said. “But we see expansion into final assembly of automotive interior trim panels and more. There are so many different avenues that we can use this in automotive alone. No one's doing this type of ultra-fast, sub-millimeter accurate dimensional check.”
He said the company believes its first-mover advantage and series of patents protect it against potential competitors.