# Intelligent cockpit human-machine interaction Topic radar · 797 documents · 2021-01-01–2026-11-10 · updated 2026-11-08 Canonical: https://slate.greyb.com/radar/intelligent-cockpit-human-machine-interaction/innovations ## In one minute ### The screen stopped being a device and became an allocation problem The most developed part of the stack is the display fabric. Application windows migrate between panels at the frame-buffer level, so the number of physical displays becomes an output of the architecture rather than a constraint on it [1] [2]. Above that lives a seat-ownership rule that decides which occupant controls which panel [3]. The engineering effort has moved to keeping that fabric honest. Dongfeng sends a theme-switch signal twice, once to the head unit and once encoded into the frame reaching the instrument cluster, and the cluster refuses to switch until the two agree, because rendering load makes them drift [4]. SAIC goes further and has the display audit the received warning image against a stored reference icon, correcting the cockpit controller when they disagree [5]. Both are admissions that the renderer cannot be trusted on its own, written into the claim rather than the specification. 1. [CN116330974B](/?paper=CN116330974B&utm_source=radar&utm_medium=dashboard) 2. [CN122698780A](/?paper=CN122698780A&utm_source=radar&utm_medium=dashboard) 3. [CN122733219A](/?paper=CN122733219A&utm_source=radar&utm_medium=dashboard) 4. [CN121448153A](/?paper=CN121448153A&utm_source=radar&utm_medium=dashboard) 5. [CN116135597B](/?paper=CN116135597B&utm_source=radar&utm_medium=dashboard) ### The cabin is sold as a certified regional product, and the certificate is the product Desay SV carried Li Auto's cockpit into Europe for the Li 6, and the work described is localisation: eight European languages, Amap, Spotify and Apple CarPlay, digital radio for Europe and the Middle East, an emergency-call module certified to EN 17240:2024, and distraction and drowsiness warnings written to Euro NCAP criteria. The company counts 32 international qualification certificates across 35 countries and regions behind that one programme. ### Chinese automakers carry the current record, and the European group holds a large older one FAW is the largest single filer in the field with 38 patents, and most of them published in 2025 and 2026. PSA is second with 36. Chery appears under two recorded names that together account for 25. Ford holds 24, XPeng 20, Geely 17, Xiaomi 8 and Great Wall 7, and all seven of Great Wall's were published in 2026. ### Permission is now computed, and it is where the newest filings concentrate The recogniser itself is settled and largely published: streaming decoder fixes, forced-alignment training, decoding shortcuts. The recent work scores whether a request should be honoured. Geely combines acoustic, visual and vehicle-context evidence into a single confidence value before answering a stranger's voice. A second filing returns execute, delay, confirm, downgrade or refuse from a graph of conflicting intents. A third filters audio by sound zone and issues an authorisation request before acting. ### The margin is abroad, and the supplier keeps it Desay SV reported 2025 revenue of ¥32.56bn, with smart cockpits at ¥20.59bn, or 63% of the total. Overseas revenue reached ¥2.41bn, up 41.1%, at a 27.3% gross margin against 18.4% at home. A broker note on the first half of 2026 puts overseas revenue at ¥1.62bn, up 55.7% and now 11% of the total, at a 31.3% margin. ### Each carmaker files on a different part of the stack The totals hide a clean division. PSA puts 21 of its 36 patents into interaction and control, which is the single largest company position in that area. FAW files across four of the five areas, which no other organisation does at this volume. Ford concentrates on comfort, with 11 of its 24 in that area and the largest holding there of any organisation. XPeng splits between interaction (10) and occupant experience (9). ### The loop runs on consolidated silicon, with the safety partition bought in Cockpit and driving control now share one system-on-chip, and the cost arithmetic is why: a single-chip implementation is reported to cut hardware expense by 20 to 30 percent and shorten the development cycle from 18 months to 8. The separation between safety-critical and non-critical workloads has become a purchasable component, with ECARX running the instrument cluster on QNX 8.0 inside a mixed-criticality SoC and ThunderSoft pairing a real-time processor with application compute in a reference design. ### Single-chip fusion has a customer list before it has volume Horizon Robotics launched the Starry 6 in April 2026 as a single system-on-chip running cabin AI and driving models together, and reported letters of intent from more than ten carmakers including Volkswagen, BYD, Changan and BAIC, plus Bosch and Denso as suppliers, with iCAR named first to production. Pateo then took a designation from a large domestic new-energy vehicle maker to build a high-end cockpit on that chip, described as the first such award for a system running entirely on a domestic cabin-driving-integrated part. Volume production was scheduled to begin in the third quarter of 2026. ## Overview A sensor reads the occupant, an authored policy decides what that reading permits, a component changes the cabin, and a score decides whether the change was worth making. Every element of that circuit is built and claimed. What is missing is the join between permission and action being tested under real use, and the value concentrates there. ## What's new China put upgradable cockpit compute into a €15,400 car, and the frozen head unit is now the planning problem. ## Research ### The acting end of the loop is the most mature and the least measured Where the inference drives a physical change, the filings already end in actuation. Great Wall gates an air-conditioning adjustment on physiological confirmation of fatigue. Xingkongjihua turns a fused fatigue and tension classification into an intervention strategy rather than a preset rule. Valeo maps an estimated emotional state onto perfume, light, sound and massage, and BYD converts skin conductance into a motion-sickness score that triggers ventilation, fragrance or a slower speed. ### The evidence behind the loop is thin, and thinning The published measurements are few and prototype-grade. The PhysDrive dataset supplies synchronised RGB, near-infrared and radar with ECG, respiration and blood-oxygen ground truth for 48 drivers. An occupant-monitoring prototype reports 92.38 percent for child detection at about 12 frames per second. No patent here reports an effect size for the action it claims. ### Three things the filings do not contain A vehicle state model. Weichai arbitrates by driving state and treats loading and unloading as states distinct from driving; Changan routes fatigue prompting through a driving-state controller; Dongfeng separates state from presentation. Safety, comfort and fleet policy are competing for entries in the same enumeration, and no standard governs which states exist. ## Market ### The cabin now competes with AI data centres for memory Automotive DRAM prices rose 70% to 100% into 2026 as wafer capacity moved to high-bandwidth memory for data centres, with reports of increases up to 180% inside three months and lead times beyond 58 weeks. S&P Global expects the scarcity to hit advanced driver assistance and cockpit systems first, and legacy LPDDR4 parts to be unavailable for new designs from 2028. General Motors put its exposure at 1.5bn to 2bn. ### The control score has already split the market by region The first results under the 2026 protocols, published in October, show how quickly the assessment separates cars that otherwise score alike. The Audi Q7 and BMW iX3 took full marks on driving controls, the Kia EV2 scored well, and the Geely E2 reached 80%. The Xpeng X9 scored 20%, and the Zeekr 7GT, Aion UT and Leapmotor B05 scored 20% or lower, with all of those cars keeping five stars overall. ### The supplier layer is consolidating while the feature layer stays unproven ECARX agreed in June 2026 to buy the whole Flyme software business, including the Flyme Auto cockpit operating system it says is already deployed in more than two million vehicles, in order to own an end-to-end stack. Capacity is being added at the same time: Yanfeng began a ¥1.45bn cockpit research and production base in Anting, due for completion in the first quarter of 2028, with Foryou General and Maticon opening plants in the same window. ## Strategy ### Sensing absorbs the fastest growth of any area Sensing and perception went from 6 patents in 2021 to 36 in the partial 2026 year, a sixfold rise, and it now trails only interaction and control in annual output. Interaction and control grew from 13 to 62 over the same span. ### The arbitration layer is drawing firms from outside the car industry The decision over which command to honour has stopped being the carmakers' alone. A video-surveillance company filed a cross-attention method for resolving intent conflicts between modalities. A display-electronics firm filed priority arbitration over a standardised event library for multi-screen cockpit control. A server maker filed multi-user conflict resolution by priority score, a bus-electronics supplier filed a full conflict-detection and scheduling pipeline, and a university filed a method for fusing and scoring multimodal interaction behaviour in the cockpit. ### Cockpit compute is consolidating around a small set of platforms, and the bespoke builders file alone Compute grew from 12 patents in 2021 to 23 in 2026, the shallowest slope of the three growing areas. The patent record there is fragmented: PSA holds 6 and FAW 5, Chery 4, GM 4 and SAIC 4, with no organisation above six. The market has moved faster than the filings, with ECARX, ThunderSoft, Qualcomm and NXP named in the recent announcements and only three ECARX patents, two Qualcomm and two Aptiv in the record. ### Comfort and evaluation have stopped growing while the rest of the field triples Occupant comfort peaked at 11 patents in 2023, then published 5, 4 and 7 in the three years since. Evaluation and testing peaked at 11 in 2025 and published 9 in the partial 2026 year. Against interaction, sensing and compute, both look static. ### The measurement work is academic, small, and thinning Of the 67 papers in the record, 19 sit in evaluation and testing, where academic authors are the largest group, and 12 more in sensing. Interaction and control, the area that carries 240 documents, has one company paper and three academic ones. ## Areas - Interaction & Control · 253 documents - Evaluation & Testing · 175 documents - Sensing & Perception · 132 documents - Cockpit Compute & Architecture · 122 documents - Occupant Experience & Services · 71 documents - Occupant Comfort & Wellness · 38 documents