HORIZON-CL5-2025-D6-12: Safe HTI in vehicle systems of the coming decade

Project Title:

SENTIENT – Safe and Efficient Next-Generation Technology Interaction for Enhanced Navigation and Transport

Objective:

SENTIENT aims to develop an AI-driven, multimodal Human-Technology Interaction (HTI) system that enhances safety, adaptability, and user experience in next-generation vehicle systems. The project will leverage real-time monitoring, advanced cognitive models, and adaptive interfaces to mitigate risks associated with driver distraction, cognitive overload, and impaired states.

Scope and Methodology

SENTIENT addresses the need for safer and more intuitive HTI in automated and connected vehicles. It integrates real-time in-cabin monitoring, AI-based behavioural analysis, and adaptive feedback mechanisms to ensure that vehicle systems respond effectively to driver and passenger conditions.

Key innovations include:

• Multimodal Sensor Fusion: Combining computer vision, biosensors, EEG, and voice recognition to assess driver attentiveness, workload, and impairment.

• AI-Driven Cognitive Load Estimation: Using deep learning models trained on real-world data to evaluate driver engagement and mental fatigue.

• Personalised Adaptive Interfaces: Dynamic adjustments of HMI elements (alerts, interface complexity, automation settings) based on user state and situational context.

• Trust and Acceptance Modelling: Investigating user preferences, cognitive responses, and perceived safety in HTI to ensure user-centred design and acceptance.

• Simulation and Real-World Validation: Conducting large-scale simulations and on-road pilot tests across multiple driving scenarios to validate system performance.

Expected Outcomes

1. Improved safety: Reduction in human-error-related accidents through real-time risk assessment and intervention.

2. Seamless HTI adaptation: Enhanced trust and user acceptance of automated driving functions through adaptive interfaces.

3. Cross-modal human monitoring: Advanced multimodal sensing improving interaction between human drivers and vehicle AI.

4. Policy and standardisation contributions: Recommendations for HTI safety guidelines in next-gen vehicle regulations.

5. Scalability and commercial viability: Industry adoption of the SENTIENT framework for future autonomous and semi-autonomous vehicles.

Consortium and Expertise

The SENTIENT consortium consists of partners from industry, academia, and research institutions, specialising in AI-based in-cabin monitoring, cognitive sciences, automotive engineering, and HMI design. The project will be conducted in collaboration with major automotive manufacturers, Tier-1 suppliers, and safety regulators.

• AI & Sensor Partners: Companies and universities working on computer vision, machine learning, and biosensing for real-time driver monitoring.

• Automotive Industry Partners: OEMs and Tier-1 suppliers focusing on HMI systems, human-centred design, and in-vehicle automation.

• Human Factors & Cognitive Science Researchers: Experts in ergonomics, trust in automation, and cognitive load modelling.

• Testing & Validation Centres: Facilities for controlled experiments, driving simulators, and real-world validation.

Relevance to Call HORIZON-CL5-2025-D6-12

The project aligns with the Horizon Europe Cluster 5 call on “Safe HTI in Vehicle Systems of the Coming Decade” by addressing:

• Human Factors in Vehicle Automation – Ensuring safety, usability, and trust in advanced vehicle systems.

• Risk Mitigation in HTI – Using AI-driven multimodal sensing to monitor and adapt to driver states in real time.

• Impact on Future Mobility – Contributing to the EU’s Vision Zero strategy and the transition to safer, automated transport.