BMW Development demo - BMW Intelligent Personal Assistant
At CES, the BMW Group and Amazon showcase voice assistant LLM capabilities based on a current development project that the companies are working on in preparation for a potential series rollout. This makes the BMW Intelligent Personal Assistant the ultimate vehicle expert thanks to generative AI that is powered by the Alexa LLM. At CES, visitors experience how the voice assistant provides quick instructions and answers about vehicle functions in a much more human, conversation-like manner, while at the same time being able to control some vehicle functions.
The BMW Intelligent Personal Assistant has been using artificial intelligence for speech processing for a long time and this demo is the latest proof point of the continued innovation BMW and its partners are bringing to customers. Complex processing capabilities, which enable human-like interactions and dialogs, have not yet been integrated into BMW series vehicles. Such capabilities are now made possible by LLMs, which are AI models that are designed to process human language at a high level and generate responses accordingly. The BMW Group is also taking careful steps to build a safe and trusted experience for customers, and continues to test and iterate these LLM capabilities over time with its partners.
Since the introduction of the first BMW Intelligent Personal Assistant in 2018, language interaction has been an essential part of BMW iDrive. Today, the voice assistant gives customers control over many vehicle functions so that they can keep their hands on the wheel and their eyes on the road. Leveraging Amazon’s Alexa Custom Assistant — a solution that is based on Alexa technology and enables companies to create their own customized voice assistant — the next-generation of the BMW Intelligent Personal Assistant will soon become more powerful over the course of the year in vehicles with BMW Operating System 9.
The BMW Intelligent Personal Assistant has been using artificial intelligence for speech processing for a long time and this demo is the latest proof point of the continued innovation BMW and its partners are bringing to customers. Complex processing capabilities, which enable human-like interactions and dialogs, have not yet been integrated into BMW series vehicles. Such capabilities are now made possible by LLMs, which are AI models that are designed to process human language at a high level and generate responses accordingly. The BMW Group is also taking careful steps to build a safe and trusted experience for customers, and continues to test and iterate these LLM capabilities over time with its partners.
Since the introduction of the first BMW Intelligent Personal Assistant in 2018, language interaction has been an essential part of BMW iDrive. Today, the voice assistant gives customers control over many vehicle functions so that they can keep their hands on the wheel and their eyes on the road. Leveraging Amazon’s Alexa Custom Assistant — a solution that is based on Alexa technology and enables companies to create their own customized voice assistant — the next-generation of the BMW Intelligent Personal Assistant will soon become more powerful over the course of the year in vehicles with BMW Operating System 9.
Category
🚗
MotorTranscript
00:00 Hey BMW, what does the My Modes button do?
00:14 The My Modes button allows you to switch between different modes such as Personal Mode, Sport
00:19 Mode and Expressive Mode, which alter the interior functions, for example, light, shading,
00:25 seat functions and the driving experience.
00:27 I see, what happens if I activate Sport Mode?
00:31 When you switch to Sport Mode, the vehicle's drivetrain system adjusts to deliver a more
00:35 dynamic driving experience.
00:38 It enhances engine performance, changes the transmission's shift points, and may also
00:43 modify the steering and suspension settings for improved handling.
00:47 How do I turn it on?
00:48 To turn on Sport Mode, you can press the My Modes button and press the Sport tile on the
00:53 screen.
00:54 Once selected, the vehicle's systems will adjust to the Sport Mode settings.
00:58 And which mode should I use here in Vegas?
01:01 If you're in Las Vegas, you may want to try the Expressive Mode.
01:05 It creates a more dynamic and exciting atmosphere with brighter lighting, more vibrant colors,
01:11 and a more responsive driving experience.
01:14 Can you set it for me?
01:16 Drive Mode has been set to Expressive.
01:18 Nice, can my car also assist me in parking?
01:22 Yes, your car is equipped with a parking assistance system that uses sensors and cameras to support
01:27 you while parking or exiting a parking space.
01:30 This system can help you park more easily and safely.
01:34 How does it work?
01:35 The parking assistance system uses sensors located at the front, rear and sides of the
01:40 vehicle to detect obstacles and provide visual and audible alerts.
01:44 These sensors may include ultrasonic sensors, cameras, or a combination of both.
01:49 When you engage the parking assistance feature, the system will activate the sensors and display
01:54 a real-time view of the surrounding area on the screen.
01:57 This view may include guidelines or markings to help you understand the vehicle's position
02:02 in relation to obstacles.
02:04 Can you also tell me about Active Cruise Control?
02:07 Cruise Control is a feature that allows the driver to set a specific speed and maintain
02:12 it without having to continuously press the accelerator pedal.
02:16 Once activated, the Cruise Control system will automatically control the vehicle's
02:21 speed, adjusting it as needed to maintain a consistent distance from the vehicle in
02:25 front.
02:26 Is there a minimum speed required to activate it?
02:29 Yes, there is usually a minimum speed required to activate Cruise Control.
02:34 This minimum speed can vary depending on the vehicle and its specifications.
02:39 It is typically set at a speed that ensures safe operation and allows the Cruise Control
02:43 system to function properly.
02:46 What is it for my car?
02:48 For your car, the minimum speed required to activate Cruise Control is 30 km/h.
02:53 Does that help to save energy?
02:56 Cruise Control can potentially help save gas by maintaining a consistent speed, which can
03:00 lead to more efficient driving.
03:03 However, the actual energy savings may vary depending on factors such as the vehicle's
03:08 speed, road conditions, and driving habits.
03:11 Is there a mode that can help me to drive more efficiently?
03:14 Yes, your car has an efficient mode that can help you drive more efficiently and save energy.
03:20 When you select efficient mode, the vehicle's systems are adjusted to optimize fuel economy.
03:25 This may include changes to the engine's performance, transmission settings, air conditioning,
03:30 and other features.
03:32 Can you turn it on?
03:33 Sure, I have set the drive mode to efficient.
03:36 Do you know if there is a speed boost in this car?
03:39 Yes.
03:40 The car has a speed boost feature called the Sport Boost function.
03:44 What does it do?
03:45 This function immediately sets all relevant systems of the vehicle to maximum sportiness,
03:50 providing an extra boost of power for acceleration.
03:53 Great, how can I use it?
03:55 To use the Sport Boost function, simply pull the left shift paddle on the steering wheel
04:00 for at least one second.
04:02 This will activate the function and provide an extra boost of power for acceleration.
04:07 It is perfect for overtaking or quick acceleration.
04:10 However, it is important to note that the Sport Boost function should only be used when
04:15 necessary as it can consume more energy and may not be suitable for all driving conditions.
04:21 Thanks so much!
04:22 [MUSIC]