The MBUX virtual assistant based on MB.OS is the most human interface ever seen in a Mercedes. Connect all MBUX systems into one unit and present customers with a new design with empathetic interaction. The MBUX Virtual Assistant is a further development of the system first presented in the VISION EQXX. It uses generative AI and proactive intelligence to make life as simple, enjoyable and comfortable as possible. For example, it can make helpful suggestions based on learned behavior and the context of the situation. For example, viewing the latest news in the morning or starting the desired massage program at the end of the working day. And if the driver is late for a scheduled appointment, the system can offer to call directly from the vehicle. If desired, customers can also automate these processes. The experience can be further enhanced by integrating mood lighting and sound system. For example, warm light and soft music can accompany a relaxing massage.
Tailored to your needs and preferences
The MBUX Virtual Assistant has four ‘personality traits’ that blend into one: natural, forward-thinking, empathetic and personal. The basic principle is always natural and provides an interaction that exploits the best of vocal and graphic interfaces. The customer can choose to speak to the assistant with or without the wake word “Hey Mercedes”. The MBUX virtual assistant takes advantage of large language models (LLMs). This allows him to respond to questions and tasks with natural dialogue. It’s similar to a conversation with a friend. The assistant answers questions based on general knowledge and can also ask questions to gain clarity on what the customer wants and draw conclusions. Thanks to its forward-thinking “nature”, the MBUX virtual assistant can also offer proactive suggestions and routines based on situation context, learned behavior and the use of generative artificial intelligence. At the same time, a more emotional neural voice, which can have different ways of speaking, generates a sense of empathy. And to ensure it is always a very personal assistant, the driver can customize it to their preferences with a range of options.
3D graphics
The holistic approach combines more natural dialogue with visual feedback via the 3D graphics of the Unity game engine. In the new MBUX Virtual Assistant, a “living” star avatar uses animations to express different moods and moods. Emotions range from calm to excitement and even sensitivity. Other animations indicate whether the assistant is speaking, listening, thinking, making a suggestion or issuing a warning. Movement, brightness, intensity and color are perfectly coordinated to communicate intuitively with the driver.
MBUX surround navigation
Integrated visual communication also reaches a new dimension with MBUX Surround Navigation. Thanks to the deeply integrated area architecture of MB.OS, navigation connects a real view of the vehicle’s surroundings with its real-time responses. The driver benefits from improved situational awareness as he is able to “see what the vehicle sees”. The integration of information with the 3D graphics of the Unity game engine in the instrument cluster promises an intuitive overview. It promises everything the driver needs to know at a glance. For example, it shows the type of traffic, whether it is another car, van, truck or cyclist. It also displays pedestrians on the side of the road and other potential hazards.
The system displays route guidance in a realistic representation of the environment, intended primarily for busy urban environments. The driver can see what lies behind the next exit. Buildings and other infrastructure can be quickly recognized. The system also provides an integrated overview of the vehicle’s status through real-time virtual reality visualization. This includes flashing turn signals, high beams and low beams. Acceleration or deceleration is displayed by the spinning wheels.
Third-party apps and content
Over-the-air (OTA) updates ensure that customers have access to the latest content and features, tailored to their regional needs and preferences. The new E-Class already offers these advantages; the infotainment system is a precursor to MB.OS technology. The MBUX Meeting app can be integrated in the first quarter of 2024. This can be used to further increase the productivity of the E-Class and participate in Teams meetings. Along with the existing offers for Zoom and WebEx, various providers in the field of video conferencing are offered.
The update also includes the addition of more apps for everyday convenience. These include Booking.com, getAbstract, Just Eat Takeaway.com and more. On the entertainment front, there are cloud-based retro games from Antstream Arcade and more.
Sony Pictures
Mercedes-Benz is expanding its video streaming offering with the integration of the RIDEVU service from Sony Pictures Entertainment (SPE). RIDEVU promises to optimize the entertainment experience for customers. To achieve this, they will have access to a range of video entertainment directly in their vehicle. The controls and functions were specially developed for use in the vehicle. Users can rent or purchase Sony Pictures Entertainment content directly in the vehicle. This includes a curated library of films available for streaming that enrich Mercedes-Benz’s entertainment offering.
Digital art customization
MBUX Collectibles is the first in-car app from Mercedes-Benz that can display digital art and collectibles based on NFTs (non-fungible tokens). This allows you to create a private art gallery by connecting the customer’s personal NFT wallet to the user interface. Users can also view an exhibition curated by Mercedes-Benz. During CES, the app will showcase NFT collections from Mercedes-Benz NXT, the company’s new specialty division focused on digital objects. The Mercedes-Benz NXT Icons Era 1 Luxury collection is the first “Era” in a series of seven based on the Mercedes-Benz design tradition. During CES there will also be a first preview of Era 2 Technology, which will still be released. And in homage to last year’s CES, visitors will get a first look at the Mercedes-Benz NXT Superdackel NFT. A limited edition of 1,000 Mercedes-Benz NXT NFT Superdackels will be released soon.
CLA Class Concept
Vehicles on the upcoming MMA platform will be the first to run entirely on MB.OS. Making its North American debut at CES 2024, the CLA Class Concept offers a near-production look at the future four-vehicle family. To emphasize the central role of MB.OS in shaping the customer experience, the interior of the concept vehicle provides a visualization of this. The multilayer architecture of the operating system is represented by one of many hardware components; the powerful water-cooled chip from collaboration partner NVIDIA. The MBUX Superscreen with three displays underlines the role of the Mercedes of the future as a hyper-personalized part of the customer’s digital life.
MB.OS provides the foundation to achieve this goal. The operating system covers four areas: infotainment, automated driving, body and comfort, as well as driving and charging. Integrated with the connectivity module for connection to the Mercedes-Benz Intelligent Cloud. The chip-to-cloud architecture ensures extensive integration with the vehicle and gives Mercedes-Benz full control over all sensors and actuators. By decoupling software and hardware innovation cycles, Mercedes-Benz can also ensure that its vehicles are always up to date.
2024-01-09 21:12:00
#MercedesBenz #adds #artificial #intelligence #MBUX