VOS

HMI design, UX/UI, User Scenario, AI and automation

Volvo Construction Equipement Sponsor Studio

Next Generation in Cab and Operating Experience

The Construction industry is constantly needed for skilled operators and future generations of operators who will lead the industry in the future. However, the industry lacks operators, and difficult for new operators to learn the skills.

“How can we bring the future generation on site, and provide them with new opportunities through Volvo OS, and construct effective and productive working system with AI and automation?

Who are we targeting?

We are targeting the future generation of the operators, and believe that they hold key to the future of the construction industry.

Brand Affinity

Creating the Next Generation CAB

The Volvo OS system, VOS will consist of 2 parts, the digital and the physical part where the OS will give the operator the ease to control the physical part as well.

Physical:

The Cab

The cab interior is designed as an aviation setting where the operators really get the gist of seriousness and going into work mode in the cab.

Digital:

VOS, or Volvo OS system integrates advanced automotive features, producing maximum productivity, safety, and trust.

The Main Features of OS

Personalized workspace

Connected

Digital twin

Safety and Confidence

AI chat

Trust and Assurance

Task automation

Efficiency

1:

Personalized Workspace

Operators are able to have their own personalized OS workspace no matter which Volvo wheel loader they hop onto. with personal authentication with mobile phone.

With organized dashboard workspace, operators can easily recognize the work status and tasks

2:

AI Chat

With the support of the AI chat bot, operators are reminded with their task, and they can gain support with decision making. They are also a great emotional companion.

operators can chat with selection chatting, this will allow them to chat without disruption from the loud environment.

3:

Digital Twin

“A digital twin is a virtual replica of a physical asset, system, or process that can be used to simulate, monitor, and optimize its performance.”

Digital twin of the construction site

What kind of digital twin are in VOS?

Digital twin of the wheel loader

Driving mode digital twin

When operator is driving, VOS visualizes the environment with the map, giving them awareness.

Work mode digital twin

While traveling with workload, the screen will display bucket info, and slopes assistant for assurance.

when there are hazards, the vehicle recognizes and warns the operator in advance.

Digital twin will make sure that the vehicle is within the safety zone, giving them 360 view of the cab.

Digital twin of the wheel loader and safety systems

Digital twin Visualization

The visualization of the cab was powered by Unreal Engine, real time 3D gaming engine.

AI and Digital twin brings a Trusted partner on the job site for operators and rapidly change the experience of operators.

Digital twin of the operator work habit

4:

Task Automation

Through AI and machine learning, the wheel loader is able to detect repetitive work task, and turn it into task automation, then the operator is able to have hands-off but monitoring job on the work field.

Automation Flow

With machine learning, the cab learns repetitive work, then suggests the operator for autonomous performance.

Before the operator approves automation, VOS will make sure that the operator is aware of the process of automation.

First, the machine detects the object that needs to be lifted,

Then, with lifting point prediction, it lets the operator know what will happen next, also with the process bar.

When the cab is traveling, it will show the map and how it will be traveling since it will be driving autonomously.

Just like lifting the bucket, the interface will display releasing point

If there're are any emergency case, and needs to take over from autonomous mode, then, it will instruct the operator to lift the joystick screen

How to achieve automation in VOS

There are two ways to get to task automation, one is selecting automated task in the task cloud, and the other is to let the wheel loader perform machine learning through repetitive task.

Joystick connection with automation

The joystick will have different visual signifier for safety depending on which mode the wheel loader is in.

Ambient lighting with modes

Different colors of ambient lighting will display on the joystick for more intuitive control of the modes and wheel loader.

Automated joystick path

On automation mode, the automated path of joystick will show through the glass flap on the joystick, giving operators the assurance when it comes to automation.

Take over

In an emergency case or when the operator wants to return to the manual mode from automation mode, the operator can simply flip the flap back up.

Dashboard design

The additional dashboard will be displayed on top of the monitor screen, allowing the operators to view vehicle status.

Manual mode

The dashboard will display vehicle essential information including speed, energy information, and bucket info.

Autonomous mode

For autonomous mode, there will be ambient indicator that the vehicle is in autonomous mode.

Volvo OS will transform the construction industry and inspire a new generation of operators, cultivating a distinct culture and work experience that is innovative, positioning construction as a highly desirable profession.

Conclusion:

Next step

Through this project, we gained better understanding of the operator’s needs and the industry’s pain points.

Next, we would like to explore a technical possibility of the AI and automation that will bring even more efficiency and change in the construction industry.

Our Sponsor class!