Tracking and training06 March 2018 | Nick Holt
Digital technologies are providing new training solutions for the automotive industry. Nick Holt reports
Eye tracking systems are now being successfully used to create training programs that reduce errors in manufacturing operations. Mike Bartel, senior research developer at Tobii Pro Insights provided an overview of what this technology offers: “Eye tracking has been around for over 30 years but it’s only in the last five years that the technology has become small enough and unobtrusive enough for it to be used the working environment. With our latest generation wearable eye tracker we are able to set up a pair of special glasses on an employee, calibrate them and have them complete their professional tasks; all the time we are measuring where they are looking, what they focusing on, what might be distracting them. We can identify where the safety hazards are they haven’t noticed, any inefficiencies in their process. We can then use this data to form best practices to implement into training protocols. So we take what we have learned from directly measuring employee attention and apply it to improving the employee experience, improving efficiency and making a better overall job performance.”
The system features an HD scene camera is mounted within the frame of the glasses, pointed outwards and capturing a widescreen view of the world. Inside the glass’s frame are high-speed sensors and illuminators that take 100 pictures of the wearer’s eye every second and then plot that data onto the video that is being captured by the scene camera. “It allows you to see the world through the eye’s of the employee,” said Bartel.
Keeping an eye on quality
The company is working with automotive manufacturers on a few different components of the process. These cover the painting process, quality assurance and the assembly line process. Bartel explained: “Using Pro Glasses 2 we are able to measure where people are looking as they are visually inspecting the paint finish on a vehicle while it’s on the line. From this we are able to couple of things. Firstly we are able to create a set of best practices for the pattern of eye movement that is associated with a good performance on this particular job. Then we’re able to train people to model that behavior as their learning process.
The company claimed automotive manufacturing clients in Japan had reported decreases in visual inspection errors after implementing eye tracking into their processes. Bartel noted that this covered creating both the set of best practices and implementing them directly into how workers were trained on the line. Another important feature of these automotive studies was to cut down the time it takes to train a worker. In one particular study their goal was to cut back training time for a specific function from six to four weeks.
Bartel offered more detail on how the eye tracking data could be adapted into a behaviour model: “We like to have an objective performance metric on quality, so we are able to do a secondary inspection of the car an determine how many errors, things missed, there were in the initial inspection. We can then go back to the eye tracking data and see the visual pattern of behaviour that is associated with this substandard performance. On the other side of this if we have the eye tracking data from someone who has done a very good inspection (no errors) in a reasonable time frame we can look at their visual strategy. The revue process involves looking back at the eye tracking video, which shows everywhere they look in real-time, plus quantifying that using an attention matrix; what is the optimal length of time to spend viewing elements of the car.”
Staying focused on the job
Another example offered was with US aluminium casting company H&H, Bartel noted that the eye tracking data revealed that when spillage occurred the eye movement’s of the workers involved were unfocussed and sporadic, they hadn’t taken the time to still eye, head and body movements in order to focus fully on the task. “We took this data and implemented it into the company’s training procedures and took the video of the pours involving spillage to show new employees what it looks like when a mistake is made,” he added.
“It’s not as simple as just showing a trainee a video then expecting them to be experts, there’s much more to it. There are other factors involved such as cognitive processing and motor behaviour, also characteristics that people develop over time as they are doing a particular job, so the visual behaviour is just one piece. However, it is a very important piece. In addition to capturing the eye tracking data we will also play back the video to the expert subject and have them narrate their experience, talking through everything they are doing, offering explanations of why they doing something in a certain way and how to avoid errors. This is our way of layering the visual attention data with the cognitive processing piece,” explained Bartel.