Methods for Machine Vision Based Driver Monitoring Applications: Dissertation

Research output: ThesisDissertationCollection of Articles

2 Citations (Scopus)

Abstract

An increasing number of information and driver-assistive facilities-such as PDAs, mobile phones, and navigators-are a feature of today's road vehicles. Unfortunately, they occupy a vital part of the driver's attention and may overload him or her in critical moments when the driving situation requires full concentration. The automotive industry has shown a growing interest in capturing the driver's behaviour due to the necessity of adapting the vehicle's Human-Machine Interface (HMI), for example, by scheduling the information flow or providing warning messages when the driver's level of alertness degrades. The ultimate aim is to improve traffic safety and the comfort of the driving experience. The scope of this thesis is to investigate the feasibility of techniques and methods, previously examined within the industry, for monitoring the driver's momentary distraction state and level of vigilance during a driving task. The study does not penetrate deeply into the fundamentals of the proposed methods but rather provides a multidisciplinary review by adopting new aspects and innovative approaches to state-of-art monitoring applications for adapting them to an in-vehicle environment. The hypotheses of this thesis states that detecting the level of distraction and/or fatigue of a driver can be performed by means of a set of image processing methods, enabling eye-based measurements to be fused with other safety-monitoring indicators such as lane-keeping performance or steering activity. The thesis includes five original publications that have proposed or examined image processing methods in industrial applications, as well as two experiment-based studies related to distraction detection in a heavy goods vehicle (HGV), complemented with some initial results from implementation in a passenger car. The test experiments of the proposed methods are mainly described in the original publications. Therefore, the objective of the introduction section is to generate an overall picture of how the proposed methods can be successfully incorporated and what advantages they offer to driver-monitoring applications. The study begins by introducing the scope of this work, and continues by presenting data acquisition methods and image pre- and post-processing techniques for improving the quality of the input data. Furthermore, feature extraction from images and classification scheme for detecting the driver's state are outlined based in part on the author's own experiments. Finally, conclusions are drawn based on the results obtained.
Original languageEnglish
QualificationDoctor Degree
Awarding Institution
  • Tampere University of Technology (TUT)
Supervisors/Advisors
  • Tuokko, Reijo, Supervisor, External person
Award date8 Dec 2006
Place of PublicationEspoo
Publisher
Print ISBNs951-38-6875-3
Electronic ISBNs951-38-6876-1
Publication statusPublished - 2006
MoE publication typeG5 Doctoral dissertation (article)

Fingerprint

Computer vision
Monitoring
Image processing
Experiments
Personal digital assistants
Passenger cars
Processing
Mobile phones
Automotive industry
Industrial applications
Feature extraction
Data acquisition
Scheduling
Fatigue of materials
Industry

Keywords

  • driver monitoring
  • machine vision
  • distraction
  • fatigue
  • wavelets
  • SVM
  • neural networks
  • classification
  • cameras
  • traffic safety
  • vehicles
  • sensors
  • colour vision
  • alertness
  • gaze
  • eyes
  • head
  • workload
  • traffic safety and vigilance

Cite this

Kutila, M. (2006). Methods for Machine Vision Based Driver Monitoring Applications: Dissertation. Espoo: VTT Technical Research Centre of Finland.
Kutila, Matti. / Methods for Machine Vision Based Driver Monitoring Applications : Dissertation. Espoo : VTT Technical Research Centre of Finland, 2006. 159 p.
@phdthesis{963d824277f745dbb6d0526e4a3be329,
title = "Methods for Machine Vision Based Driver Monitoring Applications: Dissertation",
abstract = "An increasing number of information and driver-assistive facilities-such as PDAs, mobile phones, and navigators-are a feature of today's road vehicles. Unfortunately, they occupy a vital part of the driver's attention and may overload him or her in critical moments when the driving situation requires full concentration. The automotive industry has shown a growing interest in capturing the driver's behaviour due to the necessity of adapting the vehicle's Human-Machine Interface (HMI), for example, by scheduling the information flow or providing warning messages when the driver's level of alertness degrades. The ultimate aim is to improve traffic safety and the comfort of the driving experience. The scope of this thesis is to investigate the feasibility of techniques and methods, previously examined within the industry, for monitoring the driver's momentary distraction state and level of vigilance during a driving task. The study does not penetrate deeply into the fundamentals of the proposed methods but rather provides a multidisciplinary review by adopting new aspects and innovative approaches to state-of-art monitoring applications for adapting them to an in-vehicle environment. The hypotheses of this thesis states that detecting the level of distraction and/or fatigue of a driver can be performed by means of a set of image processing methods, enabling eye-based measurements to be fused with other safety-monitoring indicators such as lane-keeping performance or steering activity. The thesis includes five original publications that have proposed or examined image processing methods in industrial applications, as well as two experiment-based studies related to distraction detection in a heavy goods vehicle (HGV), complemented with some initial results from implementation in a passenger car. The test experiments of the proposed methods are mainly described in the original publications. Therefore, the objective of the introduction section is to generate an overall picture of how the proposed methods can be successfully incorporated and what advantages they offer to driver-monitoring applications. The study begins by introducing the scope of this work, and continues by presenting data acquisition methods and image pre- and post-processing techniques for improving the quality of the input data. Furthermore, feature extraction from images and classification scheme for detecting the driver's state are outlined based in part on the author's own experiments. Finally, conclusions are drawn based on the results obtained.",
keywords = "driver monitoring, machine vision, distraction, fatigue, wavelets, SVM, neural networks, classification, cameras, traffic safety, vehicles, sensors, colour vision, alertness, gaze, eyes, head, workload, traffic safety and vigilance",
author = "Matti Kutila",
note = "Project code: 612",
year = "2006",
language = "English",
isbn = "951-38-6875-3",
series = "VTT Publications",
publisher = "VTT Technical Research Centre of Finland",
number = "621",
address = "Finland",
school = "Tampere University of Technology (TUT)",

}

Kutila, M 2006, 'Methods for Machine Vision Based Driver Monitoring Applications: Dissertation', Doctor Degree, Tampere University of Technology (TUT), Espoo.

Methods for Machine Vision Based Driver Monitoring Applications : Dissertation. / Kutila, Matti.

Espoo : VTT Technical Research Centre of Finland, 2006. 159 p.

Research output: ThesisDissertationCollection of Articles

TY - THES

T1 - Methods for Machine Vision Based Driver Monitoring Applications

T2 - Dissertation

AU - Kutila, Matti

N1 - Project code: 612

PY - 2006

Y1 - 2006

N2 - An increasing number of information and driver-assistive facilities-such as PDAs, mobile phones, and navigators-are a feature of today's road vehicles. Unfortunately, they occupy a vital part of the driver's attention and may overload him or her in critical moments when the driving situation requires full concentration. The automotive industry has shown a growing interest in capturing the driver's behaviour due to the necessity of adapting the vehicle's Human-Machine Interface (HMI), for example, by scheduling the information flow or providing warning messages when the driver's level of alertness degrades. The ultimate aim is to improve traffic safety and the comfort of the driving experience. The scope of this thesis is to investigate the feasibility of techniques and methods, previously examined within the industry, for monitoring the driver's momentary distraction state and level of vigilance during a driving task. The study does not penetrate deeply into the fundamentals of the proposed methods but rather provides a multidisciplinary review by adopting new aspects and innovative approaches to state-of-art monitoring applications for adapting them to an in-vehicle environment. The hypotheses of this thesis states that detecting the level of distraction and/or fatigue of a driver can be performed by means of a set of image processing methods, enabling eye-based measurements to be fused with other safety-monitoring indicators such as lane-keeping performance or steering activity. The thesis includes five original publications that have proposed or examined image processing methods in industrial applications, as well as two experiment-based studies related to distraction detection in a heavy goods vehicle (HGV), complemented with some initial results from implementation in a passenger car. The test experiments of the proposed methods are mainly described in the original publications. Therefore, the objective of the introduction section is to generate an overall picture of how the proposed methods can be successfully incorporated and what advantages they offer to driver-monitoring applications. The study begins by introducing the scope of this work, and continues by presenting data acquisition methods and image pre- and post-processing techniques for improving the quality of the input data. Furthermore, feature extraction from images and classification scheme for detecting the driver's state are outlined based in part on the author's own experiments. Finally, conclusions are drawn based on the results obtained.

AB - An increasing number of information and driver-assistive facilities-such as PDAs, mobile phones, and navigators-are a feature of today's road vehicles. Unfortunately, they occupy a vital part of the driver's attention and may overload him or her in critical moments when the driving situation requires full concentration. The automotive industry has shown a growing interest in capturing the driver's behaviour due to the necessity of adapting the vehicle's Human-Machine Interface (HMI), for example, by scheduling the information flow or providing warning messages when the driver's level of alertness degrades. The ultimate aim is to improve traffic safety and the comfort of the driving experience. The scope of this thesis is to investigate the feasibility of techniques and methods, previously examined within the industry, for monitoring the driver's momentary distraction state and level of vigilance during a driving task. The study does not penetrate deeply into the fundamentals of the proposed methods but rather provides a multidisciplinary review by adopting new aspects and innovative approaches to state-of-art monitoring applications for adapting them to an in-vehicle environment. The hypotheses of this thesis states that detecting the level of distraction and/or fatigue of a driver can be performed by means of a set of image processing methods, enabling eye-based measurements to be fused with other safety-monitoring indicators such as lane-keeping performance or steering activity. The thesis includes five original publications that have proposed or examined image processing methods in industrial applications, as well as two experiment-based studies related to distraction detection in a heavy goods vehicle (HGV), complemented with some initial results from implementation in a passenger car. The test experiments of the proposed methods are mainly described in the original publications. Therefore, the objective of the introduction section is to generate an overall picture of how the proposed methods can be successfully incorporated and what advantages they offer to driver-monitoring applications. The study begins by introducing the scope of this work, and continues by presenting data acquisition methods and image pre- and post-processing techniques for improving the quality of the input data. Furthermore, feature extraction from images and classification scheme for detecting the driver's state are outlined based in part on the author's own experiments. Finally, conclusions are drawn based on the results obtained.

KW - driver monitoring

KW - machine vision

KW - distraction

KW - fatigue

KW - wavelets

KW - SVM

KW - neural networks

KW - classification

KW - cameras

KW - traffic safety

KW - vehicles

KW - sensors

KW - colour vision

KW - alertness

KW - gaze

KW - eyes

KW - head

KW - workload

KW - traffic safety and vigilance

M3 - Dissertation

SN - 951-38-6875-3

T3 - VTT Publications

PB - VTT Technical Research Centre of Finland

CY - Espoo

ER -

Kutila M. Methods for Machine Vision Based Driver Monitoring Applications: Dissertation. Espoo: VTT Technical Research Centre of Finland, 2006. 159 p.