Spatio-temporal error concealment techniques in scalable video coding

Master's Thesis

    Research output: ThesisMaster's thesisTheses

    Abstract

    Modern technology has made it possible to transfer real-time video to various mobile terminals in wireless networks. The same video can be streamed to low bit rate mobile phones with low quality as well as high bit rate televisions with extremely high quality. Scalable video coding has enabled adaptive video transmission, where several types of sub-streams can be decoded from a single encoded stream with the desired spatial, temporal and quality characteristics that are suitable for the specific applications. However, the wireless transmission environment is very error-prone compared to the wired systems. A propagation channel can cause bit inversions and the network load can eventually lead to packet losses. Since the strict real-time requirements usually rule out the possibility of re-transmission, the transmission errors can result in a situation where parts of a video stream are missing, which in turn can lead to poor video quality. This means that error protection and concealment techniques are needed. This master’s thesis studies the spatio-temporal error concealment techniques in scalable video coding focusing on the error resilience in the scalable video extension of the H.264/AVC video coding standard. A new error concealment technique is developed in this work, which utilises the correctly received spatial enhancement layer information if the corresponding base layer is missing. The purpose of this research is to study whether this new technique is worth using rather than the traditional techniques that were also implemented in this work. Unlike the new method, the traditional methods discard the corresponding enhancement layer data in the case when the base layer is missing. In addition, an extensive simulation environment was set up in order to compare these different methods. The simulation results indicate that enhancement layer utilisation provides better results in the case of a missing base layer than the traditional error concealment methods. It can also be seen that the new error concealment technique is suitable for video sequences containing both plenty of motion and a relatively static background.
    Original languageEnglish
    QualificationMaster Degree
    Awarding Institution
    • University of Oulu
    Place of PublicationOulu
    Publisher
    Publication statusPublished - 2009
    MoE publication typeG2 Master's thesis, polytechnic Master's thesis

    Fingerprint

    Scalable video coding
    Packet loss
    Television
    Image coding
    Mobile phones
    Wireless networks

    Keywords

    • H.264/AVC
    • SVC
    • error resilience
    • adaptive video

    Cite this

    @phdthesis{d3fe976100bf4b379f445fa817eb2a3b,
    title = "Spatio-temporal error concealment techniques in scalable video coding: Master's Thesis",
    abstract = "Modern technology has made it possible to transfer real-time video to various mobile terminals in wireless networks. The same video can be streamed to low bit rate mobile phones with low quality as well as high bit rate televisions with extremely high quality. Scalable video coding has enabled adaptive video transmission, where several types of sub-streams can be decoded from a single encoded stream with the desired spatial, temporal and quality characteristics that are suitable for the specific applications. However, the wireless transmission environment is very error-prone compared to the wired systems. A propagation channel can cause bit inversions and the network load can eventually lead to packet losses. Since the strict real-time requirements usually rule out the possibility of re-transmission, the transmission errors can result in a situation where parts of a video stream are missing, which in turn can lead to poor video quality. This means that error protection and concealment techniques are needed. This master’s thesis studies the spatio-temporal error concealment techniques in scalable video coding focusing on the error resilience in the scalable video extension of the H.264/AVC video coding standard. A new error concealment technique is developed in this work, which utilises the correctly received spatial enhancement layer information if the corresponding base layer is missing. The purpose of this research is to study whether this new technique is worth using rather than the traditional techniques that were also implemented in this work. Unlike the new method, the traditional methods discard the corresponding enhancement layer data in the case when the base layer is missing. In addition, an extensive simulation environment was set up in order to compare these different methods. The simulation results indicate that enhancement layer utilisation provides better results in the case of a missing base layer than the traditional error concealment methods. It can also be seen that the new error concealment technique is suitable for video sequences containing both plenty of motion and a relatively static background.",
    keywords = "H.264/AVC, SVC, error resilience, adaptive video",
    author = "Mikko Uitto",
    note = "CA2: TK803 University of Oulu ; Department of Electrical and Information Engineering",
    year = "2009",
    language = "English",
    publisher = "University of Oulu",
    address = "Finland",
    school = "University of Oulu",

    }

    Spatio-temporal error concealment techniques in scalable video coding : Master's Thesis. / Uitto, Mikko.

    Oulu : University of Oulu, 2009. 76 p.

    Research output: ThesisMaster's thesisTheses

    TY - THES

    T1 - Spatio-temporal error concealment techniques in scalable video coding

    T2 - Master's Thesis

    AU - Uitto, Mikko

    N1 - CA2: TK803 University of Oulu ; Department of Electrical and Information Engineering

    PY - 2009

    Y1 - 2009

    N2 - Modern technology has made it possible to transfer real-time video to various mobile terminals in wireless networks. The same video can be streamed to low bit rate mobile phones with low quality as well as high bit rate televisions with extremely high quality. Scalable video coding has enabled adaptive video transmission, where several types of sub-streams can be decoded from a single encoded stream with the desired spatial, temporal and quality characteristics that are suitable for the specific applications. However, the wireless transmission environment is very error-prone compared to the wired systems. A propagation channel can cause bit inversions and the network load can eventually lead to packet losses. Since the strict real-time requirements usually rule out the possibility of re-transmission, the transmission errors can result in a situation where parts of a video stream are missing, which in turn can lead to poor video quality. This means that error protection and concealment techniques are needed. This master’s thesis studies the spatio-temporal error concealment techniques in scalable video coding focusing on the error resilience in the scalable video extension of the H.264/AVC video coding standard. A new error concealment technique is developed in this work, which utilises the correctly received spatial enhancement layer information if the corresponding base layer is missing. The purpose of this research is to study whether this new technique is worth using rather than the traditional techniques that were also implemented in this work. Unlike the new method, the traditional methods discard the corresponding enhancement layer data in the case when the base layer is missing. In addition, an extensive simulation environment was set up in order to compare these different methods. The simulation results indicate that enhancement layer utilisation provides better results in the case of a missing base layer than the traditional error concealment methods. It can also be seen that the new error concealment technique is suitable for video sequences containing both plenty of motion and a relatively static background.

    AB - Modern technology has made it possible to transfer real-time video to various mobile terminals in wireless networks. The same video can be streamed to low bit rate mobile phones with low quality as well as high bit rate televisions with extremely high quality. Scalable video coding has enabled adaptive video transmission, where several types of sub-streams can be decoded from a single encoded stream with the desired spatial, temporal and quality characteristics that are suitable for the specific applications. However, the wireless transmission environment is very error-prone compared to the wired systems. A propagation channel can cause bit inversions and the network load can eventually lead to packet losses. Since the strict real-time requirements usually rule out the possibility of re-transmission, the transmission errors can result in a situation where parts of a video stream are missing, which in turn can lead to poor video quality. This means that error protection and concealment techniques are needed. This master’s thesis studies the spatio-temporal error concealment techniques in scalable video coding focusing on the error resilience in the scalable video extension of the H.264/AVC video coding standard. A new error concealment technique is developed in this work, which utilises the correctly received spatial enhancement layer information if the corresponding base layer is missing. The purpose of this research is to study whether this new technique is worth using rather than the traditional techniques that were also implemented in this work. Unlike the new method, the traditional methods discard the corresponding enhancement layer data in the case when the base layer is missing. In addition, an extensive simulation environment was set up in order to compare these different methods. The simulation results indicate that enhancement layer utilisation provides better results in the case of a missing base layer than the traditional error concealment methods. It can also be seen that the new error concealment technique is suitable for video sequences containing both plenty of motion and a relatively static background.

    KW - H.264/AVC

    KW - SVC

    KW - error resilience

    KW - adaptive video

    M3 - Master's thesis

    PB - University of Oulu

    CY - Oulu

    ER -