A Virtual Cinematographer for Presenter Tracking in 4K Lecture Videos

Fitzhenry, Charles and Hahn, Maximillian and Khatieb, Tanweer and Marais, Patrick and Marquard, Stephen (2017) A Virtual Cinematographer for Presenter Tracking in 4K Lecture Videos, CS17-01-00, Department of Computer Science, University of Cape Town.

[img] PDF
A_virtual_cinematographer_for_presenter_tracking_in_4K_lecture_videos_-_Tech_Report.pdf

Download (621kB)

Abstract

Lecture recording has become an important part of the provision of accessible tertiary education and having good autonomous recording and processing systems is necessary to make it feasible. In this work, we develop and evaluate a video processing framework that uses 4K video to track the lecturer and frame him/her in a way that simulates a human camera operator. We also investigate general issues pertaining to blackboard usage and its influence on cinematography decisions. We found that post-processing produced better tracking and framing results when compared to some real-time approaches. Furthermore, the entire pipeline can run on a commodity PC and will complete within the suggested time of 300% of the input video length. In fact, our testing showed that 60% of the total processing time can be ascribed to I/O operations. With the removal of redundant reads and writes, this proportion can be reduced. Finally, some algorithms can be remapped to parallel versions which will exploit multicore CPUs or GPUs if these are available.

Item Type: Technical report
Uncontrolled Keywords: Background Segmentation, Lecture Recording, Presenter Tracking, Virtual Cinematography
Subjects: Computing methodologies > Computer graphics > Image manipulation > Image processing
Applied computing > Computers in other domains
Applied computing
Date Deposited: 08 Sep 2017
Last Modified: 10 Oct 2019 15:31
URI: http://pubs.cs.uct.ac.za/id/eprint/1178

Actions (login required)

View Item View Item