Hybrid Robotic/Virtual Pan-tilt-zom Cameras for Autonomous Event Recording

Peter Carr, Michael Mistry, Iain Matthews

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present a method to generate aesthetic video from a robotic camera by incorporating a virtual camera operating on a delay, and a hybrid controller which uses feedback from both the robotic and virtual cameras. Our strategy employs a robotic camera to follow a coarse region-of-interest identified by a realtime computer vision system, and then resamples the captured images to synthesize the video that would have been recorded along a smooth, aesthetic camera trajectory. The smooth motion trajectory is obtained by operating the virtual camera on a short delay so that perfect knowledge of immediate future events is known. Previous autonomous camera installations have employed either robotic cameras or stationary wide-angle cameras with subregion cropping. Robotic cameras track the subject using realtime sensor data, and regulate a smoothness-latency trade-off through control gains. Fixed cameras post-process the data and suffer significant reductions in image resolution when the subject moves freely over a large area.

Our approach provides a solution for broadcasting events from locations where camera operators cannot easily access. We can also offer broadcasters additional actuated camera angles without the overhead of additional human operators. Experiments on our prototype system for college basketball illustrate how our approach better mimics human operators compared to traditional robotic control approaches, while avoiding the loss in resolution that occurs from fixed camera system.
Original languageEnglish
Title of host publicationProceedings of the 21st ACM International Conference on Multimedia
Place of PublicationNew York, NY, USA
PublisherACM
Pages193-202
Number of pages10
ISBN (Print)978-1-4503-2404-5
DOIs
Publication statusPublished - 2013

Publication series

NameMM '13
PublisherACM

Fingerprint Dive into the research topics of 'Hybrid Robotic/Virtual Pan-tilt-zom Cameras for Autonomous Event Recording'. Together they form a unique fingerprint.

Cite this