Computer Vision Researcher Develops Privacy Software for Surveillance Videos
Computer vision can be a valuable tool for anyone tasked with analyzing hours of footage because it can speed up the process of identifying individuals. For example, law enforcement may use it to perform a search for individuals with a simple query, such as “Locate anyone wearing a red scarf over the past 48 hours.”
With video surveillance becoming more and more ubiquitous, UCF Center for Research in Computer Vision (CRCV) Assistant Professor Yogesh Rawat, and his collaborators Mubarak Shah and Chen Chen, are working to address privacy issues with advanced software installed on video cameras. Their work is supported by $200,000 in funding from the U.S. National Science Foundation’s Accelerating Research Translation (NSF ART) program.
“Automation allows us to watch a lot of footage, which is not possible by humans,” Rawat says. “Surveillance is important for society, but there are always privacy concerns. This development will enable surveillance with privacy preservation.”
His video monitoring software protects the privacy of those recorded by obscuring select elements, such as faces or clothing, both in recordings and in real time. Rawat explains that his software adds perturbations to the RGB pixels in the video feed – the red, green and blue colors of light – so that human eyes are unable to recognize them.
“Mainly we are interested in any identifiable information that we can visually interpret,” Rawat says. “For example, for a person’s face, I can say ‘This is that individual,’ just by identifying the face. It could be the height as well, maybe hair color, hair style, body shape — all those things that can be used to identify any person. All of this is private information.”
Since Rawat aims to have the technology available in edge devices, devices that are not dependent on an outside server such as drones and public surveillance cameras, he and his team are also working on developing the technology so that it’s fast enough to analyze the feed as it is received. This poses the additional challenge of developing algorithms that can process the data in real-time, so that efficient graphics processing units (GPUs) and central processing units (CPUs) can handle the workload of analyzing footage as it is captured.
To that end, his main considerations in implementing the software are speed and size.
“We want to do this very efficiently and very quickly in real time,” Rawat says. “We don’t want to wait for a year, a month or days. We also don’t want to take a lot of computing power. We don’t have a lot of computing power in very small GPUs or very small CPUs. We are not working with large computers there, but very small devices.”
The funding from the NSF ART program will allow Rawat to identify potential users of the technology, including nursing homes, childcare centers and authorities using surveillance cameras. Rawat is one of two UCF researchers to have projects initially funded through the $6 million grant awarded to the university earlier this year. Four more projects will be funded over the next four years.
His work builds on several previous projects spearheaded by other CRCV members, including founder Mubarak Shah and researcher Chen Chen, including extensive work that allows analysis of untrimmed security videos, training artificial intelligence models to operate on a smaller scale and a patent on software that allows for the detection of multiple actions, persons and objects of interest. Funding sources for these works include $3.9 million from the IARPA Biometric Recognition and Identification at Altitude and Range program, $2.8 million from Intelligence Advanced Research Projects Activity (IARPA) Deep Intermodal Video Analysis, and $475,000 from the U.S Combating Terrorism Technical Support Office.
Rawat says his work in computer vision is motivated by a drive to improve our world.
“I’m really interested in understanding how we can easily navigate in this world as humans,” he says. “Visual perception is something I’m very interested in studying, including how we can bring it to machines and make things easy for us as humans and as a society.”
About the Researcher
Yogesh Rawat is an assistant professor at the Center for Research in Computer Vision at UCF. He earned his doctorate in computer science at the National University of Singapore and completed his postdoctoral training in the Center for Research in Computer Vision at UCF from 2017 to 2019. He obtained his bachelor’s degree in computer science and engineering from the Indian Institute of Technology in Varanasi in 2009.
Latest Science & Tech
- 2 Promising UCF Researchers Earn 2024 NSF CAREER AwardsEarly-career professors Fan Yao and Li Fang are receiving significant research funding to continue catalyzing their work as part of an annual NSF grant program.
- UCF Researcher Is Developing Algorithms to Further Space, Sea ExplorationThe work will help protect spacecrafts from colliding with objects like asteroids and satellites.
- UCF Student’s Primitive Asteroids Work Provides Context for Further Research, Future NASA MissionsBrittany Harvison studied the composition of families of ancient asteroids to better understand the history of our solar system and if they may have carried water to Earth.
- Robot Rovers on the “Moon”: Lunabotics Challenge Preps Students for Space CareersCollege teams, including a group of Knights, will build robot rovers and compete at the new Regolith Bin at UCF’s Exolith Lab before the best crews advance to finals at Kennedy Space Center.
- UCF Researcher’s Nanoparticles Serve as Pivotal Delivery Component of Promising Pediatric Cancer TreatmentA crucial molecular mixture created at UCF combines with an RNA-targeting therapy to potentially shrink an aggressive class of pediatric brain tumor.
- NASA Administrator Bill Nelson: UCF ‘Is America’s Space University’Nelson told UCF graduates that “there’s no moonshot beyond your reach.”