US spends $11M to kick-start video search technology

DARPA wants to be about to scan through thousands of hours of video in minutes

The US military is inundated with video from airborne unmanned aircraft, remote monitoring systems and security outposts. In an effort to speed up the processing and analyzing  of all this video, researchers at Defense Advanced Research Projects Agency (DARPA) this week awarded an almost $11 million contract to open source software vendor Kitware to help develop what DARPA calls its Video and Image Retrieval and Analysis Tool (VIRAT) program.

According to DARPA, the software tools developed under VIRAT will radically improve the analysis of huge volumes of video data by: alerting operators when specific events or activities occur at specific locations or over a range of locations and; enabling fast, content-based searches of existing video archives. DARPA said it is looking for innovative algorithms for activity representation, matching and recognition which can support both indexing and retrieval.

Inside the bad-ass world of military research projects

The ability to quickly search large volumes of existing video data and monitor real-time video data for specific activities or events will provide a dramatic new capability to the US military and intelligence agencies. Currently, video analysis for unmanned Predator and other aerial video surveillance platforms is very labor intensive, and limited to metadata queries, manual annotations, and "fastforward" examination of clips, DARPA stated.    

Current search and retrieval methods must rely upon time and location data associated with the video, and any sparse annotations that might have been made during previous viewings. The videos must be manually reviewed, using normal fast forward and reverse controls, to try and find the activities and objects of interest. This process is so laborious and tools non-existent that very few archived videos are ever reviewed. Video libraries are currently being built to store and give worldwide access to the video and motion imagery data being captured today, DARPA stated.

 At the same time, the dynamics of an urban insurgency have resulted in a rapid increase in the number of activities visible in the video field of view. For current operations, the solution has been to assign more analysts to watch the same real-time video stream simultaneously. Each analyst is assigned a separate portion of the video and is given a list of activities and objects to be on the watch for. If any of the given activities or objects are spotted, the analyst issues an alert to the proper authorities. However, video or motion imagery analysts are a scarce resource within the military and intelligence communities, DARPA stated.

The the goal of VIRAT ultimately is to be able to search in minutes across a video repository containing thousands of hours of video data. The probability of detection must be high to ensure that all potential matches to activities of interest are found. Minimizing false alarms is also important, but can be mitigated by using relevance ranking techniques similar to online text searches, DARPA stated.

Kitware and others have gotten DARPA money in the past to do preliminary work on the system. The current w is expected to be completed by February 2012. 

 Follow Michael Cooney on Twitter: nwwlayer8  

 Layer 8 Extra

Check out these other hot stories:

Researchers build mysterious 'Quantum Cats' from light

NASA helps two commercial spacecraft blast off

DARPA takes aim at insider threats

NASA Kepler spacecraft spots 2 new planets crossing same star

NSF awards $20M to jazz up university research networks

IBM: Cybersecurity problems are hitting record levels

Open source tools at heart of DARPA's virtual satellite network

Philadelphia not showing any brotherly blogger love: City wants $300 license fee

Tool takes aim at ad attacks

NASA universe-watching satellite losing its cool

Group wants to protect privacy as electronic toll systems grow

Do we need a Federal law for electronics recycling?

NASA's head techie seeks brightest systems engineers of the future

Join the Network World communities on Facebook and LinkedIn to comment on topics that are top of mind.
Related:
Take IDG’s 2020 IT Salary Survey: You’ll provide important data and have a chance to win $500.