- 10 Hot Big Data Startups to Watch
- 11 Unique Uses for Google Glass, Demonstrated by Celebs
- How to Export Your Google Reader Account
- How to Better Engage Millennials (and Why They Aren't Really so Different)
Network World - Everywhere you go these days -- every store, every urban street, every car park, every ATM -- there are video cameras watching where you go and what you do. Just what are "they" (whoever "they" are) doing with all of that video surveillance?
Consider the Fraunhofer Institute's platform-independent development kit called SHORE, which stands for " Sophisticated High-speed Object Recognition Engine." This software can recognize faces presented full-frontal with 91.5% accuracy, can determine gender with an accuracy of 94.3%, estimate age with a mean absolute error of 6.85 years, and do all of that in realtime.
[ SCIENCE NONFICTION: Will future surveillance include global 'pre-crime' machine spying on everyone? ]
SHORE can also recognize facial expressions ("Happy," "Surprised," "Angry" and "Sad"), identify faces whether recognized or not, and it has a short-term memory for recognized faces to support tracking within a scene.
Some years ago I was in London -- in Harrods to be precise -- going up an escalator, and lining the walls were flat-panel displays showing ads. I started thinking about what could be done by placing a small camera beside each display and making a video of the people passing.
Using SHORE to process the video would enable us to figure out if customers were looking at the ads and which ads they paid the most attention to. This would be based not just on whether they looked at the ads, but for how long and if their eyes tracked the ads. Ideally, we'd also want to detect and measure pupil-size changes, which is known to correlate with interest level.
We could possibly even measure customers' heart and breathing rates visually as they looked at the ads. A friend of mine, Christopher Small, recently told me about a video processing technique called Eulerian Video Magnification he's been working on at Quanta Research Cambridge that amplifies microscopic movements. He's made an online demonstration of this available called Videoscope ... in particular, check out the "face" and "wrist" examples.
So, armed with all of this data about customers and their responses to ads, we'd then know which ads worked best for which demographic dimensions and, if we were processing the video in realtime, we could show ads to each customer individually that were an order of magnitude more effective because they would be tailored to what we determined their unique demographic profile to be. And, over time, using A/B testing, we could continuously refine our targeting ability.
To go further we could use full-blown facial recognition and then, when we identified someone who we had already seen and who we had characterized, we could deliver even more effective ads to them.
And how about analyzing how people navigate around a store? Store layout matters, as I'm sure you've noticed in stores that don't physically work well.