Visualizing the tiny motions in a video
Mit released a research paper last year July that shows the studies conducted, on visualizing the small tiny motions over few seconds on a video and magnifying them to show the changes happening more obviously.
Let’s take an example of a baby breathing video, this could be video captured or real time motion video, MIT’s algorithm shows the changes in the baby (without someone touching it or hooking it to a device), to measure the changes and show them obviously. Seeing how a video changes frame by frame, any particular pixel on that frame changes. They apply more red color to that changed pixel so the overall frame is red in the portions that are changing, That’s how they measure and show the changes. They released the program as an open-source project.
In our heads it’s like a big world with small motions out there. We are excited to explore it and look at the world with this new microsope that lets visualizes the small changes and reveal them and it actually turns out to shows us all sorts of exciting things about the world.
– William T Freeman of MIT
He adds, “This is a picture of steve, we took it our algorithm, and it looks at each color, to make a spatial average of the color to very accurately measured what the color intensity is at every point. From that accurate measurement you can detect small variation with the pulse signal. So we measure those, we amplify them and add them back into the video to create a color magnified video of steve”.
In the picture shown frame by frame, you can see all sorts of things like, how fast his heart is beating based on the color changes on his face, the more red, its where the blood goes.
You can try out this tool online at http://videoscope.qrclab.com/
or try this code with matlab – http://people.csail.mit.edu/mrub/vidmag/