Friday, September 23, 2011

Experts use magnetic scanner to see videos 'playing' inside people's brains


Scientists have created a revolutionary brain imaging process which allows them to 'see' moving images inside people's minds. As the test subjects think of a video, the researchers 'see' it on screen.
It's the most astonishing demonstration of 'mind reading' technology ever demonstrated.
The academics from the University of California, Berkeley, managed to decipher brain activity by measuring blood flow through the brain's visual cortex, and used this information to construct images of what they were 'thinking'. 


Sample: Subjects were shown footage from Hollywood film trailers, in this case Steve Martin in the Pink Panther 2
Sample: Subjects were shown footage from Hollywood film trailers, in this case Steve Martin in the Pink Panther 2

Result: After brain activity was analysed, this is the reconstructed image produced based on the trailer viewed
Result: After brain activity was analysed, this is the reconstructed image produced based on the trailer viewed
They then converted this information into visual patterns after feeding it through a computer, in a process which scientists say 'opens a window into the movie of our minds'.
As yet, the technology can only recognise and reconstruct movie clips shown to the test subjects before they braved the scanner.
However, the breakthrough paves the way for reproducing the movies inside our heads that no one else sees, such as dreams and memories, according to researchers.
Professor Jack Gallant, a UC Berkeley neuroscientist, said: 'This is a major leap toward reconstructing internal imagery.'
More example footage from the trailer of a nature documentary shows elephants walking across a desert land
More example footage from the trailer of a nature documentary shows elephants walking across a desert land

The remarkable reconstructed clip replicates the shapes and forms of the trailer from the mind's eye
The remarkable reconstructed clip replicates the shapes and forms of the trailer from the mind's eye
It is hoped the remarkable process could eventually be used to understand the minds of those who cannot communicate verbally, such as stroke victims and coma patients.
Experts warned though that it is likely to be decades before the technology is advanced enough to read peoples' thoughts and intentions
Previously, Gallant and fellow researchers recorded brain activity in the visual cortex while a subject viewed black-and-white photographs.
They then built a computational model that enabled them to predict with overwhelming accuracy which picture the subject was looking at.
In their latest experiment, researchers say they have solved a much more difficult problem by actually decoding brain signals generated by moving pictures.

'Opens a window into the movies of our minds'
Test subjects watched two separate sets of Hollywood movie trailers, while an MRI scanner was used to measure blood flow through the visual cortex, the part of the brain that processes visual information.
On the computer, the brain was divided into small, three-dimensional cubes - a computer-imaging term known as volumetric pixels, or 'voxels.'
Shinji Nishimoto, one of the scientists involved in the procedure, said: 'We built a model for each voxel that describes how shape and motion information in the movie is mapped into brain activity.'
The brain activity recorded while subjects viewed clips was fed into a computer program that learned, second by second, to associate visual patterns in a particular film with the corresponding brain activity.
Breakthrough: The revolutionary technology uses MRI scans to analyse blood flow to the brain and eventually convert the information back into Hollywood trailers
Breakthrough: The revolutionary technology uses MRI scans to analyse blood flow to the brain and eventually convert the information back into Hollywood trailers
The computer was then 'fed' information so that it could construct its own 'versions' of the trailers the subjects were watching - without using the original material. This was done by feeding 18 million seconds of random YouTube videos into the computer program.
The computer then cross-refefenced the two sets of data - and the subjects were shown an entirely new set of film trailers.
The 100 YouTube clips that the computer program decided were most similar to the trailer the subject was watching were merged, creating a blurry, but recognisable image of what was 'happening' inside their minds.

No comments:

Post a Comment