Brain-IT reconstructs viewed images from fMRI brain scans

Researchers at the Weizmann Institute built Brain-IT, an AI system that recreates what a person is looking at from fMRI scans. It outperformed ten other reconstruction methods on seven of eight similarity metrics and adapts to a new person with just one hour of scan data instead of 40.

• Brain-IT beat 10 reconstruction methods on 7 of 8 similarity metrics
• Adapting to a new person takes 1 hour of scans instead of 40
• Two neural networks separately predict layout and contents of the image
• Trained on 8 volunteers who each viewed about 9,000 photos