Facebook AI
“If you’ve been sitting in an MRI, you’ve been hearing that buzzing sound it makes when it gathers data, Dr. Dan Sodickson, a researcher at NYU Langone Health, told Engadget, “it is the raw data from which a magnetic resonance image is derived… and that raw data actually looks like this fascinating starburst” (See above.) That k-space data is stored in temporary storage and once it’s full, the scan is complete and the data undergoes a Fourier transform to actually plot out the spatial frequency and generate an MRI image (below).
Facebook AI
“The MRI is gathering information across the whole image and then basically that frequency information is being turned into spatial information almost like with a prism,” Sodickson continued. “So if you take a prism and you separate out the colors, on the left is going to be all the blue, on the right is going to be all the red. That’s the transform we do… we take all the different frequencies and we sort them out. And when you do that — boom — out comes, your familiar image.”
But rather than wait for k-space to fill up, fastMRI only needs 25 percent of the data that traditional MRI machines would require to generate those same images (below). To be clear, this neural network isn’t analyzing existing MRI images at accelerated rates, it’s actively generating them from the raw data itself and they’re effectively identical to traditional scans.
Facebook AI
Facebook recruited six radiologists to examine two sets of MRI sequences of a patient’s knee, one from a traditional MRI, the other using fastMRI. “The study found there were no significant differences in the radiologists’ evaluations,” per a Facebook post on Tuesday. “Five of the six radiologists were not able to correctly discern which images were generated using AI.” Someone give that sixth radiologist a raise.
“We wanted to start with a large data set so we don’t end up overfitting,” Nafissa Yakubova, a researcher at Facebook AI, told Engadget. ”So we had, I think, thousands of MRI cases from the knee,” as well as a repository of MRI brain scans, each of which contained as many as 800 still images, to use in training the fastMRI model.
Not only will this system help alleviate the stress of people who might be squeamish about spending an hour in a coffin-sized cylinder that turns their hydrogen atoms into tiny radio transmitters, but it will also enable hospitals to serve more patients as well.
“Not every institution, every hospital, every country has an abundance of MRI machines so a lot of the time you have people waiting to get scanned,” Sodickson said. “I would like to reduce that burden.”
What’s more, the system works with existing MRI machines — there’s no need to retrofit anything because this is all just software, it can be installed like a DLC. “Because it’s open-sourced anybody, any manufacturer could have access to it right now and use it for further testing,” Yakubova said. Of course, device manufacturers will still have to receive FDA certification before implementing it.