Utilizing AI to know how the brain understands sentences
New research involving neuroimaging and A.I., describes the complex network within the brain that comprehends the meaning of a spoken sentence.

The study is an example of how the application of artificial neural networks, or A.I., is enabling researchers to unlock the extremely complex signaling in the brain that underlies functions such as processing language.

The researchers gather brain activity data from study participants who read sentences while undergoing fMRI. These scans showed activity in the brain spanning across a network of different regions—anterior and posterior temporal lobes, inferior parietal cortex, and inferior frontal cortex. Using the computational model InferSent—an A.I. model developed by Facebook trained to produce unified semantic representations of sentences—the researchers were able to predict patterns of fMRI activity reflecting the encoding of sentence meaning across those brain regions.

"It's the first time that we've applied this model to predict brain activity within these regions, and that provides new evidence that contextualized semantic representations are encoded throughout a distributed language network, rather than at a single site in the brain," said the investigators.

The research team believes the findings could be helpful in understanding clinical conditions. "We're deploying similar methods to try to understand how language comprehension breaks down in early Alzheimer's disease. We are also interested in moving the models forward to predict brain activity elicited as language is produced."

Journal of Neuroscience
Source: https://www.jneurosci.org/content/early/2021/03/22/JNEUROSCI.1152-20.2021