Perceptual and semantic representations at encoding contribute to true and false recognition of objects

Loris Naspi, Paul Hoffman, Barry Devereux, Alexa Morcom

Research output: Contribution to journalArticlepeer-review

Abstract

When encoding new episodic memories, visual and semantic processing are proposed to make distinct contributions to accurate memory and memory distortions. Here, we used functional magnetic resonance imaging (fMRI) and preregistered representational similarity analysis (RSA) to uncover the representations that predict true and false recognition of unfamiliar objects. Two semantic models captured coarse-grained taxonomic categories and specific object features, respectively, while two perceptual models embodied low-level visual properties. Twenty-eight female and male participants encoded images of objects during fMRI scanning, and later had to discriminate studied objects from similar lures and novel objects in a recognition memory test. Both perceptual and semantic models predicted true memory. When studied objects were later identified correctly, neural patterns corresponded to low-level visual representations of these object images in the early visual cortex, lingual, and fusiform gyri. In a similar fashion, alignment of neural patterns with fine-grained semantic feature representations in the fusiform gyrus also predicted true recognition. However, emphasis on coarser taxonomic representations predicted forgetting more anteriorly in the anterior ventral temporal cortex, left inferior frontal gyrus and, in an exploratory analysis, left perirhinal cortex. In contrast, false recognition of similar lure objects was associated with weaker visual analysis posteriorly in early visual and left occipitotemporal cortex. The results implicate multiple perceptual and semantic representations in successful memory encoding and suggest that fine-grained semantic as well as visual analysis contributes to accurate later recognition, while processing visual image detail is critical for avoiding false recognition errors.
Original languageEnglish
Article numberJN-RM-0677-21
Pages (from-to)8375-8389
JournalJournal of Neuroscience
Volume41
Issue number40
Early online date19 Aug 2021
DOIs
Publication statusPublished - 6 Oct 2021

Keywords

  • episodic memory
  • false memory
  • fMRI
  • memory encoding
  • recognition memory
  • representational similarity analysis

Fingerprint

Dive into the research topics of 'Perceptual and semantic representations at encoding contribute to true and false recognition of objects'. Together they form a unique fingerprint.

Cite this