CATLAB

category laboratory

Navigation Menu

Category Laboratory at Vanderbilt

supported by NSF, NEI, and Vanderbilt University

In the CatLab, we study visual cognition, including visual categorization, visual memory, and visual decision making. We study how objects are perceived and represented by the visual system, how visual knowledge is represented and learned, and how visual decisions are made. We approach these questions using a combination of behavioral experiments, cognitive neuroscience techniques, and computational and neural modeling. One line of work, funded by the National Science Foundation, investigates the temporal dynamics of visual object categorization and perceptual expertise for objects and faces. Another line of work, funded by the National Eye Institute, uses computational modeling of visual decision making to predict behavioral dynamics and neural dynamics.

News

Welcome Jin!

Posted on Sep 22, 2021

We welcomed Jinhyeok Jeong to the lab this Fall 2021. Jin received his bachelor’s degree in Psychology and master’s degree in Cognitive Science at Yonsei University. Under the supervision of Professor Sang Chul Chong, he studied ensemble perception, especially the variability perception of multiple visual items. As a graduate student at Vanderbilt, he is interested in the computational mechanisms of ensemble perception and how it relates to object categorization. Jinhyeok also has great interests in cognitive models of perception, memory, and decision-making processes, and how deep neural networks can be combined with these models. His current first year research project involves developing and testing computational models of ensemble processing and looking at relations with models of categorization, memory, and decision making.

Read More


Congratulations Claire!

Posted on Jun 12, 2021

Congratulations to Claire Hanson on graduating with Highest Honors in Neuroscience in May 2021.

Claire began working in the CatLab after being awarded a DSI-SRP fellowship for the summer of 2020. Her project, How the brain makes decisions: Modeling the dynamics of neurons that drive choice, became her senior honors thesis.

Claire’s DSI-SRP and honors project aimed to understand how the brain makes decisions. Historically, the canonical model of firing rates of decision-making neurons has been the accumulation of evidence model; accumulation of evidence is also the canonical model used to explain human and non-human primate decision-making behavior. This model assumes that neural activity gradually ramps up until a threshold is reached and then a decision is made. A relatively recent publication challenged this notion, introducing evidence for the possibility that an immediate transition in firing rates – a step rather than a ramp – is a better model to describe the dynamics of decision-making neurons when those dynamics are measured on a trial-to-trial basis rather than averaged across trials. The question of whether the firing rates of decision-making neurons are better characterized by ramping vs. stepping dynamics is foundational for our theoretical understanding how the brain makes decisions. Claire’s project involved conducting Monte Carlo simulations of model neurons with known dynamics and using a Bayesian statistical analysis program testing for ramping vs. stepping dynamics (an adaptation of same analysis program used by the authors who proposed stepping dynamics as the preferred model). These simulated model neurons included those with simple steps or with simple ramps, as well as the diffusion model of decision making and the leaky competing accumulator (LCA) model of decision making (both of which are members of the class of accumulator models); each of these models produced simulated spike trains across multiple trials that could be analyzed in the same way that real neural data is analyzed. Claire’s simulations have shown that while simple steps are classified as simple steps by the analysis program and that simple ramps are characterized as simple ramps by the analysis program, the more complex dynamics of the diffusion and LCA are actually characterized as steps by the analysis program. Even though models like the diffusion model and LCA are clearly accumulating evidence over time, the analysis program characterizes them as steps. While real neurons might look “step-like” on a trial-by-trial basis, the computations being performed by these neurons may still be best characterized as an accumulation of evidence over time.

Claire joined the NIH baccalaureate program in the summer of 2021 in the Section on Developmental Neurogenomics, where she will use computational techniques to better understand childhood-onset neuropsychiatric disorders. Claire then plans to go on to an MD-PhD program.

Read More


Welcome Simon!

Posted on Feb 13, 2021

We welcome Simon Lilburn to the CatLab, Vanderbilt, Nashville, and the United States as a new postdoctoral fellow. Simon comes from the land of sunny beaches, large marsupials, and disgustingly salty spreads which Australians pretend to like to fool foreigners. He received his Ph.D degree from the University of Melbourne investigating the dynamics of visual short-term memory in the Vision and Attention Lab under the supervision of Prof. Philip Smith and Dr David Sewell. His work has used a blend of traditional psychophysical experimentation with computational models of memory and decision-making to understand some of the fundamental limits on perception. His research centers on coupling intensive and individualized experiments with formal theories of basic cognitive processes with a particular emphasis on the link between perception (what we see, hear, feel) and action (what we do).

Read More


Vanderbilt University announces launch of new undergraduate data science minor

Posted on Jan 29, 2021

Vanderbilt University has announced the addition of an undergraduate minor in data science beginning with the fall 2021 term.

Driven by the growing interest on the part of the data science community at Vanderbilt for an undergraduate program in data science, the Data Science Minor Working Group was established in March 2020 by Provost and Vice Chancellor for Academic Affairs Susan R. Wente and the deans of the College of Arts and Science, Blair School of Music, Peabody College and School of Engineering to develop and propose a trans-institutional undergraduate minor in data science. Palmeri chaired the working group that developed and proposed the minor and will serve as Director of the minor.

Click below for a MyVU story:
https://news.vanderbilt.edu/2021/01/29/vanderbilt-university-announces-launch-of-new-data-science-minor-in-fall-2021/?utm_source=myvupreview&utm_medium=myvu_email&utm_campaign=myvupreview-2021-01-29

Click below for a Vanderbilt Hustler story:
https://vanderbilthustler.com/37760/featured/data-science-minor-to-be-offered-beginning-fall-2021/

Read More


Mike Mack Wins 2021 Randolph Blake Early Career Award

Posted on Oct 29, 2020

Congratulations to Mike for being the 2021 winner of the Randolph Blake Early Career Award from the program in Psychological Sciences at Vanderbilt. Mike is an alumnus of the CatLab. Mike came to Vanderbilt after earning a B.S. and M.S. in Computer Science from Michigan State, where he worked with Aude Oliva before she moved to MIT. After earning his PhD from our graduate program 2011, he went on to complete a postdoctoral fellowship at UT Austin with Alison Preston and Brad Love (continuing after Brad left for UCL). Since 2016 Mike has been an Assistant Professor of Psychology at the main campus of the University of Toronto.

The program in Psychological Sciences at Vanderbilt established The Randolph Blake Early Career Award to recognize exemplary alumni of our program in the early stages of their career. The recipient receives a plaque, a $500 award, and an invitation to give a research colloquium at Vanderbilt. This award honors Randolph Blake as a distinguished Vanderbilt alumnus, as an outstanding researcher and mentor, and as a former chair of the Department of Psychology who served in that role during some of the most important years of its growth.

Read More


Recruiting New Graduate Students For Fall 2021

Posted on Sep 2, 2020

I am looking to recruit new graduate students to join my lab in Fall 2021. Check the web pages for Psychological Sciences for details on our graduate program and how to apply for admission; doctoral students are provided five years (12 months per year) of guaranteed support (stipend, tuition, health insurance).

My laboratory currently focuses on two interrelated lines of research.

One line of work examines visual object recognition, categorization, and the development of perceptual expertise in humans using behavioral experiments (laboratory and online), computational modeling, and cognitive neuroscience techniques; some of this work has been in collaboration with Isabel Gauthier and her laboratory. Some of my current work uses a combination of cognitive models and deep learning convolutional neural network models.

The other line of work develops and tests cognitive and neural models of visual attention, selection, categorization, and decision making that explain the dynamics of behavior in human and monkeys, electrophysiology in humans and monkeys, and neurophysiology in monkeys; much of this work has been in collaboration with Jeffrey Schall and Gordon Logan.

Read More


Our NIH/NEI grant “Stochastic Models of Visual Decision Making and Visual Search” is Renewed

Posted on Sep 2, 2020

We just received the official award notice that our NIH/NEI grant R01 EY021833 Stochastic Models of Visual Decision Making and Visual Search has been renewed for $1,583,958 for four years.

Project Summary: Support is requested to advance an innovative, productive collaboration aimed at linking mind, brain, and behavior using performance, neurophysiological, and electrophysiological measures from monkeys and humans performing visual search and visual decision making tasks. The general goal is to derive the connections from spike trains in monkeys to behavior in humans using computational models that specify mental states mathematically, link them to brain states in particular neurons, and explain how the neural computations produces behavior. Our Gated Accumulator Model (GAM) assumes a stochastic accumulation of evidence to threshold for alternative responses. Model assessment involves quantitatively testing alternative model architectures on predictions of behavioral measures, response probabilities and distributions of correct and error response times, as well as neural measures and how these change with set size and target-distractor discriminability in previously collected data from monkeys performing visual search. While our previously funded research aimed to understand the architecture of evidence accumulation in GAM and the relationship of model accumulators to the observed dynamics of movement-related neurons in FEF, our newly proposed research aims to understand computationally the nature of the evidence that drives that accumulation and its relationship to the measured dynamics of visually-responsive neurons in FEF. Aim 1 compares the quality of salience evidence in lateralized EEG signals and neural discharges from visually-responsive neurons in monkeys performing visual search as input evidence to a network of stochastic accumulators to predict behavior. Aim 2 addresses a major challenge to the neural accumulator framework by determining whether movement neuron dynamics in FEF actually ramp or step. Aim 3 evaluates alternative architectures for an abstract Visual Attention Model (VAM) of the evidence driving accumulation to jointly predict observed behavior and the measured dynamics of visually-responsive neurons. Aim 4 extends VAM to more complex visual tasks involving filtering and selection. The result will be a broader and deeper understanding of the visual processes that select targets and control eye movements. Computational models like VAM and GAM may be at the “just right” level of abstraction. They capture essential details of the computation in ways that explain neural activity and behavior in single participants, whether monkey or human. These models can be used to understand normal behavior as well as illness, disability, and disease; the best-fitting parameters can characterize individual differences in behavior and provide markers for brain measures. These models can also inform neurological conditions that have a biophysical basis at the level of individual neurons and neural circuits, offering insight into what neurons and circuits compute and how they do it.

Read More


New Papers

Posted on Sep 2, 2020

Annis, J., Gauthier, I., & Palmeri, T.J. (in press). Combining convolutional neural networks and cognitive models to predict novel object recognition in humans. Journal of Experimental Psychology: Learning, Memory, and Cognition.

Carrigan, A.J., Magnussen, J., Georgiou, A., Curby, K.M., Palmeri, T.J., & Wiggins, M.W. (in press). Differentiating experience from cue utilization in radiological assessments. Human Factors.

Read More


Postdoctoral Fellowship in Model-based Cognitive Neuroscience at Vanderbilt

Posted on Aug 1, 2020

We eagerly seek postdoctoral fellows to join an ongoing collaboration between Thomas Palmeri, Jeffrey Schall, and Gordon Logan at Vanderbilt University using cognitive and neural models to understand visual cognition in humans and monkeys. Successful models predict details of observed behavior and are constrained by and predict neurophysiological, electrophysiological, or brain imaging data. 

Research facilities include several high-end laboratory workstations, computerized behavioral testing stations, a web-based server infrastructure for online experiments, two eye trackers, a shared 10,000+ core CPU cluster and large-scale GPU cluster at Vanderbilt’s ACCRE, state-of-the art facilities for neurophysiology, electrophysiology, and brain imaging, as well as ample office and research space. Postdoctoral fellows will also take advantage of the collaborative environment, facilities, and support in the Department of Psychology (www.vanderbilt.edu/psychological_sciences/) and the Vanderbilt Vision Research Center (vvrc.vanderbilt.edu). And as Dave Grohl of the Foo Fighters said, “Everybody now thinks that Nashville is the coolest city in America”.

Candidates can hold a Ph.D. in psychology, neuroscience, computer science, mathematics, engineering, or related disciplines. Candidates should have demonstrated skills in computer programming and statistical analyses. Some demonstrated experience with computational modeling is required. Some knowledge of vision science and neuroscience is desired but not required. Start date is negotiable, but preference will be given to candidates who can begin this fall or winter. Applications will be reviewed on a rolling basis as they arrive. Salary will be based on the NIH postdoctoral scale. 

Please forward to potential interested applicants.

Applicants should send a cover letter with a brief research statement, a current CV, and names and email addresses of three references to:
Thomas Palmeri
Department of Psychology
Vanderbilt Vision Research Center
Vanderbilt University
Nashville, TN 37240
thomas.j.palmeri@vanderbilt.edu  
catlab.psy.vanderbilt.edu  

Read More


Recent Papers

Posted on Jul 14, 2020

Middlebrooks, P.G., Zandbelt, B.B., Logan, G.D., Palmeri, T.J., Schall, J.D. (in press). Unification of countermanding and perceptual decision-making. iScience.

Mack, M.L., & Palmeri, T.J. (in press). Discrimination, recognition, and classification. To appear in M.J. Kahana & A. Wagner (Eds.), Handbook on Human Memory, Oxford University Press.

Benear, S., Sunday, M.A., Palmeri, T.J., & Gauthier, I. (in press). Can art change the way we see? Psychology of Aesthetics, Creativity, and the Arts.

Palmeri, T.J. (2019). On developing and testing cognitive models. Computational Brain & Behavioral.

Read More


Data Science Institute Welcomes DSI-SRP 2020 Fellows

Posted on Jun 2, 2020

The Vanderbilt Data Science Institute welcomed its second cohort of summer research fellows on June 1. The DSI Summer Research Program engages students who are interested in carrying out data science-related research with a Vanderbilt faculty member and integrates them into the institute’s community of data science scholars. This year the program is expanding its mission, as students will be required to dedicate at least 30 percent of their time working on COVID-19 related projects.

As Director of Undergraduate Research for the Data Science Institute, Thomas Palmeri oversees the DSI-SRP program.

Read More


National Endowment for the Arts Grant funded

Posted on May 19, 2019

Palmeri and Gauthier are collaborating with the Albright-Knox Art Gallery in Buffalo, New York, on a two-year project that recently earned a National Endowment for the Arts (NEA) Research: Art Works program award. The project is a scientific study testing whether visual art training can enhance visual perception and visual cognition skills. The Albright-Knox’s Innovation Lab has played a key role in bringing together leading experts in visual arts education, visual perception and visual cognition, and vision, and other collaborators include the Ontario College of Art and Design University and the State University of New York at Buffalo. The team of interdisciplinary partners seeks to combine an art-historical approach to understanding images with a scientific understanding of high-level vision. An arts training program, developed in consultation with OCAD U, will draw from existing museum programs and workshops, as well as basic principles taught in introductory visual studies and visual arts courses, in a series of lessons featuring artworks from the collection of the Albright-Knox. In collaboration with the museum, Vanderbilt will test the impact of the training program on visual perception and visual cognition. The team hopes to use the results of these tests to help shape a curriculum for enhancing high-level visual skills for people from all walks of life, establishing an even more vital role for the visual arts and arts organizations.

Vanderbilt neuroscientists, art museum collaborate on NEA-funded visual cognition research

Read More


Recent Papers

Posted on Feb 2, 2019

Servant, M., Tillman, G., Logan, G.D., Schall, J.D., & Palmeri, T.J. (in press). Neurally-constrained modeling of speed-accuracy tradeoff during visual search: Gated accumulation of modulated evidence. Journal of Neurophysiology.

Annis, J., Evans, N.J., Miller, B.J., & Palmeri, T.J. (in press). Thermodynamic integration and steppingstone sampling methods for estimating Bayes factors: A tutorial for psychologists. Journal of Mathematical Psychology.

Boehm, U., Annis, J., Frank, M.J., Hawkins, G.E., Heathcote, A., Kellen, D., Krypotos, A.-M., Lerche, V., Logan, G.D., Palmeri, T.J., Servant, M., Singmann, H., van Ravenzwaaij, D., Starns, J.J., Wiecki, T.V., Voss, A., Matzke, D., Wagenmakers, E.-J. (in press). Estimating between-trial variability parameters of the drift diffusion model: Expert advice and recommendations. Journal of Mathematical Psychology.

Annis, J., & Palmeri, T.J. (2018). Modeling memory dynamics in visual expertise. Journal of Experimental Psychology: Learning, Memory, and Cognition.

Ross, D.A., Tamber-Rosenau, B.J., Palmeri, T.J., Zhang, J.D., Xu, Y. & Gauthier, I. (2018). High resolution fMRI reveals configural processing of cars in right anterior Fusiform Face Area of car experts. Journal of Cognitive Neuroscience.

Read More


Welcome New Members to the CatLab

Posted on Jun 24, 2018

We welcome three new members to the CatLab this summer:

Greg Cox received his PhD from Indiana University in Psychological and Brain Sciences and Cognitive Science, where he worked with Rich Shiffrin. Greg completed a postdoctoral fellowship at Syracuse University and will be joining our lab as a postdoctoral fellow in July. He will be working with Palmeri, Logan, and Schall on model-based cognitive neuroscience. Greg is interested in the development of experimental techniques and mathematical/computational models that help us understand how neural and cognitive processes jointly unfold across time.

Craig Sanders is receiving his PhD from Indiana University in Psychological and Brain Sciences this summer, where he has been working with Rob Nosofsky. Craig will be joining our lab as a postdoctoral fellow next month. He will be working with Palmeri and Gauthier on project using cognitive and deep learning models to understand individual differences in visual cognition. Craig is broadly interested in combining machine learning (especially deep learning) with classic cognitive models to understand how people perceive, categorize, and mentally represent objects.

Jason Chow completed his undergraduate degree in May 2018 at the University of Toronto, he worked with CatLab alumnus, and now University of Toronto faculty member, Michael Mack on the development and validation of a printable 3D stimulus set for categorization experiments in visual and tactile modalities. As a PhD student at Vanderbilt, Jason will be working with Palmeri and Gauthier on combining computational modeling and neuroimaging to gain insights on perceptual expertise.

Read More