Neural Mechanisms of Attentional Alteration to Multisensory Speech Perception

Project Title

Neural Mechanisms of Attentional Alteration to Multisensory Speech Perception

Faculty Mentor(s)

Project Description

Even when talking to someone in a crowded or noisy setting, we can understand what they are saying. Our research is basically looking at how we deal with all that sensory noise. Specifically, we are exploring when and how feature-based attention or the lack thereof influences multisensory integration, using techniques such as psychophysics, eye-tracking, and electroencephalography (EEG).

In a noisy environment, it is difficult to understand what the speaker is saying but being able to see the speaker's mouth makes it easier. The noisier the environment, the more helpful it is to see the speaker's mouth. This is due to multisensory integration, the process by which information from multiple sensory modalities, in this case audition and vision, is integrated into a unified perception. Past research has shown that multisensory integration is modulated by attention at several levels of sensory processing. However, the neural basis of attentional effects on multisensory integration is not well understood. The purpose of our research is to understand how and when in sensory processing attention influences multisensory integration. Attentional processing and multisensory integration are affected in Parkinson’s, schizophrenia, and ADHD. Hence, our research can help correlate the attentional deficits with the perpetual challenges experienced by individuals with these disorders.

Why is your research important?

Attentional processing and multisensory integration are affected in several neuropsychological disorders, including Parkinson’s, schizophrenia, and ADHD. Our research is important because the relationship between attention and multisensory integration remains unclear and understanding the neural mechanisms underlying this interaction will help us correlate the attentional deficits with the perceptual challenges faced by individuals with these disorders.

What does the process of doing your research look like

Our research involves developing stimuli and coding the experiment using different software applications. We also spend a lot of our time working with Eye-Tracking and Electroencephalography (EEG), which are among our primary data-collection tools. This year, we finished collecting data for our preliminary study and will be inviting participants to our lab for further data collection over the fall semester. We will soon begin our EEG training which I am very excited for!

In what ways have you showcased your research thus far?

Throughout the academic year, we had the privilege of presenting our research at multiple events, including the Oberlin College Undergraduate Research Symposium in the spring semester, the Summer Undergraduate Research Symposium this summer, and the Midwest/Great Lakes Undergraduate Research Symposium in neuroscience (mGluRs). These enriching experiences not only allowed us to share our findings but also provided invaluable opportunities to receive feedback from experts in the field and establish meaningful connections with fellow researchers.

What is your favorite aspect of the research process?

What I find most captivating about research is the pursuit of knowledge in uncharted territory. The process of exploring unanswered questions and uncovering new insights in a systematic and methodical manner is deeply fascinating and fulfilling. The intellectual challenge and the potential to make meaningful contributions to the field are what drive my passion for research.

How has the research you’ve conducted contributed to your professional or academic development?

As an someone aspiring to pursue an MD-PhD, joining the Kwakye lab has been an invaluable experience. Not only have I acquired essential technical skills, but also honed my interpersonal abilities through interactions with participants. This opportunity has facilitated significant growth, enabling me to thrive as a researcher and more.

What advice would you give to a younger student wanting to get involved in research in your field?

I would suggest the students interested in research to proactively reach out to professors and fellow students involved in research! When I was exploring research opportunities in the neuroscience department, I connected with several professors to learn about their ongoing research projects. Among them, I found Leslie’s research particularly interesting. After expressing my interest, she kindly suggested that I apply to the summer research program, which led to an amazing opportunity to work in her lab. I have been in her lab ever since and it has been an incredibly rewarding experience!