News/Research

Dongho Shin on Digital Systems Generating Mnemonics

11 Aug, 2023

Dongho Shin on Digital Systems Generating Mnemonics

We're thrilled to support our students in their summer research. Read about Dongho Shin's project to develop digital systems capable of generating mnemonics—strategies that enhance memory retention, such as creating wordplay, narratives, and visuals below!

The primary objective of this project is to develop digital systems capable of generating mnemonics—strategies that enhance memory retention, such as creating wordplay, narratives, and visuals. The core focus lies in testing the effectiveness of these systems in improving users' memory. To carry out this study, participants will be randomly assigned to one of four experimental groups. Through a web interface, they will be presented with 30 German words and tasked with memorizing them within a 30-minute timeframe.

My primary goal for the summer research plan is to establish a more accessible and engaging approach for individuals to connect with the realm of painting. This will be achieved by blending traditional painting techniques with contemporary technology, aiming to create innovative and captivating methods for people to interact with art. As I combine conventional art methods with modern techniques, my fascination has been particularly ignited by Generative AI and Large Language Models (LLMs).

The recent emergence of various generative AI software like Midjourney and Dali, coupled with improved accessibility, has democratized digital art and made it accessible to a wider audience. During my research at the MIT Media Lab, where I explored Psychology, Neuroscience, and Mnemonics, I began to contemplate the intersection of art with memory enhancement and learning. Concurrently, the widespread integration of LLM-based AI technology in daily life has redefined our lifestyle, education, and media consumption. AI has evolved into a new form of media, transitioning from being optional to becoming nearly indispensable. By adeptly integrating this burgeoning technology with our existing resources, I am convinced that significant synergy can be achieved.

Moreover, I've come to acknowledge the limited opportunities for BIPOC, LGBTQ+, Global South, differently-abled individuals, and socioeconomically disadvantaged communities to access language-learning programs. This realization has spurred me to ponder how I can provide them with an incredibly accessible, cost-effective, and user-friendly avenue for language acquisition. My team and I are actively considering the most effective approach to realize this goal, with the intention of documenting our insights in a CHI paper.

Looking ahead, my aspirations extend to delving into research aimed at enhancing memory and creating innovative mnemonic tools within a more immersive virtual space, seamlessly integrated with the VR experience. Notably, the outcomes of my research indicate that personalized mnemonic aids significantly enhance memory retention. By applying this concept to VR, I hold the belief that I can fashion a more effective and imaginative environment for memorization, presented in an enjoyable and captivating manner.

Through the development of novel tools, environments, and experiences, my aim is to break down the barriers that deter people from engaging with the world of art. Ultimately, my vision is to inspire a new generation of artists and enthusiasts.