AMIA 2024

This presentation will introduce video content summarization (VCS) and its real-world applications. We'll explore how artificial intelligence (AI), particularly large language models (LLMs) and large vision-language models (LVLMs), can be used to understand and summarize video content, and then we will show how pipelined approaches with proper pre- and post-processing elements can improve the results. Additionally, we'll cover the effectiveness of AI in video summarization and the challenges that remain. Our goal is to provide the audience with a broad understanding of VCS and how AI is transforming this field. We'll also showcase a practical implementation of VCS pipelines in the CLAMS project, an open-source AI-assisted metadata extraction platform developed via collaboration between Brandeis University and AAPB (GBH MLA).