AI to parse/summarize a video?

High-Performance Computing Machine Learning, LLMs, & AI
1

Are there any LLMs that are capable of taking an entire video/audio file and creating a synopsis and timeline?

Use Case: I don’t have time to watch the local town hall meetings, and 90% of the topics discussed are of zero interest to me. I’d like to be able to create a timeline and a summary so that I can reference only the parts of the video I am actually interested in.

2

As my knowledge there is no LLM specifically designed for the automatically generate the synopsis and timeline for the entire video and audio.

3

You could use openai whisper to transcribe the video with timestamps. You might then be able to find something else that can sumerise it but atleast it would be searchable.

2 Likes