Just yesterday I came across this video: https://youtu.be/tO6sfku_1b8
At first I did not quite get what was going on until I realized they were using the minecraft sheep as pixels on a display.
In that moment I discovered a rabbit hole that started its formation over a decade ago. I had no idea what touhou was (and still don’t really) but I was floored by some of the amazing stuff I saw.
For those like me who had no idea what the music video being played on the sheep was, here it is: https://www.youtube.com/watch?v=FtutLA63Cp8
This video turns out to be very nice for demos because it only has 2 colours: white and black.
This makes it ideal for displaying it in unexpected places like factorio (one of my favourite games), desmos, minecraft bookshelves, mechanical switches, the advent of code day 10 simulation (wow that happened really quick) , as a slice of a volume, as a fourier series!!, hand drawn risc-v cpu 
, minesweeper, and more like atari systems, gameboy, and oscilliscopes… It never ends
I’m not sure if it’s been done before but I figure I might as well try it, and make a flipbook in minecraft for this apparently famous music video.
With that, I will set a few milestones (I have not decided which order I want to complete these in yet):
[
] generate a book and flip through it with an autoclicker (probably xdotool)
- the book will probably have to be loaded as a datapack/mcfunction for the 6000+ pages/frames needed
- there likely is an existing tool to do this, but I want to make my own. If I find an existing tool I can use it as a proof of concept for this milestone
write an mcfunction to automatically flip through the book
write my own program (probably rust, maybe python if it gets too complicated) to convert video frames to pages in a minecraft book
- can probably use ffmpeg to convert frames to pictures, then some other program (opencv?) to convert the pictures to text
- ideally, make get this program to interface with ffmpeg and do all that automatically
bonus: generate a music disc or note block thing to play the music at the same time as the video plays
