Training LLMs to work on cpus. 2x better than Nvidia?

Hardware CPU
1

Watched a video on sparsity in LLMs which allows you to run them on cpus.

I’m interested to see a new way of doing things and an evolution in the tech.

I didn’t understand this fully but it was fascinating

I wonder if this might allow anyone with most any hardware to run a LLM.

1 Like
2

Interesting video and good channel. Thanks for sharing.

I do wish she’d not do that thing where the video camera keeps jumping back and forth in size which a lot of YT’s do to try and make their video “dynamic”. The sort of person who can watch a video on Sparsity in LLMs this really doesn’t need that. :wink:

But good video!

1 Like