Depends on what model you want to run?
New Lemmy User, be nice! Old enough to have played with the OG Masters of the Universe.
- 0 Posts
- 2 Comments
Joined 25 days ago
Cake day: February 13th, 2025
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
Use API credits. 64GB can barely run a 70B model. I have a MacBook Pro M3 Max with 128GB and can run those and even slightly bigger models. But results are underwhelming. Not bought for LLM only, but if I would have, I would be disappointed.