Just beware that like AMD, Intel GPUs suffer a performance hit when using LLMs because of the CUDA specific optimizations in frameworks like llama.cpp
- 0 Posts
- 4 Comments
Joined 2 years ago
Cake day: August 10th, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
+1 for quadlet. It’s another file format to learn, but it’s worth it, particularly if you want your containers to auto-update. Also check out podlet to help mitigate some of the compose to .container issues.
Why would we PUNish you?
Do you have any tips (or examples) using quadlets? I tried using them but I couldn’t wrap my head around them.