Right-sizes LLM models to your system's RAM, CPU, and GPU
Link: https://github.com/AlexsJones/llmfit
Discussion: https://news.ycombinator.com/item?id=47211830
Right-sizes LLM models to your system's RAM, CPU, and GPU
Link: https://github.com/AlexsJones/llmfit
Discussion: https://news.ycombinator.com/item?id=47211830
If you have a fediverse account, you can quote this note from your own instance. Search https://social.lansky.name/users/hn100/statuses/116158385962702846 on your instance and quote it. (Note that quoting is not supported in Mastodon.)