Why DeepSeek is cheap at scale but expensive to run locally
Link: https://www.seangoedecke.com/inference-batching-and-deepseek/
Discussion: https://news.ycombinator.com/item?id=44149238
Why DeepSeek is cheap at scale but expensive to run locally
Link: https://www.seangoedecke.com/inference-batching-and-deepseek/
Discussion: https://news.ycombinator.com/item?id=44149238
If you have a fediverse account, you can quote this note from your own instance. Search https://social.lansky.name/users/hn100/statuses/114608623422858340 on your instance and quote it. (Note that quoting is not supported in Mastodon.)