I’ve tooted about open models probably not being a way out of knowledge capture in the past few days. This article is an excellent deep dive into the issues. And it has sources!
- High end hardware available to consumers is not usually sufficient to run the models without severe compromises
- With the death of quality open data, advancing models requires larger and larger piles of money and hardware. And it’s not clear how the open community would ever close this gap.
If you have a fediverse account, you can quote this note from your own instance. Search https://mastodon.social/users/colincornaby/statuses/116036284640249670 on your instance and quote it. (Note that quoting is not supported in Mastodon.)