Pretraining Language Models via Neural Cellular Automata
Link: https://hanseungwook.github.io/blog/nca-pre-pre-training/
Discussion: https://news.ycombinator.com/item?id=47388293
Pretraining Language Models via Neural Cellular Automata
Link: https://hanseungwook.github.io/blog/nca-pre-pre-training/
Discussion: https://news.ycombinator.com/item?id=47388293
If you have a fediverse account, you can quote this note from your own instance. Search https://social.lansky.name/users/hn50/statuses/116256630858447490 on your instance and quote it. (Note that quoting is not supported in Mastodon.)