Weight-sparse transformers have interpretable circuits [pdf]
Link: https://cdn.openai.com/pdf/41df8f28-d4ef-43e9-aed2-823f9393e470/circuit-sparsity-paper.pdf
Discussion: https://news.ycombinator.com/item?id=45926371
Weight-sparse transformers have interpretable circuits [pdf]
Link: https://cdn.openai.com/pdf/41df8f28-d4ef-43e9-aed2-823f9393e470/circuit-sparsity-paper.pdf
Discussion: https://news.ycombinator.com/item?id=45926371
If you have a fediverse account, you can quote this note from your own instance. Search https://social.lansky.name/users/hn50/statuses/115594514039883456 on your instance and quote it. (Note that quoting is not supported in Mastodon.)