@simonSimon Willison have you experienced scenarios where asking a model to reason *degrades* performance?

recently, i’ve found myself enjoying being closer to the “metal”, and getting more mileage out of appropriately scoping my requests, rather than asking reasoning models to go the distance for me.

i’m wondering if the hidden tokens are making context fall away, and that creates the perception of performance degradation for me.

0

If you have a fediverse account, you can quote this note from your own instance. Search https://mastodon.social/users/austinha/statuses/114135045004594975 on your instance and quote it. (Note that quoting is not supported in Mastodon.)