I've been saying for a while that our inability to measure or value these models' lack of a viewpoint/theory-of-own-mind/rich internal goal and value structure will be the shoals a lot of the more "creative" outputs break on.
RE: https://bsky.app/profile/did:plc:565ebob5f6hw33hjdkxty6qj/post/3mbwem6vjbs2u
The value-destroying potential...
If you have a fediverse account, you can quote this note from your own instance. Search https://bsky.brid.gy/convert/ap/at://did:plc:tbig7qnx4o5ylp5v23w577vl/app.bsky.feed.post/3mbweygpzpc2j on your instance and quote it. (Note that quoting is not supported in Mastodon.)