leighelse{} @leighelse@mastodon.nz
Public

AI = Accidentally Inaccurate

An artificial intelligence note-taker has been rolled out to Emergency Departments in Aotearoa New Zealand.

rnz.co.nz/news/national/588244

Talking with an ED doctor on Wednesday, he said that in his experience the tool is not sufficiently accurate to rely on, particularly when dealing with Kiwi accents. A specific concern was the transcription of values and units; 20 mls can become 20 kilos. For now, he uses it solely for dictating his reports. He feels that using it to do more could risk patient safety.

AI scribe tool being used in emergency departments

AI is becoming a useful tool, but often cannot not be used to its full extent because of outdated IT systems, a doctors' union rep said.

www.rnz.co.nz · RNZ

0
0
1

If you have a fediverse account, you can quote this note from your own instance. Search https://mastodon.nz/users/leighelse/statuses/116149727745113480 on your instance and quote it. (Note that quoting is not supported in Mastodon.)

Adrianna Tan @skinnylatte@hachyderm.io
Public

RE: mastodon.nz/@leighelse/1161497

I worked on a large scale project testing medical transcription. (Maybe one of the largest ones) Hundreds of doctors reviewed the output and called out the issues.

It was not, and still is not, ready. Public health teams that roll this out without red teaming and remediation and feedback and a way to influence the weights of models are irresponsible.

0
0
0