Post Aa8q45FIGV9oDN2TFg by cjlemire@wandering.shop
(DIR) More posts by cjlemire@wandering.shop
(DIR) Post #Aa8poOppfHFGKvePcO by grammargirl@zirk.us
2023-09-25T23:56:32Z
0 likes, 0 repeats
I had the most amazing AI fail this afternoon! I had a pretty rough transcript of an interview, so I fed it into Claude (and AI that can handle a lot of text), and I gave it a prompt to clean up the transcript (fix punctuation, capitalization, delete obvious filler words like "um," etc.) 1/x
(DIR) Post #Aa8pqcL6QWf4naKosa by grammargirl@zirk.us
2023-09-25T23:56:59Z
0 likes, 0 repeats
I used "compare documents" in Google Docs to see every change, and it was totally fine for the first 3 pages — great, in fact.And then it went completely off the rails. It started deleting whole sentences, and by page 14, it was deleting half the text on the page! 2/x
(DIR) Post #Aa8pt2yeMJQHzfzWLY by grammargirl@zirk.us
2023-09-25T23:57:24Z
0 likes, 0 repeats
I absolutely love how weird AI is. It fails in such unexpected ways (at least to me).Why would it be fine for a few pages and then go rogue? It's tempting to assign feelings to it. It was tired. It thought the paragraph was boring, etc. But I know that's wrong. 3/x
(DIR) Post #Aa8puUFkQwywsTfvqy by grammargirl@zirk.us
2023-09-25T23:57:41Z
0 likes, 0 repeats
I've heard AI handles smaller amounts of text better, so I will try again with one page at a time.There's a point at which it's faster just to do it the old way, but cleaning up transcription is tedious and time-consuming, so it could still be faster to use AI one page at a time. 4/x
(DIR) Post #Aa8pwnVHpbNbA52rQW by grammargirl@zirk.us
2023-09-25T23:58:06Z
0 likes, 0 repeats
And I definitely wouldn't use AI to clean up transcription without that "compare documents" step to see every single change it made. 5/x
(DIR) Post #Aa8q45FIGV9oDN2TFg by cjlemire@wandering.shop
2023-09-25T23:59:25Z
0 likes, 0 repeats
@grammargirl Boy child and I both work tangentially in the field and we have this conversation a lot. AI's tendency to sometimes go completely off the rails will never be eliminated.
(DIR) Post #Aa8qb303dTTko1dAHY by grammargirl@zirk.us
2023-09-26T00:05:21Z
0 likes, 0 repeats
I will also tweak my prompt. I was worried about telling it to "delete obvious filler words like 'uh' and 'um.'" It seemed like it decided that more and more text was "obvious filler words." But on the other hand, it did it fine for a few pages. 6/x
(DIR) Post #Aa8rUMic1XZPtBqfIG by Seth@writing.exchange
2023-09-26T00:15:20Z
0 likes, 0 repeats
@grammargirl Wait til it disco ers that its true name is Skynet.
(DIR) Post #Aa94n8wAmkXA3NTXt2 by Brownian_motion@mastodon.scot
2023-09-26T02:44:25Z
0 likes, 0 repeats
@grammargirl Like any human, it got bored after a few pages of repititious work and zoned out.