Post ASV1sFblUqwgUpq42a by vik@mastodon.nzoss.nz
 (DIR) More posts by vik@mastodon.nzoss.nz
 (DIR) Post #ASS7b5BV0yy9Uns0o4 by vik@mastodon.nzoss.nz
       2023-02-08T00:18:27Z
       
       0 likes, 0 repeats
       
       OK, I've stretched ChatGPT as far as it'll go. It selectively forgets to conserve resources, eventually forgetting the data it was supposed to be working on. More artificial Amnesia than Intelligence. However, I did learn what I wanted to do from ChatGPT, in a "Rubber Ducky Debugging" kind of way.
       
 (DIR) Post #ASUV6OUFz7nbbISm7k by neil@mastodon.nz
       2023-02-09T03:51:22Z
       
       0 likes, 0 repeats
       
       @vik I don’t think it can keep a memory of the ongoing conversation that is longer than about 4000 tokens, so I think #ChatGPT  does use some sort of embeddings or something to selectively remember only some stuff in the “distant” past in the conversation.
       
 (DIR) Post #ASV1sFblUqwgUpq42a by vik@mastodon.nzoss.nz
       2023-02-09T09:58:38Z
       
       0 likes, 0 repeats
       
       @neil Sounds about right. However, it can write 'C' that achieves its processing tasks, and you can break those down into modules and APIs...