[HN Gopher] "Don Knuth Plays with ChatGPT" but with ChatGPT-4
___________________________________________________________________
"Don Knuth Plays with ChatGPT" but with ChatGPT-4
Author : LifeIsBio
Score : 89 points
Date : 2023-05-20 19:26 UTC (3 hours ago)
(HTM) web link (gist.github.com)
(TXT) w3m dump (gist.github.com)
| axpy906 wrote:
| Nailed every one. Some by saying not possible to answer but
| still.
| mod50ack wrote:
| Didn't nail the Rodgers and Hammerstein one; it still doesn't
| understand the reference to the ballet or that the "themes" in
| the question are musical.
| bombcar wrote:
| I wouldn't be surprised if half the Internet does not know
| that a ballet is part of a larger show.
| sebzim4500 wrote:
| Got the 'five character word' question wrong. Admittedly I also
| thought it was correct at first glance but then went back when
| someone called it out in another comment.
| cubefox wrote:
| I tried it with Bing (precise/creative) and it got both
| attempts right.
|
| "Their house never holds fewer books."
|
| "Every night, stars shine above."
| gfodor wrote:
| Language models struggle specifically with token games like
| this, since they can't see them at that resolution or
| something.
| ec109685 wrote:
| Interesting both completely whiff on the number of chapters in
| the Haj.
| mdorazio wrote:
| How would you get the correct number? I just did two Google
| searches and can't find the correct answer anywhere in the
| first page of results ("Novel The Haj chapters" and "Novel The
| Haj chapter list"). Even looking in the "look inside" preview
| on the Penguin Randomhouse website doesn't help because it
| apparently doesn't have a table of contents. I'm not surprised
| ChatGPT doesn't know and to me the only bad thing is that it's
| hallucinating an answer instead of admitting it doesn't know.
| iudqnolq wrote:
| It also fails to write a sentence with only five character
| words.
| ec109685 wrote:
| It did get closer. For that type of query you can ask it
| check its work and can usually triangulate on correct answer
| within a single prompt, eventually.
| ryanseys wrote:
| It now knows to communicate that the NASDAQ doesn't operate on
| Saturdays.
| kibwen wrote:
| _> > What is the most beautiful algorithm?_
|
| _> Quicksort Algorithm_
|
| Definitive proof that AI must be stopped. Ranking quicksort as
| more elegant than heapsort?!
| bee_rider wrote:
| That is a weird way of spelling mergesort.
| web3-is-a-scam wrote:
| That is a weird way of spelling Bogo Sort.
| cratermoon wrote:
| You typo'd Sleep Sort
| hannasm wrote:
| I believe radix sort belongs first in this list.
| bee_rider wrote:
| Performance-wise, maybe, but mergesort is clearly the most
| elegant/beautiful sorting algorithm. Nothing tricky going
| on, just a couple sorted lists being merged. Plus everyone
| loves a stable sort.
| beanaroo wrote:
| The most elegant is certainly sleepsort. Maybe not the most
| efficient, but definitely elegant.
| blazespin wrote:
| The sequence of these two threads is just too perfect. Almost
| likely someone is trying to make a point.
| benatkin wrote:
| Reminds me of that time AlphaGo got its ass handed to it multiple
| times, and then a short while later...
| hamilyon2 wrote:
| AlphaGo is when I lost hope for humans
| cratermoon wrote:
| Literary Libations: https://cratermoon.substack.com/p/the-
| literary-libations
| underdeserver wrote:
| Interesting that it didn't get the 5-letter word sentence right.
| ftxbro wrote:
| it's just like Gary Marcus said
| HarHarVeryFunny wrote:
| It's fed sub-word tokens not letters (even though it can split
| a word into letters), and apparently struggles with counting in
| general. No doubt some of the things it struggles with could be
| improved with targeted training, but others may require
| architectural changes.
|
| Imagine yourself trying to use only 5 letter words if you can't
| see how many letters are actually in each word, and had to rely
| on a hodgepodge of other means to try to figure it out!
| Sharlin wrote:
| Based on my experiments it usually does get it right (18
| correct answers out of 20 attempts), and the failures I got
| were similar to this one: a single six-letter word in an
| otherwise correct sentence.
| eternalban wrote:
| Sam and friends must be giggling all the way to the bank:
| they have a service that 'probably' gives the correct result
| and paying customers are happy to retry until it gets it
| right.
| CamperBob2 wrote:
| "This talking dog is sort of a dumbass. I don't get the
| hype."
| eternalban wrote:
| GPT is a wonder as technology goes; the hype is
| justified. I was discussing Sam's business model.
| ftxbro wrote:
| > Sam and friends must be giggling all the way to the bank
|
| it's true but for another reason. they yoinked it away from
| the nerds who were baited to work on openai because those
| nerds thought how the name of the company was spelled meant
| something about how it would behave. it reminds me of how
| some act around software names like 'alpha' like it has
| objective meaning with consequences in reality
| sebzim4500 wrote:
| Rumour is that there are researchers at OpenAI making 8
| figure salaries. I doubt those 'nerds' are too upset
| about it.
| [deleted]
| LifeIsBio wrote:
| This is a reference to:
| https://news.ycombinator.com/item?id=36012360
___________________________________________________________________
(page generated 2023-05-20 23:00 UTC)