[HN Gopher] Solving Math Word Problems
       ___________________________________________________________________
        
       Solving Math Word Problems
        
       Author : yigitdemirag
       Score  : 34 points
       Date   : 2021-10-29 18:56 UTC (4 hours ago)
        
 (HTM) web link (openai.com)
 (TXT) w3m dump (openai.com)
        
       | powera wrote:
       | Scoring 55% on a test like this should not be considered a great
       | accomplishment. A sign of progress, yes, but not an
       | accomplishment by itself.
       | 
       | This is still simply a system that is good at _guessing_. It does
       | not _know_ anything.
        
         | ur-whale wrote:
         | > It does not know anything.
         | 
         | I would argue that it "knows" an awful lot, but it can't
         | actually reason with it.
         | 
         | However impressive GPT3 type models are, I am not particularly
         | convinced that they're much more than glorified hashtables.
         | 
         | If the hash table is large enough, it can produce lot of
         | answers to a lot of questions, or approximately imitate a lot
         | of stuff it's seen before.
         | 
         | Whether it can actually combine "knowledge" it has stored in
         | its weights into a pattern it's never seen before ... I'm not
         | convinced.
        
           | Der_Einzige wrote:
           | Re: "Glorified Hastable"
           | 
           | There is a 1-1 correspondence between data compression and
           | generative models. GPT-2 is a highly effective loseless data
           | compression tool: https://bellard.org/textsynth/sms.html
           | 
           | Always wondered why this insight is not taught as much,
           | especially in the context of things like dimensionality
           | reduction...
        
       | howeyc wrote:
       | > Richard, Jerry, and Robert are going to share 60 cherries. If
       | Robert has 30 cherries, and has 10 more than Richard, how many
       | more cherries does Robert have than Jerry?
       | 
       | > answer:
       | 
       | > Robert has 30 + 10 = 40 cherries.
       | 
       | > If there are 60 cherries to be shared, then Richard and Jerry
       | will have 60 - 40 = 20 cherries each.
       | 
       | > Robert has 40 - 20 = 20 more cherries than Jerry.
       | 
       | Um, the answer is "correct" but isn't the actual reasoning wrong?
       | 
       | Robert has 30
       | 
       | Richard has 20
       | 
       | Jerry has 10
       | 
       | Hence they split the 60 this way.
        
         | Jensson wrote:
         | Looks like it randomly applies operations and reasonings rather
         | than read the text. This sentence for example makes no sense
         | and shows this AI has no understanding of numbers whatsoever,
         | not even first grade level understanding:
         | 
         | > If there are 60 cherries to be shared, then Richard and Jerry
         | will have 60 - 40 = 20 cherries each.
        
         | dragontamer wrote:
         | This is some "Sideways stories from Wayside School" logic here.
         | (https://wayside-school.fandom.com/wiki/Joe_(book_chapter))
         | 
         | > This doesn't make any sense. When I count the wrong way I get
         | the right answer, and when I count right I get the wrong
         | answer.
         | 
         | ---------
         | 
         | The other story this reminds me of is Abbot and Costello's "7 x
         | 13 == 28" skit.
        
       | [deleted]
        
       ___________________________________________________________________
       (page generated 2021-10-29 23:01 UTC)