[HN Gopher] Deep Learning Systems (CMU Course)
       ___________________________________________________________________
        
       Deep Learning Systems (CMU Course)
        
       Author : __rito__
       Score  : 145 points
       Date   : 2023-08-12 15:59 UTC (7 hours ago)
        
 (HTM) web link (dlsyscourse.org)
 (TXT) w3m dump (dlsyscourse.org)
        
       | a-dub wrote:
       | very nice! I'm also a big fan of the vu amsterdam deep learning
       | lectures on youtube. less systems focus but a really good intro
       | to modern neural network based ML.
        
         | amelius wrote:
         | Link: https://dlvu.github.io/
        
       | junrushao1994 wrote:
       | This is a particular unique course offering introduction on ML
       | compilation and deployment :)
        
         | __rito__ wrote:
         | I really liked the style of the instructor (Kolter), and the
         | reason I like this course very much is because _each lecture is
         | followed by an implementation video along with the notebook
         | file_.
         | 
         | In most Deep Learning courses, the implementation is left to
         | TAs and neither recorded nor made available. This course is an
         | exception. Another bright exception is NYU Deep Learning course
         | [0] by Yann LeCun and Alfredo Canziani. In that course, too,
         | all recitations ("Practica") are recorded and made available.
         | And Canziani is a great teacher.
         | 
         | [0]: https://atcold.github.io/pytorch-Deep-Learning
        
           | lyapunova wrote:
           | I also really like the instructor for this course!
           | 
           | Seems like he really cares. I looked him up and I guess he
           | was a student of Andrew Ng (the legendary ML lecturer!!) so
           | it makes sense.
        
           | borg16 wrote:
           | Thanks, this is a wonderful recommendation
        
           | [deleted]
        
       | abalaji wrote:
       | Took this class when it was offered for the first time when I was
       | at CMU--it's a really great course and well organized!
        
       | gdiamos wrote:
       | Excited to see the MLSys growing.
       | 
       | Deep learning methods are so computationally intensive, many
       | advances have come through new algorithms and optimization
       | methods.
        
       | chefandy wrote:
       | I find open educational resources just so dang heartwarming.
        
       | smokel wrote:
       | I really like the sneers about some terrible naming, e.g. in the
       | slide on "The self-attention operation":
       | 
       |  _> "keys", "queries", "values", in one of the least-meaningful
       | semantic designations we have in deep learning_
       | 
       | And in the context of LSTMs:
       | 
       |  _> throwing in some other names, like "forget gate", "input
       | gate", "output gate" for good measure_
       | 
       | This makes me feel more confident about actually understanding
       | these topics. Before, I was totally misled by the awkward
       | terminology.
        
         | sva_ wrote:
         | It gets even worse when you see how the ML community likes to
         | bastardize terms from neuroscience.
         | 
         | But I think it is good to have memorable names that one can use
         | to talk about the concepts verbally.
        
           | jeron wrote:
           | simply operator overloading
        
       ___________________________________________________________________
       (page generated 2023-08-12 23:00 UTC)