[HN Gopher] CodeTF: One-Stop Transformer Library for State-of-th...
       ___________________________________________________________________
        
       CodeTF: One-Stop Transformer Library for State-of-the-Art Code LLM
        
       Author : pabo
       Score  : 11 points
       Date   : 2023-06-07 21:34 UTC (1 hours ago)
        
 (HTM) web link (arxiv.org)
 (TXT) w3m dump (arxiv.org)
        
       | Flux159 wrote:
       | Link to the github repo: https://github.com/salesforce/CodeTF
       | 
       | It would be helpful to see some Colab notebook examples of how I
       | could use this or incorporate my own codebase with these open
       | source coding models.
       | 
       | The examples show some smaller interesting prediction task &
       | translation between csharp and java, but probably easier to try
       | it out in Colab than having to install locally.
       | 
       | I would also want to be able to compare Github Copilot's
       | autocomplete with what CodeT5 would return as a prediction.
        
       | rektide wrote:
       | Im hacking some really dumb code this week & just tried to get
       | StarCoder.cpp to give me some help, but I don't have any idea how
       | to prompt it to work with code I already have.
       | 
       | I was really surprised that all the HuggingFace stuff needed an
       | account. I didn't have any faith my data would stay local, I
       | didn't understand what that was all for. Which sucks a bit
       | because StarCoder seems to have a fairly friendly vscode
       | extension, Im just too scared to use it.
       | 
       | I think maybe the trick is to just write code comments & ask for
       | help in them? The vscode extension seems to just upload the file,
       | wrapping everything before your cursor in {start token}/* your
       | code here */{end token}.
       | 
       | I'm obviously a total newb here, but new a little tiny bit about
       | LLM, how they are tokenizing systems. It still stuns me a bit
       | seeing that these systems absolutely have the most minimal
       | ability to capture context/hints from the rest of the project,
       | from typescript definitions.
        
       ___________________________________________________________________
       (page generated 2023-06-07 23:00 UTC)