[HN Gopher] CodeTF: One-Stop Transformer Library for State-of-th...
___________________________________________________________________
CodeTF: One-Stop Transformer Library for State-of-the-Art Code LLM
Author : pabo
Score : 11 points
Date : 2023-06-07 21:34 UTC (1 hours ago)
(HTM) web link (arxiv.org)
(TXT) w3m dump (arxiv.org)
| Flux159 wrote:
| Link to the github repo: https://github.com/salesforce/CodeTF
|
| It would be helpful to see some Colab notebook examples of how I
| could use this or incorporate my own codebase with these open
| source coding models.
|
| The examples show some smaller interesting prediction task &
| translation between csharp and java, but probably easier to try
| it out in Colab than having to install locally.
|
| I would also want to be able to compare Github Copilot's
| autocomplete with what CodeT5 would return as a prediction.
| rektide wrote:
| Im hacking some really dumb code this week & just tried to get
| StarCoder.cpp to give me some help, but I don't have any idea how
| to prompt it to work with code I already have.
|
| I was really surprised that all the HuggingFace stuff needed an
| account. I didn't have any faith my data would stay local, I
| didn't understand what that was all for. Which sucks a bit
| because StarCoder seems to have a fairly friendly vscode
| extension, Im just too scared to use it.
|
| I think maybe the trick is to just write code comments & ask for
| help in them? The vscode extension seems to just upload the file,
| wrapping everything before your cursor in {start token}/* your
| code here */{end token}.
|
| I'm obviously a total newb here, but new a little tiny bit about
| LLM, how they are tokenizing systems. It still stuns me a bit
| seeing that these systems absolutely have the most minimal
| ability to capture context/hints from the rest of the project,
| from typescript definitions.
___________________________________________________________________
(page generated 2023-06-07 23:00 UTC)