Post AZ4viCDSBMsC9ym0iu by mnot@techpolicy.social
(DIR) More posts by mnot@techpolicy.social
(DIR) Post #AZ4viCDSBMsC9ym0iu by mnot@techpolicy.social
2023-08-24T23:19:37Z
0 likes, 0 repeats
@simon so.. how long before llm supports Code Llama Python? :)
(DIR) Post #AZ4viD9ahDNT4HyRLE by mnot@techpolicy.social
2023-08-24T23:20:18Z
0 likes, 0 repeats
@simon (I assume the mlc project has to do something?)
(DIR) Post #AZ4viE0PWpd1i6gcfg by simon@fedi.simonwillison.net
2023-08-25T04:49:36Z
0 likes, 0 repeats
@mnot I filed an issue! https://github.com/mlc-ai/mlc-llm/issues/805
(DIR) Post #AZ4vumwRSmK1XNox8a by simon@fedi.simonwillison.net
2023-08-25T04:50:32Z
0 likes, 0 repeats
@mnot also tried with llama-cpp but it's not quite right yet https://github.com/simonw/llm-llama-cpp/issues/9
(DIR) Post #AZ5foRWAnaWRFNRiSG by simon@fedi.simonwillison.net
2023-08-25T13:26:25Z
0 likes, 0 repeats
@mnot I did get API access working to CodeLlama Instruct via llm-anyscale-endpoints https://github.com/simonw/llm-anyscale-endpoints/releases/tag/0.2