Post A863KJsXqUxJA00Ie8 by 6r1d@fosstodon.org
(DIR) More posts by 6r1d@fosstodon.org
(DIR) Post #A863KJsXqUxJA00Ie8 by 6r1d@fosstodon.org
2021-06-09T02:29:43Z
0 likes, 0 repeats
Great news! EleutherAI's GPT-J-6B, a 6 billion parameter model trained on the Pile dataset is released.It is kinda similar to OpenAI's curie API. It is, afaik, Apache-licensed. In any case, have a look!Web Demo: https://6b.eleuther.ai/Blog post: https://arankomatsuzaki.wordpress.com/2021/06/04/gpt-j/
(DIR) Post #A863KKKu93dmZxGwqm by alexbuzzbee@fosstodon.org
2021-06-09T03:25:05Z
0 likes, 0 repeats
@6r1d Astonishing results. Still not good at fact checking or high-level consistency, but it does very, very well at writing convincing body copy.
(DIR) Post #A86hDZ9qdWKqgeQpBQ by 6r1d@fosstodon.org
2021-06-09T10:51:59Z
0 likes, 0 repeats
@alexbuzzbee And it's not the last GPT EleutherAI will train!For your context, the prompt might be extended with details, it's not very different from making a good original GPT-3 prompt.People are actively experimenting with those in GPT-j channel of EleutherAI Discord.