Post AboONUGaDsCPOf9sRM by pamelafox@fosstodon.org
(DIR) More posts by pamelafox@fosstodon.org
(DIR) Post #AboONUGaDsCPOf9sRM by pamelafox@fosstodon.org
2023-11-14T22:25:58Z
0 likes, 0 repeats
@simon Also, am debating whether to packagify the RAG evaluation CLIs I'm building, trying to figure out how generically useful they'd be beyond our sample app. Could you see them being useful for your stuff? (The first one's just a datatable so probably not, but the question/answer comparer maybe?)
(DIR) Post #AboONV3VHzKZqO2wgy by simon@fedi.simonwillison.net
2023-11-14T22:55:23Z
0 likes, 0 repeats
@pamelafox Is that using Textual? It's really nice!Given how sparse resources on running evaluations are I think anything you release would be of interest to all sorts of people - even if they don't actively use the code the patterns it embodies would be fascinating for people to explore
(DIR) Post #AboPpfVo6bS2KwHTtY by pamelafox@fosstodon.org
2023-11-14T23:13:51Z
0 likes, 0 repeats
@simon Yeah good point, half the point of packaging something is just to make it easier to discover the idea of it. And yep with Textual, my first time playing with it, I'm still flabbergasted that you can make CLI apps work like that.