Post B4csbBhpB8LC9i4xfc by davidrevoy@framapiaf.org
 (DIR) More posts by davidrevoy@framapiaf.org
 (DIR) Post #B4cfrbVRiqpTP3mprE by davidrevoy@framapiaf.org
       3 likes, 3 repeats
       
       The Local Alternative#webcomic #krita #miniFantasyTheater
       
 (DIR) Post #B4cgAubAxfeI7SfoTQ by ozzelot@mstdn.social
       0 likes, 0 repeats
       
       @davidrevoy And still unable to be decoupled from the fact that it was created by The Cabal Of The Evilest Wizards You Can Imagine, No, Eviler Than That
       
 (DIR) Post #B4cgf4REwSp3KAPHbk by LappenjammerDieZweite@vivaldi.net
       0 likes, 0 repeats
       
       @davidrevoy Is it an African or an European swallow?
       
 (DIR) Post #B4cgsB03rD9VRIwYcK by Minski@kinkycats.org
       0 likes, 0 repeats
       
       @davidrevoy 🥥 🥥
       
 (DIR) Post #B4chHuOKELHZSRYxNY by Arioch@framapiaf.org
       0 likes, 0 repeats
       
       @davidrevoy https://github.com/ggml-org/llama.cpp check this with the vulkan backend :blobwhistle:
       
 (DIR) Post #B4chce5K3KCUxuYwIi by davidrevoy@framapiaf.org
       0 likes, 0 repeats
       
       @susannelilith 🤣 Poor IE, long time dead, and still receiving nukes. (but deserved 🤭 ).
       
 (DIR) Post #B4ciJ2uw7Gzy90vGbo by cryptax@mastodon.social
       0 likes, 0 repeats
       
       @davidrevoy excellent !
       
 (DIR) Post #B4ciVmSYcJharlil3Q by gr4yweb@chaos.social
       0 likes, 0 repeats
       
       @davidrevoy I feel that, running fast-whisper and speech-to-phrase for HomeAssistant Voice locally. Superb Comic! 👌
       
 (DIR) Post #B4cihIIeZm1gnoZvkG by Zeugs@social.cologne
       0 likes, 0 repeats
       
       @davidrevoy Tuboquant may fix that problem
       
 (DIR) Post #B4cjNQ1yDsgawSrUNU by alxndr@tech.lgbt
       0 likes, 0 repeats
       
       Mom, @davidrevoy is being mean to AI bros again! Mooom!!!
       
 (DIR) Post #B4cjNQEjSQtVa2pgGm by davidrevoy@framapiaf.org
       0 likes, 0 repeats
       
       @alxndr 😆 💜
       
 (DIR) Post #B4cjQM3hRoD7UX4RLE by TopazRabbit@oldbytes.space
       0 likes, 0 repeats
       
       @davidrevoy 🦜 A...f...r...i...c...a...n... ...o...r... ...E...u...r...o...p...e...a...n...?
       
 (DIR) Post #B4cjQMDGsDrnyDY5GC by davidrevoy@framapiaf.org
       0 likes, 0 repeats
       
       @TopazRabbit 🤣 👍
       
 (DIR) Post #B4cjaajRkOJdtbTjQu by betelgeuse93@mastodon.uno
       0 likes, 0 repeats
       
       @davidrevoy like my rpi5 with a 3B model 🤣🤣🤣
       
 (DIR) Post #B4cjwdmv48LDkEcJ8K by VANTABlack2000@mastodon.gamedev.place
       0 likes, 0 repeats
       
       @davidrevoy Great Comic as usual. It's fun to see the story progress every week. Can't wait to see next week's where Pepper still isn't done./sarcasm
       
 (DIR) Post #B4ckHcAGITRyn5XJ0C by andersgo@oslo.town
       0 likes, 0 repeats
       
       @davidrevoy Self hosting is the way!
       
 (DIR) Post #B4ckR4ob8zuGFsunEO by jimmac@mastodon.social
       0 likes, 0 repeats
       
       @davidrevoy And that is exactly the big lie. The magic of brute force token jumping your way to a patch only works if you have gigawatts of Nvidia filled data center powered by methane jet engines. And nobody knows the actual cost of any of this. You try it locally and it's just making your m4 laptop, that normally churns Blender Cycles renders in seconds, crazy hot to touch and takes hours instead of seconds. It seems way less efficient than ... blockchain.
       
 (DIR) Post #B4ckWp84NR0jLMlN0S by ElectroFetish@mastodon.social
       0 likes, 0 repeats
       
       @davidrevoy Kiwix + Hotspot = profit and speed On any device, even the weakest one
       
 (DIR) Post #B4clMKCkbAyoUWVh6O by davidrevoy@framapiaf.org
       0 likes, 0 repeats
       
       @jimmac True, my local tests here were mostly with https://flathub.org/en/apps/com.jeffser.Alpaca (advantage of being easily removed and leave the computer clean after test). I tried few models available, but even on my workstation, I saw it was slow. Very educational to imagine how screaming some distant CPU and GPU must be on the servers of the AI compagnies, and how they make it totally invisible to the end users who are asking questions on their phone 'for the fun', not even questioning the (hidden) cost of it...
       
 (DIR) Post #B4cq8oE4gOIlJkVJE8 by orsinium@fosstodon.org
       0 likes, 0 repeats
       
       @davidrevoyMonty Python ❤️
       
 (DIR) Post #B4cqGAVuDTVoT6LzKS by milagemayvary@mstdn.social
       0 likes, 0 repeats
       
       @davidrevoy https://mstdn.social/@milagemayvary/116291424742312318RT: https://mstdn.social/users/milagemayvary/statuses/116291424742312318
       
 (DIR) Post #B4cs2s6jXPqTWjMo3U by gimulnautti@mastodon.green
       0 likes, 0 repeats
       
       @davidrevoy She needs to discover ternary magic 🤔
       
 (DIR) Post #B4cs5WbDxfgHgmtTLk by davidrevoy@framapiaf.org
       0 likes, 0 repeats
       
       @milagemayvary Thank you for the link! I'll watch it!
       
 (DIR) Post #B4csbBhpB8LC9i4xfc by davidrevoy@framapiaf.org
       0 likes, 0 repeats
       
       @ariarhythmic I think she is conflicted about it, she experienced many new possibilities with it (calling spells, discussing with tree spirits) and even if it always backfired on her, she is interested to keep experimenting. Her motivation (not really said here) is to get an Avian Intelligence that can rebuild her house without having to pay for premium for her AI Parrot. You check the last episode in order, I write them to shape a larger story: https://www.peppercarrot.com/en/webcomics/miniFantasyTheater__Avian-Intelligence.html
       
 (DIR) Post #B4ctPUhIqIB9XIp5No by KayOhtie@blimps.xyz
       0 likes, 0 repeats
       
       @davidrevoy @jimmac Yep. I tried, just to see, if running a smaller targeted model in something like Ollama would be any more interesting to use with Home Assistant than it's built-in parser system (which I've added to with my own automations).A _slight_ mis-hear of me setting a timer caused it to spew out some completely useless garbage on significant delay.Even making HA matches take priority, it'd still, using the very thing LLM's are _supposed_ to be good at, screw up interpretations. "is the fan on in the hallway?" and it'd say "I don't know about any fans in Home Assistant hallway" or something but the fan was very on, and very in the Hallway room (later trying the correct HA syntax answered exactly right VERY fast).I got rid of it. I'd rather be able to ramble at my speaker and say "Pizza pasta put it in your mouth" and it reply with "I'm not aware of any area called 'your mouth'" in 2 seconds or "Sorry, I didn't understand that" if I'm even more unintelligible (or just 'off' with my command), and only have the STT and TTS overheads on my GPU, than have the dice roller fuck up repeatedly.The only thing it was halfway decent at was me basically tossing it a JSON dump from the weather forecast command and going "Here make a conversational thing about the next couple days". It was actually pretty good at that, but not worth it. Rewrote that as just my own writing to say exact temps and conditions for each of the next 3 days. My brain can track the similarities hearing it.
       
 (DIR) Post #B4cx1pJovAsaMHoEKm by qgustavor@urusai.social
       0 likes, 0 repeats
       
       @davidrevoy here it's not that slow...... I use a model to filter job postings (as a fallback to when the regexes return unreliable results) which is sooo small that it's unreliable...... well, every model is unreliable, so it's just more unreliable than usual.
       
 (DIR) Post #B4cxGGyAudx8AcZazY by davidrevoy@framapiaf.org
       0 likes, 0 repeats
       
       @mohs @ariarhythmic Interesting, I'll see where it goes. I'm particularly conflicted on the episode of next week, happening a 1st April; my brain has mixed up feelings: should I do a sad thing (to change and contrast)? or something unusual? or another technique (eg. ASCII art). Many possibilities, many opportunity to have bad taste and be excused for it too ^ ^
       
 (DIR) Post #B4d2SKT4EPhoGXahl2 by Ray_Of_Sunlight@mastodon.social
       0 likes, 0 repeats
       
       @davidrevoy I don't know if she's a witch, a mage, or artificer, but heck, she's a pretty magic user with abilities in mechanics and technology, that deserves respect
       
 (DIR) Post #B4d6PMP6yZMVDca3lo by davidrevoy@framapiaf.org
       0 likes, 0 repeats
       
       @landelare Yes, but necessary for her (and global story) dramatic curve, and her relation with it (and the No AI Club) she once was part of.This episode was one of the most problematic for me; but I wanted to cover an aspect of the 'slow running locally' to make her interested to walk to the data centers.
       
 (DIR) Post #B4d6cLbhFakIVleyeG by davidrevoy@framapiaf.org
       0 likes, 0 repeats
       
       @Linebyline 😆 Thank you!
       
 (DIR) Post #B4d7yG3CgngbbUXOk4 by odysseywestra@linuxrocks.online
       0 likes, 0 repeats
       
       @davidrevoy This is so true. At least it taught me about keeping backups of everything cause it's a matter of when, not if it fails a task and cannot backtrack.I was lucky to get a sufficiently powerful enough GPU but even that is slow compared to hosted models.Oh well like her, I have an itch to scratch and it's llms. ( ꩜ ᯅ ꩜;) 
       
 (DIR) Post #B4dDYC1hd0VnJon38C by SmartmanApps@dotnet.social
       0 likes, 0 repeats
       
       @davidrevoy Nice Monty Python reference 😂https://www.youtube.com/watch?v=_7iXw9zZrLo
       
 (DIR) Post #B4dZ8rk46eMY9wrueO by Helkriz@mograph.social
       0 likes, 0 repeats
       
       @davidrevoy Magical or not it behaves the same. 🤔 ohhh.... There is a solution. Tell her don't do it herself. But get an Avian Intelligence from a provider then it may get faster. Avian will transfer data anyway while it gets the chance anyway 🫣
       
 (DIR) Post #B4eAVnuuBtLlGCjwAK by anthk@neopaquita.es
       0 likes, 0 repeats
       
       @davidrevoy that the reminds me of the Slouching Towards Bedlam text adventure, a geeky steampunk adventure. https://ifdb.org/viewgame?id=032krqe6bjn5au78You can play it offline by grabbing the Z5 file and playing it with Lectrote, Gargoyle, Frotz or any other z-machine emulator.The gblorb file can be run on Gargoyle/Lectrote. It's the same game.