Post ApbIxHq6Ktk9tU4yOW by johnefrancis@cosocial.ca
 (DIR) More posts by johnefrancis@cosocial.ca
 (DIR) Post #Apb3tQdmAmJOig15Hs by futurebird@sauropods.win
       2024-12-31T01:37:43Z
       
       0 likes, 0 repeats
       
       I don't know if I really want to take on this project. I have a lot of projects and work to do. I probably should not.https://sauropods.win/@futurebird/113744151630008623But, **if** I did, do I really need to use a webcrawler or can I interact with activity pub posts in a more direct way, skip the task of stripping the HTML to get the links. I assume the answer is yes. (or will there be permissions hurdles?)I have very little experience doing this kind of project. I'm just feeling around to see how bad it would be.
       
 (DIR) Post #Apb3tRjq5ikw7lrRNQ by lavaeolus@fedihum.org
       2024-12-31T06:47:42Z
       
       0 likes, 0 repeats
       
       @futurebird phanpy (@phanpy) by @cheeaun has a "Catch-Up"-feature, maybe this could be a start?https://mementomori.social/@nen/113554610813176498https://github.com/cheeaun/phanpy
       
 (DIR) Post #Apb3tYYOkelPGJYu12 by futurebird@sauropods.win
       2024-12-31T01:38:36Z
       
       0 likes, 0 repeats
       
       I assume I need to read this:https://www.w3.org/TR/activitypub/ugh. There isn't an O'Riley book is there? (Though so far it's not so bad.)
       
 (DIR) Post #ApbH1xBCNNGNMI2qXY by ineiti@ioc.exchange
       2024-12-31T09:14:55Z
       
       0 likes, 1 repeats
       
       @futurebird for once I think this is an excellent use case for an LLM generated program: you want to put existing technologies together, and display data in a neat way. I would not be surprised if replit and their agents will let you do such a thing in a couple of hours. Of course you should have some basic understanding of the protocols first, else you won't see the many mistakes it will generate :)Now if the goal of the project is to actually deep dive into all the technical details, using replit is bad advice...So I'd pay replit and hope to save many weeks of studying the protocols. Good luck! Let us know if you choose that project, and how it goes!
       
 (DIR) Post #ApbIY7cLChoOx3dxMe by evan@cosocial.ca
       2024-12-31T01:50:37Z
       
       0 likes, 0 repeats
       
       @randomgeek @futurebird thanks! Please enjoy it!
       
 (DIR) Post #ApbIY8sKWkCCqw8EvQ by evan@cosocial.ca
       2024-12-31T07:02:57Z
       
       0 likes, 1 repeats
       
       @randomgeek @futurebird I have links to other stores and formats here btw:https://evanp.me/activitypub-book/
       
 (DIR) Post #ApbIYA0sIScoNj8Zsm by futurebird@sauropods.win
       2024-12-31T09:31:56Z
       
       0 likes, 0 repeats
       
       @evan @randomgeek Are there any plans for a hard copy? The ebook is good, but I've always found paper books easier for these kinds of things because I can write on them, and don't need to have another device/app out when I'm coding.
       
 (DIR) Post #ApbIxHq6Ktk9tU4yOW by johnefrancis@cosocial.ca
       2024-12-31T01:47:08Z
       
       0 likes, 0 repeats
       
       @futurebird you can use the Mastodon API, it's  easier than implementing an ActivityPub peer. Or the API of another ActivityPub peer. I think you're trying to collect links from your own Mastodon feed?
       
 (DIR) Post #ApbIxIT5zuw3qQK7Au by futurebird@sauropods.win
       2024-12-31T09:36:33Z
       
       0 likes, 0 repeats
       
       @johnefrancis "I think you're trying to collect links from your own Mastodon feed?"yes.
       
 (DIR) Post #ApbIxMWmu8GWR257U8 by johnefrancis@cosocial.ca
       2024-12-31T01:49:30Z
       
       0 likes, 0 repeats
       
       @futurebird you also have API access to the local and federated feed, which you can mine in addition to your own feed.
       
 (DIR) Post #ApbJ9r7kyRjanpKZZA by paul@oldfriends.live
       2024-12-31T09:38:45Z
       
       0 likes, 1 repeats
       
       @futurebird @evan @randomgeek I'm a physical book person too. I always try to get a hard copy. Years ago, I was lucky enough to purchase a commercial laser printer that still had a couple hundred thousand pages of life left at an auction for almost nothing and can simulate paper books of several hundred pages without much effort or cost other than punching the holes in the paper and transferring to binders. Still, a formal book is better and my preference.
       
 (DIR) Post #ApbOPGCGXHyOg9bY5Q by futurebird@sauropods.win
       2024-12-31T10:37:39Z
       
       0 likes, 1 repeats
       
       @ineiti Hmmm. I think I might just be the kind of bumbling amateur who could do maximal damage with this approach, especially for something that's running queries. My general annoyance at how replit sprang AI on everyone non-withstanding I don't want to dismiss what you are saying out of hand.Have you been able to build a project in this way? Or do you just think it *ought* to be possible.How different is it from what I'd normally do: find similar code copy paste it and modify?
       
 (DIR) Post #ApbPphUblzY2opM7PM by tuban_muzuru@ohai.social
       2024-12-31T10:53:35Z
       
       0 likes, 0 repeats
       
       @futurebird @ineiti As someone who tests an LLM, I would clearly advise against building anything using much more than basic object.member name completion.Maybe in a few years, but LLMs without a lot more expert systems backing are not ready for prime time.
       
 (DIR) Post #ApbUTzWkXXgA9TpDHM by lienrag@mastodon.tedomum.net
       2024-12-31T11:45:28Z
       
       0 likes, 0 repeats
       
       @futurebird The problem, from what I understand, is that ActivityPub as it actually exists is quite different from the spec.Kaninii (I think ? Or maybe it was Lain) made a comprehensive post about what one needs to read before doing an AP implementation.I think that @bortzmeyer also had something a few years ago, when one student of his did her work on the topic ?
       
 (DIR) Post #ApbVmrHtUz1k3NR9F2 by ineiti@ioc.exchange
       2024-12-31T12:00:18Z
       
       0 likes, 0 repeats
       
       @futurebird I use LLMs regularly on a daily basis in the same way as you. And I have to admit that I never used replit and its AI. What made me suggest it anyway was an article describing how they built a simple Image converter using replit and it's AI. It read genuine, and I had discussion with a friend who oversees IT engineers using AI in an automated way for more common tasks than I'm used to. We concluded that for well known tasks, AI can actually be quite useful. As most of my projects include cryptography (work) or some obscure protocols and hardware (hobby), AI never works for me (besides reminding me of the syntax of this hours language). So I'm really curious if your project is already solvable by today's AI. I'd give it a more than 50% chance. If you like gameification, we can do a bet :)Also: the fact that you already think of how things can go wrong shows you'll wield the beast wisely.Dang, now I have to restrain myself from trying it out myself! Must. Resist. 200th weekend project. In. 2024.
       
 (DIR) Post #ApbZ9MinbmXtmGRfOa by benfulton@urbanists.social
       2024-12-31T12:38:00Z
       
       0 likes, 0 repeats
       
       @futurebird I have a Python script that pulls my own posts and turns them into HTML. You do have to parse your own links but the BeautifulSoup library makes that simple. Happy to share if you'd like!
       
 (DIR) Post #ApbZnKqxyRSlZBKB9s by futurebird@sauropods.win
       2024-12-31T12:45:14Z
       
       0 likes, 0 repeats
       
       @benfulton I would love to take a peek at that!
       
 (DIR) Post #ApbfhAIqszQEphoD2G by benfulton@urbanists.social
       2024-12-31T13:51:18Z
       
       0 likes, 0 repeats
       
       @futurebird Let me know if you have any questions about it :)https://gist.github.com/benfulton/2ee901ebbce7530c338b0ce650f32340
       
 (DIR) Post #Apbmk5Af7fgHSpJffM by futurebird@sauropods.win
       2024-12-31T15:10:16Z
       
       0 likes, 0 repeats
       
       @dalias Command like mastodon... like in a telnet window? I mean, I'm not exactly surprised it exists but it also didn't occur to me. Is this like using a command line web browser or email client? hm
       
 (DIR) Post #ApbmwBURSF8iXML3ce by futurebird@sauropods.win
       2024-12-31T15:12:31Z
       
       0 likes, 0 repeats
       
       @dalias I did confuse telnet and terminal.I mean... but there are reasons for that.
       
 (DIR) Post #ApbnGvy0MeuETS3pFA by viq@social.hackerspace.pl
       2024-12-31T15:16:13Z
       
       0 likes, 0 repeats
       
       @futurebird @dalias I'm not sure how it would work with TLS (though probably stunnel or similar could help), but you *could* access http services, including APIs, using telnet. I'm not sure why you would, except maybe a party trick, but you could. And then, uh, deal with all that JSON you received.
       
 (DIR) Post #ApbqffGrsLzNnMMs1Q by faassen@fosstodon.org
       2024-12-31T15:54:19Z
       
       0 likes, 0 repeats
       
       @futurebird@dalias https://pypi.org/project/textualdon/ is a new mastodon text mode client I learned about the other day. Have seen several others. Haven't tried this one yet.But for your purpose getting the content directly from the JSON web api mastodon offers sounds better
       
 (DIR) Post #ApbqkyD0tPOLyg5wBs by faassen@fosstodon.org
       2024-12-31T15:55:18Z
       
       0 likes, 0 repeats
       
       @futurebird@dalias Did you use muds long ago?
       
 (DIR) Post #ApbqqlLFe4IDoBi5NA by futurebird@sauropods.win
       2024-12-31T15:56:21Z
       
       0 likes, 0 repeats
       
       @faassen @dalias usenet, and the early web.
       
 (DIR) Post #ApbstqRNLPkuOoAjIW by faassen@fosstodon.org
       2024-12-31T16:19:19Z
       
       0 likes, 0 repeats
       
       @futurebird@daliasMuds were the first internet thing I used. Usenet the third after email