Posts by benlk@newsie.social
(DIR) Post #AbIvS3sL4EvbOJDfJw by benlk@newsie.social
2023-10-30T14:33:27Z
0 likes, 0 repeats
I have an idea for a 1000+record scraper project, but I'm not sure how to capture the data. CSV or a database? Which database? Any suggestions?
(DIR) Post #AbIvS4yOzBN8nP41PU by benlk@newsie.social
2023-10-30T14:35:06Z
0 likes, 0 repeats
If I end up putting this #scraper project online, then it's probably best to use mysql, since that's guaranteed to be available on website hosts, but is there a better recommendation? @simon @palewire
(DIR) Post #AbJF8wNOirp3iLuHh2 by benlk@newsie.social
2023-10-30T20:00:57Z
0 likes, 0 repeats
@palewire @walinchus @simon Yep, updated ~daily, though a weekly scrape is adequate for my purposes.Dunno how large the initial scrape will be, because I haven't scraped it yet!🤔 100 records/day * 365 d/y * 2 kb/record =~ 75 MB.I guess if GitHub Actions creates a .sqlite file, I can write a cron job on the webserver to import that, if I turn this into something public-facing.
(DIR) Post #AbNW58i0TTSfUDySsC by benlk@newsie.social
2023-11-01T23:46:22Z
0 likes, 0 repeats
@simon `jq` is very useful for parsing and querying JSON, but it doesn't have schema-specific validation. https://jqlang.github.io/jq/manual/
(DIR) Post #AbOrYKjx75bTOWbeiW by benlk@newsie.social
2023-11-02T15:21:48Z
0 likes, 0 repeats
@simon after checking your 2FA logins, check every app that requires you to log into the app. Check whether any files in nonstandard locations were transferred; they might need to be transferred manually. Were all apps installed, or are there some apps that weren't copied over?
(DIR) Post #AcAuBEi4FZEb7Kw00m by benlk@newsie.social
2023-11-25T19:37:18Z
0 likes, 0 repeats
@simon shell out to the command-line calculator `bc`? https://www.gnu.org/software/bc/manual/html_mono/bc.html as simple as `bc <<< "a + b * c"`
(DIR) Post #AcD0O0A8dTZ9o0SEbo by benlk@newsie.social
2023-11-26T19:56:08Z
0 likes, 0 repeats
@simon Oof, good to know.
(DIR) Post #AdQ1BgWUnEn1QDINWa by benlk@newsie.social
2024-01-01T22:59:26Z
0 likes, 0 repeats
@simon Speaking of WordPress.com: https://wordpress.com/100-year/
(DIR) Post #AdXoFydFf6NIbXqptI by benlk@newsie.social
2024-01-05T18:42:40Z
0 likes, 0 repeats
AMP is/was better than Apple News Format.
(DIR) Post #AdXoNifetBVXQ0fXHc by benlk@newsie.social
2024-01-05T18:44:41Z
0 likes, 0 repeats
@ken Very much agreed!But having just solved a problem with News Preview.app that has been blocking us for the last ~month, I have to say that AMP, being web tech, has tooling that is parsecs better than ANF.