[HN Gopher] Twitter archiver: Make your own simple, public, sear...
___________________________________________________________________
Twitter archiver: Make your own simple, public, searchable Twitter
archive
Author : aaossa
Score : 95 points
Date : 2022-12-19 19:21 UTC (3 hours ago)
(HTM) web link (github.com)
(TXT) w3m dump (github.com)
| cobertos wrote:
| Anyone know how to download a conversation? I want to mirror my
| tweets to my website with the comments.
|
| It doesn't come in the Twitter data export. It's also impossible
| to get a tweets comments from the API as a normal user? (> 7 days
| of conversation threading only available for academic
| institutions and enterprise)
| nixcraft wrote:
| Also, you can archive your Tweets with the Wayback Machine
| https://help.archive.org/help/how-to-archive-your-tweets-wit...
| joe-collins wrote:
| Does anyone know of a means of accomplishing this without
| access to the account? A friend passed away last year, and I
| would love to archive those memories.
| thelamest wrote:
| I hope you'll get a better answer, but a minimal solution is
| to use snscrape
| (https://github.com/JustAnotherArchivist/snscrape) to
| download a raw JSON dump of a user timeline. Some caveats: 1.
| This doesn't work for all users (e.g. some accounts seem to
| remain deindexed after unsuspensions). 2. While you can get
| rid of 90% of the file size by removing fluff columns (e.g.
| related to processing media and emojis), keep a backup. When
| importing such JSON, I unwittingly did a lossy data type
| conversion, and it can be irreparable once the tweets are
| deleted.
|
| $ snscrape --progress --jsonl twitter-user jack > jack.json
|
| [PS With courtesy rate limiting, depending on the account
| size, you may then script a way to send each tweet URL for
| archival in the Wayback Machine.]
| ElijahLynn wrote:
| YES! Thank you, I have been looking for a way to archive my
| Twitter account. I've been considering deleting mine but this
| was THE blocker! Thanks.
| nb_key wrote:
| waybachmachine is a bless these days.
| [deleted]
| terhechte wrote:
| Another shameless plug: I made a cross platform "native (Rust
| with Webkit)" desktop app that does the same thing (Win/Lin/Mac).
| It also allows you to see your "profile" afterwards in the app,
| search within your Tweets, and allows backing up things like
| mentions, responses, likes, etc:
|
| https://github.com/terhechte/twitvault
| terhechte wrote:
| Also, the reason I made a Desktop app is that all other tools
| usually require somebody to know the Terminal, or how to set up
| a Webserver. Twitvault can also be used by non-tech people to
| archive their data.
| donohoe wrote:
| Sort of a shameless plug, but you can use this PHP script to
| generate a lazy-loading basic webpage with all your tweets that
| you can host:
|
| https://github.com/donohoe/twitter-archive
|
| Example:
|
| https://donohoe.dev/twitter/
| pkulak wrote:
| Man, wish I did this before my account got suspended.
| RobertoG wrote:
| Is there an easy way of downloading the favorites?
| jchook wrote:
| v1 of the API only gives access to the last 3200 favs.
|
| v2 of the API improves on this a good bit, but I haven't tested
| it thoroughly yet.
___________________________________________________________________
(page generated 2022-12-19 23:01 UTC)