Posts by pruvisto@graz.social
(DIR) Post #APA9ru0IU8IJ9Xyipc by pruvisto@graz.social
2022-10-30T21:05:06Z
0 likes, 0 repeats
@jdaviescoates @eloquence @lioh Yes, 5000 is correct. You can only query 1000 at a time and there is some rate limiting (I think 15 requests in a 15 minute interval).So in principle I could make this higher. I set it to 5000 because one of the people who tested it had 4300 or so.
(DIR) Post #APAgbRlX0FehQaphg0 by pruvisto@graz.social
2022-11-01T20:49:44Z
0 likes, 0 repeats
@Luca Nice! Someone requested this for Debirdify as well. Might implement it at some point. Never occurred to me since I never used lists.Are you doing any kind of session management at the moment? That's something I absolutely want to avoid.
(DIR) Post #APAgtY0YX6LY06UXrs by pruvisto@graz.social
2022-11-01T20:52:53Z
0 likes, 0 repeats
@Luca @yetzt I simply use the list from instances.social instead to avoid having to do so many http requests. I refresh the list once a day.Personally I decided to focus on extracting valid Fediverse IDs regardless of whether the server is alive or dead. If someone's ID is dead you might still want to know that they have one.
(DIR) Post #APAhlcCr8hswew1hPk by pruvisto@graz.social
2022-11-01T20:54:44Z
0 likes, 0 repeats
@Luca It might be a good idea to collect unknown hosts that the app encounters and check them offline once a day or so and add them to the list of known hosts.But so far I tried to avoid any sort of data provided by users ending up on my server. I guess this should be fine though since it's not personalised.
(DIR) Post #APAiWQROhVpnmP9Hyi by pruvisto@graz.social
2022-11-01T21:11:15Z
0 likes, 0 repeats
@Luca Well you can still put the auth tokens in a cookie (which is what I do). But yes, as soon as you want to do more complex stuff like with lists I think I need something more complex.Perhaps local storage would be a way around this. Or JavaScript. I kind of don't want to store any user data on the server.
(DIR) Post #APAic6oGbNHQdGYWUi by pruvisto@graz.social
2022-11-01T21:12:16Z
0 likes, 0 repeats
@Luca Hmm, might be worth a try. But I would imagine the difference to what I'm doing right now already both in quality and in performance would probably be minimal.
(DIR) Post #APC9tn0FsBQyKtmJwu by pruvisto@graz.social
2022-11-02T13:52:40Z
0 likes, 0 repeats
@Luca Nice!What exactly are you doing for lists? Do you query the user's lists and scan the users in it for Fediverse IDs? Is rate limiting an issue there?Do you search pinned tweets of list members as well?
(DIR) Post #APCBIvKw7rkdNN07Ae by pruvisto@graz.social
2022-11-02T14:08:26Z
0 likes, 0 repeats
@Luca Just a tip: At least in the v2 API, you can set a flag in your "get accounts followed be user X" request so that the response will already contain all the pinned tweets of those accounts.I implemented that a few days ago and it definitely improved the results.
(DIR) Post #APCF21eVn4r9rEM3uK by pruvisto@graz.social
2022-11-02T14:09:00Z
0 likes, 0 repeats
@Luca We could ask Twitter to increase the limits a bit, but somehow, I doubt they would be very receptive. 😄
(DIR) Post #APCGFSX7GAvqwfrhD6 by pruvisto@graz.social
2022-11-02T15:03:51Z
0 likes, 0 repeats
@Luca It looks like this in Debirdify:resp = client.get_users_following(requested_user.id, max_results=1000, user_auth=True, user_fields=['name', 'username', 'description', 'entities', 'location', 'pinned_tweet_id'],tweet_fields=['entities'], expansions='pinned_tweet_id', pagination_token=next_token)The interesting bit is the "expansions".
(DIR) Post #ATNBRM0ZtScUxZF4fg by pruvisto@graz.social
2023-03-07T12:59:58Z
0 likes, 0 repeats
@john @kirt @rollipolliolis These sorts of things have happened sporadically in the past few months. So far it has always been due to Twitter breaking something (temporarily) and not an actual attempt to shut out Debirdify.They may well shut down the free API completely at some point, but if and when they do I think we will know right away. It will cause quite a bit of a stir.
(DIR) Post #ATNMqSmExnhqgiiATo by pruvisto@graz.social
2023-03-07T15:07:51Z
0 likes, 0 repeats
@john @kirt @rollipolliolis Yes. Somebody suggested (jokingly) that Musk noticed that one of the heaviest users of the API was twitter.com itself and he had the brilliant idea to make lots of money by charging them for using it as well. 😄