Posts by rmader@floss.social
(DIR) Post #Ac3lA4qLBmRaX7SPFA by rmader@floss.social
2023-11-22T00:01:21Z
0 likes, 0 repeats
P.S.: I was just made aware of glide (https://github.com/philn/glide) which has some compelling features: - Written in Rust which is quite popular in the app community I hear. - Seems to already support most stuff we need, could just use some UI refresh. - Explicitly supported on MacOS. That's interesting because the hardware offloading in gtk4 so far only supports Wayland, but was written in a way to work on other platforms as well.
(DIR) Post #AcQgxaSMPSjjdO6jjs by rmader@floss.social
2023-12-02T20:18:16Z
0 likes, 1 repeats
@linmob For the PPP / Camera I'd like to point out that it relies on #libcamera, #PipeWire and #GStreamer, all of which would need some improvements to get to similar results like MP on the PP (in case of libcamera mainly device specific).That being said, the big advantage of using that stack is that the camera can be used in more app, such as Decoder, @dino or #Firefox So I personally would love to see more of the knowledge and optimizations in MP finding their way upstream :)
(DIR) Post #AcQlIsZkdb7TjByOFE by rmader@floss.social
2023-11-29T22:20:18Z
0 likes, 0 repeats
Regarding the future of video playback in #gnome I'd like to add some more context around current developments in #gnomeshell, #gtk4 and #Wayland in a short 🧵 TL;DR: by making use of more modern hardware features we're finally in the position to catch up to other platforms with regards to energy efficiency. So let's do it!
(DIR) Post #AcQlItZ4xaAynOfMps by rmader@floss.social
2023-11-29T22:20:38Z
0 likes, 0 repeats
In a previous thread I wrote about YUV support in Mutter having made its way into #gnome45 (https://floss.social/@rmader/111142297368297062). Recently #gtk4 devs picked things up and implemented compositor offloading, see their nice blog post: https://floss.social/@GTK/111415523629484640
(DIR) Post #AcQlIuXhKCfJpP1mK0 by rmader@floss.social
2023-11-29T22:25:03Z
0 likes, 0 repeats
We're now working on filling the remaining gaps so this can become an actual reality on the #gnome (and generally #linux / #fdo / #gnu) desktop. And what can I say - things actually work out quite nicely! While on modern Intel or AMD systems the effect is mostly about lower resource consumption, on some low-end hardware there are visible differences on what you can play fluently.
(DIR) Post #AcQlIxEJKjwMA8yq1I by rmader@floss.social
2023-11-29T22:29:06Z
0 likes, 1 repeats
Take for example these examples of a #PinebookPro (rk3399 / v4l2 stateless) playing 4k content or the #RaspberryPi 4b (v4l2 stateful / m2m) playing 1080p@60fps (the limit of the hardware decoder) on a 2560x1440 screen. My videos probably don't fully capture the effect, but especially in the later case the difference is pretty visible). This is using the gtk video player demo with some extra patches and #gstreamer.
(DIR) Post #AcQlIy91vrJJ03W8Qa by rmader@floss.social
2023-11-29T22:29:29Z
0 likes, 0 repeats
My hope is that we can ship some initial support for all of this in #gnome46 - if possible with the default video player. Be it Totem, ported to #gtk4, or some alternative. The goal is of course that as many apps as possible can make use of it without much hassle - be it video streaming apps, video chat apps like @dino or Fractal, #fediverse clients like Tuba or camera apps like #gnomecamera / Snapshot (for a battery friendly viewfinder - important on #linuxmobile). And of course browsers.
(DIR) Post #AcQlIyy4s48xYNOtzk by rmader@floss.social
2023-11-29T22:29:48Z
0 likes, 0 repeats
Making this all work is a long process and when talking to people that have been working in the field longer than me, I often get the feedback to be not too optimistic regarding time frames. As always when pushing some limits there will be driver bugs, missing APIs and loose ends all over the place. So far every device I tried needed at least some fixes in #mesa, the kernel or both. And when things break, we have to be extra careful to not impact stability.
(DIR) Post #AcQlIzpFgMg6DIHMsS by rmader@floss.social
2023-11-29T22:30:02Z
0 likes, 0 repeats
That's why we're very fortunate that #gnome recently got funding from the #SovereignTechFund. One of the sponsored projects is to implement GL robustness in #gnomeshell / Mutter, so if the driver stumbles when trying to import some unusual buffer you won't lose your session.
(DIR) Post #AcQlJ0kgEqcD5P9EOG by rmader@floss.social
2023-11-29T22:30:29Z
0 likes, 0 repeats
My personal vision with all of this is to see #wayland desktop technologies not only catching up with what other OSs offer, but becoming leading players - just like what other FLOSS projects already archived (or are in the process of becoming) in their areas. I'm thinking of #mesa, #pipewire, #gstreamer, #systemd, the kernel of course, and many others.
(DIR) Post #AcQlJ1oyGNdqP0AAiW by rmader@floss.social
2023-11-29T22:30:55Z
0 likes, 0 repeats
The plan is as usual: expose exciting technology to a great community of technical capable people -> improve quality, reliability and features (HDR...) -> get more companies to use it for products and invest into its development -> repeat -> #wayland world domination :PYeah, quite optimistic. Let's see how it goes. End 🧵
(DIR) Post #AcQlJ2WvcwnsbKjHEW by rmader@floss.social
2023-11-29T23:10:57Z
0 likes, 1 repeats
P.S.: totally forgot - if you want to follow the development, try things out or even consider helping, here are some links:- the previous thread about the #GNOME default video player, with lots of great answers: https://floss.social/@rmader/111450167627181127- some WIP GTK patches: https://gitlab.gnome.org/GNOME/gtk/-/merge_requests/6618- some WIP Mutter patches: https://gitlab.gnome.org/GNOME/mutter/-/merge_requests/3177I'm also looking for people to help with #Gstreamer caps negotiation in various elements, especially for V4L2 decoders :)
(DIR) Post #AcdmSY0NUc3MQyK08m by rmader@floss.social
2023-03-31T14:08:27Z
0 likes, 1 repeats
Pretty cool milestone for cameras on the #PinePhonePro and the #libcamera + #PipeWire stack today: the #Manjaro images (the stock distro) for both #phosh and #PlasmaMobile now come with all required packages by default.Finally I can simply install cheese and get an image.Yes, the rotation is still wrong. Yes, there are still features missing that you'd expect from a modern camera stack. Yes, there are still bugs and suboptimal image quality. But we got a working base now.
(DIR) Post #AcdmSaIAzPTjWkfFA0 by rmader@floss.social
2023-03-31T14:15:17Z
0 likes, 0 repeats
A bunch of other distros are also close, including #alarm and #Mobian. And other devices like the #Librem5 will hopefully follow soon as well.This is all without downstream patches (besides in the kernel...), so if you use a different distro which does not ship a working stack yet, please help us by checking what needs to be done and opening issues - and please reach out to me if you need help! :)
(DIR) Post #AcdmScSWvswuFRWXZo by rmader@floss.social
2023-03-31T14:18:31Z
0 likes, 0 repeats
Typically you'll want to ensure that pipewire, wireplumber, libcamera and the gstreamer-pipewire plugin are all installed. If that's not enough (don't forget: you may need to reboot after installing e.g. wireplumber), it's likely that something around the packages is not in place yet.Good test commands include `pw-dump | grep libcamera`, `gst-device-monitor-1.0 Video/Source | grep libcamera` and `cam -l`.
(DIR) Post #AdeKtbEfx4GdjZLZWC by rmader@floss.social
2024-01-08T22:07:01Z
1 likes, 3 repeats
I'll also be at #fosdem and do a short talk about #Wayland video offloading related stuff I've been posting about, featuring #gtk4, #gstreamer, #Chromium #gnomeshell and #westonhttps://fosdem.org/2024/schedule/event/fosdem-2024-3557-the-state-of-video-offloading-on-the-linux-desktop/See you there!#Collabora #fosdem2024 #gnome #gnomeonrails
(DIR) Post #AhoMxRZakaGpdQdnzk by rmader@floss.social
2024-05-05T18:32:01Z
0 likes, 0 repeats
If you want to follow the process of getting the #libcamera (with softwareISP) + #pipewire stack into place on #postmarketOS - which will allow way more apps to use cameras on devices like the #librem5, #PinePhone (the #PinePhonePro was the first were it already kinda works) and hopefully many more devices in the future - then here's a meta issue you can subscribe to: https://gitlab.com/postmarketOS/pmaports/-/issues/2787
(DIR) Post #AhoMxTfgwsL28vVhmS by rmader@floss.social
2024-05-05T18:39:52Z
0 likes, 0 repeats
First time for me to play with #postmarketOS. The build tools are really cool - but I can't wait to have proper #systemd support for stuff like `systemctl --user [status|restart|...] pipewire` and the journal.
(DIR) Post #AhqV2pDLT5t2M1ESZs by rmader@floss.social
2024-04-30T16:11:42Z
0 likes, 0 repeats
@Luigi311 Looking forward to try this with apps doing QR code scanning (like e.g. Warp) - they desperately need better autofocus :)
(DIR) Post #AhqV2sC2OPchapdxSK by rmader@floss.social
2024-05-06T09:46:19Z
0 likes, 0 repeats
@Luigi311 Awesome! Just to be sure I understand things correctly: that the algorithm can also be used with the softwareISP / is not ISP/IPA specific, right? So if we implement the controls on the Pipewire side (or temporarily enable it by default in libcamera in some downstream patch) it should also work for the Librem/PP/...?