Post AQjnaTEE0y2rahIPqa by b_cavello@mastodon.social
(DIR) More posts by b_cavello@mastodon.social
(DIR) Post #AQjicl6o0WIRr166am by textfiles@mastodon.archive.org
2022-12-18T15:55:39Z
1 likes, 1 repeats
So, I have been turning my attention to the idea of buffering 24 hour grabs of all radio spectrum, using Web SDR. I'm just reaching out in case people are sitting on sets of these from times past. DM or jason@textfiles.com.Am I really to the point of archiving radiation? Yep.The big concern is disk space. Under current approaches, a full spectrum grab of 24 hours of signal in one geographical location is ten terabyes! But one day a year might be worth it. For history.
(DIR) Post #AQjl92DC9bRS4bbWDo by jayalane@mastodon.online
2022-12-18T16:33:48Z
0 likes, 0 repeats
@textfiles a logical extension to internet archives mission. And really 10T / day is peanuts for such unique data. Maybe get some grant for it.
(DIR) Post #AQjmRoOhq6JcgXVQRs by a@paperbay.org
2022-12-18T16:38:16Z
0 likes, 0 repeats
@textfiles I love the idea. Maybe recording samples of one hour every month and storing the complete speech2text would be more useful (especially allowing indexing and searching).
(DIR) Post #AQjnaTEE0y2rahIPqa by b_cavello@mastodon.social
2022-12-18T16:39:40Z
0 likes, 0 repeats
@textfiles image description: visualization of radio patterns with options to modify frequency, bandwidth, and other settings.
(DIR) Post #AQjoWPYHqEOcz6J9oO by textfiles@mastodon.archive.org
2022-12-18T16:42:06Z
0 likes, 0 repeats
@a I've begun discussing things with people who know better to see if compression is possible.
(DIR) Post #AQjpMqk3zkVIN3oy1I by textfiles@mastodon.archive.org
2022-12-18T16:43:15Z
0 likes, 0 repeats
If people don't know, we already grab 11,000 hours of radio a day worldwide, but that's not the same as radio spectrum.
(DIR) Post #AQjqGid5LPAbQXCJ4C by davidr@hachyderm.io
2022-12-18T16:49:37Z
0 likes, 0 repeats
@textfiles That sounds high. Can you do an adaptive sample rate thing? You don't really need 8Gsps or whatever for LF.
(DIR) Post #AQjqGlNF8lHRwGoCI4 by davidr@hachyderm.io
2022-12-18T16:53:33Z
0 likes, 0 repeats
@textfiles You could also save the 10TB annually for full IQ decoding, but do waterfall plots all the time to show traffic.
(DIR) Post #AQjrSi6nCrRrEzNIhs by plasticbiker@infosec.exchange
2022-12-18T16:57:34Z
0 likes, 0 repeats
@textfiles what frequency range and sample rate are you capturing?
(DIR) Post #AQjtMD2lzXqv48WSLw by ch00f@hachyderm.io
2022-12-18T17:08:18Z
0 likes, 0 repeats
@textfiles this kind of project could have some astronomical applications too if you can pick up the right frequencies.
(DIR) Post #AQjuMKROaakFxgezsu by polygonpusher@synth.buzz
2022-12-18T17:17:14Z
0 likes, 0 repeats
@textfiles How relevant is whitespace? Maybe some automated post process to clip whitespace?Source -> ML(ID/Clip space) -> disk?If you could specify KPI of the wave, record only those and specify everything else as non relevant or non eventful. Maybe add a buffer of the head and tail for each event.
(DIR) Post #AQjvOLKCNEIZEionCa by kepstin@glitch.social
2022-12-18T17:26:04Z
0 likes, 0 repeats
@textfiles @a it would be pretty hilarious if it ends up that you can just use, say, FLAC and get ok compression.
(DIR) Post #AQjwGEjv4b2KRzY0dk by hare@wikis.world
2022-12-18T17:26:30Z
0 likes, 0 repeats
@textfiles What opportunities are there, if any, to compress this data?
(DIR) Post #AQjxRhD7euIrtKEdPc by evn@gamedev.lgbt
2022-12-18T17:28:38Z
0 likes, 0 repeats
@textfiles What format would this be stored in? Sounds like an interesting signal processing challenge to find a still useful but more compressed format
(DIR) Post #AQjyTHjLSsLVOnd1vM by textfiles@mastodon.archive.org
2022-12-18T17:32:10Z
0 likes, 0 repeats
@plasticbiker ideally, all
(DIR) Post #AQjzSzyXZpqKHsABn6 by textfiles@mastodon.archive.org
2022-12-18T17:32:20Z
0 likes, 0 repeats
@ch00f oh, there's a thousand uses
(DIR) Post #AQk0OyubglmZmiyJGq by textfiles@mastodon.archive.org
2022-12-18T17:32:52Z
0 likes, 0 repeats
@polygonpusher i have not gotten that far, I'm a stranger in these parts, recognizing some potential
(DIR) Post #AQk1FFWv9Ha6Nnoeoa by jayrope@mastodon.online
2022-12-18T17:33:52Z
0 likes, 0 repeats
@textfiles that's roughly 458 24h broadcast. Are the radios you are grabbing not archiving themselves? What's the criteria for you to grab?
(DIR) Post #AQk2wiBkZZ0RfjCa9o by Lutrulo@chitter.xyz
2022-12-18T17:59:18Z
0 likes, 0 repeats
@textfiles That sounds awesome, but be careful. Some parts are illegal to record in the US, namely cell phone bands, because it is considered wiretapping. Militaries would probably have something to say about it too.
(DIR) Post #AQk3ylY39VLIcpAxjE by textfiles@mastodon.archive.org
2022-12-18T18:02:14Z
0 likes, 0 repeats
@Lutrulo that's me, careful
(DIR) Post #AQk4lnCXnKSFwSUiGW by GreenFire@climatejustice.social
2022-12-18T18:03:23Z
0 likes, 0 repeats
@textfiles This type of activity might be very useful for far-right monitoring and the Spanish language disinformation that is a growing problem in U.S.
(DIR) Post #AQk5XHiEAn4WBFxaNc by RyunoKi@layer8.space
2022-12-18T18:05:16Z
0 likes, 0 repeats
@textfilesI would imagine that there is a significant amount of white noise in it, isn't it?
(DIR) Post #AQk6Ys4AaytJAqXlrs by chpietsch@digitalcourage.social
2022-12-18T18:19:00Z
0 likes, 0 repeats
@textfiles It might be a good idea to use the #WebSDR tag. Not sure if I like your idea tho. You you know if the NSA is doing this?
(DIR) Post #AQk8VG9vHETGe8dl68 by EMR@mastodon.sdf.org
2022-12-18T18:32:24Z
0 likes, 0 repeats
@textfiles ohh, where do I find that/is there a way to search by station-year? I've been (passively) trying to track down a particular rendition of Here Comes The Sun that was used frequently as a bumper on WNPR around 2007-2010.
(DIR) Post #AQkAYJcf3WpoAJfQzg by tomnardi@hackaday.social
2022-12-18T18:59:38Z
0 likes, 0 repeats
@textfiles There was a very interesting talk about this concept at HOPE XII:https://hackaday.com/2018/07/23/hope-xiii-time-travel-with-software-defined-radio/https://youtu.be/Y8ZVroIIhcw
(DIR) Post #AQkCV9t0zxX10awHdQ by polygonpusher@synth.buzz
2022-12-18T19:36:21Z
0 likes, 0 repeats
@textfiles Understanding your signal to noise I think would be a great starting point. That will at least help you understand what can be ignored and what is of interest. With that you can optimize.
(DIR) Post #AQkERNinoiOmfTUNai by bobosv@mastodon.nu
2022-12-18T19:47:07Z
0 likes, 0 repeats
@textfiles Would be fun if we could have some special events... but... having that feature will make it hard to not save more... and more!! I like the idea!!I would like to have a day when there are some contests, i.e CQ WW cw/ssb https://www.cqww.com/ Maybe a day when the Grimeton transmitter is activeI would have loved to see the spectrum on 24/2 2022.. Or the days before/afterHmm.. what do you mean by spectrum btw??
(DIR) Post #AQkMs6VwhVyWkhjEY4 by JigmeDatse@mastodon.matrix.org
2022-12-18T23:40:29Z
0 likes, 0 repeats
@textfiles It sounds like a great idea, but as you say, storage is massive. I'm assuming that you can't really reduce that size without losing data?
(DIR) Post #AQkXcMNj2NtGpJZwiu by rotopenguin@mastodon.social
2022-12-19T01:30:59Z
0 likes, 0 repeats
@textfiles @supersat Q: which frequency?A: yes.
(DIR) Post #AQlFyAYA6VE0U9fbeq by textfiles@mastodon.archive.org
2022-12-19T09:57:19Z
0 likes, 0 repeats
@JigmeDatse I appear to have woken up some pretty smart people so we are gonna see what we can do.
(DIR) Post #AQpLnnBtTTt1V2Ws8u by Joeblo@fosstodon.org
2022-12-21T09:21:14Z
0 likes, 0 repeats
@textfiles It might be worth looking into ZFS file system. It offers high levels of compression for certain file types, and can also do deduplication. But I’m no expert. Only enthusiast. I highly recommend https://arstechnica.com/information-technology/2020/05/zfs-101-understanding-zfs-storage-and-performance/ as a starter point for anyone interested.
(DIR) Post #AQq28lwBWevdlhrsNk by zpercussion@social.opendesktop.org
2022-12-21T17:15:33Z
0 likes, 0 repeats
@textfilesIs this all under a specific collection?
(DIR) Post #AQq4NWNvpcHVml0Ut6 by textfiles@mastodon.archive.org
2022-12-21T17:40:59Z
0 likes, 0 repeats
@zpercussion it's all over
(DIR) Post #AQwe8kmEnolZNNOQQy by morpheu5@livellosegreto.it
2022-12-24T21:50:41Z
0 likes, 0 repeats
@textfiles Ok, I'm intrigued, tell me more. Specifically: what, and why. But also other things. I want to know.
(DIR) Post #AQwtO7TOCTVZQGMV4y by eric@ericpuryear.com
2022-12-25T00:43:09Z
0 likes, 0 repeats
@textfiles That is a very cool idea! On the plus side, 10TB stored on AWS Glacier deep archive is about $10/month, so a day a year is doable for sure.
(DIR) Post #AR3sVtUlJVFoXXrnzk by alphabet@chaos.social
2022-12-28T09:36:49Z
0 likes, 0 repeats
@textfiles Jason, you may have a look at https://github.com/oe2lsp/SDR-Buffer and check out the SDR Buffer instance located in Graz, Styria at the technical university: https://websdr.iks.tugraz.at/sdrbuffer/
(DIR) Post #AR8hxE7oarUyzrBlaq by bobosv@mastodon.nu
2022-12-30T17:29:04Z
0 likes, 0 repeats
@textfiles Worth looking in to?? https://www.youtube.com/watch?v=Y8ZVroIIhcw&list=WL&index=13