Post ApiYyUI6U90CAtUVkW by sophieschmieg@infosec.exchange
 (DIR) More posts by sophieschmieg@infosec.exchange
 (DIR) Post #ApiYyUI6U90CAtUVkW by sophieschmieg@infosec.exchange
       2025-01-03T20:46:33Z
       
       1 likes, 2 repeats
       
       I was forwarded this screenshot and it just is living rent free in my head right now.
       
 (DIR) Post #ApiYyZuDbrSfaYMWLw by sophieschmieg@infosec.exchange
       2025-01-03T20:54:00Z
       
       2 likes, 0 repeats
       
       In case you do not know how GenAI works, here is a very abridged description: First you train your model on some inputs. This is using some very fancy linear algebra, but can be seen as mostly being a regression of some sorts, i.e. a lower dimensional approximation of the input data.Once training is completed, you have your model predict the next token of your output. It will do so by creating a list of possible tokens, together with a rank of how good of a fit the model considers the specific token to be. You then randomly select from that list of tokens, with a bias to higher ranked tokens. How much bias your random choice has depends on the "temperature" parameter, with a higher temperature corresponding to a less biased, i.e. more random selection. Now obviously, this process consumes a lot of randomness, and the randomness does not need to be cryptographically secure, so you usually use a statistical random number generator like the Mersenne twister at this step.So when they write "using a Gen AI model to produce 'true' random numbers", what they're actually doing is using a cryptographically insecure random number generator and applying a bias to the random numbers generated, making it even less secure. It's amazing that someone can trick anyone into investing into that shit.
       
 (DIR) Post #ApjNfnGMoprzAwWRMW by niconiconi@mk.absturztau.be
       2025-01-04T02:20:07.445Z
       
       2 likes, 1 repeats
       
       @sophieschmieg@infosec.exchange Ironically most GenAI implementations have troubles on producing deterministic output due to floating point errors, inconsistent batching, etc. Not random enough for crypto, but random enough to create replication problems. It's what I call Murphy's Duality Law - In engineering, when a system can show both the property "A" and its negation "not A" depending on the specific context, it's always the opposite of what your application needs.
       
 (DIR) Post #ApjNl4eRb4QWYJImn2 by drsbaitso@infosec.exchange
       2025-01-04T00:37:39Z
       
       1 likes, 0 repeats
       
       @sophieschmieg If LLMs are snake oil, this "AI RNG" is meta-snake oil. It's like expecting a homeopathy distillation of horse dewormer will cure Covid.It's so obviously fake that I can't even find a good metaphor to explain how bad it is.
       
 (DIR) Post #ApjNnpPSin329Mbjg8 by wordshaper@weatherishappening.network
       2025-01-03T20:48:40Z
       
       0 likes, 0 repeats
       
       @sophieschmieg https://giphy.com/explore/facepalm
       
 (DIR) Post #ApjNnq882imENtVPIe by wordshaper@weatherishappening.network
       2025-01-03T20:49:44Z
       
       1 likes, 0 repeats
       
       @sophieschmieg "We trained our neural net on thousands of images of lava lamps and can now generate an endless series of random numbers!"
       
 (DIR) Post #ApjNqRNyUy7EVf9pqq by sophieschmieg@infosec.exchange
       2025-01-03T21:22:18Z
       
       1 likes, 0 repeats
       
       @ireneista technically Bas got this one. But I do get my fair share of cranks, and have been for a while, cryptography just has a very high crank density.
       
 (DIR) Post #ApjNtRxsnlMBAtO8e0 by amberage@eldritch.cafe
       2025-01-03T20:52:43Z
       
       0 likes, 0 repeats
       
       @sophieschmieg ??? help
       
 (DIR) Post #ApjNtT2ApINoUUP4yG by amberage@eldritch.cafe
       2025-01-03T20:58:46Z
       
       1 likes, 0 repeats
       
       @sophieschmieg who would win:random numbers from radioactive decayheating the oceans and consuming the energy output of a small country to produce a bad imitation of radioactive decay
       
 (DIR) Post #ApjNuSsOtjPAI8J9LU by paulehoffman@infosec.exchange
       2025-01-03T21:15:35Z
       
       1 likes, 0 repeats
       
       @sophieschmieg Thank you for sharing the rent-free.And, yes, this person is real, and apparently believes he is doing something interesting. https://www.linkedin.com/in/eric-dresdale/ (don't have liquids in your mouth when reading…).
       
 (DIR) Post #ApjOVYf8LfPcx1n1zE by anthropy@mastodon.derg.nz
       2025-01-03T20:48:52Z
       
       0 likes, 0 repeats
       
       @sophieschmieg I know you have your methods, but if interested I've become the first only true random shitpost generator using my brain trained on naturally recurring shitposts with enough anthropy and randomness to defend against a whole quanta of warm tea
       
 (DIR) Post #ApjOVZgEZ3t26jJQLA by tek_dmn@mastodon.tekdmn.me
       2025-01-03T20:57:30Z
       
       0 likes, 0 repeats
       
       @anthropy Nah, you're not.The only true random shitpost generator on here is @sneexy@sophieschmieg
       
 (DIR) Post #ApjOVaTVbrImZYMm92 by anthropy@mastodon.derg.nz
       2025-01-03T20:58:50Z
       
       0 likes, 0 repeats
       
       @tek_dmn @sneexy  oh yea well HNNNGG *shitposts super hard like omg why would you shitpost that hard that's dangerous and bad for your blood pressure*
       
 (DIR) Post #ApjOVb1tY0o8ICSEk4 by anthropy@mastodon.derg.nz
       2025-01-03T20:59:59Z
       
       1 likes, 0 repeats
       
       @tek_dmn @sneexy I think I might've shitposted my pants :pensive_blob: