[HN Gopher] Lyra V2 - a better, faster, and more versatile speec...
___________________________________________________________________
Lyra V2 - a better, faster, and more versatile speech codec
Author : HieronymusBosch
Score : 28 points
Date : 2022-09-30 21:35 UTC (1 hours ago)
(HTM) web link (opensource.googleblog.com)
(TXT) w3m dump (opensource.googleblog.com)
| bumblebritches5 wrote:
| petercooper wrote:
| That sample at 3200 bits per second is fantastic for such a low
| bitrate. I also love how that works out at 1.44MB/hr.. one floppy
| disk per hour!
| learndeeply wrote:
| It would be nice to compare it to a higher quality sample,
| currently the samples sound like they were recorded through a
| telephone (4 khz).
| simlevesque wrote:
| It's meant to be a phone codec.
| rektide wrote:
| Very impressive.
|
| It'd be interesting to see what the lift would be to get encoding
| & decoding running in webassembly/wasm. Further, it'd be really
| neat to try to take something like the tflife_model_wrapper[1]
| and to get it backed by something like tsjs-tflite[2] perhaps
| running atop for example tfjs-backend-webgpu[3].
|
| Longer run, the web-nn[4] spec should hopefully simplify/bake-in
| some of these libraries to the web platform, make running
| inference much easier. But there's still an interesting challenge
| & question, that I'm not sure how to tackle; how to take native
| code, compile it to wasm, but to have some of the implementation
| provided else-where.
|
| At the moment, Lyra V2 can already use XNNPACK[4], which does
| have a pretty good wasm implementation. But trying to swap out
| implementations, so for example we might be able to use the GPU
| or other accelerators, could still have some good benefits on
| various platforms.
|
| [1] https://github.com/google/lyra/pull/89/files#diff-
| ed2f131a63...
|
| [2] https://www.npmjs.com/package/@tensorflow/tfjs-tflite
|
| [3] https://www.npmjs.com/package/@tensorflow/tfjs-backend-
| webgp...
|
| [4] https://www.w3.org/TR/webnn/
|
| [5] https://github.com/google/XNNPACK
___________________________________________________________________
(page generated 2022-09-30 23:00 UTC)