[HN Gopher] Cash App migrated 400TB of data to PlanetScale's cloud
       ___________________________________________________________________
        
       Cash App migrated 400TB of data to PlanetScale's cloud
        
       Author : mschoening
       Score  : 32 points
       Date   : 2024-11-12 20:45 UTC (2 hours ago)
        
 (HTM) web link (planetscale.com)
 (TXT) w3m dump (planetscale.com)
        
       | samlambert wrote:
       | We've loved working with the incredible team at Cash App. If
       | anyone has questions myself or someone on the PlanetScale team
       | will answer.
        
         | JTyQZSnP3cQGa8B wrote:
         | It would be interesting to know why a Bitcoin application
         | requires 400 TB of disk space.
        
           | ImPostingOnHN wrote:
           | The article says,
           | 
           |  _> At peak times, Cash App 's database handles approximately
           | 3-4 million queries per second (QPS) across 400 shards,
           | totaling around 400TiB of data._
           | 
           | 400TiB represents not a lot of this data. If each query
           | stored only 1 byte, this would only be 4 years worth of this
           | data.
           | 
           | If duplicated, or processed and the results stored, that
           | would add up, too.
        
             | echoangle wrote:
             | Why would a query store data? Are they logging individual
             | queries?
        
           | osser wrote:
           | It's peer-to-peer payments and banking, which have been
           | around for much longer than the stocks/bitcoin aspect of the
           | app.
        
           | znpy wrote:
           | It's not much data.
           | 
           | With current 22TB magnetic disks it's less than 20 disks,
           | they would fit into a single machine (4u, likely).
           | 
           | The Storinator XL60 from 45drives
           | (https://www.45drives.com/products/storinator-
           | xl60-configurat...) can hold 60 disks, for (advertised)
           | ~1.4PB of data.
           | 
           | (btw i've learned about 45drives through Linus Tech Tips
           | channel so I think it's obligatory to say LTTSTORE.COM - for
           | the meme)
        
       ___________________________________________________________________
       (page generated 2024-11-12 23:01 UTC)