homeserver /how often do you replace your ssd? reddit / selfhosted ---------------------------------------------------------------------- PTRCLBN · 2023-12-27 12:24 Hi, How often do you replace your ssd? I think I'm screw with this one 😭 Samsung 870 EVO 1To : SMART Attributes Data Structure revision number: 1 Vendor Specific SMART Attributes with Thresholds: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 5 Reallocated_Sector_Ct 0x0033 076 076 010 Pre-fail Always - 231 9 Power_On_Hours 0x0032 095 095 000 Old_age Always - 24021 12 Power_Cycle_Count 0x0032 099 099 000 Old_age Always - 92 177 Wear_Leveling_Count 0x0013 099 099 000 Pre-fail Always - 12 179 Used_Rsvd_Blk_Cnt_Tot 0x0013 076 076 010 Pre-fail Always - 231 181 Program_Fail_Cnt_Total 0x0032 100 100 010 Old_age Always - 0 182 Erase_Fail_Count_Total 0x0032 100 100 010 Old_age Always - 0 183 Runtime_Bad_Block 0x0013 076 076 010 Pre-fail Always - 231 187 Uncorrectable_Error_Cnt 0x0032 095 095 000 Old_age Always - 46864 190 Airflow_Temperature_Cel 0x0032 068 038 000 Old_age Always - 32 195 ECC_Error_Rate 0x001a 199 199 000 Old_age Always - 46864 199 CRC_Error_Count 0x003e 100 100 000 Old_age Always - 0 235 POR_Recovery_Count 0x0012 099 099 000 Old_age Always - 34 241 Total_LBAs_Written 0x0032 099 099 000 Old_age Always - 14257928905 SMART Error Log Version: 1 ATA Error Count: 46899 (device log contains only the most recent five errors) ---------------------------------------------------------------------- bufandatl · 2023-12-27 12:31 When smart tells me to. But tbh if it has about 75% lifetime left I might already replace it and use the old drive as scratch drive or something. ---------------------------------------------------------------------- ipsirc · 2023-12-27 12:41 When falls out of the raid array. (1 hour to 10 years) ---------------------------------------------------------------------- gargravarr2112 · 2023-12-27 13:11 If you're getting Uncorrectable Errors, then yes, time to replace it. You can sometimes rescue such an SSD (though not the data, this will destroy all data on it) by forcing a write to every single sector - the controller will take note of bad sectors and reallocate them if it has any spares left. Yours has admittedly used 231 of them, which is not a happy number, but it may be worth a try - on Linux, you'd do a `dd` pass using `/dev/urandom` as the source, since SSDs can do clever things with predictable write patterns. I recently had two similar failures in the SSDs in my hypervisors. I lost a couple of VMs that way (thankfully rebuilding with Salt was not difficult). I wouldn't trust it with valuable data ever again. ---------------------------------------------------------------------- lilolalu · 2023-12-27 13:26 This is a bit anecdotal, since I don't remember the source but I think I read an article which said that SSD fail differently than HDD since they first throw write errors, but don't corrupt on disk data and read ops function normally. ---------------------------------------------------------------------- zezimeme · 2023-12-27 13:27 Dead after 6.6TB written? ---------------------------------------------------------------------- Sekhen · 2023-12-27 13:36 I only run on spinning rust. It's all second had 3-5 yr old stuff when I get it. So it's well tested. Over the past 10 years I've replaced 6 drives. ---------------------------------------------------------------------- APIeverything · 2023-12-27 13:53 That sucks, but you will learn from this mistake. I hold all my data / config files on a ZFS mirror on separate drives. That way, I can swap out the boot drives as needed. Look into Ansible if you are not already using it. I can rebuild my lab in less than 30 minutes, that including docker and KVM environments. If you host “valuable data” you cannot loose, you need keep external copies at the very least. Cloud archives are also a good option ---------------------------------------------------------------------- tomistruth · 2023-12-27 14:19 I have been warning about Samsung SSDs failing since the beginning of the year. I had the exact same model fail. I think all Samsung SSDs around 2018+ have the same problem. No matter Evo or Pro or normal series. They have an unusual high failure rate. I had THREE Samsung SSDs fail in just 13-15 months: 860, 870 Evo, 960 Pro. One failure, happens, 2 failures is bad luck, but 3 in just a year with minmal usage, then it's a structural problem. Samsung sold overheating controller chips with problematic memory chips. You should call warranty and then sell the new one on ebay and buy Western Digital Red. That's what I did. Do not trust your data with Samsung SSDs. ---------------------------------------------------------------------- SIN3R6Y · 2023-12-27 14:45 Consumer drives are basically garbage for long term usage like this. They are cheap because they are made with the lowest quality flash chips to meet a price point. You can often get used enterprise SSD's for similar prices. Even if they have only 90% life left, that's still more write cycles than most new consumer drives. ---------------------------------------------------------------------- Spuxilet · 2023-12-27 17:19 I have never had ssds other then Crucial. My first ssd which i got in 2014 is main drive in my homelab. OS is installed on it and it's still going strong. It's MLC ssd that is why it's so durable. Nowadays even samsung pro series are garbage. I have heard about samsungs problems that their ssds are failing left and right so i bought 2x2 TB Crucial T500. Great ssds for their price. ---------------------------------------------------------------------- Any-Understanding463 · 2023-12-27 17:20 İf ı have access to ssd i will still use hdd they last longer there is f*** hdd older than me runing still in some machines ---------------------------------------------------------------------- PTRCLBN · 2023-12-27 17:27 All valuable data are OK. I only miss some music or TV series. I had a crontab rsync task every night this ssd another one until early December. Don't ask my why I stopped it. But I definitely need to find something better. Gonna take a look at Ansible I also have multiple copy of sensitive data (syncthing) across all my computers and smartphone. ---------------------------------------------------------------------- PTRCLBN · 2023-12-27 17:31 1000 days running 24/7 😭 ---------------------------------------------------------------------- PTRCLBN · 2023-12-27 17:34 And may be 1 major power outage on 22 November (even my elevator has broke 😭😭😭) ---------------------------------------------------------------------- PTRCLBN · 2023-12-27 17:42 Thanks you all for your advice. I found an unused Lexar SSD NQ100 480GB in a drawer. It save the day for now. I have to find a good solution instead of rsync / syncthing for the futur and buy a brand new SSD. ---------------------------------------------------------------------- PTRCLBN · 2023-12-27 17:46 I also have to find something to monitor all ssd automatically and send mails on failure!? Don't even know if it's a thing 😅 ---------------------------------------------------------------------- PTRCLBN · 2023-12-27 17:47 Gonna take a look at wd red! ---------------------------------------------------------------------- PTRCLBN · 2023-12-27 17:50 Yep, that's what thought. Can't trust this ssd even if if try to rescue it. ---------------------------------------------------------------------- HighMarch · 2023-12-27 18:00 Firstly, if you're storing critical data on it, I hope you've backups or a raid or something. Second, you should always try to minimize the amount of critical data stored on stand-alone drives. For me personally: I replace ssd's when they fail, and refuse to boot. I have two machines with manual backups (it's on my list of things to fix), and I'd say at least half of the content on them that I'd worry about losing has been migrated/replicated to my NAS. My goal is to hit the point where a drive failure is inconvenient, but not the end of the world. I'm inching closer, but not there yet. ---------------------------------------------------------------------- -quakeguy- · 2023-12-27 18:07 You misunderstood the point. 6.6TB written at time of SSD death is a very VERY low number. Even the crappiest SSDs from years ago are rated for 100-150TB of writes. Most modern ones today are rated for 600-2000TB. ---------------------------------------------------------------------- PTRCLBN · 2023-12-27 18:11 Oh... Yeah I didn't get LBA thing 😔. Thanks for the translation (6.6Tb) ---------------------------------------------------------------------- ElevenNotes · 2023-12-27 18:47 Over 1200 NVMe SSD here, going strong since over a year. Have another 600 SATA SSD running since 5 years. No loss so far. Had a single NVMe "fail" but was fixed by a simple server reboot. It all depends on what SSD you use. I have 10 year old SLC SSD still running 24/7 with no errors. ---------------------------------------------------------------------- boocap · 2023-12-27 20:23 I was just having a comment section conversation about SSD vs HDD, was a fun one, basically my view and practice is SSDs are absolutely wonderful for day to day use, content creation, OS and gaming use, but I NEVER touch them for long term storage, I have a large mirrored raid and parity of spinning disks, my last drive fault was 2018, swapped in new and haven't had a failure since. Don't need blazing speeds for a big always on archive, especially over the network. ---------------------------------------------------------------------- no_step · 2023-12-28 12:58 I have a pair of Samsung 850 EVO (500gb) that have 58,000 hours (6.5 years) and 220TB of writes and still work fine, no errors reported