https://blog.ligos.net/2022-04-02/The-Reliability-Of-Optical-Disks.html Murray's Blog About the things I make and do * Home * Contact * Donate * About [ ] Technical The Reliability of Optical Disks 2022-04-02 How long will burned CDs / DVDs / BluRays last? Background I just finished an extended series on Long Term Backups and Archives. A major shift in my personal and professional backup strategy is optical media, in particular, BluRay disks. In 2009, I said goodbye to my DVD based backup strategy, because it was taking multiple disks to do a weekly snapshot of my documents and data. And photos were already overflowing many DVDs. In 2017 my backup strategy involved: 1. Cloud based backups using [S:CrashPlan:S] BackBlaze. 2. Windows File History backups to a NAS. 3. Copy+Paste archives to external (offline) disks. Five years later, in 2022, my strategy has changed to: 1. Cloud based backups using OneDrive & BackBlaze. 2. Windows File History to my TrueNAS for particular content that doesn't live on OneDrive. 3. Archives to triplicate BluRay disks, indexed via WinCatalog, two copies stored offsite. Goal Discuss the reasons why I've moved back to optical disks as a key part of my backup strategy. With particular attention on the reliability of optical disks - BluRay disks and M-Disks. History My oldest backups are from the end of the year 2000, and are now on DVD+Rs. Originally, they were burned to CD-Rs, but I migrated all my CDs to DVDs at some point and discarded the original CDs. The oldest CD I can find is from 2003, containing a snapshot of all my documents at that time. Its hard to tell the oldest DVDs, but I think 2004 or 2005 was when I moved from CDs to DVDs for backups. Finally, the DVD era came to an end in 2009, giving way to HDDs and the cloud. CD Burned in 2003, DVD from ~2005 What I didn't realise at the time, was that all these CDs and DVDs would become a grand experiment of reliability and longevity. When I read data from these backup disks in 2021, I had a 100% success rate! That's a perfect record after being stored for 12-18 years, in semi-controlled conditions (darkness, but no temperature or humidity control) and zero maintenance! Discussion This high reliability is what drove me back to optical disks in 2021 - BluRay disks in particular. The 45+ year storage requirement for church compliance data made me re-think how my backups would survive in the long term. I wasn't comfortable with HDDs surviving that long, nor anything stored in the cloud. Tapes are cheap, but their drives are expense and my only experience with them is from 2002. It was only when I tested these CDs and DVDs that I realised optical was a contender! And further research showed that BluRay disks were readily available at a reasonable price. So why chose optical disks over the alternatives (tapes, HDDs, cloud)? As I've mentioned, having hard data of their long term reliability was a big factor. Getting any kind of real world reliability data of storage mediums is really, really hard. Backblaze releases HDD stats, which is the only public information I'm aware of. Otherwise, you have to trust the manufacturer's "mean time between failure" figure. And, when the time scales you're looking at is 45+ years, there is no real world data because no consumer digital storage technology has been invented for that long (tape have been around longer, but its not aimed at consumers). So, having a few hundred optical disks of 10+ year age that I could test is a huge plus. Real world data always trumps theory. Optical disks are write once. When it comes to storing compliance data, or long term backups that's a big plus. Because the only way data can be tampered with is by replacing an entire disk (not impossible, but tricky). While most storage mediums have some kind of "write protect" switch, write once optical media physically cannot be written to multiple times. Optical disks have less moving parts than HDDs, and thus less that can break. A HDD contains the physical media (disk platters), electronics to read said media, and software to make it all work. If any one of those parts fails, it can be difficult, expensive or impossible to recover data. Optical disks are just the physical media - the electronics and software are in a separate package (the reader). If your reader breaks, you buy a new one for $200 and move on. And if you media fails, well, you're no worse off than with HDDs. HDDs, especially NAS disks, have an "always on" assumption - the disks are always online. Indeed, the Backblaze data is all about disks that run 24/7. On one hand, that's great because the NAS can scrub disks to automatically detect and correct errors. On the other hand, that costs electricity. And if you ever wanted to take disks offline and store them on a shelf, you don't really know how long they'll survive - unless you plug them in every now and then. Optical disks, by definition, are "always offline". Once burned, they must remain stable without any scrubbing, error checking or automation. They will be stored in a jewel case or a spindle, and will rarely (possibly never) be read. And yet, the expectation is, that you will be able to read the disks without problem - even with zero maintenance. Indeed, that was the outcome of my ~15 year experiment! The write once and offline properties combine for another benefit: optical disks are ransomware proof. As long as your backups are connected to a network and writable, it's possible they could be encrypted and held to ransom (or simply deleted). That includes NAS servers, and the cloud. But, because optical disks are offline and immutable, no remote hacker or malware can touch it - the only way they could be held to ransom is via physical theft (very possible, but not the current strategy of Internet Bad Guys(tm)). Finally, BluRay disks improved the failure modes compared to CDs and DVDs. Their physical spec includes improvements such as a hard coating to reduce scratches, non-organic substrates, improved error correction, and improved track addressing. See references below for several white papers on BluRay physical specifications. (And I note these are theoretical improvements, only time will tell if they yield greater longevity). There are certainly problems with optical disks though: Their capacity isn't great compared to HDDs (or tape). In the physical space of two x 4 TB HDDs, you might be able to fit 10 x 12cm optical disks. The highest capacity BluRays are 128GB per disk, which is around 1.3TB in the same space. For my purposes, I'm not generating enough data for this to be a problem. But if you're dealing with 1080p or 4k video, you'll be filling many, many spindles of optical disks each year. Optical disks are slow to read. Their sequential read and random read speeds are 10-100x worse than even the slowest, cheapest HDD. My experience is that as optical disks age they become harder to read, which makes them slower still. So you don't want to be reading from them frequently, or doing a restore with the clock ticking. Given they're designed as long term media, this isn't a big problem - but something to be aware of. A big risk with optical disks is they are becoming a niche technology . That is, they aren't as mainstream as they used to be in the 2000s. Most laptops don't come with optical drives any more, and no one really misses them. Software and content is delivered by streaming rather than disks. So, its entirely possible they will go the way of floppy disks and become obsolete and difficult to purchase. As of 2022, it is possible to buy brand new BluRay readers and media - although I note eBay is your friend if you want to buy a wide variety of media. Because optical disks are offline media, you really need to index or catalogue their content. That is, without some kind of catalogue you can browse or search, it's somewhere between hard and impossible to find what you need. And putting 100 disks into a reader, one at a time, and slowly searching each of them really sucks (I tried). In the 2000s, I never bothered with this, but I've become more disciplined this time around and am using WinCatalog to catalogue all optical media. Finally, optical disks are more expensive than HDDs - at least in cost per GB. A 4TB NAS branded HDD costs ~AU$160, which is ~4c/GB. My last BluRay purchase was for 3 x 50 spindles of 25GB disks costing AU$330, which works out to be ~9c/GB. Obviously, you need a computer for that HDD, a reader for the BluRays, and factor in things like electricity and maintenance - a full total-cost-of-ownership comparison is more complex. But in raw capacity, HDDs are cheaper. Note that M-Disc BluRays are around 4x more expensive than regular BluRays, costing ~33c/GB. Test to Destruction Given the primary reason to chose optical media over HDDs is long term reliability, I decided I should put them to the test. I tested a DVD, 3 brands of BluRays (BD-R disks), and a BluRay M-Disc to destruction. There are four things that will destroy any kind of media: light, heat, moisture and time. I've already tried time (at least for ~15 years) and found CDs and DVDs are pretty resilient! So I moved onto light and heat (I didn't test against moisture). My light test consisted of placing the disk in an east facing window that would receive ~4 hours of direct sunlight each day. While this isn't entirely scientific because I wasn't testing all the disks at the same time (some were tested in Summer and others in Winter), it's still a place to start. I tested all disks this way. Sunlight Test: an East facing window My heat test is placing disks in a) my car (which is parked such that it has ~4 hours per day of sunlight) which acts as a greenhouse, b) my ceiling cavity (which is not insulated and can reach over 50 in Summer), and c) my freezer (which should be around -18). I only tested the BluRay M-Discs for heat. The TL;DR results: keep optical disks out of direct sunlight and you should be good for a long time. DVD, BluRays and M-Disc - All Tested to Destruction Results for direct sunlight: Days Disk Before Failure Mode Failure Completely unreadable; computer reports no disk DVD < 90 when inserted. I didn't check very diligently, so not sure exactly when it failed. BluRay 38 days Some sectors have errors; disk partially (Ritek) readable. BluRay 38 days Some sectors have errors; disk partially (Verbatum) readable. BluRay Some sectors have errors; disk readable after (Verbatum 260 days multiple attempts. M-Disc) * Note the M-Disc was tested over Winter rather than Summer. Direct sunlight is definitely something to avoid. Keeping your optical media in darkness is your number one priority in storage. Comparing longevity of regular vs M-Disc BluRay media, there's a factor of ~6x difference. The marketing claims of M-Disc is they should last for "at least 100 years". If we assume regular BluRays will last for the same 15 years as my CDs and DVDs, then an M-Disc should last ~90 years. That's not quite what the manufacturer claims, but close enough - and confirms M-Disc media lasts longer. Others have done similar test to destruction for M-disc media which support my results. Tests for heat / cold started in May 2021, and remain ongoing without failure (the 2021-2022 Summer was nowhere near as hot as previous year, so I suspect this test will continue for another year at least). The take away is: keep optical disks out of direct sunlight; even better in total darkness. Heat / cold seems to be less critical. Always Test I'm promoting optical media, and particularly BluRay M-Disc media, as a zero maintenance solution for long term data storage. However, given enough time, every form of digital media will eventually fail. As long as we a) have multiple copies of the data, and b) can make new copies faster than failures, all is well. That means we must have some kind of maintenance schedule in place to detect failures and make new copies. Data stored on a NAS server has a big advantage here: any NAS will automatically check for errors, and notify if problems are found. TrueNAS (via ZFS) will automatically correct errors. But checking optical media for errors cannot be automated (unless you can afford a robot / jukebox) because the disks are stored separately to your computer. Because I'm confident optical media, when stored away from direct light, will survive for 10 years, I'm going to check them every 5 years. At least until I get some failures, so have some idea of when failures are likely to happen. References * Wikipedia - Optical Disc * Wikipedia - Blu-ray * Wikipedia - Blu-ray Disc - recordable * Hughs News - Authoritative Blu-Ray FAQ * White Paper Blu-ray Disc Format - 1. A Physical Format Specifications for BD-RE, 5th Edition, January 2018 * White Paper Blu-ray Disc Format - 1. B Physical Format Specifications for BD-R, 5th Edition, October 2010 * White Paper Blu-ray Disc Format - 1. C Physical Format Specifications for BD-ROM, 6th Edition, October 2010 * White Paper Blu-ray Disc Recordable Format Part 1 - Physical Specifications, 5th Edition, February 2006 Conclusion Optical media, and BluRay M-Discs in particular, are the most reliable way to do long term, offline data storage. CDs and DVDs have lasted for 10-20 years and can still be read successfully. BluRay media offers disk capacity of 25-128GB, and should have similar longevity. The claims of special M-Disc media lasting 100+ years seems plausible - unfortunately, it will take another 99 years before we can confirm it! Anyone who wants an offline, ransomware proof, 20+ year backup should consider BluRay optical media. Share Comments Donate * Archive * Backup * BluRay * CD * DVD * Optical Please enable JavaScript to view the comments powered by Disqus. follow: * * * * older Long Term Archiving - Part 8 - Organising Data recents * Technical The Reliability of Optical Disks 2022-04-02 * Technical Long Term Archiving - Part 8 - Organising Data 2022-02-25 * Technical Long Term Archiving - Part 7 - File Formats 2021-11-28 * Technical Long Term Archiving - Part 6 - Implementation 2021-10-29 * Technical Long Term Archiving - Part 5 - Platform Options 2021-10-09 categories * Biblical8 * Coding14 * Cooking1 * Garden1 * Legal2 * Life Skills1 * Meta1 * Speaking1 * Technical72 archives * April 20221 * February 20221 * November 20211 * October 20212 * August 20211 * June 20212 * May 20211 * April 20211 * February 20211 * January 20211 * December 20201 * August 20201 * June 20202 * April 20203 * January 20201 * November 20192 * October 20191 * September 20191 * August 20191 * July 20191 * June 20191 * May 20192 * April 20192 * March 20192 * February 20191 * December 20182 * November 20182 * October 20181 * September 20182 * August 20181 * July 20182 * June 20181 * May 20181 * April 20182 * March 20182 * February 20183 * January 20183 * December 20172 * November 20171 * October 20171 * September 20172 * August 20171 * July 20173 * June 20172 * May 20173 * April 20172 * February 20171 * January 20172 * December 20161 * November 20161 * October 20161 * September 20162 * August 20161 * July 20163 * June 20162 * April 20165 * March 20162 * February 20162 * January 20165 tags * .NET14 * .NET Core3 * .NET Standard2 * 18091 * 3rd Party1 * 4G3 * A/V2 * About1 * Access Point2 * Accountability Software1 * Ad-Blocker1 * Admin Access1 * Agreement1 * Android3 * Apps1 * Archive9 * Archiving-Series8 * Async1 * Audio2 * Authoring1 * Autoruns1 * Azure1 * Backup12 * Baking1 * Bandwidth1 * Basics3 * Best Practice1 * Bible7 * Bible Study1 * Bible Talk7 * BitBucket1 * Blocking1 * Blog4 * BluRay1 * Blue Screen1 * Boot-Failure1 * Bricked1 * Broken1 * Bsod1 * Bug Check1 * Build1 * C#13 * CA1 * CD1 * CIFS1 * COVID-19-Series4 * CPRNG13 * CPU1 * Camera3 * Cellphone2 * Certificate2 * Certify1 * Church11 * Cloud2 * Codeplex1 * Compatibility1 * Compliance9 * Computer1 * Conceptual1 * Conditions1 * Configuration1 * Content1 * Costings1 * Covernant Eyes1 * Crash3 * Crashplan2 * Crypto13 * Cryptography1 * Custom Domain1 * Custom ROM1 * CyanogenMod1 * DNS3 * DVD1 * Day Night Cycle1 * Debian7 * DeleteFacebook1 * Diagnose1 * Dice13 * Disassemble1 * Disaster-Recovery1 * Downtime2 * Driver Verifier1 * DropBox1 * Dropbox2 * Easter4 * Easter Friday4 * Email1 * Event2 * Experiment1 * Failure2 * Fastboot1 * File History2 * File Sharing1 * File System1 * Firewall4 * Fortuna13 * Garden1 * Gateway4 * Gifts1 * Godliness1 * Good Friday4 * Guest2 * Guide4 * HDD1 * HFC1 * HTTP1 * HTTPS1 * Handbrake1 * Hard Disk1 * Hardware4 * Herbs1 * Hexo4 * Hexo-Bootstrap-Series4 * Home Router4 * Home Security3 * Honour1 * Hosting3 * How-To5 * Huawei1 * Hyper-V1 * IIS3 * IO1 * IPv61 * ISP1 * Idiot Poof1 * Induction1 * Install1 * Installation4 * Internals1 * Internet6 * Internode1 * Intro1 * Isolated3 * Keepass1 * Keybase1 * LSI1 * LTE3 * Laptop1 * Laptops1 * Large Files1 * Layered Service Provider1 * Legal10 * Lets Encrypt1 * Licensing1 * Lightning1 * LineageOS1 * Linux5 * Linux Mint1 * Live Stream1 * Malware1 * Management1 * Mapcrafter1 * Meetings1 * Messaging1 * Meta1 * Metadata1 * Microsoft1 * Microsoft Account1 * Migration2 * Mikrotik22 * Mobile Internet3 * Mobile Phone2 * Model N15W11 * Modem1 * Monitoring1 * Motherboard1 * MotionEye2 * Mount1 * NBN1 * NTP1 * Netboot1 * Netflow1 * Netinstall1 * Network6 * Networking3 * New User1 * Nfdump1 * Nginx2 * Nmap1 * NuGet1 * Nuke it from Orbit1 * October Update1 * Online2 * OpenSSL1 * Optical1 * Outage1 * PGP1 * PPPoE1 * Password1 * People1 * Philippians1 * Pi-Hole2 * Planning1 * Planting1 * Policy1 * Pool1 * Porting1 * Post-Processing1 * Presentation2 * Printer1 * Privacy1 * Property1 * Public Speaking8 * Python1 * RNG13 * Random13 * Raspberry Pi3 * ReadablePassphrase1 * ReadablePassphraseGenerator1 * Recipe1 * Remove1 * Repair1 * Resources1 * Restore2 * Reverse Proxy1 * Router6 * S/MIME1 * SMB1 * SMIME1 * SSD1 * SSL1 * Safe Mode1 * Samaba1 * Scheduler1 * Screen Cast1 * Script1 * Secure1 * Security3 * Seedlings1 * Self-Hosting1 * Sermon7 * Shame1 * Shortbread1 * Slack1 * Software1 * Speech2 * Spin 5 SP5131 * Spring1 * Step-By-Step4 * Storage Spaces2 * Storm1 * Streaming1 * Submission1 * Surveillance3 * Swedish Method1 * Switch2 * Sysinternals2 * Syslog1 * System-Image1 * Tear Down1 * Telstra1 * Terms1 * Terninger-Series13 * Threading3 * Titus1 * Transcoding1 * Troubleshooting2 * Ts&Cs1 * UEFI1 * Uninstall1 * Update1 * Upgrade2 * User1 * User Interface2 * VLAN2 * VPN1 * Vegies1 * Video5 * Video Conferencing1 * Visual1 * WIndows Upgrade1 * WSL1 * Wbadmin1 * Webserver1 * WiFi4 * Windbg1 * Windows8 * Windows 103 * Windows Activation1 * Windows-101 * Winsock1 * X.5091 * YouTube1 * Yubikey1 * ZFS1 * Zoom2 * adb1 * anti-virus1 * consoleblank1 * eM Client1 * malware1 * remove1 * security1 * setterm1 * systemd1 * uninstall1 * vLAN2 * virus1 * web.config1 tag cloud .NET .NET Core .NET Standard 1809 3rd Party 4G A/V About Access Point Accountability Software Ad-Blocker Admin Access Agreement Android Apps Archive Archiving-Series Async Audio Authoring Autoruns Azure Backup Baking Bandwidth Basics Best Practice Bible Bible Study Bible Talk BitBucket Blocking Blog BluRay Blue Screen Boot-Failure Bricked Broken Bsod Bug Check Build C# CA CD CIFS COVID-19-Series CPRNG CPU Camera Cellphone Certificate Certify Church Cloud Codeplex Compatibility Compliance Computer Conceptual Conditions Configuration Content Costings Covernant Eyes Crash Crashplan Crypto Cryptography Custom Domain Custom ROM CyanogenMod DNS DVD Day Night Cycle Debian DeleteFacebook Diagnose Dice Disassemble Disaster-Recovery Downtime Driver Verifier DropBox Dropbox Easter Easter Friday Email Event Experiment Failure Fastboot File History File Sharing File System Firewall Fortuna Garden Gateway Gifts Godliness Good Friday Guest Guide HDD HFC HTTP HTTPS Handbrake Hard Disk Hardware Herbs Hexo Hexo-Bootstrap-Series Home Router Home Security Honour Hosting How-To Huawei Hyper-V IIS IO IPv6 ISP Idiot Poof Induction Install Installation Internals Internet Internode Intro Isolated Keepass Keybase LSI LTE Laptop Laptops Large Files Layered Service Provider Legal Lets Encrypt Licensing Lightning LineageOS Linux Linux Mint Live Stream Malware Management Mapcrafter Meetings Messaging Meta Metadata Microsoft Microsoft Account Migration Mikrotik Mobile Internet Mobile Phone Model N15W1 Modem Monitoring Motherboard MotionEye Mount NBN NTP Netboot Netflow Netinstall Network Networking New User Nfdump Nginx Nmap NuGet Nuke it from Orbit October Update Online OpenSSL Optical Outage PGP PPPoE Password People Philippians Pi-Hole Planning Planting Policy Pool Porting Post-Processing Presentation Printer Privacy Property Public Speaking Python RNG Random Raspberry Pi ReadablePassphrase ReadablePassphraseGenerator Recipe Remove Repair Resources Restore Reverse Proxy Router S/MIME SMB SMIME SSD SSL Safe Mode Samaba Scheduler Screen Cast Script Secure Security Seedlings Self-Hosting Sermon Shame Shortbread Slack Software Speech Spin 5 SP513 Spring Step-By-Step Storage Spaces Storm Streaming Submission Surveillance Swedish Method Switch Sysinternals Syslog System-Image Tear Down Telstra Terms Terninger-Series Threading Titus Transcoding Troubleshooting Ts&Cs UEFI Uninstall Update Upgrade User User Interface VLAN VPN Vegies Video Video Conferencing Visual WIndows Upgrade WSL Wbadmin Webserver WiFi Windbg Windows Windows 10 Windows Activation Windows-10 Winsock X.509 YouTube Yubikey ZFS Zoom adb anti-virus consoleblank eM Client malware remove security setterm systemd uninstall vLAN virus web.config Murray's Blog (c) 2016 - 2022 Murray Grant * CC BY 4.0 Powered by Hexo. Hueman theme by PPOffice