Every story tagged Storage Systems, curated for CIOs and IT leaders — ranked by source credibility, engagement, and freshness.
2 stories · open in the command center
CASTOR is CERN's hierarchical storage management system that combines high-speed disk and cost-effective tape storage to manage massive physics data archives (scaling to ~100 PB), with a component-based architecture featuring automated tape management, metadata control, and Grid-based access protocols. As of June 2020, CASTOR has been succeeded by CTA (CERN Tape Archive), representing a critical infrastructure evolution for organizations managing petabyte-scale scientific data. For CIOs, this demonstrates the strategic importance of tiered storage architectures and automated lifecycle management in reducing long-term storage costs while maintaining data accessibility for large-scale research operations.
This article describes a custom single-node key-value storage engine that eliminates expensive fsync calls, achieving 64% higher throughput (190,985 vs 116,041 obj/s) by leveraging SSD-specific optimizations including pre-allocated files, O_DIRECT writes, and application-controlled journaling. For IT organizations, this represents a critical trade-off between generalized POSIX compliance and specialized performance gains—applicable only in narrowly scoped scenarios with SSD-only environments and simple KV semantics, with significant implications for storage architecture decisions in high-throughput systems. The approach demonstrates that moving durability guarantees from the filesystem layer into the application layer can unlock substantial performance improvements, but requires deep engineering investment and careful scope definition to avoid correctness pitfalls that could lead to data loss.