Storage specialist EMC has outlined a vision that takes the cloud concept to its ultimate conclusion - a global unified storage system that functions as a single resource pool.
The theoretical system, which would use YottaYotta technology, promises to be able to overcome limitations such as latency, bandwidth and cache coherency, to allow people from all over the world to access and update the data simultaneously.
EMC's future approach to storage virtualization, dubbed storage federation, will utilize “entirely new storage models – not only more efficient than their predecessors, but entirely new approaches to storage on demand,” EMC vice president Chuck Hollis said in a blog post.
Hollis acknowledged it was an ambitious goal. “For one thing, to be truly useful, storage federation must overcome many of the fundamental challenges that result from distance,” he said. “And this is hard for us -- both technologically as well as intellectually.”
Modern networking architecture is designed around limitations such as latency and bandwidth constraints, so designing storage architecture that breaks these barriers will require a complete rethink, he added.
Recent advances in technology have helped make the goal achievable, Hollis said. For example memory is becoming dirt cheap, so very large caches are becoming possible – one Cisco UCS supports 384 GB in a single blade.
EMC's proposed technology would use resources acquired from Canadian startup YottaYotta when it went bankrupt in 2008. YottaYotta built distributed caching technology clustered on WAN networks, connected via InfiniBand or GigE. When a file was changed on one end, it was updated across the cloud.
But “a fundamental new body of computer science research” will be required to enable the interconnection of multiple large, distributed caches – research that EMC s keen to kick-start.
The development of storage federation could help the industry move towards what EMC calls global federation – in which both storage systems and the applications that use them operate from a global dynamic pool of resources.
EMC cloud executive Pat Gelsinger has promised to reveal more at May's EMC World event in Boston.