Managing disk storage was once simple, if we needed more space, we got a bigger disk drive. But data storage needs grew, so we started adding multiple disk drives. Finding and managing these became harder and took more time, so we developed RAID, network-attached storage and storage-area networks. Still, managing and maintaining thousands of disk drives became an ever more onerous task.
The latest answer to this dilemma is storage virtualization, which adds a new layer of software and/or hardware between storage systems and servers, so that applications no longer need to know on which specific drives, partitions or storage subsystems their data resides. Administrators can identify, provision and manage distributed storage as if it were a single, consolidated resource. Availability also increases with storage virtualization, since applications aren't restricted to specific storage resources and are thus insulated from most interruptions.
“Storage virtualization is part of two ongoing, larger storage industry trends and innovations – the move to place storage processing functions as close as possible (in the storage system controller) to the actual data being processed, and the increasing commoditization of storage industry hardware components,” says Tony Ward, GM, Hitachi Data Systems Middle East, North Africa & Turkey.
Also, storage virtualization generally helps automate the expansion of storage capacity, reducing the need for manual provisioning. Storage resources can be updated on the fly without affecting application performance, thus reducing downtime.
“Due to the complexity and the infrastructure challenges that enterprise are facing today, like the exponential growth of data, managing heterogeneous environment, protecting data, and the need for quick services deployments, etc…storage virtualization provides simple storage management and increased storage resource utilization and flexibility while reducing management overhead and increasing uptime, it also leverages and compliments existing storage infrastructure,” says Said Akar, Pre-Sales Manager, EMC Middle East & North West Africa.
Virtualization also simplifies storage management. “Storage administrators have to deal with requests from application or server administrators for new LUNs, extension of existing LUNs and retrieval of LUNs. The simplicity of virtualization relieves storage managers of these routine tasks. It opens up leeway for other administrators to deploy “their” storage, while the storage manager still defines the policies,” says Martyn Molnar, Regional Director Middle East, North & South Africa and Pakistan at NetApp.
Another benefit is cost savings for power and cooling since the use of fewer servers and storage systems radically affects the power and cooling requirements. In addition, the ease of deployment of virtualized environments provides the organizations with the flexibility and adaptability to surrounding changing business environments.
Technical Matters
Because virtualization operates as an intermediate layer, it becomes the primary interface between servers and storage. Servers see the virtualization layer as a single storage device, while all the individual storage devices see the virtualization layer as their only server. This makes it easy to group storage systems — even devices from different vendors — into tiers of storage.
This layer shields servers and applications from changes to the storage environment, letting users easily hot-swap a disk or tape drive. Data-copying services are also managed at the virtualization layer. This means that data replication, whether for snapshot or disaster recovery, can be handled entirely by the virtualization system, often in the background, with a common management interface. Because data can be moved at will, lightly used or outdated data can be easily moved to slower, less-expensive storage devices.
Storage virtualization can be structured in three ways:
• Host-based. Here, physical drives are handled by a traditional device driver, while a software layer above the device driver intercepts I/O requests, looks up metadata and redirects I/O.
• Storage-device-based. In this type of setup, virtualization can be built into the storage fabric; for example, newer RAID controllers allow other storage devices to be attached downstream. A primary storage controller (usually a dedicated hardware appliance, though some systems now use switches) handles pooling and manages metadata, allowing the direct attachment of other storage controllers. Such systems may also provide replication and migration services across different controllers.
• Network-based. In this configuration, storage virtualization is viewed as a network-based device, generally using Fibre Channel networks connected as a SAN. Here, too, an appliance or switch-based implementation is most common.
Experienced users agree that all three approaches can work well. But although virtualization promotes cross-vendor storage utilization, most implementations lock you into a specific vendor.
