What is creating Big Data challenges for enterprises?

by CXOtoday News Desk    Sep 24, 2013

big data

A recent survey conducted by market research agency Vanson Bourne highlights that the majority of IT decision-makers at large organizations use manual processes to analyze and migrate stored data, rarely delete data, and add more storage when necessary. The survey, which includes responses from 300 US and UK-based IT decision makers, reveals how organizations are currently managing long-term data storage and the challenges associated with Big Data. 

Organizations across a number of sectors, including media and entertainment, life sciences, medical imaging, oil and gas, government, and video surveillance, are choosing to retain much of their data for extended periods.  A number of factors influence the trend toward extended data retention, including regulatory, compliance or governance requirements, as well as the opportunity to repurpose and monetize information in the future.

Some of the other highlights of the survey are:

- 68 percent of total respondents, including 81 percent of US-based respondents, manually analyze and move their long-term data to different locations, and delete limited amounts of stored data. This finding reflects the current data center trend toward needing to retain more than just email and compliance data for future reference.  Great tools have been created for long term storage and access to structured data; however, current unstructured file data migration to cost-effective tiers often requires more manual migration.

This response was slightly more pronounced in organizations with 1,001-3,000 employees, as 71 percent of those organizations and 65 percent of organizations with more than 3,000 employees noted they manage their long-term storage in this manner.

 - 62 percent of respondents, including 77 percent of US-based respondents, manage long-term data storage by adding more capacity when necessary and rarely delete data.  This finding reflects the growing recognition of the value of data to business growth and success.  Retaining historical data is helping fuel business analytics that predict future trends.

 - 65 percent of organizations with 1,001 to 3,000 employees and 59 percent of organizations with more than 3,000 employees noted they manage their long-term storage in this manner.

 - When it comes to storing data in the cloud, 63 percent of respondents expect to keep stored data for up to five (5) years. In addition, of all respondents surveyed more than 60 percent view cost as a barrier to storing data in the cloud for longer periods of time than they do currently.

 “The survey findings illustrate the need for new storage options that allow organizations to reduce the time spent manually managing long-term storage and easily interface with low cost storage tiers,” said Molly Rector, executive vice president of product management and worldwide marketing, Spectra Logic. “The low-cost nature of tape, combined with its scalability and durability, ensures it will continue to play an important role in modern and evolving IT environments.”