How Cloud Technology Has Transformed Data Storage

We regularly hear (and say) buzzwords like big data, AI, Internet of Things (IoT)—but the modern day individual might not realize just how much data they use and collect every day. Think about how many apps you use for to-do lists and messaging programs, your daily exchange of videos and pictures, or all of your work and personal devices.

Even tech professionals might not stop to think about the staggering amount of data in the world. According to recent reports by the IDC, the global datasphere stands at 33 zettabytes (ZB), which is expected to grow to 175ZB by 2025. To put that in visual terms, David Reinsel, senior vice president at IDC, explains that if you stored that on Blu-ray discs, the stack would reach the moon, 23 times over. According to the Cisco Global Cloud Index, by 2021, 94 percent of workloads and compute instances will be processed by cloud data centers, meaning all but 6 percent of our data will be on the cloud.

As we create, save and access an enormous amount of data every day, we take for granted just how far cloud technologies have changed both personal and professional data storage. Let's dive into the evolution of everyday data storage in the face of the cloud, and how it has changed our lives as we know it.

Evolved and Improved Personal Storage

For the vast majority of us, the days of buying external storage, or bulking up local systems for storage are far behind us. The amount we're willing to pay regulates our level of storage, (typically via subscription). Many of us also hedge our bets across multiple accounts and cloud storage services for free-tier access. The impacts have radically changed data storage for consumers, but not necessarily reduced the risks of data loss, orphaned data, or service disruption when a given cloud provider changes their policies for storing your information (Google+ being the most recent example of policy change).

Services such as Apple's iCloud also span mobile and desktop platforms, offering a somewhat consolidated landing zone for the data we create between our various devices. Of course, as with any multi-device storage system, some kinks still need to be worked out.

The main result of the evolution of personal cloud usage is that 2.7 billion people walk around with devices in their pockets where they can quickly access: conversations threads from five years ago, thousands of high-res pictures, work databases, or see the person ringing their doorbell.

Offers Hybrid Solutions to Complex Enterprise Requirements

In our recent cloud migration survey of enterprise professionals across multiple industries, we found that nearly 50 percent of companies have already migrated to the cloud, with 45 percent currently undergoing a migration. As only 5.6 percent are actively planning an enterprise-level migration, we can surmise that cloud storage itself is now the industry standard. So mid-market companies are instead shifting focus to utilizing cloud services for their next generation of applications. I.e., now that we're all on the cloud, what else can it do for us?  

Amazon Web Services (AWS) serves as a leading example of a company that has re-built and expanded upon the storage industry as we used to know it. AWS users can access block (EBS), File (S3), Deep Archive/HSM (Glacier), Edge (CloudFront), and hyper-scalable file system storage (EFS) from a single provider, that continues to layer in advanced utilities such as backup and recovery, migration, and disaster recovery through a combination of recent product announcements and acquisitions. Compared to traditional on-site file storage, the cost differential is significant. However, with the lower price tag of AWS, there is a barrier to entry, as it requires developer savvy to run your storage infrastructure as code, coherently with the application and general services stack for users.

Innovations in Infrastructure

The tech industry loves to reinvent the same thing and call it new; however, in the world of data storage, there has been exciting cloud innovations to break from on-premises solutions. The evolution of large databases to data warehousing to big data, led to a major fork in the road with hyper-scalable data services started appearing, along with extremely powerful query engines and new data structures.

Companies can now create data lakes—digital DMZs to pool massive amounts of data, coupled with a mix of query/search/analytics tools and machine learning. This breakthrough warps the traditional concepts of structured and unstructured data into a brand new field of hyperscale data with machine driven intelligence and relevant outputs. The 'garbage in = garbage out' theory of mainframe computing still adheres—whereas the outputs are only as clever as the inputs from your data scientists.

Enables the Remote Workforce

We have reached the age of remote work—70 percent of employees work remotely at least once per week, and 53 percent work remotely for more than half of the week, according to an IWG global study. The remote workforce is due to such trends as Bring Your Own Device (BYOD), Desktop-as-a-Service (DaaS), and the rise of the gig economy. With the availability of hybrid-cloud-deployment to meet the needs of any organization, physical workspaces easily transform into digital.

The shift to remote workspaces not only equates increased productivity (scientifically proven), but employers have access to a more diverse talent pool and can save on overhead costs of traditional office spaces. Not to mention, the workers themselves experience better employment opportunities and work-life balance.

Dynamic Cloud Storage and Increasingly Big(ger) Data

With the ever-increasing amount of data in our lives, cloud technologies continue to evolve and adapt to meet the growing needs of consumers, corporations, workers, and employers. In the past decade, we've seen a complete overhaul of personal data (via the device-accessed cloud), the rise of the remote workforce, and the transformation of enterprise data structures.

Moreover, this is just the start; hybrid-cloud solutions will continue to scale to encompass the massive global datasphere.

Author: John Merryman is the managing director of Glasshouse.io, a technology company based in Australia that focuses on Cloud and workspace lifecycle management and helps customers embrace new technologies and operating models for enterprise compute and workspace services. Merryman has more than 20 years of experience leading technical services and product teams in both the United States and Australia. He has led teams and programs for cloud consulting, software development and more, and has delivered consulting engagements across a range of mobile, data center, cloud, voice technology, and mobile/AI/ML domains.