Part 1 in our series on Data Problems & Data Compression
Part of our series on Software and Data Management
Data Problems Are Only Growing
In the information age, data plays a vital part in the day-to-day operations of nearly every organization. Not long ago, data was measured in gigabytes. Now, many companies are dealing with terabytes, and in some cases petabytes, which truly boggles the mind. According to Data.gov, the Department of the Interior alone manages more than 40,000 databases, as of June 2017.
With more data comes the need for large databases. While popular database storage options like NoSQL and cloud storage seem to be able to handle these increasingly heavy loads, physically transferring mountains of data to a client is another story entirely, and often comes with its own unique set of challenges.
Disclaimer: transferring big data is a lower back hazard