I recently attended the Strata + Hadoop World Conference in San Jose, and came away impressed with the accelerating pace of innovation in the world of Big Data. Companies and startups are innovating in every area of the Big Data value chain – from automating how data is collected, cleaned, and organized; to data governance and management; to data storage using a plethora of NoSQL database technologies; and to the numerous emerging tools for data science. Read More »
What’s the problem with Big Data? You guessed right — it’s BIG.
Big Data empowers organizations to discern patterns that were once invisible, leading to breakthrough ideas and transformed business performance. But there is simply so much of it, and from such myriad sources — customers, competitors, mobile, social, web, transactional, operational, internal, external, structured, and unstructured — that, for many organizations, Big Data is overwhelming. The torrents of data will only increase as the Internet of Everything spreads its ever-expanding wave of connectivity, from 10 billion connected things today to 50 billion in 2020.
So, how can organizations learn to use all of that data?
The key lies not in simply having access to enormous data streams. Information must be filtered for crucial, actionable insights, and presented to the right people in a visualized, comprehensible form. Only then will Big Data transform business strategies and decisions. In effect, Big Data must be made small.
However, as McKinsey & Co. reported, many organizations don’t have enough data scientists, much less ones who understand the business well enough to draw conclusions. The trick is to get the scientists together with the experts who understand the business levers driving the organization. Put them in a room with the right tools, and watch the synergy fly.
But what sort of a room?