Big Data & Cloud Predictions for 2014

In 2013, we saw more and more big data projects move from the sandbox/proof-of-concept move into production and implementation. Big Data is not a brand new idea anymore; businesses know they need to tackle it and there are many helpful insights (and a few integration snags) coming out of such data. However, the cloud is in a very different phase, far past the initial hype and entering a new era of hybrid deployments, where the cloud extends transparently to the data center. In 2014, we can expect developments in both big data and cloud:

• Big Data and Cloud Grow Together: Most organizations know they should be using cloud platforms, but the main contribution of cloud computing to big data will shift. Soon, the cloud will serve as many sources of big data, from open data to social data to syndicated data – all sources providing energy and momentum for big data projects.

Enterprises should build a big data infrastructure that is comprehensive in the data sources it taps. Beyond “conventional” data sources (databases, ERP/CRM, etc.), this must expand to whichever other sources are relevant for the problem at hand.

• Hadoop Grows Up. Initially, Hadoop was essentially a single-task batch platform. With new advancements made in 2013 (such as YARN), Hadoop has become much more of a computing platform, able to run all kinds of concurrent workloads, some with “longer” response times, others in real-time. Many projects and companies are already using Hadoop 2.0, which will spur adoption. We can expect Hadoop to be the “next” enterprise computing platform, driving more real-time and operational uses of big data in 2014.

• Cloud Renders the Data Center Hybrid. Enterprises have adopted cloud computing, but cloud deployments remain very siloed and these systems running in the cloud don’t always work well with on-premises systems. Soon, the dichotomy between cloud-based and on-premises will become largely irrelevant. A broader use of virtualization, elastic deployment techniques, and hybrid integration platforms will enable fully hybrid deployment modes, oftentimes making it irrelevant to segment applications by in-cloud or on-premises.

• Big Data Goes Universal. This year, big data will go from being the new concept used for analytical purposes to a well-adopted practice for companies to better understand the behavior of customers, perform advanced risk analysis, etc. Essentially, the vast increase in the volume of data that can be stored or processed has allowed for enterprises to reap the benefits of big data. More data means more actionable insights.

In 2014, big data will start to be used for operational purposes and will be consumed by many applications, apps and devices. Now that the technology is becoming available, more and more use cases will appear over the year.

• Companies become Data Companies. No company can avoid being an IT company, it’s an essential part of every function and crucial to running a successful business. But in 2014, taking a step beyond IT, many companies will start to use data to profoundly transform their business and will either outright monetize their data assets, or exploit them to create new business models or take advantage of untapped segments. Companies won’t only be IT companies – they’ll be data companies.

Enterprises are just getting their hands dirty with big data – there is so much more to come. In the coming year, enterprises will be able to utilize new technology – especially the cloud – take advantage of integration systems and data tools. Buckle up, the big data hype is not over!

Yves de Montcheuil is the Vice President of Marketing at Talend, the recognized leader in open source integration. Yves holds a master’s degree in electrical engineering and computer science and has 20 years of experience in software product management, product marketing and corporate marketing. He is also a presenter, author, blogger, social media enthusiast, and can be followed on Twitter (News - Alert): @ydemontcheuil.