Blockchain and big Data: A great mariage
| 12-2-2019 | Carlo de Meijer | treasuryXL
Blockchain and Big Data are among the emerging technologies that are high on many companies’ agendas. Both are expected to radically transform the way businesses and organizations are run in the upcoming years. Long-time developing in a separate way, at first sight one might assume that these technologies are mutually exclusive. But that idea is rapidly changing.
There are growing expectations that distributed ledgers will help enterprises finally get to grips with Big Data, which thus far is struggling with a number of challenges. They are both powerful on their own, however when combined they may bring a large number of opportunities. Some even say that blockchain and Big Data are made for one another.
“Big Data is an incredibly profitable business, with revenues expected to grow to $203 billion by 2020. The data within the blockchain is predicted to be worth trillions of dollars as it continues to make its way into banking, micropayments, remittances, and other financial services. In fact, the blockchain ledger could be worth up to 20% of the total big data market by 2030, producing up to $100 billion in annual revenue.” Chris Neimeth, COO of NYC Data Science Academy.
In this blog I will look at what the interception of these two innovations may bring. Could blockchain be the solution for the existing Big Data issues and challenges?
Big data and data science/analytics: present challenges
Big Data is one of the fastest growing sectors in the world. Every business wants to get insights into usage patterns of their consumers. Massive datasets are thereby analysed using advanced statistical models and data mining. These Big Data sets will become even more prevalent over the coming years.
“It’s not the amount of data that’s important. It’s what organizations do with the data that matters. Big data can be analysed for insights that lead to better decisions and strategic business moves.” Data Analytics Company SAS
“Data analytics has become the key to corporate competitive advantage because of its role in identifying emerging market trends. In turn, companies can use this information to make quicker and better decisions that help them drive profitability”.EY
The rise of Big Data has presented a slew of issues for both big businesses and everyday consumers. With the growth in data good analytics is becoming all the more problematic. Some major problems to data management and analytics include so-called dirty data, inaccessible data, and privacy issues. And as Big Data increases in size and the web of connected devices explodes, it exposes more of companies data to potential security breaches..
With the advent of Big Data, data quality management is both more important and more challenging than ever. Companies that are dealing with large datasets should ensure that the data are clean, secure and not been modified and come from an authentic source. They have to make sure that the latest version is synchronized among all of the data centres in real time. It should also be ensured that these data are accessible. For most, however, the data silos are still a major issue and a full company-wide digital transformation is still more concept that reality.
Blockchain and Big Data: two sides of the same coin
Main question is: how do both technologies relate to each other, if any? Notwithstanding blockchain has not been explored extensively in aspects of Big Data management and analytics, both technologies could and should be seen as two sides of the same coin.
While blockchain is focused on recording validating data (data integrity), data science analyses data for actionable insight, making predictions from large amounts of data (prediction). While blockchain is changing data management, the latter is transforming the nature of transactions. Or said in another way: “If Big Data is the quantity, blockchain is the quality”.
Read the full article of our expert Carlo de Meijer on LinkedIn
Economist and researcher
