This week we had an interesting discussion within the company that I work for about the true value of Big Data and the difference with a traditional IT solution. The fact that Big Data is not a out-of-the-shelf (COTS) solution but seems to be impacting the entire IT spectrum makes it very difficult to understand for the general public. But if nobody understands the necessity how did it emerged? Is Big Data just technology innovations on traditional BI?
The study that I am currently doing from the Big Data Science program from Arcitura™ is dedicated to exploring the concept from a vendor-neutral angle. This program describes the origin of Big Data as follows:
Big Data emerged from a combination of business needs and technology innovations.
if we believe Arcitura™ new business requirements combined with the evolution of IT in a fast-changing market is the foundation of the field dedicated to Big Data. The following section will outline the primary business and technology drivers that led to Big Data. These are also described extensively in module 1 (Fundamental Big Data) of the Big Data Science program from Arcitura™.
Analytics & Data Science
As growing enterprises are collecting and storing more data to potentially find new insights and gain a competitive edge, the need for techniques en technologies (for example machine learning algorithms) that can extract meaningful information and insights has increased.
For many businesses, digital mediums have replaced physical mediums as the de facto communications and delivery mechanism. Digitized data lead to an opportunity to collect data which can be important and useful for businesses.
Affordable Technology & Commodity Hardware
Technology related to collecting and processing large quantities of diverse data has become increasingly affordable. The use of commodity hardware makes the adoption of Big Data solutions accessible to businesses without large capital investments.
The rise of social media has empowered customers to provide feedback in near-realtime via open and public mediums, a shift that has forced businesses to consider customer feedback on their offerings in their strategy planning.
Hyper-Connected Communities & Devices
The broadening coverage of the internet and proliferation of smartphones and WiFi networks has enabled more people to be continuously active in virtual communities, either directly through online interaction or indirectly through the usage of connected devices like televisions, RFID, refrigerators and smart meters.
Cloud computing technology advancements have led to the creation of remote environments referred to as “clouds”. These environments are capable of providing highly scalable, on-demand IT resources that can be leased via pay-as-you-go models. The use of cloud computing makes the adoption of Big Data solutions accessible to businesses without large capital investments.