| By Sid Probstein | Article Rating: |
|
| March 15, 2013 10:15 AM EDT | Reads: |
2,260 |
There is a backlash growing against the term "Big Data." Some of the negativity is just because of hype; people are attaching the name to their company for any reason, absurd reasons, and/or no reason at all.
I recently saw a pitch by a new venture that "creates Big Data for your business." Literally, they will create some for you if you don't already have any. It's hardly the most egregious example. We've seen mega-vendors twist their acquisitions into "Big Data" products, even though some of these technologies are 32-bit only, or have data sheets trumpeting claims like "handle up to 10M records." Big Data, indeed.

Another driver of the backlash is the cognitive dissonance that results from being told Big Data is all about huge data volumes or infrastructure that deal with it. Big Data has clearly emerged in the context of volume, but most companies are not Facebook, Zynga or the Large Hadron Collider. They simply do not have trucks filled with data unexpectedly arriving at the loading docks. Technical and data managers who grok the nature of the problem reject Big Data as a term in this context. They may even call it BS.
Yet another reason is disappointment and/or failure, as a result of overinvesting in "the volume problem." I recently spoke with a large bank that jumped on a popular open source product bandwagon, years before everyone else. They spent a fortune to do what they could have done much more easily and cheaply with existing tools. The lead manager admitted their team was more "driven by volume" and the hyped technologies used by exciting companies. They didn't consider that solving a different problem might produce more value for the bank, much more cost-effectively.
Where is Big Data headed? The good news is that rather than being rejected, the phenomenon of Big Data is morphing. It is becoming the art and science of actually using information to make decisions - more than ever before. And it is being driven by the success of companies that actually do that.
The real Big Data is driven by several factors... for one, the rapid creation of data, including voluminous data, from technical systems that interact with lots of people, where all those interactions are a multiple of the number of transactions that may ultimately occur. Another is the significant fall in the costs of storage and compute power, plus the emergence of 64-bit platforms that can use far more memory. But the real, underlying driver is...value.
Companies that have combined data volume with ubiquitous computing power and have actually brought the information together and analyzed it have found more... more customers, more profits and more growth. This is why Big Data is truly a phenomenon. Better approaches can be realized most everywhere. It cuts across industries, sectors, even countries. It is not just about things we have already defined well: volume, velocity, variety, etc. It is about the need to compete, and win, using information. Sometimes it is about figuring out how to get the data to make a better decision, and not just moving forward with gut instinct, in lieu of that.
It will stay big because when you look at what it really takes to make better decisions, there is a lot to it. Structured and unstructured. Internal and external. SQL and NoSQL. Volume, velocity and variety. Big Data is the discovery of how much data is not being used, and then realizing that changing that fact is the real challenge...and the real opportunity.
Published March 15, 2013 Reads 2,260
Copyright © 2013 SYS-CON Media, Inc. — All Rights Reserved.
Syndicated stories and blog feeds, all rights reserved by the author.
More Stories By Sid Probstein
Sid Probstein is the Chief Technology Officer of Attivio, responsible for product & technology strategy, implementation and delivery. He has over 20 years of experience in managing R&D organizations and delivering award-winning, high-value enterprise software and solutions. Previously, he was CTO at GetConnected, Inc. (GCi), a market-leading transaction processing platform enabling the sale of digital services. He was also Vice President of Technology at Fast Search & Transfer, a global enterprise search company that is now part of Microsoft Corporation.
Prior to Fast, Sid was Vice President of Engineering at Northern Light Technology, where he was responsible for production of the first enterprise version of the search engine. He also served as Director of Software Engineering at Freemark Communications, and a Principal Architect/System Manager at John Hancock Financial Services.
- Cloud People: A Who's Who of Cloud Computing
- New Relic Q1 2013 Blazes Past Growth Targets and Reaches 40,000 Active Customer Accounts
- Cloud Expo New York: Delivering Digital Marketing on the Cloud
- Cloud Expo New York: Rethink IT and Reinvent Business with IBM SmartCloud
- Cloudant to Exhibit at Cloud Expo & Big Data Expo New York
- The Accessibility of the Cloud
- Learn How To Use Google Apps Script
- Cloud Expo NY: Best Practices for Delivering Oracle Database as a Service
- Cloud Expo New York: Basics of SSD Technology and Its Use in Cloud
- Session Topics: 12th Cloud Expo / Cloud Expo New York
- Cloud Expo New York: The Big Challenge of Big Data & Hadoop Integration
- Measuring the Business Value of Cloud Computing
- Cloud People: A Who's Who of Cloud Computing
- Cloud Expo New York: Best CIO Practices Shared from SHI’s Customers
- Cloud Expo New York: How to Use Google Apps Script
- New Relic Q1 2013 Blazes Past Growth Targets and Reaches 40,000 Active Customer Accounts
- Cloud Expo New York: Why Big Data Is Really About Small Data
- Cloud Expo New York: Delivering Digital Marketing on the Cloud
- Small Cancers, Big Data, and a Life Examined
- Cloud Expo New York: Requirements of a Cloud Database
- Cloud Expo New York: Rethink IT and Reinvent Business with IBM SmartCloud
- Cloudant to Exhibit at Cloud Expo & Big Data Expo New York
- The Accessibility of the Cloud
- Learn How To Use Google Apps Script
- A Cup of AJAX? Nay, Just Regular Java Please
- Java Developer's Journal Exclusive: 2006 "JDJ Editors' Choice" Awards
- JavaServer Faces (JSF) vs Struts
- The i-Technology Right Stuff
- Rich Internet Applications with Adobe Flex 2 and Java
- Java vs C++ "Shootout" Revisited
- Bean-Managed Persistence Using a Proxy List
- Reporting Made Easy with JasperReports and Hibernate
- Creating a Pet Store Application with JavaServer Faces, Spring, and Hibernate
- Why Do 'Cool Kids' Choose Ruby or PHP to Build Websites Instead of Java?
- What's New in Eclipse?
- Where Are RIA Technologies Headed in 2008?





















