Welcome!

Java IoT Authors: Liz McMillan, Elizabeth White, Pat Romanski, Yeshim Deniz, Frank Lupo

Related Topics: @BigDataExpo, Java IoT, @CloudExpo

@BigDataExpo: Blog Feed Post

Keys to Big Data Success? KISS! By @Schmarzo | @BigDataExpo #BigData

Just 27% of C-level executives interviewed in the study think their company makes “highly effective” use of data

A recent article on Fortune.com titled “Why Big Data Isn’t Paying Off for Companies (Yet)” highlights that the vast majority of companies are still struggling with big data. The article quotes a study from the American Institute of CPAs (AICPA) and its London counterpart, the Chartered Institute of Management Accountants:

Just 27% of C-level executives interviewed in the study think their company makes “highly effective” use of data, while about a third (32%) say access to mountains of information has actually “made things worse.”

The research highlighted three hurdles that are inhibiting big data success:

  • First, organizations are in too big a rush to do something. Consequently, they skip critical business and organizational alignment steps, and dive right into the technology decisions.
  • Second, organizations start too big. Organizations start by developing a “big data strategy” when they still do not know what they are trying to accomplish from a business perspective.
  • Third, organizations do not address the political issues upfront, hoping that these problems magically take care of themselves later

This dumbfounds me, because the key to business success with big data is the upfront work – the stuff that you must do before you dive into the technology.
To address these hurdles, we use a very simple approach called the Big Data Vision Workshop. The Big Data Vision Workshop focuses on driving the business success of big data by identifying and prioritizing the business, data, analytic, and organizational requirements necessary to support an organization’s targeted business initiatives.
Note: many organizations are confused about the difference between a “business initiative” and a “use case.” Here are my definitions:

  • A business initiative tends to be a cross-functional business priority that the organization is trying to accomplish over the next 9 to 12 months. A business initiative is “what” the organization is trying to accomplish over the next 9 to 12 months from a running the business perspective.
  • A use case identifies “how” the organization will achieve the business initiative. Think of the use case as a common grouping of decisions or outcomes that need to be accomplished for the organization to successfully achieve the business initiative.

For example, if the business initiative is to “improve customer acquisition”, then the use cases could include:

  • Improve customer profiling effectiveness
  • Improve customer segmentation and clustering effectiveness
  • Improve prospect targeting
  • Improve messaging effectiveness
  • Improve promotional effectiveness
  • Improve trial effectiveness
  • Optimize channel effectiveness
  • Improve re-targeting effectiveness
  • Etc.

But before describing the Big Data Vision Workshop process, I want to highlight some key principles behind it.

Big Data Vision Workshop Underlying Principles

  • Organizations do NOT need a big data strategy as much as they need a business strategy that incorporates big data.
  • Organizations don’t fail at big data because of a lack of business opportunities; they fail because they have too many.
  • Business and IT leaders must co-lead the big data journey starting with identifying, brainstorming, and prioritizing the big data business opportunities or analytics use cases.
  • Business leaders need to be committed to treating analytics as a business discipline, in the same way they treat accounting, finance, marketing and organizational sciences.
  • Organizations culturally need to embrace data and analytics in order to optimize their key business processes, uncover new monetization opportunities and deliver a more compelling customer experience.

If these principles conflict with your organization’s business and IT objectives, then the Big Data Vision Workshop is not for your organization.

Big Data Vision Workshop Description
The Big Data Vision Workshop is a 3 to 4 week engagement which is 100% focused on identifying and prioritizing the customer’s technology, data, organizational and business needs . The Big Data Vision Workshop is designed to show business leaders how they can start their big data journey today via an engagement that is:

  • Business-centric: focuses on identifying and prioritizing the data sources and analytics necessary to advance the client’s targeted business initiatives
  • Non-technology: creates 10 to 12 illustrative analytics use cases using data science on a small sample of the client’s data to demonstrate the “realm of what’s possible”
  • Organizational-alignment: drives IT and Business collaboration around high-value, high-feasibility use cases where the business owns business value determination and IT owns implementation feasibility determination

The Big Data Vision Workshop commits the first two days understanding the client’s strategic goals over the next 9-12 months, and then targets a business initiative on which to focus that supports those goals. Interviews (by business function) and group brainstorming sessions (across business functions) are conducted in order to capture the decisions, questions and data necessary to support the targeted business initiative (see Figure 1).

bill1

Figure 1: Business Initiative Requirements Decomposition

The Big Data Vision Workshop then acquires a small sample (5 to 10GB) of the client’s data. This data is used to build 10 to 12 illustrative analytics use cases to help the client understand the “realm of what’s possible” with respect to applying data science against their targeted business initiative. Simple mockups are also developed to show the business users how the resulting analytics could be deployed within their daily operations. The data science work typically takes 2 to 3 weeks of work.

The Big Data Vision Workshop engagement is capped with a half-day in-person “envisioning workshop” where we leverage facilitation techniques and group dynamics to identify, brainstorm, envision, value, and prioritize the different use cases that support the targeted business initiative (see Figure 2).

bill2

Figure 2: Big Data Vision Workshop Timeline and Key Steps

Bottom line: The Big Data Vision Workshop is 100% about driving the customer’s business success with big data.

The value of the Big Data Vision Workshop process may be best understood by viewing the deliverables that come out of the engagement.

Big Data Vision Workshop Deliverables

  • Interview Themes. We catalog the business opportunities that come out of the interviews and brainstorming sessions. We then rank the business opportunities on a scale from Tactical to Ambitious (see Figure 3).
bill3

Figure 3: Catalog of Business Opportunities or Interview Themes

  • Use Cases Detailed Descriptions. We aggregate the interview themes into common use cases (since the interviews can uncover many of the same business opportunities). For each use cases, we capture a description, and then document the business impact (based upon the organization’s business value drivers) and implementation feasibility issues (see Figure 4).
bill4

Figure 4: Use Case Description

  • Data Assessments. The data sources that come out of the interview and brainstorming processes then need to be assessed from a 1) business value and 2) implementation feasibility (over next 9 to 12 months) perspective. The business value assessment, which is driven by the business users, determines a rough estimate of the value for each data source in support of each use case. The implementation feasibility assessment, which is driven by IT, determines implementation feasibility across a number of data, technology and organization variables such as data accessibility, data cleanliness, data accuracy, cost, granularity, and IT and data science skills/capabilities (see Figure 5).
bill5

Figure 5: Data Assessment Matrices

  • Data Science Illustrative Analytics. Our data science team spends two to three weeks working with the client’s data to create illustrative analytics in support of the identified use cases. About 10 to 12 different illustrative analytics are created in order to help the business users to envision the realm of what is possible using predictive and prescriptive analytics. This converts a conceptual use case into its possible analytic forms. By far, this is my favorite part of the engagement (see Figure 6).
bill6

Figure 6: Data Science Illustrative Analytics

  • Mockups. We also create some simple mockups in order to help the business users to envision how the results of the predictive and prescriptive analytics might impact their daily operations. Note: these do not need to be fancy mockups. Heck, most of mine yea look like they were drawn with a crayon. But do not underestimate the importance of helping the business users to visualize how the analytic results might be delivered (see Figure 7).
bill7

Figure 7: Illustrative Mockups

  • Prioritization Matrix. The capstone deliverable is the Prioritization Matrix. I have written about the Prioritization Matrix before (Guiding the Envisioning Process: Prioritization Matrix Worksheets), but I will reiterate that the Prioritization Matrix is the single most important tool in my kit bag for driving organizational alignment. It is a very simple KISS (keep it simple stupid) tool which brings together the Business and IT leaders to discuss, debate, cajole, scream, and wrestle with where on the Prioritization Matrix to position each use case from a business value and implementation feasibility. The conversations that ensue during the business value and implementation feasibility debate can be the most important discussions to determining the success of the big data project (see Figure 8).
bill8

Figure 8: Prioritization Matrix

Big Data KISS Summary
To some, this will seem like a lot of unnecessary work before one starts to deploy the technology. Can’t one simply install the big data technology, load up some data, hire a data scientist or two, and then wait for magic to happen? But as the Forbes article highlights, that approach just does not work. Tick. Tock.

Want to achieve business success with Big Data? Hint: Start with the business! What is the business trying to accomplish over the next 9 to 12 months? Who are the key business stakeholders who either impact or are impacted by that key business initiative? What decisions do these stakeholders need to make in support of that key business initiative? What questions are the stakeholders trying to answer and what data do they need to answer those questions?

It is really that simple. Seriously. KISS

Keys to Big Data Success? KISS!
Bill Schmarzo

Read the original blog entry...

More Stories By William Schmarzo

Bill Schmarzo, author of “Big Data: Understanding How Data Powers Big Business”, is responsible for setting the strategy and defining the Big Data service line offerings and capabilities for the EMC Global Services organization. As part of Bill’s CTO charter, he is responsible for working with organizations to help them identify where and how to start their big data journeys. He’s written several white papers, avid blogger and is a frequent speaker on the use of Big Data and advanced analytics to power organization’s key business initiatives. He also teaches the “Big Data MBA” at the University of San Francisco School of Management.

Bill has nearly three decades of experience in data warehousing, BI and analytics. Bill authored EMC’s Vision Workshop methodology that links an organization’s strategic business initiatives with their supporting data and analytic requirements, and co-authored with Ralph Kimball a series of articles on analytic applications. Bill has served on The Data Warehouse Institute’s faculty as the head of the analytic applications curriculum.

Previously, Bill was the Vice President of Advertiser Analytics at Yahoo and the Vice President of Analytic Applications at Business Objects.

@ThingsExpo Stories
In his Opening Keynote at 21st Cloud Expo, John Considine, General Manager of IBM Cloud Infrastructure, will lead you through the exciting evolution of the cloud. He'll look at this major disruption from the perspective of technology, business models, and what this means for enterprises of all sizes. John Considine is General Manager of Cloud Infrastructure Services at IBM. In that role he is responsible for leading IBM’s public cloud infrastructure including strategy, development, and offering ...
SYS-CON Events announced today that N3N will exhibit at SYS-CON's @ThingsExpo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. N3N’s solutions increase the effectiveness of operations and control centers, increase the value of IoT investments, and facilitate real-time operational decision making. N3N enables operations teams with a four dimensional digital “big board” that consolidates real-time live video feeds alongside IoT sensor data a...
In a recent survey, Sumo Logic surveyed 1,500 customers who employ cloud services such as Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP). According to the survey, a quarter of the respondents have already deployed Docker containers and nearly as many (23 percent) are employing the AWS Lambda serverless computing framework. It’s clear: serverless is here to stay. The adoption does come with some needed changes, within both application development and operations. Tha...
SYS-CON Events announced today that Avere Systems, a leading provider of enterprise storage for the hybrid cloud, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Avere delivers a more modern architectural approach to storage that doesn't require the overprovisioning of storage capacity to achieve performance, overspending on expensive storage media for inactive data or the overbui...
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend 21st Cloud Expo October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.
SYS-CON Events announced today that mruby Forum will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. mruby is the lightweight implementation of the Ruby language. We introduce mruby and the mruby IoT framework that enhances development productivity. For more information, visit http://forum.mruby.org/.
Digital transformation is changing the face of business. The IDC predicts that enterprises will commit to a massive new scale of digital transformation, to stake out leadership positions in the "digital transformation economy." Accordingly, attendees at the upcoming Cloud Expo | @ThingsExpo at the Santa Clara Convention Center in Santa Clara, CA, Oct 31-Nov 2, will find fresh new content in a new track called Enterprise Cloud & Digital Transformation.
SYS-CON Events announced today that NetApp has been named “Bronze Sponsor” of SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. NetApp is the data authority for hybrid cloud. NetApp provides a full range of hybrid cloud data services that simplify management of applications and data across cloud and on-premises environments to accelerate digital transformation. Together with their partners, NetApp emp...
Smart cities have the potential to change our lives at so many levels for citizens: less pollution, reduced parking obstacles, better health, education and more energy savings. Real-time data streaming and the Internet of Things (IoT) possess the power to turn this vision into a reality. However, most organizations today are building their data infrastructure to focus solely on addressing immediate business needs vs. a platform capable of quickly adapting emerging technologies to address future ...
Amazon is pursuing new markets and disrupting industries at an incredible pace. Almost every industry seems to be in its crosshairs. Companies and industries that once thought they were safe are now worried about being “Amazoned.”. The new watch word should be “Be afraid. Be very afraid.” In his session 21st Cloud Expo, Chris Kocher, a co-founder of Grey Heron, will address questions such as: What new areas is Amazon disrupting? How are they doing this? Where are they likely to go? What are th...
Most technology leaders, contemporary and from the hardware era, are reshaping their businesses to do software. They hope to capture value from emerging technologies such as IoT, SDN, and AI. Ultimately, irrespective of the vertical, it is about deriving value from independent software applications participating in an ecosystem as one comprehensive solution. In his session at @ThingsExpo, Kausik Sridhar, founder and CTO of Pulzze Systems, will discuss how given the magnitude of today's applicati...
Join IBM November 1 at 21st Cloud Expo at the Santa Clara Convention Center in Santa Clara, CA, and learn how IBM Watson can bring cognitive services and AI to intelligent, unmanned systems. Cognitive analysis impacts today’s systems with unparalleled ability that were previously available only to manned, back-end operations. Thanks to cloud processing, IBM Watson can bring cognitive services and AI to intelligent, unmanned systems. Imagine a robot vacuum that becomes your personal assistant th...
SYS-CON Events announced today that SkyScale will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. SkyScale is a world-class provider of cloud-based, ultra-fast multi-GPU hardware platforms for lease to customers desiring the fastest performance available as a service anywhere in the world. SkyScale builds, configures, and manages dedicated systems strategically located in maximum-security...
SYS-CON Events announced today that Avere Systems, a leading provider of hybrid cloud enablement solutions, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Avere Systems was created by file systems experts determined to reinvent storage by changing the way enterprises thought about and bought storage resources. With decades of experience behind the company’s founders, Avere got its ...
SYS-CON Events announced today that Taica will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. ANSeeN are the measurement electronics maker for X-ray and Gamma-ray and Neutron measurement equipment such as spectrometers, pulse shape analyzer, and CdTe-FPD. For more information, visit http://anseen.com/.
High-velocity engineering teams are applying not only continuous delivery processes, but also lessons in experimentation from established leaders like Amazon, Netflix, and Facebook. These companies have made experimentation a foundation for their release processes, allowing them to try out major feature releases and redesigns within smaller groups before making them broadly available. In his session at 21st Cloud Expo, Brian Lucas, Senior Staff Engineer at Optimizely, will discuss how by using...
In this strange new world where more and more power is drawn from business technology, companies are effectively straddling two paths on the road to innovation and transformation into digital enterprises. The first path is the heritage trail – with “legacy” technology forming the background. Here, extant technologies are transformed by core IT teams to provide more API-driven approaches. Legacy systems can restrict companies that are transitioning into digital enterprises. To truly become a lead...
SYS-CON Events announced today that Yuasa System will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Yuasa System is introducing a multi-purpose endurance testing system for flexible displays, OLED devices, flexible substrates, flat cables, and films in smartphones, wearables, automobiles, and healthcare.
SYS-CON Events announced today that CAST Software will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CAST was founded more than 25 years ago to make the invisible visible. Built around the idea that even the best analytics on the market still leave blind spots for technical teams looking to deliver better software and prevent outages, CAST provides the software intelligence that matter ...
SYS-CON Events announced today that Daiya Industry will exhibit at the Japanese Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Ruby Development Inc. builds new services in short period of time and provides a continuous support of those services based on Ruby on Rails. For more information, please visit https://github.com/RubyDevInc.