Welcome!

Java IoT Authors: Liz McMillan, APM Blog, Jnan Dash, Elizabeth White, Stackify Blog

Related Topics: @DXWorldExpo, Java IoT, @CloudExpo

@DXWorldExpo: Blog Feed Post

Keys to Big Data Success? KISS! By @Schmarzo | @BigDataExpo #BigData

Just 27% of C-level executives interviewed in the study think their company makes “highly effective” use of data

A recent article on Fortune.com titled “Why Big Data Isn’t Paying Off for Companies (Yet)” highlights that the vast majority of companies are still struggling with big data. The article quotes a study from the American Institute of CPAs (AICPA) and its London counterpart, the Chartered Institute of Management Accountants:

Just 27% of C-level executives interviewed in the study think their company makes “highly effective” use of data, while about a third (32%) say access to mountains of information has actually “made things worse.”

The research highlighted three hurdles that are inhibiting big data success:

  • First, organizations are in too big a rush to do something. Consequently, they skip critical business and organizational alignment steps, and dive right into the technology decisions.
  • Second, organizations start too big. Organizations start by developing a “big data strategy” when they still do not know what they are trying to accomplish from a business perspective.
  • Third, organizations do not address the political issues upfront, hoping that these problems magically take care of themselves later

This dumbfounds me, because the key to business success with big data is the upfront work – the stuff that you must do before you dive into the technology.
To address these hurdles, we use a very simple approach called the Big Data Vision Workshop. The Big Data Vision Workshop focuses on driving the business success of big data by identifying and prioritizing the business, data, analytic, and organizational requirements necessary to support an organization’s targeted business initiatives.
Note: many organizations are confused about the difference between a “business initiative” and a “use case.” Here are my definitions:

  • A business initiative tends to be a cross-functional business priority that the organization is trying to accomplish over the next 9 to 12 months. A business initiative is “what” the organization is trying to accomplish over the next 9 to 12 months from a running the business perspective.
  • A use case identifies “how” the organization will achieve the business initiative. Think of the use case as a common grouping of decisions or outcomes that need to be accomplished for the organization to successfully achieve the business initiative.

For example, if the business initiative is to “improve customer acquisition”, then the use cases could include:

  • Improve customer profiling effectiveness
  • Improve customer segmentation and clustering effectiveness
  • Improve prospect targeting
  • Improve messaging effectiveness
  • Improve promotional effectiveness
  • Improve trial effectiveness
  • Optimize channel effectiveness
  • Improve re-targeting effectiveness
  • Etc.

But before describing the Big Data Vision Workshop process, I want to highlight some key principles behind it.

Big Data Vision Workshop Underlying Principles

  • Organizations do NOT need a big data strategy as much as they need a business strategy that incorporates big data.
  • Organizations don’t fail at big data because of a lack of business opportunities; they fail because they have too many.
  • Business and IT leaders must co-lead the big data journey starting with identifying, brainstorming, and prioritizing the big data business opportunities or analytics use cases.
  • Business leaders need to be committed to treating analytics as a business discipline, in the same way they treat accounting, finance, marketing and organizational sciences.
  • Organizations culturally need to embrace data and analytics in order to optimize their key business processes, uncover new monetization opportunities and deliver a more compelling customer experience.

If these principles conflict with your organization’s business and IT objectives, then the Big Data Vision Workshop is not for your organization.

Big Data Vision Workshop Description
The Big Data Vision Workshop is a 3 to 4 week engagement which is 100% focused on identifying and prioritizing the customer’s technology, data, organizational and business needs . The Big Data Vision Workshop is designed to show business leaders how they can start their big data journey today via an engagement that is:

  • Business-centric: focuses on identifying and prioritizing the data sources and analytics necessary to advance the client’s targeted business initiatives
  • Non-technology: creates 10 to 12 illustrative analytics use cases using data science on a small sample of the client’s data to demonstrate the “realm of what’s possible”
  • Organizational-alignment: drives IT and Business collaboration around high-value, high-feasibility use cases where the business owns business value determination and IT owns implementation feasibility determination

The Big Data Vision Workshop commits the first two days understanding the client’s strategic goals over the next 9-12 months, and then targets a business initiative on which to focus that supports those goals. Interviews (by business function) and group brainstorming sessions (across business functions) are conducted in order to capture the decisions, questions and data necessary to support the targeted business initiative (see Figure 1).

bill1

Figure 1: Business Initiative Requirements Decomposition

The Big Data Vision Workshop then acquires a small sample (5 to 10GB) of the client’s data. This data is used to build 10 to 12 illustrative analytics use cases to help the client understand the “realm of what’s possible” with respect to applying data science against their targeted business initiative. Simple mockups are also developed to show the business users how the resulting analytics could be deployed within their daily operations. The data science work typically takes 2 to 3 weeks of work.

The Big Data Vision Workshop engagement is capped with a half-day in-person “envisioning workshop” where we leverage facilitation techniques and group dynamics to identify, brainstorm, envision, value, and prioritize the different use cases that support the targeted business initiative (see Figure 2).

bill2

Figure 2: Big Data Vision Workshop Timeline and Key Steps

Bottom line: The Big Data Vision Workshop is 100% about driving the customer’s business success with big data.

The value of the Big Data Vision Workshop process may be best understood by viewing the deliverables that come out of the engagement.

Big Data Vision Workshop Deliverables

  • Interview Themes. We catalog the business opportunities that come out of the interviews and brainstorming sessions. We then rank the business opportunities on a scale from Tactical to Ambitious (see Figure 3).
bill3

Figure 3: Catalog of Business Opportunities or Interview Themes

  • Use Cases Detailed Descriptions. We aggregate the interview themes into common use cases (since the interviews can uncover many of the same business opportunities). For each use cases, we capture a description, and then document the business impact (based upon the organization’s business value drivers) and implementation feasibility issues (see Figure 4).
bill4

Figure 4: Use Case Description

  • Data Assessments. The data sources that come out of the interview and brainstorming processes then need to be assessed from a 1) business value and 2) implementation feasibility (over next 9 to 12 months) perspective. The business value assessment, which is driven by the business users, determines a rough estimate of the value for each data source in support of each use case. The implementation feasibility assessment, which is driven by IT, determines implementation feasibility across a number of data, technology and organization variables such as data accessibility, data cleanliness, data accuracy, cost, granularity, and IT and data science skills/capabilities (see Figure 5).
bill5

Figure 5: Data Assessment Matrices

  • Data Science Illustrative Analytics. Our data science team spends two to three weeks working with the client’s data to create illustrative analytics in support of the identified use cases. About 10 to 12 different illustrative analytics are created in order to help the business users to envision the realm of what is possible using predictive and prescriptive analytics. This converts a conceptual use case into its possible analytic forms. By far, this is my favorite part of the engagement (see Figure 6).
bill6

Figure 6: Data Science Illustrative Analytics

  • Mockups. We also create some simple mockups in order to help the business users to envision how the results of the predictive and prescriptive analytics might impact their daily operations. Note: these do not need to be fancy mockups. Heck, most of mine yea look like they were drawn with a crayon. But do not underestimate the importance of helping the business users to visualize how the analytic results might be delivered (see Figure 7).
bill7

Figure 7: Illustrative Mockups

  • Prioritization Matrix. The capstone deliverable is the Prioritization Matrix. I have written about the Prioritization Matrix before (Guiding the Envisioning Process: Prioritization Matrix Worksheets), but I will reiterate that the Prioritization Matrix is the single most important tool in my kit bag for driving organizational alignment. It is a very simple KISS (keep it simple stupid) tool which brings together the Business and IT leaders to discuss, debate, cajole, scream, and wrestle with where on the Prioritization Matrix to position each use case from a business value and implementation feasibility. The conversations that ensue during the business value and implementation feasibility debate can be the most important discussions to determining the success of the big data project (see Figure 8).
bill8

Figure 8: Prioritization Matrix

Big Data KISS Summary
To some, this will seem like a lot of unnecessary work before one starts to deploy the technology. Can’t one simply install the big data technology, load up some data, hire a data scientist or two, and then wait for magic to happen? But as the Forbes article highlights, that approach just does not work. Tick. Tock.

Want to achieve business success with Big Data? Hint: Start with the business! What is the business trying to accomplish over the next 9 to 12 months? Who are the key business stakeholders who either impact or are impacted by that key business initiative? What decisions do these stakeholders need to make in support of that key business initiative? What questions are the stakeholders trying to answer and what data do they need to answer those questions?

It is really that simple. Seriously. KISS

Keys to Big Data Success? KISS!
Bill Schmarzo

Read the original blog entry...

More Stories By William Schmarzo

Bill Schmarzo, author of “Big Data: Understanding How Data Powers Big Business”, is responsible for setting the strategy and defining the Big Data service line offerings and capabilities for the EMC Global Services organization. As part of Bill’s CTO charter, he is responsible for working with organizations to help them identify where and how to start their big data journeys. He’s written several white papers, avid blogger and is a frequent speaker on the use of Big Data and advanced analytics to power organization’s key business initiatives. He also teaches the “Big Data MBA” at the University of San Francisco School of Management.

Bill has nearly three decades of experience in data warehousing, BI and analytics. Bill authored EMC’s Vision Workshop methodology that links an organization’s strategic business initiatives with their supporting data and analytic requirements, and co-authored with Ralph Kimball a series of articles on analytic applications. Bill has served on The Data Warehouse Institute’s faculty as the head of the analytic applications curriculum.

Previously, Bill was the Vice President of Advertiser Analytics at Yahoo and the Vice President of Analytic Applications at Business Objects.

@ThingsExpo Stories
Widespread fragmentation is stalling the growth of the IIoT and making it difficult for partners to work together. The number of software platforms, apps, hardware and connectivity standards is creating paralysis among businesses that are afraid of being locked into a solution. EdgeX Foundry is unifying the community around a common IoT edge framework and an ecosystem of interoperable components.
"MobiDev is a software development company and we do complex, custom software development for everybody from entrepreneurs to large enterprises," explained Alan Winters, U.S. Head of Business Development at MobiDev, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
In his session at 21st Cloud Expo, Carl J. Levine, Senior Technical Evangelist for NS1, will objectively discuss how DNS is used to solve Digital Transformation challenges in large SaaS applications, CDNs, AdTech platforms, and other demanding use cases. Carl J. Levine is the Senior Technical Evangelist for NS1. A veteran of the Internet Infrastructure space, he has over a decade of experience with startups, networking protocols and Internet infrastructure, combined with the unique ability to it...
"Space Monkey by Vivent Smart Home is a product that is a distributed cloud-based edge storage network. Vivent Smart Home, our parent company, is a smart home provider that places a lot of hard drives across homes in North America," explained JT Olds, Director of Engineering, and Brandon Crowfeather, Product Manager, at Vivint Smart Home, in this SYS-CON.tv interview at @ThingsExpo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"IBM is really all in on blockchain. We take a look at sort of the history of blockchain ledger technologies. It started out with bitcoin, Ethereum, and IBM evaluated these particular blockchain technologies and found they were anonymous and permissionless and that many companies were looking for permissioned blockchain," stated René Bostic, Technical VP of the IBM Cloud Unit in North America, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventi...
"Akvelon is a software development company and we also provide consultancy services to folks who are looking to scale or accelerate their engineering roadmaps," explained Jeremiah Mothersell, Marketing Manager at Akvelon, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Coca-Cola’s Google powered digital signage system lays the groundwork for a more valuable connection between Coke and its customers. Digital signs pair software with high-resolution displays so that a message can be changed instantly based on what the operator wants to communicate or sell. In their Day 3 Keynote at 21st Cloud Expo, Greg Chambers, Global Group Director, Digital Innovation, Coca-Cola, and Vidya Nagarajan, a Senior Product Manager at Google, discussed how from store operations and ...
Large industrial manufacturing organizations are adopting the agile principles of cloud software companies. The industrial manufacturing development process has not scaled over time. Now that design CAD teams are geographically distributed, centralizing their work is key. With large multi-gigabyte projects, outdated tools have stifled industrial team agility, time-to-market milestones, and impacted P&L stakeholders.
Gemini is Yahoo’s native and search advertising platform. To ensure the quality of a complex distributed system that spans multiple products and components and across various desktop websites and mobile app and web experiences – both Yahoo owned and operated and third-party syndication (supply), with complex interaction with more than a billion users and numerous advertisers globally (demand) – it becomes imperative to automate a set of end-to-end tests 24x7 to detect bugs and regression. In th...
"Cloud Academy is an enterprise training platform for the cloud, specifically public clouds. We offer guided learning experiences on AWS, Azure, Google Cloud and all the surrounding methodologies and technologies that you need to know and your teams need to know in order to leverage the full benefits of the cloud," explained Alex Brower, VP of Marketing at Cloud Academy, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clar...
"There's plenty of bandwidth out there but it's never in the right place. So what Cedexis does is uses data to work out the best pathways to get data from the origin to the person who wants to get it," explained Simon Jones, Evangelist and Head of Marketing at Cedexis, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
SYS-CON Events announced today that CrowdReviews.com has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5–7, 2018, at the Javits Center in New York City, NY. CrowdReviews.com is a transparent online platform for determining which products and services are the best based on the opinion of the crowd. The crowd consists of Internet users that have experienced products and services first-hand and have an interest in letting other potential buye...
SYS-CON Events announced today that Telecom Reseller has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. Telecom Reseller reports on Unified Communications, UCaaS, BPaaS for enterprise and SMBs. They report extensively on both customer premises based solutions such as IP-PBX as well as cloud based and hosted platforms.
It is of utmost importance for the future success of WebRTC to ensure that interoperability is operational between web browsers and any WebRTC-compliant client. To be guaranteed as operational and effective, interoperability must be tested extensively by establishing WebRTC data and media connections between different web browsers running on different devices and operating systems. In his session at WebRTC Summit at @ThingsExpo, Dr. Alex Gouaillard, CEO and Founder of CoSMo Software, presented ...
WebRTC is great technology to build your own communication tools. It will be even more exciting experience it with advanced devices, such as a 360 Camera, 360 microphone, and a depth sensor camera. In his session at @ThingsExpo, Masashi Ganeko, a manager at INFOCOM Corporation, introduced two experimental projects from his team and what they learned from them. "Shotoku Tamago" uses the robot audition software HARK to track speakers in 360 video of a remote party. "Virtual Teleport" uses a multip...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
SYS-CON Events announced today that Evatronix will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Evatronix SA offers comprehensive solutions in the design and implementation of electronic systems, in CAD / CAM deployment, and also is a designer and manufacturer of advanced 3D scanners for professional applications.
Leading companies, from the Global Fortune 500 to the smallest companies, are adopting hybrid cloud as the path to business advantage. Hybrid cloud depends on cloud services and on-premises infrastructure working in unison. Successful implementations require new levels of data mobility, enabled by an automated and seamless flow across on-premises and cloud resources. In his general session at 21st Cloud Expo, Greg Tevis, an IBM Storage Software Technical Strategist and Customer Solution Architec...
To get the most out of their data, successful companies are not focusing on queries and data lakes, they are actively integrating analytics into their operations with a data-first application development approach. Real-time adjustments to improve revenues, reduce costs, or mitigate risk rely on applications that minimize latency on a variety of data sources. In his session at @BigDataExpo, Jack Norris, Senior Vice President, Data and Applications at MapR Technologies, reviewed best practices to ...
An increasing number of companies are creating products that combine data with analytical capabilities. Running interactive queries on Big Data requires complex architectures to store and query data effectively, typically involving data streams, an choosing efficient file format/database and multiple independent systems that are tied together through custom-engineered pipelines. In his session at @BigDataExpo at @ThingsExpo, Tomer Levi, a senior software engineer at Intel’s Advanced Analytics gr...