Welcome!

Java IoT Authors: Stackify Blog, Pat Romanski, Matt Lonstine, Glenda Sims, Paul Simmons

Related Topics: @DXWorldExpo, Java IoT, @ThingsExpo

@DXWorldExpo: Blog Feed Post

The Challenge of Macro Analytics (Economics) By @Schmarzo | @BigDataExpo #BigData

One of the most challenging & empowering concepts that I’ve learned from data scientist friends is the power of micro analytics

I recently had a chance to speak at The International Monetary Fund (IMF) big data symposium.  I was told to make my presentation a bit provocative, so I opened my session by stating to the economist audience “Aren’t you embarrassed that the CVS across the street knows more about the U.S. economy on a day-to-day basis than you do?”  Okay, so maybe that was a bit unfair, but the point behind the comment was not; which is that organizations need to think differently about how they leverage data and analytics to power their key business initiatives.  And for the IMF, that means changing how it thinks about macro analytics (and macro economics) in a world more and more driven by micro analytics (and micro economics).  Let me explain further.

One of the most challenging and empowering concepts that I’ve learned from my data scientist friends over the past couple of years is the power of micro analytics.  That is, the power of developing detailed analytic profiles at the individual customer/machine/device level with the goal of capturing that individual’s behaviors, tendencies, propensities, patterns, trends, interests, passions, associations and affiliations.  Once you have built these individual analytic profiles, then one can identify, quantify and act on behavioral changes at the individual level.

Equally important is the ability to aggregate these micro analytics to the macro level in order to make macro-level decisions and take macro-level actions.  To say this again, one needs to uncover insights at the micro or individual level in order to make decisions and deliver prescriptive recommendations at the macro level.

For example, Figure 2 shows a sample analytic profile developed for hospital patients.  The analytic profile is comprised of some basic demographic and current health data such as age, height, weight, body mass index, cholesterol levels, blood pressure, etc.  And because we have (or should have) a detailed history of the patient’s health treatments, medications, test results and general wellness on this patient, hospitals and physicians can quickly flag any concerning changes in that patient’s behaviors and clinical results (see figure 1).

Patient_Profile

Figure 1:  Patient Analytic Profile

But more important than just the demographics and the wellness data, is the ability to aggregate the wealth of internal and external data about the patient to create scores around those things that the hospital and physicians have deemed important; that is, build scores around those things that are key patient or hospital healthcare initiatives such as reducing strokes, reducing heart attacks, staph infections and improving the patient life expectancy.  Scores that could be developed to support those healthcare initiatives could include:

  • Diet score that leverages external data from apps such as MyFitnessPal, MyFoodDiary and MyPlate by LiveStrong
  • Exercise score leveraging external data from fitness trackers such as Garmin, Nike or Fitbit
  • Stress stores leveraging external data captured from mental acuity apps such as Lumosity, Fit Brains Trainer and Elevate

With these insights and scores, the hospital, physicians and nurses are ready to transition from a “when you are sick then I care” reactive care model to a “how do we improve the quality of your life” preventive care model (see figure 2).

Patient_app

Figure 2:  Patient Wellness Actionable Dashboard

So developing these detailed analytic profiles are key to uncovering actionable insights and personalized recommendations at the individual or micro level.  But how does one go from the micro level to the macro level?

Population Health Example
Let’s continue our healthcare example and look at the ramifications of micro level analysis in the area of population health.  Population health focuses on understanding the overall health and the potential health outcomes of groups of individuals.  For example, population health may predict a 25% uptick in influenza outbreaks in the Midwest in the month of January versus what was experienced over the past 3 years.  Typically, the different population health organizations would advise its patients to immediately get flu shots.

But what if:

  • There isn’t enough flu vaccine available for everyone, how do healthcare providers prioritize the flu vaccine supply in light of this predicted increase in influenza?
  • Should everyone get a shot or only those who are most likely to contract the influenza?
  • Should everyone get a shot immediately, or is there a way to delay some of the shots in order to optimize the current vaccine supply while more is being manufactured?
  • Are there some patients (e.g., elderly, infants, cancer patients) were the side effects of the shot are more risky than the influenza itself?

At the macro level, it is nearly impossible to make those decisions.  However at the patient (micro) level, we have the patient analytic profiles (with detailed care and treatment history coupled with relevant healthcare and wellness scores) that allows the healthcare providers to make the decisions about who should get the shots and when given the limited vaccine inventory and the potential benefits of the shots weighted against the potential side effects.

Once we have the detailed analysis and recommendations for the individual patients, then the behaviors, tendencies and predicted outcomes can be aggregated to the general population level to help the population health organizations (such as the World Health Organization) make general market decisions and drive actions.  These world health organizations will not only have more accurate insights about the constantly changing health across the country and across the world, but will now be in a position to make granular population recommendations about the characteristics of people who are most susceptible to the influenza outbreak (see figure 3).

patient_,micro

Figure 3:  Aggregating Micro Analysis to the Macro Level

Instead of making general recommendations at the population (macro) level, the population health organizations could instead work with local healthcare providers to uncover the detailed characteristics of the most susceptible members of the population, and then aggregate those different characteristics into more accurate and actionable general population recommendations and actions.

Micro Analytics Summary
Big data enables new ways to look at data, and probably one of the most powerful big data concepts is the ability to perform detailed individual customer (or device) level analysis to uncover very granular insights.  From these insights, individual recommendations can then be generated.

But these individual insights and recommendations can then be aggregated across a multitude of dimensions (e.g., merchant preferences, payment methods, behavioral tendencies, life stage categories) to come up with more accurate and more actionable recommendations at the macro level.  This is true in areas as diverse as population health and economics.  Think differently is always one of the biggest challenges in realizing the maximum business value from your big data initiatives.

Read the original blog entry...

More Stories By William Schmarzo

Bill Schmarzo, author of “Big Data: Understanding How Data Powers Big Business” and “Big Data MBA: Driving Business Strategies with Data Science”, is responsible for setting strategy and defining the Big Data service offerings for Dell EMC’s Big Data Practice. As a CTO within Dell EMC’s 2,000+ person consulting organization, he works with organizations to identify where and how to start their big data journeys. He’s written white papers, is an avid blogger and is a frequent speaker on the use of Big Data and data science to power an organization’s key business initiatives. He is a University of San Francisco School of Management (SOM) Executive Fellow where he teaches the “Big Data MBA” course. Bill also just completed a research paper on “Determining The Economic Value of Data”. Onalytica recently ranked Bill as #4 Big Data Influencer worldwide. Bill has over three decades of experience in data warehousing, BI and analytics. Bill authored the Vision Workshop methodology that links an organization’s strategic business initiatives with their supporting data and analytic requirements. Bill serves on the City of San Jose’s Technology Innovation Board, and on the faculties of The Data Warehouse Institute and Strata. Previously, Bill was vice president of Analytics at Yahoo where he was responsible for the development of Yahoo’s Advertiser and Website analytics products, including the delivery of “actionable insights” through a holistic user experience. Before that, Bill oversaw the Analytic Applications business unit at Business Objects, including the development, marketing and sales of their industry-defining analytic applications. Bill holds a Masters Business Administration from University of Iowa and a Bachelor of Science degree in Mathematics, Computer Science and Business Administration from Coe College.

@ThingsExpo Stories
In his session at 21st Cloud Expo, Carl J. Levine, Senior Technical Evangelist for NS1, will objectively discuss how DNS is used to solve Digital Transformation challenges in large SaaS applications, CDNs, AdTech platforms, and other demanding use cases. Carl J. Levine is the Senior Technical Evangelist for NS1. A veteran of the Internet Infrastructure space, he has over a decade of experience with startups, networking protocols and Internet infrastructure, combined with the unique ability to it...
"There's plenty of bandwidth out there but it's never in the right place. So what Cedexis does is uses data to work out the best pathways to get data from the origin to the person who wants to get it," explained Simon Jones, Evangelist and Head of Marketing at Cedexis, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"Cloud Academy is an enterprise training platform for the cloud, specifically public clouds. We offer guided learning experiences on AWS, Azure, Google Cloud and all the surrounding methodologies and technologies that you need to know and your teams need to know in order to leverage the full benefits of the cloud," explained Alex Brower, VP of Marketing at Cloud Academy, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clar...
Large industrial manufacturing organizations are adopting the agile principles of cloud software companies. The industrial manufacturing development process has not scaled over time. Now that design CAD teams are geographically distributed, centralizing their work is key. With large multi-gigabyte projects, outdated tools have stifled industrial team agility, time-to-market milestones, and impacted P&L stakeholders.
Gemini is Yahoo’s native and search advertising platform. To ensure the quality of a complex distributed system that spans multiple products and components and across various desktop websites and mobile app and web experiences – both Yahoo owned and operated and third-party syndication (supply), with complex interaction with more than a billion users and numerous advertisers globally (demand) – it becomes imperative to automate a set of end-to-end tests 24x7 to detect bugs and regression. In th...
"Akvelon is a software development company and we also provide consultancy services to folks who are looking to scale or accelerate their engineering roadmaps," explained Jeremiah Mothersell, Marketing Manager at Akvelon, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"MobiDev is a software development company and we do complex, custom software development for everybody from entrepreneurs to large enterprises," explained Alan Winters, U.S. Head of Business Development at MobiDev, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
SYS-CON Events announced today that CrowdReviews.com has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5–7, 2018, at the Javits Center in New York City, NY. CrowdReviews.com is a transparent online platform for determining which products and services are the best based on the opinion of the crowd. The crowd consists of Internet users that have experienced products and services first-hand and have an interest in letting other potential buye...
"IBM is really all in on blockchain. We take a look at sort of the history of blockchain ledger technologies. It started out with bitcoin, Ethereum, and IBM evaluated these particular blockchain technologies and found they were anonymous and permissionless and that many companies were looking for permissioned blockchain," stated René Bostic, Technical VP of the IBM Cloud Unit in North America, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventi...
SYS-CON Events announced today that Telecom Reseller has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. Telecom Reseller reports on Unified Communications, UCaaS, BPaaS for enterprise and SMBs. They report extensively on both customer premises based solutions such as IP-PBX as well as cloud based and hosted platforms.
"Space Monkey by Vivent Smart Home is a product that is a distributed cloud-based edge storage network. Vivent Smart Home, our parent company, is a smart home provider that places a lot of hard drives across homes in North America," explained JT Olds, Director of Engineering, and Brandon Crowfeather, Product Manager, at Vivint Smart Home, in this SYS-CON.tv interview at @ThingsExpo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Coca-Cola’s Google powered digital signage system lays the groundwork for a more valuable connection between Coke and its customers. Digital signs pair software with high-resolution displays so that a message can be changed instantly based on what the operator wants to communicate or sell. In their Day 3 Keynote at 21st Cloud Expo, Greg Chambers, Global Group Director, Digital Innovation, Coca-Cola, and Vidya Nagarajan, a Senior Product Manager at Google, discussed how from store operations and ...
It is of utmost importance for the future success of WebRTC to ensure that interoperability is operational between web browsers and any WebRTC-compliant client. To be guaranteed as operational and effective, interoperability must be tested extensively by establishing WebRTC data and media connections between different web browsers running on different devices and operating systems. In his session at WebRTC Summit at @ThingsExpo, Dr. Alex Gouaillard, CEO and Founder of CoSMo Software, presented ...
WebRTC is great technology to build your own communication tools. It will be even more exciting experience it with advanced devices, such as a 360 Camera, 360 microphone, and a depth sensor camera. In his session at @ThingsExpo, Masashi Ganeko, a manager at INFOCOM Corporation, introduced two experimental projects from his team and what they learned from them. "Shotoku Tamago" uses the robot audition software HARK to track speakers in 360 video of a remote party. "Virtual Teleport" uses a multip...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
SYS-CON Events announced today that Evatronix will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Evatronix SA offers comprehensive solutions in the design and implementation of electronic systems, in CAD / CAM deployment, and also is a designer and manufacturer of advanced 3D scanners for professional applications.
Leading companies, from the Global Fortune 500 to the smallest companies, are adopting hybrid cloud as the path to business advantage. Hybrid cloud depends on cloud services and on-premises infrastructure working in unison. Successful implementations require new levels of data mobility, enabled by an automated and seamless flow across on-premises and cloud resources. In his general session at 21st Cloud Expo, Greg Tevis, an IBM Storage Software Technical Strategist and Customer Solution Architec...
To get the most out of their data, successful companies are not focusing on queries and data lakes, they are actively integrating analytics into their operations with a data-first application development approach. Real-time adjustments to improve revenues, reduce costs, or mitigate risk rely on applications that minimize latency on a variety of data sources. In his session at @BigDataExpo, Jack Norris, Senior Vice President, Data and Applications at MapR Technologies, reviewed best practices to ...
An increasing number of companies are creating products that combine data with analytical capabilities. Running interactive queries on Big Data requires complex architectures to store and query data effectively, typically involving data streams, an choosing efficient file format/database and multiple independent systems that are tied together through custom-engineered pipelines. In his session at @BigDataExpo at @ThingsExpo, Tomer Levi, a senior software engineer at Intel’s Advanced Analytics gr...
When talking IoT we often focus on the devices, the sensors, the hardware itself. The new smart appliances, the new smart or self-driving cars (which are amalgamations of many ‘things’). When we are looking at the world of IoT, we should take a step back, look at the big picture. What value are these devices providing? IoT is not about the devices, it’s about the data consumed and generated. The devices are tools, mechanisms, conduits. In his session at Internet of Things at Cloud Expo | DXWor...