Welcome!

Java IoT Authors: Yeshim Deniz, Pat Romanski, Liz McMillan, Zakia Bouachraoui, Carmen Gonzalez

Related Topics: @DXWorldExpo, Java IoT, @ThingsExpo

@DXWorldExpo: Blog Feed Post

The Challenge of Macro Analytics (Economics) By @Schmarzo | @BigDataExpo #BigData

One of the most challenging & empowering concepts that I’ve learned from data scientist friends is the power of micro analytics

I recently had a chance to speak at The International Monetary Fund (IMF) big data symposium.  I was told to make my presentation a bit provocative, so I opened my session by stating to the economist audience “Aren’t you embarrassed that the CVS across the street knows more about the U.S. economy on a day-to-day basis than you do?”  Okay, so maybe that was a bit unfair, but the point behind the comment was not; which is that organizations need to think differently about how they leverage data and analytics to power their key business initiatives.  And for the IMF, that means changing how it thinks about macro analytics (and macro economics) in a world more and more driven by micro analytics (and micro economics).  Let me explain further.

One of the most challenging and empowering concepts that I’ve learned from my data scientist friends over the past couple of years is the power of micro analytics.  That is, the power of developing detailed analytic profiles at the individual customer/machine/device level with the goal of capturing that individual’s behaviors, tendencies, propensities, patterns, trends, interests, passions, associations and affiliations.  Once you have built these individual analytic profiles, then one can identify, quantify and act on behavioral changes at the individual level.

Equally important is the ability to aggregate these micro analytics to the macro level in order to make macro-level decisions and take macro-level actions.  To say this again, one needs to uncover insights at the micro or individual level in order to make decisions and deliver prescriptive recommendations at the macro level.

For example, Figure 2 shows a sample analytic profile developed for hospital patients.  The analytic profile is comprised of some basic demographic and current health data such as age, height, weight, body mass index, cholesterol levels, blood pressure, etc.  And because we have (or should have) a detailed history of the patient’s health treatments, medications, test results and general wellness on this patient, hospitals and physicians can quickly flag any concerning changes in that patient’s behaviors and clinical results (see figure 1).

Patient_Profile

Figure 1:  Patient Analytic Profile

But more important than just the demographics and the wellness data, is the ability to aggregate the wealth of internal and external data about the patient to create scores around those things that the hospital and physicians have deemed important; that is, build scores around those things that are key patient or hospital healthcare initiatives such as reducing strokes, reducing heart attacks, staph infections and improving the patient life expectancy.  Scores that could be developed to support those healthcare initiatives could include:

  • Diet score that leverages external data from apps such as MyFitnessPal, MyFoodDiary and MyPlate by LiveStrong
  • Exercise score leveraging external data from fitness trackers such as Garmin, Nike or Fitbit
  • Stress stores leveraging external data captured from mental acuity apps such as Lumosity, Fit Brains Trainer and Elevate

With these insights and scores, the hospital, physicians and nurses are ready to transition from a “when you are sick then I care” reactive care model to a “how do we improve the quality of your life” preventive care model (see figure 2).

Patient_app

Figure 2:  Patient Wellness Actionable Dashboard

So developing these detailed analytic profiles are key to uncovering actionable insights and personalized recommendations at the individual or micro level.  But how does one go from the micro level to the macro level?

Population Health Example
Let’s continue our healthcare example and look at the ramifications of micro level analysis in the area of population health.  Population health focuses on understanding the overall health and the potential health outcomes of groups of individuals.  For example, population health may predict a 25% uptick in influenza outbreaks in the Midwest in the month of January versus what was experienced over the past 3 years.  Typically, the different population health organizations would advise its patients to immediately get flu shots.

But what if:

  • There isn’t enough flu vaccine available for everyone, how do healthcare providers prioritize the flu vaccine supply in light of this predicted increase in influenza?
  • Should everyone get a shot or only those who are most likely to contract the influenza?
  • Should everyone get a shot immediately, or is there a way to delay some of the shots in order to optimize the current vaccine supply while more is being manufactured?
  • Are there some patients (e.g., elderly, infants, cancer patients) were the side effects of the shot are more risky than the influenza itself?

At the macro level, it is nearly impossible to make those decisions.  However at the patient (micro) level, we have the patient analytic profiles (with detailed care and treatment history coupled with relevant healthcare and wellness scores) that allows the healthcare providers to make the decisions about who should get the shots and when given the limited vaccine inventory and the potential benefits of the shots weighted against the potential side effects.

Once we have the detailed analysis and recommendations for the individual patients, then the behaviors, tendencies and predicted outcomes can be aggregated to the general population level to help the population health organizations (such as the World Health Organization) make general market decisions and drive actions.  These world health organizations will not only have more accurate insights about the constantly changing health across the country and across the world, but will now be in a position to make granular population recommendations about the characteristics of people who are most susceptible to the influenza outbreak (see figure 3).

patient_,micro

Figure 3:  Aggregating Micro Analysis to the Macro Level

Instead of making general recommendations at the population (macro) level, the population health organizations could instead work with local healthcare providers to uncover the detailed characteristics of the most susceptible members of the population, and then aggregate those different characteristics into more accurate and actionable general population recommendations and actions.

Micro Analytics Summary
Big data enables new ways to look at data, and probably one of the most powerful big data concepts is the ability to perform detailed individual customer (or device) level analysis to uncover very granular insights.  From these insights, individual recommendations can then be generated.

But these individual insights and recommendations can then be aggregated across a multitude of dimensions (e.g., merchant preferences, payment methods, behavioral tendencies, life stage categories) to come up with more accurate and more actionable recommendations at the macro level.  This is true in areas as diverse as population health and economics.  Think differently is always one of the biggest challenges in realizing the maximum business value from your big data initiatives.

Read the original blog entry...

More Stories By William Schmarzo

Bill Schmarzo, author of “Big Data: Understanding How Data Powers Big Business” and “Big Data MBA: Driving Business Strategies with Data Science”, is responsible for setting strategy and defining the Big Data service offerings for Hitachi Vantara as CTO, IoT and Analytics.

Previously, as a CTO within Dell EMC’s 2,000+ person consulting organization, he works with organizations to identify where and how to start their big data journeys. He’s written white papers, is an avid blogger and is a frequent speaker on the use of Big Data and data science to power an organization’s key business initiatives. He is a University of San Francisco School of Management (SOM) Executive Fellow where he teaches the “Big Data MBA” course. Bill also just completed a research paper on “Determining The Economic Value of Data”. Onalytica recently ranked Bill as #4 Big Data Influencer worldwide.

Bill has over three decades of experience in data warehousing, BI and analytics. Bill authored the Vision Workshop methodology that links an organization’s strategic business initiatives with their supporting data and analytic requirements. Bill serves on the City of San Jose’s Technology Innovation Board, and on the faculties of The Data Warehouse Institute and Strata.

Previously, Bill was vice president of Analytics at Yahoo where he was responsible for the development of Yahoo’s Advertiser and Website analytics products, including the delivery of “actionable insights” through a holistic user experience. Before that, Bill oversaw the Analytic Applications business unit at Business Objects, including the development, marketing and sales of their industry-defining analytic applications.

Bill holds a Masters Business Administration from University of Iowa and a Bachelor of Science degree in Mathematics, Computer Science and Business Administration from Coe College.

IoT & Smart Cities Stories
Dion Hinchcliffe is an internationally recognized digital expert, bestselling book author, frequent keynote speaker, analyst, futurist, and transformation expert based in Washington, DC. He is currently Chief Strategy Officer at the industry-leading digital strategy and online community solutions firm, 7Summits.
Digital Transformation is much more than a buzzword. The radical shift to digital mechanisms for almost every process is evident across all industries and verticals. This is often especially true in financial services, where the legacy environment is many times unable to keep up with the rapidly shifting demands of the consumer. The constant pressure to provide complete, omnichannel delivery of customer-facing solutions to meet both regulatory and customer demands is putting enormous pressure on...
IoT is rapidly becoming mainstream as more and more investments are made into the platforms and technology. As this movement continues to expand and gain momentum it creates a massive wall of noise that can be difficult to sift through. Unfortunately, this inevitably makes IoT less approachable for people to get started with and can hamper efforts to integrate this key technology into your own portfolio. There are so many connected products already in place today with many hundreds more on the h...
The standardization of container runtimes and images has sparked the creation of an almost overwhelming number of new open source projects that build on and otherwise work with these specifications. Of course, there's Kubernetes, which orchestrates and manages collections of containers. It was one of the first and best-known examples of projects that make containers truly useful for production use. However, more recently, the container ecosystem has truly exploded. A service mesh like Istio addr...
Digital Transformation: Preparing Cloud & IoT Security for the Age of Artificial Intelligence. As automation and artificial intelligence (AI) power solution development and delivery, many businesses need to build backend cloud capabilities. Well-poised organizations, marketing smart devices with AI and BlockChain capabilities prepare to refine compliance and regulatory capabilities in 2018. Volumes of health, financial, technical and privacy data, along with tightening compliance requirements by...
Charles Araujo is an industry analyst, internationally recognized authority on the Digital Enterprise and author of The Quantum Age of IT: Why Everything You Know About IT is About to Change. As Principal Analyst with Intellyx, he writes, speaks and advises organizations on how to navigate through this time of disruption. He is also the founder of The Institute for Digital Transformation and a sought after keynote speaker. He has been a regular contributor to both InformationWeek and CIO Insight...
Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settlement products to hedge funds and investment banks. After, he co-founded a revenue cycle management company where he learned about Bitcoin and eventually Ethereal. Andrew's role at ConsenSys Enterprise is a mul...
To Really Work for Enterprises, MultiCloud Adoption Requires Far Better and Inclusive Cloud Monitoring and Cost Management … But How? Overwhelmingly, even as enterprises have adopted cloud computing and are expanding to multi-cloud computing, IT leaders remain concerned about how to monitor, manage and control costs across hybrid and multi-cloud deployments. It’s clear that traditional IT monitoring and management approaches, designed after all for on-premises data centers, are falling short in ...
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...
Dynatrace is an application performance management software company with products for the information technology departments and digital business owners of medium and large businesses. Building the Future of Monitoring with Artificial Intelligence. Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more busine...