Welcome!

Java IoT Authors: Elizabeth White, Pat Romanski, Liz McMillan, Yeshim Deniz, Frank Lupo

Article

Effective Server Side Data Mashups In Enterprise Clouds - Windows Azure Appfabric Proposition

Data Mashups & Slowly Changing Dimensions

Mashups are  new concept in web 2.0 where by  the web User interface combine data from multiple sources to build new views that show information in new ways. Mashups can take different forms. As a cloud provider or an enterprise who deploys applications on Cloud, you may  have to provide mashups to end users by combining business data from different sources into a unified interface.  These include data from external, internal, public sources.

Mashups & SQL Joins :

Traditionally in relational database JOINs (INNER JOIN, OUTER JOIN, SELF JOIN) are utilized to join data from multiple subjects and provide multiple views to the end user. However there are many ways Mashups provide more flexibility than traditional JOINS.

·         Data need not be aggregated to one place. Traditional SQL JOIN require that data is ETL (Extracted, Transformed, Loaded) from multiple sources to target. But the new way of content generation mandate that the needs for data integration are unknown till the run time and these situational applications have to modify them selves  dynamically.

·         Traditional SQL JOIN works well between the same database but requires lot of cost and licensing for multi database support. If we need to Join Oracle to DB2 or vice versa then we may have to purchase the expensive gateway products from respective vendors.

·         Traditional SQL JOIN assumes that the provider enterprise owns all the data, however the Mashups inherently provide for data integration between providers both internal and external.

·         Traditional SQL JOIN works well for relational data where as Mashups are for both relational as well for unstructured content.

The below diagram gives a view of the Mashups in a typical enterprise where the data integration needs are from very many disparate sources.

It is evident that Data Mashup plays a vital role in providing a richer set of intelligence to your business process and improves the QoS of your cloud services.

Key Success Factors For a Successful Data Mashup :

·        Keep Control Of Your Dimensional Attributes that require for Mashing Up with external engines : As evident  unlike a traditional RDBMS / Data Mart applications where the enterprise has got all the control of data, in Cloud data mashup only half of  the data is under the organization’s control and rest are from external sources. For example depending on the Customer’s  Geography your application need to provide the near by service centers, then keeping the zip code as part of your  enterprise data and linking it with external feeds based on the Zipcode as a key is important.

 

·         Aware of the Slowly Changing Dimensions and ensure the validity of data to near 100% :    While much of the success of your business depends on mashing up the data from multiple internal and external sources in a cloud enabled enterprise,  but due to dynamic nature of the  dimensional data you may end up with old data too frequent unless there are measures to keep track of it  using multiple means. For example assuming that much of the  mashup strategy depends on the customer’s drive location for example the customer’s  work location zip code, so that lot of marketing materials can be targeted towards that location and assume that customer has changed his work location and this information is not kept current, this may result in unnecessary or redundant information to the customer  and may result in loss of business. This concept  traditionally known as ‘Slowly Changing Dimension’  (Dimension  is some thing that describes the attributes of key business parameters – Customer, Product, Region, Date/Time are typically some of the Dimensions). There are multiple types of changes and each of these SCD (slow changing dimensions) can be tackled appropriately as per the Mashup strategy.

 

o   Type 1  SCD :   In this type the  new data replaces the old data. For example  some Address information can be considered as Type 1  where by once the customer moves his location we can change his Zip code too so that newer data mashups will represent the customer’s current location.

o   Type 2/3 SCD :  Both are slight variations, but basically here even if the dimension information changes both the old and new information kept to make your mashups even more useful. For example  you keep track of your customer’s interest and show relevant information  on your mashup strategy.

§  Assuming that the current interest  of the customer is about  Music  then you show relevant musical CDs or other Concert related information for the customer

§  Assuming that your customer profile is updated with an added interest of  Major League Base Ball, it does not mean that your mash strategy should  replace the music related feeds rather it can augment with MLB related feeds like Scores, game information etc…

·         Aware of Performance Related Issues with respect to Linking data  :    The information  like explained above  (zip code…) are the key to the linking strategy to the rest of the external feeds. And the key has to be most appropriate for the situation to bring the most relevant information  that is meaningful to the customer in a shortest possible time. For example if there a Mashup with a Weather feed it is more appropriate to  link with zipcode than with state code.

 

Windows Azure Appfabric

Windows Azure AppFabric provides a comprehensive cloud middleware platform for developing, deploying and managing applications on the Windows Azure Platform. It delivers additional developer productivity adding in higher-level Platform-as-a-Service (PaaS) capabilities on top of the familiar Windows Azure application model.

It also enables bridging your existing applications to the cloud through secure connectivity across network and geographic boundaries, and by providing a consistent development model for both Windows Azure and Windows Server.

You can refer to Microsoft  Vendor site documentation about detailed explanation on Azure stack of products especially for data mashup scenarios. 

 

Using a proper selection of tools  and appropriate strategy will provide the basis for your organization’s ability to build effective situational applications.  Once the data strategy for the Mashups are clearly defined the user interface can be built on top of it using the appropriate WIDGETS available as part of various platforms.

 

More Stories By Srinivasan Sundara Rajan

Highly passionate about utilizing Digital Technologies to enable next generation enterprise. Believes in enterprise transformation through the Natives (Cloud Native & Mobile Native).

@ThingsExpo Stories
SYS-CON Events announced today that N3N will exhibit at SYS-CON's @ThingsExpo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. N3N’s solutions increase the effectiveness of operations and control centers, increase the value of IoT investments, and facilitate real-time operational decision making. N3N enables operations teams with a four dimensional digital “big board” that consolidates real-time live video feeds alongside IoT sensor data a...
In a recent survey, Sumo Logic surveyed 1,500 customers who employ cloud services such as Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP). According to the survey, a quarter of the respondents have already deployed Docker containers and nearly as many (23 percent) are employing the AWS Lambda serverless computing framework. It’s clear: serverless is here to stay. The adoption does come with some needed changes, within both application development and operations. Tha...
SYS-CON Events announced today that Avere Systems, a leading provider of enterprise storage for the hybrid cloud, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Avere delivers a more modern architectural approach to storage that doesn't require the overprovisioning of storage capacity to achieve performance, overspending on expensive storage media for inactive data or the overbui...
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend 21st Cloud Expo October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.
SYS-CON Events announced today that mruby Forum will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. mruby is the lightweight implementation of the Ruby language. We introduce mruby and the mruby IoT framework that enhances development productivity. For more information, visit http://forum.mruby.org/.
Digital transformation is changing the face of business. The IDC predicts that enterprises will commit to a massive new scale of digital transformation, to stake out leadership positions in the "digital transformation economy." Accordingly, attendees at the upcoming Cloud Expo | @ThingsExpo at the Santa Clara Convention Center in Santa Clara, CA, Oct 31-Nov 2, will find fresh new content in a new track called Enterprise Cloud & Digital Transformation.
SYS-CON Events announced today that NetApp has been named “Bronze Sponsor” of SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. NetApp is the data authority for hybrid cloud. NetApp provides a full range of hybrid cloud data services that simplify management of applications and data across cloud and on-premises environments to accelerate digital transformation. Together with their partners, NetApp emp...
Smart cities have the potential to change our lives at so many levels for citizens: less pollution, reduced parking obstacles, better health, education and more energy savings. Real-time data streaming and the Internet of Things (IoT) possess the power to turn this vision into a reality. However, most organizations today are building their data infrastructure to focus solely on addressing immediate business needs vs. a platform capable of quickly adapting emerging technologies to address future ...
Amazon is pursuing new markets and disrupting industries at an incredible pace. Almost every industry seems to be in its crosshairs. Companies and industries that once thought they were safe are now worried about being “Amazoned.”. The new watch word should be “Be afraid. Be very afraid.” In his session 21st Cloud Expo, Chris Kocher, a co-founder of Grey Heron, will address questions such as: What new areas is Amazon disrupting? How are they doing this? Where are they likely to go? What are th...
Most technology leaders, contemporary and from the hardware era, are reshaping their businesses to do software. They hope to capture value from emerging technologies such as IoT, SDN, and AI. Ultimately, irrespective of the vertical, it is about deriving value from independent software applications participating in an ecosystem as one comprehensive solution. In his session at @ThingsExpo, Kausik Sridhar, founder and CTO of Pulzze Systems, will discuss how given the magnitude of today's applicati...
Join IBM November 1 at 21st Cloud Expo at the Santa Clara Convention Center in Santa Clara, CA, and learn how IBM Watson can bring cognitive services and AI to intelligent, unmanned systems. Cognitive analysis impacts today’s systems with unparalleled ability that were previously available only to manned, back-end operations. Thanks to cloud processing, IBM Watson can bring cognitive services and AI to intelligent, unmanned systems. Imagine a robot vacuum that becomes your personal assistant th...
SYS-CON Events announced today that SkyScale will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. SkyScale is a world-class provider of cloud-based, ultra-fast multi-GPU hardware platforms for lease to customers desiring the fastest performance available as a service anywhere in the world. SkyScale builds, configures, and manages dedicated systems strategically located in maximum-security...
SYS-CON Events announced today that Avere Systems, a leading provider of hybrid cloud enablement solutions, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Avere Systems was created by file systems experts determined to reinvent storage by changing the way enterprises thought about and bought storage resources. With decades of experience behind the company’s founders, Avere got its ...
SYS-CON Events announced today that Taica will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. ANSeeN are the measurement electronics maker for X-ray and Gamma-ray and Neutron measurement equipment such as spectrometers, pulse shape analyzer, and CdTe-FPD. For more information, visit http://anseen.com/.
High-velocity engineering teams are applying not only continuous delivery processes, but also lessons in experimentation from established leaders like Amazon, Netflix, and Facebook. These companies have made experimentation a foundation for their release processes, allowing them to try out major feature releases and redesigns within smaller groups before making them broadly available. In his session at 21st Cloud Expo, Brian Lucas, Senior Staff Engineer at Optimizely, will discuss how by using...
In this strange new world where more and more power is drawn from business technology, companies are effectively straddling two paths on the road to innovation and transformation into digital enterprises. The first path is the heritage trail – with “legacy” technology forming the background. Here, extant technologies are transformed by core IT teams to provide more API-driven approaches. Legacy systems can restrict companies that are transitioning into digital enterprises. To truly become a lead...
SYS-CON Events announced today that Yuasa System will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Yuasa System is introducing a multi-purpose endurance testing system for flexible displays, OLED devices, flexible substrates, flat cables, and films in smartphones, wearables, automobiles, and healthcare.
SYS-CON Events announced today that CAST Software will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CAST was founded more than 25 years ago to make the invisible visible. Built around the idea that even the best analytics on the market still leave blind spots for technical teams looking to deliver better software and prevent outages, CAST provides the software intelligence that matter ...
SYS-CON Events announced today that Daiya Industry will exhibit at the Japanese Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Ruby Development Inc. builds new services in short period of time and provides a continuous support of those services based on Ruby on Rails. For more information, please visit https://github.com/RubyDevInc.
As businesses evolve, they need technology that is simple to help them succeed today and flexible enough to help them build for tomorrow. Chrome is fit for the workplace of the future — providing a secure, consistent user experience across a range of devices that can be used anywhere. In her session at 21st Cloud Expo, Vidya Nagarajan, a Senior Product Manager at Google, will take a look at various options as to how ChromeOS can be leveraged to interact with people on the devices, and formats th...