Welcome!

Java IoT Authors: Pat Romanski, Yeshim Deniz, Zakia Bouachraoui, Elizabeth White, Liz McMillan

Related Topics: Containers Expo Blog, Microservices Expo

Containers Expo Blog: Article

Roadmap for Data Virtualization

How data virtualization vendors will meet tomorrow’s information management challenges

It is clear that information management is becoming more difficult.

Business users today are far more demanding as competition and cost-cutting drive IT requirements, and information savvy business staff members deploy more "do-it-yourself" capabilities such as those described in Data Virtualization at Pfizer: A Case Study.

Information overload due to exponential volume growth and omnipresent delivery on our desktops, phones and tablets, is something we all feel at a personal level.

Further, the IT environment keeps getting more complex as add new big data sources, such as Hadoop; new use cases, such as predictive analytics; new styles of deployment, such as cloud computing, and more.

The Importance of a Data Virtualization Product Roadmap
In last month's Virtualization Journal article Data Virtualization Adoption Propelled by Significant Business Benefits, I highlighted key data virtualization technology capabilities that organizations were adopting to meet these challenges.

This article and How to Evaluate a Data Virtualization Platform provide useful guidance when selecting from several data virtualization vendor solutions as different vendors have taken different approaches to these challenges.

Further, the latter article also urged readers to consider not only functional capabilities, but also domain expertise and complementary services that each vendor can provide.  Examples of these can be found in Data Virtualization Best Practices and It's Here! The First Book on Data Virtualization.

In this article, I add one more criteria for consideration - the data virtualization vendor's product roadmap.  To make this important topic tangible, I will use the roadmap one of the leading data virtualization vendors, Composite Software.

Composite Software's Roadmap
At Composite Software, the roadmap for relevant and successful product evolution is driven by collaboration with innovative customers, consideration of key industry trends and the creativity of the engineering organization.

Composite's ever-advancing technology road map spans five critical dimensions:

  • Wider Access
  • Deeper Optimizations
  • Broader Deployment
  • Easier to Use
  • Better Governance

Let's consider why each dimension is important and how the Composite Data Virtualization Platform will grow to meet these expanding requirements.

Wider Access Keeps Data Virtualization Relevant
Technology developments at both the consumer and data source levels occur at a stunning pace.  Consider the past few years.  Tablet applications arrived from nowhere, while cloud applications became entrenched.  REST services bypassed SOAP.  Databases transformed into appliances.  And NoSQL and other big data stores have become standard.

While the list of source and consumer integration options is already long and diverse, expanding it will continue as a critical and growing component of Composite Software's data virtualization product line.  On the source side, access to software-as-a-service offerings will expand rapidly as these cloud computing solutions grow in popularity. On the delivery side, mobile applications will most likely set the integration agenda.

Deeper Optimizations Needed to Meet Volume Demands
According to IBM's 2011 CIO survey, business intelligence and analytics are CIO's top priority. To work, these applications require data.  For users, the more data, the better. And don't make the wait.

From its origin in the same Stanford research lab where Google's search algorithms were created, Composite Software's unique query optimization algorithms, caching, and a myriad of other advanced techniques have pushed the data virtualization performance frontier.  Pressing this intellectual property (IP) advantage will become even more critical as users execute ever larger and more complex queries.

Broader Deployment Requires Larger Scale Systems
Patterns of data virtualization deployment are evolving rapidly. Five years ago, most new Composite Software customers purchased its data virtualization platform to integrate data at the project level.  Last year, half of them purchased us to serve as the enterprise-scale data layer from the start, with over 60 percent of the earlier buyers now on the same journey.  With many organizations already supporting thousands of users, this trend will continue with user counts rising to the tens of thousands on a global basis.

Data virtualization's ultimate deployment architecture is a low-latency, globally distributed data fabric, operating 24x365, with full source and consumer location transparency that spans both on-premise and cloud.  Operating at this scale will significantly impact to the Composite Software's roadmap for its development, run-time and management environments.

Expanding User Base Drives Ease-of-Use Agenda
To date, most data virtualization users have been skilled developers and administrators.  This is reflected in the user tools provided by today's data virtualization vendors.  As data virtualization deployments expand, the range of business and IT staff using this technology becomes larger and more diverse.  Enabling these new communities to learn data virtualization quickly, and then use it productively, is critical to data virtualization's expansion.

To ensure this happens, Composite Software's data virtualization roadmap implements two strategies.  The first is to continue pushing the bounds of automation to eliminate work wherever possible.  The second is to continue to provide more powerful and intuitive tools to maximize user productivity for the work that remains.

Better Governance for Consistency, Compliance and Control
As data virtualization deployments evolve from projects to layers to global data fabrics, the need for greater data governance expands as well.  Control over data access, assurance of data quality, sharing of common specification and compliance with standards and regulations are but a few examples of governance requirements.

The Composite Software data virtualization roadmap includes capabilities that expand internal visibility over and support of governance practices and policies.  Closer alignment with adjacent technologies and processes will simplify governance as well.

Conclusion
Just as business and technology continuously evolves, so too will the scope and impact of data virtualization adoption and offerings.  The offerings that best meet expanding access, optimization, deployment, ease-of-use, and governance requirements, along with the organizations that adopt them, will thrive.

Enabled by a solid roadmap, this will be an exhilarating and rewarding journey.

More Stories By Robert Eve

Robert Eve is the EVP of Marketing at Composite Software, the data virtualization gold standard and co-author of Data Virtualization: Going Beyond Traditional Data Integration to Achieve Business Agility. Bob's experience includes executive level roles at leading enterprise software companies such as Mercury Interactive, PeopleSoft, and Oracle. Bob holds a Masters of Science from the Massachusetts Institute of Technology and a Bachelor of Science from the University of California at Berkeley.

IoT & Smart Cities Stories
The challenges of aggregating data from consumer-oriented devices, such as wearable technologies and smart thermostats, are fairly well-understood. However, there are a new set of challenges for IoT devices that generate megabytes or gigabytes of data per second. Certainly, the infrastructure will have to change, as those volumes of data will likely overwhelm the available bandwidth for aggregating the data into a central repository. Ochandarena discusses a whole new way to think about your next...
CloudEXPO | DevOpsSUMMIT | DXWorldEXPO are the world's most influential, independent events where Cloud Computing was coined and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals. Sponsors of DXWorldEXPO | CloudEXPO benefit from unmatched branding, profile building and lead generation opportunities.
All in Mobile is a place where we continually maximize their impact by fostering understanding, empathy, insights, creativity and joy. They believe that a truly useful and desirable mobile app doesn't need the brightest idea or the most advanced technology. A great product begins with understanding people. It's easy to think that customers will love your app, but can you justify it? They make sure your final app is something that users truly want and need. The only way to do this is by ...
Digital Transformation and Disruption, Amazon Style - What You Can Learn. Chris Kocher is a co-founder of Grey Heron, a management and strategic marketing consulting firm. He has 25+ years in both strategic and hands-on operating experience helping executives and investors build revenues and shareholder value. He has consulted with over 130 companies on innovating with new business models, product strategies and monetization. Chris has held management positions at HP and Symantec in addition to ...
Dynatrace is an application performance management software company with products for the information technology departments and digital business owners of medium and large businesses. Building the Future of Monitoring with Artificial Intelligence. Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more busine...
DXWorldEXPO LLC announced today that Big Data Federation to Exhibit at the 22nd International CloudEXPO, colocated with DevOpsSUMMIT and DXWorldEXPO, November 12-13, 2018 in New York City. Big Data Federation, Inc. develops and applies artificial intelligence to predict financial and economic events that matter. The company uncovers patterns and precise drivers of performance and outcomes with the aid of machine-learning algorithms, big data, and fundamental analysis. Their products are deployed...
Cell networks have the advantage of long-range communications, reaching an estimated 90% of the world. But cell networks such as 2G, 3G and LTE consume lots of power and were designed for connecting people. They are not optimized for low- or battery-powered devices or for IoT applications with infrequently transmitted data. Cell IoT modules that support narrow-band IoT and 4G cell networks will enable cell connectivity, device management, and app enablement for low-power wide-area network IoT. B...
The hierarchical architecture that distributes "compute" within the network specially at the edge can enable new services by harnessing emerging technologies. But Edge-Compute comes at increased cost that needs to be managed and potentially augmented by creative architecture solutions as there will always a catching-up with the capacity demands. Processing power in smartphones has enhanced YoY and there is increasingly spare compute capacity that can be potentially pooled. Uber has successfully ...
SYS-CON Events announced today that CrowdReviews.com has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5–7, 2018, at the Javits Center in New York City, NY. CrowdReviews.com is a transparent online platform for determining which products and services are the best based on the opinion of the crowd. The crowd consists of Internet users that have experienced products and services first-hand and have an interest in letting other potential buye...
When talking IoT we often focus on the devices, the sensors, the hardware itself. The new smart appliances, the new smart or self-driving cars (which are amalgamations of many ‘things'). When we are looking at the world of IoT, we should take a step back, look at the big picture. What value are these devices providing. IoT is not about the devices, its about the data consumed and generated. The devices are tools, mechanisms, conduits. This paper discusses the considerations when dealing with the...