Click here to close now.


Java IoT Authors: Pat Romanski, Yeshim Deniz, Adrian Bridgwater, SmartBear Blog, Elizabeth White

Related Topics: Containers Expo Blog, Java IoT

Containers Expo Blog: Article

Butterfly Effect in Virtualized Environments

How small inconsequential events can have radical consequences down the line

In 1969 Edward Lorenz, the famed meteorologist and Chaos Theory proponent, introduced the concept now known as the "Butterfly Effect" when he posed the famous question: "Does the flap of a butterfly's wings in Brazil set off a tornado in Texas?" The Butterfly Effect theory describes the phenomenon of how small variations in a dynamic system can subsequently cause larger and more complex variations over the long term.

Today's modern virtualized data center represents a new kind of dynamic system. Just as the Brazilian butterfly may set off a tornado a world away, any change to the virtualized objects that are the components of the virtual infrastructure can have severe and unintended consequences to virtualized systems, networks, and data centers. As virtualization technologies are deployed in live production environments, the potential for small changes at the virtual layer disrupting the virtual and physical network resources are becoming a real concern.

Seeing Through the Fog of Virtualization
The evolution of IT has been marked by several distinct cycles. The adoption of virtualization in the data center is proving to be the next major paradigm shift as was the change from mainframe to client/server computing in years past. The next advance in the corporate infrastructure is now underway with the broad embrace of cloud computing, marked by the use of Software-as-a-Service (SaaS). Cloud computing will become increasingly more prevalent once more servers and desktops are virtualized and migrating servers in the cloud is as easy as dragging and dropping an icon onto a remote server.

Clearly, the virtual data center is quickly becoming a reality and organizations that deploy virtualization are now coming to grips with a new set of management challenges. Jim Frey, a senior analyst at Enterprise Management Associates, coined the phrase "Fog of Virtualization" to describe this new challenge. Since one cannot manage or control what they can't see, virtual data center administrators are experiencing management and policy enforcement limitations.

Visibility into both the virtual and physical infrastructure is becoming a crucial operating requirement. Administrators need a visual representation of their virtual environment to understand the entire virtual network, track changes, and manage both their physical and virtual infrastructure. Virtualization creates an invisible line where servers and applications are easily moved and managed by multiple cross-functional organizational departments. Not only can servers, storage, and networks can be dynamically managed as a single pool of resources but servers, switches, and networks can be created at the click of a mouse with applications moving seamlessly from one physical server to another.

Consequently such a dynamic environment can create issues uncommon in traditional physical environments. Policies can be defined to dynamically move virtual machines based on resource utilization or for disaster recovery and business continuity. This automated mobility means that administrators only know the current location of a virtual machine. Of course, with virtualization it's fast and easy to deploy new servers. Perhaps a little too easy, as administrators struggle to control this new breed of virtual server sprawl which adds another layer of complexity and decreases the cost savings to the organization. Virtual environments are subject to an extreme number of infrastructure configuration changes that tend to obfuscate the data center as a whole - understanding how components are connected, and the consequences of changes, can mean the difference between success and failure.

To maintain proper and secure configuration in a virtual environment, organizations must be able to track all infrastructure changes in real-time to maintain an accurate model of the virtual environment. If Murphy were a data center administrator, his law might read: "A misconfigured device possesses a risk equal to one that's unpatched for known vulnerabilities." Virtualization makes configuration of virtual infrastructure a point-and-click operation, opening the doors for simple human error.

The Unintended Consequences of Interdependent Systems
Large virtual infrastructures have grown so complex and interdependent that the Butterfly Effect is emerging as a real threat. There are a number of dynamic forces at work in virtual systems, and changes to one part of the infrastructure can have far-reaching consequences. The downside of these complex interdependencies is that human mistakes, even small errors in configuration, can manifest themselves as major problems down the road. These forces conspire to put pressure on both the system and administrators, increasing the probability of mistakes and making their impact more far-reaching and costly. IT specialists attempting to configure, change, release, and support critical applications can find themselves facing a daunting reality.

The Butterfly Effect in the virtual data center is exacerbated by a complex infrastructure designed to support multi-tiered networks, interdependencies between different layers of infrastructure, fewer IT resources, and more applications that require changes and demands to support new initiatives like service-oriented IT and distributed architectures. Administrators are struggling to manage the Butterfly Effect while trying to meet the conflicting challenges of providing the continuous availability of critical applications. But achieving continuous availability in complex virtual environments is no small task.

More Stories By Hezi Moore

Hezi Moore is founder and Chief Technology Officer of Reflex Systems. He brings more than 15 years experience in security, networking and entrepreneurial expertise to Reflex Systems. In his role of CTO, he is responsible for shaping the company's technology strategy and defining the roadmap for future design and development of innovative, integrated network security solutions and delivering them to market. Moore led the effort to develop the industry's first Virtual Security Appliance (VSA) that provides visibility and security for virtual network infrastructure. Prior to founding Reflex Systems, Moore was president and co-founder of MicroTech Systems - a firm specializing in network design and configuration of point-of-sale systems - which was subsequently acquired by Retail Technologies International of Sacramento, California. He has also held such diverse occupations as a technical support and research analyst for GE Technology. Moore was a pioneer of the automated network intrusion response system, the concept out of which Reflex Systems grew.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

@ThingsExpo Stories
WebRTC is about the data channel as much as about video and audio conferencing. However, basically all commercial WebRTC applications have been built with a focus on audio and video. The handling of “data” has been limited to text chat and file download – all other data sharing seems to end with screensharing. What is holding back a more intensive use of peer-to-peer data? In her session at @ThingsExpo, Dr Silvia Pfeiffer, WebRTC Applications Team Lead at National ICT Australia, will look at different existing uses of peer-to-peer data sharing and how it can become useful in a live session to...
NHK, Japan Broadcasting, will feature the upcoming @ThingsExpo Silicon Valley in a special 'Internet of Things' and smart technology documentary that will be filmed on the expo floor between November 3 to 5, 2015, in Santa Clara. NHK is the sole public TV network in Japan equivalent to the BBC in the UK and the largest in Asia with many award-winning science and technology programs. Japanese TV is producing a documentary about IoT and Smart technology and will be covering @ThingsExpo Silicon Valley. The program, to be aired during the peak viewership season of the year, will have a major impac...
The buzz continues for cloud, data analytics and the Internet of Things (IoT) and their collective impact across all industries. But a new conversation is emerging - how do companies use industry disruption and technology enablers to lead in markets undergoing change, uncertainty and ambiguity? Organizations of all sizes need to evolve and transform, often under massive pressure, as industry lines blur and merge and traditional business models are assaulted and turned upside down. In this new data-driven world, marketplaces reign supreme while interoperability, APIs and applications deliver un...
Developing software for the Internet of Things (IoT) comes with its own set of challenges. Security, privacy, and unified standards are a few key issues. In addition, each IoT product is comprised of at least three separate application components: the software embedded in the device, the backend big-data service, and the mobile application for the end user's controls. Each component is developed by a different team, using different technologies and practices, and deployed to a different stack/target - this makes the integration of these separate pipelines and the coordination of software upd...
Internet of Things (IoT) will be a hybrid ecosystem of diverse devices and sensors collaborating with operational and enterprise systems to create the next big application. In their session at @ThingsExpo, Bramh Gupta, founder and CEO of, and Fred Yatzeck, principal architect leading product development at, discussed how choosing the right middleware and integration strategy from the get-go will enable IoT solution developers to adapt and grow with the industry, while at the same time reduce Time to Market (TTM) by using plug and play capabilities offered by a robust IoT ...
Through WebRTC, audio and video communications are being embedded more easily than ever into applications, helping carriers, enterprises and independent software vendors deliver greater functionality to their end users. With today’s business world increasingly focused on outcomes, users’ growing calls for ease of use, and businesses craving smarter, tighter integration, what’s the next step in delivering a richer, more immersive experience? That richer, more fully integrated experience comes about through a Communications Platform as a Service which allows for messaging, screen sharing, video...
Can call centers hang up the phones for good? Intuitive Solutions did. WebRTC enabled this contact center provider to eliminate antiquated telephony and desktop phone infrastructure with a pure web-based solution, allowing them to expand beyond brick-and-mortar confines to a home-based agent model. It also ensured scalability and better service for customers, including MUY! Companies, one of the country's largest franchise restaurant companies with 232 Pizza Hut locations. This is one example of WebRTC adoption today, but the potential is limitless when powered by IoT.
SYS-CON Events announced today that Luxoft Holding, Inc., a leading provider of software development services and innovative IT solutions, has been named “Bronze Sponsor” of SYS-CON's @ThingsExpo, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. Luxoft’s software development services consist of core and mission-critical custom software development and support, product engineering and testing, and technology consulting.
“In the past year we've seen a lot of stabilization of WebRTC. You can now use it in production with a far greater degree of certainty. A lot of the real developments in the past year have been in things like the data channel, which will enable a whole new type of application," explained Peter Dunkley, Technical Director at Acision, in this interview at @ThingsExpo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
"Matrix is an ambitious open standard and implementation that's set up to break down the fragmentation problems that exist in IP messaging and VoIP communication," explained John Woolf, Technical Evangelist at Matrix, in this interview at @ThingsExpo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
You have your devices and your data, but what about the rest of your Internet of Things story? Two popular classes of technologies that nicely handle the Big Data analytics for Internet of Things are Apache Hadoop and NoSQL. Hadoop is designed for parallelizing analytical work across many servers and is ideal for the massive data volumes you create with IoT devices. NoSQL databases such as Apache HBase are ideal for storing and retrieving IoT data as “time series data.”
There are so many tools and techniques for data analytics that even for a data scientist the choices, possible systems, and even the types of data can be daunting. In his session at @ThingsExpo, Chris Harrold, Global CTO for Big Data Solutions for EMC Corporation, will show how to perform a simple, but meaningful analysis of social sentiment data using freely available tools that take only minutes to download and install. Participants will get the download information, scripts, and complete end-to-end walkthrough of the analysis from start to finish. Participants will also be given the pract...
Clearly the way forward is to move to cloud be it bare metal, VMs or containers. One aspect of the current public clouds that is slowing this cloud migration is cloud lock-in. Every cloud vendor is trying to make it very difficult to move out once a customer has chosen their cloud. In his session at 17th Cloud Expo, Naveen Nimmu, CEO of Clouber, Inc., will advocate that making the inter-cloud migration as simple as changing airlines would help the entire industry to quickly adopt the cloud without worrying about any lock-in fears. In fact by having standard APIs for IaaS would help PaaS expl...
SYS-CON Events announced today that ProfitBricks, the provider of painless cloud infrastructure, will exhibit at SYS-CON's 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. ProfitBricks is the IaaS provider that offers a painless cloud experience for all IT users, with no learning curve. ProfitBricks boasts flexible cloud servers and networking, an integrated Data Center Designer tool for visual control over the cloud and the best price/performance value available. ProfitBricks was named one of the coolest Clo...
Organizations already struggle with the simple collection of data resulting from the proliferation of IoT, lacking the right infrastructure to manage it. They can't only rely on the cloud to collect and utilize this data because many applications still require dedicated infrastructure for security, redundancy, performance, etc. In his session at 17th Cloud Expo, Emil Sayegh, CEO of Codero Hosting, will discuss how in order to resolve the inherent issues, companies need to combine dedicated and cloud solutions through hybrid hosting – a sustainable solution for the data required to manage I...
Mobile messaging has been a popular communication channel for more than 20 years. Finnish engineer Matti Makkonen invented the idea for SMS (Short Message Service) in 1984, making his vision a reality on December 3, 1992 by sending the first message ("Happy Christmas") from a PC to a cell phone. Since then, the technology has evolved immensely, from both a technology standpoint, and in our everyday uses for it. Originally used for person-to-person (P2P) communication, i.e., Sally sends a text message to Betty – mobile messaging now offers tremendous value to businesses for customer and empl...
Scott Guthrie's keynote presentation "Journey to the intelligent cloud" is a must view video. This is from AzureCon 2015, September 29, 2015 I have reproduced some screen shots in case you are unable to view this long video for one reason or another. One of the highlights is 3 datacenters coming on line in India.
Nowadays, a large number of sensors and devices are connected to the network. Leading-edge IoT technologies integrate various types of sensor data to create a new value for several business decision scenarios. The transparent cloud is a model of a new IoT emergence service platform. Many service providers store and access various types of sensor data in order to create and find out new business values by integrating such data.
SYS-CON Events announced today that IBM Cloud Data Services has been named “Bronze Sponsor” of SYS-CON's 17th Cloud Expo, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. IBM Cloud Data Services offers a portfolio of integrated, best-of-breed cloud data services for developers focused on mobile computing and analytics use cases.
Apps and devices shouldn't stop working when there's limited or no network connectivity. Learn how to bring data stored in a cloud database to the edge of the network (and back again) whenever an Internet connection is available. In his session at 17th Cloud Expo, Bradley Holt, Developer Advocate at IBM Cloud Data Services, will demonstrate techniques for replicating cloud databases with devices in order to build offline-first mobile or Internet of Things (IoT) apps that can provide a better, faster user experience, both offline and online. The focus of this talk will be on IBM Cloudant, Apa...