Click here to close now.

Welcome!

Java Authors: Liz McMillan, AppDynamics Blog, Kelly Murphy, Pat Romanski, Carmen Gonzalez

Related Topics: Virtualization, Java

Virtualization: Article

Butterfly Effect in Virtualized Environments

How small inconsequential events can have radical consequences down the line

In 1969 Edward Lorenz, the famed meteorologist and Chaos Theory proponent, introduced the concept now known as the "Butterfly Effect" when he posed the famous question: "Does the flap of a butterfly's wings in Brazil set off a tornado in Texas?" The Butterfly Effect theory describes the phenomenon of how small variations in a dynamic system can subsequently cause larger and more complex variations over the long term.

Today's modern virtualized data center represents a new kind of dynamic system. Just as the Brazilian butterfly may set off a tornado a world away, any change to the virtualized objects that are the components of the virtual infrastructure can have severe and unintended consequences to virtualized systems, networks, and data centers. As virtualization technologies are deployed in live production environments, the potential for small changes at the virtual layer disrupting the virtual and physical network resources are becoming a real concern.

Seeing Through the Fog of Virtualization
The evolution of IT has been marked by several distinct cycles. The adoption of virtualization in the data center is proving to be the next major paradigm shift as was the change from mainframe to client/server computing in years past. The next advance in the corporate infrastructure is now underway with the broad embrace of cloud computing, marked by the use of Software-as-a-Service (SaaS). Cloud computing will become increasingly more prevalent once more servers and desktops are virtualized and migrating servers in the cloud is as easy as dragging and dropping an icon onto a remote server.

Clearly, the virtual data center is quickly becoming a reality and organizations that deploy virtualization are now coming to grips with a new set of management challenges. Jim Frey, a senior analyst at Enterprise Management Associates, coined the phrase "Fog of Virtualization" to describe this new challenge. Since one cannot manage or control what they can't see, virtual data center administrators are experiencing management and policy enforcement limitations.

Visibility into both the virtual and physical infrastructure is becoming a crucial operating requirement. Administrators need a visual representation of their virtual environment to understand the entire virtual network, track changes, and manage both their physical and virtual infrastructure. Virtualization creates an invisible line where servers and applications are easily moved and managed by multiple cross-functional organizational departments. Not only can servers, storage, and networks can be dynamically managed as a single pool of resources but servers, switches, and networks can be created at the click of a mouse with applications moving seamlessly from one physical server to another.

Consequently such a dynamic environment can create issues uncommon in traditional physical environments. Policies can be defined to dynamically move virtual machines based on resource utilization or for disaster recovery and business continuity. This automated mobility means that administrators only know the current location of a virtual machine. Of course, with virtualization it's fast and easy to deploy new servers. Perhaps a little too easy, as administrators struggle to control this new breed of virtual server sprawl which adds another layer of complexity and decreases the cost savings to the organization. Virtual environments are subject to an extreme number of infrastructure configuration changes that tend to obfuscate the data center as a whole - understanding how components are connected, and the consequences of changes, can mean the difference between success and failure.

To maintain proper and secure configuration in a virtual environment, organizations must be able to track all infrastructure changes in real-time to maintain an accurate model of the virtual environment. If Murphy were a data center administrator, his law might read: "A misconfigured device possesses a risk equal to one that's unpatched for known vulnerabilities." Virtualization makes configuration of virtual infrastructure a point-and-click operation, opening the doors for simple human error.

The Unintended Consequences of Interdependent Systems
Large virtual infrastructures have grown so complex and interdependent that the Butterfly Effect is emerging as a real threat. There are a number of dynamic forces at work in virtual systems, and changes to one part of the infrastructure can have far-reaching consequences. The downside of these complex interdependencies is that human mistakes, even small errors in configuration, can manifest themselves as major problems down the road. These forces conspire to put pressure on both the system and administrators, increasing the probability of mistakes and making their impact more far-reaching and costly. IT specialists attempting to configure, change, release, and support critical applications can find themselves facing a daunting reality.

The Butterfly Effect in the virtual data center is exacerbated by a complex infrastructure designed to support multi-tiered networks, interdependencies between different layers of infrastructure, fewer IT resources, and more applications that require changes and demands to support new initiatives like service-oriented IT and distributed architectures. Administrators are struggling to manage the Butterfly Effect while trying to meet the conflicting challenges of providing the continuous availability of critical applications. But achieving continuous availability in complex virtual environments is no small task.

More Stories By Hezi Moore

Hezi Moore is founder and Chief Technology Officer of Reflex Systems. He brings more than 15 years experience in security, networking and entrepreneurial expertise to Reflex Systems. In his role of CTO, he is responsible for shaping the company's technology strategy and defining the roadmap for future design and development of innovative, integrated network security solutions and delivering them to market. Moore led the effort to develop the industry's first Virtual Security Appliance (VSA) that provides visibility and security for virtual network infrastructure. Prior to founding Reflex Systems, Moore was president and co-founder of MicroTech Systems - a firm specializing in network design and configuration of point-of-sale systems - which was subsequently acquired by Retail Technologies International of Sacramento, California. He has also held such diverse occupations as a technical support and research analyst for GE Technology. Moore was a pioneer of the automated network intrusion response system, the concept out of which Reflex Systems grew.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@ThingsExpo Stories
Wearable devices have come of age. The primary applications of wearables so far have been "the Quantified Self" or the tracking of one's fitness and health status. We propose the evolution of wearables into social and emotional communication devices. Our BE(tm) sensor uses light to visualize the skin conductance response. Our sensors are very inexpensive and can be massively distributed to audiences or groups of any size, in order to gauge reactions to performances, video, or any kind of presentation. In her session at @ThingsExpo, Jocelyn Scheirer, CEO & Founder of Bionolux, will discuss ho...
The true value of the Internet of Things (IoT) lies not just in the data, but through the services that protect the data, perform the analysis and present findings in a usable way. With many IoT elements rooted in traditional IT components, Big Data and IoT isn’t just a play for enterprise. In fact, the IoT presents SMBs with the prospect of launching entirely new activities and exploring innovative areas. CompTIA research identifies several areas where IoT is expected to have the greatest impact.
Every day we read jaw-dropping stats on the explosion of data. We allocate significant resources to harness and better understand it. We build businesses around it. But we’ve only just begun. For big payoffs in Big Data, CIOs are turning to cognitive computing. Cognitive computing’s ability to securely extract insights, understand natural language, and get smarter each time it’s used is the next, logical step for Big Data.
We are reaching the end of the beginning with WebRTC, and real systems using this technology have begun to appear. One challenge that faces every WebRTC deployment (in some form or another) is identity management. For example, if you have an existing service – possibly built on a variety of different PaaS/SaaS offerings – and you want to add real-time communications you are faced with a challenge relating to user management, authentication, authorization, and validation. Service providers will want to use their existing identities, but these will have credentials already that are (hopefully) i...
The 4th International Internet of @ThingsExpo, co-located with the 17th International Cloud Expo - to be held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA - announces that its Call for Papers is open. The Internet of Things (IoT) is the biggest idea since the creation of the Worldwide Web more than 20 years ago.
17th Cloud Expo, taking place Nov 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Meanwhile, 94% of enterprises are using some form of XaaS – software, platform, and infrastructure as a service.
The Industrial Internet revolution is now underway, enabled by connected machines and billions of devices that communicate and collaborate. The massive amounts of Big Data requiring real-time analysis is flooding legacy IT systems and giving way to cloud environments that can handle the unpredictable workloads. Yet many barriers remain until we can fully realize the opportunities and benefits from the convergence of machines and devices with Big Data and the cloud, including interoperability, data security and privacy.
The Internet of Things is tied together with a thin strand that is known as time. Coincidentally, at the core of nearly all data analytics is a timestamp. When working with time series data there are a few core principles that everyone should consider, especially across datasets where time is the common boundary. In his session at Internet of @ThingsExpo, Jim Scott, Director of Enterprise Strategy & Architecture at MapR Technologies, discussed single-value, geo-spatial, and log time series data. By focusing on enterprise applications and the data center, he will use OpenTSDB as an example t...
The 17th International Cloud Expo has announced that its Call for Papers is open. 17th International Cloud Expo, to be held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, APM, APIs, Microservices, Security, Big Data, Internet of Things, DevOps and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportunity. Submit your speaking proposal today!
Scott Jenson leads a project called The Physical Web within the Chrome team at Google. Project members are working to take the scalability and openness of the web and use it to talk to the exponentially exploding range of smart devices. Nearly every company today working on the IoT comes up with the same basic solution: use my server and you'll be fine. But if we really believe there will be trillions of these devices, that just can't scale. We need a system that is open a scalable and by using the URL as a basic building block, we open this up and get the same resilience that the web enjoys.
SYS-CON Events announced today that MetraTech, now part of Ericsson, has been named “Silver Sponsor” of SYS-CON's 16th International Cloud Expo®, which will take place on June 9–11, 2015, at the Javits Center in New York, NY. Ericsson is the driving force behind the Networked Society- a world leader in communications infrastructure, software and services. Some 40% of the world’s mobile traffic runs through networks Ericsson has supplied, serving more than 2.5 billion subscribers.
Container frameworks, such as Docker, provide a variety of benefits, including density of deployment across infrastructure, convenience for application developers to push updates with low operational hand-holding, and a fairly well-defined deployment workflow that can be orchestrated. Container frameworks also enable a DevOps approach to application development by cleanly separating concerns between operations and development teams. But running multi-container, multi-server apps with containers is very hard. You have to learn five new and different technologies and best practices (libswarm, sy...
SYS-CON Events announced today that DragonGlass, an enterprise search platform, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. After eleven years of designing and building custom applications, OpenCrowd has launched DragonGlass, a cloud-based platform that enables the development of search-based applications. These are a new breed of applications that utilize a search index as their backbone for data retrieval. They can easily adapt to new data sets and provide access to both structured and unstruc...
Converging digital disruptions is creating a major sea change - Cisco calls this the Internet of Everything (IoE). IoE is the network connection of People, Process, Data and Things, fueled by Cloud, Mobile, Social, Analytics and Security, and it represents a $19Trillion value-at-stake over the next 10 years. In her keynote at @ThingsExpo, Manjula Talreja, VP of Cisco Consulting Services, will discuss IoE and the enormous opportunities it provides to public and private firms alike. She will share what businesses must do to thrive in the IoE economy, citing examples from several industry sector...
With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo in Silicon Valley. Learn what is going on, contribute to the discussions, and ensure that your enterprise is as "IoT-Ready" as it can be! Internet of @ThingsExpo, taking place Nov 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 17th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal an...
All major researchers estimate there will be tens of billions devices - computers, smartphones, tablets, and sensors - connected to the Internet by 2020. This number will continue to grow at a rapid pace for the next several decades. With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo, June 9-11, 2015, at the Javits Center in New York City. Learn what is going on, contribute to the discussions, and ensure that your enterprise is as "IoT-Ready" as it can be
The Internet of Things is a misnomer. That implies that everything is on the Internet, and that simply should not be - especially for things that are blurring the line between medical devices that stimulate like a pacemaker and quantified self-sensors like a pedometer or pulse tracker. The mesh of things that we manage must be segmented into zones of trust for sensing data, transmitting data, receiving command and control administrative changes, and peer-to-peer mesh messaging. In his session at @ThingsExpo, Ryan Bagnulo, Solution Architect / Software Engineer at SOA Software, focused on desi...
An entirely new security model is needed for the Internet of Things, or is it? Can we save some old and tested controls for this new and different environment? In his session at @ThingsExpo, New York's at the Javits Center, Davi Ottenheimer, EMC Senior Director of Trust, reviewed hands-on lessons with IoT devices and reveal a new risk balance you might not expect. Davi Ottenheimer, EMC Senior Director of Trust, has more than nineteen years' experience managing global security operations and assessments, including a decade of leading incident response and digital forensics. He is co-author of t...
While great strides have been made relative to the video aspects of remote collaboration, audio technology has basically stagnated. Typically all audio is mixed to a single monaural stream and emanates from a single point, such as a speakerphone or a speaker associated with a video monitor. This leads to confusion and lack of understanding among participants especially regarding who is actually speaking. Spatial teleconferencing introduces the concept of acoustic spatial separation between conference participants in three dimensional space. This has been shown to significantly improve comprehe...
SYS-CON Events announced today that the "First Containers & Microservices Conference" will take place June 9-11, 2015, at the Javits Center in New York City. The “Second Containers & Microservices Conference” will take place November 3-5, 2015, at Santa Clara Convention Center, Santa Clara, CA. Containers and microservices have become topics of intense interest throughout the cloud developer and enterprise IT communities.