Welcome!

Java IoT Authors: Pat Romanski, William Schmarzo, Liz McMillan, AppDynamics Blog, Elizabeth White

Related Topics: Containers Expo Blog, Java IoT

Containers Expo Blog: Article

Butterfly Effect in Virtualized Environments

How small inconsequential events can have radical consequences down the line

In 1969 Edward Lorenz, the famed meteorologist and Chaos Theory proponent, introduced the concept now known as the "Butterfly Effect" when he posed the famous question: "Does the flap of a butterfly's wings in Brazil set off a tornado in Texas?" The Butterfly Effect theory describes the phenomenon of how small variations in a dynamic system can subsequently cause larger and more complex variations over the long term.

Today's modern virtualized data center represents a new kind of dynamic system. Just as the Brazilian butterfly may set off a tornado a world away, any change to the virtualized objects that are the components of the virtual infrastructure can have severe and unintended consequences to virtualized systems, networks, and data centers. As virtualization technologies are deployed in live production environments, the potential for small changes at the virtual layer disrupting the virtual and physical network resources are becoming a real concern.

Seeing Through the Fog of Virtualization
The evolution of IT has been marked by several distinct cycles. The adoption of virtualization in the data center is proving to be the next major paradigm shift as was the change from mainframe to client/server computing in years past. The next advance in the corporate infrastructure is now underway with the broad embrace of cloud computing, marked by the use of Software-as-a-Service (SaaS). Cloud computing will become increasingly more prevalent once more servers and desktops are virtualized and migrating servers in the cloud is as easy as dragging and dropping an icon onto a remote server.

Clearly, the virtual data center is quickly becoming a reality and organizations that deploy virtualization are now coming to grips with a new set of management challenges. Jim Frey, a senior analyst at Enterprise Management Associates, coined the phrase "Fog of Virtualization" to describe this new challenge. Since one cannot manage or control what they can't see, virtual data center administrators are experiencing management and policy enforcement limitations.

Visibility into both the virtual and physical infrastructure is becoming a crucial operating requirement. Administrators need a visual representation of their virtual environment to understand the entire virtual network, track changes, and manage both their physical and virtual infrastructure. Virtualization creates an invisible line where servers and applications are easily moved and managed by multiple cross-functional organizational departments. Not only can servers, storage, and networks can be dynamically managed as a single pool of resources but servers, switches, and networks can be created at the click of a mouse with applications moving seamlessly from one physical server to another.

Consequently such a dynamic environment can create issues uncommon in traditional physical environments. Policies can be defined to dynamically move virtual machines based on resource utilization or for disaster recovery and business continuity. This automated mobility means that administrators only know the current location of a virtual machine. Of course, with virtualization it's fast and easy to deploy new servers. Perhaps a little too easy, as administrators struggle to control this new breed of virtual server sprawl which adds another layer of complexity and decreases the cost savings to the organization. Virtual environments are subject to an extreme number of infrastructure configuration changes that tend to obfuscate the data center as a whole - understanding how components are connected, and the consequences of changes, can mean the difference between success and failure.

To maintain proper and secure configuration in a virtual environment, organizations must be able to track all infrastructure changes in real-time to maintain an accurate model of the virtual environment. If Murphy were a data center administrator, his law might read: "A misconfigured device possesses a risk equal to one that's unpatched for known vulnerabilities." Virtualization makes configuration of virtual infrastructure a point-and-click operation, opening the doors for simple human error.

The Unintended Consequences of Interdependent Systems
Large virtual infrastructures have grown so complex and interdependent that the Butterfly Effect is emerging as a real threat. There are a number of dynamic forces at work in virtual systems, and changes to one part of the infrastructure can have far-reaching consequences. The downside of these complex interdependencies is that human mistakes, even small errors in configuration, can manifest themselves as major problems down the road. These forces conspire to put pressure on both the system and administrators, increasing the probability of mistakes and making their impact more far-reaching and costly. IT specialists attempting to configure, change, release, and support critical applications can find themselves facing a daunting reality.

The Butterfly Effect in the virtual data center is exacerbated by a complex infrastructure designed to support multi-tiered networks, interdependencies between different layers of infrastructure, fewer IT resources, and more applications that require changes and demands to support new initiatives like service-oriented IT and distributed architectures. Administrators are struggling to manage the Butterfly Effect while trying to meet the conflicting challenges of providing the continuous availability of critical applications. But achieving continuous availability in complex virtual environments is no small task.

More Stories By Hezi Moore

Hezi Moore is founder and Chief Technology Officer of Reflex Systems. He brings more than 15 years experience in security, networking and entrepreneurial expertise to Reflex Systems. In his role of CTO, he is responsible for shaping the company's technology strategy and defining the roadmap for future design and development of innovative, integrated network security solutions and delivering them to market. Moore led the effort to develop the industry's first Virtual Security Appliance (VSA) that provides visibility and security for virtual network infrastructure. Prior to founding Reflex Systems, Moore was president and co-founder of MicroTech Systems - a firm specializing in network design and configuration of point-of-sale systems - which was subsequently acquired by Retail Technologies International of Sacramento, California. He has also held such diverse occupations as a technical support and research analyst for GE Technology. Moore was a pioneer of the automated network intrusion response system, the concept out of which Reflex Systems grew.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@ThingsExpo Stories
Manufacturers are embracing the Industrial Internet the same way consumers are leveraging Fitbits – to improve overall health and wellness. Both can provide consistent measurement, visibility, and suggest performance improvements customized to help reach goals. Fitbit users can view real-time data and make adjustments to increase their activity. In his session at @ThingsExpo, Mark Bernardo Professional Services Leader, Americas, at GE Digital, discussed how leveraging the Industrial Internet a...
On Dice.com, the number of job postings asking for skill in Amazon Web Services increased 76 percent between June 2015 and June 2016. Salesforce.com saw its own skill mentions increase 37 percent, while DevOps and Cloud rose 35 percent and 28 percent, respectively. Even as they expand their presence in the cloud, companies are also looking for tech professionals who can manage projects, crunch data, and figure out how to make systems run more autonomously. Mentions of ‘data science’ as a skill ...
IoT generates lots of temporal data. But how do you unlock its value? You need to discover patterns that are repeatable in vast quantities of data, understand their meaning, and implement scalable monitoring across multiple data streams in order to monetize the discoveries and insights. Motif discovery and deep learning platforms are emerging to visualize sensor data, to search for patterns and to build application that can monitor real time streams efficiently. In his session at @ThingsExpo, ...
"delaPlex is a software development company. We do team-based outsourcing development," explained Mark Rivers, COO and Co-founder of delaPlex Software, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
ReadyTalk has expanded the capabilities of the FoxDen collaboration platform announced late last year to include FoxDen Connect, an in-room video collaboration experience that launches with a single touch. With FoxDen Connect, users can now not only engage in HD video conferencing between iOS and Android mobile devices or Chrome browsers, but also set up in-person meeting rooms for video interactions. A host’s mobile device automatically recognizes the presence of a meeting room via beacon tech...
SYS-CON Events announced today that LeaseWeb USA, a cloud Infrastructure-as-a-Service (IaaS) provider, will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. LeaseWeb is one of the world's largest hosting brands. The company helps customers define, develop and deploy IT infrastructure tailored to their exact business needs, by combining various kinds cloud solutions.
Amazon has gradually rolled out parts of its IoT offerings in the last year, but these are just the tip of the iceberg. In addition to optimizing their back-end AWS offerings, Amazon is laying the ground work to be a major force in IoT – especially in the connected home and office. Amazon is extending its reach by building on its dominant Cloud IoT platform, its Dash Button strategy, recently announced Replenishment Services, the Echo/Alexa voice recognition control platform, the 6-7 strategic...
The cloud market growth today is largely in public clouds. While there is a lot of spend in IT departments in virtualization, these aren’t yet translating into a true “cloud” experience within the enterprise. What is stopping the growth of the “private cloud” market? In his general session at 18th Cloud Expo, Nara Rajagopalan, CEO of Accelerite, explored the challenges in deploying, managing, and getting adoption for a private cloud within an enterprise. What are the key differences between wh...
For basic one-to-one voice or video calling solutions, WebRTC has proven to be a very powerful technology. Although WebRTC’s core functionality is to provide secure, real-time p2p media streaming, leveraging native platform features and server-side components brings up new communication capabilities for web and native mobile applications, allowing for advanced multi-user use cases such as video broadcasting, conferencing, and media recording.
SYS-CON Events announced today that Venafi, the Immune System for the Internet™ and the leading provider of Next Generation Trust Protection, will exhibit at @DevOpsSummit at 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Venafi is the Immune System for the Internet™ that protects the foundation of all cybersecurity – cryptographic keys and digital certificates – so they can’t be misused by bad guys in attacks...
There will be new vendors providing applications, middleware, and connected devices to support the thriving IoT ecosystem. This essentially means that electronic device manufacturers will also be in the software business. Many will be new to building embedded software or robust software. This creates an increased importance on software quality, particularly within the Industrial Internet of Things where business-critical applications are becoming dependent on products controlled by software. Qua...
In addition to all the benefits, IoT is also bringing new kind of customer experience challenges - cars that unlock themselves, thermostats turning houses into saunas and baby video monitors broadcasting over the internet. This list can only increase because while IoT services should be intuitive and simple to use, the delivery ecosystem is a myriad of potential problems as IoT explodes complexity. So finding a performance issue is like finding the proverbial needle in the haystack.
Machine Learning helps make complex systems more efficient. By applying advanced Machine Learning techniques such as Cognitive Fingerprinting, wind project operators can utilize these tools to learn from collected data, detect regular patterns, and optimize their own operations. In his session at 18th Cloud Expo, Stuart Gillen, Director of Business Development at SparkCognition, discussed how research has demonstrated the value of Machine Learning in delivering next generation analytics to imp...
The 19th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Digital Transformation, Microservices and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportuni...
The Internet of Things will challenge the status quo of how IT and development organizations operate. Or will it? Certainly the fog layer of IoT requires special insights about data ontology, security and transactional integrity. But the developmental challenges are the same: People, Process and Platform. In his session at @ThingsExpo, Craig Sproule, CEO of Metavine, demonstrated how to move beyond today's coding paradigm and shared the must-have mindsets for removing complexity from the develo...
SYS-CON Events announced today that MangoApps will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. MangoApps provides modern company intranets and team collaboration software, allowing workers to stay connected and productive from anywhere in the world and from any device.
Large scale deployments present unique planning challenges, system commissioning hurdles between IT and OT and demand careful system hand-off orchestration. In his session at @ThingsExpo, Jeff Smith, Senior Director and a founding member of Incenergy, will discuss some of the key tactics to ensure delivery success based on his experience of the last two years deploying Industrial IoT systems across four continents.
Basho Technologies has announced the latest release of Basho Riak TS, version 1.3. Riak TS is an enterprise-grade NoSQL database optimized for Internet of Things (IoT). The open source version enables developers to download the software for free and use it in production as well as make contributions to the code and develop applications around Riak TS. Enhancements to Riak TS make it quick, easy and cost-effective to spin up an instance to test new ideas and build IoT applications. In addition to...
Identity is in everything and customers are looking to their providers to ensure the security of their identities, transactions and data. With the increased reliance on cloud-based services, service providers must build security and trust into their offerings, adding value to customers and improving the user experience. Making identity, security and privacy easy for customers provides a unique advantage over the competition.
"We've discovered that after shows 80% if leads that people get, 80% of the conversations end up on the show floor, meaning people forget about it, people forget who they talk to, people forget that there are actual business opportunities to be had here so we try to help out and keep the conversations going," explained Jeff Mesnik, Founder and President of ContentMX, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.