Welcome!

Java IoT Authors: Jnan Dash, Roger Strukhoff, Elizabeth White, Pat Romanski, Liz McMillan

Blog Feed Post

Unraveling the Mystery: How to Anticipate Application Performance Problems

Complexity vs application performance monitoring

Monitoring application performance is simple…as long as the application and the deployment architecture are also simple.  The mystery appears as the complexity of the application architecture grows and begins to span from an isolated Java or .NET silo into a full-blooded composite application spanning web, middleware and mainframe tiers.  Unraveling this mystery can be daunting as the builders of the application often view their role as within a silo, e.g. web, application server, or database.  However, as transactions traverse across tiers the consequences of what has been coded is not always clear to the developer.  They may have done a perfect job in Java, but their objects might have created something in the database that unknowingly persists after the Java part of the application has exited and its objects are destroyed.  And that is where problems start to creep in…unknowable consequences whose frequency grows with complexity.

Complexity itself is a word that can be used to describe composite applications. According to Wikipedia: “A complex system is a system composed of interconnected parts that as a whole exhibit one or more properties (behavior among the possible properties) not obvious from the properties of the individual parts.”  One may conclude (sometimes, erroneously) from this definition that misbehavior in one or more components of a complex system may not necessarily compromise the system as a whole. The challenge is in how to know that our “complex system” is misbehaving or acting outside of “normal” and what is the impact of this?

Today’s monitoring tools are pretty good at identifying known faults such as server availability, network errors, resource utilization, etc – piece parts. A typical data center receives many thousands of alerts (sometimes millions) daily about all kinds of faults. Many alerts have nothing to do with system-wide outages, but are in fact part of the normal operation of complex systems.  But, from this never ending stream of event big data, how do we separate the signal from the noise and detect abnormal behavior?

For example, a “server down” alert is clearly an indication of a failed system. However, if the server is clustered and the failover succeeded without service interruption, the “server down” is part of normal operation of a complex system and should not raise a red flag. The same applies to the performance attributes of complex systems such as response time, volume and latency. Knowing normal ranges, deviations (dispersion) is key to understanding how complex systems behave.  The other crucial dimension of composite applications is transaction flow, which is the context and the flow of information from one part of the application to another – their behavior.

Real-time application performance monitoring of composite applications requires low-latency analysis using something like a Complex Event Processing engine in order to effectively understand the performance behavior of composite applications as it unfolds.   It must be able to rapidly determine whether current behavior is normal or abnormal or trending towards abnormal and then take action. For more on this topic see the white paper here.

Read the original blog entry...

More Stories By Charles Rich

Charles Rich is Vice President of Product Management at Nastel Technologies, a provider of middleware-centric application performance monitoring for mission-critical applications from the datacenter to the cloud. He is a software product management professional who brings over 27 years of technical hands-on experience working with large-scale customers to meet their application and systems management requirements.

IoT & Smart Cities Stories
This month @nodexl announced that ServerlessSUMMIT & DevOpsSUMMIT own the world's top three most influential Kubernetes domains which are more influential than LinkedIn, Twitter, YouTube, Medium, Infoworld and Microsoft combined. NodeXL is a template for Microsoft® Excel® (2007, 2010, 2013 and 2016) on Windows (XP, Vista, 7, 8, 10) that lets you enter a network edge list into a workbook, click a button, see a network graph, and get a detailed summary report, all in the familiar environment of...
IT professionals are also embracing the reality of Serverless architectures, which are critical to developing and operating real-time applications and services. Serverless is particularly important as enterprises of all sizes develop and deploy Internet of Things (IoT) initiatives. Serverless and Kubernetes are great examples of continuous, rapid pace of change in enterprise IT. They also raise a number of critical issues and questions about employee training, development processes, and opera...
At CloudEXPO Silicon Valley, June 24-26, 2019, Digital Transformation (DX) is a major focus with expanded DevOpsSUMMIT and FinTechEXPO programs within the DXWorldEXPO agenda. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of business. Only 12% still survive. Similar percentages are found throug...
AI and machine learning disruption for Enterprises started happening in the areas such as IT operations management (ITOPs) and Cloud management and SaaS apps. In 2019 CIOs will see disruptive solutions for Cloud & Devops, AI/ML driven IT Ops and Cloud Ops. Customers want AI-driven multi-cloud operations for monitoring, detection, prevention of disruptions. Disruptions cause revenue loss, unhappy users, impacts brand reputation etc.
At CloudEXPO Silicon Valley, June 24-26, 2019, Digital Transformation (DX) is a major focus with expanded DevOpsSUMMIT and FinTechEXPO programs within the DXWorldEXPO agenda. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of business. Only 12% still survive. Similar percentages are found throug...
Atmosera delivers modern cloud services that maximize the advantages of cloud-based infrastructures. Offering private, hybrid, and public cloud solutions, Atmosera works closely with customers to engineer, deploy, and operate cloud architectures with advanced services that deliver strategic business outcomes. Atmosera's expertise simplifies the process of cloud transformation and our 20+ years of experience managing complex IT environments provides our customers with the confidence and trust tha...
The Japan External Trade Organization (JETRO) is a non-profit organization that provides business support services to companies expanding to Japan. With the support of JETRO's dedicated staff, clients can incorporate their business; receive visa, immigration, and HR support; find dedicated office space; identify local government subsidies; get tailored market studies; and more.
At CloudEXPO Silicon Valley, June 24-26, 2019, Digital Transformation (DX) is a major focus with expanded DevOpsSUMMIT and FinTechEXPO programs within the DXWorldEXPO agenda. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of business. Only 12% still survive. Similar percentages are found throug...
As you know, enterprise IT conversation over the past year have often centered upon the open-source Kubernetes container orchestration system. In fact, Kubernetes has emerged as the key technology -- and even primary platform -- of cloud migrations for a wide variety of organizations. Kubernetes is critical to forward-looking enterprises that continue to push their IT infrastructures toward maximum functionality, scalability, and flexibility. As they do so, IT professionals are also embr...
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...