Welcome!

Java IoT Authors: Pat Romanski, Elizabeth White, Liz McMillan, Paul Simmons, Yeshim Deniz

Related Topics: @DevOpsSummit

@DevOpsSummit: Blog Post

How to Talk About Performance Testing | @DevOpsSummit #DevOps

Do you ever feel like your performance testing initiatives aren't getting the attention they deserve?

How to Talk About Performance Testing with CEOs and Business Managers

Do you ever feel like your performance testing initiatives aren't getting the attention they deserve? Do they get brushed off as technical exercises? Are they considered second-rate? Do adequate resources remain elusive?

If you've answered yes to any of these questions, there may be a perception problem at play. A business manager who thinks that performance testing is a "nice to have" probably doesn't understand how vital the effort is to the overall business.

You have the power to change that.

We all know things can get crazy in the board room. With all the moving parts in a tech-heavy company, test results can take a back-seat to other metrics. In order to help your manager and high-level staff understand how performance testing directly impacts the bottom line, you'll want to look at things from their perspective: profitability, revenue, and customer retention. That's why, in this post, we'll arm you with the language and examples you need to talk about performance testing with executives.

You've Been Warned: The Health Risks Of Non-Performance
A tech-driven company is only as good as its overall customer experience, and that customer experience is only good when the product is up and running.

Consumers are becoming harder and harder to please. The web is a competitive space, and you'll need more than a strong value proposition to keep customers happy and coming back. Performance matters to your users. They want zippy, interactive access over any device they choose. If they don't get that, they'll jump ship.

As a performance engineer, you know that one of the most risky times in a business's life is when it is actually growing and everything appears to be doing well. Think about it - you are acquiring new users, your brand reputation is expanding, and while everyone else is celebrating this success you know that this is when your infrastructure is being taxed the most. If you take a wrong step... BOOM! Your website could crash and users would flee. Momentum would be halted, and you'd be cooked. But when things are going well, no one wants to think about this scenario.

So, how do you best discuss this risk with your managers so they understand it?

The Business Language of Web & Mobile Performance
If you want to draw attention to the importance of load testing and online performance, use terms that are typically discussed in board rooms. These metrics underlie the business engine that keeps money flowing and servers running.

  • MRR (Monthly Recurring Revenue): This is the crown jewel of any subscription site. It is the money that comes in every month from paying users. If users stop using (because, for example, the site is slow), you'll see MRR decline which could mean the beginning of the end for your business (to put it lightly).
  • AOV (Average Order Value): This is a key metric for an ecommerce site, as it indicates how much money is in the cart when the user checks out. A frustrating experience may cause people to stop browsing (because it's too slow to see a lot of pages). This makes them buy less and subsequently AOV goes down.
  • Lost Traffic / Visitors: Virtually any online business monitors this factor closely because it's a leading indicator of success. The more traffic you have, the more people are on the site, and the more you can expect those visitors to convert to revenue in one way or another. If performance issues are impacting the user experience, you'll see visits decline - particularly those of returning visitors who got fed up and don't come back.
  • Conversion Rate: Do visitors buy? That's what the conversion rate measures. If they have a sub-par experience with your service, they won't buy and you'll observe that the conversion rate will go down. You don't want that to happen.
  • Cart Abandonment: In a real brick-and-mortar store, you would never walk up to the front counter with a full shopping cart, leave the cart, and then just wander off. But this happens all the time online. If it takes too long to check out, you'll see abandonment go up. Losing customers right before they're about to pay is painful.
  • Customer Churn: You spend a lot of money to acquire a new customer. When they start paying you, it's nice to keep them around. If people have a frustrating experience with web pages that don't load, they won't come back. That's customer churn, and it's money out the door. Wave goodbye!
  • Brand Reputation: If enough people experience problems on a site, it can develop a reputation for being hard to use. Once it's set, a reputation is a very hard thing to change. Anyone remember Friendster? That site pre-dated Facebook and could've been the world's most prominent social network, but it kept crashing, so people stopped using it.
  • PR Nightmare: When your site fails on Black Friday or Mother's Day or some other widely publicized moment, it can be a heart-attack-inducing moment. Fear of a PR nightmare alone can be a very powerful motivator.

Everyone Loves a Good Story
Another good way to speak with business people is to tell a story. There are few better ways to communicate urgency than by recounting what happened to someone else. The web is littered with real-life warnings. Here are a couple of tidbits that can help you communicate the relevance of performance testing and monitoring to executives.

Customers Have Ecommerce Anxiety
Did you know that research shows 10% of respondents would go through the trouble of switching banks based on mobile services alone? Further research by Kissmetrics says that web and app users care more about functionality and transactional speed than any other feature.

This anxiety translates into real dollars. Take the example of Best Buy on Black Friday 2014. Unexpected spikes in mobile traffic brought down the website and cost the company real revenue on what should've been one of the most lucrative days of the year.

Slow Sites = Poor Search Rankings
For those who didn't know, Google uses performance data in search rankings. That means slower sites will be dinged in the algorithm. While this has been true for some time, what's new is that Google now displays the fact that a site is slow in the results page.

When given the choice of search results, would you click on a site marked "slow" or would you scroll down the page to the next result? You don't want to push users away before they ever get to your site.

Stick to Prevention Strategies and Ward Off Big Problems
Do you need to know more about the business impact of performance testing for your website?Check out this handy write up from Neotys that will walk you through all the business benefits. Don't miss the section on Load Testing ROI for more detail on how performance testing methods address key risks in your industry. Finally, prepare yourself with our slideshare for more advice on talking about testing with non-experts.

Photo credit: Scott Schiller

More Stories By Tim Hinds

Tim Hinds is the Product Marketing Manager for NeoLoad at Neotys. He has a background in Agile software development, Scrum, Kanban, Continuous Integration, Continuous Delivery, and Continuous Testing practices.

Previously, Tim was Product Marketing Manager at AccuRev, a company acquired by Micro Focus, where he worked with software configuration management, issue tracking, Agile project management, continuous integration, workflow automation, and distributed version control systems.

@ThingsExpo Stories
Cloud-enabled transformation has evolved from cost saving measure to business innovation strategy -- one that combines the cloud with cognitive capabilities to drive market disruption. Learn how you can achieve the insight and agility you need to gain a competitive advantage. Industry-acclaimed CTO and cloud expert, Shankar Kalyana presents. Only the most exceptional IBMers are appointed with the rare distinction of IBM Fellow, the highest technical honor in the company. Shankar has also receive...
It is of utmost importance for the future success of WebRTC to ensure that interoperability is operational between web browsers and any WebRTC-compliant client. To be guaranteed as operational and effective, interoperability must be tested extensively by establishing WebRTC data and media connections between different web browsers running on different devices and operating systems. In his session at WebRTC Summit at @ThingsExpo, Dr. Alex Gouaillard, CEO and Founder of CoSMo Software, presented ...
WebRTC is great technology to build your own communication tools. It will be even more exciting experience it with advanced devices, such as a 360 Camera, 360 microphone, and a depth sensor camera. In his session at @ThingsExpo, Masashi Ganeko, a manager at INFOCOM Corporation, introduced two experimental projects from his team and what they learned from them. "Shotoku Tamago" uses the robot audition software HARK to track speakers in 360 video of a remote party. "Virtual Teleport" uses a multip...
Business professionals no longer wonder if they'll migrate to the cloud; it's now a matter of when. The cloud environment has proved to be a major force in transitioning to an agile business model that enables quick decisions and fast implementation that solidify customer relationships. And when the cloud is combined with the power of cognitive computing, it drives innovation and transformation that achieves astounding competitive advantage.
Data is the fuel that drives the machine learning algorithmic engines and ultimately provides the business value. In his session at Cloud Expo, Ed Featherston, a director and senior enterprise architect at Collaborative Consulting, discussed the key considerations around quality, volume, timeliness, and pedigree that must be dealt with in order to properly fuel that engine.
IoT is rapidly becoming mainstream as more and more investments are made into the platforms and technology. As this movement continues to expand and gain momentum it creates a massive wall of noise that can be difficult to sift through. Unfortunately, this inevitably makes IoT less approachable for people to get started with and can hamper efforts to integrate this key technology into your own portfolio. There are so many connected products already in place today with many hundreds more on the h...
When shopping for a new data processing platform for IoT solutions, many development teams want to be able to test-drive options before making a choice. Yet when evaluating an IoT solution, it’s simply not feasible to do so at scale with physical devices. Building a sensor simulator is the next best choice; however, generating a realistic simulation at very high TPS with ease of configurability is a formidable challenge. When dealing with multiple application or transport protocols, you would be...
Detecting internal user threats in the Big Data eco-system is challenging and cumbersome. Many organizations monitor internal usage of the Big Data eco-system using a set of alerts. This is not a scalable process given the increase in the number of alerts with the accelerating growth in data volume and user base. Organizations are increasingly leveraging machine learning to monitor only those data elements that are sensitive and critical, autonomously establish monitoring policies, and to detect...
In his keynote at 18th Cloud Expo, Andrew Keys, Co-Founder of ConsenSys Enterprise, provided an overview of the evolution of the Internet and the Database and the future of their combination – the Blockchain. Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settl...
In his session at @ThingsExpo, Dr. Robert Cohen, an economist and senior fellow at the Economic Strategy Institute, presented the findings of a series of six detailed case studies of how large corporations are implementing IoT. The session explored how IoT has improved their economic performance, had major impacts on business models and resulted in impressive ROIs. The companies covered span manufacturing and services firms. He also explored servicification, how manufacturing firms shift from se...
DevOpsSummit New York 2018, colocated with CloudEXPO | DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City. Digital Transformation (DX) is a major focus with the introduction of DXWorldEXPO within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of bus...
The Jevons Paradox suggests that when technological advances increase efficiency of a resource, it results in an overall increase in consumption. Writing on the increased use of coal as a result of technological improvements, 19th-century economist William Stanley Jevons found that these improvements led to the development of new ways to utilize coal. In his session at 19th Cloud Expo, Mark Thiele, Chief Strategy Officer for Apcera, compared the Jevons Paradox to modern-day enterprise IT, examin...
IoT solutions exploit operational data generated by Internet-connected smart “things” for the purpose of gaining operational insight and producing “better outcomes” (for example, create new business models, eliminate unscheduled maintenance, etc.). The explosive proliferation of IoT solutions will result in an exponential growth in the volume of IoT data, precipitating significant Information Governance issues: who owns the IoT data, what are the rights/duties of IoT solutions adopters towards t...
Amazon started as an online bookseller 20 years ago. Since then, it has evolved into a technology juggernaut that has disrupted multiple markets and industries and touches many aspects of our lives. It is a relentless technology and business model innovator driving disruption throughout numerous ecosystems. Amazon’s AWS revenues alone are approaching $16B a year making it one of the largest IT companies in the world. With dominant offerings in Cloud, IoT, eCommerce, Big Data, AI, Digital Assista...
Organizations planning enterprise data center consolidation and modernization projects are faced with a challenging, costly reality. Requirements to deploy modern, cloud-native applications simultaneously with traditional client/server applications are almost impossible to achieve with hardware-centric enterprise infrastructure. Compute and network infrastructure are fast moving down a software-defined path, but storage has been a laggard. Until now.
Digital Transformation is much more than a buzzword. The radical shift to digital mechanisms for almost every process is evident across all industries and verticals. This is often especially true in financial services, where the legacy environment is many times unable to keep up with the rapidly shifting demands of the consumer. The constant pressure to provide complete, omnichannel delivery of customer-facing solutions to meet both regulatory and customer demands is putting enormous pressure on...
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...
DXWorldEXPO LLC announced today that All in Mobile, a mobile app development company from Poland, will exhibit at the 22nd International CloudEXPO | DXWorldEXPO. All In Mobile is a mobile app development company from Poland. Since 2014, they maintain passion for developing mobile applications for enterprises and startups worldwide.
"Akvelon is a software development company and we also provide consultancy services to folks who are looking to scale or accelerate their engineering roadmaps," explained Jeremiah Mothersell, Marketing Manager at Akvelon, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
IoT is at the core or many Digital Transformation initiatives with the goal of re-inventing a company's business model. We all agree that collecting relevant IoT data will result in massive amounts of data needing to be stored. However, with the rapid development of IoT devices and ongoing business model transformation, we are not able to predict the volume and growth of IoT data. And with the lack of IoT history, traditional methods of IT and infrastructure planning based on the past do not app...