Welcome!

Java IoT Authors: Pat Romanski, Liz McMillan, Elizabeth White, Yeshim Deniz, Frank Lupo

Related Topics: @CloudExpo, Java IoT, Mobile IoT, Linux Containers, Agile Computing, FinTech Journal, @DevOpsSummit

@CloudExpo: Article

Mobile Performance Testing | @CloudExpo #DevOps #IoT #M2M #ML #BigData

Simply ignoring mobile users during your performance testing is dangerous

If you read the title and assumed this post would be filled with baseball analogies, you'd be right! It's game day and all those fans who fill up major league stadiums, those are your application users. They are invested in the game and have shown up to watch the players (i.e. your application) perform.

Depending on how the game plays out, your audience will either head home elated or full of disappointment. The great thing is that in your case, unlike in the case of traditional baseball games, there doesn't have to be a loser. You can consistently ensure happy mobile users by setting yourself up for home runs and the crème de la crème, grand slams.

Despite the monumental importance of providing a seamless app experience for mobile users, companies still fall short in terms of mobile performance testing - some even choose to completely forgo the practice.

Striking out isn't any fun for you or your app users, but that's exactly what you'll end up doing if you ignore mobile users during performance testing. So here's the breakdown - from strikeouts to grand slams - of the steps you'll need to take to deliver exceptional application performance to all of your mobile users, regardless of device, network conditions and geographic location.

A Strikeout
Simply ignoring mobile users during your performance testing is dangerous. More than once, major brands have faced website outages on Black Friday, no less, due to unexpected spikes in mobile usage. You need a mobile performance testing strategy because people will access your application via mobile devices, whether or not you have a dedicated mobile app.

If you fail to test the performance of your application for mobile users, they may encounter slow load times and/or site outages. This results in an automatic strikeout. It's even possible that your poor application performance sends users running...straight into the arms of competitors.

A Single
Device Simulation

Hitting a single is nothing to be ashamed of, but it's nothing to write home about either. As it relates to mobile performance testing, hitting a single means you're simulating devices (i.e., using a software platform installed on a laptop or desktop that imitates a mobile platform or OS environment). This gives testers insight into how an application behaves on an emulated phone.

A Double
Device Simulation + Network Emulation

As you'll note, these build on one another. Hitting a double is a result of using both device simulation and network emulation. Unlike desktop and laptop users, mobile users will suffer from poor network conditions including limited bandwidth, latency and packet loss at a much greater rate. Using a tool to emulate different conditions in your testing scenarios is essential in understanding how your application performs when users face changes in connectivity.

Ignoring the various network conditions users will face in the wild will surely affect the end user experience, and not in a positive way.

A Triple
Device Simulation + Network Emulation + Real-Device Recording

To hit a triple, you'll need to incorporate recording from real devices. Could you record your test cases on the web version of your app and just use device simulation during your tests? Sure, but you need to know the web and mobile versions of your app inside and out.

While the calls to the backend may be the same for web and mobile versions of apps, mobile versions often don't have all the features of the web versions. This means you may be replaying actions a mobile user would never perform, and that could significantly skew your test results.

A Home Run
Device Simulation + Network Emulation + Real-Device Recording + End-User Experience Testing on Real Devices

Adding end-user experience (EUE) testing via real devices to your mobile performance testing strategy will earn you a home run! With EUE testing, functional test scripts will run on a real device while load testing is also being performed. Meanwhile, testers are able to measure the rendering times on the front end of the application so they can correlate backend times in order to quickly identify the root cause of performance issues.

A Grand Slam
Device Simulation + Network Emulation + Real-Device Recording + End User Experience Testing on Real Devices + Cloud Testing

To perform complete mobile performance testing and hit that grand slam, you'll need to add geographic realism to your scenarios by load testing from the cloud. Mobile users aren't accessing your servers from a single location and varying geographic dynamics can greatly affect the way load is placed on your application. To create the most realistic tests, use the cloud to distribute your load generators geographically based on historical user data - from where do they typically access your application?

Adding geographic realism to your performance tests will give you better insight into any performance limitations of your application.

Take Home the Win
Racking up some singles, doubles and triples never hurt, but mobile users (and fans) demand more. Any sign of application performance issues can quickly lead to revenue loss, brand damage and diminished employee productivity. As such, companies should, at the very least, invest in the development of a Home Run mobile performance testing strategy.

However, to come out on top and continuously deliver an exceptional application experience to mobile users, you'll need to adopt a Grand Slam strategy. We know that on your journey to complete mobile performance testing you may face some challenges. To learn how you can overcome these challenges check out our free whitepaper, "Addressing Mobile Load Testing Challenges."

Batter up!

More Stories By Tim Hinds

Tim Hinds is the Product Marketing Manager for NeoLoad at Neotys. He has a background in Agile software development, Scrum, Kanban, Continuous Integration, Continuous Delivery, and Continuous Testing practices.

Previously, Tim was Product Marketing Manager at AccuRev, a company acquired by Micro Focus, where he worked with software configuration management, issue tracking, Agile project management, continuous integration, workflow automation, and distributed version control systems.

@ThingsExpo Stories
Most technology leaders, contemporary and from the hardware era, are reshaping their businesses to do software. They hope to capture value from emerging technologies such as IoT, SDN, and AI. Ultimately, irrespective of the vertical, it is about deriving value from independent software applications participating in an ecosystem as one comprehensive solution. In his session at @ThingsExpo, Kausik Sridhar, founder and CTO of Pulzze Systems, will discuss how given the magnitude of today's applicati...
Smart cities have the potential to change our lives at so many levels for citizens: less pollution, reduced parking obstacles, better health, education and more energy savings. Real-time data streaming and the Internet of Things (IoT) possess the power to turn this vision into a reality. However, most organizations today are building their data infrastructure to focus solely on addressing immediate business needs vs. a platform capable of quickly adapting emerging technologies to address future ...
SYS-CON Events announced today that Ryobi Systems will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Ryobi Systems Co., Ltd., as an information service company, specialized in business support for local governments and medical industry. We are challenging to achive the precision farming with AI. For more information, visit http:...
As popularity of the smart home is growing and continues to go mainstream, technological factors play a greater role. The IoT protocol houses the interoperability battery consumption, security, and configuration of a smart home device, and it can be difficult for companies to choose the right kind for their product. For both DIY and professionally installed smart homes, developers need to consider each of these elements for their product to be successful in the market and current smart homes.
SYS-CON Events announced today that Golden Gate University will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Since 1901, non-profit Golden Gate University (GGU) has been helping adults achieve their professional goals by providing high quality, practice-based undergraduate and graduate educational programs in law, taxation, business and related professions. Many of its courses are taug...
What is the best strategy for selecting the right offshore company for your business? In his session at 21st Cloud Expo, Alan Winters, U.S. Head of Business Development at MobiDev, will discuss the things to look for - positive and negative - in evaluating your options. He will also discuss how to maximize productivity with your offshore developers. Before you start your search, clearly understand your business needs and how that impacts software choices.
SYS-CON Events announced today that Avere Systems, a leading provider of hybrid cloud enablement solutions, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Avere Systems was created by file systems experts determined to reinvent storage by changing the way enterprises thought about and bought storage resources. With decades of experience behind the company’s founders, Avere got its ...
High-velocity engineering teams are applying not only continuous delivery processes, but also lessons in experimentation from established leaders like Amazon, Netflix, and Facebook. These companies have made experimentation a foundation for their release processes, allowing them to try out major feature releases and redesigns within smaller groups before making them broadly available. In his session at 21st Cloud Expo, Brian Lucas, Senior Staff Engineer at Optimizely, will discuss how by using...
In this strange new world where more and more power is drawn from business technology, companies are effectively straddling two paths on the road to innovation and transformation into digital enterprises. The first path is the heritage trail – with “legacy” technology forming the background. Here, extant technologies are transformed by core IT teams to provide more API-driven approaches. Legacy systems can restrict companies that are transitioning into digital enterprises. To truly become a lead...
SYS-CON Events announced today that Yuasa System will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Yuasa System is introducing a multi-purpose endurance testing system for flexible displays, OLED devices, flexible substrates, flat cables, and films in smartphones, wearables, automobiles, and healthcare.
SYS-CON Events announced today that CAST Software will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CAST was founded more than 25 years ago to make the invisible visible. Built around the idea that even the best analytics on the market still leave blind spots for technical teams looking to deliver better software and prevent outages, CAST provides the software intelligence that matter ...
SYS-CON Events announced today that Daiya Industry will exhibit at the Japanese Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Ruby Development Inc. builds new services in short period of time and provides a continuous support of those services based on Ruby on Rails. For more information, please visit https://github.com/RubyDevInc.
SYS-CON Events announced today that Evatronix will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Evatronix SA offers comprehensive solutions in the design and implementation of electronic systems, in CAD / CAM deployment, and also is a designer and manufacturer of advanced 3D scanners for professional applications.
As businesses evolve, they need technology that is simple to help them succeed today and flexible enough to help them build for tomorrow. Chrome is fit for the workplace of the future — providing a secure, consistent user experience across a range of devices that can be used anywhere. In her session at 21st Cloud Expo, Vidya Nagarajan, a Senior Product Manager at Google, will take a look at various options as to how ChromeOS can be leveraged to interact with people on the devices, and formats th...
SYS-CON Events announced today that Taica will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Taica manufacturers Alpha-GEL brand silicone components and materials, which maintain outstanding performance over a wide temperature range -40C to +200C. For more information, visit http://www.taica.co.jp/english/.
SYS-CON Events announced today that SourceForge has been named “Media Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. SourceForge is the largest, most trusted destination for Open Source Software development, collaboration, discovery and download on the web serving over 32 million viewers, 150 million downloads and over 460,000 active development projects each and every month.
Enterprises have taken advantage of IoT to achieve important revenue and cost advantages. What is less apparent is how incumbent enterprises operating at scale have, following success with IoT, built analytic, operations management and software development capabilities – ranging from autonomous vehicles to manageable robotics installations. They have embraced these capabilities as if they were Silicon Valley startups. As a result, many firms employ new business models that place enormous impor...
SYS-CON Events announced today that TidalScale will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. TidalScale is the leading provider of Software-Defined Servers that bring flexibility to modern data centers by right-sizing servers on the fly to fit any data set or workload. TidalScale’s award-winning inverse hypervisor technology combines multiple commodity servers (including their ass...
SYS-CON Events announced today that MIRAI Inc. will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. MIRAI Inc. are IT consultants from the public sector whose mission is to solve social issues by technology and innovation and to create a meaningful future for people.
In his Opening Keynote at 21st Cloud Expo, John Considine, General Manager of IBM Cloud Infrastructure, will lead you through the exciting evolution of the cloud. He'll look at this major disruption from the perspective of technology, business models, and what this means for enterprises of all sizes. John Considine is General Manager of Cloud Infrastructure Services at IBM. In that role he is responsible for leading IBM’s public cloud infrastructure including strategy, development, and offering ...