Click here to close now.




















Welcome!

Java IoT Authors: Liz McMillan, Pat Romanski, Rolando Kahn, Carmen Gonzalez, Elizabeth White

Related Topics: Microservices Expo, Java IoT, Industrial IoT, Microsoft Cloud, IoT User Interface, Release Management

Microservices Expo: Article

GUI Versus Script: Is This Old Load Testing Debate Now Over?

New breed of hybrid load testing solutions

The first step in performance or load testing a web application is to create a realistic test script. This script, representing a specific type of end user, contains steps that are fully automated transactions flows. Often, complex behaviors need to be emulated as part of these flows. To incorporate the needed behavior or to handle complex scenarios, testers need to customize these load scripts. The question is whether you utilize a tool that takes a GUI driven approach for script customization/manipulation, or whether you choose a tool which requires the use of a programming language.

As Performance testers, we typically evaluate several load testing tools before diving into a project. Some of us prefer the GUI driven approach to creating load scripts because, being results driven, we want to get the test up and running as quickly as possible. The GUI approach saves us time and there is no programming involved thus the learning curve is also extremely fast. These GUI scripts are typically easily modified by having their parameters and values organized in a visually obvious format. And just because a tool is easy to use, doesn't mean that it's only for beginners. Remember the good old days of MS-DOS? Eeek, thank goodness for GUI driven DOS (Windows).

Some testers (mistakenly) dismiss the GUI driven approach as being too limited for complicated behaviors. Old school testers insist on only utilizing program-based scripts because past experience has led them to think that this is the most flexible or the only choice for handling complicated behaviors. All too often, the perception is that GUI driven scripts limit the level of customizations possible to emulate a real user. This opinion is likely based on experiences with rudimentary GUI tools on the market that are too basic and limited in their capabilities such as handling dynamic content and varying the transactions flows.

However, there is a new breed in load testing solutions, designed and built to handle the most complex advanced scenarios. These are true enterprise-class solutions which provide a hybrid approach by containing both GUI and programming features. The power behind this hybrid approach enables the user to emulate even the most complex behavior but it also includes time saving features which can only be offered by a GUI solution.

Let's get really technical for a minute to highlight an example: Some tools provide the common "programming" tools like loops and conditions. Recorded values of parameters are easily replaced by variables with a click of the mouse. NeoLoad, an example of a modern enterprise solution, goes further to provide even more advanced features. Some specific examples include: 1) "Wait Until" Action to the current execution thread until certain conditions have been verified 2) "Shared Queue" Action to use values from one VU's response as input in an entirely different VU execution 3) a "While" Action allows various transactions, such as web pages, to be iterated while a condition remains false 4) "Try ...Catch" Action to break out of the script based on Validation or Assertions and go to the End phase. The use of nested actions creates even more complex behaviors. All of these advanced scenarios are accomplished without programming! PUSHtechnology which is rapidly being deployed in today's RIA's adds even more complexity. With asynchronous updates pushed to/from the page independent of complete page refreshes...imagine this programming nightmare! NeoLoad has a way to solve this problem using cutting edge technology that can "listen" for PUSH behavior (all polling or streaming requests) and wrap all these asynchronous requests into a GUI fork Action, even calculating the average time interval between execution, then presents you with a newly modified script to emulate these load pattern characteristics. Again, all of these GUI centric features allow further manipulation without the need for programming.

Admittedly, there are rare occasions which call for programming and the new breed solution has a Javascript Action with a complete API to give it a "hybrid" of GUI and coding capability. Again, simply drag the Javascript action into the place where you want it executed and add the java or javascript required. Accomplish things like computation of variables, logging values to files, manipulating cookies, etc.. Incorporating the javascript feature allows for unlimited flexibility in scripting.
As the script becomes more complicated, it's nice to have this hierarchical GUI-type view.

New breed solutions not only allow for complex behaviors...the GUI approach has other time saving embedded assets. To handle dynamic parameters, NeoLoad is delivered with an ever evolving list of known architectural framework dynamic parameters which are automatically detected and handled by a wizard. The search and replace feature finds strings embedded in any request (body, header, URL's, XML tree, partial matches, etc.) and replaces or concatenates to the string with any data or variable - choose to replace entire string or just part of the string. There's an automatic extraction feature to take data from any response and use it to populate the value of a variable. You can enable/disable specific transactions at a page level or embedded request level which a click of the mouse to isolate transactions of interest. Target an entirely different QA/Performance/Production environment - change the Servers field from host where you initially made the recording to the new server name and port. Debug scripts easily using the side-by-side comparison feature with a tab isolating only the differences of recorded vs. replayed values.

From this perspective, the great debate over choosing a GUI driven or programming approach is over...eliminate the tradeoffs and choose a hybrid which has a powerful GUI and also extends the flexibility for programming. Skip most of the manual programming and only use coding where it's required. Both experts and beginners can agree there is now a solution which meets all of the load & performance testing challenges of your own unique web application. Introducing the "GUI hybrid".

More Stories By Rebecca Clinard

Rebecca Clinard is a Senior Performance Engineer at Neotys, a provider of load testing software for Web applications. Previously, she worked as a web application performance engineer for Bowstreet, Fidelity Investments, Bottomline Technologies and Timberland companies, industries spanning retail, financial services, insurance and manufacturing. Her expertise lies in creating realistic load tests and performance tuning multi-tier deployments. She has been orchestrating and conducting performance tests since 2001. Clinard graduated from University of New Hampshire with a BS and also holds a UNIX Certificate from Worcester Polytechnic Institute.

@ThingsExpo Stories
SYS-CON Events announced today that Micron Technology, Inc., a global leader in advanced semiconductor systems, will exhibit at the 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. Micron’s broad portfolio of high-performance memory technologies – including DRAM, NAND and NOR Flash – is the basis for solid state drives, modules, multichip packages and other system solutions. Backed by more than 35 years of technology leadership, Micron's memory solutions enable the world's most innovative computing, consumer,...
SYS-CON Events announced today the Containers & Microservices Bootcamp, being held November 3-4, 2015, in conjunction with 17th Cloud Expo, @ThingsExpo, and @DevOpsSummit at the Santa Clara Convention Center in Santa Clara, CA. This is your chance to get started with the latest technology in the industry. Combined with real-world scenarios and use cases, the Containers and Microservices Bootcamp, led by Janakiram MSV, a Microsoft Regional Director, will include presentations as well as hands-on demos and comprehensive walkthroughs.
SYS-CON Events announced today that Pythian, a global IT services company specializing in helping companies leverage disruptive technologies to optimize revenue-generating systems, has been named “Bronze Sponsor” of SYS-CON's 17th Cloud Expo, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. Founded in 1997, Pythian is a global IT services company that helps companies compete by adopting disruptive technologies such as cloud, Big Data, advanced analytics, and DevOps to advance innovation and increase agility. Specializing in designing, imple...
In his session at @ThingsExpo, Lee Williams, a producer of the first smartphones and tablets, will talk about how he is now applying his experience in mobile technology to the design and development of the next generation of Environmental and Sustainability Services at ETwater. He will explain how M2M controllers work through wirelessly connected remote controls; and specifically delve into a retrofit option that reverse-engineers control codes of existing conventional controller systems so they don't have to be replaced and are instantly converted to become smart, connected devices.
With the Apple Watch making its way onto wrists all over the world, it’s only a matter of time before it becomes a staple in the workplace. In fact, Forrester reported that 68 percent of technology and business decision-makers characterize wearables as a top priority for 2015. Recognizing their business value early on, FinancialForce.com was the first to bring ERP to wearables, helping streamline communication across front and back office functions. In his session at @ThingsExpo, Kevin Roberts, GM of Platform at FinancialForce.com, will discuss the value of business applications on wearable ...
Akana has announced the availability of the new Akana Healthcare Solution. The API-driven solution helps healthcare organizations accelerate their transition to being secure, digitally interoperable businesses. It leverages the Health Level Seven International Fast Healthcare Interoperability Resources (HL7 FHIR) standard to enable broader business use of medical data. Akana developed the Healthcare Solution in response to healthcare businesses that want to increase electronic, multi-device access to health records while reducing operating costs and complying with government regulations.
17th Cloud Expo, taking place Nov 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Meanwhile, 94% of enterprises are using some form of XaaS – software, platform, and infrastructure as a service.
The 3rd International WebRTC Summit, to be held Nov. 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA, announces that its Call for Papers is now open. Topics include all aspects of improving IT delivery by eliminating waste through automated business models leveraging cloud technologies. WebRTC Summit is co-located with 15th International Cloud Expo, 6th International Big Data Expo, 3rd International DevOps Summit and 2nd Internet of @ThingsExpo. WebRTC (Web-based Real-Time Communication) is an open source project supported by Google, Mozilla and Opera that aims to enable bro...
The 17th International Cloud Expo has announced that its Call for Papers is open. 17th International Cloud Expo, to be held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, APM, APIs, Microservices, Security, Big Data, Internet of Things, DevOps and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportunity. Submit your speaking proposal today!
SYS-CON Events announced today that the "Second Containers & Microservices Expo" will take place November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. Containers and microservices have become topics of intense interest throughout the cloud developer and enterprise IT communities.
WebRTC services have already permeated corporate communications in the form of videoconferencing solutions. However, WebRTC has the potential of going beyond and catalyzing a new class of services providing more than calls with capabilities such as mass-scale real-time media broadcasting, enriched and augmented video, person-to-machine and machine-to-machine communications. In his session at @ThingsExpo, Luis Lopez, CEO of Kurento, will introduce the technologies required for implementing these ideas and some early experiments performed in the Kurento open source software community in areas ...
Consumer IoT applications provide data about the user that just doesn’t exist in traditional PC or mobile web applications. This rich data, or “context,” enables the highly personalized consumer experiences that characterize many consumer IoT apps. This same data is also providing brands with unprecedented insight into how their connected products are being used, while, at the same time, powering highly targeted engagement and marketing opportunities. In his session at @ThingsExpo, Nathan Treloar, President and COO of Bebaio, will explore examples of brands transforming their businesses by t...
SYS-CON Events announced today that HPM Networks will exhibit at the 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. For 20 years, HPM Networks has been integrating technology solutions that solve complex business challenges. HPM Networks has designed solutions for both SMB and enterprise customers throughout the San Francisco Bay Area.
While many app developers are comfortable building apps for the smartphone, there is a whole new world out there. In his session at @ThingsExpo, Narayan Sainaney, Co-founder and CTO of Mojio, will discuss how the business case for connected car apps is growing and, with open platform companies having already done the heavy lifting, there really is no barrier to entry.
Too often with compelling new technologies market participants become overly enamored with that attractiveness of the technology and neglect underlying business drivers. This tendency, what some call the “newest shiny object syndrome,” is understandable given that virtually all of us are heavily engaged in technology. But it is also mistaken. Without concrete business cases driving its deployment, IoT, like many other technologies before it, will fade into obscurity.
With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo in Silicon Valley. Learn what is going on, contribute to the discussions, and ensure that your enterprise is as "IoT-Ready" as it can be! Internet of @ThingsExpo, taking place Nov 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 17th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal an...
With the proliferation of connected devices underpinning new Internet of Things systems, Brandon Schulz, Director of Luxoft IoT – Retail, will be looking at the transformation of the retail customer experience in brick and mortar stores in his session at @ThingsExpo. Questions he will address include: Will beacons drop to the wayside like QR codes, or be a proximity-based profit driver? How will the customer experience change in stores of all types when everything can be instrumented and analyzed? As an area of investment, how might a retail company move towards an innovation methodolo...
As more intelligent IoT applications shift into gear, they’re merging into the ever-increasing traffic flow of the Internet. It won’t be long before we experience bottlenecks, as IoT traffic peaks during rush hours. Organizations that are unprepared will find themselves by the side of the road unable to cross back into the fast lane. As billions of new devices begin to communicate and exchange data – will your infrastructure be scalable enough to handle this new interconnected world?
The Internet of Things is in the early stages of mainstream deployment but it promises to unlock value and rapidly transform how organizations manage, operationalize, and monetize their assets. IoT is a complex structure of hardware, sensors, applications, analytics and devices that need to be able to communicate geographically and across all functions. Once the data is collected from numerous endpoints, the challenge then becomes converting it into actionable insight.
Contrary to mainstream media attention, the multiple possibilities of how consumer IoT will transform our everyday lives aren’t the only angle of this headline-gaining trend. There’s a huge opportunity for “industrial IoT” and “Smart Cities” to impact the world in the same capacity – especially during critical situations. For example, a community water dam that needs to release water can leverage embedded critical communications logic to alert the appropriate individuals, on the right device, as soon as they are needed to take action.