Welcome!

Java IoT Authors: Elizabeth White, Liz McMillan, Pat Romanski, Yeshim Deniz, Zakia Bouachraoui

Related Topics: @DevOpsSummit, Java IoT, Microservices Expo, @CloudExpo

@DevOpsSummit: Blog Post

The Art of DevOps | @DevOpsSummit [#DevOps #Containers #Microservices]

Important risk analysis must be performed during the initial requirements gathering during each sprint

The Art of DevOps | Part 3

In this 4-part blog series, I am exposing DevOps best practices using a metaphor inspired by the famous 6th century Chinese manuscript: "The Art of War." It is worth reminding that Sun Tzu, just like me, considered war as a necessary evil, which must be avoided whenever possible. What are we fighting for here? Ultimately, we're fighting for the absolute best services and features that we can deliver to our customers as quickly as we possibly can, and to eliminate the "War Room" scenario we are all so familiar with.

When we last left off, the troops had deployed the build from the Islands of Development to the Staging Grounds. The environments have been outfitted with extensive application monitoring tools and prepared for testing that exposes the battle readiness of the build. Ultimately each build must be exhaustively tested to help ferret out issues that regularly infiltrate user scenarios, UI, high concurrent use, performance, security, disaster recovery, processes, infrastructure and any other function that affects successful operations.

Uncovering issues in the build accomplishes the primary objective in the Staging Grounds. Important risk analysis must be performed during the initial requirements gathering during each sprint. Risks must be assessed regarding how each addition or change in the sprint will affect the overall operation. Because not every change is created equal, the level of risk each change poses will determine:

  • What should be tested
  • The priority in which to build the automated test cases
  • How comprehensive the testing should be around the change
  • Data that may be needed to exercise the identified risks
  • Configuration change effects
  • Number of possibilities to consider when testing the build. This may include but is not limited to:
    • Geographical placement of the tests
    • Consumers such as:
      • Desktop browsers
      • Native Mobile Applications
      • Thick clients
      • Browser versions
    • Business Continuity & Disaster Recovery Scenarios
    • Login users, roles and rights
    • Workflow paths
    • Operating Systems

Constructing the automated testing can be challenging, time-consuming and expensive. While automation in testing adds to the defenses, it also introduces new complexities. Automated test cases must be maintained and updated; therefore, automation cases should be scrutinized for their overall value and return on investment. Automation in testing acts as a supplemental guard to manual testing and will often be evolutionary. A solid feedback loop between operations and development is crucial to improving the automated tests within the delivery pipeline. Ideally the automation should decrease the time to identify an issue and enable troops to focus manual test cases on more obscure and valuable scenarios. As a best practice all test cases identified should be tracked and managed in a Test Case manager like Zephyr, Silk Central or TestRail, to name just a few. Moreover, the system that is chosen must integrate with the requirements tracking tool. This will maintain traceability by linking the test cases with the requirements throughout the lifecycle. For example, Zephyr is the native test case manager used in conjunction with Jira.

As for the staging environments, the infrastructure should be as close to imitating the infrastructure found in the Operational Battlefield. This will ensure that all testing performed is relevant and test results will accurately predict what's to be expected in operations. Troops should also, when deemed effective, establish new virtual machines using baseline images and apply version controlled configuration templates executed by the same configuration management tools found in the Islands of Development. The following types of performance tests are then performed in the Staging Grounds:

A host of software options are available for our arsenal and affords many of the automation functions mentioned above. A few common tools embraced are Selenium, Load Runner and Visual Studio Test. Larger and far more comprehensive testing for web sites can be executed using platform services such as Dynatrace Synthetic Monitoring - a global network of machines that provide most of the testing variations reviewed earlier. Batteries of tests can be authored in this SaaS environment and directed to hit the Staging Grounds with a vengeance. A global simulation emulates a vast number of end users, using a diverse set of desktop configurations and mobile devices that are located across the world. Traffic patterns can be increased to introduce high volumes of concurrent users and attain accurate real world effects on the staged build. Leveraging these automated testing techniques in combination with a highly focused set of manual tests offers the optimal atmosphere for uncovering issues.

Click here for the full article.

More Stories By Brett Hofer

Brett Hofer is as passionate about DevOps as he is about music and art. Specializing in delivering complex mission critical software under methodologies such as Agile, Lean and Waterfall (to name a few), his success at managing and delivering projects with complex technical and political challenges is almost legendary. More than twenty years of broad software/IT experience—from product designer and solution architect to senior management—has given him a unique 360° perspective on IT that has earned the respect of customers and peers alike. Tweet him at @brett_solarch

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


IoT & Smart Cities Stories
In his session at 21st Cloud Expo, Raju Shreewastava, founder of Big Data Trunk, provided a fun and simple way to introduce Machine Leaning to anyone and everyone. He solved a machine learning problem and demonstrated an easy way to be able to do machine learning without even coding. Raju Shreewastava is the founder of Big Data Trunk (www.BigDataTrunk.com), a Big Data Training and consulting firm with offices in the United States. He previously led the data warehouse/business intelligence and Bi...
Nicolas Fierro is CEO of MIMIR Blockchain Solutions. He is a programmer, technologist, and operations dev who has worked with Ethereum and blockchain since 2014. His knowledge in blockchain dates to when he performed dev ops services to the Ethereum Foundation as one the privileged few developers to work with the original core team in Switzerland.
Contextual Analytics of various threat data provides a deeper understanding of a given threat and enables identification of unknown threat vectors. In his session at @ThingsExpo, David Dufour, Head of Security Architecture, IoT, Webroot, Inc., discussed how through the use of Big Data analytics and deep data correlation across different threat types, it is possible to gain a better understanding of where, how and to what level of danger a malicious actor poses to an organization, and to determin...
Cloud-enabled transformation has evolved from cost saving measure to business innovation strategy -- one that combines the cloud with cognitive capabilities to drive market disruption. Learn how you can achieve the insight and agility you need to gain a competitive advantage. Industry-acclaimed CTO and cloud expert, Shankar Kalyana presents. Only the most exceptional IBMers are appointed with the rare distinction of IBM Fellow, the highest technical honor in the company. Shankar has also receive...
Digital Transformation and Disruption, Amazon Style - What You Can Learn. Chris Kocher is a co-founder of Grey Heron, a management and strategic marketing consulting firm. He has 25+ years in both strategic and hands-on operating experience helping executives and investors build revenues and shareholder value. He has consulted with over 130 companies on innovating with new business models, product strategies and monetization. Chris has held management positions at HP and Symantec in addition to ...
"MobiDev is a Ukraine-based software development company. We do mobile development, and we're specialists in that. But we do full stack software development for entrepreneurs, for emerging companies, and for enterprise ventures," explained Alan Winters, U.S. Head of Business Development at MobiDev, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
Cloud computing delivers on-demand resources that provide businesses with flexibility and cost-savings. The challenge in moving workloads to the cloud has been the cost and complexity of ensuring the initial and ongoing security and regulatory (PCI, HIPAA, FFIEC) compliance across private and public clouds. Manual security compliance is slow, prone to human error, and represents over 50% of the cost of managing cloud applications. Determining how to automate cloud security compliance is critical...
Enterprises have taken advantage of IoT to achieve important revenue and cost advantages. What is less apparent is how incumbent enterprises operating at scale have, following success with IoT, built analytic, operations management and software development capabilities - ranging from autonomous vehicles to manageable robotics installations. They have embraced these capabilities as if they were Silicon Valley startups.
Recently, REAN Cloud built a digital concierge for a North Carolina hospital that had observed that most patient call button questions were repetitive. In addition, the paper-based process used to measure patient health metrics was laborious, not in real-time and sometimes error-prone. In their session at 21st Cloud Expo, Sean Finnerty, Executive Director, Practice Lead, Health Care & Life Science at REAN Cloud, and Dr. S.P.T. Krishnan, Principal Architect at REAN Cloud, discussed how they built...
When talking IoT we often focus on the devices, the sensors, the hardware itself. The new smart appliances, the new smart or self-driving cars (which are amalgamations of many ‘things'). When we are looking at the world of IoT, we should take a step back, look at the big picture. What value are these devices providing. IoT is not about the devices, its about the data consumed and generated. The devices are tools, mechanisms, conduits. This paper discusses the considerations when dealing with the...