Welcome!

Java IoT Authors: Elizabeth White, Carmen Gonzalez, Pat Romanski, Liz McMillan, Yeshim Deniz

Related Topics: Java IoT, Industrial IoT, Microservices Expo

Java IoT: Article

Software Quality Best Practices: Healthy Software

Great Software IS Great Marketing

Consider the following scenario-typical in many application development organizations. A major new release of an application has just gone into production. Although the development and QA teams endured many late nights of coding and testing, and consumed large quantities of delivered pizza, the project missed its ship date. Still, customers are happy with the product and are giving positive feedback. By many definitions, the team has produced a quality product.

Then, a new, large business opportunity requires the rapid implementation of a significant new feature in the product. The tired and over-worked development team struggles with how, or even if, it can meet the new requirement. They are concerned that the new feature will break the existing product and predict a lengthy development cycle.

Schedule overruns, tired staff, and difficulty in changing or adding functionality are sure indications that something is wrong with your software: your software is unhealthy. It is poorly specified, architected, and designed; it lacks comprehensive documentation, and automated unit and system tests. Changing even the smallest part of its code is fraught with risk as no one fully understands the implications.

The cost of unhealthy software
The impact of unhealthy software is significant and even has a quantifiable effect on the value of the business.  The total payroll for individuals in the US software workforce approaches US$120 Billion per year.  According to industry experts such as Capers Jones, nearly US$75 Billion of that can be attributed to software repair.  This amount is equivalent to one-fifth of the profits reported by the largest 500 corporations in the United States.  Stated another way, if corporations were able to convert this $120 Billion into profits, they would increase their market capitalization by an incredible USD$2 Trillion, based on current S&P500 multiples.   Other studies, such as the May 2002 NIST report estimated a smaller amount for the value of potentially recoverable costs--$21 Billion.

The costs associated with the consequences of defective software are even more severe.  The NIST report estimates that over $38 Billion of end-users' time is wasted.  And the Standish Group reported downstream business costs-"collateral damage" of nearly $300 billion.

The path to healthy software
Many solutions have been proposed to help remedy the problem, including requirements management, modeling tools, incremental development, component-based development, service orientation, and automated system tests. All of these solutions add value, but none have as much impact as Developer Testing.

It makes so much sense: developers create the code that embodies the design and also harbors the software's defects. Enabling developers to validate the correctness of their code at the time they write it creates cascading positive effects that have tremendous beneficial impact on software health:

  • Developers can fix simple coding errors at a very low cost, without negatively affecting other modules.
  • They are able to fix the design flaw that led to the error, not just remove the manifestation of the error. Testable code is better code.
  • They keep the tests with their code and run them often. Any changes that introduce errors at later stages of the development cycle are immediately observed and fixed.
  • The tests developers create serve as an executable specification. Other developers can understand what each developer's software module does from these tests, and write their own software such that it interacts correctly - further promoting proper design.
  • The final software product they deliver comes with a body of executable unit tests that cover all of its code, branches, and outcomes. Developers will be confident of the software's quality and make changes with speed and certainty.

Figure 1: Developer Testing results in healthier applications.

As the above graph indicates in red, in the absence of Developer Testing, developers work without significant feedback on software quality until the QA team begins testing, which is usually late in the development cycle.

By then, software health has deteriorated to the point where it is typically impossible to fully restore. At a minimum, it would be difficult and expensive to do so.

In contrast, the above chart shows in green that a team using Developer Testing keeps its software healthy throughout the development cycle. The project will be completed earlier, with more confidence, and less stress. And the resulting product will be highly reusable and extensible. The team has delivered healthy software.

Developer Testing defined
Developer Testing (also called unit testing, or programmer testing) has gained significant acceptance in the recent years, fueled by the adoption of agile development processes such as XP and Scrum. The popular Developer Testing framework JUnit has been downloaded more than 1 million times and is now included with most IDEs.

Here is how we define Developer Testing for software development teams:

  • For every software unit created, developers also create meaningful tests that can be automatically executed to verify that the software functions correctly.
  • Developers do not check in a unit of software before the tests for that unit pass.
  • Developers add the tests to a repository of unit tests that verify that all units of the integrated system function correctly.
  • This collection of unit tests is executed frequently, and the team commits to keep the tests passing at every stage of the development process.

Teams that practice Developer Testing usually use some form of build automation. By integrating new code into a fully built system on a regular basis, it is possible to detect and fix regressions early, particularly when the process includes running a comprehensive body of unit tests.
Broadening the adoption of Developer Testing

If Developer Testing provides so many benefits, why is it done so rarely? The answer, to a large degree, is that current approaches rely too much on extensive manual effort:

  • Writing tests is a combinatorial problem. Every branch in code requires multiple tests. To accomplish good coverage, developers must often write test code that is several times as long as the source code it is meant to test.
  • Maintaining tests becomes more of a burden as the number of tests grows and the associated code changes. As a result, tests often go out of date and, once they have, they lose their value and are no longer used.
  • Even if tests are up-to-date and are being run frequently, it can be hard to interpret their relevance. What part of the code has been tested, and what has not? Is the untested code likely to harbor defects? Without tools to interpret and direct the results, Developer Testing will only have marginal value.

Test execution frameworks like JUnit, build automation tools like Ant and Maven, and integration/automation tools like CruiseControl have had an enormously positive impact on the adoption of Developer Testing. What is still needed is a set of tools that help overcome the most significant barriers: the creation and maintenance of unit tests, and the management of Developer Testing efforts.

More Stories By Hollis Tibbetts

Hollis Tibbetts, or @SoftwareHollis as his 50,000+ followers know him on Twitter, is listed on various “top 100 expert lists” for a variety of topics – ranging from Cloud to Technology Marketing, Hollis is by day Evangelist & Software Technology Director at Dell Software. By night and weekends he is a commentator, speaker and all-round communicator about Software, Data and Cloud in their myriad aspects. You can also reach Hollis on LinkedIn – linkedin.com/in/SoftwareHollis. His latest online venture is OnlineBackupNews - a free reference site to help organizations protect their data, applications and systems from threats. Every year IT Downtime Costs $26.5 Billion In Lost Revenue. Even with such high costs, 56% of enterprises in North America and 30% in Europe don’t have a good disaster recovery plan. Online Backup News aims to make sure you all have the news and tips needed to keep your IT Costs down and your information safe by providing best practices, technology insights, strategies, real-world examples and various tips and techniques from a variety of industry experts.

Hollis is a regularly featured blogger at ebizQ, a venue focused on enterprise technologies, with over 100,000 subscribers. He is also an author on Social Media Today "The World's Best Thinkers on Social Media", and maintains a blog focused on protecting data: Online Backup News.
He tweets actively as @SoftwareHollis

Additional information is available at HollisTibbetts.com

All opinions expressed in the author's articles are his own personal opinions vs. those of his employer.

@ThingsExpo Stories
SYS-CON Events announced today that Systena America will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Systena Group has been in business for various software development and verification in Japan, US, ASEAN, and China by utilizing the knowledge we gained from all types of device development for various industries including smartphones (Android/iOS), wireless communication, security technology and IoT serv...
SYS-CON Events announced today that Outscale will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Outscale's technology makes an automated and adaptable Cloud available to businesses, supporting them in the most complex IT projects while controlling their operational aspects. You boost your IT infrastructure's reactivity, with request responses that only take a few seconds.
DevOps at Cloud Expo – being held October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA – announces that its Call for Papers is open. Born out of proven success in agile development, cloud computing, and process automation, DevOps is a macro trend you cannot afford to miss. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the world's largest enterprises – and delivering real r...
SYS-CON Events announced today that delaPlex will exhibit at SYS-CON's @CloudExpo, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. delaPlex pioneered Software Development as a Service (SDaaS), which provides scalable resources to build, test, and deploy software. It’s a fast and more reliable way to develop a new product or expand your in-house team.
Five years ago development was seen as a dead-end career, now it’s anything but – with an explosion in mobile and IoT initiatives increasing the demand for skilled engineers. But apart from having a ready supply of great coders, what constitutes true ‘DevOps Royalty’? It’ll be the ability to craft resilient architectures, supportability, security everywhere across the software lifecycle. In his keynote at @DevOpsSummit at 20th Cloud Expo, Jeffrey Scheaffer, GM and SVP, Continuous Delivery Busine...
SYS-CON Events announced today that Outscale, a global pure play Infrastructure as a Service provider and strategic partner of Dassault Systèmes, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Founded in 2010, Outscale simplifies infrastructure complexities and boosts the business agility of its customers. Outscale delivers a secure, reliable and industrial strength solution for its customers, which in...
In order to meet the rapidly changing demands of today’s customers, companies are continually forced to redefine their business strategies in order to meet these needs, stay relevant and continue to see profitable growth. IoT deployment and development is integral in this transformation, and today businesses are increasingly seeing the value of investing their resources into IoT deployments. These technologies are able increase ROI through projects such as connecting supply chains or enabling sm...
SYS-CON Events announced today that CollabNet, a global leader in enterprise software development, release automation and DevOps solutions, will be a Bronze Sponsor of SYS-CON's 20th International Cloud Expo®, taking place from June 6-8, 2017, at the Javits Center in New York City, NY. CollabNet offers a broad range of solutions with the mission of helping modern organizations deliver quality software at speed. The company’s latest innovation, the DevOps Lifecycle Manager (DLM), supports Value S...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
Everywhere we turn in our industry we can find strong opinions about the direction, type and nature of cloud’s impact on computing and business. Another word that is used in every context in our industry is “hybrid.” In his session at 20th Cloud Expo, Alvaro Gonzalez, Director of Technical, Partner and Field Marketing at Peak 10, will use a combination of a few conceptual props and some research recently commissioned by Peak 10 to offer a real-world consideration of how the various categories of...
SYS-CON Events announced today that Peak 10, Inc., a national IT infrastructure and cloud services provider, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Peak 10 provides reliable, tailored data center and network services, cloud and managed services. Its solutions are designed to scale and adapt to customers’ changing business needs, enabling them to lower costs, improve performance and focus intern...
SYS-CON Events announced today that Super Micro Computer, Inc., a global leader in compute, storage and networking technologies, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Supermicro (NASDAQ: SMCI), the leading innovator in high-performance, high-efficiency server technology, is a premier provider of advanced server Building Block Solutions® for Data Center, Cloud Computing, Enterprise IT, Hadoop/...
Multiple data types are pouring into IoT deployments. Data is coming in small packages as well as enormous files and data streams of many sizes. Widespread use of mobile devices adds to the total. In this power panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, panelists will look at the tools and environments that are being put to use in IoT deployments, as well as the team skills a modern enterprise IT shop needs to keep things running, get a handle on all this data, and deli...
In his opening keynote at 20th Cloud Expo, Michael Maximilien, Research Scientist, Architect, and Engineer at IBM, will motivate why realizing the full potential of the cloud and social data requires artificial intelligence. By mixing Cloud Foundry and the rich set of Watson services, IBM's Bluemix is the best cloud operating system for enterprises today, providing rapid development and deployment of applications that can take advantage of the rich catalog of Watson services to help drive insigh...
SYS-CON Events announced today that SoftLayer, an IBM Company, has been named “Gold Sponsor” of SYS-CON's 18th Cloud Expo, which will take place on June 7-9, 2016, at the Javits Center in New York, New York. SoftLayer, an IBM Company, provides cloud infrastructure as a service from a growing number of data centers and network points of presence around the world. SoftLayer’s customers range from Web startups to global enterprises.
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend @CloudExpo | @ThingsExpo, June 6-8, 2017, at the Javits Center in New York City, NY and October 31 - November 2, 2017, Santa Clara Convention Center, CA. Learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.
SYS-CON Events announced today that EARP Integration will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. EARP Integration is a passionate software house. Since its inception in 2009 the company successfully delivers smart solutions for cities and factories that start their digital transformation. EARP provides bespoke solutions like, for example, advanced enterprise portals, business intelligence systems an...
SYS-CON Events announced today that Progress, a global leader in application development, has been named “Bronze Sponsor” of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Enterprises today are rapidly adopting the cloud, while continuing to retain business-critical/sensitive data inside the firewall. This is creating two separate data silos – one inside the firewall and the other outside the firewall. Cloud ISVs oft...
As cloud adoption continues to transform business, today's global enterprises are challenged with managing a growing amount of information living outside of the data center. The rapid adoption of IoT and increasingly mobile workforce are exacerbating the problem. Ensuring secure data sharing and efficient backup poses capacity and bandwidth considerations as well as policy and regulatory compliance issues.
The 21st International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Digital Transformation, Machine Learning and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding busin...