Click here to close now.


Java IoT Authors: Automic Blog, Anders Wallgren, Liz McMillan, Greg O'Connor, Tim Hinds

Related Topics: @CloudExpo, Java IoT, Microservices Expo, Containers Expo Blog, @BigDataExpo, SDN Journal

@CloudExpo: Blog Post

Harness APIs to Deliver Competitive Applications in the ‘Cloud of Clouds’

Re‐evaluate your service delivery cycle to see how APIs, cloud, and DevOps can help

Based on Andi Mann's presentation at Cloud Expo 2013 Silicon Valley

IT organizations face a growing demand for faster innovation and new applications to support emerging opportunities in social, mobile, growth markets, Big Data analytics, mergers and acquisitions, strategic partnerships, and more. This is great news because it shows that IT continues to be a key stakeholder in delivering business service innovation. However, it also means that IT must deliver new innovation despite flat budgets, while maintaining existing services that grow more complex every day.

The 'Cloud of Clouds'
This is where cloud computing can help to deliver business outcomes, especially if you look beyond just one or two cloud providers, to the almost limitless variety of interconnected and intermediated cloud services - what I call the 'cloud of clouds'. This is true especially for foundational capabilities - like compute infrastructure, data storage, content delivery, or financial management; and cloud-native services like social media, mobile interfaces, or Big Data analytics. Indeed, it makes little sense today to waste time and resources to rewrite existing code every time you need one of these foundational or cloud-native services. By leveraging the cloud of clouds, developers can instead focus on writing new and unique application code that delivers the competitive advantage the business needs.

APIs in the Cloud of Clouds
This is what a range of innovative startups and services already do. For example:

  • A mashup of the data from cyclists' GPS devices with the Google Maps API has given us the explosively popular cycling tracker, Strava, a new way to track your progress, compete with friends and strangers, follow pros, and manage your own personal records.
  • New York State's Metropolitan Transit Authority (MTA) opened up its APIs to developers in a hackathon-style contest called App Quest, enabling developers to build new mobile apps to help enhance the transit experience of MTA's 8.5 million daily riders.
  • Connecting and mining the cloud newsfeeds of AP, Reuters, AFP, and many others new services around the world via their open APIs and other data feeds, allowed NewsMap to deliver one of my favorite news applications, a dynamic graphical worldwide news 'heat map.'

The key to rapid development of new applications is finding services that fill foundational needs; accessing these services efficiently and safely; and building innovative capabilities on top of them.

Identifying Opportunities in the Cloud of Clouds
Initially, you must identify cloud services that can help you speed your time to value. This means you need to know where your gaps are and where your core competencies are. Project and Portfolio Management (PPM) is a mature discipline with new relevance in the cloud of clouds. PPM solutions like CA Clarity PPM allow you to compare your available internal applications and code with best practices in the external cloud; and to detect and analyze your current cloud service usage to find the 'known good services' that are already delivering value. Using PPM tools that account for cost, risk, performance, uniqueness, criticality, compliance, quality, and more, you can quickly see, for example:

  • Where you have unique and competitive core competencies internally
  • Which existing internal capabilities you should lean on for new development
  • What existing capabilities you should move to the cloud of clouds
  • Where you should double-down on external cloud services you already use
  • What additional services you should source from the cloud of clouds

A formal portfolio analysis allows you to narrow your search and find the best services in the cloud of clouds, beyond the 'usual suspects' (like Amazon Web Services, Google App/Compute Engine,, or Akamai). Look also at new cloud marketplaces like AppDirect or CloudCommons, at emerging cloud service brokers, and of course at your existing internal IT services.

You can then focus on accessing those services for commodity, mundane, or routine services, and connecting them to your unique code development to deliver competitive new applications. Key elements here include:

  • Integration and interoperability: Making external compute, cloud, and applications look like internal code to your developers is often an integration challenge
  • Security and compliance: Opening up to public or outsourced private cloud will introduce some repeat challenges in moving data and workloads
  • Governance and management: Defining and enforcing policies for how your enterprise consumes interacts with cloud services

Accessing APIs in the Cloud of Clouds
Inevitably, access to these cloud services will be via APIs, so you will need to manage and secure API access. An integrated API security and management solution like CA Layer 7 Gateway accelerates application ROI by addressing a range of API needs - like security, performance, scalability, flexibility, and extensibility. This approach to leveraging APIs helps you to:

  • Connect partners and divisions with each other and with external cloud services
  • Provide secure integration to multiple platforms including mobile and back-end systems
  • Enable internal and external developers to collaborate on code seamlessly

This last point is particularly important. Two-way integration extracts even more value out of your existing capabilities by exposing your existing code to external developers and systems. They can then leverage your strengths and build entirely new services around your core capabilities.

This approach to leveraging the cloud of clouds via existing APIs to deliver new competitive applications will enable multiple business goals - from reach and revenue to agility and access. You can build applications that can reach your customers wherever they are. You can accelerate the pace and quality of new disruptive innovation, improving IT efficiency through reuse and agility. You can enable new applications to fuel the fire of employee mobility, or simply deliver new applications to support new products and services that drive new revenue.

Accelerating Development with a DevOps Approach
However, merely accessing cloud services via open APIs does not ensure rapid application delivery. The final part of this approach is to speed the application development lifecycle, integrating APIs from the cloud of clouds with new approaches to the software development lifecycle (SDLC). By adopting a DevOps approach to the SLDC, you can bring the application portfolio forward to meet market challenges with collaboration and efficiency from design to deployment.

A holistic devops approach to application delivery is a topic for an entirely different post, but the following capabilities will certainly help you on your way:

  • Collaborative Product Planning: Business leaders, development engineers, and system administrators working together to improve collaboration and reduce delays
  • Infrastructure Abstraction and Automation: To automate change, configuration, and provisioning and save time on mundane infrastructure activities
  • Service Virtualization: Virtualizing the entire environment for development, test, and QA so every developer and tester can have every resource they need, all the time
  • Continuous Delivery: Automated code drop (and rollback) to enable rapid iteration that delivers new capabilities in hours, not weeks (or months) to production
  • End‐to‐End Operational Monitoring: Enabling DevOps professionals to detect, diagnose, and resolve problems faster by accelerating problem tracking, identification, and fix

This all fits together into a reiterative closed-loop application delivery lifecycle. Shared portfolio gaps and application requirements feed an agile development process including accelerated test and quality assurance, released rapidly and integrated continuously into production, with real-time operations monitoring to mine performance and capacity data, feeding requirements back into portfolio analysis, ready for the next iteration of the application development.

There is no doubt that a DevOps approach to application delivery helps to deliver better code into production, faster and cheaper. For example, independent research has shown that organizations with a DevOps approach to application delivery have:

  • Improved quality of our deployed applications by 22%
  • Reduced time-to-market for software/services by 20%
  • Reduction spend on development and operations by 18%
  • And increased frequency of software/services deployments by 17%

Getting Started
Where can you start on this transformative journey to delivering new, competitive applications by harnessing APIs and the cloud of clouds? Some of my recommendations would include:

  • Re‐evaluate your service delivery cycle to see how APIs, cloud, and DevOps can help
  • Evaluate how APIs to cloud and internal services can support new innovation
  • Evaluate new processes to connect business, development, and operations teams
  • Evaluate new technologies to support a devops approach to application delivery
  • Improve education, communications, collaboration, and cross‐skilling in both dev and ops
  • Try cloud and API development in a small part of your org, a new project, or skunkworks
  • Leverage cloud APIs in a critical new application that you need to deliver yesterday

Once you see how you can harness APIs to deliver competitive applications in the "cloud of clouds," you will see how this approach will help you support your business partners in their quest for more rapid innovation, delivered through new competitive applications, to support critical new business opportunities.

More Stories By Andi Mann

Andi Mann is vice president of Strategic Solutions at CA Technologies. With more than 20 years’ experience across four continents, he has deep expertise of enterprise software on cloud, mainframe, midrange, server and desktop systems. He has worked within IT departments for governments and corporations, from small businesses to global multi-nationals; with several large enterprise software vendors; and as a leading industry analyst advising enterprises, governments, and IT vendors – from startups to the worlds’ largest companies. Andi is a co-author of the popular handbook, ‘Visible Ops – Private Cloud’; he blogs at ‘Andi Mann – Übergeek’ (, and tweets as @AndiMann.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

@ThingsExpo Stories
Countless business models have spawned from the IaaS industry – resell Web hosting, blogs, public cloud, and on and on. With the overwhelming amount of tools available to us, it's sometimes easy to overlook that many of them are just new skins of resources we've had for a long time. In his general session at 17th Cloud Expo, Harold Hannon, Sr. Software Architect at SoftLayer, an IBM Company, broke down what we have to work with, discussed the benefits and pitfalls and how we can best use them to design hosted applications.
Most of the IoT Gateway scenarios involve collecting data from machines/processing and pushing data upstream to cloud for further analytics. The gateway hardware varies from Raspberry Pi to Industrial PCs. The document states the process of allowing deploying polyglot data pipelining software with the clear notion of supporting immutability. In his session at @ThingsExpo, Shashank Jain, a development architect for SAP Labs, discussed the objective, which is to automate the IoT deployment process from development to production scenarios using Docker containers.
We all know that data growth is exploding and storage budgets are shrinking. Instead of showing you charts on about how much data there is, in his General Session at 17th Cloud Expo, Scott Cleland, Senior Director of Product Marketing at HGST, showed how to capture all of your data in one place. After you have your data under control, you can then analyze it in one place, saving time and resources.
The Internet of Things (IoT) is growing rapidly by extending current technologies, products and networks. By 2020, Cisco estimates there will be 50 billion connected devices. Gartner has forecast revenues of over $300 billion, just to IoT suppliers. Now is the time to figure out how you’ll make money – not just create innovative products. With hundreds of new products and companies jumping into the IoT fray every month, there’s no shortage of innovation. Despite this, McKinsey/VisionMobile data shows "less than 10 percent of IoT developers are making enough to support a reasonably sized team....
Just over a week ago I received a long and loud sustained applause for a presentation I delivered at this year’s Cloud Expo in Santa Clara. I was extremely pleased with the turnout and had some very good conversations with many of the attendees. Over the next few days I had many more meaningful conversations and was not only happy with the results but also learned a few new things. Here is everything I learned in those three days distilled into three short points.
DevOps is about increasing efficiency, but nothing is more inefficient than building the same application twice. However, this is a routine occurrence with enterprise applications that need both a rich desktop web interface and strong mobile support. With recent technological advances from Isomorphic Software and others, rich desktop and tuned mobile experiences can now be created with a single codebase – without compromising functionality, performance or usability. In his session at DevOps Summit, Charles Kendrick, CTO and Chief Architect at Isomorphic Software, demonstrated examples of com...
As organizations realize the scope of the Internet of Things, gaining key insights from Big Data, through the use of advanced analytics, becomes crucial. However, IoT also creates the need for petabyte scale storage of data from millions of devices. A new type of Storage is required which seamlessly integrates robust data analytics with massive scale. These storage systems will act as “smart systems” provide in-place analytics that speed discovery and enable businesses to quickly derive meaningful and actionable insights. In his session at @ThingsExpo, Paul Turner, Chief Marketing Officer at...
In his keynote at @ThingsExpo, Chris Matthieu, Director of IoT Engineering at Citrix and co-founder and CTO of Octoblu, focused on building an IoT platform and company. He provided a behind-the-scenes look at Octoblu’s platform, business, and pivots along the way (including the Citrix acquisition of Octoblu).
In his General Session at 17th Cloud Expo, Bruce Swann, Senior Product Marketing Manager for Adobe Campaign, explored the key ingredients of cross-channel marketing in a digital world. Learn how the Adobe Marketing Cloud can help marketers embrace opportunities for personalized, relevant and real-time customer engagement across offline (direct mail, point of sale, call center) and digital (email, website, SMS, mobile apps, social networks, connected objects).
The Internet of Everything is re-shaping technology trends–moving away from “request/response” architecture to an “always-on” Streaming Web where data is in constant motion and secure, reliable communication is an absolute necessity. As more and more THINGS go online, the challenges that developers will need to address will only increase exponentially. In his session at @ThingsExpo, Todd Greene, Founder & CEO of PubNub, exploreed the current state of IoT connectivity and review key trends and technology requirements that will drive the Internet of Things from hype to reality.
Two weeks ago (November 3-5), I attended the Cloud Expo Silicon Valley as a speaker, where I presented on the security and privacy due diligence requirements for cloud solutions. Cloud security is a topical issue for every CIO, CISO, and technology buyer. Decision-makers are always looking for insights on how to mitigate the security risks of implementing and using cloud solutions. Based on the presentation topics covered at the conference, as well as the general discussions heard between sessions, I wanted to share some of my observations on emerging trends. As cyber security serves as a fou...
With all the incredible momentum behind the Internet of Things (IoT) industry, it is easy to forget that not a single CEO wakes up and wonders if “my IoT is broken.” What they wonder is if they are making the right decisions to do all they can to increase revenue, decrease costs, and improve customer experience – effectively the same challenges they have always had in growing their business. The exciting thing about the IoT industry is now these decisions can be better, faster, and smarter. Now all corporate assets – people, objects, and spaces – can share information about themselves and thei...
The cloud. Like a comic book superhero, there seems to be no problem it can’t fix or cost it can’t slash. Yet making the transition is not always easy and production environments are still largely on premise. Taking some practical and sensible steps to reduce risk can also help provide a basis for a successful cloud transition. A plethora of surveys from the likes of IDG and Gartner show that more than 70 percent of enterprises have deployed at least one or more cloud application or workload. Yet a closer inspection at the data reveals less than half of these cloud projects involve production...
Discussions of cloud computing have evolved in recent years from a focus on specific types of cloud, to a world of hybrid cloud, and to a world dominated by the APIs that make today's multi-cloud environments and hybrid clouds possible. In this Power Panel at 17th Cloud Expo, moderated by Conference Chair Roger Strukhoff, panelists addressed the importance of customers being able to use the specific technologies they need, through environments and ecosystems that expose their APIs to make true change and transformation possible.
Microservices are a very exciting architectural approach that many organizations are looking to as a way to accelerate innovation. Microservices promise to allow teams to move away from monolithic "ball of mud" systems, but the reality is that, in the vast majority of organizations, different projects and technologies will continue to be developed at different speeds. How to handle the dependencies between these disparate systems with different iteration cycles? Consider the "canoncial problem" in this scenario: microservice A (releases daily) depends on a couple of additions to backend B (re...
Too often with compelling new technologies market participants become overly enamored with that attractiveness of the technology and neglect underlying business drivers. This tendency, what some call the “newest shiny object syndrome” is understandable given that virtually all of us are heavily engaged in technology. But it is also mistaken. Without concrete business cases driving its deployment, IoT, like many other technologies before it, will fade into obscurity.
Container technology is shaping the future of DevOps and it’s also changing the way organizations think about application development. With the rise of mobile applications in the enterprise, businesses are abandoning year-long development cycles and embracing technologies that enable rapid development and continuous deployment of apps. In his session at DevOps Summit, Kurt Collins, Developer Evangelist at, examined how Docker has evolved into a highly effective tool for application delivery by allowing increasingly popular Mobile Backend-as-a-Service (mBaaS) platforms to quickly crea...
The Internet of Things is clearly many things: data collection and analytics, wearables, Smart Grids and Smart Cities, the Industrial Internet, and more. Cool platforms like Arduino, Raspberry Pi, Intel's Galileo and Edison, and a diverse world of sensors are making the IoT a great toy box for developers in all these areas. In this Power Panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, panelists discussed what things are the most important, which will have the most profound effect on the world, and what should we expect to see over the next couple of years.
Growth hacking is common for startups to make unheard-of progress in building their business. Career Hacks can help Geek Girls and those who support them (yes, that's you too, Dad!) to excel in this typically male-dominated world. Get ready to learn the facts: Is there a bias against women in the tech / developer communities? Why are women 50% of the workforce, but hold only 24% of the STEM or IT positions? Some beginnings of what to do about it! In her Day 2 Keynote at 17th Cloud Expo, Sandy Carter, IBM General Manager Cloud Ecosystem and Developers, and a Social Business Evangelist, wil...
PubNub has announced the release of BLOCKS, a set of customizable microservices that give developers a simple way to add code and deploy features for realtime apps.PubNub BLOCKS executes business logic directly on the data streaming through PubNub’s network without splitting it off to an intermediary server controlled by the customer. This revolutionary approach streamlines app development, reduces endpoint-to-endpoint latency, and allows apps to better leverage the enormous scalability of PubNub’s Data Stream Network.