Welcome!

Java IoT Authors: Elizabeth White, Pat Romanski, Yeshim Deniz, Liz McMillan, Stackify Blog

Related Topics: @DevOpsSummit, Java IoT, @CloudExpo

@DevOpsSummit: Article

How to Lead with Analytics By @HoardingInfo | @DevOpsSummit [#DevOps]

The speed and performance of the modern software delivery pipeline brings a new set of challenges

Today, everything must be faster. Faster releases; faster and larger backlogs; faster complaints; faster bugs. The speed and performance of the modern software delivery pipeline brings a new set of challenges. How do you keep up? There really is only one option - automation and measurement. You need a method for automatically collecting data about your application and how it is being used. But also a good way to find the relevant information and act on it. And in order to do this your development team needs to lead with analytics first.

There are many types of analytics platforms. The breadth of each platform is determined by the amount and type of data they contain from the delivery pipeline.

Log management and analytics butters across all data produced by the pipeline. And for this reason it is one place the team can centralize the collection of new data. Data collection is great and relatively easy, but there are a few problems.

  1. Data stored without a purpose or way to analyze has no value.
  2. IT often owns Log analysis and sometimes developers have limited access or participation.

Yes, you can log everything; and you should. The reason you should is because getting data retroactively is expensive and difficult; and it might not provide value right away.  But another reason is to improve  communication and ownership around the log analysis service itself. Often with log analysis, Ops owns its implementation and usage. Depending on the culture of the teams this could hinder the development team from gaining value or insights from the tool. In a worse case scenario IT locks out all data and usage that is not system and infrastructure related. In the best case developers have their own level of access or even their own tools, and are storing data in the system as well.

10-ways-to-lead-with-analytics

Without everyone working in, storing, analyzing and sharing value from the log analysis service there are guaranteed gaps in communication and issue resolution. It is critical that the entire team use the system to ensure consistent communication and continuity between application layer and system layer issues. Not only will developers help enrich the platform, they also can benefit from bugs that are identified more quickly.

So how can the developers better use log analysis platform? Here are 10 things developers can do to lead with analytics.

In Your Code

  1. Exception Blocks: This is a simple idea, but not commonly done. In your exception blocks, log the error message or maybe even the entire stack trace.  This is a great way to create dashboards on error types. And historically measure the number and frequency of error types.
  2. Log Trigger Events: Log critical actions such as user activity. This data can later be related to user cohorts for marketing, product management, and growth hacking purposes. But also for the developers to optimize user flow. For example, events you expect a user to take, but they do not.  Or accidental actions such as a logout.
  3. Run Duration for Bigger Processes: For large process intensive or lengthy application processes, log start and stop times. It can then be correlated to pegged servers, outages or load issues if they arise. This data can help to identify areas where the product is slow to respond, or issues of application processes effecting infrastructure.
  4. Log Deprecated Functionality: When deprecated functionality is called, log it so the team can be alerted. This will help QA and Development know when outdated classes are being used by other team members by accident.
  5. Log flag Changes: Some developers like to use flags in their code to indicate different states. Create a function for changing flags so that it is logged and clear when flags are off or on. This allows the reporting or alerting of when a particular flag that should have been off, remained on in production.
  6. Log Component Usage: Applications are a treasure pile of 3rd party component libraries. These libraries pose a risk when they are not monitored. For all the components used, it is good to log their usage - component name and version.  There is a downside as this can be very chatty if not designed well. And it has to be backed by some good component tracking process outside of the collection, and from the insights.

With the Team

  1. Architect Your Logs: Make sure the development team agrees on a standard for logging key value pairs. A consistent language and format so that everyone on the team can understand it.
  2. Leverage Tags: Creating the logs is part of it, but create relevant tags once the logging happens. For example "User" for user data. "Error" for the above error exception data.
  3. Create Dashboards: If you log it, use it. Create dashboards give them convenient names and share them with the team. Also create alerting and email reports on regular basis. There does need to be a process to review and prune unused or old dashboards or you will have dashboard sprawl/confusion.
  4. Unify System to Application: Help the broader team understand the relationship of applications to the infrastructure they run on. For example apache functionality specific to a new version, ties to orchestration scripts or containers, etc. If you do this successful IT may not have to ask you about OS level configurations and backend code, they can fix it themselves.

For a team to be metrics- and results-driven, they need to lead with analytics. And to lead with analytics means to log everything and establish easy ways to leverage what is logged. Developers have a lot to gain from a valuable system and application logging service including reducing bugs, faster time to resolution, and better insight across infrastructure and application layers.

More Stories By Trevor Parsons

Trevor Parsons is Chief Scientist and Co-founder of Logentries. Trevor has over 10 years experience in enterprise software and, in particular, has specialized in developing enterprise monitoring and performance tools for distributed systems. He is also a research fellow at the Performance Engineering Lab Research Group and was formerly a Scientist at the IBM Center for Advanced Studies. Trevor holds a PhD from University College Dublin, Ireland.

@ThingsExpo Stories
Announcing Poland #DigitalTransformation Pavilion
Digital Transformation is much more than a buzzword. The radical shift to digital mechanisms for almost every process is evident across all industries and verticals. This is often especially true in financial services, where the legacy environment is many times unable to keep up with the rapidly shifting demands of the consumer. The constant pressure to provide complete, omnichannel delivery of customer-facing solutions to meet both regulatory and customer demands is putting enormous pressure on...
DXWorldEXPO LLC announced today that All in Mobile, a mobile app development company from Poland, will exhibit at the 22nd International CloudEXPO | DXWorldEXPO. All In Mobile is a mobile app development company from Poland. Since 2014, they maintain passion for developing mobile applications for enterprises and startups worldwide.
CloudEXPO | DXWorldEXPO are the world's most influential, independent events where Cloud Computing was coined and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals. Sponsors of DXWorldEXPO | CloudEXPO benefit from unmatched branding, profile building and lead generation opportunities.
The best way to leverage your CloudEXPO | DXWorldEXPO presence as a sponsor and exhibitor is to plan your news announcements around our events. The press covering CloudEXPO | DXWorldEXPO will have access to these releases and will amplify your news announcements. More than two dozen Cloud companies either set deals at our shows or have announced their mergers and acquisitions at CloudEXPO. Product announcements during our show provide your company with the most reach through our targeted audienc...
@DevOpsSummit at Cloud Expo, taking place November 12-13 in New York City, NY, is co-located with 22nd international CloudEXPO | first international DXWorldEXPO and will feature technical sessions from a rock star conference faculty and the leading industry players in the world.
Everything run by electricity will eventually be connected to the Internet. Get ahead of the Internet of Things revolution. In his session at @ThingsExpo, Akvelon expert and IoT industry leader Sergey Grebnov provided an educational dive into the world of managing your home, workplace and all the devices they contain with the power of machine-based AI and intelligent Bot services for a completely streamlined experience.
DXWorldEXPO | CloudEXPO are the world's most influential, independent events where Cloud Computing was coined and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals. Sponsors of DXWorldEXPO | CloudEXPO benefit from unmatched branding, profile building and lead generation opportunities.
22nd International Cloud Expo, taking place June 5-7, 2018, at the Javits Center in New York City, NY, and co-located with the 1st DXWorld Expo will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud ...
In his keynote at 19th Cloud Expo, Sheng Liang, co-founder and CEO of Rancher Labs, discussed the technological advances and new business opportunities created by the rapid adoption of containers. With the success of Amazon Web Services (AWS) and various open source technologies used to build private clouds, cloud computing has become an essential component of IT strategy. However, users continue to face challenges in implementing clouds, as older technologies evolve and newer ones like Docker c...
"MobiDev is a software development company and we do complex, custom software development for everybody from entrepreneurs to large enterprises," explained Alan Winters, U.S. Head of Business Development at MobiDev, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
JETRO showcased Japan Digital Transformation Pavilion at SYS-CON's 21st International Cloud Expo® at the Santa Clara Convention Center in Santa Clara, CA. The Japan External Trade Organization (JETRO) is a non-profit organization that provides business support services to companies expanding to Japan. With the support of JETRO's dedicated staff, clients can incorporate their business; receive visa, immigration, and HR support; find dedicated office space; identify local government subsidies; get...
Dion Hinchcliffe is an internationally recognized digital expert, bestselling book author, frequent keynote speaker, analyst, futurist, and transformation expert based in Washington, DC. He is currently Chief Strategy Officer at the industry-leading digital strategy and online community solutions firm, 7Summits.
Bill Schmarzo, author of "Big Data: Understanding How Data Powers Big Business" and "Big Data MBA: Driving Business Strategies with Data Science," is responsible for setting the strategy and defining the Big Data service offerings and capabilities for EMC Global Services Big Data Practice. As the CTO for the Big Data Practice, he is responsible for working with organizations to help them identify where and how to start their big data journeys. He's written several white papers, is an avid blogge...
In past @ThingsExpo presentations, Joseph di Paolantonio has explored how various Internet of Things (IoT) and data management and analytics (DMA) solution spaces will come together as sensor analytics ecosystems. This year, in his session at @ThingsExpo, Joseph di Paolantonio from DataArchon, added the numerous Transportation areas, from autonomous vehicles to “Uber for containers.” While IoT data in any one area of Transportation will have a huge impact in that area, combining sensor analytic...
Bill Schmarzo, author of "Big Data: Understanding How Data Powers Big Business" and "Big Data MBA: Driving Business Strategies with Data Science," is responsible for setting the strategy and defining the Big Data service offerings and capabilities for EMC Global Services Big Data Practice. As the CTO for the Big Data Practice, he is responsible for working with organizations to help them identify where and how to start their big data journeys. He's written several white papers, is an avid blogge...
Charles Araujo is an industry analyst, internationally recognized authority on the Digital Enterprise and author of The Quantum Age of IT: Why Everything You Know About IT is About to Change. As Principal Analyst with Intellyx, he writes, speaks and advises organizations on how to navigate through this time of disruption. He is also the founder of The Institute for Digital Transformation and a sought after keynote speaker. He has been a regular contributor to both InformationWeek and CIO Insight...
Michael Maximilien, better known as max or Dr. Max, is a computer scientist with IBM. At IBM Research Triangle Park, he was a principal engineer for the worldwide industry point-of-sale standard: JavaPOS. At IBM Research, some highlights include pioneering research on semantic Web services, mashups, and cloud computing, and platform-as-a-service. He joined the IBM Cloud Labs in 2014 and works closely with Pivotal Inc., to help make the Cloud Found the best PaaS.
It is of utmost importance for the future success of WebRTC to ensure that interoperability is operational between web browsers and any WebRTC-compliant client. To be guaranteed as operational and effective, interoperability must be tested extensively by establishing WebRTC data and media connections between different web browsers running on different devices and operating systems. In his session at WebRTC Summit at @ThingsExpo, Dr. Alex Gouaillard, CEO and Founder of CoSMo Software, presented ...
I think DevOps is now a rambunctious teenager - it's starting to get a mind of its own, wanting to get its own things but it still needs some adult supervision," explained Thomas Hooker, VP of marketing at CollabNet, in this SYS-CON.tv interview at DevOps Summit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.