Welcome!

Java IoT Authors: Jnan Dash, Elizabeth White, Liz McMillan, Carmen Gonzalez, Pat Romanski

Related Topics: Java IoT, Microsoft Cloud, IoT User Interface

Java IoT: Blog Post

Let the Logs do the Talking

Did you know that the same log analysis tool could be your key to reporting with management

You are on top of your game. You have a log analysis tool churning logs from all your applications and infrastructure. And now that you have data (LOTS and lots of data...), you are able to understand your infrastructure better than you ever did before. You might even build a dashboard or two that tells you what is going on with your IOPS and utilization, at a glance.

But when it comes time to explain system status or configurations to everyone else in the organization you get stuck. Stuck and frustrated that your time is being taken away from tasks that need to get done.

Did you know that the same log analysis tool could be your key to reporting with management, communicating with developers, and building business cases for change? All with much less effort than before.

How?? Let the logs do the talking for you.

shutterstock_209678401 (1)

During your busy day you are too consumed with regular system admin tasks to think about your next monthly or quarterly meeting with management. In this meeting, however, you are expected to say what is going well, what is going poorly, and how you are improving it. And that is just one audience; the developers need your help too. They demand issue details, and status updates after new releases.  You know all this stuff in your head, but putting it together is hard.

For the developers you cannot just say "hey, something is wrong"... you have to pinpoint the issue in order to avoid the "it works on my machine, or in the lab" challenge. Management wants to know not only what happened, but also the impact on customers and usage. But, often tech speak does not translate to the business issues. And if you know there is an opportunity for improvement, that is going to cost some money, you will have to prove 1)  there is a problem, and 2) that the spend will fix it. How do you build a case, on top of your other work?

It's hard. But just like log analysis tools assimilate information for you to better understand what is going on, they can provide you the tools to help others understand what is going on as well.

A well designed system of dashboards and reporting literally makes it possible for you to screenshot a dashboard, add some numbers and comments, and polish off a great presentation in minuets not days.

Here are some best practices to make your reporting life easier.

  1. Be deliberate in your dashboard creation. Sometimes you are compelled to create a dashboard on demand, as the moment strikes you. While you should not suppress that urge, make sure you understand how any new dashboard is going to be consumed.
  1. Name your dashboards with external communication in mind.  Your naming conventions should not be cryptic. You need to be able to quickly spot the dashboard. For example "OutagesWithTimeSeries" in order to report on recent outages for the quarter.
  1. Give developers a piece of the pie. Allow your developers to access the portions of the analysis platform that pertain to them. Why? Because this makes them accept the information from the platform, and makes them feel a part of the solution. You build a comfort level that allows the communication to flow more easily.
  1. If you always have to use a query you are doing something wrong. Design your quires to be repeatable, and something you can report on.  There is no way to avoid unique one-offs but 90% of the time you should not be writing queries to answer common questions. It's better to turn those quires into pictures.  Use the querying approaches for your research and deep dives into particular issues or analysis only.
  1. Be consistent. Nothing wastes time in meetings like arguing over what a number means.  Be consistent with all reporting so as not to confuse people.  Ideally your presentation will have the same slides, just over different periods of time.
  1. Don't go too deep. The deeper you go the more questions you create. Also you might just lose people in details of say memory utilization that they do not care about. Rather, report on the overall consumption of your infrastructure, and what you are doing with the underage or overage. For example. This means that your reports need to be more concise than you are used to for your own consumption.
  1. Help your boss. Make your boss look great, by creating reports that he/she can also use to streamline their presentations. Setup regular email alerts with the reports and think about what is useful for business teams to know.
  1. Think about your design. If there is an opportunity to better organize, or collect logs than use it. Often organization is an afterthought and comes too late, and then once a year you are trying to clean everything up. Stay organized at the beginning and you will save a ton of time.

Log analysis is a work horse giving you a better point of view of what is going on. It allows you to see the steady state of your applications and infrastructure in one location, and with no manual effort. Log analysis also allows you to make decisions you could not have previously. But this is only half the benefit.  It can be an excellent communication tool as well.

When you use your log management tool into a reporting and communication tool, you will skip the frustration of preparing for the next meeting, or trying to translate your data for other departments in your organization. Save time by taking the extra step to let the logs do the talking for you.

More Stories By Trevor Parsons

Trevor Parsons is Chief Scientist and Co-founder of Logentries. Trevor has over 10 years experience in enterprise software and, in particular, has specialized in developing enterprise monitoring and performance tools for distributed systems. He is also a research fellow at the Performance Engineering Lab Research Group and was formerly a Scientist at the IBM Center for Advanced Studies. Trevor holds a PhD from University College Dublin, Ireland.

@ThingsExpo Stories
Unsecured IoT devices were used to launch crippling DDOS attacks in October 2016, targeting services such as Twitter, Spotify, and GitHub. Subsequent testimony to Congress about potential attacks on office buildings, schools, and hospitals raised the possibility for the IoT to harm and even kill people. What should be done? Does the government need to intervene? This panel at @ThingExpo New York brings together leading IoT and security experts to discuss this very serious topic.
Internet of @ThingsExpo has announced today that Chris Matthieu has been named tech chair of Internet of @ThingsExpo 2017 New York The 7th Internet of @ThingsExpo will take place on June 6-8, 2017, at the Javits Center in New York City, New York. Chris Matthieu is the co-founder and CTO of Octoblu, a revolutionary real-time IoT platform recently acquired by Citrix. Octoblu connects things, systems, people and clouds to a global mesh network allowing users to automate and control design flo...
Everyone knows that truly innovative companies learn as they go along, pushing boundaries in response to market changes and demands. What's more of a mystery is how to balance innovation on a fresh platform built from scratch with the legacy tech stack, product suite and customers that continue to serve as the business' foundation. In his General Session at 19th Cloud Expo, Michael Chambliss, Head of Engineering at ReadyTalk, discussed why and how ReadyTalk diverted from healthy revenue and mor...
SYS-CON Events has announced today that Roger Strukhoff has been named conference chair of Cloud Expo and @ThingsExpo 2017 New York. The 20th Cloud Expo and 7th @ThingsExpo will take place on June 6-8, 2017, at the Javits Center in New York City, NY. "The Internet of Things brings trillions of dollars of opportunity to developers and enterprise IT, no matter how you measure it," stated Roger Strukhoff. "More importantly, it leverages the power of devices and the Internet to enable us all to im...
Information technology is an industry that has always experienced change, and the dramatic change sweeping across the industry today could not be truthfully described as the first time we've seen such widespread change impacting customer investments. However, the rate of the change, and the potential outcomes from today's digital transformation has the distinct potential to separate the industry into two camps: Organizations that see the change coming, embrace it, and successful leverage it; and...
The 20th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held June 6-8, 2017, at the Javits Center in New York City, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Containers, Microservices and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportunity. Submit your speaking proposal ...
20th Cloud Expo, taking place June 6-8, 2017, at the Javits Center in New York City, NY, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy.
You have great SaaS business app ideas. You want to turn your idea quickly into a functional and engaging proof of concept. You need to be able to modify it to meet customers' needs, and you need to deliver a complete and secure SaaS application. How could you achieve all the above and yet avoid unforeseen IT requirements that add unnecessary cost and complexity? You also want your app to be responsive in any device at any time. In his session at 19th Cloud Expo, Mark Allen, General Manager of...
DevOps is being widely accepted (if not fully adopted) as essential in enterprise IT. But as Enterprise DevOps gains maturity, expands scope, and increases velocity, the need for data-driven decisions across teams becomes more acute. DevOps teams in any modern business must wrangle the ‘digital exhaust’ from the delivery toolchain, "pervasive" and "cognitive" computing, APIs and services, mobile devices and applications, the Internet of Things, and now even blockchain. In this power panel at @...
Bert Loomis was a visionary. This general session will highlight how Bert Loomis and people like him inspire us to build great things with small inventions. In their general session at 19th Cloud Expo, Harold Hannon, Architect at IBM Bluemix, and Michael O'Neill, Strategic Business Development at Nvidia, discussed the accelerating pace of AI development and how IBM Cloud and NVIDIA are partnering to bring AI capabilities to "every day," on-demand. They also reviewed two "free infrastructure" pr...
Financial Technology has become a topic of intense interest throughout the cloud developer and enterprise IT communities. Accordingly, attendees at the upcoming 20th Cloud Expo at the Javits Center in New York, June 6-8, 2017, will find fresh new content in a new track called FinTech.
"Dice has been around for the last 20 years. We have been helping tech professionals find new jobs and career opportunities," explained Manish Dixit, VP of Product and Engineering at Dice, in this SYS-CON.tv interview at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
An IoT product’s log files speak volumes about what’s happening with your products in the field, pinpointing current and potential issues, and enabling you to predict failures and save millions of dollars in inventory. But until recently, no one knew how to listen. In his session at @ThingsExpo, Dan Gettens, Chief Research Officer at OnProcess, discussed recent research by Massachusetts Institute of Technology and OnProcess Technology, where MIT created a new, breakthrough analytics model for ...
"At ROHA we develop an app called Catcha. It was developed after we spent a year meeting with, talking to, interacting with senior citizens watching them use their smartphones and talking to them about how they use their smartphones so we could get to know their smartphone behavior," explained Dave Woods, Chief Innovation Officer at ROHA, in this SYS-CON.tv interview at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
"ReadyTalk is an audio and web video conferencing provider. We've really come to embrace WebRTC as the platform for our future of technology," explained Dan Cunningham, CTO of ReadyTalk, in this SYS-CON.tv interview at WebRTC Summit at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Whether your IoT service is connecting cars, homes, appliances, wearable, cameras or other devices, one question hangs in the balance – how do you actually make money from this service? The ability to turn your IoT service into profit requires the ability to create a monetization strategy that is flexible, scalable and working for you in real-time. It must be a transparent, smoothly implemented strategy that all stakeholders – from customers to the board – will be able to understand and comprehe...
In his keynote at 18th Cloud Expo, Andrew Keys, Co-Founder of ConsenSys Enterprise, provided an overview of the evolution of the Internet and the Database and the future of their combination – the Blockchain. Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life sett...
Successful digital transformation requires new organizational competencies and capabilities. Research tells us that the biggest impediment to successful transformation is human; consequently, the biggest enabler is a properly skilled and empowered workforce. In the digital age, new individual and collective competencies are required. In his session at 19th Cloud Expo, Bob Newhouse, CEO and founder of Agilitiv, drew together recent research and lessons learned from emerging and established compa...
The WebRTC Summit New York, to be held June 6-8, 2017, at the Javits Center in New York City, NY, announces that its Call for Papers is now open. Topics include all aspects of improving IT delivery by eliminating waste through automated business models leveraging cloud technologies. WebRTC Summit is co-located with 20th International Cloud Expo and @ThingsExpo. WebRTC is the future of browser-to-browser communications, and continues to make inroads into the traditional, difficult, plug-in web co...
WebRTC is the future of browser-to-browser communications, and continues to make inroads into the traditional, difficult, plug-in web communications world. The 6th WebRTC Summit continues our tradition of delivering the latest and greatest presentations within the world of WebRTC. Topics include voice calling, video chat, P2P file sharing, and use cases that have already leveraged the power and convenience of WebRTC.