Welcome!

Java IoT Authors: Yeshim Deniz, Elizabeth White, Liz McMillan, Pat Romanski, Zakia Bouachraoui

Related Topics: @ThingsExpo, Java IoT, Microservices Expo, Microsoft Cloud, Linux Containers, Containers Expo Blog, Agile Computing, @CloudExpo, @DXWorldExpo

@ThingsExpo: Article

Look Beyond the Big Data with the IoT

There Are Several Dimensions to Consider, Not Just Size & Frequency

I've been writing recently about the dimensions of Big Data in the IoT: urgency, importance, frequency, consequences, remedy, cost. You can find my stories on IoT Journal or at my personal website.

The big item missing from this list is, of course, size. How big are individual messages or files? A couple of kilobytes? Many megabytes? And are there still a lot of people who think of Big Data as massive, petabyte-size repositories of epidemiological, meteorological, or particle acceleration data?

I didn't originally include it, because I saw it as twinned with frequency. In the IoT, most message & file sizes are going to be small. Big Data in the IoT has more to do with sensors and less to do with massive scientific apps.

Frequency might mean a real-time sampling rate of 10 times per second, 100 times per second, or more. Or it may be tethered to a passive device that reports in a timeframe we can call "every once in awhile." So the frequency dimension might vary by several million times from one application to another. Even if expressed logarithmically, that's a lot of variance.

Nevertheless, I think I'll combine the two, and change one of the six categories to size/frequency.

Pay to Play
I go through all this because, in the end, someone has to pay for the dataflow and all tha supports it. Most analyses seem to focus on the amount of data being consumed and stores, ie the size/frequency dimension.

But urgency and importance are mission-critical in setting up proper IoT monitoring, analysis, and the speed of that analysis. Furthermore, the consequences of something gone bad can vary from "there's a lightbulb out on the bridge" to "a section of the bridge just collapsed."

The dimensions of consequence and remedy are therefore potentially much more important to cost than the dataflow.

Designing and deploying an IoT project, whether something fun like installing a smart public bench or something grave like monitoring traffic flow, is thus far more than an IT project.

As we get involved in analyzing the cloud computing infrastructures that will no doubt underpin and serve most of the IoT, it's time to focus not only on cost-per-whateverbyte -- the size/frequency dimension -- but also the other dimensions, which tell us what this IoT thing is supposed to do and what happens when things go wrong.

Contact Me on Twitter

More Stories By Roger Strukhoff

Roger Strukhoff (@IoT2040) is Executive Director of the Tau Institute for Global ICT Research, with offices in Illinois and Manila. He is Conference Chair of @CloudExpo & @ThingsExpo, and Editor of SYS-CON Media's CloudComputing BigData & IoT Journals. He holds a BA from Knox College & conducted MBA studies at CSU-East Bay.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


IoT & Smart Cities Stories
Machine learning has taken residence at our cities' cores and now we can finally have "smart cities." Cities are a collection of buildings made to provide the structure and safety necessary for people to function, create and survive. Buildings are a pool of ever-changing performance data from large automated systems such as heating and cooling to the people that live and work within them. Through machine learning, buildings can optimize performance, reduce costs, and improve occupant comfort by ...
René Bostic is the Technical VP of the IBM Cloud Unit in North America. Enjoying her career with IBM during the modern millennial technological era, she is an expert in cloud computing, DevOps and emerging cloud technologies such as Blockchain. Her strengths and core competencies include a proven record of accomplishments in consensus building at all levels to assess, plan, and implement enterprise and cloud computing solutions. René is a member of the Society of Women Engineers (SWE) and a m...
With 10 simultaneous tracks, keynotes, general sessions and targeted breakout classes, @CloudEXPO and DXWorldEXPO are two of the most important technology events of the year. Since its launch over eight years ago, @CloudEXPO and DXWorldEXPO have presented a rock star faculty as well as showcased hundreds of sponsors and exhibitors! In this blog post, we provide 7 tips on how, as part of our world-class faculty, you can deliver one of the most popular sessions at our events. But before reading...
Poor data quality and analytics drive down business value. In fact, Gartner estimated that the average financial impact of poor data quality on organizations is $9.7 million per year. But bad data is much more than a cost center. By eroding trust in information, analytics and the business decisions based on these, it is a serious impediment to digital transformation.
Charles Araujo is an industry analyst, internationally recognized authority on the Digital Enterprise and author of The Quantum Age of IT: Why Everything You Know About IT is About to Change. As Principal Analyst with Intellyx, he writes, speaks and advises organizations on how to navigate through this time of disruption. He is also the founder of The Institute for Digital Transformation and a sought after keynote speaker. He has been a regular contributor to both InformationWeek and CIO Insight...
Bill Schmarzo, Tech Chair of "Big Data | Analytics" of upcoming CloudEXPO | DXWorldEXPO New York (November 12-13, 2018, New York City) today announced the outline and schedule of the track. "The track has been designed in experience/degree order," said Schmarzo. "So, that folks who attend the entire track can leave the conference with some of the skills necessary to get their work done when they get back to their offices. It actually ties back to some work that I'm doing at the University of ...
DXWorldEXPO LLC, the producer of the world's most influential technology conferences and trade shows has announced the 22nd International CloudEXPO | DXWorldEXPO "Early Bird Registration" is now open. Register for Full Conference "Gold Pass" ▸ Here (Expo Hall ▸ Here)
CloudEXPO New York 2018, colocated with DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI, Machine Learning and WebRTC to one location.
The best way to leverage your Cloud Expo presence as a sponsor and exhibitor is to plan your news announcements around our events. The press covering Cloud Expo and @ThingsExpo will have access to these releases and will amplify your news announcements. More than two dozen Cloud companies either set deals at our shows or have announced their mergers and acquisitions at Cloud Expo. Product announcements during our show provide your company with the most reach through our targeted audiences.
The Internet of Things will challenge the status quo of how IT and development organizations operate. Or will it? Certainly the fog layer of IoT requires special insights about data ontology, security and transactional integrity. But the developmental challenges are the same: People, Process and Platform and how we integrate our thinking to solve complicated problems. In his session at 19th Cloud Expo, Craig Sproule, CEO of Metavine, demonstrated how to move beyond today's coding paradigm and sh...