Welcome!

Java IoT Authors: Elizabeth White, Pat Romanski, Dana Gardner, Liz McMillan, AppDynamics Blog

News Feed Item

DataTorrent Raises the Bar on Real-Time Data Analytics With Industry's First Enterprise Class Real-Time Streaming Platform

DataTorrent RTS Delivers Greater Than 1 Billion Operations/Second With High Availability On Wide Set of Hadoop Distributions

SANTA CLARA, CA -- (Marketwired) -- 06/03/14 -- DataTorrent, creator of the world's first enterprise grade real-time stream processing platform on Hadoop, today announced the general availability of DataTorrent RTS. DataTorrent RTS enables enterprises to take action in real-time as a result of high-performance complex processing of data as it is created. Separately, DataTorrent announced a strategic go-to-market partnership with Trace3.

With today's release, DataTorrent RTS becomes the industry's first commercial offering to deliver real-time streaming analytic capabilities on Hadoop with performance greater than 1 billion data events per second -- equivalent to processing 46 cumulative hours of streaming Twitter data in one second. Additionally, DataTorrent RTS' fault tolerant architecture ensures zero downtime and is certified to run on all major Hadoop and Cloud distributions.

"We are seeing increasing interest in stream-processing platforms for real-time analytics, as a complement to data warehouses and Apache Hadoop," said Jason Stamper, Research Analyst, 451 Group. "Enterprise adoption of stream-processing requires fast, in-memory processing of a large volume of events at scale -- and in many cases a fault-tolerant architecture too."

By 2020, the number of smartphones, tablets, and personal computers in use will reach 7.3 billion units. Additionally, the number of Internet of Things (IoT) connected devices will grow to 26 billion units, a nearly 30-fold increase from 0.9 billion in 2009.(1)

As this massive amount of human and machine-generated data outpaces the capabilities of traditional databases, organizations are seeking ways to find scalable, predictable technology that enables reduced operational costs, increased revenue and increased customer satisfaction. Current Hadoop technology provides a scalable way to store and process data in a batch-oriented mode, but processing data in this way can take hours or even days.

DataTorrent RTS Streaming Analytics Platform

DataTorrent RTS allows organizations to harness the full potential of big data by enabling faster data ingestion, data processing, and more timely data insights. Key capabilities include:

  • Streaming, scalable data ingestion & extraction from any source: DataTorrent RTS connects to thousands of systems simultaneously using pre-built operators and processes millions of incoming data events without delay.
  • High performance data transformation and complex computation: In-memory processing on data and events as they happen provides near-zero latency. With the ability to scale to billions of data events per second, DataTorrent RTS delivers the needs of today's enterprises and future-proofs tomorrow's unexpected requirements.
  • Real-time monitoring, alerting and action: DataTorrent RTS' architecture provides the ability to extend analytic capabilities beyond static queries. Custom business logic written in Java enables monitoring, alerting, analysis, and action all taken in real-time, saving organizations time and money while also increasing customer satisfaction.
  • Compatibility with existing Big Data processes: DataTorrent RTS archives and loads results into any data store for archiving and query-based analytics. This ensures that an organization's existing processes work the same, just sooner -- they no longer need to wait hours or days to do data analysis.
  • Fault tolerant, highly available, dynamic system: DataTorrent RTS' streaming window implementation allows for in-line system checkpointing to ensure high availability and guarantees processing of every event. The fault tolerant implementation provides the flexibility to change business logic and insert or delete operators on a running system with no downtime.

"Hadoop has made big data analytics a reality; however, the true value of big data is unlocked when it can be acted upon in real-time," said Phu Hoang, co-founder and CEO, DataTorrent. "DataTorrent RTS is designed specifically to address this need for the enterprise. Through the advances provided by Hadoop 2.0, we are proud to raise the bar on real-time analytics to offer the industry's first true real-time data ingestion and analysis platform at scale."

Open Platform Support Provides Customer Choice

DataTorrent RTS is a Hadoop 2.0 (YARN) native application. One hundred percent Hadoop 2.0 compliance allows DataTorrent RTS and Hadoop Map Reduce to exist side-by-side. With more than 400 Apache 2.0 open source DataTorrent operators, creating and deploying real time streaming analytic application is now easier than ever.

DataTorrent's open approach is validated by certifications on the industry leading Hadoop distributions from Cloudera, Hortonworks and MapR Technologies as well as the leading cloud providers, Amazon Web Services and Google Compute Engine.

"The certification of DataTorrent RTS on Cloudera Enterprise 5, provides our joint customers the ability to ingest, analyze, and act on voluminous streams of data in real-time as data flows into an enterprise data hub," said Amr Awadallah, co-founder and chief technology officer, Cloudera. "This real-time capability allows joint customers to uncover real-time insights and enables them to realize the full value of Cloudera's industry leading platform for big data."

"We're pleased to certify DataTorrent RTS on Hortonworks Data Platform 2.1, the industry's only 100-percent open source Apache Hadoop distribution," said John Kreisa, vice president of strategic marketing at Hortonworks. "With partners like DataTorrent and their YARN Ready applications in the Hadoop ecosystem, we're able to provide enterprises with the ability to aggregate new types of data from sensors/machines, server logs, clickstreams, and other sources to a Data Lake, empowering a true modern data architecture that delivers business insights in real-time."

"Real-time data analysis at large scale with fault tolerance is a key customer requirement," said M.C. Srivas, CTO and Co-Founder of MapR Technologies. "DataTorrent RTS certification provides an enterprise-grade, real-time streaming application managed by YARN within the mission-critical, high-performance MapR Distribution for Apache Hadoop."

DataTorrent RTS for Hadoop is generally available today. For more information, or to download, click here.

Additional Resources

  • Visit the DataTorrent RTS Webpage
  • Learn how DataTorrent handles over 1 billion data events per second
  • Check out the DataTorrent blog
  • Follow us on Twitter

About DataTorrent
DataTorrent RTS is the world's most powerful Big Data streaming platform built exclusively on Hadoop. With its massively scalable architecture, DataTorrent RTS allows enterprises to process, monitor, analyze and act on data instantaneously. Based in Santa Clara, California, DataTorrent is backed by leading investors including August Capital, Morado Ventures, and Yahoo co-founder Jerry Yang. For more information, visit our website or follow us on Twitter.

(1) Gartner Press Release, "Gartner Says the Internet of Things Installed Base Will Grow to 26 Billion Units By 2020." December 12, 2013. http://www.gartner.com/newsroom/id/2636073

Media Contact:
Fitzgerald Barth
LEWIS PR for DataTorrent
(415) 432-2457
Email Contact

More Stories By Marketwired .

Copyright © 2009 Marketwired. All rights reserved. All the news releases provided by Marketwired are copyrighted. Any forms of copying other than an individual user's personal reference without express written permission is prohibited. Further distribution of these materials is strictly forbidden, including but not limited to, posting, emailing, faxing, archiving in a public database, redistributing via a computer network or in a printed form.

@ThingsExpo Stories
In addition to all the benefits, IoT is also bringing new kind of customer experience challenges - cars that unlock themselves, thermostats turning houses into saunas and baby video monitors broadcasting over the internet. This list can only increase because while IoT services should be intuitive and simple to use, the delivery ecosystem is a myriad of potential problems as IoT explodes complexity. So finding a performance issue is like finding the proverbial needle in the haystack.
The 19th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Digital Transformation, Microservices and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportuni...
Large scale deployments present unique planning challenges, system commissioning hurdles between IT and OT and demand careful system hand-off orchestration. In his session at @ThingsExpo, Jeff Smith, Senior Director and a founding member of Incenergy, will discuss some of the key tactics to ensure delivery success based on his experience of the last two years deploying Industrial IoT systems across four continents.
The Internet of Things will challenge the status quo of how IT and development organizations operate. Or will it? Certainly the fog layer of IoT requires special insights about data ontology, security and transactional integrity. But the developmental challenges are the same: People, Process and Platform. In his session at @ThingsExpo, Craig Sproule, CEO of Metavine, demonstrated how to move beyond today's coding paradigm and shared the must-have mindsets for removing complexity from the develo...
SYS-CON Events announced today that MangoApps will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. MangoApps provides modern company intranets and team collaboration software, allowing workers to stay connected and productive from anywhere in the world and from any device.
IoT is rapidly changing the way enterprises are using data to improve business decision-making. In order to derive business value, organizations must unlock insights from the data gathered and then act on these. In their session at @ThingsExpo, Eric Hoffman, Vice President at EastBanc Technologies, and Peter Shashkin, Head of Development Department at EastBanc Technologies, discussed how one organization leveraged IoT, cloud technology and data analysis to improve customer experiences and effi...
The IETF draft standard for M2M certificates is a security solution specifically designed for the demanding needs of IoT/M2M applications. In his session at @ThingsExpo, Brian Romansky, VP of Strategic Technology at TrustPoint Innovation, explained how M2M certificates can efficiently enable confidentiality, integrity, and authenticity on highly constrained devices.
In today's uber-connected, consumer-centric, cloud-enabled, insights-driven, multi-device, global world, the focus of solutions has shifted from the product that is sold to the person who is buying the product or service. Enterprises have rebranded their business around the consumers of their products. The buyer is the person and the focus is not on the offering. The person is connected through multiple devices, wearables, at home, on the road, and in multiple locations, sometimes simultaneously...
“delaPlex Software provides software outsourcing services. We have a hybrid model where we have onshore developers and project managers that we can place anywhere in the U.S. or in Europe,” explained Manish Sachdeva, CEO at delaPlex Software, in this SYS-CON.tv interview at @ThingsExpo, held June 7-9, 2016, at the Javits Center in New York City, NY.
"We've discovered that after shows 80% if leads that people get, 80% of the conversations end up on the show floor, meaning people forget about it, people forget who they talk to, people forget that there are actual business opportunities to be had here so we try to help out and keep the conversations going," explained Jeff Mesnik, Founder and President of ContentMX, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
Internet of @ThingsExpo, taking place November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with the 19th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world and ThingsExpo Silicon Valley Call for Papers is now open.
The IoT is changing the way enterprises conduct business. In his session at @ThingsExpo, Eric Hoffman, Vice President at EastBanc Technologies, discussed how businesses can gain an edge over competitors by empowering consumers to take control through IoT. He cited examples such as a Washington, D.C.-based sports club that leveraged IoT and the cloud to develop a comprehensive booking system. He also highlighted how IoT can revitalize and restore outdated business models, making them profitable ...
"delaPlex is a software development company. We do team-based outsourcing development," explained Mark Rivers, COO and Co-founder of delaPlex Software, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
We all know the latest numbers: Gartner, Inc. forecasts that 6.4 billion connected things will be in use worldwide in 2016, up 30 percent from last year, and will reach 20.8 billion by 2020. We're rapidly approaching a data production of 40 zettabytes a day – more than we can every physically store, and exabytes and yottabytes are just around the corner. For many that’s a good sign, as data has been proven to equal money – IF it’s ingested, integrated, and analyzed fast enough. Without real-ti...
"There's a growing demand from users for things to be faster. When you think about all the transactions or interactions users will have with your product and everything that is between those transactions and interactions - what drives us at Catchpoint Systems is the idea to measure that and to analyze it," explained Leo Vasiliou, Director of Web Performance Engineering at Catchpoint Systems, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York Ci...
I wanted to gather all of my Internet of Things (IOT) blogs into a single blog (that I could later use with my University of San Francisco (USF) Big Data “MBA” course). However as I started to pull these blogs together, I realized that my IOT discussion lacked a vision; it lacked an end point towards which an organization could drive their IOT envisioning, proof of value, app dev, data engineering and data science efforts. And I think that the IOT end point is really quite simple…
A critical component of any IoT project is what to do with all the data being generated. This data needs to be captured, processed, structured, and stored in a way to facilitate different kinds of queries. Traditional data warehouse and analytical systems are mature technologies that can be used to handle certain kinds of queries, but they are not always well suited to many problems, particularly when there is a need for real-time insights.
Big Data, cloud, analytics, contextual information, wearable tech, sensors, mobility, and WebRTC: together, these advances have created a perfect storm of technologies that are disrupting and transforming classic communications models and ecosystems. In his session at @ThingsExpo, Erik Perotti, Senior Manager of New Ventures on Plantronics’ Innovation team, provided an overview of this technological shift, including associated business and consumer communications impacts, and opportunities it ...
You think you know what’s in your data. But do you? Most organizations are now aware of the business intelligence represented by their data. Data science stands to take this to a level you never thought of – literally. The techniques of data science, when used with the capabilities of Big Data technologies, can make connections you had not yet imagined, helping you discover new insights and ask new questions of your data. In his session at @ThingsExpo, Sarbjit Sarkaria, data science team lead ...
Is your aging software platform suffering from technical debt while the market changes and demands new solutions at a faster clip? It’s a bold move, but you might consider walking away from your core platform and starting fresh. ReadyTalk did exactly that. In his General Session at 19th Cloud Expo, Michael Chambliss, Head of Engineering at ReadyTalk, will discuss why and how ReadyTalk diverted from healthy revenue and over a decade of audio conferencing product development to start an innovati...