Click here to close now.

Welcome!

Java Authors: Carmen Gonzalez, Plutora Blog, Pat Romanski, Harry Trott, Elizabeth White

News Feed Item

DataTorrent Raises the Bar on Real-Time Data Analytics With Industry's First Enterprise Class Real-Time Streaming Platform

DataTorrent RTS Delivers Greater Than 1 Billion Operations/Second With High Availability On Wide Set of Hadoop Distributions

SANTA CLARA, CA -- (Marketwired) -- 06/03/14 -- DataTorrent, creator of the world's first enterprise grade real-time stream processing platform on Hadoop, today announced the general availability of DataTorrent RTS. DataTorrent RTS enables enterprises to take action in real-time as a result of high-performance complex processing of data as it is created. Separately, DataTorrent announced a strategic go-to-market partnership with Trace3.

With today's release, DataTorrent RTS becomes the industry's first commercial offering to deliver real-time streaming analytic capabilities on Hadoop with performance greater than 1 billion data events per second -- equivalent to processing 46 cumulative hours of streaming Twitter data in one second. Additionally, DataTorrent RTS' fault tolerant architecture ensures zero downtime and is certified to run on all major Hadoop and Cloud distributions.

"We are seeing increasing interest in stream-processing platforms for real-time analytics, as a complement to data warehouses and Apache Hadoop," said Jason Stamper, Research Analyst, 451 Group. "Enterprise adoption of stream-processing requires fast, in-memory processing of a large volume of events at scale -- and in many cases a fault-tolerant architecture too."

By 2020, the number of smartphones, tablets, and personal computers in use will reach 7.3 billion units. Additionally, the number of Internet of Things (IoT) connected devices will grow to 26 billion units, a nearly 30-fold increase from 0.9 billion in 2009.(1)

As this massive amount of human and machine-generated data outpaces the capabilities of traditional databases, organizations are seeking ways to find scalable, predictable technology that enables reduced operational costs, increased revenue and increased customer satisfaction. Current Hadoop technology provides a scalable way to store and process data in a batch-oriented mode, but processing data in this way can take hours or even days.

DataTorrent RTS Streaming Analytics Platform

DataTorrent RTS allows organizations to harness the full potential of big data by enabling faster data ingestion, data processing, and more timely data insights. Key capabilities include:

  • Streaming, scalable data ingestion & extraction from any source: DataTorrent RTS connects to thousands of systems simultaneously using pre-built operators and processes millions of incoming data events without delay.
  • High performance data transformation and complex computation: In-memory processing on data and events as they happen provides near-zero latency. With the ability to scale to billions of data events per second, DataTorrent RTS delivers the needs of today's enterprises and future-proofs tomorrow's unexpected requirements.
  • Real-time monitoring, alerting and action: DataTorrent RTS' architecture provides the ability to extend analytic capabilities beyond static queries. Custom business logic written in Java enables monitoring, alerting, analysis, and action all taken in real-time, saving organizations time and money while also increasing customer satisfaction.
  • Compatibility with existing Big Data processes: DataTorrent RTS archives and loads results into any data store for archiving and query-based analytics. This ensures that an organization's existing processes work the same, just sooner -- they no longer need to wait hours or days to do data analysis.
  • Fault tolerant, highly available, dynamic system: DataTorrent RTS' streaming window implementation allows for in-line system checkpointing to ensure high availability and guarantees processing of every event. The fault tolerant implementation provides the flexibility to change business logic and insert or delete operators on a running system with no downtime.

"Hadoop has made big data analytics a reality; however, the true value of big data is unlocked when it can be acted upon in real-time," said Phu Hoang, co-founder and CEO, DataTorrent. "DataTorrent RTS is designed specifically to address this need for the enterprise. Through the advances provided by Hadoop 2.0, we are proud to raise the bar on real-time analytics to offer the industry's first true real-time data ingestion and analysis platform at scale."

Open Platform Support Provides Customer Choice

DataTorrent RTS is a Hadoop 2.0 (YARN) native application. One hundred percent Hadoop 2.0 compliance allows DataTorrent RTS and Hadoop Map Reduce to exist side-by-side. With more than 400 Apache 2.0 open source DataTorrent operators, creating and deploying real time streaming analytic application is now easier than ever.

DataTorrent's open approach is validated by certifications on the industry leading Hadoop distributions from Cloudera, Hortonworks and MapR Technologies as well as the leading cloud providers, Amazon Web Services and Google Compute Engine.

"The certification of DataTorrent RTS on Cloudera Enterprise 5, provides our joint customers the ability to ingest, analyze, and act on voluminous streams of data in real-time as data flows into an enterprise data hub," said Amr Awadallah, co-founder and chief technology officer, Cloudera. "This real-time capability allows joint customers to uncover real-time insights and enables them to realize the full value of Cloudera's industry leading platform for big data."

"We're pleased to certify DataTorrent RTS on Hortonworks Data Platform 2.1, the industry's only 100-percent open source Apache Hadoop distribution," said John Kreisa, vice president of strategic marketing at Hortonworks. "With partners like DataTorrent and their YARN Ready applications in the Hadoop ecosystem, we're able to provide enterprises with the ability to aggregate new types of data from sensors/machines, server logs, clickstreams, and other sources to a Data Lake, empowering a true modern data architecture that delivers business insights in real-time."

"Real-time data analysis at large scale with fault tolerance is a key customer requirement," said M.C. Srivas, CTO and Co-Founder of MapR Technologies. "DataTorrent RTS certification provides an enterprise-grade, real-time streaming application managed by YARN within the mission-critical, high-performance MapR Distribution for Apache Hadoop."

DataTorrent RTS for Hadoop is generally available today. For more information, or to download, click here.

Additional Resources

  • Visit the DataTorrent RTS Webpage
  • Learn how DataTorrent handles over 1 billion data events per second
  • Check out the DataTorrent blog
  • Follow us on Twitter

About DataTorrent
DataTorrent RTS is the world's most powerful Big Data streaming platform built exclusively on Hadoop. With its massively scalable architecture, DataTorrent RTS allows enterprises to process, monitor, analyze and act on data instantaneously. Based in Santa Clara, California, DataTorrent is backed by leading investors including August Capital, Morado Ventures, and Yahoo co-founder Jerry Yang. For more information, visit our website or follow us on Twitter.

(1) Gartner Press Release, "Gartner Says the Internet of Things Installed Base Will Grow to 26 Billion Units By 2020." December 12, 2013. http://www.gartner.com/newsroom/id/2636073

Media Contact:
Fitzgerald Barth
LEWIS PR for DataTorrent
(415) 432-2457
Email Contact

More Stories By Marketwired .

Copyright © 2009 Marketwired. All rights reserved. All the news releases provided by Marketwired are copyrighted. Any forms of copying other than an individual user's personal reference without express written permission is prohibited. Further distribution of these materials is strictly forbidden, including but not limited to, posting, emailing, faxing, archiving in a public database, redistributing via a computer network or in a printed form.

@ThingsExpo Stories
Dale Kim is the Director of Industry Solutions at MapR. His background includes a variety of technical and management roles at information technology companies. While his experience includes work with relational databases, much of his career pertains to non-relational data in the areas of search, content management, and NoSQL, and includes senior roles in technical marketing, sales engineering, and support engineering. Dale holds an MBA from Santa Clara University, and a BA in Computer Science from the University of California, Berkeley.
The cloud is now a fact of life but generating recurring revenues that are driven by solutions and services on a consumption model have been hard to implement, until now. In their session at 16th Cloud Expo, Ermanno Bonifazi, CEO & Founder of Solgenia, and Ian Khan, Global Strategic Positioning & Brand Manager at Solgenia, will discuss how a top European telco has leveraged the innovative recurring revenue generating capability of the consumption cloud to enable a unique cloud monetization model to drive results.
As organizations shift toward IT-as-a-service models, the need for managing and protecting data residing across physical, virtual, and now cloud environments grows with it. CommVault can ensure protection &E-Discovery of your data – whether in a private cloud, a Service Provider delivered public cloud, or a hybrid cloud environment – across the heterogeneous enterprise. In his session at 16th Cloud Expo, Randy De Meno, Chief Technologist - Windows Products and Microsoft Partnerships, will discuss how to cut costs, scale easily, and unleash insight with CommVault Simpana software, the only si...
Analytics is the foundation of smart data and now, with the ability to run Hadoop directly on smart storage systems like Cloudian HyperStore, enterprises will gain huge business advantages in terms of scalability, efficiency and cost savings as they move closer to realizing the potential of the Internet of Things. In his session at 16th Cloud Expo, Paul Turner, technology evangelist and CMO at Cloudian, Inc., will discuss the revolutionary notion that the storage world is transitioning from mere Big Data to smart data. He will argue that today’s hybrid cloud storage solutions, with commodity...
Every innovation or invention was originally a daydream. You like to imagine a “what-if” scenario. And with all the attention being paid to the so-called Internet of Things (IoT) you don’t have to stretch the imagination too much to see how this may impact commercial and homeowners insurance. We’re beyond the point of accepting this as a leap of faith. The groundwork is laid. Now it’s just a matter of time. We can thank the inventors of smart thermostats for developing a practical business application that everyone can relate to. Gone are the salad days of smart home apps, the early chalkb...
Cloud data governance was previously an avoided function when cloud deployments were relatively small. With the rapid adoption in public cloud – both rogue and sanctioned, it’s not uncommon to find regulated data dumped into public cloud and unprotected. This is why enterprises and cloud providers alike need to embrace a cloud data governance function and map policies, processes and technology controls accordingly. In her session at 15th Cloud Expo, Evelyn de Souza, Data Privacy and Compliance Strategy Leader at Cisco Systems, will focus on how to set up a cloud data governance program and s...
Roberto Medrano, Executive Vice President at SOA Software, had reached 30,000 page views on his home page - http://RobertoMedrano.SYS-CON.com/ - on the SYS-CON family of online magazines, which includes Cloud Computing Journal, Internet of Things Journal, Big Data Journal, and SOA World Magazine. He is a recognized executive in the information technology fields of SOA, internet security, governance, and compliance. He has extensive experience with both start-ups and large companies, having been involved at the beginning of four IT industries: EDA, Open Systems, Computer Security and now SOA.
The industrial software market has treated data with the mentality of “collect everything now, worry about how to use it later.” We now find ourselves buried in data, with the pervasive connectivity of the (Industrial) Internet of Things only piling on more numbers. There’s too much data and not enough information. In his session at @ThingsExpo, Bob Gates, Global Marketing Director, GE’s Intelligent Platforms business, to discuss how realizing the power of IoT, software developers are now focused on understanding how industrial data can create intelligence for industrial operations. Imagine ...
We certainly live in interesting technological times. And no more interesting than the current competing IoT standards for connectivity. Various standards bodies, approaches, and ecosystems are vying for mindshare and positioning for a competitive edge. It is clear that when the dust settles, we will have new protocols, evolved protocols, that will change the way we interact with devices and infrastructure. We will also have evolved web protocols, like HTTP/2, that will be changing the very core of our infrastructures. At the same time, we have old approaches made new again like micro-services...
Operational Hadoop and the Lambda Architecture for Streaming Data Apache Hadoop is emerging as a distributed platform for handling large and fast incoming streams of data. Predictive maintenance, supply chain optimization, and Internet-of-Things analysis are examples where Hadoop provides the scalable storage, processing, and analytics platform to gain meaningful insights from granular data that is typically only valuable from a large-scale, aggregate view. One architecture useful for capturing and analyzing streaming data is the Lambda Architecture, representing a model of how to analyze rea...
SYS-CON Events announced today that Vitria Technology, Inc. will exhibit at SYS-CON’s @ThingsExpo, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Vitria will showcase the company’s new IoT Analytics Platform through live demonstrations at booth #330. Vitria’s IoT Analytics Platform, fully integrated and powered by an operational intelligence engine, enables customers to rapidly build and operationalize advanced analytics to deliver timely business outcomes for use cases across the industrial, enterprise, and consumer segments.
Today’s enterprise is being driven by disruptive competitive and human capital requirements to provide enterprise application access through not only desktops, but also mobile devices. To retrofit existing programs across all these devices using traditional programming methods is very costly and time consuming – often prohibitively so. In his session at @ThingsExpo, Jesse Shiah, CEO, President, and Co-Founder of AgilePoint Inc., discussed how you can create applications that run on all mobile devices as well as laptops and desktops using a visual drag-and-drop application – and eForms-buildi...
Containers and microservices have become topics of intense interest throughout the cloud developer and enterprise IT communities. Accordingly, attendees at the upcoming 16th Cloud Expo at the Javits Center in New York June 9-11 will find fresh new content in a new track called PaaS | Containers & Microservices Containers are not being considered for the first time by the cloud community, but a current era of re-consideration has pushed them to the top of the cloud agenda. With the launch of Docker's initial release in March of 2013, interest was revved up several notches. Then late last...
SYS-CON Events announced today that Dyn, the worldwide leader in Internet Performance, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Dyn is a cloud-based Internet Performance company. Dyn helps companies monitor, control, and optimize online infrastructure for an exceptional end-user experience. Through a world-class network and unrivaled, objective intelligence into Internet conditions, Dyn ensures traffic gets delivered faster, safer, and more reliably than ever.
CommVault has announced that top industry technology visionaries have joined its leadership team. The addition of leaders from companies such as Oracle, SAP, Microsoft, Cisco, PwC and EMC signals the continuation of CommVault Next, the company's business transformation for sales, go-to-market strategies, pricing and packaging and technology innovation. The company also announced that it had realigned its structure to create business units to more directly match how customers evaluate, deploy, operate, and purchase technology.
In their session at @ThingsExpo, Shyam Varan Nath, Principal Architect at GE, and Ibrahim Gokcen, who leads GE's advanced IoT analytics, focused on the Internet of Things / Industrial Internet and how to make it operational for business end-users. Learn about the challenges posed by machine and sensor data and how to marry it with enterprise data. They also discussed the tips and tricks to provide the Industrial Internet as an end-user consumable service using Big Data Analytics and Industrial Cloud.
The explosion of connected devices / sensors is creating an ever-expanding set of new and valuable data. In parallel the emerging capability of Big Data technologies to store, access, analyze, and react to this data is producing changes in business models under the umbrella of the Internet of Things (IoT). In particular within the Insurance industry, IoT appears positioned to enable deep changes by altering relationships between insurers, distributors, and the insured. In his session at @ThingsExpo, Michael Sick, a Senior Manager and Big Data Architect within Ernst and Young's Financial Servi...
Performance is the intersection of power, agility, control, and choice. If you value performance, and more specifically consistent performance, you need to look beyond simple virtualized compute. Many factors need to be considered to create a truly performant environment. In his General Session at 15th Cloud Expo, Harold Hannon, Sr. Software Architect at SoftLayer, discussed how to take advantage of a multitude of compute options and platform features to make cloud the cornerstone of your online presence.
Almost everyone sees the potential of Internet of Things but how can businesses truly unlock that potential. The key will be in the ability to discover business insight in the midst of an ocean of Big Data generated from billions of embedded devices via Systems of Discover. Businesses will also need to ensure that they can sustain that insight by leveraging the cloud for global reach, scale and elasticity.
IoT is still a vague buzzword for many people. In his session at @ThingsExpo, Mike Kavis, Vice President & Principal Cloud Architect at Cloud Technology Partners, discussed the business value of IoT that goes far beyond the general public's perception that IoT is all about wearables and home consumer services. He also discussed how IoT is perceived by investors and how venture capitalist access this space. Other topics discussed were barriers to success, what is new, what is old, and what the future may hold. Mike Kavis is Vice President & Principal Cloud Architect at Cloud Technology Pa...