Welcome!

Java IoT Authors: Elizabeth White, Yeshim Deniz, AppNeta Blog, Carmen Gonzalez, Liz McMillan

Related Topics: Java IoT

Java IoT: Article

Designing Custom Multithreading Frameworks in J2EE Containers

An efficient way to improve the performance of Java apps

A custom multithreading framework is an efficient way to improve the performance of Java applications. It uses an asynchronous parallel pattern to implement the business process. However, its traditional Java thread-based implementation shouldn't be used in applications hosted in a J2EE Application Server because the threads in that framework are beyond the control of the J2EE Container. This article will discuss an intelligent solution for implementing custom multithreading by using message-driven beans. This message-driven bean based multithreading framework enables the J2EE container to manage threads and multiple MDBs to execute the business logic in parallel.

Java multithreading makes maximum use of the CPU by keeping the processor's idle time to minimum. To avoid the overhead of creating threads on-the-fly, every J2EE application server container has a default thread pool that contains a set of execute threads. The container can borrow one of the threads from the pool, and assign it a task. Upon completion of the task, the thread goes into a wait state ready to accept another assignment. The J2EE container monitors all execute threads in that pool. Custom threads are different from execute threads. They are created and controlled by the applications rather than the container. This article will introduce a solution implementing custom multithreading in a J2EE container.

Asynchronous Parallel Design Pattern

The analysis model of the custom multithreading framework is based on the concept of asynchronous parallel design pattern. The pattern combines the advantages of delegate, asynchronous, and parallel design patterns. It's a model that consists of an asynchronous interface and a business engine. The business engine is composed of multiple parallel instances of business services, and fulfills the business processes. Figure 1 shows the class diagram representing the structure of the asynchronous parallel pattern.

The client doesn't have to have knowledge of the services that the back-end business engine provides. It simply sends the requests to the delegate, which adds the incoming requests to a mediator repository and returns a result to the client. The client doesn't go into a block state waiting for a response from the back-end business engine. The repository notifies the business engine when new requests are received. The multiple parallel instances of the services in the business engine then pick up the requests from the repository and process them concurrently. Figure 2 shows sequence diagrams that illustrate typical interactions among the components of the asynchronous parallel pattern.

Our example is based on an online brokerage system. We choose to model the process of an investor placing an order that is routed to the market for execution. I simplify the business scenario so we can focus on the custom multithreading framework.

Java Thread-Based Custom Multithreading Framework (CMF)

The components of a Java thread-based CMF include a Thread Pool, Worker Thread, Task Dispatcher, Task, and Task Queue. The class diagram in Figure 3 shows the solution model of a Java thread-based multithreading framework.

The Task interface represents the abstract of the business cases fulfilled in the business process. Business cases are modeled by the Java class that implements the Task interface. For example, the Trade class represents the Stock Trade in a stock trading process. The business logic for processing each business case is implemented in the ‘execute' method of each class.

The TaskFIFOQueue and the TaskDispatcher classes implement the asynchronous interface of the asynchronous parallel pattern. The TaskFIFOQueue class is designed as an intermediary repository that stores unassigned tasks. The TaskDispatcher class works as the delegate of the framework, which receives clients' requests, creates an instance of a Java class implementing Task interface for each incoming request (such as Trade class), adds a new instance to TaskFIFOQueue. The client can continue with other activities without having to wait for its request to be processed. The code snippet in Listing 1 at the end of this article shows how to add or get a task from the TaskFIFOQueue.

The business engine of the asynchronous parallel pattern is implemented by the WorkThread class and the ThreadPool class. The WorkThread class provides the threads that will process the assigned task. Each instance of the WorkThread class is a custom thread, created and controlled by the application. The Thread-Pool class serves as the central control point to manage custom threads. Using an object of the ThreadPool class to store running threads lets us allocate custom threads in a predictable way, reuse an existing thread for multiple tasks, and save time for thread instantiation and initialization. The code in Listing 2 at the end of this article demonstrates how to implement the business engine.

When the TaskDispatcher receives a request from a client, it creates an instance of a particular Task-type class, such as the Trade class, and adds the instance to the TaskFIFOQueue. The TaskFIFOQueue then notifies all waiting threads that a new task is ready to be picked up. The current active WorkerThread gets the task from the TaskFIFOQueue and starts to process the task by running the execute() method of the particular Task-type class. After the WorkThreads finishes the task, it goes into a wait state and is ready to accept the next task. The sequence diagram in Figure 4 illustrates the sample collaborations for the CMF.

Although Java thread-based CMF provides an efficient solution to improve the overall performance of Java applications, it shouldn't be used in applications hosted in the J2EE application server. Java thread-based CMF is discouraged in the J2EE applications for the following reasons.

J2EE Application Server Can't Control Custom Threads
The J2EE application server container is configured to manage all the threads in the Java Virtual Machine. The threads from the CMF won't carry the implicit context that a container normally puts on a thread. The container loses control over the custom threads created explicitly by the CMF because it's not aware of their existence.

Consequently, if a custom thread fails, the container will not be able to detect the failure and so can't recover the thread - either by reclaiming the resources occupied by the particular thread or by restarting it to complete the assigned task. The presence of unmanaged failed threads in the application server can seriously impact the stability, scalability, and performance of the application server.

Thread- Based CMF Affects the Load Balancing in the J2EE Application Cluster
Since a J2EE application server isn't aware of the custom threads in the CMF, it's also not aware of the work being done by the threads, and so won't account for the impact that the additional threads have on the overall workload of the server. This will affect the load balancing of the J2EE application cluster. It will potentially over-assign work to the server, and result in significant throughput or performance problems with the server.

The EJB 2.0 specification integrates EJB with JMS, and defines a new type of Enterprise JavaBean: Message-Driven Bean (MDB). It enables the EJB container to support the asynchronous parallel design pattern. Because the basic theories of the Java thread-based CMF don't negatively impact the application server runtime, we'll use the same analysis model to design the MDB-based CMF. For the purpose of demonstration, the MDB-based framework will be implemented and deployed on WebLogic Server 8.1.

More Stories By Di Li

Di Li, a Sun certified enterprise architect, is an expert in the areas of business process modeling, enterprise architecture design, and software architecting. He has over 10 years of experience in software engineering and technical architecture. Li worked in providing the end-to-end solution of financial services, e-business, and enterprise application integration. You can contact him at [email protected]

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@ThingsExpo Stories
WebRTC sits at the intersection between VoIP and the Web. As such, it poses some interesting challenges for those developing services on top of it, but also for those who need to test and monitor these services. In his session at WebRTC Summit, Tsahi Levent-Levi, co-founder of testRTC, reviewed the various challenges posed by WebRTC when it comes to testing and monitoring and on ways to overcome them.
Every successful software product evolves from an idea to an enterprise system. Notably, the same way is passed by the product owner's company. In his session at 20th Cloud Expo, Oleg Lola, CEO of MobiDev, will provide a generalized overview of the evolution of a software product, the product owner, the needs that arise at various stages of this process, and the value brought by a software development partner to the product owner as a response to these needs.
The Internet of Things can drive efficiency for airlines and airports. In their session at @ThingsExpo, Shyam Varan Nath, Principal Architect with GE, and Sudip Majumder, senior director of development at Oracle, discussed the technical details of the connected airline baggage and related social media solutions. These IoT applications will enhance travelers' journey experience and drive efficiency for the airlines and the airports.
In his keynote at @ThingsExpo, Chris Matthieu, Director of IoT Engineering at Citrix and co-founder and CTO of Octoblu, focused on building an IoT platform and company. He provided a behind-the-scenes look at Octoblu’s platform, business, and pivots along the way (including the Citrix acquisition of Octoblu).
In his session at @ThingsExpo, Sudarshan Krishnamurthi, a Senior Manager, Business Strategy, at Cisco Systems, will discuss how IT and operational technology (OT) work together, as opposed to being in separate siloes as once was traditional. Attendees will learn how to fully leverage the power of IoT in their organization by bringing the two sides together and bridging the communication gap. He will also look at what good leadership must entail in order to accomplish this, and how IT managers ca...
In his keynote at @ThingsExpo, Chris Matthieu, Director of IoT Engineering at Citrix and co-founder and CTO of Octoblu, focused on building an IoT platform and company. He provided a behind-the-scenes look at Octoblu’s platform, business, and pivots along the way (including the Citrix acquisition of Octoblu).
SYS-CON Events announced today that CA Technologies has been named “Platinum Sponsor” of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY, and the 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CA Technologies helps customers succeed in a future where every business – from apparel to energy – is being rewritten by software. From ...
SYS-CON Events announced today that Outlyer, a monitoring service for DevOps and operations teams, has been named “Bronze Sponsor” of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Outlyer is a monitoring service for DevOps and Operations teams running Cloud, SaaS, Microservices and IoT deployments. Designed for today's dynamic environments that need beyond cloud-scale monitoring, we make monitoring effortless so you...
DevOps is being widely accepted (if not fully adopted) as essential in enterprise IT. But as Enterprise DevOps gains maturity, expands scope, and increases velocity, the need for data-driven decisions across teams becomes more acute. DevOps teams in any modern business must wrangle the ‘digital exhaust’ from the delivery toolchain, "pervasive" and "cognitive" computing, APIs and services, mobile devices and applications, the Internet of Things, and now even blockchain. In this power panel at @...
In his session at @ThingsExpo, Steve Wilkes, CTO and founder of Striim, will delve into four enterprise-scale, business-critical case studies where streaming analytics serves as the key to enabling real-time data integration and right-time insights in hybrid cloud, IoT, and fog computing environments. As part of this discussion, he will also present a demo based on its partnership with Fujitsu, highlighting their technologies in a healthcare IoT use-case. The demo showcases the tracking of pati...
In his keynote at 18th Cloud Expo, Andrew Keys, Co-Founder of ConsenSys Enterprise, provided an overview of the evolution of the Internet and the Database and the future of their combination – the Blockchain. Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settle...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
With 10 simultaneous tracks, keynotes, general sessions and targeted breakout classes, Cloud Expo and @ThingsExpo are two of the most important technology events of the year. Since its launch over eight years ago, Cloud Expo and @ThingsExpo have presented a rock star faculty as well as showcased hundreds of sponsors and exhibitors! In this blog post, I provide 7 tips on how, as part of our world-class faculty, you can deliver one of the most popular sessions at our events. But before reading the...
SYS-CON Events announced today that Cloud Academy will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Cloud Academy is the industry’s most innovative, vendor-neutral cloud technology training platform. Cloud Academy provides continuous learning solutions for individuals and enterprise teams for Amazon Web Services, Microsoft Azure, Google Cloud Platform, and the most popular cloud computing technologies. Ge...
The best way to leverage your Cloud Expo presence as a sponsor and exhibitor is to plan your news announcements around our events. The press covering Cloud Expo and @ThingsExpo will have access to these releases and will amplify your news announcements. More than two dozen Cloud companies either set deals at our shows or have announced their mergers and acquisitions at Cloud Expo. Product announcements during our show provide your company with the most reach through our targeted audiences.
TechTarget storage websites are the best online information resource for news, tips and expert advice for the storage, backup and disaster recovery markets. By creating abundant, high-quality editorial content across more than 140 highly targeted technology-specific websites, TechTarget attracts and nurtures communities of technology buyers researching their companies' information technology needs. By understanding these buyers' content consumption behaviors, TechTarget creates the purchase inte...
20th Cloud Expo, taking place June 6-8, 2017, at the Javits Center in New York City, NY, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy.
Your homes and cars can be automated and self-serviced. Why can't your storage? From simply asking questions to analyze and troubleshoot your infrastructure, to provisioning storage with snapshots, recovery and replication, your wildest sci-fi dream has come true. In his session at @DevOpsSummit at 20th Cloud Expo, Dan Florea, Director of Product Management at Tintri, will provide a ChatOps demo where you can talk to your storage and manage it from anywhere, through Slack and similar services ...
Have you ever noticed how some IT people seem to lead successful, rewarding, and satisfying lives and careers, while others struggle? IT author and speaker Don Crawley uncovered the five principles that successful IT people use to build satisfying lives and careers and he shares them in this fast-paced, thought-provoking webinar. You'll learn the importance of striking a balance with technical skills and people skills, challenge your pre-existing ideas about IT customer service, and gain new in...
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend @CloudExpo | @ThingsExpo, June 6-8, 2017, at the Javits Center in New York City, NY and October 31 - November 2, 2017, Santa Clara Convention Center, CA. Learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.