Welcome!

Java IoT Authors: Elizabeth White, Liz McMillan, AppDynamics Blog, Sematext Blog, Pat Romanski

Related Topics: Java IoT

Java IoT: Article

Designing Custom Multithreading Frameworks in J2EE Containers

An efficient way to improve the performance of Java apps

A custom multithreading framework is an efficient way to improve the performance of Java applications. It uses an asynchronous parallel pattern to implement the business process. However, its traditional Java thread-based implementation shouldn't be used in applications hosted in a J2EE Application Server because the threads in that framework are beyond the control of the J2EE Container. This article will discuss an intelligent solution for implementing custom multithreading by using message-driven beans. This message-driven bean based multithreading framework enables the J2EE container to manage threads and multiple MDBs to execute the business logic in parallel.

Java multithreading makes maximum use of the CPU by keeping the processor's idle time to minimum. To avoid the overhead of creating threads on-the-fly, every J2EE application server container has a default thread pool that contains a set of execute threads. The container can borrow one of the threads from the pool, and assign it a task. Upon completion of the task, the thread goes into a wait state ready to accept another assignment. The J2EE container monitors all execute threads in that pool. Custom threads are different from execute threads. They are created and controlled by the applications rather than the container. This article will introduce a solution implementing custom multithreading in a J2EE container.

Asynchronous Parallel Design Pattern

The analysis model of the custom multithreading framework is based on the concept of asynchronous parallel design pattern. The pattern combines the advantages of delegate, asynchronous, and parallel design patterns. It's a model that consists of an asynchronous interface and a business engine. The business engine is composed of multiple parallel instances of business services, and fulfills the business processes. Figure 1 shows the class diagram representing the structure of the asynchronous parallel pattern.

The client doesn't have to have knowledge of the services that the back-end business engine provides. It simply sends the requests to the delegate, which adds the incoming requests to a mediator repository and returns a result to the client. The client doesn't go into a block state waiting for a response from the back-end business engine. The repository notifies the business engine when new requests are received. The multiple parallel instances of the services in the business engine then pick up the requests from the repository and process them concurrently. Figure 2 shows sequence diagrams that illustrate typical interactions among the components of the asynchronous parallel pattern.

Our example is based on an online brokerage system. We choose to model the process of an investor placing an order that is routed to the market for execution. I simplify the business scenario so we can focus on the custom multithreading framework.

Java Thread-Based Custom Multithreading Framework (CMF)

The components of a Java thread-based CMF include a Thread Pool, Worker Thread, Task Dispatcher, Task, and Task Queue. The class diagram in Figure 3 shows the solution model of a Java thread-based multithreading framework.

The Task interface represents the abstract of the business cases fulfilled in the business process. Business cases are modeled by the Java class that implements the Task interface. For example, the Trade class represents the Stock Trade in a stock trading process. The business logic for processing each business case is implemented in the ‘execute' method of each class.

The TaskFIFOQueue and the TaskDispatcher classes implement the asynchronous interface of the asynchronous parallel pattern. The TaskFIFOQueue class is designed as an intermediary repository that stores unassigned tasks. The TaskDispatcher class works as the delegate of the framework, which receives clients' requests, creates an instance of a Java class implementing Task interface for each incoming request (such as Trade class), adds a new instance to TaskFIFOQueue. The client can continue with other activities without having to wait for its request to be processed. The code snippet in Listing 1 at the end of this article shows how to add or get a task from the TaskFIFOQueue.

The business engine of the asynchronous parallel pattern is implemented by the WorkThread class and the ThreadPool class. The WorkThread class provides the threads that will process the assigned task. Each instance of the WorkThread class is a custom thread, created and controlled by the application. The Thread-Pool class serves as the central control point to manage custom threads. Using an object of the ThreadPool class to store running threads lets us allocate custom threads in a predictable way, reuse an existing thread for multiple tasks, and save time for thread instantiation and initialization. The code in Listing 2 at the end of this article demonstrates how to implement the business engine.

When the TaskDispatcher receives a request from a client, it creates an instance of a particular Task-type class, such as the Trade class, and adds the instance to the TaskFIFOQueue. The TaskFIFOQueue then notifies all waiting threads that a new task is ready to be picked up. The current active WorkerThread gets the task from the TaskFIFOQueue and starts to process the task by running the execute() method of the particular Task-type class. After the WorkThreads finishes the task, it goes into a wait state and is ready to accept the next task. The sequence diagram in Figure 4 illustrates the sample collaborations for the CMF.

Although Java thread-based CMF provides an efficient solution to improve the overall performance of Java applications, it shouldn't be used in applications hosted in the J2EE application server. Java thread-based CMF is discouraged in the J2EE applications for the following reasons.

J2EE Application Server Can't Control Custom Threads
The J2EE application server container is configured to manage all the threads in the Java Virtual Machine. The threads from the CMF won't carry the implicit context that a container normally puts on a thread. The container loses control over the custom threads created explicitly by the CMF because it's not aware of their existence.

Consequently, if a custom thread fails, the container will not be able to detect the failure and so can't recover the thread - either by reclaiming the resources occupied by the particular thread or by restarting it to complete the assigned task. The presence of unmanaged failed threads in the application server can seriously impact the stability, scalability, and performance of the application server.

Thread- Based CMF Affects the Load Balancing in the J2EE Application Cluster
Since a J2EE application server isn't aware of the custom threads in the CMF, it's also not aware of the work being done by the threads, and so won't account for the impact that the additional threads have on the overall workload of the server. This will affect the load balancing of the J2EE application cluster. It will potentially over-assign work to the server, and result in significant throughput or performance problems with the server.

The EJB 2.0 specification integrates EJB with JMS, and defines a new type of Enterprise JavaBean: Message-Driven Bean (MDB). It enables the EJB container to support the asynchronous parallel design pattern. Because the basic theories of the Java thread-based CMF don't negatively impact the application server runtime, we'll use the same analysis model to design the MDB-based CMF. For the purpose of demonstration, the MDB-based framework will be implemented and deployed on WebLogic Server 8.1.

More Stories By Di Li

Di Li, a Sun certified enterprise architect, is an expert in the areas of business process modeling, enterprise architecture design, and software architecting. He has over 10 years of experience in software engineering and technical architecture. Li worked in providing the end-to-end solution of financial services, e-business, and enterprise application integration. You can contact him at [email protected]

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@ThingsExpo Stories
The 19th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Digital Transformation, Microservices and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportuni...
From wearable activity trackers to fantasy e-sports, data and technology are transforming the way athletes train for the game and fans engage with their teams. In his session at @ThingsExpo, will present key data findings from leading sports organizations San Francisco 49ers, Orlando Magic NBA team. By utilizing data analytics these sports orgs have recognized new revenue streams, doubled its fan base and streamlined costs at its stadiums. John Paul is the CEO and Founder of VenueNext. Prior ...
A critical component of any IoT project is what to do with all the data being generated. This data needs to be captured, processed, structured, and stored in a way to facilitate different kinds of queries. Traditional data warehouse and analytical systems are mature technologies that can be used to handle certain kinds of queries, but they are not always well suited to many problems, particularly when there is a need for real-time insights.
CenturyLink has announced that application server solutions from GENBAND are now available as part of CenturyLink’s Networx contracts. The General Services Administration (GSA)’s Networx program includes the largest telecommunications contract vehicles ever awarded by the federal government. CenturyLink recently secured an extension through spring 2020 of its offerings available to federal government agencies via GSA’s Networx Universal and Enterprise contracts. GENBAND’s EXPERiUS™ Application...
"My role is working with customers, helping them go through this digital transformation. I spend a lot of time talking to banks, big industries, manufacturers working through how they are integrating and transforming their IT platforms and moving them forward," explained William Morrish, General Manager Product Sales at Interoute, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
Internet of @ThingsExpo, taking place November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with the 19th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world and ThingsExpo Silicon Valley Call for Papers is now open.
Big Data engines are powering a lot of service businesses right now. Data is collected from users from wearable technologies, web behaviors, purchase behavior as well as several arbitrary data points we’d never think of. The demand for faster and bigger engines to crunch and serve up the data to services is growing exponentially. You see a LOT of correlation between “Cloud” and “Big Data” but on Big Data and “Hybrid,” where hybrid hosting is the sanest approach to the Big Data Infrastructure pro...
The IoT is changing the way enterprises conduct business. In his session at @ThingsExpo, Eric Hoffman, Vice President at EastBanc Technologies, discussed how businesses can gain an edge over competitors by empowering consumers to take control through IoT. He cited examples such as a Washington, D.C.-based sports club that leveraged IoT and the cloud to develop a comprehensive booking system. He also highlighted how IoT can revitalize and restore outdated business models, making them profitable ...
We all know the latest numbers: Gartner, Inc. forecasts that 6.4 billion connected things will be in use worldwide in 2016, up 30 percent from last year, and will reach 20.8 billion by 2020. We're rapidly approaching a data production of 40 zettabytes a day – more than we can every physically store, and exabytes and yottabytes are just around the corner. For many that’s a good sign, as data has been proven to equal money – IF it’s ingested, integrated, and analyzed fast enough. Without real-ti...
I wanted to gather all of my Internet of Things (IOT) blogs into a single blog (that I could later use with my University of San Francisco (USF) Big Data “MBA” course). However as I started to pull these blogs together, I realized that my IOT discussion lacked a vision; it lacked an end point towards which an organization could drive their IOT envisioning, proof of value, app dev, data engineering and data science efforts. And I think that the IOT end point is really quite simple…
With 15% of enterprises adopting a hybrid IT strategy, you need to set a plan to integrate hybrid cloud throughout your infrastructure. In his session at 18th Cloud Expo, Steven Dreher, Director of Solutions Architecture at Green House Data, discussed how to plan for shifting resource requirements, overcome challenges, and implement hybrid IT alongside your existing data center assets. Highlights included anticipating workload, cost and resource calculations, integrating services on both sides...
"We are a well-established player in the application life cycle management market and we also have a very strong version control product," stated Flint Brenton, CEO of CollabNet,, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
The IoT has the potential to create a renaissance of manufacturing in the US and elsewhere. In his session at 18th Cloud Expo, Florent Solt, CTO and chief architect of Netvibes, discussed how the expected exponential increase in the amount of data that will be processed, transported, stored, and accessed means there will be a huge demand for smart technologies to deliver it. Florent Solt is the CTO and chief architect of Netvibes. Prior to joining Netvibes in 2007, he co-founded Rift Technologi...
Unless your company can spend a lot of money on new technology, re-engineering your environment and hiring a comprehensive cybersecurity team, you will most likely move to the cloud or seek external service partnerships. In his session at 18th Cloud Expo, Darren Guccione, CEO of Keeper Security, revealed what you need to know when it comes to encryption in the cloud.
We're entering the post-smartphone era, where wearable gadgets from watches and fitness bands to glasses and health aids will power the next technological revolution. With mass adoption of wearable devices comes a new data ecosystem that must be protected. Wearables open new pathways that facilitate the tracking, sharing and storing of consumers’ personal health, location and daily activity data. Consumers have some idea of the data these devices capture, but most don’t realize how revealing and...
What are the successful IoT innovations from emerging markets? What are the unique challenges and opportunities from these markets? How did the constraints in connectivity among others lead to groundbreaking insights? In her session at @ThingsExpo, Carmen Feliciano, a Principal at AMDG, will answer all these questions and share how you can apply IoT best practices and frameworks from the emerging markets to your own business.
Basho Technologies has announced the latest release of Basho Riak TS, version 1.3. Riak TS is an enterprise-grade NoSQL database optimized for Internet of Things (IoT). The open source version enables developers to download the software for free and use it in production as well as make contributions to the code and develop applications around Riak TS. Enhancements to Riak TS make it quick, easy and cost-effective to spin up an instance to test new ideas and build IoT applications. In addition to...
You think you know what’s in your data. But do you? Most organizations are now aware of the business intelligence represented by their data. Data science stands to take this to a level you never thought of – literally. The techniques of data science, when used with the capabilities of Big Data technologies, can make connections you had not yet imagined, helping you discover new insights and ask new questions of your data. In his session at @ThingsExpo, Sarbjit Sarkaria, data science team lead ...
Extracting business value from Internet of Things (IoT) data doesn’t happen overnight. There are several requirements that must be satisfied, including IoT device enablement, data analysis, real-time detection of complex events and automated orchestration of actions. Unfortunately, too many companies fall short in achieving their business goals by implementing incomplete solutions or not focusing on tangible use cases. In his general session at @ThingsExpo, Dave McCarthy, Director of Products...
Ask someone to architect an Internet of Things (IoT) solution and you are guaranteed to see a reference to the cloud. This would lead you to believe that IoT requires the cloud to exist. However, there are many IoT use cases where the cloud is not feasible or desirable. In his session at @ThingsExpo, Dave McCarthy, Director of Products at Bsquare Corporation, will discuss the strategies that exist to extend intelligence directly to IoT devices and sensors, freeing them from the constraints of ...