Welcome!

Java IoT Authors: Liz McMillan, Miska Kaipiainen, Dana Gardner, Elizabeth White, Kevin Benedict

Related Topics: Java IoT

Java IoT: Article

Intelligent GUIs Should Require No Thought to Operate

Repeated exposure to the same input drives the response into the unconscious area of the mind

In Bernard J. Baar's book "A Cognitive Theory of Consciousness," he describes the brain as having a single conscious area that can be occupied by one thought at a time. The unconscious part of the brain stores memories and experiences and, like the conscious brain, is capable of performing tasks; however, it does so automatically, unlike the conscious area that requires the intervention of the "self." The first time we are given a new input, sensation, or experience to deal with, the conscious brain is responsible for analyzing it, comparing it to something that has occurred before, and dealing with the action accordingly. Repeated exposure to the same input drives the response into the unconscious area of the mind, so the next time the same experience is encountered, an automatic reply can be recalled without requiring conscious intervention.

An example of this is driving a car; an extremely complex function to perform that deals with multiple inputs - many different feedback loops to control speed, direction, and so forth. Only once you have mastered how to control the mechanics of a car, via repetition and practice, can you begin to drive it around using unconscious thought and start to concentrate on inputs such as road signs, other drivers, and assorted day-to-day driving hazards. A very real problem exists that when driving the same route over and over, what should be a conscious thought process becomes unconscious, leading to more traffic accidents occurring in your own neighbourhood on familiar roads than, ironically, far from home where conscious thought needs to be engaged. The fact that the brain can only single task can be exacerbated by functions such as talking on the phone while driving; advanced driving schools recognize this when they teach better road skills by making drivers repeat to themselves everything they are seeing as they drive, helping to ensure that it's the conscious and not unconscious brain behind the wheel.

This model of how the brain performs tasks causes problems for GUI designers in two ways: the wrong consciousness is active when input or response is required, and too much conscious thought slows down the user, creating slow and costly context switches.

An example of where things break down is with dialogs that pop up and require a response. From a design point they're the equivalent of a road user driving along happily in an unconscious mode, thinking about what they're going to do at their destination, when a deer runs in front of the car. Immediately, conscious thought is required to create a response, and as the driver creates the correct response, their locus of attention is changed from their day dreaming to the more pressing situation at hand. When you delete a file in Windows Explorer it puts it in the recycle bin asking if you to confirm you're sure. From here you can retrieve it later if you want to. If you don't want to fill up the recycle bin you can press Shift+Delete together to do a "delete and don't recycle". This too asks if you're sure with a "Yes/No" response, however the problem is that because pressing Yes to the modal dialog that follows delete has become an automatic part of deletion you don't read the dialog, and don't read and process the Shift+Delete different, potentially more severe with no recovery, question. The problem is that conscious actions, through repetition, can become unconscious, so each time a user sees the dialog they will become more accustomed to just pressing OK to dismiss it, so that dealing with the "Are you sure you want to delete?" just becomes an automatic part of the delete action. For an application that uses dialogs to grab the user's attention, which they have learned as part of the normal operation, what then must it do to really get the user woken up ? One such way is to actually stop the user from proceeding, a technique used by wizards, for example, that disables the Finish button until enough information has been completed. Again, though, the desire to spend as little time being interrupted leads the user to learn all that is required is the minimum set of input to make the Finish button enabled and get the dialog to dismiss itself. Despite this, I find that it's a rare GUI designer who will avoid the knee-jerk decision to use a modal dialog to report a situation that, while exceptional to the application, is just a distraction and annoyance to the user, and for modal screens to be used for dialogs such as property pages, creation wizards, and so forth.

The second problem with mapping brain function to GUIs is that the mind is not a pre-emptive parallel multi-tasking machine, but it is basically capable of serial thought. Switching between one thought and another requires moving the locus of conscious attention, rather like moving an imaginary cursor inside the mind to a new position. This takes time to do and, for the task being left behind, this will either fade from short-term memory in a few seconds, or else must be moved to unconscious thought by repetition or reinforcement.

GUIs that work well are those that embrace the way the mind works, and only invoke conscious thought for the experienced user as and when required. The problem that GUIs often encounter is that they're sold on the basis of how they look, the sparkle and up-front razz, and how quickly they can simplify tasks they're engineered specifically to demo well. However, the true test comes when a skilled user can operate them with unconscious efficiency to mirror the speed at which touch typists can capture information into a console-based text app. I've worked on several failed applications for financial institutions where we wrote superb GUI applications that the users just rejected out of hand because there were too many screens presented in a manner that, while familiar to IDE users' unconscious brains, were just over complex to end users who reverted to spreadsheets to capture all their data and create outputs. To get the edge over basic tools it needs to replace, GUI design must engage the user's brain on their terms, not that of the designer or the framework and language on which it runs.

More Stories By Joe Winchester

Joe Winchester, Editor-in-Chief of Java Developer's Journal, was formerly JDJ's longtime Desktop Technologies Editor and is a software developer working on development tools for IBM in Hursley, UK.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@ThingsExpo Stories
The Internet of Things will challenge the status quo of how IT and development organizations operate. Or will it? Certainly the fog layer of IoT requires special insights about data ontology, security and transactional integrity. But the developmental challenges are the same: People, Process and Platform and how we integrate our thinking to solve complicated problems. In his session at 19th Cloud Expo, Craig Sproule, CEO of Metavine, will demonstrate how to move beyond today's coding paradigm ...
Ask someone to architect an Internet of Things (IoT) solution and you are guaranteed to see a reference to the cloud. This would lead you to believe that IoT requires the cloud to exist. However, there are many IoT use cases where the cloud is not feasible or desirable. In his session at @ThingsExpo, Dave McCarthy, Director of Products at Bsquare Corporation, will discuss the strategies that exist to extend intelligence directly to IoT devices and sensors, freeing them from the constraints of ...
From wearable activity trackers to fantasy e-sports, data and technology are transforming the way athletes train for the game and fans engage with their teams. In his session at @ThingsExpo, will present key data findings from leading sports organizations San Francisco 49ers, Orlando Magic NBA team. By utilizing data analytics these sports orgs have recognized new revenue streams, doubled its fan base and streamlined costs at its stadiums. John Paul is the CEO and Founder of VenueNext. Prior ...
Technology vendors and analysts are eager to paint a rosy picture of how wonderful IoT is and why your deployment will be great with the use of their products and services. While it is easy to showcase successful IoT solutions, identifying IoT systems that missed the mark or failed can often provide more in the way of key lessons learned. In his session at @ThingsExpo, Peter Vanderminden, Principal Industry Analyst for IoT & Digital Supply Chain to Flatiron Strategies, will focus on how IoT de...
IoT offers a value of almost $4 trillion to the manufacturing industry through platforms that can improve margins, optimize operations & drive high performance work teams. By using IoT technologies as a foundation, manufacturing customers are integrating worker safety with manufacturing systems, driving deep collaboration and utilizing analytics to exponentially increased per-unit margins. However, as Benoit Lheureux, the VP for Research at Gartner points out, “IoT project implementers often ...
So, you bought into the current machine learning craze and went on to collect millions/billions of records from this promising new data source. Now, what do you do with them? Too often, the abundance of data quickly turns into an abundance of problems. How do you extract that "magic essence" from your data without falling into the common pitfalls? In her session at @ThingsExpo, Natalia Ponomareva, Software Engineer at Google, provided tips on how to be successful in large scale machine learning...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, wh...
In his general session at 18th Cloud Expo, Lee Atchison, Principal Cloud Architect and Advocate at New Relic, discussed cloud as a ‘better data center’ and how it adds new capacity (faster) and improves application availability (redundancy). The cloud is a ‘Dynamic Tool for Dynamic Apps’ and resource allocation is an integral part of your application architecture, so use only the resources you need and allocate /de-allocate resources on the fly.
Information technology is an industry that has always experienced change, and the dramatic change sweeping across the industry today could not be truthfully described as the first time we've seen such widespread change impacting customer investments. However, the rate of the change, and the potential outcomes from today's digital transformation has the distinct potential to separate the industry into two camps: Organizations that see the change coming, embrace it, and successful leverage it; and...
SYS-CON Events announced today that Roundee / LinearHub will exhibit at the WebRTC Summit at @ThingsExpo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. LinearHub provides Roundee Service, a smart platform for enterprise video conferencing with enhanced features such as automatic recording and transcription service. Slack users can integrate Roundee to their team via Slack’s App Directory, and '/roundee' command lets your video conference ...
Digital transformation is too big and important for our future success to not understand the rules that apply to it. The first three rules for winning in this age of hyper-digital transformation are: Advantages in speed, analytics and operational tempos must be captured by implementing an optimized information logistics system (OILS) Real-time operational tempos (IT, people and business processes) must be achieved Businesses that can "analyze data and act and with speed" will dominate those t...
The Jevons Paradox suggests that when technological advances increase efficiency of a resource, it results in an overall increase in consumption. Writing on the increased use of coal as a result of technological improvements, 19th-century economist William Stanley Jevons found that these improvements led to the development of new ways to utilize coal. In his session at 19th Cloud Expo, Mark Thiele, Chief Strategy Officer for Apcera, will compare the Jevons Paradox to modern-day enterprise IT, e...
There are several IoTs: the Industrial Internet, Consumer Wearables, Wearables and Healthcare, Supply Chains, and the movement toward Smart Grids, Cities, Regions, and Nations. There are competing communications standards every step of the way, a bewildering array of sensors and devices, and an entire world of competing data analytics platforms. To some this appears to be chaos. In this power panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, Bradley Holt, Developer Advocate a...
There is growing need for data-driven applications and the need for digital platforms to build these apps. In his session at 19th Cloud Expo, Muddu Sudhakar, VP and GM of Security & IoT at Splunk, will cover different PaaS solutions and Big Data platforms that are available to build applications. In addition, AI and machine learning are creating new requirements that developers need in the building of next-gen apps. The next-generation digital platforms have some of the past platform needs a...
SYS-CON Events announced today that ReadyTalk, a leading provider of online conferencing and webinar services, has been named Vendor Presentation Sponsor at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. ReadyTalk delivers audio and web conferencing services that inspire collaboration and enable the Future of Work for today’s increasingly digital and mobile workforce. By combining intuitive, innovative tec...
SYS-CON Events announced today that Bsquare has been named “Silver Sponsor” of SYS-CON's @ThingsExpo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. For more than two decades, Bsquare has helped its customers extract business value from a broad array of physical assets by making them intelligent, connecting them, and using the data they generate to optimize business processes.
Cognitive Computing is becoming the foundation for a new generation of solutions that have the potential to transform business. Unlike traditional approaches to building solutions, a cognitive computing approach allows the data to help determine the way applications are designed. This contrasts with conventional software development that begins with defining logic based on the current way a business operates. In her session at 18th Cloud Expo, Judith S. Hurwitz, President and CEO of Hurwitz & ...
Fact is, enterprises have significant legacy voice infrastructure that’s costly to replace with pure IP solutions. How can we bring this analog infrastructure into our shiny new cloud applications? There are proven methods to bind both legacy voice applications and traditional PSTN audio into cloud-based applications and services at a carrier scale. Some of the most successful implementations leverage WebRTC, WebSockets, SIP and other open source technologies. In his session at @ThingsExpo, Da...
Almost two-thirds of companies either have or soon will have IoT as the backbone of their business in 2016. However, IoT is far more complex than most firms expected. How can you not get trapped in the pitfalls? In his session at @ThingsExpo, Tony Shan, a renowned visionary and thought leader, will introduce a holistic method of IoTification, which is the process of IoTifying the existing technology and business models to adopt and leverage IoT. He will drill down to the components in this fra...
The Internet of Things can drive efficiency for airlines and airports. In their session at @ThingsExpo, Shyam Varan Nath, Principal Architect with GE, and Sudip Majumder, senior director of development at Oracle, will discuss the technical details of the connected airline baggage and related social media solutions. These IoT applications will enhance travelers' journey experience and drive efficiency for the airlines and the airports. The session will include a working demo and a technical d...