Freshly emerged from the HCI for UX program at MIT Computer Science & Artificial Intelligence Laboratory, I am brimming with ideas for exploring emerging technologies. One area that continually piques my interest is the future of screenless interactions.

With so many thoughts swirling around, I decided to share some insights on this uncharted territory, from the vanguard of Humane’s screenless tech to the historical pioneers that preceded it, and finally, AI’s remarkable in our lives.

Venturing beyond screens with Humane

The limits of conventional screen-based interactions are being challenged by Humane — an AI-powered standalone wearable platform. The focus of this carefully crafted tool is on making it feel natural and human while placing us users at the center of its design.

The mission of Humane is to make technology an invisible companion that enhances our experience of the world — redefining its role beyond being just a device and technology becomes an enabler instead of a barrier as it facilitates effortless navigation in unfamiliar environments along with providing personalized recommendations and supports seamless communication across all languages aided by the power of AI.

Here are a few examples of their product capabilities, according to the patent “Wearable multimedia device and cloud computing platform with laser projection system”:

• Receiving context data from a wearable multimedia device.
• Creating data processing pipeline with apps based on context data and user requests/preferences
• Processing context data in a data processing pipeline
• Sending the output of the data processing pipeline to a wearable device and/or another device to present the output.

The potential of a wearable device leveraging AI for natural language translation and personalized assistance with context-aware decision-making was demonstrated by Imran Chaudhri, former Apple designer, at a TED Talks event in April 2013.

“This is so much more than devices just getting smaller or more powerful. This is the possibility of reimagining the human-technology relationship as we know it.”

—Imran Chaudhri, Humane Co-founder.

Humane aims to reshape our interaction with technology from its very core, and the vision is to have technology fade into our surroundings and challenge the limitations of current screen-based interfaces. Crafting AI tech, which isn’t just powerful but equally easy to use while providing an engaging experience, represents what I believe will be the latest step forward for User Interface Design.

The Pioneers of Screenless Interaction

The conception of this revolutionary idea is attributed to those who had a different perspective and were regarded as visionaries.

OmnitTouch

The former Microsoft Research Hrvoje Benko (currently Director of Research Science at Meta Reality Labs Research) co-created the OmniTouch prototype in 2011, which used a depth-sensing camera along with a pico-projector for converting any surface into an interactive display, although less sophisticated manner whereby users could engage with the projected interface by dialing numbers on their hands and viewing wall-projected maps. The device set a precedent in intuitive, seamless digital interactions, laying the groundwork for future screenless and wearable technologies.

This innovative approach to screenless interaction continued to evolve and eventually transformed into Kinect, developed by Microsoft for the Xbox gaming console.

Skinput

Developed in 2010 by researchers Chris Harrison and Microsoft Research team, Skinput was a revolutionary technology that allows users to use their bodies as interfaces for input.

By tapping different parts of their skin, acoustic vibrations are detected and interpreted as commands, eliminating the need for physical touchscreens or input devices.

This innovation in interface design opens up new possibilities for immersive and personalized user experiences while offering improved accessibility for individuals with physical impairments.

Skinput represents a significant step towards a screenless future, where technology seamlessly integrates with our natural gestures and touchpoints, creating a more intuitive and human-centred interaction paradigm.

SixthSense

Pranav Mistry, a computer scientist from MIT, also deserves special mention. He envisioned the concept of integrating the digital world with everyday objects and gestures, pushing the boundaries of what was considered possible. His brainchild, the SixthSense wearable device, was a breakthrough. With a head-mounted projector and camera, it augmented physical reality with digital information, making interactions more intuitive and immersive.

Mistry’s work and the development of high-performance polymer films for wearable electronics underscore that we’re standing on the shoulders of giants. The path they paved in 2009 allows companies like Humane to innovate further and revolutionize the user interface.

Artificial Intelligence: the next frontier

AI currently sits at the crest of a hype wave, stirring boundless optimism and deep-seated fears. As Designers, our role is to look beyond the short benefits and examine its long-term implications.

Artificial intelligence systems harbor the capacity to fundamentally transform the dynamics between man and machine. However, vigilance must be exercised. Rather than augmenting our human faculties, technology sometimes preys upon our faculty for attentiveness, profits from our personal details, and takes advantage of our psychological susceptibilities.

In this new era of User Experience design, it’s our responsibility to champion ethical practices. We need to ensure that technology serves people and not vice versa. Designing intuitive, respectful, and transparent interfaces can help us navigate this new landscape while preserving the human element at its core.

As we venture into this new era of invisible interfaces and AI-enhanced experiences, we’re not just designing products but shaping the future.

Let’s do so thoughtfully, with an eye toward enhancing the human experience, fostering joy, and maintaining our connection with the world around us.

Designing for invisibility: challenges and opportunities

A paradox in design lies in the fact that while we strive for invisibility, it’s unattainable. However, what steps should be taken when designing something meant to disappear? Technology needs to blend in with our natural behaviors for it to be truly intuitive. This undertaking demands a thorough comprehension of the nuances in human conduct and an understanding of their expectations.

Humane’s approach is a step in the right direction. By creating a platform that leverages AI to provide personalized and context-aware assistance. This is where technology becomes a silent partner, enhancing our abilities without distracting us from our tasks or surroundings.

On the other hand, becoming invisible is anything but simple. Achieving the perfect harmony between functionality with simplicity, along with maintaining privacy & trustworthiness in both the digital & physical worlds, can be challenging but must be done.

Navigating the future

The key to successful user experience moving into the future is taking a comprehensive and holistic approach, and the impact of new technology like AI should be assessed with consideration for human factors. Rather than exploiting us or overpowering us with its strength, technology should work as a support system for humanity.

Seeing pioneering companies such as Humane drive forth in this era of User Interface evolution is truly exciting, and moving towards the future of invisible interfaces and smarter involvements with the use of AI should surely put humans first.

It’s important to design technology that respects humanity’s uniqueness and celebrates their differences while contributing positively towards their lives. Let’s create technological solutions that generate amazement and invoke pure joy.

We cannot predict the future for User Interface precisely, but we can expect a lot where technology is not just a device, software or hype tool but an actual partner — a future where technology is human by design.