Beyond Real-World Parity

Embracing Human-AI Synergy in HCI Research

Niklas Elmqvist
3 min read5 days ago
Image by MidJourney (v6.1).

As a human-computer interaction researcher, I’ve noticed a curious trend in our field: the persistent quest to replicate real-world experiences in digital form. While this approach is perhaps only natural and has its merits, I’ve come to believe that it might be causing us to overlook more transformative opportunities.

Consider how often we encounter technology striving to mirror physical reality. Pen-based interfaces aim for the precision and tactile feel of traditional writing tools. Communication platforms attempt to recreate the nuances of face-to-face interactions. Virtual reality systems try to increase the fidelity of their simulation of physical environments. The real world, undoubtedly, provides a valuable baseline for comparison and user familiarity. However, by fixating on this benchmark, are we limiting the true potential of human-centered computing?

This realization has been a gradual shift in my perspective, crystallized by a grant proposal I wrote some time ago. My initial pitch centered on developing a digital sketching tool that would replicate the experience of drawing on paper. I extolled the virtues of texture simulation, pressure sensitivity, and supporting physical paper interactions.

But as I delved deeper into the proposal, I began to question the wisdom of investing substantial engineering efforts into recreating an experience that already exists in a near-perfect form (i.e. paper itself). More importantly, I recognized that this approach neglected to leverage the unique strengths of digital media.

This realization caused me to reframe my proposal accordingly. Instead of mimicking paper, I focused on the distinctive advantages of a digital solution: instant searchability of sketches, unlimited editability without compromising the original, reliable backups, seamless sharing across devices and with collaborators, and effortless integration of multimedia content. Suddenly, my proposal wasn’t about digitizing an analog experience — it was about unlocking entirely new creative possibilities.

This shift in thinking has broader implications for human-computer interaction research. As we design tools and interfaces, we must recognize that our technologies have their own sets of strengths and weaknesses. While addressing limitations is important, we should be wary of diminishing returns in our pursuit of real-world parity.

Consider voice assistants, for instance. Despite significant advances in natural language processing, we’re still far from replicating the nuanced understanding present in human conversation. Rather than concentrating solely on closing this gap, what if we directed more attention to capabilities that transcend human abilities? These might include rapid retrieval and synthesis from vast knowledge bases, intelligent recording and indexing for enhanced searchability, or seamless integration with advanced content creation and data analysis tools.

This approach doesn’t mean disregarding user needs or requirements. On the contrary, it embraces a more nuanced, human-centered design philosophy. In a truly human-centered approach, we acknowledge that there’s always a human in the loop — a creative, adaptable, intelligent user who can work with and around technological limitations if the overall value proposition is sufficiently compelling.

This idea is at the core of human-centered AI (HCAI). Instead of striving to create AI that replicates all human capabilities (and inevitably falling short in subtle but important ways), we should develop AI that complements and enhances human abilities. It’s about fostering a symbiotic relationship where both human and machine contribute their unique strengths.

Let’s move beyond the fixation on achieving parity with the real world. Instead, let’s focus on functionality that amplifies human capabilities in ways previously unimagined. Let’s create experiences that don’t just match their real-world counterparts, but open up entirely new horizons for human creativity and productivity.

After all, isn’t that the true promise of human-centered computing? Not to simply digitize our existing world, but to expand it in ways we’ve never dreamed possible. It’s time we embraced that vision and started aiming beyond the familiar confines of real-world experiences.

--

--

Niklas Elmqvist

Professor in visualization and human-computer interaction at Aarhus University in Aarhus, Denmark.