Will AI take the job of XR developers?

Straight from Scifi. Do you want to create a method that calculates the Fibonacci sequence? Just say so. You want to build a game? Just tell the computer what it should do in plain English.

Recent advances in AI language models (such as OpenAI Codex or GitHub Copilot) make it possible for developers and non-developers to create programs without coding.

What can this technology be used for? What are its limitations? Can you use it for developing AR and VR experiences?

Will it take your job?

The wonders of the Hololens 2 Research Mode

This session takes a look at the features of the Hololens 2 Research Mode, and then dives deeper into some fascinating functionality that's only possible by directly analyzing the output of the depth cameras on the device!

ChatGPT to C#hatGPT: Sharper Chats with Plugins

OpenAI's ChatGPT Plugins are said to be the new App Store. It's also the infrastructure for extending all of Microsoft's Copilots: in Windows, in Bing, in Office, in various other applications. Plugins enable ChatGPT and Copilots to access up-to-date information, run computations or use second and third-party services, such as reserve a table at a restaurant.

This example- and code-rich session will not only show you how to create such plugins in C#, but you will also gain a deep understanding of how, when and why the plugins get invoked, and what kind of tips you can apply to get the most out of them.

ChatGPT to C#hatGPT: Make Your .NET App Talk Back Using ChatGPT Function Calling

After the 1990s, applications without graphical user interfaces felt ancient. After 2023, apps without a chat will feel the same.

Natural Language Interfaces allow the user perform tasks more easily and efficiently by typing or speaking commands instead of navigating menus and icons. Chat Interfaces will become an important and expected piece of UI for user-friendly and modern applications.

This example- and code-rich talk will show you how to empower your existing (or new) .NET application with a powerful and intuitive AI-driven chat interface. You will gain a deep understanding of how Function Calling works, how the AI can be made aware of the capabilities of your app and how it will be able to invoke the right functions at the right time according to the wishes expressed by the user.

ChatGPT to C#hatGPT: Why Let Pythonistas Have All the Fun?

Feeling left out of the AI buzz because you 're a C# developer? Don't fret; this session is your golden ticket.

This example- and code-rich talk will introduce you to the powerful GPT models running on Azure and show you how to harness their power using C# within your application or web service. You will also be introduced to Function Calling so that the AI can interact with the real world through your application. Just be careful not to give it too much power!

Designing Tomorrow: How AI Will Shape User Experience

As the graphical user interface and the iPhone fundamentally transformed our interaction with technology, Generative AI is poised to usher in the next wave of innovation in UX design. 'Designing Tomorrow: How AI Will Shape User Experience' is an essential session for UX designers seeking to navigate this new landscape.

This concise, demo-rich presentation will delve into:

Novel Interactions Enabled by AI: Explore how AI breaks traditional boundaries, allowing for more intuitive and human-centric user experiences.
Adapting Technology to Human Logic: Understand how AI is shifting the paradigm from users adapting to technology, to technology adapting to users.
Emerging UX Patterns with Generative AI: Identify new design patterns and best practices in the age of AI.
Navigating AI 'Hallucinations': Learn strategies to mitigate the challenges posed by AI inaccuracies and ensure reliable user interactions.
Speed and Interaction: Highlighting how AI's quick response times revolutionize user interaction, enabling instant feedback and fostering greater experimentation.
Transforming Project Lifecycles: From initial concept to final delivery, discover how the new AI paradigms change the UX design process.
Join us to gain insights into the future of UX design, equipped with practical strategies to leverage AI effectively in your projects. This session will not only inspire but also prepare you to play an active role in shaping the next generation of user experiences.

This talk has been given privately, and sparked a 1.5 hour Q&A session, clearly indicating how excited and engaged the attendees were.

AI and Common Sense (Workshop)

We are living in the age of AI. Some can discuss whether AI is its infant, adolescent, or youth period; we cannot avoid it in our industry and everyday life. Will it be our savior or, vice versa, it is the evil himself?

Instead of diving deeply into philosophical debates in this workshop, Andras and Istvan will discuss some approaches, behaviors, patterns, and attitudes that help us leverage AI. We aim to discuss with the audience how to feel more productive and empowered and, first, remain humans with feelings and needs for cooperation.

The speakers (an AI expert and a commonsense coach) share their field experience and particular views on this topic and give you helpful hints to take away. The workshop is interactive; besides the Q&A after each section, we invite the audience to connect to the discussions.

A Completely Unscientific, Intuitive Understanding of Generative AI

Welcome to an engaging and intuitive exploration of Generative AI! In this talk, we will dive into the fascinating world of generative artificial intelligence, focusing on key understanding and concepts of how GenAIs work - all without any equations!

You will understand how and why AI "Hallucinates" (or bluffs), why it's weak in math but can write better code than most people. The presentation is full of a-ha moments, where you will 'get' how AI can both understand and generate text and images. Using a set of metaphors, you will gain an intuitive understanding of Generative AI's - an understanding you can use in your everyday interactions with AI to drive it in the direction you need, and to get the results you desire.

What will you do 5 years from now?

And more importantly, what will an average user do? What will computing mean to her and how will she interact with the computer? What will computers look like? A perfect storm is coming with AR/VR/MR, AI, and the cloud. It will fundamentally transform everything we consider computing today – and it will fundamentally change the whole world. And a bit further out, there’s quantum computing… You better be ready!

How to Give 5 WOW HoloLens Demos

So you created your HoloLens app, it is fantastic, and you want to show it to people at an exhibition or put it on the head of a big shot CEO. Awesome! But creating an app and making it presentable are two different things. This talk sums up the lessons learned from thousands of hands-on demos with dozens of different applications at expos, conferences and exclusive meeting rooms. What are the technology, storytelling and UX challenges and their solutions in this high risk – high reward scenario? How do you keep people engaged and how do you help them when you can’t even see what they’re seeing? How do you keep the devices working and what is the best Plan B, Plan C and Plan Z if something goes wrong?

Escape from Flatland! How to design captivating 3D experiences

When getting started with AR and VR development, the most difficult challenge to overcome is not technical — it is to think and design spatially instead of in 2D. Just like the characters in Edwin A. Abbott’s novella, most design teams find it difficult to escape traditional 2D thinking and seize the opportunities the new technologies present. This talk contains tips & tricks on how to think in 3D, alongside inspiring real-world examples and demos.

Prototyping Mixed Reality Projects in VR

Prototyping is a well known technique when it comes to design web sites, mobile or desktop apps. However, with Spatial Computing, tools are still immature, and processes even more so. This talk will introduce lessons learned during the design phase of a project that empowers airplane engineers with augmented reality glasses.

The Lego Bricks of AR and VR

The spatial computing revolution is coming! This talk introduces the main components of how different AR and VR headsets work. The talk covers everything from the optics, through controllers, spatial audio, to tracking and sensors to give a clear understanding of how the state of the art technologies work, what are their strong points and limitations of each approach. If you listen to this talk, you'll have a clear understanding of the capabilities of all major AR and VR headsets, from HoloLens, HoloLens 2, Magic Leap One, Vive, Vive Pro, Oculus Rift, Oculus Quest and others.

AI + AR = SuperPowers!

Do you remember the name of every person you've ever met? Where you've left your keys? Would you like to?

What if face recognition and an Augmented Reality headset could give you this ability? This highly technical talk will show you how to develop an application from scratch that integrates AR headsets (like the HoloLens or Magic Leap) with on-device and cloud AI algorithms to recognize faces and objects. Imagine looking at a colleague, and the device immediately showing you their profile or last Facebook post so you can pretend to remember what's going on in their lives!

More Enterprise-y Unity applications

Unity is a game engine. But it's increasingly being used for scenarios that are more enterprise-y: line-of-business applications, AR/VR systems with server connections. For these areas, Unity's performance-centric architecture is less than ideal.

This talks introduces a real-world tested approach to designing Unity applications in a way that supports clean separation of presentation and logic, support for unit testing (even outside the Unity editor), built on the UniRX framework and my open source MVPToolkit for Unity.