It is impossible to imagine software development without UI tests. Despite technological progress, the automation of UI tests is still considered too complex to function completely without manual intervention. Especially when automating canvas elements, embedded maps or shadow DOM elements, many approaches reach their limits.

That is why more and more image-based approaches are being pursued, in addition to classical ones such as Selenium.

This talk will cover modern UI automation approaches with an overview of tools and techniques. In particular, current problems and future developments will be addressed. We show exemplarily how several tools like Taiko and Cypress can be used and how AI will help to approach such challenges in the future.