By using Azure OpenAI or other tools you’ve created valuable business systems. But complaints are arriving at your desk of people using the systems for useless things and the costs are getting higher than expected.

When working with generative AI tools like OpenAI services it’s important to manage the usage. Not only should the access be protected but especially when using tools with a pay-as-you-go model it’s important to keep a grip on how they are used. In this talk I will show what can be done on a management level to have more control over your AI usage and spend. Besides that I will also demonstrate how this can be implemented by using API Management.

Do you want to know what controls you can put in place on your AI systems? Or do you want to know how to implement things like content-filters, token based throttling or caching? Join this talk and find out how to do this!