Is this you? As a journalist, you can create a free Muck Rack account to customize your profile, list your contact preferences, and upload a portfolio of your best work.
Claim your profile
Articles by Andre Dewes
🚀 Smart load balancing for OpenAI endpoints using containers
Many service providers, including OpenAI, usually set limits on the number of calls that can be made. In the case of Azure OpenAI, there are token limits (TPM or tokens per minute) and limits on the number of requests per minute (RPM). When a server starts running out of resources or the service limits are exhausted, the provider may issue a 429 or TooManyRequests HTTP Status code, and also a Retry-After response header indicating how much time you should wait until you try the next request.
🚀 Smart load balancing for OpenAI endpoints and Azure API Management
Smart load balancing for OpenAI endpoints and Azure API Management Many service providers, including OpenAI usually set limits on the number of calls that can be made. In the case of Azure OpenAI, there are token limits (TPM or tokens per minute) and limits on the number of requests per minute (RPM).
Plotting
It is quite a common requirement when working with API gateways (such asAzure API Management) to understand how many users are actively accessing your applications in the backend. However, the solution for that is not the same for everyone. For instance, a metric exposed out-of-the-box is the total number of HTTP requests... but that doesn't tell us how many unique users we have. Normally, an application running in the client devices generates multiple HTTP requests towards the backend. So...
API Management: enable request tracing from the server-side
Introduction One of the most useful debug features of API Management isrequest tracing. The problem is: we need to reproduce the same client request with an extra header (Ocp-Apim-Trace) or tell the consumers to do so. What if we could just generate the traces from the APIM clients without telling them to add such header or do that ourselves? Is there an easier way to have APIM log the request traces coming from the real consumers temporarily for a certain period without much effort?
Creating Azure Monitor alerts for Cosmos (and other databases) queries
Introduction Did you ever find yourself in the situation where getting alerted to something happening inside your CosmosDB database would be useful? I'm talking about using raw SQL queries. For example, you would like to get an Azure Monitor alert if a query like "SELECT * FROM orders WHERE orders. status = 'failed' " returns anything. Optimally you would want the original application/service responsible for this domain to raise such an event and perform an action on it.
Leveraging KEDA to scale Azure DevOps agents efficiently
The default option to have a scalable self-hosted pool in Azure Devops is use Azure virtual machine scale sets. However, if you have an ecosystem that is running mostly in containers and Kubernetes, you might also think about using containers instead and leverage KEDA scalable triggers to spin up more agents when the demand increases and lower them when the demand decreases.
App Service Hybrid connections: is it fast enough?
App Service Hybrid connection offers a quick and uncomplicated way to reach your on-premises services in scenarios where there aren't other networking solutions like VPN or ExpressRoute available. Normally, you don't even need to open any firewall ports in your on-premises environments because it only requires outbound HTTP connection over port 443 towards Azure to work. Behind the scenes, it is a TCP relay proxy over websockets.
Show More
loading
Actions
Is this you?
As a journalist, you can create a free Muck Rack account to customize your profile, list your contact preferences, and upload a portfolio of your best work.Get in touch with Andre
Contact Andre, search articles and posts on X, monitor coverage, and track replies from one place.
Learn more about Muck Rack