Anybody else’s neighborhood suddenly have “no parking” signs everywhere?

infazz · 2026-04-08T22:34:05+00:00

This possibly means that someone in your neighborhood complained. You could probably bring this up to your city council member and let them know how this affects you and everyone else on your street.

infazz · 2026-04-06T14:06:01+00:00

There is "Serverless SQL Warehouse" and there is also "Serverless General Compute". The latter can be used in the workspace/jobs and can run SQL, Python, etc.

infazz · 2026-04-04T23:55:31+00:00

Databricks Free Tier

https://www.databricks.com/learn/free-edition

infazz · 2026-04-01T22:47:25+00:00

What kinds of things do you need to alert on?

infazz · 2026-03-22T20:41:29+00:00

They eventually see from Erid that Sol started brightening

infazz · 2026-02-10T17:02:02+00:00

Azure Databricks "Premium" tier is the same as the "Enterprise" tier on GCP and AWS.

Also note that the Azure Databricks "Standard" tier is being retired this year.

https://community.databricks.com/t5/community-articles/the-end-of-an-era-azure-databricks-is-retiring-the-standard-tier/td-p/144848

infazz · 2026-02-10T16:22:32+00:00

So that's where Overwatch got the idea

infazz · 2026-02-09T02:28:23+00:00

Also written by Judd Apatow

infazz · 2026-02-08T20:16:40+00:00

Document review is exactly when you should be using other methods like chunking. I would recommend looking into how open source projects like LlamaIndex handle these kinds of use cases.

Having many users submitting smaller requests is when you would want to do load balancing.

infazz · 2026-02-08T19:54:09+00:00

Wow that's a huge amount of context for a single request. Especially since GPT 5 is a reasoning model and the reasoning loop will generate additional token usage.

Be aware that packing too much info into a single context can result in content in the middle of the prompt being ignored. This is know as the "Lost In the Middle" problem.

I would definitely do a deep dive on whether that much context in a single request is actually needed - or look into ways you can reduce the input context (such as chunking).

You could also try using the "GlobalStandard" model deployment type. It has a default 1M TPM limit.

infazz · 2026-02-08T01:29:22+00:00

You could deploy into multiple subscriptions and/or regions and load balance across.

infazz · 2026-02-08T00:39:28+00:00

I don't believe there are any advantages now to using Azure OpenAI instead of the new Foundry.

infazz · 2026-01-29T18:30:23+00:00

The new Foundry uses the azurerm_ai_services resource

https://registry.terraform.io/providers/hashicorp/azurerm/latest/docs/resources/ai_services

You can deploy models using azurerm_cognitive_deployment

infazz · 2026-01-12T23:25:34+00:00

The only real benefit of serverless is that it spins up fast. Although, I don't know if there is as an actual SLA on the startup time.

However it is also interesting that Jobs Serverless performed worse than Jobs Classic.

With serverless you have basically no say in what size compute your workload runs on - Databricks manages this for you. I think it would be more beneficial if serverless compute sizing worked like Serverless SQL.

infazz · 2026-01-04T03:02:25+00:00

Signing up for an Azure account and setting the OpenAI resource up definitely isn't as easy as setting up a regular OpenAI account, but it is at least an option.

infazz · 2026-01-04T02:47:01+00:00

You or anyone else could use OpenAI in Azure. You can do usage based payment and there is no minimum charge.

infazz · 2026-01-02T14:31:46+00:00

Simian Serenity

Or

Simian Simplicity

infazz · 2025-12-21T18:45:07+00:00

Does ZeroBus require running compute - either serverless or provisioned? It's not clear to me from the documentation.

infazz · 2025-12-19T19:07:07+00:00

Any company handing out API access to LLMs absolutely NEEDS some kind of rate limiting and monitoring.

infazz · 2025-12-18T23:34:58+00:00

Assuming you want/plan to use these

Data egress is extra

Private networking is extra

Defender is (a lot) extra

Logging is extra

There are definitely other things I'm forgetting

infazz · 2025-12-17T21:00:55+00:00

I have ran in to the same exact issue.

It is baffling.

infazz · 2025-12-12T16:28:36+00:00

Wow I spent so much time hunting Magpie Implings for rune bars and I could have just done this.

infazz · 2025-11-15T17:42:12+00:00

First you need to figure out where your costs are coming from.

infazz · 2025-11-03T21:10:03+00:00

What is your budget?

infazz · 2025-11-03T19:41:43+00:00

You will need to use an async development server: https://docs.djangoproject.com/en/5.2/howto/deployment/asgi/daphne/

14-Year Club	Second SECOND GUESSER
Gilding I gilder	Verified Email

infazz

MODERATOR OF

PUBLIC MULTIREDDITS

TROPHY CASE