Policies, PII Detection & Response Caching

Three updates to help you set up faster, keep sensitive data safe, and save on costs.
Policy templates make it easy to get started with custom content policies. Instead of writing descriptions from scratch, you can now browse pre-built templates and add them with one click. Pick the ones that fit your use case, customize if needed, and you're good to go.
PII detection lets you catch personally identifiable information - names, emails, phone numbers, SSNs, credit card numbers, and more - before it ever reaches your AI provider. You choose what happens when PII is found: get a warning, block the request entirely, or automatically strip it out and replace it with placeholders. Just add the PII action header to your scan or proxy requests to enable it.
Response caching is now built into proxy mode. Repeated identical requests are served from cache automatically, which means faster responses and lower API costs. It's enabled by default for non-streaming requests.
What's new:
- Policy templates - Pre-built content policies you can add and customize in one click
- PII detection and redaction - Detect sensitive data in prompts with options to warn, block, or strip it automatically
- Response caching - Automatic caching for proxy requests to reduce latency and save on API costs
Browse templates from the Policies page in your dashboard, and check out the API reference for PII setup details.





