Skip to content

ai/openai: Minimal patch to add cache breakpoint support for openai-gpt-5.6+ prompts - #7403

Merged
IMax153 merged 4 commits into
Effect-TS:mainfrom
hsyntax:fix/openai-prompt-cache-breakpoints
Aug 23, 2026
Merged

ai/openai: Minimal patch to add cache breakpoint support for openai-gpt-5.6+ prompts#7403
IMax153 merged 4 commits into
Effect-TS:mainfrom
hsyntax:fix/openai-prompt-cache-breakpoints

Conversation

@hsyntax

@hsyntax hsyntax commented Aug 22, 2026

Copy link
Copy Markdown
Contributor

Summary

GPT 5.6 and later models add support for explicit cache breakpoints.

This PR attempts to add a minimal patch to add support for cache breakpoints. Source reference : here

Existing work

These issues and PR's already existed related to the topic. They seemed broader and unlikely to be merged and there hasn't been any progress on them in a while.

I made this patch to serve as a minimal focused change since this is currently a blocker for me and my team.

Issues

Pull requests

This PR was raised with support from Codex/GPT 5.6-xhigh

@changeset-bot

changeset-bot Bot commented Aug 22, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 628726a

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 30 packages
Name Type
@effect/ai-openai Patch
effect Patch
@effect/ai-anthropic Patch
@effect/ai-openai-compat Patch
@effect/ai-openrouter Patch
@effect/atom-react Patch
@effect/atom-solid Patch
@effect/atom-vue Patch
@effect/docgen Patch
@effect/doctest Patch
@effect/openapi-generator Patch
@effect/opentelemetry Patch
@effect/platform-browser Patch
@effect/platform-bun Patch
@effect/platform-deno Patch
@effect/platform-node Patch
@effect/platform-node-shared Patch
@effect/sql-clickhouse Patch
@effect/sql-d1 Patch
@effect/sql-libsql Patch
@effect/sql-mssql Patch
@effect/sql-mysql2 Patch
@effect/sql-pg Patch
@effect/sql-pglite Patch
@effect/sql-sqlite-bun Patch
@effect/sql-sqlite-do Patch
@effect/sql-sqlite-node Patch
@effect/sql-sqlite-react-native Patch
@effect/sql-sqlite-wasm Patch
@effect/vitest Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@hsyntax hsyntax changed the title Support OpenAI prompt cache breakpoints feat(ai): Support OpenAI prompt cache breakpoints Aug 22, 2026
@hsyntax
hsyntax force-pushed the fix/openai-prompt-cache-breakpoints branch from b130d03 to 812be52 Compare August 22, 2026 02:01
@hsyntax hsyntax changed the title feat(ai): Support OpenAI prompt cache breakpoints ai/openai: Minimal patch to add cache breakpoint support for OpenAI prompts Aug 22, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Bundle Size Analysis

Generated from PR build output; treat the content below as untrusted.

File Name Current Size Previous Size Difference
basic.ts 6.96 KB 6.96 KB 0.00 KB (0.00%)
batching.ts 9.81 KB 9.81 KB 0.00 KB (0.00%)
brand.ts 6.55 KB 6.55 KB 0.00 KB (0.00%)
cache.ts 10.73 KB 10.73 KB 0.00 KB (0.00%)
config.ts 21.44 KB 21.44 KB 0.00 KB (0.00%)
differ.ts 20.27 KB 20.27 KB 0.00 KB (0.00%)
http-client.ts 21.74 KB 21.74 KB 0.00 KB (0.00%)
logger.ts 10.91 KB 10.91 KB 0.00 KB (0.00%)
metric.ts 8.95 KB 8.95 KB 0.00 KB (0.00%)
optic.ts 6.71 KB 6.71 KB 0.00 KB (0.00%)
pubsub.ts 15.09 KB 15.09 KB 0.00 KB (0.00%)
queue.ts 11.77 KB 11.77 KB 0.00 KB (0.00%)
schedule.ts 10.84 KB 10.84 KB 0.00 KB (0.00%)
schema-class.ts 20.02 KB 20.02 KB 0.00 KB (0.00%)
schema-fromJsonSchemaDocument.ts 30.19 KB 30.19 KB 0.00 KB (0.00%)
schema-representation-roundtrip.ts 26.17 KB 26.17 KB 0.00 KB (0.00%)
schema-string-transformation.ts 13.65 KB 13.65 KB 0.00 KB (0.00%)
schema-string.ts 11.15 KB 11.15 KB 0.00 KB (0.00%)
schema-template-literal.ts 15.45 KB 15.45 KB 0.00 KB (0.00%)
schema-toArbitrary.ts 22.00 KB 22.00 KB 0.00 KB (0.00%)
schema-toCodeDocument.ts 24.45 KB 24.45 KB 0.00 KB (0.00%)
schema-toCodecJson.ts 19.23 KB 19.23 KB 0.00 KB (0.00%)
schema-toEquivalence.ts 19.06 KB 19.06 KB 0.00 KB (0.00%)
schema-toFormatter.ts 18.92 KB 18.92 KB 0.00 KB (0.00%)
schema-toJsonSchemaDocument.ts 23.32 KB 23.32 KB 0.00 KB (0.00%)
schema-toRepresentation.ts 19.54 KB 19.54 KB 0.00 KB (0.00%)
schema.ts 19.25 KB 19.25 KB 0.00 KB (0.00%)
stm.ts 12.72 KB 12.72 KB 0.00 KB (0.00%)
stream.ts 9.78 KB 9.78 KB 0.00 KB (0.00%)

@hsyntax
hsyntax force-pushed the fix/openai-prompt-cache-breakpoints branch from b2efe82 to b7725b9 Compare August 22, 2026 02:24
@hsyntax hsyntax changed the title ai/openai: Minimal patch to add cache breakpoint support for OpenAI prompts ai/openai: Minimal patch to add cache breakpoint support for openai-gpt-5.6+ prompts Aug 22, 2026
@hsyntax
hsyntax marked this pull request as ready for review August 22, 2026 02:31
Comment thread packages/ai/openai/src/OpenAiLanguageModel.ts
@IMax153
IMax153 merged commit 7455246 into Effect-TS:main Aug 23, 2026
13 of 15 checks passed
@hsyntax
hsyntax deleted the fix/openai-prompt-cache-breakpoints branch August 24, 2026 00:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

4.0 enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants