Prompt Cache Planner

Request ke blocks aise kram mein rakhiye ki cache hone wala prefix jitna lamba ho sake.

Yahaan sirf block ke aakaar bhare jaate hain, unki content nahi. Kuchh bhi upload nahi hota.

Agent loop ka kharch nikaaliye

Prompt Cache Planner ke baare mein

Caching prefix ke milan par chalti hai, aur yahi ek tathya sab kuchh tay kar deta hai. Pehla badla hua byte uske baad ke har byte ko invalid kar deta hai: yaani pachchees hazaar sthir tokens se pehle rakhi gayi ek badalti line — koi timestamp, request ki pehchaan, user ka sawal — ka matlab hai ki unme se ek bhi cache nahi hota. Ilaaj hamesha ek hi aakaar ka hai: sthir aage, badalta hua peechhe. Jo saaf nahi hai wo hai galti ki keemat, isliye yahaan use sankhya di jaati hai. Request ke blocks unke badalne ki dar ke saath bhariye, aur ye unhe kram mein lagakar prefix naapta hai aur aapki requests ki sankhya par farq ka anumaan lagata hai.

Features

• Blocks aise kram mein jisse prefix sabse lamba ho
• Badalte blocks ke peechhe phanse sthir blocks named karta hai
• Cache hone wala prefix aur har baar chukaya jaane wala hissa naapta hai
• Prefix nyoontam se neeche ho aur chupchaap cache na ho to warning
• Kai requests par farq ka anumaan
• Kabhi-kabhaar badalne wale blocks dikhata hai — wo apne baad sab kuchh mita dete hain
• Models ke cache-read rates, jaanch ki tithi ke saath
• Block ke aakaar aapki request ke hisaab se editable

Prompt Cache Planner kaise use karein

1. Request ke blocks unke aakaar ke saath soochibaddh kijiye
2. Har ek kitni baar badalta hai ye chihnit kijiye
3. Sujhaya gaya kram aur bachat padhiye
4. Cache point sthir prefix ke ant mein le jaiye

Example

Input

User question (300) sent first

Output

29,500 stable tokens cannot be cached

Aage rakha ek badalta block apne peechhe sab kuchh mita deta hai.

Common errors aur troubleshooting

• Meri cache hit rate shunya hai. — Kuchh badalta hua prefix mein ghus gaya hai. Timestamp, request ki pehchaan, ya bina tay kram wali tools list — inme se koi ek hi kaafi hai.
• Mera prefix nyoontam se neeche hai. — Chhote prefix cache hote hi nahi, aur ye bataya nahi jaata. Ya to prefix badhaiye, ya maan lijiye ki caching nahi hogi.
• Kabhi cache lagti hai, kabhi nahi. — Aam taur par koi kabhi-kabhaar badalne wala block bahut pehle rakha hai. Uska har badlav apne baad sab kuchh mita deta hai, yaani kabhi-kabhaar ka matlab kabhi-kabhaar poora daam.
• Kram badalne se arth badal jayega. — Tab ye asli adla-badli hai. Jise wahin rehna hai wo ek bandhan hai; ye tool uski keemat dikha deta hai taaki faisla jaankari ke saath ho.

Aksar pooche jaane wale sawaal

Prompt caching asal mein kaise kaam karti hai?

Aapki request cache ki gayi request se prefix ke aadhaar par milayi jaati hai. Pehle farq tak ka sab kuchh cache se aata hai aur daam ka ek ansh leta hai; uske baad ka sab poora daam. Isiliye kram hi sab kuchh hai.

Chupchaap cache kin cheezon se tootti hai?

Har wo cheez jo byte jaldi badal de: system prompt mein timestamp, request ki pehchaan, bina kram wali structure se bani tools list, prati-user koi field. Inme se koi error nahi deti — bas hit rate gir jaati hai.

Nyoontam prefix kyun hota hai?

Model ke hisaab se ek aakaar se neeche caching laagu hi nahi hoti. Ye chupchaap fail hoti hai, isliye ho sakta hai jis chhote system prompt ko aap cache hua maan rahe the wo kabhi cache hua hi na ho.

Cache point kahaan rakhein?

Aakhri sthir block ke ant mein. Usse pehle ka sab dobara istemaal hota hai, uske baad ka sab har baar naya — yahaan ka kram theek yahi kataan banata hai.

Kya caching hamesha faayde ki hai?

Jab koi bada prefix sach mein dobara istemaal hota hai to haan: read rate input rate ka ek ansh hai. Jis request mein sthir prefix hai hi nahi use marodne layak nahi — yahaan ki error yahi batati hai.

Related tools

• Agent Loop Cost Estimator — Turn-dar-turn kharch nikaaliye, dobara bheje history aur cache ke saath.
• Context Window Planner — Window ko prompt, tools, history aur jawab mein baantiye.
• Project Instructions Builder — Aisi CLAUDE.md likhiye jo har session mein apni jagah kamaye.
• Prompt Diff — Do versions shabd-dar-shabd milaiye, token antar ke saath.
• Text Chunker — Document ko asli seemayon par tootne wale overlap tukdon mein baantiye.
• Batch Request Builder — Rows ki table ko alag pehchaan wale bulk job mein badliye.

AI aur agents ke aur tools

• Skill Builder — SKILL.md likhiye, frontmatter saath-saath check hota hai.
• Skill Linter — SKILL.md paste kijiye aur dekhiye use kisi kaam se judne se kya rok raha hai.
• Subagent Builder — Subagent ki definition file banaiye, uske tools aur model samet.
• Slash Command Builder — Arguments aur tools list ke saath apna command banaiye.
• Project Instructions Builder — Aisi CLAUDE.md likhiye jo har session mein apni jagah kamaye.
• Plugin Manifest Builder — plugin.json banaiye aur uski apekshit folder banawat dekhiye.
• Hooks Builder — settings.json ke hooks banaiye aur kabhi na chalne wale matchers pakadiye.
• Permission Rule Tester — Allow, ask aur deny rules asli commands par aazmaiye.
• MCP Server Config — stdio, HTTP ya SSE ke liye MCP server entry banaiye.
• MCP Tool Schema Builder — Tool tay kijiye aur JSON Schema paiye, strict mode jaanch ke saath.
• Tool Schema Checker — Definition paste kijiye aur jaaniye wo kyun reject ho rahi hai.
• Prompt Template Filler — Ek prompt ko rows ki table par failaiye aur kami dekhiye.
• System Prompt Linter — Contradictions, bekaar instructions aur bina bhare placeholders dhoondhiye.
• Prompt Diff — Do versions shabd-dar-shabd milaiye, token antar ke saath.
• Few-shot Example Builder — Input-output jodon ko tag, JSON ya chat roop ke examples banaiye.
• XML Prompt Section Builder — Sections ko aise tags mein lapetiye jinse content bahar na nikle.
• JSONL Viewer aur Validator — JSONL file line-dar-line padhiye, chhaantiye aur jaanchiye.
• Chat Transcript Converter — Messages array ko padhne layak transcript mein badliye, aur wapas.
• Dataset Validator — chat roop ka JSONL dataset un errors ke liye jaanchiye jo training gira dein.
• SSE Stream Viewer — Kacchi stream se text, tool calls aur usage wapas paiye.
• Context Window Planner — Window ko prompt, tools, history aur jawab mein baantiye.
• Text Chunker — Document ko asli seemayon par tootne wale overlap tukdon mein baantiye.
• Agent Loop Cost Estimator — Turn-dar-turn kharch nikaaliye, dobara bheje history aur cache ke saath.
• Batch Request Builder — Rows ki table ko alag pehchaan wale bulk job mein badliye.

AI aur agents ke sabhi tools dekhein · Saare tools