返回 Skill 列表
extension
分类: AI Agent 能力无需 API Key

dynamic-budget-orchestrator

根据资源遥测、提示大小和配置预设动态调整模型令牌预算。在令牌限制需要适应硬件限制、每次请求的大小或安全/快速/质量模式时使用。

person作者: jakexiaohubgithub

Dynamic Budget Orchestrator

Use this skill to make LLM token limits elastic to local resources and request size.

Workflow

  1. Capture RAM and VRAM snapshot (best effort).
  2. Estimate prompt size and compute a prompt-based cap.
  3. Apply a profile factor (safe, fast, balanced, quality).
  4. Clamp to min/max and emit an effective token budget.

Scripts

  • Run: python skills/automation/dynamic-budget-orchestrator/scripts/probe_budget.py

References

  • references/profile_presets.json