--- name: coreweave-rate-limits description: 'Handle CoreWeave API and GPU quota limits. Use when hitting quota limits, managing GPU resource allocation, or implementing request queuing for inference endpoints. Trigger with phrases like "coreweave quota", "coreweave limits", "coreweave gpu allocation", "coreweave throttle". ' allowed-tools: Read, Write, Edit, Bash(kubectl:*) version: 1.0.0 license: MIT author: Jeremy Longshore tags: - saas - gpu-cloud - kubernetes - inference - coreweave compatibility: Designed for Claude Code --- # CoreWeave Rate Limits ## Overview CoreWeave limits are primarily GPU quota-based rather than API rate limits. Each namespace has allocated GPU quotas per type. ## Check GPU Quota ```bash kubectl describe resourcequota -n my-namespace kubectl get resourcequota -o json | jq '.items[].status' ``` ## Inference Request Queuing ```python import asyncio from collections import deque class InferenceQueue: def __init__(self, max_concurrent: int = 10): self.semaphore = asyncio.Semaphore(max_concurrent) self.queue_depth = 0 async def inference(self, client, prompt: str) -> str: self.queue_depth += 1 async with self.semaphore: try: return await asyncio.to_thread(client.generate, prompt) finally: self.queue_depth -= 1 ``` ## Resources - [CoreWeave Node Pools](https://docs.coreweave.com/products/cks/nodes/manage) ## Next Steps For security, see `coreweave-security-basics`.