Low
Qwen3.5-9B
High-volume sorting, routing and pulling data out of forms. Fits on a single low-cost GPU.
The easy majorityModels
Right-size the model to the task.
Our starting shortlist, all open-weight. Nothing is recommended until it has been benchmarked on your workload with full running costs.
Medium
Qwen3.8-27B
Reading PDFs, answering from internal documents, everyday coding, vision and OCR.
General business assistantsHigh
GLM-5.3-Flash
Multi-step agents and very large document batches, via API from day one.
Heavier reasoningEscalation
Your frontier model
The hardest 10 to 15% of requests, through the contract you already have.
Kept for what needs itTrack A
In your own cloud
For teams with strict InfoSec rules and existing cloud credits.
- Deploys inside your AWS, GCP or Azure account with one Helm chart
- Inference never leaves your perimeter
- You pay your cloud provider for GPUs directly
- High availability across two zones
Track B
Managed endpoint
For fast-moving teams that want the saving without an MLOps hire.
- Dedicated single-tenant GPUs, US or EU, zero data retention
- No infrastructure for you to run
- Switch over by changing two lines of config:
# The only change in your app client = OpenAI( base_url=os.environ["MS_URL"], api_key=os.environ["MS_KEY"], )
Find out what your AI bill should be.
Fifteen minutes, three questions, no system access. If there's nothing worth shifting, we'll tell you that too.