InferenceHub
37 subscribers
2 videos
10 links
Infer. Intelligently. Impact.
Download Telegram
Channel created
Media is too big
VIEW IN TELEGRAM
Using Claude Code with InferenceHub โ€” all models with one key, $10/mo.
Start free: https://app.inferencehub.tech/portal#/agents
๐Ÿ‘4
Media is too big
VIEW IN TELEGRAM
Using Zcode with InferenceHub $10 plan for daily development work

https://zcode.z.ai/en
โค3
Created a group, please feel free to join and ask any questions you might have.
https://t.me/inferencehub_group
๐Ÿ–ฅ๏ธ InferenceHub Desktop is here

The full InferenceHub chat, now a native app for macOS and Windows โ€” every model on one key: real Claude, GPT, and open-weight models, plus web search, deep research, and project files, outside the browser.

Download โ†’ https://inferencehub.tech/download
โ€ข macOS (Apple Silicon)
โ€ข Windows 10/11 (x64)

Sign in with your InferenceHub account โ€” $1 free credit to start.

One honest heads-up: this is an early unsigned preview, so your OS will warn on first launch:
โ€ข Windows: More info โ†’ Run anyway
โ€ข macOS: right-click the app โ†’ Open โ†’ Open anyway

Code signing is on the way. Until then the app's source is public, so you can see exactly what you're running: https://github.com/InferenceHub/inferencehub-desktop

Kick the tires and tell us what breaks โ€” reply in the @inferencehub_group or open an issue. ๐Ÿ™
โค6
Claude Opus 5 is live on InferenceHub: opus-5 on the API and Claude Code, and selectable in the hosted chat under Anthropic. Parity pricing, 0% markup - $5/$25 per 1M, $0.50 cached input, same sheet as Opus 4.8. Bare opus still means 4.8. Changelog: https://inferencehub.tech/changelog
โค2๐Ÿ‘2
Auto routing is live: name a price, not a model.

Two new model ids:
โ€ข ih-auto โ€” routes each request to a fast open-weight model at a flat $1/M input, $5/M output. Never escalates.
โ€ข ih-auto-smart โ€” same pool, but a genuinely hard turn escalates to Claude Sonnet 5, billed exactly as if you'd picked sonnet-5 yourself. Choosing -smart is the consent.

The honest print, up front:
โ€ข Named models here pass through at 0% markup. Auto is the one deliberate exception โ€” the spread between the flat sheet and the routed model's native price is the routing fee.
โ€ข Not a black box: routing is a deterministic rule table (no LLM reads your prompt to classify it), and every response tells you what served it โ€” the model field, the x-ih-auto header, and your usage view.
โ€ข On plans, Auto never touches the premium budget โ€” the all-day coding id on Plus and Max.

Bonus for long agent sessions: the Auto ids can compact an overgrown conversation instead of erroring on context, and x-ih-compact: 1 trims to a working set on demand โ€” you're billed on the compacted request.

Works everywhere a model id goes: Claude Code ("model": "ih-auto-smart"), Cursor (add as custom model), Kilo, plain API.

Docs: https://inferencehub.tech/docs/auto
๐Ÿ‘2
๐Ÿ“ข Big plans upgrade: one flat plan for chat, coding, and research

We've reorganized InferenceHub models into three clear tiers:

๐Ÿ”ธ Premium (โ‰ฅ $4/1M input tokens) โ€” Fable 5, the Opus series, GPT 5.6 Sol
๐Ÿ”น Standard ($1โ€“$4/1M input tokens) โ€” Sonnet 5, Kimi K3, GPT 5.6 Terra, GLM 5.2, and more
๐Ÿ†“ Free (< $1/1M input tokens, plus select frontier models) โ€” Haiku 4.5, GPT 5.6 Luna, and more

Honest fine print: Free tier applies inside the chat app only. The same models used via the API (coding agents, integrations) are billed normally at list price.

โšก Max plan โ€” $50/month

- $500/month of premium model usage
- $2,000/month of standard model usage
- Works across everything: chat, deep research, and API/coding

For most users, that's your entire AI stack โ€” chat + coding agent + research โ€” covered by one $50 plan.

๐Ÿง  Prompt caching is now live across our models. Long conversations and coding sessions reuse cached context at a fraction of the cost, so your plan allowance stretches much further than raw token prices suggest.

Prefer something lighter? The Plus plan ($25/month) is also available โ€” full breakdown: https://inferencehub.tech/pricing

Questions or edge cases? Feel free to ask in the group chat here: @inferencehub_group
We'll answer straight. Thanks all! ๐Ÿ™
โค5
๐Ÿ“ฃ InferenceHub is on Telegram โ€” meet @InferenceHubBot. Link it to your account (portal โ†’ Account โ†’ Telegram) and chat with frontier + open-weight models on your own balance: same catalog, same pay-as-you-go pricing as the web chat and API. /models to browse, /model to switch, /new for a fresh thread. Free-class models included on trial. Nothing is sold in-chat โ€” your portal stays in charge. https://inferencehub.tech/docs/telegram
โค2๐Ÿ‘1
๐Ÿš€ Big open-weight drop on InferenceHub - 5 new models, all live:

๐Ÿ‹ DeepSeek V4 Flash (0731) - deepseek-v4-flash-0731
$0.08 in / $0.252 out per 1M ยท fast, agentic, absurdly cheap

๐Ÿ‹ DeepSeek V4 Pro (0813) - deepseek-v4-pro-0813
$1.32 in / $3.96 out per 1M ยท DeepSeek's flagship-class snapshot

๐ŸŒ€ Qwen3.8 Max - qwen3.8-max
$2.00 in / $6.00 out per 1M ยท Qwen's 2.4T-para

โšก GLM-5.3 - glm-5.3
$1.40 in / $4.40 out per 1M ยท 1M context + up to 1M output (4ร— GLM-5.2)

โšก GLM-5.3 Flash - glm-5.3-flash
$0.15 in / $0.50 out per 1M ยท same 1M window, fraction of the price

Every one of them is served natively on all three API surfaces - Chat Completions, Anthropic Messages, and Responses. That means Claude Code and Codex CLI work out of the box: swap the model id and go. Tool calling on all five, prompt caching where the model supports it.

One key. Every model. ๐Ÿ”‘
โค7
Fable 5.1 is enabled now.
โค5๐Ÿ”ฅ4๐Ÿ‘2
GPT-6 Astra is live on InferenceHub. OpenAI's new frontier model โ€” 1.05M context, 128K output, native reasoning, tool calling, prompt caching โ€” at pass-through pricing: $10 / 1M input, $50 / 1M output, $1 / 1M cached input.

Where it works today:
โ€ข API: gpt-6-astra on /v1/responses (Codex and any Responses client)
โ€ข Cursor: add gpt-6-astra as a custom model (Chat, Cmd-K, Agent)
โ€ข Claude Code: ANTHROPIC_MODEL=gpt-6-astra, or pick claude-code-gpt-6-astra from /model
โ€ข Chat: chat.inferencehub.tech โ†’ OpenAI โ†’ GPT-6 Astra

On plans it draws from the shared premium budget alongside Opus, Fable 5 and GPT-5.6 Sol.
Docs: https://inferencehub.tech/docs/models ยท Changelog: https://inferencehub.tech/changelog
๐Ÿ‘5