OpenRelay
2-person YC startup routing AI inference across cheap, hardware-agnostic GPUs.
OpenRelay sells cheap, compatible-API GPU routing into a room where Baseten already scaled and ZML gives the same idea away free.
OpenRelay helps companies run AI models on cheaper computers by directing the work to the best available hardware, charging 90% less than big cloud companies. The problem: a free competitor called ZML launched the same idea in July 2026 with backing from a major AI researcher, and bigger companies like Baseten already handle this for customers across multiple cloud services. What might save OpenRelay is if it discovers a specific type of customer or use case that the bigger players ignore, but right now it is competing purely on price in a race where larger companies with more money usually win.
ZML's free engine gains adoption from named enterprise customers beyond Scaleway/VSORA. Would show the free open-source alternative is closing OpenRelay's cost-arbitrage wedge.
OpenRelay publishes a named customer or vertical focus (e.g. HIPAA, FedRAMP, EU data residency). Would show a pivot to a regulated niche the incumbents can't easily enter.
- Baseten Series F: $1.5B at ~$13B valuation
- Baseten spans 18 clouds, 87 clusters
- OpenRelay team: 2 people
- No shipped moat; OpenAI/Anthropic-compatible API lowers switching costs for customers to leave.
- Free open-source ZML engine (July 2026) directly replicates core hardware-agnostic pitch at zero cost.
- Only 2-person team with no disclosed independent funding or named customers as of July 2026.
- Commodity margin-tax race against well-capitalized incumbents like Baseten and Vast.ai.
- Industry-wide B200/Blackwell GPU supply constraints could limit hardware sourcing.
| Rival | Direction | Evidence |
|---|---|---|
| Baseten | losing to | Raised $1.5B Series F at ~$13B valuation with 18 clouds/87 clusters as of June 22, 2026 |
| ZML | losing to | Released free open-source hardware-agnostic inference engine July 8, 2026, matching OpenRelay's pitch |
| Vast.ai | losing to | Established GPU marketplace with five-year head start, offering AMD support since May 2024 |
| RunPod | contesting | Operates competing GPU rental/serverless marketplace as of July 15, 2026 |
| Modal Labs | losing to | Reportedly in talks near $2.5B valuation as of July 8, 2026 |
- Is OpenRelay profitable?
- No revenue, ARR, or customer figures have been disclosed. OpenRelay is a 2-person, pre-seed Y Combinator Summer 2026 startup founded in 2026, with no independent funding announced as of July 22, 2026, making profitability highly unlikely at this stage.
- Who are OpenRelay's biggest competitors?
- Baseten (raised $1.5B Series F at a ~$13B valuation, June 22, 2026, spanning 18 clouds and 87 clusters), GPU marketplaces Vast.ai and RunPod, and ZML, which open-sourced a free hardware-agnostic inference engine on July 8, 2026, matching OpenRelay's core pitch.
- Could open-source tools replace OpenRelay?
- Yes, potentially. On July 8, 2026, Paris-based ZML released ZML/LLMD v2, a free, Yann LeCun-endorsed, hardware-agnostic inference engine offering the same 'run any model anywhere' proposition OpenRelay sells, directly undercutting its differentiation with a zero-cost alternative.
- How much does OpenRelay charge for GPU compute?
- OpenRelay advertises $0.98/hr for RTX 5090 and A100 32GB tiers and $2.30/hr for H100 80GB, claiming savings of up to 90% versus AWS, Azure, and GCP; these are the company's own vendor-claimed figures as of July 22, 2026.
- Who owns OpenRelay?
- OpenRelay is privately held, based in Seattle, WA, founded in 2026, and part of Y Combinator's Summer 2026 (S26) batch with 'Active' status. No parent company, acquisition, or independent funding round has been publicly disclosed as of July 22, 2026.
- Has OpenRelay raised a seed round?
- As of July 22, 2026, no independent, non-YC funding announcement has been found for OpenRelay; only its participation in Y Combinator's Summer 2026 batch is confirmed, with no disclosed valuation or round size.
- 2026-07-22YC lists OpenRelay as 2-person, Active S26 company with no open job postings
- 2026-07-08ZML releases free open-source hardware-agnostic inference engine ZML/LLMD v2
- 2026-06-22Baseten announces $1.5B Series F at roughly $13B valuation
- 2026-06-18TechCrunch reports Baseten raising $1.5B with ~20x YoY revenue growth
- 2026-04-12Industry-wide B200/Blackwell GPU supply constraints noted
- 2026OpenRelay founded in Seattle, WA, joins YC Summer 2026 batch
- 2024-05-01Vast.ai becomes first GPU rental marketplace to offer AMD support
- Announcing our Series F (2026-06-22)
- AI inference startup Baseten reportedly raising $1.5B months after its last mega-round (2026-06-18)
- A Paris Startup Bets Its Free AI Software Can Anchor Europe's Chip Independence (2026-07-08)
- ZML releases free inference software that could reshape AI compute economics (2026-07-08)
- French Startup ZML Unveils Open-Source Tool to Slash AI Compute Costs (2026-07-08)
- OpenRelay: Distributed, hardware-agnostic AI inference
- Jobs at OpenRelay
- OpenRelay, Distributed GPU cloud for production inference
- OpenRelay API Documentation
- OpenRelay, API Provider, Schemas (2026-07-22)
- Hosted inference and GPU compute
- Best GPU Cloud for AI Inference (2026) (2026-07-15)