从公网边缘、分布式控制与隔离执行,
到 Model Gateway、AI Runtime 与模型工程,
我们构建面向大规模 AI 产品的纵向系统栈。
From high-bandwidth edge ingress and distributed control to isolated execution, Model Gateway, AI Runtime and model engineering — one integrated systems stack for AI products at scale.
以 25Gbps 级公网 Edge 作为可替换数据平面单元;
公网流量增长时直接增加 Edge 实例,Controller 主动建立 QUIC v1 / TLS 1.3 连接,
通过固定 Ed25519 身份保持认证边界,业务权威不随边缘扩张。
Use 25Gbps-class public Edge instances as replaceable data-plane units. As ingress grows, add Edge capacity horizontally; Controller initiates QUIC v1 / TLS 1.3 connections with fixed Ed25519 identity while business authority stays in the core.
Controller、Execution Node、Data Gateway、
Model Gateway 与 Storage 按各自需求横向增加;
机器规模增长不要求重定义整体系统拓扑。
Controller, execution nodes, Data Gateway, Model Gateway and storage expand according to their own demand without redefining the topology as machine count grows.
YaoBox 不以 Pod、Service Mesh 或通用 Scheduler
作为核心抽象,
而直接围绕 Task、NodeSession、Gateway
与 Linux 资源边界组织 Runtime。
YaoBox is defined around Task, NodeSession, gateways and Linux resource boundaries instead of a generic Pod / Service Mesh / scheduler abstraction.
Execution Node 只提交绑定当前
Task 的标准 Model Request。
Model Gateway 负责 staging、routing、
Provider Credential、Provider effect
与流式响应标准化。
Execution nodes submit a standard Model Request bound to the current Task. Model Gateway owns staging, routing, provider credentials, provider effects and stream normalization.
外部 effect 不被隐藏在自动 retry 中。
系统先建立唯一 ownership,再执行外部 effect,
最后通过显式 readback 或确定结果完成状态提交。
External effects are not hidden behind automatic retry. The system establishes unique ownership first, performs the external effect, then resolves it through explicit readback or a deterministic outcome.
模型结构、数值体系、GPU 通信、长上下文执行和训练 /
rollout policy identity 被共同定义,
让 Research 直接连接最终 Runtime 与 Serving。
Architecture, numerics, GPU communication, long-context execution and training / rollout policy identity are co-defined so research connects directly to runtime and serving.
Infrastructure、Commerce、Distribution 与产品形态
连接到同一技术底座。
Yaoledge、Yaoedge、Ember、Nova
是这套系统在不同层面的表达。
Infrastructure, commerce, distribution and product surfaces connect to one technical foundation. Yaoledge, Yaoedge, Ember and Nova are different expressions of that system.