SheepNav
Ghostlink

Ghostlink

getghostlink.com

Run local LLMs across heterogeneous clusters

今天制作者:Ryan Williams

关于 Ghostlink

Distributed LLM inference fabric for heterogeneous local clusters. Features zero-copy SPSC ring buffers, automated tuning, and an OpenAI-compatible API. - rwilliamspbg-ops/Ghostlink

相关工具