Star AlbumentationsX on GitHub

GitHub repository

rustfs/GPUCache

A PB-scale, ultra-low latency distributed GPU cache for AI inference. Built with Rust, NVIDIA DOCA, RDMA, and BF-4 DPUs to bridge GPU HBM and NVMe storage, eliminating the recompute tax for large language models.

Repository metrics

Stars · Nov 15, 2026
14
Leaderboard status
Outside the current top 1,000

Source: GitHubLB snapshots.