SAFusion: Efficient Tensor Fusion with Sparsification Ahead for High-Performance Distributed DNN Training

Tensor Fusion is a state-of-the-art GPU virtualization and pooling solution designed to optimize GPU cluster utilization to its fullest potential. ai, amd-gpu, autoscaling, gpu, gpu-pooling, gpu-scheduling, gpu-usage, gpu-virtualization, inference, karpenter, llm-serving, nvidia, pytorch, rcuda, remote-gpu, vgpu