[SIGCOMM 2023] Lightning: A Reconfigurable Photonic-Electronic SmartNIC for Fast and Energy-Efficient Inference
-
Updated
Nov 17, 2023 - Verilog
[SIGCOMM 2023] Lightning: A Reconfigurable Photonic-Electronic SmartNIC for Fast and Energy-Efficient Inference
[Long Term Support] [SIGCOMM 2023] Lightning: A Reconfigurable Photonic-Electronic SmartNIC for Fast and Energy-Efficient Inference
The official repo for the paper "Optimizing LLM Inference Throughput via Memory-aware and SLA-constrained Dynamic Batching"
Official repo for the ACSOS 2021 paper on how to manage many deep learning models at the edge!
Add a description, image, and links to the inference-serving topic page so that developers can more easily learn about it.
To associate your repository with the inference-serving topic, visit your repo's landing page and select "manage topics."