Code

Feat/onnx inference#7

Code

Merged

remsky merged 5 commits intomasterremsky/Kokoro-FastAPI:masterfrom feat/onnx-inferenceremsky/Kokoro-FastAPI:feat/onnx-inferenceCopy head branch name to clipboardJan 4, 2025

+6,400-1,541

Commits

Commits on Jan 3, 2025

• WIP, Functional for CPU: Updated for ONNX runtime support, Dockerfile and TTS Service

  remsky

  committed
  e4d8e74

  Copy full SHA for e4d8e74

• WIP: CPU/GPU Functional, few straggling tests to fix and check.

  remsky

  committed
  9496a3a

  Copy full SHA for 9496a3a

Commits on Jan 4, 2025

• - CPU ONNX + PyTorch CUDA, functional

  Show description for 7df2a68
  remsky

  committed
  7df2a68

  Copy full SHA for 7df2a68

• Enhance ONNX optimization settings and add validation script for TTS audio files

  remsky

  committed
  93aa205

  Copy full SHA for 93aa205

• Allow ONNX support optimizations for CPU inference and update benchmarking scripts; modify README for clarity on performance metrics

  remsky

  committed
  76e8b07

  Copy full SHA for 76e8b07