From ab92f7e0069a9ef53551c9086548d67614f3cc81 Mon Sep 17 00:00:00 2001 From: Neko Ayaka Date: Mon, 6 Jan 2025 17:19:16 +0800 Subject: [PATCH] chore: updated .gitignore --- .gitignore | 2 +- docs/pages/en/index.md | 0 docs/pages/en/research/gaming/minecraft.md | 5 ++++ docs/pages/en/research/lipsync.md | 28 ++++++++++++++++++++++ docs/pages/en/research/mocap.md | 1 + docs/pages/en/research/text-to-motion.md | 24 +++++++++++++++++++ docs/pages/en/research/tts.md | 3 +++ 7 files changed, 62 insertions(+), 1 deletion(-) create mode 100644 docs/pages/en/index.md create mode 100644 docs/pages/en/research/gaming/minecraft.md create mode 100644 docs/pages/en/research/lipsync.md create mode 100644 docs/pages/en/research/mocap.md create mode 100644 docs/pages/en/research/text-to-motion.md create mode 100644 docs/pages/en/research/tts.md diff --git a/.gitignore b/.gitignore index d55164c3..651032dc 100644 --- a/.gitignore +++ b/.gitignore @@ -30,4 +30,4 @@ coverage/ *.ogg *.mp3 -**/temp/ */ +**/temp/ diff --git a/docs/pages/en/index.md b/docs/pages/en/index.md new file mode 100644 index 00000000..e69de29b diff --git a/docs/pages/en/research/gaming/minecraft.md b/docs/pages/en/research/gaming/minecraft.md new file mode 100644 index 00000000..4f3b48a1 --- /dev/null +++ b/docs/pages/en/research/gaming/minecraft.md @@ -0,0 +1,5 @@ +PrismarineJS/mineflayer: Create Minecraft bots with a powerful, stable, and high level JavaScript API. +https://github.com/PrismarineJS/mineflayer + +mindcraft/src/agent/agent.js at main · kolbytn/mindcraft +https://github.com/kolbytn/mindcraft/blob/main/src/agent/agent.js diff --git a/docs/pages/en/research/lipsync.md b/docs/pages/en/research/lipsync.md new file mode 100644 index 00000000..30ea8433 --- /dev/null +++ b/docs/pages/en/research/lipsync.md @@ -0,0 +1,28 @@ +## Index + +- [harlanhong/awesome-talking-head-generation](https://github.com/harlanhong/awesome-talking-head-generation?tab=readme-ov-file) + +## Papers & Projects + +- [taherfattahi/nvidia-human-ai-lipsync](https://github.com/taherfattahi/nvidia-human-ai-lipsync) +- [met4citizen/TalkingHead](https://github.com/met4citizen/TalkingHead) +- [zak-45/WLEDLipSync](https://github.com/zak-45/WLEDLipSync) +- [hecomi/uLipSync](https://github.com/hecomi/uLipSync) +- [DanielSWolf/rhubarb-lip-sync](https://github.com/DanielSWolf/rhubarb-lip-sync) +- [AnimaVR/NeuroSync_Player](https://github.com/AnimaVR/NeuroSync_Player) +- [saifhassan/Wav2Lip-HD](https://github.com/saifhassan/Wav2Lip-HD) +- [instant-high/wav2lip-onnx-HQ](https://github.com/instant-high/wav2lip-onnx-HQ) +- [DanielSWolf/rhubarb-lip-sync](https://github.com/DanielSWolf/rhubarb-lip-sync) +- [RealTalk: Real-time and Realistic Audio-driven Face Generation with 3D Facial Prior-guided Identity Alignment Network](https://huggingface.co/papers/2406.18284) +- [loopyavatar.github.io](https://loopyavatar.github.io/) +- [Rudrabha/Wav2Lip](https://github.com/Rudrabha/Wav2Lip) +- [audio2face-3d Model by NVIDIA | NVIDIA NIM](https://build.nvidia.com/nvidia/audio2face-3d) +- [2306.10799 SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking Faces](https://ar5iv.labs.arxiv.org/html/2306.10799?_immersive_translate_auto_translate=1) +- [anothermartz/Easy-Wav2Lip: Colab for making Wav2Lip high quality and easy to use](https://github.com/anothermartz/Easy-Wav2Lip) +- [OpenTalker/SadTalker](https://github.com/OpenTalker/SadTalker) +- [TMElyralab/MuseTalk](https://github.com/TMElyralab/MuseTalk) + +## Related ones + +- [JingLi513/Audio2Gestures](https://github.com/JingLi513/Audio2Gestures) +- [Digital Humans | Reply](https://www.reply.com/en/metaverse/digital-humans) diff --git a/docs/pages/en/research/mocap.md b/docs/pages/en/research/mocap.md new file mode 100644 index 00000000..a352793e --- /dev/null +++ b/docs/pages/en/research/mocap.md @@ -0,0 +1 @@ +- [freemocap/freemocap: Free Motion Capture for Everyone 💀✨](https://github.com/freemocap/freemocap) diff --git a/docs/pages/en/research/text-to-motion.md b/docs/pages/en/research/text-to-motion.md new file mode 100644 index 00000000..d0c1051a --- /dev/null +++ b/docs/pages/en/research/text-to-motion.md @@ -0,0 +1,24 @@ +## Index + +- [derikon/awesome-human-motion](https://github.com/derikon/awesome-human-motion) + +## Papers & Projects + +Developer-Zer0/MoDDM-Text-to-Motion-Synthesis-Using-Discrete-Diffusion: Official implementation of "MoDDM: Text-to-Motion Synthesis using Discrete Diffusion Model (BMVC2023)" +https://github.com/Developer-Zer0/MoDDM-Text-to-Motion-Synthesis-Using-Discrete-Diffusion + +EMOTION：通过上下文学习为人形机器人生成富有表现力的运动序列 --- EMOTION: Expressive Motion Sequence Generation for Humanoid Robots with In-Context Learning +https://arxiv.org/html/2410.23234?_immersive_translate_auto_translate=1 + +Harmon：根据语言描述生成人形机器人的全身运动 --- Harmon: Whole-Body Motion Generation of Humanoid Robots from Language Descriptions +https://arxiv.org/html/2410.12773?_immersive_translate_auto_translate=1 + +来自人级指令的人机交互 --- Human-Object Interaction from Human-Level Instructions +https://arxiv.org/html/2406.17840?_immersive_translate_auto_translate=1 + +## Industry Solutions + +- [Synthesia Pricing | From $18 per Month](https://www.synthesia.io/pricing-options) +- [Plask Motion: AI-powered Mocap Animation Tool](https://plask.ai/en-US) +- [Pricing Saymotion](https://www.deepmotion.com/sign-up?product=SmWeb&plan=Freemium) +- [Digital Humans | Reply](https://www.reply.com/en/metaverse/digital-humans) diff --git a/docs/pages/en/research/tts.md b/docs/pages/en/research/tts.md new file mode 100644 index 00000000..e4c36a96 --- /dev/null +++ b/docs/pages/en/research/tts.md @@ -0,0 +1,3 @@ +- [snakers4/silero-models](https://github.com/snakers4/silero-models#text-to-speech) +- [voicevox-client/python](https://github.com/voicevox-client/python) +- [VOICEVOX/voicevox_engine: 無料で使える中品質なテキスト読み上げソフトウェア、VOICEVOXの音声合成エンジン](https://github.com/VOICEVOX/voicevox_engine/tree/master)