Skip to content
/ mojimap Public

Real-time facial expression to emoji mapping in the browser using MediaPipe & TensorFlow.js ๐ŸŽญ๐Ÿค–

Notifications You must be signed in to change notification settings

tjoab/mojimap

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

4 Commits
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

๐Ÿ˜ถโ€๐ŸŒซ๏ธ Mojimap

Mojimap is a browser-based playground that infers emoji reactions based on your facial expressionsโ€”entirely client-side. Using TensorFlow.js and MediaPipeโ€™s lightweight vision models, it tracks your face and maps your expressions to emojis in real time.

Check out the playground here!

  • For optimial performance please use a browser other than Chrome, Firefox and Safari seem to work great! Unsure why Chrome gets bogged down.

๐Ÿš€ Features

  • Real-time face landmark detection, using 478 points facial feature points
  • Facial expression classficiation all happening locally in your browser
    • Blendshape model infers subtle muscle movements and expressions taking the 478 landmark points as input
  • See currently supported expressions below:

๐Ÿง  Supported Expressions

Expression Emoji
Winking (match same eye as emoji)
Smirking with leaning eyes (match same as emoji)
Smiling (without teeth)
Smiling (with teeth)
Shocked
Rolling Eyes

๐Ÿ“ฌ Feedback or Ideas?

๐Ÿ™Œ Contributions, feedback, and emoji ideas are always welcome.

Got a cool idea? Found a bug? Feel free to reach out ๐Ÿ˜„

About

Real-time facial expression to emoji mapping in the browser using MediaPipe & TensorFlow.js ๐ŸŽญ๐Ÿค–

Topics

Resources

Stars

Watchers

Forks