40

GitHub - sneha-belkhale/AI4Animation-js: AI4Animation in javascript & three....

 5 years ago
source link: https://github.com/sneha-belkhale/AI4Animation-js
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
neoserver,ios ssh client

README.md

AI4Animation - for javascript & three.js

Description

This project is a port of the original AI4Animation project, for use with three.js on the web. It explores the possibilities of using artifical intelligence to generate realtime character animations. This is very powerful as it allows for an unlimited number of realistic transitions between animation states.

I followed the SIGGRAPH 2018. example for this demo, using the same model weights and corresponding skeleton. After providing the inputs of trajectory points and previous bone positions, the neural network ( written using numjs ) outputs the next set of bone positions and velocities.

If you want to use a different skeleton, you will need to get motion capture data for this skeleton and train a new model, the instructions and tensorflow code for this are in the AI4Animation project here.

56511517-5ee6e700-655f-11e9-9660-ca6d687ddd00.png

Todo Items:

  • An example with a human skeleton.
  • Trying a simpler machine learning model to help with the fps.

Live Demo

https://codercat.tk/ai-animation/

Run the demo yourself:

Run the following commands:

yarn install
yarn pull // this pulls the model weights hosted on the web
yarn start

Then open http://127.0.0.1:3000 in a web browser.


About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK