Facial analysis application demonstrating some features like real-time LSTM classification, annotation, training tool and single frame evaluation.
CNTK - Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit https://github.com/Microsoft/CNTK
We are using kinect v2 to extract 3d points from faces, then we select some specific points ( eye brow and nose) in each frame and then calculate Euclidean distance and vector orientation. With that result we evaluate in real time a sequence of frames with a LSTM neural network previously trained. The patterns evaluated are Neutral,Smile,Angry and Awe.
CNTK - Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit https://github.com/Microsoft/CNTK
We are using kinect v2 to extract 3d points from faces, then we select some specific points ( eye brow and nose) in each frame and then calculate Euclidean distance and vector orientation. With that result we evaluate in real time a sequence of frames with a LSTM neural network previously trained. The patterns evaluated are Neutral,Smile,Angry and Awe.
Category
📚
Learning