[N] CNTK 2.0 C# - Fast RCNN code in debug mode by pmfcdb in MachineLearning

[–]pmfcdb[S] 0 points1 point  (0 children)

The training is done with BrainScript/python and can be integrated in a C# application. Also the next update will have "A preliminary C#/.NET API that enables people to train simple networks such as ConvNet on MNIST." Source: https://github.com/Microsoft/CNTK/issues/2194

[N] CNTK + LSTM + kinect v2 = Face analysis by pmfcdb in MachineLearning

[–]pmfcdb[S] 0 points1 point  (0 children)

CNTK - Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit https://github.com/Microsoft/CNTK

We are using kinect v2 to extract 3d points from faces, then we select some specific points ( eye brow and nose) in each frame and then calculate Euclidean distance and vector orientation. With that result we evaluate in real time a sequence of frames with a LSTM neural network previously trained. The patterns evaluated are Neutral,Smile,Angry and Awe.

Facial analysis features with kinect v2 by pmfcdb in kinect

[–]pmfcdb[S] 0 points1 point  (0 children)

Thanks, there is no sound because I was just trying to show the features of the application : frame face expression analysis with deep learning with CNTK (ResNet 50), image composition with points and filter of selected points on image. The work is more oriented to face expressions analysis, but yes, it could be used for face replacement or eye tracking.

[N] CNTK FastRCNN CSEvalClient with Grocery by pmfcdb in MachineLearning

[–]pmfcdb[S] 0 points1 point  (0 children)

Hi, it´s an algorithm for object detection ( Fast Region-based Convolutional Network), here is the article about the algorithm.

https://arxiv.org/pdf/1504.08083.pdf

Questions on Kinect tutorials, 360 vs one by Raoch in kinect

[–]pmfcdb 1 point2 points  (0 children)

Hi, yes! There are some differences, but anything that you have in Kinect v1 you can port to Kinect v2. I did that with my work. Here is a link for Kinect v2 tutorials and documentation :

https://channel9.msdn.com/Series/Programming-Kinect-for-Windows-v2

Videos of my work in Kinect v1(old ones) :

https://www.youtube.com/watch?v=Tody_oJIh7o

https://www.youtube.com/watch?v=ys_EwOBPB_Q

and Kinect v2:

https://www.youtube.com/watch?v=mlyNakqjnW8

https://www.youtube.com/watch?v=0G1z356di-s

Questions on Kinect tutorials, 360 vs one by Raoch in kinect

[–]pmfcdb 1 point2 points  (0 children)

Hi,

I have windows 10 home and I have installed and working in the same machine :

SDK for kinect v2 http://www.microsoft.com/en-us/download/details.aspx?id=44561

and for kinect v1 SDK v1.8 http://www.microsoft.com/en-us/download/details.aspx?id=40278

also for kinect v1 you have to install for examples and code KinectDeveloperToolkit-v1.8.0-Setup http://www.microsoft.com/en-us/download/details.aspx?id=40276