The paper presents specific methods of processing of multimodal data recorded during physical acitivities by depth MS Kinect cameras, thermal imaging cameras and heart rate sensors.