Samples - chitsaw/psi GitHub Wiki

The psi-samples repository contains a few small example applications written with Platform for Situated Intelligence. Some of the samples address specialized topics like how to leverage speech recognition components or how to bridge to ROS, but in general looking through them can give you more insight into programming with Platform for Situated Intelligence. Besides these samples, a good place to start reading about programming with \psi is the Brief Introduction and the set of Tutorials.

As indicated in the last column in the table below, some of the samples have a corresponding detailed walkthrough that explains how the samples are constructed and function, and provide further pointers to documentation and learning materials. Going through these walkthroughs can also help you learn more about programming with \psi.

Name Description Windows Linux Walkthrough
HelloWorld Hello World preview image showing code snippet This sample is the simplest possible starting point for creating a \psi application. Yes Yes Yes
SimpleVoiceActivityDetector Preview image showing visualized audio and VAD result streams This sample captures audio from a microphone and performs voice activity detection, i.e., it computes a boolean signal indicating whether or not the audio contains voiced speech. Yes Yes Yes
WebcamWithAudioSample Preview gif showing webcam view of a person speaking and audio level changing This sample illustrates how to display images from a camera and the audio energy level from a microphone. Yes - Yes
LinuxWebcamWithAudioSample This sample illustrates how to display images from a camera and the audio energy level from a microphone on Linux. - Yes Yes
AzureKinectSample This sample demonstrates how to use the Azure Kinect sensor with body tracking and how to use the Join() and Pair() operators to synchronize and fuse streams. Yes - Yes
WhatIsThat Preview gif of visualized 3d output from What-is-That sample This sample implements a simple application that uses an Azure Kinect sensor to detect the objects a person is pointing to. Yes - Yes
PsiBot This sample application shows how you can integrate \psi with the Teams bot architecture to develop bots that can participate in live meetings. Yes - Yes
KinectSample This sample illustrates how to augment an existing voice activity detector by leveraging information about lips motion extracted from Kinect face tracking. Yes - -
SpeechSample This sample illustrates how to use various speech recognition components. Yes - -
LinuxSpeechSample This sample illustrates how to use various speech recognition components on Linux. - Yes Yes
RosTurtleSample This sample illustrates how to connect Platform for Situated Intelligence to the turtlesim in ROS. Yes Yes Yes
RosArmControlSample This sample illustrates how to connect Platform for Situated Intelligence to control the uArm Metal using ROS. Yes Yes Yes
OpenCVSample This sample illustrates how to interop with OpenCV. Yes - -
HoloLensSample Preview gif of visualized output streams from one of the HoloLens Sample demos This sample demonstrates how to develop Mixed Reality \psi applications for HoloLens 2. UWP - Yes