Home - xrcollaboratory/xrc-toolkit GitHub Wiki
XRC Toolkit
This wiki contains information about the XRC Toolkit; including guidelines, development instructions, and best practices. Please use the sidebar to the right to navigate.
The XRC Toolkit is a collection of tools and 3D interaction techniques, developed by the XR Collaboratory, to accelerate AR/VR prototyping. These modular, reusable packages are used across all our prototyping activities, including research explorations, collaborations, and student projects.
Packages
Below is a list of XRC Toolkit packages.
XRC Agents
Documentation | edu.cornell.xrc.toolkit.agents
| 0.1.0
Package for implementing AI agents, using Microsoft's Semantic Kernel Agent Framework. Compared to the XRC AI
package, this package provides more advance AI use cases, such as agent orchestration, handoffs etc. This package requires the following NuGet packages: Microsoft.SemanticKernel.Core Microsoft.SemanticKernel.Agents.Core Microsoft.SemanticKernel.Agents.Orchestration Microsoft.SemanticKernel.Agents.RunTime.InProcess Microsoft.SemanticKernel.Connectors.OpenAI
XRC AI
Documentation | edu.cornell.xrc.toolkit.ai
| 0.1.1
Package for integrating LLMs into XRC Toolkit. The package contains a simple example using single or standalone LLMs by integrating the relatively new abstractions frmo Microsoft.Extension.AI, as showcased in the XRC AI sample. A more advanced approach can be found in the XRC Agents package, which uses Microsoft's Semantic Kernel and the Agent Framework. API keys: For handling your OpenAI API key you will use a scriptable object. Right-click in your Unity project and select XRC -> XRC API Key. Add your API key as the key value. Make sure to store this file in a gitignored location.
XRC Core
Documentation | edu.cornell.xrc.toolkit.core
| 0.2.1
A collection of starter assets and core utility scripts used across XRC Toolkit packages.
XRC Create
Documentation | edu.cornell.xrc.toolkit.create
| 0.2.0
An implementation of create, delete, and duplicate.
XRC Go-Go
Documentation | edu.cornell.xrc.toolkit.gogo
| 0.2.1
This package implements the Go-Go interaction technique as presented in the original paper, by extending the XR Interaction Toolkit. Original paper: Ivan Poupyrev, Mark Billinghurst, Suzanne Weghorst, and Tadao Ichikawa. 1996. The go-go interaction technique: non-linear mapping for direct manipulation in VR. In Proceedings of the 9th annual ACM symposium on User interface software and technology (UIST '96). Association for Computing Machinery, New York, NY, USA, 79–80. https://doi.org/10.1145/237091.237102.
XRC Grab Move
Documentation | edu.cornell.xrc.toolkit.grabmove
| 0.2.0
This package is an implementation of the locomotion technique seen in the Gravity Sketch application. The technique, here called Grab Move, is built using Unity's XR Interaction Toolkit.
XRC Motor
Documentation | edu.cornell.xrc.toolkit.motor
| 0.2.0
A basic package to demonstrate ROS motor control in XR.
XRC Repeat
Documentation | edu.cornell.xrc.toolkit.repeat
| 0.1.0
Package for spatial recording and playback. Requires Ultimate Replay 3.0 (paid asset).
XRC Speech
Documentation | edu.cornell.xrc.toolkit.speech
| 0.1.1
Package for speech-to-text, and text-to-speech functionality. Meant to be used with the XRC Compute server, or an OpenAI key.
XRC Sphere Select
Documentation | edu.cornell.xrc.toolkit.sphereselect
| 0.2.0
An implementation of a selection technique using a sphere as the selection volume; Sphere Select. This is similar to the selection technique found in Gravity Sketch.
XRC Vision
Documentation | edu.cornell.xrc.toolkit.vision
| 0.1.0
Package for communicating with specific vision models. Currently the package implements a simple call to a locally-hosted Segment Anything Model 2 (SAM 2). Meant to be used with the XRC Compute server.
This document is automatically generated. Do not edit manually.