Getting Started - XAIA-ExtendedAugmentationInArchitecture/HandTracking GitHub Wiki

A guide on how to start drawing using with HoloLens 2 and the HandTracking application.

How to start the app?

  1. Wear and turn on Hololens

  2. If the app is built and deployed on the Hololens, you will find it in the All apps section. Otherwise, you can connect with a working Unity file through the Holographic Remoting.

  3. Pick Your team

  1. Read and accept the Starting Information

How to localize your working enviroment?

This QR code represents the origin of your working space. We recommend using the small size. Print it and place it in your space.

  1. Move close to the QR code Marker that represents the origin of your working space.

  2. Access the localize via QR code button from the Hand Menu ** If your palm is not fully open the hand menu will not appear

  1. The 3 Axis will appear on the upper left corner of the QR code marker. Stay Still until they disappear (Repeat steps 1-3 whevever the overlay looks off

How to upload meshes to the app?

  1. Place the geometries in relation to the QR marker
  2. Avoid the Table Menu Area
  1. Make Sure the geometries are Triangulated Meshes
  2. Add them to the List with unique names each
  1. Select which Geometry you want to send
  1. Make Sure you have selected the correct Team (the same as the Hololens user)
  1. Press “Send”
  2. You should see the message “Message published”
  1. The Hololens user will get notified for the new geometry. Then they can decide if they want to accept of reject it.

If not please refer to : TroubleShooting

** For dense meshes there will be a bit of time until the hololens user receives the new geometries

How to draw?

How to save a drawing?

  1. Access the Save button from the Hand Menu. It will save the visualized drawing on the Hololens.

How to send a drawing to Rhino?

On Unity:

  1. Access the Send button from the Hand Menu.
  1. Approve the sending of the written drawing to your Team

On Grasshopper:

  1. Make Sure you have selected the correct Team ( the same as the Hololens user)
  2. Reset the connection ( once when you open the file for the first time / or when you are not received the drawings)
  1. Everytime you are receiving a new message (a) the new drawing, along with the geometries in their place will appear (b).
  2. Internalize the lines and the geometries (c) if you want to save the drawing on GH

MQTT Connection is Lost.

If the connection with the mqtt broker is lost the following message will pop up. This connection is important for the communication between the CAD and the Application.