Luke Meeting Notes

01/12/2022

• Went over JniTeapot Project
• Went over ArCore API basics
• Went over z-buffers
• Went over Skyboxes

01/19/2022

• Go over OpenGl Shader Basics
• Went over OpenGl Render pipeline
• Hard-coded a 2d point in openGL

01/26/2022

• Went over attributes and uniforms
• Updated 2d point example to move around screen and change color with attributes/uniforms
• Went over GPU architecture

02/02/2022

• Went over color blending modes
• Went over projection matrices
• Made 2d dvd demo 3d!

02/09/2022

• Used VBO to store mesh vertices
• Talked about face culling
• Ran into opacity bug. (Luke fixed during the week)
• Used instanced rendering for rendering multiple square meshes

02/16/2022

• Talked about geometry shader and tessellation
• Talked about RANSAC and how the algorithm works
• Implemented ARCore point cloud

02/16/2022

• Reviewed ArCore example code
• Moved point cloud into ARWrapper
• Fixed rendering of invalid point-cloud data
• Merged branch with master
• Talked about using depth textures to occlude points

02/23/2022

• Accumulated points over time
• Rendered 1k points closest to player

03/02/2022

• Spring break

03/09/2022

• Sorted points based on distance to user
• Rendered nearest 1000 closest points to user
• Discussed using depth image to occlude points behind walls

03/16/2022

• Removed unconfident points when sorting
• Fixed the translation bug

03/23/2022

• Acquired depth image from ArCore
• Processed YUV depth image into openGL texture
• Modified GlCamera to render depth image
• Ran into issue rendering image on screen

03/30/2022

• Discussed image stride and pitch
• Reviewed ArCore documentation
• Replaced YUV code with depth16 code (our phones don't return YUV)
• Replaced uint16 with two uint8's when uploading depth image to GPU
• Cleaned up depth image code.
• Can now display depth image on screen

04/06/2022

• Short meeting.
• Parsed confidence and distance in depth shader
• Discussed endianness on unsigned bytes
• Tried to render depth in layers similar to kinect (WIP)

04/13/2022

• Made Wiki
• Fixed parsing of depth image values in shader
• Added HeatMap view to depth texture
• Wrote depth image depth to gl_FragDepth