Integrating Apps and Content with AR Quick Look - juniverse1103/ARKitStudy GitHub Wiki

Integrating Apps and Content with AR Quick Look

Lecturer: David Lui

AR Quick Look

ARQuickLook was designed to enrich any application on the OS with AR content with a simpler way to adopt AR previewing for consistent viewing experience.

Overview

  • What is AR Quick Look?
  • Adopting AR Quick Look
  • Creating 3D models for AR Quick Look

What is AR Quick Look?

  • AR Quick Look is the way to preview 3D content in AR that is built in and deeply integrated into the OS to allow previewing from any application and websites.
  • Available on ARKit compatible devices in iOS12, only object mode on non-ARKit supported devices.
  • AR Quick Look handles seting up the AR experience like
    • Plane detection
    • Object placement
    • Gesture manipulations
    • Creating contact shadows
  • Developer Benefits
    • No need to create own AR viewer
    • Really easy to integrate
    • Built-in AR setup
    • No understanding of AR technology required
  • Demo
    • USDZ file format
    • Gesture Recognition
    • Contact Shadow
    • Matching color intensity and the temperature reported by ARKit from the world
      • Using those with lighting setup
    • Accesibilities
      • VoiceOver
        • Notify whether model is on screen or off screen
      • Switch control
  • First Party Apps adopted and integrated AR QuickLook Viewer
    • Files
    • Mail
    • Messages
    • Notes
    • News
    • Safari
      • It is able to integrate ARQuicklook views into own website.
  • USDZ file
    • New file format for distributing 3D models
    • Packages a model and its textures into a single file
    • Based on Pixar's open-source USD(Universal Scene Description) format
    • Supported on iOS and macOS
    • usdz_converter tool in Xcode10

AR Quick Look Integration

  • App integration

    • Use Quick Look API to facilitate AR Quick Look integration, to preview usdz files, and load them into the viewer

  • Website integration

    • Integrating AR Quick Look in news articles and product pages of online storefronts
      • Various application that would complement previous experience by providing a new way to visualize the content and develop a better understanding of what people are actually seeing.

  • Quick Look

    • Preview documents
    • Framework for previewing file formats
    • Control over transitions and presentation modes
    • Secure and private
    • => Quick Look Previews from the Ground Up Session [WWDC18]

  • Quick Look Preview Flow

    • MainViewController => Thumbnails for various 3D models
    • QLPreviewController
      • datasource, delegate = self
      • How many items does MainVC have for QLPreviewController to preview?
        • For usdz files, only one
      • URL for preview item?
        • URL to a .usdz file for a model that was tapped
      • Source view for transition?
        • View for the model
      • let previewController = QLPreviewController()