Part 2 Real AI HW - terrytaylorbonn/auxdrone GitHub Wiki

In this part 2 (Gdrive) a real CC (companion computer, PI4/Nano) is used (all other components and the world are simulated).

image image

The goals for the tests in this section include

  • (1) Fly sim copter (with sim FC),
  • (2) stand in front of the (real) camera,
  • (3) the (real) CC recognizes that I am human OR recognizes a guesture and
  • (4) in response the (real) CC sends a MAVlink flight command to the sim FC (in this example to land the copter).

image

The first 4 sections of this Part B (Gdrive folder) describe how I got a few AI routines (I tried quite a few the first time around) running on the following platform HW:

  • 2.1 AI Ubuntu. Haarcascades and mediapipe gestures running on the Ubuntu (documents 2_B1.1,2,3, 23.0122-0131). I started using Ubuntu as the first test platform (instead of PI4/Nano) to avoid issues (such as camera drivers; PI4/Nano used their custom version of 18.04 Ubuntu).

  • 2.2 AI PI4. Haarcascades, TF-lite, and mediapipe face meshes (document 2_B2, 23.0119-0121).

  • 2.3 AI Jetson Nano. OpenCV, haarcascades (documents 2_B3_2a-1, 2_B3_3a, 23.0110-0118; 2_B3_2a describes Nvidia tutorials, for which I had trouble getting the camera other drivers setup).

  • 2.4 AI STM. Covers AI implmentations on STM hardware.

The last section covers:

  • 2.5 AI study. This section includes mainly the hands-on demos I did when I first started out studying AI.

========================================

The following diagrams shows where the CC fits in the drone physically and functionally ("flight board" = CC). The second diagram is from Intelligent Quads.

image

image