Exercise 28 - WefaaRobotics/Smorphi GitHub Wiki
- An assembled Smorphi 2 robot
- HuskyLens set (can all be found in the HuskyLens box)
- A computer
- Internet connection
- Learn what is a HuskyLens
- Learn how to set up a HuskyLens
- Learn about the possible application of a HuskyLens
- Broder perspective of HuskyLens application (link to CV, ML, AI)
| Steps | Description |
|---|---|
| 1 | [Introducing the HuskyLens camera] HuskyLens offers seamless integration with Smorphi2 through UART or I2C protocols, empowering users with a versatile AI machine vision sensor featuring 7 distinct functionalities: face recognition, object tracking, object recognition, line tracking, color recognition, tag recognition, and object classification. With its intuitive interface, HuskyLens simplifies the process of implementing complex algorithms, making it ideal for enthusiasts seeking to embark on innovative and creative projects. More details on HuskyLens https://wiki.dfrobot.com/HUSKYLENS_V1.0_SKU_SEN0305_SEN0336 |
| 2 | [How to set up the HuskyLens] To quickly understand the functionalities and the usage of the HuskyLens with Smorphi, let’s download the HuskyLens library which allows you to communicate between HuskyLens and Smorphi. Link to download library:(https://codeload.github.com/HuskyLens/HUSKYLENSArduino/zip/master) |
| 3 | [Connect the HuskyLens to Smorphi] Follow the section/page number 49 and page number 50 of the Smorphi user manual for connecting your HuskyLens with the Smorphi. |
| 4 | [Exercise, inbuilt face recognition] Let’s make HuskyLens for face recognition. This feature of HuskyLens can detect any face contour, recognize and track the learned face. Direct the HuskyLens towards any face. Upon detection, the face will be enclosed by a white frame on the screen, accompanied by the label 'Face.' Position the '+' symbol over the detected face and short press the 'learning button' to learn it. Once trained, if the HuskyLens subsequently detects the same face, it will be enclosed by a blue frame bearing the label 'Face: ID1,' signifying successful recognition. For more details please refer Section 7.1 Face Recognition in https://wiki.dfrobot.com/HUSKYLENS_V1.0_SKU_SEN0305_SEN0336#target_15 Now if the learned face is detected by HuskyLens, it will recognise the ID of it. The ID of the recognized face along with other details such as the location and the size of the bounding box can be communicated with Smorphi through serial communication. |
| 5 | Below is an example code for operating the robot using the face recognition feature of HuskyLens. You can upload the following code to Smorphi to test it out. Start with Smorphi configured to any shape other than an 'O' shape. When the recognized individual faces towards HuskyLens, Smorphi reconfigures into an 'O' shape from its current shape. For other individuals, Smorphi's shape remains unchanged. The sample code to perform the above action could be found here |
| 6 | [Further exploration] There are many more things you can do with HuskyLens, such as object detection, classification, tag recognition, and object tracking. You can explore more about these features here: https://wiki.dfrobot.com/HUSKYLENS_V1.0_SKU_SEN0305_SEN0336 |