Arduino Sign Language (ASL) - cmubuild18/Build18 GitHub Wiki

Arduino Sign Language (ASL)

Ever wanted to be able to convert someone signing in ASL to characters. With Arduino Sign Language, you can!

Thumbnail Image

This project allows for people who do not understand American Sign Language themselves to read what someone who is signing is trying to say. The project consists of a glove with multiple sensors on it to detect the different positions of the hand along with the movement that it is doing. Flex resistors were attached to each finger and could sense how curled the finger is. An IMU (gyroscope/accelerometer) was connected to the top of the palm to detect movement. The data was collected for each letter into a CSV file then fed into a TensorFlow neural net as training. The model was exported after training then it was used to predict the new data from the sensors when actually using the project. The model was able to achieve around 90% accuracy in validation data.

Team Members

Team Member Photo
Andrew Cuonzo Team Member Photo
Liam Merino Team Member Photo
Sebastian Garcia Team Member Photo

Photos

https://drive.google.com/drive/folders/1yURA90kojs_yMYNYlWWKNF3bI4FhsVfs?usp=sharing

Parts

Part Unit Price Quantity Cost Needs to be Orderedthrough Build18? (Y/N) Part Link
Arduino Uno - R5 Wifi $27.50 2 $55.00 Y https://www.sparkfun.com/products/22632
Arduino Gyroscope and Accelerometer- MPU6050 $3.33 12 $39.96 Y https://www.amazon.com/dp/B00LP25V1A?ref_=cm_sw_r_apin_dp_PVG6FHB4BSPV2DZVZP1Z&language=en-US
Flex sensor $11.95 15 $179.25 Y https://www.sparkfun.com/products/10264?_gl=1*1hr3u21*_ga*NDU4NzQ2MTE1LjE3MDA2MTI1Nzc.*_ga_T369JS7J9N*MTcwMDYxMjU3Ni4xLjEuMTcwMDYxMjY5MS42MC4wLjA.&_ga=2.30924221.364886163.1700612577-458746115.1700612577
Cotton gloves $10.00 2 $20.00 Y https://www.amazon.com/10pairs-Washable-Stretch-Moisturizing-Inspection/dp/B08NB72PRT/ref=sr_1_6?crid=2VNPHC5BMS3P&keywords=cotton%2Bgloves&qid=1700613276&sprefix=cotton%2Bgloves%2Caps%2C90&sr=8-6&th=1
Hot glue gun $7.99 1 $7.99 Y https://www.amazon.com/Assark-Sticks-School-Repairs-20W/dp/B09FYWQ44L
USB C-C $13.99 1 13.99 Y https://www.amazon.com/Anker-Charging-MacBook-Galaxy-Charger/dp/B088NRLMPV/ref=sr_1_3?crid=ZHYA0N3VT97T&keywords=6ft%2Busb%2Bc&qid=1700623279&sprefix=6ft%2Busb%2B%2Caps%2C142&sr=8-3&th=1
USB-C Brick $13 1 $12.99 Y https://www.amazon.com/Charger-4-Port-Charging-Multiport-Samsung/dp/B0C1SK8237/ref=sr_1_6?crid=Y058CA4FFV7A&keywords=usb%2Bc%2Bcharger%2Bblock&qid=1700623340&sprefix=usb%2Bc%2B%2Caps%2C112&sr=8-6&th=1
Total Cost: $274.18
Remaining Budget:(out of $300) $25.82