Increment 2 - Samhitha1193/ase-project GitHub Wiki
Existing Services/REST API:
There are similar apps like TheMine, IKEA and Amazon shopping which are the used for the advertising of the furniture. Ours is a similar application which scans the marker and displays the furniture on it. We are also planning to use the speech to text recognition in our project which would help the disabled people as well.
Design:
The following is the proposed Architecture diagram for our project.
Sequence diagram for our project:
Testing:
Implementation:
We have implemented the project using ThingWorx Studio. ThingWorx studio is a latest tool for Augmented Reality which helps the developers to develop AR applications with ease. It helps us to build AR apps irrespective of the platform which provides advantage to the companies to advertise their product. We don’t need to write lengthy lines of code for the implementation using this tool.
The major advantages of using this tool are:
- Cost reduction
- Easy to use
- Platform independent
- Supports the access on multiple devices.
- Also enables to build animations.
- It can be used for IoT data as well.
Procedure:
Create Account on ThingWorx Studio.
Give the default URL in the next page.
Install ThingWorx Studio on laptop.
Now we're ready to use the tool. We need to configure the tool.
Create an AR project
Connect to the server portal.
Add a thingmark.
Configure the AR project.
Place the thingmark.
Import and add 3D object. Here we have used the coffee table as example.
Add 2D widgets.Bind them to 3D widgets.This was 3D modelling. It was done using GrabCad libraries and tutorials.
Save, Review and publish to test the application. The following is the preview of the screenshot upon the scanning of the marker.
Code for publish.js: Initialise the variables and the function to connect to the app.
Code for publishing the application:
Css styling code snippets:
Deployment:
We have deployed the application on the phone and were able to display the coffee table in 3D upon scanning of the marker in Augmented Reality. Below are the images taken while implementing the application on phone. The initial screen is for the login.
The following is the first screen after successful login.
This screen shows to scan the code so that the image can be displayed in 3D.
Scanning of the image:
Once the image is scanned, the coffee table is displayed in Augmented Reality.
Upon adjusting the image position using the symbols on the top, it looks like this:
Project Management:
Work completed:
In phase-1 of the project, we have completed the work till displaying the shape of sphere upon scanning of the marker. Since the work was difficult with android native app and to test, we have done the app which is platform independent. It works both on ios and Android. Tasks and responsibility: Samhitha - Code to display object, report (25%) - 30 hours approximately Swati Singh - 3D modelling, front end (25%) - 30 hours approximately Zeenat - Speech to text (25%) - 30 hours approximately Khushal - Speech to text (25%) - 30 hours approximately
Work to be completed:
80% of the project is already completed. We would be mostly working on the display of more furniture objects in Augmented Reality and to improvise the front end.
Tasks and responsibility: Swati Singh - Code to display object, report - 30 hours approximately Samhitha Tummanapalli - 3D modelling, front end - 30 hours approximately Zeenat - Speech to text - 30 hours approximately Khushal - Speech to text - 30 hours approximately
Issues:
One of the major issue which we faced was that the speech to text recognition was easier on android and hence they were working on it. Hence now we have decided upon the development of web app which can be deployed both on android and ios.
Bibliography:
https://www.ptc.com/en/products/augmented-reality/thingworx-studio https://www.youtube.com/watch?v=O0vOJRwSZUU https://developer.thingworx.com/