Final project report - Samhitha1193/ase-project GitHub Wiki

Existing Services/REST API:

There are similar apps like TheMine, IKEA and Amazon shopping which are the used for the advertising of the furniture. Ours is a similar application which scans the marker and displays the furniture on it.

Design:

The following is the proposed Architecture diagram for our project.

Sequence diagram for our project:

Testing:

Implementation:

We have implemented the project using ThingWorx Studio. ThingWorx studio is a latest tool for Augmented Reality which helps the developers to develop AR applications with ease. It helps us to build AR apps irrespective of the platform which provides advantage to the companies to advertise their product. We don’t need to write lengthy lines of code for the implementation using this tool.

The major advantages of using this tool are:

  • Cost reduction
  • Easy to use
  • Platform independent
  • Supports the access on multiple devices.
  • Also enables to build animations.
  • It can be used for IoT data as well.

Procedure:

Create Account on ThingWorx Studio.

Give the default URL in the next page.

Install ThingWorx Studio on laptop.

Now we're ready to use the tool. We need to configure the tool.

Create an AR project

Connect to the server portal.

Add a thingmark.

Configure the AR project.

Place the thingmark.

Import and add 3D object. Here we have used the coffee table as example.

Modelling of the side cabinet:

Modelling of the bed:

Add 2D widgets.Bind them to 3D widgets.This was 3D modelling. It was done using GrabCad libraries and tutorials.

Save, Review and publish to test the application. The following is the preview of the screenshot upon the scanning of the marker.

Code for publish.js: Initialise the variables and the function to connect to the app.

Code for publishing the application:

Css styling code snippets:

Deployment:

We have deployed the application on the phone and were able to display the coffee table in 3D upon scanning of the marker in Augmented Reality. Below are the images taken while implementing the application on phone. The initial screen is for the login.

The following is the first screen after successful login.

This screen shows to scan the code so that the image can be displayed in 3D.

Scanning of the image:

Once the image is scanned, the coffee table is displayed in Augmented Reality.

Upon adjusting the image position using the symbols on the top, it looks like this:

Project Management:

Work completed:

In phase-1 of the project, we have completed the work till displaying the shape of sphere upon scanning of the marker. Since the work was difficult with android native app and to test, we have done the app which is platform independent. It works both on ios and Android. Tasks and responsibility:

  • Samhitha - Code to display object, report (25%) - 30 hours approximately
  • Swati Singh - 3D modelling, front end (25%) - 30 hours approximately
  • Zeenat - Speech to text (25%) - 30 hours approximately
  • Khushal - Speech to text (25%) - 30 hours approximately

Future scope of the project:

This project currently runs on the scan of the marker. It can be modified to scan the real objects which would be in front of the user. We can also extend this project by adding the capabilities like shopping cart, integrating with other apps, showing suggestions to the user based on his preferences etc.

Issues:

One of the major issue which we faced was that the speech to text recognition was easier on android and hence they were working on it. Hence now we have decided upon the development of web app which can be deployed both on android and ios.

Bibliography:

https://www.ptc.com/en/products/augmented-reality/thingworx-studio https://www.youtube.com/watch?v=O0vOJRwSZUU https://developer.thingworx.com/