System function - GP-sketch2CAD/App GitHub Wiki

System function

Number recognition

We made the model CNN and the dataset used MNIST data and the data we drew ourselves. When a user draws a picture on an app, the app determines whether the picture is a number or a picture using a model. If the app determines that it is a number, it recognizes the number and enters a value. If it is judged to be a picture due to low accuracy, the picture is corrected and drawn.

Correction

Each painting is stacked on a stack. First of all, all the pictures are stacked on the objstack and each is stacked on the number stack, wall stack, etc. So we can easily find the picture and correlate it with each other to correct it. Even if the actual user draws a little apart, we calculate the association with the side coordinates as shown in the drawing and correct it so that it is drawn. Also, it is not easy to draw neatly like a user drew with a ruler. Therefore, even if the user does not draw it accurately, it corrects it as if it was drawn with a ruler.

Architecture recognition

The system can distinguish between structures drawn by the user. When drawing a drawing, there are various things such as doors, walls, and windows. The user can distinguish the structure by drawing the door as a triangle, the wall as a square, and the window as a shaded square.

Export

There is a function that converts the drawing, which is the most important function in this system, into a CAD file. When the user presses the export button, the system sends the drawn information to the server to automatically generate the CAD file. The user can receive a CAD file.