Release 2 Documentation - CSC4790-Fall2024-Org/Grocery-Receipt-App GitHub Wiki

1. Velocity

In the past 3 sprints, we have been working at approximately one large task per sprint, along with a small UI upgrade each sprint as well. The integration and setup of Textract was a large task and was completed in one sprint. Next was our integration of the Gemini AI and, associated with it making the returned items click and sortable. In each of these sprints we have also been working on UI upgrades, but nothing with a bigger size than a small.

Our project is using the Gemini AI to help sort the data that comes in from Textract. We are prompting it to split the string of extracted data into individual items, their price, and any associated discount. This is a really big step in our process, because any hard-coded analysis of the receipt is almost impossible. Every store formats their receipts in a different way, so the AI is the best way to account for the different Textract outputs.
Two challenges is that we are having is that AI always produces slightly different results, and it sometimes does not run correctly. We are spending a lot of time developing the prompt we need which produces the most consistent results. The format of the AI output and the accuracy of its results can fluctuate, so we are working on making our prompt as clear as possible.
The other challenge we are working through is that sometimes the app glitches and when it advances to the page where the results should be shown it is blank. We then click back to the home page and press "analyze" again, and the second time the results will appear. We are still workshopping how too fix this issue, but it is not a major priority because the app still runs how we want it to most of the time.