B.4 ‐ Robotic Process Automation Online Workshop ‐ Build and use AI models to enhance user experience in workflows - dcasota/m365-scripts GitHub Wiki
This is mainly the content from https://learn.microsoft.com/en-us/training/modules/add-ai-model-process-invoice-online-workshop/exercise.
-
Open a new web browser and then go to https://make.powerautomate.com. Sign in if needed and then make sure that you're in the correct environment.
-
In the left navigation pane, select AI hub, then select AI models near the middle of the screen.
- Start the AI Builder trial.
- From the models section, select the Document Processing model. The model should also say Extract custom information from documents. If your model results are filtered by Most popular, then it's the second result.
- From the Extract custom information from documents dialog, select the Create custom model button located in the lower-right corner.
- Select the pencil icon to the left of the model name to begin editing. In the Model name field, name the model as Enter invoice information AI model. Select the Rename button. Then, select Fixed template documents and then select Next.
- Create four fields for your AI model. Select the dropdown menu next to the + Add button and then select the Text field option. Within the Text field dialog, in the Name field, enter Bill to. Select Done.
- Repeat these steps until you add the following four fields. Keep in mind that you already added the Bill to field.
Bill to Contact Date Total
-
After you add all four fields, select the Next button in the lower part of the screen.
-
Collections allow for the grouping of documents for a particular organizer, customer, or counterparty. Create a collection for Contoso by selecting the New collection button.
- Select Collection 1 and then rename it to Contoso Coffee Shop.
- Select the plus (+) sign in the center of the collection and then select the Add documents button to upload your sample PDF files from the module resources folder. For this exercise, upload the files from local storage/source. Select the following documents from your local storage by locating them within the file you saved and then holding the Ctrl key and selecting them. Then, select Open. (You can find the documents under the AutomationIAD-Learn-student-files folder, then the files are under Lab #6 Training data for AI Builder). Locate and ensure that the five PDF files that are used for this training are selected. Then, select the Upload 5 documents button located in the lower part of the Upload documents dialog.
Contoso_INVOICE_(Fabrikam_UK).pdf Contoso_INVOICE_(Litware_CAN).pdf Contoso_INVOICE_(Proseware_NY).pdf Contoso_INVOICE_(TailSpin).pdf Contoso_INVOICE_(WingTip).pdf
After the documents are uploaded, a success message appears, similar to the one in the following figure. Select Done to continue.
- In the Add documents dialog, select the Next button.
- After the system finishes the loading process, you need to tag your documents. Tag the documents one by one, to the correct value of the corresponding fields so that you can teach AI Builder how to extract values from this form example.
Ensure that you're currently viewing the first document. By using a drag-to-highlight method, highlight the Bill to contact within the document (don't include "Bill to" in your highlight, only highlight the contact). After you highlight the contact in the document, a menu with field options will appear.
Select the Bill to field option from the menu. The system should tag the document information to the Bill to field within the list to the right of the screen. A green check mark appears to confirm the tag.
- Use the same process to highlight the Contact information within the first document. Then, from the field menu that appears, select the Contact field. A green check mark appears in the list to signify that the tag is made within this document.
- Repeat the previous steps to tag the Date and Total information from the first document to the proper field. In the upper part of the screen, the first document shows as shaded with a blue color. This shading indicates that all possible tags within this document are made. Your screen should resemble the following figure.
- In the upper portion of your screen, use the arrows to switch to the next document. Repeat the same process to tag the correct information within the document to the proper field. Repeat this step for the remaining documents until all five documents show as shaded in blue, indicating that all possible tags are made within each document. After you finish making all possible tags within the five documents, select the Next button located in the lower left of the screen.
-
Now, you're ready to train your AI Builder model. To do so, select the Train button located in the lower left of the screen. This process might take a few minutes to complete. A window appears while the model is training. Select the Go to models button. After the AI Builder model training is complete, the status changes to trained. Select the title of the model to gain access to more options. Here you can publish your AI Builder model by selecting Publish.
-
Now you have an AI Builder model trained and published. Next, you use this AI Builder model that you trained in your automation. From the menu to the left of the screen, select Solutions and then open Invoice processing solution.
- Select Add existing and then select AI Model.
- Select the model that you created and then select Add.
- Unfortunately, in the tutorial Step 34 content from https://learn.microsoft.com/en-us/training/modules/add-ai-model-process-invoice-online-workshop/exercise the login again does not work anymore. Hence, again I wasn't able to finish the exercise.