Validation - sedioben/IoTproject GitHub Wiki
The validation of the living lab iteration was successful, as both hypotheses are completed and no occurrences indicate invalidity.
Hypothesis 1
Use of IoT devices in the incumbent delivery service enables end-to-end delivery experience with replicator effect
Technical Validation of Architecture to identify existing media breaks (Fleisch):
- Feasibility Study:
In a Feasibility Study, the IoT Stack has been analyzed with respect to the fulfillment of the Digital Service through the layers of Analytics, Connectivity, Sensors / Actuators and Physical Things. In that context, no layer was identified to provide inconsistency towards the fulfillment of the service. The sensors and actuators as well as its communication behavior outline integrated environment enabling the replicator effect through IoT devices.
Survey of Test Lab participants:
- NPS Survey:
After showing the service of Come'N'Eat to ten participants in our Smart Living Lab, the total net promoter score was 9.0. The likeliness of fulfilling the food replicator value proposition with 9 Promoters and 1 Passive.
Hypothesis 1 is fulfilled
Hypothesis 2
Voice Assistant coordinates deliverer for meal placement and leaving the flat
Number of successful meal placement by test deliverer
Throughout the living lab process, ten test runs took place, trying to make a meal placement in our test mock setup department. The interaction for meal placement was always successful.
NPS of Test Deliverer
- NPS Survey:
After showing the service of Come'N'Eat to ten participants in our Smart Living Lab, the total net promoter score was 9.0. The likeliness of being able to deliver meals to the customer's tables has been rated with always a high likeliness.
Qualitative Evaluation of Dialogues
- Analyzing conversation without successful outcome by means of dead ends.
Even though the living lab test run by deliverers has been 100 percent successful, within the tests, a few occurrences took place, where Alexa did not fully understand the request. In that case, she offered alternative requests, that lead to the successful placement of meals.