Conversation,Agent,Queue,Metric,John Doe Score,Jane Doe Comment,John Doe Score,Jane Doe Comment,AutoQA,AutoQA Justification,Consensus,Agreement %
c-ec8ed120-6d93-57f4-97ef-25a9c505c482,,,Bot Confirmation,N/A,,Not Adhered,,Adhered,The agent clearly confirms that the flight has been successfully booked and states that an email will be sent shortly. This directly fulfills the requirement to confirm both the booking completion and the email notification to the customer.,No Consensus,
c-ec8ed120-6d93-57f4-97ef-25a9c505c482,,,Bot Greetings,Adhered,,Not Adhered,,Adhered,,No Consensus,
c-ec8ed120-6d93-57f4-97ef-25a9c505c482,,,V2 By Question - Base rate,N/A,,N/A,,N/A,"The customer did not request any information related to current interest rates during the evaluated turns. Since the triggering condition was never met, the rule is not applicable in this conversation and cannot be assessed for adherence.",N/A,100
c-ec8ed120-6d93-57f4-97ef-25a9c505c482,,,V2 Question - Bot Interaction,Adhered,,Adhered,,Adhered,"The customer provided source, destination, and travel dates, fulfilling the condition of a flight booking request with itinerary details. The agent subsequently confirmed that the flight had been successfully booked and informed the customer about receiving an email, which satisfies the expected confirmation behavior.",Adhered,100
c-ec8ed120-6d93-57f4-97ef-25a9c505c482,,,V2 By Question - Flight booking,Adhered,,Not Adhered,,N/A,"The customer provided the destination and travel dates; however, there is no indication that flight search results were presented or confirmed as available. Since all triggering conditions were not clearly satisfied, the rule is considered not applicable for evaluation.",No Consensus,
c-ec8ed120-6d93-57f4-97ef-25a9c505c482,,,Ask Arrival Place,N/A,,Adhered,,Adhered,The agent asked for the destination which captures the arrival place.,No Consensus,
c-ec8ed120-6d93-57f4-97ef-25a9c505c482,,,Ask Departure Place,N/A,,N/A,,Adhered,The agent asked for the source which captures the departure place.,N/A,100
c-ec8ed120-6d93-57f4-97ef-25a9c505c482,,,Provide Flight Price,N/A,,Not Adhered,,Not Adhered,The agent completed the booking flow but did not provide any flight price in the conversation.,No Consensus,
c-9e217d3a-d40c-5263-ab04-2d46d4ec0738,,,Bot Confirmation,Adhered,,N/A,,Adhered,"The assistant clearly confirms that the flight has been booked and informs that an email will be received shortly, which fulfills the requirement to confirm both the booking and the sending of an email to the customer.",No Consensus,
c-9e217d3a-d40c-5263-ab04-2d46d4ec0738,,,Bot Greetings,Adhered,,Not Adhered,,Adhered,,No Consensus,
c-9e217d3a-d40c-5263-ab04-2d46d4ec0738,,,V2 By Question - Base rate,Not Adhered,,Not Adhered,,N/A,LLM Call Failure,Not Adhered,100
c-9e217d3a-d40c-5263-ab04-2d46d4ec0738,,,V2 Question - Bot Interaction,Not Adhered,,Not Adhered,,N/A,LLM Call Failure,Not Adhered,100
c-9e217d3a-d40c-5263-ab04-2d46d4ec0738,,,V2 By Question - Flight booking,Not Adhered,,Not Adhered,,N/A,LLM Call Failure,Not Adhered,100
c-9e217d3a-d40c-5263-ab04-2d46d4ec0738,,,Ask Arrival Place,Adhered,,Not Adhered,,,Response not found for this subMetric,No Consensus,
c-9e217d3a-d40c-5263-ab04-2d46d4ec0738,,,Ask Departure Place,Not Adhered,,Not Adhered,,,Response not found for this subMetric,Not Adhered,100
c-9e217d3a-d40c-5263-ab04-2d46d4ec0738,,,Provide Flight Price,N/A,,Not Adhered,,,Response not found for this subMetric,No Consensus,