Company: Handshake
Country: United States
Location: Remote
Job Type: Contract
Salary: USD0.00 - USD0.00
The AI Evaluator (Travel Services & Reservations) applies travel services and customer operations expertise to evaluate, validate, and improve AI-generated content related to travel reservations, ticketing, itinerary management, transportation coordination, and customer service interactions. This role ensures AI outputs are accurate, customer-appropriate, and aligned with real-world travel service workflows.
As an AI Evaluator, you will review and assess AI-generated responses, scenarios, and service guidance involving travel bookings, ticketing processes, itinerary changes, and customer support interactions. You will identify booking errors, policy misinterpretations, unrealistic service responses, and workflow gaps, providing structured feedback to improve AI model reliability and service quality in travel-related contexts. Key responsibilities include: - Evaluating AI-generated content related to reservations, ticketing, itinerary management, and travel service support - Validating the accuracy of booking logic, fare rules, change policies, and customer communications - Assessing realism of service scenarios, customer interactions, and problem-resolution approaches - Applying structured evaluation rubrics to score AI outputs and recommend improvements - Flagging customer-impact risks, policy violations, or misleading service guidance - Providing expert feedback to support the continuous improvement of AI performance in travel services
- Professional background in travel services, such as: - Reservation and Transportation Ticket Agent - Travel Clerk - 4+ years of professional experience in travel reservations, ticketing, or customer service operations - Strong understanding of booking systems, fare rules, itinerary management, and travel policies - Experience working in customer-facing travel or transportation service environments - Ability to critically evaluate service-related content and provide clear, structured written feedback - High attention to detail, customer empathy, and service judgment - Comfortable working remotely and reviewing written, scenario-based, or conversational content Preferred (but not required): - Experience handling complex itineraries, rebookings, or service disruptions - Familiarity with travel regulations, refund policies, or vendor coordination - Exposure to training, QA, or customer service evaluations - Interest in AI, automation, or digital customer service tools Compensation Per completed evaluation task (rate may vary based on task scope and complexity)
Application Deadline: 30 May, 2026
Job Status:
Submit Application