Company: Handshake
Country: United States
Location: Remote
Job Type: Contract
Salary: USD0.00 - USD0.00
The AI Evaluator (Manufacturing & Production Operations) applies real-world manufacturing and operations expertise to evaluate, validate, and improve AI-generated content related to production planning, logistics, workflow optimization, inventory control, and operational decision-making. This role ensures AI outputs are accurate, practical, and aligned with real manufacturing environments.
As an AI Evaluator, you will review and assess AI-generated responses, scenarios, and analyses involving manufacturing operations, production scheduling, supply chain coordination, and operational efficiency. You will identify planning gaps, logistical inconsistencies, unrealistic assumptions, and process inefficiencies, providing structured feedback to improve AI model performance and usefulness in manufacturing contexts. Key responsibilities include: - Evaluating AI-generated content related to production planning, expediting, logistics, and manufacturing operations - Validating accuracy of workflows, scheduling logic, inventory assumptions, and resource utilization - Assessing the realism of manufacturing scenarios, throughput expectations, and operational constraints - Applying structured evaluation rubrics to score AI outputs and recommend improvements - Flagging operational risks, inefficiencies, or misleading production guidance - Providing expert feedback to support the continuous improvement of AI performance in manufacturing settings
- Professional background in manufacturing or operations, such as: - Production, Planning, and Expediting Clerk - Logistician - Industrial Production Manager - 4+ years of professional experience in manufacturing operations, production planning, logistics, or plant management - Strong understanding of manufacturing workflows, scheduling, inventory control, and operational coordination - Experience working in plant, factory, or production-focused environments - Ability to critically evaluate operational and analytical content and provide clear, structured written feedback - High attention to detail, process discipline, and operational judgment - Comfortable working remotely and reviewing written, scenario-based, or analytical content Preferred (but not required): - Experience with lean manufacturing, continuous improvement, or production metrics - Familiarity with ERP, MRP, or supply chain planning tools - Exposure to audits, process documentation, or operations reviews - Interest in AI, automation, or digital transformation in manufacturing Compensation Per completed evaluation task (rate may vary based on scope and complexity)
Application Deadline: 01 May, 2026
Job Status:
Submit Application