Job Title

Position: Software Engineering, Data Science, and Systems Design Experts Type: Hourly contract Compensation: $60$100/hour Location: Remote Commitment: 1040 hours/week Role Responsibilities Evaluate LLM-generated responses to software engineering, data science, and systems design questions. Validate technical accuracy by reviewing reasoning, explanations, and generated code. Execute and test code to confirm correctness and expected outputs. Identify logical flaws, inefficiencies, edge cases, and misleading explanations. Assess code quality, readability, algorithmic soundness, and system design choices. Apply structured evaluation frameworks, benchmarks, and taxonomies. Provide clear, actionable annotations to improve AI model performance. Ensure outputs align with real-world engineering best practices and conversational standards. Requirements Strong academic background in computer science or a closely related discipline. Strong professional background in software engineering, data science, or systems design. Strong problem-solving ability and comfort evaluating complex technical reasoning. Excellent written communication skills and attention to detail. Ability to work independently in a fully remote environment. #J-18808-Ljbffr