Job Details

Compensation: $90 - $180/ hr

Overview

Huzzle Labs is seeking experienced software engineers to review enterprise slide content and rate it for substance and style. You will read business and technical presentations such as architecture reviews, product decks and engineering updates, and judge how accurate, clear and well argued they are. Your judgement builds the reference data used to evaluate frontier AI systems.

The engagement starts with a short screening task in which you rate enterprise slides for content and style. Depending on your screener performance, you may be invited to take part in ongoing campaign tasks.

This is an expert judgement role focused on careful reading, precise rating and consistent documentation.

Key Responsibilities

• Rate slides: Score enterprise slides and decks for content (technical accuracy, insight, logic, fit for the audience) and style (structure, clarity, visual communication, polish).
• Judge technical substance: Assess whether architecture, trade-off and delivery claims are correct and clearly explained to the intended audience.
• Explain your ratings: Write short, precise rationales that a peer reviewer could follow.
• Apply guidelines consistently: Follow the rating rubric, flag ambiguous cases and help refine the criteria.
• Deliver on time: Work in batches and meet turnaround targets.

Ideal Qualifications

• Experience as a software engineer at a top technology company.
• An undergraduate degree from a well-known English-speaking university: top 100 in the US News Best Global Universities rankings (English-speaking countries only), or top 300 in the US News US college rankings.
• At least 1 year of professional work experience, with part of that employment within the past 7 years.
• Fluent written English and a strong sense of what good business communication looks like.
• Careful and detail-oriented: consistent ratings and clear written rationales.
• Nice to have: experience building or reviewing executive-ready presentations; prior annotation, rating or QA experience.

About Huzzle Labs

Huzzle Labs partners with leading AI organisations to evaluate and improve frontier models through deep human expertise. Contributors assess advanced AI systems in their specialist fields, receive competitive compensation, and help define the standards used to measure model performance.

Confidentiality: An NDA must be signed before the engagement begins.