← All Jobs
Posted Jul 18, 2025

AI Research Scientist - Evaluation, Handshake AI

Apply Now ✨

Your impact

Handshake is building the future of human data for AI.

We partner directly with top AI labs to power large language model (LLM) training and evaluation with high-quality, expert-generated data. As AI models become more sophisticated, the demand for specialized human input continues to grow—and Handshake is uniquely positioned to meet it. We power career platforms at 92% of the top U.S. universities, giving us direct access to verified expert talent across a wide range of domains.

Our AI team is rapidly building a new generation of human data products—from expert annotation platforms to AI interviewers and seamless payout infrastructure—all designed to accelerate research and improve model performance.

We’ve assembled a world-class team from YC, Notion, Scale, Coinbase, Palantir, and more, and we’re working directly with many of the world’s leading AI research labs. This is a unique opportunity to join a fast-growing team shaping the future of AI through better data, better tools, and better systems—for experts, by experts.

We’re seeking Research Scientists to join our Handshake AI Research team, where you’ll conduct pioneering research that pushes the boundaries of LLM understanding and evaluation. You’ll work at the frontiers of model comprehension, advanced evaluation methodologies, and the intersection of human and AI knowledge systems, with the goal of building the future of how we understand and measure AI capabilities.

As a Research Scientist, you’ll collaborate closely with engineers and cross-functional teams to transform fundamental insights into breakthrough evaluation frameworks and understanding paradigms. Whether you’re developing novel approaches to probe model understanding, creating sophisticated benchmarks that reveal emergent capabilities, or establishing new methodologies for measuring AI-human knowledge alignment; you’ll help define how we comprehend and assess the next generation of AI systems.

Location: San Francisco or New York City

Your role

Your experience

Nice to Have

Why Join Us

What we offer

At Handshake, we'll give you the tools to feel healthy, happy and secure.

Benefits below apply to US employees in full-time positions.

Looking for more? Explore our mission, values and comprehensive US benefits at joinhandshake.com/careers.

Handshake is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or reasonable accommodation, please let your recruiter know during initial communications.

Apply Now