LLM Benchmarking AI Jobs

Gather facts on site specs, counterparty structure, commercial terms, and timing; prepare the structure review and term-sheet input for the. Lead's sign-off early enough to shape the deal.

Contract management and templates. Own the commercial redline for HDO and R&D services agreements (MSAs, SOWs, order forms, amendments, and renewals), partnering with Legal on legal terms, so deals move quickly while maintaining negotiation posture.

Prototype rapidly to find define the AI frontier for cybersecurity work Design evaluations that measure model performance on the work security teams actually do.

Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

Gather facts on site specs, counterparty structure, review and own commercial contracting for tax clauses; provide structure review and term-sheet input early enough to shape the deal.

Lead, coach, and grow a high-performing team of AI and software engineers, developing them into strong technical leaders while fostering a culture of ownership, technical excellence, experimentation, and continuous learning.

Establish clear, reusable evaluation criteria that reflect real user expectations—helpfulness, trust, tone, control, and transparency. You’ll translate qualitative insight into scoring guidance that can be applied consistently across teams and over time.

Own the strategy and roadmap for price benchmarks and contract intelligence, turning Ramp's aggregated spend and contract dataset into the most accurate price benchmarking product on the market.