Research Scientist (New York) Job at Patronus AI, Inc., New York, NY

QTYreEtkVythcmxjUkd6YlVWcndJcGVHdnc9PQ==
  • Patronus AI, Inc.
  • New York, NY

Job Description

Note: We have a preference for candidates that are able to work out of NYC or SF for this role!

About Patronus AI

Patronus AI’s mission is to provide the security and risk management layer for AI. We are solving the problem of scalable oversight - how can humans continue to supervise AI systems when AI far outperforms them in many real world scenarios? Our vision is a world in which AI evaluates AI. Our founding team comes from top applied ML and research backgrounds, including Facebook AI Research (FAIR), Airbnb, Meta Reality Labs, and quant finance. As a team, we have published research papers at top ML conferences (NeurIPS, EMNLP, ACL), designed and launched Airbnb’s first conversational AI assistant, pioneered causal inference at Meta Reality Labs, exited a quant hedge fund backed by Mark Cuban, and scaled 0→1 products at high growth startups. We are backed by Lightspeed Venture Partners and high profile operators like Amjad Masad, Gokul Rajaram, and Fortune 500 executives and board members.

  • Competitive salary and equity packages
  • Health, dental, and vision insurance plans
  • 401(k) plan
  • Unlimited PTO
  • Fun global offsites!

Responsibilities

As a Research Scientist at Patronus AI, you will be pivotal to solving the most important and challenging open research problems facing society’s adoption of AI today, surrounding AI evaluation, language model understanding and robustness challenges.

In this role, you will:

  • Develop state-of-the-art systems for AI evaluation. Implement algorithms and models based on state-of-the-art NLP advancements, especially in the areas of evaluation and LLM alignment.
  • Conduct novel research on redteaming language models, automated evaluation and alignment.
  • Scope out and lead research projects, including experiment design, timelines for research deliverables, understanding results.
  • Develop processes for high quality research, including dataset collection, model training, benchmarking and inference.
  • Experiment with latest technologies and proactively suggest experiments and improvements to research and ML systems.
  • Assist in the construction of high quality, novel datasets for classification and generative tasks, through synthetic data augmentation techniques and publicly available datasets.
  • Contribute to research to production efforts that advance product offerings.
  • Collaborate closely with product and engineering in our globally-based team.

Qualifications

Above all, we look for a proactive mindset, willingness to learn, relentless drive, and passion for working hands-on with customers. You are a great fit if you have a background in the following:

  • Publications at leading AI conferences, journals or workshops, such as NeurIPS, ICML, EMNLP, ACL, AAAI.
  • Experience conducting empirical NLP research in an academic or industry research lab.
  • Knowledge and understanding of state-of-the-art machine learning concepts, with a focus on NLP. Familiarity with transformer-based architectures, attention mechanisms, evaluation metrics and benchmarks.
  • Experience training language models in applied or research settings.
  • Experience working and communicating cross functionally in a team environment.
  • Creativity in problem solving and strong communication skills.
  • Have good character, integrity and respect for others.

Patronus AI is an equal opportunity employer. We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected characteristics.

#J-18808-Ljbffr

Job Tags

Full time,

Similar Jobs

Housekeeper.com

URGENT: Housekeeper Wanted - Experienced Housekeeper Needed In Bowling Green, Ky $18/Hour Job at Housekeeper.com

 ...looking for a trustworthy and detail-oriented cleaning lady to help keep my one-bedroom apartment tidy. I live on the ground floor...  ...housekeeper to help maintain our home in pristine condition. No prior experience necessary, but a positive attitude and reliability are a must.... 

Capital One Careers

Principal Associate, Executive Protection Specialist Job at Capital One Careers

Principal Associate, Executive Protection SpecialistCapital Ones Global Workplace Services...  ...Basic QualificationsAssociates Degree or Military experienceAt least two years...  ...employment qualified applicants with a criminal history in a manner consistent with the... 

PTR Global

User Experience Designer Job at PTR Global

 ...flows, mockups, use cases, and prototypes. Advocate for end users by collaborating with product owners and business stakeholders....  ...strategies aligned with project goals and KPIs. Create usability test plans, interview scripts, and scenarios for testing prototypes.... 

Rock Harbor Church FL

Youth Ministry Director / Pastor Job at Rock Harbor Church FL

 ...Job Description Job Description Youth Ministry Director/Pastor Full-time - $45,000 to $65,000 Rock Harbor Church is seeking a passionate and dedicated Youth Ministry Director/Pastor to lead and develop our vibrant youth ministry. This role will involve creating... 

Senior Helpers - Elmwood Park, IL

Live-In Caregivers Needed - $230/Day to Start + Free Room & Board! Job at Senior Helpers - Elmwood Park, IL

 ...check* CNA or HHA certification a plus, but not required Compensation & Benefits:* Daily pay starting $230/day* Free room and board while on assignment* Flexible live-in shift schedules (2 to 7 days available)* Long-term and consistent assignments*...