Join a high-impact Safeguards team focused on reviewing sensitive content, making sound judgment calls, and supporting escalation workflows that help keep people safe. This role is ideal for someone who is detail-oriented, thrives under pressure, and is comfortable working on complex cases that require careful documentation and collaboration across legal, policy, and threat intelligence teams.

Preferred location: San Francisco, CA

Responsibilities

• Review user content and interactions to assess potential policy violations, with particular attention to violent exchanges and threats of harm
• Determine whether cases meet established criteria for referral to law enforcement or the National Center for Missing & Exploited Children (NCMEC)
• Document case details, rationale, and decision-making in a clear and thorough way that can support internal and external review
• Apply escalation workflows carefully, flagging uncertain or ambiguous cases for additional review when needed
• Support broader enforcement efforts by reviewing customer signals and user exchanges across multiple policy areas as priorities shift
• Partner with legal, policy, strategy, and threat intelligence teams to surface trends, identify risks, and improve processes
• Contribute to post-incident reviews, operational improvements, and refinements to referral criteria and detection workflows
• Respond to customer communications and appeals related to enforcement decisions in a professional and timely manner

Skills

• Experience making careful, defensible judgments in high-stakes situations
• Ability to work with disturbing or sensitive material in a steady, professional manner
• Strong written and verbal communication skills, especially for documentation that may be reviewed externally
• Excellent attention to detail and a structured approach to complex work
• Comfort working independently while knowing when to escalate appropriately
• Ability to adapt quickly in a changing environment and learn new workflows rapidly
• Strong time management skills and the ability to meet deadlines under pressure
• Genuine interest in AI safety, responsible technology, and ethical decision-making

Preferred Skills

• Experience with law enforcement referrals, mandatory reporting, or similar escalation processes
• Background in trust and safety, content moderation, investigations, or reviewing violent or harmful content
• Experience in threat assessment, crisis response, intelligence analysis, or a related field
• Familiarity with policy enforcement in digital platforms and related legal considerations
• Understanding of how user behavior analysis can support risk identification and mitigation
• Experience collaborating across cross-functional teams to improve operations or policy

Horizontal is committed to fostering an inclusive workplace where diverse perspectives are valued, and where equity and respect are central to how we work together. We welcome applicants from all backgrounds and encourage individuals with different experiences and viewpoints to apply.