Skip to content

Latest commit

 

History

History

README.md

User Guide

Protect your users from harm with remarkable ease.

Overview

Coop is the open source review and moderation tool from ROOST that provides a comprehensive solution for online safety:

  • Automated Enforcement: Customizable multi-condition rules that evaluate every submitted item against signals to automatically take action or route reports to a human review queue based on your policies

    Rules Scam Rule
    Policies Text bank
  • Review Console: Configurable human review queues for moderators to quickly make complex policy-based moderation decisions, with added context and wellness features built-in

    Review Console Job page
    Review Console settings Wellness settings
  • Integrations & Rich Content Processing: Support for reviewing and matching against text content and threads, images and video media, account data, and custom content types using built-in signals plus free safety APIs from Google, OpenAI, Zentropi, and NCMEC out of the box

    Integrations Items
    NCMEC job HMA routing
  • Metrics & Reporting: Dashboards and detailed audit logs for accountability and insights into moderation effectiveness and trends

    Dashboard Recent decisions
  • API Integration: Simple REST and webhook APIs power seamless bidirectional platform integration for content ingestion, user reports, appeals, performing moderation actions, fetching additional items, and more

    Action API keys
  • So much more. Coop supports NCMEC reporting, hash matching, user strikes, appeals, investigation, bulk actioning, powerful user/role management, location-based enforcement, and single sign-on to name a few. And as an open source project with custom integration support, the potential for adaptability is limitless.

How Coop works

This simplified diagram can help you better understand how data flows between a platform and Coop:

Simple Diagram

For more detail, review the basic concepts, technical architecture, and API reference.

Getting started as an admin

We recommend beginning by familiarizing yourself with Coop's basic concepts. Once you're up to speed:

  1. Ensure you have an account and API key for your Coop instance

  2. Define your Item Types; the kinds of content and actors on your platform

  3. Input your detailed platform Policies

  4. Define your Actions and expose callback endpoints so Coop can trigger enforcement on your platform

Once Coop is configured, your platform can:

  1. Begin submitting items to Coop via the Items API so they run through your proactive rules

  2. Submit user reports via the Report API to route them into review queues for your moderators

<style> .content img { margin-block: 0.5em; border: 0.5em solid color-mix(var(--bg) 80%, white); box-shadow: 0 0.25em 0.5em 0.25em rgba(0 0 0 / 0.1 ); box-sizing: border-box; } .content table, .content table thead, .content table thead tr, .content table thead th, .content table tbody tr, .content table tbody tr td { background: none !important; border: none !important; padding: 0 0.5em; } </style>