Overview
Moderation is the core process of analyzing and filtering user-generated content. Pixel Patrol combines AI-powered analysis with rule-based decision making to provide flexible, accurate content moderation.Moderation Flow
Submission Process
Media Types Supported
Images
- JPEG, PNG, GIF
- WebP, AVIF
- Up to 50MB
Videos
- MP4, WebM
- MOV, AVI
- Up to 200MB
Text
- Plain text
- Rich text
- Up to 1MB
Submission Methods
- API Submission: Direct API calls with media URLs
- File Upload: Direct file upload to storage
- Batch Processing: Multiple items in one request
AI Analysis
Detection Categories
Pixel Patrol’s AI analyzes content for:- Violence: Graphic violence, gore, weapons
- Adult Content: Nudity, sexual content
- Hate Speech: Discriminatory content, symbols
- Self-Harm: Content promoting self-injury
- Drugs: Drug use or paraphernalia
- Spam: Repetitive or promotional content
- Custom Labels: Team-specific categories
Confidence Scores
Each detection includes a confidence score (0-1):0.0-0.3
: Low confidence0.3-0.7
: Medium confidence0.7-1.0
: High confidence
Moderation Queue
Queue Management
The moderation queue shows:- Pending items awaiting review
- AI analysis results
- Applied rules and decisions
- Moderation history
Filtering Options
- Status: Pending, Approved, Rejected, Flagged
- Content Type: Image, Video, Text
- Date Range: Custom time periods
- Confidence: Score thresholds
- Labels: Specific AI detections
Manual Review
When Manual Review Occurs
- Items flagged by rules
- Low AI confidence scores
- Content in gray areas
- Random sampling for quality
Review Actions
Moderators can:- Approve: Allow the content
- Reject: Block the content
- Escalate: Send to senior moderator
- Re-moderate: Trigger new AI analysis
Moderation Results
Result Structure
Webhook Notifications
Results are sent to configured webhooks:Performance Metrics
Key Metrics
- Processing Time: Average time from submission to decision
- Accuracy Rate: Correct decisions vs. manual overrides
- False Positive Rate: Safe content incorrectly blocked
- False Negative Rate: Harmful content incorrectly approved
Monitoring Dashboard
Track moderation performance:- Real-time processing stats
- Decision distribution
- Rule effectiveness
- AI accuracy metrics
Best Practices
Optimization Tips
- Rule Tuning: Adjust thresholds based on results
- Regular Reviews: Sample and verify decisions
- Feedback Loop: Learn from manual overrides
- Balance Speed/Accuracy: Configure for your needs
Common Patterns
- Strict First: Start with strict rules, then relax
- Category Focus: Prioritize high-risk content types
- User Trust: Consider user reputation in rules
- Time-Based: Adjust rules for peak periods
Related Concepts
- AI Moderation - AI capabilities in detail
- Rules - Rule configuration
- Queue Management - Using the moderation queue