The Text Conversation Rewards system is a sophisticated UbiquityOS Plugin that revolutionizes open source collaboration by implementing an AI-powered reward mechanism for quality contributions. Let’s dive deep into its technical architecture and understand how it works under the hood.

Core Architecture

The system is built on a modular architecture with several key components that work together to evaluate, incentivize, and reward contributions:

Content Evaluation Engine

At the heart of the system is a sophisticated content evaluation module that leverages OpenAI’s GPT-4o model to analyze the quality of contributions. Here’s how it works:

1. The system processes both issue comments and pull request review comments through different evaluation pipelines.

2. For issue comments, it generates a context-aware prompt that includes:

   • The original issue description
   • All comments in the conversation for context
   • The specific comments being evaluated

3. The evaluation process handles GitHub-flavored markdown intelligently:

   • It distinguishes between quoted text (starting with ‘>’) and original content
   • Only evaluates the commenter’s original contributions
   • Considers the relationship between comments and their context

4. The AI model assigns relevance scores from 0 to 1:

   interface Relevances {
     [commentId: string]: number; // 0 = irrelevant, 1 = highly relevant}
   

Review Incentivization System

The review incentivization module implements a sophisticated algorithm for rewarding code reviews:

interface ReviewScore {
  reviewId: number;  effect: {
    addition: number;    deletion: number;  };  reward: number;  priority: number;}

The system calculates rewards based on:

1. The scope of code reviewed (additions + deletions)
2. Issue priority labels
3. The conclusiveness of the review (APPROVED or CHANGES_REQUESTED states receive additional credit)
4. File-specific exclusions through pattern matching

Permit Generation and Reward Distribution

The permit generation module handles the secure distribution of rewards:

1. Security Checks:

   • Validates that the issue is collaborative

   • Verifies private key permissions against organization and repository IDs

   • Implements a multi-format encryption system for private keys:

     Format 1: PRIVATE_KEY:GITHUB_OWNER_ID
     Format 2: PRIVATE_KEY:GITHUB_OWNER_ID:GITHUB_REPOSITORY_ID
     

2. Fee Processing:

   • Automatically calculates and deducts platform fees
   • Supports token-specific fee exemptions through whitelist
   • Creates treasury allocations for fee distribution

3. Reward Distribution:

   • Generates ERC20 token permits for each contributor
   • Stores permit data securely in a Supabase database
   • Creates claimable reward URLs in the format: https://pay.ubq.fi?claim=[encoded_permit]

Technical Implementation Details