How We Ensure High-Quality Participants

At MobLab Research, data quality is our top priority. We maintain a high-quality participant pool through our comprehensive reputation and credit system, which tracks participant behavior, rewards quality contributions, and ensures you receive authentic, reliable data.

Our Participant Reputation System

Every participant in our pool has a reputation profile that determines their access to study invitations. This system incentivizes high-quality work and penalizes poor behavior, ensuring you recruit engaged and reliable participants.

Key Metrics We Track

Our system monitors several key performance indicators for each participant:

• Approval Rate: The percentage of submissions that have been approved by researchers. Participants with low approval rates receive fewer study invitations.
• Show-Up Rate: For LIVE studies, we track attendance records. Participants who fail to show up for reserved sessions see reduced access to future live studies.
• Completion Rate: We monitor whether participants complete studies within the required timeframe or time out before submission.
• Badge Status: Participants can earn or lose badges based on their behavior (detailed below).

The Badge System

We award badges to recognize quality and reliability. These badges are visible to participants and directly impact their eligibility for studies.

1. Authentic Contributor Badge

This badge indicates that a participant provides genuine, human-generated responses.

• How it works: Participants start with this badge and must maintain it by submitting authentic work.
• Removed if: Any submission is rejected due to AI detection or use of AI writing tools (ChatGPT, Claude, etc.).
• Impact: Losing this badge dramatically reduces a participant's eligibility for future studies.

2. Punctuality Pro Badge

This badge recognizes participants with excellent live study attendance records.

• Earned by: Consistently showing up on time for reserved LIVE study sessions.
• Removed if: The participant no-shows any live study.
• Impact: Holders of this badge are prioritized for LIVE study invitations.

Preventing AI-Generated Responses

We take a strict stance against AI-generated content to protect research integrity.

We educate participants about this policy and actively monitor for AI-generated content. As a researcher, if you detect AI use in submissions, rejecting the submission will trigger our reputation system penalties.

How Reputation Affects Your Studies

Our system works behind the scenes to prioritize high-quality participants for your studies:

• Invitation Priority: Participants with higher approval rates, active badges, and good show-up rates receive study invitations first.
• Automatic Filtering: Participants with very low reputation scores may be automatically excluded from certain study types.
• Quality Feedback Loop: When you approve or reject submissions, you directly contribute to improving the overall pool quality.

Upcoming Features: Advanced Participant Filtering

We are actively developing enhanced filtering options that will give you even more control over participant selection.

Best Practices for Maintaining Pool Quality

As a researcher, you play a crucial role in maintaining our participant pool quality:

1. Review Submissions Carefully

Take time to evaluate the quality of responses. Rejecting low-quality or AI-generated submissions helps maintain pool standards.

2. Provide Clear Rejection Feedback

When rejecting a submission, provide specific feedback so participants understand what went wrong and can improve.

3. Use Bonus Payments

Reward exceptional work with bonus payments. This encourages participants to provide high-quality responses and builds a culture of excellence.

4. Set Clear Study Instructions

Well-written study instructions reduce confusion and help participants provide better responses, improving overall data quality.