AI & Data Technical Administrator

Role Summary

The Calibrate Technical Administrator is responsible for the technical configuration, data management, and validation of the Calibrate AI platform. The administrator contributes to model reliability, scoring integrity, and continuous improvement, working closely with QA, Operations, and Data teams.

This role ensures that:

· QA requirements are accurately translated into system configurations

· Evaluation data is complete, consistent, and reliable

· Outputs are structured and usable for reporting and analysis

This is a data-focused, entry-level IT role, not a QA decision-making role.

 

Core Responsibilities

1. Prompt Deployment & Testing

· Implement and test AI prompts

· Track changes and validate output consistency

2. Data Quality & Monitoring

· Ensure evaluation coverage meets targets

· Identify missing, inconsistent, or duplicate data

· Monitor usage and scan volumes

3. System Configuration

· Set up clients, programs, and evaluation structures

· Translate QA scorecards into system logic

4. Data Extraction & Reporting

· Export and prepare datasets for QA and Operations

· Support dashboards and reporting needs

5. Basic Analysis

· Identify trends, anomalies, and scoring inconsistencies

· Compare automated vs manual QA results