Julia D. Carson
Toronto,ON
Summary
Detail-oriented AI Annotator with experience evaluating and improving general chat behaviour in Large Language Models (LLMs) and Generative AI with Scale AI. Consistently receives 100% high-quality ratings for contributions. Strong academic background in Occupational Therapy (M.Sc.) and Psychology (B.A.) with verifiable experience in applying scientific research, statistics, and professional writing skills to the delivery of accurate and precise AI annotations.
Overview
17
17
years of professional experience
Work History
AI Annotator
Scale AI (Outlier AI)
11.2025 - Current
- Receives 100% high-quality annotation task ratings
- Annotates 125 tasks monthly for AI models
- Specializes in labeling and annotating data for machine learning models and algorithms
- Follows clear taxonomies, benchmarks and detailed annotation guidelines to ensure consistency
- Executes image, video, text and audio annotations
- RLHF tasks including evaluating model responses prompt engineering, and identifying hallucinations
- SFT tasks to establish "ground truth" in AI training
Occupational Therapist
COTA Health, Austin Rehab, KM Medical Management
09.2008 - 05.2013
- Provided top-quality client-centred and evidence-based patient care
- Identified occupational performance issues, provided evidence-based assessments and interventions, evaluated client progress and adjusted treatment plans accordingly
- Synthesized high volumes of complex health data into structured professional reports
- Followed strict medical and legal rubrics (C.O.T.O. Standards of Practice, Code of Ethics and Competencies) in professional practice
- Worked in the healthcare environment where accuracy and precision in documentation were mandatory
- Actively participated in peer evaluation and lifelong, self-directed learning
Education
Graduate Certificate (Incoming Student Sept 2026) - Web Design & Development (Candidate)
Humber College
Toronto05-2027
University-level Mathematics - Statistical Methods I & II (HHI.PSYC.202 6.0)
York University
Toronto05-2007
Master of Science - Occupational Therapy
McMaster University
Hamilton, Ontario08-2008
Bachelor of Arts - Psychology
York University
Toronto05-2006
Skills
- AI Training: Annotate image, text, audio and video data with accuracy, precision, and strong attention to detail to train machine learning models
- AI Evaluation: experienced in RLHF while applying error taxonomies to diagnose logic failures in AI models
- Statistical Analysis & Logic: Applied university-level mathematics (Hypothesis testing, p-values, t-tests, and Descriptive Statistics) to evaluate data validity and distinguish patterns from anomalies
- Occupational Therapy: Over 4 years of professional experience
- Clinical Precision: Disciplined adherence to strict guidelines and rubrics; able to spot minute inconsistencies in complex datasets (text, image, video and audio)
- Communication: significant experience using LLMs to understand user intent, and excellent writing skills to articulate AI reasoning errors
Timeline
AI Annotator
Scale AI (Outlier AI)
11.2025 - Current
Occupational Therapist
COTA Health, Austin Rehab, KM Medical Management
09.2008 - 05.2013
Graduate Certificate (Incoming Student Sept 2026) - Web Design & Development (Candidate)
Humber College
University-level Mathematics - Statistical Methods I & II (HHI.PSYC.202 6.0)
York University
Master of Science - Occupational Therapy
McMaster University
Bachelor of Arts - Psychology
York University
Linked In: www.linkedin.com/in/j-carson-871002381
LinkedIn Address