Annotation QA · Benchmark Evaluation · Training Dataset Standards
A blog and newsletter on Expert human data collection and annotation methodology and AI training data quality and evaluation.
Training Dataset Standards
Benchmark Dataset Contamination Detection Methods
Five detection methods exist, each blind to different types of contamination.
Benchmark Evaluation
LLM-as-Judge Evaluation Reliability and Systematic Biases
Annotation QA