Review AI-generated military and government reports for source quality, reasoning, uncertainty, and operational usefulness. Identify cases where an AI model refuses legitimate analytic exploration, and document the issue clearly. Record edge cases and disagreements between analysts to support stronger evaluation methods. Work with project leads to refine source-evaluation procedures and confidence-level assignments. Share expert insights that help calibrate analytic standards and improve AI benchmarks.
Requirements: Professional fluency in English. Demonstrated all-source analytic experience or deep expertise in a specific analytic discipline. Strong proficiency in source evaluation, confidence-level assessment, established analytic standards, structured analytic techniques, and intelligence tradecraft standards. Ability to identify and explain nuanced model limitations and over-refusal scenarios. Strong written and verbal communication focused on clarity and precision. Experience teaching, mentoring, or leading analytic reviews is valuable. Civilian intelligence community background or comparable government and defense analysis experience is useful.
Skills: Analytic rigor; source handling; over-refusal detection; all-source intelligence analysis.
