Exercise Evaluation / AAR-CAP Analyst

Position Type: Full-time
Location: Washington, DC Metro preferred; telework as approved
Clearance / Suitability: Secret preferred; ability to obtain and maintain Secret and DHS suitability required
Travel: Occasional travel required

Position Summary

The Exercise Evaluation / AAR-CAP Analyst leads evaluation design, data collection, post-exercise analysis, Summary Reports, Quick Look Reports, After-Action Reports, Improvement Plans, Corrective Action Plans, and longitudinal analysis. This position turns observations, surveys, hotwash comments, evaluator notes, and stakeholder input into defensible findings, best practices, areas for improvement, and corrective actions.

Essential Duties and Responsibilities

• Develop evaluation plans, EEGs, feedback forms, survey questions, observation templates, data collection plans, and analysis frameworks.
• Coordinate evaluator assignments, observation collection, hotwash data capture, participant feedback collection, and post-event data consolidation.
• Analyze exercise objectives, capabilities, observations, strengths, areas for improvement, and cross-cutting trends.
• Draft Summary Reports, Quick Look Reports, AARs, Improvement Plans, CAPs, AAM materials, and corrective action tracking products.
• Support six-month follow-up outreach to exercise participants to identify changes or modifications made to plans, procedures, policies, training, or processes.
• Conduct quarterly and annual analysis of completed exercises, AARs, Improvement Plans, CAPs, and program-level trends.
• Coordinate adjudication of Government comments and stakeholder input into final reports.
• Prepare analytical products, meta-analysis reports, charts, tables, and briefing materials that communicate exercise findings to internal and external stakeholders.
• Support development and tracking of program performance metrics and exercise outcome measures.
• Maintain organized records of evaluation data, supporting evidence, and approved final products.

Required Qualifications

• 5+ years of experience in exercise evaluation, emergency management analysis, after-action reporting, program evaluation, performance measurement, or policy analysis.
• Experience developing AARs, CAPs, Improvement Plans, QLRs, Summary Reports, or comparable evaluation products.
• Strong ability to synthesize qualitative and quantitative data into clear findings and actionable recommendations.
• Experience with surveys, questionnaires, hotwash facilitation, evaluator note collection, or longitudinal follow-up analysis.
• Excellent analytical writing, editing, and stakeholder coordination skills.
• Proficiency with Microsoft Word, Excel, PowerPoint, SharePoint, and Teams.

Preferred Qualifications

• HSEEP training or experience.
• Experience supporting CISA, DHS, FEMA, SLTT, critical infrastructure, or emergency management exercises.
• Experience building dashboards, trend reports, or performance metrics for federal programs.

Primary Deliverables / Work Products Supported

• Evaluation plans and EEGs
• Feedback forms and survey tools
• Summary Reports and Quick Look Reports
• AARs, Improvement Plans, and CAPs
• Quarterly and annual trend analysis
Six-month follow-up analysis

Applied Training Solutions, LLC is a leading simulations company providing innovative systems, products, and solutions to government and commercial customers.

Applied Training Solutions, LLC is committed to hiring and retaining a diverse workforce. We are an Equal Opportunity Employer, making decisions without regard to race, color, religion, sex, national origin, age, veteran status, disability, or any other protected class. U.S. Citizenship is required for most positions.