The content of this paper summarizes four years of research designed to develop valid and reliable performance criteria for the Navy's Tactical Aircrew Combat Training System (TACTS). Measures used in performance assessment were selected on the basis of their operational importance and their demonstrated statistical relationship to successful completion of such air combat tasks as missile launch success and engagement outcomes. A measurement framework has evolved and may be appropriately applied to estimate overall air combat effectiveness, and to provide diagnostic performance analysis of critical air combat tasks. More recently, these measures and assessment methods have been incorporated in a computer-based TACTS aircrew debrief system called the Performance Assessment and Appraisal System (PAAS). The PAAS is representative of an emerging technology which uses automated performance measurement methods for enhancing the training process by providing performance based feedback to operational aircrews.