On the basis of anecdotal evidence and media interest, the public profile of applied sport psychology is ever increasing in terms of its perceived impact on the performance of elite athletes and teams. In the profession, however, there is some concern over whether we are managing to concurrently match this pace empirically, through the evolution of scientific methods and mechanisms to evaluate the effectiveness of practice. This article considers requirements of the current evaluation climate and provides an overview of existing formal evaluation procedures. It is suggested that the evolving intricacies and complexities of applied sport psychology practice are neither fully captured nor represented by these procedures. Consequently, a framework of professional judgment and decision making (PJDM) is proposed from which to consider the evaluation of practice. In addition, methods and mechanisms for enhancing and building on our current evaluation procedures are offered.