Office Of Justice Programs Technical Assistance And Training Program

Audit Report No. 04-40
September 2004
Office of the Inspector General


Appendix 6

Technical Assistance and Training Grants
Summary of Performance Measures - BJA


Purpose of GrantEvaluation MethodBased on the grantee's evaluation method, can the OJP measure program performance or impact?
National Center for Missing and Exploited Children
2000-MC-CX-K021
Developed standards for School Resource Officers (SRO) and developed and conducted SRO training nationwide. Between June 26, 2000, and August 14, 2002, the grantee was awarded a total of $10,993,363, of which Fox Valley Technical College was authorized to receive $8,411,398 as a single-source provider.All course participants were required to turn in a completed evaluation form in order to receive a certificate. Results were tabulated and summarized.No37
Development Services Group, Inc.
1999-JB-VX-K001
Provided technical assistance and training to states and units of local government with funds to develop programs to promote greater accountability in the juvenile justice system. From November 1, 1998, to June 30, 2003, the OJP awarded the grantee a total of $5,377,201.Participants were asked to complete evaluation forms at the end of each session or day, depending on the trainingNo
Florida Atlantic University
95-JN-FX-0024
Provided assistance to juvenile justice systems wishing to: 1) expand and enhance restitution and related restorative sanctioning programs and practices, 2) use these programs and practices as a catalyst for broader changes in juvenile justice sanctioning and supervision practices, and 3) redesign or restructure their community supervision systems based on a Balanced Approach mission within a Restorative Justice conceptual framework (BARJ). As of September 30,2003, the grantee was awarded a total of $2,018,869 to provide training and technical assistance to states and local jurisdictions wishing to implement to BARJ model.Only verbal evaluations took place at the roundtables; thus the grantee's staff evaluated progress of each state participating in the roundtables based on oral reports and supplemental materials provided in advance and at the roundtable meetings. In addition, outside contractors were hired to evaluate the project.No38
Boys and Girls Clubs of America (BGCA)
98-JN-FX-0007
Built upon the existing efforts of the BGCA and the Taco Bell Foundation to provide educational, recreational, and community service activities through current TEENSupreme Centers operated nationwide by local BGCAs. As of August 31, 2003, the grantee was awarded a total of $9,275,000 to provide a comprehensive array of career preparation services to youth, ages 13 to 18, with a special emphasis on job preparedness, placement, and follow-up support services for 16 to 18 year-old club members. The program recipients were given the opportunity to evaluate the training provided to them through surveys. The survey forms were provided and evaluated by Policy Studies Associates (PSA), the company contracted to perform evaluations of the TEENSupreme program. In addition, outside contractors were hired to evaluate the program.No
Constitutional Rights Foundation
2001-JS-FX-008
To teach young people about the law so that they can lead successful lives within the confines of the law. As of July 10, 2002, the grantee was awarded a total of $1,066,400 to strengthen successful models in 49 states, the District of Columbia, and Puerto Rico, that link the Law Related Education with violence prevention. Individual training program evaluation forms were completed on-site by participants and collected by staff. Staff reviewed and summarized comments and made changes to the program accordingly. No
National Court Appointed Special Advocate Association
2002-CH-BX-K001
Supported the grantee in providing training and technical assistance to its network of local programs across the nation. As of April 2, 2002, the grantee was awarded a total of $3,823,500 to promote and enhance the highest possible volunteer representation of children by establishing methods and measures of consistency, quality, and cultural sensitivity in the management of Court Appointed Special Advocate/Guardian ad Litem (CASA/GAL) programs.Individual training program evaluation forms were completed on-site by participants and collected by staff.No
Children's Advocacy Center for the Pikes Peak Region
2001-MU-MU-K002
Assisted communities in establishing and strengthening children's advocacy centers and multi-disciplinary teams to address the needs of child victims of abuse. Between December 2000, and February 2003, the grantee was awarded a total of $1,124,343 to provide training and technical assistance to communities in the western region.The grantee used two basic types of evaluation forms to evaluate training. The individual forms were reviewed and a consolidated form was prepared. The results were reviewed to assess the quality of services provided and adjustments were made to the training program as necessary. There was no method for evaluating the technical assistance.No
Suffolk University
1999-JS-FX-0001
To improve legal services for juveniles in three targeted communities and to prevent at-risk juveniles from getting into legal difficulties. Between December 31, 1998, and August 14, 2002, the grantee was awarded a total of $5,060,685.The grantee provided training recipients with the opportunity to evaluate the training programs; however, the grantee did not retain the evaluations from participants in the clinical program. The legal assistance provided to the juveniles was not evaluated.No
Children's Hospital
2000-CI-FX-K001
To increase the number of facility-based, multi-disciplinary children's advocacy centers in the Midwest for the purposes of providing coordinated, non-traumatizing services to children and families that are victims of child abuse and neglect, and to strengthen existing services through local, state, regional, and national collaboration. As of March 19, 2003, the grantee had been awarded a total of $1,286,115 to provide technical assistance and training to improve services available in the Midwest to child victims of physical and sexual abuse and neglect.Program attendees at training and technical assistance events were requested to fill out evaluation forms. The results were compiled for each event.No
Fox Valley Technical College Missing Children's Assistance #1
98-MC-CX-K010
Provided training and technical assistance to professionals involved in the management and investigation of cases involving missing or exploited children. Between September 30, 1998, and August 27, 2002, the grantee was awarded an initial grant and four supplements totaling $7,263,359. The grantee provided an evaluation form to each participant attending regional training and receiving technical assistance. Most participants filled out and returned the forms. Grantee officials and the OJP read the evaluations and acted upon them if possible, including suggestions for improving or expanding the material covered. No
Fox Valley Technical College Missing Children's Assistance #2
98-MC-CX-K003
Provided training and technical assistance to individuals and organizations involved in aiding and responding to missing and exploited children and their families. As of April 2, 2002, the grantee was awarded a total of $2,298,701 to train state and local law enforcement officers through a training course entitled Responding to Missing and Abducted Children.The grantee provided an evaluation form to each participant attending regional training and receiving technical assistance. Most participants filled out and returned the forms. Grantee officials and the OJP read the evaluations and acted upon them if possible, including suggestions for improving or expanding the material covered.No


Footnotes

  1. We concluded that the OJP does not collect sufficient information from the grantees to measure program performance or program impact.
  2. However, one of the objectives listed in a subsequent grant application related to the development of performance measures and a performance measurement methodology to be utilized by juvenile justice systems nationwide to determine the impact of balanced and restorative justice. The subsequent grant was awarded under a new project number, 2002-JI-BX-0002 on August 2003, but had not been implemented when we performed on audit.