HPOG Implementation, Systems and Outcomes

The HPOG Implementation, Systems, and Outcomes (ISO) project developed an evaluation plan for measuring the implementation, systems change, and outcomes of 27 HPOG grantees. Additionally, HPOG ISO tracks the program management and accountability progress of all 32 grantees.

The HPOG Implementation, Systems, and Outcomes (ISO) project has two parts. The first developed an evaluation plan for measuring the implementation, systems change, and outcomes of 27 HPOG programs focused on TANF recipients and other low-income individuals. The second built and maintains the HPOG Performance Reporting System (PRS), a management information system, to track grantee progress for program management and accountability, and to record participant data for use in the evaluation for all 32 HPOG grantees.

For the design of this evaluation, questions of primary interest are:

  • How are health professions training programs being implemented across the grantee sites?
  • What changes to the service delivery system are associated with program implementation?
  • What individual-level outputs and outcomes occur—e.g., recruitment, enrollment, retention, completion (accreditation/certification), job entry, employment retention and advancement, and earning?
  • What key components appear necessary to, or contribute to the success of, these programs?

Timeline for HPOG ISO

ACF contracted with Abt Associates in 2010 to conduct the Health Profession Opportunity Grants (HPOG) Implementation, Systems, and Outcomes (ISO) Project.  The purpose of this project was to provide recommendations for the design of an evaluation intended to be universal to the 27 HPOG programs focused on TANF recipients and other low-income individuals and to assess implementation, systems change, and outcomes.  The ISO contract resulted in the design for the HPOG National Implementation Evaluation.  The ISO project will conclude in 2015.

HPOG Grantees Participating in HPOG ISO Study

  • Alamo Community College District and University Health System
  • Bergen Community College
  • Buffalo and Erie County WDC
  • Central Community College
  • Central Susquehanna Intermediate Unit
  • Community Action Project of Tulsa County, Inc.
  • Eastern Gateway Community College
  • Edmonds Community College
  • Full Employment Council
  • Gateway Community and Technical College (KY)
  • Gateway Technical College (WI)
  • Kansas Department of Commerce
  • Milwaukee Area WIB
  • New Hampshire Office of Minority Health
  • Pensacola State College
  • Pima County Community College
  • Research Foundation of CUNY-Hostos Community College
  • San Diego Workforce Partnership
  • Schenectady County Community College
  • South Carolina Department of Social Services
  • Southland Health Care Forum, Inc.
  • Suffolk County Department of Labor
  • Temple University, Center for Social Policy
  • The WorkPlace
  • WDC of Seattle – King County
  • WIB SDA-83 Inc. (LA)
  • Will County WIB
  • College of Menominee Nation
  • Cankdeska Cikana Community College
  • Turtle Mountain Community College
  • Cook Inlet Tribal Council
  • Blackfeet Community College

HPOG ISO Partners and Sponsors

Primary Evaluation Sponsor

OPREThe HPOG Implementation, Systems, and Outcomes evaluation was funded by The Office of Planning, Research, and Evaluation (OPRE). OPRE is the principal advisor to the Assistant Secretary for Children and Families, U.S. Department of Health and Human Services, on increasing the effectiveness and efficiency of programs designed to improve the economic and social well-being of children and families.

Lead Evaluator

Abt Associates logoAbt Associates is a mission-driven, global leader in research and program implementation in the fields of health, social and environmental policy, and international development. Known for its rigorous approach to solving complex challenges, Abt Associates is regularly ranked as one of the top 20 global research firms and one of the top 40 international development innovators. The company has multiple offices in the U.S. and program offices in more than 40 countries.

Evaluation Partner

Urban Institute LogoUrban Institute fosters sound public policy and effective government by analyzing policies, evaluating programs, and informing community development to improve social, civic, and economic well-being.


Additional Links


HPOG ISO Project Director
Alan Werner
Principal Associate
Abt Associates

Federal Project Officer
Hilary Bruck
Employment & Training Research Team Lead
Senior Social Science Research Analyst
Administration for Children and Families

Other ACF-Sponsored Studies