Located in:
- III. Operational Planning Elements
The Unified or Combined State Plan must include an Operational Planning Elements section that supports the State’s strategy and the system-wide vision described in Section II(c) above. Unless otherwise noted, all Operational Planning Elements apply to Combined State Plan partner programs included in the plan as well as to core programs. This section must include—
- b. State Operating Systems and Policies
The Unified or Combined State Plan must include a description of the State operating systems and policies that will support the implementation of the State strategy described in section II Strategic Elements. This includes—
- b. State Operating Systems and Policies
III. b. 4. D. Evaluation
Describe how the State will conduct evaluations and research projects on activities under WIOA core programs; how such projects will be coordinated with, and designed in conjunction with, State and local boards and with State agencies responsible for the administration of all respective core programs; and, further, how the projects will be coordinated with the evaluations provided for by the Secretary of Labor and the Secretary of Education under WIOA.
Current Narrative:
(D) Evaluation. Describe how the state will conduct evaluations and research projects on activities under WIOA core programs; how such projects will be coordinated with, and designed in conjunction with, State and local boards and with State agencies responsible for the administration of all respective core programs; and further, how the projects will be coordinated with the evaluations provided for by the Secretary of Labor and the Secretary of Education under WIOA.
Recognizing that program evaluation and research are two key components of achieving overall system improvement, Maryland’s WIOA Partners are committed to working with appropriate organizations to design and coordinate projects that inform sound WIOA policymaking that is refined to appropriately meet shared customer needs. Evidence provided by research and evaluations can improve policy in two main ways: it can lead policymakers to adopt or scale-up programs or policies that are found to have net social benefits; or, it can lead policymakers to terminate existing programs that are found to have net social costs. The WIOA Partners, therefore, agree to explore how independent evaluation efforts, that have been historically contracted by each agency independently, can be coordinated to provide a comprehensive, deeper look at the overall WIOA system.
In addition to this continued commitment, the State has developed formal monitoring tools to conduct regular evaluations. All AJC program partners are assessed by both the State and Local Areas twice annually in conjunction with formal monitoring by DWDAL’s Monitoring and Compliance Unit. As part of both program and fiscal monitoring, Local Area leadership and MD Labor’s Title III Labor Exchange Administrators complete an assessment survey regarding partners, their service delivery, and their performance. When a partner is not performing well, and/or not in accordance with the MOU or RSA, a Corrective Action Plan is developed.
When developing the State’s policy on monitoring (PI 2019-07 Monitoring) and other monitoring tools, stakeholders considered how to involve partners and leadership in the evaluation process. As a result, reports are often shared with Local Directors and Local Board Chairs. Additionally, MD Labor’s Program Monitoring Questionnaire includes, but is not limited to, the following questions for evaluation prior and during monitoring visits:
- Please describe any special, shared, or common responsibilities taken on by the AJC partners to improve service delivery within the AJC. For example, which partners provide assistance in the resource room, reception, workshops, assessments, participant outreach, etc.?
- Describe the processes and tools that are in place to support continuous improvement activities in the AJC.
- How is the Local Area integrating and partnering its programs within the AJC? Please provide examples of the integration/coordination of activities (USDOL Core Monitoring Guide).
- How does the Local Area assess its performance integration, and how is the data used?
- What area of integration has been identified as a priority for the Local Areas and what action had been taken for this integration?
Responses are used to guide discussions during visits, provide technical assistance, and again, contribute to Maryland’s overall commitment to continuous partner and system evaluation.