Director of Evaluation
Department Description: This role is providing direction on the Beth Israel Lahey Health Community Benefits team.
Job Location: Boston, MA
Req ID: 31324BR
Job Summary: This position reports to the senior leadership of Community Benefits for Beth Israel Lahey Health. The position will develop and implement the evaluation plan and program to inform and monitor the Beth Israel Lahey Health (BILH) system and individual hospitals' Community Benefits and Community Relations strategy and programs. This position is responsible for defining and overseeing the evaluation plan and metrics to ensure BILH and all BILH hospitals adhere to Community Benefits local, state and federal regulatory reporting requirements. This includes developing metrics, training staff, ensuring integrity of data collection, analyzing and evaluating data, applying quality improvement, developing internal and external reports on outcomes and evaluating new and existing initiatives for sustainability, spread and impact. This position is responsible for translating evaluation questions into analytic plans, analyzing health, community and program data, conducting valid comparisons and statistical tests, and summarizing findings of evaluations.
- Develops, implements, manages and monitors BILH Community Benefits and Community Relations evaluation plan and strategy that aligns with regulatory requirements and informs BILH strategy, programming and resource allocation decisions.
- Develops and monitor evaluation plans, providing technical assistance, training and support on metrics development, goal setting, indicators, methods, etc. Develops and manages an evaluation framework to measure and track outcomes for and impact of all BILH CB and CR initiatives. Assesses the efficacy of programs in order to help prioritize the allocation of resources and set goals.
- Contributes to informing, identifying & establishing BILH and local priorities, and participates in CB/CR policy making as appropriate. Advises and establishes BILH CB/CR and all BILH hospital CB/CR programs on goal setting, indicators, evaluation methods, metrics, and data.
- Informs, oversees, and evaluates the community health needs assessment, prioritization and community engagement processes for all BILH hospitals. Serves as part of the BILH Community Benefits program leadership team and contributes to the development, implementation and execution of data driven strategic initiatives.
- Researches best practices for grant making, program design and measuring program outcomes. Works with individual hospital to select, coordinate and provide oversight of independent evaluators.
- Has the responsibility to lead and support managers and directors in developing and improving operations to create optimal performance levels. Direct Reports: None Indirect Reports: None
- Master's degree in Public Health or Public Policy required.
- More than 10 years related work experience required and 1-3 years supervisory/management experience required
- Progressive experience conducting and leading data analysis and cross-functional, long-term, complex, multi-faceted evaluation initiatives with diverse stakeholders. Program evaluation, including process and outcome evaluation, qualitative and quantitative methods, and varied levels of evidence applied to public health, community health, community engagement, strategy, and policy and planning.
- Significant experience designing and implementing performance measurement program initiatives and translating research and complex concepts for non-expert audiences. Proven knowledge and experience applying program evaluation principles, theories, concepts, and practices. Demonstrated use of evaluation and community-based research to inform program development.
- Exceptional evaluation skills, including design, advanced inferential statistics, and qualitative research methods. Proven capacity for project management.
- Advanced skills with Microsoft applications which may include Outlook, Word, Excel, PowerPoint or Access and other web-based applications. May produce complex documents, perform analysis and maintain databases.
- Health and public policy related evaluation and statistics.
- Decision Making: Ability to make decisions with significant, broad implications for the management and operations of a major department or multiple departments. Participates in decisions on overall strategy and direction of the organization.
- Problem Solving: Ability to address problems that are broad, complex and abstract, often involving Medical Center-wide issues and requiring substantial creativity, resourcefulness, staff engagement, Lean diagnostic techniques, negotiation and diplomacy to develop solutions.
- Independence of Action: Ability to set goals and priorities for functional area. May make recommendations for department policies, practices and programs. Manager or Director provides broad guidance and overall direction.
- Written Communications: Ability to communicate complex information in English effectively in writing to all levels of staff, management and external customers across functional areas.
- Oral Communications: Ability to verbally communicate complex concepts in English and address sensitive situations, resolve conflicts, negotiate, motivate and persuade others.
- Knowledge: Ability to demonstrate broad and comprehensive knowledge of theories, concepts, practices and policies with the ability to use them in complex and/or unprecedented situations across multiple functional areas.
- Team Work: Ability to lead collaborative teams for larger projects or groups both internal and external to the Medical Center and across functional areas. Results have implications for the management and operations of multiple areas of the organization.
- Customer Service: Ability to lead operational initiatives to meet or exceed customer service standards and expectations in assigned unit(s) and/or across multiple areas in a timely and respectful manner.
Physical Nature of the Job:
Sedentary work: Exerting up to 10 pounds of force occasionally in carrying, lifting, pushing, pulling objects. Sitting most of the time, with walking and standing required only occasionally