DOE A to Z: A B C D E F G H I J K L M N O P Q R S T U V W X Y Z #

Implementation Quality Toolkit

The Implementation Quality Framework (IQF) below conceptualizes the components of evaluation implementation and provides a graphic organizer for describing where quality can be improved. Hover your cursor over each component of the IQF to find links to relevant tools. For more information on the toolkit, strategies for using it, and descriptions of the individual tools, please click on the  bars below the graphic.

AchieveNJ Implementation Quaity Toolkit graphic AcheiveNJ Expectations and Communication Educator Training and Capacity Building Execution and Monitoring of Evaluation Process Organizational Capacity and Culture Data Systems and Infrastructure

AcheiveNJ Expectations and Communication

  1. Implementation Quality District Self-Assessment
  2. Creating Common Observation Protocols

Educator Training and Capacity Building

  1. Student Growth Objective (SGO) Presentation (PPT | PDF)
  2. SGO Video Series
  3. SGO Quality Rating Rubric (PDF | Word)
  4. Administrator Goals: Updated Guidance and Exemplars (PDF | Word)
  5. Effective Feedback Protocol

Execution and Monitoring of Evaluation Process

  1. Observation Report Quality Rubric
  2. Calibration Activities for Observers
  3. Improving Accuracy, Adding Value
  4. Reflective Practice Protocol Implementation Guidebook

Organizational Capacity and Culture

  1. Collaborative Teams Toolkit
  2. ScIP Guidance 1.0
  3. Creating an AchieveNJ Teacher Survey

Data Systems and Infrastructure

  1. Teacher SGO Tracking and Scoring Tool
  2. Alternate Observation Data Platform

 

Introduction to the Implementation Quality (IQ) Toolkit

Districts in the state of New Jersey have been implementing AchieveNJ since School Year (SY) 2013-14. In the intervening years, many districts have developed strategies to ensure that the process provides educators with valuable feedback as well as accurate ratings. Over SY 2015-16, nine New Jersey school districts worked closely with the New Jersey Department of Education's Office of Evaluation to systematically improve the quality of their implementation of AchieveNJ. This toolkit is an outgrowth of that work. Its development was further guided by the work of national partners such as the Wallace Foundation and the Council of Chief State School Officers (CCSSO), as well as best practices emerging from individual states and districts.

Using this Toolkit

Educational leaders can begin using this toolkit by completing the Implementation Quality Self-Assessment.   The self-assessment is aligned to the Implementation Quality Framework pictured above and will help in identifying strengths and areas  for growth. The data collected can be an integral part of a school- or district-level professional development plan. The other tools support implementation quality in each of the five areas of the Implementation Quality Framework and are designed to support districts moving beyond compliance and onto quality and ownership.

Description of Tools

AchieveNJ Expectations and Communication

  1. Implementation Quality District Self-Assessment
    A self-assessment aligned to the Implementation Quality Framework ( IQF) and structured to be used by leadership teams, including the ScIP and DEAC. Results will help districts to identify areas of weakness and plan strategies to improve implementation using some of the tools in this toolkit.

  2. Creating Common Observation Protocols
    Collaboratively created protocols support consistency among observers, a key component in accuracy and equity. The sample protocols illustrate best practices in planning for and conducting pre-conferences, observations and post-conferences.  They can be used as they are or serve as a model for districts to use as they explore their current practices and determine which strategies will lead to improved consistency while providing the flexibility needed to accommodate contextual differences.

Educator Training and Capacity Building

  1. Student Growth Objective (SGO) Presentation (PPT | PDF)
    The most recent training materials designed to support districts in creating and executing SGOs at a high level. The presentation focuses on helping educators ensure that SGOs are: aligned to standards, grounded in data and driven by high expectations for students.

  2. SGO Video Series
    A component of the "SGO Basics" and the "Improving SGOs" training for administrators (regulatory updates require that school administrators receive SGO training)

  3. SGO Quality Rating Rubric (PDF | Word)
    This rubric provides administrators with a streamlined tool to guide professional conversations around the development and approval of SGOs.  Scores generated using this rubric cannot be used as part of an educator's required evaluation rating.

  4. Administrator Goals: Updated Guidance and Exemplars (PDF | Word)
    The guidance and the exemplars contained in this document support the creation of high-quality administrator goals, aligned with other goals being created in districts.

  5. Effective Feedback Protocol
    Conducting post-observation conferences that provide teachers with evidence-based, actionable feedback is one example of a high-impact leadership activity. This suite of tools gives school leaders a pathway to improve their skill in preparing for and conducting post-observation conferences.

Execution and Monitoring of the Evaluation Process

  1. Observation Report Quality Rubric
    This rubric is a teaching tool that may be used by teachers and administrators to work toward producing high-quality observation reports.  It describes activities and components of observation reports that align with guidance documents and presentations previously published by the Department.  Scores generated using this rubric cannot be used as part of an administrator's required evaluation rating.

  2. Calibration Activities for Observers
    These calibration activities are designed to help administrators deepen their knowledge of their teacher practice instrument and improve in their identification of evidence-based best practices across a variety of grade levels, subjects, and student populations.

  3. Improving Accuracy, Adding Value
    This document provides strategies and tools to help school and district leaders evaluate teachers using AchieveNJ to improve their implementation of the system.

  4. Reflective Practice Protocol Implementation Guidebook
    This guidebook presents a protocol for districts seeking to utilize the observation flexibility afforded under the proposed regulatory changes to AchieveNJ for highly effective tenured teachers.

Organizational Capacity and Culture

  1. Collaborative Teams Toolkit
    Assembled to support the monitoring and effective use of Student Growth Objectives (SGOs) and other student data, this set of resources is designed to help schools foster successful evidence-based conversations between educators.

  2. ScIP Guidance 1.0
    The School Improvement Panel (ScIP) is an important vehicle for fostering a collaborative, growth-oriented culture around evaluation in every school. This document provides clarification around the requirements for a ScIP and highlights best practices from districts successfully implementing ScIPs.

  3. Creating an AchieveNJ Teacher Survey
    Stakeholder feedback has been shown to be a critical component in identifying areas for growth and planning professional learning that creates high-impact change. This guidance is intended to help districts capture feedback on overall implementation for the purpose of improvement and is not designed to be incorporated into evaluation at any level.

Data Systems and Infrastructure

  1. Teacher SGO Tracking and Scoring Tool
    This comprehensive support tool helps teachers use baseline data to place students in tiers, set student targets, monitor student progress, and ultimately translate student growth or achievement into an SGO score.

  2. Alternate Observation Data Platform
    An alternative evaluation data warehouse, this tool is built on Microsoft Excel©, and is ideally suited for smaller districts. It is compatible with all computers and devices that run Excel or Excel conversion software, and is available free of charge. For more information, call 609 777-3788.

The Department thanks its partner districts, as well as the many other educators whose hard work and willingness to share best practices, contributed to this document.  The Office of Evaluation invites feedback or questions and can be reached at  educatorevaluation@doe.state.nj.us or 609-777-3788.