In the best-case scenarios, educators are able to use data to assess student performance so that they can better plan, implement and revise instruction. Research shows that if instructional plans are based on assessment data, it’s more likely that students will attain the desired learning outcomes.
In reality, however, using data is not so easy. Teachers and administrators need to be data literate. District leaders must encourage and assist educators in understanding the importance of relating valid student assessment information to instructional practice. And perhaps trickiest of all, the school culture needs to be one in which teachers can collaborate, share information, and not be intimidated by what the data may show.
School CIO spoke with a few districts to see where they are in the data-driven decision-making process. Hopefully their experiences can help you in handling your own data-driven decisions.
Professional Development Meets Data
For Donna Lee Mitchell, deputy officer, teacher and leader effectiveness unit for professional development for the Delaware Department of Education (DDOE), there’s a twoword answer to helping districts understand how to work with data: data coaching.
With part of the state’s Race to the Top funds, DDOE contracted with Wireless Generation to send 29 data coaches to work with teachers in all of Delaware’s schools. Data coaches work with groups of teachers who look at their own data in real time. The coaches show teachers how to speak about data and use it to draw conclusions and improve instructional planning. The educators learn how to understand patterns and find and evaluate the solutions. If it’s done right, says Wireless Generation’s Alan Stadtmauer, the coach coaches herself out of a job.
Each school has to provide 90 minutes of collaborative planning time a week per teacher, which is handled differently by every school, says Mitchell. The data coaches work with data from state and classroom assessments and help teachers and administrators learn to look at it and make informed decisions about planning, practice, and activities beyond what they are currently doing with data. They can see which strategies work better than others and share best practices across grades, departments, and schools.
Delaware has a statewide student accounting system that houses discipline, achievement, and attendance information so the coaches can work with several schools. If a district uses an additional technology product, the entire district uses it, which helps to streamline the tools the coaches and educators need to understand.
Teachers at Salt Creek 48 use their eInstruction CPSs to find out if their kids understand what they are discussing. Mitchell is pleased with the data-coaching model. “We’re hearing everything from ‘this isn’t the best use of time’ to ‘this is what we’ve been missing,’ and everything in between,” she says, “but the waste-of-time comments are diminishing.”
Wireless Generation’s Stadtmauer, who oversees data coaching, says this method is effective because teachers are overwhelmed by data and need a simple approach. “They have to learn how to figure out what to do next. It’s a core skill teachers need.” We must help teachers learn how to look for patterns across an entire class.
Jamie Lee, a former Delaware high school English teacher who is now a data coach, says the key to helping teachers is to give them adequate time to reflect, plan, and analyze. “Data isn’t just numbers all the time,” she says. “It’s looking at what interventions and curricular resources are available and how they are working. We are constantly asking each other, ‘Are we seeing patterns that tell us to adjust the instruction?’”
Leveraging the Data Warehouse
About 10 years ago, Cumberland County Schools (CCS) in North Carolina formed its own data warehouse. Because NC has a statewide student information system, CCS wanted to download the data for the statewide student information system (SIS) and store it in a centralized place where people could track data for any given student. The district also needed to merge assessment and other types of data with the SIS data.
CCS worked with eScholar to create a data warehouse. Today, that warehouse includes school enrollment, staff demographics and certification, attendance, discipline, and item-level assessment data for individual students. Principals use the data for planning; teachers use it to track student performance on skills and objectives and provide targeted instruction.
When it became available, the district started using eScholar myTrack, which lets teachers use data to personalize education. eScholar myTrack capitalizes on the data in the warehouse and provides teachers with recommended strategies and interventions that are aligned with state and local standards. It lets them create goals and strategies, monitor and measure progress, and evaluate the effectiveness of those programs and interventions.
A teacher logs into the system, enters a student ID, and gets all the data collected on that student. The teacher reviews the information and creates a plan within the same program to pinpoint areas by goal and objective and develop academic and, if needed, behavioral interventions. The teacher can select predetermined interventions based on success rates reported in the system or create new ones.
“Historical data is one of the most helpful things,” says Kevin Coleman, executive director of technology. “You get the exact numbers for what works and what doesn’t, and you can customize a program for each child instead of aiming for the middle.”
Ruben A. Reyes, executive director for Exceptional Children’s Services, advises districts to start the data process by asking what your actual audience wants. “We started by working with principals but found that we needed to dig down to the teacher level,” he says. “The teachers helped us make it electronic instead of paperbased. They wanted to grab information from the student information system instead of typing everything in.”
Both Reyes and Coleman stress that the more you use the data, the more uses you’ll find. As they say, “For the first six years we used the data to impact instructional decisions from an administrative level, but when we dug deeper we saw we could get down to the individual level.”
Updating the Data Process
For the last couple of years, Marion County (FL) Public Schools was busy upgrading its earlier data system to be more robust and comprehensive. The district needed a system that was quicker, more user friendly, and would provide more access to data to support decision making at all levels. It also added a component that connects student data to teacher actions.
Student Profile page provides a snapshot of the student including demographics, goals, assessments, attendance, and courses with the ability to drill into historical information. “When our fifth-grade students took their first science assessment this year, we saw that the entire district struggled,” says Diana Greene, deputy superintendent. “It quickly became apparent that we put this assessment on the calendar too early. We needed to give students more instruction and more time to fully understand the concepts we were testing. As a result, we’ve made adjustments to our calendar for next year and provided our schools with the support to make that change.”
According to Greene, the district wanted a system that would allow for online testing and the ability to make decisions about how well students were doing throughout the year. They chose Performance Matters, which lets teachers access the information easily to see how individual students and whole classes are performing.
“There’s a report that quickly shows me which standards the children understand or don’t,” Greene says. “It’s very comforting that I can look at it, and so can our elementary director, our curriculum people, or our staff development. All of us can see the data and we can talk about what we need to do, whether it’s bringing in more resources, more staff development, or something else.”
A technician converted benchmark data into predictive Florida state test scores so staff can predict how well a student will do on the state test. Once schools get the information, they can develop an action plan based on the findings.
Essentially, Performance Matters helps everyone make decisions about what is best for students. When they saw that every third-grader struggled with authors’ intention, they realized the curriculum was teaching it one way and it was being tested another way, so they did additional staff development and made some changes.
Greene appreciates her relationship with Performance Matters, which she says is collaborative and positive. “Make sure that whatever vendor you choose will be a partner in accomplishing your goals.”
District-wide Assessment
The teachers at Salt Creek 48 (IL) School District have been using eInstruction CPS student response systems to conduct formative assessments for a while, but they recently starting using ECRA Group’s value-added growth model for more long-term program decision-making.
ECRA Group is a consulting firm that helps schools develop research-based analytic solutions to help link student performance to teacher and administrator evaluations and document return on investment for programs and interventions. Salt Creek is using ECRA Group to predict with a high degree of accuracy what a child will do, all factors being equal. “When we evaluate programs on a long-term basis, it’s nice to see if our interventions are working or making things worse,” says Mark Hupp, director of technology.
Recently, an evaluation revealed that one intervention strategy seems to be working. He says that the ECRA rep shared results from a recent high-stakes test and a group of third-grade math students’ results were off the charts. The teacher driving those changes uses eInstruction CPS SRS every day.
With ECRA, the district is able to pinpoint where certain programs and strategies are working. “If that math teaches continues to show growth, others will have to pay attention to what she’s doing,” says Hupp. “It’ll push others to use SRSs.”
Although this type of consulting is costly, the district is in a consortium with other districts to drive costs down, says Hupp. “Years ago systems wanted to aggregate formative assessment data, but that’s impractical. We’re just starting to use propensity scores for measurement, but I think it’s the way to go.”
What Are Districts Saying About Data?
Gartner, Inc., surveyed district leaders, school leaders, technology leaders, and teachers across the country to gauge their attitudes toward the data housed in SIS and LMS solutions. Closing the Gap: Turning SIS/LMS Data into Action also discusses how schools are using this data to improve classroom practice and student learning.
Here are some of the findings from the survey.
53% of teachers using LMS solutions and 61% of those using SIS solutions feel unsure how to best integrate the data into classroom instruction.
80% of school leaders report using the data from their SIS/ LMS solutions to make curriculum and academic program and policy decisions to impact student learning.
37% of school leaders are dissatisfied with their installed SIS solution.
35% of school leaders report being satisfied with their SIS solution.
92% of district leaders report using the data from their SIS/ LMS solutions to make curriculum and academic program and policy decisions to impact student learning.
