7 Ways to Maximize Hattie’s Effect Size on Feedback

Few would argue the importance of feedback to increase student achievement even without having read the research from John Hattie. With an effect size of .73, Feedback is almost double that of the hinge point .4, making it an effective instructional strategy that is applicable across disciplines and grades. What is clear when distilling information regarding the what & how of effective feedback is that the components are similar in the research and theory but the variability lies in the inhibiting factors and culture of feedback in the classroom.

Top Teaching Strategy according to the research done by John Hattie

So how do we as educators recognize and remedy the variability of feedback to maximize the effect size Hattie found in his meta-analysis involving more than 150 million students to move from Feedback to Punctuating Feedback! as Nuthall and Alton-Lee named it?

Feedback as defined by Hattie and Timperley, “Feedback relating to actions or information provided by an agent (teacher, peer, book, parent, internet, experience) that provides information regarding aspects of one’s performance or understanding.”

Educators and theorists have an often similar definition, relating to students asking and answering: Where am? Where to next? How do I get there?

Punctuating Feedback includes the time given for students to process feedback, an understanding of how to interpret the feedback, and classroom culture to support applying skills gained through the feedback. The greatest impact of feedback occurs when it is supported by effective teaching and learning strategies.

Maximizing a Culture of Feedback

  1. Feedback sits within a formative assessment framework. It includes “where to next” and “how to improve”. Adjusting teaching depends upon this information.
  2. Internal motivation to promote curiosity and willingness to learn and deepen the current understanding. Active involvement by students in their own learning and recognizing growth from where they began to where they are now; not a comparison against other students.
  3. Embedded challenge mindsets, mindframes, metacognition, and deliberate practice, spaced not massed are effective.
  4. Normalizing and celebrating of error is the key to new learning and promotes a culture of actionable feedback.
  5. Equity in learning is maximized through mixed ability grouping.
  6. Feedback needs to be task-related rather than ego-related. Comments vs. grades equal greater gains in student achievement.
  7. All of this is “underpinned in the belief that all students can improve.” (Hattie)

When Effective Feedback is coupled with a Culture to maximize it, variables are lessened and ALL students improve.

Source: John Hattie and Shirley Clarke. Visible Learning Feedback. 2018.

Top 5 Takeaways from Visible Learning Institute

My Post (14)

This week, roles were flipped as Steven Anderson and I had an opportunity to learn from John Hattie at the Visible Learning Institute in San Diego. Hattie, a researcher in education, has studied more than 150 million students, synthesizing more than 800 meta-studies to determine the effect size various influences have on teaching and learning. His work disaggregates not only what works in education but what works best. And perhaps most importantly, where we as educators need to concentrate our efforts to support student learning at high levels.

The institute was two days, with Day One led by Hattie and Karen Flories, and covered topics on research, Mindframes, feedback and how to better analyze data. Educators from around the globe had the opportunity to dig into the what, why, and how of the Visible Learning methods while being able to speak directly with both Hattie and Flories. Copious amounts of notes were taken, but the following were our Top 5 Takeaways from the first day of learning.

Top 5 Takeaways from the Visible Learning Institute:

  1. Upscaling Success – Upscaling is not typically seen in education. In fact, Hattie states that “all you need to enhance achievement is … a pulse.”  Every teacher can have success in terms of student achievement in their classroom, this is why every teacher can argue that they have evidence that what they are doing works. Hattie urges us all, “Do not ask what works – but works best!” Identify what works best for your students and upscale those practices school-wide. In most cases, it takes 10-12 weeks to see the results of new instructional methods tried with students. During that time we need to have the “sticktoitness” to follow through. But we also have to be mindful that we may not see the results we want and not be afraid to leave practices behind that just don’t work. If something works, upscale it. If it doesn’t abandon it and move on to something that does.
  2. Goldilocks Principle – “Not too hard, Not too boring.” In alignment with current brain research, Hattie introduced us to the Goldilocks Principle. In terms of learning, students prefer learning to be a challenge, but not too hard that success is impossible and also learning that is relevant and engaging. This also ties back to ability grouping and how the research shows that just isn’t what is best for students, especially those that are struggling. When we group students by ability, educators naturally slow down their teaching to ensure everyone “got it.” Rather, what should take place is a heterogeneous mix of ability levels where a challenge is the norm. Our brains, and especially those that are developing, crave a challenge.
  3. Assessment-Capable Learners – Flories introduced the concept of Assessment-Capable Learners, claiming that they should know the answers to 3 Key Questions of Visible Learning: What am I learning? How will I know I’ve been successful in my learning? What evidence can I provide to support I’ve learned? Students who can answer these questions have teachers who see learning through the eyes of their students and help them to become their own teachers. Learning can’t be a mystery to students. Nor can it be just a repetition of facts and figures. Teacher clarity has an effect size of 0.75. The more we are clear with students of what we are doing, why we are doing it and how we will know we’ve done it, the more they learn. As part of this, we would add a fourth question students should be able to answer. How will I communicate what I’ve learned to others? Not only should the learning reside within the student, but there must also be opportunities for them to share with that they know.
  4. Know Thy Impact – Repeated throughout the Institute, “Know Thy Impact”, Hattie argues that the most important Mindframe of Visible Learning is when teachers understand their job is to evaluate their own impact on student learning. Acknowledging the word “Impact” is ambiguous, Hattie sheds light that the conversations in schools relating to the definition of Impact solidify what each school views as important in terms of learning with Their students but should include triangulation of scores, student’s voice, and artifacts of student work. When educators Know Their Impact, they make better decisions on student learning success.
  5. Feedback – Flories ended the day with a focus on feedback and the .70 effect size on student learning. Startling statements were shared. “80% of feedback that kids get is from each other and 80% of that feedback is wrong – Nuthall.” And “Effective feedback doubles the speed of learning – Dylan William”. Student Feedback should be targeted to close the gap in their learning, and used by students to understand the next steps in their learning. Effective feedback begins with teacher clarity when designing and delivering tasks. Good feedback isn’t just focused on the tasks. (And actually, the feedback that is focused exclusively on task doesn’t show students grow anyway.) The feedback that does the most good is that on the self, the personal evaluation of the learner, and done during the process, not at the end. Feedback is just in time, just for me, information delivered when and where it can do the most good.

By the end of the first day, we had taken an endless supply of notes and had much to digest and discuss. What is even more clear to us now is that while much of what we learned feels like common sense to us, it serves as a good reminder and new learning for some.

Hattie says there are no bad teachers; just Good Teachers and Great Teachers. What separates the two is the willingness to know thyself, know thy students and know thy impact. Those that do not only have students who are high achievers but they also have students who are fully prepared for what’s next.

In our next post, we will look at the 5 Takeaways from Day Two where we dove into Visible Learning in the Literacy Classroom with Nancy Frey.

Writer’s Workshop in the High School Classroom

My Post (9)

Typically, the discussion around Workshop takes place against the backdrop of the elementary classroom. When I tell other educators I also used workshop in my high school classes I am inundated with endless questions… How did you do that? What curriculum did you use? How much time did you have?

First, before jumping into the weekly schedule and content I used, I always explain a few things up front.

Logistics and Important Information About My Classroom:

  • Class periods were 42 minutes and I met with the students every day for one semester.
  • I worked hard at the beginning to build a community of writers, one where students would be willing to take risks in their style and content and share with a wider audience than the traditional lone teacher.
  • All students submitted a writing portfolio at the end of the course, sharing their chosen pieces, paragraphs, lines, etc. which demonstrated mastery in standards.
  • All students were required to complete, at least, three typed-pages every week of original work or one that was heavily revised and edited.
  • Students were part of a blogging community and required to post something every other week and comment on 2 other blog posts every week. This public sharing of work provided a different audience than the traditional lone teacher and helped grow writers faster than anything else I had done throughout my writing. (This community was high school students from across the US and in 4 different classrooms.)
  • Students chose content and type of writing each week. Portfolio asked for examples in multiple types, subgenres, and media; but students had complete control over the when, what, and how during the semester.
  • Along with typical types and subgenres of writing, students also created and wrote in contemporary modes including images, videos, music, infographics, etc.
  • Every two to three weeks students turned in a “publishable piece” to be assessed.
  • Finally, I wrote with my students. I modeled my thinking, shared my pieces, and asked for feedback!  

 

I used the traditional Workshop model where I tried to keep my direct instruction at a minimum so that students could write, apply the learning, and collaborate with each other and me when needed. The following is a typical weekly schedule. During student Independent Writing time they had three options: write, collaborate with peers, collaborate with me. As long as their actions were done with intent, the climate and culture in my classroom allowed them to decide what they needed most at that moment to move them forward as a writer, and then do it!

A Simplified weekly schedule of Writer’s Workshop for a 12th-grade writing class:

MondayInspiration. Brainstorm. Share Every Monday I would take time to launch students into writing. I called this “Monday Inspiration”. There were many methods I used to get kids excited about writing. Students were inspired by a mentor text, video, image, or other types of communication. I would pose a question or prompt to contemplate and write about. Students would take part in an inspiring writing activity that typically had them developing lists, sketching, moving, and so forth. All inspiration and accompanying thinking were recorded in their digital Writer’s Notebook section we labeled, Writing Territories, a term from Nancy Atwell. After the 10 to 15 minute inspiration, students would continue to brainstorm and write about the topic or in the genre at hand. This beginning may be something that they continue to develop throughout the week, or remain in their Writing Territories to call upon if they “don’t know what to write about.” At the very end of the class period, I would make sure to leave time to share. I learned early on, students loved sharing their thoughts, writing, and ideas on Monday after the inspiring start. The sharing was sometimes done as a whole class or in a small group.

TuesdayIndependent Writing. Peer Collaboration. Small Group. 1 on 1  On Tuesday, students were writing or creating independently on a piece of their choice. While they could continue the piece they started on Monday, students in my classroom always had a choice in Type and content of their writing. During this time, I worked with small groups, to teach a skill, reinforce something previously learned, or meet individual needs, collectively. I also had time to meet with a few students 1 on 1. This allowed me to know them as writers, address specific needs that either they or I identified, and to just do a check-in on their process. Along with working independently, or meeting with me, students also had the option to work with a partner or small group. During a writer’s workshop, students are at multiple points in the writing process. Some continued pieces week to week, others may just be in the beginning stages; students would revise, edit, and provide feedback to each other and their “virtual classmates” in the blogging community based on their needs as a writer.

Wednesday Language Study. Independent Writing. Portfolio. Blog. On Wednesdays, the class period began with a lesson over grammar, usage, or mechanics. Teaching grammar in isolation does not lead to use in writing. With this in mind, I used student writing, identify common errors made by the class and this is where I would focus my teaching. After the lesson, students continue to write or work with peers. Wednesday was also time for students to work on their writing portfolio, a collection of their best examples and reflections throughout the year and aligned to the standards or teaching goals. Students could also add a new post to their blogs or leave a comment on another student blog from our community.  

Thursday –  Independent Writing. Revising. Editing. Small Groups. 1 on 1. Thursday was spent much like Tuesday. Students chose how they spent their time based on their writing needs. Some worked independently, others worked with a partner or small group. During the revising and editing stages, students used a variety of strategies to accomplish their goals. These strategies were taught via whole class and small groups. They also prepared for Friday, making sure they had something of substance to share the following day. I spent my time working one on one with students, teaching specific techniques that would move them forward as writers.  

FridaySharing with Feedback. Fridays were typically spent sharing writing. To help build a community of growth, we started off sharing in small groups of 3 using the PQP strategy (Praise, Question, Polish by Bill Lyons). This allows the writer to receive the specific feedback needed. Another method used was Go, Fish, a whole class strategy that allowed every writer to give and receive feedback. An Author’s Spotlight was used to highlight individuals and often included multiple pieces by 2 or 3 writers. Important things about students sharing their writing: Everyone shared what they wanted to with the rest of the class, feedback was specific (more strategies were taught for this) and used to move everyone forward, finally, sharing their writing honored the process and provided a different audience than the traditional lone teacher.

It is possible to use a workshop framework in a high school classroom. In fact, I cannot imagine teaching writing a different way. Students had a choice in content and writing type. They also shared their work with classmates and to a larger, public audience. Students were writing for real, not just writing for school, and created in multiple mediums to communicate their voice through video, text, visuals, and more. And although this post shared a basic structure, I hope that it provided you with enough information to see the possibilities when considering how to structure a writer’s workshop in your own classroom.

Measuring Up: 6 Focus Areas for Blended Curriculum Assessment

MUL2.0_Demo_Intro_MDR.jpg

It is true, not all curriculum is created equal. There are specific things I look for when reviewing a curriculum to make the best decisions for kids and teachers. So when my friends at We Are Teachers asked me to take a look at, Measuring Up, a blended curriculum for grades 2-8, I was eager to check it out and provide feedback.

This post is sponsored by We Are Teachers and Mastery Education. All opinions expressed are my own. (Meaning, if I don’t like something about a particular education product I will not write about it on my blog)

I immediately recognized many positives while reading through the sample curriculum:

  • Concepts connected by what students will learn; to what they may already know; to real-world examples.
  • Academic vocabulary in context.
  • Scaffolded learning with guided instruction and gradual release of responsibility.
  • Apply learning independently.

Along with the previous list, two things stuck out to me about Measuring Up that I appreciate as a professional. First, the instruction is done by the expert classroom teacher, not the computer; and second, the Measuring Up Live 2.0 version aligned with my view on student-learning and assessment which they have streamlined through the use of computer applications.

6 Focus Areas for Blended Curriculum Assessment:

  1. Practice – Whether it is a high-stakes test or a certification exam; assessment practices are shifting from paper and pencil to an online version for a variety of reason (costs, access, data disaggregation, etc.) When students have little to no practice or frame of reference to online testing, anxiety rises and results are impacted. Blended curriculum should contain both digital and analog assessment options, as well as multiple types of assessment students,  can take in both a low-stake and high-stakes environment.  
  2. Cognitive Demand – If students have limited interaction and touches on devices when it comes to testing, all of their cognitive energy is wasted on how to manipulate the computer instead of answering the questions. Cognitive energy is best used for thinking critically and demonstrating understanding. From drag and drop to typing extended answers, when students have little access to the types of computer assessments they will take in their schooling and life, cognitive demands are misplaced on basic computer skills.
  3. Adaptive – When evaluating curriculum, edtech options for assessment should include adaptive measures, meaning, the test is sensitive to the answers the student provides and modifications are made based on answers. This ensures that the just right measures are used to gauge what the student knows and what they are not understanding.
  4. Feedback – Feedback is another area I explore when looking at assessment provided by curriculum with blended components. Feedback could come in the form of immediate grading, but could also provide extensions and reinforcement. All of these provides students with an understanding of what they have mastered and what additional support they can access to continue refining their learning.
  5. Mastery and Goal Setting – Curriculum that provides assessment should be aligned to the standards and instruction. It should provide a clear picture as to which skills and standards the students have mastered, what they have left to master and provide a direction on how to move forward. Measuring up provides students and teachers this information, as well as a way for students to set their own learning goals.
  6. Informs Instruction – FInally, data collected is useless unless it is used to inform instruction. Along with providing formative and summative student information, an assessment done via technology streamlines the process of accessing, disaggregating, and changing instruction to best meet students’ needs.

Curriculum cycles are a part of every district I have worked with over the past 10 years. Making the most informed purchasing decisions helps educators in their instruction and assessment of students. While all companies and curriculum writers provide unique frameworks or specialty components, be sure that any curriculum claiming to be blended places value in the professional and contains a comprehensive assessment system, similar to that of Measuring Up,  with a focus on the 6 areas above.