Top 5 Takeaways from Visible Learning Institute

My Post (14)

This week, roles were flipped as Steven Anderson and I had an opportunity to learn from John Hattie at the Visible Learning Institute in San Diego. Hattie, a researcher in education, has studied more than 150 million students, synthesizing more than 800 meta-studies to determine the effect size various influences have on teaching and learning. His work disaggregates not only what works in education but what works best. And perhaps most importantly, where we as educators need to concentrate our efforts to support student learning at high levels.

The institute was two days, with Day One led by Hattie and Karen Flories, and covered topics on research, Mindframes, feedback and how to better analyze data. Educators from around the globe had the opportunity to dig into the what, why, and how of the Visible Learning methods while being able to speak directly with both Hattie and Flories. Copious amounts of notes were taken, but the following were our Top 5 Takeaways from the first day of learning.

Top 5 Takeaways from the Visible Learning Institute:

  1. Upscaling Success – Upscaling is not typically seen in education. In fact, Hattie states that “all you need to enhance achievement is … a pulse.”  Every teacher can have success in terms of student achievement in their classroom, this is why every teacher can argue that they have evidence that what they are doing works. Hattie urges us all, “Do not ask what works – but works best!” Identify what works best for your students and upscale those practices school-wide. In most cases, it takes 10-12 weeks to see the results of new instructional methods tried with students. During that time we need to have the “sticktoitness” to follow through. But we also have to be mindful that we may not see the results we want and not be afraid to leave practices behind that just don’t work. If something works, upscale it. If it doesn’t abandon it and move on to something that does.
  2. Goldilocks Principle – “Not too hard, Not too boring.” In alignment with current brain research, Hattie introduced us to the Goldilocks Principle. In terms of learning, students prefer learning to be a challenge, but not too hard that success is impossible and also learning that is relevant and engaging. This also ties back to ability grouping and how the research shows that just isn’t what is best for students, especially those that are struggling. When we group students by ability, educators naturally slow down their teaching to ensure everyone “got it.” Rather, what should take place is a heterogeneous mix of ability levels where a challenge is the norm. Our brains, and especially those that are developing, crave a challenge.
  3. Assessment-Capable Learners – Flories introduced the concept of Assessment-Capable Learners, claiming that they should know the answers to 3 Key Questions of Visible Learning: What am I learning? How will I know I’ve been successful in my learning? What evidence can I provide to support I’ve learned? Students who can answer these questions have teachers who see learning through the eyes of their students and help them to become their own teachers. Learning can’t be a mystery to students. Nor can it be just a repetition of facts and figures. Teacher clarity has an effect size of 0.75. The more we are clear with students of what we are doing, why we are doing it and how we will know we’ve done it, the more they learn. As part of this, we would add a fourth question students should be able to answer. How will I communicate what I’ve learned to others? Not only should the learning reside within the student, but there must also be opportunities for them to share with that they know.
  4. Know Thy Impact – Repeated throughout the Institute, “Know Thy Impact”, Hattie argues that the most important Mindframe of Visible Learning is when teachers understand their job is to evaluate their own impact on student learning. Acknowledging the word “Impact” is ambiguous, Hattie sheds light that the conversations in schools relating to the definition of Impact solidify what each school views as important in terms of learning with Their students but should include triangulation of scores, student’s voice, and artifacts of student work. When educators Know Their Impact, they make better decisions on student learning success.
  5. Feedback – Flories ended the day with a focus on feedback and the .70 effect size on student learning. Startling statements were shared. “80% of feedback that kids get is from each other and 80% of that feedback is wrong – Nuthall.” And “Effective feedback doubles the speed of learning – Dylan William”. Student Feedback should be targeted to close the gap in their learning, and used by students to understand the next steps in their learning. Effective feedback begins with teacher clarity when designing and delivering tasks. Good feedback isn’t just focused on the tasks. (And actually, the feedback that is focused exclusively on task doesn’t show students grow anyway.) The feedback that does the most good is that on the self, the personal evaluation of the learner, and done during the process, not at the end. Feedback is just in time, just for me, information delivered when and where it can do the most good.

By the end of the first day, we had taken an endless supply of notes and had much to digest and discuss. What is even more clear to us now is that while much of what we learned feels like common sense to us, it serves as a good reminder and new learning for some.

Hattie says there are no bad teachers; just Good Teachers and Great Teachers. What separates the two is the willingness to know thyself, know thy students and know thy impact. Those that do not only have students who are high achievers but they also have students who are fully prepared for what’s next.

In our next post, we will look at the 5 Takeaways from Day Two where we dove into Visible Learning in the Literacy Classroom with Nancy Frey.

Measuring Up: 6 Focus Areas for Blended Curriculum Assessment

MUL2.0_Demo_Intro_MDR.jpg

It is true, not all curriculum is created equal. There are specific things I look for when reviewing a curriculum to make the best decisions for kids and teachers. So when my friends at We Are Teachers asked me to take a look at, Measuring Up, a blended curriculum for grades 2-8, I was eager to check it out and provide feedback.

This post is sponsored by We Are Teachers and Mastery Education. All opinions expressed are my own. (Meaning, if I don’t like something about a particular education product I will not write about it on my blog)

I immediately recognized many positives while reading through the sample curriculum:

  • Concepts connected by what students will learn; to what they may already know; to real-world examples.
  • Academic vocabulary in context.
  • Scaffolded learning with guided instruction and gradual release of responsibility.
  • Apply learning independently.

Along with the previous list, two things stuck out to me about Measuring Up that I appreciate as a professional. First, the instruction is done by the expert classroom teacher, not the computer; and second, the Measuring Up Live 2.0 version aligned with my view on student-learning and assessment which they have streamlined through the use of computer applications.

6 Focus Areas for Blended Curriculum Assessment:

  1. Practice – Whether it is a high-stakes test or a certification exam; assessment practices are shifting from paper and pencil to an online version for a variety of reason (costs, access, data disaggregation, etc.) When students have little to no practice or frame of reference to online testing, anxiety rises and results are impacted. Blended curriculum should contain both digital and analog assessment options, as well as multiple types of assessment students,  can take in both a low-stake and high-stakes environment.  
  2. Cognitive Demand – If students have limited interaction and touches on devices when it comes to testing, all of their cognitive energy is wasted on how to manipulate the computer instead of answering the questions. Cognitive energy is best used for thinking critically and demonstrating understanding. From drag and drop to typing extended answers, when students have little access to the types of computer assessments they will take in their schooling and life, cognitive demands are misplaced on basic computer skills.
  3. Adaptive – When evaluating curriculum, edtech options for assessment should include adaptive measures, meaning, the test is sensitive to the answers the student provides and modifications are made based on answers. This ensures that the just right measures are used to gauge what the student knows and what they are not understanding.
  4. Feedback – Feedback is another area I explore when looking at assessment provided by curriculum with blended components. Feedback could come in the form of immediate grading, but could also provide extensions and reinforcement. All of these provides students with an understanding of what they have mastered and what additional support they can access to continue refining their learning.
  5. Mastery and Goal Setting – Curriculum that provides assessment should be aligned to the standards and instruction. It should provide a clear picture as to which skills and standards the students have mastered, what they have left to master and provide a direction on how to move forward. Measuring up provides students and teachers this information, as well as a way for students to set their own learning goals.
  6. Informs Instruction – FInally, data collected is useless unless it is used to inform instruction. Along with providing formative and summative student information, an assessment done via technology streamlines the process of accessing, disaggregating, and changing instruction to best meet students’ needs.

Curriculum cycles are a part of every district I have worked with over the past 10 years. Making the most informed purchasing decisions helps educators in their instruction and assessment of students. While all companies and curriculum writers provide unique frameworks or specialty components, be sure that any curriculum claiming to be blended places value in the professional and contains a comprehensive assessment system, similar to that of Measuring Up,  with a focus on the 6 areas above.

Assessment Types Explained for Educators

My Post (1)

Assessment in Education, in the early years, typically took the form of oral evaluation. Tests were subjective, often performed at the front of the classroom, and largely teacher directed; posing questions to the student around typical areas of mastery needed to pass to the next grade level. From there, assessing students took its traditional form (students at their desk and a paper/pencil test) in the late 1890s following the institution of letter grades (A, B, C, etc.) to replace the teacher’s subjective measure of a student’s ability.

The first standardized test in education was the Stone Arithmetic Test (the Early 1900s) and the SATs made its way onto the education landscape in the 1930s as a way to check a student’s readiness for college.

Current trends in education have seen an increase in testing and making data-driven decisions, but in the era of TLA (another Three Letter Acronym), the volume of assessments educators and districts can/have to use often leads to confusion. The following is a list of assessment terms that are commonly found in education and my simple definition and use of them.

Types of Assessment

Type Who Purpose Examples
Formative Assessment – formal and informal assessment to monitor and provide feedback on student understanding of targeted learning goals. Formative assessment is frequent and ongoing; it is not typically graded. Whole Class Formative assessment is used to inform teacher instruction and by students to set goals and next steps. Exit Slips, Games, Pretest,3-2-1
Summative Assessment –   culminating assessment used to evaluate student learning, skill acquisition, and achievement. It typically occurs at the end of a unit, lesson, semester, or year. It is commonly considered “high-stakes” testing and is graded. Whole Class Demonstration of understanding by the student. Project, Portfolio, Test, Paper
Screener –  a valid, reliable, evidence-based assessment used to indicate or predict student proficiency or identify those at-risk. Screeners are brief, identify the “who”, and are given a few times a year. Whole Class or Targeted Group Identification of students at-risk and who need additional support. AIMSweb, DIBELS, FAST, EasyCBM, iReady, STAR
Diagnostica tool used to provide insights into a student’s specific strengths and weaknesses. The data collected provides the teacher with specific skills to target when designing individualized instruction. Diagnostic Assessments identify the “what” for the student. Individual Student After a student has been identified via a screener, a diagnostic assessment is used to determine specific areas of focus. Error analysis of literacy progress monitoring data, Phonics Inventory, Reading Miscue Analysis
Progress Monitoring a tool used to assess student’s academic performance and rate of growth on individualized or targeted instruction. Individual Student To ensure the response to instruction is helping students grow in a targeted area. Based on specific intervention or instruction. The diagnostic tool can be used if there are multiple forms available.
Norm-Referenced Assessment – compares student’s performance to the “average student” score. The “average student” score is constructed statistically selected group of test takers, typically of the same age or grade level, who have already taken the exam Whole Class, Whole Grade Level Designed to rank test takers on a bell curve. Used to determine how students in a particular school or district are ranking to others who take the same test. Standardized tests. California Achievement Test, Iowa Test of Basic Skills, Stanford Achievement Test, and TerraNova.
Criterion-Referenced Assessment –  measures student performance against a fixed set of standards or criteria that are predetermined as to what a student should be able to do at a certain stage in education. The score is determined by the number of questions correct. Whole Class Can be both high-stakes (used to make decisions about students, teachers, schools, etc.) or low-stakes (used for student achievement, adjusting instruction, etc.) Multiple choices, true/false. Short answer or a combination. Can be teacher designed.
Benchmark Assessment – Fixed assessments (also called interim assessments) to measure a students progress against a grade-level or learning goal. Often given in-between formative and summative assessments. Whole Class or Individual Student Used to communicate to educators, students, and parents which skills are important to master and student’s progress (so far) towards those learning goals. Fountas and Pinnell, Reading A to Z Benchmark Passages
Other Assessment Terms You May Encounter
CFAs (Common Formative Assessments) Assessment that is collaboratively created and agreed upon by a group or grade-level team to measure students attainment of the learning goals.
Alternate Assessment Assessments for students with severe cognitive disabilities. Tests have less depth and breadth than the general assessment. (Small number of kids on IEPs that are unable to take the general test)
Alternative Assessment Also called authentic assessment or performance assessment. Alternative assessment is in contrast to the traditional standardized test and focuses on individuals progress, multiple ways to demonstrate understanding)
Authentic Assessment Replicates real-world challenges that experts or professionals in the field encounter. Used to not only demonstrate mastery of learning goals or standards but also critical thinking skills and problem-solving. (Students construct, respond, or produce to demonstrate understanding)
Synoptic Assessment Combines multiple concepts, units, or topics in which a single assessment requires students to make connections between the learning. A holistic approach to assessment and the interconnectedness of learning.
Quantitative Data Data collected that can be measured and written down in numbers.
Qualitative Data Data collected that is more subjective and speaks to the expertise of the teacher to provide their opinion based on trends and past experiences.

 

The ability to choose the right assessment that meets the needs of students and teachers is essential. Most often, confusion does not occur between the differences between formative and summative assessments. Through my own work with districts and educators across the nation, I have found a need to clarify the definition and purpose between a Screener, Diagnostic Tool, and Progress Monitoring. These three assessment types are essential when digging deep into student needs and help to inform instruction.

Resources to Explore:

My Collection of Edtech Tools for Assessment

List of Screeners

List of Diagnostic Tools

Progress Monitoring List

Authentic Assessment

Everything You Wanted to Know About Formative Assessment But Were Afraid to Ask…

Recently Steven Anderson and I had an engaging discussion on the topic of Formative Assessment for ACER Education. Check out what we had to say.


Some of the highlights:

What Is Formative Assessment—As you can tell from our video, there are many ways to describe formative assessment. Simply put, Formative Assessment is taking a pause in learning to ensure students are where they need to be for a particular lesson. The best formative assessments are subtle, giving teachers an overall picture of how students are learning and adapting to their immediate needs. Think of it as a GPS for the teacher—knowing where students are in their learning and where you should head in your teaching.

Formative Assessment could also look like “check-in” questions at the end of a lesson or class, offering valuable information on which direction to head next. Formative Assessments should not be graded assessments. At the end of the day, the goal is to get a pulse on what students know and how effectively the teacher is teaching the material.

But Why Formative Assessment-From the ASCD Book Formative Assessment Strategies for Every Classroom: An ASCD Action Tool, 2nd Edition, Susan Brookhart explains that:

Formative Assessment refers to the ongoing process students and teachers engage in when they:
● Focus on learning goals.
● Take stock of where current work is in relation to the goal.
● Take action to move closer to the goal.

Students and teachers who are engaged in the Formative Assessment process are constantly examining how teaching and learning work as one If we look at Hattie’s Effect Size, or practices that best move student learning forward, Providing Feedback, Providing Formative Evaluation, and Self-Questioning had anywhere from a 0.64 to 0.68 effect size. What do these results show us? These studies show us that students and teachers who engage in the Formative Assessment process learn and retain more information compared to take-home homework.

Low-Tech Formative Assessment- Technology can make the collection of data related to Formative Assessment easier, but it’s not necessary. We’ve seen a variety of different low-tech ways to gauge student understanding. From dry erase boards where students can write the answer to a question, to sticky notes exercises that can act as an open-forum, Formative Assessment does not require a large investment to make a large impact.

Is There Hardware Designed For Formative Assessment? In fact, there is. Shaelynn and I are partnering with ACER Education to take a look at their new TravelMate Spin B118. It’s a dynamic, classroom-specific device that was built with Formative Assessment in mind. It comes with their ACER TeachSmart software that makes use of LED lights built into the lid of the device. This allows the teacher to ask Formative Assessment questions in the middle of a lesson and students can change their lights simply and easily. The lights could stand for anything—ABCD, Yes/No, I’ve got it/I don’t understand.

The TravelMate Spin B118 is also equipped with a digital pen and Windows Ink that allows users to sketch, map, annotate, and draw with the ease of a traditional pen and the magic of digital ink. The visual aspect of this tool is not only beneficial for teachers to model skills to students, but students are able to brainstorm, ideate, and prototype during the design process, making this an invaluable tool in the classroom.

Our Favorite Apps and Tools For Formative Assessment We’ve talked about how Formative Assessment can be done without tech. However, when we add that layer into our teaching and learning, we can do so much more. There are many (free!) apps and tools out there that achieve this.

Nearpod— Create lessons and sync them across devices in the classroom, with built-in tools for questioning, drawing, audio and video responses.
RecapApp— One of our favorite tools built for Formative Assessment. Available on any device, students can record their thoughts and feelings on any given lesson. There’s also a questions tool where feedback can be posted.
EdPuzzle— Add an interactive layer to YouTube videos. Teachers can build in short questions at various points in the video to ensure students are getting what they need out of it. This is also great for data collection and seeing how students’ progress over time.
Flipgrid— A very cool way to post video questions and gather responses. Videos can be shared so students can see where their peers are in their learning as well.
Padlet—A virtual board for multimodal sticky notes. Great for tickets out the door or reflection activities.

Acer_Q3_EDU_Banner_640X480_B (1)

3 Essentials for Success in a Blended [Literacy] Classroom

Adobe Spark (13) (1)This post is sponsored by ThinkCERCA, an online platform designed to empower teachers to personalize literacy instruction across disciplines.

The use of digital learning spaces has exploded in use in classrooms nearly everywhere. Through Learning Management Systems (LMS) many educators are moving to put content online and extend learning beyond the four walls and beyond the school day. This Blended Learning approach is both beneficial but its definition can be tough to nail down. Blended Learning is different than merely integrating technology into the classroom. It provides all learners the ability and opportunity to contribute both openly and differently than they would in a traditional classroom. Simply putting a lecture online and calling it blended learning doesn’t cut it. Students need opportunities for collaborating with peers, creating new ideas, and formatively assessing their knowledge, all taking place in the digital environment.

When done correctly, any classroom can benefit from the blended approach, literacy classrooms especially. Literacy learning is unique in that there are both concrete and abstract concepts that work well in face-to-face teaching and in the digital space. We believe there are 3 essentials for success in any blended literacy classroom.

 

  1. Maximizing Physical and Digital Space – In a blended literacy classroom, success is partly attributed to identifying the “best” practices in both the traditional classroom and a digital space and blending them together. Whole class literacy instruction is best-done face to face. From the modeling of the teaching point to the scaffolding of the active engagement, a physical space in which students can gather and learn is preferred. Co-constructing anchor charts and a quick formative assessment during the active engagement provides educators timely information in which to inform instruction. On the other hand, enrichments for learning, differentiated content, and substantive conversations to construct knowledge may be best in a digital space in which the teacher can support student needs on a larger scale and students can personalize learning anytime and anyplace.  When one considers student needs in both a physical and digital space the list looks similar:

 

Instructional Practices Physical Space Digital Space
Whole Class Purpose: Gathering area to learn and share as a whole class, direct instruction

What it Looks Like: A carpet or rug, open area to accommodate students, transition or movement of bodies/tables for older students

Purpose: Shared digital space by all classmates and teacher(s)

What it Looks Like: A forum or class-stream where everyone can view, post, and comment. A repository of accessible resources, information, and tools that students can utilize during learning.

Independent Purpose: Student area to work, learn, and create on their own
What it Looks Like: A desk, table or flexible furniture from Ivy and Wilde, storage space(see selfstorageprices.org.uk), materials
Purpose: Student area to work, learn, and create independently
What it Looks Like: Individual student logins, profile page or virtual “locker” to store materials, information, creations
Small Group Purpose: Area designated to work as a small group of peers or a teacher working with a small group
What it Looks Like: A table; grouping of desks, chairs, or pillows; flexible for student needs and task intent
Purpose: Area designated to work as a small group of peers or a teacher working with a small group
What it Looks Like: A breakout room, group room, or other “digital space” language that designated a spot for students to work together. It may also include a way to assign and share resources peer to group or teacher to group
One on One Purpose: Area designated for partner work, peer conferencing, or teacher to student conferring
What it Looks Like: Conferring table, flexible seating, teacher moves to student
Purpose: Similar to small group with the addition of private peer to peer feedback, teacher to student feedback, messaging
What it Looks Like: Space used can be similar to a small group. Ability to target and differentiate messages and feedback to an individual or privately. Private assessment and gradebook
  1.  Fostering Collaboration and Communication – Although most of our students do not know the world without the internet, collaboration and communication in a digital space does not come naturally to them. In a blended literacy classroom, students are sharing their writing, participating in literature circles, creating multimedia projects in small groups, and providing feedback to each other. A blended environment asks educators to not only support student learning in content areas, it also requires special consideration on how best to grow and support students in a healthy and safe reading and writing community. These skills are often overlooked but essential for success in a blended literacy classroom. To do so, we must foster digital communication and collaboration skills that will impact not only their current learning but their digital footprint as well. One of the best ways is to co-create and establish norms for the blended literacy classroom. Digital space expectations would include communication, collaboration, sharing, messaging, appropriate use, etc. Here are a few to get you started:
  • Communicate effectively when in a digital space.
    • ALL CAPS = Shouting
    • Know your peers/partner/audience, is text lingo appropriate?
    • 3 before Me – have 3 other people read before you publish
  • Recognize all voices in group and peer to peer spaces.
  • Be careful when using jokes or humor online, it is hard to convey meaning through text alone.
  • When providing feedback to peers address them by name, use the PQP Strategy (Praise, Question, Polish), be specific, and sign your name at the end.  
  • During a class discussion on the forum: Be Engaged, Be Active, Be Reflective

 

  1. Accessible Texts and Materials – Finally, recognizing the capability of differentiating content based on student needs in a blended literacy classroom is an essential component for success. With the access to information and support from platforms like ThinkCERCA, blended learning should not limit student choice to one particular text or resource. In fact, through collaboration with the librarian or media specialists, student choice in what they read should increase exponentially. A digital text that is linked to an LMS (Learning Management System) is not blended learning. Blended learning in a literacy classroom includes multiple texts and information that are high interest and available at all independent reading levels. The Common Core State Standards are end goals that are scaffolded and applicable to any content which is seen in the expert reader. Expert readers apply similar skills no matter what they are reading. These transferable strategies are what we intend to fill our students’ toolboxes with and are done so through text in which they can independently access. And just like the fluidity of student interests, so too is their independent reading level. It can change based on prior knowledge, motivation, or interest. When students have endless access to information and texts everyone wins. Fill your blended literacy space as you would a classroom library; full of books, informational texts, articles, media, and audio at all levels and interests!  

 

These 3 Essentials for Blended [Literacy] Learning help to maximize the digital space to support all young readers and writers. Intentional virtual spaces, scaffolding collaboration and communication, and surrounding students with high-interest, accessible texts promote literacy learning and help to raise student achievement that will last a lifetime.

 

Want to learn more? Check out the Administrator Guide to Personalizing Literacy Through Blended Learning from ThinkCERCA! There is also a great webinar on crafting Scalable Blended Literacy Programs worth a watch as well.

Shaelynn Farnsworth is a Digital Literacy Expert in the Iowa. You can follow her on Twitter @shfarnsworth
Steven W. Anderson is a Digital Teaching and Relationship Evangelist. You can follow him on Twitter @web20classroom.