Tag Archives: formative assessment

T3 International Conference: sketch notes for learning

2016 T³ International Conference
February 26-28, 2016, Orlando, Florida

Dylan Wiliam: Leadership for Teacher Learning

“Nothing has bigger impact on student learning than formative assessment.” How might we learn, grow, and change our habits.  What if we expect proficiency for all and excellence for many? How might we focus on learning to impact outcomes?

Wiliam02

Dylan Wiliam: Using Formative Assessment to Improve Instruction

How might we impact learning? Know and show what is essential to learn. Seek evidence that learning occurs. Strengthen relationships with learner.  Ask: what will have the biggest impact for student learning?

Wiliam03

Dylan Wilam: Protocol for Questions

How might we elicit evidence of learning? 1) High quality task selection. 2) High quality task presentation. 3) Know what evidence we are looking for. 4)  Empower learners to accumulate evidence so show and now they are learning.

Wiliam01

Focus on learning: build a team – Embedding Formative Assessment VTR SPW

What if we collect evidence of progress to plan for next steps in learning?

image

What if we take up a series of 30 Day Challenges: Step outside your comfort zone! as described in Justin Cahill’s linked post? Justin (@justybubpe) writes:

How about professionally? How can I apply the 30-day challenge to my job as a physical education teacher? How can I use this challenge to motivate my students? How can I take advantage of trying something new for 30 days to help bolster my planning and strengthen my curriculum? How will I answer all of these questions in under 30 days?

What if we focus on learning? When we set goals, are we committed to reaching them? What if we set micro-goals and action-steps that move our learning forward regularly?  How might we choose to team to step outside our comfort zone for 30 days to shift our practice to more formative assessment?

What if we choose to build a supportive accountability team to carve out moments for self- and peer-assessment?

Four weeks appears to be a minimum period of time for teachers to plan and carry out a new idea in their classroom. (Wiliam, 22 pag.)

How might we shift to grow from

a knowledge-giving business to a habit-changing business? (Wiliam, 19 pag.)

What if we try for 30 days?

Indeed, the evidence suggests that attention to classroom formative assessment can produce greater gains in achievement than any other change in what teachers do. (Wiliam, 11 pag.)

How might we try for 30 days?

Viewed from this perspective, choice is not a luxury but a necessity. (Wiliam, 15 pag.)


Cahill, Justin. “30 Day Challenges: Step outside Your Comfort Zone!” Keeping Kids in Motion. WordPress, 06 Jan. 2016. Web. 08 Jan. 2016.

Wiliam, Dylan, and Siobhán Leahy. Embedding Formative Assessment: Practical Techniques for F-12 Classrooms. West Palm Beach, FL: Learning Sciences, 2015. Print.

Agents of formative assessment – Embedding Formative Assessment VTR SPW

Anyone – teacher, learner, or peer – can be the agent of formative assessment. (Wiliam, 8 pag.)

I wonder if we have a common understanding of formative assessment.  I like the following from Dylan Wiliam and Paul Black (2009).

image

…evidence elicited, interpreted, and used…to make decisions…

How might we empower every learner in our community to act as an agent of formative assessment?  What if we all use evidence of student learning to make decisions about next steps?

What if we team to clarify and share learning intentions and success criteria? How might we diagnose where learners are and start from there? While we already offer some feedback, what if we are intentional about the messaging in our feedback? Do learners know where they are now and where we want them to go next?

The third strategy emphasizes the teacher’s role in providing feedback to the students that tells them not only where they are but also what steps they need to take to move their learning forward. (Wiliam, 11 pag.)

How might we increase the frequency of feedback loops to offer feedback in the moment rather than the next day?

But the biggest impact happens with “short-cycle” formative assessment, which takes place not every six to ten weeks but every six to ten minutes, or even every six to ten seconds. (Wiliam, 9 pag.)

image

If we want the biggest impact, we need help.  Are our learning intentions and success criteria clear and visible to learners? Do we offer moments for self- and peer-assessment? How might we grow in our ability to give high quality feedback that enables learners to move forward?

If anyone can be an agent of formative assessment, how might we team to offer big impact?


Wiliam, Dylan, and Siobhán Leahy. Embedding Formative Assessment: Practical Techniques for F-12 Classrooms. West Palm Beach, FL: Learning Sciences, 2015. Print.

 

Deep Practice, Leveling, and Communication (TBT Remix)

Does a student know that they are confused and can they express that to their teacher? We need formative assessment and self-assessment to go hand-in-hand.

I agree that formative self-assessment is the key. Often, I think students don’t take the time to assess if they understand or are confused. I think that it is routine and “easy” in class. The student is practicing just like they’ve been coached in real time. When they get home, do they “practice like they play” or do they just get through the assignment? I think that is where deep practice comes into play. If they practice without assessing (checking for success) will they promote their confusion?  I tell my students that it is like practicing shooting free throws with your feet perpendicular to each other. Terrible form does not promote success. Zero practice is better than incorrect practice.

With that being said, I think that teachers must have realistic expectations about time and quality of assignments. If we expect students to engage in deep practice (to embrace the struggle) then we have to shorten our assignments to accommodate the additional time it will take to engage in the struggle.  We now ask students to complete anywhere from 1/3 to 1/2 as many problems as in the past with the understanding that these problems will be attempted using the method of deep practice.

Our version of deep practice homework:
“We have significantly shortened this assignment from years past in order to allow you time to work these questions correctly. We want you do work with deep practice.

  • Please work each problem slowly and accurately.
  • Check the answer to the question immediately.
  • If correct, go to the next problem.
  • If not correct, mark through your work – don’t eraseleave evidence of your effort and thinking.
    • Try again.
    • If you make three attempts and can not get the correct answer, go on to the next problem. “

I also think that the formative assessments with “leveling” encourage the willingness to struggle. How many times has a student responded to you “I don’t get it”? Perhaps it is not a lack of effort. Perhaps it is a lack of connected vocabulary. It is not only that they don’t know how, is it that they don’t know what it is called either. It is hard to struggle through when you lack vocabulary, skill, and efficacy all at the same time. How might we help our learners attend to precision, to communicate in the language of our disciplines?

Now is the time to guide our young learners to develop voice, confidence (and trust), and a safe place to struggle.


Deep Practice, Leveling, and Communication was originally published on November 20, 2010

 

Reflection, Attitude, and Efficacy (TBT Remix)

How can we promote success-oriented behaviors to foster learning and self-efficacy?

I dare you to read the following journal entries but replace the word math with assessment or whatever you are struggling to learn right now.  Out of the mouth of babes


 

I’ve been rereading journal entries from August to reflect on the growth of children I coach to learn algebra.  The point of this particular journal entry was to help assess disposition.

Can we effect their growth in algebra AND their growth as learners? Can changing our assessment practices and our approach to learning help them learn to embrace the struggle, to see that a “failure” is an opportunity to learn?  Does success breed success?  Does success change your confidence, efficacy, and disposition?

How can we help failure-avoidant students grow to become success-oriented learners?  Are most learners both success-oriented and failure-avoidant with a strong preference for one or the other?

Wait… I choose to revise my question.  How can we promote success-oriented behaviors to foster learning and self-efficacy?

What do you think?
Is QB success oriented, failure avoidant, or both?

 
The reason why I chose a picture of a person repelling or climbing a mountain is because math is a mountain for me. A mountain is an object that you cannot go through or around. The only way to get to the top of the mountain is by climbing. Math for me is a mountain. I can only climb my way to the top. There will be slips and falls along the way but, that is the only way to get to the top of the mountain. Every step I take teaches me something about that mountain. When you climb to the top of the mountain you can look back and say all those little slips and falls taught me something about that mountain, but now I can see all those tiny steps added up.”

Every step I take teaches me something about that mountain. When you climb to the top of the mountain you can look back and say all those little slips and falls taught me something about that mountain, but now I can see all those tiny steps added up.”

I love this child; he spends many hours with me learning and improving.  We have two classes together, and he chooses to work with me after school several days each week.  When I read his journal on the first day of class, I put him in the success-oriented category.  As I have worked with him this semester, I have seen him on a rollercoaster ride, struggling to not lapse into failure-avoidant behaviors.  I believe it is my job is to be his cheer-master, his coach, and his support.  I want to coach him to find his strenghts and successes.

The same day, CL wrote:

I think this picture best describes my experiences in math for a lot of reasons. If you look at the girl’s face, it seems like she doesn’t know what she is doing. But if you look at her body, she seems to be doing the right thing. This is like me in math in a way. A lot of times I am doing the right steps, but I still think I am wrong. Like the girl in the photo, I don’t believe I am doing the right steps (or moves in her case). My feelings toward math are basic. I don’t love math, but I don’t hate it. Math also doesn’t come naturally to me. I have to work hard at something until I really understand it. I am more interested in math that we use every day than just random lessons. I also like to know the why in things. Like “Why do we use this trick?”. The why and how are keys words for me in learning math. I think my job in math is to learn new things, listed to the students and other students and the teachers, and to help others learn. I believe math is very helpful in everyday situations. I also believe math is hard, but if you work hard enough you will understand it. I want to learn from my mistakes in math. I also need different techniques to learn from if one doesn’t work. Lastly, my goal this year in math is to maintain a high grade by fully understanding the material.

 

How often do we make curricular decisions based on what we think we see?  Are we looking at the face or the body?  How often do we assume that our students are learning?  Do we check for evidence of learning – not grade – really check for proof?   When we see the body doing the right things, do we ignore the face?  Do we check for confidence?  I fear that we may promote failure-avoidant behaviors if we are not careful.

CL wrote:

If you look at the girl’s face, it seems like she doesn’t know what she is doing. But if you look at her body, she seems to be doing the right thing.”  

How do we give our learners enough feedback so that they know that they are doing the right work?  How do we build up their confidence so that they will either feel successful or know that it is safe (and encouraged) to ask questions to learn and grow?  How do we reward effort and willingness to struggle to learn without giving students a false impression of their achievement?

CL:

I want to learn from my mistakes in math. I also need different techniques to learn from if one doesn’t work.

Me too!  If we don’t assess learning and offer feedback in the midst of the experience, how will we know if we are promoting learning for all?  How will we know if some (or all) need a different approach? Again, we must be careful to promote success-oriented behaviors.

I also think that my team and I spend a fair amount of time in CL’s shoes.

A lot of times I am doing the right steps, but I still think I am wrong. Like the girl in the photo, I don’t believe I am doing the right steps (or moves in her case).

Am I doing the right things for my students?  My assessment plan is so different from what they will probably experience next year.  When I listen to others who are uncomfortable with this “radical” change, I question if I’m doing the right steps.  From what I read and study, I believe that I am doing the right things to help them learn and grow.

CL’s words where I have replaced math with assessment:

I don’t love assessment, but I don’t hate it. Assessment also doesn’t come naturally to me. I have to work hard at something until I really understand it.

My team experiments with me. Are we failure-avoidant teachers or success-oriented learners?  We collect data and ask questions; We refine our hypothesis and try again. We are learning by doing; we are making assessment and grading decisions based on what the data indicates.  Are we confident about our assessment work 100% of the time?  No…Does it cause us to ask questions, think deeply, risk, learn?  Yes…

It is certainly a work in progress.


Reflection, Attitude, and Efficacy was originally published on December 16, 2010.

Try on a new lens – (TBT Remix)

We perceive only the sensations we are programmed to receive, and our awareness is further restricted by the fact that we recognize only those for which we have mental maps or categories. (Zander, 10 pag.)

The following was posted on the last day of Pre-Planning my first year at Trinity.  While no longer a stranger, I continue to need and learn from  the stories of our children and colleagues.

From August 14, 2012:

I am new to my community – a stranger, if you will.  As a fledgling member of the community, I need and want to hear the stories of the children and my colleagues, the history of the people and the place. One spectacular opportunity afforded me is to hear the same story from multiple perspectives.  I value the luxury of learning and seeing through multiple lenses.

Through which lens do I choose to look at my surroundings?  On what do I choose to focus?  How do I practice seeing bright spots?  How often do I focus on success rather than struggle?  How do I make the practice of bright-spot-seeking a habit?  Do I teach this habit to others?

For our children, school begins tomorrow. What will they want and need from us, their teachers?  How will we offer feedback as they learn and grow?  Is it our habit to highlight their success or their struggle?  When we mark student papers, do we “award credit” or do we “take points off?” Literally, what do we mark?  What is our habit? What are we teaching through our habit?

How do our actions impact the lens through which our learners see themselves? How does our habit impact the way we see our learners? I am learning to make a point to change my lens to see with different clarity.  What does the story say if I change my view? What do we learn as we try on a new lens?

The frames our minds create define – and confine – what we perceive to be possible.  (Zander, 14 pag.)

Draw a different frame around the same set of circumstances and new pathways come into view. (Zander, 1 pag.)

How do our actions impact the lens through which our learners see themselves? How does our habit impact the way we see our learners? I am learning to make a point to change my lens to see with different clarity.

What does the story say if I change my view? What do we learn as we try on a new lens?


[This post was originally cross published as Try on a new lens – edu180atl: jill gough 8.14.12 and “edu180atl: jill gough 8.14.12“]

Zander, Rosamund Stone, and Benjamin Zander. The Art of Possibility: Transforming Professional and Personal Life. Camberwell, Vic.: Penguin, 2002. Print.

Reflection required: Learning over time #MyLearning

I am not defined by my performance today. I can grow and learn more with continued goal setting, practice, and feedback.

Yesterday I posted Patience required: Learning over time (#MyLearning) (#ShowYourWork). I ended the post wondering my learning is evident to the viewer of these artifacts.

“We do not learn from experience… we learn from reflecting on experience.” ― John Dewey

When serving as Trinity’s Personalized Learning Specialist, our Early Elementary Division Head of School, Rhonda Mitchell (@rgmteach), developed and refined a protocol for reflection.

Screen Shot 2015-08-02 at 8.36.08 AM

We want learners to collect, select, and reflect.

My COLLECTion is archived on my MyLearning Journey for #ShowYourWork Doodles and Sketch Notes Pinterest board.

I SELECTed these two from the collection:

Screen Shot 2015-07-31 at 10.40.22 PM

And, I REFLECTed on my growth and learning:

Throughout the 2014-15 school year, I doodled notes during every professional development learning session that I attended.  I remember how nervous I felt about taking notes this way during Joe’s opening faculty meeting last August.  I used an erasable pen because I was so scared of making a mistake. I remember most of his talk. The importance of our vision of pedagogy to deepen understanding, empower learners, and to cultivate community through personal experiences is clear. These tenants are reflected in our actions with learning progressions and our My Learning e-portfolios.  George’s comments in June actually connect to Joe’s comments from August.  We are in an age or era where we have connections at our fingertips.  No longer are we promoting a Jeopardy version of success.  How will we offer learners voice and choice? What if we co-create knowledge, problem-finding and problem-solving, and joyful experiences with our learners?

It is clear to me that I am more confident with the process of doodling to learn. I’m no longer using an erasable pen; in fact, I’m informed and opinionated about what works best for me. Clearly, color adds value and communicates ideas.  I see growth in my sketches of people, ideas, and connectors. I am still in awe of how much impact doodling has on my retention and recall of ideas.

I’ve learned that I listen better, think differently and more deeply, and remember more when I exercise my creativity to use visuals to represent ideas.  It is true that a picture is worth 1000s of words.  When I frantically tried to write everything down – before doodling – I could record lots of words, but did I capture any ideas? Not often.

This reminds me of timed math tests. I know! Weird connection.  It reminds me of timed math tests because of the stress and pressure of time.  I learn and remember more through doodling because I’m not frantic. I’m not afraid that I’m going to miss something.  I know that I’m visualizing big ideas and their surrounding details.

I’ve also learned that the more I practice, the more I want to learn.  I see improvement, and I see where and what I want to learn next.

I plan to continue making my thinking and learning visible using sketch noting.  I am encouraged to learn and to share.  I am not defined by my performance today. I can grow and learn more with continued goal setting, practice, and feedback.

Again, I find value and real joy in having the collection.  My portfolio of doodles shows me several concurrent learning journeys. Reflection offers glimpses of what I’m learning and where I am now. I have choice in where I go next and in how I’m going to get there.

Worth repeating:

I’ve also learned that the more I practice, the more I want to learn.  I see improvement, and I see where and what I want to learn next.  

How might we teach, model, and facilitate experiences to collect, select, and reflect learning over time? What if we offer time, encouragement, and opportunities?