What is my effect size as a parent educational supervisor?

That is the question that I am pondering at the moment after nearly two weeks of remote learning with my four children as a result of COVID19. Like all parents and teachers in this situation, it has not been easy. Furthermore, the likelihood of this continuing into term 2 is quite daunting. I think everyone is trying to do the best for our children and I want to thank not only the teachers of my children, but all teachers for what they have accomplished so far during this crisis.

I must admit I do feel like a substitute teacher at the moment. Each morning I check the inbox tray for the work that has been set by my children’s teachers. The morning session is often a mad scramble of trying to interpret the set work, answer clarifying questions and try build some type of independence, so that I can complete my work (Often impossible with a Kindy and Year 1 student in the mix). The rest of the day reminds me of cramming to complete a University assignment. It’s a crazy rush to ensure everything is completed before 3pm and to provide their teachers with the opportunity to give the kids feedback (Which they love!).

Here is a more detailed example of my day:

Screen Shot 2020-04-02 at 1.54.40 pm
Reading Books with Patrick (Kindy)
Screen Shot 2020-04-02 at 3.28.38 pm
Making a puppet show with Patrick and Liam (Year 1) retelling their stories.
Screen Shot 2020-04-02 at 8.55.38 pm
Practicing spelling tricky words with Liam and uploading his recording to seesaw.
Screen Shot 2020-04-02 at 9.00.07 pm
Helping Connor (Year 4) edit his persuasive writing and hand it in via Google Classroom.
Screen Shot 2020-04-02 at 11.09.21 pm
Helping Imogen (Year 6) with her STEM project to build a rollercoaster

But wait there is more…… Mathletics, Studdyladder, Read Theory, constructing an Easter Hat for our virtual parade next week. In addition, running the canteen and yard supervision during trampoline time and that does not include a number of Zoom meetings and other work that I completed during the day. The challenge for me is that I am a trained teacher and this is tough work, especially balancing educational supervision and my core work.

In a recent news article, NSW Education Minister Sarah Mitchell helped relieve some stress and anxiety from parents when she commented “that a few hours worth of maths and literacy was sufficient for remote learning and parents should not beat themselves up over getting everything completed”. An interesting comment when prior to COVID19 everything in the media about education was laser focused on schools not meeting educational benchmarks within PISA assessments and constant declines in NAPLAN testing results. It is liberating to know that these types of assessments are no longer important to governments, which is great news!

In light of this, I am curious about a few things:

  1. What effect will this situation have on my children’s learning progress? 
  2. If my role is to supervise the educational program of my children, what will be the magnitude of the impact that I will/can have on their learning outcomes?
  3. What if this situation creates a greater impact on learning? Do we go back to the same way, when the situation is resolved?

To align my thinking and possibly answer some of my own questions. I thought that the research conducted by John Hattie would be a good benchmark.  Given his research the effect of this situation should be somewhere between 0.15 and 0.40 as shown in his famous diagram highlighting the Barometer of Influence.

Screen Shot 2020-04-02 at 8.45.13 pm

However, this situation has number of key factors that must me consider. Within his recent analysis of Influences And Effect Sizes Related To Student Achievement. I can infer that my high parental involvement (0.50) and the reduced class size (0.21) experienced by my children, will have a positive impact their academic progress this year. What is concerning, is that distance education (0.13) and technology in distance education (0.01) have a very low effect on student achievement. Yet, this does not mean that they are not beneficial tools or strategies, but for any impact on student achievement it is more about the changes that we make to our teaching in this changed environment. Just creating a google classroom or setting up a zoom will not yield significant learning growth for our students, it is how we incorporate high impact learning strategies within these tools and situations that make significant differences.

I do agree with Pashi Sahlberg that we cannot expect from ourselves or one another the same things as a normal situation (It is not the same environment that our children experienced 3 weeks ago). The responsibility of teaching our children remains with the school. But maybe there is the opportunity for parents to be more than an educational supervisor. Maybe it is about how we provide honest feedback to what our children can and can’t complete (It is not about doing the work for them). This situation requires a triad of collaboration between teachers, parents and students and communication is the key enabler. If we can foster this mutually beneficial relationship, then we will have a significant impact on moving the dial for student learning during this unprecedented time.

To PBL or NOT TO PBL (Is that the correct Question?)

I recently read an article produced by the NSW Centre for Education Statistics & Evaluation titled Cognitive load theory: Research that teachers really need to understand. It was a well written and easy to comprehend review of academic literature on Cognitive Load Theory. However, the article poses this proposed debate of how people learn best and broadly divides it into two approaches to teaching practice, explicit instruction vs inquiry learning. Last year I attended a PBL conference in Zurich and the same notion occurred in a debate between Professor Henk G. Schmidt, a pioneer of PBL versus Professor John Sweller.

pbl_2
Henk ‘McGregor’ Schmidt versus John ‘Mayweather’ Sweller

This debate was the educational equivalence of the recent Mayweather versus McGregor boxing match. In one corner, we have the inquiry or PBL approach, which many people believe  is about allowing students to discover or construct some or all of the information themselves. In the other corner, are those who believe that learners do best when they are provided with explicit instructional guidance in which teachers clearly show students what to do and how to do it.

However, I propose that these two approaches are not in opposition and a deep understanding of both approaches are needed by all teachers.

Cognitive Load Theory is about how students learn best

Cognitive Load Theory, as the title of the article suggests is definitely something that all teachers need to understand. In 1956, cognitive psychologist George Miller produced an influential paper title ‘The Magical Number Seven, Plus or Minus Two‘, which proposed that short-term memory is subject to certain limits including span and the quantity of information that can be stored at a given time. Cognitive load theory supports explicit models of instruction, because such models tend to accord with how human brains learn most effectively (Kirschner, Sweller & Clark 2006). Explicit instruction involves teachers clearly showing students what to do and how to do it, rather than having students discover or construct information for themselves. Furthermore, it is important that teachers understand the limitations of working memory and avoid making simple mistakes in instruction that produce cognitive overload and are harmful to student learning.

However, these mistakes can occur in teacher-centred instructional environments that focus on explicit instruction. Some examples include the ‘redundancy effect‘, which can occur when a teacher reads the text projected on a screen to students. This requires learners to process redundant information and inhibits learning because it overloads working memory. Another example is the ‘split attention effect‘, which occurs when learners are required to process two or more sources of information simultaneously in order to understand the material. An example, is when a diagram is used to explain a concept, but it cannot be understood without referring to a separate piece of explanatory text (common in worksheets). In this instance the learner is required to hold both sources of information in their working memory at the same time and to mentally integrate the two. This places a high cognitive load on the working memory, reducing the ability of the learner to transfer the relevant information to their long-term memory.

On the contrary, these issues also occur in student-centred instructional environments that focus on PBL. The most common issue is the creation of extraneous cognitive load, which is the ‘bad’ type of cognitive load, because it does not directly contribute to learning. For example, a common misunderstanding of PBL is ‘minimal guidance’. Therefore, teachers incorrectly see themselves as ‘guides on side’, rather than activators of knowledge. Facilitating an environment where students have to solve problems for themselves, with minimal guidance from the teacher is detrimental to student learning. This approach imposes a high cognitive load, but does little to encourage students to make meaning of information being learnt, often because the student’s attention is focused on solving the problem rather than the learning.

What is the intersection between PBL and Cognitive Load Theory?

It is important to note that cognitive load theorists do not advocate using all aspects of explicit instruction all the time. Indeed, they recognise the need for learners to be given the opportunity to work in groups and solve problems independently – but assert this should be used as a means for practicing newly learnt content and skills, not to discover information themselves (Clark, Kirschner & Sweller 2012, p. 6).

These approaches are aimed at promoting learner independence while managing cognitive load appropriately, depending on the learner’s novice/expert status … If the instructor provides some guiding principles, prior information, signposts along the way, and scaffolds and assistance where needed, there is less burden on working memory. (Martin 2016, p. 39)

So how can PBL benefit from an understanding of cognitive load theory?

Dr Michael McDowell the author of Rigorous PBL by Design provides some coherence to the alignment between PBL and Cognitive Load Theory. In his blog titled The Missing Ingredient in PBL: Direct Instruction he proposes that direct instruction is a missing approach in many problem and project based learning environments and as a result a significant number of students are not realizing the learning gains we [should] expect. Furthermore, he argues that we need to utilize effective direct instruction in the PBL/PrBL classroom specifically in situations where a ‘high intrinsic cognitive load‘ is placed on student memory as they are novice learners building new knowledge and skills.

John Hattie summarises explicit instruction as an approach in which:

The teacher decides the learning intentions and success criteria, makes them transparent to the students, demonstrates them by modelling, evaluates if they understand what they have been told by checking for understanding, and retelling them what they have been told by tying it all together with closure. (Hattie 2009, p. 206)

Great idea. How does this work in a classroom?

I recently visited a teacher in a year 5 classroom who attended a workshop presented by Dr McDowell. The teacher was utilising Project Based Learning as the primary pedagogy and students were working in groups to solve real world problems regarding the geography of Western Sydney. Existing within the classroom were the key elements of project based learning including entry event, driving and need to know list.

However, this approach was more than just minimal guidance, allowing students to construct their own knowledge.

IMG_1763
The project wall showing the key elements of Project Based Learning

Firstly, there were clear benchmarks linking targeted instruction opportunities for students (often as a result of formative student assessment data). These benchmarks not only scaffolded the learning in project, but they also provided a clear need for explicit instruction. Both the ‘simple-to-complex’ and ‘part-whole’ approaches where utilised in the early benchmarks to afford students the opportunity to build their mental representations of knowledge in this project. The teacher was the key activator of this knowledge and explicit instruction was the driver.

Subsequent benchmarks, required students to make connections between the knowledge they had acquired, encoded and stored, and the project they were working on as a group. If the explicit instruction had not occurred, the result would be ‘extraneous’ cognitive load being placed on students as they attempt to solve the problem and work as a group.

Secondly, all learning intentions identified were represented as a transparent success criteria, showing the development of knowledge at a surface, deep and transfer level. Furthermore, within the success criteria there were clear models helping students reduce the burden on working memory and allowing them the opportunity to transfer the information into their long-term memory.

 

IMG_1768
Clear success criteria and examples for students at surface, deep and transfer.
IMG_1769
The integration of benchmarks with explicit success criteria at different levels within the project.

Conclusion 

There is still considerable work to be undertaken in this area. However, hopefully this blog provides some coherence in the comparisons between PBL and Cognitive Load Theory, rather than the contrasting view that is often presented.

 

 

 

Projects Vs Project Based Learning: What is the difference?

At a conference recently I was asked to reflect on what I remember learning at school. These experiences could include subjects, topics, projects, specific content or skills. I must admit, I actually found this task quite challenging (which could be a reflection on my memory). However, I do have three vivid memories, that I could recall and each one was a project. The first was the wooden pencil box that I made in year 7. The second was the BBQ utensils that I made and marketed in year 8. The third was made in a year 10 commerce project where we marketed a new soft drink product. During a conversation with a colleague, I was challenged to look beyond recalling the product that I created, but to discuss the knowledge that I learnt. I found this extremely difficult and slightly distressing that I could not recall any specific knowledge from these engaging learning experiences that were etched in my memory. This experience highlighted a question that I constantly see experienced by many teachers in the infancy of their PBL journey – What is the difference between ‘doing projects’ and Project Based Learning?

Screen Shot 2017-05-10 at 5.55.30 am

What is the difference between ‘doing projects’ and ‘Project Based Learning’?

On the surface there are some very distinct differences. Many PBL educators often use the metaphor that ‘doing projects is the dessert’ and ‘Project Based Learning is the main course’. My colleague Kurt Challinor (@kchalls) uses the Master Chef TV show to explain the difference by comparing the ‘Adriano Zumbo Croquembouche Tower’ as a project against the ‘Invention Test’ which is more like Project Based Learning.

Screen Shot 2017-05-10 at 6.15.41 amScreen Shot 2017-05-10 at 6.15.48 am

Furthermore, there are a number of resources available to help teachers differentiate, like the one below that compare and contrast the unique differences.

Screen Shot 2017-05-10 at 6.15.32 am

Also, the New Tech Network presents a great sense maker that visually highlights the difference between a traditional taught unit of work with a culminating project (like I experienced as a student) vs the process of Project Based Learning.

Screen Shot 2017-05-10 at 5.52.50 am

All of these resources make sense on the surface, however many teachers fail to recognise that Project Based Learning is a process of sustained and deep inquiry. Rooted in the cognitive architecture of how the brain works and how humans learn. Without fully understanding this process our greatest intentions often result in engaging learning experiences for students, where deep learning fails to prosper.

The PBL Black Box

The issue resides in what I refer to as the ‘PBL Black Box’. Like the black box flight recorder on an aeroplane, people understand the end product but not how it is generated. For example, they understand a project starts with the entry event and culminates with the end product. They are unsure what exactly happens in the middle of a project. Many believe that it is self-directed learning or inquiry, some believe it is student voice and choice or collaborative learning. But the mystery remains, what exactly occurs during the project process to ensure that students learn the required content and skills.

Screen Shot 2017-05-10 at 8.33.58 amThe answer is in understanding the relationship between the elements of the PBL instructional core.

Screen Shot 2017-05-10 at 8.28.47 am

At the core of any project is the content. This is the non negotiable knowledge that students are expected to master by completing the project. By utilising the ‘need to know’ list this should drive the inquiry cycle to help students identify, acquire and receive feedback from the different learning experiences in the project. Outside the content core is the product, this relates to the skill sets that the students will acquire as a product of the PBL process. Often it will take more than one experience in PBL to develop these skill sets. Finally, the PBL process is what ensures that the content and product are developed and deepened for each student in their PBL experience. If fidelity to the process is not maintained by the teacher it will result in learning gaps within the content and product for each student. This issue is often masked by the increase of student engagement in a project. Engagement assists in the learning process, but is not the only factor in academic achievement.

Below is a diagram that outlines the framework behind the PBL process:

Screen Shot 2017-05-10 at 8.35.12 am

1. The Project Launch

  • From the entry event students should be able to identify the content and skills that they need to acquire in order to complete the project. This is the first step in the inquiry process and is an ongoing measure used throughout the project to ensure that students are building upon their knowledge and skills.
  • The assessment rubric provides students with a snapshot of how they will receive feedback throughout the process to ensure that their end product meets the required criteria.

2. The Inquiry Cycle

  • The inquiry cycle is driven by the need to know list and requires appropriate scaffolded intervention by the teacher. Appropriate formative assessments are made regarding student progress and feedback is given.
  • This process will continue in order to help the students deepen their knowledge and skillsets within the project.

3. Differentiated Workshops

  • Throughout the project students and groups will progress at a different pace with content and skill acquisition. The use of differentiated workshops driven by the ‘Need to Know List’ and formative assessment helps ensure that all learning opportunities are maximised.
  • Appropriate feedback is given to students and the process is continued.
  • Note: Inquiry process is not a lockstep process and should be modified to meet the needs of the students and groups within the class.

4. End Product

  • Each group is working towards their end product or culminating event throughout the inquiry process.
  • Feedback given to students and groups is key to ensure that they are able to create a solution that responds to the entry event.

5. Evaluation

  • Evaluation should focus on student self evaluation regarding their content and skill development, peer evaluation regarding their collaboration and project evaluation to provide teachers with opportunities for future developments.

 

Why PBL gets a bad name?

The lack of process understanding by teachers when creating projects is often what gives PBL a bad name. The effective implementation of this process brings together a range of high impact teaching strategies and makes them authentic in the context of the classroom environment. The diagram below shows the high-impact, evidence-based teaching strategies identified by John Hattie.

Hattie-Teaching-1024x648

Below is the PBL Funnel which shows how each of these strategies has a place within the PBL framework to provide a high impact on student learning and development of skillsets. A deep understanding of the PBL process affords teachers the opportunity to address each of these strategies in their ongoing practice.

Screen Shot 2017-05-10 at 8.37.11 am

Next steps

Hopefully, this provides you with some coherence regarding the importance of the PBL process against the need to create just projects.  This process is something that will take time for staff to fully understand, however modelling is an excellent strategy to ensure that it can be sustained. Think about modelling the process in your staff meetings or professional development opportunities as an appropriate next step.

Good luck!

A Forensic Investigation into Group Work

The key to the ongoing success in Project-Based Learning is the ability to scaffold for students the development of skill sets, as well as content. Furthermore, it is important that teachers who teach in a PBL context have a deep understanding of the purpose of grouping and use a wide range of scaffolds that foster successful group work strategies. Recently, I conducted a workshop for some teachers on helping them come to a greater awareness of these scaffolds and their unique purpose. The workshop was presented in a CSI theme, where we analysed a dysfunctional group and explored some possible reasons for the demise of the group and identified strategies that could be employed in assist future groups.

Below is a snapshot of this work:

ENTRY EVENT – The Crime Scene

During the presentation of a project, you notice that Kenneth is doing all the talking. Adam tries to add his thoughts but is constantly cut-off by Kenneth. Christopher presents a prepared part of the presentation, that does not sound like something he would produce. Furthermore, Robert stands away from the group and does not contribute to the presentation and every time Charlie tries to speak he just laughs.

The next day you receive a note from the parents of Kenneth and Adam expressing the hard work that their son has contributed to the project and their group members have let them down. They are extremely concerned that the lack of effort by other group members will have an adverse effect on their overall mark.

In analysing the peer feedback data you find that all students have scored their group members low, while scoring themselves high. A range of reasons have been provided with the scores.

51565465 - close up of female police officer presenting evidence to suspect

WHO IS GUILTY?

THE SUSPECTS – Who is involved in the success or failure of this group?

Below are the suspects identified from the investigation. They include the five students and the teacher in this project.Suspects

THE EVIDENCE – What strategies could have been used to stop the demise of this group?

EVIDENCE 1 – The group contract

The group contract is the glue that keeps groups functional. Without this key scaffold, dysfunctional groups will occur more frequently. We cannot just expect that students will learn collaborative skills by the more opportunities that they have to work in groups.

large_1395335531

Below are some key insights to consider with group contracts:

  • Keep the contracts readily available
  • Refer to the contract when problems in the group arise
  • Ask the groups to reflect on the contract at the end of the project
  • Is the step-by-step firing clause evident?
  • Continual reference and application of roles throughout project, so roles must be taken seriously.

 

EVIDENCE 2 – Assign group leaders

Assigning group roles is important to the success of groups. However, it is important that the teacher is purposeful in the selection and rotation of leadership opportunities within the class. Tuckman’s team development model is good guide for developing leadership capabilities within groups.

TCTC-Forming-Storming

Below are some key insights to consider with managing group leaders:

  • Meet with the group leaders on a daily basis to discuss the group’s progress and any questions their group might have.
  • Provide the group leader support with their responsibility.
  • Have the group leader keep a daily log of what the group accomplished.
  • Award bonus points to the leader if all deadlines are met.

 

EVIDENCE 3 – Project pacing charts

The use of project pacing charts provide a visible progress snapshot of each group in the class. They also allow students in the class to have autonomy on the decision-making regarding their progress. This can also be used in conjunction with the group contract, so that there is equity regarding the distribution of tasks within the groups.

Screen Shot 2017-04-03 at 9.58.36 pm.png

Below are some key insights to consider with project pacing charts:

  • Ask the students to fill in due dates and responsibilities for all aspects of the project.
  • Ensure that they assign the and record all student responsibilities and contributions.
  • It is important that this scaffold is visible to all students during the project.
  • Review the pacing chart on a regular basis

 

EVIDENCE 4 – Group Observation Checks

The use of group observation checks provides accountability to both students and teachers for the role that they play in managing the groups within PBL. Concerning the teacher it allows them to collect evidence on each student, so that further explicit teaching may occur especially in areas where students are stuck in working collaboratively with other students. Regarding students it provides them with feedback that they can feed forward into future group situations.

teacher_observation_checklist

Below are some key insights to consider with group observation checks:

  • Ensure that you a range of formal vs informal check-ins with all groups.
  • Manage opportunities for brief check-ins with students in a particular role from each group.
  • Make sure that you document the discussion and provide the feedback to students. This make require students to note-take the feedback on their own rubric.

 

EVIDENCE 5 – Formative Group Evaluations

Sometimes the only time that we collect feedback from the group about the performance of all group members is at the end of the project. This information can only assist with the next project, not the current project. The use of formative group evaluations can provide the teacher and groups members with evidence and direction regarding resolving current issues, before they become significant issues.

peer-evaluation-form-for-group-work_1

Below are some key insights to consider with formative group evaluations:

  • If you are formatively assessing, you are managing your classroom effectively with accountability, reflecting on your teaching and their needs, and ensuring quality PBL project products.
  • It is important to understand how this information will be collect and presented for all students in the group.
  • Ensure that the form is easy to use and understand.

 

THE ARREST – Who is responsible?

41635082 - arrest of suspect man in interrogation room

Unfortunately, the teacher is responsible for providing the enabling elements to ensure that groups can work together effectively. All the elements listed in the evidence above where not used by the teacher in this scenario and hence the group was dysfunctional. These elements are only the basic elements in managing groups, there are many more that you can use or some that you may currently use. The key is to ensure that everything that you select has an explicit purpose to enabling students to grow and develop their collaboration skills.

If you have any others that use, please share them with me and I can add them to the evidence.

All paths lead to ‘Project Design’

The design process of projects in Project-Based Learning is crucial in any attempt to improve student learning via the implementation of contemporary learning pedagogies. The first victory for teachers in the implementation of PBL is definitely increased student engagement (often just a result from increased teacher engagement). However, to achieve sustained improvements in student learning a focus on precision and consistency in the essential elements is required. Michael McDowell in his blog post “3 Ingredients for Authentic PBL” provides a valuable insight into the issue of measuring the impact of PBL on improving student learning. Michael refers to the research of John Hattie that found the overall effect size of PBL is at .15. However, when students are learning more complex knowledge and skills this increases to an effect size of .68.

So what is the difference?

The difference is that some projects are designed to engage students as the primary focus and often fail to address sustained inquiry and the achievement of academic rigour. For teachers embarking on their PBL journey they spend considerable time on making the project ‘authentic’ and generating appropriate ‘adult connections’. Don’t get me wrong these are needed, but if they are the only elements your project is addressing then this will ultimately promote surface learning and limit the overall effectiveness of student learning. So what should you do differently?

Creating quality projects

I have always found Steinberg’s 6 As for project design as a good starting point for creating quality projects (See the adaption by the New Tech Network). Each pillar provides a good point of reference for teachers in their attempt to change the way they teach and how students learn. However, the areas that have the most influence on student learning are the core pillars shown in my quality project flowchart below.

screen-shot-2017-02-19-at-10-10-53-am

It recognises that all pillars are essential, but the identified pillars in blue have the greatest impact on student learning. I agree with Michael McDowell in his blog that states clarity, challenge and culture are the key ingredients to improve student learning through PBL. The marriage of a deeper understanding of these ingredients with a sustained focus on the core pillars can ultimately improve the design of your projects.

So if you are starting your PBL journey what insights do you need to know to ensure that you create quality projects for your students.

  • Academic Rigour – The key to academic rigour is to ensure that students are constantly challenged throughout the project. Furthermore, student learning should always be supported with appropriate scaffolds that meet the students at their point of need. All of this just seems like good teaching practice. However, teachers need to constantly gather appropriate assessment data from students and provide targeted instructional interventions to improve student learning and performance. Not all students will have the same needs, which increases the complexity in a collaborative environment. However, within a student centered environment there are greater opportunities to provide workshop interventions for students and even mastery learning can provide some good insights to promoting academic rigour. Make sure that you don’t sit back in wonder and awe of the increased student engagement in your projects, collect data, assess learning and extend understanding.
  • Apply Content and Skills – If the learning that students undertake during the project is not applied to the end product, then it is not Project-Based Learning. This can be an easy mistake to make. However, you can bridge this gap by ensuring that the need to know list drives and provides clarity to the learning intentions throughout the duration of all learning opportunities in the project.
  • Assessment – Ensuring that you have multiple opportunities for ‘formative assessment’ within the project is important to ensure that academic rigour can be sustained. Try to avoid making formative assessment formal and ensure there are a range of opportunities at the point of student need. Co-constructing success criteria’s with students will provide a great opportunity for students to gain a deeper understanding of what success looks like in the project. Dylan Wiliam provides some great practical examples of formative assessment that can be utilised in your project.
  • Active choices – This is where a culture that is focused on learning is fostered. This aspect may take time to develop. However, by building in metacognitive structures to your project that allow students to reflect and make informed choices regarding their learning pathway will ultimately have an increased impact on student learning. I know easier said than done! But an appropriate next step could be building in visible thinking routines into your project pathway.

All paths lead to ‘Project Design’

Don’t be too hard on yourself if don’t always address all aspects of the 6 A’s, they are only a guide. The key is to make sure that you are always trying to move beyond engagement to developing greater clarity, supporting challenge and promoting culture. Finally, all improvements start and end with the effectiveness of your project design.

What are the non-negotiable elements in Project Based Learning?

Project Based Learning is seen by many as an effective contemporary student-centered pedagogy that sustains inquiry, promotes student choice and provides a vehicle for the explicit teaching of 21st century skills and competencies. However, this increased popularity in PBL also raises concerns regarding the effectiveness of a variety of varying implementations. A lot of practices and curriculum materials labelled as “PBL” are not rigorous or even truly PBL, and yield disappointing results. Some “projects” are just “hands-on activities. The Buck Institute for Education (BIE) recently released ‘Gold Standard PBL’ in an attempt to provide clear guidance and adequate preparation for teachers to ensure that poorly designed and implemented projects don’t frustrate students, disappoint teachers, and damage PBL’s reputation.

Sometimes, all that is needed is something to hang your hat on. A set of non-negotiable elements that ensure that your implementation is heading in the right direction. It may not be ‘gold standard’, but it is well on the way of achieving such a feat.

hanging-up-my-hat

 

Below are a list of the six non-negotiable elements in project based learning. If your project does not have these elements as a minimum your curriculum implementation is not PBL!

 

1. The Driving Question

The driving question is used to initiate and focus the inquiry of the project. It should capture and communicate the purpose of the project in a succinct open-ended question. It should be continually referred to while students are working on the project, so they are reminded of the purpose of the project in their daily work.

 

2. The Entry Event

The entry event outlines what the students need to do in order to complete the project. Entry events should have either a real-world context, use real-world processes, tools or be connected to student concerns or interests. Combined with a provocative driving question for the project, the entry event provides students with a series of “need to know” questions aligned with the selected key knowledge and skills.

 

3. Need to Knows

The need to know list drives the sustained inquiry within the project. The need to know list should be an organic and evolving list used throughout the project. It should allow students to generate questions, find resources and develop their own answers. It also provides students with feedback concerning what they have learnt throughout the project. 

 

4. Group Contract

The group contract is a project management and collaboration scaffold that assists all students in managing the group over the course of the project. Like the need to know list it needs to be purposefully constructed at the start of the project and should be constantly updated through the course of the project.

 

5. Formative and Summative Assessment

Formative or ‘assessment for’ learning is conducted during the project. The primary aim of formative assessment should be to provide feedback to students regarding their progress towards their end product. Summative or ‘assessment of’ learning is often aligned with the evaluation of the end product. The end product may incorporate multiple aspects including content knowledge from various subject domains and relevant 21st century skills.

 

6. End Product

The end product is the response by the students to the entry event.  It is the culminating event when students share the product or result of their investigation, receive feedback, and celebrate their learning. Often the end product is linked to the summative assessment for the project.

 

Please understand that these are only the minimum elements and they do not address the quality expected of effective project design. Something like the 6 A’s of successful project design developed by Steinberg and modified by the New Tech Network is a good benchmark for improving your project quality.

The top ‘five’ considerations when starting your PBL journey

As the new academic year begins in Australia, many schools will be embarking on new and innovative pathways to try and meet the dynamic needs of their students. These initiatives come in various shapes and sizes, all with the primary focus of engaging students in the learning process to improve learning outcomes. For some schools in 2017, the implementation of Project Based Learning (PBL) is part of their strategic direction. However, as many educational leaders would attest, change management is a daunting and difficult task. Therefore, I thought it would be a good opportunity to provide my ‘top five’ considerations for educational leaders when implementing PBL.

1. Ensure your plan is more than ‘let’s do PBL’

It is great that you have made the decision to implement PBL. Hopefully, you have strategically allocated resources to this initiative. However, you also need to apply some deep thought, especially amongst your leadership team about what you want as the end game for your students. You are equipping them with a range of 21st skills that will change how they learn forever. Overtime you will create critical and independent learners who will struggle in learning environments that transfer content and fail to challenge them with new and creative insights. Ensure that you have an overarching plan for each subsequent year of schooling, focusing on the pedagogy employed and the critical skills to be developed.

If your goal is to engage year 9, you better apply some thought to what will happen in the following years.

2. Always ask yourself – ‘How does this improve student learning?’

As I stated in the introduction of this blog, change management is extremely difficult. But the rewards far exceeds the difficulty experienced in the adjustment stage. Therefore, it is extremely important for leaders to maintain a consistent focus on the reason they made the decision to implement PBL – to improve student learning. There will be many individuals and groups that will try and distract you and attempt to chart a different course in your journey. Some students and teachers will want to maintain the status quo, often because it is easier.

Learning new content and skills should be challenging, that is what makes it so rewarding. PBL has a strong focus on the development of life long skills such as communication, collaboration and critical thinking. For some people these skills may take years to develop and they require multiple opportunities to learn and gain feedback on their skill development. Your decision to implement PBL should be because you want to maximise the learning opportunities of the students in your care.

_dxa2766

Never forget that everything you do should have a direct link to improving student outcomes.

3. Strive for ‘relentless consistency’ in the use language with all stakeholders

Especially, if your PBL initiative is across multiple year groups or faculties the use of language must be clear and consistent. This must be a clear expectation amongst all stakeholders, otherwise it will foster ambiguity and confusion. Some examples of the terminology that needs to consistently used include:

  • Driving question…
  • Entry event…
  • Need to knows…
  • Next steps….
  • Rubric…
  • Benchmarks…
  • Formative and summative assessment …..

All of these terms are the key elements within Project Based Learning. Therefore, it is important that the leadership of the school ensures that there is ‘relentless consistency’ in the use of these terms. This starts with leaders using the language in their own conversations and extends to simulating the language and processes in professional development opportunities. If staff have a question that should become a need to know, there are always next steps in the busy school environment. John Larmer for BIE gives a good insight into the use of ‘project slices‘ as a structure to help staff develop a sound conceptual understanding of PBL terminology and processes.

The teachers must model these expectations to the students in their daily practice and soon you will start to hear the parents using similar language.

leave-board-hand-learn-54597

4. Find new and creative ways to give staff time

The one variable that you always need when implementing PBL is time. Unfortunately, no matter how much time you give staff, it is never enough. But don’t despair, teachers are happy with any time to assist is the preparation and planning of their projects. Often leaders can create more time for staff by thinking outside the box for increased opportunities. Here are a couple ideas that you may already utilise or they may get your creative thoughts flowing within your own school context:

  • Employ non-teaching staff for supervision tasks to free up teacher time.
  • Podcast meetings so that teachers can watch them at a convenient time affording more time for face to face professional development and planning.
  • Look at your school timetable to find opportunities to embed professional learning opportunities. Start earlier, finish later, reduce admin time by utilising technology ect.

Often you will have to let go of something old, in order to gain something new. Tough decisions are the responsibility of leaders. 

5. Ask for feedback from everyone

Feedback provides information on progress and achievement. Furthermore, it provides opportunities for reflection and deep inquiry regarding the collection of data. Surveys and structured meetings are a great way to gauge the success of the implementation and also may help clarify any misunderstandings. Feedback should be collected from all stakeholders. Here are a few ideas that you may want to use:

  • Have a student focus group each week. Select up to five students of varying attitudes towards PBL for a lunchtime meeting. Set confidentiality norms regarding the meetings and give them the opportunity to express their thoughts on PBL in a safe environment. Start with the positive ‘I like..’ then move onto clarifying confusing aspects of classroom practice by using ‘I wonder…’ and finally gather their thoughts on ‘next steps…’. Change up the groups each week to give each student an opportunity to express their thoughts.
  • Parent university meetings are a great way to help parents grapple with the changes in instruction at your school. The focus of a parent university is an opportunity for students to provide peer support to their parents in a small group environment, facilitated by the teacher. Being a small group (No more than 10 parents), the teacher can help clarify any misconceptions by both the parents and the student. Using something like a ‘project slice’ is a great way to simulate the learning process and help parents experience all phases of the project.

 

The more feedback you get on an informal and formal basis, allows for a greater opportunity to grow and improve.

pexels-photo

Hopefully, these considerations provide you with a starting point for future discussions regarding your PBL journey. Good luck.

 

What is the role of PBL in the STEM revolution?

 

With the STEM revolution sweeping both primary and secondary classrooms, it is extremely important to understand which pedagogy is appropriate for the successful implementation to the STEM curriculum.

Lets get aligned – STEM is the content

Sometimes it is easy to caught up in the hype around STEM, with the 3D printers, robots, laser cutters and other gadgets.  Consequently, we may forget that STEM is just the integration of four areas of curriculum around a common context. It is an opportunity for classrooms to move away the segregation, towards integration. Where this gets tricky is that instructional methods especially in engineering, mathematics and science have traditionally been taught in a teacher-centered approach (Krishnan, Gabb, & Vale, 2011). However, it is important to understand that STEM is not the approach to teaching and the employment of more student-centred approaches to teaching are needed if the true benefits of STEM are to be realised.

 

What exactly is Project-Based Learning?

Project-Based Learning is a student-centred pedagogy that presents students with an authentic challenge that generates sustained inquiry over a duration of time from approximately 3 – 10 weeks. We approach this inquiry from the premise that project-based learning requires a well-defined outcome, with ill-defined tasks (Capraro, Capraro, & Morgan, 2013; Markham, 2003).

The essential elements of Project-Based Learning is a focus on soft skill development such as teamwork and communication skills. Also a public product is extremely important as a culminating event. Students must see a connection between the content and the product. Below is a snapshot of the “In the Shadows of Shoah Project” by Kurt Challinor and Maddison Cleveringa, which was voted in the top 15 BIE Projects for 2016 by John Larmer. This project is a great example of an meaningful public product (Museum Exhibit) that is closely linked to the content studied (World War 2 and The Boy in Striped Pyjamas).

Similar, to managing a project in engineering, the content to be studied must be driven by the needs of the product. For example, if the challenge is to create an aeroplane, then the content should involve material science, Bernoulli’s principle, speed, acceleration and surface area. If this content is not part of your STEM curriculum then the plane project may be engaging, but not appropriate!

A snapshot of  a STEM Project

In order to understand why Project-Based Learning is essential to the success of your STEM curriculum it is important to gain an understanding of a PBL driven STEM project.

The area of focus for this project was aerodynamics and was designed for Year 9 students in a STEM elective. The driving question/challenge was How could a drone be used to save human life in a natural disaster?

Below are the key content areas and aspects that were studied:

What do the students need to know?

  • describe the evolution of flight technologies.
  • explain aerodynamic principles.
  • describe a range of technologies used in aerodynamics
  • describe the effects of lift, drag, weight and thrust.
  • explain the use of forces and scientific principles in flight.
  • explain the mathematical methods behind velocity and acceleration.
  • describe a range of technologies used in CAD and CAM processes.

 

What do the students need to do?

  • perform experiments using a range of aerodynamic technologies to solve engineering problems.
  • calculate lift/drag ratios
  • apply mathematical and graphical methods to solve aerodynamic related problems.
  • apply mathematical methods to solve motion related problems involving velocity and acceleration.
  • construct models for the purpose of solving aerodynamic problems
  • use a variety of technologies which assist in the rapid prototyping process

 

The following phases were utilised within the project:

Phase 1 – Exploring the Content and prototyping

Students were required to investigate the different types of disasters and how a drone could be used to save human life. Furthermore, they had to research the different designs, components and materials technology required for construction. Each group designed a prototype and it was cut-out in cardboard using the laser cutter.

screen-shot-2017-01-20-at-12-05-09-am

The drone prototypes were assembled to ensure all components fitted accurately and the final design was appropriate.

 

Phase 2 – Building the drone

Students then used their selected materials to construct their drones. Materials ranged from plywood to different types of perspex and plastics. All components were added and tested to see that they were in working order. Finally, other components such as cameras, GPS and package dropping mechanisms were added.

screen-shot-2017-01-20-at-12-12-22-am

screen-shot-2017-01-20-at-12-12-45-am

screen-shot-2017-01-20-at-12-12-35-am

Phase 3 – Testing

Students were then given the opportunity to present publicly how their drone could be used to save human life in a natural disaster. Students were marked individually and as a group throughout the project through various formative and summative assessments according to a rubric.

 

Students demonstrated a deep understanding of the different STEM curriculum areas. Furthermore, they developed an appreciation for problem solving and the need for iterations of design in the problem solving process.

 

Final thoughts

Please understand that Project-Based Learning is only one example of a student-centred pedagogy. There are many others that can be utilised to help the teaching of STEM integrations in order to move away from more traditional teacher-centred approaches. Finally, before implementing any STEM initiative answer the following questions in chronological order:

  1. What student-centered pedagogy will you utilise?
  2. How will you assess soft skills?
  3. What resources will be available for this initiative?

 

References

  • Capraro, R. M., Capraro, M.M.,
    & Morgan, J. R. (2013). STEM project-based learning: An integrated science, technology, engineering, and mathematics (STEM) approach (2nd ed.). Rotterdam, the Netherlands: Sense.

  • Krishnan, S., Gabb, R., & Vale, C. (2011). Learning cultures of problem-based learning teams. Australasian Journal of Engineering Education, 17(2), 67–78.
  • Markham, T. (2003). Project based learning handbook: A guide to standards-focused project-based learning for middle and high school teachers. Novato, CA: Buck Institute for Education.

  • Larmer, J., & Mergendoller, J. R. (2015, April 21). Gold Standard PBL: Essential project design elements [Web log post]. Retrieved from http://bie.org/blog/gold_ standard_pbl_essential_project_ design_element.

Does a change in pedagogy improve results?

Schools are being challenged to provide students with a more authentic, relevant and student centred learning opportunity. However, the yard stick for school success in NSW at the moment is achievement on a standarised examination. So can we prepare students for the challenges of the 21st century and achieve success in the HSC?

The answer is ‘YES’. The reason why I know the answer is because I have witnessed it first hand at Parramatta Marist High School. To give some perspective, “it is the oldest Catholic school in the country, but Parramatta Marist High is a model of modern education.” Through the implementation of Project and Problem Based Learning the school has been able to focus on key skills such critical thinking, problem solving, presentation skills and social development and also navigate a crowded curriculum. Students at Parramatta Marist now have an increased confidence to collaborate with other students in solving authentic and rigorous problems.

But that is only part of the story. Parramatta Marist has been consistently in the top 100 schools in NSW over the last seven years, with the 2014 cohort achieving our best results so far. 

The remarkable improvement saw the comprehensive low-fee Catholic school jump from 73rd in the state to 42nd on a list of the state’s top-performing HSC schools, outperforming private schools such as The King’s School, Scots College and Trinity Grammar.

 The 2014 cohort achieved some outstanding individual student success as highlighted on the infographic below. But the statistics that highlight the success of our focus on a student centred pedagogy is the fact that 90% of all students achieved a band 4, 5 and 6. This  shows that students who work together can learn from each other and improve the overall results of a cohort.

Any change is challenging and results are always expected. But many schools will be reassured that such a feat is possible. It requires the confidence of school leadership to manage the change, especially by a dedicated investment in the human capital of teachers. It is imperative that teachers are given the skills to navigate the change and are confident that a focus on skills will always result in academic improvements.

Creating Opportunities for Authentic Learning (COAL)

How to keep it real?

I was lucky to meet Sam Seidel, author of Hip Hop Genius when he was involved in PBL World Australia in 2013. The theme of his keynote presentation for like minded educators attempting to implement Project Based Learning (PBL) was to – Keep it real!


From my experience in implementing PBL, one of the key factors for increasing student engagement in the classroom is Creating Opportunities for Authentic Learning or as I like to call it COAL. It is the goal of all 21st century educators to create these experiences, however some times these ‘real life’ experiences occur naturally such as existing competitions or current events. However, often teachers may need to craft real world experiences or occupations to align with the curriculum content. The key ingredient is to keep it real!


Teachers need to be challenged to source opportunities to include COAL into their classroom. Not only does it increase student engagement with the curriculum content, but it also provides a foundation to challenge students to think critically, apply problem solving techniques and develop their social and emotional intelligence. This can be challenging for teachers without a focus of student-centred pedagogies such as Project or Problem Based Learning.


In 2014, Parramatta Marist had the opportunity to participate in a Bridges Project organised by the Global Educational Community (GEC). The project promoted the collaboration of schools in China, United States, Singapore, Australia and Finland on a STEM themed engineering project. Parramatta Marist were fortunate to collaborate with Manor New Tech in Austin, Texas. This COAL opportunity occurred organically from an openness to collaborate globally and a strong focus on student-centred learning and problem solving. 


The video below provides an explanation of the project:

As a result, educational outcomes are also maximised when COAL is targeted. Below are few tips that I have identified to help you in your quest for COAL in your classroom.


TIP 1 – Look for existing competitions

  • There are a number existing competitions that can be easily aligned to curriculum outcomes. These competitions provide an authentic context and importantly an external audience for judging student work.
  • Some good examples of competitions include:

TIP 2 – Using content experts in the classroom

  • The use of content experts is a great way to increase the authenticity of your classroom. Some of the best projects I have implemented have had an external expert. From local politicians, scientists, engineers and journalists, all have challenged students to achieve deeper levels of learning.
  • In 2013, considerable time was spent in populating a parent occupation database. The occupation and interest details of parents were collected to be used in the construction of our PBL projects.
  • The primary aim was to use their expert knowledge and interests as content experts and/or external audiences in project presentations. The secondary aim was a way for teachers to open up channels of communication with parents regarding what is taking place in the classroom. 
  • In recent times staff have used technologies such as skype to bring globally renowned experts into their classroom.

TIP 3 – Providing students with authentic tertiary learning opportunities

  • Providing students in high school with the opportunity to complete tertiary courses is a great way to challenge students in an educational setting.
  • Adriano De Rossi (below) completed a Certificate 1 in Active Volunteering through the Max Potential Program which has also provided him with opportunities for further tertiary courses to be completed in year 12.
  • The University of Notre Dame also provide an Authentic Learning Opportunity for students through their Logo Course.

Adriano De Rossi being presented with his Certificate I in Active Volunteering

TIP 4 – Providing students with authentic mentoring opportunities

  • Creating connections for students in the workplace can foster authentic learning opportunities. Especially, student mentoring which provides students with an opportunity to develop social and emotional intelligences. 
  • In 2014, Year 10 students had the opportunity to participate in the Work Inspiration Program. This program aligned students with mentors at the National Australia Bank. Culminating in students and mentors working together on a collaborative real life project. This was definitely an authentic learning opportunity. 

Parramatta Marist student John Anderson(Left) with his NAB mentor

Finally, I started this blog with the idea ‘keep it real’ and I think that is the key. If you want to achieve COAL in your classroom you have to constantly ask yourself – ‘would this happen in real life’. This should reduce the existence of artificial or fake classroom focuses and provide opportunities for students to challenge themselves to achieve learning opportunities that are outside the boundaries of the classroom.

If you have any further ideas to achieve COAL please share them.