THE EFFECTS OF TEACHER PERCEPTIONS ON ADOPTING A NEW ROLE

CHAPTER 2 : Methodology

This research collected data from the 2005 cohort of teacher administrators. It utilised a series of questionnaires, interviews and journal entries in order to elicit information about initial and subsequent perceptions of the teacher administrator role. It focused on interpreting teachers' changing perceptions as they developed their skills and knowledge of their role during the training process and throughout their time working in their new role. Throughout this process teachers were asked to reflect on their changing perceptions and identify any information or skills they felt would enable them to perform more effectively in the new role.

Applications for the role of teacher administrators were submitted by March 1. From these applications, ninety six teachers were selected. Half of these were trained in August and administered tasks to Year 8 students. The others were trained in October and administered tasks to Year 4 students. The teachers participating in the research had all applied for the position and can be assumed to be motivated to undergo training for this role. The teachers came from a variety of school cultures, from all around New Zealand. They taught or had taught at a variety of age levels in the primary system. The teachers came from a range of teaching experience, from less than five years to more than twenty years.

Once NEMP had selected the teacher administrators for the 2005 cycle of assessment, a questionnaire was sent out to all the teacher administrators. The questionnaires used in this research are included in Appendix A. The first questionnaire ascertained information on the teachers' prior knowledge and understanding and expectations of NEMP and their role as teacher administrator. During the two training weeks, several teachers from each group volunteered to complete an interview about their perceptions of the administrator role. This interview was recorded, transcribed and analysed. On completion of their training week all teachers were asked to complete a second questionnaire to see if changes had occurred in their understanding of the role of teacher administrator.

Both groups of teachers spent five weeks working with students in a variety of schools. Whilst working as an administrator, the teachers that were interviewed were asked to keep a reflection journal, so they could monitor their perceptions of their role. At the end of the five week period of assessment a third questionnaire was sent out to all teacher administrators, to gather data on their perceptions of their role, after they had completed their administration period.

A number of NEMP staff were involved with the training of the teacher administrators: the co-directors of NEMP coordinate the training process and work directly with teachers during the training week. NEMP also have other personnel who facilitate the training process; one of these is contracted by NEMP in the role of 'visiting teacher' for a year, the others are permanent staff members. One of the directors of NEMP, the visiting teacher for 2005 and two permanent member of the NEMP team were asked to participate in an interview before the training process began, in order to ascertain the requirements that NEMP had for their teacher administrators. Further interviews took place after each training week, once video tapes from the first administration week had been viewed, in order to establish if there were any changes to, or conflicts of the expectations of the teacher administrator role for NEMP staff. The interviews were recorded, transcribed and analysed.

In January 2006, some of the data from the 2005 NEMP assessment cycle was marked. Often, teachers who have worked as administrators during the collection of the data, apply to work as teacher markers. Part of the marking process requires the markers to watch videotaped activities of students working on assessment tasks. Teacher markers then grade performances against set criteria. The videotapes show the teacher administrators explaining the assessment tasks and working with students in order to obtain detailed data. Markers view a variety of teacher administrators, all of whom participated in the training process. Teacher administrators who chose to be part of the marking process were identified and asked to participate in a further questionnaire and interview, after their marking week. Their perceptions of the administrator role after completing the marking process were recorded and analysed.

The Grounded Theory approach was used to gather and analyse the information provided through the questionnaires, interviews and reflection journals. The systematic collection and analysis of data generated from the research enabled the conceptualization of fundamental latent patterns occurring in the research situation, enabling generation of theory (Glaser, 2003: 189). Patterns in the responses emerging from the questionnaires and interviews, along with anecdotal evidence given by the teacher administrators during the various stages of their learning and application of their role were noted. Concepts indicated by the data were used to guide the analysis of information. Theories were then generated from the analysis of emerging patterns, to explain the data. The theories derived from the data were verified through comparison with literature from previous research. Collectively they describe the tensions and challenges faced by the teacher administrators and how those administrators perceived, interpreted and translated their new role into practice.


       

CHAPTER 3 : Results and Discussion

The following section provides an analysis of the information obtained from interviews, questionnaires and journal entries, grouped into common themes and issues as they arose. The first two sections report on the reasons for teachers wanting to work as a teacher administrator and their initial perceptions of this role. These included the skills they felt they needed to work as a TA and the skills they brought to the position that they felt were important. Their perceptions of the role and the importance of various skills were then analysed at the end of the training period and at the end of administrating. Subsequent sections deal with aspects of the administrator role that teachers had not realised were important, but became so as they worked in their role. These included: the need for flexibility; the importance of developing a positive collaborative working relationship with their partner; the importance of constructive feedback during the training and administration process. Teachers also suggested ways that would better prepare them to understand and implement the administrator role. The final section discusses teacher markers perceptions of the administrator role.

Comments from NEMP staff on these themes were integrated. Comments made by teachers and NEMP staff were coded in the following way:

TA4
- interview with Year 4 teacher administrator
TA8
- interview with Year 8 teacher administrator
TAJ
- journal entry from teacher administrator
TM
- interview with teacher marker
NEMP
- interview with National Education Monitoring Project staff
   
a1.0 Reasons for becoming a teacher administrator
Figure 1 shows teachers' reasons for applying to become a teacher administrator. Some people had been administrators on previous occasions and wished to repeat the experience; some had colleagues or friends that had worked as teacher administrators and had recommended the experience to them. For some teachers, NEMP provided an opportunity for them to visit and observe other students in other schools. Having the chance to be out of regular classroom work in order to revitalise oneself, or consider other career opportunities were also significant reasons. The majority of teachers chose to train to be an administrator because they were interested in one or more of the curriculum areas being assessed. They perceived the role would provide professional development opportunity in assessment of those curriculum areas.
a1.1 Teachers' initial perceptions of the teacher administrator role.
The reasons teachers gave for becoming a teacher administrator provided insight as to how they perceived the opportunity of working in the administrator role. This section examines in more detail the skills they perceived to be necessary in this role. In the first questionnaire completed before commencing the administrator training programme, teachers perceived that the most important skills for a teacher administrator were to have the ability to develop a good rapport with students and to be organised in order to work efficiently. They identified that being a good listener to children was also important and recognised that an ability to follow instructions would be beneficial to the role. These ideas formed the teachers' initial perceptions of the administrator role. These initial perceptions are represented in Figure 2.
Teachers were also asked to identify the skills that they felt they brought to the administrator role. Most teachers thought that they brought with them organisational skills and the ability to relate well to students and to work well with other people. The skills that they brought with them which they identified as being important also serve to reflect their initial perceptions and beliefs about the requirements of the administrator role. This information is represented in Figure 3.

When Figure 2 and Figure 3 are compared it appears that relating well to students, in order to develop a good rapport with them, and being organised were identified as being important skills required for the teacher administrator role and skills that most teachers recognised they brought with them to the role. Although teachers rated working effectively with others as an important skill they brought with them, they did not perceive this to be as important in the administrator role. Being a good listener to children was identified as being an important skill for the administrator role. Although some teachers recognised it as a skill they brought with them to the role, many others did not. This possibly showed an awareness of the skills that teachers felt that they needed to gain to be effective teacher administrators. Teachers perceived the ability to follow instructions accurately to be significant for implementing the administrator role. However, it was not identified as a skill that teachers brought with them to the role. . This may also have been something they felt they needed training in.

In their initial interview, all NEMP staff identified that having a good rapport with students was crucial to performing well in this role and that being well organised was essential for administering the tasks efficiently. This corresponded with the skills that teachers brought with them to the role and with teachers' initial perceptions of important skills required. NEMP staff also included the importance of developing a good rapport with colleagues. Teachers perceived that this was a skill they brought with them (Figure 3) but did not put much emphasis on it for the administrator role (Figure 2).

   
NEMP 1: We're looking for teachers that can establish good rapport with colleagues and with children…that have good relationships… that's high in the rankings. Another factor is that they can work methodically and efficiently; as you know, NEMP is a very well defined packaging of procedures and so on, and in order to maintain high levels of consistency at a national level of gathering information, that's quite important.
   
Having knowledge of the curriculum areas they were involved with and an interest in assessment in those areas was also a factor for NEMP staff.
   
NEMP 1: That they've got an interest in the subject areas that we're assessing. We don't expect them to be specialists, but we expect them to have a…a healthy interest in curriculum…and, well most teachers do really, but most years you'll find a teacher's got a particular interest…in other words, that there is some motivational factor there that's related to the curriculum, as part of their reason. Also, their interest in developing their understanding about assessment.
   

The majority of teachers chose to train to be an administrator because they were interested in one or more of the curriculum areas being assessed. They perceived the role would provide professional development opportunity in assessment of those curriculum areas (Figure 1). These initial perceptions of teachers corresponded to the requirements of NEMP.

One member of the NEMP staff also identified patience as a key requirement and another member thought that flexibility was vital.

   
NEMP 2: Well, probably the most important is the way they work with students. That they've got an encouraging, positive approach with a student, that's especially important to get the best out of them. Also, that they are patient. Organisation is quite a thing. It's a big issue to get through all the tasks in a certain time, you need to be really highly organised.
   
NEMP 4: They need knowledge in curriculum focus areas. They must be people who can cope with changing environments… an ability to work with others.
   
a1.2 Skills teachers feel they need to learn during the training week.
The previous sections discussed how teachers initially perceived the administrator role. It identified the skills that teachers perceived they had which they considered would be necessary to implement that role. This showed some differences between what they felt were important skills for teacher administrators and the skills that they brought with the. This section deals more explicitly with the skills that teachers perceived they needed to learn during the training week in order to be prepared for the administrator role. However, the skills that they identified in this section were not the ones that the previous section suggested may have been raised. When completing Questionnaire 1, before commencing the training, teachers were asked to identify these skills. The skills they felt they most needed to develop during this week were:
the ICT skills needed to administer and record the assessment process
familiarity with the assessment tasks
   
A number of people noted that they needed to develop their organisational and time management skills. A few people felt that they needed to develop the skills of working collaboratively with a partner. This information is shown in Figure 4. These skills identified were based on teacher's prior knowledge of the administrator role. Teachers' prior knowledge seemed to be informed by the teacher administrator job specifications contained in the NEMP application pack. In some instances this prior knowledge may have been influenced by talking to other teachers who had previously worked as a teacher administrator.
The NEMP staff identified that confidence to implement the assessment programme effectively was the aim of the training programme and this included:
the need for the teachers to develop an understanding of the NEMP process
knowledge of the NEMP tasks and resources and how to use the manuals
Knowing how to facilitate the assessment process
ICT skills in order to be competent with the equipment.
the skills needed to get the best responses from students
   
It seems that before entering the training programme, consistent with the expectations of NEMP staff, teachers perceived the most important skills that they needed to learn was the use of ICT equipment and knowledge of the NEMP tasks and resources. However, at this stage, teachers did not place an emphasis on a need to develop an understanding of the NEMP process, and knowing how to facilitate the assessment process in order to get the best responses from students. These skills and understandings were seen by NEMP staff as being necessary to implement the assessment programme effectively. Teachers did identify 'following instructions' as being a necessary skill for implementing the administrator role, as indicated in Figure 2. However, they did not include it in the skills they brought to the role as shown in Figure 3, and they did not perceive it to be a skill they need to learn during the training week. The teachers had perceptions about their own learning needs. However, previous research by Creighton and Johnson (2002) has suggested that it is not until teachers are actively engaged in a new role do they realise that there are components and challenges that were not part of their expectations of the role and not perceived as a learning requirement. Their findings lead them to posit the need for a safe practice field to enable learners to get a feel for the role and make mistakes, which serve to enhance learning and cultivate new beliefs. The discrepancies noted between teachers' perceptions of what they needed to learn to implement their new role and the requirements of that role seem to corroborate the findings from Creighton and Johnson's (2002) study.
   
a1.3 The skills and ideas or understandings that teachers learned during the training week.
After identifying teachers' perceptions of what they needed to learn in Section 1.2 it was necessary to consider what were the important skills they perceived they did learn during their training. At the end of the training week teachers were asked to complete a second questionnaire. In this questionnaire they were asked to identify the most important skills and ideas or understandings that they had learned during the training week. The skills and ideas or understandings identified were:
to follow instructions (“stick to the script”)
to be organised with the equipment
the use of ICT
to praise student effort and not their performance
to work in a facilitating role and not a teaching role
   
Figure 5 shows this information.
At the end of the training period, teachers' comments demonstrated that they had incorporated some understanding of the NEMP process into their perceptions of the administrator role:
TA8-8: Being organised, in terms of being prepared; know what you are doing - delivery of the tasks for example. Being enthusiastic and making the students feel welcome and at ease.
TA8-5: Trying to divorce myself from the teacher role and be a facilitator. Trying not to teach, just encourage them to think. I'll have to be careful with that. It will upset the results that come through by leading the children in certain directions instead of letting them follow their own direction and what their own thoughts are. You want to find out what they think instead of what you think they should think. That could damage the results more than anything else.
TA4-7: Important to be consistent…to say things in the proper way for it to be valid. Make sure children feel comfortable so that you get the most out of it. Make sure the equipment is working. Make sure you keep records accurately so that data is worthwhile and usable.
   

Figure 5 shows that being organised with the assessment resources and the use of ICT equipment were identified as important skills learnt. These skills were both included in teachers' perceptions of what they needed to learn, as demonstrated in Figure 4.

The majority of responses in Figure 5 indicated that following instructions was one of the most important understandings they thought they learnt during training. As discussed in Section 1.2, this was not perceived by teachers as a skill that they needed to learn (Figure 4). However, nor did they identify it as a skill they brought with them to the role (Figure 3). This suggested that it was a surprising feature for them when learning about being an administrator. Teachers also acknowledged that they were required to change their role from that of a teacher to that of a facilitator in order to implement the administrator role (Figure 5). Teachers' perceptions of what they needed to learn did not include developing this skill (Figure 4). Other skills and understandings that were not included in teachers learning needs were focusing on effort and not performance of students and developing an understanding of the role of NEMP. Both of these were included as important things learnt during training, as shown in Figure 5. None of these skills were identified as ones which teachers brought with them to the role. It would seem from the results shown in Figure 5 that NEMP training provided teachers with an understanding of these new aspects of the administrators' role.

However, research suggests that it is important to acknowledge the effects of teacher perceptions on the assimilation of new learning. It is necessary to identify factors that impact on changing those perceptions in order to enhance the acceptance and integration of a new technique or role (Smylie, 1988). NEMP requires teachers to change their behaviour in order to integrate their new role. Teachers have to become facilitators; they have to focus on students' efforts and not their performance; they have to follow instructions accurately. Studies have indicated that in order to make significant changes towards desired behaviours, training should be systematically focused on sensitising teachers to a particular skill, and provide practice experience based on theoretical content, followed up by opportunities for review and feedback (McGee 1980).

 

prev page / next page

top of page    |    return to Probe Studies - INDEX   |    return to Other Studies menu
For further information and contact details for the Author    |    Contact USEE