Use of Word Clouds to Understand Target Learners

Description

Currently, the physiotherapy programme includes 120- 190 students in a large-group teaching (lecture). While there is some benefits to delivering teacher-directed content to the students in this way, it is somewhat difficult to engage students and to establish the current understanding of the cohort as a whole.

While preparing for a lecture that was to be presented following the “lunchtime lull”, I considered introducing something different to help break the monotony; for students to interact and contribute to; to provide me with an understanding of their current learning so could refocus the remainder of my lecture; and for students to get instant feedback on what others had contributed to. In order to attend to the above, I utilised Mentimeter Word Clouds into the middle of my lecture.

Reflection on Understanding Target Learners

While I have reflected on the benefits and constraints of the use of Mentimeter in another post (see 1a); here, I will reflect on how the use of the interactive Word Cloud enabled a better understanding of the students’ current learning. 

I have always found it difficult to gauge the overall level of learning of students in large-group environments- and it appears when discussing with others that I am not alone. With close to 200 students in a lecture theatre, it is those in the front row or only a handful of the same individuals that seem to consistently share their opinions during the lecture. 

The use of the interactive Word Cloud enabled more engagement to the online-based questions than if this was asked verbally. For example- when asked, “what are some effects of aging on the neuromuscular system?”- there were over 80 responses. I found it interesting to see the momentum grow as subsequent students engaged with the interactive question. It seemed to me that by seeing peer responses go up on the data show in “real time”, this provided others confidence of what they were thinking. 

It was relatively easy to establish some of the common themes of what the students were considering in response- with those that had multiple responses represented either larger, or more central. This helped direct my understanding of their current knowledge, and what to emphasis on in the remainder of the lecture. Having the responses more central, did not equate to always being correct, however. However, this did provide me a great opportunity to address the understanding there and then. Likewise, what was more “on the rim” or smaller may have been deemphasised, with some discussion as to why a particular response could be warranted (and/ or correct)… 

In the future, I will use the MentiMeter Word Cloud function which enables student-directed learning as they self-pace through a series of questions. This may be provided ahead of the lecture (though may not provide the confidence to answer as described above); or made available during the time of the lecture only. Watch this space!

Advertisements

Deploying and Supporting Use of 360 cameras

Description

Healthcare higher education (HHE) continues to grow as it tries to meet the deficit of healthcare professionals in New Zealand (Ministry of Health, 2018). However, this puts pressure on lecturer to staff ratio, physical classroom sizes, tutorial equipment, and clinical experiences. In response, HHE lecturers need to consider alternative pedagogy to delivery engaging teaching, that shifts from teacher-directed to student-directed learning in extended [virtual] clinical environments due to the limited opportunity for clinical situated learning. The use of 360 virtual environments may help to bridge that gap.

Other blogs have outlined deployment and support of staff using 360 cameras and virtual environments including a proposal for equipment; Educational workshops; development of a “how-to cheat-sheet”; and instructional video for the online software (SeekBeak).

Reflection on Deployment

Being relatively novice to the use of the 360 cameras myself, I was somewhat nervous in being “called upon” to develop the proposal for the School and to lead teaching sessions to peers (something I find more nerve-wracking compared to teaching students). However, I received some good feedback from the School workshops, with some expressing enthusiasm for its use in their own teaching (see support below). As I became more confident in its use, I was able to initiate, then develop on the “cheat-sheet” and instructional videos. On reflection, having these resources available has reduced the common questions asked on “how to” set up; enabling concentrated face-to-face time on the scenario they are using the 360 environment for.

Reflection on Support

I always find it rewarding to see others develop something that was initially new to them. Even more rewarding when it is using resources personally developed. Staff, especially first time users, were supported in their development of scenarios and use of 360 environments with individualised meetings. I learnt that there was significant value in providing an initial 30 minute meeting to hear their intention for teaching was, to provide an overview of the resources, and then leave with the video and “cheat sheet”. It meant that the next meeting they would have developed an independent plan of how they would use the 360 environment, have a “play” with the equipment and software and have some “creative license”. One example included working with the Occupational Therapy team that focuses on management of an individual with an identified falls risk. I have also learnt that I have gained personal insight by working with different healthcare disciplines who have differing perspectives on the priority of care (i.e. the flow of the scenario). This has provided me a broader context to the clinical reasoning of my own approach to priorities- and to teaching students the consideration of other interprofessionals. I have also learnt to broadened my face-to-face contact when supporting staff- starting with “what is the end result you want to get the students to understand?”, and acknowledge when the use of 360 environment is not suited for that learning.

Another example of supporting others includes an impromptu invite to assist a Seekbeak workshop during the ASCILITE 2017 Conference. By doing so, I in turn developed experience working with others outside HHE; as well as confidence in “student”-directed blended learning as the workshop was directed by the participants’ needs.

I have learnt that by utilising a case scenario in a virtual environment, (HHE) students’ can independently investigate the scene to assess, prioritise then link to other resources. They are also prompted in their own time to peer-up and complete practical tasks, or to confirm learning with the lecturer.  I have been encouraged by how the use of virtual environments has naturally led to student-directed, blended learning.

Research Presentations

“It Takes a Village…” Curriculum Working Group #cmaltcmooc #cmalt

Description

The following is an outline of our physiotherapy programme’s recent initiation of a curriculum review. While there have been some minor amendments of papers,  it had been 8 years since the role out of our current undergraduate programme. A change in the Programme Management in August 2018, has enabled a focused review of the curriculum as a whole- supported by incidental reviews leading up to this time.

Reflection

In appreciation of the need for a review based on staff and student feedback, the incoming Head of Department (HOD) and I met to discuss a way forward. While not in the Programme Leader role at the time, I was asked if I would be happy to take on the responsibility of reviewing the curriculum. In preparation for this, there were a few considerations I wanted to be clear about:

1. Not to “go it alone”. If I was to lead the review, I would want to do it with a group of individuals who could help champion the progress forward. Discussions with the HOD lead to the advocacy of a  “working group” that would have delegated responsibility to review, and make an informed decision and administer changes within the curriculum. At the next available staff meeting, the Head of Department called for expressions of interest in a Curriculum Working Group and a number of key (and well respected) staff volunteered to be involved
2. “Do a few things well”– then move on. I was keen to establish the idea that we would tackle a couple of areas of the curriculum at a time- though always returning to the agreed framework that had been established to ensure that if fitted with the overall vision for the programme.

Informally, this would follow a design thinking process- a methodology that provides a solution-based approach to solving complex problems that are otherwise ill-defined. This is done by following (not necessarily in sequential order) five steps (adapted from Dam & Siang, 2018):

1. Empathising– understanding the human needs involved. This includes consulting (and re-consulting) the students, staff, and stakeholders to understand more about their concerns about the programme. Engaging and empathising to understand their experiences and motivations of the current curriculum, which allows setting aside of own assumptions of the needs of the programme.
2. Defining– reframing and defining the problem in human-centric ways. The important information has been gathered to define the core strengths and weaknesses that the working group has identified up to this point. This is usually done by creating “Problem Statements”
3. Ideating– creating many ideas in ideation sessions. Here, solutions are generated. Now with an understanding of the needs of the students, staff, and stakeholders, the working group can “think outside the box” to identify new solutions to the problem statement to look for alternative ways of viewing the problem
4. Prototyping– adopting a hands-on approach in prototyping. The group then presents a number of versions to the staff- or sub-group. The aim is to identify the best solution for each problem statement. The solutions are investigated and either accepted, improved and re-examined or rejected based on the responses.
5. Testing– developing a prototype/ solution to the problem. While the final stage includes the application solution, there may be further refinement as a deeper understanding of the impact of the implemented solution is developed.

It can be seen from above, that there are some potential similarities to the phases within Educational Design Research (EDR) as outlined by McKenney & Reeves (2018)- (Analysis and Exploration; Design and Construction; Evaluation and Reflection; Maturing Intervention and Theoretical understanding; and Implementation and Spread)

The following is a recent example of how we have utilised a design thinking process to the development of the curriculum:

1. Empathising– Once the group had been established, I arranged a meeting (utilising www.doodle.com) and set about gathering some background information so we could start the process well informed. This included a review of the framework models and common themes proposed by teams of staff before amalgamating the models into the “preferred” framework. I also met with the Student Representative Group to ensure that I had “student voice” in any proposed changes. At the meeting (23rd July), there was general consensus in that we agreed (1) we had some good content already; (2) we want the programme to regain the “gold standard” status we had as a physiotherapy programme; and that (3) it was the framework [and delivery] that we needed to turn our attention to, and- with continued feedback from staff and students- ideas would be informed, presented, redesigned, implemented and evaluated.
2. Defining– Key members of the Curriculum Working Group were delegated to gather further information on identified “key themes”. Information was gathered then presented back at the next staff meeting (21st August). From this, we agreed to focus initially on two key themes for the overall framework- (1) the integration of research, and (2) the role of optional papers within the programme.
3. Ideating– Based on information gathered at the empathising stage, and then confirmation of key themes at the staff meeting, I was able to immediately put research and elective options to staff in a survey sent via email (21st August). The aim was to provide staff with six options, to then determine a preference with qualitative data on their reasoning. The survey was open for just under a week (21st- 27th August) which resulted in a response rate of (78%), with 21 responses from the 27 current teaching staff.
4. Prototyping– once I had collated the research and elective survey data, I arranged a second meeting (11th September) with the Curriculum Working Group to discuss the next set for prototyping. Ideas were discussed and documented on an “evolving ideas whiteboard”…

The results enabled us to identify two main options, which I then presented in a narrated PowerPoint via an unlisted YouTube Link (13th September). The aim was to provide staff a final opportunity to discuss and consider prior to the next staff meeting (24th September)- after which the Curriculum Working Group would proceed with the identified preferred option for research and electives. This will not be able to be tested until 2020, which would be the first year any curriculum changes would be implemented from this date.

With the regular Curriculum Working Group meetings and a sense of progression and being updated, it had been rewarding to see the collective ownership and shared responsibility that is being developed within the group. This includes two staff who have presented the pros and cons of the two options at the next staff meeting.

Impact on Teaching, Learning or Pedagogy

My use of technology as the working group has met and then updated staff has not been incidental. By utilising the various modes of delivery (PowerPoint, SurveyMonkey, staff meetings and YouTube Video) I have inadvertently showcased alternative ways of engagement that has been commended by others, been suggested as good approaches in collating information and have has been requested as a great way to readily receive information in the future. While this appears to be an involved process for two aspects of a curriculum framework (Research and Optional Papers)- so it should be. I will be utilising elements of the design thinking process and Educational Design Research as I lead the Working Group in the curriculum review. Already, it can been seen that by utilising these processes, that the appropriate users are engaged with, empathised with; that ideas are defined, options are developed, prototyped (and later- tested), and then evaluated.

It is envisioned that this Blog Post will be updated at the next CMALT review.

References

Dam, R., & Siang, T. (2018, September 10). 5 Stages in the Design Thinking Process. Retrieved September 20, 2018, from https://www.interaction-design.org/literature/article/5-stages-in-the-design-thinking-process

McKenney, S. & Reeves, T. C. (2018). Conducting Educational Design Research. (2nd Ed). Routledge: London.

Developing a Guideline for Audio and Video Recording for Assessment Moderation #cmaltcmooc #cmalt

Description

To ensure fair and equitable assessment processes that are consistent with others within the Faculty (and University), each paper/ module reports on assessment moderation. While this can be fairly easy to plan, execute and evaluate for paper-based assessments (i.e. written examination, assignments and reports), the consistency of assessing practical skills can be problematic. Currently, the physiotherapy programme includes (1) pre-assessment moderation meetings; (2) cross-marking within the scheduled examination period; and (3) post-assessment moderation meetings.

I was approached by the physiotherapy management team to investigate the use of audio and video moderation of examinations. This subsequently led to the development of a guideline/ policy for the Physiotherapy Department.

Reflection

When considering implementing recording of assessment for moderation, on reflection there were a few key questions that I needed to consider:

• How will the students be informed of the video and audio being captured?
• How will the video and audio be captured, and will it be able to capture the movement throughout the practical examination?
• Will there be enough storage space on the device to capture ALL examinations?

There was some contention as I suggested that the newly purchased video cameras (Sony HDR-PJ410) would not be sufficient and further cameras would need to be purchased. While my argument was based on a comparison of the current cameras to specifications required at a similar cost- the School budget did not allow the purchase of further cameras.

I also consulted other key staff members who were involved in the practical examinations as well as colleagues in paramedicine and nursing who were already recording their assessments.

When considering all the above, it was clear that while there was value in establishing recording for the purpose of moderation; there were no clear guidelines or policy to work from. This was confirmed at a meeting with the Faculty Associate Dean (SS).  Overall, my reflection on the current issue (consistency of moderation of practical examination) and consultation with others led to the development of a Guideline for Audio and Video Recording for Assessment Moderation.

As the paper booklets for Semester Two 2018 had already been published, these Guidelines were not able to be implemented in full this semester. It was pleasing that those papers intending to use the recording for moderation had already included some information in their published booklets. They then utilised the remaining guideline information to better inform the students online and on the examination timetable.

One paper I am involved in did include the recording of assessment. We met as a team to discuss how would use the audio recorders (including what would state; to “stop” at each exam to create separate files, and that would review any that were unsure of final mark and those that were receiving a fail mark).

In future updates of this guideline, I would include the suggestion on a pre-moderation meeting to discuss the consistency of recording (as outlined above). It has also since been confirmed (November 2018) that as the recording is part of a moderation of assessment, that the student’s right to refuse recording; and ability to withdraw consent for recording can be removed; though students can still request to listen to the recording if they wish.

Use of Evernote for Presentation #cmaltcmooc #cmalt

Description

While I have been using Evernote to keep my various notes organised for a few years, I had not utilised it for the purposes of presentation. I was asked a couple of weeks ago if I would be interested in presenting an overview of my initial exploration of mobile VR in physiotherapy education. As I am increasingly using Evernote to collate my To Do Lists, Meeting agenda and minutes, and research- I started jotting down the ideas I had for this 25 minute Google Hangout presentation. These ideas quickly formed my notes, and the notes formed my handouts for the audience. Rather than starting up a new PowerPoint (my “go to” for presentations), I decided to investigate how I could use the presenter tool in Evernote. I was surprised to see that all I needed to do was add the “slide” dividers which could be found in the Presentation Layout. Some of the key benefits and constraints that I found when using the presenter tool can be found below:

Reflection on Benefits

• Add lines for “slides”- done. No extra work to develop “ideas” into “slides”
• Limited tools = no fiddling…#1. As the tools available in the Evernote presenter is fairly limited, this, in turn, limited your ability to spend potential hours on perfecting the slides; or adding in unnecessary slide transitions or animations… It is simply (1) decide on the colour of the pointer; (2) colour of the background- white or black; and (3) the font size.
• External links and back- no problem. When an URL link is clicked in Powerpoint, the presentation is superimposed by the browser which then requires the user to escape, find the PowerPoint again to then return to the rest of the presentation. In Evernote however, while a full screen of the external link is provided, you have the option to open the image in the browser or to return to the Evernote presentation at the click of a button (top left corner when presenting). Makes for much simpler transfer between open applications.
• Present on another screen?- easy. Evernote gives you the choice of which available screen you want to present on (right click on the Evernote and choose “Present on another Screen). While this is available in PowerPoint, it is a bit cumbersome  (Slide Show-Set Up Show- Monitors).

Reflection on Constraints

• Images/ pdf difficult to view online. When the audience clicked on the link for the associated Evernote, the web-based outline unfortunately warped some of the images. However, this could be rectified by clicking on the attachment icon, by “viewing as presentation” or “View in Evernote”.
• Limited tools = no fiddling…#2. With the limited tools, it does mean that you would need to ensure that any images you need are already developed beforehand- either using Evernote tables, audio or video recorder or file from external software. This might lead you back to PowerPoint which was the case for me as I included slides from a previous presentation.
• Images to pdf. On the note of inserting slides from other software, Evernote converts these images as pdf. I am unsure of the rationale for this, other than might mean that viewers are unable to change the image and/ or to reduce the size of the files.

Impact on Teaching, Learning or Pedagogy

The consideration of other media to relay content knowledge aligns with Gavriel Salomon’s (2016) learning theory of Symbols System which acknowledges that we utilise different types of media to correlate with the different levels of processing required to enable acquisition of knowledge. The use of Evernote was geared specifically for a a small audience- and while my first experience of using the presentation tool was positive, it is not something that I would utilise for a two-hour lecture to students… …yet. I have since utilised Evernote to present in other small group meetings (e.g. the Curriculum Working Group) which has been met with, “Oh, that’s different… …what are you using?”- followed by an ad hoc teaching session with those interested in the use of Evernote.

My use of Evernote to present on the Google Hangouts platform (also new to me) can be found below or by using the following link http://bit.ly/SoTELBFhangout 

References

Salomon, G. (2016). Interaction of media, cognition, and learning an exploration of how symbolic forms cultivate mental skills and affect knowledge acquisition. New York: Routledge. ISBN: 1138972959 9781138972957.

To Turnitin, or not Turnitin- that is the question…

Description

In 2016, I entered as a joint Paper Coordinator for a third-year physiotherapy undergraduate module (Managing Complexity in the Community Environment). We inherited a paper that was very didactic in delivery and required the students to incorporate their collective knowledge on the module into one Summative Assessment as a written assignment. While the assignment had to be submitted to Turnitin for a review of plagiarism; students were also required to submit the same assignment to Blackboard for the purposes of marking. This seemed non-intuitive and open for error. Student reviews for the paper in 2015 were “average” to say the least, and as incumbent Coordinators, we agreed that we would utilise creative liberty to refresh the delivery and mode of assessment.

Reflection

We gathered up the teaching team to discuss a new approach to the assessment. The teaching had been delivered by four lecturers- all with their own specialty. The purpose of the paper was to demonstrate complexity in common physiotherapy conditions. With the teaching being delivered by four key lecturers- all with their own specialty- it was proposed that we adopt a problem-based learning approach, which used complex case scenarios from the four key areas as a mode to assist complex clinical reasoning and consideration of interprofessionals. These cases were delivered in small group teaching to enable discussion and exploration of the scenarios- some of which included blended learning through a virtual environment (myself) to incorporate resources they would readily utilise when on clinical and graduation, as well as to promote “investigation” of the scene- rather than providing all clinical features for the students.. .

We also wanted to emphasise the importance of good clinical documentation- in particular- referral letters to interprofessionals. Our first summative assessment, therefore, included submission of a 1 1/2 page referral letter (with 1/2 page of endnotes) that was submitted to Turnitin (Appendix 1). By keeping the assessment relevant to the case scenarios presented in the small groups; the assessment clinically relevant; and also some creative license (i.e. students came up with their own letterheads; business name; digital signature: and logo)- it made it all manageable for students. By submitting once to Turnitin and utilising the available marking tools (including cut and paste; user strings, etc) it made for easy turn over of feedback to students which was then utilised for the second summative assessment (clinical reasoning regarding the content of the letter).

Impact on Assessment

So- this is where “To Turnitin” worked for us last year (2017):

• Reflection on clinical problem-based learning
• Rather than an “assignment”- assessment was relevant to a clinically useful skill that was not otherwise introduced (or assessed) in the programme (i.e. development of concise referral letters)
• Develop consistent feedback strategies
  • Use of a Rubric for learning outcomes (Appendix 2)
  • Link comments in Turnitin directly to the learning outcomes
  • Use “QuickMarks” “Commonly Used in Turnitin
  • No information in the “User’s Comments” Section- feedback was to be provided “within” the assignment

This approach has been found to be successful by the teaching team, with the students quickly seeing the clinical relevance- rather than “just another assignment”.

In an effort to learn from other colleagues, discussions with the paramedicine team revealed that they have extended the assessment within Turnitin to using not only the audio feedback feature, though have included attaching a video (mp4) for feedback. This seems to have been well received by the students. It may be something that we need to consider for future use of Turnitin for our module; or to disseminate the effectiveness of the practice to others within our department at a staff meeting… (Appendix 3)

Appendix 1

MCCE_ConcussionCase_2017

Appendix 2

Appendix 3