Monday 18 March 2013

Assignment 5


Reading through Read to Succeed Review and Action Plan: Recommendations (May 2009) a report from the Read to Succeed Review Committee for the Saskatoon Public School Division I noted the two main goals:
·      to improve reading performance, and
·      to gain the confidence and skills necessary to work at an independent level in the regular classroom setting.

During an interview with one of the Read to Succeed committee members, she stressed the ‘bigger picture,’ or aim of the Read to Succeed Program, specifically “building confidence and capability” in our students while connecting reading, writing and ways to find information and communicate.  I became curious about student confidence, mainly as students get older, how their confidence in reading (when it seems everyone else is good at it) fades as they see themselves compared to others. 

In Emily Calhoun’s book Teaching Beginning Reading and Writing: With the Picture Word Inductive Model (1999), she writes:

“A positive aspect in addressing the literacy challenge is that these older students, whatever their native language or home environment, bring more knowledge with them than 6-year-olds.  The older students are more mature; if they choose to engage, they can make rapid progress, moving ahead in reading and literacy much faster than the average 6-year-old,”  (p. 103).

I think the reasons for the success of the Read to Succeed program are:
·      students generate the words and information from…
·      they learn from each other (as well as from the teacher)
·      the concepts they already know and own about how language works are used to support instruction and are extended upon

Unlike other programs, which may concentrate or begin with student deficits, the Read to Succeed program appreciates and looks to what the student already knows.
This approach to learning which involves the expansion of and building on to what is already known, along with student-generated concepts and starting places is very successful.  Both the Gray Oral Reading Test (GORT) and the Fountas and Pinnel Benchmark Assessment System have shown double and triple student gains as well as an average growth of 1.3 Grade Level Equivalency (GLE).

The program must boost student self-confidence and self-esteem as well.  So wondering about the connection between motivation and confidence, and how one might measure or get a sense of how student attitude toward reading can change or improve, I did some investigating.  The first resource I found was a book titled, Improving Reading: Strategies and Resources by Jerry L. Johns and Susan Davis Lenski (2001).  Their survey titled, Motivation to Read Profile: Reading Survey was to be used as a starting point in planning as the teacher gained a sense of student attitude toward reading.  My initial survey used many of the questions from the Motivation to Read survey and consisted of 20 questions:




After giving some teachers (classroom and resource room teachers) the survey Ias well as the 809 assignment, I anticipated their feedback and suggestions.  I also found the Rhody Secondary Reading Attitude Assessment (http://employee.heartland.edu/icole/rhody/index.html) and circled some questions from that survey that I thought I could add. 

 These are some of the changes I made based on both the comments I received and the Rhody Secondary Reading Attitude survey:

a)  One of my ‘testers’ felt the survey was too long, and wondered where my open-ended questions were.  I omitted the first two questions since the teachers giving the test knew the students and therefore did not need the students to fill in their gender and age and began combing through questions which could be re-written as open-ended or scale-rated.

 b) Another teacher pointed out, “If they do not like reading and their friends do not like reading, I don’t think # 8 is relevant.”  Question #8 was,

I tell my friends that reading is
Really fun
Fun
OK
No fun at all

This was a good point, so I removed #8 and #3 and kept these two questions, pertaining to friends:

My friends think I am a
Very good reader
Good reader
An okay reader
A poor reader  and

My best friends think reading is
Great
Really good
Okay
Boring

These questions seemed to indicate whether the student had support from his or her peer group or if reading was something they ever talked about or participated in outside of school. 

c) It was also pointed out that kids usually get gift certificates to pick out their own book these days, and that the question, When someone gives me a book as a gift…I feel…might have been better stated, When I receive a book on a topic that I like…I feel…so I changed the question to If I got a gift certificate to buy a book, I would be…(I should have used “received” instead of “got!”  yikes!). 

d) Another issue I thought of during our discussion was that many students do not have their own bedroom or a bedroom at all to sleep in, so changing the question from You have a lot of books in your room at home to (Rhody survey) At home, I have…was more inclusive of all students. 

e) Another teacher pointed out the use of the word “fun,” and wondered if perhaps kids don’t equate fun to something more physical like a game.  The concept of reading as something that is interesting or enjoyable, was agreed upon, but I decided to use great, really good, okay and boring, since students would be filling out the survey, I wanted the vocabulary to consist of words students would use.

My final survey is comprised of twelve questions which given at the beginning of the Read to Succeed program, then mid way and at the end of each students’ year would help determine any changes in attitude and interest in the area of reading and competency.
 I liked the layout and design of the kwiksurvey website, however it did not allow for open ended questions.  When I wanted to reformat the style of question, I could not, as the free version only permitted multiple choice questions and would not allow a variety of question types.   The open-ended questions in the final survey look like multiple choices, which might be confusing.



* As a final bit of advice, one of the teachers suggested reading the questions out loud, along with the students.  She pointed out that if they have difficulty with reading to start with, the survey may be stressful and I may not get accurate feedback.  “This isn’t a test to see how much they know, we want to know how they feel about reading, and themselves as readers.”   Another teacher pointed out that reading the questions out loud, might invite students to ask questions throughout as well…but the overall consensus of the group was that that was okay for better understanding of each question. 


* Even though my survey was designed with grade 3,4,5 and 6 students in mind, I thought that teachers would be the best ‘testers’ as they would have a sense of what I am hoping to gain through the survey and the best indicators of confidence and competence in reading.  I was curious about a student response, so I gave the survey to a neighbor who is in grade 5.  He thought it was fine, but on question #3 he drew a picture instead of writing words and on #6 he scribbled down…trilogy!!!  He also added the words “for money,” at the very end of the survey after checking off the box that read I would do another one.





                                             

Thursday 21 February 2013

Overview of Program

The Read to Succeed Program is an intervention provided in small group or one-to-one instruction to support at-risk learners, specifically struggling readers. Read to Succeed is offered to students in grade three to twelve who have difficulties with reading fluency and/or comprehension who are two or more grade levels behind.  The goals of Read to Succeed are to improve reading performance and to gain confidence and skills necessary to work independently in a regular classroom.  The teachers are trained to implement the program daily (90 mins/day) in addition to the regular Language Arts instruction and work in groups of 15 or 28 with two teachers.  The program is viewed as an intensive support which aims to move children out of the program quickly as they gain confidence and competency and learn to read for both information and enjoyment.  The Read to Succeed program relies on consistent communication and collaboration between the regular classroom teacher and the trained Read to Succeed instructor, with recommendation of a Read to Succeed Team in every school.
Every year, the Read to Succeed program has averaged a double or tripled gain in reading comprehension (measured by the Gray Oral Reading Test).  Read to Succeed is viewed as a strong intervention for supporting struggling readers and promoting a lifelong love of reading.

Saskatoon Public Schools (2009) Read to Succeed Review and Action Plan: Recommendations: A Report of the Read to Succeed Review Committee


Thursday 14 February 2013

Assignment Four Project Logic Model R2S

GOAL

OBJECTIVES

ACTIVITIES
OUTPUTS
OUTCOMES

IMPACTS

Statement of the overall purpose of the project
Specific statements of what the project sets out to accomplish
Specific tasks to complete through implementation of the project
Immediate results (direct products of project activities)
Intermediate results (1 to 3 years after project starts)
Long-term results (3 to 10 years after project starts)
To improve reading performance
To build and foster student confidence in reading and writing
To build background knowledge (curricular outcomes) students are missing in content areas
Foster a love of reading for knowledge and enjoyment
Teach students the reading - writing connection
Teach students that reading and writing are communication tools (to convey messages)
To gain the confidence and skills necessary to work at an independent level in the regular classroom setting
For students to improve one grade level equivalent (GLE) in one year (at least)
Establish good language habits through modeling  and explicit instruction
Students have metacognition, independence and control over their learning
Students learn to read well enough to handle the grade level materials they learn at school
Training of teachers in Picture Word Inductive Model (PWIM)
Small groups of 15 students (or two working with 28 students)
The Read to Succeed program is embedded into the school day as uninterrupted every day for 90 minutes, on top of regular daily Language Arts
Systematic approach to instruction
Collaboration across classrooms with support staff, resource room teacher, English as an Additional Language teacher and classroom teacher(s)
Explicit goals and expectations
Sequence of phonemic awareness, systematic phonics, vocabulary, fluency, reading comprehension strategies and comprehension skills implemented daily
Writing every day
Read Alouds from teacher daily
Daily silent reading
Word study and word work daily (including classifying)
Monitoring of program and successes based on curriculum
Ongoing daily formative assessments
Word assessment 3 times during each PWIM cycle
Summative assessments three times a year (as students come into the program, January and June)




Students have exited the program and are academically successful in their classrooms
Students are able to apply the learned reading and writing strategies to aid in their learning
Students read to find new information and for enjoyment
Students can read and write at grade level
Students have confidence as readers, writers and learners
Competence in reading and writing becomes proficient so that they can function in society as productive democratic citizens
An enjoyment of reading for knowledge and pleasure
Critical thinking based on reading



Goals and Objectives represent the Strategic Directions of your Project
Activities comprise the Project Work Plan, which should include details for each activity (Who?, What?, When?, Where? How?)
Outputs link directly to project activities; activities are what is done…outputs are the expected results of what is done
Outcomes relate to your objectives; objectives are desired, outcomes are the expected results
Impacts relate to goals; a goal is desired, impacts are the expected end-results

Friday 8 February 2013

Assignment Three




           A READ to SUCCEED PROGAM at one school

Who should be involved? 

Students, Classroom Teachers, Read to Succeed Teachers, Parents, Administrators, Superintendents, Resource Room Teachers, English as an Additional Language Teachers, and Literacy Teachers.
How might they be engaged?
By collecting observations, feedback, opinions, data and through conversation, each of the stakeholders can provide reflection and the success or failure of the Read to Succeed goals.

           Focus the Evaluation

What are you going to evaluate?  Describe program (logic model).

The program I have chosen to evaluate is the Saskatoon Public School Divisions’ Read to Succeed Program.  The goals of the program are to improve student reading performance and instill confidence and competency so that children may work well independently in a regular classroom.  Progress is also gained by gains made in Grade Level Equivalency (GLE).

What is the purpose of the evaluation?
The purpose of the program is to evaluate whether the program is reaching it’s goals and to what extent. 
Who will use the evaluation? How will they use it?
Who/users
How will they use the information?
Read to Succeed Teachers
Teachers working directly with students, eg. Read to Succeed teachers, Resource teachers and classroom teachers will be able to evaluate whether or not they are reaching their goals.  Literacy teachers and consultants will be able to measure the gains made and the areas which require modification.
Literacy Teachers
Literacy Consultants
School Administrators
The principal and vice principal in the school will be able to measure the effectiveness of the program in order to improve the Continuous Improvement Framework set out by the Ministry and Division which is to create higher literacy rates among students. 
What questions will the evaluation seek to answer?
Are the goals of the Read to Succeed Program clear and understood by all the stakeholders?  If not, what clarifications or additions are needed? What would each of the stakeholders proclaim the value or effectiveness of the program to be?  What extra training, resources, information or support do the stakeholders require in order for the goals to be attained?

What information do you need to answer the questions?
What I wish to know
Indicators – How will I know it?
The knowledge of the program of stakeholders.
Survey and interview.
The procedures and implementation steps of the program.
Interview and observation.
What is working well with the program?
Interview and Testimonials from stakeholders.
What is not working well or not being utilized and why?
Interview and survey. 
What modifications could be applied to the program?
Survey and interview.
What information, training, supports and resources would make the program more successful?
Survey and interview.
When is the evaluation needed?
The results of the evaluation should be attainable by the end of April, so that they can be shared with the stakeholders and suggested modificationschanges in the final school report.
What evaluation design will you use?
The evaluation design used will be Provus’s Discrepancy Model which is designed to:  improving the existing Read to Succeed Program, address the greater accountability of educators to the public and make wiser decisions by administrators (and consultants) about the implementation and effect of the program. 

           Collect the information
 

What sources of information will you use?
Existing Information: Read to Succeed and Resource Room teachers’ evaluations and feedback on the program.  AFL and CAT/4 test scores as well as daily work gathered from the teachers.
People: Read to Succeed, Resource Room and Classroom teachers.
Pictorial Records and Observations: Observations obtained through learning walks and teachers opinions of student confidence and competence will be collected. 
What data collection method(s) will you use?
X
Survey
X
Document review
X
Interview
X
Testimonials
X
Observation

Expert panel

Group techniques

Simulated problems or situations

Case study

Journal, log, diary
X
Tests

Unobtrusive measures

Photos, videos

Other (list)

Instrumentation: What is needed to record the information?
A survey must be created, as well as a set of interview questions seeking information about the goals and purpose of the program and it’s effectiveness.  A checklist for observation, based on a review of the Read to Succeed documents.  A gathering of student samples and assessments (recent and from the beginning of the program) to compare and ask teachers to comment on.
When will you collect data for each method you’ve chosen?
Method
Before program
During program
Immediately after
Later
Survey

   X


Interview

  X


Observation

   X


Tests
X
  

X
Document Review

   X


Testimonials

  X



Will a sample be used? 

No
X

Yes

If yes, describe the procedure you will use.
Pilot testing: when, where, how? 

Pilot testing will occur before the evaluation begins specifically by looking at the survey questions, interview questions and tests collected by a groups of stakeholders.

           Analyze and Interpret
 

The surveys, interview questions and observations will be gathered and sorted so that they can be summarized and compared to the review of the Read to Succeed program review.  The testing of Grade Level Equivalency will be done prior to and after the evaluation. 

How will the data be analyzed?
Data Analysis: the survey questions, interview information and observation questions will be sorted and studied for similar attributes.
Methods: Common ideas, criticisms and suggestions will be grouped together, as well as measurement of growth (GLE).
Who is Responsible? The evaluators will be responsible for sorting the information. 
How will the information be interpreted—by whom?
The information will be categorized and analyzed, then shared with stakeholders to be analyzed again and interpreted by those directly involved in the day to day implementation of the program as well as by the administrators and literacy consultants downtown for suggestions and improvements. 

What did you learn? What are the limitations?
The stakeholders will meet to discuss the results and whether or not gains have been made.  They will discuss what implications might have occurred and what led to the successes or goals not met.  The stakeholders will develop a list of modifications or changes which could be implemented so that goals are attained.  The limitations might be the attitudes and opinions of the stakeholders with regard to the barriers which might exist in student success in the program Eg. Student absences, or transiency. Another limiting factor might be the resources suggested to improve the program.
 

           Use the Information

How will the evaluation be communicated and shared?
To whom
When/where/how to present
Teachers
A summarization of the findings will be presented to the teachers.

A meeting or in-service would gather the stakeholders together to make suggestions and ofer improvements.
Administrators
Administrators would be included in the summarization presentation and the in-service.
Parents
A short report on the findings and the suggestions for improvement would be shared with parents (letter or email).
Next steps?
The stakeholders and evaluators would gather to design a timeline and actions related to the outcomes, the suggestions and the changes needed for improvement.  Administrators would then share the information with their superintendents.

           Manage the evaluation                      Standards
X
Human subject’s protection
X
Utility
X
Management chart
X
Feasibility
X
Timeline
X
Propriety
X
Responsibilities
X
Accuracy
X
Budget