Qualitative Inquiry
Wednesday, April 6, 2011
Educational Programming
Sunday, April 3, 2011
Rereading with a Critical Eye
At this point in my research, I have read a significant number of articles and studies for my literature review-some good and some not so good. Also, when I get stuck in the writing process, distracted or just need a break, I look up more articles and studies to add to my collection. The paper piles on my dining room table have now extended to piles on the floor along the wall not to mention the piles on my kitchen table-too much information.
The study by Werts, Lambert & Carpenter (2009), What Special Education Directors Say About RTI, that I reread this week with a more critical eye, is a qualitative study using e-mail surveys. I think this was a good study overall with information clearly organized. The introduction gives a full background on the history of RTI and an operational definition of the topic in the first sentence. The authors state, “…the lack of consensus on many important issues related to RTI, we conducted a short online survey…” This was an effective alternative to writing “The purpose of this study…”
The research questions were well written to illicit the information needed from a survey. Tables in the study gave a graphic representation of the study. Table 1 included the survey questions and percentages of responses and table 2 gave the demographic information for the respondents and were added to the results section of the study.
The discussion section is clearly written with several interesting conclusions drawn from the data. Limitations of the study are discussed and include areas that I thought about as I was reading the research. Bias, survey return rate, self-selected representation were also discussed. Werts et al. (2009) found the validity a concern due to the nature of having the data collected through a survey format. The survey was only sent to one state, and the “…return rate of usable questionnaires was less than 50%.” Werts et al. (2009) also stated that the data was self-reported but because the questions asked for opinions, there was “less propensity for making themselves ‘look better’ because of practices they may or may not want to admit.” The authors also noted that since the state department officials trained the special education directors, this might have had an influence on the participants’ perception of the process.
Creswell (2007) discusses validation strategies and recommends that qualitative researchers use at least two of them in a given study (p. 207-209). This study included rich, thick descriptions, external audits and triangulation.
Under the Procedures section in this study, the questionnaire was developed through a systematic process of reviews. A team of volunteers consisting of professionals working and teaching in a university department included: a special education teacher, a principal, a special education director, two professors in special education, and an adjunct professor in the special education department. These volunteers reviewed the preliminary draft of the survey and were asked to suggest additional items, recommend deletion of items and make revisions in the wording of items that yielded a second survey that was then given back to the same team for feedback. A final draft was then written by the authors and used in this study (Werts et al., 2009).
Under the Data Analysis section, “analytical rigor was attained by having a third investigator independently review the tabular data and written responses. Any areas of ambiguity or disagreement were marked and discussed by the team until consensus was reached (Werts et al., 2009).
I thought this study added to the understanding of RTI from the perspective of a particular group (special education directors) in one state (North Carolina) and it would be interesting to compare these results with the results of another state like Connecticut.
Werts, M. G., Lambert, M. & Carpenter, E. (2009). What special education directors say about RTI. Learning Disability Quarterly, 32(4), 245-254.
Critiquing a Study
The purpose of the above study was to examine "the possible differences between silent and aloud reading comprehension scores on Maze assessment probes." The participants were 89 first and second graders from general education classes at a private school in the southeast. The researchers used grade-level appropriate Aimsweb Maze passages to assess "aloud and silent Maze comprehension." (The Maze test consists of a complete first sentence, after which every seventh word is deleted. Students have to choose from three words given in parentheses and circle the correct answer.) To compare results, the authors also used grade-level appropriate DIBELS (Dynamic Indicators of Basic Early Literacy Skills) reading passages and norm-referenced passages from the Woodcock-Johnson Tests of Achievement. The assessments were conducted over a three-month period in the spring. The tests were given individually in a private room attached to the classroom and administered by "one primary investigator and five graduate students." The "primary investigator ensured that each graduate student could administer each assessment appropriately and score each assessment reliably." Each child read three passages silently and three orally within a period of five consecutive school days "to limit the possible effects from increased skill development."
Results indicated that reading silently or orally did not affect the students' understanding of the tested material.
The authors mention that the "sample size was relatively small and came from a private school district." Therefore, "the generalizability of the results of this study are limited." They also state that most of the children were above grade-level readers.
I'm satisfied wtih the way this study was conducted. In my opinion, the authors come across as upfront and truthful. There was triangulation of sorts, in that there were several administrators, all of whom followed the same testing and scoring procedures. The tests were timed and needed right-or-wrong responses, so there was no room for subjectivity. There was "rich data," in that different assessments were used, and the oral reading was tape-recorded. Finally, although Hale et al. place a limit on the overall generalizability of the results, the study does seem to have internal generalizability, which Maxwell defines as "the generalizability of a conclusion within the setting or group studied" (p. 115).
Saturday, March 26, 2011
The Light bulb
So, I am in the process of writing the literature review and the light bulb just went on this week. I have been fiddling with it for about three weeks now. In my research, I plan to look at 5 variables, which will be examined through a survey and interview. It was not until this week that I realized that I should use the five variables as categories to present the past research. When it hit me, I breathed a sigh of relief and now I think I know what I am doing --now just to polish it to submit for review.
Sometimes I wish the light bulb would turn on faster. You know when you walk into a place that has motion censors, the light flicks on and then when you leave, it goes off. Sometimes I feel like I am living in a motion censored world. When I am in one place, the light bulb goes on and as soon as I leave _____, the light flickers and then I am back to the craziness of this world; the mind simply goes blank. This only means that I need to write down everything. I used to be able to remember so much. I was a pro at taking mental notes. Now, if I don't write things down, I am sorry but, I am not going to remember. So the message I am taking away this week is to take notes and think in categories.
Sunday, March 13, 2011
Interviewing Dad
The Recorder
My father enjoys talking about the old days.
None of the stories I heard growing up were discussed during the interview. He was quiet at first. I had to use probing questions to get him to talk some more. I also had to phrase the question in another way to make him start thinking about his career and his life now. It was funny that with the recorder he felt like he needed to be cautious. How will others respond to a voice recorder?
...........................................................................................................................
Throughout the interview, my dad kept coming back to a central theme, observation. He said that he was an observer. He believes that growing up, his observation of people around him, shaped who is today.
My dad is a chef and usually everything revolves around food and when he was younger, he did not have to cook. His older sisters and mother cooked for him. However, he was watching and asking questions. It was not until he was 19, that he started to take some real interest in cooking. Through observing chefs in the kitchen, he developed his talents.
...............................................................................................................................
I asked my dad what was so difficult about having the recorder on the table and he said that he felt like he was under scrutiny. This is interesting and important to think about. He suggested that I start off with a simple, easy going conversation before I dig into the interview. This is to make the interviewee comfortable with the recorder and the process.
The Apple Doesn't Fall Far...
So this week’s assignment to interview a willing participant was so interesting. Our “think tank” group decided that we would all interview our fathers. We agreed that they would be easily accessible and happy to talk with their daughters for this class project. We agreed on the central question: How did your childhood influence your life? Follow up questions included (1) How did your childhood lead you to your career? (2) How did your childhood affect your adult life?
When I told my Dad about this project he was happy to chat with me and although, over the years, I had heard his childhood memories, interesting antidotes, and funny stories, it was always in a social context and never formal or recorded. Since our schedules did not allow for us to interview in person, we decided on an audio-recorded phone interview. It was easy to imagine his facial expressions, hand gestures and smile as he was talking.
A few specific themes surfaced during the interview regarding his childhood, but no matter what direction the interview took, his stories always came back to food. Yes, the hardships of the Great Depression, the family work ethic, counted blessings, money, religion, problems, love and music were all discussed but most of the conversation circled back to food-lots of food, not enough food, who was cooking the food, good cooks in the family, Sunday food, preparing food, cooking food, Italian food, courses of food, etc.
I never realized how much my family talks about food. It is one of my favorite topics to discuss and is also a popular theme with the rest of my family, children and friends.
This assignment was a great way to practice our interviewing procedures and skills in my opinion. The experience was low stress and could be forgiving in the event of a possible question or technology glitch. There is definitely an “art” to the interviewing process that I am hoping to get much better at with more practice.