- About Archives
- About SAA
- Careers
- Education
- Publications
- Advocacy
- Membership
DAS Subcommittee
Conference Call Minutes
March 24, 2015
9:00 am PT, 10:00 am MT, 11:00 am CT, and Noon ET.
Present: Lori Lindberg, Glen McAninch, Liz Bishoff, Cynthia Ghering, Veronica Martzahl, Sybil Schaefer, Tom Rosko, Solveig De Sutter, Ania Jaroszek.
Absent: Mahnaz Ghaznavi.
We are going to address the exam questions; specifically identify items that were performing unusually in the last exam.
LL: The next exam is going to be offered in August, at the annual meeting
SD: Yes, but we need to complete this one quickly because we haven’t given people the scores yet
LL: Everyone should have the Key Validation Report- March 2015 open and Veronica’s last email. We had 37 test takers last time. Let’s look at the Table 1, 2, and 3 (pages 2 & 3). We should look at the items that repeat on table 1, 2, 3; check the answer key and/or other characters that caused people not to get the answer correctly. Today, we need to decide which questions we should keep, remove or look at the question. Also, the summary of 37 measured people is on page 7.
VM: The statistics are close to how people are scoring.
LB: The numbers on what’s an easy question are surprised because the overall score is low.
LL: We had 9 hard questions out of 100. That is pretty good.
GM: Can we look at the questions? The ones that are both hard and unusual .
SD: We eliminate the questions that have possible two answers.
LL: The unusual question #28 from the last exam (I0038). People, who should have got it right, got it wrong. 16 people chose D, 19 –C, 1-A, 1-B.
GM: Looking the question, what standard are we talking about, what model? We should label them, which theory the question comes from.
LL: For that question majority of people chose C or D and there is a significant difference in it.
TR: We should put the quote “in the institutionalization stage.” We need to revise that.
LL: Another one is #14 (I0019)
VM: We looked at this one in Chicago and we wanted to change it.
GM I think this is very poor question. I would vote for throwing it out. 28 people answered A, 1-B, 8-D.
Question #14 – voted out. Everyone agreed.
LB: Can we change the score sheet?
SD: Yes
LB: We can change the score sheet to A.
VM: It is not fair to change the answer sheet now.
LL: Let’s rewrite it and see if people are able to answer accurately.
LB: We can rewrite it for the August exam.
SD: it will be become a pilot question
GM We are still throwing this one out for now.
LL: Question #25 (I0117)
Only 4 people got it correctly.
LL & GM I thought the correct answer was B.
LL: We marked the answer sheet incorrectly. We have to throw the question out.
LB: Why can’t we change the answer sheet?
VM: I need to change the transcript.
LB: The score sheet shows C as the correct answer on question #25.
SD: Should we throw this one out and correct it for the next exam?
LL: Question #65 (I0094)
GM I think the key here is the “descriptive information” and people need to read it more carefully.
VM: We can keep it for now and maybe revise it for later. 6 people got it right.
GM That is a bad question that we can leave for now.
LL: That is all for the hard one. The reminders are 5 under the Unusual Responses table. Question #4 (I0004)
GM It is a good question; I am not sure why people missed it. People who did well on the test missed it.
LL: I don’t see a problem with it. Let move to question #40 (I0057)
Most people got it right. Some people were probably overthinking it.
LB: This was the first time I proctored the exam and I was amazed how long it took for people to complete it.
LL: Question # 5 (I0005) this one is good.
Question #24 (I0033) 36 people got it correct, why is it in, maybe it’s too easy one.
Question #88 (I0129)
GM This question deals with general knowledge. I wouldn’t throw it out. Let’s leave it and revise it later.
LL: To summarize it, we decide to throw questions #25 and 14. We have a few that we are not changing at all and a few that need to be revised. We throw out two questions and get people the scoring.
After the revision we will have the exam ready for August. The next conference call we will work on the Strategic Plan.
GM Everyone, look at the first eight easy questions and write the suggestions how to revise them. Get the write up to Mahnaz and we’ll talk about this next time.
LB: Next conference call is on April 23, 2015 same time. Let do it before April 15th.