From jordan.hermens at state.or.us Wed Jul 8 07:56:10 2015 From: jordan.hermens at state.or.us (HERMENS Jordan) Date: Wed, 8 Jul 2015 14:56:10 +0000 Subject: [Assessment_Advisory_Committee] Requesting Feedback for SAI KA Presentation Message-ID: Good Afternoon, As a part of the Kindergarten Assessment Summer Assessment Institute Presentation, ODE will be requesting feedback from the audience on scheduling strategies used in their districts last year when administering the assessment within the first 6 weeks of school. I am reaching out to you to collect strategies your district has used to deliver the KA in the first six weeks of school that I can add to the presentation to share with the audience. I know this is a slight imposition, since it is summer and your time is very valuable. If I may have your input by COB Tuesday, July 21st, I would greatly appreciate it. Thank you! Amber Jordan Hermens Administrative Specialist Oregon Department of Education 255 Capitol St NE | Salem, OR 97310 | *503-947-5905 -------------- next part -------------- An HTML attachment was scrubbed... URL: From bbain at ttsd.k12.or.us Wed Jul 8 08:40:39 2015 From: bbain at ttsd.k12.or.us (Bain, Brian) Date: Wed, 8 Jul 2015 15:40:39 +0000 Subject: [Assessment_Advisory_Committee] Requesting Feedback for SAI KA Presentation In-Reply-To: References: Message-ID: <016B0BFF1DF04E44B5C8ED9AACF3243A6B2930C2@EX3.ttsd.ttsd.k12.or.us> Aren't you in luck? I've got two strategies... Tigard-Tualatin has a long history of DIBELS testing during the second and third week of the school year. We test an entire school in a day, K-5. To accomplish this students are brought to a room full of testers. The testers are the schools' IAs, IAs from a "partner school" and a district funded "core team". We used this model and allowed extra time to complete the Kindergarten Assessment the last two years. It's not a cheap option. Somewhere between 12-16 testers per a school, and maybe 15 minutes per a classroom. You're looking at something on the scale of 15 man-hours per a school. This year, we'll be using a Kindergarten Connect model. Kindergarteners will not attend during the first week of school. Instead, parents and students will have one-on-one appointments with their teacher during that week. After meeting the teacher, orienting to the classroom, discussing the student's needs, etc, etc, etc, the parent will leave the room and the teacher will administer the Kindergarten Assessment. Also not an inexpensive proposition. The payscale for licensed Kindergarten teachers is much higher than IAs, and the meetings will run about an hour each. However, Kindergarten Connect will provide a positive transition for students, allow a faster instructional start in that second week, and forge a lasting relationship with the teacher and school that will improve parent engagement and student outcomes in the long run. Brian Bain District Assessment Coordinator Tigard-Tualatin School District 6960 SW Sandburg St, Tigard, OR 97223 503-431-4120 - bbain at ttsd.k12.or.us From: Assessment_Advisory_Committee [mailto:assessment_advisory_committee-bounces at listsmart.osl.state.or.us] On Behalf Of HERMENS Jordan Sent: Wednesday, July 08, 2015 7:56 AM To: assessment_advisory_committee at listsmart.osl.state.or.us Subject: [Assessment_Advisory_Committee] Requesting Feedback for SAI KA Presentation Good Afternoon, As a part of the Kindergarten Assessment Summer Assessment Institute Presentation, ODE will be requesting feedback from the audience on scheduling strategies used in their districts last year when administering the assessment within the first 6 weeks of school. I am reaching out to you to collect strategies your district has used to deliver the KA in the first six weeks of school that I can add to the presentation to share with the audience. I know this is a slight imposition, since it is summer and your time is very valuable. If I may have your input by COB Tuesday, July 21st, I would greatly appreciate it. Thank you! Amber Jordan Hermens Administrative Specialist Oregon Department of Education 255 Capitol St NE | Salem, OR 97310 | ?503-947-5905 -------------- next part -------------- An HTML attachment was scrubbed... URL: From bbain at ttsd.k12.or.us Wed Jul 8 08:43:26 2015 From: bbain at ttsd.k12.or.us (Bain, Brian) Date: Wed, 8 Jul 2015 15:43:26 +0000 Subject: [Assessment_Advisory_Committee] Requesting Feedback for SAI KA Presentation In-Reply-To: References: Message-ID: <016B0BFF1DF04E44B5C8ED9AACF3243A6B2930E5@EX3.ttsd.ttsd.k12.or.us> I should have qualified. My 15 man-hour estimate on the first option was ONLY for the KA segment of that DIBELS testing day. On a DIBELS day we typically have 12-16 testers for a full 6 hours, quite a bit more than the 15 man hours I stated below. Brian Bain District Assessment Coordinator Tigard-Tualatin School District 6960 SW Sandburg St, Tigard, OR 97223 503-431-4120 - bbain at ttsd.k12.or.us From: Assessment_Advisory_Committee [mailto:assessment_advisory_committee-bounces at listsmart.osl.state.or.us] On Behalf Of HERMENS Jordan Sent: Wednesday, July 08, 2015 7:56 AM To: assessment_advisory_committee at listsmart.osl.state.or.us Subject: [Assessment_Advisory_Committee] Requesting Feedback for SAI KA Presentation Good Afternoon, As a part of the Kindergarten Assessment Summer Assessment Institute Presentation, ODE will be requesting feedback from the audience on scheduling strategies used in their districts last year when administering the assessment within the first 6 weeks of school. I am reaching out to you to collect strategies your district has used to deliver the KA in the first six weeks of school that I can add to the presentation to share with the audience. I know this is a slight imposition, since it is summer and your time is very valuable. If I may have your input by COB Tuesday, July 21st, I would greatly appreciate it. Thank you! Amber Jordan Hermens Administrative Specialist Oregon Department of Education 255 Capitol St NE | Salem, OR 97310 | ?503-947-5905 -------------- next part -------------- An HTML attachment was scrubbed... URL: From CARLSON_CATHERINE at salkeiz.k12.or.us Wed Jul 8 09:25:55 2015 From: CARLSON_CATHERINE at salkeiz.k12.or.us (Catherine Carlson) Date: Wed, 8 Jul 2015 16:25:55 +0000 Subject: [Assessment_Advisory_Committee] Requesting Feedback for SAI KA Presentation In-Reply-To: References: Message-ID: Amber, We always set aside days for assessment before kindergarten students start school. Each student has an appointment to come in and meet the teacher and take assessments. Before the KA we used this time to administer the DRA/EDL, but now we give the KA first, and then part of the DRA/EDL as time allows, and the rest of testing is completed during class time. With full-day kindergarten this coming year, we are only taking September 9-11 to test-less days than in past years. Catherine Carlson Coordinator Testing & Evaluation/Student Records Department Salem-Keizer School District 503-399-5590 FAX 503-391-4088 Supporting student achievement through information, professional development, and assessment services From: Assessment_Advisory_Committee [mailto:assessment_advisory_committee-bounces at listsmart.osl.state.or.us] On Behalf Of HERMENS Jordan Sent: Wednesday, July 08, 2015 7:56 AM To: assessment_advisory_committee at listsmart.osl.state.or.us Subject: [Assessment_Advisory_Committee] Requesting Feedback for SAI KA Presentation Good Afternoon, As a part of the Kindergarten Assessment Summer Assessment Institute Presentation, ODE will be requesting feedback from the audience on scheduling strategies used in their districts last year when administering the assessment within the first 6 weeks of school. I am reaching out to you to collect strategies your district has used to deliver the KA in the first six weeks of school that I can add to the presentation to share with the audience. I know this is a slight imposition, since it is summer and your time is very valuable. If I may have your input by COB Tuesday, July 21st, I would greatly appreciate it. Thank you! Amber Jordan Hermens Administrative Specialist Oregon Department of Education 255 Capitol St NE | Salem, OR 97310 | ?503-947-5905 -------------- next part -------------- An HTML attachment was scrubbed... URL: From stewartw at bctonline.com Wed Jul 8 09:57:00 2015 From: stewartw at bctonline.com (Bill Stewart) Date: Wed, 8 Jul 2015 09:57:00 -0700 Subject: [Assessment_Advisory_Committee] Requesting Feedback for SAI KA Presentation In-Reply-To: References: Message-ID: <69C19ABD-2CF4-409C-982A-D4AA38DCCB78@bctonline.com> Jordan, Much like Catherine and Brian indicated, we also use a transition week plan, which includes time to complete the literacy & numeracy components of the KA. One of our goals is to make sure the KA administration is caring, friendly and non-threatening, while still adhering to the prescribed admin protocols....which I'm sure is true in S-K and TTSD as well. We want to make each student's very first school experience as positive as possible. Bill Sent from Bill Stewart's iPad > On Jul 8, 2015, at 9:25 AM, Catherine Carlson wrote: > > Amber, > We always set aside days for assessment before kindergarten students start school. Each student has an appointment to come in and meet the teacher and take assessments. Before the KA we used this time to administer the DRA/EDL, but now we give the KA first, and then part of the DRA/EDL as time allows, and the rest of testing is completed during class time. With full-day kindergarten this coming year, we are only taking September 9-11 to test?less days than in past years. > > Catherine Carlson > Coordinator > Testing & Evaluation/Student Records Department > Salem-Keizer School District > 503-399-5590 > FAX 503-391-4088 > Supporting student achievement through information, professional development, and assessment services > > > > From: Assessment_Advisory_Committee [mailto:assessment_advisory_committee-bounces at listsmart.osl.state.or.us] On Behalf Of HERMENS Jordan > Sent: Wednesday, July 08, 2015 7:56 AM > To: assessment_advisory_committee at listsmart.osl.state.or.us > Subject: [Assessment_Advisory_Committee] Requesting Feedback for SAI KA Presentation > > Good Afternoon, > > As a part of the Kindergarten Assessment Summer Assessment Institute Presentation, ODE will be requesting feedback from the audience on scheduling strategies used in their districts last year when administering the assessment within the first 6 weeks of school. > > I am reaching out to you to collect strategies your district has used to deliver the KA in the first six weeks of school that I can add to the presentation to share with the audience. > > I know this is a slight imposition, since it is summer and your time is very valuable. If I may have your input by COB Tuesday, July 21st, I would greatly appreciate it. > > Thank you! > Amber > > > Jordan Hermens > Administrative Specialist > Oregon Department of Education > 255 Capitol St NE | Salem, OR 97310 | ?503-947-5905 > > > > _____________________________________________________ > Assessment_Advisory_Committee mailing list > Assessment_Advisory_Committee at listsmart.osl.state.or.us > http://listsmart.osl.state.or.us/mailman/listinfo/assessment_advisory_committee > Hosted by the Oregon State Library. The Library is not responsible for content. > Questions related to message content should be directed to list owner(s) or the sender of the message, by phone or email. > Technical questions? Call 503-378-8800. -------------- next part -------------- An HTML attachment was scrubbed... URL: From holly.carter at state.or.us Thu Jul 23 13:23:54 2015 From: holly.carter at state.or.us (CARTER Holly) Date: Thu, 23 Jul 2015 20:23:54 +0000 Subject: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 Message-ID: At our May 6 meeting, AIR reviewed with us a new "Item Response Time Machine" tool that would be available in 2015-16. The slide below summarizes this proposed tool as AIR described it to us at the meeting: [cid:image001.png at 01D0C54A.172AB130] ODE has recently learned from AIR that they will need to limit this feature to retrieving responses entered during the student's current test session as allowing students to go back and retrieve responses from an earlier test session uses too many system resources and risks slowing down the testing experience for all students. Given this change in scope, ODE now requests your input whether there is still value in implementing the Item Response Time Machine for 2015-16. So that we can finalize our specifications and prepare communications to the field about supported tools, we request your input by COB Tuesday, July 28. Thank you as always for your valuable feedback! Holly Carter Assessment Policy Analyst Office of Learning | Inst., Stand., Asmt, &Acc. Unit | Oregon Department of Education Phone: 503.947.5739 | Fax: 503.378.5156 | *holly.carter at state.or.us -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 46672 bytes Desc: image001.png URL: From CARLSON_CATHERINE at salkeiz.k12.or.us Thu Jul 23 15:27:04 2015 From: CARLSON_CATHERINE at salkeiz.k12.or.us (Catherine Carlson) Date: Thu, 23 Jul 2015 22:27:04 +0000 Subject: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 In-Reply-To: References: Message-ID: Holly, Given the technical problems we encountered around this issue, I think that being able to recover drafts in the current session is better than not having the ability at all. Catherine Carlson Coordinator Testing & Evaluation/Student Records Department Salem-Keizer School District 503-399-5590 FAX 503-391-4088 Supporting student achievement through information, professional development, and assessment services From: Assessment_Advisory_Committee [mailto:assessment_advisory_committee-bounces at listsmart.osl.state.or.us] On Behalf Of CARTER Holly Sent: Thursday, July 23, 2015 1:24 PM To: assessment_advisory_committee at listsmart.osl.state.or.us Subject: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 Importance: High At our May 6 meeting, AIR reviewed with us a new "Item Response Time Machine" tool that would be available in 2015-16. The slide below summarizes this proposed tool as AIR described it to us at the meeting: [cid:image001.png at 01D0C55B.93F11310] ODE has recently learned from AIR that they will need to limit this feature to retrieving responses entered during the student's current test session as allowing students to go back and retrieve responses from an earlier test session uses too many system resources and risks slowing down the testing experience for all students. Given this change in scope, ODE now requests your input whether there is still value in implementing the Item Response Time Machine for 2015-16. So that we can finalize our specifications and prepare communications to the field about supported tools, we request your input by COB Tuesday, July 28. Thank you as always for your valuable feedback! Holly Carter Assessment Policy Analyst Office of Learning | Inst., Stand., Asmt, &Acc. Unit | Oregon Department of Education Phone: 503.947.5739 | Fax: 503.378.5156 | *holly.carter at state.or.us -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 46672 bytes Desc: image001.png URL: From holly.carter at state.or.us Thu Jul 23 15:32:15 2015 From: holly.carter at state.or.us (CARTER Holly) Date: Thu, 23 Jul 2015 22:32:15 +0000 Subject: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 In-Reply-To: References: Message-ID: Thanks, Catherine. There's one important piece of clarification that we have received that I want to share with you all. AIR has clarified that, regardless of whether it is in the same session or a different session, if a student pauses the test, they will not be able to view previous draft responses once the student logs back in. When we reviewed this tool back in May, it was your collective recommendation that this tool should not be on for all students automatically as it may cause confusion/distraction, but that the TA should be able to enable the tool mid-test if the need arose. Given the recent clarification from AIR that the response history will not persist when a student logs out and logs back in (which is required for the TA to turn on a tool mid-test), how does this impact the benefit/use of this tool? Holly From: Catherine Carlson [mailto:CARLSON_CATHERINE at salkeiz.k12.or.us] Sent: Thursday, July 23, 2015 3:27 PM To: 'CARTER Holly'; assessment_advisory_committee at listsmart.osl.state.or.us Subject: RE: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 Holly, Given the technical problems we encountered around this issue, I think that being able to recover drafts in the current session is better than not having the ability at all. Catherine Carlson Coordinator Testing & Evaluation/Student Records Department Salem-Keizer School District 503-399-5590 FAX 503-391-4088 Supporting student achievement through information, professional development, and assessment services From: Assessment_Advisory_Committee [mailto:assessment_advisory_committee-bounces at listsmart.osl.state.or.us] On Behalf Of CARTER Holly Sent: Thursday, July 23, 2015 1:24 PM To: assessment_advisory_committee at listsmart.osl.state.or.us Subject: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 Importance: High At our May 6 meeting, AIR reviewed with us a new "Item Response Time Machine" tool that would be available in 2015-16. The slide below summarizes this proposed tool as AIR described it to us at the meeting: [cid:image001.png at 01D0C55C.BFABB9F0] ODE has recently learned from AIR that they will need to limit this feature to retrieving responses entered during the student's current test session as allowing students to go back and retrieve responses from an earlier test session uses too many system resources and risks slowing down the testing experience for all students. Given this change in scope, ODE now requests your input whether there is still value in implementing the Item Response Time Machine for 2015-16. So that we can finalize our specifications and prepare communications to the field about supported tools, we request your input by COB Tuesday, July 28. Thank you as always for your valuable feedback! Holly Carter Assessment Policy Analyst Office of Learning | Inst., Stand., Asmt, &Acc. Unit | Oregon Department of Education Phone: 503.947.5739 | Fax: 503.378.5156 | *holly.carter at state.or.us -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 46672 bytes Desc: image001.png URL: From CARLSON_CATHERINE at salkeiz.k12.or.us Thu Jul 23 15:38:07 2015 From: CARLSON_CATHERINE at salkeiz.k12.or.us (Catherine Carlson) Date: Thu, 23 Jul 2015 22:38:07 +0000 Subject: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 In-Reply-To: References: Message-ID: Holly, This clarification makes me wonder about the value of the tool then. It seems like most of the issues with losing student writing happened after pausing or logging out and logging back in. I'd be interested to hear feedback from others in the group. Catherine From: CARTER Holly [mailto:holly.carter at state.or.us] Sent: Thursday, July 23, 2015 3:32 PM To: Catherine Carlson; assessment_advisory_committee at listsmart.osl.state.or.us Subject: RE: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 Thanks, Catherine. There's one important piece of clarification that we have received that I want to share with you all. AIR has clarified that, regardless of whether it is in the same session or a different session, if a student pauses the test, they will not be able to view previous draft responses once the student logs back in. When we reviewed this tool back in May, it was your collective recommendation that this tool should not be on for all students automatically as it may cause confusion/distraction, but that the TA should be able to enable the tool mid-test if the need arose. Given the recent clarification from AIR that the response history will not persist when a student logs out and logs back in (which is required for the TA to turn on a tool mid-test), how does this impact the benefit/use of this tool? Holly From: Catherine Carlson [mailto:CARLSON_CATHERINE at salkeiz.k12.or.us] Sent: Thursday, July 23, 2015 3:27 PM To: 'CARTER Holly'; assessment_advisory_committee at listsmart.osl.state.or.us Subject: RE: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 Holly, Given the technical problems we encountered around this issue, I think that being able to recover drafts in the current session is better than not having the ability at all. Catherine Carlson Coordinator Testing & Evaluation/Student Records Department Salem-Keizer School District 503-399-5590 FAX 503-391-4088 Supporting student achievement through information, professional development, and assessment services From: Assessment_Advisory_Committee [mailto:assessment_advisory_committee-bounces at listsmart.osl.state.or.us] On Behalf Of CARTER Holly Sent: Thursday, July 23, 2015 1:24 PM To: assessment_advisory_committee at listsmart.osl.state.or.us Subject: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 Importance: High At our May 6 meeting, AIR reviewed with us a new "Item Response Time Machine" tool that would be available in 2015-16. The slide below summarizes this proposed tool as AIR described it to us at the meeting: [cid:image001.png at 01D0C55D.92409200] ODE has recently learned from AIR that they will need to limit this feature to retrieving responses entered during the student's current test session as allowing students to go back and retrieve responses from an earlier test session uses too many system resources and risks slowing down the testing experience for all students. Given this change in scope, ODE now requests your input whether there is still value in implementing the Item Response Time Machine for 2015-16. So that we can finalize our specifications and prepare communications to the field about supported tools, we request your input by COB Tuesday, July 28. Thank you as always for your valuable feedback! Holly Carter Assessment Policy Analyst Office of Learning | Inst., Stand., Asmt, &Acc. Unit | Oregon Department of Education Phone: 503.947.5739 | Fax: 503.378.5156 | *holly.carter at state.or.us -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 46672 bytes Desc: image001.png URL: From stewartw at gladstone.k12.or.us Thu Jul 23 15:41:14 2015 From: stewartw at gladstone.k12.or.us (Bill Stewart) Date: Thu, 23 Jul 2015 15:41:14 -0700 Subject: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 In-Reply-To: References: Message-ID: Thanks Holly! Per your message and our phone conversation, it now seems like this would *not* be an effective tool to address the problems that a number of students across the state encountered this past spring. If a TA has to have the tool turned on BEFORE the problem arises, then the TA is essentially 'required' to turn it on for all students at the start of the session to have any chance of recovering drafts. I'm not enough of a mind-reader to know, ahead of time, which kids will need this feature. I'm not at all sure it is worth slowing down the system for all students. I hope others will weigh-in and show me the error of my logic. Bill On Thu, Jul 23, 2015 at 3:32 PM, CARTER Holly wrote: > Thanks, Catherine. There?s one important piece of clarification that we > have received that I want to share with you all. AIR has clarified that, > regardless of whether it is in the same session or a different session, if > a student pauses the test, they will not be able to view previous draft > responses once the student logs back in. > > > > When we reviewed this tool back in May, it was your collective > recommendation that this tool should not be on for all students > automatically as it may cause confusion/distraction, but that the TA should > be able to enable the tool mid-test if the need arose. Given the recent > clarification from AIR that the response history will not persist when a > student logs out and logs back in (which is required for the TA to turn on > a tool mid-test), how does this impact the benefit/use of this tool? > > > > Holly > > > > *From:* Catherine Carlson [mailto:CARLSON_CATHERINE at salkeiz.k12.or.us] > *Sent:* Thursday, July 23, 2015 3:27 PM > *To:* 'CARTER Holly'; > assessment_advisory_committee at listsmart.osl.state.or.us > *Subject:* RE: [Assessment_Advisory_Committee] assessment advisory: input > on time machine tool requested by 7/28 > > > > Holly, > > Given the technical problems we encountered around this issue, I think > that being able to recover drafts in the current session is better than not > having the ability at all. > > > Catherine Carlson > > Coordinator > Testing & Evaluation/Student Records Department > Salem-Keizer School District > 503-399-5590 > FAX 503-391-4088 > *Supporting student achievement through information, professional > development, and assessment services* > > > > > > > > *From:* Assessment_Advisory_Committee [ > mailto:assessment_advisory_committee-bounces at listsmart.osl.state.or.us > ] *On > Behalf Of *CARTER Holly > *Sent:* Thursday, July 23, 2015 1:24 PM > *To:* assessment_advisory_committee at listsmart.osl.state.or.us > *Subject:* [Assessment_Advisory_Committee] assessment advisory: input on > time machine tool requested by 7/28 > *Importance:* High > > > > At our May 6 meeting, AIR reviewed with us a new ?Item Response Time > Machine? tool that would be available in 2015-16. The slide below > summarizes this proposed tool as AIR described it to us at the meeting: > > > > > > ODE has recently learned from AIR that they will need to limit this > feature to retrieving responses entered *during the student?s current > test session* as allowing students to go back and retrieve responses from > an earlier test session uses too many system resources and risks slowing > down the testing experience for all students. > > > > Given this change in scope, ODE now requests your input whether there is > still value in implementing the Item Response Time Machine for 2015-16. So > that we can finalize our specifications and prepare communications to the > field about supported tools, we request your input by *COB* *Tuesday, > July 28.* > > > > Thank you as always for your valuable feedback! > > > > *Holly Carter* > Assessment Policy Analyst > > Office of Learning | Inst., Stand., Asmt, &Acc. Unit | Oregon Department > of Education > > Phone: 503.947.5739 | Fax: 503.378.5156 | *holly.carter at state.or.us > > > > > > _____________________________________________________ > Assessment_Advisory_Committee mailing list > Assessment_Advisory_Committee at listsmart.osl.state.or.us > > http://listsmart.osl.state.or.us/mailman/listinfo/assessment_advisory_committee > Hosted by the Oregon State Library. The Library is not responsible for > content. > Questions related to message content should be directed to list owner(s) > or the sender of the message, by phone or email. > Technical questions? Call 503-378-8800. > > -- Bill Stewart Special Projects Gladstone SD stewartw at gladstone.k12.or.us 503-805-8680 - cell -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 46672 bytes Desc: not available URL: From Karen.Brown at imesd.k12.or.us Thu Jul 23 16:37:25 2015 From: Karen.Brown at imesd.k12.or.us (Karen Brown Smith) Date: Thu, 23 Jul 2015 23:37:25 +0000 Subject: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 In-Reply-To: References: Message-ID: <98aff540a1ab40d7b0fce64df8b18904@IMESD-EXCH.imesd.local> I agree with Bill. Karen ________________________________ [IMESD] Karen Brown Smith | ESD Partner, Data Specialist & Accountability Support Karen.Brown at imesd.k12.or.us InterMountain ESD | www.imesd.k12.or.us 541.966.3124 or 800.706.4447 x3124 From: Assessment_Advisory_Committee [mailto:assessment_advisory_committee-bounces at listsmart.osl.state.or.us] On Behalf Of Bill Stewart Sent: Thursday, July 23, 2015 3:41 PM To: CARTER Holly Cc: assessment_advisory_committee at listsmart.osl.state.or.us Subject: Re: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 Thanks Holly! Per your message and our phone conversation, it now seems like this would not be an effective tool to address the problems that a number of students across the state encountered this past spring. If a TA has to have the tool turned on BEFORE the problem arises, then the TA is essentially 'required' to turn it on for all students at the start of the session to have any chance of recovering drafts. I'm not enough of a mind-reader to know, ahead of time, which kids will need this feature. I'm not at all sure it is worth slowing down the system for all students. I hope others will weigh-in and show me the error of my logic. Bill On Thu, Jul 23, 2015 at 3:32 PM, CARTER Holly > wrote: Thanks, Catherine. There?s one important piece of clarification that we have received that I want to share with you all. AIR has clarified that, regardless of whether it is in the same session or a different session, if a student pauses the test, they will not be able to view previous draft responses once the student logs back in. When we reviewed this tool back in May, it was your collective recommendation that this tool should not be on for all students automatically as it may cause confusion/distraction, but that the TA should be able to enable the tool mid-test if the need arose. Given the recent clarification from AIR that the response history will not persist when a student logs out and logs back in (which is required for the TA to turn on a tool mid-test), how does this impact the benefit/use of this tool? Holly From: Catherine Carlson [mailto:CARLSON_CATHERINE at salkeiz.k12.or.us] Sent: Thursday, July 23, 2015 3:27 PM To: 'CARTER Holly'; assessment_advisory_committee at listsmart.osl.state.or.us Subject: RE: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 Holly, Given the technical problems we encountered around this issue, I think that being able to recover drafts in the current session is better than not having the ability at all. Catherine Carlson Coordinator Testing & Evaluation/Student Records Department Salem-Keizer School District 503-399-5590 FAX 503-391-4088 Supporting student achievement through information, professional development, and assessment services From: Assessment_Advisory_Committee [mailto:assessment_advisory_committee-bounces at listsmart.osl.state.or.us] On Behalf Of CARTER Holly Sent: Thursday, July 23, 2015 1:24 PM To: assessment_advisory_committee at listsmart.osl.state.or.us Subject: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 Importance: High At our May 6 meeting, AIR reviewed with us a new ?Item Response Time Machine? tool that would be available in 2015-16. The slide below summarizes this proposed tool as AIR described it to us at the meeting: [cid:image003.png at 01D0C565.DB8CC930] ODE has recently learned from AIR that they will need to limit this feature to retrieving responses entered during the student?s current test session as allowing students to go back and retrieve responses from an earlier test session uses too many system resources and risks slowing down the testing experience for all students. Given this change in scope, ODE now requests your input whether there is still value in implementing the Item Response Time Machine for 2015-16. So that we can finalize our specifications and prepare communications to the field about supported tools, we request your input by COB Tuesday, July 28. Thank you as always for your valuable feedback! Holly Carter Assessment Policy Analyst Office of Learning | Inst., Stand., Asmt, &Acc. Unit | Oregon Department of Education Phone: 503.947.5739 | Fax: 503.378.5156 | ?holly.carter at state.or.us _____________________________________________________ Assessment_Advisory_Committee mailing list Assessment_Advisory_Committee at listsmart.osl.state.or.us http://listsmart.osl.state.or.us/mailman/listinfo/assessment_advisory_committee Hosted by the Oregon State Library. The Library is not responsible for content. Questions related to message content should be directed to list owner(s) or the sender of the message, by phone or email. Technical questions? Call 503-378-8800. -- Bill Stewart Special Projects Gladstone SD stewartw at gladstone.k12.or.us 503-805-8680 - cell -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.jpg Type: image/jpeg Size: 4553 bytes Desc: image002.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.png Type: image/png Size: 46672 bytes Desc: image003.png URL: From staplesd at newberg.k12.or.us Fri Jul 24 08:35:09 2015 From: staplesd at newberg.k12.or.us (Don Staples) Date: Fri, 24 Jul 2015 08:35:09 -0700 Subject: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 In-Reply-To: <98aff540a1ab40d7b0fce64df8b18904@IMESD-EXCH.imesd.local> References: <98aff540a1ab40d7b0fce64df8b18904@IMESD-EXCH.imesd.local> Message-ID: Could it be turned on for all students in TIDE? Would this indeed slow down test delivery performance? If yes to slowing down performance, then it is likely not worth it. Don Staples On Thu, Jul 23, 2015 at 4:37 PM, Karen Brown Smith < Karen.Brown at imesd.k12.or.us> wrote: > I agree with Bill. > > Karen > > > ------------------------------ > > [image: IMESD] > > *Karen Brown Smith* | ESD Partner, Data Specialist & Accountability > Support > Karen.Brown at imesd.k12.or.us > *InterMountain ESD* | www.imesd.k12.or.us > 541.966.3124 or 800.706.4447 x3124 > > > > *From:* Assessment_Advisory_Committee [mailto: > assessment_advisory_committee-bounces at listsmart.osl.state.or.us] *On > Behalf Of *Bill Stewart > *Sent:* Thursday, July 23, 2015 3:41 PM > *To:* CARTER Holly > *Cc:* assessment_advisory_committee at listsmart.osl.state.or.us > *Subject:* Re: [Assessment_Advisory_Committee] assessment advisory: input > on time machine tool requested by 7/28 > > > > Thanks Holly! > > Per your message and our phone conversation, it now seems like this would > *not* be an effective tool to address the problems that a number of > students across the state encountered this past spring. > > If a TA has to have the tool turned on BEFORE the problem arises, then the > TA is essentially 'required' to turn it on for all students at the start of > the session to have any chance of recovering drafts. I'm not enough of a > mind-reader to know, ahead of time, which kids will need this feature. > > I'm not at all sure it is worth slowing down the system for all students. > > I hope others will weigh-in and show me the error of my logic. > > Bill > > > > On Thu, Jul 23, 2015 at 3:32 PM, CARTER Holly > wrote: > > Thanks, Catherine. There?s one important piece of clarification that we > have received that I want to share with you all. AIR has clarified that, > regardless of whether it is in the same session or a different session, if > a student pauses the test, they will not be able to view previous draft > responses once the student logs back in. > > > > When we reviewed this tool back in May, it was your collective > recommendation that this tool should not be on for all students > automatically as it may cause confusion/distraction, but that the TA should > be able to enable the tool mid-test if the need arose. Given the recent > clarification from AIR that the response history will not persist when a > student logs out and logs back in (which is required for the TA to turn on > a tool mid-test), how does this impact the benefit/use of this tool? > > > > Holly > > > > *From:* Catherine Carlson [mailto:CARLSON_CATHERINE at salkeiz.k12.or.us] > *Sent:* Thursday, July 23, 2015 3:27 PM > *To:* 'CARTER Holly'; > assessment_advisory_committee at listsmart.osl.state.or.us > *Subject:* RE: [Assessment_Advisory_Committee] assessment advisory: input > on time machine tool requested by 7/28 > > > > Holly, > > Given the technical problems we encountered around this issue, I think > that being able to recover drafts in the current session is better than not > having the ability at all. > > > Catherine Carlson > > Coordinator > Testing & Evaluation/Student Records Department > Salem-Keizer School District > 503-399-5590 > FAX 503-391-4088 > *Supporting student achievement through information, professional > development, and assessment services* > > > > > > > > *From:* Assessment_Advisory_Committee [ > mailto:assessment_advisory_committee-bounces at listsmart.osl.state.or.us > ] *On > Behalf Of *CARTER Holly > *Sent:* Thursday, July 23, 2015 1:24 PM > *To:* assessment_advisory_committee at listsmart.osl.state.or.us > *Subject:* [Assessment_Advisory_Committee] assessment advisory: input on > time machine tool requested by 7/28 > *Importance:* High > > > > At our May 6 meeting, AIR reviewed with us a new ?Item Response Time > Machine? tool that would be available in 2015-16. The slide below > summarizes this proposed tool as AIR described it to us at the meeting: > > > > > > ODE has recently learned from AIR that they will need to limit this > feature to retrieving responses entered *during the student?s current > test session* as allowing students to go back and retrieve responses from > an earlier test session uses too many system resources and risks slowing > down the testing experience for all students. > > > > Given this change in scope, ODE now requests your input whether there is > still value in implementing the Item Response Time Machine for 2015-16. So > that we can finalize our specifications and prepare communications to the > field about supported tools, we request your input by *COB* *Tuesday, > July 28.* > > > > Thank you as always for your valuable feedback! > > > > *Holly Carter* > Assessment Policy Analyst > > Office of Learning | Inst., Stand., Asmt, &Acc. Unit | Oregon Department > of Education > > Phone: 503.947.5739 | Fax: 503.378.5156 | *holly.carter at state.or.us > > > > > > > _____________________________________________________ > Assessment_Advisory_Committee mailing list > Assessment_Advisory_Committee at listsmart.osl.state.or.us > > http://listsmart.osl.state.or.us/mailman/listinfo/assessment_advisory_committee > Hosted by the Oregon State Library. The Library is not responsible for > content. > Questions related to message content should be directed to list owner(s) > or the sender of the message, by phone or email. > Technical questions? Call 503-378-8800. > > > > > -- > > Bill Stewart > > Special Projects > > Gladstone SD > > stewartw at gladstone.k12.or.us > > 503-805-8680 - cell > > _____________________________________________________ > Assessment_Advisory_Committee mailing list > Assessment_Advisory_Committee at listsmart.osl.state.or.us > > http://listsmart.osl.state.or.us/mailman/listinfo/assessment_advisory_committee > Hosted by the Oregon State Library. The Library is not responsible for > content. > Questions related to message content should be directed to list owner(s) > or the sender of the message, by phone or email. > Technical questions? Call 503-378-8800. > > -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.jpg Type: image/jpeg Size: 4553 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.png Type: image/png Size: 46672 bytes Desc: not available URL: From stewartw at bctonline.com Fri Jul 24 09:14:21 2015 From: stewartw at bctonline.com (Bill Stewart) Date: Fri, 24 Jul 2015 09:14:21 -0700 Subject: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 In-Reply-To: References: <98aff540a1ab40d7b0fce64df8b18904@IMESD-EXCH.imesd.local> Message-ID: Good observation Don...thanks! I had understood the info to mean that "on" would archive for everyone and thus impact speed/performance of the test delivery for all test takers If that's not the case, then I'll rethink my concern. Bill Bill Stewart's iPhone > On Jul 24, 2015, at 8:35 AM, Don Staples wrote: > > Could it be turned on for all students in TIDE? Would this indeed slow down test delivery performance? If yes to slowing down performance, then it is likely not worth it. > > Don Staples > >> On Thu, Jul 23, 2015 at 4:37 PM, Karen Brown Smith wrote: >> I agree with Bill. >> >> Karen >> >> >> >> >> >> Karen Brown Smith | ESD Partner, Data Specialist & Accountability Support >> Karen.Brown at imesd.k12.or.us >> InterMountain ESD | www.imesd.k12.or.us >> 541.966.3124 or 800.706.4447 x3124 >> >> >> >> From: Assessment_Advisory_Committee [mailto:assessment_advisory_committee-bounces at listsmart.osl.state.or.us] On Behalf Of Bill Stewart >> Sent: Thursday, July 23, 2015 3:41 PM >> To: CARTER Holly >> Cc: assessment_advisory_committee at listsmart.osl.state.or.us >> Subject: Re: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 >> >> >> >> Thanks Holly! >> >> Per your message and our phone conversation, it now seems like this would not be an effective tool to address the problems that a number of students across the state encountered this past spring. >> >> If a TA has to have the tool turned on BEFORE the problem arises, then the TA is essentially 'required' to turn it on for all students at the start of the session to have any chance of recovering drafts. I'm not enough of a mind-reader to know, ahead of time, which kids will need this feature. >> >> I'm not at all sure it is worth slowing down the system for all students. >> >> I hope others will weigh-in and show me the error of my logic. >> >> Bill >> >> >> >> On Thu, Jul 23, 2015 at 3:32 PM, CARTER Holly wrote: >> >> Thanks, Catherine. There?s one important piece of clarification that we have received that I want to share with you all. AIR has clarified that, regardless of whether it is in the same session or a different session, if a student pauses the test, they will not be able to view previous draft responses once the student logs back in. >> >> >> >> When we reviewed this tool back in May, it was your collective recommendation that this tool should not be on for all students automatically as it may cause confusion/distraction, but that the TA should be able to enable the tool mid-test if the need arose. Given the recent clarification from AIR that the response history will not persist when a student logs out and logs back in (which is required for the TA to turn on a tool mid-test), how does this impact the benefit/use of this tool? >> >> >> >> Holly >> >> >> >> From: Catherine Carlson [mailto:CARLSON_CATHERINE at salkeiz.k12.or.us] >> Sent: Thursday, July 23, 2015 3:27 PM >> To: 'CARTER Holly'; assessment_advisory_committee at listsmart.osl.state.or.us >> Subject: RE: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 >> >> >> >> Holly, >> >> Given the technical problems we encountered around this issue, I think that being able to recover drafts in the current session is better than not having the ability at all. >> >> >> Catherine Carlson >> >> Coordinator >> Testing & Evaluation/Student Records Department >> Salem-Keizer School District >> 503-399-5590 >> FAX 503-391-4088 >> Supporting student achievement through information, professional development, and assessment services >> >> >> >> >> >> >> >> From: Assessment_Advisory_Committee [mailto:assessment_advisory_committee-bounces at listsmart.osl.state.or.us] On Behalf Of CARTER Holly >> Sent: Thursday, July 23, 2015 1:24 PM >> To: assessment_advisory_committee at listsmart.osl.state.or.us >> Subject: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 >> Importance: High >> >> >> >> At our May 6 meeting, AIR reviewed with us a new ?Item Response Time Machine? tool that would be available in 2015-16. The slide below summarizes this proposed tool as AIR described it to us at the meeting: >> >> >> >> >> >> >> >> ODE has recently learned from AIR that they will need to limit this feature to retrieving responses entered during the student?s current test session as allowing students to go back and retrieve responses from an earlier test session uses too many system resources and risks slowing down the testing experience for all students. >> >> >> >> Given this change in scope, ODE now requests your input whether there is still value in implementing the Item Response Time Machine for 2015-16. So that we can finalize our specifications and prepare communications to the field about supported tools, we request your input by COB Tuesday, July 28. >> >> >> >> Thank you as always for your valuable feedback! >> >> >> >> Holly Carter >> Assessment Policy Analyst >> >> Office of Learning | Inst., Stand., Asmt, &Acc. Unit | Oregon Department of Education >> >> Phone: 503.947.5739 | Fax: 503.378.5156 | *holly.carter at state.or.us >> >> >> >> >> >> >> _____________________________________________________ >> Assessment_Advisory_Committee mailing list >> Assessment_Advisory_Committee at listsmart.osl.state.or.us >> http://listsmart.osl.state.or.us/mailman/listinfo/assessment_advisory_committee >> Hosted by the Oregon State Library. The Library is not responsible for content. >> Questions related to message content should be directed to list owner(s) or the sender of the message, by phone or email. >> Technical questions? Call 503-378-8800. >> >> >> >> >> -- >> >> Bill Stewart >> >> Special Projects >> >> Gladstone SD >> >> stewartw at gladstone.k12.or.us >> >> 503-805-8680 - cell >> >> >> _____________________________________________________ >> Assessment_Advisory_Committee mailing list >> Assessment_Advisory_Committee at listsmart.osl.state.or.us >> http://listsmart.osl.state.or.us/mailman/listinfo/assessment_advisory_committee >> Hosted by the Oregon State Library. The Library is not responsible for content. >> Questions related to message content should be directed to list owner(s) or the sender of the message, by phone or email. >> Technical questions? Call 503-378-8800. > > _____________________________________________________ > Assessment_Advisory_Committee mailing list > Assessment_Advisory_Committee at listsmart.osl.state.or.us > http://listsmart.osl.state.or.us/mailman/listinfo/assessment_advisory_committee > Hosted by the Oregon State Library. The Library is not responsible for content. > Questions related to message content should be directed to list owner(s) or the sender of the message, by phone or email. > Technical questions? Call 503-378-8800. -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.jpg Type: image/jpeg Size: 4553 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.png Type: image/png Size: 46672 bytes Desc: not available URL: From bbain at ttsd.k12.or.us Mon Jul 27 15:05:05 2015 From: bbain at ttsd.k12.or.us (Bain, Brian) Date: Mon, 27 Jul 2015 22:05:05 +0000 Subject: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 In-Reply-To: References: Message-ID: <016B0BFF1DF04E44B5C8ED9AACF3243A7BF34542@EX1.ttsd.ttsd.k12.or.us> Sorry for joining the conversation late. I'm off on Fridays all summer, and had teachers in a training/workshop session all day on Thursday. I agree with Bill and Catherine. It would be a great tool, but only if it is "always on" and then accessible by the proctor on an "as needed" basis. My understanding, during our meeting, was that AIR was caching student work every 2 minutes anyway.... is this not true? I wouldn't recommend introducing the time machine to the state assessments given the limited implementation. Just to clarify, I don't recall our recommendation being that the tool not be on for every student by default. I thought we recommended that access to it be a tool in the proctor's back pocket and that they (the proctor) be allowed to access the time machine on the students' computer rather than having student directions that include time travel as part of the standardized administration. Brian Bain District Assessment Coordinator Tigard-Tualatin School District 6960 SW Sandburg St, Tigard, OR 97223 503-431-4120 - bbain at ttsd.k12.or.us From: Assessment_Advisory_Committee [mailto:assessment_advisory_committee-bounces at listsmart.osl.state.or.us] On Behalf Of Bill Stewart Sent: Thursday, July 23, 2015 3:41 PM To: CARTER Holly Cc: assessment_advisory_committee at listsmart.osl.state.or.us Subject: Re: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 Thanks Holly! Per your message and our phone conversation, it now seems like this would not be an effective tool to address the problems that a number of students across the state encountered this past spring. If a TA has to have the tool turned on BEFORE the problem arises, then the TA is essentially 'required' to turn it on for all students at the start of the session to have any chance of recovering drafts. I'm not enough of a mind-reader to know, ahead of time, which kids will need this feature. I'm not at all sure it is worth slowing down the system for all students. I hope others will weigh-in and show me the error of my logic. Bill On Thu, Jul 23, 2015 at 3:32 PM, CARTER Holly > wrote: Thanks, Catherine. There?s one important piece of clarification that we have received that I want to share with you all. AIR has clarified that, regardless of whether it is in the same session or a different session, if a student pauses the test, they will not be able to view previous draft responses once the student logs back in. When we reviewed this tool back in May, it was your collective recommendation that this tool should not be on for all students automatically as it may cause confusion/distraction, but that the TA should be able to enable the tool mid-test if the need arose. Given the recent clarification from AIR that the response history will not persist when a student logs out and logs back in (which is required for the TA to turn on a tool mid-test), how does this impact the benefit/use of this tool? Holly From: Catherine Carlson [mailto:CARLSON_CATHERINE at salkeiz.k12.or.us] Sent: Thursday, July 23, 2015 3:27 PM To: 'CARTER Holly'; assessment_advisory_committee at listsmart.osl.state.or.us Subject: RE: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 Holly, Given the technical problems we encountered around this issue, I think that being able to recover drafts in the current session is better than not having the ability at all. Catherine Carlson Coordinator Testing & Evaluation/Student Records Department Salem-Keizer School District 503-399-5590 FAX 503-391-4088 Supporting student achievement through information, professional development, and assessment services From: Assessment_Advisory_Committee [mailto:assessment_advisory_committee-bounces at listsmart.osl.state.or.us] On Behalf Of CARTER Holly Sent: Thursday, July 23, 2015 1:24 PM To: assessment_advisory_committee at listsmart.osl.state.or.us Subject: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 Importance: High At our May 6 meeting, AIR reviewed with us a new ?Item Response Time Machine? tool that would be available in 2015-16. The slide below summarizes this proposed tool as AIR described it to us at the meeting: [cid:image001.png at 01D0C87D.9EA11B50] ODE has recently learned from AIR that they will need to limit this feature to retrieving responses entered during the student?s current test session as allowing students to go back and retrieve responses from an earlier test session uses too many system resources and risks slowing down the testing experience for all students. Given this change in scope, ODE now requests your input whether there is still value in implementing the Item Response Time Machine for 2015-16. So that we can finalize our specifications and prepare communications to the field about supported tools, we request your input by COB Tuesday, July 28. Thank you as always for your valuable feedback! Holly Carter Assessment Policy Analyst Office of Learning | Inst., Stand., Asmt, &Acc. Unit | Oregon Department of Education Phone: 503.947.5739 | Fax: 503.378.5156 | ?holly.carter at state.or.us _____________________________________________________ Assessment_Advisory_Committee mailing list Assessment_Advisory_Committee at listsmart.osl.state.or.us http://listsmart.osl.state.or.us/mailman/listinfo/assessment_advisory_committee Hosted by the Oregon State Library. The Library is not responsible for content. Questions related to message content should be directed to list owner(s) or the sender of the message, by phone or email. Technical questions? Call 503-378-8800. -- Bill Stewart Special Projects Gladstone SD stewartw at gladstone.k12.or.us 503-805-8680 - cell -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 46672 bytes Desc: image001.png URL: From holly.carter at state.or.us Thu Jul 30 08:38:10 2015 From: holly.carter at state.or.us (CARTER Holly) Date: Thu, 30 Jul 2015 15:38:10 +0000 Subject: [Assessment_Advisory_Committee] Thank you for your input: time machine tool Message-ID: Good morning everyone, Thank you all for your speedy input on the time machine tool. I wanted to take a quick moment to follow up with you and let you know where we have landed. Based on your collective recommendations, we will move forward with AIR to implement the time machine, with this tool enabled for all students by default. The TA would retain the ability to disable it for individual students as needed from the TA interface (e.g., if the tool proved to be a distraction for a given student). Best, Holly Carter Assessment Policy Analyst Office of Learning | Inst., Stand., Asmt, &Acc. Unit | Oregon Department of Education Phone: 503.947.5739 | Fax: 503.378.5156 | ?holly.carter at state.or.us From: Bain, Brian [mailto:bbain at ttsd.k12.or.us] Sent: Monday, July 27, 2015 3:05 PM To: Bill Stewart; CARTER Holly Cc: assessment_advisory_committee at listsmart.osl.state.or.us Subject: RE: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 Sorry for joining the conversation late. I'm off on Fridays all summer, and had teachers in a training/workshop session all day on Thursday. I agree with Bill and Catherine. It would be a great tool, but only if it is "always on" and then accessible by the proctor on an "as needed" basis. My understanding, during our meeting, was that AIR was caching student work every 2 minutes anyway.... is this not true? I wouldn't recommend introducing the time machine to the state assessments given the limited implementation. Just to clarify, I don't recall our recommendation being that the tool not be on for every student by default. I thought we recommended that access to it be a tool in the proctor's back pocket and that they (the proctor) be allowed to access the time machine on the students' computer rather than having student directions that include time travel as part of the standardized administration. Brian Bain District Assessment Coordinator Tigard-Tualatin School District 6960 SW Sandburg St, Tigard, OR 97223 503-431-4120 - bbain at ttsd.k12.or.us From: Assessment_Advisory_Committee [mailto:assessment_advisory_committee-bounces at listsmart.osl.state.or.us] On Behalf Of Bill Stewart Sent: Thursday, July 23, 2015 3:41 PM To: CARTER Holly Cc: assessment_advisory_committee at listsmart.osl.state.or.us Subject: Re: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 Thanks Holly! Per your message and our phone conversation, it now seems like this would not be an effective tool to address the problems that a number of students across the state encountered this past spring. If a TA has to have the tool turned on BEFORE the problem arises, then the TA is essentially 'required' to turn it on for all students at the start of the session to have any chance of recovering drafts. I'm not enough of a mind-reader to know, ahead of time, which kids will need this feature. I'm not at all sure it is worth slowing down the system for all students. I hope others will weigh-in and show me the error of my logic. Bill On Thu, Jul 23, 2015 at 3:32 PM, CARTER Holly > wrote: Thanks, Catherine. There?s one important piece of clarification that we have received that I want to share with you all. AIR has clarified that, regardless of whether it is in the same session or a different session, if a student pauses the test, they will not be able to view previous draft responses once the student logs back in. When we reviewed this tool back in May, it was your collective recommendation that this tool should not be on for all students automatically as it may cause confusion/distraction, but that the TA should be able to enable the tool mid-test if the need arose. Given the recent clarification from AIR that the response history will not persist when a student logs out and logs back in (which is required for the TA to turn on a tool mid-test), how does this impact the benefit/use of this tool? Holly From: Catherine Carlson [mailto:CARLSON_CATHERINE at salkeiz.k12.or.us] Sent: Thursday, July 23, 2015 3:27 PM To: 'CARTER Holly'; assessment_advisory_committee at listsmart.osl.state.or.us Subject: RE: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 Holly, Given the technical problems we encountered around this issue, I think that being able to recover drafts in the current session is better than not having the ability at all. Catherine Carlson Coordinator Testing & Evaluation/Student Records Department Salem-Keizer School District 503-399-5590 FAX 503-391-4088 Supporting student achievement through information, professional development, and assessment services From: Assessment_Advisory_Committee [mailto:assessment_advisory_committee-bounces at listsmart.osl.state.or.us] On Behalf Of CARTER Holly Sent: Thursday, July 23, 2015 1:24 PM To: assessment_advisory_committee at listsmart.osl.state.or.us Subject: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28 Importance: High At our May 6 meeting, AIR reviewed with us a new ?Item Response Time Machine? tool that would be available in 2015-16. The slide below summarizes this proposed tool as AIR described it to us at the meeting: [cid:image001.png at 01D0CAA3.10EEF480] ODE has recently learned from AIR that they will need to limit this feature to retrieving responses entered during the student?s current test session as allowing students to go back and retrieve responses from an earlier test session uses too many system resources and risks slowing down the testing experience for all students. Given this change in scope, ODE now requests your input whether there is still value in implementing the Item Response Time Machine for 2015-16. So that we can finalize our specifications and prepare communications to the field about supported tools, we request your input by COB Tuesday, July 28. Thank you as always for your valuable feedback! Holly Carter Assessment Policy Analyst Office of Learning | Inst., Stand., Asmt, &Acc. Unit | Oregon Department of Education Phone: 503.947.5739 | Fax: 503.378.5156 | ?holly.carter at state.or.us _____________________________________________________ Assessment_Advisory_Committee mailing list Assessment_Advisory_Committee at listsmart.osl.state.or.us http://listsmart.osl.state.or.us/mailman/listinfo/assessment_advisory_committee Hosted by the Oregon State Library. The Library is not responsible for content. Questions related to message content should be directed to list owner(s) or the sender of the message, by phone or email. Technical questions? Call 503-378-8800. -- Bill Stewart Special Projects Gladstone SD stewartw at gladstone.k12.or.us 503-805-8680 - cell -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 46672 bytes Desc: image001.png URL: