<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:Cambria;
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:"Franklin Gothic Medium";
panose-1:2 11 6 3 2 1 2 2 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Good morning everyone,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Thank you all for your speedy input on the time machine tool. I wanted to take a quick moment to follow up with you and let you know where we have landed. Based
on your collective recommendations, we will move forward with AIR to implement the time machine, with this tool enabled for all students by default. The TA would retain the ability to disable it for individual students as needed from the TA interface (e.g.,
if the tool proved to be a distraction for a given student). <o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Best,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Arial","sans-serif";color:black">Holly Carter</span></b><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">
<br>
</span><span style="font-size:10.0pt;font-family:"Calibri","sans-serif";color:#595959">Assessment Policy Analyst</span><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black"><br>
<br>
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Calibri","sans-serif";color:#595959">Office of Learning | Inst., Stand., Asmt, &Acc. Unit | Oregon Department of Education</span><span style="font-size:10.0pt;font-family:"Cambria","serif";color:#595959"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Calibri","sans-serif";color:#595959">Phone:</span><span style="font-size:10.0pt;font-family:"Calibri","sans-serif";color:#595959">
</span><span style="font-size:10.0pt;font-family:"Calibri","sans-serif";color:#595959">503.947.5739</span><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:#595959"> | Fax:</span><span style="font-size:10.0pt;font-family:"Franklin Gothic Medium","sans-serif";color:#595959"> </span><span style="font-size:10.0pt;font-family:"Calibri","sans-serif";color:#595959">503.378.5156</span><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:#595959">
| </span><span style="font-size:10.0pt;font-family:Wingdings;color:#595959">*</span><span style="font-size:10.0pt;font-family:"Calibri","sans-serif";color:#595959">holly.carter@state.or.us
</span><span style="font-size:10.0pt;font-family:"Calibri","sans-serif";color:#595959"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Bain, Brian [mailto:bbain@ttsd.k12.or.us]
<br>
<b>Sent:</b> Monday, July 27, 2015 3:05 PM<br>
<b>To:</b> Bill Stewart; CARTER Holly<br>
<b>Cc:</b> assessment_advisory_committee@listsmart.osl.state.or.us<br>
<b>Subject:</b> RE: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-family:"Calibri","sans-serif";color:#1F497D">Sorry for joining the conversation late. I'm off on Fridays all summer, and had teachers in a training/workshop session all day on Thursday.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Calibri","sans-serif";color:#1F497D">I agree with Bill and Catherine. It would be a great tool, but only if it is "always on" and then accessible by the proctor on an "as needed" basis. My understanding, during
our meeting, was that AIR was caching student work every 2 minutes anyway.... is this not true?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Calibri","sans-serif";color:#1F497D">I wouldn't recommend introducing the time machine to the state assessments given the limited implementation.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Calibri","sans-serif";color:#1F497D">Just to clarify, I don't recall our recommendation being that the tool not be on for every student by default. I thought we recommended that access to it be a tool in the proctor's
back pocket and that they (the proctor) be allowed to access the time machine on the students' computer rather than having student directions that include time travel as part of the standardized administration.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Brian Bain<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">District Assessment Coordinator<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Tigard-Tualatin School District<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">6960 SW Sandburg St, Tigard, OR 97223<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">503-431-4120 -
<a href="mailto:bbain@ttsd.k12.or.us" target="_blank">bbain@ttsd.k12.or.us</a><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Assessment_Advisory_Committee [<a href="mailto:assessment_advisory_committee-bounces@listsmart.osl.state.or.us">mailto:assessment_advisory_committee-bounces@listsmart.osl.state.or.us</a>]
<b>On Behalf Of </b>Bill Stewart<br>
<b>Sent:</b> Thursday, July 23, 2015 3:41 PM<br>
<b>To:</b> CARTER Holly<br>
<b>Cc:</b> <a href="mailto:assessment_advisory_committee@listsmart.osl.state.or.us">
assessment_advisory_committee@listsmart.osl.state.or.us</a><br>
<b>Subject:</b> Re: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Thanks Holly! <br>
<br>
Per your message and our phone conversation, it now seems like this would <b><u>not</u></b> be an effective tool to address the problems that a number of students across the state encountered this past spring.
<br>
<br>
If a TA has to have the tool turned on BEFORE the problem arises, then the TA is essentially 'required' to turn it on for all students at the start of the session to have any chance of recovering drafts. I'm not enough of a mind-reader to know, ahead of time,
which kids will need this feature. <o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt">I'm not at all sure it is worth slowing down the system for all students.<o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt">I hope others will weigh-in and show me the error of my logic.<o:p></o:p></p>
</div>
<p class="MsoNormal">Bill<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Thu, Jul 23, 2015 at 3:32 PM, CARTER Holly <<a href="mailto:holly.carter@state.or.us" target="_blank">holly.carter@state.or.us</a>> wrote:<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:#1F497D">Thanks, Catherine. There’s one important piece of clarification that we have received that I want to share with you all. AIR has clarified that, regardless
of whether it is in the same session or a different session, if a student pauses the test, they will not be able to view previous draft responses once the student logs back in.
</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:#1F497D">When we reviewed this tool back in May, it was your collective recommendation that this tool should not be on for all students automatically as it may
cause confusion/distraction, but that the TA should be able to enable the tool mid-test if the need arose. Given the recent clarification from AIR that the response history will not persist when a student logs out and logs back in (which is required for the
TA to turn on a tool mid-test), how does this impact the benefit/use of this tool?
</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:#1F497D">Holly</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:#1F497D"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Catherine Carlson [mailto:<a href="mailto:CARLSON_CATHERINE@salkeiz.k12.or.us" target="_blank">CARLSON_CATHERINE@salkeiz.k12.or.us</a>]
<br>
<b>Sent:</b> Thursday, July 23, 2015 3:27 PM<br>
<b>To:</b> 'CARTER Holly'; <a href="mailto:assessment_advisory_committee@listsmart.osl.state.or.us" target="_blank">
assessment_advisory_committee@listsmart.osl.state.or.us</a><br>
<b>Subject:</b> RE: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:#1F497D">Holly,</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:#1F497D">Given the technical problems we encountered around this issue, I think that being able to recover drafts in the current session is better than not having
the ability at all.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:#1F497D"><br>
Catherine Carlson</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:#1F497D">Coordinator<br>
Testing & Evaluation/Student Records Department<br>
Salem-Keizer School District<br>
503-399-5590<br>
FAX 503-391-4088<br>
<i>Supporting student achievement through information, professional development, and assessment services</i></span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:#1F497D"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Assessment_Advisory_Committee
[<a href="mailto:assessment_advisory_committee-bounces@listsmart.osl.state.or.us" target="_blank">mailto:assessment_advisory_committee-bounces@listsmart.osl.state.or.us</a>]
<b>On Behalf Of </b>CARTER Holly<br>
<b>Sent:</b> Thursday, July 23, 2015 1:24 PM<br>
<b>To:</b> <a href="mailto:assessment_advisory_committee@listsmart.osl.state.or.us" target="_blank">
assessment_advisory_committee@listsmart.osl.state.or.us</a><br>
<b>Subject:</b> [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28<br>
<b>Importance:</b> High</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">At our May 6 meeting, AIR reviewed with us a new “Item Response Time Machine” tool that would be available in 2015-16. The slide below summarizes this
proposed tool as AIR described it to us at the meeting:</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"><img border="0" width="480" height="360" id="_x0000_i1025" src="cid:image001.png@01D0CAA3.10EEF480"></span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">ODE has recently learned from AIR that they will need to limit this feature to retrieving responses entered
<b>during the student’s current test session</b> as allowing students to go back and retrieve responses from an earlier test session uses too many system resources and risks slowing down the testing experience for all students.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">Given this change in scope, ODE now requests your input whether there is still value in implementing the Item Response Time Machine for 2015-16. So that
we can finalize our specifications and prepare communications to the field about supported tools, we request your input by
<b>COB</b> <b>Tuesday, July 28.</b></span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">Thank you as always for your valuable feedback!</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt"><b><span style="font-family:"Arial","sans-serif";color:black">Holly Carter</span></b><span style="color:#1F497D">
<br>
</span><span style="font-size:10.0pt;color:#595959">Assessment Policy Analyst</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;color:#595959">Office of Learning | Inst., Stand., Asmt, &Acc. Unit | Oregon Department of Education</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;color:#595959">Phone: 503.947.5739</span><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:#595959"> | Fax:</span><span style="font-size:10.0pt;font-family:"Franklin Gothic Medium","sans-serif";color:#595959"> </span><span style="font-size:10.0pt;color:#595959">503.378.5156</span><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:#595959">
| </span><span style="font-size:10.0pt;font-family:Wingdings;color:#595959">*</span><span style="font-size:10.0pt;color:#595959"><a href="mailto:holly.carter@state.or.us" target="_blank">holly.carter@state.or.us</a>
</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:#1F497D"> </span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
_____________________________________________________<br>
Assessment_Advisory_Committee mailing list<br>
<a href="mailto:Assessment_Advisory_Committee@listsmart.osl.state.or.us">Assessment_Advisory_Committee@listsmart.osl.state.or.us</a><br>
<a href="http://listsmart.osl.state.or.us/mailman/listinfo/assessment_advisory_committee" target="_blank">http://listsmart.osl.state.or.us/mailman/listinfo/assessment_advisory_committee</a><br>
Hosted by the Oregon State Library. The Library is not responsible for content.<br>
Questions related to message content should be directed to list owner(s) or the sender of the message, by phone or email.<br>
Technical questions? Call 503-378-8800.<o:p></o:p></p>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<br>
-- <o:p></o:p></p>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Bill Stewart<o:p></o:p></p>
</div>
<p class="MsoNormal">Special Projects<o:p></o:p></p>
</div>
<p class="MsoNormal">Gladstone SD<o:p></o:p></p>
</div>
<p class="MsoNormal"><a href="mailto:stewartw@gladstone.k12.or.us" target="_blank">stewartw@gladstone.k12.or.us</a><o:p></o:p></p>
</div>
<p class="MsoNormal">503-805-8680 - cell<o:p></o:p></p>
</div>
</div>
</div>
</div>
</body>
</html>