<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.EmailStyle20
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.EmailStyle21
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.EmailStyle22
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle23
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle24
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:black;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:622185;
mso-list-template-ids:-1422237054;}
@list l1
{mso-list-id:1389915395;
mso-list-template-ids:-73652500;}
@list l1:level1
{mso-level-tab-stop:.5in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l1:level2
{mso-level-tab-stop:1.0in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l1:level3
{mso-level-tab-stop:1.5in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l1:level4
{mso-level-tab-stop:2.0in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l1:level5
{mso-level-tab-stop:2.5in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l1:level6
{mso-level-tab-stop:3.0in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l1:level7
{mso-level-tab-stop:3.5in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l1:level8
{mso-level-tab-stop:4.0in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l1:level9
{mso-level-tab-stop:4.5in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l2
{mso-list-id:1882403742;
mso-list-template-ids:-73652500;}
@list l2:level1
{mso-level-tab-stop:.5in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l2:level2
{mso-level-tab-stop:1.0in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l2:level3
{mso-level-tab-stop:1.5in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l2:level4
{mso-level-tab-stop:2.0in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l2:level5
{mso-level-tab-stop:2.5in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l2:level6
{mso-level-tab-stop:3.0in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l2:level7
{mso-level-tab-stop:3.5in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l2:level8
{mso-level-tab-stop:4.0in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l2:level9
{mso-level-tab-stop:4.5in;
mso-level-number-position:left;
text-indent:-.25in;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:black">My comments/thoughts (apologies if any of these are duplicative of others’). And I’ll also note that a large-district perspective may be quite different on the
utility of this tool than smaller districts.<o:p></o:p></span></p>
<ol style="margin-top:0in" start="1" type="1">
<li class="MsoNormal" style="color:black;mso-list:l2 level1 lfo3"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Is the purpose of the ORA clearly stated?<br>
</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:red">Yes</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""><o:p></o:p></span></li><li class="MsoNormal" style="color:black;mso-list:l2 level1 lfo3"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Is the intended population who will participate in the ORA clear (i.e., is the decision rule used to determine whether to administer
the ORA clear)?<br>
</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:red">I think so, although perhaps some things should be stated even a little more explicitly. Specifically, if I understand correctly, students must complete at least 20 items on
the ORExt to count for participation regardless of whether the ORA is used.<br>
<br>
What needs more clarity is whether this will be a required component or will be an optional tool. For Portland, unless this is mandated, I think it is extremely unlikely that any teacher will use it as we already have similar tools in place. In addition our
teacher’s union will likely see this as a workload issue if required and will want to take away one of our other assessments.<br>
<br>
One more question: is the decision to use the ORA tied to student abilities on specific ORExt domains? I’m guessing most teachers would be able to figure this out, but may be worth making more explicit in the instructions.</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""><o:p></o:p></span></li><li class="MsoNormal" style="color:black;mso-list:l2 level1 lfo3"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Does the ORA appear to be a useful tool for the intended population (i.e., face validity)?<br>
</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:red">Yes, except that in Portland we already use similar (and slightly more comprehensive) tools that we would likely not replace with the ORA. Per comment above, if ORA is mandated
for these students this will put us in a difficult position whether we have to drop something else (per union negotiation) that we would prefer to use over the ORA.</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""><o:p></o:p></span></li><li class="MsoNormal" style="mso-list:l2 level1 lfo3"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:black">Are the ORA administration instructions
</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">clear, particularly in the areas of describing the LOI and COM scales?<br>
<span style="color:red">The only thing not clear to me here is whether there is another (secure) document that includes prompts or interaction scenarios that would be used. The instructions give a fairly concrete example (using a beverage) but the scoring instructions
are more generic. Is there a set of prompts that will be used for the ORA? If not, is this assessment time bound/on demand or can teachers rely on (recent) past experience to complete ratings? Most of the content on the rating is already being attended to
in the classroom. I’m rambling a bit; I guess my suggestion is more clarity is needed as to whether this is a constrained assessment or an looser, non-time-bound observational tool.</span><o:p></o:p></span></li><li class="MsoNormal" style="mso-list:l2 level1 lfo3"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Are the ORA scoring instructions clear?<br>
<span style="color:red">Yes</span><o:p></o:p></span></li><li class="MsoNormal" style="mso-list:l2 level1 lfo3"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Do you feel that IEP teams will be able to use this information for students who are so low functioning that they cannot access the academic
demands of the ORExt?<br>
<span style="color:red">Maybe not useful for these severely impacted students. As previously mentioned, in Portland we already do additional assessments for this group of students and couple that with how closely teachers know and work with students already,
the utility for the teacher seems limited. </span><o:p></o:p></span></li><li class="MsoNormal" style="color:black;mso-list:l2 level1 lfo3"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Do you feel that clear directions regarding the use of the results from the ORA have been provided?<br>
</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:red">Yes</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""><o:p></o:p></span></li><li class="MsoNormal" style="color:black;mso-list:l2 level1 lfo3"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Do you have any recommended edits/changed to the ORA?<br>
</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:red">What is the anticipated PD addition for this assessment? The instructions seem relatively clear so that additional training would be limited; but in some cases, may be needed.</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""><o:p></o:p></span></li></ol>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:black">Joe<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:black"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Assessment_Advisory_Committee [mailto:assessment_advisory_committee-bounces@listsmart.osl.state.or.us]
<b>On Behalf Of </b>HEIDE Jordan<br>
<b>Sent:</b> Friday, September 25, 2015 7:48 AM<br>
<b>To:</b> assessment_advisory_committee@listsmart.osl.state.or.us<br>
<b>Subject:</b> [Assessment_Advisory_Committee] Oregon Extended Assessment Observational Rating Assessment<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:black">We’d like to request your review of the attached proposed Oregon Extended Assessment Observational Rating Assessment (ORA)(see attached Administration Instructions
and ORA) designed to provide instructional and functional information for teachers and parents in in four domains: attention, math concepts, receptive and expressive communication. The ORA is designed to be administered to students who are not able to access
the academic tasks presented on the Oregon Extended Assessment (ORExt), even when extensive, universal supports are provided. The ORA will be incorporated into the Extended Assessment beginning 2015-16.
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:black">Given the description and purpose of the ORA, we are seeking feedback on the questions below
<b><u>by 9/30/15</u></b>:<o:p></o:p></span></p>
<ol style="margin-top:0in" start="1" type="1">
<li class="MsoNormal" style="color:black;mso-list:l1 level1 lfo4"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Is the purpose of the ORA clearly stated?<o:p></o:p></span></li><li class="MsoNormal" style="color:black;mso-list:l1 level1 lfo4"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Is the intended population who will participate in the ORA clear (i.e., is the decision rule used to determine whether to administer
the ORA clear)?<o:p></o:p></span></li><li class="MsoNormal" style="color:black;mso-list:l1 level1 lfo4"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Does the ORA appear to be a useful tool for the intended population (i.e., face validity)?<o:p></o:p></span></li><li class="MsoNormal" style="mso-list:l1 level1 lfo4"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:black">Are the ORA administration instructions
</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">clear, particularly in the areas of describing the LOI and COM scales?<o:p></o:p></span></li><li class="MsoNormal" style="mso-list:l1 level1 lfo4"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Are the ORA scoring instructions clear?<o:p></o:p></span></li><li class="MsoNormal" style="mso-list:l1 level1 lfo4"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Do you feel that IEP teams will be able to use this information for students who are so low functioning that they cannot access the academic
demands of the ORExt?<o:p></o:p></span></li><li class="MsoNormal" style="color:black;mso-list:l1 level1 lfo4"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Do you feel that clear directions regarding the use of the results from the ORA have been provided?<o:p></o:p></span></li><li class="MsoNormal" style="color:black;mso-list:l1 level1 lfo4"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Do you have any recommended edits/changed to the ORA?<o:p></o:p></span></li></ol>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:black"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:black">Please submit your feedback to Brad Lenhardt
</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">(<a href="mailto:brad.lenhardt@state.or.us">brad.lenhardt@state.or.us</a>).
</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Finally, we would appreciate it if you would keep this information confidential at this time. Once we finalize the ORA we will distribute it through the typical ODE communication channels.<u><o:p></o:p></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Sincere thanks<i> for your expert consideration and assist<span style="color:#1F497D"><o:p></o:p></span></i></span></p>
</div>
</body>
</html>