New help files for version 2004081100.

This commit is contained in:
rkingdon
2004-09-08 11:27:59 +00:00
parent 5d6bb02f7c
commit b25b9f2dce
5 changed files with 156 additions and 0 deletions
@@ -0,0 +1,69 @@
<p align="center"><b>Comparison of Assessments</b></p>
<p>In a workshop it is common for the same piece of work to be assessed by the
teacher and the students. If examples are used then the teacher first
assesses them before the students assess a selection of them. The work from
the students may well be assessed by the teacher, at least in part, and
very possibly by a number of students. A workshop allows the teacher to award
a proportion of the grade to the student's assessments, the remainder of
the grade is allocated to the assessments of the work itself. (The
proportions of the grade given to these two areas is set towards the end of
the workshop.) A student's assessments are given a grade based on how well
they match the corresponding assessments make by the teacher. (In the
absence of a teacher assessment then the average of the peer assessments is
used).</p>
<p>The degree of agreement between the student's and teacher's assessment is
based on the differences between the scores in individual elements
(actually the squared differences are used). The mean of these differences
must to converted into a meaningful grade. The &quot;Comparison of
Assessments&quot; option allows the teacher a degree of control on how
these comparisons are converted into grades.</p>
<p>To get some idea on what effect this option has, take the (fairly simple)
case of an assessment which has ten Yes/No questions. For example the
assessment might use questions like "Is the chart correctly formatted?",
"Is the calculated profit $100.66?", etc. Assume there are ten such
questions. When the &quot;Very Lax&quot; setting is chosen, prefect
agreement between the student's and teacher's assessment gives a grade of
100%, if there is only one question which does not match the grade is 90%,
two disagreements give a grade of 80%, three
disagreements 70%, etc.. That might seem very reasonable and you might be thinking
why is this option called a &quot;Very Lax&quot; comparison. Well, consider
the case of a student doing a completely random assessment where the
answers of the ten questions are simply
guessed. On average this would result in five of the ten questions being
matched. So the &quot;monkey's&quot; assessment would get a grade of around
50%. The situation gets a little more sensible with the &quot;Lax&quot;
option, then
the random assessment gets around 20%. When the &quot;Fair&quot; option is
chosen, random guessing will result in a zero grade most of the
time. At this level, a grade of 50% is given when the two assessments agree
on eight questions of the ten. If three questions are in disagreement then
the grade given is 25%. When the option is set to &quot;Strict&quot; having
two questions out of sync gives a grade of 40%. Moving into the &quot;Very
Strict&quot; territory a disagreement in just two questions drops the grade to
35% and having a single question in disagreement gives a grade of 65%.</p>
<p>This example is sightly artifical as most assessments usually have elements
which have a range of values rather than just Yes or No. In those cases the
comparison is likely to result in somewhat higher grades then the values
indicated above. The various levels (Very Lax, Lax, Fair...) are given so
that the teacher can fine tune the comparisons. If they feel that the grades
being given for assessments are too low then this option should be moved
towards the &quot;Lax&quot; or even &quot;Very Lax&quot; choices. And
alternatively, if the grades for the student's assessments are, in general,
felt to be too high this option should be moved to either the
&quot;Strict&quot; or &quot;Very Strict&quot; choices. It is really a
matter of trial and error with the best starting point being the
&quot;Fair&quot; option.</p>
<p>During the course of the workshop the teacher may feel that the grades given
to the student assessments are either too high or too low. These grades are
shown on the exercise's Administration Page. In this case, the teacher can
change the setting of this option and re-calculate the student assessment
grades (the &quot;Grading Grades&quot;). The re-calculation is done by
clicking the &quot;Re-grade Student Assessments&quot; link found on the
administration page of the workshop. This can be safely performed at any
time in the workshop.</p>
+12
View File
@@ -0,0 +1,12 @@
<p align="center"><b>The Grade of the Submissions</b></p>
<p>This value determines the maximum grade which can be awarded to a <b>submission</b>.</p>
<p>The overall grade for the workshop is the sum of the (average) grade of the student's
assessments and the grade from their submission(s). Thus if the (maximum)
grade for the student's assessments is set to 30 and the (maximum) grade for
the submissions is 70 the (maximum) grade for the workshop is 100.</p>
<p>This value can be changed at any time and the effect on the grades seen by
the students (and the teacher) is immediate.</p>
+26
View File
@@ -0,0 +1,26 @@
<p align=center><b>Grade of Student Assessments</b></p>
<p>This is the maximum grade given to the assessments make by students of their
own and/or other work. That is, the grade for their assessments. The actual
grades for an assessment is calculated by the workshop module by comparing
that assessment with the "best" assessment of the same submission. The
&quot;best&quot; assessment is the one which is closest to the mean of all
the assessments. (This is a &quot;weighted&quot; mean if the teacher's
assessment are given a weight greater than one.) Note that if there is only
one assessment of an submission, that single assessemnt is taken as the
best. If there are are two assessments of an submission, both are
considered &quot;best&quot;. Only when there are three or more assessments
does the module start to make distinctions between the assessments.</p>
<p>This grade is sometimes called the &quot;grading grade&quot; and is
<i><b>not</b></i> the maximum grade given to the work, that grade is called
&quot;Grade for Submissions&quot;.</p>
<p>A student's grade for the workshop is the sum of this grade and the grade
for their submission(s). Thus if the (maximum) grade for the Student
assessments is set at 20 and the (maximum) grade for submission is set to
80, then the (maximum) grade for the workshop is 100.</p>
<p>This value can be changed at any time and the effect on the grades seen by
the students (and the teacher) is immediate.</p>
+25
View File
@@ -0,0 +1,25 @@
<P ALIGN=CENTER><B>Weight of Teacher's Assessments</B></P>
<P>This option, usually set at 1, can be used to either &quot;switch off&quot;
any assessments made by the teacher, to give them an equal weight as the
student assessments, or give them more weight than the student assessemnts.</p>
<p>The normal value for this option is 1. This gives the teacher's assessments
the same weight as student assessments.</p>
<p>There may arise circumstances when it is felt that the students are consistently
&quot;over grading&quot; assessments, that is giving their peers too high a
grade. The oposite may happen when the peer grading is too low (but that is
more unusual). The poor grading by the students can be compensated, to a
degree, by increasing the value of this option. Setting the value to 5, for
example, means that if there are 5 student assessments of each submission,
say, then the teacher's assessment has the same weight (in dropping suspect
assessments and in determining the grade)
as all 5 of the student assessments. Further in the analysis of assessments,
student assessments which do not agree with that of the teacher are more
likely to be dropped when this option is greater than one. The remaining
assessments are closer to the teacher's grade thus giving even more weight
to the teacher's assessment.</p>
<p>This option can be changed at any time during the assignment.</p>
@@ -0,0 +1,24 @@
<P ALIGN=CENTER><B>UnGraded Assessments</B></P>
<P>In general, the assessments made by students are given a (small) proportion
of marks which count towards their final grade. The grading of these
assessments (and those made by the teacher) is done in the background by
the workshop module. Provided a submission is assessed
three or more times, the module can make a reasonable estimate of each
assessment's &quot;worth&quot;. (For submissions which have been assessed
only once or twice, these assessments are given the maximum &quot;grading
grade&quot;.) As this grading process is done at regular intervals, the
number of ungraded assessments will normally be zero.</p>
<p>The function of this link is to force a re-calculation of the grading grades,
the grades given to assessments. The teacher may want to do this when either
of these two options is changed:
<ol>
<li>The option &quot;Comparison of Assessments&quot;;</li>
<li>The weighting given to the teacher's assessments.</li>
</ol>
Clicking on this link will immediately bring the grading grades up-to-date,
reflecting the current values given to these parameters. Changes to other
the settings of the workshop, such as the value for the grading grade
itself, do <b>not</b> require this re-calculation to be performed.</p>