Index: openacs-4/packages/assessment/www/doc/data_collection.html
===================================================================
RCS file: /usr/local/cvsroot/openacs-4/packages/assessment/www/doc/data_collection.html,v
diff -u -r1.7 -r1.7.14.1
--- openacs-4/packages/assessment/www/doc/data_collection.html 5 Aug 2004 01:29:06 -0000 1.7
+++ openacs-4/packages/assessment/www/doc/data_collection.html 16 Jul 2016 17:39:21 -0000 1.7.14.1
@@ -16,9 +16,9 @@
- - survey_responses which capture information about which
+
- survey_responses which capture information about which
survey was completed, by whom, when, etc
- - survey_question_responses which capture the actual user
+
- survey_question_responses which capture the actual user
data in a "long skinny table" mechanism
@@ -29,11 +29,11 @@
- - Assessment Session which captures information about
+
- Assessment Session which captures information about
which Assessment, which Subject, when, etc
- - Section Data which holds information about the status of
+
- Section Data which holds information about the status of
each Section
- - Item Data which holds the actual data extracted from the
+
- Item Data which holds the actual data extracted from the
Assessment's html forms; this is the "long skinny table"
To support user modification of submitted data (of which
@@ -44,7 +44,7 @@
itself, different authors may be using different versions of the
Assessment. While this situation may be unusual, the fact that it must
be supported means that the semantics of cr_items don't fit the
- Assessment itself. They do fit the semantics of a given user's
+ Assessment itself. They do fit the semantics of a given user's
Assessment "session" however.
We distinguish here between "subjects" which are users whose
information is the primary source of the Assessment's responses, and
@@ -53,8 +53,8 @@
completed some paper form that is being transcribed by staff people who
are users. We thus account for both the "real" and one or more "proxy"
respondents via this mechanism. Note that subjects may or may not be
- OpenACS users who can log into the system running Assessment. Thus subject_id
- will be a foreign key to persons not users. If the responding
+ OpenACS users who can log into the system running Assessment. Thus subject_id
+ will be a foreign key to persons not users. If the responding
user is completing the assessment for herself, the staff_id will be identical
to the subject_id. But if the user completing the assessment is doing it by proxy
for the "real" subject, then the staff_id will be hers while the subject_id will belong
@@ -65,14 +65,14 @@
here is how and why:
- - Annotations: We previously had a separate table to capture any type of
+
- Annotations: We previously had a separate table to capture any type of
ad hoc explanations/descriptions/etc that a user would need to attach to a given
data element (either an item or section). Instead, we will use the OpenACS General Comments
package, which is based on the CR and thus can support multiple comments attached to a given
revision of a data element. The integration between Assessment and GC thus will need to
be at the UI level, not the data model level. Using GC will support post-test "discussions" between
student and teacher, for example, about inidividual items, sections or sessions.
- - Scoring-grading: This has been a rather controversial area because of the
+
- Scoring-grading: This has been a rather controversial area because of the
wide range of needs for derived calculations/evaluations that different applications need
to perform on the raw submitted data. In many cases, no calculations are needed at all; only
frequency reports ("74% of responders chose this option") are needed. In other cases, a given
@@ -82,16 +82,16 @@
of arbitrary combinations of items among different sections or even consisting of arithmetic means
of already calculated scale scores.
Because of this variability as well as the recognition that Assessment should be primarily
- a data collection package, we've decided to abstract all scoring-grading functions to one
+ a data collection package, we've decided to abstract all scoring-grading functions to one
or more additional packages. A grading package
(evaluation)
is under development now by part of our group, but no documentation is yet available about it.
- How such client packages will interface with Assessment has not yet been worked out, but this
- is a crucial issue to work through. Presumably something to do with service contracts.
+ How such client packages will interface with Assessment has not yet been worked out, but this
+ is a crucial issue to work through. Presumably something to do with service contracts.
Such a package will need to interact both with Assessment metadata (to define what items are to be
"scored" and how they are to be scored -- and with Assessment collected data (to do the actual
calculations and mappings-to-grades.
- - Signatures: The purpose of this is to provide identification and nonreputability during
+
- Signatures: The purpose of this is to provide identification and nonreputability during
data submission. An assessment should optionally be configurable to require a pass-phrase from the user
at the individual item level, the section level, or the session level. This pass-phrase would be used
to generate a hash of the data that, along with the system-generated timestamp when the data return to
@@ -101,21 +101,21 @@
We previously used a separate table for this since probably most assessments won't use this (at least,
that is the opinion of most of the educational folks here). However, since we're generating separate
revisions of each of these collected data types, we decided it would be far simpler and more appropriate
- to include the signed_data field directly in the as_item_data table. Note that for complex
+ to include the signed_data field directly in the as_item_data table. Note that for complex
applications, the need to "sign the entire form" or "sign the section" could be performed by concatenating
all the items contained by the section or assessment and storing that in a "signed_data" field in as_section_data
or as_sessions. However, this would presumably result in duplicate hashing of the data -- once for the
individual items and then collectively. Instead, we'll only "sign" the data at the atomic, as_item level, and
procedurally sign all as_item_data at once if the assessment author requires only a section-level or assessment-level
signature.
- - "Events" related to assessments In some applications (like clinical trials), it is important to define
+
- "Events" related to assessments In some applications (like clinical trials), it is important to define
a series of "named" assessment events (like "baseline" "one month" "six months" etc) at which time assessments
are to be performed. Earlier we included an "event_id" attribute in data collection entities (notably as_item_data)
to make mapping of these events to their data easy. This denormalization makes some sense for efficiency considerations,
but it doesn't prove to be generally applicable enough to most contexts, so we've removed it. Instead, any
client package using Assessment in this fashion should implement its own relationships (presumably with acs_rels).
- - "Status" of data collection entities An assessment author may specify different allowable steps
+
- "Status" of data collection entities An assessment author may specify different allowable steps
for her assessment -- such as whether a user can "save&resume" between sessions, whether a second user needs
to "review&confirm" entered data before it becomes "final", etc etc. Rather than try to anticipate these kinds
of workflow options (and considering that many uses of Assessment won't want to track any such status), we've
@@ -141,7 +141,7 @@
- - Assessment Sessions (as_sessions) are the top of the
+
- Assessment Sessions (as_sessions) are the top of the
data-collection entity hierarchy. They provide the central definition
of a given subject's performance of an Assessment. Attributes include:
@@ -151,12 +151,12 @@
- assessment_id (note that this is actually a revision_id)
- subject_id - references a Subjects entity that we don't
define in this package. Should reference the parties table as there is no
- concept of storing persons in OpenACS in general. Note: this cannot
+ concept of storing persons in OpenACS in general. Note: this cannot
reference users, since in many cases, subjects will not be able (or should not
be able) to log into the system. The users table requires email addresses.
Subjects in Assessment cannot be required to have email addresses. If they
can't be "persons" then Assessment will have to define an as_subjects
- table for its own use.
- staff_id - references Users if someone is doing the
Assessment as a proxy for the real subject
@@ -183,7 +183,7 @@
- - Assessment Section Data (as_section_data) tracks the
+
- Assessment Section Data (as_section_data) tracks the
state of each Section in the Assessment. Attributes include:
- section_data_id
@@ -196,7 +196,7 @@
- - Assessment Item Data (as_item_data) is the heart
+
- Assessment Item Data (as_item_data) is the heart
of the data collection piece. This is the "long skinny table" where all
the primary data go -- everything other than "scale" data ie calculated
scoring results derived from these primary responses from subjects.
@@ -230,15 +230,15 @@
- - Assessment Scales : As discussed above, this will for the time being be handled by
+
- Assessment Scales : As discussed above, this will for the time being be handled by
external grading-scoring-evaluation packages. Assessment will only work
with percentages internally. It might be necessary to add scales into
assessment as well, but we will think about this once the time arrives, but we think that
a more elegant (and appropriate, given the OpenACS toolkit design) approach will be to define
service contracts to interface these packages.
- - Assessment Annotations provides a
+
- Assessment Annotations provides a
flexible way to handle a variety of ways that we need to be able to
"mark up" an Assessment. Subjects may modify a response they've already
made and need to provide a reason for making that change. Teachers may