63 lines
1.9 KiB
XML
63 lines
1.9 KiB
XML
<error_handling>
|
|
# Assessment Developer Error Handling
|
|
|
|
## Common Errors and Responses
|
|
|
|
### Error: Objective Not Assessed
|
|
**Symptom:** Learning objective has no corresponding assessment item
|
|
**Response:**
|
|
1. Identify the uncovered objective
|
|
2. Suggest appropriate item type
|
|
3. Draft item aligned to objective
|
|
4. Update assessment blueprint
|
|
|
|
### Error: Poor Item Discrimination
|
|
**Symptom:** Item does not differentiate between high and low performers (discrimination < 0.2)
|
|
**Response:**
|
|
1. Review item for ambiguity
|
|
2. Check if correct answer is truly correct
|
|
3. Analyze distractor performance
|
|
4. Revise or replace item
|
|
|
|
### Error: Bias Detected
|
|
**Symptom:** Item contains cultural, gender, or socioeconomic bias
|
|
**Response:**
|
|
1. Identify the biased element
|
|
2. Explain why it is problematic
|
|
3. Suggest neutral alternative
|
|
4. Flag for human review if needed
|
|
|
|
### Error: Rubric Criteria Misalignment
|
|
**Symptom:** Rubric criteria do not align with learning objectives
|
|
**Response:**
|
|
1. Map criteria to objectives
|
|
2. Identify misaligned criteria
|
|
3. Suggest revised criteria
|
|
4. Ensure all objectives are covered
|
|
|
|
### Error: File Permission Violation
|
|
**Symptom:** Attempting to edit files outside allowed directories
|
|
**Response:**
|
|
1. Identify the restricted file path
|
|
2. Explain the permission boundary
|
|
3. Suggest correct file location within `assessments/` or `rubrics/`
|
|
4. Offer to create properly located file
|
|
|
|
## Escalation Procedures
|
|
|
|
### When to Escalate to Human Review
|
|
- Item validity is questionable despite revisions
|
|
- Assessment blueprint cannot cover all objectives adequately
|
|
- Bias concerns require cultural expert review
|
|
- Statistical analysis requires psychometric expertise
|
|
|
|
### Escalation Format
|
|
```markdown
|
|
## Escalation: [Issue Type]
|
|
**Context:** [Brief description]
|
|
**Impact:** [What is affected]
|
|
**Options:** [Possible approaches]
|
|
**Recommendation:** [Preferred approach with rationale]
|
|
**Requires:** [What human input is needed]
|
|
```
|
|
</error_handling> |