| Course | HD520 Health Education Program Assessment |
|---|---|
| Unit | Unit 4 |
| Paper type | Instrument appraisal |
| Length | About 1,100 words, 6 pages double-spaced |
| Format | APA 7 student paper |
| School | Purdue University Global |
| Program | MS in Health Education |
| Updated | October 2026 |
Free sample paper for HD520 Unit 4
The Ice Cream Label Will Not Travel: A Unit 4 Instrument Appraisal for Measuring What Refugee Orientation Graduates Can Do
[Student Name]
Purdue University Global
HD520: Health Education Program Assessment
Unit 4 Instrument Appraisal
[Instructor Name]
[Date]
The agency, the task and its checklist are composite; the Newest Vital Sign, the testing standards and the adaptation and cognitive interviewing methods cited are real.
The Appraisal Question
The assessment designed in Unit 2 asks whether newly arrived adults who finish the orientation can arrange primary care on their own. An instrument suits that purpose only if its scores mean the same thing for these adults, in their languages, as they did for the people it was developed with. Validity, in the testing standards, belongs to the interpretation of scores for a stated use, not to an instrument in general (American Educational Research Association [AERA] et al., 2014). Each candidate below is judged against that use.
Candidate 1: The Newest Vital Sign
The Newest Vital Sign asks six questions about an ice cream nutrition label, such as how many calories a person would eat if they ate the whole container. It was developed with adult primary care patients in English and Spanish, takes about three minutes and correlated well with a longer health literacy test in its validation study (Weiss et al., 2005). It is widely used, brief and free.
Its strengths are real, and for the population it was built for it is a sensible screen. Three problems rule it out here.
Content. Four of its six questions require arithmetic with serving sizes and percentages. The orientation does not teach label reading; it teaches how to reach care. A high score would show numeracy, not the skill the funder asked about.
Format. A packaged-food label with a nutrition panel is unfamiliar to many participants, particularly adults from rural areas or long stays in camps. A low score could reflect that unfamiliarity rather than any difficulty with health information.
Language. No validation exists in Dari, Arabic or Swahili. Translating it would change the reading demands of each item, and the evidence from English and Spanish would not carry over.
The Newest Vital Sign is a good instrument for a different question; used here, it would measure reading and arithmetic on a foreign label and call the result readiness for primary care.
Candidate 2: A Single Confidence Item
A one-item measure asks how confident the respondent is filling out medical forms alone, on a five-point scale. Single items of this kind have been used as quick literacy screens in clinics, and the item is easy to translate and to read aloud.
It is kept, but only as a secondary measure. It records how people judge their own ability, which matters, since adults who doubt themselves may avoid calling a clinic. But self-ratings tend to rise right after a class whatever has been learned, and the agency's own survey showed how readily participants agree with a positive statement. The confidence item will be reported beside the main outcome, never in place of it.
Candidate 3: The Clinic-Call Performance Task
The third option is built from the class's own aims. The participant receives a short scenario card, read aloud in their language: they need a first appointment for a check-up and have their Medicaid card. They then call a number that rings to an assessor playing a clinic scheduler, ask for an interpreter, and arrange an appointment. A second assessor scores the call on a ten-item checklist.
The checklist items are: asks for an interpreter in the correct language; gives full name; gives date of birth; states the reason for the visit; gives the Medicaid number; accepts or negotiates an appointment date and time; asks or confirms where the clinic is; asks what to bring; repeats back the date and time; and ends the call with a way to reach the clinic again. A call counts as completed when at least eight items are met, including the interpreter request, the appointment and the repeat-back, since without those the call fails in practice.
Validity Evidence for the Task
The testing standards name several sources of validity evidence (AERA et al., 2014). The appraisal uses four.
Content. Two clinic schedulers and two bilingual educators reviewed the checklist against what a real first-appointment call requires. They added the repeat-back item and removed one about spelling a street name, which schedulers said they rarely need. That review is complete.
Response process. Do participants understand the scenario as intended? This needs cognitive interviews in each language, in which a participant thinks aloud or explains their answers after the call (Willis, 2005). They are planned but not yet done.
Internal structure. If the ten items reflect one underlying skill, adults who complete harder items should usually complete easier ones. This can be checked once baseline data exist.
Relations to other variables. Task scores should relate to whether adults actually kept a first clinic appointment within 90 days, which the partner clinic can confirm for consenting participants. This is the most persuasive source for the funder and the last to arrive.
Reliability
Two raters will independently score a random [20] percent of calls from recordings. Agreement on the completion decision will be reported as a kappa coefficient, and the plan sets a minimum of 0.70 before task scores are used in analysis. Disagreements will be discussed and the scoring rules sharpened in writing.
Translation and Adaptation
The scenario card and assessor script will be translated following the forward translation, back translation and expert committee steps described by Beaton et al. (2000), then tested in cognitive interviews. Translation alone does not establish equivalence, so the plan does not treat a translated script as validated until those interviews are complete.
Practical Demands
The task takes about fifteen minutes per adult, including the scenario card, the call and a short debrief, against three minutes for the Newest Vital Sign. Over two rounds for about 240 adults, that adds roughly 60 assessor hours and the cost of interpreter-line minutes. The appraisal accepts that cost, because a shorter instrument measuring the wrong skill would leave the funder's question unanswered, however efficiently. Recorded calls also allow scoring to be checked later.
What Remains Unknown
Most of the evidence for the task does not yet exist. Content review is done; response process, internal structure and relations to clinic attendance are planned. The appraisal recommends the task because its content matches the decision the funder must make, and it says plainly that scores should be read cautiously until the remaining evidence is in.
References
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. American Educational Research Association.
Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine, 25(24), 3186-3191. https://doi.org/10.1097/00007632-200012150-00014
Weiss, B. D., Mays, M. Z., Martz, W., Castro, K. M., DeWalt, D. A., Pignone, M. P., Mockbee, J., & Hale, F. A. (2005). Quick assessment of literacy in primary care: The newest vital sign. Annals of Family Medicine, 3(6), 514-522. https://doi.org/10.1370/afm.405
Willis, G. B. (2005). Cognitive interviewing: A tool for improving questionnaire design. Sage.
The Purdue Global HD520 Unit 4 instructions
The fourth unit typically asks students to identify instruments that could measure the assessment's main outcomes and to appraise their validity, reliability and fit with the population. Many prompts ask for two or three candidates and a recommendation. Describe each instrument accurately, including who it was developed with and what its validation showed. Judge each against the specific use you have in mind. Organize validity evidence by recognized sources, such as content, response process, internal structure and relations to other variables. Plan reliability checks and, for populations using other languages, a translation and adaptation process. Expect four to six pages, and cite the original validation studies.
How this HD520 Unit 4 example is built
The appraisal question comes first, framed through the testing standards: validity belongs to a score's interpretation for a stated use. The Newest Vital Sign gets a fair description before three objections: content, format and language. The highlighted sentence states why a sound instrument can still be wrong here. The confidence item is kept in a limited role. The performance task is described in full, with its ten checklist items and the rule that a call counts as complete at eight items including three critical ones. Validity evidence is sorted into four sources, reliability into a double-scored sample, and a section on practical demands weighs fifteen minutes per adult against three.
Where the points sit in the HD520 Unit 4 rubric
Instrument appraisals are commonly graded on accurate description of each tool, appropriate criteria, sound use of validity and reliability concepts, attention to population fit and a justified recommendation. Accuracy earns credit when the appraisal reports what validation actually showed. Criteria score well when they come from the assessment's purpose rather than a generic checklist. Validity reasoning is stronger when organized by evidence source and when gaps are named. Population fit carries heavy weight in multilingual settings. A recommendation is judged on whether it follows from the appraisal and admits what remains unknown. APA format and clear organization complete the grade. Instructors also look at whether practical demands, such as time per participant and interpreter costs, are weighed against the quality of evidence, since an appraisal that ignores feasibility can recommend a tool no agency could use.
Common HD520 Unit 4 mistakes, and how to avoid them
A common mistake is rejecting a well-known instrument without describing its strengths, which reads as unfair. Another is calling an instrument "valid" as if validity were fixed. Some students recommend a tool because it is short or free without asking whether it measures the outcome that matters. Others translate an instrument and treat the translation as validated. Writing one sentence stating the intended use, and testing every claim against it, prevents most of these. If your population differs from the groups your candidate tools were built for, describe who they are, and we can help you sort the evidence each tool would still need. It also helps to note who developed each tool and with which patients.
Get an HD520 Unit 4 example written to your instructions
Name the construct your Unit 4 appraisal must measure, the population concerned and any instruments your section suggests, then include the rubric. Candidates are appraised for fit to that population, and the chosen one receives a full validity and reliability argument. The first custom sample is free, delivered within 24-48h. The paper above is an original model document written by our desk, not a submitted student paper and not an official Purdue University Global document.
More HD520 papers and MS in Health Education samples
- HD520 Unit 1: Discussion Board Post
- HD520 Unit 2: Design Rationale Paper
- HD520 Unit 3: Sampling Plan
- HD520 Unit 5: Mixed Methods Protocol
- HD520 Unit 6: Seminar Reflection
- HD520 Unit 7: Participation and Governance Plan
- HD520 Unit 8: Data Analysis Section
- HD520 Unit 9: Limitations Analysis
- HD520 Unit 10: Assessment Protocol
HD520 Unit 4 questions, answered
Can an instrument validated in English be translated and used?
Often, but translation alone does not carry validity across. Common practice includes forward translation, back translation, reconciliation by a bilingual panel and cognitive interviews with members of the target group to check that items mean what they should. The appraisal plans all four and notes that scores should not be compared across languages until equivalence is examined.
Why not develop a completely new questionnaire?
A new questionnaire would need all of its validity evidence gathered from scratch. The example adapts a performance task instead because the skill in question, making an appointment through an interpreter, is observable, and a checklist of observable steps is easier to validate than attitudes. Most HD520 sections favor adapting over inventing when a reasonable starting point exists.
What reliability statistic suits a checklist scored by raters?
An agreement measure that accounts for chance, such as Cohen's kappa for two raters on categorical items or an intraclass correlation for total scores. The appraisal plans double scoring on a portion of calls and names a threshold below which raters would be retrained. Internal consistency statistics tell less about a task whose steps are not meant to be interchangeable.
Where can I find a free HD520 Unit 4 sample paper?
A full Unit 4 instrument appraisal is posted here, comparing the Newest Vital Sign, a confidence item and a clinic-call performance task.
What is response process validity evidence?
It shows whether people understand and answer items as intended. Cognitive interviews, where participants explain how they read an item, are the usual way to gather it.