IR 05000321/2007301: Difference between revisions
StriderTol (talk | contribs) (Created page by program invented by StriderTol) |
StriderTol (talk | contribs) (StriderTol Bot change) |
||
| (One intermediate revision by the same user not shown) | |||
| Line 18: | Line 18: | ||
=Text= | =Text= | ||
{{#Wiki_filter:Draft Submittal (Pink Paper)DRAFT Written Exam Quality Checklist (ES-401-6) | {{#Wiki_filter:Draft Submittal (Pink Paper) | ||
&Written Exam Sample Plan HATCH DECEMBER 2007 EXAM 05000321/2007301 AND 05000366/2007301 | DRAFT Written Exam Quality Checklist (ES-401-6) | ||
&Written Exam Sample Plan HATCH DECEMBER 2007 EXAM 05000321/2007301 AND 05000366/2007301 DECEMBER 3 - 6, 2007, AND DECEMBER 10, 2007, (WRITTEN) | |||
ES-401 Written Examination Quality Checklist Form ES-401-6 DRAFT Facility: | |||
Hatch Date of Exam: | |||
TBD Exam Level: SRO Initial 4. | |||
If more than four RO and two SRO questions are repeated from the last two NRC licensing exams, the facility licensee's sampling process was random and systematic. | |||
9. | |||
Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are justified. | |||
New | |||
CIA | |||
Modified | |||
Memory o | |||
Bank Item Description Bruno Caballero Ronald F. Aiello Malcolm T. Widmann NRC KlAs are referenced for all questions. | |||
Facility learning objectives are referenced as available. | Facility learning objectives are referenced as available. | ||
a.b.Between 50 and 60 percent of, the questions on the RO exam are written at the comprehension/ | a. | ||
analysis level;the SRO exam may exceed 60 percent if the randomly selected KlAs support the higher cognitive levels;enter the actual RO/SRO question distribution(s) | |||
at right.Bank u,se meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified); | b. | ||
enter the actual RO/SRO-only question distribution(s) | |||
at right.7.6.2.3.SRO questions are appropriate in accordance with Section D.2.d of ES-401 1.Questions and answers are technically accurate and applicable to the facility.5.Question duplication from the license screening/audit exam was controlled as indicated helow (check the item that applies)and appears appropriate: | Between 50 and 60 percent of, the questions on the RO exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly selected KlAs support the higher cognitive levels; enter the actual RO / SRO question distribution(s) at right. | ||
Bank u,se meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO / SRO-only question distribution(s) at right. | |||
7. | |||
6. | |||
2. | |||
3. | |||
SRO questions are appropriate in accordance with Section D.2.d of ES-401 1. | |||
Questions and answers are technically accurate and applicable to the facility. | |||
5. | |||
Question duplication from the license screening/audit exam was controlled as indicated helow (check the item that applies) and appears appropriate: | |||
_ | |||
the 'audit exam was systematically and randomly developed audit exam was completed before the license exam was started examinations were developed independently licensee certifies that there is no duplication | |||
_ | |||
other (explain) | |||
8. | |||
References/handouts provided do not give away answers or aid in the elimination of distractors. | |||
11. | |||
The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet. | |||
a. Author b. Facility Reviewer (*) | |||
c. NRC Chief Examiner (#) | |||
d. NRC Regional Supervisor 10. | |||
Question psychometric quality and format meet the guidelines in ES Appendix B. | |||
Note: | |||
* The facility reviewer's initials/signature are not applica Ie for NRC-developed examinations. | |||
# Independent NRC reviewer initial items in Column "c"; chief examiner concurrence require ES-401 Written Examination Quality Checklist Form ES-401-6 DRAFT Facility: | |||
Hatch Date of Exam: | |||
TBD Exam Level: RO Initial 4. | |||
If more than four RO and two SRO questions are repeated from the last two NRC licensing exams, the facility licensee's sampling process was random and systematic. | |||
9. | |||
Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are justified. | |||
3. | |||
SRO questions are appropriate in accordance with Section D.2.d of ES-401 | |||
New | |||
CIA | |||
Modified Memory | |||
2 Bank Item Description NRC KlAs are referenced for all questions. | |||
Facility learning objectives are referenced as available. | Facility learning objectives are referenced as available. | ||
a.b.Between 50 and 60 percent of the questions on the RO exam are written at the comprehension/ | a. | ||
analysis level;the SRO exam may exceed 60 percent if the randomly selected KlAs support the higher cognitive levels;enter the actual RO/SRO question distribution(s) | |||
at right.Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified); | b. | ||
enter the actual RO/SRO-only question distribution(s) | |||
at right.2.6.7.5.Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies)and appears appropriate: | Between 50 and 60 percent of the questions on the RO exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly selected KlAs support the higher cognitive levels; enter the actual RO / SRO question distribution(s) at right. | ||
Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO / SRO-only question distribution(s) at right. | |||
2. | |||
6. | |||
7. | |||
5. | |||
Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate: | |||
_ | |||
the audit exam was systematically and randomly developed | |||
_ | |||
the audit exam was completed before the license exam was started | |||
_the 'examinations were developed independently | |||
_ | |||
the licensee certifies that there is no duplication | |||
_ | |||
other (explain) | |||
1. | |||
Questions and answers are technically accurate and applicable to the facility. | |||
8. | |||
References/handouts provided do not give away answers or aid in the elimination of distractors. | |||
10. | |||
Question psychometric quality and format meet the guidelines in ES Appendix B. | |||
11. | |||
The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet. | |||
a. Author b. Facility Reviewer (*) | |||
c. NRC Chief Examiner (#) | |||
d. NRC Regional Supervisor Bruno Caballero Ron Aiello Malcolm T. Widmann Note: | |||
* The facility reviewer's initials/signature are not applicable for NRC-developed examinations. | |||
#Independent NRC reviewer initial items in Column | # Independent NRC reviewer initial items in Column HC"; chief examiner concurrence required. | ||
}} | }} | ||
Latest revision as of 18:03, 14 January 2025
| ML080460209 | |
| Person / Time | |
|---|---|
| Site: | Hatch |
| Issue date: | 02/14/2008 |
| From: | Michael B Division of Reactor Safety II |
| To: | |
| References | |
| 50-321/07-301, 50-366/07-301 | |
| Download: ML080460209 (4) | |
Text
Draft Submittal (Pink Paper)
DRAFT Written Exam Quality Checklist (ES-401-6)
&Written Exam Sample Plan HATCH DECEMBER 2007 EXAM 05000321/2007301 AND 05000366/2007301 DECEMBER 3 - 6, 2007, AND DECEMBER 10, 2007, (WRITTEN)
ES-401 Written Examination Quality Checklist Form ES-401-6 DRAFT Facility:
Hatch Date of Exam:
TBD Exam Level: SRO Initial 4.
If more than four RO and two SRO questions are repeated from the last two NRC licensing exams, the facility licensee's sampling process was random and systematic.
9.
Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are justified.
New
CIA
Modified
Memory o
Bank Item Description Bruno Caballero Ronald F. Aiello Malcolm T. Widmann NRC KlAs are referenced for all questions.
Facility learning objectives are referenced as available.
a.
b.
Between 50 and 60 percent of, the questions on the RO exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly selected KlAs support the higher cognitive levels; enter the actual RO / SRO question distribution(s) at right.
Bank u,se meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO / SRO-only question distribution(s) at right.
7.
6.
2.
3.
SRO questions are appropriate in accordance with Section D.2.d of ES-401 1.
Questions and answers are technically accurate and applicable to the facility.
5.
Question duplication from the license screening/audit exam was controlled as indicated helow (check the item that applies) and appears appropriate:
_
the 'audit exam was systematically and randomly developed audit exam was completed before the license exam was started examinations were developed independently licensee certifies that there is no duplication
_
other (explain)
8.
References/handouts provided do not give away answers or aid in the elimination of distractors.
11.
The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet.
a. Author b. Facility Reviewer (*)
c. NRC Chief Examiner (#)
d. NRC Regional Supervisor 10.
Question psychometric quality and format meet the guidelines in ES Appendix B.
Note:
- The facility reviewer's initials/signature are not applica Ie for NRC-developed examinations.
- Independent NRC reviewer initial items in Column "c"; chief examiner concurrence require ES-401 Written Examination Quality Checklist Form ES-401-6 DRAFT Facility:
Hatch Date of Exam:
If more than four RO and two SRO questions are repeated from the last two NRC licensing exams, the facility licensee's sampling process was random and systematic.
9.
Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are justified.
3.
SRO questions are appropriate in accordance with Section D.2.d of ES-401
New
CIA
Modified Memory
2 Bank Item Description NRC KlAs are referenced for all questions.
Facility learning objectives are referenced as available.
a.
b.
Between 50 and 60 percent of the questions on the RO exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly selected KlAs support the higher cognitive levels; enter the actual RO / SRO question distribution(s) at right.
Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO / SRO-only question distribution(s) at right.
2.
6.
7.
5.
Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:
_
the audit exam was systematically and randomly developed
_
the audit exam was completed before the license exam was started
_the 'examinations were developed independently
_
the licensee certifies that there is no duplication
_
other (explain)
1.
Questions and answers are technically accurate and applicable to the facility.
8.
References/handouts provided do not give away answers or aid in the elimination of distractors.
10.
Question psychometric quality and format meet the guidelines in ES Appendix B.
11.
The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet.
a. Author b. Facility Reviewer (*)
c. NRC Chief Examiner (#)
d. NRC Regional Supervisor Bruno Caballero Ron Aiello Malcolm T. Widmann Note:
- The facility reviewer's initials/signature are not applicable for NRC-developed examinations.
- Independent NRC reviewer initial items in Column HC"; chief examiner concurrence required.