ML22342B260
| ML22342B260 | |
| Person / Time | |
|---|---|
| Site: | Grand Gulf |
| Issue date: | 10/14/2022 |
| From: | Heather Gepford Operations Branch IV |
| To: | Entergy Operations |
| References | |
| Download: ML22342B260 (1) | |
Text
EXAM ASSIGNMENT TICKLER Chief: Clyde Osterholtz Facility: GG Date of Written Exam: 10/17/2022 U/I: Start of Op Test: 10/10/2022 End of Op Test: 10/15/2022 Written Exam Developed By: NRC / Facility Operating Test Developed By: NRC / Facility Due Date Description Date Complete Initials Notes For NRC prepared exams, arrangements made 2/7/2022 Examination administration date confirmed 12/8/2021 cco for the facility to submit reference materials 3/14/2022 NRC examiners and facility contact assigned 12/8/2022 cco 3/14/2022 Facility contact briefed on security and other requirements 12/8/2022 cco 3/14/2022 Reference material due for NRC prepared exams N/A ES-201 Att-3 3/14/2022 Corporate Notification Letter sent 12/8/2022 cco ES-201 Att-4 produced by CE 3/28/2022 NRC developed written examination outline sent to facility contact 12/8/2022 cco ES-401-1/2 and ES-401-3 5/9/2022 Operating test outline(s) and other checklists due 5/6/2022 cco ES-201-2, 201-3, 301-1, 301-2, 301-5, D-1 Operating test outline(s) reviewed by NRC and feedback 5/23/2022 provided to facility licensee 5/19/2022 cco ES-201-2 signed by CE & BC Proposed exams, outlines, supporting documentation, and Exams prepared by the NRC are approved by 7/25/2022 reference materials due. 7/7/2022 cco BC and forwarded for facility licensee review 8/1/2022 Peer review of written exam complete N/A cco Document review on ES-401-9 8/22/2022 Written exam and operating test reviews completed 8/19/2022 cco Document review on ES-401-9 9/5/2022 Feedback approved by Branch Chief 9/5/2022 cco Examination review results discussed between NRC and facility 9/5/2022 licensee 9/5/2022 cco 9/12/2022 Preliminary license applications & waiver/excusal requests due 9/12/2022 cco NRC Forms 398/396 9/12/2022 On-site validation & 10% audit of license applications 9/12/2022 cco 9/19/2022 Preliminary license applications and waivers reviewed 9/12/2022 cco 9/26/2022 Final license applications & waiver/excusal requests due 9/26/2022 cco ES-201-4 prepared by LA 10/3/2022 Written exams and operating tests approved by Branch Chief 9/29/2022 cco 10/3/2022 Request facility licensee management feedback on the exam 9/29/2022 cco Final applications reviewed and audited; exam approval and LA produces / BC signs Exam Approval Letter 10/3/2022 waiver/excusal letters sent 9/30/2022 cco (ES-201 Att-5)
Proctoring/written exam administration guidelines reviewed with 10/3/2022 facility licensee 9/30/2022 cco 10/3/2022 Approved scenarios and JPMs distributed to examiners 9/30/2022 cco 10/10/2022 Administer Operating Test 10/10/2022 cco 10/22/2022 Examiner's document op test results on ES 303's 11/7/2022 cco 11/6/2022 Post exam comments and graded exams received 11/7/2022 cco ES-403-1 to BC Post exam written comments reviewed and incorporated and 11/14/2022 NRC grading completed 11/7/2022 cco Post exam operating test comments reviewed and ES-303-1 11/14/2022 updated 11/7/2022 cco Chief examiner review of operating test and/or written exam 11/21/2022 grading completed 11/8/2022 cco Signed ES 303's to BC 11/28/2022 Branch Chief review of exam results completed 12/6/2022 cco 12/5/2022 Waivers/deferrals reviewed for impact on licensing decision 12/6/2022 cco 12/5/2022 License/Proposed Denial letters mailed; Facility notified of results 12/6/2022 cco 12/5/2022 RPS/IP number of examinees updated 12/6/2022 cco print Report-21 12/26/2022 Final Denial Letters mailed (if no request for informal review) N/A 21 days after proposed denial letters mailed.
1/2/2023 Examination Report Issued by 1/5/2023 cco produced by CE 1/9/2023 Ref Mat'l Returned after Final Resolution of Appeals N/A 2/6/2023 SUNSI checklist complete and exam docs to ADAMS N/A SUNSI checklist to LA Replaces NUREG-1021, Revision 11, Forms ES-201-1 and ES-501-1 Rev. 9
password es1021 Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Clyde C. Osterholtz/ 5/18/2022 Clyde C. Osterholtz/ 5/18/2022 Heather J. Gepford 5/19/22
Form 2.3-4 Written Examination Quality Checklist Facility: Grand Gulf Nuclear Station Date of Exam: October 17, 2022 Exam Level: RO SRO (Y)es / (N)o Item Description a b* c#
- 1. Questions and answers are technically accurate and applicable to the facility. Each question includes a technical reference. y i y
- 2. a. All questions reference NRG knowledge and abilities(KIAs) requirements.
- b. Facility learning objectives are referenced as available.
- c. All questions include an explanation of the correct answer explanation and a distractor analvsis.
y y y
- 4. The sampling process was random and systematic. (If more than four reactor operator(RO) or two SRO questions were repeated from the last two NRG licensing exams, including full (100-question) retake examinations, consult the NRG Office of Nuclear Reactor Regulation 'I 1 y operator licensinq program office.)
- 5. Question duplication from the licensee screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:
y y
_ The audit exam was systematically and randomly developed.
_ The audit exam was completed before the license exam was started. y
_ The examinations were developed independently.
{._ The licensee certifies that there is no duplication.
Other (explain):
Bank Modified New Bank use meets limits(no more than 75% from the bank, at least v
6.
10% new(at the comprehension/analysis level), and the rest new 51 7.
or modified); enter the actual RO/SRO-only question distribution >
Between 38 and 45 questions of the questions on the RO exam 23/30.6%
1/ 1.3% 68%
y y Memory C/A and at least 13 of the questions on the SRO-only portion of the exam are written at the comprehension/analysis level; enter the actual RO/SRO-only question distribution > 33/ 44% 42/ 56%
y y y
- 8. References/handouts provided do not give away answers or aid in the elimination of distractors.
'{ 'I y
- 9. Question content conforms to specific KIA statements in the previously approved examination outline and is appropriate for the KIA statements' assiqned tier; deviations are justified. V y y
- 10. Question psychometric quality and format meet the instructions and guidelines in ES-4.2.
'/ 'I y
- 11. The exam contains the required number of one-point, multiple-choice items; the total is correct and agrees with the value on the cover sheet.
Printed Name/ ure y
Date
'I y t:;;;,,
R..j
/p-/
- a. Author le_ P..P,,oS / .LIL I) c, z,2-
- b. Facility Reviewer(*) -1:*,.,,",,
- W 1ta!,*AI lv '1/1.1/l 1.
- c. NRG Reviewer(#) Clyde Osterholtz 9/28/2022 NRG Chief Examiner Clyde Osterholtz 9/28/2022 NRG Regional Supervisor Heather Gepford 9/30/22
- The facility licensee signature is not applicable for NRG-developed tests.
- An independent NRG reviewer performs steps in column c. This may be the NRG Chief Examiner if he/she did not develop the written examination under review.
y y
y y
y y
y y
y y
y Clyde Osterholtz 9/28/2022 Clyde Osterholtz 9/28/2022 Heather Gepford 9/30/22
Form 2.3-2 Operating Test Quality Checklist
- a. Each job performance measure (JPM) includes the following, as applicable:
- task standard
- initial conditions
- initiating cues
- references and tools, including associated procedures i1 reasonable and validated time limits (average time allowed for completion) and specific designation if the facility licensee deems it to be time critical
- alternate path JPMs are labeled as "alternate path" y
- operationally important specific performance criteria that include the following:
- detailed expected actions with exact criteria and nomenclature
- system response and other examiner cues
- statements describing important observations to be made by the applicant
- criteria for successful completion of the JPM task standard identification of critical steps and their associated performance standards
- restrictions on the sequence of steps, if aoolicable
- b. Ensure that any changes from the previously approved JPM outlines (Forms 3.2-1 and 3.2-2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last two NRC examinations) specified on those forms.
yy y Simulator Scenario Set Criteria for Scenario Numbers: 1 / 2 / 3 QUALITATIVE ATTRIBUTES
- 1. The initial conditions are realistic in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events. y 1 y
- 2. The scenarios consist mostly of related events. '( '/ y
- 3. Each event description consists of the following:
f 1 the point in the scenario when it is to be initiated
- the malfunction(s) or conditions that are entered to initiate the event y
- the symptoms/cues that will be visible to the crew
- the expected operator actions (by shift position)
- the event termination point (if applicable)
(Y)es / (N)o QUALITATIVE ATTRIBUTES (continued) a b* c#
- 4. The events are valid with regard to physics and thermodynamics. y '/ y
- 5. The sequencing and timing of events is reasonable and allows the examination team to observe and evaluate applicant performance. y y y
- 6. If time compression techniques are used, the scenario summary clearly so indicates.
Operators have sufficient time to carry out expected activities without undue time constraints. Cues are given.
f y y
- 7. The simulator modeling is not altered. '-I y y
- 8. The scenarios have been validated. Pursuant to 10 CFR 55.46(d}, any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to y y ensure that functional fidelity is maintained while running the planned scenarios.
- 9. Scenarios are new or significantly modified in accordance with ES-3.4. '( y y
y y
y y
y y
y y
y Clyde Osterholtz 9/29/2022 Clyde Osterholtz 9/29/2022 Heather Gepford 9/30/22
Form 3.4-1 Events and Evolutions Checklist Facility: GRAND GULF NUCLEAR Date of Exam: 10/10/2022 Operating Test No.:GGNS-2022 E Scenarios A V M P E I P N 1 2 3 4 T N L T O I I T M C T POSITION POSITION POSITION POSITION A U
A Y L S A B S A B S A B S A B M*
N P R T O R T O R T O R T O T E O C P O C P O C P O C P RO I U RO RX 1 1 1 1 0 NOR 1 1 2 1 1 1 SRO-I I/C 3 3 6 4 4 2 SRO-U MAJ 2 1 3 2 2 1 Man. Ctrl 2 1 3 1 1 0 TS 0 2 2 RX 1 1 1 1 0 RO NOR 1 1 2 1 1 1 SRO-I I/C 3 3 6 4 4 2 MAJ 2 1 3 2 2 1 SRO-U Man. Ctrl 1 2 3 1 1 0 TS 0 2 2 RO RX 1 1 2 1 1 0 NOR 2 1 3 1 1 1 SRO-I I/C 6 3 9 4 4 2 SRO-U MAJ 2 1 3 2 2 1 Man. Ctrl 3 1 4 1 1 0 TS 2 2 0 2 2 RO RX 1 1 1 1 0 NOR 2 1 3 1 1 1 SRO-I I/C 6 3 9 4 4 2 SRO-U MAJ 2 1 3 2 2 1 Man. Ctrl 3 2 5 1 1 0 TS 2 2 0 2 2 RO RX 1 1 1 1 0 NOR 2 2 1 1 1 SRO-I I/C 6 6 4 4 2 SRO-U MAJ 2 2 2 2 1 Man. Ctrl 3 3 1 1 0 TS 2 2 0 2 2
Form 3.4-1 Events and Evolutions Checklist Facility: GRAND GULF NUCLEAR Date of Exam: 10/10/2022 Operating Test No.:GGNS-2022 E Scenarios A V M P E I P N 1 2 3 4 T N L T O I I T M C T POSITION POSITION POSITION POSITION A U
A Y L S A B S A B S A B S A B M*
N P R T O R T O R T O R T O T E O C P O C P O C P O C P RO I U RO RX 1 1 1 1 0 NOR 1 2 3 1 1 1 SRO-I I/C 3 6 9 4 4 2 SRO-U MAJ 2 1 3 2 2 1 Man. Ctrl 2 3 5 1 1 0 TS 2 2 0 2 2 RX 1 1 2 1 1 0 RO NOR 1 2 3 1 1 1 SRO-I I/C 3 6 9 4 4 2 MAJ 2 1 3 2 2 1 SRO-U Man. Ctrl 1 3 4 1 1 0 TS 2 2 0 2 2
IP 21 Operator Licensing Exam Schedule From 01/01/2022 to 12/31/2022 Phase Code: 2 - Construction, 5 - Operational Region: 4
- Candidates Exam Site / Docket # / Insp Rpt # RO LSRO SROI SROU Type Exam Author Chief Examiner Examiners Assigned Week 09/11/2022 Grand Gulf / 05000416 / 2022301 FB-OR- Osterholtz, Clyde Hernandez,Nick CAC #: 000956 ONSITE Kirkland,John VALIDATI Murphy,Kevin ON OF Osterholtz,Clyde INITIAL You,David LICENSE EXAMIN ATION (OV) 10/09/2022 Grand Gulf / 05000416 / 2022301 4 0 7 1 FB-OR- NFF Osterholtz, Clyde Hernandez,Nick CAC #: 000500 INITIAL Kirkland,John LICENSE Murphy,Kevin EXAM Osterholtz,Clyde ADMINIS You,David TRATION (EXAD)
Sites: GG Orgs: ALL Exam Author: ALL Activity Codes: EXAD, NEXAD, NOV, OV 11/16/2022 1:14:50 PM Page 1 of 4
IP 21 Operator Licensing Exam Schedule From 01/01/2022 to 12/31/2022 Phase Code: 2 - Construction, 5 - Operational Region: 4 Summary by Date RO SROI SROU LSRO Total 10/2022 4 7 1 0 12 Sites: GG Orgs: ALL Exam Author: ALL Activity Codes: EXAD, NEXAD, NOV, OV 11/16/2022 1:14:50 PM Page 2 of 4
IP 21 Operator Licensing Exam Schedule From 01/01/2022 to 12/31/2022 Phase Code: 2 - Construction, 5 - Operational Region: 4 Summary by Site RO SROI SROU LSRO Total Grand Gulf 4 7 1 0 12 Sites: GG Orgs: ALL Exam Author: ALL Activity Codes: EXAD, NEXAD, NOV, OV 11/16/2022 1:14:50 PM Page 3 of 4
IP 21 Operator Licensing Exam Schedule From 01/01/2022 to 12/31/2022 Phase Code: 2 - Construction, 5 - Operational Region: 4 Summary by Region RO SROI SROU LSRO Total Region 4 4 7 1 0 12 Sites: GG Orgs: ALL Exam Author: ALL Activity Codes: EXAD, NEXAD, NOV, OV 11/16/2022 1:14:50 PM Page 4 of 4