ML22221A048
| ML22221A048 | |
| Person / Time | |
|---|---|
| Site: | Calvert Cliffs  |
| Issue date: | 08/02/2022 |
| From: | Division of Operating Reactors |
| To: | Constellation Energy Group |
| Shared Package | |
| ML21020A064 | List: |
| References | |
| EPID L-2022-OLL-0005 | |
| Download: ML22221A048 (16) | |
Text
Form 2.3-3 Operating Test Review Worksheet (JPMs)
Facility: Calvert Cliffs Exam Date: July 11, 2022
2 3 4 5 6 1 Type ALT LOD JPM Errors U/E/S 7 JPM # or title (S/P/A) (Y/N) (1-5) LOD REF IC TSK CUE CS TL Explanation
RO Admin 1 - Take the Added a 1/M plot key Reactor Critical A N 2 E Tolerance on critical step plot points - added a tolerance of +/ - 0.05 RO Admin 2 - Verify No comments BAST operability A N 2 S
RO Admin 3 - Determine No comments and Apply Technical Specification A N 3 S Requirements
RO Admin 4 - Perform Are there ERO passwords we need to avoid Duties as Emergency retaining in public ADAMS?
Communicator - Removed password specifics from JPM
A N 2 E What is the basis for time critical 10 minutes?
- Changed to 15 min to align with ERO basis Bolded the statement to not hit send in multiple places.
Deleted all steps after the hit send step.
Form 2.3-3 Operating Test Review Worksheet (JPMs)
Facility: Calvert Cliffs Exam Date: July 11, 2022
2 3 4 5 6 1 Type ALT LOD JPM Errors U/E/S 7 JPM # or title (S/P/A) (Y/N) (1-5) LOD REF IC TSK CUE CS TL Explanation
SRO Admin 1 - Verify an Changed how Number 5 of the initiating cue Estimated Critical A N 3 E was worded.
Condition Calculation SRO Admin 2 - Perform No comments the Initial Review of a A N 2 E Completed STP SRO Admin 3 - No comments Determine and Apply A N 2 S Technical Specification Requirements SRO Admin 4 -
- Crected minor typithe itiing cu Determine Protective A N 3 E
- Changed the time for Job 1 to 55 minutes.
Measures for On-Site Personnel SRO Admin 5 - No comments Recommend Protective A N 3 E Action Guidelines to Public Officials.
- b. SIM-2 Verify
- Pstep tt the RED light Shutdown S Y 2 E is lit added clarifyindetls a the rrekeys.
Form 2.3-3 Operating Test Review Worksheet (JPMs)
Facility: Calvert Cliffs Exam Date: July 11, 2022
2 3 4 5 6 1 Type ALT LOD JPM Errors U/E/S 7 JPM # or title (S/P/A) (Y/N) (1-5) LOD REF IC TSK CUE CS TL Explanation
Sequencer Loads
- P added an evu notout are Operating the OI -22F.
M -3 ift Added iactions f E-33 Alm Winw Pssuze S Y 2 E Lev/Press Contr Chnels
M -4 Restart RC
- Added cue ts that sonds s S N 2 E sed.
- Deleted reference to starting 12A RCP next.
- e. SIM-5 Ensure No comments Turbine is Tripped S Y 2 S
- f. SIM-6 Verify a Reworded the cues on page 5.
Recirculation S Y 3 E Actuation Signal (RAS)
- g. SIM-7 Nulling NI pots No comments to Delta T Pots S N 3 S
- h. SIM-8 Discharge
- Added step tthe iti ctis 11(12) RCWMT E about the RMS V ilk bng S N 3 tuate
- Added an evuat cue opage Form 2.3-3 Operating Test Review Worksheet (JPMs)
Facility: Calvert Cliffs Exam Date: July 11, 2022
2 3 4 5 6 1 Type ALT LOD JPM Errors U/E/S 7 JPM # or title (S/P/A) (Y/N) (1-5) LOD REF IC TSK CUE CS TL Explanation
- a. PLT -1 Locally Control Added clarifying information to the cue for AFW flow during P N 3 E step 2.d.(4).
- b. PLT -2 Slow Speed No comments Start a Diesel P Y 3 S Generator
Form 2.3-3 Instructions for Completing the JPM Table
- 1. Enter the JPM number and/or title.
- 2. Enter the type of JPM (S)imulator, (P)lant, or (A)dministrative.
- 3. Enter (Y)es or (N)o for an Alternate Path JPM.
- 4. Rate the level of difficulty (LOD) of each JPM using a scale of 1-5 (easy-difficult). A JPM containing less than two critical steps, a JPM that tests solely for recall or memorization, or a JPM that involves directly looking up a single correct answer is lik ely LOD = 1 (too easy). Conversely, a JPM with over 30 steps or a JPM that takes more than 45 minutes to complete is likely LOD = 5 (too difficult).
- 5. Check the appropriate block for each JPM error type, using the following criteria:
- LOD = 1 or 5 is unsatisfactory (U).
- REF: The JPM lacks required references, tools, or procedures (U).
- CUE: The JPM lacks adequate evaluator cues to allow the applicant to complete the task, or the evaluator cues are subjective or leading (U).
- TSK: The JPM lacks a task standard or lacks completion c riteria for a task standard (U).
- CS: The JPM contains errors in designating critical steps, or the JPM lacks an adequate performance standard for a critical step (U).
- 6. Mark the JPM as unsatisfactory (U), satisfactory (S), or needs enhancements (E). A JPM is (U) if it has one or more (U) errors as determined in step 5. Examples of enhancements include formatting, spelling, or other minor changes.
- 7. Briefly describe any JPM determined to be unsatisfactory (U) or needing enhancement (E). Save initial review comments and detail subsequent comment resolution so that each exam -bound JPM is marked by a satisfactory (S) resolution on this form.
Form 2.3-3 Operating Test Review Worksheet (Scenarios)
Facility: Calvert Cliffs Scenario: 1 Exam Date: July 11, 2022 (contingency EOP entry) 2 1 Scenario event errors 3 4 Scenario Event Realism/ Performance Verifiable Critical Task TS U/E/S Explanation ID/Name: Credibility Standards Actions 1 N-SRO S R-ATC 2 C-BOP/SRO S TS TS-SRO 3 C-BOP/SRO S TS TS-SRO 4 C-ATC/SRO S MC-ATC 5 C-ATC/SRO S
6 C-ATC/SRO S CT-1
7 C-ALL S CT-2
8 C-BOP/SRO S MC-BOP 9 M-ALL S CT-3
Edits made:
- Added admin step to verify 13 SW pump magnets are correct.
- Added comms for the loss of ventilation and MCC-102 on page 6.
- Added clarifying details to Event 9 on page 16
Form 2.3-3 Operating Test Review Worksheet (Scenarios)
Facility: Calvert Cliffs Scenario: 2 Exam Date: July 11, 2022
2 1 Scenario event errors 3 4 Scenario Event Realism/ Performance Verifiable Critical Task TS U/E/S Explanation ID/Name: Credibility Standards Actions 1 C-ATC/SRO S
2 C-BOP/SRO S TS TS-SRO 3 C-ATC/SRO S MC-ATC 4 C-BOP/SRO S MC-BOP 5 R-ATC/BOP TS C-SRO S
TS-SRO 6 C-ALL S CT-1
7 M-ALL S CT-2, CT-3
Edits made:
SAT Added component names and IDs to critical task bullets requiring isolating the SG.
Form 2.3-3 Operating Test Review Worksheet (Scenarios)
Facility: Calvert Cliffs Scenario: Scenario 4 (SPARE, Exam Date: July 11, 2022 contingency EOP entry)
2 1 Scenario event errors 3 4 Scenario Event Realism/ Performance Verifiable Critical Task TS U/E/S Explanation ID/Name: Credibility Standards Actions 1 C-BOP/SRO S MC-BOP 2 C-BOP/SRO S TS TS-SRO 3 R-BOP/ATC TS C-SRO S TS-SRO 4 C-ALL S
5 C-ATC/SRO S CT-1 MC-ATC 6 C-ALL S CT-2
7 M-ALL S CT-3
Edits made:
SAT Added a comm for the fire alarm on the reactor trip.
`
Form 2.3-3 Instructions for Completing the Scenario Table
- 1. For each scenario, enter the scenario event names and descriptions.
- 2. Review the individual events contained in each scenario, and identify and mark event errors:
- The scenario guide event description is not realistic/credible unsatisfactory (U).
- The scenario guide event description lacks adequate crew/operator performance standards needs enhancement (E).
- The scenario guide event description lacks verifiable actions for a credited normal event, reactivity event instrument/component malfunction, or technical specification (TS) event (or a combination of these) (U).
- The scenario guide event description incorrectly designates an event as a critical task (i.e., a noncritical task labeled as critical or a critical task labeled as noncritical). This includes critical tasks that do not meet the critical task criteria (i.e., the critical task does not have a measurable performance standard) (U).
- The scenario guide event description incorrectly designates entry into TS actions when not required or does not designate entry into TS actions when required (U).
- 3. Based on the outcome in step 2, mark the scenario event as unsatisfactory (U), satisfactory (S), or needs enhancements (E). An event is (U) if it has one or more (U) errors as determined in step 2. Examples of enhancements include formatting, spelling, or other minor changes.
- 4. Briefly describe any scenario event determined to be unsatisfactory (U) or needing enhancement (E). Save initial review comments and detail subsequent comment resolution so that each exam -bound scenario event is marked by a satisfactory (S) resolution on this form.
Form 2.3-5 Written Examination Review Worksheet 2022 Calvert Cliffs Written Exam - NRC written. Administered July 20, 2022.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. K/A Use Flaws 6. Source7. Status Q# LOK LOD Stem (B/M/N) (U/E/S) 8. Explanation (F/H) (1-5) Focus Cues T/F Cred. Dist. Partial Job Link Minutia #/Units Logic Q-K/A License Level
1 H 3 B E Removed Time = 1000 in stem Added for the current conditions after EOP -0.
2 F 1.5 N E Added PORV is stuck open and not able to be closed to stem
3 F 2 X B U A is correct as worded. Changed A to say at 300 psia. Rewrote distractor B to ensure it is incorrect.
Original question is minutia (starting duty times), not operationally important. Rewrote question to better 4 F 2 N S match K/A..
Added to plausibility of time 1310
5 H 2 B S
6 H 2 B S Bolded the word Flow
7 F 3 B S
8 H 3 B E Added is to stem
Added plausibility statements included. Changed distractors so that B is correct to make distribution on 9 F 2 N E overall exam to be more even. Also added noun names CEDM to distractors.
Earliest pressure setpoint is illogical wording.
Changed to highest Removed "by placing 11 S/G Block and Reset 10 F 2 N E keyswitch, 1-HS-4042 to block.
Changed distractors so that B is correct to make distribution on overall exam to be more even. Also made format changes to make it read better
11 F 3 M E Bolded location
12 F 3 B E Shortened stem, combine 1st bullet into stem.
13 F 3 B E Added a value of Thot t ensure natural circulation exists.
14 H 3 B S Added K/A justification Form 2.3-5 Written Examination Review Worksheet
`15 H 2 N S Added plausibility statements and fixed parenthesis issue in distractor D.
16 H 3 B E Removed Time = 1000 Form 2.3-5 Written Examination Review Worksheet
17 H 3 X B U C and D are the same answer. Added ONLY to distractor D to make it incorrect.
could have been is awkward, sounds like a guess.
Changed to A likely leak source would be.
18 H 2 N E Changed tense of some of the grammar to be consistent.
Stem has window dressing. Removed refueling 19 H 3 N E outage Changed reactor to RPS in part 2 of stem.
20 H 3 N E B2 and D2 do not follow grammatically. Edited part 2s od B and D to improve grammar 21 F 3 N E Removed So that the suspension of the reactor startup is not challenged, Added image/embedded reference 22 H 3 N E Edited question to read like Unit 2
23 F 3 B S
24 F 3 B S
Added plausibility to wrong answers A or B 25 F 3 B E Clarified distractor C to avoid possible subset issues.
Added ONLY to distractor C.
Reworded answer A to align better with terminology 26 F 3 B E now used in new EOP/AOP revisions that have removed the term PTS.
27 H 2 B E Capitalized and bolded minimum
Changed When the limit is violated to If the limit is exceeded
28 H 3 N E Changed order of distractors do that D is correct and to make distribution on exam more even
Changed FAC to ultrasonic void inspection to avoid possible correct answer with FAC.
29 H 2 B E Added that the normal ion exchanger is in service at middle of core life
30 F 3 X B U Rewrote question, there is no correct answer. New question is SAT
`31 H 2 B S Edited plausibility statement
32 F 3 N E Removed leaking from stem to avoid cueing answer.
Form 2.3-5 Written Examination Review Worksheet
33 H 2 B S
Couldnt write a discriminating question on original K/A.
34 H 2 X N U Redr ew K/A and rewrote question. New question SAT.
35 H 2 N E removed capitalize of Output and combined bullets into a sentence
36 F 2 B S
37 H 2 B S
38 F 1.5 B E Added into containment in stem
A is correct as well. Changed distractor A to no effect 39 H 3 X B U on sensor logic. Also changed stem to ask effect, if any
40 H 2 B E
41 H 3 N S
42 F 2 N S
43 H 3 B S
44 F 3 B E Dont understand plausibility of C - 5.6% open. This is incorrect, changed to 56%
45 F 2 B E Added AFW alignment conditions into the stem and edited distractors
46 H 3 B S
`47 H 1.5 N E Distractor C from 3.71 kV to 3.63 kV because it was very close to being correct.
48 H 3 B S Changed 7 hours8.101852e-5 days <br />0.00194 hours <br />1.157407e-5 weeks <br />2.6635e-6 months <br /> to 8 hours9.259259e-5 days <br />0.00222 hours <br />1.322751e-5 weeks <br />3.044e-6 months <br /> in distractors B and D. 7 hours8.101852e-5 days <br />0.00194 hours <br />1.157407e-5 weeks <br />2.6635e-6 months <br /> is too close to being correct.
Form 2.3-5 Written Examination Review Worksheet
Changed question from yes/no to running/not running.
49 F 3 N E Also changed 5 sec to 15 sec in stem to better test K/A.
50 H 3 N S
51 H 3 B S
52 H 3 B S
This dives into TS bases. Is this RO level?
53 H 3 B E Reworded to ensure above the line knowledge. Also removed with he following conditions
54 F 2 B S
55 H 3 M E Changed reading on scale from 110 to 125 to align better with the band expected in AOP 9A
56 F 2 X N U Answer is incorrect, temperature fails low, not high. Edited distractor A to ensure A is correct (fails low).
57 H 3 B S
Added noun name to 2-RI-5316.
58 F 2 B E Wrong alarm window - edited alarm window
Changed grammar of deistractors to capture status of fuel movement.
59 H 3 B E Edited to combine last two statements in stem as one sentence. Stem edited for efficiency.
60 H 2 N E Deleted aggressive and edited stem
61 F 3 B S Changed tanks in stem to normal tank (RCWMT)
62 H 2 B S
`63 F 3 B S
64 F 2 B S
65 H 3 B S
66 F 2 B E Removed question mark and edited violated to exceeded.
Form 2.3-5 Written Examination Review Worksheet
67 F 3 N S
Good question but too system specific for Tier 3.
68 F 2 X B U Redrew K/A and selected a new bank question.
69 H 3 B S
70 F 2 N E Tier 4 - added to stem for more operationally valid information
71 H 3 B E Tier 4, edited increase/decrease to rises/lowers.
Added to stem for more operationally valid information Tier 4, C1 and D1 are correct per wording in the stem.
72 F 2 X N U Reworded stem from reactor is critical to reactor has now become critical. Also removed following a change in power in C1 and D1.
Tier 4 - changed valve to 1RV200, had the wrong 73 H 3 N S component ID in draft version.
Also changed increase to rise
74 F 3 B S Tier 4. - added to stem for more operationally valid information
75 F 3 B S Tier 4
76 H 2 B E Added conditions in the stem to indicate that an event has occurred.
77 H 3 B E Edited 2nd bullet. Removed -2 on AOP-3B
78 H 2 B E Overlap with 89. Changed this question to text AOP -7C instead pf AOP-2A
79 H 3 B S SRO level justification added
80 H 2 B E Added use per AOP -7J. On second bullet, changed it to describe actions taken and added 3 rd bullet.
Removed 4th bullet. Added statement on using
`81 H 3 X B U reference. Also changed distractor from 7 days to 14 days because 7 days could be argued correct.
82 H 2 X N U Subset - Alert has to be declared by 1020 also.
Reworded stem to say latest time to declare..
83 H 3 B S
84 H 2 B S.
85 H 3 B E Changed 12 gpm to 25 gpm because flow meter could be showing 12 gpm due to noise.
Form 2.3-5 Written Examination Review Worksheet
86 H 3 N E changed 'Both' to 'ALL CC Pumps"
87 F 2 N E Removed 2nd bullet and note, also improved grammar in stem.
88 F 3 N E Added SRO justification - question tests below line knowledge/surveillance details
89 F 2 N E Reworded A to match terminology in procedure
90 H 3 B S
91 H 3 N E Added SRO justification
EOP revision has now made all part 2s of distractors incorrect. Changed part 2s of distractors to 4% and 92 H 3 N S 8%.
Also added to part (2) of stem maximum allowable when referring to hydrogen concentration.
93 H 2 N E Rewrote as a 2x2 question. Question deals with TS bases knowledge is required to answer question.
Added SRO justification.
Not a discriminating SRO level K/A. Question is minutia.
94 F 3 X N U Redraw K/A and replaced with question with #97 since question matched K/A better.
95 F 2 B S
96 F 3 N S
K/A mismatch - doesnt test ability to manipulate console controls. This K/A is more suited for ROs.
97 F 3 X B U Question is good and SRO level. - moved this question to #94.
Rewrote new question and redrew K/A
`98 H 3 B S
Edited A2 and C2 because original version could be correct.
99 F 2 N E Added location 5 East Pen Room to better align with procedural instruction that operators would use.
Locations are given in procedure.
100 F 3 B E Edited distractor D from classification to notification since classification cannot be delegated.