ML22221A048
| ML22221A048 | |
| Person / Time | |
|---|---|
| Site: | Calvert Cliffs  |
| Issue date: | 08/02/2022 |
| From: | Division of Operating Reactors |
| To: | Constellation Energy Group |
| Shared Package | |
| ML21020A064 | List: |
| References | |
| EPID L-2022-OLL-0005 | |
| Download: ML22221A048 (16) | |
Text
Form 2.3-3 Operating Test Review Worksheet (JPMs)
Facility: Calvert Cliffs Exam Date: July 11, 2022 1
JPM # or title 2
Type (S/P/A) 3 ALT (Y/N) 4 LOD (1-5) 5 JPM Errors 6
U/E/S 7
Explanation LOD REF IC TSK CUE CS TL RO Admin 1 - Take the Reactor Critical A
N 2
E Added a 1/M plot key Tolerance on critical step plot points - added a tolerance of +/- 0.05 RO Admin 2 - Verify BAST operability A
N 2
S No comments RO Admin 3 - Determine and Apply Technical Specification Requirements A
N 3
S No comments RO Admin 4 - Perform Duties as Emergency Communicator A
N 2
E Are there ERO passwords we need to avoid retaining in public ADAMS?
Removed password specifics from JPM What is the basis for time critical 10 minutes?
Changed to 15 min to align with ERO basis Bolded the statement to not hit send in multiple places.
Deleted all steps after the hit send step.
Form 2.3-3 Operating Test Review Worksheet (JPMs)
Facility: Calvert Cliffs Exam Date: July 11, 2022 1
JPM # or title 2
Type (S/P/A) 3 ALT (Y/N) 4 LOD (1-5) 5 JPM Errors 6
U/E/S 7
Explanation LOD REF IC TSK CUE CS TL SRO Admin 1 - Verify an Estimated Critical Condition Calculation A
N 3
E Changed how Number 5 of the initiating cue was worded.
SRO Admin 2 - Perform the Initial Review of a Completed STP A
N 2
E No comments SRO Admin 3 -
Determine and Apply Technical Specification Requirements A
N 2
S No comments SRO Admin 4 -
Determine Protective Measures for On-Site Personnel A
N 3
E Corrected minor typo in the initiating cues Changed the time for Job 1 to 55 minutes.
SRO Admin 5 -
Recommend Protective Action Guidelines to Public Officials.
A N
3 E
No comments
N 2
S No comments
- b. SIM-2 Verify Shutdown S
Y 2
E Page 5 step 5 - added that the RED light is lit and added clarifying details about the required keys.
Form 2.3-3 Operating Test Review Worksheet (JPMs)
Facility: Calvert Cliffs Exam Date: July 11, 2022 1
JPM # or title 2
Type (S/P/A) 3 ALT (Y/N) 4 LOD (1-5) 5 JPM Errors 6
U/E/S 7
Explanation LOD REF IC TSK CUE CS TL Sequencer Loads are Operating Page 8 - added an evaluator note about the use of OI-22F.
- c. SIM-3 Shift Pressurizer Level/Pressure Control Channels S
Y 2
E Added in actions for E-33 Alarm Window
- d. SIM-4 Restart RCPs S
N 2
E Added a cue to say that 60 seconds has elapsed.
Deleted reference to starting 12A RCP next.
- e. SIM-5 Ensure Turbine is Tripped S
Y 2
S No comments
- f.
SIM-6 Verify a Recirculation Actuation Signal (RAS)
S Y
3 E
Reworded the cues on page 5.
- g. SIM-7 Nulling NI pots to Delta T Pots S
N 3
S No comments
- h. SIM-8 Discharge 11(12) RCWMT S
N 3
E Added a step to the initial conditions about the RMS VLV interlock being actuated.
Added an evaluator cue on page 4.
Form 2.3-3 Operating Test Review Worksheet (JPMs)
Facility: Calvert Cliffs Exam Date: July 11, 2022 1
JPM # or title 2
Type (S/P/A) 3 ALT (Y/N) 4 LOD (1-5) 5 JPM Errors 6
U/E/S 7
Explanation LOD REF IC TSK CUE CS TL
N 3
E Added clarifying information to the cue for step 2.d.(4).
- b. PLT-2 Slow Speed Start a Diesel Generator P
Y 3
S No comments
N 3
S No comments
Form 2.3-3 Instructions for Completing the JPM Table
- 1. Enter the JPM number and/or title.
- 2. Enter the type of JPM(S)imulator, (P)lant, or (A)dministrative.
- 3. Enter (Y)es or (N)o for an Alternate Path JPM.
- 4. Rate the level of difficulty (LOD) of each JPM using a scale of 1-5 (easy-difficult). A JPM containing less than two critical steps, a JPM that tests solely for recall or memorization, or a JPM that involves directly looking up a single correct answer is likely LOD = 1 (too easy). Conversely, a JPM with over 30 steps or a JPM that takes more than 45 minutes to complete is likely LOD = 5 (too difficult).
- 5. Check the appropriate block for each JPM error type, using the following criteria:
LOD = 1 or 5 is unsatisfactory (U).
REF: The JPM lacks required references, tools, or procedures (U).
IC: The JPM initial conditions are missing or the JPM lacks an adequate initial cue (U).
CUE: The JPM lacks adequate evaluator cues to allow the applicant to complete the task, or the evaluator cues are subjective or leading (U).
TSK: The JPM lacks a task standard or lacks completion criteria for a task standard (U).
CS: The JPM contains errors in designating critical steps, or the JPM lacks an adequate performance standard for a critical step (U).
TL: The JPM validation times are unreasonable, or a time-critical JPM lacks a completion time (U).
- 6. Mark the JPM as unsatisfactory (U), satisfactory (S), or needs enhancements (E). A JPM is (U) if it has one or more (U) errors as determined in step 5. Examples of enhancements include formatting, spelling, or other minor changes.
- 7. Briefly describe any JPM determined to be unsatisfactory (U) or needing enhancement (E). Save initial review comments and detail subsequent comment resolution so that each exam-bound JPM is marked by a satisfactory (S) resolution on this form.
Form 2.3-3 Operating Test Review Worksheet (Scenarios)
Facility: Calvert Cliffs Scenario: 1 (contingency EOP entry)
Exam Date: July 11, 2022 1
Scenario Event ID/Name:
2 Scenario event errors 3
U/E/S 4
Explanation Realism/
Credibility Performance Standards Verifiable Actions Critical Task TS 1
N-SRO R-ATC S
2 C-BOP/SRO TS-SRO S
TS 3
C-BOP/SRO TS-SRO S
TS 4
C-ATC/SRO MC-ATC S
5 C-ATC/SRO S
6 C-ATC/SRO S
CT-1 7
C-ALL S
CT-2 8
C-BOP/SRO MC-BOP S
9 M-ALL S
CT-3 SAT Edits made:
Added admin step to verify 13 SW pump magnets are correct.
Added may electrically realign 13 SW Pump to page 9.
Added comms for the loss of ventilation and MCC-102 on page 6.
Added clarifying details to Event 9 on page 16
Form 2.3-3 Operating Test Review Worksheet (Scenarios)
Facility: Calvert Cliffs Scenario: 2 Exam Date: July 11, 2022 1
Scenario Event ID/Name:
2 Scenario event errors 3
U/E/S 4
Explanation Realism/
Credibility Performance Standards Verifiable Actions Critical Task TS 1
C-ATC/SRO S
2 C-BOP/SRO TS-SRO S
TS 3
C-ATC/SRO MC-ATC S
4 C-BOP/SRO MC-BOP S
5 R-ATC/BOP C-SRO TS-SRO S
TS 6
C-ALL S
CT-1 7
M-ALL S
CT-2, CT-3 SAT Edits made:
Added component names and IDs to critical task bullets requiring isolating the SG.
Form 2.3-3 Operating Test Review Worksheet (Scenarios)
`
Facility: Calvert Cliffs Scenario: Scenario 4 (SPARE, contingency EOP entry)
Exam Date: July 11, 2022 1
Scenario Event ID/Name:
2 Scenario event errors 3
U/E/S 4
Explanation Realism/
Credibility Performance Standards Verifiable Actions Critical Task TS 1
C-BOP/SRO MC-BOP S
2 C-BOP/SRO TS-SRO S
TS 3
R-BOP/ATC C-SRO TS-SRO S
TS 4
C-ALL S
5 C-ATC/SRO MC-ATC S
CT-1 6
C-ALL S
CT-2 7
M-ALL S
CT-3 SAT Edits made:
Added a comm for the fire alarm on the reactor trip.
Form 2.3-3 Instructions for Completing the Scenario Table
- 1. For each scenario, enter the scenario event names and descriptions.
- 2. Review the individual events contained in each scenario, and identify and mark event errors:
The scenario guide event description is not realistic/credibleunsatisfactory (U).
The scenario guide event description lacks adequate crew/operator performance standardsneeds enhancement (E).
The scenario guide event description lacks verifiable actions for a credited normal event, reactivity event instrument/component malfunction, or technical specification (TS) event (or a combination of these) (U).
The scenario guide event description incorrectly designates an event as a critical task (i.e., a noncritical task labeled as critical or a critical task labeled as noncritical). This includes critical tasks that do not meet the critical task criteria (i.e., the critical task does not have a measurable performance standard) (U).
The scenario guide event description incorrectly designates entry into TS actions when not required or does not designate entry into TS actions when required (U).
- 3. Based on the outcome in step 2, mark the scenario event as unsatisfactory (U), satisfactory (S), or needs enhancements (E). An event is (U) if it has one or more (U) errors as determined in step 2. Examples of enhancements include formatting, spelling, or other minor changes.
- 4. Briefly describe any scenario event determined to be unsatisfactory (U) or needing enhancement (E). Save initial review comments and detail subsequent comment resolution so that each exam-bound scenario event is marked by a satisfactory (S) resolution on this form.
Form 2.3-5 Written Examination Review Worksheet Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. K/A Use Flaws
- 6. Source (B/M/N)
- 7. Status (U/E/S)
- 8. Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job Link Minutia
- /Units Logic Q-K/A License Level 1
H 3
B E
Removed Time = 1000 in stem Added for the current conditions after EOP-0.
2 F
1.5 N
E Added PORV is stuck open and not able to be closed to stem 3
F 2
X B
U A is correct as worded. Changed A to say at 300 psia. Rewrote distractor B to ensure it is incorrect.
4 F
2 N
S Original question is minutia (starting duty times), not operationally important. Rewrote question to better match K/A..
Added to plausibility of time 1310 5
H 2
B S
6 H
2 B
S Bolded the word Flow 7
F 3
B S
8 H
3 B
E Added is to stem 9
F 2
N E
Added plausibility statements included. Changed distractors so that B is correct to make distribution on overall exam to be more even. Also added noun names CEDM to distractors.
10 F
2 N
E Earliest pressure setpoint is illogical wording.
Changed to highest Removed "by placing 11 S/G Block and Reset keyswitch, 1-HS-4042 to block.
Changed distractors so that B is correct to make distribution on overall exam to be more even. Also made format changes to make it read better 11 F
3 M
E Bolded location 12 F
3 B
E Shortened stem, combine 1st bullet into stem.
13 F
3 B
E Added a value of Thot t ensure natural circulation exists.
14 H
3 B
S Added K/A justification 2022 Calvert Cliffs Written Exam - NRC written. Administered July 20, 2022.
Form 2.3-5 Written Examination Review Worksheet
`15 H
2 N
S Added plausibility statements and fixed parenthesis issue in distractor D.
16 H
3 B
E Removed Time = 1000
Form 2.3-5 Written Examination Review Worksheet 17 H
3 X
B U
C and D are the same answer. Added ONLY to distractor D to make it incorrect.
18 H
2 N
E could have been is awkward, sounds like a guess.
Changed to A likely leak source would be.
Changed tense of some of the grammar to be consistent.
19 H
3 N
E Stem has window dressing. Removed refueling outage Changed reactor to RPS in part 2 of stem.
20 H
3 N
E B2 and D2 do not follow grammatically. Edited part 2s od B and D to improve grammar 21 F
3 N
E Removed So that the suspension of the reactor startup is not challenged, 22 H
3 N
E Added image/embedded reference Edited question to read like Unit 2 23 F
3 B
S 24 F
3 B
S 25 F
3 B
E Added plausibility to wrong answers A or B Clarified distractor C to avoid possible subset issues.
Added ONLY to distractor C.
26 F
3 B
E Reworded answer A to align better with terminology now used in new EOP/AOP revisions that have removed the term PTS.
27 H
2 B
E Capitalized and bolded minimum 28 H
3 N
E Changed When the limit is violated to If the limit is exceeded Changed order of distractors do that D is correct and to make distribution on exam more even Changed FAC to ultrasonic void inspection to avoid possible correct answer with FAC.
29 H
2 B
E Added that the normal ion exchanger is in service at middle of core life 30 F
3 X
B U
Rewrote question, there is no correct answer. New question is SAT
`31 H
2 B
S Edited plausibility statement 32 F
3 N
E Removed leaking from stem to avoid cueing answer.
Form 2.3-5 Written Examination Review Worksheet 33 H
2 B
S 34 H
2 X
N U
Couldnt write a discriminating question on original K/A.
Redrew K/A and rewrote question. New question SAT.
35 H
2 N
E removed capitalize of Output and combined bullets into a sentence 36 F
2 B
S 37 H
2 B
S 38 F
1.5 B
E Added into containment in stem 39 H
3 X
B U
A is correct as well. Changed distractor A to no effect on sensor logic. Also changed stem to ask effect, if any 40 H
2 B
E 41 H
3 N
S 42 F
2 N
S 43 H
3 B
S 44 F
3 B
E Dont understand plausibility of C - 5.6% open. This is incorrect, changed to 56%
45 F
2 B
E Added AFW alignment conditions into the stem and edited distractors 46 H
3 B
S
`47 H
1.5 N
E Distractor C from 3.71 kV to 3.63 kV because it was very close to being correct.
48 H
3 B
S Changed 7 hours8.101852e-5 days <br />0.00194 hours <br />1.157407e-5 weeks <br />2.6635e-6 months <br /> to 8 hours9.259259e-5 days <br />0.00222 hours <br />1.322751e-5 weeks <br />3.044e-6 months <br /> in distractors B and D. 7 hours8.101852e-5 days <br />0.00194 hours <br />1.157407e-5 weeks <br />2.6635e-6 months <br /> is too close to being correct.
Form 2.3-5 Written Examination Review Worksheet 49 F
3 N
E Changed question from yes/no to running/not running.
Also changed 5 sec to 15 sec in stem to better test K/A.
50 H
3 N
S 51 H
3 B
S 52 H
3 B
S 53 H
3 B
E This dives into TS bases. Is this RO level?
Reworded to ensure above the line knowledge. Also removed with he following conditions 54 F
2 B
S 55 H
3 M
E Changed reading on scale from 110 to 125 to align better with the band expected in AOP 9A 56 F
2 X
N U
Answer is incorrect, temperature fails low, not high.
Edited distractor A to ensure A is correct (fails low).
57 H
3 B
S 58 F
2 B
E Added noun name to 2-RI-5316.
Wrong alarm window - edited alarm window Changed grammar of deistractors to capture status of fuel movement.
59 H
3 B
E Edited to combine last two statements in stem as one sentence. Stem edited for efficiency.
60 H
2 N
E Deleted aggressive and edited stem 61 F
3 B
S Changed tanks in stem to normal tank (RCWMT) 62 H
2 B
S
`63 F
3 B
S 64 F
2 B
S 65 H
3 B
S 66 F
2 B
E Removed question mark and edited violated to exceeded.
Form 2.3-5 Written Examination Review Worksheet 67 F
3 N
S 68 F
2 X
B U
Good question but too system specific for Tier 3.
Redrew K/A and selected a new bank question.
69 H
3 B
S 70 F
2 N
E Tier 4 - added to stem for more operationally valid information 71 H
3 B
E Tier 4, edited increase/decrease to rises/lowers.
Added to stem for more operationally valid information 72 F
2 X
N U
Tier 4, C1 and D1 are correct per wording in the stem.
Reworded stem from reactor is critical to reactor has now become critical. Also removed following a change in power in C1 and D1.
73 H
3 N
S Tier 4 - changed valve to 1RV200, had the wrong component ID in draft version.
Also changed increase to rise 74 F
3 B
S Tier 4. - added to stem for more operationally valid information 75 F
3 B
S Tier 4 76 H
2 B
E Added conditions in the stem to indicate that an event has occurred.
77 H
3 B
E Edited 2nd bullet. Removed -2 on AOP-3B 78 H
2 B
E Overlap with 89. Changed this question to text AOP-7C instead pf AOP-2A 79 H
3 B
S SRO level justification added 80 H
2 B
E Added use per AOP-7J. On second bullet, changed it to describe actions taken and added 3rd bullet.
`81 H
3 X
B U
Removed 4th bullet. Added statement on using reference. Also changed distractor from 7 days to 14 days because 7 days could be argued correct.
82 H
2 X
N U
Subset - Alert has to be declared by 1020 also.
Reworded stem to say latest time to declare..
83 H
3 B
S 84 H
2 B
S 85 H
3 B
E Changed 12 gpm to 25 gpm because flow meter could be showing 12 gpm due to noise.
Form 2.3-5 Written Examination Review Worksheet 86 H
3 N
E changed 'Both' to 'ALL CC Pumps" 87 F
2 N
E Removed 2nd bullet and note, also improved grammar in stem.
88 F
3 N
E Added SRO justification - question tests below line knowledge/surveillance details 89 F
2 N
E Reworded A to match terminology in procedure 90 H
3 B
S 91 H
3 N
E Added SRO justification 92 H
3 N
S EOP revision has now made all part 2s of distractors incorrect. Changed part 2s of distractors to 4% and 8%.
Also added to part (2) of stem maximum allowable when referring to hydrogen concentration.
93 H
2 N
E Rewrote as a 2x2 question. Question deals with TS bases knowledge is required to answer question.
Added SRO justification.
94 F
3 X
N U
Not a discriminating SRO level K/A. Question is minutia.
Redraw K/A and replaced with question with #97 since question matched K/A better.
95 F
2 B
S 96 F
3 N
S 97 F
3 X
B U
K/A mismatch - doesnt test ability to manipulate console controls. This K/A is more suited for ROs.
Question is good and SRO level. - moved this question to #94.
Rewrote new question and redrew K/A
`98 H
3 B
S 99 F
2 N
E Edited A2 and C2 because original version could be correct.
Added location 5 East Pen Room to better align with procedural instruction that operators would use.
Locations are given in procedure.
100 F
3 B
E Edited distractor D from classification to notification since classification cannot be delegated.