ML051030151: Difference between revisions

From kanterella
Jump to navigation Jump to search
(StriderTol Bot insert)
 
(StriderTol Bot change)
 
Line 15: Line 15:


=Text=
=Text=
{{#Wiki_filter:To:           Todd Fish, Chief Examiner From:         Phil Nielsen, Peach Bottom Regulatory Exam Author
{{#Wiki_filter:To:
Todd Fish, Chief Examiner From:
Phil Nielsen, Peach Bottom Regulatory Exam Author  


==Subject:==
==Subject:==
Adjustments to Peach Bottom Operating Exam Materials for the February 2005 Initial NRC Examination.
Adjustments to Peach Bottom Operating Exam Materials for the February 2005 Initial NRC Examination.
The following materials received modifications resulting from comments from the NRC Examination Team during the on-site preparation held December 14 - 16, 2004.
The following materials received modifications resulting from comments from the NRC Examination Team during the on-site preparation held December 14 - 16, 2004.
Administrative JPMs RO Conduct of Operations - Initiate a Temporary Change 0   Enhanced the Initiation Cue for clarity.
Administrative J PM s RO Conduct of Operations - Initiate a Temporary Change 0
0   Enhanced the task standard for critical steps to indicate which sub-steps are critical.
Enhanced the Initiation Cue for clarity.
RO Equipment Control - Identify Clearance Points 0   Enhanced the task standard for critical steps to indicate which sub-steps are critical.
0 Enhanced the task standard for critical steps to indicate which sub-steps are critical.
RO Emergency Plan - Make State and Local Notifications 0   Enhanced the Initiation Cue for clarity.
RO Equipment Control - Identify Clearance Points 0
0   Removed the critical indication for some steps.
Enhanced the task standard for critical steps to indicate which sub-steps are critical.
SRO Conduct of Operations - Manual Heat Balance 0   Truncated JPM for evaluation efficiency while maintaining adequate length for a comprehensive evaIuat ion.
RO Emergency Plan - Make State and Local Notifications 0
Enhanced the Initiation Cue for clarity.
0 Removed the critical indication for some steps.
SRO Conduct of Operations - Manual Heat Balance 0
Truncated JPM for evaluation efficiency while maintaining adequate length for a comprehensive eva I ua t ion.
SRO Equipment Control - Clearance Approval Added another error to the provided clearance.
SRO Equipment Control - Clearance Approval Added another error to the provided clearance.
SRO Radiation Control - Authorize an Emergency Exposure 0   Enhanced the Task Conditions for clarity.
SRO Radiation Control - Authorize an Emergency Exposure 0
System JPMs ADS Reset 0   Enhanced Task Conditions by changing indicated Reactor Pressure for realism.
Enhanced the Task Conditions for clarity.
System JPMs ADS Reset 0
Enhanced Task Conditions by changing indicated Reactor Pressure for realism.
HPCl Suction Transfer Modified JPM to require the candidate to diagnose the condition before taking appropriate actions.
HPCl Suction Transfer Modified JPM to require the candidate to diagnose the condition before taking appropriate actions.
1
1
 
: e.  
e.


==Subject:==
==Subject:==
Adjustments to Peach Bottom Operating Exam Materials for the February 2005 Initial NRC Examination (Continued)
Adjustments to Peach Bottom Operating Exam Materials for the February 2005 Initial NRC Examination (Continued)
System JPMs (Continued)
System JPMs (Continued)
Diesel Generator Load Test 0 Truncated JPM for exam administration efficiency.
Diesel Generator Load Test 0
0   Removed Alternate Path Off Gas - Place the Standby Air Ejector in service 0   Enhanced Task Conditions by changing GP-2 Attachment reference Main Steam - Close Stuck Open MSlV 0   Changed from Unit 2 to Unit 3 JPM 0   Clarified that this JPM is Alternate Path RPS - Scram Solenoid Deenergization 0   Enhanced Task conditions from specific rods to several rods.
Truncated JPM for exam administration efficiency.
Control Room Ventilation Restoration 0 Truncated JPM for exam administration efficiency Simulator Dynamic Scenarios Scenario 1 0   Changed one event to require more RO actions on failure.
0 Removed Alternate Path Off Gas - Place the Standby Air Ejector in service 0
Scenario 2 0   Changed classification of one failure from instrument to Component.
Enhanced Task Conditions by changing GP-2 Attachment reference Main Steam - Close Stuck Open MSlV 0
Scenario 3 0   Removed Instrument classification from one event present only for its Tech Spec evaluation.
Changed from Unit 2 to Unit 3 JPM 0
Scenario 4 0   Swapped sequence of first two events for exam administration efficiency.
Clarified that this JPM is Alternate Path RPS - Scram Solenoid Deenergization 0
0   Removed Instrument classification from two events present only for their Tech Spec evaluation.
Enhanced Task conditions from specific rods to several rods.
0   Enhanced Shift Turnover for clarity.
Control Room Ventilation Restoration 0
2
Truncated JPM for exam administration efficiency Simulator Dynamic Scenarios Scenario 1 0
Changed one event to require more RO actions on failure.
Scenario 2 0
Changed classification of one failure from instrument to Component.
Scenario 3 0
Removed Instrument classification from one event present only for its Tech Spec evaluation.
Scenario 4 0
Swapped sequence of first two events for exam administration efficiency.
0 Removed Instrument classification from two events present only for their Tech Spec evaluation.
0 Enhanced Shift Turnover for clarity.
2  
 
ES-401 Written Examination Review Worksheet PB 2005 Form ES-401-9


ES-401 Written Examination Review Worksheet PB 2005 Form ES-401-9
;1#
: 1.      2.        3. Psychometric Flaws          4. Job Content Flaws    5. Other 6.                7.
Instructions
;1#   LOK    LOD (F/H)  (1-5)  Stem Cues    T/F  Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S                Explanation Focus              Dist.        Link          units ward WA Only Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
Line 55: Line 73:
4 range are acceptable).
4 range are acceptable).
Check the appropriate box if a psychometric flaw is identified:
Check the appropriate box if a psychometric flaw is identified:
0         The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
0 The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc.).
0          The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc.).
The distractors are not credible; single implausible distractors should be repaired, more than one is One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions or too much needless information).
0 The answer choices are a collection of unrelated true/false statements.
The answer choices are a collection of unrelated true/false statements.
0 The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
unacceptable.
0        One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
that are not contradicted by stem).
0 0
0 0
Check the appropriate box if a job content error is identified:
Check the appropriate box if a job content error is identified:
0 The question is not linked to the job requirements (Le., the question has a valid WA but, as written, is not operational in content).
0 The question is not linked to the job requirements (Le., the question has a valid WA but, as written, is not The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter The question requires reverse logic or application compared to the job requirements.
0          The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
operational in content).
0        The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
is not required to be known from memory).
0        The question requires reverse logic or application compared to the job requirements.
in percent with question in gallons).
Check auestions that are sampled for conformance with the approved K/A and those that are designated SRO-only (WA and license level mismatches are unacceptable).
0 0
0 Check auestions that are sampled for conformance with the approved K/A and those that are designated SRO-only (WA and license level mismatches are unacceptable).
Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement),
Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement),
in need of (E)ditorial enhancement, or (Sjatisfactory?
in need of (E)ditorial enhancement, or (Sjatisfactory?
.       At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
: 1.
: 2.
: 3. Psychometric Flaws
: 4. Job Content Flaws
: 5. Other
: 6.
: 7.
LOK LOD (F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
#/
Back-Q= SRO U/E/S Explanation Focus Dist.
Link units ward WA Only At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).  


7.
artial Job-Minutia  
artial Job- Minutia #/ Back- Q= SRO   U/E/S                       Explanation Link         units ward WA Only Delete the first sentence begin question with Per T-102...                               I
#/
: 4. Job Content Flaws     5. Other   6.                           7.
Back-Q= SRO U/E/S Link units ward WA Only
lob- Minutia #/ Back- Q= SRO UIHS                               Explanation
: 7.
-ink          units ward WA Only Y     N   E     Format: Complete the following: Existing 480V. ..etc.
Explanation II Delete the first sentence begin question with Per T-102...
1      I I         IY IN IE          I              Eliminate 1st sentence I      I I         Iy IN       Is   I I 1 I                     IN IE     IDelete expected.
: 4. Job Content Flaws lob-Minutia
Y    N   E     modify Q stem, e.g., Following the Fast Transfer the SOONEST/EARLIEST power will be restored ...
#/
Y     N   E     Delete expected 2 places Y      N   E     De1eteexpected I   IY IN IE         IDelete expected Y     N   E     Delete the RClC system; make choices work grammatically Y    N   E     Grammar; match stem to choices I       I I         IY IN     Is   I
Back-
-ink units ward 1
I I
IY IN IE I
Eliminate 1 st sentence
: 5. Other
: 6.
: 7.
Q= SRO UIHS Explanation WA Only Y
N E
Format: Complete the following: Existing 480V...etc.
I I
I Iy IN Is I
Y I
1 I IN IE IDelete expected.
N E
modify Q stem, e.g., Following the Fast Transfer the SOONEST/EARLIEST power will be restored...
Y Y
N E
Delete expected 2 places N E De1eteexpected I
IY IN IE IDelete expected Y
Y N
E Delete the RClC system; make choices work N
E Grammar; match stem to choices grammatically I
I I
IY IN Is I  


7.
artial Job-Minutia  
artial Job- Minutia #/ Back- Q= SRO U/WS                   Explanation Ljnk       units ward WA Only Delete expected,reword stem ...using procedures...
#/
Back-Q= SRO U/WS Ljnk units ward WA Only
: 7.
Explanation Delete expected, reword stem...using procedures...  


ES-401 2 Form ES-401-9
ES-401 2
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other   6. 7.
Form ES-401-9
Q# LOK   LOD (F/H) (1-5) Stem Cues T/F   Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S     Explanation Focus             Dist.       Link         units ward WA Only 26 L     2                                                             Y   N   S 57 H     2                                                             Y   N   S 58 L     2                                                             Y   N   S
: 1.
: 2.
: 3. Psychometric Flaws
: 4. Job Content Flaws
: 5. Other
: 6.
: 7.
Q#
LOK LOD (F/H)
(1-5) Stem Cues T/F Cred. Partial Job-Minutia  
#/
Back-Q= SRO U/E/S Explanation Focus Dist.
Link units ward WA Only 26 L 2
Y N
S 57 H 2
Y N
S 58 L 2
Y N
S


ES-401 2 Form ES-401-9
ES-401 2
Form ES-401-9  


ES-401 2 Form ES-401-9}}
ES-401 2
Form ES-401-9}}

Latest revision as of 20:39, 15 January 2025

Draft - Nrc/Facility Comments - Operating Test and Written (401-9) (Folder 2)
ML051030151
Person / Time
Site: Peach Bottom  Constellation icon.png
Issue date: 11/19/2004
From: Nielsen P
Exelon Generation Co
To: Todd Fish
NRC/RGN-I/DRS/OSB
Conte R
References
Download: ML051030151 (13)


Text

To:

Todd Fish, Chief Examiner From:

Phil Nielsen, Peach Bottom Regulatory Exam Author

Subject:

Adjustments to Peach Bottom Operating Exam Materials for the February 2005 Initial NRC Examination.

The following materials received modifications resulting from comments from the NRC Examination Team during the on-site preparation held December 14 - 16, 2004.

Administrative J PM s RO Conduct of Operations - Initiate a Temporary Change 0

Enhanced the Initiation Cue for clarity.

0 Enhanced the task standard for critical steps to indicate which sub-steps are critical.

RO Equipment Control - Identify Clearance Points 0

Enhanced the task standard for critical steps to indicate which sub-steps are critical.

RO Emergency Plan - Make State and Local Notifications 0

Enhanced the Initiation Cue for clarity.

0 Removed the critical indication for some steps.

SRO Conduct of Operations - Manual Heat Balance 0

Truncated JPM for evaluation efficiency while maintaining adequate length for a comprehensive eva I ua t ion.

SRO Equipment Control - Clearance Approval Added another error to the provided clearance.

SRO Radiation Control - Authorize an Emergency Exposure 0

Enhanced the Task Conditions for clarity.

System JPMs ADS Reset 0

Enhanced Task Conditions by changing indicated Reactor Pressure for realism.

HPCl Suction Transfer Modified JPM to require the candidate to diagnose the condition before taking appropriate actions.

1

e.

Subject:

Adjustments to Peach Bottom Operating Exam Materials for the February 2005 Initial NRC Examination (Continued)

System JPMs (Continued)

Diesel Generator Load Test 0

Truncated JPM for exam administration efficiency.

0 Removed Alternate Path Off Gas - Place the Standby Air Ejector in service 0

Enhanced Task Conditions by changing GP-2 Attachment reference Main Steam - Close Stuck Open MSlV 0

Changed from Unit 2 to Unit 3 JPM 0

Clarified that this JPM is Alternate Path RPS - Scram Solenoid Deenergization 0

Enhanced Task conditions from specific rods to several rods.

Control Room Ventilation Restoration 0

Truncated JPM for exam administration efficiency Simulator Dynamic Scenarios Scenario 1 0

Changed one event to require more RO actions on failure.

Scenario 2 0

Changed classification of one failure from instrument to Component.

Scenario 3 0

Removed Instrument classification from one event present only for its Tech Spec evaluation.

Scenario 4 0

Swapped sequence of first two events for exam administration efficiency.

0 Removed Instrument classification from two events present only for their Tech Spec evaluation.

0 Enhanced Shift Turnover for clarity.

2

ES-401 Written Examination Review Worksheet PB 2005 Form ES-401-9

1#

Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 -

4 range are acceptable).

Check the appropriate box if a psychometric flaw is identified:

0 The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc.).

The distractors are not credible; single implausible distractors should be repaired, more than one is One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions or too much needless information).

The answer choices are a collection of unrelated true/false statements.

unacceptable.

that are not contradicted by stem).

0 0

0 0

Check the appropriate box if a job content error is identified:

0 The question is not linked to the job requirements (Le., the question has a valid WA but, as written, is not The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter The question requires reverse logic or application compared to the job requirements.

operational in content).

is not required to be known from memory).

in percent with question in gallons).

0 0

0 Check auestions that are sampled for conformance with the approved K/A and those that are designated SRO-only (WA and license level mismatches are unacceptable).

Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement),

in need of (E)ditorial enhancement, or (Sjatisfactory?

1.
2.
3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.
7.

LOK LOD (F/H)

(1-5)

Stem Cues T/F Cred. Partial Job-Minutia

  1. /

Back-Q= SRO U/E/S Explanation Focus Dist.

Link units ward WA Only At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).

artial Job-Minutia

  1. /

Back-Q= SRO U/E/S Link units ward WA Only

7.

Explanation II Delete the first sentence begin question with Per T-102...

4. Job Content Flaws lob-Minutia
  1. /

Back-

-ink units ward 1

I I

IY IN IE I

Eliminate 1 st sentence

5. Other
6.
7.

Q= SRO UIHS Explanation WA Only Y

N E

Format: Complete the following: Existing 480V...etc.

I I

I Iy IN Is I

Y I

1 I IN IE IDelete expected.

N E

modify Q stem, e.g., Following the Fast Transfer the SOONEST/EARLIEST power will be restored...

Y Y

N E

Delete expected 2 places N E De1eteexpected I

IY IN IE IDelete expected Y

Y N

E Delete the RClC system; make choices work N

E Grammar; match stem to choices grammatically I

I I

IY IN Is I

artial Job-Minutia

  1. /

Back-Q= SRO U/WS Ljnk units ward WA Only

7.

Explanation Delete expected, reword stem...using procedures...

ES-401 2

Form ES-401-9

1.
2.
3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.
7.

Q#

LOK LOD (F/H)

(1-5) Stem Cues T/F Cred. Partial Job-Minutia

  1. /

Back-Q= SRO U/E/S Explanation Focus Dist.

Link units ward WA Only 26 L 2

Y N

S 57 H 2

Y N

S 58 L 2

Y N

S

ES-401 2

Form ES-401-9

ES-401 2

Form ES-401-9