ML18057B535
| ML18057B535 | |
| Person / Time | |
|---|---|
| Site: | Summer  |
| Issue date: | 02/26/2018 |
| From: | NRC/RGN-II |
| To: | South Carolina Electric & Gas Co |
| References | |
| Download: ML18057B535 (118) | |
See also: IR 05000395/2011301
Text
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
VC SUMMER 2011-301 EXAM REVIEW Instructions [Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.] 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level. 2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable). 3. Check the appropriate box if a psychometric flaw is identified:
$ The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
$ The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
$ The answer choices are a collection of unrelated true/false statements.
$ The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
$ One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem). 4. Check the appropriate box if a job content error is identified:
$ The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
$ The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
$ The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with que
stion in gallons).
$ The question requires reverse logic or application compared to the job requirements. 5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable). 6. Based on the reviewer's judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory? 7. At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only Generic Issues. 1. In the stem of the question, need to determine if a period is or is not going to be used in the bulleted area of the stem. Sometimes it is used and sometimes it is not. It does not matter which one just do it one way or the other. 2. For the first few questions that use annunciator windows in the stem or distractors, these are not written the same. Some have the panel some have the panel and tile number, we need to get that uniform. 3. Reference material assembled is insufficient for examination review, system diagrams are not provided, key ARPs and AOPs not provided. Appears that the littlest amount of material was provided for the review to take place. 4. Add to those questions where necessary, applicable procedures being used to accomplish the appropriate tasks. This ensures validity of each question.
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 1 F 2 X E Question still needs work. Could be a
U. 004K4.07, Task Master Ž question 4483
1. Distractor B is NOT plausible. In that, when does a single failure cause the system to actuate unless there is some other information provided in the stem to identify they have to think of
this. Need to change this distractor. 2. Characterized as Higher, this is a very low higher cognitive
question. 3. KA appears to match Tuesday, October 04, 2011
1. Change provides values associated with the parameter
identified in the distractor.
2. Actual 3. Using the values, in B and C make them more implausible. HOW does the instrument failing HIGH, cause emergency makeup to occur? Actual have no relevance to the control system, so putting actual level does not help.
Recommendation: 1. Develop a 2 by 2 question using 2. The design feature of what happens on the failure and then what operator actions are necessary to combat that failure. ** Design feature of what happens, then operator actions to combat
the failure.
This question needs more work, it is still an E. Or potentially a U
.
Thursday, October 13, 2011
1. Added actual in each of the NEW 2/2 question. 2. SAT.
Satisfactory
S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 2 H 2
S 012K6.03, New, 1. This question is kind of backwards
logic, in that, it is you have to think of it failed? Not sure if this is a good way to ask this. 2. Were there any issues with reading this question? Based on evaluator review. Ask licensee. 3. Do we need names of each of these or are they required to know that form memory. The licensee states that they are required to know this material.
4. Kind of simple.
5. KA appears to match Thursday, October 13, 2011 1. No changes, operators are required to know the P numbers. 2. Still Sat. 3 H 3
S 011K4.03, Higher, New, 1. In distractor A, need to somehow identify the word
NO , so the applicants do not miss it. Bold, underline, don't care, pick one use it the same throughout the test. 2. Would it be better to add to 1) that will "eventually" cause a reactor trip? This may ensure that they have to evaluate the entire cycle like the analysis identifies. . Ask licensee. 3. KA appears to match Tuesday, October 04, 2011
1. Still think in question number 1 that we bold an underline the NO before operator, like
no. 2. Otherwise ok.
Thursday, October 13, 2011 1. Made consistent with other questions. 2. Rearranged SERVE after ONLY, GL suggested. 3. Bolded in B and D, serve only
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 4 H 2 X
E 016A2.01, Modified, Higher, Modified question was not supplied with
package. 1. Not sure that the initial information in the stem has a real meaning to answer the question. Other than it provides a starting point. This can be removed from the stem. 2. The KA requires in the second part to use procedures, while this is sort of the way about it, but it does not state what procedure just the actions to accomplish the required. Is there a way to add procedures in the second part rather than stating it in the
stem? Ask licensee. 3. Add the word "the" prior to the word "failure" in the stem of the question. Just to clarify a little. Tuesday, October 04, 2011
1. The question as changed still does not meet the KA, in that, there is no procedure listed in the answer. This is awkward! . 2. Change the stem to read:
WOOTF identifies the Resistance Temperature Detector (RTD) failure that would cause these indications
and the appropriate operator actions in accordance with AOP 304.3, Continuous Control Ro Motion?
1. Remove the procedure from distracters A and B. 2. Add parenthesis around the A as in "A" for all distracters since parenthesis are used in the initial
conditions. Make this
a global change for all
questions. This needs to be fixed before it is Satisfactory. Thursday, October 13, 2011 1. Changed the second part to as if they had to enter the AOP or not to and for rods in MANUAL. Changes SAT.
S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 5 H 2-3
E 00005G2.1.31, New, Higher, 1. How is it known that the alarm provided is the one that comes in FIRST? Was this run on the simulator to prove that it actually is
the first? Ask licensee. 2. Distractor C, P-12 is written differently here on this question than it was written on Question # 2. Is there a reason why?
Should they read the same and change # 2 or does this provide information to help decide that on Question # 2 that the distractor it appears is NOT correct for either. Discuss with licensee. 3. KA while it is not a complete match, it appears to cover the question fairly well. OK 4. Not sure if distractor is plausible. Need to ask another examiner.
Tuesday, October 04, 2011 1. Why was the question's stem changed? 2. As the question appears the change is ok. Now a Sat question Thursday, October 13, 2011
1. Changed the stem to be clearer. See question. WOOTF will be received simultaneously with a feedwater isolation signal
actuation?
S 6 H/F 2-3
E 000007EK2.03, New, Higher, 1. The reference material identifies the annunciator to have "an
intermittent fast flash." This is significant difference from the way the question is worded. Recommend that the essence of these words be put in for the answer other distractors that use the same wording, ie. Distractor B. 2. Do not agree this is higher level. The first part of the question is memory, does a failure of the IR cause a rx trip. Also second part of question, how does the alarm flash. Also could be memory. Discuss with licensee. 3. KA appears to match. Tuesday, October 04, 2011
1. Question was changed as requested, now satisfactory.
S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only Thursday, October 13, 2011 1. No further changes. Still satisfactory.
7 F 2-3
X U 000032AA.2.03, Modified, Knowledge (Fundamental)? 1. Remove from stem the word "choices" it is redundant and not necessary. The first sentence can read, in almost every case, Which One of the following (WWOTF)-..describes, indicates.
- 2. Modified question not supplied. 3. When were these new NI's installed? Was everyone in class when they were changed out? Or are the ONLY individuals who
were around then were the SRO-Us? I would imagine that this is the case. IF this is true, then the plausibility of the OLD versus the NEW does not bode well for the plausibility. 4. The procedure provided actually states to verify AT and not ABOVE as the question indicates. Could there be an issue with distractor B, in that, this may be close to the P-6 interlock (Source Range Permissive). Is this what we are looking at in this question? Discuss with licensee. 5. KA appears to NOT match. The KA asks the expected values of source range indication when high voltage is automatically removed. This is for a LOSS of Source Range NI. Discuss with
licensee. Tuesday, October 04, 2011 1. The question was entirely replaced with a new question. 2. The KA was changed at the request of the licensee. The NEW
KA is 000032AA2.06 3. Question matches KA, 4. Put a comma between EOP-12.0 and Monitoring Critical Safety
Functions. 5. Otherwise, question appears to be Satisfactory. Thursday, October 13, 2011
No further changes still ok,. Made minor changes to stem.
S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 8 H 3
E 000029EK2.06, New, Higher, 1. The question is kind of confusi
ng, in that, the stem is asking about minimum number of malfunctions that would cause a failure of an automatic reactor trip during the situation presented. Can this be worded a little differently? Is this like in the answer that there are three malfunctions? This does not
make any sense to me. . 2. How did the evaluators do? 3. What reference are you going to give? Not sure if it is only going to be the print of the RTBs and bypass breakers and emergency borate flow. 4. Is it necessary to have the emergency borate flow there?
5. KA appears to Tuesday, October 04, 2011
1. This change removed the requirement for the use of a reference. 2. Question as changed is satisfactory. Thursday, October 13, 2011 1. Scott P identified an issue with this question. Will discuss this on Friday. Friday, October 14, 2011
SAT S 9 H 2-3
S 010A4.01, Bank, Higher, 1. KA appears to match\ 2. Question was used on Watts Bar last exam. 3. Not a hard question.
Tuesday, October 04, 2011
1. Made a change to the IC, added statement for group 2 Backup heaters. No reason was provided for the added statement.
Added 2. Appears to be Satisfactory
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only
10
U 063K4.04, New, Fundamental, 1. THE KA does not match. This is almost the way it can be but it is talking about DC power and Trips, this would be better to
identify what electrical trips are not available for the DG or only the TRIPS associated with electrical. BUT they do not mean the mechanical trips how to stop the DG. Loss of Electrical power
causes the loss of most trips which ones do not get bypassed. The DG overspeed and the DG reverse power trip. This needs to be corrected. Discuss with licensee. Tuesday, October 04, 2011
2. Question was completely replaced. 3. The question asks what is the response of the EDG during the loss of All "A" train DC power. Ask it this way! The questionasks the response, which would indicate something shouldhappen. However from the answer, nothing happens. It is
really asking what is the status of the EDG, running or tripped?This is the way it should be asked, that status, not response. 4. To make it more valid, need to add what test is being done sothat the operator understands what the situation is with the
EDG. Can this be added to the initial conditions. AS
KLICENSEE. 5. Each distractor has a loss of DC power, it is already asked inthe stem, it is not necessary in each distractor. Remove thestatement due to a loss of DC power. 6. Same idea with second question, either there is or is notprotected. Therefore re write the question to read
After the ICs
E
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S WOOTF describes a) the status of the EDG following the loss of DCpower and b). the protection 1DA has from the 51 overcurrent trip. A.) a.) EDG will trip b.) 1DA is protected by the 51 trips.
B.) a.) EG will trip
b.) 1DA is not protected by the 51 trips
C.) a.) EDG will remain running b.) 1DA is protected by the 51 trips D.) a.) EDG will remain running
b.) 1DA is
not protected by the 51 trips
with this change it should be easier to read and will be Satisfactory.Licensee please make this change to this question and ensure we still
have a valid question.
Basically the question is ok, just look at the above and note the changesthat will help shorten and make it easier to read for the applicants.
Thursday, October 13, 2011
1. needed to add words to the stem to identify closer what was
being asked. 2. Additionally, added output to the EDG breaker and the nounname to the breaker to be clearer.
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 11 F 2--3
U if #2 is correct and OK otherwise. 022K1.01, New, Fundamental, 1. KA appears to match 2. Distractors B and D second part do not seem plausible. After reading the analysis it seems like they may be ok, but, I am going to ask G. Laska, tomorrow to see how he feels about this part of the distractor. It does not sit well with me, it seems to be
easy to eliminate them. Tuesday, October 04, 2011
1. Second part of distracters C and D have been changed. 2. Are there vacuum relief valves on the return lines of the RBCUs? This is a question I am not sure of. Need to ask the licensee if this is a true statement or is it something made up. 3. This needs some more work to understand what is or is not happening. IS there something like what is described in distracters C and D available on any other system?
Ask licensee. If there is NO other system that has this kind of vacuum relief valves then these distractors are unsat. Friday, October 14, 2011
1. Question was replaced. 2. See new question as SAT 3. SAT E/U s
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 12 H 2-3
E 064K1.05, Higher, VCS Closed Bank 1. Remove reason for DG will not start from the Main Control Room (MCR), faulty wiring. All they need to know is it will not start from the MCR.
Done 2. In the bulleted part, the A in the third bullet is not in quotes as it is in the stem of the question. Write it one way or the other, I do
not care which method is used, just be consistent. Same for distractor D with the "A" or just A. 3. The A distractor uses a period and the rest do not have periods, be consistent within and all questions. Either way is ok with me. 4. KA appears to match Wednesday, October 05, 2011
1. After reviewing this question again, the question asks if the EDGwill be prevented from coming up to speed. It does not say start, it states come up to speed. This is key in understanding 2. The air start system ONLY provides air to turn the crankshaft to allow the combustion cycle to start, that's what causes this to come up to speed. The air system would not get the EDG to operating speed. 3. If an operator ONLY depresses the air start system valve, does this then start the EDG or does the operator have to place a start signal to the circuit for the EDG to actually start? Was the
action that INITIALLY started the EDG that locked IN? SO did the DG have a start signal that would allow the DG to run after the engine is turned over???? ASK LICENSEE. I am not sure that this is clear and if it is, then the distractors may not be
plausible.
DISCUSS. 4. ADD to the stem WOOTF -. IAW AOP 304.3. Is this the procedure Friday, October 14, 2011
SATISFACTORY
S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 13 H 2-3
E W/E10EK3.4, BANK, VCS closed , higher 1. Is this abbreviation something the applicants would know, ESFLSs? Should we have it spelled out to begin with? Ask
Licensee. 2. Why in the stem do we NOT use the actual procedure the crew would be in? 3. KA does it match? Well kind of. The KA speaks to "adhered to and the limitations in the facility's license and amendments are not violated." This is not covered in this question. Discuss with 4. licensee. Need to have another examiner review for KA match. Wednesday, October 05, 2011
1. The question as changed appears to be ok. 2. No further changes warranted. Friday, October 14, 2011
Minor changes from validation comments, see exam for changes.
ADDED MINIMUM in the stem
SAT. S S 14 H 2
S 000057AA.2.12, MOD, VCS Closed, Higher. 1. APN-5901 thru 5904, what is the noun name of that bus? Is there any? 2. Are operators expected to know this information from memory? 3. Is 5902 channel II? 4. Low level higher question, really is memory, how if not memorized anyone would know this. Wednesday, October 05, 2011
1. Question Matches KA 2. Why not add the high PZRP level alarm annunciator alarm that should come in also? Ask if this does come in and add it if it does. Discuss with licensee. Minor enhancement, but it would
make the question more technically correct. 3. Other than that, it is appears to be ok. Friday, October 14, 2011 1. Added appropriate alarms that came in, as asked. 2. SATISFACTORY.
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 15 H 2 X U 064A3.03, New, Higher, 1. Is there a noun name for XTF-31? If so, add it to the stem. 2. Distractors C and D, second part are NOT plausible. The operator applicants all have observed DG starts and know that there is not a cycling of the frequency as described. Something better has to be used. The way this is it is not plausible. This is describing sequencing. Let's just say that. "Frequency
fluctuates as the load sequencer sequences. " 3. The analysis does not describe the function of XTF-31 or where to find information about it. No reference identified. 4. The stem is difficult to read. "Which choice below identifies the following with regard to-.." With regard to the A DG response,
which one of the following (WOOTF). May read better. Use recommendation above. Should be a S then.
Wednesday, October 05, 2011
1. None of the suggestions were used. 2. Answer D is another correct answer. This makes the question
unsat. 3. D has to be changed to make this question sat. Discuss with licensee. Friday, October 14, 2011
1. SAT SEE EXAM CHANGES.
U S 16 F 2 X E/S 063A2.01, New, Lower, 1. The question's KA was replaced with 063A3.01. This should be in the header of the question. Replace 2.01 with 3.01 in the header. Otherwise, it does not make sense for the question. 2. It states Local indication, is there no location where battery
voltage can be observed? This is not clear and should ensure this is not another provable answer. Discuss with licensee.
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only U 3. KA appears to match. Wednesday, October 05, 2011
1. Licensee identifies there is a LOCAL battery meter, provides a reference, reference was not submitted to identify that there are local battery meters. Are there 126 v and 108 v system local meters. 2. Licensee states that the procedure means in the reference "monitor Batter Bus Voltage throughout this procedure" implies the MCB. If this is the case WHY would anyone select LOCAL for reading the battery bus voltage? Why is it plausible? With this new information, distractors B and C are NOT plausible. Discuss with licensee. This makes this question UNSAT.
Friday, October 14, 2011
CHANGES SAT
S 17 H 2-3
E 062A2.01, Bank, Higher, 1. Add to the stem the procedure they would actually be in. 2. Why is it necessary to add "on low flow" in both A and B. This is not necessary and can be deleted. 3. Why is it necessary for the 1 minute time after the event? Discuss with licensee. 4. KA appears to match. Wednesday, October 05, 2011
1. ADD to the question the procedure, SOP-XX the crew would be in, in addition, to the GOP. Is there another one to parallel the MTG? 2. Question modified as requested, appears to be SAT. Friday, October 14, 2011 1. SAT NO CHANGES MADE.
S S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 18 H 2-3
S 045 G2.4.3, Bank, Higher. 1. Add noun name for 1A1X. This may or may not be necessary 2. KA appears to almost match. This is a borderline analysis. 3. The questions KA discusses use of annunciator alarms, indications or procedure response. The question uses a ARP that came in based on loss of a power supply. The correct
answer analysis uses the AOP. The answer to the question does not use a procedure but identifies how the system works. The question barely matches the KA. Discuss with licensee. 4. The manual adjustment of the field provides the reason for the first part of the question. This really has nothing to do with the procedure. What is the response procedure we are answering in this question? Discuss with licensee Wednesday, October 05, 2011 1. Why was the question changed from the loss of 1A1X to the Regulator Core Alarm? This was not suggested in the above?
Discuss with licensee! SO IT WAS CLOSER TO KA
2. The new question provides information as to why the annunciator came in. AND provides the ARP correct actions to
address this event. The skill set is different for answering this question than for the first question. 3. The first part of each distractor should have the words "-load will vary," with either "-load will increase," or "-load will decrease." This will then make the question more operationally valid. What will have happen to the reactive or real load.
Basically, as it sits the operator does not have to know what the action taken will do. 4. Additionally, the second part of the question has to be re-written to the following: "-AND based on a over temperature condition how the Main Generator Voltage Regulator will respond." Currently, the question does not really identify that the condition
is higher than the information provided in the IC. Recommendations:
If the above are followed the question will be considered SAT. Friday, October 14, 2011
S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only MADE CHANGES TO THE QUESTION. See changes on exam SATISFACTORY.
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 19 H 3
E 026K2.01, New, Higher, 1. I do not understand why the 480 v bus is a plausible distractor. I understand what is written, however, I do not understand why that is plausible. 2. The analysis does not explain the function of the XCP-639 point 6-4 BUS 1DX LCKOUT 86 B. The ARP was not provided. It
should have been. 3. Does the Reactor building Spray pump get any control power from the 480V bus? Does the 480 V bus 1DA1 bus get
powered from the 7.2KV Bus 1DA. 4. No information provided about the lockout 5. KA appears to match. Wednesday, October 05, 2011
1. The question stem was changed from the submittal. The information asked for is in a different order than those of the answers. The question stem asks for the location of the breaker
and the ultimate power supply. The distractors answer the power supply and then where power comes from. The question does NOT elicit the answers. Again, stem asks for the
LOCATION of breaker and answers identify From power supply, ie from offsite power, from the A EDG. Doesn't Location mean the BUS it is on, 1DA, on or the building it bus sits in. This now makes this question UNSAT. 2. I still do not believe that the 480 V bus is plausible. Discuss directly with licensee to understand why anyone would select A
or B and that a Safety Related Motor would be ONLY 480 volts. While this was characterized as an E, it initially should have been characterized as a U. Regardl
ess, of the characterization the question has two distractors that have been determined as implausible and therefore is UNSAT. The licensee did not provide a good reason why the less than competent operator
would select a pump that is safety related and is powered from the 480V power supply.
3. IS 1 EA powered in this instance with 1 DA? What is the voltage of 1EA1 bus? Discuss if either of these buses are
U
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S plausible under the plant conditi
ons listed in the IC. Monday, October 17, 2011
1. #2 1DA is ok as a distractor because the rhr and spray pumps are in the same room, however, they are powered from different
buses. Question is sat. 20 H 2-3
E 001K2.01,Modified, Higher, 1. KA appears to match 2. So 1DA2 and 1DB2 are safeguards buses? I don't understand why these are plausible! It seems like we are comparing apples and oranges, in that, one is 7200v and the other is 480v. Discuss with licensee 3. Need to understand why those in 2 are plausible. Wednesday, October 05, 2011
1. Why was the power supplies identified at the next lower voltage power? Why not use buses 1B3 and 1C2 as the alternate answers for distractors B and D? Discuss with licensee. 2. Why is the above not as good or better answer than 1A3X and
1C3X? 3. Question has two implausible distractors B and D, this is the same type of argument identified in question 19 using different power supplies one being a lower voltage than the other. Monday, October 17, 2011
1. Used the suggestion above, as 480 switch gear. 2. SAT U S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 21 F 3
X E/S 000055EA2.06. New, Knowledge, 1. No reference diagram for power line up. Discussed in the analysis of the answer but that is hard if not impossible to understand without a diagram. 2. Does the conditions of the stem put the plant in a Station
Blackout? Not sure it does. Ask licensee. 3. The KA talks about clearing an item to allow re-energization. The question concerns itself with preventing closing. It's a little difference but it is not the KA requirements. Discuss with licensee. 4. Have licensee explain this question with references. Wednesday, October 05, 2011
1. Question is OK as it is. No further changes necessary. Monday, October 17, 2011 1. Sat S 22 F 2-3 X U 0000056AK3.02, New, Knowledge, 1. KA appears to match 2. Distractors A and B do not make sense, in that, placing the Service Water pumps in PTL, Pull to Lock, does not make sense to remove the cooling medium for the EDGs. 3. The second part of B and D are not plausible to me. To immediately provide a heat sink for CCW. This does not seem plausible. The system being without power, CCW that is, has
no ability to cool anything, no heat transfer is being
accomplished, so when power comes back the heat load on CCW should be low, so an IMMEDIATE requirement will not appeal to any of the applicants. This needs to be changed. 4. Fix both sets of concerns.
Wednesday, October 05, 2011
1. First issue was corrected, however, now we have numerous reasons for doing this. Why only 2 in the 2 by 2 format. 2. Second part of B is still not plausible. Needs to be fixed.
U
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S 3. Second part of second part of D needs to be replaced. Not
plausible. 4. Use second part of C in B and then use the second part of A in D. Then it will be sat until fixed remains unsat. Monday, October 17, 2011
1. Followed the above suggestion.
2. Changed the order of distractors to have them look like the
other questions.
3. Also changed the loss
SAT 23 F 2
S 071A1.06, Modified, Knowledge, 1. In the stem, separate the wind direction from the speed. Make wind speed a separate bullet. 2. IS there a reason why the procedure that is governing the
release is not being identified? I think it should be in the stem. 3. What is actually going to be provided to the applicants for the reference? Is it just the SOP-119, Table A? IF so the reference should be ok to be provided. 4. Original question not provided.
5. KA appears to match. Wednesday, October 05, 2011 1. Question changed as requested, question SAT. Monday, October 17, 2011 1. SAT 24 F 2
X U 039A1.05, New, Knowledge, 1. KA speaks to Main and Reheat Steam and ability to predict and or monitor changes in Tave (without exceeding design limits) associated with operating the MRSS controls. What is the design limit in this question? Could use the 547 and 543 to make it a 2 by 2, but as it sits it does
not match. 2. Distractor C does not appear to be plausible due to system
alignment. 3. Also distractor D does not
seem plausible because this is
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S something that is done for Every Reactor trip. 4. The main issue with the question is that it does not prevent exceeding the limit. How is this tested with current question? This needs to be changed to match the KA Ask Licensee.
Wednesday, October 05, 2011 1. KA match addressed. Appears to match now. 2. Change stem to add WOOTF based on the conditions
provided-(this is a minor change to the modified question). 3. Question as changed is satisfactory. Monday, October 17, 2011
1. Used above # 2.
2. Added 1 and 2 in stem added to the distractors. 3. Reworded the stem.
4. SAT 25 F 2-3
E 061K6.02, Bank, Knowledge 1. Simple1 line diagram not provided. Cannot validate where valves are wrt the other valves.
Don't have time to look up every system. 2. KA appears to match 3. Is there a flow rate even associated with FCV 3546? Why would anyone think this valve has a runout feature also? Ask
Licenee. 4. The stem is too wordy. WOOTF completes the following statement? Which one of the following -.. That's all that is necessary.
Wednesday, October 05, 2011 1. Question changed as requested. 2. Only one minor change, should the word "RUNOUT" be identified in quotes as identified above? Not necessary but want to ensure that the applicants do not miss this word. 3. Otherwise appears to be satisfactory Monday, October 17, 2011
S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only Changed minor, see exam.
Sat. 26 F 2-3
S 078K1.01, Bank, Knowledge 1. This KA was changed to have 1.03 vice 1.01, need to change the header to reflect this when exam is built. 2. KA appears to match Wednesday, October 05, 2011 1. Changed as requested, still satisfactory.
27 F 2 X U 000026AK3.02, New, Knowledge, 1. KA appears to match. 2. Distractors C and D, first part are not plausible. This makes this questions unsat. We need to come up with something that makes this question more plausible. Maximize the flow to the
RHR heat exchangers is not plausible. This is a basic system
knowledge to know that CCW flow would not increase during the injection phase of an accident. This does not make sense why anyone would pick this. How did the validation fare? Did
anyone choose this? Need to replace this with something more plausible. Wednesday, October 05, 2011 1. Change to question appears to be a better choice, question is now considered satisfactory. Monday, October 17, 2011
1. Made minor changes.
2. SAT S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 28 F 2-3
E 073K3.01, New, Knowledge. 1. KA appears to match. 2. Distractors B and D, need to separate the other Valve and write it like, A & B. The way it is written is like the procedure and you
could choose either valve. This does not work for that and needs to be separated. 3. How about swapping the second line in A and C and start with the word ONLY. This will be consistent with B and C where BOTH starts them off. Discuss with Licensee. 4. What is the difference between XPB and PVB, are they considered the same? Explain. Wednesday, October 05, 2011 1. ALL comments addressed 2. Question is considered satisfactory Monday, October 17, 2011 1. SAT NO changes.
S 29 H 2-3
E 2.3.11, Bank, Higher. 1. Need to add to the stem the procedure the release is being done under. 2. It seems that there are a LOT of "A"s for answers, we need to look at the end of the exam and determine if we have too many one or the other. 3. Add another time prior to the answer and make the answer B, something like 0300 on 10/3. Wednesday, October 05, 2011 1. Do not understand the comment in the second submittal. I Still want to add some time prior to 10/06 at 2330 that will be wrong
and will make answer B be the correct answer. There are WAY to many A's or add two times and make the answer C. Either way, I would like to have an answer other than A. 2. Still E, until discussed with licensee.
E
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S Monday, October 17, 2011 1. Changed to 0300 on 10/6. 2. Bolded and highlighted without in the stem. 3. Added additional quotes around tank letters and capitalized Tank and Decay. See exam for the comments. 4. SAT.
30 F 2
E 103K4.04, New, Knowledge 1. KA appears to match. 2. Change "door" to "airlock" Wednesday, October 05, 2011 1. Understand requirements for airlock and airlock door or doors, however, do not understand both AIRLOCKS vent valves. Have licensee explain this concept. 2. Otherwise appears to be Satisfactory. Monday, October 17, 2011
1. Sat no changes.
S 31 F 2
S 022A4.02, Bank,Higher 1. KA appears to match. 2. Is the 2000 gpm minimum flow rate knowledge that the operators are expected to memorize? Wednesday, October 05, 2011 1. Comment, the word MINIMUM does not follow the convention used to identify other like aspects of what it is being identified. For example, it seems that it should be small letters with bolding
and underlining minimum 2. Otherwise appears to be satisfactory. Monday, October 17, 2011
1. Made minor changes. See exam.
2. SAT S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 32 F 2 x E 008A1.001,New,Knowledge 1. KA appears to match. 2. The stem of the first part of the question answers the second part. You open the header when flow reaches the band. Therefore, B and D distracters are not plausible. Wednesday, October 05, 2011 1. Understand issue with typo in the stem. 2. Question appears to be satisfactory. Monday, October 17, 2011 1. Sat as changed 2. Minor changes see exam.
S 33 H 2 x X U 028AK2.03,Bank, Higher 1. KA does not match. Not pressurizer level malfunction. 2. A flow control valve that supplies a fluid to the system would never throttle closed in response to a low level signal. Distracters A and D are not plausible.
RSB Agree this question is unsat, it does not match the ka, it does cover controllers and positioners however, it does not cover anything with the
Pressurizer Level malfunction. While this covers level control it does not match the intent of the KA.
Wednesday, October 05, 2011 1. Disagree with KA match, the question concerns itself with charging flow now Pressurizer LEVEL malfunctions. Discuss with M Meeks to get his view on this analysis. Until this is done,
this question remains unsatisfactory. Monday, October 17, 2011
1. New question has teaching in it. This is a failure of the Controlling PZR level control
2. This may need to be run on the simulator to see how long
3. THIS QUESTION IS NOT CONSIDERED SAT TILL THIS IS
U U?
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only RUN ON THE TABLE TOP SIMULATOR. 34 F 3
S 004A2.09, New, Knowledge 1. KA appears to match. Wednesday, October 05, 2011 1. No changes, still satisfactory
S 35 F 2 X E 007G2.4.18, New, Knowledge 1. KA appears to match. . 2. Distracters C. and D. are trivial during an EOP. If you have a valid safety injection, the operator is not going to be concerned
about breaking or potentially breaking the rupture disks.
RSB
This question distractors C and D are not plausible. Above states exactly why would anyone think that there was a reason to vent to the PRT during a LOCA and SI. This does not make sense at all. Additionally, this would
make this question evaluation UNSAT since both C and D would be
considered not plausible.
Wednesday, October 05, 2011 1. Initially should have been analyzed as Unsatisfactory because it
S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only had two distractors that were not plausible. 2. Changed C only, appears to be ok. 3. Question appears to be satisfactory. Minor issue, change answer so that A is NOT the correct answer. Re arrange to make C the correct answer to better distribute the answers
across A B and C and D. Monday, October 17, 2011
1. CHANGED AS REQUESTED. ` 36 H 2
S 006A3.01, Bank, Higher 1. KA appears to match.
Wednesday October 5, 2011 1. Can third bullet be deleted? Based on Appendix E brief, applicant should understand that automatic actions occurred unless explicitly given otherwise. 2. Verify with licensee shutoff head of RHR pumps-distractor analysis states that 350 psig is in RHR pressure band for decay
heat removal. 3. Recommend adding "Based on the
given plant conditions" to the question statement to be clear to applicant about time frame of question-because if time keeps moving, answer choice "C" will also be correct. Q statement could say "Based on the plant conditions as given, which ONE (1) of the following-." Friday, October 14, 2011 1. Licensee implemented the suggestions above. 2. Question is still SAT.
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 37 H 2 X E 036AA2.03, Bank, Higher 1. KA appears to match. . 2. Distracters C. and D. do not appear to be very plausible
considering the short time frame involved. Answer C might be improved by being in a lowered inventory status. Answers D. and C. are similar in that you're trying to imply fuel damage due
to inadequate cooling. Perhaps the 4
th option could have something to do with dry storage.
Wednesday, October 05, 2011
1. Distractor B is not plausible. Applicant can easily differentiate between dropping a spent fuel assembly that has been irradiated for hundreds of days vs. dropping a brand new fuel
assembly that hasn't been in the reactor core. 2. Can distractor D be a correct answer? Ref. lesson plan GS-05 fig. GS5.3 flowpath from 6669 to 6674 to 6681 to SFP
purification pump to 6691 to RWST. What is the maximum radiation field given whatever will be the height of spent fuel pool water above the 6669 valve siphon? 3. We don't need any information above the WOOTF statement-
can be deleted. Friday, October 14, 2011
1. Verified that D is NOT the answer. 2. Changed B, validation
S 38 H 2
S 012K5.01, New Higher 1. KA appears to match.
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only E Wednesday, October 05, 2011
1. Need to bound the time frame that the question is asking-for example, 5 seconds? 10 seconds? after the spray valve is open
and before the reactor trips. 2. Also need to mention before any operator action? Friday, October 14, 2011 1. Made the question easier to read and identified the 1 and 2 in stem and each distractor. 2. Added Assume no operator action.
S 39 H 3
S 07A4.10, Modified, Higher 1. KA appears to match. 2. GFE type question. 3. PRT Temperature is not required. 4. If the Pressurizer Code Safety is leaking, which ONE (1) of the following is the expected temperature as read on TI-465 (Use Noun Name)?
Wednesday, October 05, 2011
1. Check the correct answer-using steam tables and interpolation should correct answer be 267 degrees F, not 260? 2. Delete first and second bullets as unnecessary?
3. Need to add "approximate" to the temperatures because some people will use Mollier diagram and some will interpolate, etc..
E
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S For example, change Q statement to read as follows: "If a Pressurizer Code Safety valve is leaking, which ONE (1) of the following is the expected approximate temperature as read-." 4. Distractor 'D' is not plausible-recommend to come up with another wrong way to calculate an answer in the 200s range of temperatures. Having a single distractor 327 degrees F too big
from three other answers is hard to believe.
Friday, October 14, 2011
1. Changed this as suggested.
2. SAT SAT 40 H 2 X S 005 K6.03, Modified, Higher 1. Sort of matches KA. 2. Distracter D is weak. Why would anyone assume that the temperature recorder measured HX outlet only.
Wednesday, October 05, 2011
1. K/A match is weak, willing to accept. 2. Q is OK as written. Friday, October 14, 2011
1. No changes. Ok as is.
41 H 2-3
S 041 K1.02, Modified, Higher 1. KA appears to match.
Wednesday, October 05, 2011 1. Need to add that steam dumps are controlling in automatic pressure mode to second bullet? Implied by correct answer but
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only E not completely stated.
added 2. Inserting control rods is not plausible. In the power range control rods ultimately control Tavg not reactor power. Every other choice involves a manipulation of the secondary system. Potential recommendation: "Raising the setpoint on the STM DUMP CNTRL potentiometer (clock)." 3. Is it necessary to add "potentially" to the question statement? i.e. "Which ONE (1) of the following actions would potentially cause a "swell" in S/G level?" I.e. what are effects of FRV
operation, etc. 4. Need to provide current Tavg value in Q stem to make distractor A. more plausible (i.e. would actual Tavg be greater than 5
degrees higher than no load, which would lead someone to
erroneously believe the steam dumps would open in Tavg mode?) Friday, October 14, 2011 1. Changed as selected, see exam for changes. 2. SAT SAT S 42 H 2-3
S 035 K6.01, Modified, Highe
r 1. KA appears to match. 2. Correct answer uses similar thought process to 41.
Wednesday, October 05, 2011
1. GFE question that examines same concepts-shrink vs. swell as 41. Low discriminatory value/no tie to plant-specific knowledge. 2. Change distractor C. to "Steam Generator "B" narrow range level will decrease" for parallelism with distractor B? 3. How is this question operationally valid? If the reactor should trip on an inadvertent MSIV closure, and it does not, operators
E
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S are in an ATWS/FR-S.1 situation and steam generator parameters are irrelevant. 4. Potential double jeopardy with previous Q (#40)-applicant could potentially get two Q wrong if applicant has a misconception of shrink and swell phenomena. Friday, October 14, 2011
1. Completely new question to avoid double jeopardy with steam dumps. In 41. SATISFACTORY 43 H 2
S 003 K5.04, New, Higher 1. KA appears to match. 2. Not very discriminative. Just a GFE question.
Thursday, October 06, 2011
1. How is it plausible to have higher steam flows with no change in steam generator pressure, or to have higher steam generator pressures with no change in steam flows? Need to discuss with
licensee, may be o.k. if validators missed? Friday, October 14, 2011
1. sat s
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 44 F 2 X S 002 2.3.13, Modified, Knowledge 1. KA appears to match. 2. B and D are not plausible. Operators do not carry rad monitors. 3. Specifically identify the procedure in which these requirements
exist. RSB The plausibility of B and D needs to be fixed. Operators do not normally use rad monitors themselves. Do they use them at Summer? I doubt it, see what we can do to identify a more plausible distractor.
Wednesday, October 05, 2011 1. DISAGREE with licensee concerning that the second part of
distractors B and D are plausible. 2. NORMALLY the individual does NOT have the radiation monitoring device. The procedure does not allow an individual go to by them self. Change B and D to read: Must be accompanied by another operator who radiation monitor qualified with a radiation monitor. 3. How is 500 rads/hr plausible? How many system restoration valve lineups (i.e. normal ops) take place in a room posted with 500 rad/hr fields? Friday, October 14, 2011 1. CHANGED as requested. 2. The change has generic terminology concerning rad qualified. Need to change that 3. Removed 500 rads SATISFACTORY
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 45 F 2
X U 001 2.1.31, Bank, Knowledge KA does not match. KA discusses the ability to locate CR switches and indications and determine if they correctly reflect
the desired plan lineup.
Wednesday, October 05, 2011 1. Question was replaced, 2. KA appears to match 3. With two protection channels failed high, you would not be in a 3.0.3 shutdown, the reactor would automatically trip. Question as written is not operationally valid. In either case (whether the Rx trips or not), what procedure would specifically direct
operation of PORV PCV-444B (i.e. to ensure a single correct
answer)? 4. Recommend adding "both" to first bullet: "-have both failed
high." 5. There are multiple switches on the CREP panel-one is the isolation switch and one is the switch to position the valve/component. If Q is salvageable, the Q statement needs to
reflect this. Recommend: "Which ONE (1) of the following describes the location of the switch (or switches) that will be used to control Pressurizer PORV PCV-444B and the correct
position of that switch (or switches), in accordance with AOP-??
?" 6. As written distractor A. is potentially correct, because those should be the at-power positions of the switches at the CREP. 7. Question is still U due to operational validity issues. Friday, October 14, 2011 1. NEW Question 2. See exam for changes. 3. SAT S 46 F 2
S 003 2.1.2, Modified, Knowledge KA appears to match.
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S Thursday, October 06, 2011
1. Recommend changing word "ones" to "operators" in the Q statement, would say "The NROATC and the CRS are the only operators present in the Control Room." 2. Otherwise Q looks SAT.
Friday, October 14, 2011
1. SAT 47 F 2
X S or U 003 2.1.29, Bank, Knowledge 1. Need to discuss if KA matches. If it matches question is SAT. Wednesday, October 05, 2011 1. This question does NOT match the KA. Just because you ask the question associated with Component/Condition Verification , SAP 153, it does not match the KA. The question asked is
more of a radiation question. 2. Ideas for questions associated with this KA, red tag procedure, locked valve procedure, expectations associated with second
person verification. 3. WHY should an RO know this fr
om recognizing this value? One could possibly identify that this is an SRO only knowledge. It would be better to rewrite this question and hit the KA better associated with valve line up.
Friday, October 14, 2011
1. New question, 2. Changed what was proposed. 3. SAT U S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 48 F 2-3
S 003 2.4.25, Modified, Knowledge 1. KA appears to match. 2. KA importance rating for 2.4.25 is only 3.3.
Wednesday, October 05, 2011
1. Unsure as to WHY this question changed from the initial
submittal. 2. UPON Further review, this
question is considered UNSAT. When in ANY procedures does the RO/SRO/BOP operate DISCONNECT SWITCHES as Immediate operator actions. 3. Changes made in green (2
nd part of distractors) look o.k. and are plausible given AOP-600.1 knowledge of the RO in-plant JPM "i" (where leaving one RCP running was a critical step).
The issue with the Q is that tripping the Reactor is such a strong
correct choice as an immediate operator action that it may be hard to develop a second choice that is technically incorrect (when viewed against Rx trip) and plausible. 4. K/A covers all aspects of fire protection procedures, does not necessarily need to cover immediate actions of FEP-4.0. 5. Q is U due to two non-plausible distractors. Friday, October 14, 2011
1. Chose to use disconnects for IPV-445a and b and C. BOP does not trip the reactor. Rx trip is a duty of the RO. \ 2. Changes are sat 3. Question is sat
U S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 49 F 2-3
X E 003 2.4.34, Modified, Knowledge 1. KA does NOT fully match. Need to discuss tasks AND "resultant operational effects".
Thursday, October 06, 2011 1. K/A is now met with the changes as made. 2. Q now looks SAT.
Friday, October 14, 2011 SATISFACTORY.
S 50 F 3
S 086 K3.01, Modified, Knowledge 1. KA appears to match. 2. Supplied documentation does not fully support basis for correct answer or distracters. Distracters appear valid based on limited
documentation.
Thursday, October 06, 2011
1. Questions 48, 49, and 50 all deal with FEP-4.0 and may present a potential "double jeopardy" for an applicant. For example, if an applicant has a misconception that train "A" is used during FEP-4.0 rather than train "B" the applicant may get both 49 and 50 wrong. Recommend licensee and chief examiner discuss to
determine if this is acceptable. 2. Need to bound the time frame of actions performed within the scope of the Q-specifically, the attachments of FEP-4.0 specify that actions to black out the "A" ESF train and start turbine-
driven EFW pump need to be completed within 30 minutes. This needs to be reflected in the Q stem. Potential fix to last
E
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S bullet: "It has been 45 minutes (note to licensee: pick a technically correct time here, 35 min? 40 min? 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />?) since the crew began implementing FEP-4.0 CONTROL ROOM EVACUATION DUE TO FIRE." 3. If double jeopardy issues resolved to satisfaction, Q should be o.k. with changes as recommended.
Friday, October 14, 2011 1. BOUNDED THE TIME TO BE 45 min, all actions should be done by 30 minutes. 2. Changed as requested. See exam for changes 3. Question is SAT.
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 51 H 3
S 003 2.4.31, New, Higher 1. KA appears to match. 2. Last bullet on given information does not appear to have any
value. Thursday, October 06, 2011 1. K/A is met. 2. Distractor "D" is not plausible as written. The combination of leaving the RCPs running, in combination with a loss of all seal
cooling, does not make any sense. However, changing distractor "D" in a 2x2 format means that other aspects of the Q
also have to change. 3. Potential recommendation:
"Initial plant conditions: -100% power
Current plant conditions: -XCP-612 pt 4, PHASE B ISOL, alarms -RB Spray pumps "A" and "B" are NOT running
-RB pressure is 0.4 psig and stable -all phase B automatic actions have occurred
Based on the current conditions, which ONE (1) of the following states how RCPs should be operated, in accordance with ARP-001-XCP-612 for PHASE B ISOL; AND what is the status of
RCP seal cooling?
A. Trip all RCPs immediately.
Seal cooling still exists. B. Trip all RCPs immediately.
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only E All seal cooling has been lost. C. RCP operation may continue as long as parameters remain within limits as displayed on IPCS ZZRCPBRG.
Seal cooling still exists. D. RCP operation may continue as long as parameters remain within limits as displayed on IPCS ZZRCPBRG.
All seal cooling has been lost."
4. Note: the reason it would not be recommended to simply insert the above first part of C. and D. into the Q as written now, is the LOCA in progress. Specifically, RCP trip criteria is so well-known that if the LOCA progresses to the point that a valid
phase B occurs, it is much less plausible to keep the RCPs
running. I.e., if the LOCA started out as a small enough SBLOCA that we didn't have to trip RCPs on the first pass through EOP-1.0/EOP-2.0, now the LOCA has gotten so big
there's 12 psig into the RB-so the operators will be thinking shut down the RCPs even without the phase B actuation. Friday, October 14, 2011 1. Made the question into 2 by 2, good 2. SAT SAT S 52 H 2-3
S 002 G2.2.44, New, Higher KA appears to match.
Thursday, October 06, 2011
1. Second part of distractors A. and C. are weak, because no RWST level to be worried about is provided in the Q stem.
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only E 2. Recommendation: keep the distractors as shown, modify the Q statement to read something like
"Given the following plant conditions: -The crew is responding to a Faulted Steam Generator (S/G)
-The S/G has blown dry -The crew has transitioned to EOP-1.2, SI TERMINATION -RCS pressure is increasing
-RWST level is 40% and slowly decreasing (licensee verify a good RWST level at this point)
-"A" charging pump is running
-The crew has just secured the "B" charging pump
Based on the given conditions, which ONE (1) of the following is
the next required action, in accordance with EOP-1.2; AND why a reduction in SI flow should be done expeditiously?"
Friday, October 14, 2011 1. Changed this to have just RWST is decreasing. 2. SAT S 53 H 2-3
S 002 K5.14, New, Higher KA appears to match.
Thursday, October 06, 2011 1. Potential issue is that the electronic references for EOP-4.0 rev 20 do not seem to have any steps that put in aux spray at steps
22 and 23 of EOP-4.0 (where the operators depressurize the RCS to refill pressurizer). However, there is a step at EOP-4.0 22.c.2) that closes PVT-8125? When would this valve ever be
opened before this point in EOP-4.0? Is this a potential procedural error? Discuss with licensee. 2. This Q has overlap with a simulator JPM-applicants will be very familiar with steps 22 and 23 of EOP-4.0. 3. How is it plausible to put in aux spray if EOP-4.0 does not list that as an option at steps 22/23?
E
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S 4. Potential fix: put the operators in EOP-4.2 (i.e. step 27) in the fifth bullet of the Q stem. Maybe say something like "the operators are at the step to depressurize the RCS to reduce
break flow in EOP-4.2, SGTR WITH LOSS-" Does the Q still work then-check with licensee? Si
nce there is a chance to use aux spray in this procedure (EOP-4.2 vs. EOP-4.0), the
plausibility issues are enhanced.
Friday, October 14, 2011 1. Changed the starting point to EOP 4.2 at step 27. SATIFSACTORY 54 H 2
S 003 EA2.04, New, Higher KA appears to match.
Thursday, October 06, 2011
1. Need to discuss with licensee the potential for first part of A. andC. to be correct-potential for C. to also be true. The provided
distractor analysis for A. or C. does not discuss why primary to secondary leak flow has decreased is incorrect. 2. If first part of A. and C. can be shown to be incorrect, Q should
be SAT.
Friday, October 14, 2011
1. SAT. 2. 55 F 2
S 002 EK1.3, Bank, Knowledge KA appears to match.
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only E Thursday, October 06, 2011
1. Q is low discriminatory value, operators who saw the EOP-2.5 simulator scenario (and resulting simulator "freeze" issue) will be very familiar with this Q and the correct answer. 2. Distractor C. is not plausible. Is there any procedure in the Westinghouse EOP network where SI flow rates are used as parameters? Recommend modifying C. to be "RCS subcooling" 3. Q should be o.k. with modification. Friday, October 14, 2011 1. Fixed distractor C 2. SAT
3. S 56 F 2
S 009 EK1.02, New, Knowledge KA appears to match
Friday, October 07, 2011
1. If the S/Gs are dry, answer choices to stop removing heat may be correct. Need to add S/G levels to stem of Q to ensure RCS-to-S/Gs coupled in order for reflux boiling to occur? Maybe add a bullet to state: "All S/G narrow range levels are approximately 50% and stable." 2. Steam binding is a phenomena normally associated with pumps, not U-tube S/Gs, making the second part changes to A. and B. suspect. Recommend "stop removing heat due to interruption of natural circulation." Ensure not too much
overlap/potential double jeopardy with Q 53. 3. The time frame is also important in this Q, because if the hot legs are completely voided would reflux boiling be able to
occur? Recommend modification to second Q statement as follows: "After RCS level decreases to the point that steam voiding has just begun to occur in the RCS hot leg-." Friday, October 14, 2011
E
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 1. Added all the recommendations.
2. SAT 57 H 2
E KA appears to match
Friday, October 07, 2011
1. Potential overlap with Q 52, ensure we're not putting the applicant in too much double jeopardy. Should be o.k. 2. The fact that every distractor except C. deals with Both RHR
pumps gives it weak plausibility. Recommend either changing C. to "Both RHR pumps were stopped to conserve RWST
inventory," or potentially changing B. to read something like "ONE (1) RHR pump was stopped to align to charging pump suction," if you want to keep C. as written-this will improve the
parallelism of the Q. 3. Recommend adding "in accordance with EOP-2.0 LOSS OF REACTOR OR SECONDARY COOLANT" to the end of the WOOTF statement to clearly identify the source of the correct
answer. Friday, October 14, 2011
Satisfactory,
S 58 H 2
E 004 A2.01, Higher, New 1. KA appears to match. 2. Question uses much of the same information required to answer
question 57.
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S Friday, October 07, 2011
1. Q looks SAT.
SAT 59 H 2 X E 003 A1.2, Higher, New 1. KA appears to match. 2. For the choices give, "5% power level" could never be wrong. It is more severe than IR SUR positive, therefore without knowing anything else, if the SUR answer led to a red path, then the power range answer must too.
Friday, October 07, 2011
1. Q still has a potential subset issue/multiple correct answers, because if Intermediate Range SUR is positive, wouldn't Source Range SUR be positive as well? 2. Recommend modifying the Q statement as follows: "WOOTF-
and the lowest Intermediate Range SUR indication that will result in an ORANGE path on the Subcriticality critical safety function, in accordance with EOP-12.0, MONITORING OF
CRITICAL SAFETY FUNCTIONS? A. End of Life 0.1 DPM and stable
B. End of Life 0.2 DPM and stable C. Beginning of Life
0.1 DPM and stable D. Beginning of Life 0.2 DPM and stable"
Friday, October 14, 2011
1. Used recommendation. 2. S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 60 F 3
E E13 EK3.4, Knowledge, Bank KA appears to match
Friday, October 07, 2011 1. This Q has overlap issues with SRO Q 94. 2. Need to understand the impact of the loss of instrument air header pressure-has it been long enough to bleed down MSIV
accumulators and close all MSIVs? Issue is that if the
condenser is "available," then EOP-15.1 step 8 alternate action would first have the operator locally operate steam dump valves
before attempting to locally operate SG PORVs. 3. Distractor C is not plausible. Common knowledge that TDEFW pump has steam line sources from B & C S/Gs, not the A S/G. If
the overlap issues can be resolved
and it made clear that it has been a long-term loss of instrument air, changing distractor C. to say "Locally operate steam dump valves in all condenser sections to reduce affected SG pressure," may be a plausible
candidate for replacing C. 4. Should delete "-based upon a yellow condition on the Heat
Sink CSF status tree" as teaching in the stem; you can only get to EOP-15.1 on a yellow path. Friday, October 14, 2011
1. Changed no overlap issue. 2. MSIVs no accumulators 3. Removed teaching from the stem. 4. In C removed in each condenser section. To each condenser like the procedure.
SAT S 61 F 2
S W/E15 EA1.3 get this from here.
Friday, October 07, 2011 1. Distractor B. is a subset of correct answer A. A faulted SG
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only inside containment would be one of the unexpected sources of
water. Therefore B. is a non-plausible distractor. 2. Potential recommendation for B.: "Evaluate ECCS system status to determine strategy to transition to cold and hot leg injection." to play off distractor D. Friday, October 14, 2011
1. Changed B to look like D. SATISFACTORY 62 H 2-3
E 022 G2.4.11, Higher, Modified 1. KA appears to match. 2. Using the word "Immediately" implies immediate action. Instead suggest using "which step will the AOP require first"?
Friday, October 07, 2011
1. Q was modified as requested in first 401-9. 2. Q is of low discriminatory value, but acceptable. 3. Q now appears SAT. Friday, October 14, 2011
SAT S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 63 F 2
X E 00024AK1.01 need to get this one from file.
003 AK1.01, Knowledge, New 1. KA slightly matches. 2. The question is NOT very discriminating. The candidates really do not need to understand the operational impact of the loss of RHR, the just need to know the max pressure and temperature
that it can be put in service. A better question might put them outside one of the limits and have them determine that they cannot put it in service until they restore the parameter.
Friday, October 07, 2011 1. Q was modified as requested in first 401-9. 2. Could be acceptable Q if source is provided for correct answer-i.e. design limits based on what document? Westinghouse Design Basis Document for RHR system? VC
Summer FSAR? Etc. Once source is specified, recommend listing it as an "in accordance with-" at the end of WOOTF
statement. 3. Q may be o.k. with modifications as requested
Friday, October 14, 2011
1. Changed question based on the comment from NRC.
S 64 F 2-3
S 076 K3.05,Knowledge, New 1. KA appears to match. 2. Answer is logical. Does not appear to be adequate procedural documentation to ensure only one correct answer. How long is RCS temperature expected to remain stable?
Friday, October 07, 2011
E
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S 1. Distractor B is non-plausible. How would the condenser still be
available? Recommend slight
modification to read: "Dump steam using S/G PORVs." Friday, October 14, 2011
1. Version two uses SG PORVs. 2. Changed B to use MDAFW to feel one SG and use that S/G to
depressurization. 65 F 3
X E 065 AA1.03, Knowledge, New 1. KA sort of matches. 2. KA is asking how to operate equipment when air is restored. In other words, what do you need to do prior to restoring air to
ensure you don't damage the plant or cause another transient when you restore air. Valve switches may be placed in hard open or closed (or gagged open or closed) to prevent
repositioning upon air restoration. This question appears to be written from a standpoint of operating without air vice operating while restoring air.
Friday, October 07, 2011
1. Q was modified as requested in initial 401-9. 2. Q now looks SAT.
Friday, October 14, 2011 Validation identified that it was a gaging handwheel so had to change the stem to a valve that needed to be ungagged.
S S 66 F 2 X E 079 A4.01, Higher, New 1. KA appears to match. 2. Answer C is NOT plausible. Why would service air isolate before the backup compressor started?
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S Friday, October 07, 2011 1. Q modified as requested in initial 401-9. 2. Q now looks SAT. Friday, October 14, 2011 1. Not higher level of knowledge otherwise ok. 2. SAT S 67 F 2-3
S 059 G2.4.11, Higher, Bank 1. KA appears to match. 2. Consider asking which AOP would they enter and what is the first action that would be taken. 3. Is it certain that manually controlling all three FRVs cannot cause SG levels to rise?
Friday, October 07, 2011 1. Distractor A. is still potentially correct. For the given plant conditions, operators would meet entry conditions for AOP-210.1 and A. is the first immediate operator action of AOP-210.1. Also, use of the word "all" in distractor A. is a giveaway
word. 2. If agreement can be reached that A. is clearly technically incorrect, recommend changing A. to read "take feed reg. valves
to manual for the affected S/Gs." 3. If A. is not clearly incorrect, recommend development of new distractor to replace A. Would
it be plausible to start additional condensate pumps or feedwater booster pumps? Friday, October 14, 2011 1. Changed A to start feed water booster pump. 2. Changed the stem . see final exam for changes.
3. Sat SAT E S 68 H 3
S 077 AK3.02, Higher, New 1. KA appears to match.
Friday, October 07, 2011
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 1. Unsure about higher cognitive, Q can be answered via simple recall of AOP-301.1 CAUTION/first step. Should be Fundamental LOK. 2. Recommend adding "Based on th
e given conditions, -" to the WOOTF statement. 3. Otherwise Q looks SAT. Friday, October 14, 2011
1. SAT SAT 69 F 2
E 059 AK1.01, Knowledge, New 1. KA appears to match. 2. If this is knowledge that the operators are expected to memorize, it is OK. However it is not very discriminating.
Specific to plant.
Friday, October 07, 2011 1. What microcuries/gm setpoint would correspond to a full Condensate Storage Tank? i.e. check to ensure A. and B. are incorrect. 2. As mentioned in first 401-9, not very discriminating; however, if above concern is resolved Q should be SAT. Friday, October 14, 2011
1. SAT as is, need to know spec.
SAT S 70 F 2
S 058 G2.2.36 Higher, New 1. KA appears to match. 2. Memorization. No higher level ability required. 3. Not very discriminating. Any person knowledgeable of PWR operations could answer.
Friday, October 07, 2011 1. Q should be SAT.
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only Friday, October 14, 2011
sat
71 F 2 X S 003 3.01, Higher, New 1. KA appears to match. 2. Stopping dilution within 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> is part of the material below the line. ROs do not need to know this information. This makes
these distracters very weak. Recommend using be in cold shutdown within 12 hours1.388889e-4 days <br />0.00333 hours <br />1.984127e-5 weeks <br />4.566e-6 months <br /> as a better distracter.
Friday, October 07, 2011
1. Potential subset issue-if second part of distracters B. and D. were correct, second part of distracters A. and C. are also correct. 2. Also need to add "with no operator action" to the Q statement? Because FCV-122 is in MANUAL- 3. Potential fix for this issue would be to change WOOTF statement to read: "Which ONE(1) of the following describes an expected parameter trend if the running RHR pump trips with no other operator actions, and the required action as stated in
Technical Specifications?"
Friday, October 14, 2011
1. Fixed the subset issues. 2. Added with no operator actions to the stem. SATISFACTORY
E S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 72 F 2
U 017 AK2.10, Knowledge, New 1. KA matches somewhat. 2. Memorization. No higher level ability required. 3. Not very discriminating. Memorization of the trip setpoint and a basic understanding of reactor physics that any nuclear
professional should have.
Friday, October 07, 2011
1. This Q has multiple subset issues. As written D. is a potentially correct answer along with C. Second part of A. and B. are not
plausible because they would allow operators to restart a RCP at 100% power (current MODE is MODE 1), and because if the second part of A. and B. are true, then the second part of C. and
D. are also true. 2. 311 degrees is also not plausib
le because it's too high-seal return would be superheated at this temp? (return flow at VCT
pressure?) 3. Q as written is UNSAT due to the above issues. 4. Potential fix/recommendation: (delete the Given- and the bullets) In accordance with SOP-101, REACTOR COOLANT SYSTEM, which ONE (1) of the following correctly identifies:
1) The lowest seal water outlet temperature at which a RCP must be stopped. 2) The highest MODE in which a RCP can be restarted after the cause of the high temperature is corrected?
A. 1) 195 F 2) MODE 3
B. 1) 195 F
2) MODE 4 C. 1) 235 F 2) MODE 3
S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only D. 1) 235 F 2) MODE 4"
Friday, October 14, 2011
Followed all recommendations.
SAT 73 H 2 X S 003 AK1.21 Higher, New 1. KA appears to match. 2. Not very discriminating. Bases for the plausibility of AFD being within the band is that the candidate must know that the
surveillance requires 2/4 to be outside the band to be considered outside the band. Given that it is easy to see that two NIs are outside the band, the average person with no
knowledge would declare it out.
A more discriminating question would have three inside and one outside.
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only E Friday, October 07, 2011
1. Q was not changed given the recommendation of the first 401-9. As written, first part of Q is essentially a direct look-up on the 100% power line (points given on the provided reference). Therefore, with two values outside the acceptable region,
plausibility of first part of A. and C. is weak. 2. Recommend changes to delta flux indications as follows: Before the Drop After the drop N41 -4.4% -3.6% N42 -4.4% -5.7%
N43 -4.4% -9.1%
N44 -4.4% -6.8%
3. Recommend changing the second half of the Q statement to "The BOP is required to maintain Tavg within a maximum of _____ of Tref, in accordance with AOP-403.5, STUCK OR MISALIGNED CONTROL ROD." 4. If the above changes are made, C. is the new correct answer. 5. Q should be ok with modifications.
Friday, October 14, 2011
1. Sat as changed, it is a little different but ok
74 F 2
S 2.2.35, Knowledge, New KA appears to match
Friday, October 07, 2011
1. K_eff values up to 0.99 are not plausible. How could you ever refuel at that value? Recommend making one first part choice
E
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S "less than or equal to 0.90" and the other "less than or equal to 0.95" Temperature choices in the 2x2 are ok. 2. Another potential enhancement to WOOTF statement: "WOOTF - that can exist when the
first Rx Vessel head bolt is detensioned in accordance with Technical Specifications?" Friday, October 14, 2011 1. Changed from 0.99 to 0.90, changed less than or equal to . 2. 75 F 3
S 003 2.2.37, Knowledge, Bank 1. KA appears to match. 2. Memorization. Plant specific.
Friday, October 07, 2011 1. Q appears to be SAT. Friday, October 14, 2011
1. S SRO ONLY Questions
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 76 H 3
E 017 AK2.10, Knowledge, New 4. KA matches somewhat. 5. Memorization. No higher level ability required. 6. Not very discriminating. Memorization of the trip setpoint and a basic understanding of reactor physics that any nuclear
professional should have.
Friday, October 07, 2011
5. This Q has multiple subset issues. As written D. is a potentially correct answer along with C. Second part of A. and B. are not
plausible because they would allow operators to restart a RCP at 100% power (current MODE is MODE 1), and because if the second part of A. and B. are true, then the second part of C. and
D. are also true. 6. 311 degrees is also not plausib
le because it's too high-seal return would be superheated at this temp? (return flow at VCT
pressure?) 7. Q as written is UNSAT due to the above issues. 8. Potential fix/recommendation: (delete the Given- and the bullets) In accordance with SOP-101, REACTOR COOLANT SYSTEM, which ONE (1) of the following correctly identifies:
1) The lowest seal water outlet temperature at which a RCP must be stopped.
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S 2) The highest MODE in which a RCP can be restarted after the cause of the high temperature is corrected?
A. 1) 195 F 2) MODE 3
B. 1) 195 F
2) MODE 4
C. 1) 235 F 2) MODE 3 D. 1) 235 F
2) MODE 4"
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 77 H 2
X U W/E16G2.4.30, New, Higher, 1. Depending on the other questions, the reference provided should be the entire EAL matrix. This way the applicant at least has to find the section necessary to answer the question. IF ONLY the page that is associated with each question is provided then the question becomes a look up for only that item on that page. Suggest the entire EAL Matrix be provided, unless it helps answer other questions on the exam (RO or SRO) 2. An event occurred that increased (raised) the readings- Not sure it is necessary to say significant. Also, reading should be plural, readings. And at the end of the second bullet add the
word "respectively." 3. KA does not match, reporting to agencies internal or external, not done, only classification is done. Not notification. Repair or
replace
Wednesday, September 28, 2011
1. 1. Replacement question. New Lower, 2. Distractors C is NOT plausible, the stem of the question does not provide any substantive
information concerning the information that would require the identification of offsite dose projections. While the question analysis states that the INITIAL notification does not require the offsite dose projection, the question in the stem does not provide any information that would be used to do this. Additionally, the stem states offsite
radiation is normal. 3. Distractor D is NOT plausible. This new question still warrants an evaluation of a U.
Thursday, October 13, 2011 1. Changed to a 2 by 2 format.
U
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only U 2. Event prognosis and estimated release duration was used. 3. Stem has a radiation monitor that needs to be changed because there is a 309 that needs to be removed from the rad
monitorl RMG-7 needs to be changed.
- still have to ensure that RMG-7 nomenclature is corrected. 78 F 2 X U G2.2.25, New, Lower, 1. Distractors with run out are not plausible A and C. This is a system knowledge item that is covered by everyone, not just SRO knowledge. 2. The 13 gpm value listed in the question in C and D are also not valid. In that, what or where does this number come up that
would cause the operators to think it is plausible? Additionally, what did the results of the validation see for this question? Anyone pick anything but the correct answer? Did anyone pick
D? or C? If not these most likely are not valid answers and not
plausible. 3. Asked G. Laska concerning the evaluation of the question. He agrees. Thursday, September 29, 2011
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S 1. Question was UNCHANGED. The above evaluation still is
valid. Question is still a U.
Thursday, October 13, 2011
1. The new question still has s
ubset issues. B and D can be
also correct. Subset iss
ues. Changes to this are necessary so it is bounded. 2. Change maximum of 33 and a maximum of 39. This was changed during this meeting. 3. JL asks what part is the SRO? 4. Had to change to maximum of vice less than. This included a less than 13 which would also be 33 gpm. 5. Also changed distracters to add during the design basis LOCA. 6. Changed pump to RCP. Question is satisfactory. 79 H 2
X U 000062AA2.03, New, Higher, 1. In the stem of the question, the "A" EDG is listed this way and A EDG. With or without quotes. Pick a standard for all questions and do it the same. 2. This information while in the basis of TSs, is not SRO ONLY knowledge. 3. Question needs to be re-written to be at SRO level. 4. Verified with G. Laska to ensure it was NOT SRO ONLY, he
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S agrees.
Thursday, September 29, 2011
1. Replacement question. New Lower. 2. Attempting is misspelled in the last bullet in the stem. 3. Suggest to put a comma after the first line in each distractor, this will separate the answers 4. KA appears to match
5. Otherwise, this appears to be
OK. -------------------------------------------------------------------------- -How is Q lower cognitive? Should be higher cog based on evaluation of plant conditions, operability call required, etc.? Thursday, October 13, 2011
SATISFACTORY
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 80 H 2-3
U 00025AA2.04, New, Higher, 1. Use of period in bulleted area, one has all rest do not have
periods 2. Question is NOT SRO ONLY. Systems knowledge can answer this without any knowledge of the procedure. 3. The procedure is provided so the SRO does not have to identify what procedure to handle this in. 4. The PZR level is not described sufficiently, uncontrollably, is not good enough to evaluate. 5. The stem TELLS the applicant that there is an indication of a LOSS of inventory. Why not use that instead of teaching that. Don't tell the applicant what is going on. 6. G. Laska reviewed for verification of NOT SRO ONLY, he agrees. 7. KA appears to match. Thursday, September 29, 2011
1. NEW, LOWER, current question was MODIFIED from 45 day
submittal. 2. Question should NOT ask how operators would use, but how the SRO would direct! This would be a better indication of what we are asking the applicant to figure out. Discuss this with licensee. This is an enhancement. 3. This question while closer to the requirements of an SRO question is low level. 4. KA appears to match, not really close but close enough. 5. The question appears to be more common sense and can be answered with that. The first part is basic knowledge. The subcooling is decreasing and this will need to be fixed by being in the injection mode. 6. Why would anyone select distractors C and D with LOCA OUTSIDE CONTAINMENT? This does not seem plausible. Discuss with the licensee. WHY would an applicant pick these? 7. In the analysis, it is stated that EOP 2.5 will NOT be entered from mode 4. Need to understand this and why it is plausible. 8. Matches KA
9. Still considered a U because of the procedure selected. Thursday, October 13, 2011
U
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S 1. New question 2. Changed wording of initial conditions. 3. Changed PZR level that has level go from 60 to 30 in the time frame and do they enter 112.2, loca during mode 4. 4. Leak needs to be greater than the capacity of the CCP. Does the 60 to 30 do this? 5. Changed the time to 0415,
81 H 2-3
U 086A2.01, New, Higher, 1. Question is trivial. 2. Question can be salvaged by, removing in the stem not reset in the second bullet. It should read the pump has been shutdown
and the (whatever the switch is called is ) either OFF. Do not say it was reset. 3. This question is not SRO ONLY. The only part is the timeframe for which to return to operability. 4. What is the difference between a roving fire watch or a continuous fire watch? I believe they are the same. 5. Discussed with BC M. Widmann and G. Laska both believe the question is NOT SRO ONLY. Thursday, September 29, 2011
1. The licensee changed the question as discussed in # 2 above. However, the information provided does not appear to be correct. How is the switch labeled? Is there an AUTO position on the switch? If there is, then the switch was taken from the
AUTO to OFF/RESET. Not the ON position. Discuss with
licensee. 2. The distractors A and B are not credible. Why would anyone that is trained call something OPERABLE and then have a compensatory measure for it being OPERABLE. 3. Discuss with licensee
Thursday, October 13, 2011
New question and will be discussed later,
U ??
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only A lso, MM provided a NEW KA
Friday, October 14, 2011
New ka provided by MM.
0002A2.04 New question is SAT. See exam for new test item.
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 82 H 3 U 000007EG2.4.34, New, Higher, 1. Need to add the noun name of procedure AOP-600.01, 2. NOT SRO ONLY, this question requires an operator to determine if when transferring control of a pump to the Control Room Evacuation Panel (CREP) is Operable or Inoperable. This knowledge is not just the SROs in this case. The RO is
taught this and should know this for control of the pump as well as if it was not swapped to the local area for control. 3. The second part of the question concerns itself with the requirement of starting room coolers when starting equipment. This is a system requirement and the RO is taught this also to prevent failure of the equipment. 4. KA does NOT match. The KA was supposed to be written during a situation of Reactor-Trip Stabilization and Recovery, performed OUTSIDE the MCR during an emergency and the resultant operational effects. While this is OUTSIDE the control
room it is not during a reactor trip-. Thursday, September 29, 2011
1. This question was inserted into the examination at this point. 000007EG2.4.34, New, Higher, is the new question 7 or SRO 82 this questions was the # 9
in the first submittal. 2. AOP 600.1 at step 6 states 6 Attempt to start the Diesel Generator by depressing the ENGINE SHUT DOWN RESET Pushbutton Is this the step the analysis is talking about? Will this work in this case? Ask licensee to explain how this works. Stem of the question should ask what procedure to use and then what action the procedure should direct. For example, the answer should now read: AOP 600.1, Control Room Evacuation, start the "B" EDG. Now the stem does not identify the procedure is being asked. It starts with the action then a procedure. Also, it does not identify where the operator is going to operate MVT-8104. Discuss with licensee. Enhancements-------------------------------------------------------------Additional comments on 007EG2.4.34 as submitted in "2011 NRC SRO Test 2
nd Submittal" -need to ensure operators are in correct procedure-could 'A' be correct? Or, once 'B' EDG is started as per choice 'D,' based on the
note before steps 12-19 of AOP-600.1 would 'A' not also be correct?
-stem should probably state reason why control room was evacuated, otherwise FEP-4.0 could be the right procedure.
-not sure about operational validity-from AOP-600.1 step 12.d. Alernative Action
, wouldn't o
perator emer
genc y borate with AOP-
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only U S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 83 OLD H 2-3
X U 063A2.02, New, Higher, 1. KA does NOT match. The second part of the KA was not tested. It is required to test the (b) part of the KA when there is a two part KA. The (b) part required the question be written to use procedures to correct, control or mitigate. This question
does not do this. This question only identifies the generation of Hydrogen or Sulphuric acid vapors. Has nothing to do with procedure that will correct etc. .This makes this question
unsat.
Thursday, October 13, 2011 1. SAT At this point, the licensee submitted the Second submittal. This second submittal the numbers and KAs for each question was changed. Not sure why. As licensee why this was done. Starting with question 82 the KAs were swapped.
83 NEW H 2
S 063A2.02 Thursday, September 29, 2011
1. KA 063A2.02, was number 10 in submittal # 1, (S1) now it is question number 8 in Submittal # 2 (S2) 2. S1 it was higher new and now it is lower new. 3. In stem put quotes around XVA1A and commas as appropriate. i.e. "A charge of "A" Battery, "XBA1A," is in progress." This will
make this read better. 4. KA appears to match 5. The stem is a little confusin
g concerning the lifting of the lead and then the requirement to continue or recommence the charge. Has the charge ever been stopped because of the fans being found off? Ask licensee if this is important or not. 6. Otherwise appears to be ok. Thursday, October 13, 2011
1. Changed 14 days to 96 hours0.00111 days <br />0.0267 hours <br />1.587302e-4 weeks <br />3.6528e-5 months <br />. 96 hours0.00111 days <br />0.0267 hours <br />1.587302e-4 weeks <br />3.6528e-5 months <br />, nuisance annunciators, can open a link from 48 to extend the open to 96 hours0.00111 days <br />0.0267 hours <br />1.587302e-4 weeks <br />3.6528e-5 months <br />. What was wrong with 14 days. Operations does nothing in
14 days.
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 2. Changed back to 14 days. SAT QUESTION. 84 H 3 X
E 012A2.01, New, Higher, Summer Thursday, September 29, 2011
Question was changed from S1 1. Distractor D identifies just to SHUT down the reactor, however, A and B identify to be in HOT STANBY, this keys the applicant
that D is not totally correct, in that, the MODE is NOT listed. I believe that this makes this distractor not plausible. 2. For distractor A and B, is this plant terminology, "Initiate Measures -." Prepare for plant shutdown by XXXX to Hot Standby by XXX. 3. When the stem states asks for the MINIMUM action, does that mean the shortest action? Discuss with the licensee. 4. KA appears to match, this is a TS question, need to make sure that we do not have too many for the A2 KAs. 5. The distractors could be made such that the first two have the BS trip times added to the end of the statements and then have the opposite where the BS are tripped as in Distractor D and
then have the reactor down power done to hot standby. This would alleviate the unsymmetrical distractor part of C. Discuss with licensee. Thursday, October 13, 2011 1. NEW FORMAT and 2 x 2 question. 2. SAT S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 85 H 3 X
U Thursday, September 29, 2011 039G2.4.11, New, Higher,
1. Question was NOT changed from S1 to S2. 2. Question concerns itself with TS evaluation. We need to be careful with the use of TS questions. There were a lot before
and we may exceed or emphasis on TSs. 3. This question, needs a reference because it is greater than an hour. If the reference is presented, then the question as is written this would make it a direct look up. This makes the
questions unacceptable. 4. Main and reheat steam, could have used ARPs and maybe with a PORV that had failed open, maybe there could have been a
reportability call to make, i.e. an SRO ONLY type question. How long, who to call. 5. As the question is not Sat because of the call of TS greater than 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />, information not required to be memorized by operators. 6. Also in the stem could shorten action or actions by using
action(s).
IF the licensee validates that this knowledge is REQUIRED for the SRO, then this question could be Satisfactory. Discuss with licensee.
Thursday, October 13, 2011 1. NEW question, suggested by MM. 2. New question will require TS 3.7.1.2, 78 hours9.027778e-4 days <br />0.0217 hours <br />1.289683e-4 weeks <br />2.9679e-5 months <br />, 3 days plus
6. 3. REFERENCE will be provided.
SAT S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 86 H 2
U 00027AA2.01, New, Higher, Thursday, September 29, 2011
1. Question was re-written from S1 to S2. Minor changes to make consistent with other questions. 2. Analysis of the answer A states procedure step 10 a. however in EOP 1-2, this step is not the requirement for subcooling margin being greater than 52.2 F. This is in the foldout page but not in step 10a. Have licensee identify where this comes from. 3. Do not understand What the stem is asking, PZR level greater than the SI termination criterion is expected for this event and whether other conditions are met to transfer to EOP 1.2. have
the licensee explain what this is asking. 4. KA appears to match question -----------------------------------------------------------------------
Additional comments on 027AA2.01 as submitted in "2011 NRC SRO Test 2
nd Submittal" -not sure about SRO-only match on procedure selection, operators are not selecting a procedure but only staying in current procedure. Would it be better to ask expected procedural flowpath (i.e. E-1 to ES-1.2, then ES-1.3) or give four-choices of procedures with some additional info in stem? E.g. choose between staying in E-1, going to ES-1.2, going to ES-1.1, or going to ES-1.3 (WOG
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S designators). Otherwise Q is potential RO-level knowledge of SI
Termination criteria (e.g. subcooling value is foldout page item). -careful about teaching in answer choices-"subcooling is too low" should be "subcooling not met," etc. Thursday, October 13, 2011
1. Replaced.
2. Replacement ok.
SAT 87 H 3
S 000056EA2.06, New, Higher, Thursday, September 29, 2011
1. This question is the new number 12, but corresponds to the old # 15. 2. Question was made into a two part question/answer.
3. Question appears to be ok. 4. KA appears to match Thursday, October 13, 2011
1. Changed the graphic from 5% to 2%. Changed this because as soon as the SI pump is started it would or could be secured.
SAT. S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 88 H 3 E 076A2.01, New Higher
Monday, October 03, 2011 1. In the stem of the question, the Loop is identified with parenthesis. However, the last bullet the A train, should be the same "A" train. Also there is one extra space in the last bullet
between Pump and is. 2. SW is not defined until the first question. 3. In the second question in the stem there is a missing period.
4. The First question, should not be an "AN", it should be an A. Would recommend that this be re written to something like: Due to the "A" Service Water pump failure this
caused the -.. 5. What is the status of the "C" Service Water pump at this time? Per the figure provided for the start logic (Figure IB1.6), shouldn't the "C" service water pump auto-start on low header
pressure? If the pump is running, the answer choices may be
different. 6. As currently written, first part of distracters C. and D. are weak. Recommend changing first part of C. and D. to "The "A" Motor-Driven Emergency Feedwater Pump is OPERABLE." Thursday, October 13, 2011
1. Rewrote question in 2X 2
2. Appears to do all the above, SAT. S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 89 H 3 X
U K/A 103G2.4.18 NEW HIGHER Monday, October 03, 2011
1. Q appears to match K/A. Q appears to be SRO-only. 2. Q statement needs to specifically reference the EOP; for example, "Which ONE (1) of the choices below is correct in accordance with EOP-2.4?" 3. Second part of distracters C. and D. is not plausible. RWST would have to gravity drain through the RB spray header rings against a 40 psig differential pressure. 4. Need to lower RWST level to make securing a RB Spray pump more plausible-30% level is above the 18% setpoint to go to cold leg recirculation. 5. Question is U due to more than one non-plausible distractor.
Thursday, October 13, 2011
1. Wants to keep rwst level at 30%, 2. Changes the pressure of containment to 32 psig rather than 40
psig. 3. SAT with changes to C and D, see question for change.
S 90 H 3 X
E K/A 011G2.4.21 NEW HIGHER
Monday, October 03, 2011
1. Q appears to match K/A. Q appears to be SRO-only. 2. Operational validity/stem content: how would any SRO be
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S entering a YELLOW path procedure 15 minutes after a LBLOCA? Must increase the time frame to be operationally
valid. Did increase comment.
3. Stem needs to provide all criteria for critical safety path evaluation-for example, needs to include intermediate range power and startup rate values, containment pressure values,
and RHR sump level values. Thursday, October 13, 2011 1. SAT SAT 91 H 3
E G 2.2.38, Bank, Higher. 1. Question appears to be within the SRO knowledge requirements. 2. KA appears to match. 3. Question is kind of easy, not trivial but it does not require much cognitive skills to answer. 4. Why is the answer 92 days, is that the time frame you use for a Quarter?. 5. The description for the analysis for distractor A is incorrect. TS 4.0.3, allows up to 24 hours2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br />, so why is that not the reason for A rather than the applicant's miss-reading quarterly as Shiftly? That does not make sense. K/A G2.2.38
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S NEW HIGHER Monday, October 03, 2011 1. Q appears to match K/A. Q appears to be SRO-only. 2. Fourth bullet needs to explicitly match the language in the TS 4.0.3 for completing a risk assessment. For example, "A Risk Evaluation has been performed fo
r the surveillance, and has concluded that the risk associated with the delay of the
surveillance is
minimal." 3. For the distracters, need to specify time limit from the time of discovery; for example: A. Within the next 24 hours2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br /> from time of discovery B. Within the next 23 days from time of discovery C. Within the next 92 days from time of discovery D. Within the next 115 days from time of discovery" Friday, October 14, 2011
1. Question was replaced. See exam for question. 2. Presented question with word shiftly, GL states not terminology 3. Question is SAT. 92 F 3 X
U 072A2.03, New, Knowledge. 1. When a KA has a two part K or A if the question cannot be written to the part (a) and (b) then the goal is to write the question using the SRO portion of the K or A, meaning the (b) part of the KA. This question does not meet the (a) part, it does
not predict the impact. There is no justification why the (a) was not written in this question. 2. Procedures to correct. Part (b), this is a 30 day action, the questions indicates INITIAL action required if the power supply fails. There is no INITIAL action in any of the distractors. 3. The RM used in distractors C and D, RM-A4, would, if in service, alarm for ANY leak. 4. As written, this question is
unsat 5. Is the SRO required to know 14 day and 30 day TSs from
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S memory? Ask licensee, this seems unreasonable
K/A 072A2.03
LOWER Monday, October 03, 2011 1. Q is essentially unchanged from initial submittal. 2. Distractor "A" is potentially another correct answer. 3. Q is still U
4. Making the applicants recognize instruments that may or may not be in TS. Is this something you expect? Items are 7 days, 72 hours8.333333e-4 days <br />0.02 hours <br />1.190476e-4 weeks <br />2.7396e-5 months <br />?? Ask licensee. Friday, October 14, 2011
1. New KA provided by MM. 034K3.02 2. See new question, modified slightly from what was provided. Generic Comment: in two-part questions, it is better to indent the (1) and the (2) parts of the question statement (offset from the "Which ONE of the following") for readability.
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 93 F 2
U K/A 028G2.1.27 Monday, October 03, 2011
1. Q appears to match K/A. Q appears to be SRO-only. 2. Last bullet for temperatures needs degrees Fahrenheit (F) after the degree symbol.
3. Recommend modification to question statement as follows: "Based on the initial conditions, which ONE (1) of the following is correct in accordance with EOP-14.0?
did (1) How many hydrogen recombiners will be started? (2) What is the
next procedure transition?" 4. When would operators ever start both Hydrogen Recombiners at the same time? First part of distracters C. and D. are not
plausible. 5. Recommend potential fix for first part C. and D. to say "No recombiner will be started."
6. Correct spelling error for "Guideline" in all choices. 7. Q is U due to two non-plausible distracters.
Thursday, October 13, 2011
1. Changed as suggested.
2. SAT Satisfactory
S
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 94 H 3
U K/A WE13EA2.2 Monday, October 03, 2011
1. Q appears to match K/A. Q appears to be SRO-only level. 2. Distractor B. is not plausible because all MSIVs are closed, why would you dump steam from the B&C steam generators when
you had an option to use A? (distractor A.) Also it is not clear whether "dump steam" infers using steam dumps or steamline PORVs. 3. Distractor D. is not plausible because there is not physical steam supply from the A S/G to the turbine driven EFW pump. 4. Q is U due to two non-plausible distracters.
5. Need to move the last bullet ("Operators have entered EOP-15.1, STEAM GENERATOR OVERPRESSURE") to bullet number three. 6. Potential fix/recommendation: "Based on the given conditions, which ONE (1) of the following is the procedure and the action the CRS will direct? A. Remain in EOP-15.1, STEAM GENERATOR OVERPRESSURE, and dump steam from "A" Steam Generator steamline PORV. B. Remain in EOP-15.1, STEAM GENERATOR OVERPRESSURE, and initiate blowdown from the "A" Steam Generator. C. Transition to EOP-15.2, STEAM GENERATOR HIGH LEVEL, and dump steam from "A" Steam Generator steamline PORV. D. Transition to EOP-15.2, STEAM GENERATOR HIGH LEVEL, and initiate blowdown from the "A" Steam Generator. (new correct answer)
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S Thursday, October 13, 2011
1. Followed recommendations. \ 2. 2/2 format.
Satisfactory
95 H 3
E K/A WE08G2.4.21 NEW HIGHER
Monday, October 03, 2011
1. Q appears to match K/A. Q appears to be SRO-only 2. Valid with respect to physics and thermodynamics? RCS and RB pressures are matched-is there a LBLOCA in progress as
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S well as the steam line break? 3. Delete "30 minutes ago" from first Q statement. Again, do not believe conditions would be established as stated in 30 min
timeframe. 4. Distractor D. is not plausible, Recommend changing to "Remain in EOP-3.1, UNCONTROLLED DEPRESSURIZATION OF ALL
STEAM GENERATORS." 5. Change question statement to read: "WOOTF identifies the procedure the CRS will direct the crew to implement to
effectively mitigate this condition?" Friday, October 14, 2011
1. New question, did not follow the above recommendation.
2. Changed from what was presented slightly, see question for new sat question.
SAT 96 F 2
S K/A G2.3.14
Monday, October 03, 2011
1. Q appears to match K/A. Q appears to be SRO-only. 2. Q is SAT. Friday, October 14, 2011
1. The licensee wants to change this question based ONLY on the results of the everyone FAILED. Initially this question was validated by 2 SROs and was not an issue. The question was revalidated again because there were 5 individuals who Question would not be justifiable. The OLD version will be used.
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 97 F 2
E K/A G2.3.12
Monday, October 03, 2011
1. Q appears to match K/A. Q appears to be SRO-only. 2. Q is SAT as submitted . Tuesday, October 04, 2011
When is the RB Charcoal Clean up unit energized? Licensee needs to identify. This is from OAP 108.1 b. Determine if operation of four RBCU's (fast speed) per SOP-114 should be performed in
order to increase stay times for teams entering
containment. Why is D not also correct? Distractor C appears to be not plausible. Need to clarify or identify a special case for entering the RB and then Key off of that. Discuss. Thursday, October 13, 2011
1. ADDED in stem a DAC reference to make C more plausible, 2. Changed D to slow speed.
3. SAT Satisfactory.
S 98 H 2
S K/A G2.1.4
Monday, October 03, 2011
1. Q appears to match K/A. Q appears to be SRO-only. 2. Remove "to regain SRO proficiency" from distractor D. Thursday, October 13, 2011 SATISFACTORYs
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 99 F 2-3
U G 2.1.3, New, Lower 1. KA appears to match 2. Distracters C and D are not plausible. The situation for a reactor start up NO distractions would occur and therefore
implausible. This makes the SRO
functions trivial, there is no instance where an operator would select these. 3. Recommendation
Knowledge between long and short term turnovers. Use the 2 by 2 format to identify 2 items from each or something that is unique to the short and
not to the long.
Thursday, October 13, 2011
1. NEW QUESTION 2. OK SATISFACTOY
s 100
U 2.4.37, VCS CLOSED, Lower, 1. KA does NOT match, SRO ONLY, trivial knowledge 2. The answers for the second part are not really answered by the answers in the distracters. For example, what happens if the TSC is not manned but the ED takes command from the IED?
Should the question ask when is the IED relieved from his
duties? There is some information needed to the stem of the question.
Recommendation:
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other
6. U/E/S 7. Explanation
Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S 1. The ED declares that the cross connection of 1DA and 1DB is necessary for the protection of health and safety of the public. This would then help in the decision for the SS to comply with
the cross connection of the power supplies. There is a lot of information not identified that should be here. 2. The reference provided is associated with the EOP users Guide. The KA is the lines or authority during implementation of the EPlan. These are different. Thursday, October 13, 2011
1. SUGGESTED REPLACEMENT, DID NOT LIKE. VERY SIMPLE. Changed second part for the new question. Not ready yet.
VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination
Review Worksheet Form ES-401-9