ML18057B535

VC Summer 05000395/2011301 Exam Administrative Items 2C

ML18057B535
Person / Time
Site:	Summer
Issue date:	02/26/2018
From:	NRC/RGN-II
To:	South Carolina Electric & Gas Co
References
Download: ML18057B535 (118)

See also: IR 05000395/2011301

Text

VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 VC SUMMER 2011-301 EXAM REVIEW Instructions [Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.] 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level. 2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable). 3. Check the appropriate box if a psychometric flaw is identified: $ The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information). $ The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc). $ The answer choices are a collection of unrelated true/false statements. $ The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable. $ One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem). 4. Check the appropriate box if a job content error is identified: $ The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content). $ The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory). $ The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons). $ The question requires reverse logic or application compared to the job requirements. 5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable). 6. Based on the reviewer's judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory? 7. At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met). Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only Generic Issues. 1. In the stem of the question, need to determine if a period is or is not going to be used in the bulleted area of the ste Sometimes it is used and sometimes it is not. It does not matter which one just do it one way or the othe . For the first few questions that use annunciator windows in the stem or distractors, these are not written the sam Some have the panel some have the panel and tile number, we need to get that unifor . Reference material assembled is insufficient for examination review, system diagrams are not provided, key ARPs and AOPs not provide Appears that the littlest amount of material was provided for the review to take plac . Add to those questions where necessary, applicable procedures being used to accomplish the appropriate task This ensures validity of each questio VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 1 F 2 X E Question still needs work. Could be a U. 004K4.07, Task Master Ž question 4483 1. Distractor B is NOT plausibl In that, when does a single failure cause the system to actuate unless there is some other information provided in the stem to identify they have to think of thi Need to change this distracto . Characterized as Higher, this is a very low higher cognitive questio . KA appears to match Tuesday, October 04, 2011 1. Change provides values associated with the parameter identified in the distracto . Actual 3. Using the values, in B and C make them more implausibl HOW does the instrument failing HIGH, cause emergency makeup to occur? Actual have no relevance to the control system, so putting actual level does not hel Recommendation: 1. Develop a 2 by 2 question using 2. The design feature of what happens on the failure and then what operator actions are necessary to combat that failur ** Design feature of what happens, then operator actions to combat the failur This question needs more work, it is still an E. Or potentially a Thursday, October 13, 2011 1. Added actual in each of the NEW 2/2 questio . SA Satisfactory S

VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 2 H 2 S 012K6.03, New, 1. This question is kind of backwards logic, in that, it is you have to think of it failed? Not sure if this is a good way to ask thi . Were there any issues with reading this question? Based on evaluator revie Ask license . Do we need names of each of these or are they required to know that form memory. The licensee states that they are required to know this materia . Kind of simpl . KA appears to match Thursday, October 13, 2011 1. No changes, operators are required to know the P number . Still Sat. 3 H 3 S 011K4.03, Higher, New, 1. In distractor A, need to somehow identify the word NO, so the applicants do not miss i Bold, underline, don't care, pick one use it the same throughout the tes . Would it be better to add to 1) that will "eventually" cause a reactor trip? This may ensure that they have to evaluate the entire cycle like the analysis identifie . Ask licensee. 3. KA appears to match Tuesday, October 04, 2011 1. Still think in question number 1 that we bold an underline the NO before operator, like no. 2. Otherwise ok. Thursday, October 13, 2011 1. Made consistent with other question . Rearranged SERVE after ONLY, GL suggeste . Bolded in B and D, serve only VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 4 H 2 X E 016A2.01, Modified, Higher, Modified question was not supplied with packag . Not sure that the initial information in the stem has a real meaning to answer the questio Other than it provides a starting poin This can be removed from the stem. 2. The KA requires in the second part to use procedures, while this is sort of the way about it, but it does not state what procedure just the actions to accomplish the require Is there a way to add procedures in the second part rather than stating it in the stem? Ask licensee. 3. Add the word "the" prior to the word "failure" in the stem of the questio Just to clarify a littl Tuesday, October 04, 2011 1. The question as changed still does not meet the KA, in that, there is no procedure listed in the answe This is awkward! . Change the stem to read: WOOTF identifies the Resistance Temperature Detector (RTD) failure that would cause these indications and the appropriate operator actions in accordance with AOP 304.3, Continuous Control Ro Motion? 1. Remove the procedure from distracters A and . Add parenthesis around the A as in "A" for all distracters since parenthesis are used in the initial condition Make this a global change for all question This needs to be fixed before it is Satisfactor Thursday, October 13, 2011 1. Changed the second part to as if they had to enter the AOP or not to and for rods in MANUAL. Changes SA S VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 5 H 2-3 E 00005G2.1.31, New, Higher, 1. How is it known that the alarm provided is the one that comes in FIRST? Was this run on the simulator to prove that it actually is the first? Ask licensee. 2. Distractor C, P-12 is written differently here on this question than it was written on Question # Is there a reason why?

Should they read the same and change # 2 or does this provide information to help decide that on Question # 2 that the distractor it appears is NOT correct for eithe Discuss with license . KA while it is not a complete match, it appears to cover the question fairly well. OK 4. Not sure if distractor is plausibl Need to ask another examine Tuesday, October 04, 2011 1. Why was the question's stem changed? 2. As the question appears the change is o Now a Sat question Thursday, October 13, 2011 1. Changed the stem to be cleare See questio WOOTF will be received simultaneously with a feedwater isolation signal actuation? S 6 H/F 2-3 E 000007EK2.03, New, Higher, 1. The reference material identifies the annunciator to have "an intermittent fast flash." This is significant difference from the way the question is worde Recommend that the essence of these words be put in for the answer other distractors that use the same wording, ie. Distractor . Do not agree this is higher leve The first part of the question is memory, does a failure of the IR cause a rx tri Also second part of question, how does the alarm flas Also could be memor Discuss with licensee. 3. KA appears to matc Tuesday, October 04, 2011 1. Question was changed as requested, now satisfactory. S VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only Thursday, October 13, 2011 1. No further changes. Still satisfactor F 2-3 X U 000032AA.2.03, Modified, Knowledge (Fundamental)? 1. Remove from stem the word "choices" it is redundant and not necessar The first sentence can read, in almost every case, Which One of the following (WWOTF)-..describes, indicates. - 2. Modified question not supplied. 3. When were these new NI's installed? Was everyone in class when they were changed out? Or are the ONLY individuals who were around then were the SRO-Us? I would imagine that this is the cas IF this is true, then the plausibility of the OLD versus the NEW does not bode well for the plausibility. 4. The procedure provided actually states to verify AT and not ABOVE as the question indicate Could there be an issue with distractor B, in that, this may be close to the P-6 interlock (Source Range Permissive). Is this what we are looking at in this question? Discuss with licensee. 5. KA appears to NOT matc The KA asks the expected values of source range indication when high voltage is automatically remove This is for a LOSS of Source Range N Discuss with licensee. Tuesday, October 04, 2011 1. The question was entirely replaced with a new questio . The KA was changed at the request of the license The NEW KA is 000032AA2.06 3. Question matches KA, 4. Put a comma between EOP-12.0 and Monitoring Critical Safety Function . Otherwise, question appears to be Satisfactory. Thursday, October 13, 2011 No further changes still ok,. Made minor changes to ste S VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 8 H 3 E 000029EK2.06, New, Higher, 1. The question is kind of confusing, in that, the stem is asking about minimum number of malfunctions that would cause a failure of an automatic reactor trip during the situation presente Can this be worded a little differently? Is this like in the answer that there are three malfunctions? This does not make any sense to me. . 2. How did the evaluators do? 3. What reference are you going to give? Not sure if it is only going to be the print of the RTBs and bypass breakers and emergency borate flow. 4. Is it necessary to have the emergency borate flow there?

5. KA appears to Tuesday, October 04, 2011 1. This change removed the requirement for the use of a referenc . Question as changed is satisfactor Thursday, October 13, 2011 1. Scott P identified an issue with this questio Will discuss this on Frida Friday, October 14, 2011

SAT S 9 H 2-3 S 010A4.01, Bank, Higher, 1. KA appears to match\ 2. Question was used on Watts Bar last exam. 3. Not a hard questio Tuesday, October 04, 2011 Made a change to the IC, added statement for group 2 Backup heaters. No reason was provided for the added statemen Added 2. Appears to be Satisfactory VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only

10 U 063K4.04, New, Fundamental, 1. THE KA does not matc This is almost the way it can be but it is talking about DC power and Trips, this would be better to identify what electrical trips are not available for the DG or only the TRIPS associated with electrica BUT they do not mean the mechanical trips how to stop the D Loss of Electrical power causes the loss of most trips which ones do not get bypasse The DG overspeed and the DG reverse power tri This needs to be correcte Discuss with license Tuesday, October 04, 2011 2. Question was completely replace . The question asks what is the response of the EDG during the loss of All "A" train DC powe Ask it this way! The questionasks the response, which would indicate something shouldhappe However from the answer, nothing happen It is really asking what is the status of the EDG, running or tripped?This is the way it should be asked, that status, not respons . To make it more valid, need to add what test is being done sothat the operator understands what the situation is with the ED Can this be added to the initial condition ASKLICENSEE. 5. Each distractor has a loss of DC power, it is already asked inthe stem, it is not necessary in each distracto Remove thestatement due to a loss of DC power. 6. Same idea with second question, either there is or is notprotected. Therefore re write the question to read After the ICs E VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S WOOTF describes a) the status of the EDG following the loss of DCpower and b). the protection 1DA has from the 51 overcurrent tri A.) a.) EDG will trip b.) 1DA is protected by the 51 trip B.) a.) EG will trip b.) 1DA is not protected by the 51 trips C.) a.) EDG will remain running b.) 1DA is protected by the 51 trips D.) a.) EDG will remain running b.) 1DA is not protected by the 51 trips with this change it should be easier to read and will be Satisfactory.Licensee please make this change to this question and ensure we stillhave a valid questio Basically the question is ok, just look at the above and note the changesthat will help shorten and make it easier to read for the applicant Thursday, October 13, 2011 1. needed to add words to the stem to identify closer what wasbeing aske . Additionally, added output to the EDG breaker and the nounname to the breaker to be cleare SAT VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 11 F 2--3 U if #2 is correct and OK otherwise. 022K1.01, New, Fundamental, 1. KA appears to match 2. Distractors B and D second part do not seem plausibl After reading the analysis it seems like they may be ok, but, I am going to ask G. Laska, tomorrow to see how he feels about this part of the distracto It does not sit well with me, it seems to be easy to eliminate the Tuesday, October 04, 2011 1. Second part of distracters C and D have been change . Are there vacuum relief valves on the return lines of the RBCUs? This is a question I am not sure o Need to ask the licensee if this is a true statement or is it something made up. 3. This needs some more work to understand what is or is not happenin IS there something like what is described in distracters C and D available on any other system? Ask license If there is NO other system that has this kind of vacuum relief valves then these distractors are unsa Friday, October 14, 2011 1. Question was replace . See new question as SAT 3. SAT E/U s VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 12 H 2-3 E 064K1.05, Higher, VCS Closed Bank 1. Remove reason for DG will not start from the Main Control Room (MCR), faulty wirin All they need to know is it will not start from the MC Done 2. In the bulleted part, the A in the third bullet is not in quotes as it is in the stem of the questio Write it one way or the other, I do not care which method is used, just be consisten Same for distractor D with the "A" or just . The A distractor uses a period and the rest do not have periods, be consistent within and all question Either way is ok with me. 4. KA appears to match Wednesday, October 05, 2011 1. After reviewing this question again, the question asks if the EDGwill be prevented from coming up to spee It does not say start, it states come up to spee This is key in understanding 2. The air start system ONLY provides air to turn the crankshaft to allow the combustion cycle to start, that's what causes this to come up to spee The air system would not get the EDG to operating spee . If an operator ONLY depresses the air start system valve, does this then start the EDG or does the operator have to place a start signal to the circuit for the EDG to actually start? Was the action that INITIALLY started the EDG that locked IN? SO did the DG have a start signal that would allow the DG to run after the engine is turned over???? ASK LICENSE I am not sure that this is clear and if it is, then the distractors may not be plausibl DISCUSS. 4. ADD to the stem WOOTF -. IAW AOP 30 Is this the procedure Friday, October 14, 2011 SATISFACTORY S

VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 13 H 2-3 E W/E10EK3.4, BANK, VCS closed , higher 1. Is this abbreviation something the applicants would know, ESFLSs? Should we have it spelled out to begin with? Ask Licensee. 2. Why in the stem do we NOT use the actual procedure the crew would be in? 3. KA does it match? Well kind o The KA speaks to "adhered to and the limitations in the facility's license and amendments are not violated." This is not covered in this questio Discuss with 4. license Need to have another examiner review for KA match. Wednesday, October 05, 2011 1. The question as changed appears to be ok. 2. No further changes warrante Friday, October 14, 2011 Minor changes from validation comments, see exam for changes. ADDED MINIMUM in the stem SA S S 14 H 2 S 000057AA.2.12, MOD, VCS Closed, Highe . APN-5901 thru 5904, what is the noun name of that bus? Is there any? 2. Are operators expected to know this information from memory? 3. Is 5902 channel II? 4. Low level higher question, really is memory, how if not memorized anyone would know this. Wednesday, October 05, 2011 1. Question Matches KA 2. Why not add the high PZRP level alarm annunciator alarm that should come in also? Ask if this does come in and add it if it doe Discuss with license Minor enhancement, but it would make the question more technically correc . Other than that, it is appears to be o Friday, October 14, 2011 Added appropriate alarms that came in, as asked. 2. SATISFACTOR VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 15 H 2 X U 064A3.03, New, Higher, 1. Is there a noun name for XTF-31? If so, add it to the ste . Distractors C and D, second part are NOT plausibl The operator applicants all have observed DG starts and know that there is not a cycling of the frequency as describe Something better has to be use The way this is it is not plausibl This is describing sequencin Let's just say tha "Frequency fluctuates as the load sequencer sequences. " 3. The analysis does not describe the function of XTF-31 or where to find information about i No reference identifie . The stem is difficult to rea "Which choice below identifies the following with regard to-.." With regard to the A DG response, which one of the following (WOOTF). May read bette Use recommendation abov Should be a S the Wednesday, October 05, 2011 1. None of the suggestions were used. 2. Answer D is another correct answe This makes the question unsat. 3. D has to be changed to make this question sa Discuss with license Friday, October 14, 2011 1. SAT SEE EXAM CHANGE U S 16 F 2 X E/S 063A2.01, New, Lower, 1. The question's KA was replaced with 063A3.01. This should be in the header of the questio Replace 2.01 with 3.01 in the heade Otherwise, it does not make sense for the questio . It states Local indication, is there no location where battery voltage can be observed? This is not clear and should ensure this is not another provable answe Discuss with license VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only U 3. KA appears to matc Wednesday, October 05, 2011 1. Licensee identifies there is a LOCAL battery meter, provides a reference, reference was not submitted to identify that there are local battery meter Are there 126 v and 108 v system local meter . Licensee states that the procedure means in the reference "monitor Batter Bus Voltage throughout this procedure" implies the MC If this is the case WHY would anyone select LOCAL for reading the battery bus voltage? Why is it plausible? With this new information, distractors B and C are NOT plausibl Discuss with licensee. This makes this question UNSA Friday, October 14, 2011 CHANGES SAT

S 17 H 2-3 E 062A2.01, Bank, Higher, 1. Add to the stem the procedure they would actually be in. 2. Why is it necessary to add "on low flow" in both A and This is not necessary and can be delete . Why is it necessary for the 1 minute time after the event? Discuss with licensee. 4. KA appears to matc Wednesday, October 05, 2011 1. ADD to the question the procedure, SOP-XX the crew would be in, in addition, to the GO Is there another one to parallel the MTG? 2. Question modified as requested, appears to be SA Friday, October 14, 2011 1. SAT NO CHANGES MAD S S VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 18 H 2-3 S 045 G2.4.3, Bank, Higher. 1. Add noun name for 1A1 This may or may not be necessary 2. KA appears to almost matc This is a borderline analysi . The questions KA discusses use of annunciator alarms, indications or procedure response. The question uses a ARP that came in based on loss of a power suppl The correct answer analysis uses the AO The answer to the question does not use a procedure but identifies how the system work The question barely matches the KA. Discuss with licensee. 4. The manual adjustment of the field provides the reason for the first part of the questio This really has nothing to do with the procedur What is the response procedure we are answering in this question? Discuss with licensee Wednesday, October 05, 2011 1. Why was the question changed from the loss of 1A1X to the Regulator Core Alarm? This was not suggested in the above?

Discuss with licensee! SO IT WAS CLOSER TO KA 2. The new question provides information as to why the annunciator came i AND provides the ARP correct actions to address this even The skill set is different for answering this question than for the first questio . The first part of each distractor should have the words "-load will vary," with either "-load will increase," or "-load will decrease." This will then make the question more operationally vali What will have happen to the reactive or real loa Basically, as it sits the operator does not have to know what the action taken will d . Additionally, the second part of the question has to be re-written to the following: "-AND based on a over temperature condition how the Main Generator Voltage Regulator will respond." Currently, the question does not really identify that the condition is higher than the information provided in the I Recommendations:

If the above are followed the question will be considered SA Friday, October 14, 2011 S VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only MADE CHANGES TO THE QUESTIO See changes on exam SATISFACTOR VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 19 H 3 E 026K2.01, New, Higher, 1. I do not understand why the 480 v bus is a plausible distracto I understand what is written, however, I do not understand why that is plausibl . The analysis does not explain the function of the XCP-639 point 6-4 BUS 1DX LCKOUT 86 The ARP was not provide It should have bee . Does the Reactor building Spray pump get any control power from the 480V bus? Does the 480 V bus 1DA1 bus get powered from the 7.2KV Bus 1DA. 4. No information provided about the lockout 5. KA appears to matc Wednesday, October 05, 2011 1. The question stem was changed from the submitta The information asked for is in a different order than those of the answer The question stem asks for the location of the breaker and the ultimate power suppl The distractors answer the power supply and then where power comes fro The question does NOT elicit the answer Again, stem asks for the LOCATION of breaker and answers identify From power supply, ie from offsite power, from the A ED Doesn't Location mean the BUS it is on, 1DA, on or the building it bus sits i This now makes this question UNSAT. 2. I still do not believe that the 480 V bus is plausibl Discuss directly with licensee to understand why anyone would select A or B and that a Safety Related Motor would be ONLY 480 volts. While this was characterized as an E, it initially should have been characterized as a Regardless, of the characterization the question has two distractors that have been determined as implausible and therefore is UNSA The licensee did not provide a good reason why the less than competent operator would select a pump that is safety related and is powered from the 480V power suppl . IS 1 EA powered in this instance with 1 DA? What is the voltage of 1EA1 bus? Discuss if either of these buses are U VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S plausible under the plant conditions listed in the I Monday, October 17, 2011 1. #2 1DA is ok as a distractor because the rhr and spray pumps are in the same room, however, they are powered from different buse Question is sa H 2-3 E 001K2.01,Modified, Higher, 1. KA appears to match 2. So 1DA2 and 1DB2 are safeguards buses? I don't understand why these are plausible! It seems like we are comparing apples and oranges, in that, one is 7200v and the other is 480 Discuss with licensee 3. Need to understand why those in 2 are plausibl Wednesday, October 05, 2011 1. Why was the power supplies identified at the next lower voltage power? Why not use buses 1B3 and 1C2 as the alternate answers for distractors B and D? Discuss with licensee. 2. Why is the above not as good or better answer than 1A3X and 1C3X? 3. Question has two implausible distractors B and D, this is the same type of argument identified in question 19 using different power supplies one being a lower voltage than the othe Monday, October 17, 2011 1. Used the suggestion above, as 480 switch gea . SAT U S VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 21 F 3 X E/S 000055EA2.06. New, Knowledge, 1. No reference diagram for power line u Discussed in the analysis of the answer but that is hard if not impossible to understand without a diagra . Does the conditions of the stem put the plant in a Station Blackout? Not sure it doe Ask licensee. 3. The KA talks about clearing an item to allow re-energizatio The question concerns itself with preventing closin It's a little difference but it is not the KA requirement Discuss with license . Have licensee explain this question with reference Wednesday, October 05, 2011 1. Question is OK as it is. No further changes necessar Monday, October 17, 2011 1. Sat S 22 F 2-3 X U 0000056AK3.02, New, Knowledge, 1. KA appears to match 2. Distractors A and B do not make sense, in that, placing the Service Water pumps in PTL, Pull to Lock, does not make sense to remove the cooling medium for the EDG . The second part of B and D are not plausible to m To immediately provide a heat sink for CC This does not seem plausibl The system being without power, CCW that is, has no ability to cool anything, no heat transfer is being accomplished, so when power comes back the heat load on CCW should be low, so an IMMEDIATE requirement will not appeal to any of the applicant This needs to be changed. 4. Fix both sets of concern Wednesday, October 05, 2011 1. First issue was corrected, however, now we have numerous reasons for doing this. Why only 2 in the 2 by 2 forma . Second part of B is still not plausibl Needs to be fixe U VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S 3. Second part of second part of D needs to be replace Not plausible. 4. Use second part of C in B and then use the second part of A in Then it will be sat until fixed remains unsat. Monday, October 17, 2011 1. Followed the above suggestion. 2. Changed the order of distractors to have them look like the other questions. 3. Also changed the loss SAT 23 F 2 S 071A1.06, Modified, Knowledge, 1. In the stem, separate the wind direction from the spee Make wind speed a separate bulle . IS there a reason why the procedure that is governing the release is not being identified? I think it should be in the ste . What is actually going to be provided to the applicants for the reference? Is it just the SOP-119, Table A? IF so the reference should be ok to be provide . Original question not provide . KA appears to matc Wednesday, October 05, 2011 1. Question changed as requested, question SA Monday, October 17, 2011 1. SAT 24 F 2 X U 039A1.05, New, Knowledge, 1. KA speaks to Main and Reheat Steam and ability to predict and or monitor changes in Tave (without exceeding design limits) associated with operating the MRSS control What is the design limit in this question? Could use the 547 and 543 to make it a 2 by 2, but as it sits it does not matc . Distractor C does not appear to be plausible due to system alignment. 3. Also distractor D does not seem plausible because this is VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S something that is done for Every Reactor tri . The main issue with the question is that it does not prevent exceeding the limi How is this tested with current question? This needs to be changed to match the KA Ask License Wednesday, October 05, 2011 1. KA match addresse Appears to match now. 2. Change stem to add WOOTF based on the conditions provided-(this is a minor change to the modified question). 3. Question as changed is satisfactory. Monday, October 17, 2011 1. Used above # . Added 1 and 2 in stem added to the distractor . Reworded the ste . SAT 25 F 2-3 E 061K6.02, Bank, Knowledge 1. Simple1 line diagram not provide Cannot validate where valves are wrt the other valve Don't have time to look up every syste . KA appears to match 3. Is there a flow rate even associated with FCV 3546? Why would anyone think this valve has a runout feature also? Ask Licenee. 4. The stem is too word WOOTF completes the following statement? Which one of the following -.. That's all that is necessar Wednesday, October 05, 2011 1. Question changed as requeste . Only one minor change, should the word "RUNOUT" be identified in quotes as identified above? Not necessary but want to ensure that the applicants do not miss this wor . Otherwise appears to be satisfactory Monday, October 17, 2011 S VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only Changed minor, see exa Sa F 2-3 S 078K1.01, Bank, Knowledge 1. This KA was changed to have 1.03 vice 1.01, need to change the header to reflect this when exam is buil . KA appears to match Wednesday, October 05, 2011 1. Changed as requested, still satisfactor F 2 X U 000026AK3.02, New, Knowledge, 1. KA appears to matc . Distractors C and D, first part are not plausibl This makes this questions unsat. We need to come up with something that makes this question more plausibl Maximize the flow to the RHR heat exchangers is not plausibl This is a basic system knowledge to know that CCW flow would not increase during the injection phase of an acciden This does not make sense why anyone would pick thi How did the validation fare? Did anyone choose this? Need to replace this with something more plausibl Wednesday, October 05, 2011 1. Change to question appears to be a better choice, question is now considered satisfactory. Monday, October 17, 2011 1. Made minor change . SAT S VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 28 F 2-3 E 073K3.01, New, Knowledg . KA appears to matc . Distractors B and D, need to separate the other Valve and write it like, A & The way it is written is like the procedure and you could choose either valv This does not work for that and needs to be separate . How about swapping the second line in A and C and start with the word ONL This will be consistent with B and C where BOTH starts them of Discuss with Licensee. 4. What is the difference between XPB and PVB, are they considered the same? Explain. Wednesday, October 05, 2011 1. ALL comments addressed 2. Question is considered satisfactory Monday, October 17, 2011 1. SAT NO change S 29 H 2-3 E 2.3.11, Bank, Highe . Need to add to the stem the procedure the release is being done unde . It seems that there are a LOT of "A"s for answers, we need to look at the end of the exam and determine if we have too many one or the othe . Add another time prior to the answer and make the answer B, something like 0300 on 10/ Wednesday, October 05, 2011 1. Do not understand the comment in the second submitta I Still want to add some time prior to 10/06 at 2330 that will be wrong and will make answer B be the correct answe There are WAY to many A's or add two times and make the answer Either way, I would like to have an answer other than A. 2. Still E, until discussed with license E VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S Monday, October 17, 2011 1. Changed to 0300 on 10/ . Bolded and highlighted without in the stem. 3. Added additional quotes around tank letters and capitalized Tank and Deca See exam for the comment . SA F 2 E 103K4.04, New, Knowledge 1. KA appears to match. 2. Change "door" to "airlock" Wednesday, October 05, 2011 1. Understand requirements for airlock and airlock door or doors, however, do not understand both AIRLOCKS vent valve Have licensee explain this concept. 2. Otherwise appears to be Satisfactory. Monday, October 17, 2011 1. Sat no change S 31 F 2 S 022A4.02, Bank,Higher 1. KA appears to match. 2. Is the 2000 gpm minimum flow rate knowledge that the operators are expected to memorize? Wednesday, October 05, 2011 1. Comment, the word MINIMUM does not follow the convention used to identify other like aspects of what it is being identifie For example, it seems that it should be small letters with bolding and underlining minimum 2. Otherwise appears to be satisfactor Monday, October 17, 2011 1. Made minor change See exa . SAT S VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 32 F 2 x E 008A1.001,New,Knowledge 1. KA appears to match. 2. The stem of the first part of the question answers the second part. You open the header when flow reaches the ban Therefore, B and D distracters are not plausible. Wednesday, October 05, 2011 1. Understand issue with typo in the stem. 2. Question appears to be satisfactory. Monday, October 17, 2011 1. Sat as changed 2. Minor changes see exam. S 33 H 2 x X U 028AK2.03,Bank, Higher 1. KA does not matc Not pressurizer level malfunction. 2. A flow control valve that supplies a fluid to the system would never throttle closed in response to a low level signa Distracters A and D are not plausible. RSB Agree this question is unsat, it does not match the ka, it does cover controllers and positioners however, it does not cover anything with the Pressurizer Level malfunctio While this covers level control it does not match the intent of the K Wednesday, October 05, 2011 1. Disagree with KA match, the question concerns itself with charging flow now Pressurizer LEVEL malfunction Discuss with M Meeks to get his view on this analysi Until this is done, this question remains unsatisfactor Monday, October 17, 2011 1. New question has teaching in i This is a failure of the Controlling PZR level control 2. This may need to be run on the simulator to see how long 3. THIS QUESTION IS NOT CONSIDERED SAT TILL THIS IS U U?

VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only RUN ON THE TABLE TOP SIMULATO F 3 S 004A2.09, New, Knowledge 1. KA appears to match. Wednesday, October 05, 2011 1. No changes, still satisfactory

S 35 F 2 X E 007G2.4.18, New, Knowledge 1. KA appears to matc . 2. Distracters C. and D. are trivial during an EO If you have a valid safety injection, the operator is not going to be concerned about breaking or potentially breaking the rupture disks. RSB This question distractors C and D are not plausibl Above states exactly why would anyone think that there was a reason to vent to the PRT during a LOCA and S This does not make sense at al Additionally, this would make this question evaluation UNSAT since both C and D would be considered not plausibl Wednesday, October 05, 2011 1. Initially should have been analyzed as Unsatisfactory because it S VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only had two distractors that were not plausibl . Changed C only, appears to be ok. 3. Question appears to be satisfactory. Minor issue, change answer so that A is NOT the correct answer. Re arrange to make C the correct answer to better distribute the answers across A B and C and Monday, October 17, 2011 1. CHANGED AS REQUESTE ` 36 H 2 S 006A3.01, Bank, Higher 1. KA appears to matc Wednesday October 5, 2011 1. Can third bullet be deleted? Based on Appendix E brief, applicant should understand that automatic actions occurred unless explicitly given otherwise. 2. Verify with licensee shutoff head of RHR pumps-distractor analysis states that 350 psig is in RHR pressure band for decay heat removal. 3. Recommend adding "Based on the given plant conditions" to the question statement to be clear to applicant about time frame of question-because if time keeps moving, answer choice "C" will also be correc Q statement could say "Based on the plant conditions as given, which ONE (1) of the following-." Friday, October 14, 2011 1. Licensee implemented the suggestions abov . Question is still SA VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 37 H 2 X E 036AA2.03, Bank, Higher 1. KA appears to matc . 2. Distracters C. and D. do not appear to be very plausible considering the short time frame involve Answer C might be improved by being in a lowered inventory statu Answers D. and C. are similar in that you're trying to imply fuel damage due to inadequate cooling. Perhaps the 4th option could have something to do with dry storag Wednesday, October 05, 2011 1. Distractor B is not plausibl Applicant can easily differentiate between dropping a spent fuel assembly that has been irradiated for hundreds of days vs. dropping a brand new fuel assembly that hasn't been in the reactor core. 2. Can distractor D be a correct answer? Ref. lesson plan GS-05 fig. GS5.3 flowpath from 6669 to 6674 to 6681 to SFP purification pump to 6691 to RWS What is the maximum radiation field given whatever will be the height of spent fuel pool water above the 6669 valve siphon? 3. We don't need any information above the WOOTF statement-can be deleted. Friday, October 14, 2011 1. Verified that D is NOT the answe . Changed B, validation S 38 H 2 S 012K5.01, New Higher 1. KA appears to matc VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only E Wednesday, October 05, 2011 1. Need to bound the time frame that the question is asking-for example, 5 seconds? 10 seconds? after the spray valve is open and before the reactor trips. 2. Also need to mention before any operator action? Friday, October 14, 2011 1. Made the question easier to read and identified the 1 and 2 in stem and each distracto . Added Assume no operator actio S 39 H 3 S 07A4.10, Modified, Higher 1. KA appears to match. 2. GFE type question. 3. PRT Temperature is not required. 4. If the Pressurizer Code Safety is leaking, which ONE (1) of the following is the expected temperature as read on TI-465 (Use Noun Name)? Wednesday, October 05, 2011 1. Check the correct answer-using steam tables and interpolation should correct answer be 267 degrees F, not 260? 2. Delete first and second bullets as unnecessary?

3. Need to add "approximate" to the temperatures because some people will use Mollier diagram and some will interpolate, et E VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S For example, change Q statement to read as follows: "If a Pressurizer Code Safety valve is leaking, which ONE (1) of the following is the expected approximate temperature as read-." 4. Distractor 'D' is not plausible-recommend to come up with another wrong way to calculate an answer in the 200s range of temperature Having a single distractor 327 degrees F too big from three other answers is hard to believ Friday, October 14, 2011 1. Changed this as suggeste . SAT SAT 40 H 2 X S 005 K6.03, Modified, Higher 1. Sort of matches KA. 2. Distracter D is wea Why would anyone assume that the temperature recorder measured HX outlet onl Wednesday, October 05, 2011 1. K/A match is weak, willing to accept. 2. Q is OK as written. Friday, October 14, 2011 1. No change Ok as i H 2-3 S 041 K1.02, Modified, Higher 1. KA appears to matc Wednesday, October 05, 2011 1. Need to add that steam dumps are controlling in automatic pressure mode to second bullet? Implied by correct answer but VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only E not completely state added 2. Inserting control rods is not plausibl In the power range control rods ultimately control Tavg not reactor powe Every other choice involves a manipulation of the secondary syste Potential recommendation: "Raising the setpoint on the STM DUMP CNTRL potentiometer (clock)." 3. Is it necessary to add "potentially" to the question statement? i.e. "Which ONE (1) of the following actions would potentially cause a "swell" in S/G level?" I.e. what are effects of FRV operation, etc. 4. Need to provide current Tavg value in Q stem to make distractor A. more plausible (i.e. would actual Tavg be greater than 5 degrees higher than no load, which would lead someone to erroneously believe the steam dumps would open in Tavg mode?) Friday, October 14, 2011 1. Changed as selected, see exam for changes. 2. SAT SAT S 42 H 2-3 S 035 K6.01, Modified, Highe r 1. KA appears to match. 2. Correct answer uses similar thought process to 4 Wednesday, October 05, 2011 1. GFE question that examines same concepts-shrink vs. swell as 4 Low discriminatory value/no tie to plant-specific knowledge. 2. Change distractor C. to "Steam Generator "B" narrow range level will decrease" for parallelism with distractor B? 3. How is this question operationally valid? If the reactor should trip on an inadvertent MSIV closure, and it does not, operators E VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S are in an ATWS/FR-S.1 situation and steam generator parameters are irrelevant. 4. Potential double jeopardy with previous Q (#40)-applicant could potentially get two Q wrong if applicant has a misconception of shrink and swell phenomena. Friday, October 14, 2011 1. Completely new question to avoid double jeopardy with steam dumps. In 4 SATISFACTORY 43 H 2 S 003 K5.04, New, Higher 1. KA appears to match. 2. Not very discriminativ Just a GFE questio Thursday, October 06, 2011 1. How is it plausible to have higher steam flows with no change in steam generator pressure, or to have higher steam generator pressures with no change in steam flows? Need to discuss with licensee, may be o.k. if validators missed? Friday, October 14, 2011 1. sat s VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 44 F 2 X S 002 2.3.13, Modified, Knowledge 1. KA appears to match. 2. B and D are not plausibl Operators do not carry rad monitors. 3. Specifically identify the procedure in which these requirements exist. RSB The plausibility of B and D needs to be fixe Operators do not normally use rad monitors themselve Do they use them at Summer? I doubt it, see what we can do to identify a more plausible distracto Wednesday, October 05, 2011 1. DISAGREE with licensee concerning that the second part of distractors B and D are plausibl . NORMALLY the individual does NOT have the radiation monitoring devic The procedure does not allow an individual go to by them self. Change B and D to read: Must be accompanied by another operator who radiation monitor qualified with a radiation monitor. 3. How is 500 rads/hr plausible? How many system restoration valve lineups (i.e. normal ops) take place in a room posted with 500 rad/hr fields? Friday, October 14, 2011 1. CHANGED as requeste . The change has generic terminology concerning rad qualifie Need to change that 3. Removed 500 rads SATISFACTORY VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 45 F 2 X U 001 2.1.31, Bank, Knowledge KA does not matc KA discusses the ability to locate CR switches and indications and determine if they correctly reflect the desired plan lineu Wednesday, October 05, 2011 1. Question was replaced, 2. KA appears to match 3. With two protection channels failed high, you would not be in a 3.0.3 shutdown, the reactor would automatically tri Question as written is not operationally vali In either case (whether the Rx trips or not), what procedure would specifically direct operation of PORV PCV-444B (i.e. to ensure a single correct answer)? 4. Recommend adding "both" to first bullet: "-have both failed high." 5. There are multiple switches on the CREP panel-one is the isolation switch and one is the switch to position the valve/componen If Q is salvageable, the Q statement needs to reflect thi Recommend: "Which ONE (1) of the following describes the location of the switch (or switches) that will be used to control Pressurizer PORV PCV-444B and the correct position of that switch (or switches), in accordance with AOP-?? ?" 6. As written distractor A. is potentially correct, because those should be the at-power positions of the switches at the CREP. 7. Question is still U due to operational validity issues. Friday, October 14, 2011 1. NEW Question 2. See exam for change . SAT S 46 F 2 S 003 2.1.2, Modified, Knowledge KA appears to matc VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S Thursday, October 06, 2011 1. Recommend changing word "ones" to "operators" in the Q statement, would say "The NROATC and the CRS are the only operators present in the Control Room." 2. Otherwise Q looks SA Friday, October 14, 2011 1. SAT 47 F 2 X S or U 003 2.1.29, Bank, Knowledge Need to discuss if KA matche If it matches question is SAT. Wednesday, October 05, 2011 1. This question does NOT match the K Just because you ask the question associated with Component/Condition Verification , SAP 153, it does not match the K The question asked is more of a radiation questio . Ideas for questions associated with this KA, red tag procedure, locked valve procedure, expectations associated with second person verificatio . WHY should an RO know this from recognizing this value? One could possibly identify that this is an SRO only knowledg It would be better to rewrite this question and hit the KA better associated with valve line u Friday, October 14, 2011 1. New question, 2. Changed what was proposed. 3. SAT U S VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 48 F 2-3 S 003 2.4.25, Modified, Knowledge 1. KA appears to match. 2. KA importance rating for 2.4.25 is only Wednesday, October 05, 2011 1. Unsure as to WHY this question changed from the initial submittal. 2. UPON Further review, this question is considered UNSA When in ANY procedures does the RO/SRO/BOP operate DISCONNECT SWITCHES as Immediate operator actions. 3. Changes made in green (2nd part of distractors) look o.k. and are plausible given AOP-600.1 knowledge of the RO in-plant JPM "i" (where leaving one RCP running was a critical step).

The issue with the Q is that tripping the Reactor is such a strong correct choice as an immediate operator action that it may be hard to develop a second choice that is technically incorrect (when viewed against Rx trip) and plausible. 4. K/A covers all aspects of fire protection procedures, does not necessarily need to cover immediate actions of FEP-4.0. 5. Q is U due to two non-plausible distractor Friday, October 14, 2011 1. Chose to use disconnects for IPV-445a and b and BOP does not trip the reacto Rx trip is a duty of the R \ 2. Changes are sat 3. Question is sat SAT

U S VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 49 F 2-3 X E 003 2.4.34, Modified, Knowledge 1. KA does NOT fully matc Need to discuss tasks AND "resultant operational effects". Thursday, October 06, 2011 1. K/A is now met with the changes as made. 2. Q now looks SA Friday, October 14, 2011 SATISFACTOR S 50 F 3 S 086 K3.01, Modified, Knowledge 1. KA appears to match. 2. Supplied documentation does not fully support basis for correct answer or distracter Distracters appear valid based on limited documentatio Thursday, October 06, 2011 1. Questions 48, 49, and 50 all deal with FEP-4.0 and may present a potential "double jeopardy" for an applican For example, if an applicant has a misconception that train "A" is used during FEP-4.0 rather than train "B" the applicant may get both 49 and 50 wron Recommend licensee and chief examiner discuss to determine if this is acceptable. 2. Need to bound the time frame of actions performed within the scope of the Q-specifically, the attachments of FEP-4.0 specify that actions to black out the "A" ESF train and start turbine-

driven EFW pump need to be completed within 30 minute This needs to be reflected in the Q ste Potential fix to last E VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S bullet: "It has been 45 minutes (note to licensee: pick a technically correct time here, 35 min? 40 min? 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />?) since the crew began implementing FEP-4.0 CONTROL ROOM EVACUATION DUE TO FIRE." 3. If double jeopardy issues resolved to satisfaction, Q should be o.k. with changes as recommende Friday, October 14, 2011 1. BOUNDED THE TIME TO BE 45 min, all actions should be done by 30 minutes. 2. Changed as requeste See exam for changes 3. Question is SAT. SAT VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 51 H 3 S 003 2.4.31, New, Higher 1. KA appears to match. 2. Last bullet on given information does not appear to have any valu Thursday, October 06, 2011 1. K/A is met. 2. Distractor "D" is not plausible as writte The combination of leaving the RCPs running, in combination with a loss of all seal cooling, does not make any sens However, changing distractor "D" in a 2x2 format means that other aspects of the Q also have to change. 3. Potential recommendation: "Initial plant conditions: -100% power Current plant conditions: -XCP-612 pt 4, PHASE B ISOL, alarms -RB Spray pumps "A" and "B" are NOT running

-RB pressure is 0.4 psig and stable -all phase B automatic actions have occurred Based on the current conditions, which ONE (1) of the following states how RCPs should be operated, in accordance with ARP-001-XCP-612 for PHASE B ISOL; AND what is the status of RCP seal cooling? Trip all RCPs immediatel Seal cooling still exists. Trip all RCPs immediatel VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only E All seal cooling has been lost. RCP operation may continue as long as parameters remain within limits as displayed on IPCS ZZRCPBR Seal cooling still exists. RCP operation may continue as long as parameters remain within limits as displayed on IPCS ZZRCPBR All seal cooling has been lost." 4. Note: the reason it would not be recommended to simply insert the above first part of C. and D. into the Q as written now, is the LOCA in progres Specifically, RCP trip criteria is so well-known that if the LOCA progresses to the point that a valid phase B occurs, it is much less plausible to keep the RCPs runnin I.e., if the LOCA started out as a small enough SBLOCA that we didn't have to trip RCPs on the first pass through EOP-1.0/EOP-2.0, now the LOCA has gotten so big there's 12 psig into the RB-so the operators will be thinking shut down the RCPs even without the phase B actuation. Friday, October 14, 2011 1. Made the question into 2 by 2, good 2. SAT SAT S 52 H 2-3 S 002 G2.2.44, New, Higher KA appears to matc Thursday, October 06, 2011 1. Second part of distractors A. and C. are weak, because no RWST level to be worried about is provided in the Q ste VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only E 2. Recommendation: keep the distractors as shown, modify the Q statement to read something like "Given the following plant conditions: -The crew is responding to a Faulted Steam Generator (S/G)

-The S/G has blown dry -The crew has transitioned to EOP-1.2, SI TERMINATION -RCS pressure is increasing

-RWST level is 40% and slowly decreasing (licensee verify a good RWST level at this point) -"A" charging pump is running

-The crew has just secured the "B" charging pump Based on the given conditions, which ONE (1) of the following is the next required action, in accordance with EOP-1.2; AND why a reduction in SI flow should be done expeditiously?" Friday, October 14, 2011 1. Changed this to have just RWST is decreasin . SAT S 53 H 2-3 S 002 K5.14, New, Higher KA appears to matc Thursday, October 06, 2011 1. Potential issue is that the electronic references for EOP-4.0 rev 20 do not seem to have any steps that put in aux spray at steps 22 and 23 of EOP-4.0 (where the operators depressurize the RCS to refill pressurizer). However, there is a step at EOP-4.0 22.c.2) that closes PVT-8125? When would this valve ever be opened before this point in EOP-4.0? Is this a potential procedural error? Discuss with licensee. 2. This Q has overlap with a simulator JPM-applicants will be very familiar with steps 22 and 23 of EOP-4.0. 3. How is it plausible to put in aux spray if EOP-4.0 does not list that as an option at steps 22/23? E VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S 4. Potential fix: put the operators in EOP-4.2 (i.e. step 27) in the fifth bullet of the Q ste Maybe say something like "the operators are at the step to depressurize the RCS to reduce break flow in EOP-4.2, SGTR WITH LOSS-" Does the Q still work then-check with licensee? Since there is a chance to use aux spray in this procedure (EOP-4.2 vs. EOP-4.0), the plausibility issues are enhance Friday, October 14, 2011 1. Changed the starting point to EOP 4.2 at step 2 SATIFSACTORY 54 H 2 S 003 EA2.04, New, Higher KA appears to matc Thursday, October 06, 2011 1. Need to discuss with licensee the potential for first part of A. andC. to be correct-potential for C. to also be tru The provided distractor analysis for A. or C. does not discuss why primary to secondary leak flow has decreased is incorrec . If first part of A. and C. can be shown to be incorrect, Q should be SA Friday, October 14, 2011 1. SAT. F 2 S 002 EK1.3, Bank, Knowledge KA appears to matc VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only E Thursday, October 06, 2011 1. Q is low discriminatory value, operators who saw the EOP-2.5 simulator scenario (and resulting simulator "freeze" issue) will be very familiar with this Q and the correct answer. 2. Distractor C. is not plausibl Is there any procedure in the Westinghouse EOP network where SI flow rates are used as parameters? Recommend modifying C. to be "RCS subcooling" 3. Q should be o.k. with modification. Friday, October 14, 2011 1. Fixed distractor C 2. SAT S 56 F 2 S 009 EK1.02, New, Knowledge KA appears to match Friday, October 07, 2011 1. If the S/Gs are dry, answer choices to stop removing heat may be correc Need to add S/G levels to stem of Q to ensure RCS-to-S/Gs coupled in order for reflux boiling to occur? Maybe add a bullet to state: "All S/G narrow range levels are approximately 50% and stable." 2. Steam binding is a phenomena normally associated with pumps, not U-tube S/Gs, making the second part changes to A. and B. suspec Recommend "stop removing heat due to interruption of natural circulation." Ensure not too much overlap/potential double jeopardy with Q 53. 3. The time frame is also important in this Q, because if the hot legs are completely voided would reflux boiling be able to occur? Recommend modification to second Q statement as follows: "After RCS level decreases to the point that steam voiding has just begun to occur in the RCS hot leg-." Friday, October 14, 2011 E VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 1. Added all the recommendation . SAT 57 H 2 E KA appears to match Friday, October 07, 2011 1. Potential overlap with Q 52, ensure we're not putting the applicant in too much double jeopard Should be o.k. 2. The fact that every distractor except C. deals with Both RHR pumps gives it weak plausibilit Recommend either changing C. to "Both RHR pumps were stopped to conserve RWST inventory," or potentially changing B. to read something like "ONE (1) RHR pump was stopped to align to charging pump suction," if you want to keep C. as written-this will improve the parallelism of the Q. 3. Recommend adding "in accordance with EOP-2.0 LOSS OF REACTOR OR SECONDARY COOLANT" to the end of the WOOTF statement to clearly identify the source of the correct answer. Friday, October 14, 2011 Satisfactory, S 58 H 2 E 004 A2.01, Higher, New 1. KA appears to match. 2. Question uses much of the same information required to answer question 5 VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S Friday, October 07, 2011 1. Q looks SA SAT 59 H 2 X E 003 A1.2, Higher, New 1. KA appears to match. 2. For the choices give, "5% power level" could never be wron It is more severe than IR SUR positive, therefore without knowing anything else, if the SUR answer led to a red path, then the power range answer must to Friday, October 07, 2011 1. Q still has a potential subset issue/multiple correct answers, because if Intermediate Range SUR is positive, wouldn't Source Range SUR be positive as well? 2. Recommend modifying the Q statement as follows: "WOOTF- and the lowest Intermediate Range SUR indication that will result in an ORANGE path on the Subcriticality critical safety function, in accordance with EOP-12.0, MONITORING OF CRITICAL SAFETY FUNCTIONS? End of Life 0.1 DPM and stable End of Life 0.2 DPM and stable Beginning of Life 0.1 DPM and stable Beginning of Life 0.2 DPM and stable" Friday, October 14, 2011 1. Used recommendation. S VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 60 F 3 E E13 EK3.4, Knowledge, Bank KA appears to match Friday, October 07, 2011 1. This Q has overlap issues with SRO Q 94. 2. Need to understand the impact of the loss of instrument air header pressure-has it been long enough to bleed down MSIV accumulators and close all MSIVs? Issue is that if the condenser is "available," then EOP-15.1 step 8 alternate action would first have the operator locally operate steam dump valves before attempting to locally operate SG PORVs. 3. Distractor C is not plausibl Common knowledge that TDEFW pump has steam line sources from B & C S/Gs, not the A S/G. If the overlap issues can be resolved and it made clear that it has been a long-term loss of instrument air, changing distractor C. to say "Locally operate steam dump valves in all condenser sections to reduce affected SG pressure," may be a plausible candidate for replacing C. 4. Should delete "-based upon a yellow condition on the Heat Sink CSF status tree" as teaching in the stem; you can only get to EOP-15.1 on a yellow path. Friday, October 14, 2011 1. Changed no overlap issu . MSIVs no accumulators 3. Removed teaching from the stem. 4. In C removed in each condenser section. To each condenser like the procedur SAT S 61 F 2 S W/E15 EA get this from her Friday, October 07, 2011 1. Distractor B. is a subset of correct answer A faulted SG VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only inside containment would be one of the unexpected sources of wate Therefore B. is a non-plausible distractor. 2. Potential recommendation for B.: "Evaluate ECCS system status to determine strategy to transition to cold and hot leg injection." to play off distractor D. Friday, October 14, 2011 1. Changed B to look like SATISFACTORY 62 H 2-3 E 022 G2.4.11, Higher, Modified KA appears to match. 2. Using the word "Immediately" implies immediate actio Instead suggest using "which step will the AOP require first"? Friday, October 07, 2011 1. Q was modified as requested in first 401-9. 2. Q is of low discriminatory value, but acceptable. 3. Q now appears SAT. Friday, October 14, 2011 SAT S VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 63 F 2 X E 00024AK1.01 need to get this one from fil AK1.01, Knowledge, New KA slightly matches. 2. The question is NOT very discriminatin The candidates really do not need to understand the operational impact of the loss of RHR, the just need to know the max pressure and temperature that it can be put in servic A better question might put them outside one of the limits and have them determine that they cannot put it in service until they restore the paramete Friday, October 07, 2011 1. Q was modified as requested in first 401-9. 2. Could be acceptable Q if source is provided for correct answer-i.e. design limits based on what document? Westinghouse Design Basis Document for RHR system? VC Summer FSAR? Et Once source is specified, recommend listing it as an "in accordance with-" at the end of WOOTF statement. 3. Q may be o.k. with modifications as requested Friday, October 14, 2011 1. Changed question based on the comment from NR S 64 F 2-3 S 076 K3.05,Knowledge, New KA appears to match. 2. Answer is logica Does not appear to be adequate procedural documentation to ensure only one correct answe How long is RCS temperature expected to remain stable? Friday, October 07, 2011 E VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S 1. Distractor B is non-plausibl How would the condenser still be available? Recommend slight modification to read: "Dump steam using S/G PORVs." Friday, October 14, 2011 1. Version two uses SG PORV . Changed B to use MDAFW to feel one SG and use that S/G to depressurizatio F 3 X E 065 AA1.03, Knowledge, New 1. KA sort of matches. 2. KA is asking how to operate equipment when air is restore In other words, what do you need to do prior to restoring air to ensure you don't damage the plant or cause another transient when you restore ai Valve switches may be placed in hard open or closed (or gagged open or closed) to prevent repositioning upon air restoratio This question appears to be written from a standpoint of operating without air vice operating while restoring ai Friday, October 07, 2011 1. Q was modified as requested in initial 401-9. 2. Q now looks SA Friday, October 14, 2011 Validation identified that it was a gaging handwheel so had to change the stem to a valve that needed to be ungagge S S 66 F 2 X E 079 A4.01, Higher, New 1. KA appears to match. 2. Answer C is NOT plausibl Why would service air isolate before the backup compressor started?

VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S Friday, October 07, 2011 1. Q modified as requested in initial 401-9. 2. Q now looks SAT. Friday, October 14, 2011 1. Not higher level of knowledge otherwise o . SAT S 67 F 2-3 S 059 G2.4.11, Higher, Bank 1. KA appears to match. 2. Consider asking which AOP would they enter and what is the first action that would be taken. 3. Is it certain that manually controlling all three FRVs cannot cause SG levels to rise?

Friday, October 07, 2011 1. Distractor A. is still potentially correc For the given plant conditions, operators would meet entry conditions for AOP-210.1 and A. is the first immediate operator action of AOP-21 Also, use of the word "all" in distractor A. is a giveaway wor . If agreement can be reached that A. is clearly technically incorrect, recommend changing A. to read "take feed reg. valves to manual for the affected S/Gs." 3. If A. is not clearly incorrect, recommend development of new distractor to replace Would it be plausible to start additional condensate pumps or feedwater booster pumps? Friday, October 14, 2011 1. Changed A to start feed water booster pum . Changed the stem . see final exam for change . Sat SAT E S 68 H 3 S 077 AK3.02, Higher, New 1. KA appears to matc Friday, October 07, 2011 VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 1. Unsure about higher cognitive, Q can be answered via simple recall of AOP-301.1 CAUTION/first step. Should be Fundamental LO . Recommend adding "Based on the given conditions, -" to the WOOTF statement. 3. Otherwise Q looks SAT. Friday, October 14, 2011 1. SAT SAT 69 F 2 E 059 AK1.01, Knowledge, New 1. KA appears to match. 2. If this is knowledge that the operators are expected to memorize, it is O However it is not very discriminatin Specific to plan Friday, October 07, 2011 1. What microcuries/gm setpoint would correspond to a full Condensate Storage Tank? i.e. check to ensure A. and B. are incorrect. 2. As mentioned in first 401-9, not very discriminating; however, if above concern is resolved Q should be SAT. Friday, October 14, 2011 1. SAT as is, need to know spe SAT S 70 F 2 S 058 G2.2.36 Higher, New 1. KA appears to match. 2. Memorizatio No higher level ability required. 3. Not very discriminatin Any person knowledgeable of PWR operations could answe Friday, October 07, 2011 1. Q should be SA VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only Friday, October 14, 2011 sat 71 F 2 X S 003 3.01, Higher, New 1. KA appears to match. 2. Stopping dilution within 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> is part of the material below the lin ROs do not need to know this informatio This makes these distracters very wea Recommend using be in cold shutdown within 12 hours1.388889e-4 days <br />0.00333 hours <br />1.984127e-5 weeks <br />4.566e-6 months <br /> as a better distracte Friday, October 07, 2011 1. Potential subset issue-if second part of distracters B. and D. were correct, second part of distracters A. and C. are also correc . Also need to add "with no operator action" to the Q statement? Because FCV-122 is in MANUAL- 3. Potential fix for this issue would be to change WOOTF statement to read: "Which ONE(1) of the following describes an expected parameter trend if the running RHR pump trips with no other operator actions, and the required action as stated in Technical Specifications?" Friday, October 14, 2011 1. Fixed the subset issues. 2. Added with no operator actions to the ste SATISFACTORY E S VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 72 F 2 U 017 AK2.10, Knowledge, New 1. KA matches somewhat. 2. Memorizatio No higher level ability required. 3. Not very discriminatin Memorization of the trip setpoint and a basic understanding of reactor physics that any nuclear professional should hav Friday, October 07, 2011 1. This Q has multiple subset issue As written D. is a potentially correct answer along with Second part of A. and B. are not plausible because they would allow operators to restart a RCP at 100% power (current MODE is MODE 1), and because if the second part of A. and B. are true, then the second part of C. and D. are also true. 2. 311 degrees is also not plausible because it's too high-seal return would be superheated at this temp? (return flow at VCT pressure?) 3. Q as written is UNSAT due to the above issues. 4. Potential fix/recommendation: (delete the Given- and the bullets) In accordance with SOP-101, REACTOR COOLANT SYSTEM, which ONE (1) of the following correctly identifies: 1) The lowest seal water outlet temperature at which a RCP must be stopped. 2) The highest MODE in which a RCP can be restarted after the cause of the high temperature is corrected? ) 195 F 2) MODE 3 ) 195 F 2) MODE 4 ) 235 F 2) MODE 3 S VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only ) 235 F 2) MODE 4" Friday, October 14, 2011 Followed all recommendation SAT 73 H 2 X S 003 AK1.21 Higher, New 1. KA appears to match. 2. Not very discriminatin Bases for the plausibility of AFD being within the band is that the candidate must know that the surveillance requires 2/4 to be outside the band to be considered outside the ban Given that it is easy to see that two NIs are outside the band, the average person with no knowledge would declare it ou A more discriminating question would have three inside and one outsid VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only E Friday, October 07, 2011 1. Q was not changed given the recommendation of the first 401-9. As written, first part of Q is essentially a direct look-up on the 100% power line (points given on the provided reference). Therefore, with two values outside the acceptable region, plausibility of first part of A. and C. is weak. 2. Recommend changes to delta flux indications as follows: Before the Drop After the drop N41 -4.4% -3.6% N42 -4.4% -5.7%

N43 -4.4% -9.1%

N44 -4.4% -6.8% 3. Recommend changing the second half of the Q statement to "The BOP is required to maintain Tavg within a maximum of _____ of Tref, in accordance with AOP-403.5, STUCK OR MISALIGNED CONTROL ROD." 4. If the above changes are made, C. is the new correct answer. 5. Q should be ok with modification Friday, October 14, 2011 1. Sat as changed, it is a little different but ok 74 F 2 S 2.2.35, Knowledge, New KA appears to match Friday, October 07, 2011 1. K_eff values up to 0.99 are not plausibl How could you ever refuel at that value? Recommend making one first part choice E VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S "less than or equal to 0.90" and the other "less than or equal to 0.95" Temperature choices in the 2x2 are ok. 2. Another potential enhancement to WOOTF statement: "WOOTF - that can exist when the first Rx Vessel head bolt is detensioned in accordance with Technical Specifications?" Friday, October 14, 2011 1. Changed from 0.99 to 0.90, changed less than or equal to . F 3 S 003 2.2.37, Knowledge, Bank 1. KA appears to match. 2. Memorizatio Plant specifi Friday, October 07, 2011 1. Q appears to be SAT. Friday, October 14, 2011 S SRO ONLY Questions VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 76 H 3 E 017 AK2.10, Knowledge, New 4. KA matches somewhat. 5. Memorizatio No higher level ability required. 6. Not very discriminatin Memorization of the trip setpoint and a basic understanding of reactor physics that any nuclear professional should hav Friday, October 07, 2011 5. This Q has multiple subset issue As written D. is a potentially correct answer along with Second part of A. and B. are not plausible because they would allow operators to restart a RCP at 100% power (current MODE is MODE 1), and because if the second part of A. and B. are true, then the second part of C. and D. are also true. 6. 311 degrees is also not plausible because it's too high-seal return would be superheated at this temp? (return flow at VCT pressure?) 7. Q as written is UNSAT due to the above issues. 8. Potential fix/recommendation: (delete the Given- and the bullets) In accordance with SOP-101, REACTOR COOLANT SYSTEM, which ONE (1) of the following correctly identifies: 1) The lowest seal water outlet temperature at which a RCP must be stoppe VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S 2) The highest MODE in which a RCP can be restarted after the cause of the high temperature is corrected? ) 195 F 2) MODE 3 ) 195 F 2) MODE 4 ) 235 F 2) MODE 3 ) 235 F 2) MODE 4"

VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 77 H 2 X U W/E16G2.4.30, New, Higher, 1. Depending on the other questions, the reference provided should be the entire EAL matri This way the applicant at least has to find the section necessary to answer the questio IF ONLY the page that is associated with each question is provided then the question becomes a look up for only that item on that pag Suggest the entire EAL Matrix be provided, unless it helps answer other questions on the exam (RO or SRO) 2. An event occurred that increased (raised) the readings- Not sure it is necessary to say significan Also, reading should be plural, reading And at the end of the second bullet add the word "respectively." 3. KA does not match, reporting to agencies internal or external, not done, only classification is don Not notificatio Repair or replace Wednesday, September 28, 2011 1. Replacement questio New Lower, 2. Distractors C is NOT plausible, the stem of the question does not provide any substantive information concerning the information that would require the identification of offsite dose projection While the question analysis states that the INITIAL notification does not require the offsite dose projection, the question in the stem does not provide any information that would be used to do thi Additionally, the stem states offsite radiation is normal. 3. Distractor D is NOT plausibl This new question still warrants an evaluation of a Thursday, October 13, 2011 1. Changed to a 2 by 2 format. U VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only U 2. Event prognosis and estimated release duration was use . Stem has a radiation monitor that needs to be changed because there is a 309 that needs to be removed from the rad monitorl RMG-7 needs to be change ***** 4. Fission product matrix is use . PM states remove the 1 hou Added note to the make sure that the ED JUDGEMENT is NOT use .

• • • • • • still have to ensure that RMG-7 nomenclature is correcte F 2 X U G2.2.25, New, Lower, 1. Distractors with run out are not plausible A and This is a system knowledge item that is covered by everyone, not just SRO knowledg . The 13 gpm value listed in the question in C and D are also not vali In that, what or where does this number come up that would cause the operators to think it is plausible? Additionally, what did the results of the validation see for this question? Anyone pick anything but the correct answer? Did anyone pick D? or C? If not these most likely are not valid answers and not plausible. 3. Asked G. Laska concerning the evaluation of the questio He agree Thursday, September 29, 2011

VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S 1. Question was UNCHANGE The above evaluation still is vali Question is still a Thursday, October 13, 2011 1. The new question still has subset issue B and D can be also correc Subset issue Changes to this are necessary so it is bounde . Change maximum of 33 and a maximum of 3 This was changed during this meetin . JL asks what part is the SRO? 4. Had to change to maximum of vice less tha This included a less than 13 which would also be 33 gp . Also changed distracters to add during the design basis LOC . Changed pump to RC Question is satisfactor H 2 X U 000062AA2.03, New, Higher, 1. In the stem of the question, the "A" EDG is listed this way and A ED With or without quote Pick a standard for all questions and do it the sam . This information while in the basis of TSs, is not SRO ONLY knowledg . Question needs to be re-written to be at SRO level. 4. Verified with G. Laska to ensure it was NOT SRO ONLY, he VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S agree Thursday, September 29, 2011 1. Replacement questio New Lowe . Attempting is misspelled in the last bullet in the ste . Suggest to put a comma after the first line in each distractor, this will separate the answers 4. KA appears to match 5. Otherwise, this appears to be O How is Q lower cognitive? Should be higher cog based on evaluation of plant conditions, operability call required, etc.? Thursday, October 13, 2011

SATISFACTORY VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 80 H 2-3 U 00025AA2.04, New, Higher, 1. Use of period in bulleted area, one has all rest do not have periods 2. Question is NOT SRO ONL Systems knowledge can answer this without any knowledge of the procedur . The procedure is provided so the SRO does not have to identify what procedure to handle this in. 4. The PZR level is not described sufficiently, uncontrollably, is not good enough to evaluate. 5. The stem TELLS the applicant that there is an indication of a LOSS of inventor Why not use that instead of teaching that. Don't tell the applicant what is going o . G. Laska reviewed for verification of NOT SRO ONLY, he agree . KA appears to matc Thursday, September 29, 2011 1. NEW, LOWER, current question was MODIFIED from 45 day submitta . Question should NOT ask how operators would use, but how the SRO would direct! This would be a better indication of what we are asking the applicant to figure ou Discuss this with license This is an enhancement. 3. This question while closer to the requirements of an SRO question is low leve . KA appears to match, not really close but close enough. 5. The question appears to be more common sense and can be answered with tha The first part is basic knowledg The subcooling is decreasing and this will need to be fixed by being in the injection mod . Why would anyone select distractors C and D with LOCA OUTSIDE CONTAINMENT? This does not seem plausible. Discuss with the license WHY would an applicant pick these? 7. In the analysis, it is stated that EOP 2.5 will NOT be entered from mode Need to understand this and why it is plausibl . Matches KA 9. Still considered a U because of the procedure selecte Thursday, October 13, 2011 U VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S 1. New question 2. Changed wording of initial condition . Changed PZR level that has level go from 60 to 30 in the time frame and do they enter 112.2, loca during mode . Leak needs to be greater than the capacity of the CC Does the 60 to 30 do this? 5. Changed the time to 0415, 81 H 2-3 U 086A2.01, New, Higher, 1. Question is trivial. 2. Question can be salvaged by, removing in the stem not reset in the second bulle It should read the pump has been shutdown and the (whatever the switch is called is ) either OF Do not say it was rese . This question is not SRO ONL The only part is the timeframe for which to return to operabilit . What is the difference between a roving fire watch or a continuous fire watch? I believe they are the sam . Discussed with BC M. Widmann and G. Laska both believe the question is NOT SRO ONL Thursday, September 29, 2011 1. The licensee changed the question as discussed in # 2 abov However, the information provided does not appear to be correc How is the switch labeled? Is there an AUTO position on the switch? If there is, then the switch was taken from the AUTO to OFF/RESE Not the ON positio Discuss with licensee. 2. The distractors A and B are not credibl Why would anyone that is trained call something OPERABLE and then have a compensatory measure for it being OPERABL . Discuss with licensee Thursday, October 13, 2011 New question and will be discussed later, U ??

VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only Also, MM provided a NEW KA Friday, October 14, 2011 New ka provided by M A2.04 New question is SA See exam for new test ite VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 82 H 3 U 000007EG2.4.34, New, Higher, 1. Need to add the noun name of procedure AOP-600.01, 2. NOT SRO ONLY, this question requires an operator to determine if when transferring control of a pump to the Control Room Evacuation Panel (CREP) is Operable or Inoperabl This knowledge is not just the SROs in this cas The RO is taught this and should know this for control of the pump as well as if it was not swapped to the local area for contro . The second part of the question concerns itself with the requirement of starting room coolers when starting equipmen This is a system requirement and the RO is taught this also to prevent failure of the equipmen . KA does NOT match. The KA was supposed to be written during a situation of Reactor-Trip Stabilization and Recovery, performed OUTSIDE the MCR during an emergency and the resultant operational effect While this is OUTSIDE the control room it is not during a reactor trip-. Thursday, September 29, 2011 1. This question was inserted into the examination at this poin EG2.4.34, New, Higher, is the new question 7 or SRO 82 this questions was the # 9 in the first submitta . AOP 600.1 at step 6 states 6 Attempt to start the Diesel Generator by depressing the ENGINE SHUT DOWN RESET Pushbutton Is this the step the analysis is talking about? Will this work in this case? Ask licensee to explain how this work Stem of the question should ask what procedure to use and then what action the procedure should direc For example, the answer should now read: AOP 600.1, Control Room Evacuation, start the "B" ED Now the stem does not identify the procedure is being aske It starts with the action then a procedur Also, it does not identify where the operator is going to operate MVT-810 Discuss with license Enhancements-------------------------------------------------------------Additional comments on 007EG2.4.34 as submitted in "2011 NRC SRO Test 2nd Submittal" -need to ensure operators are in correct procedure-could 'A' be correct? Or, once 'B' EDG is started as per choice 'D,' based on the note before steps 12-19 of AOP-600.1 would 'A' not also be correct? -stem should probably state reason why control room was evacuated, otherwise FEP-4.0 could be the right procedur not sure about operational validity-from AOP-600.1 step 12.d. Alernative Action, wouldn't operator emergency borate with AOP-

VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only U S VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 83 OLD H 2-3 X U 063A2.02, New, Higher, 1. KA does NOT matc The second part of the KA was not teste It is required to test the (b) part of the KA when there is a two part K The (b) part required the question be written to use procedures to correct, control or mitigat This question does not do thi This question only identifies the generation of Hydrogen or Sulphuric acid vapor Has nothing to do with procedure that will correct et .This makes this question unsa Thursday, October 13, 2011 1. SAT At this point, the licensee submitted the Second submitta This second submittal the numbers and KAs for each question was change Not sure wh As licensee why this was don Starting with question 82 the KAs were swappe NEW H 2 S 063A2.02 Thursday, September 29, 2011 1. KA 063A2.02, was number 10 in submittal # 1, (S1) now it is question number 8 in Submittal # 2 (S2) 2. S1 it was higher new and now it is lower ne . In stem put quotes around XVA1A and commas as appropriat i.e. "A charge of "A" Battery, "XBA1A," is in progress." This will make this read bette . KA appears to match 5. The stem is a little confusing concerning the lifting of the lead and then the requirement to continue or recommence the charg Has the charge ever been stopped because of the fans being found off? Ask licensee if this is important or no . Otherwise appears to be o Thursday, October 13, 2011 1. Changed 14 days to 96 hour0.00111 days <br />0.0267 hours <br />1.587302e-4 weeks <br />3.6528e-5 months <br /> hours, nuisance annunciators, can open a link from 48 to extend the open to 96 hour0.00111 days <br />0.0267 hours <br />1.587302e-4 weeks <br />3.6528e-5 months <br /> What was wrong with 14 day Operations does nothing in 14 day VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 2. Changed back to 14 day SAT QUESTIO H 3 X E 012A2.01, New, Higher, Summer Thursday, September 29, 2011 Question was changed from S1 1. Distractor D identifies just to SHUT down the reactor, however, A and B identify to be in HOT STANBY, this keys the applicant that D is not totally correct, in that, the MODE is NOT liste I believe that this makes this distractor not plausibl . For distractor A and B, is this plant terminology, "Initiate Measures -." Prepare for plant shutdown by XXXX to Hot Standby by XX . When the stem states asks for the MINIMUM action, does that mean the shortest action? Discuss with the license . KA appears to match, this is a TS question, need to make sure that we do not have too many for the A2 KA . The distractors could be made such that the first two have the BS trip times added to the end of the statements and then have the opposite where the BS are tripped as in Distractor D and then have the reactor down power done to hot standb This would alleviate the unsymmetrical distractor part of Discuss with license Thursday, October 13, 2011 1. NEW FORMAT and 2 x 2 questio . SAT S VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 85 H 3 X U Thursday, September 29, 2011 039G2.4.11, New, Higher, 1. Question was NOT changed from S1 to S2. 2. Question concerns itself with TS evaluatio We need to be careful with the use of TS question There were a lot before and we may exceed or emphasis on TS . This question, needs a reference because it is greater than an hou If the reference is presented, then the question as is written this would make it a direct look u This makes the questions unacceptable. 4. Main and reheat steam, could have used ARPs and maybe with a PORV that had failed open, maybe there could have been a reportability call to make, i.e. an SRO ONLY type questio How long, who to cal . As the question is not Sat because of the call of TS greater than 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />, information not required to be memorized by operator . Also in the stem could shorten action or actions by using action(s). IF the licensee validates that this knowledge is REQUIRED for the SRO, then this question could be Satisfactor Discuss with license Thursday, October 13, 2011 1. NEW question, suggested by M . New question will require TS 3.7.1.2, 78 hours9.027778e-4 days <br />0.0217 hours <br />1.289683e-4 weeks <br />2.9679e-5 months <br />, 3 days plus . REFERENCE will be provide SAT S VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 86 H 2 U 00027AA2.01, New, Higher, Thursday, September 29, 2011 1. Question was re-written from S1 to S Minor changes to make consistent with other question . Analysis of the answer A states procedure step 10 however in EOP 1-2, this step is not the requirement for subcooling margin being greater than 52.2 This is in the foldout page but not in step 10 Have licensee identify where this comes from. 3. Do not understand What the stem is asking, PZR level greater than the SI termination criterion is expected for this event and whether other conditions are met to transfer to EOP have the licensee explain what this is askin . KA appears to match question -----------------------------------------------------------------------

Additional comments on 027AA2.01 as submitted in "2011 NRC SRO Test 2nd Submittal" -not sure about SRO-only match on procedure selection, operators are not selecting a procedure but only staying in current procedure. Would it be better to ask expected procedural flowpath (i.e. E-1 to ES-1.2, then ES-1.3) or give four-choices of procedures with some additional info in stem? E.g. choose between staying in E-1, going to ES-1.2, going to ES-1.1, or going to ES-1.3 (WOG VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S designators). Otherwise Q is potential RO-level knowledge of SI Termination criteria (e.g. subcooling value is foldout page item). -careful about teaching in answer choices-"subcooling is too low" should be "subcooling not met," et Thursday, October 13, 2011 1. Replaced. 2. Replacement o SAT 87 H 3 S 000056EA2.06, New, Higher, Thursday, September 29, 2011 1. This question is the new number 12, but corresponds to the old # 1 . Question was made into a two part question/answe . Question appears to be ok. 4. KA appears to match Thursday, October 13, 2011 1. Changed the graphic from 5% to 2%. Changed this because as soon as the SI pump is started it would or could be secure SA S VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 88 H 3 E 076A2.01, New Higher Monday, October 03, 2011 1. In the stem of the question, the Loop is identified with parenthesis. However, the last bullet the A train, should be the same "A" trai Also there is one extra space in the last bullet between Pump and i . SW is not defined until the first questio . In the second question in the stem there is a missing perio . The First question, should not be an "AN", it should be an Would recommend that this be re written to something like: Due to the "A" Service Water pump failure this caused the -.. What is the status of the "C" Service Water pump at this time? Per the figure provided for the start logic (Figure IB1.6), shouldn't the "C" service water pump auto-start on low header pressure? If the pump is running, the answer choices may be different. 6. As currently written, first part of distracters C. and D. are wea Recommend changing first part of C. and D. to "The "A" Motor-Driven Emergency Feedwater Pump is OPERABLE." Thursday, October 13, 2011 1. Rewrote question in 2X 2 2. Appears to do all the above, SAT. S VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 89 H 3 X U K/A 103G2.4.18 NEW HIGHER Monday, October 03, 2011 1. Q appears to match K/ Q appears to be SRO-only. 2. Q statement needs to specifically reference the EOP; for example, "Which ONE (1) of the choices below is correct in accordance with EOP-2.4?" 3. Second part of distracters C. and D. is not plausibl RWST would have to gravity drain through the RB spray header rings against a 40 psig differential pressure. 4. Need to lower RWST level to make securing a RB Spray pump more plausible-30% level is above the 18% setpoint to go to cold leg recirculation. 5. Question is U due to more than one non-plausible distracto Thursday, October 13, 2011 1. Wants to keep rwst level at 30%, 2. Changes the pressure of containment to 32 psig rather than 40 psi . SAT with changes to C and D, see question for chang S 90 H 3 X E K/A 011G2.4.21 NEW HIGHER Monday, October 03, 2011 1. Q appears to match K/ Q appears to be SRO-only. 2. Operational validity/stem content: how would any SRO be VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S entering a YELLOW path procedure 15 minutes after a LBLOCA? Must increase the time frame to be operationally valid. Did increase commen . Stem needs to provide all criteria for critical safety path evaluation-for example, needs to include intermediate range power and startup rate values, containment pressure values, and RHR sump level values. Thursday, October 13, 2011 1. SAT SAT 91 H 3 E G 2.2.38, Bank, Highe . Question appears to be within the SRO knowledge requirement . KA appears to match. 3. Question is kind of easy, not trivial but it does not require much cognitive skills to answe . Why is the answer 92 days, is that the time frame you use for a Quarter?. 5. The description for the analysis for distractor A is incorrec TS 4.0.3, allows up to 24 hours2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br />, so why is that not the reason for A rather than the applicant's miss-reading quarterly as Shiftly? That does not make sens K/A G2.2.38 VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S NEW HIGHER Monday, October 03, 2011 1. Q appears to match K/ Q appears to be SRO-only. 2. Fourth bullet needs to explicitly match the language in the TS 4.0.3 for completing a risk assessmen For example, "A Risk Evaluation has been performed for the surveillance, and has concluded that the risk associated with the delay of the surveillance is minimal." 3. For the distracters, need to specify time limit from the time of discovery; for example: Within the next 24 hours2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br /> from time of discovery B. Within the next 23 days from time of discovery C. Within the next 92 days from time of discovery D. Within the next 115 days from time of discovery" Friday, October 14, 2011 1. Question was replace See exam for questio . Presented question with word shiftly, GL states not terminology 3. Question is SA F 3 X U 072A2.03, New, Knowledg . When a KA has a two part K or A if the question cannot be written to the part (a) and (b) then the goal is to write the question using the SRO portion of the K or A, meaning the (b) part of the K This question does not meet the (a) part, it does not predict the impac There is no justification why the (a) was not written in this questio . Procedures to correct. Part (b), this is a 30 day action, the questions indicates INITIAL action required if the power supply fail There is no INITIAL action in any of the distractor . The RM used in distractors C and D, RM-A4, would, if in service, alarm for ANY lea . As written, this question is unsat 5. Is the SRO required to know 14 day and 30 day TSs from VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S memory? Ask licensee, this seems unreasonable K/A 072A2.03 LOWER Monday, October 03, 2011 1. Q is essentially unchanged from initial submittal. 2. Distractor "A" is potentially another correct answer. 3. Q is still U 4. Making the applicants recognize instruments that may or may not be in T Is this something you expect? Items are 7 days, 72 hours8.333333e-4 days <br />0.02 hours <br />1.190476e-4 weeks <br />2.7396e-5 months <br />?? Ask license Friday, October 14, 2011 1. New KA provided by M K3.02 2. See new question, modified slightly from what was provide Generic Comment: in two-part questions, it is better to indent the (1) and the (2) parts of the question statement (offset from the "Which ONE of the following") for readabilit VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 93 F 2 U K/A 028G2.1.27 Monday, October 03, 2011 1. Q appears to match K/ Q appears to be SRO-only. 2. Last bullet for temperatures needs degrees Fahrenheit (F) after the degree symbo . Recommend modification to question statement as follows: "Based on the initial conditions, which ONE (1) of the following is correct in accordance with EOP-14.0? did (1) How many hydrogen recombiners will be started? (2) What is the next procedure transition?" 4. When would operators ever start both Hydrogen Recombiners at the same time? First part of distracters C. and D. are not plausible. 5. Recommend potential fix for first part C. and D. to say "No recombiner will be started."

6. Correct spelling error for "Guideline" in all choices. 7. Q is U due to two non-plausible distracter Thursday, October 13, 2011 1. Changed as suggested. 2. SAT Satisfactory S VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 94 H 3 U K/A WE13EA2.2 Monday, October 03, 2011 1. Q appears to match K/ Q appears to be SRO-only level. 2. Distractor B. is not plausible because all MSIVs are closed, why would you dump steam from the B&C steam generators when you had an option to use A? (distractor A.) Also it is not clear whether "dump steam" infers using steam dumps or steamline PORVs. 3. Distractor D. is not plausible because there is not physical steam supply from the A S/G to the turbine driven EFW pump. 4. Q is U due to two non-plausible distracter . Need to move the last bullet ("Operators have entered EOP-15.1, STEAM GENERATOR OVERPRESSURE") to bullet number three. 6. Potential fix/recommendation: "Based on the given conditions, which ONE (1) of the following is the procedure and the action the CRS will direct? Remain in EOP-15.1, STEAM GENERATOR OVERPRESSURE, and dump steam from "A" Steam Generator steamline PORV. B. Remain in EOP-15.1, STEAM GENERATOR OVERPRESSURE, and initiate blowdown from the "A" Steam Generator. C. Transition to EOP-15.2, STEAM GENERATOR HIGH LEVEL, and dump steam from "A" Steam Generator steamline PORV. D. Transition to EOP-15.2, STEAM GENERATOR HIGH LEVEL, and initiate blowdown from the "A" Steam Generator. (new correct answer)

VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S Thursday, October 13, 2011 1. Followed recommendations. \ 2. 2/2 forma Satisfactory 95 H 3 E K/A WE08G2.4.21 NEW HIGHER Monday, October 03, 2011 1. Q appears to match K/ Q appears to be SRO-only 2. Valid with respect to physics and thermodynamics? RCS and RB pressures are matched-is there a LBLOCA in progress as VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S well as the steam line break? 3. Delete "30 minutes ago" from first Q statement. Again, do not believe conditions would be established as stated in 30 min timeframe. 4. Distractor D. is not plausible, Recommend changing to "Remain in EOP-3.1, UNCONTROLLED DEPRESSURIZATION OF ALL STEAM GENERATORS." 5. Change question statement to read: "WOOTF identifies the procedure the CRS will direct the crew to implement to effectively mitigate this condition?" Friday, October 14, 2011 1. New question, did not follow the above recommendatio . Changed from what was presented slightly, see question for new sat question. SAT 96 F 2 S K/A G2.3.14 Monday, October 03, 2011 1. Q appears to match K/ Q appears to be SRO-only. 2. Q is SAT. Friday, October 14, 2011 1. The licensee wants to change this question based ONLY on the results of the everyone FAILED. Initially this question was validated by 2 SROs and was not an issu The question was revalidated again because there were 5 individuals who Question would not be justifiabl The OLD version will be use VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 97 F 2 E K/A G2.3.12 Monday, October 03, 2011 1. Q appears to match K/ Q appears to be SRO-only. 2. Q is SAT as submitted . Tuesday, October 04, 2011 When is the RB Charcoal Clean up unit energized? Licensee needs to identif This is from OAP 108.1 b. Determine if operation of four RBCU's (fast speed) per SOP-114 should be performed in order to increase stay times for teams entering containmen Why is D not also correct? Distractor C appears to be not plausibl Need to clarify or identify a special case for entering the RB and then Key off of tha Discus Thursday, October 13, 2011 1. ADDED in stem a DAC reference to make C more plausible, 2. Changed D to slow spee . SAT Satisfactor S 98 H 2 S K/A G2. Monday, October 03, 2011 1. Q appears to match K/ Q appears to be SRO-only. 2. Remove "to regain SRO proficiency" from distractor D. Thursday, October 13, 2011 SATISFACTORYs VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 99 F 2-3 U G 2.1.3, New, Lower 1. KA appears to match 2. Distracters C and D are not plausibl The situation for a reactor start up NO distractions would occur and therefore implausibl This makes the SRO functions trivial, there is no instance where an operator would select these. Recommendation

Knowledge between long and short term turnover Use the 2 by 2 format to identify 2 items from each or something that is unique to the short and not to the lon Thursday, October 13, 2011 1. NEW QUESTION 2. OK SATISFACTOY s 100 U 2.4.37, VCS CLOSED, Lower, 1. KA does NOT match, SRO ONLY, trivial knowledge 2. The answers for the second part are not really answered by the answers in the distracter For example, what happens if the TSC is not manned but the ED takes command from the IED?

Should the question ask when is the IED relieved from his duties? There is some information needed to the stem of the questio Recommendation:

VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other U/E/S Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S 1. The ED declares that the cross connection of 1DA and 1DB is necessary for the protection of health and safety of the publi This would then help in the decision for the SS to comply with the cross connection of the power supplies. There is a lot of information not identified that should be here. 2. The reference provided is associated with the EOP users Guide. The KA is the lines or authority during implementation of the EPla These are differen Thursday, October 13, 2011 1. SUGGESTED REPLACEMENT, DID NOT LIK VERY SIMPL Changed second part for the new questio Not ready ye VC Summer 2011-301 Examination ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 ES-401, Rev. 9 2 Form ES-401-9