ML15084A253

2015-03 Draft Exam Comments ES-401-9

ML15084A253
Person / Time
Site:	Comanche Peak
Issue date:	03/23/2015
From:	Vincent Gaddy Operations Branch IV
To:	Luminant Generation Co
References
50-445/OL-15, 50-446/OL-15
Download: ML15084A253 (15)

Text

ES-401 CP-201 5-03 Written Examination Review Worksheet Form ES-401-9 Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

$ The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

$ The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

$ The answer choices are a collection of unrelated true/false statements. $ The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

$ One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem). 4. Check the appropriate box if a job content error is identified:

$ The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content). $ The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory). $ The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons). $ The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO

-only (K/A and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES

-401 Section D.2.f

. 7. Based on the reviewer's judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).

Attachment 8 Page 1 of 15 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 1 F 2 X N E S

GENERAL COMMENT

- The questions have been renumbered, as evidenced by the numbers assigned not matching those on the outline rejection list (Form ES

-401-4). Resolve on final copy of Form ES

-401-4. General Comment has been address in the outlines.

B, CR, 41.7

- If an SI occurs, and pressurizer level is above band, does the CCP flow control valve go full shut? If so, you could argue that there are conditions where seal injection is isolated after an SI

- so to say that it "will not isolate" would not necessarily be completely true. Could reword second half of question as "Seal injection flow to the RCPs [isolates/does NOT isolate] on a safety injection signal.

The CCP minimum flow control valve maintains a minimum of 55 gpm seal flow in AUTO. To isolate, the operator would have to take the valve control to Manual and throttle it closed.

Suggested wording change made.

2 H 3 N S D, CR, 41.5

ES-401 CP-2015-03 2 Form ES-401-9 Attachment 8 Page 2 of 15 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 3 F 3 X N E S B, CR, 41.5

- The term "these relief valves" is ambiguous

- could be read to include PORVs. Combine the two question statements to read: "_________ relief valves are allowed to be substituted for PRZR PORVs for LTOP protection and would be ________ with RCS pressure at 435 psig.

Proposed revision made.

4 F 3 X N E S C, CR, 41.5

- The proposed question doesn't test the applicant's ability to predict and/or monitor cooling water temperature when operating RHR controls. It is part of the K/A statement. To say that the outlet valves go to "40% open" means that the valve position is 40% open. In actuality, the valve throttles to a preset position that corresponds to 40% design flow (per the reference material). The answers need to be reworded to state that the outlet valves are "throttled open to establish 40% system design flow" or something to that effect.

Unless it serves a purpose for the question, delete "in order to prevent exceeding the CCW system design temperature during a design basis LOCA."

Revisions to the question made. It is acceptable.

5 H 3 N S B, CR, 41.

7 - Editorial: "CCP 1-01 be operating with its suction from the RWST."

Editorial change made.

6 F 3 X N E S D, CR, 41.7

- The question stem needs to say "a PRZR Safety valve has been leaki ng by its seat." The first part of the question needs to say "is maintaining" or "is not maintaining."

According to the provided diagram, PRT cooling water appears to come from the RMWS. Is this the same as the RCDT system?

The RMWS is used to add inventory to the PRT through the spray nozzles. Cooling is performed with the RCDT. Using the RCDT system in this context is correct.

Revisions made to the question.

7 H 4 N S D, CR, 41.7 8 H 3 X N E S C, CR, 41.7 - Since the reference material says that the CB-06 indications for valve 1-TV-4646 at the MA station show demanded position, why have "demanded" written in the question stem

? This would test the applicant's knowledge of what the TK

-130 MA station shows for 1

-TV-4646 indication.

This question was discussed. The valve's demanded position is on a panel separate from the valve's actual position indication. It was decided to leave the question as is. Question is acceptable.

9 F 3 N S A, CR, 41.7

ES-401 CP-2015-03 3 Form ES-401-9 Attachment 8 Page 3 of 15 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 10 H 3 X N E S D, CR, 41.7

- There is no reference providing supporting the statement that an interlock on PT

-457 will close an open PORV at 2185 psig. If there is no data supporting this, distracter C is correct.

Additional reference provided showing that PT

-457 provides this interlock capability for PT-456. 11 H 4 N S A, CR, 41.7 12 H 4 N S D, CR, 41.7 13 H 3 X X N E S B, CR, 41.7

- The wording in the second half of the question is confusing and cues the applicant by stating the "required number of Loop Tave signals." This wording suggests more than one signal is required. Perhaps reword to: "If a feedwater isolation occurs on low Loop Tave, the MFW pumps _____ trip."

Revisions made to address comment.

14 H 3 X N E S C, CR, 41.5

- The comments posed during the optional preliminary NRC review were not addressed. Explain why the steam pressure decrease signal for MSIL does not cause the MSIL actuation at 0801. Also, without any information about what Tavg is doing, an applicant could appeal and say that EOP

-0.0A doesn't direct throttling AFW flow in this case because the applicant would have to know that Tavg is decreasing past 557F.

The correct answer is not clear.

EOP-0.0A Attachment 1.A states to stop AFW flow to any faulted SG. As the indications are clear that SG 1

-01 is faulted, direction is provided without knowing the temperature. The real reason for throttling is SG fault.

Due to the 50 second lead and 5 second lag time constant on the MSLI signal of 605 psig the 150 psig drop over 1 minute will not actuate MSLI.

Will leave question as is. 15 H 2 N S C, CR, 41.7 16 H 2 N S D, CR, 41.7 17 H 2 N S A, CR, 41.5 18 F 2 N S C, CR, 41.7 19 H 3 X N E S D, CR, 41.7

- In question 2, add "total" in front of "flow." It more closely matches the referenced Caution statement.

Revision made to address comment.

20 F 2 X N E S A, CR,41.7

- If the applicant knows the power supply to one of the RCPs listed, they can get the correct answer without knowledge of what the power supply to the other ES-401 CP-2015-03 4 Form ES-401-9 Attachment 8 Page 4 of 15 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only RCP is. Proposed question provided on 2/25/15 is acceptable.

21 F 2 N S D, CR, 41.4 22 H 2 X N E S A, CR, 41.5

- With an emergency start of an EDG, regardless of the cause, a TRIP VIBRATION alarm condition will not automatically trip the EDG. Therefore, the question doesn't appear to test the applicant's ability to predict the impacts of water buildup in the EDG cylinders. The K/A statement is not fully addressed.

Licensee response

Since there are no alarms directly related to water in the cylinders and just asking what the impact is didn't seem too discriminating, the question was written using the 2 nd part of the KA. This is usually allowed per NUREG1021 ES 401.D.2.a (2 nd paragraph) which allows just writing to the higher cognitive portion of the KA. "b" in this case.

Proposed changes based on the ALM and study guide material.

Chief Examiner response: Revisions made to question acceptable.

23 F 2 N S D, CR, 41.5 24 F 3 X X N U S A, CR, 41.10 - The comments posed during the optional preliminary NRC review were not addressed. They are reiterated here:

If the reference Tech Spec is provided open reference, then there is no knowledge tested of less than/equal to 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> Tech Spec actions displayed. It is a direct lookup question, which isn't allowed (see NUREG

-1021, ES-401, D.2.b; and Appendix B, Section C.1.c). The question as proposed does not test the K/A statement.

The correct Tech Spec call involves entering Condition B, which can direct the plant into Condition A as well (see Required Action B.1.2

). On answer A, the option to place one CREFS train in emergency recirculation mode immediately includes a tie back to Condition A to put the other train in emergency recirculation mode or secure makeup air in 7 days. The correct answer is not completely correct

. Question proposed on 2/25/15 is acceptable.

Question changed from open reference to closed reference.

25 H 3 X N E S A, CR, 41.7

- Specify which compartment of the CCW surge tank has the 50% level.

Revision made to address comment.

26 F 3 X N E S C, CR, 41.10

- SOP-509A, Section 3.0, says that Plant Page announcements should be made prior to evolutions affecting the Instrument Air header. "Should" can be argued to mean it's a good idea, but not required to be done. Therefore, distracter D ES-401 CP-2015-03 5 Form ES-401-9 Attachment 8 Page 5 of 15 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only is also a correct answer. Revision made to address comment.

Comment on the Exam Outline

A comment on the outline submission resulted in changing the K/A statement from generic 2.1.14 to 2.1.23. The exam outline and rejection list have not been revised to address this.

Exam outline comment resolved.

27 F 2 X N E S D, CR, 41.7

- It is assumed for the AOVs that do have manual hand wheels to operate them, that they can be manually operated by removing the air pressure to them as well. Verify this.

Many MOVs have manual operators as well. The motor can be disengaged via a clutch switch, and a hand wheel can be used to operate the valve. The reference material doesn't explain that the Phase B MOVs are unique in design this way. Justify why this is the correct answer. If the Phase B MOVs can be operated manually, would the radiation levels prohibit "local operations" of any of them?

The question proposed on 2/25/15 is acceptable.

28 F 2 X N U S D, CR, 41.5

- The proposed question tests knowledge of how to initiate Containment Isolation Phase B manually; and knowledge of what the maximum design pressure of the containment is. It does not test the ability predict/monitor changes in containment pressure, temperature, and humidity when operating containment system controls. Containment isolation valves are a system associated with containment system controls, but there is nothing that test the designated ability. Containment Spray is an ESF system, not the containment system. The question does not address the K/A statement.

For the proposed question, "switch(s)" should be "switch(es)." Also, from the reference material, it sounds like 2/2 switches at one of two locations can initiate Containment Spray. The clarity on this is not included in the question stem, and affects the answers.

Revisions made to match to K/A statement and to address other comments.

29 F 2 X N E S B, CR, 41.5

- The reference doesn't show that at step 107 on Control Bank C that Control Bank D starts moving. Provide a reference that shows this.

Even if the main reason that overlap is designed is to ensure more uniform differential rod worth, if as a result, it also ensures that axial flux distribution doesn't exceed its limits, an answer with it could be argued as being correct in appeals. Verify whether this has this additional effect. If so, adjust the language on the distracters to make them wrong.

Revisions made to address the comments.

ES-401 CP-2015-03 6 Form ES-401-9 Attachment 8 Page 6 of 15 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 30 F 2 X N E S B, CR, 41.7

- Remove "safeguard" and "non

-safeguard" from the answer choices unless this is the actual nomenclature/terminology that is routinely used.

Revisions made to address comments.

31 H 2 X N E S C, CR, 41.7

- Reword the "Step Counters" in the stem by their official nomenclature: Bank Demand Position Indication System. The applicant needs to determine which indication is the step

-counter and which provides actual rod position. This is the essence of the first half of the question.

Revisions made to address comments.

32 H 4 X N U S B, CR, 41.10

- To answer the first part of the question, the applicant has to have knowledge of a 24 LCO action statement. To answer the second part, the applicant has to have knowledge of an LCO action that is a combination of immediate and 2 hour2.314815e-5 days <br />5.555556e-4 hours <br />3.306878e-6 weeks <br />7.61e-7 months <br /> actions. This is a SRO question.

The question provided on 2/25/15 is acceptable.

33 H 3 X X B U S B, CR, 41.

5 - The comments posed during the optional preliminary NRC review were not addressed. The provided question is written addressing a K/A statement that was not selected in the outline. There is no evidence of a justification for adopting this K/A topic as a result of K/A rejections. The question does not match an approved K/A statement.

For the given question, distracters C&D are not plausible. There is no reason to believe that rods would move in for a failed low Tave or out for a failed high Tave. These two distracters can be easily identified as not credible with very basic GFES knowledge.

Proposed new question, answer, tied to 10 CFR 55.41(b)(5) instead of (b)(7).

Question correlates to K/A statement in exam outline. Question is acceptable.

34 F 2 X N U S C, CR, 41.7

- The comments posed during the optional preliminary NRC review were not adequately addressed. The provided question does not test the ability to operate/monitor CIRS controls in the control room. The second part of the question tests knowledge of when the deluge system starts, but it doesn't tie it to control room indications that would be involved. This would show if the applicant can monitor this correctly or not.

The question provided on 2/25/15 is acceptable.

35 F 2 X N E S A, CR, 41.7

- A lot of the text in the answers is common for all of them. This information could be stated once in the question stem, thus leaving the solutions only as answers. See NUREG

-1021 (R. 9, S. 1), Appendix B, Section C.2.d.

Question revised to address comment.

36 F 2 X X B U D, CR, 41.5

- The question does not test the ability to predict ventilation changes ES-401 CP-2015-03 7 Form ES-401-9 Attachment 8 Page 7 of 15 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only S (what will happen as a result of the situation) or monitor ventilation (where the applicant can see the changes, what controllers show him). It doesn't match the K/A statement.

As part of revision efforts, the explanations for the distracters need to be reviewed. Examples: The in-service Gas Decay Tank is not specified in the stem. If it is Gas Decay Tanks #9 or #10, their relief valves vent to the Plant Exhaust Stack where the radiation monitor is at.

There is no Waste Gas Holdup Tank shown on the given system diagrams, so any connection to this can't be verified to check the distracter plausibility.

If no action is necessary with control room ventilation, then a procedure reference is needed to show that this is the case.

It appears that distracter D is partially correct as it is an action that is required by procedure that would eventually address the adverse condition. Answer A is the better choice, but distracter D is not entirely wrong.

Outline Comment: With the draft outline submittal, it was proposed that a question could not be written to address this K/A statement. Therefore, the outline and the rejected K/A list reflect that. However, a proposed question to address the original K/A statement was provided. Resolve this with the submitted outline.

Outline comment resolved.

A new question has been proposed. It meets the K/A A1.02 for 035, Tier 2, Group 2. This matches what the draft outline said that the question would be.

The question is acceptable. The correct answer changed from A to D.

37 H 3 X N E S A, CR, 41.7

- Figure 18 indicates that a main turbine trip, with a 30 second delayed generator trip, can occur on "Loss of Turbine Oil." It also shows that an immediate generator/turbine trip can occur as a result of "Low Lube Oil Press." Which one applies here? This could lead to a different correct answer.

Question revised to provide one clear answer. It is acceptable.

Based on licensee feedback, it is unclear using the reference materials to determine what these two different turbine trip inputs accomplish. Recommend a CR generated to review training materials and make revision for clarity.

Will put into corrective action as appropriate.

38 F 2 X N E S D, CR, 41.7

- If you look at the reference text under "Halon Systems (Figure 7)," it says that the 60 second timer runs upon Halon system actuation. In this case, the actuation occurs due to 2 failed detectors. Once that 60 second timer is complete, Halon will be introduced into the room unless the ABORT button is held down. If the 60 second timer is up, removing the hand from the ABORT button will result in a ES-401 CP-2015-03 8 Form ES-401-9 Attachment 8 Page 8 of 15 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only Halon release.

The proposed correct answer says that the Halon release will happen 60 seconds after the ABORT button is released. The release happens if after 60 seconds regardless, at the moment the ABORT button is released. Based on the reference, there is no correct answer provided.

Delete the "allowing manual operation" and "causing automatic actuation" from the answer choices as they provide the applicant with an easy additional way to eliminate distractors. The question should test whether it takes one or two detectors for an actuation and the operation of the abort pushbutton.

Revised question addresses the comments.

39 F 2 N S D, CR, 41.8 40 H 3 N E S C, CR, 41.7

- Is there ever a time when a PORV that is open, when it isn't supposed to be, doesn't have a corrective action to close the PORV and its block valve?

Revised question addresses the comment.

41 F 2 N S A, CR, 41.7 42 H 3 X N E S A, CR, 41.5

- The reason for why a RCP is not started in Mode 1 or 2 needs to be identified. The basis for this restriction may have something to do with protection from DNBR issues. If it protects from DNBR getting in an unsafe area, then there may be more than one correct answer.

Proposed revision to question because the basis information for the procedure action steps could not be found. Recommend CR to track ensuring that this basis is documented as needed.

Question proposed on 2/25/15 is acceptable. Editorial comment: Change A and C to say "to address an automatic trip failure."

43 H 3 X N E S A, CR, 41.8

- Excerpts from ABN

-101 are cited in the Technical Reference section, but there are other references provided. The other references need to be added.

Of particular concern is the text supporting why flow is brought back slowly to the RCP seals and why. It isn't tied to a specific document. This needs to be clearly tied to a reference document, since the question hinges upon it.

If ABN-101 has the steps to return flow to the seals, then there should be a basis document that states the reason for the approach. Need to see if there is anything that makes the shaft seizure/sheared shaft incorrect. The explanation says it is plausible. Partial correct answer.

Question provided on 2/25/15 is acceptable.

44 H 3 N S D, CR, 41.7

ES-401 CP-2015-03 9 Form ES-401-9 Attachment 8 Page 9 of 15 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 45 F 3 X B E S B, CR, 41.10

- If the piping arrangement between RCP 1

-02 and the RCP 1

-01 discharge line allow for backflow to the Loop 1 Pressurizer Spray Line, this will reduce pressurizer spray flow PCV

-0455B. If this is the criteria stated for the correct answer of RCP 1

-04, then how can it be said that distracters C and D are incorrect? They accomplish the same thing: reducing spray flow. The RNO for EOP

-0.0A, Step 10.b says to stop RCP(s) as necessary to stop spray flow. Stopping RCP 1

-02 will not affect pressurizer level like stopping RCP 1

-04, so that appears correct as well (part of distracter D).

It is possible there are 3 correct answers, or the justification needs to be better.

The question provided on 2/25/15 addresses the K/A statement. Reviewed the explanation material, and questions 10 and 59 for potential overlap. This question is acceptable, with no issues.

46 H 3 X N E S B, CR, 41.7

- The question stem currently addresses the "ability to operate" part of the K/A statement with question 1. To address the "ability to monitor" portion, the applicant has to show that he knows what RCS pressure he is watching for. The second question can be modified to take the focus off the bases for the 350 psig transition, and changed to the 350 psig threshold itself.

Revised question addresses the comments.

47 H 4 X N E S B, CR, 41.7

- Is there a reason why answers B and D say "should NOT" vice "must NOT?" ECA

-2.1A, RNO for Step 2a., says that flow will be maintained at 100 gpm per SG minimum. If, as it is assumed in the question, the plant is being operated at the 100 gpm minimum to each SG, if the cooldown rate was exceeded, the feed rate must stay the same to be in compliance with the RNO words.

Revised to address the comments.

48 H 3 X X N E S A, CR, 41.5

- For the first question, state the name/ID number of the applicable flow recorder that should show some change for SG 1

-03. For distracter D, explain why it is plausible, if the FRV failed open, that there would not be a reactor trip on high SG level? Grant it, the level signal would build in, but the controls response would be to close the FRV, which there is no control of in the first place. Revised to address comments.

49 F 3 X N E S A, CR, 41.7

- State "LCO action statement entry requirements." The LCO applies in Mode 1, so you are in it already. The conditions show that the operability statement is not met, so entering the action statements is required.

Revised to address comments.

50 H 2 N S D, CR, 41.7

- Editorial:

Add the valve names/nomenclature in the answer choices.

ES-401 CP-2015-03 10 Form ES-401-9 Attachment 8 Page 10 of 15 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only Revised to address comment.

51 H 2 X N S B, CR, 41.5

- Editorial: To support that the voltage band is not being maintained properly, additional pages of ALM-0102A are needed for reference. See page 78 of 366. Editorial comment addressed.

52 H 3 X N U S B, CR, 41.4

- The K/A statement calls for testing knowledge of the reasons for the effect on SSW discharge flow header on a loss of CCW. The proposed question deals with a loss of SSW, and testing knowledge of reasons for actions taken on the CCW system. This doesn't match the K/A statement.

The question provided on 2/25/15 is acceptable.

53 H 2 N S D, CR, 41.7 54 H 3 N S A, CR, 41.7 55 F 4 X X N E S D, CR, 41.8

- To answer this question correctly, since ECA

-1.1A gives latitude to depressurize the number of SGs necessary, it appears that there has to be knowledge and application of the EOP's bases document text to get it. Justify that this is RO level of knowledge.

Does the 100 degree/hr cooldown rate not apply in this situation? If it does apply, then C could be considered a correct answer. Need to add "per EOP basis" or something to that effect.

Licensee Response

Changed 2 nd part of B & D to avoid "main steam isolation". This more accurately matches the procedure versus the bases. Per the procedure, when depressurizing the SGs, the 100 degree/hr cooldown rate is not mentioned. This coupled with the procedure step that mentions the "maximum rate to avoid a main steam isolation means that the cooldown rate is not a consideration.

Chief Examiner: The revisions address the comments

. 56 H 3 N S C, CR, 41.5 Procedure Comment: Per ABN-601, Section 9, Sub

-section 4.0, if grid frequency equaled 59.4 Hz for 9 minutes, the action would be to trip the reactor. The procedure doesn't drive to making an orderly transition from offsite power sources to the EDGs. Per the wording of the section, the shift to the EDGs does not occur unless grid frequency is less than 59.4 Hz for 2 minutes. Is that the intention?

Procedure corrective actions will be addressed within the licensee corrective action process following the exam.

57 F 2 N S C, CR, 41.7

ES-401 CP-2015-03 11 Form ES-401-9 Attachment 8 Page 11 of 15 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 58 H 3 X N E S C, CR, 41.5

- What is the maximum emergency boration flow that can be achieved with the available boric acid pumps? Distracter B could be a correct answer as well

, needs to be checked

. The procedure only asks if there is emergency boration flow. There is no minimum or maximum. It is incorrect because if you are not required to have > 30 gpm emergency boration flow as stated in B.

59 F 2 N E S A, CR, 41.7 - In the Explanation section, the text for distracter B refers to opening 2

-FCV-121. With the context, it looks like it is meant to say HCV

-0182. Revision made to address comment.

60 H 2 N E S A, CR, 41.7

- The structure of the two

-part question would have better alignment with NUREG-1021, Appendix B, if it is restructured some. "This could be the result of the IR detector being ________. ABN

-701 will direct the operator to re

-energize the SR detectors by placing the ____________."

Editorial: Add ABN-701 to the technical references.

Revision made to address comments.

61 F 2 X N E S C, CR, 41.13 - According to STA

-603-10, there are two maximum batch release rates: 100 gpm and 300 gpm. Unless there is another release limit that is in the 50

-75 gpm range, justify why the question wasn't set up to use these plausible answers.

Revision made to address comment. Correct answer changed from A to C.

An additional reference was added to support using the maximum allowed discharge rate out of the WWHT's as a distracter.

62 H 4 X N E S B, CR, 41.10

- Add "and stable" to All SG NR Levels = 45%.

The Explanations for B and C seem to contradict each other, but could find the reason they were incorrect in the procedure excerpt.

Revision made to address comments.

63 F 3 X N U S D, CR, 41.10

- The actions in FRZ

-0.2A are to identify the source of the water going into containment, isolate it, notify the technical staff about the containment's condition, and exit the procedure. These actions do not reduce the containment water level. Therefore, an applicant could argue there are no correct answers.

Entry conditions for FRZ

-01.A for High Containment Pressure are taught in lesson plan L021ERGFZ1.

Revision made to address comments.

64 H 3 N S B, CR, 41.7 65 H 3 N S B, CR, 41.10 ES-401 CP-2015-03 12 Form ES-401-9 Attachment 8 Page 12 of 15 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 66 F 3 N S B, CR, 41.10 67 F 2 X N U S C, CR, 41.7

- The question doesn't test the ability to locate controls. The applicant can eliminate steam dumps from the remote shutdown panel options by knowing that the MSIVs are closed earlier in the procedure. The ARVs, located on the Remote Shutdown Panel, are stated as being located there in the answer choices.

The question doesn't test the ability to operate controls. The question tests knowledge of the cool down rate, but doesn't test the how he controls it, what he uses to control it, what switch positions are required, what indications he has, etc.

This question doesn't match the K/A statemen

t. Revisions made to address comments. Reference added to show that it is plausible to locally operate the ARVs within the EOP's. Correct answer changed from A to C.

68 H 3 N S A, CR, 41.10 69 F 3 N S C, CR, 41.10 70 H 2 X N U S C, OR, 41.10 - The comments posed during the optional preliminary NRC review were not addressed. Even with the Tech Spec provided as a reference to the applicant, this involves use of ESF instrumentation tables (Table 3.3.2

-1), a task that ROs are not trained to complete. Unless it can be shown that ROs are trained in the application of such Tech Spec tables in the LCOs, this is a SRO question.

New question addresses the comments.

Revised to show distracters using Function 1.c instead of 1.d.

71 F 2 X N E S A, CR, 41.11

- The second half of the answers are awkwardly worded. Needs to be reworded to avoid confusion. "When performing a whole body frisk, you should- start on the lowest scale and move up one scale at a time until the meter is on

-scale." The question provided on 2/25/15 is acceptable.

72 F 2 X X B U S B, CR, 41.12

- For one, this question tests the knowledge of radiation monitoring requirements for a specific category of a High Radiation Area. It does not provide any insight into the ability of the applicant to comply with RWPs during normal/abnormal conditions. When doing work affected by RWP compliance, how does the applicant apply RWP requirements to the situation to ensure compliance with it? The question doesn't address the K/A statement.

Second, the proposed question has t wo correct answers. If you look at Tech Spec Section 5.7.2.d., answers A and D are allowed by item number 1. Distracter D is a sub-set of answer A.

The original question was replaced with a new one. It is acceptable. The correct answer changed from A to B.

ES-401 CP-2015-03 13 Form ES-401-9 Attachment 8 Page 13 of 15 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 73 F 3 X N E S D, CR, 41.12

- Can the applicant assume that the incore detectors are tagged out? It sounds like depending on the arrangements made, access to the SG Loop Rooms may not be allowed during refueling. See Step 6.1.2 of STA

-620. Adjust the question as needed to avoid any contentions that the applicant would not be sent into those rooms in the first place.

Revision to question addressed comments.

74 F 3 X N E S A, CR, 41.10

- Make sure the stem mentions the EOP procedure number and title to eliminate any ambiguity.

Revision to question addressed comments. 75 H 3 X N E S C, CR, 41.10

- According to LCO 3.4.12, Sub

-item c., for the LTOP System to operable, one PORV can be used with one RHR suction relief valve at the specified set point. Based on this, it appears that a single PORV by itself cannot adequately relieve pressure. Distracter D looks like the correct answer.

A revision was made to add an additional reference to support the correct answer.

76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 ES-401 CP-2015-03 14 Form ES-401-9 Attachment 8 Page 14 of 15 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 91 92 93 94 95 96 97 98 99 100 RO TOTALS:

B= 4 (5.3%) F= 3 5 (46.7%) E= 3 8 (50.7%) Additional Notes: Peer review by C. Cowdrey M= 0 (0.0%) H= 40 (53.3%) U= 1 1 (14.7%) N= 7 1 (94.7%) SRO TOTALS:

B= 0 (0%) F= 0 (0%) E= 0 (0%) Additional Notes:

RO written re

-take examination only

- no SRO questions.

M= 0 (0%) H= 0 (0%) U= 0 (0%) N= 0 (0%)

GENERAL COMMENT

S:

1. Bank / Mod / New questions are indicated in their respective column field above.

2. Chief Examiner comments are indicated in blue where multiple comments exist, otherwise they are in black

.

3. Average difficulty is

__ 2.67__ on the RO exam and N/A_ on the SRO exam.

4. The 10CFR55.41/43 distribution is:

RO / SRO (N/A) 41.1 = 0 43.1 = 0 41.2 = 0 43.2 = 0 41.3 = 0 43.3 = 0 ES-401 CP-2015-03 15 Form ES-401-9 Attachment 8 Page 15 of 15 OBDI 202 - IOLE Process 41.4 = 2 43.4 = 0 41.5 = 1 6 43.5 = 0 41.6 = 0 43.6 = 0 41.7 = 3 7 43.7 = 0 41.8 = 3 41.9 =

0 41.10 =

13 41.11 =

1 41.12 =

2 41.13 =

1 41.14 =

0 5. The answer distribution is:

RO / SRO (N/A) A = 2 0 (26.7%) / 0 (0%) B = 1 8 (2 4%) / 0 (0%) C = 1 7 (22.7%) / 0 (0%) D = 20 (26.7%) / 0 (0%) 6. There is 1 question with attachments provided. Question 70 require s hand-outs.