Regulatory Guide 5.36

Recommended Practice for Dealing with Outlying Observations

ML003739956
Person / Time
Issue date:	06/30/1974
From:	Office of Nuclear Regulatory Research
To:
References
RG-5.36
Download: ML003739956 (2)

June 1974 U.S. ATOMIC ENERGY COMMISSION

REGULATORY GUIDE

DIRECTORATE OF REGULATORY STANDARDS

REGULATORY GUIDE 5.36 RECOMMENDED PRACTICE FOR DEALING WITH

OUTLYING OBSERVATIONS

A. INTRODUCTION

Section 70.51, "Material Balance, Inventory, and Records Requirements," of 10 CFR Part 70, "Special Nuclear Material," requires certain licensees authorized to possess special nuclear material to establish and maintain sufficient written material control and account ing procedures to enable the licensee to account for the special nuclear material in his possession. Section 70.22,

"Contents of Applications," requires applicants for certain AEC licenses for special nuclear material to submit to the Commission hs part of the application a full description of such procedures, including recording, reporting, physical inventory, and measurement pro cedures for special nuclear material. Essential to satis factory material control and accounting procedures are nmeasurement and statistical control. This guide identifies methods and procedures acceptable to the Regulatory staff for dealing with the problem of outlying observa tions in samples and for testing their statistical signifi cance.

B. DISCUSSION

Committee E-I 1 on Statistical Methods of the Ameri can Society for Testing and Materials (ASTM) has revised a standard that deals with the problem of outlying observations in samples and how to test their statistical significance. An outlying observation, or "out lier." is one that appears to deviate markedly from other members of the sample in which it occurs. In this connection, the following two alternatives are of inter est:

I. An outlying observation may be merely an extreme manifestation of the random variability inherent in the data. If this is the case, the value should be retained and processed in the same manner as the other observations in the sample.

2. On the other hand, an outlying observation may be the result of gross deviation from prescribed experi mental procedure or an error in calculating or recording the numerical value. In such cases, it may be desirable to institute an investigation to ascertain the reason for the aberrant value. The observation may even eventually be rejected as a result of the investigation, though not necessarily so. At any rate. in subsequent data analysis.

the outlier or outliers will be recognized as probably being from a different process than that of the sample values.

The committee's purpose in developing this revised standard is to provide statistical rules that will lead the cxperilnenter almost unerringly to look for causes of outliers when they really exist, and hence to decide whether alternative I above is the more plausible hypothesis to accept, as compared with alternative 2. in order that the most appropriate action in further data analysis may be taken. The procedures covered therein apply primarily to the simplest kind of experimental data, that is. replicate measurement of some property of a given material or observations in a supposedly single random sample. Nevertheless, the tests suggested do cover a wide enough range of cases in practice to have broad utility.

Topics addressed in this standard are:

a. Basis of statistical criteria for outliers b. A single observation in a sample c. The least and the greatest observation in a sample d. The two largest or the two smallest observations as probable outliers e. Rejection of several outliers USAEC REGULATORY GUIDES

Copies of published guides may be obtained by request indicating the divisions desired to the US.

Atomic Energy Commission. Weshington.

D.C. 20646.

Roguiawtsiv (-fs are issued to describe and tsaice available to the public Attention Direttor of Regulatory Standards Commtents and suggetions for

"nidtht)d accetsptalis io the AEC Regulatory staff of implementing specific parts of itmprovemints in these guides we encouraged and should be sent to the Secretary the Conmmsission*s getstlOns to delineate techniques *,ad by the staff in of the Commrisson, US. Atomic Energy Commilssion. WashingtOn. D.C. 2054A.

eveluai,ng specific problems ot postulated accidents, or to provide guidance to Altenrtion: Chief. Public Proceedings Staff.

applicanits Regulatory Guiode are not substitutet for regulations and compliance wit*h thisrn, .

not required. Methods and solutions different from thoset out irs The guides are issued in the followring ten broad divisions:

the guides w*l be acceptable ,f they provide a bais for the findings requisite to the issualce or continuance of a permit or license by the Covmmission.

6. Products

2. Research, and Test Reectors

7. Transportation

3. Fuels end Materiels Facilities S. Occuportional Health Pub*ishfed guides will be re'viaed periodically, as appropriate, to accommodate

4. Environffentel and Siting

9. Antitrust Revuw corsinvnts and to.reftect now information or experience.

5. Materials end Plant Protection

1

0. General

C. Recommended criterion using independent stan dard devition g. Recommended criteria for known standard devia tion The revised standard was approved by ASTM Com mittee E-I I in February 1974 and will be published in August 1974 with the designation E178-74.

C. REGULATORY POSITION

The recommended practices dealing with the problem of outlying observations in samples and the methods for testing their statistical significance contained in ASTM

Standard E178-74. 1 "Recommended Practice for Dealing with Outlying Observations,"

are generally acceptable and provide an adequate basis for deter.

mining if an outlying observation is an aberrant value or an extreme manifestation of the random variability I'Copies may be obtained from the American Society for Testing and Materials. 1916 Race Street. Philadelphi

a. Pennsylvania

19103.

kshremt in the data, subject to the following qudli-.

Cations:

I. In regard to the statistical cuitena discussed in Section

3.1 of the ASTM Standard, the level of sipificauice should not exceed 0.5 percent.

2. Statistical outlier tests should be applied to basow measurement control processes, but not directly to the rejection of observed MUF values.

3. Caution should be applied to avoid unwarranted rejection of suspect observations. Discarding an overly large number of false outiess could introduce bias rather than eliminate it.

4. In regard to Section 3.2, the assumption of normality should be assessed usng Regulatory Guide 5.22. "Assess ment of the Assumption of Normality (Emplo)ing Individual Observed Values)," April 1974.

S. All discarded outliers should be recorded as part of the records maintained for special nuclear maerial control purposes.

5.36-2