Quality Assurance
Draft 3/1/2006
FUNCTIONAL AREA GOAL: A management system is
implemented that integrates and drives processes applicable to
DOE's mission and work which complies with requirements of 10
CFR 830 Subpart A, Quality Assurance Requirements, and DOE
Order 414.1C, Quality Assurance.
REQUIREMENTS:
- Quality Assurance Rule 10 CFR 830 - Nuclear Safety
Management
- Quality Assurance Order, O 414.1C - Quality Assurance,
6-17-05
- DOE-STD-1150-2002 - Quality Assurance Functional Area
Qualification Standard - April 2002
- Program specific requirements: NNSA Quality Management
Policy, QC-1; DOE/CBFO-94-1012, DOE Carlsbad Field Office,
Quality Assurance Program Description; DOE/RW-0333P, DOE
Office of Civilian Radioactive Waste Management, Quality
Assurance Requirements and Description.
GUIDANCE:
- Quality Assurance Guide 414.1-1A - Quality Assurance
Management Assessment and Independent Assessment Guide,
5-31-01
- Quality Assurance Guide 414.1-2A - Quality Assurance
Management System Guide, 6-17-05
- American Society of Mechanical Engineers (ASME)
NQA-1-2004, Quality Assurance Requirements for Nuclear
Facility Applications, 2004 (for nuclear-related activities)
- American National Standards Institute
(ANSI)/International Organization for
Standardization/American Society for Quality (ASQ)
Q9001:2000, Quality Management Systems: Requirements (for
nonnuclear activities); and
- ANSI/ASQ Z 1.13-1999, Quality Systems Guide for
Research, 1999, (for nonnuclear research activities).
EXCEPTION: This document is intended to provide general
guidance for conducting oversight of Quality Assuring
Management functions at the various DOE/NNSA Offices and
Sites. Performance Objectives and Lines of Inquiry were
developed in conjunction with the DOE Guide 414.1-1A, Quality
Assurance Management System Guide, 5-31-01. The guide is
generic in that it reflects the latest requirements and
practices that are expected to be found in a quality assurance
program. The Carlsbad Field Office (CBFO) and the DOE Office
of Civilian Radioactive Waste Management are exceptions since
their quality assurance programs were developed to comply with
regulatory requirements that are in effect at the time an NRC
license is issued for their respective sites. The EPA
Administrator is the only authority that can invoke a change
to the federal regulations applicable to WIPP which are
different from those cited in the CRAD. Therefore, in
conducting a review of the WIPP or the Yucca Mountain Project
quality assurance programs, regulatory requirements applicable
to those sites should be invoked where ever specific
requirements are referenced in this CRAD Performance Objective
and Lines of Inquiry.
NOTE: While Software Quality Assurance (SQA) and
Suspect/Counterfeit Items (S/CI) are mentioned in this Quality
Assurance CRAD, they are included in the context of DOE Order
414.1C, Quality Assurance, since the Order speaks to the
entire spectrum of quality interests. Separate CRAD's have
been developed for SQA and S/CI and should be referred to for
specific and detailed guidance in those areas.
Performance Objective 1: Contractor Quality Assurance
Program Documentation
Contractor line management has established a comprehensive
and integrated program specific quality and safety management
system applicable to DOE's mission and work which encompasses
requirements of 10 CFR 830 Subpart A, Quality Assurance, and
DOE Order 414.1C, Quality Assurance.
Criteria:
- The contractor has assigned and identified a senior
management position responsible for the development,
implementation, assessment, and improvement of a Quality
Assurance Program.
- The contractor has implemented QA criteria as defined in
Attachment 2 of the DOE O 414.1C, paragraph 3, Contractor
Requirements Document (CRD); paragraph 4,
Suspect/Counterfeit Items (S/CI) prevention requirements;
and paragraph 5, safety software. The graded approach is
described regarding how the QA criteria of the Order are
applied by the contractor.
- The Contractor utilizes appropriate national or
international consensus standard where practicable and
consistent with contractual or regulatory requirements, and
has identified the standard(s) approved for use by the site
office. Suggested standards include the following:
- ASME NQA-1-2000, Quality Assurance Requirements for
Nuclear Facility Applications (for nuclear-related
activities).
- ANSI/ISO/ASQ Q 9001-2000, Quality Management System:
Requirements (for nonnuclear activities).
- ANSI/ASQ Z 1.13, 1999, Quality Guidelines for
Research, (for nonnuclear research activities).
- The contractor applies additional standards, where
practicable and consistent with contractual or regulatory
requirements and as necessary to address unique/specific
work activities (e.g., development and use of safety
software or establishing the competence of a testing and
calibration laboratory). [Note: these standards may be
referred to as "voluntary standards." However, once a
practicable standard is adopted through regulation, code,
contract, QAP, or procedure, compliance with the standard is
required and is not voluntary.]
- The contractor has integrated, where practicable and
consistent with contract or regulatory requirements, quality
management system requirements as defined in the Contractor
Requirements Document (DOE O 414.1C, Attachment 2), and
other quality or management system requirements in DOE
directives and external requirements. Examples include the
following:
- DOE P 450.4, Safety Management System Policy, dated
10-15-96;
- DOE P 450.5, Line Environment, Safety and Health
Oversight, dated 06-26-97;
- NNSA Quality Management Policy, QC-1, (quality
management system for the nuclear weapons complex and
weapons-related activities);
- DOE/RW-0333P, DOE Office of Civilian Radioactive Waste
Management, Quality Assurance Requirements and
Description; and
- DOE/CBFO-94-1012, DOE Carlsbad Field Office, Quality
Assurance Program Description, (for the Waste Isolation
Pilot Plant and related activities).
- Changes to the contractor's Quality Assurance Program
are processed as follows:
- Submits a copy to DOE for approval before beginning
work under a DOE contract.
- Implements the QAP as approved and modified by DOE.
- Indicates in the submittal any third-party
certification affecting the QAP.
- Revises an existing QAP that was approved in
accordance with previous versions of the CRD (e.g., CRD to
DOE O 414.1B, Quality Assurance, dated 04-29-04) to
address enhancements required by the current CRD.
- Contractor includes modifications made or directed by
DOE.
- Note: Contractor may regard a QAP as approved by DOE
90 calendar days after DOE receipt, unless approved or
rejected by DOE at an earlier date.
- The contractor submits annually QAP changes made during
the previous year to DOE for review and approval. In the
submittal, changes are identified, the reason for the
changes, and the basis for concluding that the revised QAP
continues to satisfy the requirements of the existing CRD.
[The contractor may make changes to an approved QAP at any
time. Editorial changes made to correct spelling,
punctuation, grammar, etc., do not require explanation.]
- The contractor's QAP has addressed the most recent
revisions of the following guidance documents:
- DOE G 414.1-1A, Management Assessment and Independent
Assessment Guide for Use with 10 CFR, Part 830, Subpart A,
and DOE O414.1A, Quality Assurance; DOE P 450.4, Safety
Management System Policy; and DOE P 450.5, Line ES&H
Oversight Policy, dated 5-31-01.
- DOE G 414.1-2A, Quality Assurance Management System
Guide for Use with 10 CFR 830 Subpart A Quality Assurance
Requirements and DOE O 414.1C, Quality Assurance, dated
6-17-05.
- DOE G 414.1-3, Suspect/Counterfeit Items Guide for Use
with 10 CFR 830 Subpart A Quality Assurance Requirements
and DOE O 414.1B, Quality Assurance, dated 11-03-04.
- DOE G 414.1-4, Safety Software Guide for use with 10
CFR 830 Subpart A, Quality Assurance Requirements, and DOE
O 414.1C, Quality Assurance, dated 6-17-05.
Suggested
Lines of Inquiry and Review Approach
Performance Objective 2: Contractor Quality Assurance
Program Implementation
2.1 Quality Assurance Program: The Contractors
Quality Assurance Program description documentation describes
programs and processes that comprise the total scope of the
quality assurance management system. The documentation
includes a description of the organization structure,
functional responsibilities, levels of authority, and
interfaces for those managing, performing and assessing work.
Criteria:
- The QAP addresses and provides a description of the
organization structure, functional responsibilities, levels
of authority, and interfaces for those managing, performing
and assessing work.
- The QAP emphasizes senior management commitment to
quality and safety and that all work and every component and
employee of the organization is included within the scope of
the quality management system.
- The QAP is approved by senior management, updated
annually if needed, and changes are reviewed and approved by
DOE.
- The management processes include planning, scheduling,
and describes how resources are selected and allocated for
work.
- The contractor's quality assurance management system
includes management assessments, and independent assessments
as defined by laws, regulations, and DOE directives such as
quality assurance program requirements and other structured
operational awareness activities; incident/event reporting
processes, including occupational injury and illness and
operational accident investigations; quality improvement
mechanisms such as worker feedback; quality issues
management; lessons-learned programs; and performance
indicators/measures.
- The contractor quality assurance management system
includes methods for the flow down of quality requirements
within the organization and to subcontractors and
suppliers.
- Contractor quality assurance management system
performance data are reviewed, analyzed, compiled,
documented and made available to DOE line management as part
of formal contract performance evaluation.
Suggested
Lines of Inquiry and Review Approach
2.2: Personnel Training and Qualification:
Contractor worker qualification and training requirements
are defined and implemented to ensure personnel achieve and
maintain the capabilities to perform assigned work.
Criteria:
- Requirements and formal processes have been established
and implemented that ensure personnel responsible for
managing and performing quality assurance activities possess
appropriate experience, knowledge, skills and abilities that
are commensurate with their responsibilities.
- Worker qualification requirements are defined.
- Management plans for and commits resources to facilitate
the training and qualification of personnel.
- Management ensures that persons hired or transferred
into positions meet the appropriate requirements for
performing assigned work.
- Job proficiency maintenance and training requirements
are defined and worker information needed is
provided.
- Project/task unique training requirements are identified
and the required knowledge for performing work is
effectively provided to workers.
- Management solicits and encourages worker input to the
development of task training.
- Site/facility/specific training modules include
consideration of safety, emergency plans, and security and
operations information necessary for personnel to prepare
for and perform their assigned duties.
- Institutional training conveys general information about
the organization's mission, vision, goals, and the
importance of all workers in the achievement of each
element.
- Training includes personnel responsible for managing,
planning, performing, controlling, and overseeing work.
- Training plan content is based on current site,
facility, and organization procedures; technical and
professional references; and past organization/industry
experience.
- Training plans specify the type of training records to
be maintained.
Suggested
Lines of Inquiry and Review Approach
2.3: Quality Improvement: Management actions are
initiated for improving the quality of products, processes,
and services by establishing priorities, promulgating policy,
allocating resources, communicating lessons learned, and
resolving significant management issues and problems that
hinder the organization from achieving its quality objectives.
Criteria:
- Quality problems are identified, evaluated, causes and
significance determined, and management disposition action
is documented.
- Primary management emphasizes for improving quality is
placed on the prevention of quality problems.
- Management balances safety and mission priorities when
considering improvement actions.
- Management encourages employee participation in
planning, developing, exploring and implementing new ideas
for improving quality in products, processes, and services.
- Quality problems and other quality related information
(both positive and negative) from various internal and
external sources are reviewed and analyzed to identify
improvement opportunities in the quality management system,
processes, items, products, or services.
- The effectiveness of implemented improvements is
monitored and tracked to follow up on the adequacy of the
actions to improve quality.
- Items, services, and processes that do not meet
established requirements are identified and controlled.
- Corrective action processes require the identification
of "root-causes" and result in corrective action plans that
are developed to prevent their recurrence.
- Management has implemented a "Lessons Learned" program
that utilizes feedback from within and other related
organizations to identify potential quality improvement
processes.
- Quality problems identified as Type "A" Accident event,
or a Price-Anderson Enforcement, or DOE Inspector General
Issues are tracked through resolution.
Suggested
Lines of Inquiry and Review Approach
2.4: Documents and Records: The contractor's
documents and records management system is effective in
supplying documents for personnel to safely and correctly
perform their assigned responsibilities.
Criteria:
- Documents that prescribe work control processes, specify
requirements, or establish designs are prepared, reviewed,
approved, issued, and revised in a controlled manner.
Examples include the following:
- Procedures that define staff work processes to ensure
a quality end product are prepared, issued, and revised in
a controlled manner;
- Requirements that are passed down for the procurement
of items or services are developed, documented, issued and
revised in a controlled manner;
- Inspection/acceptance requirements for items and/or
services are defined and results are documented to confirm
requirements have been satisfied; and,
- Design documents that define facility or item design
requirements such as functional capability are developed,
issued and revised in a controlled manner.
- The document control system is effective in supporting
management actions to ensure that safety and quality
management requirements and functions are communicated to
workers.
- Records are specified, prepared, reviewed, approved, and
maintained.
- Records support management actions and decisions and
provide evidence that work was correctly performed.
- Records management controls are adequate for the
development and preservation of records for all record forms
that are maintained (e.g., electronic, written, or printed;
microfilm; photographs; radiographs; optical disks;
etc.)
- Schedules for records retention and disposition are
consistent with requirements of DOE O 200.1, Information
Management Program, dated 9-3-96.
- Hardware and software tools used to create and store
records are maintained to ensure that records are
retrievable.
Suggested
Lines of Inquiry and Review Approach
2.5.1: Work Processes: Work processes are carried
out by qualified personnel using approved procedures,
instructions, and equipment under administrative, technical,
and environmental controls to achieve a planned end
result.
Criteria:
- Work is performed consistent with technical standards,
administrative controls, and hazard controls adopted to meet
regulatory or contract requirements using approved
instructions, procedures, etc.
- Line management and workers cooperate to identify
processes that can be improved based on feedback prior to
and following implementation of the work process.
- Management solicits input from workers in the
development of work processes and communicates an
expectation of worker accountability for quality and safety
in the performance of work.
- Management ensures that the following are clearly
identified and conveyed to workers before they begin work:
- Customer and data requirements for the work and final
product;
- Hazards associated with the work;
- Safety, administrative, technical, environmental, and
quality controls to be used during the work;
- Technical standards applicable to the work and final
product;
- Acceptance criteria applicable to the work and final
product; and
- Procedures for verification of the completed work
using established criteria.
- Procedures, work instructions, or other means used to
define work processes are documented and
controlled.
- The scope and documentation detail is commensurate with
the complexity and importance of the work, the skills
required to perform the work, the hazards and risks or
consequences of quality problems in the product, process, or
service, and the need to meet regulatory and contract
requirements.
- Control of processes, skills, hazards, and equipment are
specified, understood, and documented.
Suggested
Lines of Inquiry and Review Approach
2.5-2: Work Processes - Item Identification and
Control: A process for the identification and control of
items is in place and is aggressively being applied.
Criteria:
- Management processes for the identification and control
of items are in place to:
- Prevent the use of incorrect or defective items;
- Identify and control S/CI's
- The identification and control process is applied from
manufacture or receipt through delivery, installation, or
use.
- Item configuration control requirements, based on a
graded-approach, are defined. Requirements may include item
unique part, lot, heat, model, version, serial number,
installation, and record requirements that enable
traceability to the item.
- Items and materials are maintained and stored to prevent
their damage, loss, or deterioration.
- Equipment/tools used for process monitoring or data
collection are calibrated, maintained, and properly secured.
Suggested
Lines of Inquiry and Review Approach
2.6: Design: The contractor's design management
process provides for the control of design functions and
interfaces that enables producing quality design output
products that effectively support facility design,
construction, start-up, operation and maintenance functions.
Criteria:
- The design process provides controls for design inputs,
outputs, verification, design changes and configuration
control.
- Sound engineering/scientific principles and appropriate
standards are applied to the design of items and processes.
- Applicable requirements are incorporated into design
bases when developing design documents and changes
thereto.
- Design programmatic, technical, and administrative
interfaces are identified and controlled.
- Qualified individuals or groups other than those who
perform the work perform design verification/validation of
the adequacy of design products.
- Design products are verified and/or validated prior to
their approval and implementation.
- The selection of applicable design control requirements
are guided by safety analyses that establishes the
following:
- Identification and functions of safety (safety class
and safety significance) for structures, systems, and
components (SSC);
- Significance to safety of functions performed by
SSC's; and
- Those aspects that is critical to the performance,
reliability, or programmatic requirements of
SSC's.
- Design documentation provides acceptance, inspection,
testing, and maintenance criteria to ensure continuing
reliability and safety of items.
- Design documentation includes approved computer codes
utilized for preparing designs and documentation.
- Design records include documentation such as design
inputs, calculations, and analyses; engineering reports;
design outputs; design changes; design verification
activities; and related documents that provide evidence that
the design process was completed correctly.
- Design inputs include contractual requirements and
customer expectations.
- Design inputs include information such as design bases,
health and safety considerations, expected life cycle,
performance parameters, codes and standards requirements,
and reliability requirements.
- Design processes translate design inputs into design
output documents that are technically correct and compliant
with end user requirements.
- Design output documents support other processes such as
dose and risk assessments, procurement, manufacturing,
assembly, construction, testing, operation, inspection,
maintenance, and decommissioning.
- As-built conditions for structures, systems and
components are reflected in final design output
documents.
- Design verification processes are defined and performed
by technically knowledgeable persons separate from those who
performed the design.
- Methods for conducting a graded approach to design
verification are defined.
- Design verification methods include design reviews,
alternative analyses, qualification testing, and peer
reviews.
- Interim design verification activities are conducted
under controlled conditions involving support of other work
such as procurement, manufacture, construction, or
testing.
- Design verification is completed before relying on
structures, systems, and components to perform their
function.
- Design changes that result from temporary modifications,
or installed designs that are dispositioned "use-as-is,"
undergo the same level of design review as for original
designs.
- Computer software used to originate or analyze design
solutions that serve to mitigate potential accidents is
controlled in accordance with DOE Guide G 414.1-4, Safety
Software Guide, dated 6-17-05 (or latest revision). All
other computer software used to analyze designs that might
have safety, operational, or programmatic consequences is
verified and controlled.
Suggested
Lines of Inquiry and Review Approach
2.7: Procurement: The procurement process ensures
that items and/or services provided by suppliers meet the
requirements and expectations of end users.
Criteria:
- The procurement process is planned and controlled to
ensure the following:
- Procured items and services meet established
requirements and perform as specified.
- Prospective suppliers or evaluated and selected on the
basis of established criteria.
- Only approved suppliers are utilized and that they
continue to provide acceptable items and
services.
- Procurement processes have been implemented to prevent
introduction of suspect/counterfeit items (S/CI's) and
provide a method to detect them before they are released for
use.
- Procurement requirements are commensurate with the
importance of the end use of the purchased item or
service.
- Management controls are in place and are being followed
for DOE procurement and subcontracts through applicable DOE
Orders, the Department of Energy Acquisition Regulation (the
DEAR) in 48 CFR subchapters A through H, and the Federal
Acquisition Regulation (FAR), in 48 CFR 970
et.seq.
- Existing procurement management systems adequately
respond to end-user requirements and reflect requirements of
the QA Rule 10 CFR 830, Nuclear Safety Management, and DOE
Order 414.1C, Quality Assurance.
- The procurement process provides direction on how the
contractor responsible for nuclear facilities ensures that
subcontractors and suppliers satisfy criteria of 10 CFR
830.122.
- Procurement documents include or reference requirements
and acceptance criteria for purchased items and
services.
- Procurement documents include specifications, standards
and other applicable documents as referenced in design
documents.
- Critical parameters and requirements are specified such
as document submittals, product related documentation,
problem reporting, administrative documentation, personnel
or materials qualifications, tests, inspections, performance
expectations for services, and reviews.
- Procurement processes for safety-related structures,
systems, and components are graded based on their importance
to safety and the protection of workers, public and
environment.
- Prospective suppliers of structures, systems, and
components that are important to safety and/or the
protection of workers, public and environment are required
to have a quality assurance program and their quality
programs have been verified to conform to contract
requirements that includes their capability to meet
performance and schedule requirements.
- Assessments of supplier's capability and facilities
include the portions or all of the following:
- A review of the supplier's history of providing
identical or similar items or services.
- A review of shared supplier quality information.
- An evaluation of certifications or registrations
awarded by nationally accredited third parties, and
- An evaluation of documented qualitative and
quantitative performance information provided by the
supplier.
- Qualified supplier's performance capabilities are
periodically verified and monitored to confirm their
continuing capabilities.
- Monitoring of supplier performance capability includes
some are all of the following:
- Surveillance of work activities;
- Inspection of facilities and processes;
- Review of plans and progress reports;
- Surveillance of manufacturing processes and methods;
- Processing and use of change information;
- Review of internal assessments;
- Review and disposition of non-conformances; and
- Selection, qualification, and performance monitoring
of sub-tier suppliers.
- The procurement process provides for the identification
of inspections and tests to ensure conformance with purchase
requirements.
- Procurement documents specify critical or important
acceptance parameters for inspection.
- Inspections include verification that specified
documentation has been provided by the supplier and that
items were not damaged during shipment.
- Inspections include some are all of the following:
- Inspections of materials or equipment at the
supplier's plant;
- Receipt inspection of the shipped items;
- Review of objective evidence such as certifications
and reports; and
- Verification or testing of items before or following
shipment.
- Supplier-generated documents for structures, systems and
components are accepted through the procurement system and
controlled and processed by the end-user organization.
(Documents include certificates of conformance, drawings,
analyses, test reports, maintenance data, nonconformance
documentation, corrective actions, approved changes,
waivers, and deviations.
- Items procured for safety applications in nuclear or
high-risk related activities are procured on either of the
following basis:
- Purchased from a supplier whose quality assurance
program has been evaluated and found acceptable, or
- Purchased as commercial-grade items that have been
approved for dedication to a specified application.
- Commercial-grade items intended for use in nuclear
safety or high-risk activities are procured in accordance
with documented processes using recognized consensus
standards.
- Critical design characteristics defined by the design
organization are utilized in item selection and acceptance
requirements. They may include the following:
- Unique tests to be performed,
- Inspection requirements, and/or
- Evaluation of the supplier's ability to consistently
supply the item at a level of quality that meets the
safety and reliability requirements for the
item.
- Multi-site procurements are performed only when
interfaces and responsibility agreements have been clearly
defined and established in writing with regard to quality
requirements.
Suggested
Lines of Inquiry and Review Approach
2.8: Inspection and Acceptance Testing: The
contractor's inspection and test program requirements are
effective in verifying that physical and functional aspects of
items, services, and processes meet requirements and are fit
for acceptance and use.
Criteria:
- Established acceptance and performance criteria are used
for inspecting and testing specified items, services, and
processes.
- Planning for inspections/tests includes provisions for
the following:
- Identification of characteristics to be examined;
- Qualification requirements for individuals who perform
the examinations;
- Descriptions of examination methods, including
equipment and calibration requirements;
- Acceptance and rejection criteria;
- Suitable environmental conditions;
- Shelf-life and maintenance;
- Required safety measures; and
- Mandatory hold points, when applicable.
- Technically qualified personnel are given the authority
to access appropriate information and facilities to verify
acceptance requirements perform inspections/tests.
- Inspection/test personnel are qualified and independent
of the activities being inspected/tested and have the
freedom to report the results of the
inspections/tests.
- Inspection/test results are evaluated and verified by
qualified personnel of the design organization to document
that requirements are satisfied.
- Inspection and test records identify the following:
- Item tested,
- Date of test,
- Test methods used,
- Tester or data recorder,
- Observations of any abnormal or unexpected problem(s),
- Results and acceptability, and
- Action taken concerning problems noted.
- Items or services that meet acceptance requirements are
appropriately identified to enable correct application for
their intended use.
- When requirement parameters for items are changed,
accepted items are reviewed by persons knowledgeable of
design requirements to determine if re-inspection and
testing of item(s) is (are) necessary.
- Measuring and test equipment (M&TE) used for
inspections, tests, monitoring, and data collection is
calibrated, maintained, and controlled using a documented
process.
- M&TE is checked before use to ensure it is of the
proper type, range, accuracy, and precision and is uniquely
identified and traceable to its calibration data.
- Procedures are developed that establish requirements for
testing, retesting, adjusting, and recalibrating
M&TE.
- M&TE is calibrated to standards traceable to the
National Institute of Standards and Technology or other
nationally recognized standards when appropriate, or if no
standard exists, the basis for calibration is documented.
- The M&TE used is traceable to the item for which
acceptance is established.
Suggested
Lines of Inquiry and Review Approach
2.9: Management Assessment: Managers periodically
assess their functions to determine how well their
organization is meeting both customer and management
performance expectations and mission objectives, to identify
strengths or opportunities for improving performance, and to
correct identified problems.
Criteria:
- Management assessments are planned, scheduled, conducted
and results are documented.
- Problems that hinder the organization from achieving its
objectives are identified, corrected, and personnel are
trained on the changes.
- Managers view their participation in the assessment
process as essential to ensure their gaining a first-hand
understanding of how well the management system is
functioning.
Suggested
Lines of Inquiry and Review Approach
2.10: Independent Assessment: Contractor senior
management has established a process to obtain an independent
assessment of the organization's programs, projects,
contractors, and suppliers.
Criteria:
- Senior management ensure that independent assessments
are planned, scheduled and conducted to measure item and
service quality and the adequacy of work performance to
promote improvement.
- The management structure ensures there is sufficient
authority and freedom from line management to enable
independent teams to effectively perform
assessments.
- Persons conducting independent assessments are
technically qualified and knowledgeable in the areas they
are assigned to assess and have had no previous
responsibility for the work being assessed.
- Assessments include the following:
- Evaluation of work performance and process
effectiveness;
- Evaluation of the quality of work products;
- Evaluation of the compliance to established management
system requirements;
- Identification of abnormal performance and potential
problems;
- Identification of opportunities for improvements;
- Documenting of assessment results; and
- Reporting of assessment to management.
- Results of independent assessments are analyzed to
determine if problems are local or global and appropriate
remedial management action(s) is(are) initiated to correct
problems.
- Findings from assessments are tracked and progress
towards their closure are monitored and reported to senior
management.
- Corrective actions that are implemented to address
findings are verified for their adequacy and follow up
reviews are performed to determine their effectiveness in
correcting problems.
- The management system includes a "Lessons-Learned"
reporting mechanism to enable other management groups to
benefit from identified management issues.
Suggested
Lines of Inquiry and Review Approach
Performance Objective 3: DOE Line Management
Oversight: DOE line management has established and
implemented effective oversight processes that enable
evaluating the adequacy and effectiveness of contractor
quality assurance management systems and DOE oversight
processes.
Criteria:
- The DOE Office has developed and implemented a quality
assurance program or is working to an approved "umbrella"
QAP, and employees have been trained on the application of
the QAP. The QAP implements QA criteria as defined in
paragraph 4b of DOE O 414.1C, Quality Assurance, using a
graded approach where applicable.
- The DOE Office QAP uses national or international
consensus standards where practicable and is consistent with
regulatory requirements (e.g., 10 CFR 830) and identifies
the standards used. Examples of appropriate standards
include the following:
- ASME NQA-1-2000, Quality Assurance Requirements for
Nuclear Facility Applications (for nuclear related
activities);
- ANSI/ISO/ASQ Q 9001-2000, Quality Management System;
Requirements (for nonnuclear activities); and
- ANSI/ASQ Z 1.13, Quality Guidelines for Research, 1999
(for nonnuclear research activities).
- The DOE Office applies additional standards, where
practicable and consistent with contractual or regulatory
requirements and as necessary to address unique/specific
work activities (e.g., development and use of safety
software or competence of a testing and calibration
laboratory). [Note: These standards are sometimes referred
to as "voluntary standards." However, once a practicable
standard is adopted through regulation, code, contract, QAP,
or procedure, compliance with the standard is required and
is not voluntary.]
- The DOE Office integrates, where applicable, contract or
regulatory requirements, quality management system
requirements as defined in DOE O 414.1C, Quality Assurance,
the S/CI prevention process, the Corrective Action
Management Program (CAMP), and Safety Software Quality
Requirements with other quality or management system
requirements in DOE directives and external requirements,
including as applicable the following:
- DOE P 450.4, Safety Management System Policy, dated
10-15-96;
- DOE P 450.5, Line Environment, Safety and Health
Oversight, dated 06-26-97;
- NNSA Quality Management Policy, QC-1, (quality
management system for the nuclear weapons complex and
weapons-related activities);
- DOE/RW-0333P DOE Office of Civilian Radioactive Waste
Management, Quality Assurance Requirements and
Description; and
- DOE/CBFO-94-1012, DOE Carlsbad Field Office, Quality
Assurance Program Description, (for the Waste Isolation
Pilot Plant and related activities).
- DOE line managers and supervisors communicate an
attitude of responsibility and accountability for quality of
work performed within their assigned scope of management
responsibilities. Personnel at all levels understand their
responsibilities and are committed to quality performance.
- The requirements for quality are clearly defined and
understood by each DOE management unit and sufficient
resources are provided for the unit to accomplish their
mission.
- Quality measures are applied in a graded manner to
non-safety related systems, equipment, and activities.
Measures that are applied are based on the importance to
safe and reliable facility operation.
- Quality audits and surveillances are scheduled based on
the importance of the activity and past performance issues
in selected areas.
- Individuals who have demonstrated capability for
identifying performance issues perform quality audits and
surveillances.
- Quality monitoring results are documented and corrective
actions are tracked to ensure adequacy of management actions
taken to correct problems.
- Results of surveillances and audits are reported to line
management for identification of root causes and appropriate
corrective action.
- Substantive quality problems are reported to senior
management.
- The effectiveness of actions taken to correct quality
problems are periodically reviewed to ensure the adequacy of
corrective actions that have been implemented.
Suggested
Lines of Inquiry and Review Approach
< BACK TO PREVIOUS PAGE