HSS Logo Department of Energy Seal
Left Tab SEARCH Right Tab TOOLS Right Tab Left Tab HOME Right Tab Left Tab ABOUT US Right Tab Left Tab FUNCTIONS Right Tab Left Tab RESOURCES Right Tab Left Tab NEWSFEEDS Right Tab Left Tab VIDEOS Right Tab Left Tab EVENTS
Office of Quality Assurance
Office of Nuclear Safety Home
Office of Quality Assurance Home
Policy and Directives
Software Quality Assurance
QA Library/Training
Newsletters and Bulletins
QA Contacts
Topics & Resources
Quality Council
Fundamentals of the DOE Quality System
Quality Policy
Underlying Quality Principles
Value-Added Attributes of the QA Requirements
Related Nuclear and Facility Safety Requirements and Guides
HEPA Filters
Differing Professional Opinion (DPO)
HSS Logo

Software Quality Assurance Criteria Review and Approach Documents


Safety Software Quality Assurance

Draft 3/31/2006

Note to assessors: The suggested lines of inquiry and review approach found within this document represent the collective insights and knowledge of DOE assessors who have conducted assessments in this area.  If you have specific lines of inquiry that have proven useful in deterring the effectiveness of program elements,  please forward them to us at loi@www.2004-1.org so other DOE assessors can benefit from your knowledge and experience.

Performance Objective 1: Contractor Program Documentation:

While this performance objective is focused on the Contractor, there are instances where DOE may be the performer of the work. Where DOE is the performer the contractor requirements as stated herein apply to the DOE organization doing the work.

1.1 Safety Software Inventory:  An inventory of safety software is identified, documented, and maintained.

Approach:

  • Determine the existence of a safety software inventory list. This maybe evidence by an electronic or hardcopy data set. The inventory list may be a subset of a larger software inventory list.
  • Ensure that the safety software can uniquely be defined.
  • Use sampling methods to determine the accuracy and thus maintenance of the inventory list.

Lines of Inquiry:

  • Does a list of safety software, as defined by DOE O 414.1C, documented?
  • Is each item on the safety software uniquely identifiable?
  • Is the inventory list current and accurate?

1.2 Safety Software Graded Approach: Establish grading levels for safety software. Document those grading levels in the QAP. [Suggested rewrite] Grading levels for safety software are established and documented in the QAP.

Approach:

  • Determine the existence of grading levels for safety software.
  • Review the grading levels for consistency and completeness with the graded approach as defined in 10 CFR 830 and DOE O 414.1C.
  • Determine if the document(s) containing the safety software grading levels is approved by DOE.

Lines of Inquiry:

  • Are the grading levels for safety software documented?
  • Are these grading levels consistent and complete as defined by the graded approach in 10 CFR 830 and DOE O 414.1C?
  • Has the document containing the grading levels for safety software been approved by DOE?

1.3 Safety Software Quality Assurance Consensus Standard: ASME NQA 1-2000, Quality Assurance Requirements for Nuclear Facility Applications, or other national or international consensus standards that provide an equivalent level of quality assurance requirements as ASME NQA 1 2000, are specified by the user and approved by DOE.

Approach:

  • Determine the consensus standard(s) specified for safety software quality assurance use. If the standard(s) specified is not ASME NQA-1-2000, review the documentation to establish equivalence of the specified standard(s) to ASME NQA-1-2000.
  • Determine if the specified standard(s) for safety software quality assurance is approved by DOE.

Lines of Inquiry:

  • Has a consensus standard been specified for safety software quality assurance use?
  • Has the specified consensus standard(s) been approved by DOE for safety software quality assurance?
  • Is this safety software quality assurance standard, ASME NQA-1-2000?
  • If the specified standard(s) is not ASME NQA-1-2000, has an equivalency document been developed?
  • If an equivalency document has been developed, does it prove the specified standard(s) provides an equivalent level of software quality assurance as ASME NQA-1-2000 in the following work activities?
    • Software project management and quality planning.
    • Software risk management.
    • Software configuration management.
    • Procurement and supplier management.
    • Software requirements identification and management.
    • Software design and implementation.
    • Software safety.
    • Verification and validation.
    • Problem reporting and corrective action.
    • Training of personnel in the design, development, use, and evaluation of safety software

Performance Objective 2: Contractor Program Implementation:

Work processes involving safety software must be developed and implemented using the DOE approved national or international consensus standards (as per the criteria in Section 1.3 above) and must include the following elements.

2.1 Facility Design Authority Involvement: Facility design authority is involved in the identification of software requirements specification, acquisition, design, development, verification and validation (including inspection and testing), configuration management, maintenance, and retirement.

Approach:

  • Review safety software development and acquisition documents such as safety software requirements, procurement or acquisition contracts and other documents, software development plans and documents, verification and validation documents, software configuration management documents, software maintenance documents, and software retirement plans for facility deign authority involvement in the document reviews and approvals.
  • Interview facility design authority personnel and safety software development and quality assurance staff for the level of involvement of the facility design authority staff.

Lines of Inquiry:

  • Is the facility design authority on the list of reviewers and/or approvers of the safety software development documents or their equivalent that are listed below:
    • safety software requirements?
    • safety software development plans?
    • safety software verification and validation plans?
    • safety software configuration management plans?
    • safety software test plans?
  • Is the facility design authority on the list of reviewers and/or approvers of the safety software procurement or acquisition contracts?
  • Does the facility design authority have a direct communication line with the safety software development?

2.2  Select and Implement Work Activities:  Using DOE approved grading levels (as per the criteria in Section 1.2 above) and ASME NQA-1-2000, Quality Assurance Requirements for Nuclear Facility Applications, or other DOE approved national or international consensus standards that provide an equivalent level of quality assurance requirements as ASME NQA 1 2000, applicable SQA work activities are selected and implemented from the following list to ensure that safety software performs its intended functions.

Approach:

  • Review software or quality assurance plans and documents, to determine if the 10 work activities have been evaluated to determine their applicability and requirement for full or graded implementation. The applicability of a work activity may be determined by the software type such as custom or acquired. A matrix using the approved grading levels, the software type and the 10 work activities may provide evidence that the work activities have been evaluated.
  • Use sampling methods to determine if the work activities identified through the work activity evaluation process have been implemented. This determination is associated with the assessment of the 10 work activities that are sub-elements to this Performance Objective.

Lines of Inquiry:

  • Has a classification/category such as software type to determine appropriateness for applying the 10 work activities been defined?
  • Has each of the 10 work activities been evaluated to determine their applicability under the above mentioned classification/category?
  • Does the applicability (i.e., selection) address the approved graded approach?
  • For each of the 10 work activities, has the selected work activities been implemented?

2.3 Software Project Management and Quality Planning: Software project management and quality planning depicts the organizational structure that supports the software life-cycle stages and deliverables, and influences and controls the quality of the software.

Approach:

  • Confirm the existence of project management and QA planning work activity. This may be present in software project management and/or SQA plans that exist either as a stand alone document or embedded in other documents and related procedures. The software project management and software quality planning should identify and/or define the following:
    • software project schedule;
    • software project scope;
    • software engineering activities, including software requirements and design;
    • software V&V activities, including reviews and test;
    • SCM activities;
    • software risk management approach;
    • software safety analysis and planning;
    • supplier control;
    • user and software staff training,
    • standards, practices, conventions, and metrics;
    • records and document collection, maintenance, and retention; and
    • problem reporting and corrective action methods.
  • Many of the items listed above may be detailed in other documents, for instance software V&V may be detailed in a software V&V plan or in software test plans. It should be noted that this work activity addresses the existence that these items are identified and described. Associated work activities, such as software V&V address the quality of the software V&V work activity being performed as it relates to the grading level.
  • Determine whether the documents containing the software project management and quality plan are controlled under configuration change control and document control process, and are maintained until the software is retired. This may overlap with the SCM work activity.
  • Verify that the software project management and quality plan is reviewed and updated, as necessary, for completeness and consistency. This may overlap with the software V&V work activity.

Lines of Inquiry:

  • Are the software specific activities and tasks described, identified and documented?
  • Are these activities and tasks sufficient to properly manage and control the software project and produce the required level of quality?
  • Do these plans identify the organizational structure associated with the project management and quality planning?
  • Are these plans initiated early and maintained throughout the software development life-cycle?
  • Are these plans reviewed, approved and controlled?
  • Do these activities and tasks include the following:
    • software project schedule?
    • software project scope?
    • software engineering activities, including software requirements and design?
    • software V&V activities, including reviews and test?
    • SCM activities?
    • software risk management approach?
    • software safety analysis and planning?
    • supplier control?
    • user and software staff training?
    • standards, practices, conventions, and metrics?
    • records and document collection, maintenance, and retention?
    • problem reporting and corrective action methods?

2.4 Software Risk Management: Software risk management utilizes a proactive and disciplined approach to assess and control software risks.

Approach:

  • Determine the existence of software risk management planning. This may be evident in a standalone document or embedded in another document. As applicable, ensure that the risk management planning specifies the following:
    • scope of the risk management activities;
    • risk management policies and process (for both technical and managerial) under which risk management is to be performed are defined;
    • identification of the technical and managerial risks and likelihood and potential safety consequences;
    • establishment of risk thresholds for the safety software application;
    • risk avoidance, mitigation, or transfer options; and
    • management techniques to address risks throughout project life-cycle, including tracking, decision, and feedback points.

Lines of Inquiry:

  • Have the risks associated with the successful completion of the software development or procurement been identified and documented?
  • Do these risks include risks associated with costs, resource availability, schedule, and technical aspects?
  • Have risk thresholds been identified and applied?
  • Are the risks evaluated for impact and probability of occurrence initially and periodically through the software life-cycle?
  • Are the risks prioritized and tracked through the software life-cycle?
  • Are actions taken to mitigate the risks using avoidance, risk reduction, and/or transfer of risks approaches?

2.5 Software Configuration Management: Software configuration is defined, maintained, and controlled until the software is retired.

Approach:

  • Review appropriate documents, such as applicable procedures related to safety software change control to determine if an SCM process exists and is effective. This determination is made based on the following actions.
  • Verify the existence of documented processes to control, uniquely identify, describe, and document the configuration of each version or update of safety software and its related documentation. This documented evidence may be in either SCM plan or embedded in another software or system level document.
  • Verify that a configuration baseline is defined and that it is being adequately controlled. This baseline should include operating system components, any associated runtime libraries, acquired software executables, custom-developed source code files, users' documentation, the appropriate documents containing software requirements, software design, software V&V procedures, test plans and procedures, and any software development and quality planning documents.
  • Verify a baseline labeling system has been created that uniquely identifies each configuration item, identifies changes to configuration items by revision, and provides the ability to uniquely identify each configuration.
  • Review procedures governing change management for installing new versions of the software components, including new releases of acquired software.
  • Review software change packages and work packages to ensure that (1) possible impacts of software modifications are evaluated before changes are made, (2) various software system products are examined for consistency and revised as necessary after changes are made and updated, (3) software is tested according to established standards after changes have been made, (4) changes are evaluated and approved for release by the responsible organization, and (5) software validation is performed as necessary to ensure that the change does not adversely affect the performance of the software.
  • Verify by sampling that documentation affected by software changes accurately reflects all safety-related changes that have been made to the software.
  • Interview a sample of cognizant line, engineering, and QA managers, and other personnel to verify their understanding of the change control process and commitment to manage changes affecting design, safety basis, and software changes in a formal, disciplined, and auditable manner.
  • For custom developed safety software, verify audits or reviews, such as functional configuration audit or physical configuration audit, have been performed.

Lines of Inquiry:

  • Are the methods used to control, uniquely identify, describe, and document the configuration of each version or update of software and its related documentation documented?
  • Is a configuration baseline defined and adequately controlled?
  • Does this baseline include operating system components, any associated runtime libraries, acquired software executables, custom-developed source code files, users' documentation, the appropriate documents containing software requirements, software design, software V&V procedures, test plans and procedures, and all software development and quality planning documents?
  • Has a baseline labeling system been implemented that addresses the following:
    • Unique identification of each configuration item?
    • Changes to configuration items by revision?
  • Is the baseline labeling system used throughout the life of the software development and operation?
  • Are proposed changes to the software documented, evaluated, and approved?
  • Is software baselined prior to approval for use?
  • Are only approved changes made to the baselined software?
  • Are software verification activities performed for the change to baselined software?
  • For custom developed safety software, have audits or reviews, such as functional configuration audit or physical configuration audit, been performed?

2.6 Procurement and Supplier Management: Acquired safety software, either commercial off-the-shelf (COTS) software or custom-developed for DOE, meets the appropriate level of QA based on risk, safety, facility life-cycle, complexity, and project quality requirements.

Approach:

  • Suppliers of acquired software are evaluated to ensure that the safety software is developed under an appropriate QA program and satisfies the specific requirements. The assessment of software procurement process should include the following:
    • Determine the existence of safety software technical and QA requirements. These requirements may be embedded in the DOE contractors' or subcontractors' procurement document, software or system design description, or SQA plan. If not documented in the procurement contract, ensure that the supplier has received such technical and QA requirements. This verification may overlap with the Software Requirements Management work activity.
    • Verify that the suppliers' QA program has been reviewed and meets or exceeds the procurement specification requirements. The supplier may review the supplier's QA program through supplier assessment, supplier self declaration, third-party certification, or other similar methods.
    • Review evidence that the acquired software was evaluated for the appropriate level of quality. This evidence may be included in the test results, a test summary, supplier site visit reports or supplier QA program assessment reports. This review may overlap with the V&V work activity.
    • Review procurement or other documents between the supplier and purchaser for a documented process to report software defects from the supplier to the purchaser and the purchaser to the supplier. This review may overlap with the Problem Reporting and Corrective Action work activity.

Lines of Inquiry:

  • Does the procurement and supplier documentation include both the technical and quality requirements including the following categories of software requirements:
    • Functionality?
    • Safety?
    • Security?
    • Performance?
    • Quality?
  • Does the procurement and supplier documentation include all documents to be provided to the customer?
  • Do the procurement and supplier documents include requirements for or the procedures for supplier notification of defects, new releases and other issues?
  • Do the procurement and supplier documents include requirements for or the procedures for users to report defects and requests for assistance?
  • Has the delivered product been assessed or otherwise validated to ensure requirements have been met? This evidence may be included in the test results, a test summary, supplier site visit reports or supplier QA program assessment reports.
  • Has the suppliers' QA program been reviewed to ensure it meets or exceeds the procurement specification requirements? This may include review of the supplier's QA program through supplier assessment, supplier self declaration, third-party certification, or other similar methods.

2.7 Software Requirements Identification and Management: Safety software functions, requirements, and their bases are defined, documented and managed throughout the safety software life-cycle.

Approach:

  • Review appropriate safety basis documents, such as DSAs, safety analysis reports, TSRs, procurement specifications and any system documentation to determine if the safety software requirements document is consistent with the safety system design and safety basis. The software requirements may exist either as a standalone document, such as a software requirements specification, or embedded in other system or software level documents.
  • Determine whether the following types of requirements are addressed as appropriate:
    • Verify that the software requirements address functionality, performance, security, safety design inputs, design constraints, installation considerations, operating systems (if applicable), and external interfaces necessary to design the software exist and are documented.
    • If access to the system by only authorized users is a requirement, verify that use of software is controlled so that only personnel on authorized user lists apply or maintain safety software.
    • Verify that the software requirements are correct, unambiguous, complete, consistent, verifiable, modifiable and traceable as appropriate.
    • Verify that acceptance criteria are established in the software requirements for each of the identified requirements. Such criteria should be used for V&V planning and performance as defined in each related life-cycle phase.
    • Verify that the software requirement documents are controlled under the configuration change control and document control processes. This may overlap with the SCM activity.
    • Verify that software requirement documents are reviewed and updated as necessary. This may overlap with the software V&V work activity.

Lines of Inquiry:

  • Are the software requirements defined and documented throughout the safety software life-cycle?
  • Are the software requirements uniquely identified?
  • Are the requirements controlled and maintained throughout the safety software life-cycle to minimize conflicting requirements and to maintain accuracy?
  • Are the software requirements traceable throughout the software life-cycle?
  • Are changes to the software requirements updated in any and all documents?
  • Are the requirements consistent with the safety system basis?
  • Do the software requirements address each type of the following categories:
    • Functional?
    • Performance/timing?
    • Security, including user access restrictions?
    • Interface?
    • Safety?
  • Are the software requirements complete, correct, consistent, clear, testable and feasible?
  • Can the software requirements be objectively verified and validated?

2.8 Software Design and Implementation: The safety software design depicting the logical structure, information flow, logical processing steps, data structures and interfaces are defined and documented. The design is properly implemented in the safety software.

Approach:

  • Review the appropriate documents, including design documents, review records, and source code listings. The design may be documented in a standalone document or embedded in other documents.
  • The software design description should contain the following information:
    • A description of the major safety components of the software design as they relate to the software requirements, and any interactions with non-safety components.
    • A technical description of the software with respect to control flow, control logic, mathematical model, data structure and integrity, and interface.
    • A description of inputs and outputs including allowable or prescribed ranges for inputs and outputs.
    • A description of error handling strategies and the use of interrupt protocols.
    • The design described in a manner suitable for translating into computer codes.
  • Evidence of reviews of the design and code for the appropriate grading exists. This may overlap with the software V&V work activity.
  • Evidence of developer testing including any independent testing for the appropriate grading exists.

Lines of Inquiry:

  • Is the safety software design complete and sufficient to meet the safety software requirements?
  • Does the safety software design fully describe the interfaces with external components or systems?
  • Does the safety software design describe how the software functions internally?
  • Does the safety software design describe the control flow, control logic, mathematical model?
  • Does the safety software design describe the inputs and outputs including allowable or their prescribed ranges?
  • Does the safety software design describe the data structures and provide layouts of those structures?
  • Does the safety software describe error handling strategies and the use of interrupt protocols?
  • Has a traceability between safety software requirements and the design been performed and is documented?
  • Have static analysis such as code reviews been performed on safety software code modules?
  • Is the static analysis performed adequate coverage of critical safety software components?
  • Was developer unit testing completed prior to system level testing?
  • Was developer testing, including unit, integration, and system level testing, planned and documented?
  • Does the developer testing include tests to address functions, code structure and logic, stress and load testing, software performance, and human factors?
  • Have the results of developer testing been analyzed and documented?
  • Where appropriate, have reviews and testing been performed by persons independent of the activity or code module being reviewed or tested?

2.9 Software Safety: The design of the safety software components is developed to ensure the software modules perform their intended safety function in a manner consistent with the implementation of the safety system.

Approach:

  • Review hazard analysis documents to ensure that software component and interface failures are included. This analysis may be part of a software or system level failure modes and effects analysis, fault-tree analysis, event-tree analysis or other similar analysis techniques.
  • Review how the identified hazards are resolved. Various methods are used for hazards resolutions, such as eliminations, reduction of exposure, and controlling or minimizing the effects of a hazard.
  • Review that the hazard analysis is periodically reassessed throughout the software life cycle and the changes incorporated as appropriate.
  • For Level A safety software, and optionally for Level B safety software, sample safety software modules for proof of design complexity evaluation and isolation of safety functions from non-safety functions.
  • For Level A safety software, and optionally for Level B where safety software modules defects could impact the safe operation of the system, evaluate the software design for the implementation of fault tolerant and/or self-diagnostics techniques.

Lines of Inquiry:

  • Has a hazard analysis of the software at the component level been performed and documented?
  • Did the hazard analysis identify the potential failures, the consequences of those failures, and the probably of occurrence associated with those failures?
  • Have actions been taken to eliminate or mitigate the identified failures based upon the consequences of failure and probability of occurrence?
  • Was the hazard analysis periodically reviewed and reassessed for possible changes in identified hazards or the addition of new hazards?
  • Have the changes to the hazards analysis been incorporated into the design of the safety software?
  • For Level A safety software, are the safety software components isolated from non-safety software components?
  • For Level A safety software, was the complexity of the software components used in evaluating the software design?
  • For Level A safety software, have fault tolerant techniques been considered in the design?
  • For Level A safety software, have fault detection and/or self diagnostics been considered in the design?

2.10 Verification and Validation (V&V): The V&V process and related documentation for software are defined and maintained to ensure, (1), the software correctly performs all its intended functions; (2), the software does not perform any adverse unintended function; and (3), the operation of the software addresses the original purpose, intent, and plan.

Approach:

Review appropriate documents, such as SQA plans, review plans, walkthrough records, peer review records, desk check records, inspection reports, test plans, test cases, test reports, test results, traceability matrices, system qualification plans and reports, and supplier qualifications to determine whether-

  • management process exists for performing V&V and management and independent technical reviews;
  • reviews and inspections of the software requirement specifications, procurement documents, software design, code modules, test results, training materials, and user documentation have been performed by staff other than those who developed the item;
  • software design was performed prior to the safety software being used in operations;
  • for software design V&V-
    • results of the safety software V&V are documented and controlled;
    • V&V methods include any one or a combination of design reviews, alternate calculations, and tests performed during program development; and
    • the extent of V&V methods chosen are a function of (1) the complexity of the software; (2) the degree of standardization; (3) the similarity with previously proved software; and (4) the importance to safety; and
  • for software test V&V-
    • documentation for development, factory or acceptance testing, installation, and operations testing exists and is adequate;
    • documentation includes test guidelines, test procedures, test cases including test data, and expected results;
    • results documentation demonstrates successful completion of all test cases or the resolution of unsuccessful test cases and proves direct traceability between the test results and specified software design;
    • test V&V activities and their relationship with the software life-cycle are defined;
    • software requirements and system requirements are satisfied by the execution of integration, system and acceptance testing;
    • acceptable methods for evaluating the software test case results include (1) analysis without computer assistance, (2) other validated computer programs, (3) experiments and test, (4) standard problems with known solutions, and (5) confirmed published data and correlations;
    • traceability exists from software requirements to design and testing, and if appropriate, to user documentation; and
    • hardware and software configurations pertaining to the test V&V are specified.
  • Observe or perform configuration management query tasks to address the lines of inquiry.

Lines of Inquiry:

  • Are verification and validation activities performed by competent staff that is independent of the item being verified or validated?
  • Are the verification and validation activities integrated with the software lifecycle and performed to ensure software requirements are correctly specified and implemented in the design, test documentation and released software code?
  • Do management processes exist for performing each of the following:
    • Verification and validation activities?
    • Management reviews?
    • Independent technical reviews?
  • Do the verification and validation activities include reviews and/or inspections of the following applicable items? (Note: these items may be combined or included with other system and software documentation.)
    • Software requirements specification
    • Software procurement criteria and documents
    • Software design
    • Code modules
    • User/operator training materials
    • Software development processes
    • Test results
  • Have the software testing activities been planned and documented?
  • Have the software testing plans been placed under configuration management?
  • Do the software test plans include testing for development, factory or acceptance testing, installation, and operations tests?
  • Do the software development, factory or acceptance testing, installation, and operations test cases and procedures include expected results?
  • Are the software development, factory or acceptance testing, installation, and operations test cases, procedures, and test results documented?

2.11 Problem Reporting and Corrective Action: Methods for documenting software problem reporting, and corrective action for safety software errors and failures are established, maintained, and controlled.

Approach:

Review documents and interview facility staff for the problem reporting and notification process to determine whether-

  • methods for documenting software problem reporting and corrective action development that addresses software errors, failures, and resolutions;
  • problems that impact the operation of the software are promptly reported to affected organizations;
  • corrections and changes are evaluated for impact and approved prior to being implemented;
  • corrections and changes are verified for correct operation and to ensure that no side effects were introduced;
  • preventive measures and corrective actions are provided to affected organizations in a timely manner; and
  • the organizations responsible for problem reporting and resolution are clearly defined.

Lines of Inquiry:

  • Are the practices and procedures for each of the areas below defined and documented?
    • Reporting problems or issues
    • Tracking those problems or issues
    • Resolving those problems or issues
  • Are the above practices and procedures implemented as defined above?
  • Does a process exist for evaluating if the reported problem or issue is a software defect, error or other source?
  • Are responsibilities for the following activities identified?
    • Reporting issues
    • Approving changes
    • Implementing corrective actions
  • Are the corrective actions implemented effective to ensure correct operation and no side effects were introduced?
  • Are the defects and errors associated with the safety software defects and errors correlated with software elements?
  • Has the potential impact of those defect and errors been evaluated?
  • Are the preventative measures and corrective actions commensurate with the impact of the original defect?
  • Have all users of the safety software been notified in a timely manner of the potential impact of the defects and errors?
  • For acquired safety software, do the procurement documents include requirements for the supplier to report problems to the user or purchaser?
  • For acquired safety software, do the procurement documents include requirements and/or procedures for the purchaser or user to report problems to the supplier?
  • Confirm and identify the applicable parts of NQA-1-2000, or an equivalent consensus standard for the SQA requirements, have been used for this requirement

2.12 Training of Personnel in the Design, Development, Use, and Evaluation of Safety Software: Personnel are trained/qualified and capable of performing assigned work. Continuing training to personnel to maintain job proficiency is provided.

Approach:

  • Review training records or other documentation and conduct interviews to confirm a training or indoctrination program exists for each of the personnel assignments listed above.
  • Verify the training program provides for continuing education.
  • Verify the training program is adequate and appropriate for the scope, complexity, and importance of the task being performed.

Lines of Inquiry:

  • Does a training or indoctrination program exist for each of the following personnel assignments?
    • safety software analysis
    • software development (concept to retirement)
    • operations and use
    • assessment or evaluation of safety software
  • Does the training or indoctrination program provide for continuing education and training for each of the above personnel?
  • Does the continuing education and training improve the performance and proficiency for each of the above personnel?
  • Is the training or indoctrination program designed according to the scope, complexity, and importance of the tasks, education and proficiency of the personnel?
  • Confirm and identify the applicable parts of NQA-1-2000, or an equivalent consensus standard for the SQA requirements, have been used for this requirement.
  • For Level A safety software, are metrics and measured used to determine the impact of the training or indoctrination program on personnel performance?
  • For Level A safety software, are metrics and measured used to determine the impact of the training or indoctrination program on personnel proficiency?

Performance Objective 3: DOE Line Management Oversight Documentation:

Federal personnel have the technical competency to perform SQA responsibilities: Federal personnel with SQA responsibilities have technical competency to carry out their duties. Technical qualification requirements are specified in technical qualification standards. The process has been coordinated with the Federal Technical Capability Panel (FTCP) in accordance with the requirements of DOE M 426.1-1A, Federal Technical Capability Manual, dated May 18, 2004, and DOE STD-1172-2003, Safety Software Quality Assurance Functional Area Qualification Standard, dated December 2003.

Approach:

  • Review the technical qualification records to determine the individual responsible for having the technical competency for safety software quality assurance.
  • Review the qualification process of the individual to ensure it meets DOE M 426.1-1A.

Lines of Inquiry:

  • Has DOE/NNSA identified an individual or individuals responsible for performing SQA responsibilities?
  • Are each of these individuals qualified as per DOE STD-1172-2003, Safety Software Quality Assurance Functional Area Qualification Standard, dated December 2003?
  • Did this qualification meet the process in accordance with DOE M 426.1-1A, Federal Technical Capability Manual, dated May 18, 2004?
  • Has a Technical Qualification Program (TQP) approved SQA Functional Area Qualification (FAQ) card been completed for each of the individuals responsible for performing SQA responsibilities?

 



This page was last updated on June 15, 2012