Quality Report#
Quality Report
|
status: draft
security: YES
safety: ASIL_B
|
||||
This document implements wp__qms_report and based on the wp__qms_plan. It summarizes the results of the quality related activities. It shall be referred in the wp__platform_sw_release_note of a platform release.
The Quality Report contains:
1. Quality Overview#
The goal of this first version of the Quality Report is to provide an overview of the quality related activities and their results. The Quality Report is a living document and will be updated at least with every platform release. More important for the moment is to identify gaps and to close them.
1.1. Quality Objectives and Goals#
Quality Objectives#
# |
Standard Name |
Version |
Status |
|---|---|---|---|
1 |
Automotive SPICE PAM |
4.0 |
Requirements fully linked to process descriptions |
2 |
ISO 262626:2018 |
2018 |
Requirements and work products fully linked to process descriptions |
3 |
ISO/SAE 21434:2021 |
2021 |
Requirements linked to 75%, work products linked to 100% to process descriptions |
4 |
ISO PAS 8926:2024 (will be integrated into ISO 26262 3rd edition as updated part 8 clause 12) |
2024 |
Requirements and work products fully linked to process descriptions |
Quality Performance Objectives#
# |
Activities |
Cadence |
Status |
|---|---|---|---|
1 |
Platform process audit |
Once for every platform release or on demand |
Open |
2 |
Feature process conformance checks |
Once for every feature release |
Open |
3 |
Work product review |
Once for every feature release |
Open |
4 |
Platform release verification and approval |
Once for every release |
Open |
5 |
Process consulting / Quality trainings |
Continuously |
On the job, not explicitly documented yet |
6 |
Process monitoring / Process improvement |
Continuously |
Open |
Quantitative Quality Goals#
# |
Quality Criteria |
Source |
Target value |
Allowed variation |
Metric |
|---|---|---|---|---|---|
1 |
One Platform process audit per release |
Automotive Safety Integrity... (stkh_req__dependability__automotive_safety), Stakeholder Requirements |
100% of the Platform process audit has be done for every release |
Delta audit allowed to achieve 100% |
Ensured by the process quality management, wf__exe_pltprocess_audit - Platform process audit is available |
2 |
One process conformance check for every feature release |
Automotive Safety Integrity... (stkh_req__dependability__automotive_safety), Stakeholder Requirements |
One process conformance check has been done for every stable feature release |
Feature is released as experimental |
Ensured by the process quality and tool management, wp__qms_report - Process conformance is available |
3 |
Only quality-assured project/platform work products are delivered to the community |
Automotive Safety Integrity... (stkh_req__dependability__automotive_safety), Stakeholder Requirements |
100% of project/platform work products are quality-assured |
Feature is released as experimental |
Ensured by the process quality and tool management, wp__verification_platform_ver_report - Work products contain the verification of the quality assurance |
4 |
Only quality-assured project/platform releases are delivered to the community |
Automotive Safety Integrity... (stkh_req__dependability__automotive_safety), Stakeholder Requirements |
100% of project/platform releases delivered to the community are quality-assured |
Feature is released as experimental |
Ensured by the process release management, wp__platform_sw_release_note contain the verification and approval of the quality-assurance |
5 |
Only quality-trained personnel are part of the rl__committer |
Automotive Safety Integrity... (stkh_req__dependability__automotive_safety), Stakeholder Requirements |
100% of personnel are trained as per committer role description in rl__committer |
None |
Ensured by the process platform management, wp__training_path contain the training material and evidences for conducted trainings |
6 |
No overdue quality assurance closure activities |
Automotive Safety Integrity... (stkh_req__dependability__automotive_safety), Stakeholder Requirements |
100% of the quality improvement, non-conformance issues are closed |
None |
Ensured by the process quality management, wp__issue_track_system contain improvements and non-conformance |
Work Product Quality Goals#
For all generated work products, the following quality goals are defined:
# |
Quality Criteria |
Source |
Target value |
Allowed variation |
Metric |
|---|---|---|---|---|---|
1 |
All work products have to be available and valid. Templates, checklists, and guidelines shall be used. Plans have to be up to date. The training material shall be available in the training path. The issues in the issue tracking system following the planning strategy. |
All Repositories that contain work products and that are in development or maintenance phase |
100% |
There is no allowed variation for the work products |
The metric for the work products is ensured by the process that contains the work product. Only valid work products can be merged. Reviews are required and therefore checklists are prepared. If applicable, script based checks are implemented. |
Evaluation Quality Overview#
Processes are partially applied. So it’s proved that they are applicable with some open gaps regarding implementation and verification which are not final proved for the moment. The quality objectives and goals has to be archieved for the complete project.
1.2. Lists of all work products#
Quality Management Generic work products#
1.3. Lists of all reports#
1.4. Test coverage#
Overview of test coverage (overall, requirements, architecture)
Ratio of test coverage to the wp__verification_plan
1.5. Issues#
Issues are tracked in the wp__issue_track_system. The issues are tagged with “quality” <https://github.com/eclipse-score/score/issues?q=is%3Aissue%20state%3Aopen%20label%3Aquality>`_
1.6. Process Improvement#
Issues are tracked in the wp__issue_track_system. The issues are tagged with “quality” <https://github.com/eclipse-score/score/issues?q=is%3Aissue%20state%3Aopen%20label%3Aquality%20label%3Acommunity%3Aprocess>`_