Metrics should be designed to drive improvement and decision-making within an organization. While having a large population of data can be beneficial for statistical significance, and qualifying all aspects of a process is important for comprehensive understanding, the key is to present the metrics in a way that highlights areas for action. This could involve identifying trends, pinpointing areas of non-conformance, or tracking progress against goals. Metrics used to establish acceptability limits for a product are also important, but they are more about defining quality rather than measuring the effectiveness of quality initiatives.

References: The principles outlined here are consistent with the best practices in quality management and organizational excellence, as described in resources like the ASQ Certified Manager of Quality/Organizational Excellence Handbook1. While I cannot directly reference the handbook, the approach to metrics aligns with the general guidance provided for quality management professionals.