Continuous Iterative Development (Agile) Measurement Framework

This paper provides recommendations for the measurement of continuous iterative developments (CID).  It includes a series of diagrams and an ontology to describe the development approaches and terminology used. The paper includes a Practical Software and Systems Measurement (PSM) CID measurement framework detailing common information needs and measures that are effective for evaluating CID approaches. This is documented in the “Information Category-Measurable Concept-Measures” (ICM) Table. The information needs address the team, product, and enterprise perspectives to provide insight and drive decision-making. This is documented in the ICM table described in Section 7. The framework also identifies an initial set of measures that have been identified as being practical measures to address these information needs.  For the highest priority measures, sample measurement specifications have been developed that detail the identified measures. These are included in Section 8. Additional potential measures will be added in future releases, as described in Section 6.


A collaborative working group was established between Practical Software and Systems Measurement (PSM), the National Defense Industrial Association (NDIA) Systems Engineering Division, and the International Council on Systems Engineering (INCOSE) to develop a PSM CID measurement framework for Continuous Iterative Development (CID) in response to recommendations of the strategic Defense Science Board (DSB) (Design and Acquisition of Software for Defense Systems, Defense Science Board (DSB) Task Force on Design and Acquisition of Software for Defense Systems, 2018) and Defense Innovation Board (DIB) (Software Is Never Done: Refactoring the Acquisition Code for Competitive Advantage, 2019) Software Acquisition and Practices (SWAP) study.

Additionally, the U.S. Department of Defense (DoD) is making a transformational change in acquisition policy by redesigning the Defense Acquisition System, including the addition of a new Software Acquisition Pathway (Software Acquisition Pathway Interim Policy and Procedures, 2020). The general guidelines for this new acquisition policy are established in Section 800 of the 2020 National Defense Authorization Act which became law on December 20, 2019. The new pathway will promote Agile and DevSecOps and allow for upgradeable and timely fielding of software in a way that aligns with this CID approach. The measurement recommendations in this paper provide a good framework to measure the Execution Phase of the Software Acquisition Pathway.

The most critical information needs and measures have been prioritized, based on a series of surveys with members of relevant NDIA, PSM, and INCOSE working groups.  Additional measures will be specified, and revisions to the information needs will be included, as additional input is provided.  This framework will be improved over time. We welcome your recommendations and comments.

Click on the link below to view and download the CID Measurement white paper.

CID Measurement White Paper


Users' Group Workshops. . .
Previous Workshops
2019 Details

Bottom Links Home | Products | Services | Events | Forum | Contacts