ISACA Changes their IP policy regarding CMMI. What does that mean to us?

 Hey Appraiser!

Our consultant just told us we had to purchase an Enterprise license in order to conduct a CMMI Appraisal now - what gives?  ~Monet Grabba

3 Tips for passing you CMMI Appraisal!

Monet,

With the release of CMMI v3.0 also came a new IP policy.  They discussed doing this when V2 came out, but wisely backed off. No longer.

The new policy is that the Practice names (statements), Value Statements, Intent, and examples are proprietary and cannot be shared with anyone who does not have an active license for the CMMI Model Viewer.

Many of these are the same exact practices that were in v1.3, which was, practically speaking, public domain because it was build with taxpayer dollars.  It's gonna be hard to stuff that back in the bag.

What this means for Lead Appraisers and companies adopting CMMI  without a license, is that appraisal results CANNOT state the name of the practice that is being reviewed and "scored" (characterized).  So...if I need to tell a client that the 1st practice in Estimating has a weakness, that's all I can tell them, unless they have an active license for EVERYONE that is in the room!

Now, don't get me wrong.  I know the fine folks at ISCA fairly well, and they're smart people, but this stuff ain't rocket science.  "Establish an Estimate" (I paraphrase here so I don't get lashed with a wet noodle) isn't the stuff of process innovation.  Most of CMMI descibes actions smart people would take if they have the right tools and training.

I understand the examples, value intent statements, and explanatory material.  That is truly original (though sometimes uninspiring). But the practice names have been around, in some form, since v1.0, and everyone has them already.

Nevertheless, those are the new rules.  So, if you're going to adopt CMMI you should get an enterprise license.  You'll want it anyhow - there's actually some great stuff in there.

For further guidance, including training resources and instructional materials, please refer to www.broadswordsolutions.com or explore instructional content on CMMI, Agile methods, CMMI Appraisals, CMMI Training, and more via CMMI-TV.

What do the "Characterizations" in a CMMI Appraisal Mean?

 Dear Appraiser,

I keep hearing about "Characterizations" in the CMMI, like FM, LM, PM, and DM.  What do these means?  ~ Mick Filipini

Want to pass your CMMI Appraisal?  Here's what not to do!

Hey Mick - good question!

When we conduct Benchmark appraisals we need a way to "score" each practice based on the two types of objective evidence - artifacts and affirmations.  Each appraisal looks at both in order to determine each practice's strength.  This is done by examining "artifacts" (documents, databases, videos, etc), and "affirmations," within the context of the organization's goals, and the Intent and Value statement of the Practice Area.

Fully Met (FM) = There is plenty of documentary and spoken/written evidence to convince the Appraisal Team that that practice is healthy and complete, given the context of the organization being appraised.  The team has no indication that there are weaknesses, and all believe the practice is being executed well.  This is like getting an "A" on a paper.

Largely Met (LM) = There is also plenty of evidence in both categories, but the team feels there is some improvement to be made, and they will tell you exactly what that is.  Examples include: Not ALL projects were as strong as others, one piece of evidence wasn't as strong as the others, or maybe the method chosen to perform a piece of work might have been better by applying a different method.  I see a lot of appraisals that use "planning poker" in a setting where that may not make sense.  This is like getting a "B" on a college paper.  You can have some of these and still be rated ML2/3/4/5, but there are caveats.

Partially Met (PM) = There is some evidence the practice is being performed effectively, but there are major holes, and they need to make improvements.  For instance, maybe they are performed estimating using "Wide Band Delphi" but they didn't execute it the way it is intended.  This is like getting a D on a college paper.  You generally can't have any of these, although there are scenarios where you could pass if a project has one of these babies.

Doesn't Meet (DM) = There is little evidence that the practice is being performance.  This is like getting an F.  The presence of a single DM usually means a fail, but like PM, there are exceptions.

In a perfect appraisal, these are the only four characterizations that we would see, but there are two more!

Not Yet (NY) = The project hasn't reached the point in the project where they should be performing the practice.  This is usually either a sampling error (why was that project selected for that Practice Area) OR a misunderstanding of the intention of the practice.  We see this with Validation and Verification, where an organization claims they haven't reached testing, not realizing that these practices should also apply to earlier actions on the project, like planning or requirements.  The final outcome of an NY depends on what other projects in the sample have scored, and the Appraisal team's view as to what affect that has on the overall organization.

Not Rated (NR) = When the appraisal team can't reach a consensus on the characterization, thereby forcing the end of the appraisal without rating the organization at a maturity level.  This is usually a failure of the appraisal team, or dare I say it, a failure of the Lead Appraiser to facilitate the team's consensus.  Once in a while, we have an Appraisal team member that refuses to compromise also - but that's rare.

So that's the system - here's to you all getting FMs and LMs!

For further guidance, including training resources and instructional materials, please refer to www.broadswordsolutions.com or explore instructional content on CMMI, Agile methods, CMMI Appraisals, CMMI Training, and more via CMMI-TV.