Thursday, July 17, 2008

Techniques used at High Maturity?

I came to know that these techniques (listed below) were used in SEIs' case studies for high maturity. Does it mean that ALL organisations are expected to use these when operating or appraised at ML 5?

This looks quite exhaustive, please advise.
  • ANOVA Reliability Growth Modeling
  • Chi-Square Response Surface Modeling
  • Regression Time Series Analysis
  • Logistic Regression Hypothesis Testing
  • Dummy Variable Regression Logit
  • Bayesian Belief Network Monte Carlo Simulation
  • Designed Experiments Optimization
  • Discrete Event Simulation
  • Reliability Growth Modeling
  • Response Surface Modeling
  • Time Series Analysis
  • Hypothesis Testing
  • Logit
  • Discrete Event Simulation
No, neither the CMMI nor the SEI expect that all organizations must use these techniques. This is a list of example techniques. However, it is expected that High Maturity organizations use these types of techniques. The organization has to determine which technique(s) work best for them to understand the special and common causes of variation, etc. The organization has to build Process Performance Baselines (PPBs) and Process Performance Models (PPMs). To build these things, the organization has to analyze their historical data. This analysis can be done in many different ways and the list of techniques include some of the typical data analysis methods.

So what would be very helpful for you is to either get some training on data analysis and statistical techniques or hire a statistician to help you with your High Maturity efforts. Then you will figure out which quantitative analysis technique(s) are appropriate for your data and your organization.

And, to quote Pat O'Toole: "High maturity is NOT just about statistical techniques. Rather, it is about performing your critical processes so consistently that the information to be gleaned from the use of these techniques contain more signal than noise. You can use the data streaming off the critical processes to detect abnormal performance, and to predict (in a statistical sense) future outcomes of interest."


connect2hcb said...

One quick thought on the statement "neither the CMMI nor the SEI expect that all organizations must use these techniques".

Even though these techniques are not "must" and should be seen as a means to an end, on the ground, they are taken as "must" by the CMMI Folks - Implementers, Consultants, and Appraisers. IMHO one way to makes this appear natural is to dove-tail CMMI High Maturity and Six Sigma. Pls see the post below from my website connect2hcb:
CMMI High Maturity and Six Sigma

Henry Schneider said...

Dear connect2hcb,
I would agree with you in general. But again, the list of techniques are all good candidates for use at ML 4 and 5, but they are NOT required NOR expected that they must be used.
There is a very good fit between the CMMI and Six Sigma at ML 4 and 5. And I would also contend that if you try to use Six Sigma at ML 2 or ML 3, you run the risk of fixing one process and appear to achieve your goal while breaking one or more other processes that can be more costly than what you have "fixed." To use Six Sigma properly, you need to have well known and understood, stable processes that can be described by using data.