As an example, lets pretend we're going to pick a server platform. In this, effort, we have some specific things we care about:
- security updates - Does the solution have automatic and timely notification of security issues and an automated way to patch the server.
- modern versions of applications supported - as a criteria, which version of ngnix does the package support
We then take this information, select a number of candidate solutions and put them into a table as column headers:
Then we take our criteria and add them as rows
Next, we do the hard work of scoring each solution according to our criteria.
|modern applications (ngnix version)||(custom install) 0||(8.54) 2||(.8.54 AND 1.0.4) 3|
As we can see, applying different score makes evaluating the "best" solution easy to comprehend. The risk is that we really should establish scoring criteria ahead of time or we'll end up fooling ourselves by scoring things according to a bias we may have toward a particular solution. Obviously this is an oversimplified set of criteria, but it should easy to see how to extend this to more complicated scenarios (just add more rows and let excel be our friend).
I'd be curious to hear other tools and techniques to do this and would welcome some comments with better/different solutions.