Which project shall come next?

Every tech company, from individual startup to multinational giants is periodically facing this complex decision: choose or prioritize projects. There are usually more opportunities and ideas that available resources and budget.

The so called “product portfolio” or “application portfolio” optimization involves deciding from (or prioritizing) a set of alternatives under multiple criteria. First alternative can present a short time-to-market while the second one can be a very innovative idea with no competition and third one seems to have a great potential. Which one shall you pick?

Analytic Hierarchy Process (AHP) is the perfect technique for this purpose because it uses a rational approach that checks decision consistency. AHP uses computes factors weights and alternative scores from individual pairwise comparisons. Here is a complete example of applying AHP to solve this problem using Welldecided that is freely available on the net. For the impatient here is a 90 seconds screencast:

 

 

To try Welldecided on your own projects click here.

We will consider 4 key factors shown in next table. You easily expand or reorganize such factor list for your specific case. An inspiration source can be the book “Will it fly? - How to know if your new business idea has wings ...” by Thomas K. McKnight. Another book about this subject is “Manage Your Project Portfolio” by Johanna Rothman (still to be published).

 

Market

This factor is better as the number of potential buyer (users) increases. To evaluate it ask yourself:

  • Do potential buyers already recognize the problem we are solving?

  • Is such need really “compelling”? Which alternatives exist?

  • How many potential buyers can you mentally count?

 

Acceptance

This factor is better if convincing a potential buyer is easier.. To evaluate it ask yourself:

  • Can you demonstrate in your solution in few minutes?

  • How long a buyer will take to get expected benefit?

  • Which possible risk exist for buyer?

  • How many people will be typically will buy decision involve (B2B)?

 

Competition

This factor is better when you have less (quality) competitors. To evaluate it ask yourself:

  • How many competitors exist? How aggressive and organized they are?

  • What is the average buyer satisfaction of existing competitors?

  • Can you easily prove that your solution is better than your competitors?

  • How long will existing or new competitors take to imitate you?

Resources

This factor is better if you need less time, money or resources in general.. To evaluate it ask yourself:

  • What is the time-to-market for this project?

  • Do you dispose of required technical resources?

  • Do you dispose of required sales and marketing resources?

 

 

Our example considers 3 alternative sales (marketing) applications:

  1. Small CRM

  2. Travel Expenses

  3. Prospect evaluator (computes close probability)

A Welldecided model with those predefined factors is available here (requires Java 6 in your browser). If you click on factors tab you see that factors have already been defined and their relative importance assessed (we are going to change it in a few moments).

To start evaluating alternatives choose Decision > Evaluate (F9). Since there are no alternatives Welldecided asks you to enter at least two (you can always add more later on Alternatives tab):

After entering our 3 alternatives the assessment process begins with first factor. You are asked to compare alternatives in pair. AHP uses this information to verify consistency: if A is better than B and B is better than C and C is better or equals to A your assessment is obviously inconsistent!

Welldecided shows undefined comparisons with a yellow background. You assess relative preference of alternatives by dragging slider thumbs. When you do that:

  1. yellow background disappear,

  2. bottom line displays the textual meaning of comparison,

  3. color of alternatives changes to reflect assessment (green is better and red is worse).

Here is the resulting assessment for “Need” factor we possibly obtained by inquiring potential buyers: a small CRM system is more compelling than Travel expenses and Prospect evaluator and Travel expenses is minimally better than Prospect evaluator.

Here is the full set of comparisons:

 

Market

Small CRM

is little better than

Travel Expenses

3/1

Small CRM

is little better than

Prospect Evaluator

3/1

Travel Expenses

is minimally better than

Prospect Evaluator

2/1

Acceptance

Small CRM

is worse than

Travel Expenses

1/4

Small CRM

is much worse than

Prospect Evaluator

1/7

Travel Expenses

is worse than

Prospect Evaluator

1/4

Competition

Small CRM

is little worse than

Travel Expenses

1/3

Small CRM

is worse than

Prospect Evaluator

1/5

Travel Expenses

is little worse than

Prospect Evaluator

1/3

Resources

Small CRM

is worse than

Travel Expenses

1/5

Small CRM

is much worse than

Prospect Evaluator

1/7

Travel Expenses

is little worse than

Prospect Evaluator

1/3

After entering assessment we get ranking of alternatives: Prospect evaluator gets 1st place.

To understand what produced such high rating click on “Values” tab and see that Acceptance factor played an important role. Being able to demonstrate in minutes the benefits of application is in fact a key success factor.

The Weights tab shows the weights of each factor, also obtained through AHP algorithm:

To change such weights, choose Factors tab, select root branch (Select best project) and click on dial icon (evaluate this factor) or F5. You will get the usual assessment dialog, but for factors this time:

The same way you can at any moment re-assess any factor by selecting and re-evaluating it. Just remember to look at Inconsistency Ratio (IR) shown on factors tree: it shall be lower than 10% (it is shown in red otherwise). If any inconsistency ratio is higher just re-asses it by fixing pairwise conflicts.

You can obviously add remove and rearrange (possibly in multiple levels) factors and alternatives or use execute Welldecided for any other multi-criteria decision problem.

 

 

Last modified on 2011-05-23 by Administrator