BLOG
06 August 2024

Why prioritize value backed by measurable data over sheer product features?

it-project-management

Understanding value becomes clear when measured in terms of income, revenue, and direct costs. But is value solely monetary? Metrics like growth rate, market share, and customer satisfaction are equally vital. Similarly, a product's ease of use and adoption are crucial optimization factors.

 

And what about the effects of engineering work?

These, too, are easily measured, for example, by the amount of functionality delivered. But it is only of secondary importance, why? Because the number of features delivered is irrelevant if none of them contribute to improving the customer's existence or capabilities.

Now, let's examine the results of the 2002 Standish Group study (an independent international IT research advisory firm):

standish.jpg

According to Jim Johnson, Chairman of The Standish Group – “The 2002 pie chart was based on 100 mission-critical applications that we were researching for a total cost of ownership (TCO) study. Since then, they have conducted several TCO studies annually. They try to incorporate this into their engagements. Based on these casual observations, their current estimate of features used for mission-critical applications is 20% often and always, 35% infrequently, and almost half hardly ever.”

According to a publication in the Harvard Business Review, 'The vast majority [of new ideas] fail in experiments, and even experts often misjudge which ones pay off. At Google and Bing, only 10-20% of experiments yield positive results. At Microsoft, one-third prove successful, one-third yield neutral results, one-third negative."

 

Does this mean that new software products should not be developed?

Of course not. What it does mean, however, is that you should pay close attention to the goal you want to achieve. It should NOT be "Let's do all the functionality, then our application will be perfect". The assumption that everything on the 'wish list' is important and valuable is wrong - as the research described above proves. Instead of worrying about whether everything will work, focus on how you can test value assumptions more quickly to reduce waste (and therefore cost) and increase the value delivered.

 

Therefore, when working with a Product Owner or Product Manager, I ask the following questions of stakeholders:

  • Despite good metrics, is it possible that we do not achieve success?
  • How do we validate assumptions about user needs or market demand?
  • What do we learn about value? How does this influence our product decisions?
  • What has changed in relation to our users or our competitors since we started this initiative?

 

From a product scientist's point of view, what to focus on when building a software solution can be defined in the following points:

  1. Develop the product based on new information. The initial product vision is a starting point, based on assumptions and guesses, many of which will be correct, but some of which will turn out to be wrong. You will need to check, adjust, and develop the product vision based on new information. I think this is most accurately stated by Peter Drucker, the management guru: If you can't measure something, you won't be able to improve it.
  2. Stay focused. Successful products have a clarified purpose. The teams creating them know who they serve and how they serve them. Poor-quality products try to serve a little bit of everyone but will not fully satisfy anyone.
  3. Constantly improve the product. To use the words of professional coach Don McGreal, 'be annoyed.' Product owners should look for opportunities to reinforce the product vision, as well as validate compliance with the product vision.

 

Below is a list of indicators that can be your starting point for measuring:

1. Satisfaction of customers using your app:

  • Net Promoter Score (NPS)
  • Revenue or profitability per customer
  • Customer return
  • Reduction in total cost of ownership
  • Increase in conversion rate
  • Increase in the number of customers or users
  • Customer referrals.

2. Achieving business goals:

  • Market share
  • Total revenue or profit
  • Cost of acquiring a new customer
  • Reducing cycle time
  • Reducing inventory in the warehouse
  • Cost savings or increased market share.

3. Customer-related performance indicators:

  • Time saved by the customer in meeting the set target
  • Frequency of use of features
  • Time of use of features
  • Number of customers or users using a feature
  • Percentage of finalized/aborted transactions.

 

How do you organize all this?

Scrum was not created to help you build and release more 'stuff.' Instead, Scrum is designed to help you maximize the value you create for your customers and therefore your organization - by delivering the product frequently, measuring the results, and then learning and adapting to squeeze even more value out of the product. Hence, a product review with your team should be an important event on your meeting calendar.

 

The outcome of a sprint review is to:

  • To verify the delivered (read working) parts of your product
  • Getting feedback from you on changes to the product, if required
  • A brief analysis of the acquired measurable data (see list of indicators above)
  • Obtaining information on general market trends in your industry The actual value and trend data provide even more empirical data to help you build your product!
  • Making decisions about the product register, i.e., finding out what we are doing next that will bring us the most value.

 

When you plan for a short Sprint period (1-month max) and then actually do the work, you have the opportunity to quickly check the results by asking:

  • What assumptions did we validate?
  • What did we learn?

 

Based on the new information, you can adjust your plan accordingly. By modifying your plans based on new, measurable information, you minimize the risk of complex work in an unpredictable and changing world. If, on the other hand, the team is forced to adhere to a schedule, this is often at the expense of quality. Ultimately, this kind of activity generates costs in the long run because it destroys your ability to deliver future value. This traditional approach to project management suggests that making more detailed plans reduces risk, but more detailed planning actually only delays confronting risk by making more assumptions. And the further into the future the forecast goes, the wider the range of unknowns, complexity, and likelihood of change. This is why so many traditional projects fail. So, in practice, the empirical assumptions of the Scrum approach reduce uncertainty by taking action rather than planning more action.

 

If you are interested in this topic, I encourage you to read the book by Stephanie Ockerman: "Mastering Professional Scrum: A Practitioner's Guide to Overcoming Challenges and Maximizing the Benefits of Agility".

 

Source of graphics: www.pexels.com.



Author
Agnieszka Topczewska-Pińczuk
Scrum Master | Project Manager

I believe that anything I do, I do for the end-user. I maximise value by:

- setting a path to the product's goal, helping developers do what they need to do

- frequently inspecting the result of their work to confront assumptions with reality

- adapting to the changing needs of Stakeholders based on feedback and measurable data.

I manage IT products agilely and know how to make your vision a reality. Would you like to work with me?