Topic

Why Dashboards Fail to Support Real Decision-Making

Insights/ Data Systems & Performance / Dashboards & BI

09 Sept 2024 - 07 min read

Why Dashboards Fail to Support Real Decision-Making
Listen to article00:00 / 08:52

When the design rules are followed and dashboards still fail

Sometimes the design rules are followed (one decision per dashboard, the right metrics, comparisons, freshness signalling) and the typology is respected (executive shape for executive use, operational shape for operational use), and the dashboard still fails. The numbers are correct. The page loads. Someone built it with care. And yet, six months in, it does not change a single decision the team makes.

This article is about the specific failure modes that survive design discipline. They are the patterns that explain why a dashboard that looks right on every checklist still gets ignored, or worse, gets approved-but-unused. Recognising them early is what separates dashboards that survive their first quarter from dashboards that quietly become decoration in a BI tool.

It pairs with the dashboard design discipline article, which covers the rules; here, the focus is the failure modes that the rules alone do not prevent.

Failure 1: The dashboard answers a question nobody is asking

The dashboard is well designed. The metrics are clear. The comparisons are honest. But the team that opens it is not actually deciding the thing the dashboard is supposed to support. The dashboard is about quarterly margin, and the team is deciding pipeline allocation. The dashboard is about user retention, and the team is deciding which feature to ship next sprint.

The mismatch is rarely deliberate. The dashboard was built when the team thought it was about to face that decision, the decision moved or was already being made elsewhere, and the dashboard remained, well-built but irrelevant. The fix is to revisit the decision the dashboard claims to support and ask the people who would supposedly use it: do you actually decide this, on this cadence, with this kind of input. If the honest answer is no, the dashboard needs to be redesigned around what they do decide, or retired.

Failure 2: Right metric, wrong comparison

The metric on the dashboard is unambiguously the right one. Revenue, response time, conversion rate, whichever number the decision actually depends on. But the comparison next to it does not match how the team thinks about the metric.

The dashboard shows revenue against last year. The team thinks in terms of "against this quarter's plan", because last year is irrelevant after a strategy shift. The dashboard shows response time as a daily average. The team thinks in terms of p95 by region, because the average hides the cases that actually trigger escalations. The dashboard shows conversion against an all-time benchmark. The team thinks against the most recent campaign.

When the comparison is wrong, the metric becomes something the user has to mentally re-anchor every time they read it, and the dashboard stops being faster than asking the question by email. The fix is small: change the comparison. The hard part is noticing that the comparison is the problem rather than the metric.

Failure 3: There is no path from the number to the action

The dashboard correctly identifies that something is wrong. Tickets are backing up. Revenue in segment X is down. The system is approaching a saturation indicator. The user reads the page, agrees that there is a problem, and then has nowhere to go from the dashboard.

The actionable record (which tickets, which customers, which servers) lives in another system. Getting from the dashboard headline to the work it implies takes a tab switch, a manual filter, sometimes a Slack message to ask the data team for a list. The dashboard surfaces the issue and stops short of letting the user act on it, so over time, users stop checking the dashboard until someone tells them there is a problem, at which point the dashboard is just confirming what they already know.

The fix is to design the path to action into the dashboard itself: a click that takes the user to the queue, a link that opens the customer record, a filter that exports the affected list. A dashboard that surfaces a problem without enabling the response is half a tool.

Failure 4: Built by committee, owned by no one

The dashboard was specified in a working group with eight stakeholders, each of whom asked for the metric most relevant to their function. The result is a long page with everyone's metric on it, approved by everyone, advocated for by no one. After the launch celebration, the meetings about the dashboard stop. The metrics that were "essential" to one stakeholder are looked at once a quarter; the others are not looked at at all.

The pattern is recognisable. Every metric was added by someone, but no single person can defend the dashboard as a whole. Nobody is responsible for retiring metrics that are no longer relevant, for tightening the design as the decision changes, for explaining anomalies when they appear. The fix is to name a single owner with the authority to remove metrics other people requested, and to accept that the resulting dashboard will be smaller and less politically inclusive than the committee version, which is a feature, not a bug.

Failure 5: The decision happens elsewhere

The dashboard exists, the metrics are right, the design is clean. The actual decision happens in a Slack thread, in a spreadsheet someone exports once a week, in a hallway conversation, in an email chain attaching screenshots. The dashboard is the official source of truth on paper; the working source of truth, the one decisions are actually made from, is somewhere else entirely.

This is the most demoralising failure mode for the team that built the dashboard, because the dashboard is "right" and unused. The cause is usually that the dashboard's surface (a BI tool, a separate URL, a login) does not fit the moment the decision is made. The fix is rarely to improve the dashboard; it is to deliver the same information in the surface where the decision actually happens. A weekly email digest. A Slack message that posts the headline numbers every Monday. An embed inside the operational tool the team already uses. The medium has to match the moment.

Failure 6: Built once, never iterated

The dashboard launched well. It was used. It changed decisions. Then the business shifted, the team shifted, the questions shifted, and the dashboard stayed exactly the same. Six months later, the metrics are still being computed, the page still loads, but the connection to current decisions has eroded.

Dashboards age. The decisions they support change shape, the comparisons that were right last year are wrong this year, the metrics that mattered then are not the ones that matter now. A dashboard that is not periodically reviewed does not stay useful by inertia; it becomes politely ignored. The fix is a quarterly editorial pass, where the owner asks of each metric: does anyone still decide on this. The metrics that cannot justify themselves are removed; the dashboard either stays sharp or is retired and replaced.

Final takeaway

Dashboards do not fail because they look bad. They fail because they answer questions nobody is asking, compare the metric against the wrong thing, surface problems the user cannot act on from the page, are owned by everyone and therefore by no one, deliver to a surface that does not fit the moment of the decision, or stay frozen while the decisions around them move on. Each of these failures is invisible at launch and obvious six months later, when the dashboard is "still there" but no longer changing anything.

The wider context, including the design discipline and dashboard typology that prevent some but not all of these failures, is collected in the data systems and performance insights cluster. And when the question moves from "we have dashboards but decisions are not changing" to "we recognise the failure mode and we now need someone to redesign around the actual decision, the actual comparison and the actual moment of action", that is exactly what my data analysis and decision-support practice is built around.

- Haja Faniry

Related services

Data Analysis, Business Intelligence & Dashboards

Data analysis consulting and business intelligence dashboards to help organisations transform data into actionable insights and improve decision-making.

Project Management & Digital Strategy

Digital project management and technology strategy consulting to support organisations in planning, coordinating and delivering complex digital initiatives.

Previous Post
What a Good BI Setup Looks Like
Next Post
How to Build a Data Strategy for Better Decisions
Why Dashboards Fail to Support Real Decision-Making | Haja Faniry