top of page

The Data Looked Great. The Decision Was (Almost) Wrong.

  • Writer: James Butz
    James Butz
  • Mar 26
  • 5 min read

By Jim Butz, Sales and Marketing expert with over 20 years of real world experience strategizing and executing sales and marketing plans for startups, small business and nonprofit.


The room was buzzing with excitement.


The marketing ops team had just presented their monthly numbers, and they looked impressive. One metric in particular caught everyone's attention: a major spike in leads from a specific channel. The numbers were up significantly month-over-month. Management was already talking about increasing investment. Should we double down? Triple the budget? The energy in the room said yes.


Something didn't sit right with me.

Dashboard with warning symbol showing bad data analytics

I started asking questions. How were these leads being tracked? What qualified someone as a lead from this channel? Had the tracking setup changed recently?

It turned out the data was wrong. Leads had been miscounted—entries that shouldn't have qualified as leads had been captured in the system. The channel wasn't performing nearly as well as the dashboard suggested. They had been minutes away from committing significant budget to a strategy built on faulty data.

This is what happens when you're "data-driven" with bad data definitions. You make confident decisions based on numbers that look right but tell the wrong story.


The Foundation: Definitions Come First

Being data-driven sounds great in theory. In practice, it's nearly impossible if you can't trust the validity of your data. Before you can measure anything, you need to define what you're measuring. And this is where most organizations stumble—not because they lack tools or expertise, but because they skip the alignment step.

What counts as a "lead"? Is it anyone who fills out a form, or only those who meet specific qualification criteria?

What's a "conversion"? A sale? A demo request? A donation above a certain amount?

When does a prospect become an MQL versus an SQL?

These might seem like semantic questions, but when your marketing team and sales team define "qualified lead" differently, your entire funnel analysis falls apart. You end up with data that looks accurate on the surface but tells completely different stories depending on who's interpreting it.


That's why at the start of any strategy engagement, one of our top priorities is getting everyone on the same page. We establish clear definitions and communicate them across all internal stakeholders. This creates a level playing field—everyone's working from the same playbook, measuring the same things, using the same criteria. Without this foundation, you're not making data-driven decisions. You're making assumptions with numbers attached.


Getting The Data Right

Once definitions are clear, the next step is ensuring data is entered correctly and consistently. This sounds basic, but it's where things break down in practice. Someone enters a lead with inconsistent formatting. Another team member uses a different dropdown value. A form captures partial information. Over time, these small inconsistencies compound into unreliable datasets.


The good news: there are reliable tools that can simplify and standardize this process. CRM platforms like HubSpot offer built-in validation rules, required fields, and automation that reduces human error. Keeping these systems clean and up-to-date is paramount. We also verify that data is being recorded properly. Not once at setup, but continuously. Spot-checks. Audits. Reviewing patterns to catch anomalies before they become systemic issues.

Only when these foundational elements are in place can you confidently begin analyzing metrics and driving meaningful insights.


What Should You Actually Be Measuring?

So what metrics matter?

The answer: it depends on what you're trying to achieve.

A SaaS startup trying to prove product-market fit cares about different numbers than an established service business optimizing operations. A nonprofit measuring community impact needs different KPIs than one focused on fundraising efficiency. That said, there are common starting points based on organization type.


For Small Businesses and Startups

Revenue metrics like Annual Recurring Revenue (ARR) or total sales give you the headline number—but the real story is in how you're generating that revenue. That's where lead statistics come in: Marketing Qualified Leads (MQLs) and Sales Qualified Leads (SQLs) tell you how many prospects are entering your funnel and how many are ready for sales engagement.


Then there's the cost side: Cost Per Lead (CPL) and Customer Acquisition Cost (CAC) reveal how efficiently you're spending to acquire customers. If your CAC is higher than your customer lifetime value, you've got a problem—even if lead volume looks strong.

Finally, track conversion rates at each stage of your sales funnel. This is where you'll find your bottlenecks and opportunities. A high MQL-to-SQL conversion rate but low SQL-to-close? Your sales process might need work. Low website-to-MQL conversion? Your messaging or targeting might be off. As your company grows and evolves, you'll likely add more metrics. Early-stage startups might obsess over activation rates and retention cohorts. More mature businesses might focus on upsell rates and customer lifetime value expansion.


For Nonprofits

Nonprofits operate differently, so the metrics shift accordingly. Channel metrics—email open rates, social media engagement, website traffic—still matter. They tell you whether your message is reaching people and resonating. But instead of revenue, you're tracking donation-focused KPIs: donation rate (what percentage of your audience gives), donor retention rate (how many donors give again), and average gift size.


Depending on your mission, you might also track service usage metrics—how many people you're serving, program participation rates, community reach. For advocacy-focused organizations, metrics might include petition signatures, event attendance, or policy engagement.


Every Organization Is Unique

This isn't an exhaustive list. Every organization will have its own unique set of key metrics based on structure, goals, and industry.

The key is to identify what matters most to your organization and build from there. In many cases, we work with clients to develop KPIs and metrics that are specific to their situation—capturing what they're actually trying to achieve, not just what's standard in their industry.


Why You Need Expert Eyes On Your Data

Back to that conference room.

The reason we caught this issue, is because we've seen this pattern before—across dozens of campaigns, multiple industries, and different types of organizations.


Data analysis requires expertise in knowing what "normal" looks like.

Someone who's reviewed hundreds of campaigns can spot the red flags: a conversion rate that's suspiciously high, a lead source that doesn't align with traffic patterns, a cost-per-acquisition that seems too good to be true.


They know to ask the second-level questions: How is this being tracked? Has anything changed in the setup? What's the source of this data?


This isn't about questioning your team's competence. It's about recognizing that context and pattern recognition matter. An isolated number can look great in a dashboard and still be completely misleading.


Whether that expertise lives internally or comes from an outside partner like Anuncier, you need it. Data-driven decisions made in a vacuum aren't data-driven—they're just decisions with numbers attached.


The Bottom Line

You can't be data-driven with bad data. And you can't have good data without:

  1. Clear definitions that everyone agrees on

  2. Consistent data capture that's validated and verified

  3. Expert analysis that knows what "normal" looks like and can spot anomalies


At Anuncier, we specialize in building these foundations. We configure CRMs and analytics systems for accuracy, establish the definitions that create alignment, and provide the expert review that catches issues before they become costly mistakes.

Because when your data is solid, your decisions are confident. And when your decisions are confident, marketing stops being guesswork.

Ready to build a data foundation you can trust? Let's talk about what accurate, actionable data could mean for your organization.

Let's get your message out. data. Data-driven decisions should never happen in a vacuum—they need to be supported by expert analysis. Whether you have that expertise internally or seek an outside perspective, having a second set of eyes on the data is essential for making sound decisions.

Comments


bottom of page