References are useless.
No agency is going to give you a reference who'll say something negative.
You'll talk to their happiest client, on their best project, with a carefully rehearsed story.
It tells you nothing about how they'll handle your project when things go wrong.
What References Actually Tell You
References tell you:
→ This agency has at least one happy client → That client is willing to spend 15 minutes on a call → The project went well enough that they stayed friends
That's it. You learn nothing about:
→ How they handle scope changes → What happens when deadlines slip → How they communicate during crises → Whether they take responsibility for mistakes → How they manage difficult conversations
The things that actually matter.
What to Do Instead
Here's how to actually vet a software partner:
1. Ask to See Their Process Documentation
How do they handle scope changes? What's their change request process? How do they manage client feedback?
If they don't have documented processes, that's your answer.
2. Ask How They Handle Scope Changes Mid-Project
Don't let them give you a rehearsed answer. Ask for a specific example. What project? What changed? How did they handle it? What did it cost?
Live examples reveal real behavior.
3. Ask to Talk to a Client Whose Project Went Sideways
Every agency has had a difficult project. The good ones will tell you about it and what they learned.
If they claim every project went perfectly, they're lying.
4. Look at Their Public Work
Open source contributions. Public repositories. Blog posts. Speaking engagements.
Actions reveal more than words.
5. Try a Paid Assessment First
Don't commit to a $100K project sight unseen.
Pay for a 2-week assessment. See how they communicate. Review their deliverables. Evaluate their process.
A $5K assessment can save you from a $100K mistake.
The Real Test
You don't need to know if they can deliver a successful project. Most agencies can when everything goes right.
You need to know: How do they behave when things go wrong?
Because things will go wrong. Scope will change. Deadlines will slip. Requirements will be unclear.
The question is: Do they own it, communicate it, and solve it? Or do they blame you, hide it, and charge you for it?
What We Do at ScopeForged
We offer paid assessments before any project commitment.
2-week engagement. We audit your requirements, identify risks, and deliver a detailed implementation plan.
You get a usable deliverable even if you don't hire us. And you get to evaluate our process, communication, and quality before committing.
That's how we'd want to be evaluated. So that's how we work.
How do you vet software partners? What questions actually reveal quality?
#consulting #softwaredevelopment #vendorselection #duediligence
→ scopeforged.com
Philip Rehberger Founder, ScopeForged scopeforged.com
