FreighAI
FreighAI · Playground checklist
Playground · Checklist

12 questions to ask before buying an AI solution for freight forwarding

Every vendor selling AI to freight forwarders has a good demo. The demo is not the thing you are buying. These twelve questions are what separate a product that will work on your enquiries from one that works on a slide.

Take the list into your next vendor call. It works on any supplier, including us. There is no form, no email and nothing to sign up for. Copy it, print it, forward it to whoever is running the evaluation.

The short answer

Twelve questions to ask any vendor selling you AI for freight forwarding. Four parts: does it work on your business, what it takes to get running, what could go wrong, and who you are dealing with. Each question carries why to ask it, a good answer, a warning sign and a follow-up if they dodge. Take it into the call.

How do you use this checklist?

Do not read it out like a survey. Twelve questions asked flatly get twelve rehearsed answers.

Send the twelve to each shortlisted vendor before the call, in writing, in the same wording for everyone. What you are testing is whether the answers change once somebody has to say them out loud.

In the call, ask them in order. Parts A and B belong in the first conversation. Parts C and D belong in the second, once you can see that the product is real.

Write each answer down in one line, in the vendor’s own words, the same day. A week later you will remember the tone of the meeting and none of the substance.

Recommendation

If you only have thirty minutes with a vendor, ask A1, B1 and D1. Those three tell you whether the product runs on real work, whether it can price your lanes, and whether anybody like you is already living with it.

An evaluation, end to end
    1. 01ShortlistTwo or three vendors worth a real conversation.
    2. 02Send the twelveThe same wording, in writing, to each of them.
    3. 03Pick twenty enquiriesYour own messy enquiries from last week.
    4. 04The callWatch it run. Ask the follow-up when an answer is thin.
    1. 05Write it downOne line per question, in their words, the same day.
    2. 06CompareRead the twelve answers side by side, not the slides.
    3. GATEYour decisionNobody signs on the strength of a demo.
FreighAIYour businessYour team approves
From shortlist to decision: the twelve questions go out in writing, the vendor runs your own twenty enquiries in front of you, and the decision stays with your team.

There is no form and no email gate on this page, on purpose. The job of a checklist is to travel. Forwarded, quoted, printed and carried into meetings the people who wrote it will never attend.

Written by a vendor

This checklist was written by FreighAI and it is built to be used on FreighAI. Ask us the same twelve. Hold our answers to the same standard as everybody else’s.

What do the four parts cover?

Twelve questions, in four parts. Each part settles a different worry, and they are ordered the way a real evaluation moves.

Part A is about evidence. Part B is about effort. Part C is about risk. Part D is about the company behind the software. A vendor can pass one part and fail another, and the part they fail tells you what the next six months look like.

The four parts
Start here

What do you still need to find out about this vendor?

PATH 01Part A. Does it actually work on my business?You have seen a demo

Real enquiries, a defined touch rate, and a failure the vendor is willing to describe.

PATH 02Part B. What will it take to get it running?You believe the demo

Where the rates come from, whether your TMS has to move, and a date for the first real quote.

PATH 03Part C. What could go wrong?You are close to signing

Who owns your rate data, what you keep if you leave, and what happens to your team.

PATH 04Part D. Who am I actually dealing with?Before the contract

A reference your own size, a named weakness, and how long the company has been doing this.

The four parts of the checklist and the point in an evaluation where each one earns its place.

Nothing here is scored. If a vendor gives you nine straight answers and three evasions, the three evasions are the finding.

What do the four answer aids mean?

Every question below carries four aids. They exist because the hard part is not asking. The hard part is knowing, in the room, whether the answer you have just heard was any good.

The four aids
Aid 01Why ask it

What the question is really testing, so you can tell a straight answer from a fluent one.

Aid 02What a good answer sounds like

Specific, checkable, and often a little uncomfortable to say out loud.

Aid 03Warning sign

The answer that sounds fine in the room and means nothing afterwards.

Aid 04If they dodge, ask this

One follow-up that closes the escape route.

Twelve questions. Four aids each. One page you can print.
The four aids under every question, and what each one is for.

Read the aids before the meeting, not during it. The follow-up in the fourth aid is the one that does the work, and it only works if you ask it in the same breath as the question itself.

Part A. Does it actually work on my business?

This part is about evidence. Every vendor can show a product working. Very few can show it working on your enquiries, put a defined number on how often it works, and describe the day it did not.

Measurement is a discipline of its own. The NIST AI Risk Management Framework, which is intended for voluntary use, puts measure alongside govern, map and manage. Carry that into A2. A percentage nobody can define is not a measurement.

A1. Run it on twenty of my real enquiries from last week. Can I watch, and can I pick which twenty?

A1 · The twenty-enquiry test
  1. Why ask it
    What to listen for
    A demo uses clean data the vendor chose. Your enquiries are messy: half a subject line, a WhatsApp forward, missing dimensions.
  2. What a good answer sounds like
    What to listen for
    Yes, this week, and you choose the twenty.
  3. Warning sign
    What to listen for
    A recorded demo, or a sandbox filled with their own sample data.
  4. If they dodge, ask this
    What to listen for
    “Then let me send you twenty right now.”

A2. Out of 100 real enquiries, how many quotes go out with nobody editing them, and how do you count that?

A2 · The number behind the number
  1. Why ask it
    What to listen for
    Every vendor quotes a percentage. Almost none define it. “Touched” can be stretched to mean anything.
  2. What a good answer sounds like
    What to listen for
    A number, the definition behind it, and what the rest of them needed.
  3. Warning sign
    What to listen for
    “Up to 80%” with no definition.
  4. If they dodge, ask this
    What to listen for
    “Does a person checking it before it goes out count as touching it?”

A3. Show me one it got wrong, and tell me what happened next.

A3 · The failure they will describe
  1. Why ask it
    What to listen for
    Anyone can show wins. How a vendor talks about failure tells you whether they have run at real volume.
  2. What a good answer sounds like
    What to listen for
    A specific case, what broke, and what they changed afterwards.
  3. Warning sign
    What to listen for
    “We have not really had that happen.” It means they have not run at volume.
  4. If they dodge, ask this
    What to listen for
    “What is the worst thing that has ever reached one of your customers?”

Part B. What will it take to get it running?

This part is about effort, and not the vendor’s effort. Yours. Three things decide whether the project starts at all: where the rates come from, whether your TMS has to move, and what the first weeks actually ask of your people.

B1. Where do you get partner and carrier rates from, and what happens when the rate is not there?

B1 · The rate question
  1. Why ask it
    What to listen for
    This is the hardest part of quoting. Nobody has fully solved agent-network rate sourcing, so the honest answer is a map, not a claim.
  2. What a good answer sounds like
    What to listen for
    A clear split of what is covered, carriers, contracted, spot and agents, and the fallback for when it is not.
  3. Warning sign
    What to listen for
    Vague talk about “integrations”.
  4. If they dodge, ask this
    What to listen for
    “On my top ten lanes, how many would you have a rate for on day one?”

B2. Do I have to change or replace my TMS or ERP?

B2 · The migration question
  1. Why ask it
    What to listen for
    Most forwarders assume AI means a system migration. It is the biggest silent reason people never start.
  2. What a good answer sounds like
    What to listen for
    No, and exactly how it sits alongside. Enquiry in, quote out.
  3. Warning sign
    What to listen for
    “It depends on your setup.”
  4. If they dodge, ask this
    What to listen for
    “If I change absolutely nothing, what still works?”

B3. From signing to my team sending a real quote, give me a date, and tell me what would push it.

B3 · The date, and what moves it
  1. Why ask it
    What to listen for
    Vendors sell the destination and stay vague about the journey. The slip is always the same two or three things.
  2. What a good answer sounds like
    What to listen for
    A date, and the specific things that would delay it.
  3. Warning sign
    What to listen for
    “It depends on the setup.”
  4. If they dodge, ask this
    What to listen for
    “How many of my people, for how many hours, and in which weeks?”

Part C. What could go wrong?

This part is about risk. It is the part buyers skip, because by then the meetings are going well and nobody wants to sound suspicious.

One rule is worth knowing about. The EU Data Act, which applies from 12 September 2025, sets out a framework for customers to switch effectively between providers of data processing services. It does not settle who owns your rate cards, and it does not decide what happens to your quote history. Your contract does. This checklist explains what to ask. It is not legal advice.

C1. Who owns my rate data and my customer list? Can I export all of it, today, without asking you?

C1 · Ownership, in writing
  1. Why ask it
    What to listen for
    Your rates are your business. Some contracts quietly claim usage or training rights over them.
  2. What a good answer sounds like
    What to listen for
    You own it, you export it yourself at any time, in a normal format, and they point at the clause that says so.
  3. Warning sign
    What to listen for
    “Of course you own it”, without showing you where it is written.
  4. If they dodge, ask this
    What to listen for
    “Can you use my data to train anything that another forwarder benefits from?”

C2. If I stop paying next year, what happens to my quote history?

C2 · The exit
  1. Why ask it
    What to listen for
    Lock-in is rarely about the software. It is about the history you cannot take with you.
  2. What a good answer sounds like
    What to listen for
    You keep it. Here is the export, and here is the format.
  3. Warning sign
    What to listen for
    Read-only, behind a paywall, or “we would never do that”.
  4. If they dodge, ask this
    What to listen for
    “And if you are acquired, or you shut down?”

C3. Does this replace anyone on my team? Answer straight.

C3 · The question your team is already asking
  1. Why ask it
    What to listen for
    Your pricing team will ask this the day you announce it. If you cannot answer, they will quietly make sure it fails.
  2. What a good answer sounds like
    What to listen for
    A direct answer about what the job becomes.
  3. Warning sign
    What to listen for
    Anything that avoids the word.
  4. If they dodge, ask this
    What to listen for
    “What does my pricing executive do on day 90 that she does not do today?”

Part D. Who am I actually dealing with?

This part is about the company rather than the product. You are putting a daily process on somebody else’s software. Can they introduce you to a forwarder like you, will they name a weakness out loud, and are they going to be here in three years.

D1. Introduce me to a forwarder my size, in my market, who uses this. Not a logo, a phone call.

D1 · A reference your own size
  1. Why ask it
    What to listen for
    An enterprise case study tells a forty-person forwarder nothing. Size and market change everything.
  2. What a good answer sounds like
    What to listen for
    An introduction within a week, to a genuinely comparable firm.
  3. Warning sign
    What to listen for
    Logos, unnamed case studies, or “our clients prefer to stay confidential”.
  4. If they dodge, ask this
    What to listen for
    “Has anyone stopped using it? Can I speak to them?”

D2. What does your product do badly? Name one thing.

D2 · The named weakness
  1. Why ask it
    What to listen for
    A vendor who cannot name a weakness either does not know their own product, or will not be straight with you.
  2. What a good answer sounds like
    What to listen for
    They name one, specifically, and it is a real one.
  3. Warning sign
    What to listen for
    “Nothing really”, or a fake weakness dressed up as a strength.
  4. If they dodge, ask this
    What to listen for
    “What kind of forwarder should not buy this?”

D3. How long have you been doing this, how many forwarders are live on it, and who funds you?

D3 · The company behind it
  1. Why ask it
    What to listen for
    You are putting a core process on somebody else’s software. If they are gone in eighteen months, you do all of this again.
  2. What a good answer sounds like
    What to listen for
    Straight numbers, however small, and honesty about what stage they are at.
  3. Warning sign
    What to listen for
    Growth talk, or “hundreds of customers” without saying how many are freight forwarders.
  4. If they dodge, ask this
    What to listen for
    “How many were live twelve months ago?”

What do you do once you have the answers?

Put the twelve answers from each vendor side by side on one page. Read down the columns, not across your meeting notes.

Two of them carry more weight than the other ten. A1, because a vendor who ran your own twenty enquiries in front of you has shown you the product rather than described it. D1, because a forwarder your size, in your market, who has lived with the thing for a year will tell you in ten minutes what a year of demos will not.

Recommendation

Shortlist on parts A and B. Decide on parts C and D. When two vendors are close after part A, the tie is almost always broken by B1, the rate question, because that is the part nobody has fully solved and the honest answer is a map rather than a claim.

A vendor who answers all twelve well is not the finish line. Check the answers. Ask for the export they described in C1. Make the reference call they offered in D1. Both are easy to verify and hard to fake.

Then run the same twelve questions on whatever you are already paying for. It is an uncomfortable hour, and it is usually the most useful one in the whole process.

Questions

Common questions

01

Do I have to ask all twelve questions?

Ask all twelve of the vendor you are close to signing with. For a first call, A1, B1 and D1 are enough to decide whether there is a second call. The other nine matter most once money and a contract are involved.

02

Can I use this checklist on FreighAI?

Yes. That is what it is for. It was written by FreighAI and it is meant to be used on FreighAI, in the same words, with the same follow-ups when an answer sounds thin.

03

Is there a form or an email gate?

No. Nothing on this page is locked. Copy it, print it, paste it into your own evaluation template or forward it to whoever is running the process. It is worth more to us travelling than sitting behind a form.

04

What if a vendor answers all twelve perfectly?

Then check the answers rather than the delivery. Two of the twelve are easy to verify: ask for the export they described in C1, and make the reference call they offered in D1. A perfect hour in a meeting room proves the salesperson, not the product.

05

How often does the checklist change?

It is reviewed about once a year and deliberately kept at twelve. A checklist that grows every quarter stops being something you can carry into a meeting. Each question has a deeper article behind it when the sheet is not enough.

READY WHEN YOU ARE

Take the twelve into your next vendor call

Ask them of every supplier on your shortlist, in the same words, and write the answers down the same day. Ask them of us too, and hold our answers to exactly the same standard.