How Benchmark Grid scores publishing technology

The composite score

Score = 0.45 × capability + 0.40 × publisher fit + 0.15 × cost of ownership

Composite = (0.45 × Capability) + (0.40 × Publisher Fit) + (0.15 × TCO), rounded to one decimal place. The maximum is 4.9 — a perfect 5.0 is never awarded, because no tool is flawless.

The three pillars

• Capability

  45% weight

  What the platform can actually do — measured against the published criteria for its category.

  Editors score each weighted criterion for the category (e.g. Editorial Workflow, Monetisation, SEO Tools) on a 0–5 scale from the vendor's own product, pricing and documentation pages and other public evidence. Where a criterion isn't evidenced we say so and score it neutrally rather than guess. Listings marked Hands-on tested have also been used by our editors. The Capability score is the weight-adjusted average of those criterion scores — not a single subjective impression.

• Publisher Fit

  40% weight

  Whether the tool is genuinely built for publishers, or a generic SaaS re-labelled as one.

  We look for publisher-specific functionality — paywall, newsroom workflows, subscription management, ad operations, reader revenue, first-party data. Tools with no publisher-specific evidence are capped and penalised so a generic CRM can't outrank a purpose-built publishing platform on the same benchmark.

• Total Cost of Ownership

  15% weight

  The real cost to adopt and run the tool — not just the sticker price.

  TCO is the average of five sub-scores so the headline always matches the breakdown: Pricing Transparency, Entry Cost, Implementation Cost, Hidden-Fees Risk, and Ongoing Cost. It carries a deliberate 15% weight so a cheaper tool can't override stronger capability and publisher fit.

TCO sub-dimensions

The TCO score is the average of five equally-weighted sub-scores, so the headline always matches the breakdown.

• 1.
  Pricing Transparency

  How openly pricing is published — full public tiers vs. 'contact sales' only.
• 2.
  Entry Cost

  How low the barrier is to start — genuine free tier or <$25/mo vs. $500+/mo.
• 3.
  Implementation Cost

  Self-serve setup vs. mandatory paid onboarding or enterprise implementation.
• 4.
  Hidden-Fees Risk

  Likelihood of overage charges, forced upgrades, or surprise costs.
• 5.
  Ongoing Cost

  Long-run value relative to peers — industry-standard vs. premium with poor value.

What feeds the scores

• Documentation and evidence review

  Each criterion is scored from the vendor's own product, pricing and documentation pages and public evidence, checked by editors who work with newsrooms, magazine brands, B2B media, newsletters, creators, broadcasters and community publishers. Listings marked Hands-on tested have also been used by our editors.

• Publisher adoption data

  Verified publisher adoptions — which publishers actually run each tool — sourced from public evidence and ads.txt scans.

• Community signals

  Public discussions from Reddit, HN, G2, Capterra, YouTube, and trade press — analysed for sentiment and authenticity.

• Vendor-claim verification

  Marketing claims are cross-checked against benchmark data before publication; disputes are tracked and published.

The 0–5 scale

Scores reflect realistic adoption and full utilisation — not just feature checklists. A 3.5 lands in Fair Fit: a credible but imperfect tool. Always read scores on the 1–5 scale; never compare to a 1–10 scale.

Review cadence & independence

• Named, not anonymous

  Each tool page carries a byline. Research is led by Vahe Arabian, founder and editor-in-chief of State of Digital Publishing. Where a platform has been tested hands-on, the SODP reviewer who tested it is named and linked to their original review. Scoring and editing are done by the SODP team. See who does the work on the About page.

• Refreshed continuously

  Each tool page shows when its evidence was last verified. We re-check listings against the vendor's current site and re-score when the market shifts.

• No pay-to-play

  Vendors cannot pay for inclusion, a higher score, or a better ranking position. The paid Vendor Verified plan buys faster corrections and badge rights — never a score change.

• Claims are verified

  Vendor marketing claims are fact-checked against benchmark data. Disputes and corrections are tracked and published transparently.

• Tiered, not just ranked

  Tools are grouped into editorial tiers — Best-in-Class, Strong Choice, Fair Fit, Marginal Fit, Limited, and Poor — so you can shortlist on fit, not just a single number.