Shopify Engineering·unknown·11 min read62

Teaching Sidekick to say no: automated data curation with LLM judge consensus (2026) - Shopify

Our Sidekick team used LLM judges to automatically curate training data and teach domain-specific models how to refuse impossible queries.

Score breakdown

  • Technical depth52
  • Practical value75
  • Originality100
  • Writing quality100
  • Source reputation86
  • Recency1
  • External engagement0
  • On-site engagement0

More like this

Engradar shows a summary and links to the original article. The full article is hosted on shopify.engineering.