Case study 1 of 5
Two-sided consumer marketplace
Fractional data leadership and LLM catalog matching
2x customer conversion on search and discovery
Challenge
Leadership no longer trusted core metrics, and merchant listings were too messy to connect reliably to the canonical product catalog, which held back search, recommendations and reporting.
Our solution
As fractional data leadership, we rebuilt trust in core metrics and data governance, then built an LLM matching system that maps messy merchant listings to canonical products.
Key technologies
What we built
- Metric definitions and data governance leadership could rely on
- LLM matching with Claude via Bedrock, queue-driven services and SageMaker embeddings
- An eval UI for reviewing matches and measuring quality before rollout
- Search relevance and ranking work
- Self-serve analytics apps for business teams
- LLM spend attribution and model right-sizing
Engagement
Fractional data leadership with hands-on builds
Results and impact
- 2x customer conversion on search and discovery surfaces
- Core metrics and governance the leadership team trusts
- LLM catalog matching running in production
- LLM spend attributed by use case, with smaller models where evals allowed