Make recommendations fit the customer, the assortment, and the moment.
Develop shopping assistance around the tradeoffs your merchandising experts understand. Teammately turns their judgments into rubrics and coverage for product recommendations, comparisons, and substitutions.
For shopping-agent owners, merchandising teams, and customer-experience leaders
Development focusProduct recommendations and substitution
What changes the decision
Relevance leaves the tradeoff unresolved.
Several products can match a request while serving the customer differently. Availability, intended use, attribute priorities, acceptable compromises, and commercial constraints influence what an experienced merchant recommends. A benchmark needs to capture those judgments without reducing every task to one preferred product.
Applied industry study · These are development and assessment methods, not reported customer results.
01
Several relevant products, different customer priorities
The context
Two products match the request, but one better fits the intended use while another satisfies an unstated assumption. The agent may need to clarify which attribute matters most.
Judgment to capture
Which evidence supports a recommendation? When is clarification useful, and when are several alternatives defensible?
02
A substitute preserves the category but loses the important attribute
The context
The preferred item is unavailable. A nearby alternative can look similar while lacking the feature that made the original appropriate.
Judgment to capture
Which attributes are essential to this customer? What may be traded off, and what difference must the recommendation explain?
03
An assortment priority conflicts with the customer’s need
The context
Commercial priorities can influence recommendations among suitable products, but may favor an option that misses the stated need or implies an unsupported benefit.
Judgment to capture
Where may merchandising preference affect the ranking? Which customer requirements and product facts must remain decisive?
The people behind the standard
Capture why a merchant would stand behind the recommendation.
Agents prepare product and response comparisons, then adapt follow-up questions as experts explain their choices. Findings become proposed rubrics for fit, substitution, and explanation, with policy boundaries preserving how customer requirements and merchandising preferences relate.
Category and merchandising experts
Product fit, meaningful attributes, assortment intent, and the tradeoffs behind a preference.
Customer-experience teams
How customer intent is expressed, when to clarify, and what makes an explanation useful.
Catalog and fulfillment teams
Reliable product facts, availability, and the conditions that make an alternative feasible.
Product and claims owners
What the evidence supports and which comparisons or promises require qualification.
Coverage and improvement
Develop shopping assistance against the reasons behind preference.
Make the reasons behind a recommendation available to development. Experts establish what fit means; coverage and synthesis expose where that judgment changes; trials test whether the candidate respects those distinctions.
Ontology dimensions
Customer intent, essential attributes, acceptable compromises, availability, and assortment priorities.
Combinations to exercise
A suitable product is unavailable; an alternative preserves the category but loses an essential attribute; several choices remain defensible.
Interpreting the case mix
Represent common shopping requests alongside difficult substitutions. A gain on straightforward matches should not conceal weaker handling of constraints.
Capture the tradeoff behind the preferred recommendation
Rubrics distinguish essential customer requirements, supported product claims, and preferences among suitable options. Policies make clear where merchandising priorities may influence a choice and where customer fit remains decisive.
What this makes possible
A recommendation can be acceptable without matching one fixed product ranking. The criteria explain which customer requirements and tradeoffs justify it.
Make substitutions and competing priorities part of the benchmark
Lemon Weave synthesizes requests, catalog context, and alternatives from the selected ontology tuples. Vary one consequential attribute or availability condition so reviewers can establish why the recommendation should change.
What this makes possible
Cases distinguish product similarity from an acceptable substitute and preserve situations with several legitimate answers.
Locate why the candidate recommends the wrong thing
Trialground compares recommendations and explanations against the rubrics. Investigate whether failures come from missing product context, an assumed preference, or the way the harness selects and explains alternatives.
What this makes possible
A specific basis for testing better clarification, retrieval, or recommendation logic with Lemon Goal’s harness prototypes.
Harness experiments can improve context gathering and recommendation logic. Lemon Weave can also construct training examples around preference boundaries the weights handle inconsistently, using the same expert rubrics and coverage design.
Assessing progress
Assess the judgment behind the recommendation.
Fit to the customer’s stated needs and the evidence available.
Recognition of essential attributes when proposing a substitute.
Supported comparisons and accurate product claims.
Appropriate clarification when preferences are unresolved.
Respect for customer requirements when applying merchandising priorities.
Inspect recommendation quality by customer intent, attribute combinations, and availability. A gain on straightforward product matches can conceal weak substitutions or an increased tendency to invent benefits.
Keep multiple acceptable options where expert judgment supports them. Conversion or ranking agreement alone cannot establish whether the recommendation respects the intended standard; examine the reasons and tradeoffs in the response.
Carry related expertise into service recovery.
Returns and recovery use some of the same product and customer distinctions, but add purchase terms, fulfillment history, and remedy authority. A suitable replacement must be both appropriate for the customer and feasible to fulfill.
Develop separate rubrics and coverage for those decisions. Reuse established product knowledge where it applies, then elicit the service-specific conditions behind refunds, replacements, exceptions, and escalation.
Adjacent workflows
Carry the expertise into adjacent workflows.
Product comparison
Explain consequential differences without inventing attributes or treating every tradeoff as universal.
Catalog content
Preserve product truth and approved claims across generated descriptions.
Returns and service recovery
Judge available remedies against purchase terms, customer needs, and operational constraints.
Bring a recommendation your experts would make differently.
Start with the customer context, the available products, and the people who can explain the tradeoff. We can identify the criteria and coverage that would make that judgment useful in development.