Production Web Analytics

Jaccard similarity across calculated metric formulas identified seven metrics with ≥ 0.85 formula overlap that all compute revenue per visit, with minor variations in attribution model and allocation. They appear to be the result of independent authors solving the same problem without coordination.

cm_revenue_per_visit              author: r.kim@      created: 2024-03-12
cm_rev_per_visit_v2               author: a.patel@    created: 2024-08-04
cm_revpv_lasttouch                author: r.kim@      created: 2024-11-19
cm_rev_visit_linear               author: m.chen@     created: 2025-01-22
cm_revenue_visit_corrected        author: a.patel@    created: 2025-04-08
cm_rpv_marketing                  author: l.gomez@    created: 2025-09-15
cm_rev_per_visit_final            author: r.kim@      created: 2026-02-03

Near-duplicate metrics produce subtly different numbers in different reports, which surfaces as “the dashboards disagree” complaints from executives. They also create maintenance debt: when the underlying definition needs to change, all seven must be updated in lockstep, and inevitably one is missed.

Designate one canonical metric, document its attribution and allocation choices, and update downstream Workspace projects to reference it. Deprecate the others by tagging them with a sunset date and auditing references via cja_auto_sdr --org-report.

The grader could not locate any prior snapshots of this data view in the configured snapshot directory. Without snapshot history, configuration changes cannot be diffed, drift cannot be detected, and audit trails are unavailable for compliance review.

cja_auto_sdr dv_prod_web --snapshot ./snapshots/baseline.json
cja_auto_sdr --git-init --git-dir ./snapshots
cja_auto_sdr dv_prod_web --git-commit --git-message "Initial baseline"

From this baseline, schedule weekly snapshots via the GitHub Action template in the cja_auto_sdr examples directory.

38 metrics and 51 dimensions in this data view have empty description fields. Descriptions are the primary way new analysts and AI agents understand what a component measures; missing descriptions force readers to infer intent from names alone, which is frequently wrong.

Metrics: 38 of 142 missing (27%). Dimensions: 51 of 203 missing (25%). Both rates exceed the rubric threshold of 10%.

Generate the list of components missing descriptions with cja_auto_sdr --quality-report json and populate via the data view API. Establish a CI check that fails new components added without descriptions.

The rubric flags segments with container nesting depth ≥ 5 as difficult to review. Four segments in this data view exceed that threshold; the deepest reaches depth 8.

seg_qualified_lead_v3             depth: 8     containers: event/session/person mixed
seg_high_intent_returning         depth: 6     containers: session/event nested
seg_b2b_account_engaged           depth: 6     containers: event/session mixed
seg_promo_responsive              depth: 5     containers: event nested

Deep nesting makes intent illegible. Reviewers cannot easily tell whether the segment matches what its name implies, and small definitional changes have unpredictable population effects.

Decompose each segment into composed sub-segments, named for what each layer captures. The surface segment then becomes a shallow combination of well-named pieces, each independently reviewable.

Last-touch is the default attribution model and is appropriate for some use cases, but the rubric flags it when applied to revenue and conversion metrics without justification. Twelve such metrics were identified.

For each flagged metric, either change the attribution model to one appropriate for the metric’s intended use (algorithmic, linear, or U-shaped for journey-aware metrics), or document in the metric description why last-touch is the correct choice.

73% of custom dimensions follow the c_ prefix convention. The rubric expects ≥ 80%. Four components diverge from the established pattern.

product_category          (expected: c_product_category)
user_segment              (expected: c_user_segment)
cart_value_band           (expected: c_cart_value_band)
last_search_term          (expected: c_last_search_term)

Rename the four affected components via the data view API. Document the prefix convention in the SDR for future contributors.