Agents Builders

Fix pipeline smoke assertions

Archived
fix-pipeline-smoke-assertions

Created

Jul 05, 21:05

DevOps handoff

Type

Bug

Shape

ui-only

Worktree Slug

fix-pipeline-smoke-assertions

Repositories

mcritchie-studio

Release Slug

Branch

feat/fix-pipeline-smoke-assertions

Pull Request

Local URL

QA URL

Production URL

qa-smoke,e2e,prod-seal

Acceptance Criteria

  • qa-readonly pipeline smoke asserts env-agnostic structure only
  • Assert actual Activities header not stale Actions
  • Drop or guard seed-dependent pl-span count assertion
  • Prod post-ship smoke seals green on empty data

Expected Test Plan

  • [e2e] npx playwright test e2e/alex_pipeline.spec.js green vs data-empty env

Checks Run

No completed checks recorded.

Agent Context

Root cause of the 2026-07-05 rel-20260705-016f81 post-ship RED smoke seal (ship NOT aborted; prod verified healthy /up 200, no rollback). e2e/alex_pipeline.spec.js @qa-readonly asserts root.toContainText('Actions') and pl-span count>=1 against live prod https://mcritchie.studio/alex/pipeline. But (1) the column-1 header in app/views/heartbeat/pipeline.html.erb:121 renders '🗋 Activities' (backed by @activity_rows), NOT 'Actions' — 'Actions' is stale terminology from before the activities/spans rename; and (2) pl-span count>=1 requires seeded AgentActivity spans that data-empty production legitimately lacks (0 spans = correct empty state). It passed on QA (seeded) and red-sealed on prod (empty) — the classic qa-readonly seed-fixture false-red. Fix: make the smoke env-agnostic — assert the actual header text ('Activities') or just the structural #col-actions/#col-insights/#col-confirmations visibility (already passing), and drop/guard the pl-span>=1 seed-dependent assertion. Confirm the intended header term with the current rename (likely 'Activities'). Test-only change; no app/view change expected unless the team decides col-actions should render 'Actions'.

Stage Timeline

Who handled each stage, the time it took (measured), and the model / tokens / cost reported (best-effort) — plus who's on it right now. means the agent didn't report that metric.

Sizing Avi · PO SMALL Dev Actual
  1. Created Designed
    S Scyther
    Scyther
    Model
    Duration
    Tokens
    Cost
    Completed Jul 05, 21:05 · 3 days ago
    api
  2. Designed Archived
    4
    4a91254b-1d69-410c-8cc9-fda19a685616
    Model
    claude-opus-4-8
    Duration
    about 1 hour
    Tokens
    8,614,009
    Cost
    ~$6.39
    Started Jul 05, 21:05
    Completed Jul 05, 21:52 · 3 days ago
    cli

Conversation

QA review feedback, agent handoffs, and follow-up notes for this task.

No task feedback has been recorded yet.

Sealed-bid sizing

Edit →

Alex (PM)

Avi (PO)

SMALL

Dev

Actual