ca-marketplace-scraper/docs/superpowers/plans/2026-04-30-live-parser-tests.md

Live Parser Tests Implementation Plan

For agentic workers: REQUIRED SUB-SKILL: Use superpowers:subagent-driven-development (recommended) or superpowers:executing-plans to implement this plan task-by-task. Steps use checkbox (- [ ]) syntax for tracking.

Goal: Add explicit live endpoint test suites for each core marketplace scraper, excluded from default tests and runnable through one script.

Architecture: Live tests live under packages/core/test/live/ and import public scraper entry points directly. Normal package tests remain offline because the new files are outside current explicit test commands and run only through bun run test:live.

Tech Stack: Bun 1.3.13, bun:test, TypeScript, existing core scraper APIs.

---

File Structure

• Create packages/core/test/live/ebay.live.test.ts: live eBay search smoke test against fetchEbayItems.
• Create packages/core/test/live/kijiji.live.test.ts: live Kijiji search smoke test against fetchKijijiItems.
• Create packages/core/test/live/facebook.live.test.ts: strict live Facebook search smoke test against fetchFacebookItems and FACEBOOK_COOKIE.
• Modify package.json: add root script test:live running all files under packages/core/test/live.

Task 1: Add eBay Live Suite

Files:

• Create: packages/core/test/live/ebay.live.test.ts

• Step 1: Write the live test file

import { describe, expect, test } from "bun:test";
import fetchEbayItems from "../../src/scrapers/ebay";

describe("eBay live parser", () => {
  test("scrapes live search results into listing details", async () => {
    const results = await fetchEbayItems("iphone", 1, { maxItems: 3 });

    expect(results.length).toBeGreaterThan(0);
    for (const listing of results) {
      expect(listing.url).toStartWith("https://");
      expect(listing.title.length).toBeGreaterThan(0);
      expect(listing.listingPrice.cents).toBeGreaterThanOrEqual(0);
      expect(listing.listingPrice.currency.length).toBeGreaterThan(0);
    }
  });
});

• Step 2: Run eBay live test

Run: bun test packages/core/test/live/ebay.live.test.ts Expected: PASS when eBay returns parseable search results; FAIL on endpoint/rate-limit/parser breakage.

Task 2: Add Kijiji Live Suite

Files:

• Create: packages/core/test/live/kijiji.live.test.ts

• Step 1: Write the live test file

import { describe, expect, test } from "bun:test";
import fetchKijijiItems from "../../src/scrapers/kijiji";

describe("Kijiji live parser", () => {
  test("scrapes live search results into detailed listings", async () => {
    const results = await fetchKijijiItems(
      "iphone",
      1,
      "https://www.kijiji.ca",
      { maxPages: 1 },
      { includeImages: false, sellerDataDepth: "basic" },
    );

    expect(results.length).toBeGreaterThan(0);
    for (const listing of results) {
      expect(listing.url).toStartWith("https://www.kijiji.ca/");
      expect(listing.title.length).toBeGreaterThan(0);
      expect(listing.listingPrice.cents).toBeGreaterThanOrEqual(0);
      expect(listing.listingPrice.currency.length).toBeGreaterThan(0);
    }
  });
});

• Step 2: Run Kijiji live test

Run: bun test packages/core/test/live/kijiji.live.test.ts Expected: PASS when Kijiji returns parseable search and detail pages; FAIL on endpoint/parser breakage.

Task 3: Add Facebook Live Suite

Files:

• Create: packages/core/test/live/facebook.live.test.ts

• Step 1: Write the live test file

import { describe, expect, test } from "bun:test";
import fetchFacebookItems from "../../src/scrapers/facebook";

describe("Facebook live parser", () => {
  test("requires FACEBOOK_COOKIE for strict live testing", () => {
    expect(process.env.FACEBOOK_COOKIE?.trim().length ?? 0).toBeGreaterThan(0);
  });

  test("scrapes live marketplace search results into listing details", async () => {
    const results = await fetchFacebookItems("iphone", 1, "toronto", 3);

    expect(results.length).toBeGreaterThan(0);
    for (const listing of results) {
      expect(listing.url).toStartWith("https://www.facebook.com/marketplace/item/");
      expect(listing.title.length).toBeGreaterThan(0);
      expect(listing.listingPrice.cents).toBeGreaterThanOrEqual(0);
      expect(listing.listingPrice.currency.length).toBeGreaterThan(0);
    }
  });
});

• Step 2: Run Facebook live test

Run: bun test packages/core/test/live/facebook.live.test.ts Expected: PASS with valid FACEBOOK_COOKIE; FAIL when FACEBOOK_COOKIE is missing, expired, or parser output is empty.

Task 4: Add Root Live Test Script

Files:

• Modify: package.json

• Step 1: Add script

Change root scripts to include:

{
  "test:live": "bun test packages/core/test/live"
}

• Step 2: Run all live tests through script

Run: bun run test:live Expected: runs eBay, Kijiji, and Facebook live suites. Facebook fails if FACEBOOK_COOKIE is unset.

Task 5: Verify Default Suite Exclusion

Files:

• No code files modified.

• Step 1: Run existing core tests

Run: bun test packages/core/test Expected: existing mocked tests run. If Bun discovers packages/core/test/live, change normal verification command to explicit glob bun test packages/core/test/*.test.ts and document that in final notes.

• Step 2: Run static checks

Run: bun run ci Expected: typecheck and Biome pass. Fix code issues without changing lint or TypeScript rules.

Commit Note

Do not commit during execution unless user explicitly requests a commit. This repo session policy overrides generic plan commit steps.

Self-Review

• Spec coverage: eBay, Kijiji, Facebook live suites; explicit script; strict Facebook auth; excluded from default flow.
• Placeholder scan: no TBD, TODO, or underspecified implementation steps.
• Type consistency: tests use current exported scraper signatures and shared listing fields from ListingDetails.