|
|
63ca006696
|
refactor: rewrite facebook item parser for comet bootstrap
|
2026-04-22 02:44:17 -04:00 |
|
|
|
c90ee54cc1
|
refactor: rewrite facebook search parser for comet bootstrap
|
2026-04-22 02:32:55 -04:00 |
|
|
|
cfd7619737
|
refactor: add facebook bootstrap candidate extraction
|
2026-04-21 23:46:00 -04:00 |
|
|
|
b072599bc6
|
refactor: add facebook response classification
|
2026-04-21 23:31:45 -04:00 |
|
|
|
b6e9501448
|
docs: align cookie setup with env-only auth
|
2026-04-21 21:53:42 -04:00 |
|
|
|
918ee92441
|
refactor: make ebay auth env-only
|
2026-04-21 21:46:40 -04:00 |
|
|
|
a7a5eca7ad
|
refactor: remove facebook cookie overrides
|
2026-04-21 21:45:42 -04:00 |
|
|
|
847ce28590
|
refactor: make cookie loading env-only
|
2026-04-21 21:44:12 -04:00 |
|
|
|
7b4b656868
|
chore: import order
Signed-off-by: Dmytro Stanchiev <git@dmytros.dev>
|
2026-04-21 21:07:07 -04:00 |
|
|
|
e144dcabeb
|
fix: accept nullable marketplace prices in formatter
|
2026-04-21 21:01:53 -04:00 |
|
|
|
f7372612fb
|
test: fix formatting in test setup
|
2026-01-23 11:56:51 -05:00 |
|
|
|
bce126664e
|
test: remove unused imports in Kijiji utils tests
|
2026-01-23 11:56:47 -05:00 |
|
|
|
8cbf11538e
|
test: fix formatting and remove unused HttpError import in Kijiji tests
|
2026-01-23 11:56:44 -05:00 |
|
|
|
79f47fdaef
|
test: remove unused import in Facebook integration tests
|
2026-01-23 11:56:41 -05:00 |
|
|
|
de5069bf2b
|
test: fix unused variable in Facebook core tests
|
2026-01-23 11:56:38 -05:00 |
|
|
|
50d56201af
|
feat: port upstream scraper improvements to monorepo
Kijiji improvements:
- Add error classes: NetworkError, ParseError, RateLimitError, ValidationError
- Add exponential backoff with jitter for retries
- Add request timeout (30s abort)
- Add pagination support (SearchOptions.maxPages)
- Add location/category mappings and resolution functions
- Add enhanced DetailedListing interface with images, seller info, attributes
- Add GraphQL client for seller details
Facebook improvements:
- Add parseFacebookCookieString() for parsing cookie strings
- Add ensureFacebookCookies() with env var fallback
- Add extractFacebookItemData() with multiple extraction paths
- Add fetchFacebookItem() for individual item fetching
- Add extraction metrics and API stability monitoring
- Add vehicle-specific field extraction
- Improve error handling with specific guidance for auth errors
Shared utilities:
- Update http.ts with new error classes and improved fetchHtml
Documentation:
- Port KIJIJI.md, FMARKETPLACE.md, AGENTS.md from upstream
Tests:
- Port kijiji-core, kijiji-integration, kijiji-utils tests
- Port facebook-core, facebook-integration tests
- Add test setup file
Scripts:
- Port parse-facebook-cookies.ts script
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
|
2026-01-23 00:34:50 -05:00 |
|
