|
|
df0c528535
|
fix: correct formatCentsToCurrency usage in facebook scraper
|
2026-01-23 14:50:41 -05:00 |
|
|
|
2f97d3eafd
|
fix: correct formatCentsToCurrency usage in kijiji scraper
|
2026-01-23 14:50:41 -05:00 |
|
|
|
65eb8d1724
|
refactor: increase kijiji scraping request rate to 4 rps
Signed-off-by: Dmytro Stanchiev <git@dmytros.dev>
|
2026-01-23 14:50:37 -05:00 |
|
|
|
8b0a65860c
|
chore: add imports for linkedom and delay utils in ebay scraper
|
2026-01-23 13:10:44 -05:00 |
|
|
|
f9b1c7e096
|
fix: remove eslint-disable directives
Signed-off-by: Dmytro Stanchiev <git@dmytros.dev>
|
2026-01-23 13:08:38 -05:00 |
|
|
|
f7372612fb
|
test: fix formatting in test setup
|
2026-01-23 11:56:51 -05:00 |
|
|
|
bce126664e
|
test: remove unused imports in Kijiji utils tests
|
2026-01-23 11:56:47 -05:00 |
|
|
|
8cbf11538e
|
test: fix formatting and remove unused HttpError import in Kijiji tests
|
2026-01-23 11:56:44 -05:00 |
|
|
|
79f47fdaef
|
test: remove unused import in Facebook integration tests
|
2026-01-23 11:56:41 -05:00 |
|
|
|
de5069bf2b
|
test: fix unused variable in Facebook core tests
|
2026-01-23 11:56:38 -05:00 |
|
|
|
637f1a4e75
|
fix: resolve biome lint errors and warnings
|
2026-01-23 10:33:15 -05:00 |
|
|
|
7b106c91ce
|
style: format ebay scraper with consistent indentation
|
2026-01-23 09:52:25 -05:00 |
|
|
|
c35aae4c95
|
chore: biome auto-fixes
|
2026-01-23 00:52:26 -05:00 |
|
|
|
50d56201af
|
feat: port upstream scraper improvements to monorepo
Kijiji improvements:
- Add error classes: NetworkError, ParseError, RateLimitError, ValidationError
- Add exponential backoff with jitter for retries
- Add request timeout (30s abort)
- Add pagination support (SearchOptions.maxPages)
- Add location/category mappings and resolution functions
- Add enhanced DetailedListing interface with images, seller info, attributes
- Add GraphQL client for seller details
Facebook improvements:
- Add parseFacebookCookieString() for parsing cookie strings
- Add ensureFacebookCookies() with env var fallback
- Add extractFacebookItemData() with multiple extraction paths
- Add fetchFacebookItem() for individual item fetching
- Add extraction metrics and API stability monitoring
- Add vehicle-specific field extraction
- Improve error handling with specific guidance for auth errors
Shared utilities:
- Update http.ts with new error classes and improved fetchHtml
Documentation:
- Port KIJIJI.md, FMARKETPLACE.md, AGENTS.md from upstream
Tests:
- Port kijiji-core, kijiji-integration, kijiji-utils tests
- Port facebook-core, facebook-integration tests
- Add test setup file
Scripts:
- Port parse-facebook-cookies.ts script
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
|
2026-01-23 00:34:50 -05:00 |
|
|
|
497c7995a2
|
feat: ebay 'buy it now' and 'canada only' filters support
|
2025-12-17 14:38:52 -05:00 |
|
|
|
a66b5b2362
|
migrate to monorepo?
|
2025-12-13 20:31:10 -05:00 |
|
