Commit Graph
54 Commits
Author SHA1 Message Date
old4ever 6f9d4db419 fix: tighten scraper parsing behavior 2026-04-22 23:41:08 -04:00
old4ever 08edfa8097 fix: align scraper unstable mode behavior 2026-04-22 23:36:00 -04:00
old4ever c7fc8352ac fix: preserve default scraper result contracts 2026-04-22 23:30:17 -04:00
old4ever 1ee41fb346 feat: add unstable mode to scraper results 2026-04-22 23:23:31 -04:00
old4ever 8141de5b4b feat: add shared unstable listing classifier 2026-04-22 17:56:26 -04:00
old4ever 9070f76412 refactor: handle facebook route-aware failure states 2026-04-22 11:48:47 -04:00
old4ever 7ddc96dfdf refactor: add facebook html fallbacks 2026-04-22 11:36:47 -04:00
old4ever 63ca006696 refactor: rewrite facebook item parser for comet bootstrap 2026-04-22 02:44:17 -04:00
old4ever c90ee54cc1 refactor: rewrite facebook search parser for comet bootstrap 2026-04-22 02:32:55 -04:00
old4ever cfd7619737 refactor: add facebook bootstrap candidate extraction 2026-04-21 23:46:00 -04:00
old4ever b072599bc6 refactor: add facebook response classification 2026-04-21 23:31:45 -04:00
old4ever b6e9501448 docs: align cookie setup with env-only auth 2026-04-21 21:53:42 -04:00
old4ever d65d81dbd1 refactor: remove mcp cookie parameters 2026-04-21 21:48:34 -04:00
old4ever 1a2c0cf6b8 refactor: remove api cookie query overrides 2026-04-21 21:47:37 -04:00
old4ever 918ee92441 refactor: make ebay auth env-only 2026-04-21 21:46:40 -04:00
old4ever a7a5eca7ad refactor: remove facebook cookie overrides 2026-04-21 21:45:42 -04:00
old4ever 847ce28590 refactor: make cookie loading env-only 2026-04-21 21:44:12 -04:00
old4ever 7b4b656868 chore: import order
Signed-off-by: Dmytro Stanchiev <git@dmytros.dev>
2026-04-21 21:07:07 -04:00
old4ever e144dcabeb fix: accept nullable marketplace prices in formatter 2026-04-21 21:01:53 -04:00
old4ever 651d54b837 fix: respect custom facebook cookie path 2026-04-21 21:01:53 -04:00
old4ever 86191e7a45 chore: deep-init
Signed-off-by: Dmytro Stanchiev <git@dmytros.dev>
2026-04-21 20:47:00 -04:00
old4ever ffc4a2c5c5 chore: useragent 2026-04-21 19:45:29 -04:00
old4everandClaude Opus 4.5 e4ab145d70 feat: add cookie support to kijiji scraper
Add optional cookie parameter to bypass bot detection (403 errors).
Cookies can be provided via parameter, KIJIJI_COOKIE env var, or
cookies/kijiji.json file. Supports both JSON array and string formats.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-23 19:29:13 -05:00
old4everandClaude Opus 4.5 1dce0392e3 refactor: use shared cookie utility in ebay scraper
Replace inline cookie loading with shared utility functions.
Now supports both JSON array and cookie string formats.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-23 19:29:02 -05:00
old4everandClaude Opus 4.5 251fcbb7d9 refactor: use shared cookie utility in facebook scraper
Replace inline cookie parsing with shared utility functions.
Maintains backward compatibility with existing exports.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-23 19:28:52 -05:00
old4everandClaude Opus 4.5 9bc57d6b54 refactor: add shared cookie utility to core package
Move cookie parsing logic to a dedicated utility module that can be
shared across all scrapers. Supports both JSON array and cookie string
formats for all input sources (parameter, env var, file).

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-23 19:28:44 -05:00
old4ever 4a467c9f02 fix: support both json and string cookies for facebook 2026-01-23 19:00:51 -05:00
old4ever cf9784a565 feat: implement cookie priority hierarchy (URL param > env var > file) for Facebook and eBay scrapers 2026-01-23 15:32:17 -05:00
old4ever df0c528535 fix: correct formatCentsToCurrency usage in facebook scraper 2026-01-23 14:50:41 -05:00
old4ever 2f97d3eafd fix: correct formatCentsToCurrency usage in kijiji scraper 2026-01-23 14:50:41 -05:00
old4ever 65eb8d1724 refactor: increase kijiji scraping request rate to 4 rps
Signed-off-by: Dmytro Stanchiev <git@dmytros.dev>
2026-01-23 14:50:37 -05:00
old4ever f3839aba54 fix: increase kijiji rate limit to 4 rps
Signed-off-by: Dmytro Stanchiev <git@dmytros.dev>
2026-01-23 13:59:47 -05:00
old4ever eb6705df0f feat: add 60-second timeouts to MCP request handlers for reliability 2026-01-23 13:59:28 -05:00
old4ever 72525609ed fix: set idle timeout to 255 seconds in MCP server to prevent premature shutdown 2026-01-23 13:59:28 -05:00
old4ever 8b0a65860c chore: add imports for linkedom and delay utils in ebay scraper 2026-01-23 13:10:44 -05:00
old4ever f9b1c7e096 fix: remove eslint-disable directives
Signed-off-by: Dmytro Stanchiev <git@dmytros.dev>
2026-01-23 13:08:38 -05:00
old4ever ee0fca826d style: fix formatting in MCP server 2026-01-23 11:56:54 -05:00
old4ever f7372612fb test: fix formatting in test setup 2026-01-23 11:56:51 -05:00
old4ever bce126664e test: remove unused imports in Kijiji utils tests 2026-01-23 11:56:47 -05:00
old4ever 8cbf11538e test: fix formatting and remove unused HttpError import in Kijiji tests 2026-01-23 11:56:44 -05:00
old4ever 79f47fdaef test: remove unused import in Facebook integration tests 2026-01-23 11:56:41 -05:00
old4ever de5069bf2b test: fix unused variable in Facebook core tests 2026-01-23 11:56:38 -05:00
old4ever 637f1a4e75 fix: resolve biome lint errors and warnings 2026-01-23 10:33:15 -05:00
old4ever 441ff436c4 feat(mcp): extend Kijiji tool with filtering parameters 2026-01-23 09:55:37 -05:00
old4ever 1f53ec912a feat(mcp): add search options to Kijiji and eBay tools 2026-01-23 09:55:21 -05:00
old4ever 053efd815b feat(api/kijiji): add filtering and pagination parameters 2026-01-23 09:54:30 -05:00
old4ever d619fa5d77 feat(api/facebook): add maxItems parameter support 2026-01-23 09:53:51 -05:00
old4ever 050fd0adba feat(api/ebay): add maxItems parameter and error handling 2026-01-23 09:53:00 -05:00
old4ever 7b106c91ce style: format ebay scraper with consistent indentation 2026-01-23 09:52:25 -05:00
old4ever 6e0487f8f3 style: format api-server index with consistent indentation 2026-01-23 09:52:22 -05:00