c90ee54cc1
refactor: rewrite facebook search parser for comet bootstrap
2026-04-22 02:32:55 -04:00
cfd7619737
refactor: add facebook bootstrap candidate extraction
2026-04-21 23:46:00 -04:00
b072599bc6
refactor: add facebook response classification
2026-04-21 23:31:45 -04:00
2617afc62f
docs: add facebook comet rewrite plan
2026-04-21 23:06:03 -04:00
ba889a1f9d
docs: add facebook comet rewrite design
2026-04-21 23:02:47 -04:00
45cff20377
docs: update cookies agents.md
...
Signed-off-by: Dmytro Stanchiev <git@dmytros.dev >
2026-04-21 22:05:49 -04:00
b6e9501448
docs: align cookie setup with env-only auth
2026-04-21 21:53:42 -04:00
d65d81dbd1
refactor: remove mcp cookie parameters
2026-04-21 21:48:34 -04:00
1a2c0cf6b8
refactor: remove api cookie query overrides
2026-04-21 21:47:37 -04:00
918ee92441
refactor: make ebay auth env-only
2026-04-21 21:46:40 -04:00
a7a5eca7ad
refactor: remove facebook cookie overrides
2026-04-21 21:45:42 -04:00
847ce28590
refactor: make cookie loading env-only
2026-04-21 21:44:12 -04:00
7b4b656868
chore: import order
...
Signed-off-by: Dmytro Stanchiev <git@dmytros.dev >
2026-04-21 21:07:07 -04:00
e144dcabeb
fix: accept nullable marketplace prices in formatter
2026-04-21 21:01:53 -04:00
651d54b837
fix: respect custom facebook cookie path
2026-04-21 21:01:53 -04:00
2231603692
chore: fix lint config
...
Signed-off-by: Dmytro Stanchiev <git@dmytros.dev >
2026-04-21 20:51:28 -04:00
86191e7a45
chore: deep-init
...
Signed-off-by: Dmytro Stanchiev <git@dmytros.dev >
2026-04-21 20:47:00 -04:00
c58d614948
chore: devenv lock update
...
Signed-off-by: Dmytro Stanchiev <git@dmytros.dev >
2026-04-21 20:37:55 -04:00
7cf21546e2
chore: ai agent config
...
Signed-off-by: Dmytro Stanchiev <git@dmytros.dev >
2026-04-21 20:37:55 -04:00
ffc4a2c5c5
chore: useragent
2026-04-21 19:45:29 -04:00
e4ab145d70
feat: add cookie support to kijiji scraper
...
Add optional cookie parameter to bypass bot detection (403 errors).
Cookies can be provided via parameter, KIJIJI_COOKIE env var, or
cookies/kijiji.json file. Supports both JSON array and string formats.
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com >
2026-01-23 19:29:13 -05:00
1dce0392e3
refactor: use shared cookie utility in ebay scraper
...
Replace inline cookie loading with shared utility functions.
Now supports both JSON array and cookie string formats.
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com >
2026-01-23 19:29:02 -05:00
251fcbb7d9
refactor: use shared cookie utility in facebook scraper
...
Replace inline cookie parsing with shared utility functions.
Maintains backward compatibility with existing exports.
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com >
2026-01-23 19:28:52 -05:00
9bc57d6b54
refactor: add shared cookie utility to core package
...
Move cookie parsing logic to a dedicated utility module that can be
shared across all scrapers. Supports both JSON array and cookie string
formats for all input sources (parameter, env var, file).
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com >
2026-01-23 19:28:44 -05:00
4a467c9f02
fix: support both json and string cookies for facebook
2026-01-23 19:00:51 -05:00
f944d319c2
chore: update dockerignore
2026-01-23 15:43:13 -05:00
cf9784a565
feat: implement cookie priority hierarchy (URL param > env var > file) for Facebook and eBay scrapers
2026-01-23 15:32:17 -05:00
df0c528535
fix: correct formatCentsToCurrency usage in facebook scraper
2026-01-23 14:50:41 -05:00
2f97d3eafd
fix: correct formatCentsToCurrency usage in kijiji scraper
2026-01-23 14:50:41 -05:00
65eb8d1724
refactor: increase kijiji scraping request rate to 4 rps
...
Signed-off-by: Dmytro Stanchiev <git@dmytros.dev >
2026-01-23 14:50:37 -05:00
f3839aba54
fix: increase kijiji rate limit to 4 rps
...
Signed-off-by: Dmytro Stanchiev <git@dmytros.dev >
2026-01-23 13:59:47 -05:00
90b98bfb09
chore: testing mcp server
...
Signed-off-by: Dmytro Stanchiev <git@dmytros.dev >
2026-01-23 13:59:28 -05:00
eb6705df0f
feat: add 60-second timeouts to MCP request handlers for reliability
2026-01-23 13:59:28 -05:00
72525609ed
fix: set idle timeout to 255 seconds in MCP server to prevent premature shutdown
2026-01-23 13:59:28 -05:00
8b0a65860c
chore: add imports for linkedom and delay utils in ebay scraper
2026-01-23 13:10:44 -05:00
f9b1c7e096
fix: remove eslint-disable directives
...
Signed-off-by: Dmytro Stanchiev <git@dmytros.dev >
2026-01-23 13:08:38 -05:00
9edc74cbeb
chore: local dev scripts
...
Signed-off-by: Dmytro Stanchiev <git@dmytros.dev >
2026-01-23 13:07:01 -05:00
ee0fca826d
style: fix formatting in MCP server
2026-01-23 11:56:54 -05:00
f7372612fb
test: fix formatting in test setup
2026-01-23 11:56:51 -05:00
bce126664e
test: remove unused imports in Kijiji utils tests
2026-01-23 11:56:47 -05:00
8cbf11538e
test: fix formatting and remove unused HttpError import in Kijiji tests
2026-01-23 11:56:44 -05:00
79f47fdaef
test: remove unused import in Facebook integration tests
2026-01-23 11:56:41 -05:00
de5069bf2b
test: fix unused variable in Facebook core tests
2026-01-23 11:56:38 -05:00
637f1a4e75
fix: resolve biome lint errors and warnings
2026-01-23 10:33:15 -05:00
441ff436c4
feat(mcp): extend Kijiji tool with filtering parameters
2026-01-23 09:55:37 -05:00
1f53ec912a
feat(mcp): add search options to Kijiji and eBay tools
2026-01-23 09:55:21 -05:00
053efd815b
feat(api/kijiji): add filtering and pagination parameters
2026-01-23 09:54:30 -05:00
d619fa5d77
feat(api/facebook): add maxItems parameter support
2026-01-23 09:53:51 -05:00
050fd0adba
feat(api/ebay): add maxItems parameter and error handling
2026-01-23 09:53:00 -05:00
7b106c91ce
style: format ebay scraper with consistent indentation
2026-01-23 09:52:25 -05:00
