old4ever/ca-marketplace-scraper
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: add cookie support to kijiji scraper

Browse Source 
Add optional cookie parameter to bypass bot detection (403 errors).
Cookies can be provided via parameter, KIJIJI_COOKIE env var, or
cookies/kijiji.json file. Supports both JSON array and string formats.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
This commit is contained in:
Dmytro Stanchiev
2026-01-23 19:29:13 -05:00
parent 1dce0392e3
commit e4ab145d70
4 changed files with 34 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
packages/mcp-server/src/protocol/handler.ts
View File

@@ -115,6 +115,7 @@ export async function handleMcpRequest(req: Request): Promise<Response> {
params.append("priceMin", args.priceMin.toString());
if (args.priceMax)
params.append("priceMax", args.priceMax.toString());
if (args.cookies) params.append("cookies", args.cookies);
console.log(
`[MCP] Calling Kijiji API: ${API_BASE_URL}/kijiji?${params.toString()}`,