From d3d1d34f9967f22c2a44b96fe7624cf15299549d Mon Sep 17 00:00:00 2001 From: Harwinder Sekhon Date: Sun, 27 Sep 2026 19:46:13 -0400 Subject: [PATCH] Crawl log: precise crawl finished (523 more requests, 46,538 headlines) Co-Authored-By: Claude Fable 5.1 --- logs/crawl_precise.log | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/logs/crawl_precise.log b/logs/crawl_precise.log index 99a2054..b17f254 100644 --- a/logs/crawl_precise.log +++ b/logs/crawl_precise.log @@ -39,3 +39,7 @@ precise: 200 windows of 14 days x 21 queries; 729 done, 4039 to go precise: 200 windows of 14 days x 21 queries; 6125 done, 523 to go 100 requests, window 2024-03-25, 44823 unique headlines, 27 req/min 200 requests, window 2021-10-11, 45308 unique headlines, 27 req/min +300 requests, window 2022-07-04, 45544 unique headlines, 27 req/min +400 requests, window 2024-01-01, 45842 unique headlines, 27 req/min +500 requests, window 2026-06-15, 46461 unique headlines, 27 req/min +done: 523 requests this run, 46538 unique headlines in /home/harwinder/Development/ML-NEWS/data/history.db