diff --git a/logs/crawl_precise.log b/logs/crawl_precise.log index 99a2054..b17f254 100644 --- a/logs/crawl_precise.log +++ b/logs/crawl_precise.log @@ -39,3 +39,7 @@ precise: 200 windows of 14 days x 21 queries; 729 done, 4039 to go precise: 200 windows of 14 days x 21 queries; 6125 done, 523 to go 100 requests, window 2024-03-25, 44823 unique headlines, 27 req/min 200 requests, window 2021-10-11, 45308 unique headlines, 27 req/min +300 requests, window 2022-07-04, 45544 unique headlines, 27 req/min +400 requests, window 2024-01-01, 45842 unique headlines, 27 req/min +500 requests, window 2026-06-15, 46461 unique headlines, 27 req/min +done: 523 requests this run, 46538 unique headlines in /home/harwinder/Development/ML-NEWS/data/history.db