Files
News-ML-Decoder/logs/crawl_precise.log
T
2026-09-27 19:46:13 -04:00

46 lines
3.0 KiB
Plaintext

precise: 200 windows of 14 days x 21 queries; 568 done, 4200 to go
100 requests, window 2024-07-15, 22643 unique headlines, 27 req/min
precise: 200 windows of 14 days x 21 queries; 729 done, 4039 to go
100 requests, window 2023-01-30, 23483 unique headlines, 27 req/min
200 requests, window 2026-08-24, 24041 unique headlines, 26 req/min
300 requests, window 2024-06-17, 24439 unique headlines, 26 req/min
400 requests, window 2020-01-06, 25024 unique headlines, 26 req/min
500 requests, window 2020-07-06, 25283 unique headlines, 26 req/min
600 requests, window 2023-03-13, 25737 unique headlines, 26 req/min
700 requests, window 2021-04-12, 26016 unique headlines, 26 req/min
800 requests, window 2022-10-24, 26529 unique headlines, 26 req/min
900 requests, window 2021-07-05, 27145 unique headlines, 26 req/min
1000 requests, window 2026-01-26, 27546 unique headlines, 26 req/min
1100 requests, window 2021-09-27, 28253 unique headlines, 26 req/min
1200 requests, window 2019-06-24, 28620 unique headlines, 26 req/min
1300 requests, window 2020-10-26, 28891 unique headlines, 26 req/min
1400 requests, window 2024-01-29, 29175 unique headlines, 26 req/min
1500 requests, window 2019-07-22, 29686 unique headlines, 26 req/min
1600 requests, window 2020-09-28, 30214 unique headlines, 26 req/min
1700 requests, window 2026-07-27, 30736 unique headlines, 26 req/min
1800 requests, window 2024-03-11, 31133 unique headlines, 26 req/min
1900 requests, window 2025-06-30, 31755 unique headlines, 26 req/min
2000 requests, window 2022-06-06, 32098 unique headlines, 26 req/min
2100 requests, window 2022-09-12, 32741 unique headlines, 26 req/min
2200 requests, window 2020-04-13, 33019 unique headlines, 26 req/min
2300 requests, window 2023-01-16, 33296 unique headlines, 26 req/min
2400 requests, window 2020-03-02, 33814 unique headlines, 26 req/min
2500 requests, window 2021-12-06, 34301 unique headlines, 26 req/min
2600 requests, window 2024-10-21, 34714 unique headlines, 26 req/min
2700 requests, window 2023-10-23, 35117 unique headlines, 26 req/min
2800 requests, window 2024-12-16, 35633 unique headlines, 26 req/min
2900 requests, window 2021-03-01, 35912 unique headlines, 26 req/min
3000 requests, window 2021-05-24, 36290 unique headlines, 26 req/min
3100 requests, window 2019-11-25, 36572 unique headlines, 26 req/min
3200 requests, window 2024-02-12, 37049 unique headlines, 26 req/min
3300 requests, window 2021-01-04, 37516 unique headlines, 26 req/min
3400 requests, window 2022-06-20, 37890 unique headlines, 26 req/min
3500 requests, window 2019-09-16, 38328 unique headlines, 26 req/min
precise: 200 windows of 14 days x 21 queries; 6125 done, 523 to go
100 requests, window 2024-03-25, 44823 unique headlines, 27 req/min
200 requests, window 2021-10-11, 45308 unique headlines, 27 req/min
300 requests, window 2022-07-04, 45544 unique headlines, 27 req/min
400 requests, window 2024-01-01, 45842 unique headlines, 27 req/min
500 requests, window 2026-06-15, 46461 unique headlines, 27 req/min
done: 523 requests this run, 46538 unique headlines in /home/harwinder/Development/ML-NEWS/data/history.db