Submitted 11 months ago by salvador@lemmy.world to programming@programming.dev
One needs to send 1 mln HTTP requests concurrently, in batches, and read the responses. No more than 100 requests at a time.
Which way will it be better, recommended, idiomatic?
Given you seem to be against adding extra info, based on the other comments, the only correct answer is “whichever one works best for you”.
The answer is quite useless, but I can’t be more specific. “Better” is vague. Faster, smoother, less taxing on system resources, there’s options and they may conflict. Good luck.
This is to me an question lacking very precise requirements. But you say you need batches, so it sounds like option one (batches) is the only option that satisfies the “batches” requirement.
Then this questin isn’t for you.
Nor is the answer for you it would seem.
ck_@discuss.tchncs.de 11 months ago
Given we know very little about the problem and runtime constraints, the second approach has the potential to have better performance, as with case 1. the average duration of the requests in a batch is equal to the worst case for all requests, while in case 2. the average duration of all requests is, well, the average.
salvador@lemmy.world 11 months ago
Who “we”? Voices in your head?
ck_@discuss.tchncs.de 11 months ago
Aaand… blocked