Today I learned: Python’s concurrency-safe queue structures have a hard limit of 32,768 items. I totally did not deadlock a piece of code by not paying attention to that, why do you ask?
Prikaži ovu nit
-
So then I tried creating a queue with a higher maxsize, and got an immediate exception saying that’s not allowed. Turns out to be a hard-coded limit. Perhaps this should be documented better.
Prikaži ovu nit
(it’s not entirely Python’s fault, since this is actually handed off to system-specific non-Python semaphore implementations, and that’s where the hard-coded limit actually lives, but still, could be documented better)
-
-
interesting, do you have more specific pointers? i can imagine there being a maximum number of concurrent "waiters" on the queue, but not how it relates to the number of items contained within.
-
Here is where Python hands off: https://github.com/python/cpython/blob/master/Modules/_multiprocessing/multiprocessing.h … SEM_VALUE_MAX is system-dependent. Which header it lives in seems to also be system-dependent.
- Još 1 odgovor
Novi razgovor -
Čini se da učitavanje traje već neko vrijeme.
Twitter je možda preopterećen ili ima kratkotrajnih poteškoća u radu. Pokušajte ponovno ili potražite dodatne informacije u odjeljku Status Twittera.