Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
The `prefetchN` in the pubsub source was complicated because: 1. The preceding `parEvalMapUnordered` effectively does a pre-fetch already 2. PrefetchN works in chunks, so there was a danger our Source was pre-fetching more batches from pubsub than expected. 3. It gave a double-meaning to the `parallelPullCount` config param, because the same param got used in two places. Which is just confusing. Moreover, I found it just wasn't needed. The input rate of this Source is high enough without the prefetch.
- Loading branch information