Reducing informer-reflector's memory footprint

[Iceber]

What would you like to be added?

Reflector waits for all data to be fetched in List before sending it to DeltaFIFO and notifying ResourceHandler to process it.

This leads to large memory consumption, and in List phase, the data is not written to the storage layer, so the processing efficiency is not maximized.

Why is this needed?

The synchronizer now causes a large amount of resources to pile up in memory when it starts, and only processes them after all resources have been pulled into memory, saving them to the storage component.
If we can avoid this huge memory buildup at List time and can quickly process the resources that have been pulled, then not only does it reduce memory, but it also speeds up the processing of the resources (writing to the storage component)

[clusterpedia-bot]

Hi @Iceber,
Thanks for opening an issue!
We will look into it as soon as possible.

Details

Instructions for interacting with me using comments are available here.
If you have questions or suggestions related to my behavior, please file an issue against the gh-ci-bot repository.