Use case:
Some APIs, like DeepSeek R1 and OpenAI, can get busy and don't respond to requests after some time. I want an option to gracefully stop sending requests AND also retain data of successful requests.

I'm looking through .cache/curator and I only see an .arrow file associated with a successful request load. It would be nice if:

• We can download data from curator viewer or
• Data of successful requests are added to a database as they're done, instead of waiting on a long request chain

If this feature is somewhat available, how should I use it? Thanks!