We have files with historical and incremental data sent to us by a customer. I have to load all these files sequentially to make sure the data in historical files does not update the latest incremental changes.
Eg: I have a folder
"S3 bucket name/Source Collection/"
And files in it as
When I start loading all these files using SourceFile.processAll(), I cannot guarantee sequential processing. Is there a way I can do that?