I am working on a project where we need to parse a file of size > 2GB and load data into DB. I am planning to break file using camel splitter into 50 different files and then process each one using Apache Camel.

My question is..

While processing one of the file, camel route fails then how to stop camel route and audit this in DB with file name. It might happen that some of the records are processed and uploaded to DB and for a specific records it is failing. So how do we log this specific record in some other file for investigation purpose.

Also while processing, due to network failure, DB operations are stopped. In this scenario file processing is incomplete. So how to handle incomplete file processing scenario using Swichyar Camel component as only remaining records should be processed again.