Currently the DataProvider work with files one by one but we can change this to work in parallel so we can go faster
- Read the DataProvider file and think how we can be faster and work in parallel.
- Bench mark the performance while working on large files
Currently the DataProvider work with files one by one but we can change this to work in parallel so we can go faster