--parallel

In order to keep the tool low on resource usage, it processes the files one by one sequentially, creating the list of files to search first and then opening and processing its contents one by one.

To increase the process speed, we can use this flag to make the tool process files in paralel. Several processes are launched where each one processes a different file, and by default the number of processes is the same as the number of physical processors available in the machine. This number of processes can be specified by using the flat --limit

As soon as we get a new file to process (plain text file or Excel) they are handled to one of those processes as they become available, or kept in a queue until they can be handled.

The results of each of those processes is returned to a result queue, and when all the files have been processed, all the results are gathered together and presented.

If this flag is not used and we have to process a big file from the list, the rest will be waiting for this big file to be processed. By having several processes that can handle files in parallel, a big file will take some time to be processed but other files can be handled without waiting for this big file to end.

This flag is implicit when using the --massive flag.

⬅️ Volver a la página anterior