Description
Running an import with -m 2 will result in three splits if there are only three consecutive integers in the table ({1, 2, 3}).
Work is (probably) spread more evenly between mappers this way, but ending up with more files than expected could be an issue.
Split-limit can also result in more values than asked for in the last chunk (due to the closed interval in the end).
Attachments
Issue Links
- links to