Goals

1. Take a command like turbo run test and split
2. Be able to specify the amount of partitions turbo run test --split=4
3. Be able to specify which partition you wish to run turbo run test --split=4 --partition=1 (or multiple turbo run test --split=4 --partition=1)

Non-goals

1. A balancing of the partitions

Background

I would like to be able to take a command like turbo run test and distribute it across multiple agents. In order to increase parallelization in my builds and overall build time to complete.

I see @sppatel has made an article on doing this https://medium.com/@sppatel/maximizing-job-parallelization-in-ci-workflows-with-jest-and-turborepo-da86b9be0ee6 but I wonder if there could be an official implementation in here.

The alternative here would be for developers to maintain they're own script or build a third party package to help consolidate effort.

Proposal

I think using @sppatel article we could build it and just need to describe the interface such as split (for how many shards) and partition to specify which ones you wish to execute. We have the graph so I think it's feasible to do this.

I think people may want is the balancing, which could definitely be done as an enhancement. Perhaps providing an option to be explicit about which packages are in your shards would work.