System information

• AutoDist version:
• Are you willing to contribute it (Yes/No):

Describe the new feature and the current behavior/state
Pipeline parallelism explained: https://arxiv.org/abs/1811.06965

Will this change the current API? How?

Describe alternatives you've considered

Additional context