Pipeline

class motorway.pipeline.Pipeline(controller_bind_address='0.0.0.0:7007', run_controller=True, run_webserver=True, run_connection_discovery=True)

definition()

Extend this method in your motorway.pipeline.Pipeline subclass, e.g.:

class WordCountPipeline(Pipeline):
    def definition(self):
        self.add_ramp(WordRamp, 'sentence')
        self.add_intersection(SentenceSplitIntersection, 'sentence', 'word', processes=2)
        self.add_intersection(WordCountIntersection, 'word', 'word_count', grouper_cls=HashRingGrouper, processes=2)
        self.add_intersection(AggregateIntersection, 'word_count', grouper_cls=HashRingGrouper, processes=1)

run()

Execute the entire pipeline in several sub processes.