Tutorial¶
First, install ceci by following the instructions on the Installation page.
To run the test example you’ll need to use the source code
Running a test pipeline¶
A mock pipeline, which just reads from and writes to a series of small text files, can be run by with the command:
ceci tests/test.yml
Making a new pipeline¶
You can use a cookiecutter template to make new pipeline stages. You can install cookiecutter with pip3 install cookiecutter
and then run:
cookiecutter https://github.com/LSSTDESC/pipeline-package-template
And enter a name for your pipeline collection.
This will create a template for your new pipeline stages. You design your pipeline stages in python files in this new repo - the example in <repo_name>/<repo_name>stage1.py
shows a template for this, and you can see the “Stages” section for more details.
Your job as a pipeline builder is to make a file like this for each stage in your pipeline, and fill them in. You can then