Automation workflow docs: ECALElf ntuples production

run-wskim.py

Submit ECAL automation jobs.

usage: run-wskim.py [-h] [--db DBNAME] [--notify NOTIFY]
                    [--campaign CAMPAIGN [CAMPAIGN ...]] [--logurl LOGURL]
                    [--wdir WDIR] [--eosdir EOSDIR]
                    {submit,resubmit,check} ...

Named Arguments

--db

Database name, default is test db

Default: “ecal_online_test”

--notify

Mattermost incoming webhook url for notifications

--campaign

Processing campaign(s). “all” for all campaigns in the db

--logurl

Base url for the logs

Default: “https://ecallogs.web.cern.ch/”

--wdir

Working directory

--eosdir

Base path of output location on EOS

subcommands

Select command to execute

subcommand

Possible choices: submit, resubmit, check

Sub-commands

submit

Process all runs marked as new in the automation db

run-wskim.py submit [-h] [--t0 | --lfn] [--nfiles NFILES]
                    [--template TEMPLATE]

Named Arguments

--t0

Read input files from T0 storage

Default: False

--lfn

Use logical file names for input files

Default: False

--nfiles

Number of files per job, None=”all”

--template

HTCondot template submit file

Default: “template.sub”

resubmit

Check for failed jobs and resubmit them

run-wskim.py resubmit [-h] [--lfn] [--template TEMPLATE]
                      [--resub-flv RESUBFLV]

Named Arguments

--lfn

Use logical file names for input files

Default: False

--template

HTCondot template submit file

Default: “template.sub”

--resub-flv

Resubmit JobFlavour

Default: “workday”

check

Check ongoing runs and mark them as done/failed if completed

run-wskim.py check [-h] [--max-retries MAX_RETRIES]
                   [--skipped-delay SKIPPED_DELAY]

Named Arguments

--max-retries

Max number of tries, for each single job. -1 = no limit

Default: -1

--skipped-delay

Number of days after which a task is considered as stalled and is marked as skipped.

Default: 7

run-zskim.py

Submit ECAL automation jobs.

usage: run-zskim.py [-h] [--db DBNAME] [--notify NOTIFY]
                    [--campaign CAMPAIGN [CAMPAIGN ...]] [--logurl LOGURL]
                    [--wdir WDIR] [--eosdir EOSDIR]
                    {submit,resubmit,check} ...

Named Arguments

--db

Database name, default is test db

Default: “ecal_online_test”

--notify

Mattermost incoming webhook url for notifications

--campaign

Processing campaign(s). “all” for all campaigns in the db

--logurl

Base url for the logs

Default: “https://ecallogs.web.cern.ch/”

--wdir

Working directory

--eosdir

Base path of output location on EOS

subcommands

Select command to execute

subcommand

Possible choices: submit, resubmit, check

Sub-commands

submit

Process all runs marked as new in the automation db

run-zskim.py submit [-h] [--t0 | --lfn] [--nfiles NFILES]
                    [--template TEMPLATE]

Named Arguments

--t0

Read input files from T0 storage

Default: False

--lfn

Use logical file names for input files

Default: False

--nfiles

Number of files per job, None=”all”

--template

HTCondot template submit file

Default: “template.sub”

resubmit

Check for failed jobs and resubmit them

run-zskim.py resubmit [-h] [--lfn] [--template TEMPLATE]
                      [--resub-flv RESUBFLV]

Named Arguments

--lfn

Use logical file names for input files

Default: False

--template

HTCondot template submit file

Default: “template.sub”

--resub-flv

Resubmit JobFlavour

Default: “workday”

check

Check ongoing runs and mark them as done/failed if completed

run-zskim.py check [-h] [--max-retries MAX_RETRIES]
                   [--skipped-delay SKIPPED_DELAY]

Named Arguments

--max-retries

Max number of tries, for each single job. -1 = no limit

Default: -1

--skipped-delay

Number of days after which a task is considered as stalled and is marked as skipped.

Default: 7