Automation workflow docs: ECAL pulse shapes

runreco.py

Submit ECAL automation jobs.

usage: runreco.py [-h] [--db DBNAME] [--notify NOTIFY]
                  [--campaign CAMPAIGN [CAMPAIGN ...]] [--logurl LOGURL]
                  [--wdir WDIR] [--eosdir EOSDIR]
                  {submit,resubmit,check} ...

Named Arguments

--db

Database name, default is test db

Default: “ecal_online_test”

--notify

Mattermost incoming webhook url for notifications

--campaign

Processing campaign(s). “all” for all campaigns in the db

--logurl

Base url for the logs

Default: “https://ecallogs.web.cern.ch/”

--wdir

Working directory

--eosdir

Base path of output location on EOS

subcommands

Select command to execute

subcommand: Possible choices: submit, resubmit, check

Sub-commands

submit

Process all runs marked as new in the automation db

runreco.py submit [-h] [--t0 | --lfn] [--nfiles NFILES] [--template TEMPLATE]

Named Arguments

--t0

Read input files from T0 storage

Default: False

--lfn

Use logical file names for input files

Default: False

--nfiles

Number of files per job, None=”all”

--template

HTCondot template submit file

Default: “template.sub”

resubmit

Check for failed jobs and resubmit them

runreco.py resubmit [-h] [--lfn] [--template TEMPLATE] [--resub-flv RESUBFLV]

Named Arguments

--lfn

Use logical file names for input files

Default: False

--template

HTCondot template submit file

Default: “template.sub”

--resub-flv

Resubmit JobFlavour

Default: “workday”

check

Check ongoing runs and mark them as done/failed if completed

runreco.py check [-h] [--max-retries MAX_RETRIES]
                 [--skipped-delay SKIPPED_DELAY]

Named Arguments

--max-retries

Max number of tries, for each single job. -1 = no limit

Default: -1

--skipped-delay

Number of days after which a task is considered as stalled and is marked as skipped.

Default: 7

merger.py

Submit ECAL automation jobs.

usage: merger.py [-h] [--db DBNAME] [--notify NOTIFY]
                 [--campaign CAMPAIGN [CAMPAIGN ...]] [--logurl LOGURL]
                 [--wdir WDIR] [--eosdir EOSDIR]
                 {submit,resubmit,check} ...

Named Arguments

--db

Database name, default is test db

Default: “ecal_online_test”

--notify

Mattermost incoming webhook url for notifications

--campaign

Processing campaign(s). “all” for all campaigns in the db

--logurl

Base url for the logs

Default: “https://ecallogs.web.cern.ch/”

--wdir

Working directory

--eosdir

Base path of output location on EOS

subcommands

Select command to execute

subcommand: Possible choices: submit, resubmit, check

Sub-commands

submit

Process all runs marked as new in the automation db

merger.py submit [-h] [--t0 | --lfn] [--eosplots EOSPLOTS]
                 [--plotsurl PLOTSURL]

Named Arguments

--t0

Read input files from T0 storage

Default: False

--lfn

Use logical file names for input files

Default: False

--eosplots

Plots webpage EOS path

--plotsurl

Plots webpage url

resubmit

Check for failed jobs and resubmit them

merger.py resubmit [-h] [--lfn] [--eosplots EOSPLOTS] [--plotsurl PLOTSURL]

Named Arguments

--lfn

Use logical file names for input files

Default: False

--eosplots

Plots webpage EOS path

--plotsurl

Plots webpage url

check

Check ongoing runs and mark them as done/failed if completed

merger.py check [-h] [--max-retries MAX_RETRIES]
                [--skipped-delay SKIPPED_DELAY]

Named Arguments

--max-retries

Max number of tries, for each single job. -1 = no limit

Default: -1

--skipped-delay

Number of days after which a task is considered as stalled and is marked as skipped.

Default: 7

merger-fill.py

Submit ECAL automation jobs.

usage: merger-fill.py [-h] [--db DBNAME] [--notify NOTIFY]
                      [--campaign CAMPAIGN [CAMPAIGN ...]] [--logurl LOGURL]
                      [--wdir WDIR] [--eosdir EOSDIR]
                      {submit,resubmit,check} ...

Named Arguments

--db

Database name, default is test db

Default: “ecal_online_test”

--notify

Mattermost incoming webhook url for notifications

--campaign

Processing campaign(s). “all” for all campaigns in the db

--logurl

Base url for the logs

Default: “https://ecallogs.web.cern.ch/”

--wdir

Working directory

--eosdir

Base path of output location on EOS

subcommands

Select command to execute

subcommand: Possible choices: submit, resubmit, check

Sub-commands

submit

Process all runs marked as new in the automation db

merger-fill.py submit [-h] [--t0 | --lfn] [--eosplots EOSPLOTS]
                      [--plotsurl PLOTSURL]

Named Arguments

--t0

Read input files from T0 storage

Default: False

--lfn

Use logical file names for input files

Default: False

--eosplots

Plots webpage EOS path

--plotsurl

Plots webpage url

resubmit

Check for failed jobs and resubmit them

merger-fill.py resubmit [-h] [--lfn] [--eosplots EOSPLOTS]
                        [--plotsurl PLOTSURL]

Named Arguments

--lfn

Use logical file names for input files

Default: False

--eosplots

Plots webpage EOS path

--plotsurl

Plots webpage url

check

Check ongoing runs and mark them as done/failed if completed

merger-fill.py check [-h] [--max-retries MAX_RETRIES]
                     [--skipped-delay SKIPPED_DELAY]

Named Arguments

--max-retries

Max number of tries, for each single job. -1 = no limit

Default: -1

--skipped-delay

Number of days after which a task is considered as stalled and is marked as skipped.

Default: 7

runhltval.py

Submit ECAL automation jobs.

usage: runhltval.py [-h] [--db DBNAME] [--notify NOTIFY]
                    [--campaign CAMPAIGN [CAMPAIGN ...]] [--logurl LOGURL]
                    [--wdir WDIR] [--eosdir EOSDIR] [--ref]
                    {submit,resubmit,check} ...

Named Arguments

--db

Database name, default is test db

Default: “ecal_online_test”

--notify

Mattermost incoming webhook url for notifications

--campaign

Processing campaign(s). “all” for all campaigns in the db

--logurl

Base url for the logs

Default: “https://ecallogs.web.cern.ch/”

--wdir

Working directory

--eosdir

Base path of output location on EOS

--ref

Run with reference conditions if set, validation one otherwise

Default: False

subcommands

Select command to execute

subcommand: Possible choices: submit, resubmit, check

Sub-commands

submit

Process all runs marked as new in the automation db

runhltval.py submit [-h] [--t0 | --lfn] [--nfiles NFILES]
                    [--template TEMPLATE]

Named Arguments

--t0

Read input files from T0 storage

Default: False

--lfn

Use logical file names for input files

Default: False

--nfiles

Number of files per job, None=”all”

--template

HTCondot template submit file

Default: “template.sub”

resubmit

Check for failed jobs and resubmit them

runhltval.py resubmit [-h] [--lfn] [--template TEMPLATE]
                      [--resub-flv RESUBFLV]

Named Arguments

--lfn

Use logical file names for input files

Default: False

--template

HTCondot template submit file

Default: “template.sub”

--resub-flv

Resubmit JobFlavour

Default: “workday”

check

Check ongoing runs and mark them as done/failed if completed

runhltval.py check [-h] [--max-retries MAX_RETRIES]
                   [--skipped-delay SKIPPED_DELAY]

Named Arguments

--max-retries

Max number of tries, for each single job. -1 = no limit

Default: -1

--skipped-delay

Number of days after which a task is considered as stalled and is marked as skipped.

Default: 7

conddb_upload.py

Submit ECAL automation jobs.

usage: conddb_upload.py [-h] [--db DBNAME] [--notify NOTIFY]
                        [--campaign CAMPAIGN [CAMPAIGN ...]] [--logurl LOGURL]
                        [--wdir WDIR] [--eosdir EOSDIR]
                        {submit,resubmit,check} ...

Named Arguments

--db

Database name, default is test db

Default: “ecal_online_test”

--notify

Mattermost incoming webhook url for notifications

--campaign

Processing campaign(s). “all” for all campaigns in the db

--logurl

Base url for the logs

Default: “https://ecallogs.web.cern.ch/”

--wdir

Working directory

--eosdir

Base path of output location on EOS

subcommands

Select command to execute

subcommand: Possible choices: submit, resubmit, check

Sub-commands

submit

Process all runs marked as new in the automation db

conddb_upload.py submit [-h] [--t0 | --lfn] [--dest-tags DEST_TAGS]
                        [--oracle-db ORACLE_DB]

Named Arguments

--t0

Read input files from T0 storage

Default: False

--lfn

Use logical file names for input files

Default: False

--dest-tags

Comma separated list of tags to update

--oracle-db

URL to oracle db: prep or prod

Default: “oracle://cms_orcoff_prep/CMS_CONDITIONS”

resubmit

Check for failed jobs and resubmit them

conddb_upload.py resubmit [-h] [--lfn]

Named Arguments

--lfn

Use logical file names for input files

Default: False

check

Check ongoing runs and mark them as done/failed if completed

conddb_upload.py check [-h] [--max-retries MAX_RETRIES]
                       [--skipped-delay SKIPPED_DELAY]

Named Arguments

--max-retries

Max number of tries, for each single job. -1 = no limit

Default: -1

--skipped-delay

Number of days after which a task is considered as stalled and is marked as skipped.

Default: 7