Configuration¶
Like any Celery application, GWCelery’s configuration options are stored at run
time in a global configuration object, gwcelery.app.conf
. There are
options for Celery itself such as options that affect the task and result
backends; these options are documented in the Configuration and defaults
section of the Celery manual.
The configuration object also holds all of the options that are specific to
GWCelery and affect the behavior of individual GWCelery tasks; examples include
the GraceDB service URLs, IGWN Alert groups, GCN hostnames, and frame file types and
channel names. For a list of all GWCelery-specific options, see the
API documentation for the gwcelery.conf
module.
GWCelery provides four preset configurations, one for each GraceDB server
instance (production, deployment, testing, or playground). The default
configuration preset is for the playground server,
gracedb-playground.ligo.org
. The recommended way to select a different
preset is to set the CELERY_CONFIG_MODULE
environment variable before starting the
workers. For example, to configure GWCelery for production:
$ export CELERY_CONFIG_MODULE=gwcelery.conf.production
Authentication¶
There are a few files that must be present in order to provide authentication tokens for GraceDB and IGWN Alert.
GraceDB
You must provide valid LSC DataGrid credentials in order for requests to the
GraceDB REST API to work. During development and testing, you can use your
personal credentials obtained from the LSC DataGrid Client by running
ligo-proxy-init
. However, credentials obtained this way expire after a few
days or whenever your machine’s temporary directory is wiped (e.g., at system
restart).
For production deployment, you should obtain a robot certificate and store
it in a location such as ~/.globus/userkey.pem
and
~/.globus/usercert.pem
.
IGWN Alert
You must provide a valid username and password for IGWN Alert. You can request an account using the SCiMMA Auth portal. To get started, see IGWN Alert Userguide. The IGWN Alert username and password should be stored in your netrc file.
Redis¶
We recommend that you make the following settings in your Redis server
configuration file (which is located at /etc/redis.conf
on most
systems):
# Some GWCelery tasks transfer large payloads through Redis.
# The default Redis client bandwidth limits are too small.
client-output-buffer-limit normal 0 0 0
client-output-buffer-limit slave 256mb 64mb 60
client-output-buffer-limit pubsub 256mb 64mb 60
# If worker nodes are only reachable on a specific network interface,
# then make sure to bind any additional IP addresses here.
bind 127.0.0.1 10.0.0.1 # replace 10.0.0.1 with address on cluster network
# Disable RDB snapshots.
save ""
# Enable appendonly snapshots.
appendonly yes
If you have to make any changes to your Redis configuration, be sure to restart the Redis daemon.