Skip to content

Background Worker Schedule

All schedules run in US/Eastern timezone. Tasks use celery_once.QueueOnce to prevent concurrent execution.

High-Frequency (seconds)

Task Schedule Queue Description
proofer.dispatch_proofing_queue 7s fast Dispatch proofing queue workers
mailer.dispatch_mailing_queue 7s fast Dispatch mailing queue workers
cloudflare_image_cleaner.process_cloudflare_deletion_queue 10s fast Process Cloudflare image deletion from SQS
sync_orders.process_orders_app_store 10s slow Shopify App Store order sync
proofer.stage_proofs 15s fast Stage Pending recipients for proofing (batches of 50)
mailer.stage_mailers 15s fast Stage Proofed recipients for mailing (batches of 50)
mail_statuses.process_status_updates 15s fast Process mailpiece status webhooks from SQS

Medium-Frequency (minutes)

Task Schedule Queue Description
audits.process_audits 1 min fast Process organization audit requests from SQS
automator.process_manual_sync_triggers 1 min fast Process manual recipient sync triggers
automator.process_all_attributions 5 min slow Process unprocessed order attributions
sync_orders.process_orders 5 min slow Sync orders from Klaviyo/Ometria
organization_status_sync.sync_organization_statuses 10 min slow Transition churned orgs to disabled (180 days)
profile_enrichments.process_profile_enrichments 10 min slow Dispatch profile enrichment subtasks
reporting_sync.process_reporting_sync 7.5 min slow Dispatch reporting sync subtasks
automator.process_automated_recipient_sync_campaigns 15 min slow Sync recipients for automation campaigns
attribution_aggregates.process_order_aggregations 15 min fast Aggregate daily order metrics (refreshes today's bucket each tick)
recipient_aggregates.process_recipient_aggregations 15 min fast Aggregate daily recipient metrics

Low-Frequency (hours/daily)

Task Schedule Queue Description
automator.process_campaign_completions 1 hr slow Auto-complete campaigns with no remaining recipients
address_enrichment.collect_and_start_enrichment_batch 1am, 7am, 1pm, 7pm fast Batch upload to Faraday for address enrichment
address_enrichment.cleanup_expired_cache daily fast Delete enrichment cache entries older than 90 days
automator.process_bfcm_reports 1:30am slow Daily BFCM reports (seasonal, stops Dec 10)
automator.process_postage_downgrades 2:00am slow Downgrade first-class to standard after configured days
automator.process_csm_cadence_updates 3:00am slow Weekly → biweekly CSM reporting cadence
automator.process_weekly_reports 3:00am Fri slow Generate and send weekly reports
automator.process_scheduled_campaigns_switchoffs 3:30am slow Complete scheduled campaigns past mail date

Tasks by Domain

Same tasks, grouped by business area. Use this to find which tasks are relevant to your work.

Domain Tasks Details
Recipient Pipeline proofer.stage_proofs, proofer.dispatch_proofing_queue, mailer.stage_mailers, mailer.dispatch_mailing_queue, mail_statuses.process_status_updates Recipient Pipeline
Recipient Syncing automator.process_automated_recipient_sync_campaigns, automator.process_manual_sync_triggers Recipient Pipeline
Address Enrichment address_enrichment.collect_and_start_enrichment_batch, address_enrichment.cleanup_expired_cache Address Enrichment
Orders & Attribution sync_orders.process_orders, sync_orders.process_orders_app_store, automator.process_all_attributions Order Syncing
Reporting & Aggregation reporting_sync.process_reporting_sync, attribution_aggregates.process_order_aggregations, recipient_aggregates.process_recipient_aggregations, automator.process_weekly_reports, automator.process_bfcm_reports
Campaign Lifecycle automator.process_campaign_completions, automator.process_scheduled_campaigns_switchoffs, automator.process_postage_downgrades
Organization Management organization_status_sync.sync_organization_statuses, automator.process_csm_cadence_updates, audits.process_audits, profile_enrichments.process_profile_enrichments
Cleanup cloudflare_image_cleaner.process_cloudflare_deletion_queue

For Celery infrastructure details (queues, workers, broker, observability, troubleshooting), see Celery Infrastructure.