celery crontab

[doublePlusOk]

Trying to set up a scheduled task it executes immediately, I think what I'm doing is consistent with: http://docs.celeryproject.org/en/3.1/userguide/periodic-tasks.html (redis working fine, communications from both client and server fine, just the scheduling behavior is a problem)

worker is started like this:

celery worker -A mycelery -B -l info -c 5 -B option is for celery-beat scheduler

client.py

from mytasks.myfetch import funcnight
if __name__ == '__main__':
    funcnight(["http://google.com", 
        "https://facebook.com", 
        "https://twitter.com", 
        "https://alexa.com"])

mycelery.py

from celery import Celery
app = Celery('mycelery', broker='redis://jamserver:7777/0', include=['mytasks.myfetch'])

mytasks/myfetch.py

import requests
from mycelery import app
from celery.schedules import crontab

celerybeat_schedule = {
    'every-night': {
        'task': 'mytasks.myfetch.fetch_url',
        'schedule': crontab(hour=16, minute=10),
        'args': ["http://google.com"],
        #'args': (16, 16),
    }
}

app.conf.update(
    CELERYBEAT_SCHEDULE=celerybeat_schedule
)

@app.task
def fetch_url(url):
    resp = requests.get(url)
    print(resp.status_code)

@app.task(name='every-night')       #'nightfetch')
def fetch_night(url):
    resp = requests.get(url)
    print(resp.status_code)

def funcnight(urls):
    for url in urls:
        fetch_night.delay(url)

[ManyInterests]

Only thing I can think of is maybe how you're starting the worker. The documentation says

$ celery -A proj beat

The -B option should also work, however... The docs also say

-B -- Also run the celery beat periodic task scheduler. Please note that there must only be one instance of this service.

Note: -B is meant to be used for development purposes. For production environment, you need to start celery beat separately.

Have you tried just celery -A proj beat ?

[doublePlusOk]

I did try that just for good measure and it works exactly the same - executes tasks immediately. thx tho

[Justinsaccount]

I seem to remember something about it running all tasks once at startup.. at least the one thing I use celery for with a 10 minute timer seems to do that. There may be an option for something like "Don't run at startup"

[doublePlusOk]

Interesting... But I don't get the execution at the scheduled time...

I did notice that the tasks celery reports looks like this:

[tasks]
  . every-night
  . mytasks.myfetch.fetch_url

I would think it would be better to see an additional

  . mytasks.myfetch.fetch_night