Example using Celery for plugin queue

[ipmb]

Moving to a real queue will help us ensure we don't drop messages during restarts and can retry in the event of transient failures.

The bot would need to modify the message it puts in Redis to match what Celery expects. In Python, it would look like this:

import base64
import json
import uuid
import redis

r = redis.StrictRedis()

# this is the message it currently sends
arg = "{\"ChatBotId\":69,\"Raw\":\":[email protected] PRIVMSG #channel hello\",\"Received\":\"2015-06-25T04:01:51.964567066Z\",\"User\":\"user\",\"Host\":\"[email protected]\",\"Command\":\"PRIVMSG\",\"Args\":[\"#channel\"],\"Content\":\"hello\",\"IsCTCP\":false,\"Channel\":\"#channel\",\"BotNick\":\"[b__b]\"}\n"

msg = {
    'id': str(uuid.uuid4()),
    'task': 'botbot.apps.plugins.tasks.route_line',
    'args': [arg],
}

payload = {
    'body': base64.b64encode(json.dumps(msg)),
    'headers': {},
    'content-type': 'application/json',
    'content-encoding': 'utf-8', 
    'properties': {
        'body_encoding': 'base64',
        'correlation_id': msg['id'],
        'delivery_info': {
            'exchange': 'celery',
            'priority': 0,
            'routing_key': 'celery'
        },
        'delivery_mode': 2,
        'delivery_tag': str(uuid.uuid4()),
        'reply_to': str(uuid.uuid4()),
    }
}
r.lpush('celery', json.dumps(payload))