python celery 中 redis集群sentinel 使用《实践踩坑》

电玩女神 2023-07-20 05:56 2阅读 0赞

[https://github.com/leffss/ScrapyRedisBloomFilterBlockCluster][https_github.com_leffss_ScrapyRedisBloomFilterBlockCluster]

[https://pypi.org/project/scrapy-redis-sentinel/][https_pypi.org_project_scrapy-redis-sentinel]   scrapy  使用redis 哨兵

import redis  
from redis.sentinel import Sentinel  
  
python 中使用  redis哨兵  
class RedisClient(object):  
    '''初始化Redis数据库'''  
    def \_\_init\_\_(self,TYPE, host=REDIS\_HOST, port=REDIS\_PORT, password=REDIS\_PASSWORD,db=0):  
       \# self.db = redis.StrictRedis(host=host, port=port, password=password, decode\_responses=True, db=db)  
        self.db = Sentinel(\[('172.20.0.252', 26079), ('172.20.0.252', 26080),('172.20.0.252', 26081)\], socket\_timeout=0.5)  
        if TYPE=='write':  
            self.db = self.db.master\_for('local-master', socket\_timeout=0.5,password='redis' ,db=db)  
        if TYPE=='read':  
            self.db = self.db.slave\_for('local-master', socket\_timeout=0.5, password='redis',db=db)

celery 中使用  redis哨兵

\# \_\*\_ coding:utf-8 \_\*\_  
\_  
import redis  
from redis.sentinel import Sentinel

from celery import Celery

\# celery\_app = Celery("ApiInterface", broker='redis://root:123@172.20.0.252:6079/9')   \#单机版  
\# CELERYD\_OPTS = "--time-limit=7200 -E --loglevel=DEBUG"  
celery\_app=Celery("app")     \#集群哨兵版  
celery\_app.conf.broker\_url = 'sentinel://root:redis@localhost:26079;sentinel://root:redis@localhost:26080;sentinel://root:redis@localhost:26081'

celery\_app.conf.broker\_transport\_options = \{ 'master\_name': "local-master" \}

[https_github.com_leffss_ScrapyRedisBloomFilterBlockCluster]: https://github.com/leffss/ScrapyRedisBloomFilterBlockCluster
[https_pypi.org_project_scrapy-redis-sentinel]: https://pypi.org/project/scrapy-redis-sentinel/