Unable to diagnose MISCONF redis issue while launching celery worker server -

-



i use celery worker server redis broker url (for receiving tasks) result backend.

broker_url = 'redis://localhost:6379/2' celery_result_backend = 'redis://localhost:6379/2' app = celery('myceleryapp', broker=broker_url,backend=celery_result_backend)

i launch celery worker server using celery -a myceleryapp worker -l info -c 8

the worker processes start processing tasks redis queue until @ point, receive infamous misconf redis error , celery worker process terminates.

unrecoverable error: responseerror('misconf redis configured save rdb snapshots, not able persist on disk. commands may modify data set disabled. please check redis logs details error.',)

i checked redis log files in /var/log/redis , tail end of file has following 

24745:c 19 aug 09:20:26.169 * rdb: 0 mb of memory used copy-on-write 1590:m 19 aug 09:20:26.247 * background saving terminated success 1590:m 19 aug 09:25:27.080 * 10 changes in 300 seconds. saving... 1590:m 19 aug 09:25:27.081 * background saving started pid 25397 25397:c 19 aug 09:25:27.082 # write error saving db on disk: no space left on device 1590:m 19 aug 09:25:27.181 # backgroun1590:m 19 aug 09:51:03.042 * 1 changes in 900 seconds. saving... 1590:m 19 aug 09:51:03.042 * background saving started pid 26341 26341:c 19 aug 09:51:03.405 * db saved on disk 26341:c 19 aug 09:51:03.405 * rdb: 22 mb of memory used copy-on-write 1590:m 19 aug 09:51:03.487 * background saving terminated success

the dump.rdb file being written /var/lib/redis/dump.rdb. since logs reported no space left on device, checked disk space /var mounted , there seems sufficient space left (1.2gb).

how root cause of error if there enough disk space? of course, prevent error happening, set config set stop-writes-on-bgsave-error no in redis-cli. want root cause of error. or pointers?

maybe caused swap file. because swap file took 1.2gb space of disk. redis complains no space write.

try "swapon -s" command check this.

i think 1.2gb not enough if disk accept ram page swap. should change dir of rdb in more big dir.





wiki

Comments

Post a Comment

Popular posts from this blog

Asterisk AGI Python Script to Dialplan does not work -

-
i'm stuck project have check database of sip extension incoming caller id , dial sip extension. below receive when run script on asterisk cli. -- registered sip '9125' @ 192.168.1.102:50142 > saved useragent "zoiper rv2.8.40" peer 9125 [2017-08-22 13:53:33] notice[5095]: chan_sip.c:24558 handle_response_peerpoke: peer '9125' reachable. (17ms / 2000ms) == using sip rtp tos bits 184 == using sip rtp cos mark 5 -- executing [0112617769@from-trunk:1] answer("sip/obitrunk1-0000000d", "") in new stack > 0x1ca50d0 -- probation passed - setting rtp source address 192.168.1.98:16834 -- executing [0112617769@from-trunk:2] agi("sip/obitrunk1-0000000d", "test.py") in new stack -- launched agi script /var/lib/asterisk/agi-bin/test.py args: ['/var/lib/asterisk/agi-bin/test.py'] env line: agi_request: test.py env line: agi_channel: sip/obitrunk1-0000000d env line: agi_language: en env line: a
Read more

python - Read npy file directly from S3 StreamingBody -

-
i have many .npy (numpy) , .json files saved in s3, need download , load these files. for json files downloading files , loading dictionary using following code: obj = s3.object(bucket, key) response = obj.get() body = response['body'].read().decode('utf-8') data = json.loads(body) that way avoid writing .json file disk , reading it. now want same .npy files, equivalent? currently downloading file, saving temp file on disk , loading np.load avoid if possible. following https://stackoverflow.com/a/28196540/3509999 : obj = s3.object(bucket, key) io.bytesio(obj.get()["body"].read()) f: # rewind file f.seek(0) arr = np.load(f) wiki
Read more

kotlin - Out-projected type in generic interface prohibits the use of metod with generic parameter -

-
i start using kotlin , defined interface this: interface aadapter<vh : recyclerview.viewholder> { fun oncreateaviewholder(parent: viewgroup): vh fun onbindaviewholder(v: vh, position: int) } and when try use on code: class klasa ( private val adapter: aadapter<*> ) { fun dosth(){ //... val vh = this.adapter.oncreateaviewholder(parent) //on below line error adapter.onbindaviewholder(v, position) //... } } i error out-projected type 'aadapter<*>' prohibits use of 'public abstract fun onbindaviewholder(v: t, position: int): unit i tied add "in" or "out" definition i'm confused. how allow it. replace aadapter<*> aadapter<recyclerview.viewholder> . class klasa ( private val adapter: aadapter<recyclerview.viewholder> ) { // ... because have declared aadapter has type parameter vh type subclass of recyclerview.
Read more