python - ZeroMQ pattern for Worker processes? -

-



i'm learning 0mq , having difficulty understanding pattern use use case.

i want create server multiple clients connect. server going hand out work items, each work item have go specific client. example, if server picking cards deck, want hearts go 1 worker, diamonds second worker, etc. (the work items events sessions, , need every event single session go same worker.)

what pattern use this, , have code shows (in python):

context = zqm.context() socket = context.socket(which type?) socket.bind("tcp://*:5555")  #wait 4 clients connect (how?)  while true:     card = getnextcard()     if card.suit == hearts:         send card worker #1 (how?)     if card.suit == diamonds:         send card workder #2     etc...

basically, how track clients have connected server, , send work items 1 of n clients connected?

welcome world of distributed-computing:

clients may introduce themselves, once starting connected server, assume server have 

sub_to_ask4connect = context.socket( zmq.sub ) sub_to_ask4connect.bind(                "tcp://a.b.c.d:p" ) sub_to_ask4connect.setsockopt(       zmq.linger, 0 ) sub_to_ask4connect.setsockopt(       zmq.subscribe, "" ) #------------------------------------------------------ ready .recv() *

next, establish client-accept-into-workerpoolpolicy():

so handle right newcomer, has introduced via above setup sub_to_ask4connect socket-interface.

clients ought know protocol of -
a) .connect() proper address
b) .send() proper self-introduction
c) ready .connect() / .bind() additional socket interfaces, per server's instructions so
d) have .bind()-ready ( or .connect()-to known server-side reverse-pub, if security requirements permit ) interface receive further details , handshaking signalisation, during workerpool-assignment/coordination/release policies, work-package specific , server-side controlled.

simply said, not expect single archetype match requirements such distributed control of ad-hoc work-package routing having dynamic ad-hoc client-association/release in-place.

such distributed-pool(s) system control-plane more important , cardinal such dynamic eco-system, simpler work-package logistics plane ( simpler handshaking takes place ).

anyway, enjoy new universe -- distributed entities appear / disappear , ( may ) cooperate in new way, not common monolythic architectures , architects.

feel free browse other zeromq questions , answers find more inspirative insights.





wiki

Comments

Post a Comment

Popular posts from this blog

Asterisk AGI Python Script to Dialplan does not work -

-
i'm stuck project have check database of sip extension incoming caller id , dial sip extension. below receive when run script on asterisk cli. -- registered sip '9125' @ 192.168.1.102:50142 > saved useragent "zoiper rv2.8.40" peer 9125 [2017-08-22 13:53:33] notice[5095]: chan_sip.c:24558 handle_response_peerpoke: peer '9125' reachable. (17ms / 2000ms) == using sip rtp tos bits 184 == using sip rtp cos mark 5 -- executing [0112617769@from-trunk:1] answer("sip/obitrunk1-0000000d", "") in new stack > 0x1ca50d0 -- probation passed - setting rtp source address 192.168.1.98:16834 -- executing [0112617769@from-trunk:2] agi("sip/obitrunk1-0000000d", "test.py") in new stack -- launched agi script /var/lib/asterisk/agi-bin/test.py args: ['/var/lib/asterisk/agi-bin/test.py'] env line: agi_request: test.py env line: agi_channel: sip/obitrunk1-0000000d env line: agi_language: en env line: a
Read more

python - Read npy file directly from S3 StreamingBody -

-
i have many .npy (numpy) , .json files saved in s3, need download , load these files. for json files downloading files , loading dictionary using following code: obj = s3.object(bucket, key) response = obj.get() body = response['body'].read().decode('utf-8') data = json.loads(body) that way avoid writing .json file disk , reading it. now want same .npy files, equivalent? currently downloading file, saving temp file on disk , loading np.load avoid if possible. following https://stackoverflow.com/a/28196540/3509999 : obj = s3.object(bucket, key) io.bytesio(obj.get()["body"].read()) f: # rewind file f.seek(0) arr = np.load(f) wiki
Read more

kotlin - Out-projected type in generic interface prohibits the use of metod with generic parameter -

-
i start using kotlin , defined interface this: interface aadapter<vh : recyclerview.viewholder> { fun oncreateaviewholder(parent: viewgroup): vh fun onbindaviewholder(v: vh, position: int) } and when try use on code: class klasa ( private val adapter: aadapter<*> ) { fun dosth(){ //... val vh = this.adapter.oncreateaviewholder(parent) //on below line error adapter.onbindaviewholder(v, position) //... } } i error out-projected type 'aadapter<*>' prohibits use of 'public abstract fun onbindaviewholder(v: t, position: int): unit i tied add "in" or "out" definition i'm confused. how allow it. replace aadapter<*> aadapter<recyclerview.viewholder> . class klasa ( private val adapter: aadapter<recyclerview.viewholder> ) { // ... because have declared aadapter has type parameter vh type subclass of recyclerview.
Read more