python - Read npy file directly from S3 StreamingBody -




i have many .npy (numpy) , .json files saved in s3, need download , load these files.

for json files downloading files , loading dictionary using following code:

obj = s3.object(bucket, key) response = obj.get() body = response['body'].read().decode('utf-8') data = json.loads(body) 

that way avoid writing .json file disk , reading it.

now want same .npy files, equivalent?

currently downloading file, saving temp file on disk , loading np.load avoid if possible.

following https://stackoverflow.com/a/28196540/3509999:

obj = s3.object(bucket, key) io.bytesio(obj.get()["body"].read()) f:     # rewind file     f.seek(0)     arr = np.load(f) 




wiki

Comments

Popular posts from this blog

Asterisk AGI Python Script to Dialplan does not work -

kotlin - Out-projected type in generic interface prohibits the use of metod with generic parameter -

python - Django Import by filename is not supported -