Stream stdout to s3

Question

I have a stream (suppose it's stdout from a generating process) which I would like to send to s3 using boto.

Could I have a code example, please?

Answer 1

I think the answer is that you cannot easily stream data into s3 unless you know the size of the data you are streaming because s3 requires the size of the object to be known beforehand. You can definitely stream data out of s3 but to get data in, you'll need to buffer in memory or disk unless you are lucky enough to know the size.