Best way to store 1000s of small images (<5k) either in MongoDb or S3?

Question

I'm planning on storing 1000s (hopefully even millions some day) of profile images from facebook and twitter. Their usual size is less than 5k.

What is the best way to do this either in MongoDB or on Amazon S3 and avoid disk fragmentation or similar issues?

Any pointers/tips on the do's and don'ts would be very helpful as well.

Answer 1

Yeah, publish profile images from the associated Social site (Facebook, Twitter, etc), but if you have to store uploaded images onto S3, rather than reading the file (from S3) and re-stream it to your user, you can enable the "Website" feature and have your images linked to S3 directly.

So your html image tag will be like:

<img src="http://<amazon s3 - website - endpoint>/<image filename>" title="something">