Micah Kornfield questions

Micah Kornfield answers

• Can Parquet be used to store images? Are there any benefits?
• Is there a size limitation/problem when writing the apache arrow format with the java API
• How does apache arrow facilitate "No overhead for cross-system communication"?
• Why Parquet over some RDBMS like Postgres
• PyArrow: Incrementally using ParquetWriter without keeping entire dataset in memory (large than memory parquet files)
• How reproducible / deterministic is Parquet format?