How to combine (merge) an array of identical DataFrames into a single one?

Question

How do I merge or combine an array of DataFrames in pandas?

dfs = []
for df in pd.read_csv(....chunksize=chunk_size):
  df1 = df
  # ....
  if condition:
    dfs.append(df1)

As you can see, they all have the same structure, I just need to combine them in a single DataFrame.

Answer 1

normally you can concatenate your array of data frame so you could have

import pandas as pd

dfs = []
for df in pd.read_csv(....chunksize=chunk_size):
  df1 = df
  # ....
  if condition:
    dfs.append(df1)
result = pd.concat(dfs)

you can find more info on this , here.