Read multiple csv files into separate pandas dataframes

Question

I've seen a few answers on reading multiple csv files into separate Pandas dataframes, and am still running into trouble. I've read my csv files and file names into a dictionary:

path = os.getcwd()
file_names = ['file1', 'thisisanotherfile', 'file3']

df_dict = {x: pd.read_csv('{}/{}.csv'.format(path, x)) for x in file_names}

Which seems to work: print(df_dict['file1'])

However what I'm looking for is a Pandas dataframe called 'file1' where I can access the data.

Is it possible to get this information from the dictionary? Do I have to call the dictionary in my code every time I want to access the data?

How to create a dict of dataframes from multiple csv files

Trenton McKinney
– Trenton McKinney

2023-11-14 18:44:31 +00:00
Commented Nov 14, 2023 at 18:44 — Trenton McKinney
– Trenton McKinney, Commented Nov 14, 2023 at 18:44

U13-Forward · Accepted Answer · 2019-07-15 05:03:26Z

1

It wouldn't be efficient to convert them to variables but if you have to, do:

locals().update(df_dict)

Inside a function do:

def f():
    ...
    globals().update(df_dict)

answered Jul 15, 2019 at 5:03

U13-Forward

71.8k15 gold badges100 silver badges125 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Johnson Over a year ago

Thanks! This is what I was looking for

PeptideWitch · Accepted Answer · 2019-07-15 05:09:28Z

1

frame = list(df_dict.values())

That should do the trick (as per this answer)!

Explanation: dictionary values returned with the df.values() call are what's called a 'view' - this is sort of like a shorthand response, but it's not actually the proper stored value. This is done for efficiency's sake so that the user can preview the value before accessing it. list(df.values()), then, actually converts the dictionary key's value into a usable form - in this case, your dataframes.

edited Jul 15, 2019 at 5:09

answered Jul 15, 2019 at 5:01

PeptideWitch

2,3591 gold badge19 silver badges31 bronze badges

Comments

Bishal Udash · Accepted Answer · 2019-07-15 05:33:28Z

0

Try this :

import pandas as pd
import os

# get folder path
folder_path = os.getcwd()
file_names = ['Siddhartha', 'employee_file2']

for file in file_names:
    final_df = file+"_df"
    print("Dataframe name : "+final_df)

    filename = file+".csv"
    final_df = pd.read_csv(filename)
    print(final_df.head())

answered Jul 15, 2019 at 5:33

Bishal Udash

1922 silver badges10 bronze badges

Collectives™ on Stack Overflow

Read multiple csv files into separate pandas dataframes

3 Answers 3

1 Comment

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

1 Comment

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related