Call external script

Question

I have a long list of pandas transformation commands that I need to run against a pandas DataFrame:

pd['newvar_A'] = pd['somevar'] * pd['somevar']
pd['newvar_C'] = pd['somevar'] * pd['somevar']
pd['newvar_D'] = pd['somevar'] * pd['somevar']
pd['newvar_ETC'] = pd['somevar'] * pd['somevar']

It's a long list (about 150 lines). Is it possible to include this as a separate script called transformations.py in an already existing script? The idea is to keep the main script simple, so my idea is the script to look like this:

import pandas as pd
pd.read_csv ('data.csv')
...
#Run transformations
insert file = "transformations.py"
...
#rest of the main script

Is there a Python command to call another Python script (assuming this script is located in the same folder as the working directory)?

Thanks!

Answer 1

You can try to "import" the script as it's the best way as per this post

A small example

sample.csv

name,age
sharon,12
shalom,10

The script which I am going to import
nameChange.py

import pandas as pd

# transform the csv file
data = pd.read_csv('sample.csv')
data.iloc[0,0] = 'justin'
data.to_csv('sample.csv',index = False)

The main code
stackoverflow.py

import pandas as pd

# before transform
data = pd.read_csv('sample.csv')
print(data)

# call the script
import nameChange

# do the work after the script runs
transformed_data = pd.read_csv('sample.csv')
print(transformed_data)

Output

  name  age
0 sharon 12
1 shalom 10
  name  age
0 justin 12
1 shalom 10

To run the above code without modifying the original csv

The script which I am going to import
nameChange.py

import pandas as pd
import pickle

# transform the csv file variable which was saved by stackoverflow.py
data = pickle.load(open('data.sav','rb'))
data.iloc[0,0] = 'justin'
# saving the df
pickle.dump(data,open('data.sav','wb'))

The main code
stackoverflow.py

import pandas as pd
import pickle

# before transform
data = pd.read_csv('sample.csv')
print(data)
pickle.dump(data,open('data.sav','wb'))

# call the script
import nameChange
transformed_data = pickle.load(open('data.sav','rb'))

# do the work after the script runs
print(transformed_data)