pandas: list comprehension for creating column in existing dataframe

Question

I have one column, and another is datetime which is in index position I done some coding on this. I try to use for loop for below condition but need optimization or list comprehension.

date_today = datetime.now()
days = pd.date_range(date_today, date_today + timedelta(254), freq='D')
dd = pd.DataFrame()
cc = sorted(np.random.randint(0,32,255))
dd['mean_base'] = cc
dd['time'] = days
dd.set_index('time',inplace=True)
rle = [(k, sum(1 for i in g)) for k,g in itertools.groupby(dd['mean_base'])]
# output Ex: rle = [(66,3),(35,12),(66,185),(35,190)]
count1 = 0 
for i in rle:
    if i[0] >= 65:
        if i[1] >= 185:
            count1 += 1
        else:
            pass
# Suggested by someone
count2 = sum([np.floor(i[1]/rolling_window) for i in rle if i[0]>=1])

# I didn't get this. (May be need changes)
print(count1)
#output: 1

screenshot

Is there any other way or how can I use list comprehension or code optimization?

measurement of count like if that condition satisfies then count shows 12 or 13 or etc.. — Sushil Kokil, Oct 20 '22 at 10:37
It is hard to understand this transformation unless you can show us sample input and expected output dataframes. — Azhar Khan, Oct 20 '22 at 11:42
@AzharKhan Input file is there.. Output doesn't have the dataframe.. It is just one int which stored in count .. Only I required the count. The question can I use list comprehension for this. — Sushil Kokil, Oct 20 '22 at 12:14
@Ynjxsjmh count2 is optional. Need to count count1. with using list comprehension. — Sushil Kokil, Oct 20 '22 at 12:23
@Ynjxsjmh it might be anything... I Changed the condition, so value is changes. but the value will be 0 or anything. but important thing is how can i reduce the for loop in single line. — Sushil Kokil, Oct 20 '22 at 12:30

score 0 · Answer 1 · answered Oct 20 '22 at 12:28

0

IIUC, you can try

count1 = sum([(i >= 2) and (j >= 32) for i, j in rle])
# or with pandas
count1 = len(pd.DataFrame(rle).loc[lambda df: df[0].ge(2) & df[1].ge(32), :])

answered Oct 20 '22 at 12:28

Ynjxsjmh

28,441
6
34
52

just I edited question. This may helpful.. – Sushil Kokil Oct 20 '22 at 12:45
@SushilKokil I provide two solutions here, does it help? Your nested if statement can be directly replaced by `(i[0] >= 65) and (i[1] >= 185)`. – Ynjxsjmh Oct 20 '22 at 12:49
Partially it works. Thank you. – Sushil Kokil Oct 20 '22 at 19:23

pandas: list comprehension for creating column in existing dataframe

1 Answers1