Masking nested array with value at index with a second array

Question

I have a nested array with some values. I have another array, where the length of both arrays are equal. I'd like to get an output, where I have a nested array of 1's and 0's, such that it is 1 where the value in the second array was equal to the value in that nested array.

I've taken a look on existing stack overflow questions but have been unable to construct an answer.

masks_list = []
for i in range(len(y_pred)):
    mask = (y_pred[i] == y_test.values[i]) * 1
    masks_list.append(mask)
masks = np.array(masks_list);

Essentially, that's the code I currently have and it works, but I think that it's probably not the most effecient way of doing it.

YPRED:
[[4 0 1 2 3 5 6]
 [0 1 2 3 5 6 4]]

YTEST:
8    1
5    4

Masks:
[[0 0 1 0 0 0 0]
 [0 0 0 0 0 0 1]]

Could you give some test array and inner test array? If it's work it gonna be a good solution. I think you can done it also with map. — ElConrado, Apr 03 '19 at 06:23
So by 'nested array' you mean a 2d array (in your example shape (2,7)). — hpaulj, Apr 03 '19 at 16:28

ElConrado · Accepted Answer · 2019-04-03T12:28:59.380

1

Another good solution with less line of code.

a = set(y_pred).intersection(y_test)
f = [1 if i in a else 0 for i, j in enumerate(y_pred)]

After that you can check performance like in this answer as follow:

import time
from time import perf_counter as pc

t0=pc()    
a = set(y_pred).intersection(y_test)
f = [1 if i in a else 0 for i, j in enumerate(y_pred)]
t1 = pc() - t0

t0=pc()
for i in range(len(y_pred)):
    mask = (y_pred[i] == y_test[i]) * 1
    masks_list.append(mask)
t2 = pc() - t0

val = t1 - t2

Generally it means if value is positive than the first solution are slower. If you have np.array instead of list you can try do as described in this answer:

type(y_pred)
>> numpy.ndarray
y_pred = y_pred.tolist()
type(y_pred)
>> list

edited Apr 03 '19 at 12:28

answered Apr 03 '19 at 06:33

ElConrado

1,477
4
20
46

np.array is unhashable. – winnie Apr 03 '19 at 07:51
Is this comment according to my answer or to @Jaja ? – ElConrado Apr 03 '19 at 08:13
Your comment, at this line: `a = set(y_pred).intersection(y_test)` – winnie Apr 03 '19 at 11:19
I understand that you have got np.array instead of list. Could you try https://stackoverflow.com/a/1966210/4510954 – ElConrado Apr 03 '19 at 12:25

Jaja · Answer 2 · 2019-04-03T07:31:23.913

0

Idea(least loop): compare array and nested array:

masks = np.equal(y_pred, y_test.values)

you can look at this too:

np.array_equal(A,B)  # test if same shape, same elements values
np.array_equiv(A,B)  # test if broadcastable shape, same elements values
np.allclose(A,B,...) # test if same shape, elements have close enough values

edited Apr 03 '19 at 07:31

answered Apr 03 '19 at 07:26

Jaja

662
7
15

Masking nested array with value at index with a second array

2 Answers2