Remove NA/NaN/Inf in a matrix

Question

I want to try two things :

How do I remove rows that contain NA/NaN/Inf
How do I set value of data point from NA/NaN/Inf to 0.

So far, I have tried using the following for NA values, but been getting warnings.

> eg <- data[rowSums(is.na(data)) == 0,]

 Error in rowSums(is.na(data)) : 
       'x' must be an array of at least two dimensions
     In addition: Warning message:
     In is.na(data) : is.na() applied to non-(list or vector) of type 'closure'

The warning is because you haven't defined `data`, which is also a function in the `utils` package. I.e., you were calling `is.na` on a function, which doesn't make sense. — Joshua Ulrich, Apr 02 '13 at 20:08
Related post: https://stackoverflow.com/questions/7518245/one-function-to-detect-nan-na-inf-inf-etc — zx8754, Sep 20 '17 at 08:34

score 42 · Answer 1 · answered Apr 02 '13 at 20:17

42

I guess I'll throw my hat into the ring with my preferred methods:

# sample data
m <- matrix(c(1,2,NA,NaN,1,Inf,-1,1,9,3),5)
# remove all rows with non-finite values
m[!rowSums(!is.finite(m)),]
# replace all non-finite values with 0
m[!is.finite(m)] <- 0

answered Apr 02 '13 at 20:17

Joshua Ulrich

173,410
32
338
418

How would you remove columns with some NA? 'm[!colSums(!is.finite(m)),]' does not work – vog Mar 01 '23 at 16:21
1

@vog: you're subsetting `m` by rows. You need `m[, !colSums(!is.finite(m))]` for columns. – Joshua Ulrich Mar 01 '23 at 16:55

Matthew Lundberg · Answer 2 · 2013-04-02T20:13:37.740

13

library(functional)
m[apply(m, 1, Compose(is.finite, all)),]

Demonstration:

m <- matrix(c(1,2,3,NA,4,5), 3)
m
##      [,1] [,2]
## [1,]    1   NA
## [2,]    2    4
## [3,]    3    5

m[apply(m, 1, Compose(is.finite, all)),]
##      [,1] [,2]
## [1,]    2    4
## [2,]    3    5

Note: Compose(is.finite, all) is equivalent to function(x) all(is.finite(x))

To set the values to 0, use matrix indexing:

m[!is.finite(m)] <- 0
m
##      [,1] [,2]
## [1,]    1    0
## [2,]    2    4
## [3,]    3    5

edited Apr 02 '13 at 20:13

answered Apr 02 '13 at 20:00

Matthew Lundberg

42,009
6
90
112

Oh, sorry, missed the Inf. – Matthew Lundberg Apr 02 '13 at 20:05
But what about second part of my ques? Setting them all to zero and not remove them at all? – user2199881 Apr 02 '13 at 20:10
You use the fact that is.finite(m) returns a logical matrix. – Matthew Lundberg Apr 02 '13 at 20:15
1

Suggestion: use `m[apply(m, 1, Compose(is.finite, all)), , drop=FALSE]` to avoid losing dimensions. – Ferdinand.kraft Apr 02 '13 at 20:42

score 9 · Answer 3 · answered Oct 20 '14 at 15:02

9

NaRV.omit(x) is my preferred option for question 1. Mnemonic NaRV means "not a regular value".

require(IDPmisc)
m <- matrix(c(1,2,3,NA,5, NaN, 7, 8, 9, Inf, 11, 12, -Inf, 14, 15), 5)
> m
     [,1] [,2] [,3]
[1,]    1  NaN   11
[2,]    2    7   12
[3,]    3    8 -Inf
[4,]   NA    9   14
[5,]    5  Inf   15
> NaRV.omit(m)
     [,1] [,2] [,3]
[1,]    2    7   12
attr(,"na.action")
[1] 1 3 4 5
attr(,"class")
[1] "omit"

answered Oct 20 '14 at 15:02

BruceSpencer.Ca

191
2
5

great package! exactly what I need! – lxcfuji May 09 '18 at 16:31

Arun · Answer 4 · 2013-04-02T20:15:48.437

4

Just another way (for the first question):

m <- structure(c(1, 2, 3, NA, 4, 5, Inf, 5, 6, NaN, 7, 8), 
              .Dim = c(4L, 3L))
#      [,1] [,2] [,3]
# [1,]    1    4    6
# [2,]    2    5  NaN
# [3,]    3  Inf    7
# [4,]   NA    5    8

m[complete.cases(m * 0), , drop=FALSE]
#      [,1] [,2] [,3]
# [1,]    1    4    6

I can't think anything else other than Matthew's answer for the second part.

edited Apr 02 '13 at 20:15

answered Apr 02 '13 at 20:10

Arun

116,683
26
284
387

Remove NA/NaN/Inf in a matrix

4 Answers4

Linked

Related