Apache Spark - How Exception Handling works in map function

Question

I am trying url decoding on input data. Few records are decoded fine, but when i tried this on larger data it is giving error. I tried exception handling to discard error data, but getting same error again and again.

val decodedVal = convertedVal22.map(s => doWork(s))

def doWork(param : String) : String = 
{

   var x9 = ""
   try {
     var y = java.net.URLDecoder.decode(param, "UTF-8")
     x9 = y
    }

    return x9
}

Error:

URLDecoder: Illegal hex characters in escape (%) pattern - For input string: "%2"

It is compiling without catch block, i don't think catch is mandatory. — Prakash Khandelwal, Aug 22 '16 at 13:15
You [learn something very day](http://stackoverflow.com/questions/1547465/what-does-scalas-try-mean-without-either-a-catch-or-finally-block). You're not catching any exceptions if there's no `catch` block. — Yuval Itzchakov, Aug 22 '16 at 13:28
errrrrr you are right. one more thing i don't need anything if error occurs. So i used catch { return "" } , but is giving error 'error: value isDefinedAt is not a member of Nothing' — Prakash Khandelwal, Aug 22 '16 at 13:53

score 0 · Answer 1 · answered Aug 23 '16 at 05:54

Run Time exception is required to in catch block.

def doWork(param : String) : String = {
var x9 = ""
try {
    var y = java.net.URLDecoder.decode(param, "UTF-8")
    x9 = y
    return x9
}
catch {   

            case runtime: RuntimeException => 
            {
                ""
            }
}

and that filter it with nonEmpty.

 val decodedVal = convertedVal22.map(s => doWork(s)).filter(_.nonEmpty)

Apache Spark - How Exception Handling works in map function

1 Answers1