I think Dávid Karnok is right in a sense that it is not particularly useful case for RxJava if your only goal is to convert a single map.
It might make more sense if you have Observable of (multiple) maps.
Then I would recommend to use a convenience of Guava transformers: https://google.github.io/guava/releases/snapshot/api/docs/com/google/common/collect/Maps.html#transformValues(java.util.Map,%20com.google.common.base.Function)
Map<String,String> source1 = ...
Map<String,String> source2 = ...
Observable.just(source1, source2)
.map(map->Maps.transformValues(map, v->Integer.parseInt(v)));
One nice thing about Guava's map value transformer is that it does not recreate map data structure, but instead creates a transformed view which maps values lazily (on the fly).
If you do not want to depend on Guava, you can just trivially implement Func1<Map<String,String>,Map<String,Integer>>
yourself.