The above answer it's ok using the isNaN() from JS, but
you can do the following if you define a helper method that can be used in the same kind of inputs, from other components. So, also using utilities from the framework:
// HELPER
function : validateNumber (component, auraId){
var value = component.find("auraId").get("v.value");
return $A.util.isNumber(value);
}
// CONTROLLER
function : saveButton (component){
if (!helper.validateNumber(component, 'customer_po')){
component.set("v.errorMessage", 'Not a numeric value');
} else {
component.set("v.errorMessage", '');
}
}