How to log all the request-responses in spring rest?

Question

The application should log the following information without impacting a client, asynchronously(in a separate thread).

Request HTTP Method and URI
Request Headers (Except the default)
Client's IP Address
Request Processing Time(In milliseconds)
Request Body
Response Body

If we consume inputstream in the filter, then it cant be consumed again by spring for json to object mapping. Somewhere during the input stream to object mapping, can we plug our logger?

Update:

We can write over logging code in a MessageConverter, but it doesnt seems to be a good idea.

public class MyMappingJackson2MessageConverter extends AbstractHttpMessageConverter<Object> {
    ...
    protected Object readInternal(Class<? extends Object> clazz, HttpInputMessage inputMessage)
            throws IOException, HttpMessageNotReadableException {
        InputStream inputStream = inputMessage.getBody();
        String requestBody = IOUtils.toString(inputStream, StandardCharsets.UTF_8);
        String method = request.getMethod();
        String uri = request.getRequestURI();
        LOGGER.debug("{} {}", method, uri);
        LOGGER.debug("{}", requestBody);
        return objectMapper.readValue(requestBody, clazz);
    }

    protected void writeInternal(Object o, HttpOutputMessage outputMessage)
            throws IOException, HttpMessageNotWritableException {
        String responseBody = objectMapper.writeValueAsString(o);
        LOGGER.debug("{}", responseBody);
        outputMessage.getBody().write(responseBody.getBytes(StandardCharsets.UTF_8));
    }
}

Nilesh · Answer 1 · 2018-06-19T07:06:46.957

An answer from baeldung.com :

Spring provides a built-in solution to log payloads. We can use ready-made filters by plugging into Spring application using configuration. AbstractRequestLoggingFilter is a filter which provides basic functions of logging. Subclasses should override the beforeRequest() and afterRequest() methods to perform the actual logging around the request. Spring framework provides following concrete implementation classes which can be used to log the incoming request. These are:

CommonsRequestLoggingFilter

ServletContextRequestLoggingFilter

Spring Boot application can be configured by adding a bean definition to enable request logging:
@Configuration
public class RequestLoggingFilterConfig {

    @Bean
    public CommonsRequestLoggingFilter logFilter() {
        CommonsRequestLoggingFilter filter
          = new CommonsRequestLoggingFilter();
        filter.setIncludeQueryString(true);
        filter.setIncludePayload(true);
        filter.setMaxPayloadLength(10000);
        filter.setIncludeHeaders(false);
        filter.setAfterMessagePrefix("REQUEST DATA : ");
        return filter;
    }
}
Also, this logging filter requires the log level be set to DEBUG. In application.properties put
logging.level.org.springframework.web.filter.CommonsRequestLoggingFilter=DEBUG

To make the logging asynchronous, we may use asynchronous appenders. Unfortunately it does not support logging response payloads. :(

This is perfect fit to log request. But how about if we want to log response status code (200, 404, 500...)? — The Tran, May 10 '19 at 06:04
Yeah, this is only useful for logging requests. What about logging response payloads or response headers or response statuscodes etc? Did Spring forget to implement that? Should we implement that on our own is there a Spring class to do this? — theprogrammer, Nov 13 '19 at 16:00
this answer does not provide response logging, which is questioned.. not an actual answer.. — aswzen, Nov 20 '19 at 07:55
Voting down. Incomplete answer. Doesn't mention how to log responses. — Mudassir Shahzad, Aug 17 '20 at 11:56
Extend ```CommonsRequestLoggingFilter```, and override ```doFilterInternal``` with ```super.doFilterInternal(...)``` will give access to response. Just log after super call. — Rurien, Jun 14 '23 at 05:53

Juan Urrego · Answer 2 · 2018-01-26T21:22:40.670

I would use 2 elements: A LoggingFilter and the Async support from Spring. For the first one, I would use a CommonsRequestLoggingFilter that already knows how to intercept the HTTP requests, create the configuration for that and the Async. You can do something like:

First Enable Async Support

@Configuration
@EnableAsync
public class SpringAsyncConfig { ... }

Then Create the loggingFilter:

public class LoggingFilter extends CommonsRequestLoggingFilter {

@Override
protected void beforeRequest(final HttpServletRequest request, final String message) {
    // DO something
    myAsyncMethodRequest(request, message)
}

@Override
protected void afterRequest(final HttpServletRequest request, final String message) {
    // Do something
   myAsyncMethodResponse(request, message)
}

// -----------------------------------------
// Async Methods
// -----------------------------------------

   @Async
   protected void myAsyncMethodRequest(HttpServletRequest request, String message) {

    // Do your thing
    // You can use message that has a raw message from the properties
   // defined in the logFilter() method. 
   // Also you can extract it from the HttpServletRequest using: 
   // IOUtils.toString(request.getReader());

   }

   @Async
   protected void myAsyncMethodResponse(HttpServletRequest request, String message) {

    // Do your thing
   }

}

Then create a custom logging configuration for the filter that you created:

@Configuration
public class LoggingConfiguration {

    @Bean
    public LoggingConfiguration logFilter() {
        LoggingFilter filter
                = new LoggingFilter();
        filter.setIncludeQueryString(true);
        filter.setIncludePayload(true);
        filter.setIncludeHeaders(true);

        return filter;
    }
}

To extract the data from the request you can use the message parameter or process the HttpServletRequest. Take as an example:

Well you just need to read the HttpServletRequest or also you can use `message` that it has the fields that you define in the annotated method with @Bean — Juan Urrego, Jan 18 '18 at 07:30
Try something like this if you want to extract from the servlet and not from the message: `IOUtils.toString(request.getReader());`. Don't forget to catch or throw the Exception. After that you can process the message as you want. Also if you know that the content is JSON you can use Jackson or GSON to process it — Juan Urrego, Jan 18 '18 at 07:33
I think this is the right way to define our logging filter class: `public class LoggingFilter extends AbstractRequestLoggingFilter`. — NanoNova, Apr 26 '22 at 07:57

score -1 · Answer 3 · answered Jan 17 '18 at 14:36

I guess your best option is to do the logging in an Async Method.

@Async
public void asyncMethodWithVoidReturnType() {
  System.out.println("Execute method asynchronously. "
    + Thread.currentThread().getName());
}

Please refer to:

Async

How to Async

How to log all the request-responses in spring rest?

3 Answers3

Linked