When I change the default font that matplotlib uses via
import matplotlib.pyplot as plt
plt.rc('text', usetex=True)
plt.rc('text.latex', preamble=r'\usepackage{lmodern}')
the filesize of the generated pdf is about twice as large compared to not using the lmodern
package (from ~230kb to ~500kb). Any idea why that is, and how to reduce the filesize?