How to profile memory usage?

Question

I am aware of Valgrind, but it just detects memory management issues. What I am searching is a tool that gives me an overview, which parts of my program do consume how much memory. A graphical representation with e.g. a tree map (as KCachegrind does for Callgrind) would be cool.

I am working on a Linux machine, so windows tools will not help me very much.

score 52 · Accepted Answer · edited May 19 '17 at 00:06

52

Use massif, which is part of the Valgrind tools. massif-visualizer can help you graph the data or you can just use the ms_print command.

edited May 19 '17 at 00:06

Eponymous

6,143
4
43
43

answered Jan 14 '11 at 12:01

ismail

46,010
9
86
95

Thanks, the screenshots looking very great..., I think this is what I always wanted. – math Jan 14 '11 at 12:45
Building massif-visualizer on CentOS 7 is a bit of a pain, but it is worth it. [Instructions](https://stackoverflow.com/a/49340854/560648) – Lightness Races in Orbit Mar 17 '18 at 20:54
1

As far as I understand, I think this answer should be noted as well (if the application is statically linked the "Valgrind" family tools won't work): https://stackoverflow.com/a/13591746/1971003 – Guy Avraham Jul 15 '18 at 06:38
1

Also available as dpkg: sudo apt install massif-visualizer – lahjaton_j Aug 31 '18 at 10:19
This doesn't seem to be supported for MPI programs. Is that correct? – pretzlstyle Apr 26 '19 at 18:51

score 16 · Answer 2 · edited Aug 07 '19 at 07:04

Try out the heap profiler delivered with gperftools, by Google. I've always built it from sources, but it's available as a precompiled package under several Linux distros.

It's as simple to use as linking a dynamic library to your executables and running the program. It collects information about every dynamic memory allocation (as far as I've seen) and save to disk a memory dump every time one of the following happens:

HEAP_PROFILE_ALLOCATION_INTERVAL bytes have been allocated by the program (default: 1Gb)
the high-water memory usage mark increases by HEAP_PROFILE_INUSE_INTERVAL bytes (default: 100Mb)
HEAP_PROFILE_TIME_INTERVAL seconds have elapsed (default: inactive)
You explicitly call HeapProfilerDump() from your code

The last one, in my experience, is the most useful because you can control exactly when to have a snapshot of the heap usage and then compare two different snapshots and see what's wrong.

Eventually, there are several possible output formats, like textual or graphical (in the form of a directed graph):

Using this tool I've been able to spot incorrect memory usages that I couldn't find using Massif.

score 8 · Answer 3 · answered Jan 21 '19 at 10:19

A "newer" option is HeapTrack. Contrary to massif, it is an instrumented version of malloc/free that stores all the calls and dumps a log.

The GUI is nice (but requires Qt5 IIRC) and the results timings (because you may want to track time as well) are less biased than valgrind (as they are not emulated).

score -2 · Answer 4 · answered Jan 24 '19 at 14:13

-2

Use callgrind option with valgrind

answered Jan 24 '19 at 14:13

Rohit

142
8

2

Hello, callgrind is nice tool, but it should be used for other purposes. Probably you are meaning massif (https://www.valgrind.org/docs/manual/ms-manual.html)? – Vasiliy Soshnikov Feb 28 '21 at 19:33

How to profile memory usage?

4 Answers4

Linked

Related