Stack Overflow
Stack Overflow

Questions tagged [heapy]

7 questions
8
votes
1 answer

Using Heapy's Memory Profile Browser with Twisted.web

I am trying to profile twisted python code with Heapy. For example (pseudo code): from twisted.web import resource, server from twisted.internet import reactor from guppy import hpy class RootResource(resource.Resource): render_GET(self, path,…
roder
  • 566
  • 6
  • 13
7
votes
2 answers

Measuring increase in heap size after loading large object

I'm interested to find out the increase in the total size of python's heap when a large object is loaded. heapy seems to be what I need, but I don't understand the results. I have a 350 MB pickle file with a pandas DataFrame in it, which contains…
rodion
  • 6,087
  • 4
  • 24
  • 29
5
votes
1 answer

Guppy/Heapy on Windows with Python 2.7.6

I just intalled guppy 0.1.10. Then typing in Ipython 2.1.0 from guppy import hpy hp = hpy() makes the console crash, i.e. windows tells me, that python.exe just crashed. Is there any workaround? Or a heapy alternative?
HeinzKurt
  • 612
  • 9
  • 18
3
votes
1 answer

Size of objects in memory during an IPython session (with Guppy?)

I recall reading that it is hard to pin down the exact memory usage of objects in Python. However, that thread is from 2009, and since then I have read about various memory profilers in Python (see the examples in this thread). Also, IPython has…
Amelio Vazquez-Reina
  • 91,494
  • 132
  • 359
  • 564
2
votes
1 answer

Python heapy shows constant memory usage, though 60GB of ram is exhausted in 10min

I'm running a tensorflow model which is exhausting 60G of RAM in about 10 minutes while processing large images. I've run Heapy to try to pin down a leak, but heapy shows only 90M of memory usage and remains constant. I noted this article: Python…
David Parks
  • 30,789
  • 47
  • 185
  • 328
2
votes
1 answer

Expand truncated object view in python heapy / guppy

I have a memory leak in my django app and used heapy to debug the memory stack. I believe I finally came to the cause of the problem. Now I need a way to expand that truncated representation of the string, so I can identify the source. Is there a…
Jabb
  • 3,414
  • 8
  • 35
  • 58
0
votes
0 answers

python: How to determine which file a dict is from?

I'm trying to debug a memory leak. It's a script that runs as a daemon, and has dependencies in about 10K lines of code in 30 different files. After a while you see the memory usage start creeping up. I used heapy to determine that that it's a…
prajo
  • 737
  • 2
  • 8
  • 17