Python List - "reserving" space ( ~ resizing)

Question

I am given a list l and I want to do assignment:

l[index] = val

But there might be a case when the list is too small.

So, I want to ensure I have space for the new value. Sometimes I need to fill the new space with empty strings '', and sometimes with other objects (like empty lists [], False or None).

For this task I use the following procedure:

def ResizeList(l, size, fill_with=None):
    l += [fill_with]*(size-len(l))

(note: it works even if size-len(l)<=0) (note: as I am interested in reserving space, I intentionally DO NOT truncate it to a shorter list)

Like that:

ResizeList(l, index+1)
l[index] = val

(When filling with other object, it's like : ResizeList(l, index+1, []) )

Are there more pythonic ways of doing that? Are there some built-ins or library functions for doing this?

I am using mostly Python-3.x, but know-how about Python-2x is useful and welcome.

Clarification: Please, do not tell me about dict , cause I need list

For those who would like me to be more specific:

The problem statement states it's about list type. Using dict here is not an option or solution. There are reasons for that, specifically related to the domain (I am doing a prototype of an experiment that has to show some asymptotic behaviour, not - as probably you're used to - a prototype of a program. If it would be "just a prototype of a program", then I agree with using a dict and the other comments). I have the following assumptions:

• I have many many lists (need to care about memory and performance overhead)
• due to workflow and need of prototype, I cannot call a handcoded C/C++ extension
• during computation the final list size is unknown
• we know that in the and the lists will be dense
• list cells are written and overwritten in an unknown order

Those are just a few reasons why I have stressed that I need a list and not a dict. For those interested in more details or who would like to discuss about dict, checkout how we discuss in comments HERE

Answer 1

If you're sure that a list -- and not, say, a dict -- is the best data structure for your use case, I propose the following class:

class rlist(list):
  def __init__(self, default):
    self._default = default
  def __setitem__(self, key, value):
    if key >= len(self):
      self += [self._default] * (key - len(self) + 1)
    super(rlist, self).__setitem__(key, value)

l = rlist(0)
print(l)
l[10] = 20
print(l)
l[5] = 14
print(l)

This class checks whether the index being assigned to is beyond the current length of the list, and automatically expands the list as required.

The code is compatible with both Python 2 and 3 (tested with 2.6.5 and 3.1.2).

This class could be handy if the structure is dense and you need to find the element by index as quickly as possible. If the structure is sparse, you should probably consider using a dictionary.

Answer 2

I came up with something that uses itertool.repeat().

import itertools

def assign(lst, idx, value, fill=None):
    diff = len(lst) - idx
    if diff >= 0:
        lst[idx] = value
    else:
        lst.extend(itertools.repeat(fill, -diff))
        lst.append(value)

That have the following behaviour:

>>> l = [0, 1, 2, 3, 4]
>>> assign(l, 2, 'new')
>>> l
[0, 1, 'new', 3, 4]
>>> assign(l, 8, 'new')
>>> l
[0, 1, 'new', 3, 4, None, None, None, 'new']
>>> assign(l, 10, 'new', fill=[])
>>> l
[0, 1, 'new', 3, 4, None, None, None, 'new', [], 'new']

Does this work for you?

Edit: Since the question was updated I've updated the answer.

Answer 3

Perhaps this does what you want:

def resize(l, newsize, filling=None):                                                                                  
    if newsize > len(l):                                                                                 
        l.extend([filling for x in xrange(len(l), newsize)])                                                 
    else:                                                                                                
        del l[newsize:]                  

Answer 4

Try this:

def ResizeList(some_list, length, null_item = None): 
    return some_list + [null_item 
                        for item in range(length - len(lst))]