vishes_shell vishes_shell - 1 year ago 54
Python Question

What is pythononic way of slicing a set?

I have some list of data, for example

some_data = [1, 2, 4, 1, 6, 23, 3, 56, 6, 2, 3, 5, 6, 32, 2, 12, 5, 3, 2]

and i want to get unique values with fixed length(i don't care which i will get) and i also want it to be

I know that i can do
then make it
, crop it and then make it

set(list(set(some_data))[:5]) # don't look so friendly

I understand that i don't have
method in
which wouldn't make the whole slice thing possible, but if there is a chance to make it look better?

And i completely understand that
is unordered. So it don't matter which elements will get in final

Possible options is to use:

  • ordered-set

  • using

    set(dict(map(lambda x: (x, None), some_data)).keys()[:2]) # not that great

Answer Source

Sets are iterable. If you really don't care which items from your set are selected, you can use itertools.islice to get an iterator that will yield a specified number of items (whichever ones come first in the iteration order). Pass the iterator to the set constructor and you've got your subset without using any extra lists:

import itertools

some_data = [1, 2, 4, 1, 6, 23, 3, 56, 6, 2, 3, 5, 6, 32, 2, 12, 5, 3, 2]
big_set = set(some_data)
small_set = set(itertools.islice(big_set, 5))

While this is what you've asked for, I'm not sure you should really use it. Sets may iterate in a very deterministic order, so if your data often contains many similar values, you may end up selecting a very similar subset every time you do this. This is especially bad when the data consists of integers (as in the example), which hash to themselves. Consecutive integers will very frequently appear in order when iterating a set. With the code above, only 32 is out of order in big_set (using Python 3.5), so small_set is {32, 1, 2, 3, 4}. If you added 0 to the your data, you'd almost always end up with {0, 1, 2, 3, 4} even if the dataset grew huge, since those values will always fill up the first fives slots in the set's hash table.

To avoid such deterministic sampling, you can use random.sample as suggested by jprockbelly.

Recommended from our users: Dynamic Network Monitoring from WhatsUp Gold from IPSwitch. Free Download