I am aware of the skiprows that allows you to pass a list with the indices of the rows to skip. However, I have the index of the rows I want to keep.
Say that my cvs file looks like this for millions of rows:
0 1 2
1 3 4
2 5 6
3 7 8
4 9 0
index_list = [2,3]
pd.read_csv(path, skiprows = ~index_list)
I think you would need to find the number of lines first, like this.
num_lines = sum(1 for line in open('myfile.txt'))
Then you would need to delete the indices of
to_exclude = [i for i in num_lines if i not in index_list]
and then load your data:
pd.read_csv(path, skiprows = to_exclude)