Delete first rows of csv file in python

Question

We want to delete the first 34 rows of our csv file, as it is useless text headers, which is to no use. We are trying to do so by running the following lines of code in Python 3:

with open("test.csv",'r') as f, open("temp.csv",'w') as f1:
    next(f) # skip header line
    for line in f:
        f1.write(line)

Above should only 'delete' first line, but we imagine we could make a for loop with range(0, 35) around next(f). Although that doesn't seem like the "pythonical" way of solving this.

Our data is in test.csv, and we have an empty csv file called temp.csv. The code described above is supposed to skip first line of test.csv, and then copy the rest into temp.csv.

Unfortunately we receive this error:

Traceback (most recent call last):
  File "delete.py", line 2, in <module>
    next(f) # skip header line
  File "/usr/lib/python3.6/codecs.py", line 321, in decode
    (result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xf8 in position 2625: invalid start byte

Why does this occur? And what is the pythonical way of deleting the first 34 rows in a csv file?

try with `rb` and `wb` options for both open() functions. `r` option try to decode the text from your file using the default encoding (utf-8) — Corentin Limier, Jan 29 '20 at 16:02
Does this answer your question? [UnicodeDecodeError: 'utf8' codec can't decode byte 0x9c](https://stackoverflow.com/questions/12468179/unicodedecodeerror-utf8-codec-cant-decode-byte-0x9c) — AMC, Jan 29 '20 at 18:27

score 12 · Accepted Answer · edited Feb 05 '22 at 16:53

12

I know you want to skip rows using the with context manager when opening and reading a CSV file but I would suggest you to use an excellent library called pandas to read and skip row from the CSV file like below, also you can save that to another csv file from the df data frame very easily

import pandas as pd
# skiprows=34 will skip the first 34 lines and try to read from 35 line
df = pd.read_csv('my_csv_file.csv', skiprows=34)
# print the data frame
df

edited Feb 05 '22 at 16:53

Buster3650

470
2
8
19

answered Jan 29 '20 at 16:08

A l w a y s S u n n y

36,497
8
60
103

1

This works perfectly! We wanted to clean our csv file, so we could use it in another program we have. We had no idea, we could easily just use 'skiprows' instead. Thanks a lot – Buster3650 Jan 29 '20 at 16:17
1

@Buster3650 glad it helps you mate, happy coding :) – A l w a y s S u n n y Jan 29 '20 at 16:19
1

Isn’t Pandas overkill for this? – AMC Jan 29 '20 at 18:27
I wouldn't install pandas just for this. – Dan Dec 03 '21 at 23:31

Delete first rows of csv file in python

1 Answers1