Rohan Bapat Rohan Bapat - 2 years ago 113
Python Question

Remove special characters from column headers

I have a dictionary (data_final) of dataframes (health, education, economy,...). The dataframes contain data from one xlsx file. In one of the dataframes (economy), the column names have brackets and single quotes added to it.

data_final['economy'].columns =
Index([ ('Sr.No.',),
('Forestry& Logging',),
('Mining &Quarrying',),
('Unregd. MFG.',),
('Electricity,Gas &',),
('Trade,Hotels& Restaurants',),
('Transportby other means',),
('Banking &Insurance',),
('Real, Ownership of Dwel. B.Ser.& Legal',),
('Population(In '00)',),
('Per CapitaIncome(Rs.)',)],

I cannot reference any column using


gives error -

SyntaxError: invalid syntax

I tried to use replace to remove the brackets -

data_final['economy'].columns = pd.DataFrame(data_final['economy'].columns).replace("(","",regex=True))

But this does not remove the error in column names. How can i remove all these special characters from column names?

Ed. Ed.
Answer Source

It looks as though your column names are being imported/created as tuples. What happens if you try and reference them removing the brackets, but leaving a comma on the end, like so


or even with the brackets

Recommended from our users: Dynamic Network Monitoring from WhatsUp Gold from IPSwitch. Free Download