Rohan Bapat Rohan Bapat - 5 months ago 31x
Python Question

Remove special characters from column headers

I have a dictionary (data_final) of dataframes (health, education, economy,...). The dataframes contain data from one xlsx file. In one of the dataframes (economy), the column names have brackets and single quotes added to it.

data_final['economy'].columns =
Index([ ('Sr.No.',),
('Forestry& Logging',),
('Mining &Quarrying',),
('Unregd. MFG.',),
('Electricity,Gas &',),
('Trade,Hotels& Restaurants',),
('Transportby other means',),
('Banking &Insurance',),
('Real, Ownership of Dwel. B.Ser.& Legal',),
('Population(In '00)',),
('Per CapitaIncome(Rs.)',)],

I cannot reference any column using


gives error -

SyntaxError: invalid syntax

I tried to use replace to remove the brackets -

data_final['economy'].columns = pd.DataFrame(data_final['economy'].columns).replace("(","",regex=True))

But this does not remove the error in column names. How can i remove all these special characters from column names?

Ed. Ed.

It looks as though your column names are being imported/created as tuples. What happens if you try and reference them removing the brackets, but leaving a comma on the end, like so


or even with the brackets