I am trying to read a csv file >4GB, However, when I use
fread
library(data.table)
csv1 <- fread("cleaned.csv",sep = ",",colClasses = "character",showProgress = TRUE)
embedded nul in string: '\0'
sed
sed couldn't flush stdout no space left on device
The csv files were populated with ^@ and they were placed within the blank values, somehow they couldn't be searched or replaced via sed commands
to solve the problem, I followed the following solution.
In linux, follow to the file directory and use vim command such as,
vim filename.csv
:%s/CTRL+2//g
ESC #TO SWITCH FROM INSERT MODE
:wq # TO SAVE THE FILE
I had to do this manually for every file. However, I still looking for a way to automate this either within R or using from BASH script.