Bash Question
Intricate file/text manipulation
I have some rather tricky file manipulation I need to perform, but I am rather bad with coding and I am immediately stumped with where to even begin. Any help would be amazing, so thanks in advance. Preferably in Shell or Python as they are the languages I have cursory knowledge of, however if there is an easy solution in another language I am open to it.
I have 2 massive files with information that correlates, however they are not correctly aligned with their columns which makes it difficult to match the data. To complicate things even further, they have varying values after the decimal point, even though it is only the values before the decimal point which are of interest.
So what I need to do:
- Read ,
file1,column1, but ignore all values after the decimal point.row1 - Read and search
file2for the value taken fromcolumn1while again ignoring what comes after the decimal point.file1 - Once the correlative value is found in , output both of these lines into a new file (
file2) with the rest of the data from their respective lines.file3
That is step one, and if anyone could help me get there I'd be greatly appreciative. The next step is to apply a loop to this process so that it moves onto
file1, line2
Answer
You will need to learn Python better than you know it now. Here is an outline what you will need to do. It is very typical for this kind of "file manipulation".
- Make a regular expression that will match lines from
file1andfile2(or two regular expression if the files do not have the same format). Include in your regex, syntax to capture groups that are important to you. - Read
file1line by line. - As each line is read, match it with your regex, find groups that are important, and store them in a hash.
- Now read
file2line by line. - As each line is read, match it with your regex, find groups that are important, and search the hash for a match.
- When you find the match, output to
file3 - Go back to 4 and repeat.
Source (Stackoverflow)