hi, i have more log file sorting questions =D. As an example, my logs might look like: B #/# #,E #/#,A #,A # i need to be able to go through the entire text file and sort the data alphabetically, to:
last week, i got help with that, but it resulted in the two A's being combined, losing a bunch of data =( Now, on top of that, i need to edit the file further, to:
A1 A2 B1 B2 B3 E1 E2 (labels)
# # # # # # # (data 1)
# # # # # # # (data 2)
can any one provide some insight? the main thing that stumps me is the alphabetizing without deleting data, and how to count how many numbers are associated with each data label. Finally, sometimes, there may be entire series of data missing, so there would be no B at all, yet i need to have the program fill in blanks, or at least 0's, to keep the formatting standard thanks for any help you guys can offer =D
Also please read Writeup Formatting Tips, please use <code>...</code> tags only for code, and paragraphs <p>...</p> for text.
print "File Location?"; my $data_file = <>; open(RAWDATA, $data_file); my @list; while (<RAWDATA>) { chomp; my (%hash, @rest); ($hash{first}, $hash{date}, @rest) = split(",", $_); for my $r (@rest) { my ($k, $v) = split(' ', $r, 2); $hash{$k} = $v; } push(@list, \%hash); }; my %seen; for (@list) { for (keys %$_) { $seen{$_}++ } }; delete $seen{first}; delete $seen{date}; my @allkeys = ('first', 'date', sort keys %seen); my @keys = (sort keys %seen); open(SEMIDATA, ">temp.slice"); for my $h (@list) { print(SEMIDATA join(',', $h->{first}, $h->{date}, map( $_.' '.$h->{$_}, @keys ) ), "\n") or warn "print failed: $!"; } close(RAWDATA); close(SEMIDATA); open(EDITDATA, "temp.slice"); my @array_of_data = <EDITDATA>; close ("temp.slice"); foreach my $line (@array_of_data) { #all replacements go here $line =~ s!X!!g; $line =~ s!ART ,!ART / ,!g; $line =~ s!ECG ,!ECG /,!g; $line =~ s!NBP ,!NBP / ,!g; $line =~ s!PA ,!PA / ,!g; $line =~ s!RESP ,!RESP /,!g; $line =~ s!SAO2 ,!SAO2 /,!g; $line =~ s!ST ,!ST //,!g; $line =~ s!TEMP \n!TEMP /\n!g; } # Open the file for writing. open REGDATA, ">temp2.slice"; foreach my $line (@array_of_data) { # Print each line in turn to the new filehandle DATAOUT print REGDATA "$line"; } close REGDATA; } [download]
ah, thanks for notifying me about the paragraph tags, i somehow missed them reading about them
No problem. Just go to your original question and fix the markup.
As for your programming problem, I think you're making it harder than it needs to be.
For example there's no need to store your data to disk twice, and read it again. Here's what I'd do, in non-tested perl code, with some blanks left for you to figure out:
# store all data here: my %data; while (<INPUT>){ chomp my @items = sort split m/,/; my %seen; # number the occurrences of data points, and put them into a hash for (@items) { my ($key, $val) = split m/ /, $_, 2; my $index = ++$seen{$key}; push @{$data{"$key$index"}}, $val; } } # now all data should be in the hash %data. use Data::Dumper; print Dumper \%data; # now print it: my @keys = sort keys %data; while (keys %data) { for (@keys) { if (exists $data{$_}) { # print it out here # then remove it shift @{$data{$_}}; delete $data{$_} unless @{$data{$_}}; } else { # print a placeholder here } } } [download]
The idea is to keep a list of all data values for each label, in your case ['#', '#'] for A1, ...
The choice of a clever data structure (ie one that fits the way you want to access it in your code) makes it much easier.
just to make sure i understand your programming template:
the first part does something similar to my program and splits the data according to commas, then has a space where i can count the occurrences of numbers following a label? I considered using the count function and looking for instances of \D\d{0,3}, but i don't see how to limit the count to only the area between the label and the comma. However, this doesn't really shed any light on how i can store the multiple instances of "A" in one line as seperate values.
sub rj { # right justifies each argument with a length of first parameter my $len= shift; my $str=''; while (@_) { $str.= substr(' 'x12 . shift @_), $len); } return $str; } print rj(12, @d); #prints data in columns of length 12 [download]
Remember to divide a difficult problem into smaller steps. Solving these smaller steps is always easier than looking at the whole problem.
This is what I did because I have a heck of a problem understanding what you want to put where. I neither understand your sorting order ( #,B #/# #,E is alphabetically sorted??) nor where the 1 in A1 comes from.
Please read the PerlMonks FAQ (or, at least, How do I post a question effectively?)
Edit Free Nodelet