DZone Snippets: awk code

Cut some text from file

shantanuo (shantanu oak) — Thu, 28 Aug 2008 07:46:35 GMT

// 1234567@2345|[HELLO]|adcbdefhij: asgdfdasdfhhfd-asdfasd-dsfasdf |0.678|0.0|0.213
// 1234567@2345|[HELLO]|adcbdefhij: ashhfd-asdfasd-dsfasdf |0.129|0.0|0.411
// 1234567@2345|[HELLO]|adcbdefhij: asd-aasd-dasdf |0.223|0.0|0.276
// delete the text which occurs between @ and :
// remove the numbers which occur at the end of every line |0.223|0.0|0.276



awk 'BEGIN{FS="[@:|]"}{ printf "%s%s\n",$1,$5}' file

extract table names from sql log file

shantanuo (shantanu oak) — Fri, 12 Oct 2007 08:23:02 GMT



grep "from " /var/log/mysql/mysqld.log | awk -Ffrom '{print $2}' | awk '{print $1}' | cat > /home/shantanu/testing.txt

Parse Exim log file with SpamAssassin score

Wallace (Wallace) — Sat, 29 Sep 2007 08:50:51 GMT



grep '\[Spam score: [1-9]' /var/log/exim/main.log | awk '{print $3}' | xargs -t -i grep {} /var/log/exim/main.log > /var/log/exim/spam_score.log



grep 'reporter\.pl' /var/log/exim/main.log | awk '{print $3}' | xargs -t -i grep {} /var/log/exim/main.log > /var/log/exim/spam_reporter.pl.log

FInd slow actions in a Rails app

sikelianos (Zeke Sikelianos) — Tue, 21 Aug 2007 21:08:20 GMT



# Show a list of actions sorted by time taken. Useful for finding slow actions.

cat log/development.log | awk '/Completed/ { print "[" $3 "] - " $0 }' | sort -nr

See your most used shell commands

peter (Peter Cooperx) — Tue, 03 Jul 2007 01:39:29 GMT

Found here.



history | awk '{print $2}' | awk 'BEGIN {FS="|"}{print $1}' | sort | uniq -c | sort -n | tail | sort -nr

MySQL Database Size

willcodeforfoo () — Fri, 08 Jun 2007 14:51:07 GMT

mysql -uroot -D sfcnet_development -e "show table status\G"| egrep "(Index|Data)_length" | awk 'BEGIN { rsum = 0 } { rsum += $2 } END { print rsum }'

HTML Table to CSV in AWK

jivechicken (Dave) — Sat, 21 Apr 2007 03:25:28 GMT

Here's a simple AWK script to try to parse an HTML table into a comma seperated file
from http://euri.ca/blog/category/awk/



BEGIN {s=""; FS="n"}

/]*>/, ""); s=(s ", " $1);}

/

And then you execute it (on windows) as: gawk -f 1.awk *.jsp > whatever.csv

Sort file by length of lines

AlpT (AlpT) — Sun, 14 Jan 2007 03:41:12 GMT

Sort file by length of lines



cat $@ | awk '{ print length, $0 }' | sort -n | awk '{$1=""; print $0}'

processing columns

nevadalife (nevada) — Sat, 23 Sep 2006 17:57:56 GMT

print the first column, delimited by space



nawk -Fc '{print $1}' test.txt

print the second column, delimited by :



nawk -F: '{print $2}' test.txt

OSX Restart Lookupd

phlipper (Phil Cohen) — Fri, 22 Sep 2006 00:59:05 GMT

sudo kill -HUP `ps -ax | grep lookupd | grep sbin | awk '/(\d+).*/ { print $1 }'`