DZone Snippets: administration code

backup subversion repository over email

sevkin (Vsevolod Balashov) — Thu, 21 Sep 2006 22:58:18 GMT



#!/bin/bash

#

# $Id: repodiff 3 2006-09-21 18:48:39Z sevkin $

#

# subversion repository incremental backup over e-mail

#

# (c) 2006 Vsevolod Balashov under terms of GNU GPL v.2 or later



SVNROOT=/var/svn

EMAIL=your@email.here

STORE=`mktemp -d`

GPGCRYPT=n



for REPO in `ls $SVNROOT`; do 

	REPOPATH=$SVNROOT/$REPO;

	if [ -r $REPOPATH/youngest ]; then

		LATEST=`cat $REPOPATH/youngest`

		YOUNGEST=`svnlook youngest $REPOPATH`

		if [ $LATEST -lt $YOUNGEST ]; then

			svnadmin dump $REPOPATH --incremental -r $LATEST:$YOUNGEST >$STORE/$REPO 2>/dev/null

		fi

	else

		svnadmin dump $REPOPATH --incremental >$STORE/$REPO 2>/dev/null

	fi 

	echo $YOUNGEST >$REPOPATH/youngest 

done



if [ `ls $STORE | wc -w` -gt 0 ]; then

	BACKUP=repodiff_`date -u +%Y%m%d%H%M%S`.tar.bz2

	ATTACH=$STORE/../$BACKUP

	tar  -C $STORE -cjf $ATTACH .

	if [ $GPGCRYPT = y ]; then

		gpg -e -r $EMAIL $ATTACH

		ATTACH=$ATTACH.gpg

	fi

	echo "." | mutt -c $EMAIL -a $ATTACH -s "repository incremental backup"

	rm -f $ATTACH

fi



rm -rf $STORE

Subversion service for low-load (personal?) sources repository

sevkin (Vsevolod Balashov) — Tue, 19 Sep 2006 23:48:50 GMT

Create separate user and insert svnserve into inetd.



# useradd -g root -s /bin/false -d /dev/null -c "SubVersion Daemon" svnserve

# mkdir /var/svn

# chown -R svnserve /var/svn

# update-inetd --add 'svn\tstream\ttcp\tnowait\tsvnserve\t/usr/sbin/tcpd\t/usr/bin/svnserve --inetd --root /var/svn'

/var/svn - root of repository.
update-inetd - standart tool in debian and ubuntu linux distros

You must run svnadmin as svnserve user for manage your repository



$ sudo sudo -u svnserve svnadmin

Real-time website referrers tracer

paulgoscicki (Paul Goscicki) — Sun, 19 Jun 2005 22:32:03 GMT

Trace your website visitors (and referrers) as they come using this bash script.



# CONFIGURATION

# =============



# Where your httpd log file is

log="current-http-accesslog"



# What files to exclude (request for those files won't be shown)

exclude="\.gif|\.jpg|\.png|\.ico|\.css|\.js"



# Width of request and referer columns (set it to match your terminal)

col_width=35





# MAIN SCRIPT

# ===========



# Check if log file actually exists (and is readable)

if [ ! -r "${log}" ]; then

echo "Cannot access log file: $log"

exit 0

fi



# After startup we will output few lines

start=`wc -l < "${log}"`

start=$(( $start - 30 ))

if (( ${start} < 0 ))

then start=$((0))

fi



# Main loop

while :

do

  end=`wc -l < "${log}"`

  end="${end##* }"

  if (( ${end} > ${start} ))

  then

    start=$(( $start + 1 ))

    sed -n "${start},${end}p" "${log}" | egrep -v "${exclude}" | awk -v col_width=$col_width '{



      # we are only interested in GET/POST requests

      if ( match($0, /"(GET|POST).*?"/) > 0 )

      {

        split($0, fields, "\"")



        # IP_ADDRESS

        tmp = $1

        while ( length(tmp) < 15 ) tmp = tmp " "

        printf "%s", tmp " "

    

        # HTTP_REQUEST (GET/POST)

        tmp = substr(fields[2], 0, index(fields[2], "HTTP/") - 1 )

        tmp = substr(tmp, index(tmp, " ") + 1, col_width)

        while ( length(tmp) < col_width ) tmp = tmp " "

        printf "%s", tmp " "

    

        # REFERER (the juice)

        tmp = fields[4]

        while ( length(tmp) < col_width ) tmp = tmp " "

        printf "%s", tmp " "

    

        # USER_AGENT

        printf "%s", fields[6]

    

        # new line at the end

        printf "\n"

      }

    }'



    start=${end}

  fi



  # this is an endless loop that sleeps every second

  sleep 1

done

Find which pids are using which TCP ports

nicolas (Nicolas) — Wed, 15 Jun 2005 01:06:32 GMT

On unix systems: lsof
On windows: command line: Tcpvcon
GUI: TCPView
(can be downloaded from http://www.sysinternals.com/Utilities/TcpView.html)