DZone Snippets: rake code

Rake task to set all S3 files public_read

spiceee (Spiceee) — Tue, 15 Jul 2008 01:00:37 GMT

// If you ever need to make sure all your Amazon S3 files are set to public_read, here's a rake task





namespace :s3 do

  desc "Make all objects in S3 public_read"

  task :make_public_readable do

    require 'aws/s3'

    # you might have this setup as env vars, doesn't work for me as i have more than one AWS account

    AWS::S3::Base.establish_connection!(:access_key_id => '',:secret_access_key => '')    

    

    marker = ""

    

    loop do

      objects = AWS::S3::Bucket.objects('your_bucket', :marker=>marker, :max_keys=>100)

      puts "found #{objects.size} objects"

    

      break if objects.size == 0

    

      marker = objects.last.key

      puts "new marker is \"#{marker}\""

    

      public_grant = AWS::S3::ACL::Grant.grant :public_read

  

      objects.each do |o|

        if not o.acl.grants.include? public_grant

          puts "\"#{o.key}\" does not include public_read"

          o.acl.grants << public_grant

          o.acl(o.acl)

        end

      end

    end

  end

  

end

rake task for restart rails application runed on mod_rails

bublik (Voloshin Ruslan) — Tue, 27 May 2008 12:26:32 GMT



amespace :passenger do

  desc "Restart Application"

  task :restart do

    puts `touch tmp/restart.txt`

  end

end

Easier path construction using overloaded /

shmul (Shmulik Regev) — Fri, 28 Mar 2008 15:15:50 GMT

Especially when writing rake tasks where a lot of path construction code is written the following overloading of the / operator makes the code more readable.





class String

  def /(other)

    File.join(self,other)

  end

end



# and you can write

#   path = all/along/the/watch/tower

# instead of 

#   path = "#{all}/#{along}/#{the}/#{watch}/#{tower}"

rake task to rename views to rails 2.0 format

caffo () — Thu, 20 Mar 2008 03:11:00 GMT

// This task will rename your files to the rails 2.0 format, using git mv. Add it to /lib/tasks/rails.rake



namespace 'views' do

  desc 'Renames all .rhtml views to .html.erb, .rjs to .js.rjs, .rxml to .xml.builder, and .haml to .html.haml'

  task 'rename' do

    Dir.glob('app/views/**/[^_]*.rhtml').each do |file|

      puts `git mv #{file} #{file.gsub(/\.rhtml$/, '.html.erb')}`

    end



    Dir.glob('app/views/**/[^_]*.rxml').each do |file|

      puts `git mv #{file} #{file.gsub(/\.rxml$/, '.xml.builder')}`

    end



    Dir.glob('app/views/**/[^_]*.rjs').each do |file|

      puts `git mv #{file} #{file.gsub(/\.rjs$/, '.js.rjs')}`

    end

    Dir.glob('app/views/**/[^_]*.haml').each do |file|

      puts `git mv #{file} #{file.gsub(/\.haml$/, '.html.haml')}`

    end

  end

end

create new rails rake task

bublik (Voloshin Ruslan) — Thu, 28 Feb 2008 15:02:33 GMT

Create new task for /unit/helpers/*_test.rb

Rakefile



namespace :test do

  Rake::TestTask.new(:helpers) do |t|

    t.libs << "test"

    t.pattern = 'test/unit/helper/*_test.rb'

    t.verbose = true

  end



  Rake::Task['test:helpers'].invoke

end

Active Record YAML Backup Solution - Drop in rake task and config file to backup db and directorys of your choice (user uploaded files)

rawdod (David Richards) — Fri, 16 Nov 2007 04:38:47 GMT

EZ drop in backup rake task for your rails projects - works well - 5 - 10 min set up, one rake file and one config file
backs up db and any directory's to any number of servers with rsync

BSD License or whatever, but it would be cool if you told me your using it
2007 ISS http://industrialstrengthinc.com

this is a sample config file and a rake task you can drop into any rails project to do backups, easy to automate.
Backs up your specified environment db to activerecord yml files (one per table) and zips them up in a human readable timestamped file
syncs that and any other set of arbitrary directory's to any number of arbitrary servers with rsync
be sure to set ssh key based logins
to run: rake backup
also: rake backup:db, rake backup:restoredb (promts for a file created by backup:db), rake backup:push (to push out what u got)
note: this uses something like 30 lines of code from some blog site I got it from that I cant recall, yay for that guy, thanks



## example crontab entry:



3 * * * * cd /rails_deployment_dir/current && nice rake backup RAILS_ENV=production >> /rails_deployment_dir/production_backup_system.log



## config file - goes in config/backup.yml



production: 

  dirs: 

   - db/backups

   - public/uploaded_images

  servers: 

    -  name: backup server number 1

       host: gridserver.com

       port: 22

       user: blah@whatever.com

       dir: /home/blah/backups

    -  name: backup server two

       host: kradradio.com

       port: 22

       user: kraduser

       dir: /home/kraduser/backups_from_my_rails_proj





development: 

  dirs: 

   - db/backups

   - public/uploaded_images

  servers: 

    -  name: local self

       host: localhost

       port: 5222

       user: oneman

       dir: /home/oneman/Documents/development_backup





## rake file lib/tasks/backup.rake



desc "Backup Everything Specified in config/backup.yml"

task :backup => [ "backup:db",  "backup:push"]



namespace :backup do

 

    RAILS_APPDIR = RAILS_ROOT.sub("/config/..","")

    

   def interesting_tables

     ActiveRecord::Base.connection.tables.sort.reject! do |tbl|

       ['schema_info', 'sessions', 'public_exceptions'].include?(tbl)

     end

   end

  

   desc "Push backup to remote server"

   task :push  => [:environment] do 

      FileUtils.chdir(RAILS_APPDIR)

      backup_config = YAML::load( File.open( 'config/backup.yml' ) )[RAILS_ENV]

      for server in backup_config["servers"]

       puts "Backing up #{RAILS_ENV} directorys #{backup_config['dirs'].join(', ')} to #{server['name']}"

       puts "Time is " + Time.now.rfc2822 + "\n\n"

         for dir in backup_config["dirs"]

          local_dir = RAILS_APPDIR + "/" + dir + "/"

          remote_dir = server['dir'] + "/" + dir.split("/").last + "/"

          puts "Syncing #{local_dir} to #{server['host']}#{remote_dir}"

          sh "/usr/bin/rsync -avz -e 'ssh -p#{server['port']} ' #{local_dir} #{server['user']}@#{server['host']}:#{remote_dir}"

         end

       puts "Completed backup to #{server['name']}\n\n"

      end

   end



    task :storedb => :environment do 



      backupdir = RAILS_APPDIR + '/db/backup'

      FileUtils.mkdir_p(backupdir)

      FileUtils.chdir(backupdir)

      puts "Dumping database to activerecord yaml files in #{backupdir}"

      interesting_tables.each do |tbl|



        klass = tbl.classify.constantize

        puts "Writing #{tbl}..."

        File.open("#{tbl}.yml", 'w+') { |f| YAML.dump klass.find(:all).collect(&:attributes), f }      

      end

      puts "Database Dumped.\n\n"

    end



    desc "Dump Current Environment Db to file"    

    task :db => [:environment, :storedb ] do

      backupdir = RAILS_APPDIR + '/db/backup'

      archivedir = RAILS_APPDIR + '/db/backups'

      backup_filename = "#{RAILS_ENV}_db_backup_#{Time.now.strftime("%B.%d.%Y_at_%I.%M.%S%p_%Z")}.tar.bz2"

      FileUtils.mkdir_p(archivedir)

      puts "Archiving #{backupdir} yaml files to #{backup_filename}\n\n"

      `tar -C #{backupdir} -cjf #{backup_filename} *`

      `mv #{backup_filename} #{archivedir}`

    end



    desc "Restore Current Environment Db from a file"    

    task :restoredb => [:environment] do 

        backupdir = RAILS_APPDIR + '/db/backup'

        archivedir = RAILS_APPDIR + '/db/backups'

        print "Input a file to load into the db: #{archivedir}/"

        backup_filename = STDIN.gets.chomp

        puts "Loading backup file: #{backup_filename}"

        FileUtils.chdir(archivedir)

        `tar -xjf #{backup_filename}`

        `mv *.yml #{backupdir}`

        FileUtils.mkdir_p(backupdir)

        FileUtils.chdir(backupdir)

    

        interesting_tables.each do |tbl|

        puts "Clearing #{tbl} table.."

        ActiveRecord::Base.connection.execute "TRUNCATE #{tbl}"

        puts "Loading #{tbl} backup file..."

        table = YAML.load_file("#{tbl}.yml")        



        if table.length > 0 && table.first.key?("id")

            highestid = 0

            table.each do |fixture|

             if fixture["id"] > highestid

                highestid = fixture["id"]

             end

            end



            ActiveRecord::Base.connection.execute "SELECT setval('#{tbl}_id_seq',#{highestid})"

            puts "Setting #{tbl}_id sequence to #{highestid}"

        end

         

        #klass = tbl.classify.constantize

        ActiveRecord::Base.transaction do 

        

          puts "Inserting #{table.length} values into #{tbl}"

          table.each do |fixture|

            ActiveRecord::Base.connection.execute "INSERT INTO #{tbl} (#{fixture.keys.join(",")}) VALUES (#{fixture.values.collect { |value| ActiveRecord::Base.connection.quote(value) }.join(",")})", 'Fixture Insert'

          end        

          puts "#{tbl} table restored.\n\n"

        end

       end

    end



 

end

Save db data to fixture files

bublik (Voloshin Ruslan) — Fri, 02 Nov 2007 09:30:18 GMT

rake db:fixtures:dump_all
он сохранит все данные из ваших таблиц development базы в ямлы для тестов rake

db:fixtures:dump_references
["areas","countries"]
сохранит только те таблицы которы епрописаны у него в конфиге, в данном случае это



namespace :db do

  namespace :fixtures do



    desc 'Create YAML test fixtures from data in an existing database.

Defaults to development database. Set RAILS_ENV to override.'

    task :dump_all => :environment do

      sql = "SELECT * FROM %s"

      skip_tables = ["schema_info"]

      ActiveRecord::Base.establish_connection(:development)

      (ActiveRecord::Base.connection.tables - skip_tables).each do |table_name|

        i = "000"

        File.open("#{RAILS_ROOT}/test/fixtures/#{table_name}.yml", 'w') do |file|

          data = ActiveRecord::Base.connection.select_all(sql % table_name)

          file.write data.inject({}) { |hash, record|

            hash["#{table_name}_#{i.succ!}"] = record

            hash

          }.to_yaml

        end

      end

    end

  end

  

  namespace :fixtures do

    desc 'Create YAML test fixtures for references. Defaults to development database. 

    Set RAILS_ENV to override.'

    task :dump_references => :environment do

      sql = "SELECT * FROM %s"

      dump_tables = ["areas","countries"]

      ActiveRecord::Base.establish_connection(:development)

      dump_tables.each do |table_name|

        i = "000"

        file_name = "#{RAILS_ROOT}/test/fixtures/#{table_name}.yml"

        p "Fixture save for table #{table_name} to #{file_name}"

        File.open(file_name, 'w') do |file|

          data = ActiveRecord::Base.connection.select_all(sql % table_name)

          file.write data.inject({}) { |hash, record|

            hash["#{table_name}_#{i.succ!}"] = record

            hash

          }.to_yaml

        end

      end

    end

  end

end

View all colors from a set of stylesheets

bradediger (Brad Ediger) — Thu, 04 Oct 2007 17:19:13 GMT

Rake task to grep out colors from a set of CSS stylesheets and display them on a web page. Default configuration works for OS X Safari and a Rails application.



BROWSER = "/Applications/Safari.app/Contents/MacOS/Safari"

CSS_FILES = "#{RAILS_ROOT}/public/stylesheets/**/*.css"



task :colors do

  require "tempfile"

  colors = Dir[CSS_FILES].map(&File.method(:read)).join.scan(/\#[0-9a-f]{3,6}/i).map{|c| c.upcase}.uniq

  Tempfile.open "colors" do |f|

    f.write <<-EOHTML

    

      

        

      

      

        #{colors.map{|clr| 

          " 
 #{clr} 
"

        }.join}

      

    

    EOHTML

    system BROWSER, f.path

  end

end

rcov rake task for rails project

akbloom (Andrew Bloom) — Tue, 11 Sep 2007 16:13:45 GMT

This task will create a folder (doc/coverage) then run all of your tests and produce HTML with code coverage information in that folder. If you are on a mac it will even open the index.html file up for you automatically



# this requires the RCOV gem to be installed on your system

namespace :test do

  desc "Generate code coverage with rcov"

  task :coverage do

    rm_f "doc/coverage/coverage.data"

    rm_f "doc/coverage"

    mkdir "doc/coverage"

    rcov = %(rcov --rails --aggregate doc/coverage/coverage.data --text-summary -Ilib --html -o doc/coverage test/**/*_test.rb)

    system rcov

    system "open doc/coverage/index.html" if PLATFORM['darwin']

  end

end

Dump models into fixtures.

MichaelBoutros (Michael Boutros) — Sun, 26 Aug 2007 22:26:09 GMT

This snippet of code will look in app/models for all models, then dump their contents into the corresponding fixture file found in test/fixtures. At the moment, it can not differentiate between regular models and mailer models, so just remove the extension then run the script. Same goes for models you don't want dumped. I'm working on adding only and except as well.



require 'find'



namespace :db do

  namespace :fixtures do

    desc 'Dumps all models into fixtures.'

    task :dump => :environment do

      models = []

      Find.find(RAILS_ROOT + '/app/models') do |path|

        unless File.directory?(path) then models << path.match(/(\w+).rb/)[1] end

      end

  

      puts "Found models: " + models.join(', ')

      

      models.each do |m|

        puts "Dumping model: " + m

        model = m.capitalize.constantize

        entries = model.find(:all, :order => 'id ASC')

        

        formatted, increment, tab = '', 1, '  '

        entries.each do |a|

          formatted += m + '_' + increment.to_s + ':' + "\n"

          increment += 1

          

          a.attributes.each do |column, value|

            formatted += tab

            

            match = value.to_s.match(/\n/)

            if match

              formatted += column + ': |' + "\n"

              

              value.to_a.each do |v|

                formatted += tab + tab + v

              end

            else

              formatted += column + ': ' + value.to_s

            end

            

            formatted += "\n"

          end

                    

          formatted += "\n"

        end

      

        model_file = RAILS_ROOT + '/test/fixtures/' + m.pluralize + '.yml'

        

        File.exists?(model_file) ? File.delete(model_file) : nil

        File.open(model_file, 'w') {|f| f << formatted}

      end

    end

  end

end