DZone Snippets: tidy code

Converting XHTML to XML

jrobertson (James Robertson) — Sun, 10 Feb 2008 15:35:40 GMT

Based on the code from 'Convert from HTML to XML with HTML Tidy', this code will read an xhtml file and extract text to gallery.xml as instructed by xhtml2xml.xml



#!/usr/bin/ruby

  

  require 'tidy'

  require 'projxslt'

  

  FILE_PATH = "../"

  

  class Xhtml2Xml

    def convert()

      project = 'xhtml2xml'

      filein = 'xhtml2xml.xml'

      filehtml = 'gallery.html'

      filexml = 'gallery_xhtml.xml'

      xslfile_temp = 'gallery.xsl'

      xslfile = 'xhtml2xml.xsl'

      fileout = 'gallery.xml'

      tidy_config = 'tidy.txt'

      

      project_path = FILE_PATH + project + '/'

      tidy_config_path = project_path + tidy_config

      filein_path = project_path + filein

      filehtml_path = project_path + filehtml

      filexml_path = project_path + filexml

      xslfile_temp_path = project_path + xslfile_temp

      xslfile_path = project_path + xslfile

      fileout_path = project_path + fileout

      

      Tidy.path = '/usr/lib/libtidy.so'



      file = File.new(filehtml_path,'r')

      buffer = file.read

      xml = Tidy.open(:show_warnings=>true) do |tidy|

        tidy.options.output_xml = true

        tidy.load_config(tidy_config_path)

        puts tidy.options.show_warnings

        xml = tidy.clean(buffer)

        puts tidy.errors

        puts tidy.diagnostics

        xml

      end

      

      #strip out the html document type declaration and save the file

      html_declaration = xml[/]*>){2}/]

      save_file(filexml_path, xml.gsub(html_declaration,''))    

      transform(filein_path, xslfile_path, xslfile_temp_path)

      transform(filexml_path, xslfile_temp_path, fileout_path)

      

    end

    

    def transform(xml_filepath, xsl_filepath, save_filepath)

      pxsl = Projxslt.new(xml_filepath, xsl_filepath)

      outfile = pxsl.transform

      save_file(save_filepath, outfile)

    end

    

    def save_file(filepath, buffer)

      file = File.new(filepath,'w') 

      file.puts buffer

      file.close

    end    

  end

  

  if __FILE__ == $0

    h2x = Xhtml2Xml.new()

    h2x.convert()

  end

file: xhtml2xml.xml

file:xhtml2xml.xsl (transforms the file xhtml2xml.xml to file gallery.xsl)







  

    :

    

    

      

        http://www.w3.org/1999/XSL/Transform

      

      

        1.0

      

      





  

    xml

  

  

    yes

  











      

        html

      



      

      



      

        

          

        

                  



  

    

      

        

      

      

        

      

    

    

  



    



        

       

              

        

            

              normalize-space($

                

                )

output: gallery.xml (this file is the product of gallery_xhtml.xml and gallery.xsl)







  Journey to Windsor

  

    Windsor Castle

    July 2003

    dscn0824.jpg

    

      A bright, red mailbox inside the castle. It seems oddly familiar in an historic setting.

Convert from HTML to XHTML with HTML Tidy

jrobertson (James Robertson) — Fri, 08 Feb 2008 16:51:09 GMT

This HTML Tidy example converts an html file into an xml file.



tidy -asxhtml -numeric < index.html > index.xml

example found from Tip: Convert from HTML to XML with HTML Tidy [ibm.com]

Tidy with Ruby

jrobertson (James Robertson) — Fri, 08 Feb 2008 16:28:45 GMT

Ruby interface to HTML Tidy Library Project (tidy.sf.net).



  require 'tidy'

  Tidy.path = '/usr/lib/libtidy.so'

  html = 'titleBody'

  xml = Tidy.open(:show_warnings=>true) do |tidy|

    tidy.options.output_xml = true

    puts tidy.options.show_warnings

    xml = tidy.clean(html)

    puts tidy.errors

    puts tidy.diagnostics

    xml

  end

  puts xml

output



true

line 1 column 1 - Warning: missing  declaration

line 1 column 7 - Warning: plain text isn't allowed in  elements

Info: Document content looks like XHTML 1.0 Transitional

2 warnings, 0 errors were found!







content="HTML Tidy for Linux/x86 (vers 1 September 2005), see www.w3.org" />

title



Body

Note: Couldn't get it to run on Ubuntu version 7.10 or 7.04 (LoadError: no such file to load -- tidy
), however it ran fine on Gentoo.

reference: http://tidy.rubyforge.org/

*update 18-Mar-08 16:15*
I got it working on Ubuntu I simply needed to add - require 'rubygems'

Tidy Remote HTML (using a web service)

logankoester (Logan Koester) — Thu, 28 Jun 2007 10:16:46 GMT

// Clean up some code using a web service. If you need to do this more quickly I suggest using a local tidy installation
// rather than my web service, but this is nice and easy. :)



function tidied($url) {

  /* Cleans up a page via Tidy, returning the cleaned up html as a string

   * By Logan Koester  2007-06-28

   * Props to http://infohound.net/tidy */

  return file_get_contents("http://logankoester.com/tools/tidy.php?q=$url");

}