Difference between revisions of "XmlCleaner Plugin Channel"

From AwasuWiki
Jump to: navigation, search
(Updated to use DownloadUrl parameter (which lets Awasu D/L the URL itself; thanks Taka))
(ctypes Python 2.4 compatibility issue)
Line 5: Line 5:
  
 
* Install [http://www.python.org/ Python], [http://sourceforge.net/projects/pywin32/ PyWin32], and [http://utidylib.berlios.de/ uTidyLib].
 
* Install [http://www.python.org/ Python], [http://sourceforge.net/projects/pywin32/ PyWin32], and [http://utidylib.berlios.de/ uTidyLib].
 +
  * uTidyLib contains an older version of the [http://starship.python.net/crew/theller/ctypes/ ctypes] Python module. The included version works fine with Python 2.3, but for Python 2.4, ctypes should be updated to a newer version.
 
* Create the two files listed below. It is recommended to put them into the `ChannelPlugins` directory under Awasu's installation directory.
 
* Create the two files listed below. It is recommended to put them into the `ChannelPlugins` directory under Awasu's installation directory.
  

Revision as of 09:05, 20 June 2006

This plugin corrects errors in an XML feed.


Installation

 * uTidyLib contains an older version of the ctypes Python module. The included version works fine with Python 2.3, but for Python 2.4, ctypes should be updated to a newer version.
  • Create the two files listed below. It is recommended to put them into the `ChannelPlugins` directory under Awasu's installation directory.

XmlCleaner.plugin:

[Config]
AuthorName=Tomi Junnila
AuthorEmailAddress=notlisted
PluginNotes=This plugin uses uTidylib to clean up an erroneous XML feed

' --------------------------------------------------------------------------------

[ChannelParameterDefinition-1]
Name=DownloadUrl
Type=string
DefaultValue=
Description=URL to read erroneous feed from.

XmlCleaner.py:

# -*- coding: iso-8859-1 -*-

import sys, win32api
import socket
from xml.dom.minidom import parseString
import urllib
from datetime import datetime,tzinfo,timedelta
import time as _time
import tidy

# Set options for uTidyLib
tidyopts = dict(output_xml=1, input_xml=1, add_xml_decl=1, indent=1, tidy_mark=0, output_encoding='utf8')

# Awasu will already have downloaded the DownloadUrl and stored it into a
# temporary file pointed to by DownloadUrlFile. Get the file name:
filename = win32api.GetProfileVal("System","DownloadUrlFile","",sys.argv[1])

# Then read the file:
page = file(filename,'rb')
xml = ''
block = 'a'
while block!='':
    block = page.read()
    xml = xml + block
page.close()

# Clean up the HTML:
xml = tidy.parseString(xml, **tidyopts)
print xml

Usage

To use the XmlCleaner plugin, select File -> New channel, then "Generated by a channel plugin", and browse to the XmlCleaner.py file. Add the feed URL in the plugin's URL parameter, and you're done.