Python.expat can't parse XML file with bad symbols. How to go around?

Posted by culebrón on Stack Overflow See other posts from Stack Overflow or by culebrón
Published on 2010-03-22T20:37:12Z Indexed on 2010/03/23 1:21 UTC
Read the original article Hit count: 375

Filed under:

python

|

expat

|

Xml

|

unicode

I'm trying to parse an XML file with expat, and here's the line where I get bad token exception:

<tag k="name"
v="???????????????????????????????????????????????????????????????????" />

xml.parsers.expat.ExpatError: not well-formed (invalid token): line 610127, column 37

The symbols in hex look like: \xd1? Seems like someone wrote this string (Russian alfabet) hitting backspace a few times.

I set parser.returns_unicode = True, but this didn't help. The 1st line is <?xml version="1.0" encoding="UTF-8"?>. I work with a bz2 file. (bz2.BZ2File)

How can I parse the file?

© Stack Overflow or respective owner

Related posts about python

unmet dependencies in Ubuntu 12.04

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
I tried today to install a dvb-card on my Ubuntu 12.04 (Linux blauhai-linux 3.2.0-25-generic #40-Ubuntu SMP Wed May 23 20:30:51 UTC 2012 x86_64 x86_64 x86_64 GNU/Linux ). The installation failed with an error. After that, i tried to install python (it was already installed but i got this error): linux:~$… >>> More
How can I get sikuli-ide to work?

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
I installed sikuli-ide with sudo apt-get install sikuli-ide Everything was fine until I tried to start it from the terminal. I typed sikuli-ide But the only response I got was [info] locale: en_US The application was not started, furthermore there is no desktop file and sikuli-ide does not… >>> More
Getting PATH right for python after MacPorts install

as seen on Super User - Search for 'Super User'
I can't import some python libraries (PIL, psycopg2) that I just installed with MacPorts. I looked through these forums, and tried to adjust my PATH variable in $HOME/.bash_profile in order to fix this but it did not work. I added the location of PIL and psycopg2 to PATH. I know that Terminal is… >>> More
call python with system() in R to run a python script emulating the python console

as seen on Stack Overflow - Search for 'Stack Overflow'
I want to pass a chunk of Python code to Python in R with something like system('python ...'), and I'm wondering if there is an easy way to emulate the python console in this case. For example, suppose the code is "print 'hello world'", how can I get the output like this in R? >>> print… >>> More
Python - Calling a non python program from python?

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, I am currently struggling to call a non python program from a python script. I have a ~1000 files that when passed through this C++ program will generate ~1000 outputs. Each output file must have a distinct name. The command I wish to run is of the form: program_name -input -output -o1 -o2… >>> More

Related posts about expat

getting expat to use .dtd for entity replacement in python

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm trying to read in an xml file which looks like this <?xml version="1.0" encoding="ISO-8859-1"?> <!DOCTYPE dblp SYSTEM "dblp.dtd"> <dblp> <incollection> <author>José A. Blakeley</author> </incollection> </dblp> The point that creates… >>> More
expat parser: memory consumption

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, I am using expat parser to parse an XML file of around 15 GB . The problem is it throws an "Out of Memory" error and the program aborts . I want to know has any body faced a similar issue with the expat parser or is it a known bug and has been rectified in later versions ? >>> More
Looking for streaming xml pretty printer in C/C++ using expat or libxml2

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm looking for a streaming xml pretty printer for C/C++ that's either self contained or that uses libxml2 or expat. I've searched a bit and not found one. It seems like something that would be generally useful. Am I missing an obvious tool that does this? Background: I have a library that outputs… >>> More
What configuration should i use for compiling expat for MIPS running Debian Embbeded Linux

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, I trying to understand what flags should I use when running ./configure of expat. To compile for and embedded target running a debian based distribution on MIPS. For example: Do I have to tell it where the kernel source is? Do I have to give it the architecture I'm using? ... Thanks Schmil >>> More
Python + Expat: Error on  entities

as seen on Stack Overflow - Search for 'Stack Overflow'
I have written a small function, which uses ElementTree and xpath to extract the text contents of certain elements in an xml file: #!/usr/bin/env python2.5 import doctest from xml.etree import ElementTree from StringIO import StringIO def parse_xml_etree(sin, xpath): """ Takes as input a stream… >>> More