How can I persist a large Perl object for re-use between runs?

Posted by Alnitak on Stack Overflow See other posts from Stack Overflow or by Alnitak
Published on 2010-05-25T10:52:05Z Indexed on 2010/05/25 14:51 UTC
Read the original article Hit count: 221

Filed under:

perl

|

serialization

|

persistence

I've got a large XML file, which takes over 40 seconds to parse with XML::Simple.

I'd like to be able to cache the resulting parsed object so that on the next run I can just retrieve the parsed object and not reparse the whole file.

I've looked at using Data::Dumper but the documentation is a bit lacking on how to store and retrieve its output from disk files. Other classes I've looked at (e.g. Cache::Cache appear designed for storage of many small objects, not a single large one.

Can anyone recommend a module designed for this?

EDIT. The XML file is ftp://ftp.rfc-editor.org/in-notes/rfc-index.xml

On my Mac Pro benchmark figures for reading the entire file with XML::Simple vs Storable are:

      s/iter  test1  test2
test1   47.8     --  -100%
test2  0.148 32185%     --

© Stack Overflow or respective owner

Related posts about perl

Munin on Centos 6 - missing perl MODULE_COMPAT_5.8.8

as seen on Server Fault - Search for 'Server Fault'
I'm trying to install Munin on a new VPS through yum install munin but I keep getting an error about a missing perl module: Requires: perl(:MODULE_COMPAT_5.8.8). This is the perl version currently installed: v5.10.1. I've searched all around and still haven't found a solution for this. Here's the… >>> More
Pain removing a perl rootkit

as seen on Server Fault - Search for 'Server Fault'
So, we host a geoservice webserver thing at the office. Someone apparently broke into this box (probably via ftp or ssh), and put some kind of irc-managed rootkit thing. Now I'm trying to clean the whole thing up, I found the process pid who tries to connect via irc, but i can't figure out who's… >>> More
How To Avoid a Perl script calling an Another Perl Script

as seen on Stack Overflow - Search for 'Stack Overflow'
Hello, i am calling a perl script client.pl from a main script to capture the output of client.pl in @output. is there anyway to avoid the use of these two files so i can use the output of client.pl in main.pl itself here is my code.... main.pl ======= my @output = readpipe("client.pl"); client… >>> More
Perl :how to sort dates in perl

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, How can I sort the dates in perl. my @dates = ( "02/11/2009" , "12/20/2001" , "11/21/2010" ) ; I have above dates in my array . How can I sort those dates... ? My date format is dd/mm/YYYY. >>> More
please suggest a perl book exclusively for perl programs

as seen on Stack Overflow - Search for 'Stack Overflow'
I want tha name of a perl book for only PERL PROGRAMS. The reason behind is I want to improve my programming skill in perl >>> More

Related posts about serialization

XML Serialization and Soap Serialization

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi I think even if we will not need interoperability between applications, and even we do not communicate with web services, it is easier to serialize using SoapFormatter than XmlSerializer because SOAP will serialize the private members by default, while XmlSerializer will work on public properties… >>> More
Binary serialization/de-serialization in C++ and C#

as seen on Stack Overflow - Search for 'Stack Overflow'
Hello. I am working on a distributed application which has two components. One is written in standard C++ (not managed C++) and the other one is written in C#. Both are communicating via a message bus. I have a situation in which I need to pass objects from C++ to C# application and for this I need… >>> More
Insert some data at later point once serialization(binary serialization) is done for a class

as seen on Stack Overflow - Search for 'Stack Overflow'
My application is written in C# and I am a newbie to C#. I am facing with a problem during serialization. The problem is as follows. There are many classes in my project and when serialization is called on one of the main class object it serializes itself and during this process many of the member… >>> More
FormatException with IsolatedStorageSettings

as seen on Stack Overflow - Search for 'Stack Overflow'
I have a problem when serializing a Dictionary<string,Person> to IsolatedStorageSettings. I'm doing the following: public Dictionary<string, Person> Names = new Dictionary<string, Person>(); if (!IsolatedStorageSettings.ApplicationSettings.Contains("Names")) { … >>> More
Serialization of Queue type- Serialization not working; C#

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi All, Consider this piece of code: private Queue Date=new Queue(); //other declarations public DateTime _Date { get { return (DateTime)Date.Peek();} set { Date.Enqueue(value); } } //other properties and stuff.... public void UpdatePosition(...) { //other code … >>> More