searching within a compressed sorted fixed width file

Posted by user275455 on Stack Overflow See other posts from Stack Overflow or by user275455
Published on 2010-04-23T23:42:08Z Indexed on 2010/04/23 23:43 UTC
Read the original article Hit count: 220

Filed under:

gzip

|

fixed-width

|

file-io

|

files

|

compression

Assume I have a regular compressed fixed width file that is sorted on one of the fields. Given that I know the length of the records, I can use lseek to implement a binary search to records with fields that match a given value without having to read the entire file.

Now the difficulty is that the file is gzipped. Is it possible to do this without completely inflating the file? If not with gzip. is there any compression that supports this kind of behavior?

© Stack Overflow or respective owner

Related posts about gzip

Twitterbot/0.1,gzip(gfe),gzip(gfe)

as seen on Server Fault - Search for 'Server Fault'
I see a lot of this on my google app engine error log: 05-18 06:44AM 00.897 /NTp9 405 17ms 0cpu_ms 0kb Twitterbot/0.1,gzip(gfe),gzip(gfe) 128.242.241.133 - - [18/May/2010:06:44:00 -0700] "HEAD /NTp9 HTTP/1.1" 405 124 - "Twitterbot/0.1,gzip(gfe),gzip(gfe)" Should I do something for it?? >>> More
ASP.NET GZip Encoding Caveats

as seen on West-Wind - Search for 'West-Wind'
GZip encoding in ASP.NET is pretty easy to accomplish using the built-in GZipStream and DeflateStream classes and applying them to the Response.Filter property. While applying GZip and Deflate behavior is pretty easy there are a few caveats that you have watch out for as I found out today for… >>> More
How do I turn on gzip in Apache2?

as seen on Server Fault - Search for 'Server Fault'
I simply did : sudo aptitude install apache2 And that's how my server is set up. No extra modules, no nothing. I'm on ubuntu jaunty. >>> More
I can't update my system properly, "no package header" error

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
Every time I try to run sudo apt-get update or try running updates from the GUI interface I run into the following problem or something similar: Reading package lists... Error! E: Encountered a section with no Package: header E: Problem with MergeList /var/lib/apt/lists/archive.ubuntu.com_ubuntu_dists_precise_restricted_binary-i386_Packages E:… >>> More
Twitterbot/0.1,gzip(gfe),gzip(gfe)

as seen on Stack Overflow - Search for 'Stack Overflow'
I see a lot of this on my google app engine error log: 05-18 06:44AM 00.897 /NTp9 405 17ms 0cpu_ms 0kb Twitterbot/0.1,gzip(gfe),gzip(gfe) 128.242.241.133 - - [18/May/2010:06:44:00 -0700] "HEAD /NTp9 HTTP/1.1" 405 124 - "Twitterbot/0.1,gzip(gfe),gzip(gfe)" May I know what is this? >>> More

Related posts about fixed-width

Converting CSV to fixed-width in Notepad++?

as seen on Super User - Search for 'Super User'
Hi all, is there a way in notepad++ to convert a comma-separated file to fixed width columns? This feature exists in Ultraedit and explained here, but I am happy with my Motepad++ and I don't wanna pay for a UltraEdit. >>> More
Import exponetial fixed width format data into Excel

as seen on Super User - Search for 'Super User'
I've received a bunch of text data files consiting of Lots of records (30K/file) of 3 fields each of 5-place numbers in exponential format: s0.nnnnnEsee (where s is +/-, n is a digit and ee is the exponent (always 2 digit). When I open the file in Notepad, the format is perfectly uniform throughout… >>> More
Export an Excel spreadsheet to fixed-width text file?

as seen on Super User - Search for 'Super User'
Excel has the functionality to import fixed-width text files where it presents a dialog that lets you choose where the begins and ends of fields are which it puts into columns. Does it also have functionality where, given an existing spreadsheet, you can export to a fixed-width text file? If so… >>> More
Call an member function implementing the {{#linkTo ...}} helper from javascript code

as seen on Stack Overflow - Search for 'Stack Overflow'
I am trying to replace this navigation menu: <nav> {{#linkTo "nodes" }}<i class="icon-fixed-width icon-cloud icon-2x"></i>  {{t generic.nodes}} {{grayOut "(temporal)"}}{{/linkTo}} {{#linkTo "services" }}<i class="icon-fixed-width… >>> More
ExtJs - Set a fixed width in a center layout in a Panel

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi all, Using ExtJs. I'm trying to design a main which is divided into three sub panels (a tree list, a grid and a panel). The way it works is that you have a tree list (west) with elements, you click on an element which populates the grid (center), then you click on an element in the grid and that… >>> More