gzip several files and pipe them into one input

Posted by Daniel on Stack Overflow See other posts from Stack Overflow or by Daniel
Published on 2010-05-04T03:07:16Z Indexed on 2010/05/04 3:18 UTC
Read the original article Hit count: 208

Filed under:

gzip

|

pipes

I have this program that takes one argument for the source file and then it parse it. I have several files gzipped that I would like to parse, but since it only takes one input, I'm wondering if there is a way to create one huge file using gzip and then pipe it into the only one input.

© Stack Overflow or respective owner

Related posts about gzip

Twitterbot/0.1,gzip(gfe),gzip(gfe)

as seen on Server Fault - Search for 'Server Fault'
I see a lot of this on my google app engine error log: 05-18 06:44AM 00.897 /NTp9 405 17ms 0cpu_ms 0kb Twitterbot/0.1,gzip(gfe),gzip(gfe) 128.242.241.133 - - [18/May/2010:06:44:00 -0700] "HEAD /NTp9 HTTP/1.1" 405 124 - "Twitterbot/0.1,gzip(gfe),gzip(gfe)" Should I do something for it?? >>> More
ASP.NET GZip Encoding Caveats

as seen on West-Wind - Search for 'West-Wind'
GZip encoding in ASP.NET is pretty easy to accomplish using the built-in GZipStream and DeflateStream classes and applying them to the Response.Filter property. While applying GZip and Deflate behavior is pretty easy there are a few caveats that you have watch out for as I found out today for… >>> More
How do I turn on gzip in Apache2?

as seen on Server Fault - Search for 'Server Fault'
I simply did : sudo aptitude install apache2 And that's how my server is set up. No extra modules, no nothing. I'm on ubuntu jaunty. >>> More
I can't update my system properly, "no package header" error

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
Every time I try to run sudo apt-get update or try running updates from the GUI interface I run into the following problem or something similar: Reading package lists... Error! E: Encountered a section with no Package: header E: Problem with MergeList /var/lib/apt/lists/archive.ubuntu.com_ubuntu_dists_precise_restricted_binary-i386_Packages E:… >>> More
Twitterbot/0.1,gzip(gfe),gzip(gfe)

as seen on Stack Overflow - Search for 'Stack Overflow'
I see a lot of this on my google app engine error log: 05-18 06:44AM 00.897 /NTp9 405 17ms 0cpu_ms 0kb Twitterbot/0.1,gzip(gfe),gzip(gfe) 128.242.241.133 - - [18/May/2010:06:44:00 -0700] "HEAD /NTp9 HTTP/1.1" 405 124 - "Twitterbot/0.1,gzip(gfe),gzip(gfe)" May I know what is this? >>> More

Related posts about pipes

are posix pipes lightweight?

as seen on Stack Overflow - Search for 'Stack Overflow'
In a linux application I'm using pipes to pass information between threads. The idea behind using pipes is that I can wait for multiple pipes at once using poll(2). That works well in practice, and my threads are sleeping most of the time and only wake up if there is something to do for them. On… >>> More
Can I send email in Yahoo Pipes?

as seen on Stack Overflow - Search for 'Stack Overflow'
Can I and if so then how? >>> More
Using named pipes in Rails

as seen on Stack Overflow - Search for 'Stack Overflow'
I need to read and write some data through named pipes. I have tested it in a simple Ruby app, and it works nice. But I dont know, where should i put it in my Rails app? I have heard about Rake tasks, but i don't sure, is it right solution. I need to open a pipe-file, and listen to data. If there… >>> More
How to Aggregate Web Feeds with Yahoo! Pipes

as seen on Article City - Search for 'Article City'
Yahoo! Pipe is a free online web application which helps you combine many feeds into one. Sort it by your preference, filter it and finally present it. In other words, Yahoo! Pipes is a web mashup, w... [Author: Debbie Everson - Web Design and Development - March 30, 2010] >>> More
What are all the differences between pipes and message queues?

as seen on Stack Overflow - Search for 'Stack Overflow'
What are all the differences between pipes and message queues? Please explain both from vxworks & unix perspectives. I think pipes are unidirectional but message queues aren't. But don't pipes internally use message queues, then how come pipes are unidirectional but message queues are not? What… >>> More