Library for Dataflow in C

Posted by msutherl on Stack Overflow See other posts from Stack Overflow or by msutherl
Published on 2010-06-17T20:03:11Z Indexed on 2010/06/18 15:13 UTC
Read the original article Hit count: 196

Filed under:

dataflow

How can I do dataflow (pipes and filters, stream processing, flow based) in C? And not with UNIX pipes.

I recently came across stream.py.

Streams are iterables with a pipelining mechanism to enable data-flow programming and easy parallelization.

The idea is to take the output of a function that turns an iterable into another iterable and plug that as the input of another such function. While you can already do this using function composition, this package provides an elegant notation for it by overloading the >> operator.

I would like to duplicate a simple version of this kind of functionality in C. I particularly like the overloading of the >> operator to avoid function composition mess. Wikipedia points to this hint from a Usenet post in 1990.

Why C? Because I would like to be able to do this on microcontrollers and in C extensions for other high level languages (Max, Pd*, Python).

* (ironic given that Max and Pd were written, in C, specifically for this purpose – I'm looking for something barebones)

Related posts about filter

How to filter the jqGrid data NOT using the built in search/filter box

as seen on Stack Overflow - Search for 'Stack Overflow'
I want users to be able to filter grid data without using the intrinsic search box. I have created two input fields for date (from and to) and now need to tell the grid to adopt this as its filter and then to request new data. Forging a server request for grid data (bypassing the grid) and setting… >>> More
PHP Filter, how to filter input array

as seen on Stack Overflow - Search for 'Stack Overflow'
I am using PHP filter to perfom basic sanitization and validation of form data. The principle problem I am having is that I mark my form up so that all the data is in one array for the POST input. e.g. form fields, page[name], page[slug], page[body], page[status], etc. Using the following: filter_input(INPUT_POST… >>> More
Modify the filter chain - Or select servlet to respond to request using filter

as seen on Stack Overflow - Search for 'Stack Overflow'
I am trying to use a filter to map requests. I am trying to do this for two reasons, firstly to dynamically generate URI's and have them mapped to the appropriate servlet and secondly to catch URI's which are not registered and handle them appropriately. So I'm using a catch-all filter to process… >>> More
Capturing and Transforming ASP.NET Output with Response.Filter

as seen on West-Wind - Search for 'West-Wind'
During one of my Handlers and Modules session at DevConnections this week one of the attendees asked a question that I didn’t have an immediate answer for. Basically he wanted to capture response output completely and then apply some filtering to the output – effectively injecting some additional… >>> More
Subterranean IL: Filter exception handlers

as seen on Simple Talk - Search for 'Simple Talk'
Filter handlers are the second type of exception handler that aren't accessible from C#. Unlike the other handler types, which have defined conditions for when the handlers execute, filter lets you use custom logic to determine whether the handler should be run. However, similar to a catch block,… >>> More

Developer IT