Managing logs/warnings in Python extensions
Posted
by Dimitri Tcaciuc
on Stack Overflow
See other posts from Stack Overflow
or by Dimitri Tcaciuc
Published on 2010-06-08T05:47:47Z
Indexed on
2010/06/08
5:52 UTC
Read the original article
Hit count: 303
TL;DR version: What do you use for configurable (and preferably captured) logging inside your C++ bits in a Python project? Details follow.
Say you have a a few compiled .so
modules that may need to do some error checking and warn user of (partially) incorrect data. Currently I'm having a pretty simplistic setup where I'm using logging
framework from Python code and log4cxx
library from C/C++. log4cxx
log level is defined in a file (log4cxx.properties
) and is currently fixed and I'm thinking how to make it more flexible. Couple of choices that I see:
One way to control it would be to have a module-wide configuration call.
# foo/__init__.py import sys from _foo import import bar, baz, configure_log configure_log(sys.stdout, WARNING) # tests/test_foo.py def test_foo(): # Maybe a custom context to change the logfile for # the module and restore it at the end. with CaptureLog(foo) as log: assert foo.bar() == 5 assert log.read() == "124.24 - foo - INFO - Bar returning 5"
Have every compiled function that does logging accept optional log parameters.
# foo.c int bar(PyObject* x, PyObject* logfile, PyObject* loglevel) { LoggerPtr logger = default_logger("foo"); if (logfile != Py_None) logger = file_logger(logfile, loglevel); ... } # tests/test_foo.py def test_foo(): with TemporaryFile() as logfile: assert foo.bar(logfile=logfile, loglevel=DEBUG) == 5 assert logfile.read() == "124.24 - foo - INFO - Bar returning 5"
Some other way?
Second one seems to be somewhat cleaner, but it requires function signature alteration (or using kwargs and parsing them). First one is.. probably somewhat awkward but sets up entire module in one go and removes logic from each individual function.
What are your thoughts on this? I'm all ears to alternative solutions as well.
Thanks,
© Stack Overflow or respective owner