Configuring Hadoop logging to avoid too many log files
- by Eric Wendelin
I'm having a problem with Hadoop producing too many log files in $HADOOP_LOG_DIR/userlogs (the Ext3 filesystem allows only 32000 subdirectories) which looks like the same problem in this question: http://stackoverflow.com/questions/2091287/error-in-hadoop-mapreduce
My question is: does anyone know how to configure Hadoop to roll the log dir or…