MySQL on Linux out of memory

Posted by Sunrays on Server Fault See other posts from Server Fault or by Sunrays
Published on 2012-06-20T10:02:18Z Indexed on 2012/06/21 9:18 UTC
Read the original article Hit count: 486

Filed under:
|
|
|
|

OS: Redhat Enterprise Linux Server Release 5.3 (Tikanga)

Architecture: Intel Xeon 64Bit

MySQL Server 5.5.20 Enterprise Server advanced edition.

Application: Liferay.

My database size is 200MB. RAM is 64GB. The memory consumption increases gradually and we run out of memory. Then only rebooting releases all the memory, but then process of memory consumption starts again and reaches 63-64GB in less than a day.

Parameters detail:

key_buffer_size=16M

innodb_buffer_pool_size=3GB

inndb_buffer_pool_instances=3

max_connections=1000

innodb_flush_method=O_DIRECT

innodb_change_buffering=inserts

read_buffer_size=2M

read_rnd_buffer_size=256K

It's a serious production server issue that I am facing. What could be the reason behind this and how to resolve.

This is the report of 2pm today, after Linux was rebooted yesterday @ around 10pm.

Output of free -m

             total       used       free     shared    buffers     cached
Mem:         64455      22053      42402          0       1544       1164
-/+ buffers/cache:      19343      45112
Swap:        74998          0      74998



Output of vmstat 2 5

   procs -----------memory---------- ---swap-- -----io---- --system-- -----cpu------    
   r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa st
   0  0      0 43423976 1583700 1086616    0    0     1   173   22   27  1  1 98  0  0
   2  0      0 43280200 1583712 1228636    0    0     0   146 1265  491  2  2 96  1  0
   0  0      0 43421940 1583724 1087160    0    0     0   138 1469  738  2  1 97  0  0
   1  0      0 43422604 1583728 1086736    0    0     0  5816 1615  934  1  1 97  0  0
   0  0      0 43422372 1583732 1086752    0    0     0  2784 1323  545  2  1 97  0  0

Output of top -n 3 -b


top - 14:16:22 up 16:32,  5 users,  load average: 0.79, 0.77, 0.93
Tasks: 345 total,   1 running, 344 sleeping,   0 stopped,   0 zombie
Cpu(s):  1.0%us,  0.9%sy,  0.0%ni, 98.1%id,  0.1%wa,  0.0%hi,  0.0%si,  0.0%st
Mem:  66002772k total, 22656292k used, 43346480k free,  1582152k buffers
Swap: 76798724k total,        0k used, 76798724k free,  1163616k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND                     
 6434 mysql     15   0 4095m 841m 5500 S 113.5  1.3 426:53.69 mysqld                     
    1 root      15   0 10344  680  572 S  0.0  0.0   0:03.09 init                        
    2 root      RT  -5     0    0    0 S  0.0  0.0   0:00.01 migration/0                 
    3 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/0                 
    4 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/0                  
    5 root      RT  -5     0    0    0 S  0.0  0.0   0:00.01 migration/1                 
    6 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/1                 
    7 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/1                  
    8 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 migration/2                 
    9 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/2                 
   10 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/2                  
   11 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 migration/3                 
   12 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/3                 
   13 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/3                  
   14 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 migration/4                 
   15 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/4                 
   16 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/4                  
   17 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 migration/5                 
   18 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/5                 
   19 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/5                  
   20 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 migration/6                 
   21 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/6                 
   22 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/6                  
   23 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 migration/7                 
   24 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/7                 
   25 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/7                  
   26 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 migration/8                 
   27 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/8                 
   28 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/8                  
   29 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 migration/9                 
   30 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/9                 
   31 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/9                  
   32 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 migration/10                
   33 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/10                
   34 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/10                 
   35 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 migration/11                
   36 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/11                
   37 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/11                 
   38 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 migration/12                
   39 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/12                
   40 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/12                 
   41 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 migration/13                
   42 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/13                
   43 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/13                 
   44 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 migration/14                
   45 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/14                
   46 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/14                 
   47 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 migration/15                
   48 root      34  19     0    0    0 S  0.0  0.0   0:00.01 ksoftirqd/15                
   49 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/15                 
   50 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 migration/16                
   51 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/16                
   52 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/16                 
   53 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 migration/17                
   54 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/17                
   55 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/17                 
   56 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 migration/18                
   57 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/18                
   58 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/18                 
   59 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 migration/19                
   60 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/19                
   61 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/19                 
   62 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 migration/20                
   63 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/20                
   64 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/20                 
   65 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 migration/21                
   66 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/21                
   67 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/21                 
   68 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 migration/22                
   69 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/22                
   70 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/22                 
   71 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 migration/23                
   72 root      34  19     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/23                
   73 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/23                 
   74 root      10  -5     0    0    0 S  0.0  0.0   0:00.02 events/0                    
   75 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 events/1                    
   76 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 events/2                    
   77 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 events/3                    
   78 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 events/4                    
   79 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 events/5                    
   80 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 events/6                    
   81 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 events/7                    
   82 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 events/8                    
   83 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 events/9                    
   84 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 events/10                   
   85 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 events/11                   
   86 root      10  -5     0    0    0 S  0.0  0.0   0:00.01 events/12                   
   87 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 events/13                   
   88 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 events/14                   
   89 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 events/15                   
   90 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 events/16                   
   91 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 events/17                   
   92 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 events/18                   
   93 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 events/19                   
   94 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 events/20                   
   95 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 events/21                   
   96 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 events/22                   
   97 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 events/23                   
   98 root      10  -5     0    0    0 S  0.0  0.0   0:00.01 khelper                     
  615 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kthread                     
  643 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/0                   
  644 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/1                   
  645 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/2                   
  646 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/3                   
  647 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/4                   
  648 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/5                   
  649 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/6                   
  650 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/7                   
  651 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/8                   
  652 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/9                   
  653 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/10                  
  654 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/11                  
  655 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/12                  
  656 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/13                  
  657 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/14                  
  658 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/15                  
  659 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/16                  
  660 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/17                  
  661 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/18                  
  662 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/19                  
  663 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/20                  
  664 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/21                  
  665 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/22                  
  666 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kblockd/23                  
  667 root      17  -5     0    0    0 S  0.0  0.0   0:00.00 kacpid                      
  840 root      17  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/0                    
  841 root      18  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/1                    
  842 root      19  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/2                    
  843 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/3                    
  844 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/4                    
  845 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/5                    
  846 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/6                    
  847 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/7                    
  848 root      12  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/8                    
  849 root      13  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/9                    
  850 root      13  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/10                   
  851 root      13  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/11                   
  852 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/12                   
  853 root      16  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/13                   
  854 root      17  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/14                   
  855 root      18  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/15                   
  856 root      19  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/16                   
  857 root      19  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/17                   
  858 root      19  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/18                   
  859 root      19  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/19                   
  860 root      19  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/20                   
  861 root      19  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/21                   
  862 root      19  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/22                   
  863 root      19  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue/23                   
  866 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 khubd                       
  868 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kseriod                     
 1118 root      23   0     0    0    0 S  0.0  0.0   0:00.00 pdflush                     
 1119 root      15   0     0    0    0 S  0.0  0.0   0:00.11 pdflush                     
 1120 root      19  -5     0    0    0 S  0.0  0.0   0:00.00 kswapd0                     
 1121 root      19  -5     0    0    0 S  0.0  0.0   0:00.00 kswapd1                     
 1122 root      19  -5     0    0    0 S  0.0  0.0   0:00.00 aio/0                       
 1123 root      19  -5     0    0    0 S  0.0  0.0   0:00.00 aio/1                       
 1124 root      19  -5     0    0    0 S  0.0  0.0   0:00.00 aio/2                       
 1125 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 aio/3                       
 1126 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 aio/4                       
 1127 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 aio/5                       
 1128 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 aio/6                       
 1129 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 aio/7                       
 1130 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 aio/8                       
 1131 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 aio/9                       
 1132 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 aio/10                      
 1133 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 aio/11                      
 1134 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 aio/12                      
 1135 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 aio/13                      
 1136 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 aio/14                      
 1137 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 aio/15                      
 1138 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 aio/16                      
 1139 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 aio/17                      
 1140 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 aio/18                      
 1141 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 aio/19                      
 1142 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 aio/20                      
 1143 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 aio/21                      
 1144 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 aio/22                      
 1145 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 aio/23                      
 1308 root      11  -5     0    0    0 S  0.0  0.0   0:00.00 kpsmoused                   
 1566 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 ata/0                       
 1567 root      10  -5     0    0    0 S  0.0  0.0   0:00.27 ata/1                       
 1568 root      10  -5     0    0    0 S  0.0  0.0   0:02.39 ata/2                       
 1569 root      10  -5     0    0    0 S  0.0  0.0   0:00.07 ata/3                       
 1570 root      10  -5     0    0    0 S  0.0  0.0   0:00.72 ata/4                       
 1571 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 ata/5                       
 1572 root      10  -5     0    0    0 S  0.0  0.0   0:00.15 ata/6                       
 1573 root      10  -5     0    0    0 S  0.0  0.0   0:00.07 ata/7                       
 1574 root      10  -5     0    0    0 S  0.0  0.0   0:00.06 ata/8                       
 1575 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 ata/9                       
 1576 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 ata/10                      
 1577 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 ata/11                      
 1578 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 ata/12                      
 1579 root      10  -5     0    0    0 S  0.0  0.0   0:00.14 ata/13                      
 1580 root      10  -5     0    0    0 S  0.0  0.0   0:01.56 ata/14                      
 1581 root      10  -5     0    0    0 S  0.0  0.0   0:00.04 ata/15                      
 1582 root      10  -5     0    0    0 S  0.0  0.0   0:00.40 ata/16                      
 1583 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 ata/17                      
 1584 root      10  -5     0    0    0 S  0.0  0.0   0:00.11 ata/18                      
 1585 root      10  -5     0    0    0 S  0.0  0.0   0:00.03 ata/19                      
 1586 root      10  -5     0    0    0 S  0.0  0.0   0:00.02 ata/20                      
 1587 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 ata/21                      
 1588 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 ata/22                      
 1589 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 ata/23                      
 1590 root      13  -5     0    0    0 S  0.0  0.0   0:00.00 ata_aux                     
 1616 root      10  -5     0    0    0 S  0.0  0.0   0:17.20 scsi_eh_0                   
 1617 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 scsi_eh_1                   
 1668 root      11  -5     0    0    0 S  0.0  0.0   0:00.00 scsi_eh_2                   
 1669 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 qla2xxx_2_dpc               
 1670 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 scsi_wq_2                   
 1671 root      11  -5     0    0    0 S  0.0  0.0   0:00.00 fc_wq_2                     
 1672 root      12  -5     0    0    0 S  0.0  0.0   0:00.00 fc_dl_2                     
 1673 root      12  -5     0    0    0 S  0.0  0.0   0:00.00 scsi_eh_3                   
 1674 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 qla2xxx_3_dpc               
 1675 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 scsi_wq_3                   
 1676 root      11  -5     0    0    0 S  0.0  0.0   0:00.00 fc_wq_3                     
 1677 root      12  -5     0    0    0 S  0.0  0.0   0:00.00 fc_dl_3                     
 1728 root      12  -5     0    0    0 S  0.0  0.0   0:00.00 kstriped                    
 1829 root      10  -5     0    0    0 S  0.0  0.0   1:09.14 kjournald                   
 1857 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kauditd                     
 1891 root      11  -4 13008 1188  388 S  0.0  0.0   0:00.40 udevd                       
 4555 root      11  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/0                   
 4556 root      13  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/1                   
 4557 root      13  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/2                   
 4558 root      14  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/3                   
 4559 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/4                   
 4560 root      16  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/5                   
 4561 root      16  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/6                   
 4562 root      17  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/7                   
 4563 root      18  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/8                   
 4564 root      19  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/9                   
 4565 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/10                  
 4566 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/11                  
 4567 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/12                  
 4568 root      13  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/13                  
 4569 root      13  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/14                  
 4570 root      13  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/15                  
 4571 root      14  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/16                  
 4572 root      14  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/17                  
 4573 root      14  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/18                  
 4574 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/19                  
 4575 root      16  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/20                  
 4576 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/21                  
 4577 root      16  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/22                  
 4578 root      16  -5     0    0    0 S  0.0  0.0   0:00.00 kmpathd/23                  
 4579 root      18  -5     0    0    0 S  0.0  0.0   0:00.00 kmpath_handlerd             
 4734 root      13  -5     0    0    0 S  0.0  0.0   0:00.00 kjournald                   
 4736 root      10  -5     0    0    0 S  0.0  0.0   0:04.82 kjournald                   
 4744 root      13  -5     0    0    0 S  0.0  0.0   0:00.00 kjournald                   
 5238 root      RT   0 87584 3648 2768 S  0.0  0.0   0:03.60 multipathd                  
 5537 root      11  -4 27328  812  580 S  0.0  0.0   0:00.14 auditd                      
 5539 root       7  -8 81804  768  616 S  0.0  0.0   0:00.04 audispd                     
 5564 root      15   0  5904  632  512 S  0.0  0.0   0:00.10 syslogd                     
 5567 root      15   0  3800  432  344 S  0.0  0.0   0:00.01 klogd                       
 5579 root      18   0 10728  384  244 S  0.0  0.0   0:00.42 irqbalance                  
 5592 rpc       18   0  8048  584  464 S  0.0  0.0   0:00.00 portmap                     
 5625 root      18   0 11032  768  632 S  0.0  0.0   0:00.00 rpc.statd                   
 5681 root      11  -5     0    0    0 S  0.0  0.0   0:00.00 rpciod/0                    
 5682 root      11  -5     0    0    0 S  0.0  0.0   0:00.00 rpciod/1                    
 5683 root      12  -5     0    0    0 S  0.0  0.0   0:00.00 rpciod/2                    
 5684 root      12  -5     0    0    0 S  0.0  0.0   0:00.00 rpciod/3                    
 5685 root      12  -5     0    0    0 S  0.0  0.0   0:00.00 rpciod/4                    
 5686 root      12  -5     0    0    0 S  0.0  0.0   0:00.00 rpciod/5                    
 5687 root      12  -5     0    0    0 S  0.0  0.0   0:00.00 rpciod/6                    
 5688 root      12  -5     0    0    0 S  0.0  0.0   0:00.00 rpciod/7                    
 5689 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 rpciod/8                    
 5690 root      12  -5     0    0    0 S  0.0  0.0   0:00.00 rpciod/9                    
 5691 root      12  -5     0    0    0 S  0.0  0.0   0:00.00 rpciod/10                   
 5692 root      13  -5     0    0    0 S  0.0  0.0   0:00.00 rpciod/11                   

© Server Fault or respective owner

Related posts about linux

Related posts about mysql