I have a server with 3 oracle instances on it, and the file system is nfs with netapp. After shutdown the databases, one process for each database doesn't quit for a long time. Each kill -i doesn't work. I tried to truss, pfile it, the command through error.
And iostat shows there are lots of IO to the netapp server. So someone said the process was busy writing data to remote netapp server, and before the write complete, it won't quit. So what need to be done was just wait until all the IO was done.
After wait for longer time (about 1.5 hours), the processes exit.
So my question is: how can a process ignore the kill signal? As far as I know, if we kill -9, it will stop immediately. Do you encounter such situation kill -i doesn't kill the process right away?
TEST7-stdby-phxdbnfs11$ ps -ef|grep dbw0
oracle 1469 25053 0 22:36:53 pts/1 0:00 grep dbw0
oracle 26795 1 0 21:55:23 ? 0:00 ora_dbw0_TEST7
oracle 1051 1 0 Apr 08 ? 3958:51 ora_dbw0_TEST2
oracle 471 1 0 Apr 08 ? 6391:43 ora_dbw0_TEST1
TEST7-stdby-phxdbnfs11$ kill -9 1051
TEST7-stdby-phxdbnfs11$ ps -ef|grep dbw0
oracle 1493 25053 0 22:37:07 pts/1 0:00 grep dbw0
oracle 26795 1 0 21:55:23 ? 0:00 ora_dbw0_TEST7
oracle 1051 1 0 Apr 08 ? 3958:51 ora_dbw0_TEST2
oracle 471 1 0 Apr 08 ? 6391:43 ora_dbw0_TEST1
TEST7-stdby-phxdbnfs11$ kill -9 471
TEST7-stdby-phxdbnfs11$ ps -ef|grep dbw0
oracle 26795 1 0 21:55:23 ? 0:00 ora_dbw0_TEST7
oracle 1051 1 0 Apr 08 ? 3958:51 ora_dbw0_TEST2
oracle 471 1 0 Apr 08 ? 6391:43 ora_dbw0_TEST1
oracle 1495 25053 0 22:37:22 pts/1 0:00 grep dbw0
TEST7-stdby-phxdbnfs11$ ps -ef|grep smon
oracle 1524 25053 0 22:38:02 pts/1 0:00 grep smon
TEST7-stdby-phxdbnfs11$ ps -ef|grep dbw0
oracle 1526 25053 0 22:38:06 pts/1 0:00 grep dbw0
oracle 26795 1 0 21:55:23 ? 0:00 ora_dbw0_TEST7
oracle 1051 1 0 Apr 08 ? 3958:51 ora_dbw0_TEST2
oracle 471 1 0 Apr 08 ? 6391:43 ora_dbw0_TEST1
TEST7-stdby-phxdbnfs11$ kill -9 1051 471 26795
TEST7-stdby-phxdbnfs11$ ps -ef|grep dbw0
oracle 1528 25053 0 22:38:19 pts/1 0:00 grep dbw0
oracle 26795 1 0 21:55:23 ? 0:00 ora_dbw0_TEST7
oracle 1051 1 0 Apr 08 ? 3958:51 ora_dbw0_TEST2
oracle 471 1 0 Apr 08 ? 6391:43 ora_dbw0_TEST1
TEST7-stdby-phxdbnfs11$ truss -p 26795
truss: unanticipated system error: 26795
TEST7-stdby-phxdbnfs11$ pfiles 26795
pfiles: unanticipated system error: 26795