Adpatch Issues - Worker failed

While applying patch in Oracle E-Business Suite, we get issues like

   1. Worker failed patching
  
Whenever adpatch gives error and stops patching because some reason. First check the status of worker with ADCTRL  utility and then go through your adpatch log and get some hint why patch is failed, then try to fix accordingly. Each issue has specific approach for fixing it.

Worker failed patching:
While we check the adpacth log at location APL_TOP/ADMIN/SID/LOG/adpatch.log and we notice that adpatch failed because of worker has failed patching. We must immediately check the worker log at location APPL_TOP/ADMIN/SID/LOG/adworkxxx.log and check for the issue and fix it.

Once issue is fixed then follow below steps:

    Login with applmgr user
    Source the environment
    Start adctrl and restart the failed Worker.

.rf9 is the file which helps the adpatch to determine where patch was left patching. Patching information is held into tables AD_DEFERRED_JOBS and FND_INSTALLED_PROCESSES.

RT1223O applmgr@linuxrt64:~[101] adctrl
                     Copyright (c) 2002, 2012 Oracle Corporation
                        Redwood Shores, California, USA
                                 AD Controller
                                 Version 12.2.0
NOTE: You may not use this utility for custom development
      unless you have written permission from Oracle Corporation.
Your default directory is '/remote/app/applmgr/rt1223o/fs1/EBSapps/appl'.
Is this the correct APPL_TOP [Yes] ?
AD Controller records your AD Controller session in a text file
you specify.  Enter your AD Controller log file name or press [Return]
to accept the default file name shown in brackets.
Filename [adctrl.log] :
************* Start of AD Controller session *************
AD Controller version: 12.2.0
AD Controller started at: Sat Oct 04 2014 07:46:43
APPL_TOP is set to /remote/app/applmgr/rt1223o/fs1/EBSapps/appl
Reading product information from file...
Reading language and territory information from file...
Reading language information from applUS.txt ...
Enter the ORACLE username of Application Object Library [APPLSYS] :
Enter the ORACLE password of Application Object Library [APPS] :
AD Controller is verifying your username/password.
*** Not Edition Enabled User ***
The status of various features in this run of AD Controller is:
                                           <-feature in-="" version="">
Feature                          Active?   APPLTOP    Data model    Flags
------------------------------   -------   --------   -----------   -----------
CHECKFILE                        Yes       1          1             Y N N Y N Y
PREREQ                           Yes       6          6             Y N N Y N Y
CONCURRENT_SESSIONS              No        2          2             Y Y N Y Y N
PATCH_TIMING                     Yes       2          2             Y N N Y N Y
PATCH_HIST_IN_DB                 Yes       6          6             Y N N Y N Y
SCHEMA_SWAP                      Yes       1          1             Y N N Y Y Y
JAVA_WORKER                      Yes       1          1             Y N N Y N Y
CODELEVEL                        Yes       1          1             Y N N Y N Y

                    AD Controller Menu
     ---------------------------------------------------
     1.    Show worker status
     2.    Tell worker to restart a failed job
     3.    Tell worker to quit
     4.    Tell manager that a worker failed its job
     5.    Tell manager that a worker acknowledges quit
     6.    Restart a worker on the current machine
     7.    Exit



Enter your choice [1] : 2
Enter the worker number(s)/range(s) or 'all' for all workers,
or press [Return] to go back to the menu : 1
Status changed to 'Fixed, restart' for worker 1.
Review the messages above, then press [Return] to continue.
                    AD Controller Menu
     ---------------------------------------------------
     1.    Show worker status
     2.    Tell worker to restart a failed job
     3.    Tell worker to quit
     4.    Tell manager that a worker failed its job
     5.    Tell manager that a worker acknowledges quit
     6.    Restart a worker on the current machine
     7.    Exit



Enter your choice [1] :


Note:

What are the tables created while we start adpatch session?

AD_DEFERRED_JOBS and FND_INSTALLED_PROCESSES tables are created.

What does AD_DEFERRED_JOBS and FND_INSTALLED_PROCESSES tables contain?

FND_INSTALLED_PROCESSES: adpacth creates FND_INSTALL_PROCESSES table, assigns each worker unique ID with new row for each worker. This table is used to store the information about the job for each worker. Once all jobs are completed, worker shuts down and drops FND_INSTALL_PROCESSES table.

AD_DEFERRED_JOBS: This table holds the information of failed (workers which has failed its job). This table is created on starting the session of adpatch utility and drops once it is complete.

From which table ADCTRL gathers information?

FND_INSTALL_PROCESSES