Wednesday, November 11, 2015

Application errors

ORACLE APPLICATION ERRORS

 Oracle Apps R12 Login Page showing a blank page 
This issue is caused due to missing class files in the OA_HTML directory.
We can see the below error in oacore application.log file
javax.servlet.ServletException: oracle.classloader.util.AnnotatedClassNotFoundException: Missing class: _AppsLocalLogin
Please perform the below steps
1. Shutdown the application services
2. Compile the jsp’s manually using the below command
perl $FND_TOP/patch/115/bin/ojspCompile.pl –compile –flush -p 2
3. Check whether all the jsp’s are getting compiled successfully
4. Restart the application services
5. Clear the browser cache
6. Try to open the R12 Login page


OPMNCTL does not start after a clone (EBS R12)


Error

[ons-secure] Failed to open wallet (file:F:\R12\inst\apps\TEST_testdbs\certs\opmn) [default password] (28759)

Cause
This issue is caused by missing certificate files used to start OPMN and Apache
Solution
Copy the files to the following locations:
cp /Apache/Apache/conf/ssl.wlt/default/ewallet.p12 to  $INST_TOP/certs/Apache/ewallet.p12
cp /opmn/conf/ssl.wlt/default/ewallet.p12 to  $INST_TOP/certs/opmn/ewallet.p12
cp /opmn/conf/ssl.wlt/default/cwallet.sso to  $INST_TOP/certs/opmn/cwallet.sso
Now attempt to start opmn and its managed services

Patching Issues


While we apply patch get multiple issues like

Worker failed patching
Network failure
Pre-Requisite patch is missing

Whenever adpatch gives error and stops patching because some reason. First check the status of worker with ADCTRL  utility and then go through your adpatch log and get some hint why patch is failed, then try to fix accordingly. Each issue has specific approach for fixing it.

1) Worker failed patching:

While we check the adpacth log at location APPL_TOP/ADMIN/SID/LOG/adpatch.log and we notice that adpatch failed because of worker has failed patching. We must immediately check the worker log at location APPL_TOP/ADMIN/SID/LOG/adworkxxx.log and check for the issue and fix it.

Once issue is fixed then follow below steps:
Login with APPLMGR user
Source the environment
Start adpatch session again and will ask for continuation of previous session
Say yes
It will continue patching with previous session only where it was left.

.rf9 is the file which helps the adpatch to determine where patch was left patching. Patching information is held into tables AD_DEFERRED_JOBS and FND_INSTALLED_PROCESSES.

2) Network Issue:

While we are applying application patch and network is failed in between. In this case we have to apply the patch again with below steps:
Login with APPLMGR user
Source the environment
adpacth - It will ask for continue to previous session
Say yes

If still patching is not working, Please check the log at location $APPL_TOP/ADMIN/SID/LOG/adpatch.log and sometimes it shows some autopatch error. In this case, we must check the worker status with ADCTRL utility with option 1. It shows as worker is still under running.
This is the actual problem and will stop the worker with ADCTRL utility selecting option 3 as below:

AD Controller Menu
---------------------------------------------------

1. Show worker status

2. Tell worker to restart a failed job

3. Tell worker to quit

4. Tell manager that a worker failed its job

5. Tell manager that a worker acknowledges quit

6. Restart a worker on the current machine

7. Exit

But if you check the status of worker again with ADCTRL utility, It shows as worker is still running. Problem is still not resolved and for resolving the issues to continue with patching worker status should change to failed.
So in this case will get into ADCTRL utility menu and opt for option 4: Tell manager that a worker failed its job. Now if you check the worker status, it will change to failed.
You can start adpatch again and continue with session to patch where patch had stopped working.

3) Pre-Requisite patch is missing:

If patch is failed because of pre-requisite patch missing. In this case , we need to take the backup of AD_DEFERRED_JOBS, FND_INSTALLED_PROCESSES and restart directory(containing .rf9 file). Location of restart directory is $APPL_TOP/ADMIN/SID/restart.
Drop these tables and start with new session and apply the pre-requisite patch and check the log.
One pre-requisite patch is complete, recover the backed up tables and restart directory start adpatch session and continue with previous session.
Steps to apply pre-requisite patch:
1.      Stop the worker with ADCTRL utility.
2.      Backup FND_INSTALL_PROCESSES and AD_DEFERRED_JOBS tables.
3.      Backup the .rf9 file located at $APPL_TOP/admin/<SID>/restart directory.
4.      Drop FND_INSTALL_PROCESSES and AD_DEFERRED_JOBS tables.
5.       Apply the pre-requisite patch.
6.      Restore the backed up .rf9 file or restart directory.
7.      Restore the FND_INSTALL_PROCESSES table.
8.      Restore the AD_DEFERRED_JOBS table.
9.      Start adpatch, it will resume where it stopped previously.

What are the tables created while we start adpatch session?
AD_DEFERRED_JOBS and FND_INSTALLED_PROCESSES tables are created.

What does AD_DEFERRED_JOBS and FND_INSTALLED_PROCESSES tables contain?
FND_INSTALLED_PROCESSES: adpacth creates FND_INSTALL_PROCESSES table, assigns each worker unique ID with new row for each worker. This table is used to store the information about the job for each worker. Once all jobs are completed, worker shuts down and drops FND_INSTALL_PROCESSES table.

AD_DEFERRED_JOBS: This table holds the information of failed (workers which has failed its job). This table is created on starting the session of adpatch utility and drops once it is complete.

From which table ADCTRL gathers information?
FND_INSTALL_PROCESSES


Patching Issues/Sollutions/WorkArounds

During Patching, If you get different AD Worker Errors:

1. AD Worker error:
The following ORACLE error:
occurred while executing the SQL statement:
GRANT select on GV$LOGFILE to em_oam_monitor_role
Error occurred in file
/appltop/apps/ad/11.5.0/patch/115/sql/ademusr.sql

Work Around:


->connect DB / as sysdba
->grant select on GV_$LOGFILE to system with grant option.
->connect system/systempwd.
->grant select on GV$LOGFILE to em_oam_monitor_role.
-> Restart the failed worker using adctrl.

2.AD Worker error:
The following ORACLE error:ORA-12801: error signaled in parallel query server P000ORA-01452: cannot CREATE UNIQUE INDEX; duplicate keys foundoccurred while executing the SQL statement:CREATE UNIQUE INDEX ICX.ICX_TRANSACTIONS_U1 ON ICX.ICX_TRANSACTIONS(TRANSACTION_ID) LOGGING STORAGE (INITIAL 4K NEXT 104K MINEXTENTS 1MAXEXTENTS UNLIMITED PCTINCREASE 0 FREELIST GROUPS 4 FREELISTS 4 ) PCTFREE10 INITRANS 11 MAXTRANS 255 COMPUTE STATISTICS PARALLEL TABLESPACE ICXXAD Worker error:Unable to compare or correct tables or indexes or keysbecause of the error above

Work Around

->Execute the following SQL to prevent errors during Patch Application through adpatch:
->SELECT TRANSACTION_ID, count(*)FROM ICX.ICX_TRANSACTIONSGROUP BY TRANSACTION_IDHAVING count(*)>1
->If the Above query returns any Row then Please execute the following SQL :

->$ICX_TOP/sql (named ICXDLTMP.sql).

While applying an apps patch following error occurs:
ORA-28000 account locked on the apps account
  Reason:
The profile option "AD_PATCH_MONITOR_PROFILE" has not been set to "unlimited" and is still set at the default value of "3".
Solution:
1. Login as SYS or SYSTEM and run:
SQL> alter profile AD_PATCH_MONITOR_PROFILE limit failed_login_attempts unlimited;
SQL> alter profile default limit failed_login_attempts unlimited password_lock_time 1/1440;
SQL> alter user apps account unlock;
2. Retest for the issue.
Note: Examples of queries that can be used to check the APPS user account :
SQL> select profile , resource_name, limit from dba_profiles where resource_name like '%FAIL%';
SQL> select username, profile from dba_users where username='APPS';
SQL> select username, profile from dba_users where username='APPLSYS';
Reference Metalink id: 420001.1

How to Apply an 11i Patch When adpatch is Already Running



Step 1 Execute adctrl utility and shutdown the workers.
Step 2 Backup the FND_INSTALL_PROCESSES and AD_DEFERRED_JOBS table which is owned by the APPLSYS
schema
Step 3 Backup the .rf9 files located in $APPL_TOP/admin//restart directory.
a. cd $APPL_TOP/admin/
b. mv restart restart_back
c. mkdir restart
Step 4 Drop the FND_INSTALL_PROCESSES table and the AD_DEFERRED_JOBS table.
Step 5 Apply the new patch.
Step 6 Restore the .rf9 files located in $APPL_TOP/admin//restart_back
directory.
a. cd $APPL_TOP/admin/
b. mv restart restart_c. mv restart_back restart
Stop 7 Restore the FND_INSTALL_PROCESSES and AD_DEFERRED_JOBS table which is owned by the APPLSYS
schema.
Step 8 Re-create synonyms
a. sqlplus apps/apps
b. create synonym AD_DEFERRED_JOBS for APPLSYS.AD_DEFERRED_JOBS;
c. create synonym FND_INSTALL_PROCESSES FOR
APPLSYS.FND_INSTALL_PROCESSES;
Step 9 Start adpatch, it will resume where it stopped previously.
Conclusion:
If you have wasted your time in main patch near about 8 to 10hrs. then you should take backup of FND_INSTALL_PROCESSES,AD_DEFFERED_JOBS and baclup of restart files which extension is .bk9,rf9 and these files located in $APPL_TOP/admin/sid/restart before quit the workers and then apply the pre-req. of patch and when you will go for main patch then before start the main patch restore the tables and backup files.

CONCURRENT MANAGERS ISSUES:

Concurrent Manager showing status “System Hold, Fix Manager before resetting counters”.

Recently after EBS upgrade to 12.1.3 CM were not functional and was showing status “System Hold, Fix Manager before resetting counters”.
Issue:
Concurrent Manager showing status “System Hold, Fix Manager before resetting counters”.

Solution:

To implement the solution, please execute the following steps:

1. Stop all middle tier services including the concurrent managers.
Please make sure that no FNDLIBR, FNDSM, or any dead process is
running.

2. Go to cd $FND_TOP/bin
$ adrelink.sh force=y link_debug=y “fnd FNDLIBR”
$ adrelink.sh force=y link_debug=y “fnd FNDFS”
$ adrelink.sh force=y link_debug=y “fnd FNDCRM”
$ adrelink.sh force=y link_debug=y “fnd FNDSM”

3. Run the CMCLEAN.SQL script from the referenced note below (don’t forget to commit).
Note 134007.1 CMCLEAN.SQL – Non Destructive Script to Clean Concurrent Manager Tables

4. Start the concurrent manager.

5. Retest the issue.

Cannot View Concurrent Manager Log And Out Files in R12 ?

Error Message:
'APP-FND-1634-The log file &FILENAME does not exist or this program is restricted from reading it'
If the concurrent request has completed then please contact your system administrator. APP-FND-1636 NO REPORT AVAILABLE FOR THIS CONCURRENT PROCESS.

Cause:
Profile Option 'RRA:enabled' setting is not correct.

Solution:
To implement the solution, please execute the following steps:
1. Shut down managers and verify no FNDLIBR processes are running.
2. Go into the responsibility: System Administrator
3. Navigate to profile/system
4. Search for profile 'RRA:enabled' and set the value to Yes.
5. Save
6. Restart the managers
7. Retest the issue.

Cleaning Concurrent Manager Tables
Non Destructive Script to Clean Concurrent Manager Tables

cmclean.sql

The Document Id to get the script from metalink is 134007.1

Ensure that No FNDLIBR processes are running as detailed within the Troubleshooting 
 Note 104541.1 and that the Concurrent Manageris down.

  You need to issue a commit once the script is run for the changes
  to take effect.




The Concurrent requests are in Pending status appears / No Concurrent Manager defined to execute the request

Problem Description : 

The Concurrent request are in Pending status appears / No Concurrent Manager defines to execute the request

The submitted concurrent request are in pending state. The logs states, No Concurrent Manager is running to attend the job. When checked the Admin console for concurrent manager, we found that Internal Concurrent Manager and standard manager were not active.
 ------------------------******************-----------------------------------------

Error from $APPLCSF - 

Shutting down Internal Concurrent Manager : 10-JUL-2012 06:14:04
The visr12_0709@visr12 internal concurrent manager has terminated successfully - exiting. 
--------------------------*****************------------------------------------------

When I checked the app node for FNDLIBR  process, the process was running but OAM console was showing it as terminated. So, obviously something was not right. So I decided to bounce the concurrent manager 

Possible cause for Inactive OR No Manager

i) No manager is defined to run the request
or
ii) All managers are locked by run-alone requests
or
iii) Concurrent Manager Service is down
or
iv) No concurrent manager process because of workshift
To check Work Shift for any Concurrent Manager From System Administrator responsibility > Concurrent > Manager > Define > Work Shifts > Processes

Solution :
=======

[oracle@appsnode log]$ adcmctl.sh  stop apps/apps 
You are running adcmctl.sh version 120.17.12010000.5
Shutting down concurrent managers for visr12 ...
ORACLE Password:
Submitted request 400227 for CONCURRENT FND SHUTDOWN
adcmctl.sh: exiting with status 0
adcmctl.sh: check the logfile /u01/app/oracle/visr12/inst/apps/visr12_appsnode/logs/appl/admin/log/adcmctl.txt for more information ...

-- starting the Concurrent Manager with diag=Y for detailed info [oracle@appsnode log]$ adcmctl.sh  start apps/apps diag=Y 
You are running adcmctl.sh version 120.17.12010000.5
Starting concurrent manager for visr12 ...
Starting visr12_0710@visr12 Internal Concurrent Manager
Default printer is noprint
adcmctl.sh: exiting with status 0
adcmctl.sh: check the logfile /u01/app/oracle/visr12/inst/apps/visr12_appsnode/logs/appl/admin/log/adcmctl.txt for more information ...

[oracle@appsnode log]$ adcmctl.sh  status apps/apps 
You are running adcmctl.sh version 120.17.12010000.5
Internal Concurrent Manager is Active.
adcmctl.sh: exiting with status 0


[oracle@appsnode log]$ ps -ef | grep FNDLIBR 
oracle    7650  7644  0 06:39 pts/1    00:00:03 FNDLIBR                                                    
oracle    7924  7759  0 06:55 ?        00:00:02 FNDLIBR                                                                                                                                                               
oracle    7925  7759  0 06:55 ?        00:00:02 FNDLIBR                                                                                                                                                               
oracle    7926  7759  0 06:55 ?        00:00:02 FNDLIBR                                                                                                                                                               
oracle    7931  7759  0 06:55 ?        00:00:00 FNDLIBR              

Once started I opened Concurrent Request form, from OAM > system administrator responsibility > concurrent > request option. 
Once the form is opened Navigate to +Concurrent > Manager > Administrator and double click on it to open another form. Here you will see Administer Concurrent Manager screen, from which you can identify running or pending requests.

https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgHD5VObodEeE7dwDNFlXvHDcOYjlDf9u7wXQvnpTf0HxgfBCx-sk8Fy3S3cJh2In7hEWSHn8MDz_jxaI0IfKr_znsvEI7x42aOQihUFElBeKghv8a0SJkHeIvBR5lrQP6k1OIMey5bphk/s1600/temp.png

for more detailed logs, pls check $LOG_HOME/appl/conc OR $APPLCSF


TROUBLESHOOTING CONCURRENT MANAGER STARTUP PROBLEMS

 IMPORTANT NOTE - Some of these steps are destructive and should not be
run on a Production system without advice from Oracle Support.

INTRODUCTION

This note is designed to help diagnose and resolve problems starting the
Oracle Applications Concurrent Manager. There can be many issues which
prevent the CCM from starting and the errors may not always indicate the true problem.

CHECKS TO MAKE

Check the log files for any reported errors. The default name for the Internal Manager log file is 'CM_.log'
 on NT or >ManagerName>.mgr on Unix. Also check any other manager
log files in the $APPLCSF/$LOG directory for relevant messages. Do these
 errors point to any obvious places to check (e.g. database not running,
 TNS alias incorrect)? If these files do not exist at all, there may be
permission problems that prevent processes from writing
files to the proper directories.

2) Ensure that you are logged in as the 'applmgr' (or equivalent) user
on Unix, or if on NT that the service is being started by the 'applmgr'
(or equivalent) user.

3) If you are getting errors such as 'establish ICM unable to insert ICM record

APP-1167 APP-1244 Oracle error 1631 in insert_icm_record' Check your
database's tablespace for the FND tables to ensure you enough free space
 to create the next extent. Also check the FND tables to ensure no
table has hit the maximum number of extents.

4) Log in to SQLPLUS as database user "apps".

Verify that view fnd_v$process exists: SELECT view_name

FROM all_views WHERE view_name LIKE '%V$%';

If the view is missing or invalid, rebuild it. From the operating system, as the applmgr user type:

FNDLIBR FND FNDCPBWV applsys/fnd SYSADMIN 'System Administrator' SYSADMIN
or as the applsys user run the following SQL statement

CREATE VIEW fnd_v$process AS
( SELECT P.Addr, P.Pid, S.Process Spid, S.Osuser Username, P.Serial#,
S.Terminal, S.Program, P.Background, P.Latchwait, S.Lockwait FROM
V$process P, V$session S WHERE P.Addr = S.Paddr );

5) Close down all Concurrent Manager processes and clear database tables/log
files. This process will remove all history of Concurrent Jobs and
remove all scheduled jobs. Please contact Oracle Support for advice when
 doing this to a Production installation.

Check there are no FNDLIBR, FNDCRM or other Concurrent Manager processes
 running. This can be done via the Concurrent Manager-->Administer
screen, or from the operating system - Note 68993.1 has a list of the
process names to look for.

In SQLPLUS run the following SQL TRUNCATE TABLE fnd_concurrent_processes;

UPDATE fnd_concurrent_requests set phase_code = 'C', status_code = 'X'
where status_code = 'T'; UPDATE fnd_concurrent_queues SET
running_processes = 0; SELECT concurrent_queue_name, control_code,
running_processes, max_processes FROM fnd_concurrent_queues;

The control_codes should be 'E' for deactivated managers, blank for all others
except FNDICM which should be 'X'. You will need to update the table
manually if you find any exceptions to these values. For example:-

UPDATE fnd_concurrent_queues SET control_code = 'X' WHERE concurrent_queue_name = 'FNDICM';

c) Delete all log and output files in FND_TOP/log, APPLCSF/log and APPLCSF/out if these files are no longer needed.




Apache Common Issues
General Information to Troubleshoot Apache Issues.
1)If you mistype any directive in Apache (httpd.conf or any conf file), Apache will not start & it will not write even in error_log. In these case it will report any error message to file
$COMMON_TOP/admin/log/$CONTEXT_NAME/adapcctl.txt

So first check in the above file
2)Found *.pid file in Apache_Top/Apache/logs/ even after bounce of an Apache web server (When Apache starts it creates .pid file in logs directory and when you shutdown apache it cleans this .pid file). So if this file is already there then Apache will not start.
Fix: Simply move this file

3)Could not bind port (Port already in Use) or Sometimes apache and concurrent Manager will interchange their port no.’s while starting results error and both of them will not up
Fix: To overcome this up the services in this manner
1)Listener
2)Apache web server
3)Concurrent manager
4)adstrtal.sh

4)Error 500 – Internal server error
Fix: 1) Clear Cache (Application Server Cache)and start the services
5)If there are no error messages in error_log or error_log_pls
then there might be issues in starting Jserv component of web server (which caters Java requests by mod_jserv)
6)If you don’t know port number of your web server you can check it in file $IAS_ORACLE_HOME/Apache/Apache/conf/httpd.conf with directive Listen & Port

7)Once you are able to access
http://hostname.domainname:port and if you are getting any error message that means your web server (Core Apache) is working but there are various components called as modules and there may be issues with those modules which we will check these modules . few modules of our interest are
-mod_jserv
-mod_pls
-mod_oprocmgr
-mod_ossl (If you have ssl enabled on web server)
-mod_osso (If single sign on server is enabled on web server)

8)Once in a while adapcctl.sh start will not work then ultimate you have to go and invoke apachectl script file in Apache top/apache/bin to start Apache webserver.
09)Error : Your session is no longer valid while trying to loging to applications.
The issue is resolved by changing the profile option session_cookie_domain to null from
domain.com
10)HTTP-403 forbidden message after entering the username and password in the “Apps Logon Links” page. [Not authorised to view this page]
Check for Apps password in $APACHE_TOP/modplsql/cfg/wdbsvr.app ,Comment out custom_auth entry in $APACHE_TOP/modplsql/cfg/wdbsvr.app and bounce apache.

11)Error message: You have insufficient privileges for the current operation.
Verify and update SESSION_COOKIE_DOMAIN in ICX_parameters if it is wrong.
Example :
update icx_parameters set SESSION_COOKIE_DOMAIN=’NEW_VALUE’ where SESSION_COOKIE_DOMAIN=’OLD_VALUE’
12)AppsLocalLogin?.jsp page error outs….
  • Edit the $IAS_ORACLE_HOME/Apache/Jserv/etc/jserv.properties
  • Set wrapper.bin.parameters=-DLONG_RUNNING_JVM=false
  • add the line wrapper.bin.parameters=-DCACHEMODE=LOCAL
  • Restarted Apache for these changes to take effect and retested the issue
13) Login to the applications URL fails with
500 Internal server Error
java.lang.NoClassDefFoundError at
oracle.apps.fnd.sso.AppsLoginRedirect.AppsSetting(AppsLoginRedirect.java:126) at
oracle.apps.fnd.sso.AppsLoginRedirect.init(AppsLoginRedirect.java:170) at com.evermind[Oracle
Containers for J2EE 10g (10.1.3.0.0)
].server.http.HttpApplication.loadServlet(HttpApplication.java:2231) at com.evermind[Oracle
Containers for J2EE 10g (10.1.3.0.0)
].server.http.HttpApplication.findServlet(HttpApplication.java:4617) at com.evermind[Oracle
Containers for J2EE 10g (10.1.3.0.0)
].server.http.HttpApplication.findServlet(HttpApplication.java:4541) at com.evermind[Oracle
Containers for J2EE 10g (10.1.3.0.0)
Performed the below steps, but it did not resolved the issue
1) Bounced Apache server, cleared cache and validated ports
2) Bounced all Middle tier services and killed defunct processes
3) Bounced Unix Server

Solution
=======
Java object Caching Configuration parameter was Enabled in oc4j.properties
$INST_TOP/ora/10.1.3/j2ee/oacore/config
Disabled LONG_RUNNING_JVM=false from True
Bounced Apache server and could login to the applications URL without issues

ISSUES AND SOLUTIONS

ISSUE 1:
Description
When Apache script adapcctl.sh is issued.It shows that Apache is started.On checking the status Apache is stopped
Cause
The error log file in the folder
cd $APACHE_TOP/Apache/logs
Showed
fopen: No such file or directory httpd: could not log pid to file /var/opt/_/Apache/logs/httpd_pls.pid
SOLUTION 1
Created the missing directories /_/Apache/logs under /var/opt folder
Bounced Apache
**********************************************************************
ISSUE 2:
Description
oacore was not comming up in the configurator node.
opmnctl status
ias-component process-type pid status
OC4J oacore N/A Down
OC4J oacore N/A Down
OC4J oacore N/A Down
OC4J oacore N/A Down
Cause
Check the oacore error log.
Example:
Below Log file gives root cause. //mtlog/_/logs/ora/10.1.3/opmn/oacore_default_group_2/oacorestd.err
14:11:56 Error initializing server: //inst/apps/_/ora/10.1.3/j2ee/oacore/config/server.xml,
Fatal error at line 70 offset 1 in file://inst/apps/_/ora/10.1.3/j2ee/oacore/config/server.xml: .:
XML-20100: (Fatal Error) Expected ‘EOF’.
SOLUTION 2
Edit the /sid/inst/apps/SID_hostname/ora/10.1.3/j2ee/oacore/configserver.xml file and remove the extra line in the file. Restart and check oacore will be starting. This sudden change in server.xml seems to be because of a bug.
Bug – 6702510
************************************************************************
ISSUE 3
AppsLocalLogin?.jsp page was displaying errors
Cause
Extract from the Jserv log file =========================== [27/02/2008 16:57:14:447 CST] weboamLocal/oracle.apps.fnd.oam. servlet.ui.OAMServlet:
Sucessfully initialize oaosu.OAMServlet [27/02/2008 16:57:14:447 CST] Servlet Zone rootauohstrzt11 initia lization complete [27/02/2008 16:57:15:101 CST]
Creating noun for: oracle.jsp.JspServlet [27/02/2008 16:57:15:102 CST] Creating noun for: AppsLocalLogin?.jsp
[27/02/2008 16:57:15:120 CST] oracle.jsp.JspServlet: init [27/02/2008 16:57:28:066 CST] Creating noun for: oracle.jsp.JspServlet
[27/02/2008 16:57:28:067 CST] Creating noun for: AppsLocalLogin?.jsp [27/02/2008 16:57:28:078 CST] oracle.jsp.JspServlet: init
[27/02/2008 16:57:29:753 CST] JspServlet?: unable to dispatch to requested page: Exception:java.lang.NoClassDefFoundError
SOLUTION 3:
Edited the $IAS_ORACLE_HOME/Apache/Jserv/etc/jserv.properties
a) Set wrapper.bin.parameters=-DLONG_RUNNING_JVM=false
b) Add the line wrapper.bin.parameters=-DCACHEMODE=LOCAL
c) Restarted Apache for these changes to take effect and retested the issue
********************************************************************
ISSUE 4
New Message when starting Apache using adapcctl.sh start
Cause
It takes 7/10 minutes to clear this cache directory if present
apache Web Server Listener is not running.
Starting Apache Web Server Listener (dedicated HTTP) …
Removing gantt cache directory
/ppomwi/applmgr/r12/apps/apps_st/comn/webapps/oacore/html/cabo/images/cache
Successfully removed the gantt cache directory:/tcge1i/applmgr/common/html/cabo/images/cache/gantt
Apache Web Server Listener (PLSQL) is not running.
Starting Apache Web Server Listener (dedicated PLSQL) …
SOLUTION 4
$COMMON_TOP/webapps/oacore/html/cabo/images/cache
Wait for atleast 7 to 10 minutes and this cache directory will be cleared and Apache will be started successfully
***********************************************************************
ISSUE 5
Apache server is up and running.
But adapcctl.sh status shows
adapcctl.sh version 115.54
Apache Web Server Listener is not running. Apache Web Server Listener (PLSQL) is not running.
adapcctl.sh: exiting with status 1

Cause
Incorrect Lock file path given in httpd.conf
LockFile? $APACHE_TOP/Apache/log/PPOMWI_httpd.lock
and Incorrect path given in adapcctl.sh script.
SOLUTION 5:
Modified the path of lock file in $APACHE_TOP/Apache/conf/httpd.conf file.
LockFile? /var/opt/SID_/httpd.lock
and Modified the path of adapcctl.sh file by commenting the wrong path
************************************************************************
ISSUE 6

After selecting the E-Business home page got internal server error Internal Server Error The server encountered an internal error or misconfiguration and was unable to complete your request. Please contact the server administrator, and inform them of the time the error occurred, and anything you might have done that may have caused the error.
More information about this error may be available in the server error log.

Cause
Found that all the properties files as below
jserv.properties jserv_restrict.properties zone.properties zone_restrict.properties
were pointing to a dbc file name _.dbc
which was not physically present at the path
/sid/applmgr/11510/fnd/11.5.0/secure/_
$ cd //applmgr/11510/fnd/11.5.0/secure/_
$ ls .dbc
SOLUTION 6:
copied the file PROD.dbc
which was physically present at path
//applmgr/11510/fnd/11.5.0/secure/_
to the dbc file name which was being pointed by all the properties files
This resolved the issue.
**********************************************************************
ISSUE 7
Instance is very slow / inaccessible with a warning on login page:
Warning
Low-level logging is currently enabled. Your application will not perform as well while Low-level logging is on.
Cause
Logging was enabled through profile values:
FND: Debug Log Enabled — Yes
FND: Debug Log Level — Statement
FND: Debug Log Module — %
SLA: Enable Diagnostics — Yes
FND Validation Level — Error
SOLUTION 7
1. Change these values to:
FND: Debug Log Enabled — No
FND: Debug Log Level — ( Blank )
FND: Debug Log Module — ( Blank )
SLA: Enable Diagnostics — No
FND Validation Level — None
2. Bounce Apache on all the MTs and clear Apache cache.
*********************************************************************
ISSUE 8
Login to the applications URL fails with
500 Internal Server Error java.lang.NoClassDefFoundError at oracle.apps.fnd.sso.AppsLoginRedirect.AppsSetting(AppsLoginRedirect?.java:126) at oracle.apps.fnd.sso.AppsLoginRedirect.init(AppsLoginRedirect?.java:170) at com.evermind[Oracle Containers for J2EE? 10g (10.1.3.0.0) ].server.http.HttpApplication.loadServlet(HttpApplication?.java:2231) at com.evermind
Performed the below steps, but it did not resolved the issue
1) Bounced Apache server, cleared cache and validated ports
2) Bounced all Middle tier services and killed defunct processes
3) Bounced Unix Server

Cause
No Cause Entered
SOLUTION 8
Java object Caching Configuration parameter was Enabled in oc4j.properties $INST_TOP/ora/10.1.3/j2ee/oacore/config
Disabled LONG_RUNNING_JVM=false from True
Bounced Apache server and could login to the applications URL without issues
Java Caching is a mechanism used to improve performance by storing data in the Middle Tier JVM memory, instead of retrieving the data from the database every time it is requested.
***********************************************************************
ISSUE 9
When trying to access the URL (Either Big IP or the node level), it hangs for a long time and getting redirected to a different URL and gives a blank page. For example, When try to access the ipayments URL which is hosted on node2, it hangs for a long time and its getting redirected towards the Sales URL which is hosted on node3, and displays a blank page.

Cause
All the host reference and the URL directives are pointing towards node3 and sales URL respectively, in the below files. Hence every attempt tries to launch the sales URL and get fails as the apache configuration files and parameters are pointing towards the correct one.
jserv.conf forms.properties zone.properties jserv.properties
SOLUTION 9
Stop Apache. Edit the files jserv.conf, forms.properties, zone.properties, jserv.properties, jserv.conf to replace the host reference and the URL directives to the correct one (In our case, its node3 . Clear the cache and restart the Apache.
ISSUE 10
Apache login issues occurs in multi MT environment. Unable to login to oracle applications.

Cause
Issue due to distributed cache.
SOLUTION 10
Set is_distributed to false in javacache.xml Bounce Apache.
ISSUE 11
Apache server is down. Apache logfile did not provide useful information.
Started the Apache server, but the Apache Web listener did not started.
1) Verified no log files (Apache,Jserv) crossed 2GB limit. error_log, access.log, mod_jserv
2) Veified that the port is listening (netstat -an |grep ) Apache port(httpd.conf), pls listener(httpd_pls.conf)
3) Verified that the Apache and Jserv configuration files are not changed recently httpd.conf & Jserv.conf
4) Shutdown all the Middle tier services and check for ipcs (semaphores) did not resolve the outage.
$ ipcs on application middle tier as Application user ap

Cause
No Cause Entered
SOLUTION 11
Rebooted the server and started the services. All services came back normal.
************************************************************************
ISSUE 12
Unable to login to the home page URL. Login fails with the error:
Error Page You have encountered an unexpected error. Please contact the system administrator for assistance.
Click here for exception details
Checks:
Upon clicking the link, can observe the error:
oracle.apps.fnd.framework.OAException: Application: FND, Message Name: SQL_PL SQL_ERROR. Tokens: ROUTINE = createSession(int)(userId=6,sessionMode=’null’,’2D8 FCCC57459B66EE040558CDBC6118E44964630721347149122084914143412?’); REASON = java.s ql.SQLException: ORA-01422: exact fetch returns more than requested number of ro ws ORA-06512: at “APPS.FND_SESSION_MANAGEMENT”, line 295 ORA-06512: at “APPS.FND_SESSION_MANAGEMENT”, line 455 ORA-06512: at line 1 ; ERRNO = 1422;
Cause
FND_NODES table was updated with the same server_id for all Nodes.
SOLUTION 12
Update the table FND_NODES with correct server_ids for all nodes as in $FND_TOP/secure/sid_host/sid.dbf
Bounced apache on all apache nodes.
and Run select node_name, server_id from fnd_nodes;
to confirm the values.
Below is the example for the solution:
Found three hosts using same server_id:
SQL> select node_name, server_id from fnd_nodes; NODE_NAME SERVER_ID
AUOHSACPS06 2D8FCCC57459B66EE040558CDBC6118E44964630721347149122084914143412
AUOHSACPS03 2D8FCCC57459B66EE040558CDBC6118E44964630721347149122084914143412
AUOHSACPS02 2D8FCCC57459B66EE040558CDBC6118E44964630721347149122084914143412
reset server_id with original server_id from each hosts .dbc file @ $FND_TOP/secure:
SQL> select node_name, server_id from fnd_nodes; NODE_NAME SERVER_ID
AUOHSACPS06 2D8FF21843830F82E040558CDBC6195C27690802237516122831445560236127
AUOHSACPS03 2D90005D5A13C774E040558CDBC61D9436546148971863330582284123371818
AUOHSACPS02 2D8FCCC57459B66EE040558CDBC6118E44964630721347149122084914143412
************************************************************************
ISSUE 13
Users getting ‘404 page not found errors’ when tyring to access the URL
(OR)
Getting Exception in thread “main” java.lang.ClassFormatError: Truncated class file
(OR)
adstrtal.sh or adstpall.sh is throwing below error message
You are running adstrtal.sh version 115.16
Exception in thread “main” java.lang.ClassFormatError: oracle/apps/ad/context/AppsContext (Truncated class file) at java.lang.ClassLoader.defineClass0(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader?.java:539) at java.security.SecureClassLoader.defineClass(SecureClassLoader?.java:123) at java.net.URLClassLoader.defineClass(URLClassLoader?.java:251) at java.net.URLClassLoader.access$100(URLClassLoader?.java:55) at java.net.URLClassLoader$1.run(URLClassLoader?.java:194) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader?.java:187) at java.lang.ClassLoader.loadClass(ClassLoader?.java:289) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:274) at java.lang.ClassLoader.loadClass(ClassLoader?.java:235) at java.lang.ClassLoader.loadClassInternal(ClassLoader?.java:302) at oracle.apps.ad.autoconfig.ServiceControl.(ServiceControl?.java:319) at oracle.apps.ad.autoconfig.ServiceControl.main(ServiceControl?.java:662) Check logfile //applmgr/common/admin/log/_/08061104.log for details
Exiting with status 1
(OR)
[06/08/2007 11:03:12:181] (ERROR) an error returned handling request via protocol “ajpv12″ [06/08/2007 11:03:12:181] (EMERGENCY) ajp12: can not connect to host 140.85.188.36:20021 [06/08/2007 11:03:13:184] (EMERGENCY) ajp12: can not connect to host 140.85.188.36:20021 [06/08/2007 11:03:15:038] (EMERGENCY) ajp12: auth did not receive challenge size [06/08/2007 11:03:15:038] (EMERGENCY) ajp12: auth fail
Cause
Extract from the JVM log file: //product/iAS/Apache/Jserv/logs/jvm/OACoreGroup.0.stderr
Exception in thread “main” java.lang.ClassFormatError: Truncated class file at org.apache.jserv.JServServletManager.load_init(JServServletManager?.java:765) at org.apache.jserv.JServServletManager.loadServlet(JServServletManager?.java:659) at org.apache.jserv.JServServletManager.loadStartupServlets(JServServletManager?.java:789) at org.apache.jserv.JServServletManager.init(JServServletManager?.java:447) at org.apache.jserv.JServ.start(JServ.java:625)
Verified that there are no log files that exceed 2GB limit (OS limit).
Clearing the Apache and Jserv cache did not resolve the issue. Unmount / mount product specific file system did not resolve
SOLUTION 13:
Try each of these solutions until the problem is resolved, in order to have the least impact on the system.
1. If you can determine the specific class file from the log files, use the ‘touch’ command.
e.g. touch classfile
If necessary, restart Apache and clear server cache.
2. Shut down all MT services, exit the Apps owner and ask the System Admin to unmount and remount the /sid/applmgr file system (mount point above $JAVA_TOP). Ask the System Admin to kill any processes that may be holding the file system open. Then log in to the Apps owner and restart MT services.
3. Shutdown all the MT services and ask System Admin to reboot the server if the actions above don’t resolve the outage.
************************************************************************
ISSUE 14:
Got login error – Internal Server Error after bounced all services on . find following message from Jserv log file:
$ tail -8 mod_jserv.log
[07/05/2007 18:41:06:915] (ERROR) ajp12: Servlet Error: java.lang.NoClassDefFoundError: null
[07/05/2007 18:41:06:916] (ERROR) an error returned handling request via protocol “ajpv12″
[07/05/2007 18:41:06:916] (ERROR) balance: 11906 internal servlet error in server auohsnops03.oracleoutsourcing.com:20720
[07/05/2007 18:41:06:916] (ERROR) an error returned handling request via protocol “balance”
[07/05/2007 20:07:52:732] (ERROR) ajp12: Servlet Error: java.lang.NoClassDefFoundError: null
No runaway, no lock on port 20720.

SOLUTION 14:
Shutdown all services on MT. Removed all log file (standard error…) from Jserv/jvm. Started All services with successful login.
************************************************************************
ISSUE 15
Customer reported Not able to login with “Internal Server Error” on .
We could not start some of services during bounced All Services with following error message: adapcctl.sh version 115.47
Cannot complete applications logon. You may have entered an invalid applications password, or there may have been a database connect error.
Apache Web Server Listener is not running (dedicated HTTP) …
Cannot complete applications logon. You may have entered an invalid applications password, or there may have been a database connect error.
Cannot complete applications logon. You may have entered an invalid applications password, or there may have been a database connect error.
Apache Web Server Listener is already stopped.
Cannot complete applications logon. You may have entered an invalid applications password, or there may have been a database connect error.
adapcctl.sh: exiting with status 2
Unable to login the application URL, facing the error while login:
Internal Server Error The server encountered an internal error or misconfiguration and was unable to complete your request. Please contact the server administrator, ap@domain.com and inform them of the time the error occurred, and anything you might have done that may have caused the error.
Cause:
SQL> select END_DATE from fnd_user where user_name=’GUEST';
END_DATE
———
05-OCT-10
SOLUTION 15
We found out the apps and applsys were not in sync.
Just manual change the apps password from sqlplus.
Restarted all services and login successfully.
or
Update the FND_USER table with END_DATE=null and bounced apache
SQL> update fnd_user set END_DATE=null where user_name=’GUEST';
1 row updated.
SQL> commit;
Commit complete.
SQL> select END_DATE from fnd_user where user_name=’GUEST';
END_DATE
———–
************************************************************************



ISSUE 16
Unable to login to oracle applications:
error message: You have insufficient privileges for the current operation.
Checks
Unable to login to oracle applications:
error message: You have insufficient privileges for the current operation.
SOLUTION 16
Verify and update SESSION_COOKIE_DOMAIN in ICX_parameters if it is wrong.
Example :
update icx_parameters set SESSION_COOKIE_DOMAIN=’NEW_VALUE’ where SESSION_COOKIE_DOMAIN=’OLD_VALUE';
************************************************************************
ISSUE 17
Apache home page is not coming up even after bounced
Found in jvm log asking for java version
SOLUTION 17
//product/iAS/Apache/Apache/bin/java.sh: /usr/java/jdk1.3.1_15/bin/java: not found
Check the version in /usr/java and update that version in java.sh file and Bounced Apache.
************************************************************************
ISSUE 18
Unable to access applications
cause
All applications are up and running.
“Solaris Error: 12: Not enough space” errors are encounterd in database listener logfile.
SOLUTION 18:
Check if the OS is SUN Solaris.
Check if /tmp filesystem is 100% full.
Check Swap space utilization.
Check the application process that is hagging resources. (Check if any sql sessions are hagging resources)
Clear the process in issue after getting required approval.
NOTE:
The above is applicable only for environments on Solaris OS.
************************************************************************
ISSUE 19
Not able to login to APPS. JSP Error:
Unable to create an user session or ORA-01403 : no data found has been detected in FND.SIGNON.AUDIT_USER
Checks
Check number of rows in dual table.
Select * from dual;
DUAL table should always contain only one row.
The table named DUAL is a small table in the data dictionary that Oracle and user-written programs can reference to guarantee a known result.
This table has one column called DUMMY and one row containing the value X.
SOLUTION 19
DUAL table should always contain only one row and one column.
Insert a row with value X into dual table if the dual table contains 0 rows. If the dual table contains more than one row then delete the rows by keeping one row.
The rows in dual table not equal to zero.
************************************************************************
ISSUE 20
Signature for “https URL redirecting to http URL”
Issue:
https URL redirecting to http URL and the page cannot be displayed error occurs.
SOLUTION 20
Check the httpd.conf and url_fw.conf, in url_fw.conf the Rewrite rule was
RewriteRule ^/$/OA_HTML/AppsLocalLogin.jsp.
Changed into
RewriteRule
https://: /OA_HTML/AppsLocalLogin.jsp.

Issue : R12 Forms,oacore services are going down very frequently

Error Message

There is no much error message

In log file of

$INST_TOP/logs/ora/10.1.3/j2ee/oacore/oacore_default_group_1/server.log

oracle.ons.Notification@bbe161
08/06/11 14:19:30.498 10.1.3.0.0 Stopped (Shutdown executed by oc4jadmin from 127.0.0.1 (localhost))
when you check adopmnctl.sh status
All services are down except HTTP_Server

Cause Identified

When ever Services are started services creates lock files in

$INST_TOP/ora/10.1.3/j2ee/oacore/persistence
$INST_TOP/ora/10.1.3/j2ee/oafm/persistence
$INST_TOP/ora/10.1.3/j2ee/forms/persistence

Sometimes these files create problem to keep the services up

Solution/Work Around

1)Delete/Rename(better) the file under

$INST_TOP/ora/10.1.3/j2ee/oacore/persistence
$INST_TOP/ora/10.1.3/j2ee/oafm/persistence
$INST_TOP/ora/10.1.3/j2ee/forms/persistence

2)Restart the services,Check the issue
Standard Manager Not Picking Up Request .Managers are working not working after specifc changes have done
.
Stop the CM
Run AutoConfig
Run cmclean.sql script -- Concurrent Processing - CMCLEAN.SQL - Non Destructive Script to Clean Concurrent Manager Tables [ID 134007.1]
Run ccml.sql script -- Concurrent Processing - CCM.sql Diagnostic Script to Diagnose Common Concurrent Manager Issues [ID 171855.1]
Start the CM


Standard Manager Not Picking Up Request .Managers are working not working after specifc changes have done
.
Stop the CM
Run AutoConfig
Run cmclean.sql script -- Concurrent Processing - CMCLEAN.SQL - Non Destructive Script to Clean Concurrent Manager Tables [ID 134007.1]
Run ccml.sql script -- Concurrent Processing - CCM.sql Diagnostic Script to Diagnose Common Concurrent Manager Issues [ID 171855.1]
Start the CM

After logging into the Oracle Applications R12, some users are complaining about the error "You have insufficient privileges” Error but they click the home button it is working fine.

Solution:-
1. Manually run the Compile Security' concurrent program, set the parameter to YES
2. Restart the Middle Tier (Apache).
3. Retest the issue.

After logging into the Oracle Applications R12.1.2,They get the pop up message:"Number of open notifications Please use the workflow worklist to view and respond to your notification"

Solution:-
Each Application user that has notifications will be notified of them upon login if the Sign-On: Notification System
Profile option was set to yes. If you wish to stop getting these messages, request you to do the following:
1. Log into Oracle Applications.
2. using the System Administrator responsibility perform the following navigation:
/Profile /System /
3. Within the Profile window, enter: Sign-On: Notification and click on Find.
4. Using the list of values, this feature can be enabled setting it to Yes or Disabled setting it to No.
5. After changing the setting to No, log out of Applications and back in where the change will be in place.

Active users Request shows completed error in R12.
When we check the log file it shows below error
There was an error trying to initialize the HPI library.
Please check your installation, HotSpot does not work correctly
when installed in the JDK 1.2 Solaris Production Release, or
with any JDK 1.1.x release.
signal chaining not allowed for VM interrupt signal, try -XX:+UseAltSigs.
Program exited with status 1

Solution:-
At application user level go to $ORACLE_HOME/bin and take the backup of reports.sh file .then
vi reports.sh (under #Solaris Sparc we have to modify)
## Default settings
else
## Solaris Sparc
LD_LIBRARY_PATH=$ORACLE_HOME/jdk/jre/lib/sparc:$ORACLE_HOME/jdk/jre/lib/sparc/native_threads:$ORACLE_HOME/lib32:$ORACLE_HOME/lib:/usr/dt/lib:/usr/openwin/lib:${LD_LIBRARY_PATH}; export LD_LIBRARY_PATH
We have to add the $ORACLE_HOME/jdk/jre/lib/sparc/server: to starting of above path then we can see like below
LD_LIBRARY_PATH=$ORACLE_HOME/jdk/jre/lib/sparc/server:$ORACLE_HOME/jdk/jre/lib/sparc:$ORACLE_HOME/jdk/jre/lib/sparc/native_threads:$ORACLE_HOME/lib32:$ORACLE_HOME/lib:/usr/dt/lib:/usr/openwin/lib:${LD_LIBRARY_PATH}; export LD_LIBRARY_PATH
Note: The above solution is applicable on Solaris platform only

How to purge the bne.log file under $BNE_TOP/log in Oracle EBS R12
Solution:-
>bne.log

The core files shows big size under dbs directory in db oracle home
Solution:-
1. First we have to remove the core files under dbs directory by using >core command
2. Set sqlnet.expire_time=0 in $ORACLE_HOME/network/admin/sqlnet.ora on the server.
Restart the listener to ensure that these changes take effect.


Common Error: Concurrent Manager shows “Target Node/Queue Unavailable “
April 17, 2013
Issue:
Users reports back that reports are not running with no manager error (see below), and when you check manager status, all managers have Description- Target Node/Queue Unavailable
clone
Solution One:
1. . Run the following in SQL*Plus:
SQL> EXEC FND_CONC_CLONE.SETUP_CLEAN;
COMMIT;
EXIT;
2. Run AutoConfig on all tiers, firstly on the DB tier and then the APPS tiers, to repopulate the required system tables.
Db Tier:
cd $ORACLE_HOME/appsutil/scripts/<inst>/adautocfg.sh
Apps Tier:
cd $ADMIN_SCRIPTS_HOME/adautocfg.sh

Solution Two:
1. Run cmclean.sql with Apps tier down
2. restart all services and check
Solution Three (if All else fails, check all the details  below:)
SQL> select node_name,target_node,control_code from fnd_concurrent_queues;
SQL> update apps.fnd_concurrent_queues set node_name = ‘Node NAME’ where node_name=’Existing Node Name';
SQL> select NODE_NAME,NODE_MODE,STATUS from fnd_nodes;
SQL> select control_code,target_node,node_name,CONCURRENT_QUEUE_NAME from fnd_concurrent_queues;
SQL> UPDATE fnd_concurrent_queues set control_code = null;
SQL> select TARGET_NODE,NODE_NAME from fnd_concurrent_queues where node_name='<Existing Node Name>';
SQL> select TARGET_NODE,NODE_NAME from fnd_concurrent_queues where TARGET_NODE='<Existing Node Name>';
SQL> update fnd_concurrent_queues set NODE_NAME='<Node Name>’ where NODE_NAME='<Source/Existing Node Name>';
SQL> update fnd_concurrent_queues set TARGET_NODE='<Node Name>’ where TARGET_NODE='<Source/Exixting Node Name>';
SQL> UPDATE fnd_concurrent_queues set target_node = ‘<Node Name>';
SQL> UPDATE fnd_concurrent_queues set node_name = ‘<Node Name>';
SQL> Commit;
SQL> select control_code,target_node,node_name,CONCURRENT_QUEUE_NAME from fnd_concurrent_queues;
SQL>select TARGET_NODE,NODE_NAME from fnd_concurrent_queues where node_name='<Node Name>';
SQL>select TARGET_NODE,NODE_NAME from fnd_concurrent_queues where TARGET_NODE='<Node Name>';
Solution four:
SQL> set linesize 1000;
SQL> column CONTROL_CODE format A15
SQL> select CONCURRENT_QUEUE_NAME, CONTROL_CODE , TARGET_NODE, NODE_NAME from FND_CONCURRENT_QUEUES where concurrent_queue_name like ‘OAMGCS_%';
Sample Output:
CONCURRENT_QUEUE_NAME          CONTROL_CODE    TARGET_NODE                    NODE_NAME
——————————                        —————                 —————————–    ——————————
OAMGCS_SUPTEBSAL1                            E                                                                      SUPTEBSAL1
To implement the solution, please execute the following steps:
1. Please set control_code to null for the OAMGCS concurrent queue on the specific node that is affected by this issue.
SQL>  update FND_CONCURRENT_QUEUES
      set control_code = null
      where concurrent_queue_name = ‘OAMGCS_<hostname>'; <Ur Existing Node Name>
2. Make sure the Target_node is correct for the OAMGCS manager:
SQL> update FND_CONCURRENT_QUEUES
           set TARGET_NODE='<correct node >’
           where CONCURRENT_QUEUE_NAME=’OAMGCS_<hostname>';
SQL> commit;
References:
Conflict Resolution Manager Shows Target Node/Queue Unavailable [ID 732709.1]
OAM Generic Collection Service shows State: “The target node/queue unavailable”. [ID 393706.1]
After Cloning all the Concurrent Managers do not start for the cloned Instance [ID 555081.1]
Conflict Resolution Manager Shows Target Node/Queue Unavailable [ID 732709.1]
Concurrent Managers Do Not Start After Cloning Nodes Not Updated In Conc_queues [ID 466532.1]
Summary of Possible Reasons and Solutions for the Problem Where All Concurrent Requests Stuck in Pending Phase [ID 182154.1]
Output Post Processor is Down with Actual Process is 0 And Target Process is 1 [ID 858813.1]
Using Load-Balancers with Oracle E-Business Suite Release 12 [ID 380489.1]
Documentation For Specific Load Balancer Hardware [ID 727171.1]
Sharing The Application Tier File System in Oracle E-Business Suite Release 12 [ID 384248.1]
Add new node to application —- 384248.1
Concurrent Manager: Acutal 0 Target 1
Concurrent Processing – Output Post Processor is Down with Actual Process is 0 And Target Process is 1 [ID 858813.1]
Issue:
Follow steps below if your concurrent manager processes show that actual is 0 and Target is 1. This issue may come up after a clone
Solution:
1. Shut down application tier services
2. To ensure concurrent manager down; check there is no FNDLIBR process running.
ps -ef | grep applmgr | grep FNDLIBR
3. Run adadmin to relink FNDSVC executable.
  • Invoke adadmin from command prompt
  • Choose option 2 (2. Maintain Applications Files menu)
  • Choose option 1 (1. Relink Applications programs )
  • Then type “FND” When prompted; ( Enter list of products to link (‘all’ for all products) [all] : FND )
  • Ensure adrelink is exiting with status 0
4. Restart application tier and retest.


 To compile the jsp as soon as you access jsp page

How to Enable Automatic Compilation of JSP pages in R12 Environment [ID 458338.1].

Metalink details
================
Goal
====
In Release 11i, the deployment of a (custom) JSP was done as follows:

Copy the file (for example: custom.jsp) to the web tier in the $OA_HTML directory.
Request it in the browser like URL> http://<myhost.mydomain>:<port>/OA_HTML/custom.jsp.
The result on the web tier is that:

The custom.jsp was compiled
Output files of the compilation _custom.class (and _custom.java) are saved under the _pages directory
The custom.jsp page is shown in the browser.

Performing the same steps in Release 12 environment just shows a blank screen and no compilation of the custom.jsp is done. 
The steps in this Note explain how the same behavior as in Release 11i can be achieved in Release 12.

Solution
========
In Release 12 the (automatic) compilation of a JSP is disabled and, at runtime, only the pre-compiled JSP's are picked up. Since this requires fewer checks to be done, the performance is improved and therefore this is the recommended and default setting for a Production environment where JSP's will only be replaced occasionally.

In cases where development activities are done and JSP pages are changing often this default setting makes things more complicated. Each time a JSP is deployed a manual compilation using the ojspCompile.pl is needed and the OC4J running the oacore needs a restart to pick up the changes. This will also affect other people working on the same environment.

Follow the steps below to:

Automatically have the JSP recompiled when the JSP is changed (at least the time stamp)
See the new JSP without the need to restart the OC4J running oacore
The objective is to change the setting for main_mode from justrun to recompile in

$INST_TOP /ora/10.1.3/j2ee/oacore/application-deployments/oacore/html/orion-web.xml.



<init-param>
         <param-name>main_mode</param-name>
         <param-value>recompile</param-value>
      </init-param>



Lets do it practically.
=============

The objective is to change the setting for main_mode from justrun to recompile in
[applmgr@apps scripts]$ grep -i s_jsp_main_mode $CONTEXT_FILE
         <jsp_debug_parameters oa_var="s_jsp_main_mode">justrun</jsp_debug_parameters>
[applmgr@apps scripts]$

 when i run autconfig it will update $INST_TOP/ora/10.1.3/j2ee/oacore/application-deployments/oacore/html/orion-web.xml.

Before running autoconfig the current values in orion-web.xml is .

<init-param>
         <param-name>main_mode</param-name>
         <param-value>justrun</param-value>
</init-param>


I changed the parameter in xml file to recompile.

[applmgr@apps scripts]$ grep -i s_jsp_main_mode $CONTEXT_FILE
         <jsp_debug_parameters oa_var="s_jsp_main_mode">recompile</jsp_debug_parameters>
[applmgr@apps scripts]$

Now running autoconfig.
====================


[applmgr@apps scripts]$ ./adautocfg.sh
Enter the APPS user password:

The log file for this session is located at: /u02/inst/apps/PROD_apps/admin/log/04281239/adconfig.log

AutoConfig is configuring the Applications environment...

AutoConfig will consider the custom templates if present.
        Using CONFIG_HOME location     : /u02/inst/apps/PROD_apps
        Classpath                   : /u02/apps/apps_st/comn/java/lib/appsborg2.zip:/u02/apps/apps_st/comn/java/classes

        Using Context file          : /u02/inst/apps/PROD_apps/appl/admin/PROD_a pps.xml

Context Value Management will now update the Context file

        Updating Context file...COMPLETED

        Attempting upload of Context file and templates to database...COMPLETED

Configuring templates from all of the product tops...
        Configuring AD_TOP........COMPLETED
        Configuring FND_TOP.......COMPLETED
        Configuring ICX_TOP.......COMPLETED
        Configuring MSC_TOP.......COMPLETED
        Configuring IEO_TOP.......COMPLETED
        Configuring BIS_TOP.......COMPLETED
        Configuring AMS_TOP.......COMPLETED
        Configuring CCT_TOP.......COMPLETED
        Configuring WSH_TOP.......COMPLETED
        Configuring CLN_TOP.......COMPLETED
        Configuring OKE_TOP.......COMPLETED
        Configuring OKL_TOP.......COMPLETED
        Configuring OKS_TOP.......COMPLETED
        Configuring CSF_TOP.......COMPLETED
        Configuring IGS_TOP.......COMPLETED
        Configuring IBY_TOP.......COMPLETED
        Configuring JTF_TOP.......COMPLETED
        Configuring MWA_TOP.......COMPLETED
        Configuring CN_TOP........COMPLETED
        Configuring CSI_TOP.......COMPLETED
        Configuring WIP_TOP.......COMPLETED
        Configuring CSE_TOP.......COMPLETED
        Configuring EAM_TOP.......COMPLETED
        Configuring FTE_TOP.......COMPLETED
        Configuring ONT_TOP.......COMPLETED
        Configuring AR_TOP........COMPLETED
        Configuring AHL_TOP.......COMPLETED
        Configuring OZF_TOP.......COMPLETED
        Configuring IES_TOP.......COMPLETED
        Configuring CSD_TOP.......COMPLETED
        Configuring IGC_TOP.......COMPLETED

AutoConfig completed successfully.
[applmgr@apps scripts]$


Once autoconfig completed check context file and orion-web.xml.

[applmgr@apps scripts]$ grep -i s_jsp_main_mode $CONTEXT_FILE
         <jsp_debug_parameters oa_var="s_jsp_main_mode">recompile</jsp_debug_parameters>
[applmgr@apps scripts]$


orion-web.xml.
=============

<init-param>
         <param-name>main_mode</param-name>
         <param-value>recompile</param-value>
</init-param>

Note: JSP’s are compiled automatically after patching (whenever patch updates one or more jsp it calls ojspCompile.pl to compile JSP)

How to compile jsp manually in R12?


Bring down application service's and make sure no processes are running.

[applmgr@apps scripts]$ ps -fu applmgr

UID        PID  PPID  C STIME TTY          TIME CMD
applmgr  26766 26765  0 17:33 pts/1    00:00:00 -bash
applmgr  28635 26766  0 18:17 pts/1    00:00:00 ps -fu applmgr
[applmgr@apps scripts]$

cd $FND_TOP/patch/115/bin


[applmgr@apps bin]$ perl ojspCompile.pl --compile --flush -p 4
logfile set: /u02/inst/apps/PROD_apps/logs/appl/rgf/ojsp/ojspc_error.log
starting...(compiling all)
using 10i internal ojsp ver: 10
synchronizing dependency file:
  loading deplist...8048
  enumerating jsps...8048
  updating dependency...0
initializing compilation:
  eliminating children...5979 (-2069)
translating and compiling:
  translating jsps...5979/5979 in 2m44s
  compiling jsps...5979/5979 in 4m28s
Finished!

[applmgr@apps bin]$
/u02/apps/apps_st/appl/fnd/12.0.0/patch/115/bin
[applmgr@apps bin]$


JSP Compilation logs 
=============

In 11i, all jsp compilation errors are logged in 

$IAS_ORACLE_HOME/Apache/Jserv/logs/mod_jserv.log

In R12, all jsp compilation errors are logged in $LOG_HOME/ora/10.1.3/j2ee/oacore/oacore_default_group_1/application.log

How to terminate and cancel the request in oracle apps?


Please cancel the Request Id.35853542 in ebsoltp instance.
Note:
 you will get a request from user as user is unable to cancel a request from front end and user will raise a ticket with dba team to terminate a request.



find out crossponding sid for the request id .35853542.Once you found check sid status and hash sql vlaue
that will help you when you try to update fnd_concurrent_requests table and you are unable to update the table or it will hang or it will not come to the prompt in such case you need sid and serial# value to kill the session.

SQL> @sid
What is the SID : 3538

LOGONTIME SID SERIAL# STATUS TYPE USERNAME OSUSER MACHINE PROGINFO
--------------- ------ ---------- -------- ---------- ---------- ---------- ---------- ------------------------------
PROCESS DBProc SQL_HASH_VALUE
------------------------ ------ --------------
06/10 13:33:10 3538 339 ACTIVE USER APPS appoltp ctssp e:FND:cp:STANDARD - STANDARD@t
4225 23232 3964553037

SQL>

SQL> @hashsql
What is the SQL Hash Value : 2283418808

SQL_TEXT
----------------------------------------------------------------
begin FND_CP_OPP_REQ.postprocess (:reqid, :groupid, :flag, :errm
sg); end;


SQL> select name from v$database;

NAME
---------
ebsoltp

SQL> update applsys.fnd_concurrent_requests set phase_code = 'C',status_code = 'X' where request_id ='35853542';

==>sometime it will hang here.do alter system kill session new window and commit it.
1 row updated.

SQL> commit;

Commit complete.

SQL>


awstatus.sql
select sid,serial#,machine,sql_hash_value,status from v$session where sid='3538';

Below script and above sql statement is same.

SQL> @awstatus.sql
Enter value for sid: 3538

SID SERIAL# MACHINE SQL_HASH_VALUE STATUS
------ ---------- ---------- -------------- --------
3538 339 ctssp 2283418808 ACTIVE

SQL> alter system kill session '3538,339';

System altered.

SQL>
Programs not running by showing status as INACTIVE, NOMANAGER in ebstest instance.
when i check the mount point it is filled up.


apptest@ctssd $ df -h .
Filesystem                size used avail capacity Mounted on
/dev/vx/dsk/ebstestdg/erpcsf
                          32G 32G 0K 100% /u01/ebscsf

cleanup old request/out files from this location cd $APPLCSF/$APPLLOG
cd $APPLCSF/$APPLOUT.

 find . -name "*.req/out" -mtime +30 -exec rm {} \;

i removed the files which are older than 30days and mount point issue resolved.

apptest@ctssd $ df -h .
Filesystem             size used avail capacity Mounted on
/dev/vx/dsk/ebstestdg/erpcsf
                       32G 25G 7.4G 78% /u01/ebscsf



I did the sanity instance is working fine and also asked user to check from his side
its working fine.

Fresher Alerts Monitoring job

In realtime you will get alerts from grid/crontab/shellscript with some percentage of criteria like if tablespace
reaches 85% you will recieve alert in the mailbox/blackberry and mount point 90% and it depends how do you set it.



1)Tablespace issue's.

I copied this tablepsace scipt from SAM ALAPATHI.

column file_name format a46
column tablespace_name format a11
set verify off
accept tbs prompt 'What is the Tablespace Name: '
SELECT  dts.tablespace_name,
NVL(ddf.bytes / 1024 / 1024, 0) avail,
NVL(ddf.bytes - NVL(dfs.bytes, 0), 0)/1024/1024 used,
NVL(dfs.bytes / 1024 / 1024, 0) free,
TO_CHAR(NVL((ddf.bytes - NVL(dfs.bytes, 0)) / ddf.bytes * 100, 0), '990.00')
"Used %" ,
TO_CHAR(NVL((ddf.bytes - NVL(ddf.bytes - NVL(dfs.bytes, 0), 0)) / ddf.bytes
* 100, 0), '990.00') free_pct,
decode(sign(
(NVL(ddf.bytes - NVL(dfs.bytes, 0), 0)/1024/1024)/0.85 - NVL(ddf.bytes / 1024 /
1024, 0)),-1,0,(NVL(ddf.bytes - NVL(dfs.bytes, 0), 0)/1024/1024)/0.85 - NVL(ddf.bytes / 1024 / 1024, 0))  "Required MB"
FROM
sys.dba_tablespaces dts,
(select tablespace_name, sum(bytes) bytes
from dba_data_files group by tablespace_name) ddf,
(select tablespace_name, sum(bytes) bytes
from dba_free_space group by tablespace_name) dfs
WHERE
dts.tablespace_name = ddf.tablespace_name(+)
AND dts.tablespace_name = dfs.tablespace_name(+)
and dts.tablespace_name = '&tbs';

select file_name,bytes/1024/1024 from dba_data_files
where tablespace_name = '&tbs';

Above script will give you the output in the below fashion.


TABLESPACE_      AVAIL       USED       FREE Used %  FREE_PC Required MB
----------- ---------- ---------- ---------- ------- ------- -----------
APPS_TS_TX_   5680.125   5122.375     557.75   90.18    9.82  346.198529
DATA



FILE_NAME                                      BYTES/1024/1024

---------------------------------------------- ---------------
/u01/db/apps_st/data/a_txn_data03.dbf                  1430.25
/u01/db/apps_st/data/a_txn_data02.dbf                 1985.375
/u01/db/apps_st/data/a_txn_data01.dbf                   1380.5
/u01/db/apps_st/data/a_txn_data04.dbf                      884

i)How to resize a datafile and what are the things you need to check before adding the space in the tablepsace?

First check mount pont space i .e Avail 42G now i can add it.



SQL> !df -h /u01/db/apps_st/data

Filesystem            Size  Used Avail Use% Mounted on
/dev/sda3              97G   51G   42G  56% /u01

SQL> alter database datafile '/u01/db/apps_st/data/a_txn_data01.dbf' resize 1500m;

Database altered.

Below is the ouput after adding the space before it was 1380.5

TABLESPACE_      AVAIL       USED       FREE Used %  FREE_PC Required MB
----------- ---------- ---------- ---------- ------- ------- -----------
APPS_TS_TX_   5799.625   5122.375     677.25   88.32   11.68  226.698529
DATA


FILE_NAME                                      BYTES/1024/1024
---------------------------------------------- ---------------
/u01/db/apps_st/data/a_txn_data03.dbf                  1430.25
/u01/db/apps_st/data/a_txn_data02.dbf                 1985.375
/u01/db/apps_st/data/a_txn_data01.dbf                     1500
/u01/db/apps_st/data/a_txn_data04.dbf                      884


ii)how to add a datafile and what are the pre requisites?

1)First check rman backup is running or not.

ps -ef|grep -i backup

ps -ef|grep -i rman

If your backup is running then it will show ACTIVE.

SQL> select count(*),status from v$backup group by status;

  COUNT(*) STATUS
---------- ------------------
        44 NOT ACTIVE

SQL> select name from v$database;

NAME
---------
PROD

SQL>

once the pre requisite done .now add a datafile.

SQL> select file_name from dba_data_files where file_name like '%/u01/db/apps_st/data/a_txn_data04.dbf%';

FILE_NAME
----------------------------------------------
/u01/db/apps_st/data/a_txn_data04.dbf

SQL> !ls -ld /u01/db/apps_st/data/a_txn_data04.dbf
-rw-r-----  1 oracle dba 926949376 Feb 13 11:27 /u01/db/apps_st/data/a_txn_data04.dbf

SQL> select file_name from dba_data_files where file_name like '%/u01/db/apps_st/data/a_txn_data05.dbf%';

no rows selected

File doesnot exists now you can add it safely.


Adding a datafile
===========
SQL> alter tablespace APPS_TS_TX_DATA add datafile '/u01/db/apps_st/data/a_txn_data05.dbf' size 2000m;

Tablespace altered.

SQL> @tsusage
What is the Tablespace Name: APPS_TS_TX_DATA

TABLESPACE_      AVAIL       USED       FREE Used %  FREE_PC Required MB
----------- ---------- ---------- ---------- ------- ------- -----------
APPS_TS_TX_   7799.625   5123.375    2676.25   65.69   34.31           0
DATA



FILE_NAME                                      BYTES/1024/1024
---------------------------------------------- ---------------
/u01/db/apps_st/data/a_txn_data03.dbf                  1430.25
/u01/db/apps_st/data/a_txn_data02.dbf                 1985.375
/u01/db/apps_st/data/a_txn_data01.dbf                     1500
/u01/db/apps_st/data/a_txn_data04.dbf                      884
/u01/db/apps_st/data/a_txn_data05.dbf                     2000

SQL>



2)Rman backup and archive monitoring.

To check rman backup/archive is running or not use below command.

ps -ef|grep -i rman
ps -ef|grep -i arch

More information can also be found through rman logfile.

3)Lock Holding sessions/inactive session in the database.(Degrade performance)


 Will coming up shortly with details .


SQL> select sid,serial#,sql_hash_value,status from v$session where username like  '%SCOTT%';

       SID    SERIAL# SQL_HASH_VALUE STATUS
---------- ---------- -------------- --------
       372         59              0 INACTIVE

SQL> alter system kill session '372,59';

System altered.

SQL>


4)Mount point issue.

Below are the mount points  will get fill due to huge number of transaction or becasue of  req/out/log/trc/dbg/.t and .tmp files  and many other.As you get the alert in your mailbox you have
to remove the unwanted files or the files which are not in used

To check all mount point of server.

[oracle@apps ~]$ df -kh
Filesystem            Size  Used Avail Use% Mounted on
/dev/sda1              15G  7.4G  6.4G  54% /
none                  3.5G     0  3.5G   0% /dev/shm
/dev/sda6             5.0G  331M  4.4G   7% /tmp
/dev/sda3              97G   53G   39G  58% /u01
/dev/sda2              97G   78G   14G  85% /u02
/dev/sda7              70G   47G   20G  71% /u03
[oracle@apps ~]$



Use below command according to situation.
To check the files more than 10 mb.

[applmgr@apps log]$ find . -name "*.req" -size +10000000c -mtime +0 -exec ls -ltrh {} \;
[applmgr@apps log]$find . -name "*.out" -size +10000000c -mtime +0 -exec ls -ltrh {} \;
[applmgr@apps log]$find . -name "*.pdf" -size +10000000c -mtime +0 -exec ls -ltrh {} \;


To check files more than 30 days.

find . -name "*" -mtime +30 -exec ls -lth {} \;

To check files more than two days.

[applmgr@apps log]$ find . -name "*.req" -mtime +0 -exec ls -tlrh {} \;
-rw-r--r--  1 applmgr dba 1.5K Feb 11 14:42 ./l388255.req
-rw-r--r--  1 applmgr dba 2.3K Feb 11 14:46 ./l388257.req
-rw-r--r--  1 applmgr dba 1.4K Feb 11 14:18 ./l388235.req
-rw-r--r--  1 applmgr dba 1.5K Feb 11 14:30 ./l388247.req
-rw-r--r--  1 applmgr dba 1.9K Feb 11 20:29 ./l388285.req
-rw-r--r--  1 applmgr dba 1.9K Feb 11 14:58 ./l388266.req
-rw-r--r--  1 applmgr dba 1.2K Feb 11 14:33 ./l388250.req
-rw-r--r--  1 applmgr dba 1.2K Feb 11 14:35 ./l388252.req
-rw-r--r--  1 applmgr dba 1.2K Feb 11 14:44 ./l388258.req
-rw-r--r--  1 applmgr dba 464 Feb  7 19:29 ./l387477.req
-rw-r--r--  1 applmgr dba 1.4K Feb  8 19:08 ./l388223.req
-rw-r--r--  1 applmgr dba 1.2K Feb 11 14:30 ./l388248.req
-rw-r--r--  1 applmgr dba 1.9K Feb  7 20:33 ./l388206.req
-rw-r--r--  1 applmgr dba 1.2K Feb 11 14:40 ./l388256.req
-rw-r--r--  1 applmgr dba 1.9K Feb 11 14:54 ./l388264.req
-rw-r--r--  1 applmgr dba 7.0K Feb 11 14:12 ./l388220.req
-rw-r--r--  1 applmgr dba 2.3K Feb  8 16:55 ./l388222.req
-rw-r--r--  1 applmgr dba 1.3K Feb 11 13:57 ./l388201.req
-rw-r--r--  1 applmgr dba 6.0K Feb 11 15:01 ./l388210.req
-rw-r--r--  1 applmgr dba 1.4K Feb  8 19:08 ./l388229.req
-rw-r--r--  1 applmgr dba 1.8K Feb 11 14:02 ./l388227.req
-rw-r--r--  1 applmgr dba 1.9K Feb 11 18:57 ./l388282.req
[applmgr@apps log]$ date
Wed Feb 13 12:30:25 IST 2013
[applmgr@apps log]$

To check files are in used or not.
 find . -name "*.req" -mtime +0 -exec fuser {} \;
To find the files more than 200MB.

find . -name "*" -size +500000 -exec ls -ltrh {} \;


5)Monitoring long Running concurrent Request.

6)Resolving the status of suspended agent .

switch to oemgrid user.
./emctl status agent
./emctl stop agent

cd $AGENT_HOME/sysman/emd/upload
rm *
cd $AGENT_HOME/sysman/emd/state
rm *
./emctl clearstate agent
./emctl secure agent
./emctl start agent
./emctl pingOMS

7)Checking alert logfile of production for ORA-00* errors.

1)ORA-00600

2)ORA-00745

The above two errors are more critical and precarious for the health of database and
for the same you will recieve alert in your mailbox.You have to login to metalink and you have
to search for the cause and symtomps and you have to send a mail to seniors with the
explanation they will take appropiate action on it.
Informatoin alerts
=============
MWA server bounced on theASCP prodcution.
Apache server bounce on  production.
user using Apps password.
Terminated request still running ( As they will take time to release the momory)
Production backup reports for all the database
ORA-02097: parameter cannot be modified because specified value is invalid
Please enable primary archiving to this location /db/arch1  and secondary archive location to /opt/arch2.Please switch logfile to ensure archive are generated in both the location.

SQL> archive log list
Database log mode              Archive Mode
Automatic archival             Enabled
Archive destination            /db/vision/db/tech_st/11.1.0/dbs/arch
Oldest online log sequence     20
Next log sequence to archive   21
Current log sequence

SQL> show parameter spfile

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
spfile                               string      /db/vision/db/tech_st/11.1.0/d
                                                 bs/spfilevision.ora
SQL> alter system set log_archive_dest_1='LOCATION=/db/arch1';

System altered.

SQL> alter system set log_archive_dest_2='LOCATION=/opt/arch2';

System altered.

SQL>

SQL> show parameter arch

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
archive_lag_target                   integer     0
log_archive_config                   string
log_archive_dest                     string
log_archive_dest_1                   string      LOCATION=/db/arch1
log_archive_dest_10                  string
log_archive_dest_2                   string      LOCATION=/opt/arch2
log_archive_dest_3                   string
log_archive_dest_4                   string
log_archive_dest_5                   string
log_archive_dest_6                   string
log_archive_dest_7                   string

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
log_archive_dest_8                   string
log_archive_dest_9                   string
log_archive_dest_state_1             string      enable
log_archive_dest_state_10            string      enable
log_archive_dest_state_2             string      enable
log_archive_dest_state_3             string      enable
log_archive_dest_state_4             string      enable
log_archive_dest_state_5             string      enable
log_archive_dest_state_6             string      enable
log_archive_dest_state_7             string      enable
log_archive_dest_state_8             string      enable

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
log_archive_dest_state_9             string      enable
log_archive_duplex_dest              string
log_archive_format                   string      %t_%s_%r.dbf
log_archive_local_first              boolean     TRUE
log_archive_max_processes            integer     4
log_archive_min_succeed_dest         integer     1
log_archive_start                    boolean     FALSE
log_archive_trace                    integer     0
standby_archive_dest                 string      ?/dbs/arch
SQL>

SQL> alter system switch logfile;

System altered.


SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.1.0.7.0 - Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
[dbvision@apps 11.1.0]$ pwd
/db/vision/db/tech_st/11.1.0
[dbvision@apps 11.1.0]$ cd /db/arch1
[dbvision@apps arch1]$ pwd
/db/arch1
[dbvision@apps arch1]$ ls -tlrh
total 180M
-rw-r----- 1 dbvision dba 387M Sep 20 07:30 1_21_790902108.dbf
[dbvision@apps arch1]$ cd /opt/arch2
[dbvision@apps arch2]$ ls -tlrh
total 298M
-rw-r----- 1 dbvision dba 387M Sep 20 07:31 1_21_790902108.dbf
[dbvision@apps arch2]$





If archive log is disabled then how to do archiving in two location.
===================================================================
create pfile from spfile;
shutdown immediate
add below parameters and start database.
log_archive_dest_1='LOCATION=/db/arch1'
log_archive_dest_2='LOCATION=/opt/arch2'
*.log_archive_dest_state_1=ENABLE
*.log_archive_dest_state_2=ENABLE

startup mount pfile='location'

alter database archivelog;
create spfile from pfile='loc';
shutdown immediate
startup
alter system logfile;

Please provide Output of the script cstcheck.sql need to upload to oracle.

1)Download script from metalink.oracle.com site
2)Move to server
3)Execute the script in apps schema.
4)Give the output to user and user upload the file to oracle.

SQL> show user
USER is "APPS"
SQL> select name from v$database;

NAME
---------
EBSOLTP1

SQL> @cstcheck.sql


Enter value for customer:
IBM_INTER

/bin/INCTGL: No such file or directory

End of Diagnostic Report. Look for CstDiag115.txt in user's current directory.

Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
$ pwd


It will generate text file (CstDiag115.txt)give it to user and user will upload to oracle.

-rwxrwxrwx 1 oraoltp1 dbaoltp1 122 May 29 23:29 comm.lst

-rw-r--r-- 1 oraoltp1 dbaoltp1 171K May 29 23:29 CstDiag115.txt





How to bounce apache and clear cache in oracle apps 11i on sunsolaris operating system?
Go to scripts location.

cd $COMMON_TOP/admin/scripts/$CONTEXT_NAME


apptest@cstsd $ adapcctl.sh stop ; mv $COMMON_TOP/_pages $COMMON_TOP/_pages_3june2013; mkdir $COMMON_TOP/_pages;ps -fu apptest|grep -i http; adapcctl.sh start

adapcctl.sh version 115.55

Apache Web Server Listener :httpd ( pid 20394 ) is running.
Stopping Apache Web Server Listener (dedicated HTTP) ...
Apache Web Server Listener (PLSQL) :httpd ( pid 20529 ) is running.
Stopping Apache Web Server Listener (dedicated PLSQL) ...

adapcctl.sh: exiting with status 0  ===> apache stop successfully

apptest 821 28664 0 14:17:57 pts/4 0:00 grep -i http  ==> checking for any http process

adapcctl.sh version 115.55 ==> Now starting apache

Apache Web Server Listener is not running.
Starting Apache Web Server Listener (dedicated HTTP) ...
Apache Web Server Listener (PLSQL) is not running.
Starting Apache Web Server Listener (dedicated PLSQL) ...

adapcctl.sh: exiting with status 0  ==> apache started successfully

apptest@cstsd $
apptest@cstsd $
apptest@cstsd $ ps -fu apptest|grep -i http|wc -l   ==> checking the http processes
18
apptest@cstsd $

(MWA)Telnet is not working on the below port 10230
User will raise ticket with dbateam saying mobile server(telnet)  is not running on ebsvision database(or)
you will get communication mail from user (or)business.

How do you check whether mobile services is up and running in R12?

[applvision@apps install]$ ps -fu applvision|grep -i Doracle
501       7146  5748  0 00:22 pts/3    00:00:00 grep -i doracle

Check whether the mobile port is listening for any sevices.
[applvision@apps install]$ netstat -ann|grep -i 10230

After checking above two steps we can say that telnet is down.

[applvision@apps scripts]$ cd $ADMIN_SCRIPTS_HOME
[applvision@apps scripts]$ pwd
/apps/vision/inst/apps/vision_apps/admin/scripts

Now start mobile service on the same port
============================
[applvision@apps scripts]$ nohup mwactl.sh start 10230 &
[1] 7161
[applvision@apps scripts]$ nohup: appending output to `nohup.out'

[1]+  Done                    nohup mwactl.sh start 10230
[applvision@apps scripts]$ pwd
/apps/vision/inst/apps/vision_apps/admin/scripts


Now verify it
============
[applvision@apps scripts]$ ps -fu applvision|grep -i Doracle
501       7163     1  1 00:22 pts/3    00:00:03 /apps/vision/apps/tech_st/10.1.3/appsutil/jdk/bin/java -DCLIENT_PROCESSID=7163 -Doracle.apps.mwa=/apps/vision/apps/apps_st/appl/mwa/12.0.0 -Doracle.apps.jrad.mmd=/apps/vision/apps/apps_st/comn/webapps/oacore/html/jrad -Doracle.apps.inst=/apps/vision/inst/apps/vision_apps -mx512m -ms128m oracle.apps.mwa.presentation.telnet.Listener 10230
501       7313  5748  0 00:26 pts/3    00:00:00 grep -i doracle
[applvision@apps scripts]$ netstat -ann|grep -i 10230
tcp        0      0 0.0.0.0:10230               0.0.0.0:*                   LISTEN
[applvision@apps scripts]$


Now the mobile services are up and running.Tell user to check now.


Please bounce OPMN Services/Apache bounce in ebsdev instance?


Why OPMN bounce/Apache bounce?
Developers deployed new objects in JAVA_TOP which require a full OPMN bounce
these are for OAF objects which require a full bounce for middle tier caching
and the objects consists of .class files and .xml files.when we bounce these objects
will get reflected.


[applmgr@apps scripts]$ adopmnctl.sh status

You are running adopmnctl.sh version 120.6

Checking status of OPMN managed processes...

Processes in Instance: PROD_apps.apps.user.com
---------------------------------+--------------------+---------+---------
ias-component                    | process-type       |     pid | status
---------------------------------+--------------------+---------+---------
OC4JGroup:default_group          | OC4J:oafm          |     N/A | Down
OC4JGroup:default_group          | OC4J:forms         |     N/A | Down
OC4JGroup:default_group          | OC4J:oacore        |     N/A | Down
HTTP_Server                      | HTTP_Server        |     N/A | Down

Make sure no process are running.
[applmgr@apps scripts]$ ps -fu applmgr
UID        PID  PPID  C STIME TTY          TIME CMD
applmgr  26766 26765  0 17:33 pts/1    00:00:00 -bash
applmgr  28635 26766  0 18:17 pts/1    00:00:00 ps -fu applmgr
[applmgr@apps scripts]$

Start all service.

==========


[applmgr@apps scripts]$ adopmnctl.sh status

You are running adopmnctl.sh version 120.6


Checking status of OPMN managed processes...


Processes in Instance: PROD_apps.apps.user.com

---------------------------------+--------------------+---------+---------
ias-component                    | process-type       |     pid | status
---------------------------------+--------------------+---------+---------
OC4JGroup:default_group          | OC4J:oafm          |     774 | Alive
OC4JGroup:default_group          | OC4J:forms         |     708 | Alive
OC4JGroup:default_group          | OC4J:oacore        |     629 | Alive
HTTP_Server                      | HTTP_Server        |     577 | Alive


adopmnctl.sh: exiting with status 0


adopmnctl.sh: check the logfile /u02/inst/apps/PROD_apps/logs/appl/admin/log/adopmnctl.txt for more information ...


[applmgr@apps scripts]$

Adding a path in utl_file_dir
Please add this path (/db/vision/temp) in utl_file_dir parameter.
You will get above details from ticket or business communication.

Bring down all middle tier services if you are using Oracle Application Ebs.

[applvision@apps ~]$ ps -fu applvision
UID        PID  PPID  C STIME TTY          TIME CMD
501       5747  5739  0 23:41 ?        00:00:00 sshd: applvision@pts/3
501       5748  5747  1 23:41 pts/3    00:00:00 -bash
501       5835  5748  0 23:41 pts/3    00:00:00 ps -fu applvision

Crosscheck whether the given path is exists in utl_file_dir.

SQL> show parameter utl_file_dir

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
utl_file_dir                         string      /usr/tmp, /usr/tmp, /db/vision
                                                 /db/tech_st/11.1.0/appsutil/ou
                                                 tbound/vision_apps, /usr/tmp
SQL>

Note:UTL_FILE_DIR parameter is static ,we have to bounce the database in order to add the path.

How to check whether a parameter is static or dynamic?

SQL> select ISSYS_MODIFIABLE from v$parameter where name like '%utl_file_dir%';

ISSYS_MOD
---------
FALSE              ===>static 

SQL>

SQL>  select ISSYS_MODIFIABLE from v$parameter where name like '%log_archive_dest%';

ISSYS_MOD
---------
IMMEDIATE        ====>dynamic


Create pfile from spfile and open pfile add the path and start your database with your modified
pfile.

SQL> show parameter spfile

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
spfile                               string      /db/vision/db/tech_st/11.1.0/d
                                                 bs/spfilevision.ora
SQL> create pfile='/db/vision/initaddpath.ora' from spfile;

File created.

SQL>

Bring down the database
========================
SQL> shutdown immediate
Database closed.
Database dismounted.
ORACLE instance shut down.
SQL>


Add path in pfile in utl_file_dir parameter
=============================
[dbvision@apps temp]$ grep -i /db/vision/temp /db/vision/initaddpath.ora
*.utl_file_dir='/usr/tmp','/usr/tmp','/db/vision/db/tech_st/11.1.0/appsutil/outbound/vision_apps','/usr/tmp',
'/db/vision/temp'
[dbvision@apps temp]$


Start the database with pfile

======================
[dbvision@apps temp]$ sqlplus "/as sysdba"

SQL*Plus: Release 11.1.0.7.0 - Production on Sun Sep 22 00:02:47 2013

Copyright (c) 1982, 2008, Oracle.  All rights reserved.

Connected to an idle instance.

SQL> startup nomount pfile='/db/vision/initaddpath.ora'
ORACLE instance started.

Total System Global Area 1071333376 bytes
Fixed Size                  1318172 bytes
Variable Size             440402660 bytes
Database Buffers          616562688 bytes
Redo Buffers               13049856 bytes
SQL> show parameter utl_file_dir

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
utl_file_dir                         string      /usr/tmp, /usr/tmp, /db/vision
                                                 /db/tech_st/11.1.0/appsutil/ou
                                                 tbound/vision_apps, /usr/tmp,
                                                 /db/vision/temp
SQL> create spfile from pfile='/db/vision/initaddpath.ora';

File created.

SQL> shutdown immediate
ORA-01507: database not mounted


ORACLE instance shut down.
SQL> startup
ORACLE instance started.

Total System Global Area 1071333376 bytes
Fixed Size                  1318172 bytes
Variable Size             440402660 bytes
Database Buffers          616562688 bytes
Redo Buffers               13049856 bytes
Database mounted.
Database opened.
SQL> show parameter spfile

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
spfile                               string      /db/vision/db/tech_st/11.1.0/d
                                                 bs/spfilevision.ora
SQL> show parameter utl_file_dir

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
utl_file_dir                         string      /usr/tmp, /usr/tmp, /db/vision
                                                 /db/tech_st/11.1.0/appsutil/ou
                                                 tbound/vision_apps, /usr/tmp,
                                           
      /db/vision/temp
SQL>
Servlet to socket mode conversion

How to check servlet mode is enable or not?

[applmgr@apps US]$ grep -i s_frmConnectMode $CONTEXT_FILE
         <forms_connect oa_var="s_frmConnectMode">servlet</forms_connect>
[applmgr@apps US]$

OR
[applmgr@apps US]$ grep connectMode $FORMS_WEB_CONFIG_FILE
connectMode=servlet
[applmgr@apps US]$

[applmgr@apps US]$ cat $FORMS_WEB_CONFIG_FILE|grep serverURL=
serverURL=/forms/lservlet
[applmgr@apps US]$

Note Oracle Application Release 12 is, by default, configured to run in servlet mode.
Port number used to run Forms in socket mode. The default port number is 9095.

Syntax:

$FND_TOP/bin/txkrun.pl -script=ChangeFormsMode -contextfile=[context file name with full path] -mode=socket -port=[forms port value] -runautoconfig=No






1) Source the Env file

2) Stop all the application services.
3) Run the following command to enable Forms Socket Mode:
$FND_TOP/bin/txkrun.pl -script=ChangeFormsMode 
-contextfile=/u02/inst/apps/PROD_apps/appl/admin/PROD_apps.xml -mode=socket -port=9095 -runautoconfig=No
4)On UNIX:
$INST_TOP/admin/scripts/adautocfg.sh

5)Start all the application tier services:On UNIX:

$INST_TOP/admin/scripts/adstrtal.sh

6)Check whether Forms Server is running:On UNIX:


$INST_TOP/admin/scripts/adformsrvctl.sh status


7)Log in to Oracle Applications and launch a Forms-based application.

Open the Sun Java Console (from Tools Menu in Internet Explorer).
Check whether the "mode" directive displayed in Sun Java Console when launching forms-based applications is set to socket.
The direct launch URL for Forms Socket Mode is:
http://webhost.domain:webport/OA_HTML/frmservlet

[applmgr@apps appl]$ ls -lrh APPS*.env
-rw-r--r--  1 applmgr dba 999 Apr 28 12:40 APPSPROD_apps.env
[applmgr@apps appl]$ . ./APPSPROD_apps.env
[applmgr@apps appl]$



[applmgr@apps ~]$ ps -fu applmgr
UID        PID  PPID  C STIME TTY          TIME CMD
applmgr   5477  5476  0 20:18 pts/4    00:00:00 -bash
applmgr   5594  5477  0 20:23 pts/4    00:00:00 ps -fu applmgr
applmgr  26968 26967  0 18:31 pts/2    00:00:00 -bash
[applmgr@apps ~]$

[applmgr@apps ~]$ $FND_TOP/bin/txkrun.pl -script=ChangeFormsMode -contextfile=/u02/inst/apps/PROD_apps/appl/admin/PROD_apps.xml -mode=socket -port=9095 -runautoconfig=No


*** ALL THE FOLLOWING FILES ARE REQUIRED FOR RESOLVING RUNTIME ERRORS
*** Log File = /u02/inst/apps/PROD_apps/logs/appl/rgf/TXK/txkChangeFormsMode_Fri_May_10_20_27_35_2013.log
Program : /u02/apps/apps_st/appl/fnd/12.0.0/patch/115/bin/txkChangeFormsMode.pl started @ Fri May 10 20:27:35 2013

*** Log File = /u02/inst/apps/PROD_apps/logs/appl/rgf/TXK/txkChangeFormsMode_Fri_May_10_20_27_35_2013.log

Arguments passed: -contextfile=/u02/inst/apps/PROD_apps/appl/admin/PROD_apps.xml -mode=socket -port=9095 -runautoconfig=No


-----------
Values used
-----------
Context File   : /u02/inst/apps/PROD_apps/appl/admin/PROD_apps.xml
Mode           : socket
Port           : 9095
Run AutoConfig : No


Execute SYSTEM command : netstat -a


********************************
Backing up context file....
********************************
Context file backed up at: /u02/inst/apps/PROD_apps/logs/appl/rgf/TXK/Fri_May_10_20_27_35_2013/PROD_apps.xml


********************************
Changing to Socket Mode.......
********************************
Updating context Variable s_forms_servlet_serverurl....
Updated context Variable s_forms_servlet_serverurl to
Updating context Variable s_frmConnectMode....
Updated context Variable s_frmConnectMode to socket
Updating context Variable s_formsstatus....
Updated context Variable s_formsstatus to disabled
Updating context Variable s_formsserver_status....
Updated context Variable s_formsserver_status to enabled
Updating context Variable s_other_service_group_status....
Updated context Variable s_other_service_group_status to enabled
Updating context Variable s_formsport....
Updated context Variable s_formsport to 9095
Updating context Variable s_formslauncher_path....
Updated context Variable s_formslauncher_path to OA_HTML/frmservlet


*********************************************************************************
You should run Autoconfig to update the runtime configurations to new Forms Mode.
*********************************************************************************

Log file to change the Forms Mode :
 /u02/inst/apps/PROD_apps/logs/appl/rgf/TXK/txkChangeFormsMode_Fri_May_10_20_27_35_2013.log


Program : /u02/apps/apps_st/appl/fnd/12.0.0/patch/115/bin/txkChangeFormsMode.pl completed @ Fri May 10 20:27:59 2013

End of /u02/apps/apps_st/appl/fnd/12.0.0/patch/115/bin/txkChangeFormsMode.pl : No Errors encountered
[applmgr@apps ~]$


Run autoconfig to reflect the changes.
============================

[applmgr@apps ~]$ cd $ADMIN_SCRIPTS_HOME
[applmgr@apps scripts]$ ls
adalnctl.sh  adautocfg.sh  adexecsql.pl   adformsrvctl.sh  adoafmctl.sh  adpreclone.pl  adstrtal.sh  ieo      jtffmctl.sh  msc        mwactlwrpr.sh
adapcctl.sh  adcmctl.sh    adformsctl.sh  adoacorectl.sh   adopmnctl.sh  adstpall.sh    gsmstart.sh  java.sh  majid.sh     mwactl.sh  sqlnet.log
[applmgr@apps scripts]$ adautocfg.sh
Enter the APPS user password:

The log file for this session is located at: /u02/inst/apps/PROD_apps/admin/log/05102029/adconfig.log


AutoConfig is configuring the Applications environment...


AutoConfig will consider the custom templates if present.

        Using CONFIG_HOME location     : /u02/inst/apps/PROD_apps
        Classpath                   : /u02/apps/apps_st/comn/java/lib/appsborg2.zip:/u02/apps/apps_st/comn/java/classes

        Using Context file          : /u02/inst/apps/PROD_apps/appl/admin/PROD_apps.xml


Context Value Management will now update the Context file


        Updating Context file...COMPLETED


        Attempting upload of Context file and templates to database...COMPLETED


Configuring templates from all of the product tops...

        Configuring AD_TOP........COMPLETED
        Configuring FND_TOP.......COMPLETED
        Configuring ICX_TOP.......COMPLETED
        Configuring MSC_TOP.......COMPLETED
        Configuring IEO_TOP.......COMPLETED
        Configuring BIS_TOP.......COMPLETED
        Configuring AMS_TOP.......COMPLETED
        Configuring CCT_TOP.......COMPLETED
        Configuring WSH_TOP.......COMPLETED
        Configuring CLN_TOP.......COMPLETED
        Configuring OKE_TOP.......COMPLETED
        Configuring OKL_TOP.......COMPLETED
        Configuring OKS_TOP.......COMPLETED
        Configuring CSF_TOP.......COMPLETED
        Configuring IGS_TOP.......COMPLETED
        Configuring IBY_TOP.......COMPLETED
        Configuring JTF_TOP.......COMPLETED
        Configuring MWA_TOP.......COMPLETED
        Configuring CN_TOP........COMPLETED
        Configuring CSI_TOP.......COMPLETED
        Configuring WIP_TOP.......COMPLETED
        Configuring CSE_TOP.......COMPLETED
        Configuring EAM_TOP.......COMPLETED
        Configuring FTE_TOP.......COMPLETED
        Configuring ONT_TOP.......COMPLETED
        Configuring AR_TOP........COMPLETED
        Configuring AHL_TOP.......COMPLETED
        Configuring OZF_TOP.......COMPLETED
        Configuring IES_TOP.......COMPLETED
        Configuring CSD_TOP.......COMPLETED
        Configuring IGC_TOP.......COMPLETED

AutoConfig completed successfully.

[applmgr@apps scripts]$



[applmgr@apps scripts]$ grep -i ConnectMode $CONTEXT_FILE
         <forms_connect oa_var="s_frmConnectMode">socket</forms_connect>
[applmgr@apps scripts]$


[applmgr@apps scripts]$ adopmnctl.sh status

You are running adopmnctl.sh version 120.6


Checking status of OPMN managed processes...


Processes in Instance: PROD_apps.apps.user.com

---------------------------------+--------------------+---------+---------
ias-component                    | process-type       |     pid | status
---------------------------------+--------------------+---------+---------
OC4JGroup:default_group          | OC4J:oafm          |   11579 | Alive
OC4JGroup:default_group          | OC4J:oacore        |   11578 | Alive
HTTP_Server                      | HTTP_Server        |   11577 | Alive


adopmnctl.sh: exiting with status 0


adopmnctl.sh: check the logfile /u02/inst/apps/PROD_apps/logs/appl/admin/log/adopmnctl.txt for more information ...


[applmgr@apps scripts]$


[applmgr@apps scripts]$ $INST_TOP/admin/scripts/adformsrvctl.sh status

You are running adformsrvctl.sh  version 120.15.12010000.2

Checking status of FORMS Server (Socket Mode) ...

 Forms Server (Socket) is running as PID  12014


adformsrvctl.sh: exiting with status 0

adformsrvctl.sh: check the logfile /u02/inst/apps/PROD_apps/logs/ora/10.1.2/forms/socket.log for more information ...

[applmgr@apps scripts]$
Here we can find useful Unix commands and it will help to oracle dba’s and Linux Administrators.
1) To Find total hard Disk Size:
[root@ns2 ~]# fdisk -l
Disk /dev/sda: 500.1 GB, 500107862016 bytes
255 heads, 63 sectors/track, 60801 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 * 1 255 2048256 83 Linux
/dev/sda2 256 60801 486335745 8e Linux LVM
[root@ns2 ~]# fdisk -l |grep Disk
Disk /dev/sda: 500.1 GB, 500107862016 bytes
2) To Find out the mount Points in Linux OS
[root@ns2 ~]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00
4.8G 478M 4.1G 11% /
/dev/mapper/VolGroup00-LogVol07
95G 188M 90G 1% /u01
/dev/mapper/VolGroup00-LogVol02
9.5G 151M 8.9G 2% /tmp
/dev/mapper/VolGroup00-LogVol06
961M 125M 787M 14% /opt
/dev/mapper/VolGroup00-LogVol08
95G 188M 90G 1% /u02
/dev/mapper/VolGroup00-LogVol01
4.8G 138M 4.4G 4% /home
/dev/mapper/VolGroup00-LogVol03
19G 4.5G 14G 25% /usr
/dev/mapper/VolGroup00-LogVol05
9.5G 151M 8.9G 2% /usr/local
/dev/mapper/VolGroup00-LogVol04
20G 4.5G 14G 25% /var
/dev/sda1 1.9G 47M 1.8G 3% /boot
tmpfs 839M 0 839M 0% /dev/shm
3) To Find out Operating System CPU Info:
[root@ns2 ~]# more /proc/cpuinfo
processor : 0
vendor_id : GenuineIntel
cpu family : 6
model : 58
model name : Intel(R) Pentium(R) CPU G2020 @ 2.90GHz
stepping : 9
cpu MHz : 1600.000
cache size : 3072 KB
physical id : 0
fpu : yes
fpu_exception : yes
cpuid level : 13
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm co
nstant_tsc nonstop_tsc arat pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips : 5786.75
–More–(0%)
4) To change user
[root@ns2 ~]# su – testdb
[testdb@ns2 ~]$
5) To change the password for Linux user:
Here I am changing password for User “testdb”
[root@ns2 ~]# passwd testdb
Changing password for user testdb.
New UNIX password:
BAD PASSWORD: it is based on a dictionary word
Retype new UNIX password:
passwd: all authentication tokens updated successfully.
6) How many database are installed in Linux OS:
[appltest@oracleprod2 appltest]$ more /etc/oratab
TEST:/u01/testdb/9.2.0:N
*:/u01/testora/8.0.6:N
*:/u01/testora/iAS:N
TEST:/u01/testdb/9.2.0:N
TEST:/u01/testdb/9.2.0:N
TEST:/u01/db/testdb/9.2.0:N
*:/u01/apps/testora/iAS:N
*:/u01/apps/testora/8.0.6:N
TEST:/u01/db/testdb/9.2.0:N
*:/u01/apps/testora/iAS:N
*:/u01/apps/testora/8.0.6:N
TEST:/u01/db/testdb/9.2.0:N
*:/u01/apps/testora/iAS:N
*:/u01/apps/testora/8.0.6:N
TEST:/u01/db/testdb/9.2.0:N
*:/u01/apps/testora/iAS:N
*:/u01/apps/testora/8.0.6:N
TEST:/u01/db/testdb/9.2.0:N
*:/u01/apps/testora/iAS:N
*:/u01/apps/testora/8.0.6:N
TEST:/u01/db/testdb/9.2.0:N
*:/u01/apps/testora/iAS:N
Oratab is the file which is store in /etc/ location. oratab file gives the list of database are created under oracle software automatically(using DBCA utility). If we create database as manually we need to enter the database name in oratab file.
Note: we can also start the database automatically when operating system boot using change the value of database entry of Y instead of N.
7)[appltest@oracleprod2 appltest]$ ps -ef |grep ora_
appltest 29620 1 0 Mar07 ? 00:10:01 ora_pmon_TEST
appltest 29622 1 0 Mar07 ? 00:11:25 ora_dbw0_TEST
appltest 29624 1 0 Mar07 ? 01:09:00 ora_lgwr_TEST
appltest 29626 1 0 Mar07 ? 00:18:04 ora_ckpt_TEST
appltest 29628 1 0 Mar07 ? 00:08:04 ora_smon_TEST
appltest 29630 1 0 Mar07 ? 00:00:00 ora_reco_TEST
appltest 29632 1 0 Mar07 ? 00:00:01 ora_cjq0_TEST
appltest 29644 1 0 Mar07 ? 00:00:30 ora_arc0_TEST
This command is used for know the oracle database is running or not from linux command line.
8)[appltest@oracleprod2 appltest]$ top
11:10am up 59 days, 21:01, 1 user, load average: 0.63, 0.33, 0.26
304 processes: 301 sleeping, 1 running, 2 zombie, 0 stopped
CPU0 states: 24.0% user, 6.0% system, 0.0% nice, 68.0% idle
CPU1 states: 3.0% user, 8.0% system, 0.0% nice, 87.0% idle
CPU2 states: 0.0% user, 0.0% system, 0.0% nice, 100.0% idle
CPU3 states: 2.0% user, 28.0% system, 0.0% nice, 68.0% idle
Mem: 3943884K av, 3913268K used, 30616K free, 763696K shrd, 576804K buff
Swap: 6286312K av, 613680K used, 5672632K free 1809048K cached
PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND
30683 appltest 15 0 6920 6528 5156 S 17.1 0.1 13:42 FNDLIBR
29626 appltest 15 0 42188 31M 32516 S 7.6 0.8 18:04 oracle
30336 appltest 15 0 1252 1248 824 R 2.8 0.0 0:00 top
27040 appltest 15 0 32788 24M 23464 S 1.9 0.6 0:00 oracle
This is the Important command which is check the performance of the system. I will explain about top command clearly in the next post.

Issue with APPLSYS and APPS password

Issue 1:
As you know that apps and applsys password should be in synch and should be changed using FNDCPASS.
There can be situation where a novice user changes applsys password from the backend database. In that case when you try to start the services it will show following error
APP-FND-01496: Cannot access application ORACLE password
Cause: Application Object Library was unable access your ORACLE password.
You can even reproduce this issue (ofcourse after taking the backup of FND_USER and FND_ORACLE_USERID table) using the following steps
1. Use the ALTER USER command to change the APPLSYS password
2. Try to run the adstrall.sh script to start Apps services.
3. You will get an error “Cannot complete applications logon. You may have entered an invalid applications password, or there may have been a database connect error.”
4. Then try FNDCPASS to fix password and you will get the error the APP-FND-01496 error.
If this situation happens then you cannot access the application. Infact the services even wont start.
Resolution to such problem is to rollback the 2 tables FND_USER and FND_ORACLE_USERID. Once you rollback the tables, apps and applsys passwords will be in synch and password will be older one. You can then run FNDCPASS and change the password.
Issue 2:
Some times when you run FNDCPASS, you get following error
APP-FND-01502: Cannot encrypt application ORACLE password
Cause: Application Object Library was unable encrypt your ORACLE password.
Action: Contact your support representative. (ORACLEUSER=APPS_SERV)
The error comes because the table fnd_oracle_userid contain rows for schemas that does not exist. Those rows must be deleted from the table.
Use the following query to get the details of the schema that doest not exists
select * from fnd_oracle_userid
where oracle_username not in
(select username from all_users);
The rows returned by this query can be deleted from FND_ORACLE_USERID table. This will resolve this issue.
Issue 3:
There can be situation where users has update APPLSYS password using ALTER command in database directly and also you dont have backup of those tables. Under such situation, it is very difficult to recover the application and make it working. Still following methodology is proposed which might help you to restore the password back and make your application work fine.
For this to work you should have some other application (may be debug or UAT) which is having the same passwords or default passwords for schemas. If you have such application the following the below steps in the application which is affected by password mismatch.
This method is for resetting apps and applsys passwords. Below are the SQL statements that will help you reset the APPS and APPLSYS passwords to APPS, the APPLSYSPUB password to PUB, and the SYSADMIN password to SYSADMIN.
WARNING: This procedure will cause all user passwords to become invalid. ALL users passwords will need to be reset through the sysadmin responsibility.
Step 1) Reset the Oracle User IDs
Open a SQL*Plus as SYSTEM and reset the passwords for the APPS, APPLSYS, and the APPLSYSPUB Oracle user ID:
ALTER USER apps IDENTIFIED BY apps;
ALTER USER applsys IDENTIFIED BY apps;
ALTER USER applsyspub IDENTIFIED BY pub;
Step 2) Backup the FND_ORACLE_USERID and FND_USER tables (even though these tables are right now corrupted, do take a backup. You can restore the same when ever you want).
Open a SQL*Plus session as APPLSYS and backup the tables:
create table FND_ORACLE_USERID_BAK as (select * from FND_ORACLE_USERID);
create table FND_USER_BAK as (select * from FND_USER);
Step 3) Reset the APPS and APPLSYS application encrypted passwords
Open a SQL*Plus session as APPLSYS and update the FND_ORACLE_USERID table.
update FND_ORACLE_USERID
set ENCRYPTED_ORACLE_PASSWORD = ‘ZGA34EA20B5C4C9726CC95AA9D49EA4DBA8EDB705CB7673E645EED570D5447161491D78D444554655B87486EF537ED9843C8′
where ORACLE_USERNAME in (‘APPS’, ‘APPLSYS’);
commit;
This encrypted string we are updating is the default encrypted string for apps. So if your application is having apps password the encrypted string will look like this. We are updating this encrypted string here directly.
Verify the table update:
select ENCRYPTED_ORACLE_PASSWORD
from FND_ORACLE_USERID
where ORACLE_USERNAME IN (‘APPS’, ‘APPLSYS’);
Step 4) Reset the APPLSYSPUB application encrypted password
Open a SQL*Plus session as APPLSYS and update the FND_ORACLE_USERID table.
update FND_ORACLE_USERID
set ENCRYPTED_ORACLE_PASSWORD = ‘ZG31EC3DD2BD7FB8AD2628CE87DDDF148C1D2F248BE88BE987FDF82830228A88EF44BC78BC7A9FAD4BFB8F09DAD49DF7280E’
where ORACLE_USERNAME = (‘APPLSYSPUB’);
commit;
The above encrypted string is the encrypted string for password pub. If your applsyspub password is pub then the encrypted string in FND_ORACLE_USERID will look like this.
Verify the table update:
select ENCRYPTED_ORACLE_PASSWORD
from FND_ORACLE_USERID
where ORACLE_USERNAME = ‘APPLSYSPUB’;
Once these updates are done, try your luck by running FNDCPASS and it should work fine.
References
Metalink note ID 445153.1
Metalink note ID 429244
This entry was posted in Oracle Apps DBA Real Time Issues on May 25, 2013.

FNDCPASS SYNTAX AND TROUBLE SHOOTING

In Oracle Applications, we have an FND functionality for changing the passwords for application users, product schema passwords, and “APPS and APPLSYS.” The location of FNDCPASS utility is $FND_TOP/bin directory.
FNDCPASS Usage:
FNDCPASS logon 0 Y system/password mode username new_password
where logon is username/password[@connect]
system/password is password of the system account of that database
mode is SYSTEM/USER/ORACLE
username is the username where you want to change its password
new_password is the new password in unencrypted format
example FNDCPASS apps/apps 0 Y system/manager SYSTEM APPLSYS WELCOME
FNDCPASS apps/apps 0 Y system/manager ORACLE GL GL1
FNDCPASS apps/apps 0 Y system/manager USER VISION WELCOME
If you just type FNDCPASS and press enter, it will give you these details.
The first usage
FNDCPASS apps/apps 0 Y system/manager SYSTEM APPLSYS WELCOME
is for changing the password for apps and applsys. These are the database schema users (most important for application to work). Password for both these users should be in synch. You can change the password of these users using this command. Note that this is the only way to change the password for apps and applsys. Please do not try any other method for changing apps and applsys password. Oracle recomends using FNDCPASS only to change apps and applsys password. Also note that using this command will change the password for both apps and applsys.
Following activities will take place
(1) applsys validation. (make sure APPLSYS name is correct)
(2) re-encrypt all password in FND_USER
(3) re-encrypt all password in FND_ORACLE_USERID
(4) update applsys’s password in FND_ORACLE_USERID table.
(5) Update apps password in FND_ORACLE_USERID table.
Also changes are made in DBA_USERS table.
The second usage
FNDCPASS apps/apps 0 Y system/manager ORACLE GL GL1
is for changing password for any other product schema like MSC, GL etc.
Following activities will take place
(1) update GL’s password in FND_ORACLE_USERID table. The new password is re-encrypted with the current applsys password.
If GL does not exists, step (2) below does not happen. Message for invalid oracle user is written in the log file.
(2) alter user to change GL’s password.
The third usage
FNDCPASS apps/apps 0 Y system/manager USER VISION WELCOME
is for changing the application level passwords like sysadmin etc used for logging into application.
Following activities will take place
(1) update VISION’s password in FND_USER table. The new password is re-encrypted with the current applsys password.
If VISION does not exist, message for invalid application user is written in the log file.
No products affected by the patch
When you run FNDCPASS command it will check the integrity of all schema password in the application. If any of the password is corrupt then this will through and error and will not change the password.
The tables that it uses is FND_USER and FND_ORACLE_USERID. All the application passwords and schema passwords are stored in these two tables. Ofcourse DBA_USERS will have the schema users and password stored as well.
When we run FNDCPASS it will update all the above 3 tables.
Best usage of FNDCPASS
Before using FNDCPASS:
1) Always keep the back of tables FND_USER and FND_ORACLE_USERID. You can take back of these tables using CREATE TABLE — AS SELECT * FROM —.
You must have backup of these tables before running FNDCPASS. In case if FNDCPASS fails then it might corrupt the passwords of your application and worst can happen that the application wont come up. So always be cautions about this command.
2) If possible also keep an export dump of these two tables.
3) verify each arguement you are providing to FNDCPASS. Like verify that apps and system passwords you are providing is correct.
4) Never update apps, applsys or any schema password directly from database using the alter command. Always use FNDCPASS. System password can be set directly using ALTER command in database.
After logging into the Oracle Applications R12, some users are complaining about the error "You have insufficient privileges” Error but they click the home button it is working fine.

Solution:-
1. Manually run the Compile Security' concurrent program, set the parameter to YES
2. Restart the Middle Tier (Apache).
3. Retest the issue.

After logging into the Oracle Applications R12.1.2,They get the pop up message:"Number of open notifications Please use the workflow worklist to view and respond to your notification"

Solution:-
Each Application user that has notifications will be notified of them upon login if the Sign-On: Notification System
Profile option was set to yes. If you wish to stop getting these messages, request you to do the following:
1. Log into Oracle Applications.
2. using the System Administrator responsibility perform the following navigation:
/Profile /System /
3. Within the Profile window, enter: Sign-On: Notification and click on Find.
4. Using the list of values, this feature can be enabled setting it to Yes or Disabled setting it to No.
5. After changing the setting to No, log out of Applications and back in where the change will be in place.

Active users Request shows completed error in R12.
When we check the log file it shows below error
There was an error trying to initialize the HPI library.
Please check your installation, HotSpot does not work correctly
when installed in the JDK 1.2 Solaris Production Release, or
with any JDK 1.1.x release.
signal chaining not allowed for VM interrupt signal, try -XX:+UseAltSigs.
Program exited with status 1

Solution:-
At application user level go to $ORACLE_HOME/bin and take the backup of reports.sh file .then
vi reports.sh (under #Solaris Sparc we have to modify)
## Default settings
else
## Solaris Sparc
LD_LIBRARY_PATH=$ORACLE_HOME/jdk/jre/lib/sparc:$ORACLE_HOME/jdk/jre/lib/sparc/native_threads:$ORACLE_HOME/lib32:$ORACLE_HOME/lib:/usr/dt/lib:/usr/openwin/lib:${LD_LIBRARY_PATH}; export LD_LIBRARY_PATH
We have to add the $ORACLE_HOME/jdk/jre/lib/sparc/server: to starting of above path then we can see like below
LD_LIBRARY_PATH=$ORACLE_HOME/jdk/jre/lib/sparc/server:$ORACLE_HOME/jdk/jre/lib/sparc:$ORACLE_HOME/jdk/jre/lib/sparc/native_threads:$ORACLE_HOME/lib32:$ORACLE_HOME/lib:/usr/dt/lib:/usr/openwin/lib:${LD_LIBRARY_PATH}; export LD_LIBRARY_PATH
Note: The above solution is applicable on Solaris platform only

How to purge the bne.log file under $BNE_TOP/log in Oracle EBS R12
Solution:-
>bne.log

The core files shows big size under dbs directory in db oracle home
Solution:-
1. First we have to remove the core files under dbs directory by using >core command
2. Set sqlnet.expire_time=0 in $ORACLE_HOME/network/admin/sqlnet.ora on the server.
Restart the listener to ensure that these changes take effect.


Q: - while installing R12 we get the error “Rapidwiz fails with error: RC-20200: Fatal: Could not find Unzip” on Solaris.
Solution: unzip the p8639046_R12_GENERIC.zip in stage area. Rapidwiz wants high version to unzip.

Q: - While installing R12 we get the error “RW-50016:ERROR :-{0} was not create” on post install steps at login page level .
Solution: we have to recreate the dbc file by using adgendbc.sh then we click the retry button on screen
Note: first we have to run the Autoconfig on db tier. If it successful no need to create dbcfile.
If it fails we have to create the dbc file using adgendbc.sh.

Q: while upgrading from 12.1.1 to 12.1.2 we get the error “ORA-04030: out of process memory “
Solution: - We have to run the adpatch again very less number of workers.
Note: While we applying 7303030 patch default it shows 64 workers. I have given the 30 workers but i got the above error then again we run the adpatch freshly using 12 workers and resolved the issue. So during upgradation we have to enter the vey less number of worker


Q: adcfgclone.pl error:RC-50014: Fatal: Execution of AutoConfig was failed in R12.


When we check the log file we can see the error like below
AutoConfig could not successfully instantiate the following files:

Directory: /u01/oradb/db/tech_st/11.1.0/appsutil/install/TEST1_<hostname>

adcrdb.sh INSTE8

AutoConfig is exiting with status 1

RC-50014: Fatal: Execution of AutoConfig was failed

Raised by oracle.apps.ad.clone.ApplyDatabase
Solution: we have to copy the adcrdb.sh file ($ORACLE_HOME/appsutil/template) from Source to target ($ORACLE_HOME/appsutil/template) then we run the adcfgclone.pl dbTier again.
Note: Normally adcrdb.sh file is missed if we provide the wrong apps password on target
What happens if we remove the _pages under $COMMON_TOP in R12
In 11i after removing the class files under $COMMON_TOP/_pages new class files are created automatically when the JSP page is called from a browser session and JSP
In R12 if we done the same thing the login screen will hang or it shows blank page
Temporary Solution: compile the jsp pages using below command
Bash$ perl $FND_TOP/patch/115/bin/ojspCompile.pl --compile --flush -p 2
Once completion of above command the new class files are created under $COMMON_TOP/_pages
Permanent solution:
When we check the Application context file it shows like below
<jsp_debug_parameters oa_var="s_jsp_main_mode">justrun</jsp_debug_parameters>
1. We have to change the s_jsp_main_mode from justrun to recompile in the context file.
2. Run the autoconfig to change the values related configuration files
3. How check whether autoconfig completed successfully or not
·         check in application context file
      <jsp_debug_parameters oa_var="s_jsp_main_mode">recompile</jsp_debug_parameters>
·         check the configuration file $INST_TOP/ora/10.1.3/j2ee/oacore/application-deployments/oacore/html/orion-web.xml .
                    <param-name>main_mode</param-name>
                    <param-value>recompile</param-value>
Once completion of above activity the new class files are created under $COMMON_TOP/_pages

 Note:  on production recommended method is manual 'ojspcompile.pl'


OEM Configuration for Single db in Oracle
 We can execute below command in db level any location.
-bash-3.00$ emca -repos create
STARTED EMCA at Mar 18, 2013 5:16:44 AM
EM Configuration Assistant, Version 11.1.0.7.0 Production
Copyright (c) 2003, 2005, Oracle.  All rights reserved.
Enter the following information:
Database SID: TEST1
Listener port number: 1521
Password for SYS user:
Password for SYSMAN user:
Do you wish to continue? [yes(Y)/no(N)]: Y
Mar 18, 2013 5:17:00 AM oracle.sysman.emcp.EMConfig perform
INFO: This operation is being logged at /u01/oradb/db/tech_st/11.1.0/cfgtool
Mar 18, 2013 5:17:01 AM oracle.sysman.emcp.EMReposConfig invoke
INFO: Dropping the EM repository (this may take a while) ...
Mar 18, 2013 5:56:58 AM oracle.sysman.emcp.EMReposConfig invoke
INFO: Repository successfully dropped
Mar 18, 2013 5:56:58 AM oracle.sysman.emcp.EMReposConfig createRepository
INFO: Creating the EM repository (this may take a while) ...
Mar 18, 2013 6:27:38 AM oracle.sysman.emcp.EMReposConfig invoke
INFO: Repository successfully created
Enterprise Manager Configuration completed successfully
FINISHED EMCA at Mar 18, 2013 6:27:38 AM
-Bash-3.00$ emca -config dbcontrol db
STARTED EMCA at Mar 18, 2013 6:28:55 AM
EM Configuration Assistant, Version 11.1.0.7.0 Production
Copyright (c) 2003, 2005, Oracle.  All rights reserved.
Enter the following information:
Database SID: TEST1
Database Control is already configured for the database TEST1
You have chosen to configure Database Control for managing the database TEST1
This will remove the existing configuration and the default settings and perform a fresh configuration
Do you wish to continue? [Yes(Y)/no (N)]: Y
Listener port number: 1521
Password for SYSMAN user: Email address for notifications (optional):
Outgoing Mail (SMTP) server for notifications (optional):
-----------------------------------------------------------------
You have specified the following settings
Database ORACLE_HOME ................ /u01/oradb/db/tech_st/11.1.0
Local hostname................ AAA.bbb.com
Listener port number ................ 1521
Database SID................ TEST1
Email address for notifications...............
Outgoing Mail (SMTP) server for notifications...............
-----------------------------------------------------------------
Do you wish to continue? [yes(Y)/no(N)]: Y
Mar 18, 2013 6:29:37 AM oracle.sysman.emcp.EMConfig perform
INFO: This operation is being logged at /u01/oradb/db/tech_st/11.1.0/cfgtoollogs/emca/TEST1/emca_2013_03_18_06_28_55.log.
Mar 18, 2013 6:29:40 AM oracle.sysman.emcp.util.DBControlUtil stopOMS
INFO: Stopping Database Control (this may take a while) ...
Mar 18, 2013 6:32:33 AM oracle.sysman.emcp.EMReposConfig uploadConfigDataToRepository
INFO: Uploading configuration data to EM repository (this may take a while) ...
Mar 18, 2013 6:49:46 AM oracle.sysman.emcp.EMReposConfig invoke
INFO: Uploaded configuration data successfully
Mar 18, 2013 6:49:58 AM oracle.sysman.emcp.util.DBControlUtil configureSoftwareLib
INFO: Software library configured successfully.
Mar 18, 2013 6:49:58 AM oracle.sysman.emcp.EMDBPostConfig configureSoftwareLibrary
INFO: Deploying Provisioning archives ...
Mar 18, 2013 6:50:18 AM oracle.sysman.emcp.EMDBPostConfig configureSoftwareLibrary
INFO: Provisioning archives deployed successfully.
Mar 18, 2013 6:50:18 AM oracle.sysman.emcp.util.DBControlUtil secureDBConsole
INFO: Securing Database Control (this may take a while)...
Mar 18, 2013 6:50:40 AM oracle.sysman.emcp.util.DBControlUtil secureDBConsole
INFO: Database Control secured successfully.
Mar 18, 2013 6:50:40 AM oracle.sysman.emcp.util.DBControlUtil startOMS
INFO: Starting Database Control (this may take a while)...
Mar 18, 2013 6:51:56 AM oracle.sysman.emcp.EMDBPostConfig performConfiguration
INFO: Database Control started successfully
Mar 18, 2013 6:51:56 AM oracle.sysman.emcp.EMDBPostConfig performConfiguration
INFO: >>>>>>>>>>> The Database Control URL is https://AAA.bbb.com:5500/em<<<<<<<<<<<
Mar 18, 2013 6:52:06 AM oracle.sysman.emcp.EMDBPostConfig invoke
WARNING:
************************ WARNING ************************
Management Repository has been placed in secure mode wherein Enterprise Manager Data will be encrypted.  The encryption key has been placed in the file: /u01/oradb/db/tech_st/11.1.0/AAA.bbb.com_TEST1/sysman/config/emkey.ora.   Please ensure this file is backed up as the encrypted data will become unusable if this file is lost.
Enterprise Manager Configuration completed successfully
FINISHED EMCA at Mar 18, 2013 6:52:06 AM
_________________________________________________________________________________
Then we have to enable the port 5500 from server side.
Once the port 5500 enabled we will check the URL https://AAA.bbb.com:5500/em in internet explorer (or) chrome it will ask username and password. Then
We will give the SYSMAN username and password
                                                  (Or)
  We will give the SYS username and password as SYSDBA
Once password authentication done we will get the Oracle enterprise manager page.
                                 So Finally OEM Configuration has successfully completed
------------------------------------------------**********************---------------------------------------------------
 Errors:
                           We will get the below errors while implementing OEM.
-bash-3.00$ emca -repos create
First time whenever we implement OEM we have to give above command only to create repository
But sometimes  we will get the error like SYSMAN user already exist .in that situation we have to give the  emca -repos recreate command .
-bash-3.00$ emca -repos recreate
Error2:-
If you get any below error after passing the user name and password
1.       It will take long time to authenticate  (or)
2.        internet explorer cannot display the page error
Check the space for SYSAUX, SYSTEM and TEMP Table space.
Note: -   OEM is consuming very high TEMP tablespace




Opatch Issues
 The below opatch issues we can get source or Cloned instance
-bash-3.00pwd
/u01/oradb/db/tech_st/11.2.0/OPatch
-bash-3.00$ opatch lsinventory
OPatch failed with error code 104
Solution:
Step 1:-check the oraInst.loc file has created or not at OS Level under /var/opt/oracle/
If not, copy the oraInst.loc from $ORACLE_HOME to /var/opt/oracle/ directory.
Note: /var/opt is Solaris platform .Remaining platforms may be different at OS level
-bash-3.00$cp $ORACLE_HOME /orainst.loc /var/opt/oracle
vi /var/opt/oracle/oraInst.loc
inventory_loc=$ORACLE_HOME/admin/oui/<SID>_<hostname>/oraInventory
Suppose if oraInst.loc file exist but we are getting the error. Then
Step 2:-
-bash-3.00$opatch lsinventory -invPtrLoc $ORACLE_HOME/oraInst.loc
OPatch succeeded.
If above command also not working then
Step3:-we check the files ContentsXMLinstall. Platform,
logs and oraInstaller.properties are exist or not below location /u01/oradb/db/tech_st/11.2.0/admin/oui/<SID>_<hostname>/oraInventory
If not, copy from source instance to above location.
Step 4: if files are exist then
-bash-3.00$ cd ContentsXML
-bash-3.00$ ls
comps.xml inventory.xml libs.xml
-bash-3.00$ view inventory.xml
<?xml version="1.0" standalone="yes" ?>
<!-- Copyright (c) 1999, 2008, Oracle. All rights reserved. -->
<!-- Do not modify the contents of this file by hand. -->
<INVENTORY>
<VERSION_INFO>
<SAVED_WITH>11.2.0.3.0</SAVED_WITH>
<MINIMUM_VER>2.1.0.6.0</MINIMUM_VER>
</VERSION_INFO>
<HOME_LIST>
<HOME NAME="TEST1_DB__u01_oradb_db_tech_st_11_2_0" LOC="/u01/oradb/db/tech_st/11.2.0" TYPE="O" IDX="1"/>
</HOME_LIST>
</INVENTORY>
Note: here <HOME NAME> we have to provide the our instance name and Oracle home details


Autoconfig issue after clone

Issue :

1) This issue was occured  while Autoconfig was running at Apps  
    Tier as a part of post clone task.
2) Autoconfig completed with errors.
3) We found below error message in Autoconfig log file

Error Message:

AC-50480: Internal error occurred: java.lang.Exception: Error while generating listener.ora.


Solution:

1) We found doc id 453901.1 and performed below action plan

To implement the solution, please execute the following steps :

1. Open a new shell and source the APPS Environment.

2. Start the sqlplus Utility and execute following commands as APPS User:
sqlplus apps/<Password>
exec fnd_conc_clone.setup_clean

3. Open a new shell and source the DB-Tier Environment.

4. Execute Autoconfig at the DB-Tier.

5. Switch to the Shell with the APPS Enviornment sourced or start a new Shell and source the APPS Environment.

6. Execute Autoconfig at the APPS-Tier.

7. Retest the Services startup.

OC4J Components exiting with status 204,3 and 150

R12-oafm, forms and oacore exiting with status 204, status 3 and status 150 after IP address change:

Recently, I had gone through a problem while, I changed the server IP and started the oracle application with adstrtal.sh script.

adstrtal.sh: Exiting with status 3 and adoafmctl.sh: exiting with status 204

Solution to fix this issue:

Problem: IP address is present in OC4J lock files, Once IP address is changed - lock files contain the wrong IP address which causes the problem to fail OC4J.

Steps to be followed to exit with 0:

Open a new session and set the environment with apps user.
Go to $ADMIN_SCRIPTS_HOME ( cd $INST_TOP/ADMIN/SCRIPTS)
adopmnctl.sh stop
Verify the staus once: ps -ef grep grep opmn
Delete the persistence directory with below commands:
rm -r $INST_TOP/ora/10.1.3/j2ee/oacore/persistence/*
rm -r $INST_TOP/ora/10.1.3/j2ee/oafm/persistence/*
rm -r $INST_TOP/ora/10.1.3/j2ee/forms/persistence/*
adopmnctl.sh start
Check if the issue has been resolved: adapcctl.sh status

adoafmctl.sh fails after 12.1.3 Upgrade
Recently performed an Upgrade of :

1.Database from 11.2.0.2 to 11.2.0.3 and
2. Oracle R12 from 12.1.2 to 12.1.3.

While trying to start all services, adoafmctl.sh fails with below error :

Starting OPMN managed OAFM OC4J instance ...

adoafmctl.sh: exiting with status 152

And the log file says:

Error
--> Process (index=1,uid=457048498,pid=14483554)
time out while waiting for a managed process to start


Solution:

1. rm $ORA_CONFIG_HOME/10.1.3/opmn/logs/states/*
Clear the TLD cache:

- stop all middle tier services

-Make sure there are not background unix processes 'ps -ef|grep applmgr'

- Delete/backup the file:

$COMMON_TOP/_TldCache

2. delete all .lock files from the below directory subtrees:

$INST_TOP/ora/10.1.3/j2ee/forms/persistence/forms_default_group_1/
$INST_TOP/ora/10.1.3/j2ee/oacore/persistence/oacore_default_group_1/
$INST_TOP/ora/10.1.3/j2ee/oafm/persistence/oafm_default_group_1/

Then Start all services.

=========================================================================

Apache issue after installing EBS R12 on Linux x86

EBS R12 installed on a Red Hat Enterprise Linux AS release 4 (2.6.9-5.EL)

After the install, when trying to start up the http server, this happens:

$./adapcctl.sh start
.
You are running adapcctl.sh version 120.6
.
Starting OPMN managed Oracle HTTP Server (OHS) instance ...
.
adapcctl.sh: exiting with status 204
.
adapcctl.sh: check the logfile
$INST_TOP/apps/CONTEXT_NAME/logs/appl/admin/log/adapcctl.txt for more information.

Workaround:

Remove the parameter -DSSL in the ohs_start() function as follows:
.
$/<?>ora/10.1.3/Apache/Apache/bin/apachectl:

$ diff apachectl.original apachectl.mine

129c129,130
> eval ohs_start -DSSL "$args"
---
> # eval ohs_start -DSSL "$args"
> eval ohs_start "$args"

Restart Apache.

This is however a temporary solution. The main problem is due to not Installing all the Linux RPMS as per the R12 installation document (Note.402310.1). This has to be implemented so as to have a permanent workaround.

===============================================================================================



Autoconfig Error after clone in 12.1.3 Instance

While running autoconfig on a cloned instance , the below mentioned error occurred:

PL/SQL procedure successfully completed.

declare
*
ERROR at line 1:
ORA-00001: unique constraint (APPLSYS.AD_APPL_TOPS_U2) violated
ORA-06512: at line 32


Disconnected from Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
adadmprf.sh exiting with status 1
ERRORCODE = 1 ERRORCODE_END
.end std out.

.end err out.

AutoConfig could not successfully execute the following scripts:
    Directory: /u01/apps/mine/inst/apps/test_mine/admin/install
      adadmprf.sh             INSTE8_PRF         1

Solution:


1. select applications_system_name from applsys.fnd_product_groups;

This will return the source instance sid.

2. Update the entry with target instance name:

 update applsys.fnd_product_groups set applications_system_name = '<target instance>';

3. Run autoconfig again.


============================================================================================


File system gets filled due to Report cache in Oracle apps R12



In Oracle Apps R12 the report server is started by the concurrent manager whenever there is a need to run a report and it is an in-process report server which is started as per the need.

During this process the oracle reports writes to a temporary cache directory. The path and cache size is defined in the rwbuilder.conf file.

For example:

<cache class="oracle.reports.cache.RWCache">
<property name="cacheSize" value="50"/>
<property name="cacheDir" value="full path for $INST_TOP/logs/ora/10.1.2/reports/cache"/>
<!--property name="maxCacheFileNumber" value="max number of cache files"/-->
<!--property name="ignoreParameters" value="parameter names to be ignored in constructing cache key, separated by comma ','"/-->
</cache>

This cache directory doesn’t have any control on its growth and purging, though its temporary in nature. The Purge Concurrent Request and/or Manager Data" (FNDCPPUR) program also doesn’t purge these files.

Hence as more oracle reports are run, more temporary files gets created and space gets filled up under:

$INST_TOP/logs/ora/10.1.2/reports/cache.

Solution:

Manually delete the files under:
$INST_TOP/logs/ora/10.1.2/reports/cache


Change the cache size parameter in rwbuilder.conf to zero:
<property name="cacheSize" value="50"/> to
<property name="cacheSize" value="0"/>

======================================================================

Gather stats fails after upgrade to Oracle 10G
Gather Schema Statistics or Gather Table Statistics or running FND_STATS  fails with "ORA-20005: object statistics are locked".


Example:


ERROR: While GATHER_TABLE_STATS:
object_name=AR.AR_REV_REC_QT***ORA-20005: object statistics are locked (stattype = ALL)***


This can happen with Advance Queue tables.


In 10g, if a queue is created or recreated during the upgrade, automatic statistics gather gets locked (disabled) on these queue.
The following statement can be used to check the tables which have statistics locked:


    select owner, table_name, stattype_locked
    from dba_tab_statistics
    where stattype_locked is not null;

SOLUTION:

Unlock gather stats running on those queues :

exec dbms_stats.unlock_schema_stats('schema_owner');
exec dbms_stats.unlock_table_stats('table_owner','table_name');

Example:
SQL> exec dbms_stats.unlock_schema_stats ('AR');
SQL> exec dbms_stats.unlock_table_stats('AR', 'AR_REV_REC_QT');


======================================================================

Login issues in Oracle EBS 11i after Clone ( from hotbackup)

Error in login page:

ORA-01110: data file 98: '/disk09_250/oradata/mine/a_txn_data14.dbf'
ORA-26040: Data block was loaded using the NOLOGGING option

SOLUTION:

1. Compile jsp:
cd $FND_TOP/patch/115/bin
perl ojspCompile.pl --compile --flush

2. Access the form directly using the URL:
http://sanop.mine.com:8020/forms/frmservlet?form_params=config=PRODMINE

3. Run the request:
"Synchronize WF LOCAL tables" - Parameters: ALL
"Synchronize WF LOCAL tables" - Parameters: FND_USER

Restart Apache. This will resolve the issue.

 OACORE fails to start after increasing the JVM processes in Oracle R12

Issue: OACORE processes are not starting.

Recent changes: Increased the JVM processes in the context file.

Error:

adoacorectl.sh: exiting with status 206

Solution:

1)  Stop the middle tier processes:

adopmnctl.sh stop

2) Kill any runaway/zombie processes.

3) Remove the following jms lock files:

$ORA_CONFIG_HOME/10.1.3/j2ee/forms/persistence/forms_default_group_1/jms.state.lock,

$ORA_CONFIG_HOME/10.1.3/j2ee/oacore/persistence/oacore_default_group_1/jms.state.lock

$ORA_CONFIG_HOME/10.1.3/j2ee/oafm/persistence/oafm_default_group_1jms.state.lock

4) Restart middle tier:
adopmnctl.sh start


======================================================================================


Resolving ORA-02374: conversion error loading table during impdp

Iam trying to do an import of a table into 11.2.0.2 database and facing the below mentioned error:

ORA-02374: conversion error loading table "MINE_USR"."POPUPS_PROJECT_BIN"
ORA-12899: value too large for column MINE_TEXT (actual: 66, maximum: 64)
ORA-02372: data for row: MINE_TEXT : 0X'45737061C3B16F6C2020202020202020202020202020202020'


Details:


1.        Used expdp and created a dump for the table: MINE_USR. POPUPS_PROJECT_BIN

2.        While doing a impdp on the target database :

ORA-02374: conversion error loading table "MINE_USR"."POPUPS_PROJECT_BIN"
ORA-12899: value too large for column MINE_TEXT (actual: 66, maximum: 64)
ORA-02372: data for row: MINE_TEXT : 0X'45737061C3B16F6C2020202020202020202020202020202020'

Solution:

When you describe the table, you will see that the column MINE_TEXT is char(64):

SQL> desc MINE_USR.POPUPS_PROJECT_BIN
 Name                                      Null?    Type
 ----------------------------------------- -------- ----------------------------
 MINE_IDX                                NOT NULL NUMBER(5)
 MINE_IDX                                 NOT NULL NUMBER(5)
 MINE_COLUMN                                     NUMBER(5)
 MINE_VALUE                                      NUMBER(5)
 MINE_TEXT                                         CHAR(64)

Execute the below to modify the column of the table:

SQL> alter table MINE_USR.POPUPS_PROJECT_BIN modify MINE_TEXT CHAR(66);
Table altered.

Now perform the import using the below command:

impdp directory=DATA_PUMP_DIR dumpfile=MINE_USR.dmp logfile=MINE_USR.log tables=MINE_USR.POPUPS_PROJECT_BIN table_exists_action=truncate



============================================================================================


FRM-92101 There was a failure in forms server during startup: Error after cloning in 12.1.3 Instance


https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjk9bbKRFtjYJ8weTbkeNypZXIGmewli_y61_UTeE1DrLkRCnZp_0j468EUKY0KGDtKuJ_xR6v51AcoNdeItbT7hLaZPzHqyhE9KMuJImTLT2c51WFyVAnKmtO5vBiHBzf16sp-iCJF388/s320/Capture.PNG


After Performing Clone from PRODUCTION to TEST : Database 11.2.0.3 and Apps 12.1.3 , while opening forms the above error occurred.


Solution:

1. 
$ cd $ORACLE_HOME/lib32   >>>>>>This is 10.1.2 OH
$ rm ldflags
$ ln -s $ORACLE_HOME/lib/ldflags ldflags

Then, stop the web tier services and relink the forms executable(s):

$ cd $ORACLE_HOME/forms/lib32/
$ make -f ins_forms.mk install

2. Start all Services and retest.


How to bounce Apache, clear HTML cache and have updated Java code class active in R12

In this post, sharing the difficulties of boucing Apache, clearing HTML comparing with 11i.

To clear HTML cache and bounce Apache at R12 level, firstly goto the scripts directory of R12
cd $INST_TOP/admin/scripts

To clear HTML cache :

The _pages directory under $COMMON_TOP should not be cleared for E-Biz R12, which we used to do in 11i applications. For clearing middle tier cache in R12,
Navigate to Functional Administrator responsibility > Core Services > 
Caching Framework > Global Configuration > Clear cache

Instead of clearing the _pages in R12 creates blank login page issue, as in R12 the jsp files does not get compiled automatically.

cd $INST_TOP/admin/scripts
adapcctl.sh start
adapcctl.sh start

At R12 level bouncing apache command  is different of the one to bounce oacore oc4j engine andothers.
An example of situation is : how  to make a modification to a JSPand have that modification recognized by the OC4J - JSP engine.

In 11i the apache start and stop command, also bounce the JVM running on JSERV and clear caches by doings as below :
To clear the jsp & modplsql caches run this command
rm -Rf $OA_HTML/_pages/*
rm -Rf $COMMON_TOP/_pages/*
rm -Rf $IAS_ORACLE_HOME/Apache/modplsql/cache/*

But in R12 the command to stop and start apache only takes action on Apache web server  and not on the OC4J container that executes the JVM.
To bounce the OC4J container there is an specific script:

$INST_TOP/admin/scripts/adoacorectl.sh

Therefore when making  a modification to a JAVA class in R12 for the web application,  in order to have  that change recognized,  it is needed to bounce
OC4J using adoacorectl.sh script.

Bouncing oacore OC4J engine may also be needed  if you make modifications to system properties.
Example for JTT based applications:  jtt system properties.



No comments:

Post a Comment