my-orcl@Areef DBA, my-orcl@Arif DBA: Java Web Start Implementation on EBS R12.2.9

Hi, In this topic we implement JWS on EBS R12.2.9

List of Topics (Linux, Database, RAC, EBS)

================================================================================================================

Using Java Web Start with Oracle E-Business Suite (Doc ID 2188898.1)

Check all the Application patches applied or not:

####################--- Application Patch Check Queries ---############

select ad_patch.is_patch_applied('R12',-1,24498616) from dual;

select ad_patch.is_patch_applied('R12',-1,25449925) from dual;

select ad_patch.is_patch_applied('R12',-1,25380324) from dual;

select ad_patch.is_patch_applied('R12',-1,28713780) from dual;

select ad_patch.is_patch_applied('R12',-1,23475123) from dual;

select ad_patch.is_patch_applied('R12',-1,23280764) from dual;

select ad_patch.is_patch_applied('R12',-1,23645622) from dual;

select ad_patch.is_patch_applied('R12',-1,23575933) from dual;

select ad_patch.is_patch_applied('R12',-1,22221603) from dual;

select ad_patch.is_patch_applied('R12',-1,23586286) from dual;

select ad_patch.is_patch_applied('R12',-1,24833534) from dual;

select ad_patch.is_patch_applied('R12',-1,28700057) from dual;

select ad_patch.is_patch_applied('R12',-1,29058008) from dual;

select ad_patch.is_patch_applied('R12',-1,29024389) from dual;

select ad_patch.is_patch_applied('R12',-1,28700057) from dual;

select ad_patch.is_patch_applied('R12',-1,32645734) from dual;--not applied (4.7.2)

select ad_patch.is_patch_applied('R12',-1,32902510) from dual;--not applied (4.8.2)

---------

select * from ad_bugs where bug_number in('24498616','25449925','25380324'); --4.2.3 Application Technology Patches for Oracle E-Business Suite Release 12.2

-- 4.2.3 all 3 patches are available with lang patch also

select * from ad_bugs where bug_number in('28713780','23475123','23280764','23645622','23575933','22221603','23586286','24833534');--4.2.4 Product-Specific Patches for Oracle E-Business Suite Release 12.2

-- 4.2.4 all 8 patches are available with lang patch also

select * from ad_bugs where bug_number in('28700057','29058008','29024389');--4.5 Required Patches for Multiple Forms Session Support Using Java Web Start

-- 4.5 all 3 patches are available with lang patch also

select * from ad_bugs where bug_number in('28156520','28700057')--4.6 Required Patches for Supporting Firefox ESR on macOS (Catalina and Earlier) Using Java Web Start

-- 4.6 all 2 patches are available with lang patch also

select * from ad_bugs where bug_number in('28700057','32645734'); -- 4.7.2 Required Patches for Oracle E-Business Suite Release 12.2

-- 4.7.2 only 1 txk patch is applied, FND patch (32645734) is not applied

select * from ad_bugs where bug_number in('32902510') -- 4.8.2 Required Patches for Oracle E-Business Suite Release 12.2

-- 4.8.2 patch not applied

#############################################################################

OS Check Before Prepare:

root@ebsprodapp3:~# cat /etc/release

                            Oracle Solaris 11.4 SPARC

  Copyright (c) 1983, 2020, Oracle and/or its affiliates.  All rights reserved.

                             Assembled 26 March 2020

root@ebsprodapp3:~#

root@ebsprodapp3:~# uname -a
SunOS ebsprodapp3 5.11 11.4.20.4.0 sun4v sparc sun4v

root@ebsprodapp3:~#

root@ebsprodapp3:~# prtconf

System Configuration: Oracle Corporation sun4v

Memory size: 391680 Megabytes

System Peripherals (Software Nodes):

prtconf: devinfo facility not available

root@ebsprodapp3:~#

root@ebsprodapp3:~# pkg info entire

Name: entire

Summary: entire incorporation including Support Repository Update

(Oracle Solaris 11.4.20.4.0).

Description: This package constrains system package versions to the same

build. WARNING: Proper system update and correct package

selection depend on the presence of this incorporation.

Removing this package will result in an unsupported system.

For more information see:

https://support.oracle.com/rs?type=doc&id=2433412.1

Category: Meta Packages/Incorporations

State: Installed

Publisher: solaris

Version: 11.4 (Oracle Solaris 11.4.20.4.0)

Branch: 11.4.20.0.1.4.0

Packaging Date: Thu Mar 26 17:29:32 2020

Last Install Time: Wed Oct 14 20:51:30 2020

Size: 2.52 kB

FMRI: pkg://solaris/entire@11.4-11.4.20.0.1.4.0:20200326T172932Z

root@ebsprodapp3:~#

Implementation of Java Web Start(JWS) on DEV Server:

2.1 How Does Java Web Start Impact the Oracle E-Business Suite Architecture?

[applmgr@ebsdevapp ~]$ $ADJVAPRG -version

java version "1.7.0_321"

Java(TM) SE Runtime Environment (build 1.7.0_321-b08)

Java HotSpot(TM) Server VM (build 24.321-b08, mixed mode)

[applmgr@ebsdevapp ~]$

4.2.2 Oracle Forms 10g Technology Patch for Oracle E-Business Suite Release 12.2

[applmgr@ebsdevapp ~]$ $ORACLE_HOME/OPatch/opatch lsinventory | grep 25441839

1) Patch 25441839 applied on Thu Sep 30 09:08:40 GMT 2021

[applmgr@ebsdevapp ~]$ $ORACLE_HOME/OPatch/opatch lsinventory | grep 8551790 --Mandatory pach as per 25441839 Readme.

[ Bug fixes: 8551790 16234436 ]

[applmgr@ebsdevapp ~]$

As per 4.7.2 Required Patches for Oracle E-Business Suite Release 12.2

it is better to apply patch on Patch file system, so no need to run fsclone.

[applmgr@ebsdevapp ~]$ $ORACLE_HOME/OPatch/opatch lsinventory | grep 32922089

[applmgr@ebsdevapp ~]$ adstpall.sh apps/devdb1

================================================================================================================

Before Proceeding make full backup of APPS, DB_HOME, Database Restore point.

1. tar backup of Apps

2. Database home Backup

3. Flashback restore point for database restore; --need to check behavior if created before cutover phase

select name,open_mode,LOG_MODE,FLASHBACK_ON from v$database;

select * from v$restore_point;

show parameter db_recovery_file_dest

SQL> alter system set db_recovery_file_dest_size=20g;

SQL> alter system set db_recovery_file_dest='/u01/app/oracle/db/12.1.0/fra';

SQL> alter database flashback on;

SQL> alter system switch logfile;

SQL> create restore point before_patch_ guarantee flashback database;

Restore point created.

SQL> alter system switch logfile;

System altered.

SQL>

For Database restore:

SQL> shut immediate

SQL> startup mount;

SQL> flashback database to restore point before_patch_

select * from v$restore_point;

SQL> alter database open resetlogs;

SQL> drop restore point before_patch_

SQL> alter database flashback off;

For Apps Restore:

mv dev dev_old_fail

untar the file or if you backup with different folder name then rename to actual name:

================================================================================================================

Apply Patch 25441839:

[applmgr@ebsdevapp 25441839]$ $ORACLE_HOME/OPatch/opatch apply

Apply Patch 32922089:

[applmgr@ebsdevapp 32922089]$ $ORACLE_HOME/OPatch/opatch apply

Oracle Interim Patch Installer version 1.0.0.0.64

Oracle recommends you to use the latest OPatch version

and read the OPatch documentation available in the OPatch/docs

directory for usage. For information about the latest OPatch and

other support-related issues, refer to document ID 293369.1

available on My Oracle Support (https://myoraclesupport.oracle.com)

Oracle Home : /u01/dev/fs2/EBSapps/10.1.2

Oracle Home Inventory : /u01/dev/fs2/EBSapps/10.1.2/inventory

Central Inventory : /home/applmgr/oraInventory

from : /etc/oraInst.loc

OUI location : /u01/dev/fs2/EBSapps/10.1.2/oui

OUI shared library : /u01/dev/fs2/EBSapps/10.1.2/oui/lib/linux/liboraInstaller.so

Java location : /u01/dev/fs2/EBSapps/10.1.2/jdk/jre/bin/java

Log file location : /u01/dev/fs2/EBSapps/10.1.2/.patch_storage/<patch ID>/*.log

Creating log file "/u01/dev/fs2/EBSapps/10.1.2/.patch_storage/32922089/Apply_32922089_11-10-2021_06-09-21.log"

Invoking fuser to check for active processes.

Patch "32922089" overlays " 14825718 ". Conflict check between them is skipped.

Subset patches: 25441839,

The fixes for Patch 25441839, are included in the patch currently

being installed (32922089). OPatch will roll back the subset patch(es) and

install the new patch (32922089).

Provide your email address to be informed of security issues, install and

initiate Oracle Configuration Manager. Easier for you if you use your My

Oracle Support Email address/User Name.

Visit http://www.oracle.com/support/policies.html for details.

Email address/User Name:

You have not provided an email address for notification of security issues.

Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Y

Oracle Configuration Manager has been installed but not configured. OCM enables

Oracle to provide superior, proactive support for our customers. Oracle

strongly recommends customers configure OCM. To complete the configuration of

OCM, refer to the OCM Installation and Administration Guide

(http://www.oracle.com/technology/documentation/ocm.html).

Backing up comps.xml ...

OPatch detected non-cluster Oracle Home from the inventory and will patch the local system only.

Please shut down Oracle instances running out of this ORACLE_HOME

(Oracle Home = /u01/dev/fs2/EBSapps/10.1.2)

Is this system ready for updating?

Please respond Y|N >

Rolling back patch 25441839...

Creating log file "/u01/dev/fs2/EBSapps/10.1.2/.patch_storage/25441839/RollBack_25441839_11-10-2021_06-09-59.log"

Rolling back with all-node mode.

OPatch detected non-cluster Oracle Home from the inventory and will patch the local system only.

Oracle instances have been shut down, proceeding with auto-rollback.

Removing patch 25441839...

Restoring archive files...

Restoring copied files...

Running make for target sharedlibs.

Running make for target sharedlib.

Running make for target install.

Updating inventory...

Back to applying patch 32922089...

Backing up 2nd copy of comps.xml ..

Applying patch 32922089...

Patching archive files...

Patching copy files...

Running make for target sharedlibs.

Running make for target sharedlib.

Running make for target install.

Inventory is good and does not have any dangling patches.

Updating inventory...

Verifying patch...

Backing up comps.xml ...

OPatch succeeded.

[applmgr@ebsdevapp 32922089]$

[applmgr@ebsdevapp 32922089]$ $ORACLE_HOME/OPatch/opatch lsinventory | grep 32922089

1) Patch 32922089 applied on Wed Nov 10 06:11:00 GMT 2021

[applmgr@ebsdevapp 32922089]$

[applmgr@ebsdevapp 32922089]$ $ORACLE_HOME/OPatch/opatch lsinventory | grep 25441839

[applmgr@ebsdevapp 32922089]$

##################################################################################

Main Patch Apply for JWS

As per 4.7.2 Required Patches for Oracle E-Business Suite Release 12.2

select * from ad_trackable_entities where abbreviation in('atg_pf','ad','txk');

[applmgr@ebsdevapp JWS_FOLDER]$ unzip p32645734_R12.FND.C_R12_GENERIC.zip

[applmgr@ebsdevapp JWS_FOLDER]$ unzip p32645734_R12.FND.C_R12_ar.zip

[applmgr@ebsdevapp JWS_FOLDER]$ unzip p32902510_R12.FND.C_R12_GENERIC.zip

[applmgr@ebsdevapp JWS_FOLDER]$ unzip p32902510_R12.FND.C_R12_ar.zip

[applmgr@ebsdevapp JWS_FOLDER]$ adop -status (check current adop status)

It is better to run adop phases in screen session under root user:

[applmgr@ebsdevapp JWS_FOLDER]$ adop phase=prepare (approx 30 mins)

[applmgr@ebsdevapp JWS_FOLDER]$ adop -status

Enter the APPS password:

Connected.

==============================================================

ADOP (C.Delta.12)

Session Id: 32

Command: status

Output: /u01/dev/fs_ne/EBSapps/log/adop/32/20211110_065817/adzdshowstatus.out

===============================================================

Node Name Node Type Phase Status Started Finished Elapsed

--------------- ---------- --------------- --------------- -------------------- -------------------- ------------

ebsdevapp master PREPARE COMPLETED 2021/11/10 06:32:50 2021/11/10 06:56:13 0:23:23

APPLY NOT STARTED

FINALIZE NOT STARTED

CUTOVER NOT STARTED

CLEANUP NOT STARTED

File System Synchronization Type: Full

adop exiting with status = 0 (Success)

[applmgr@ebsdevapp JWS_FOLDER]$

Find log command for prepare phase::

find $ADOP_LOG_HOME/28 -iname txkADOPValidations.log

find $ADOP_LOG_HOME/28 -iname txkADOPPreparePhaseSanityCheck.log

find $ADOP_LOG_HOME/28 -iname txkADOPPreparePhaseSynchronize.log

find $ADOP_LOG_HOME/28 -iname ADOPValidations*.log

It is better to run adop phases in screen session under root user:

[applmgr@ebsdevapp JWS_FOLDER]$ adop phase=apply patches=32645734,32645734_AR:u32645734.drv patchtop=/u02/ftp/JWS_FOLDER (approx 45 mins)

Enter the APPS password:

Enter the SYSTEM password:

Enter the WLSADMIN password:

. . . . .

===========================================================================

ADOP (C.Delta.12)

Session ID: 32

Node: ebsdevapp

Phase: apply

Log: /u01/dev/fs_ne/EBSapps/log/adop/32/20211110_070028/adop.log

===========================================================================

Applying patch 32645734.

Log: /u01/dev/fs_ne/EBSapps/log/adop/32/20211110_070028/apply/ebsdevapp/32645734/log/u32645734.log

Applying patch 32645734_AR:u32645734.drv.

Log: /u01/dev/fs_ne/EBSapps/log/adop/32/20211110_070028/apply/ebsdevapp/32645734_AR/log/u32645734.log

Generating post apply reports.

Generating log report.

Output: /u01/dev/fs_ne/EBSapps/log/adop/32/20211110_070028/apply/ebsdevapp/adzdshowlog.out

The apply phase completed successfully.

adop exiting with status = 0 (Success)

[applmgr@ebsdevapp JWS_FOLDER]$

Find log command for apply phase:

find $ADOP_LOG_HOME/32 -iname u*log

###--- check patch applied or not on patch file system

[applmgr@ebsdevapp 32]$ . /u01/dev/EBSapps.env patch

E-Business Suite Environment Information

----------------------------------------

RUN File System : /u01/dev/fs2/EBSapps/appl

PATCH File System : /u01/dev/fs1/EBSapps/appl

Non-Editioned File System : /u01/dev/fs_ne

DB Host: ebsdevdb.ebsdevapps.areefdba.com Service/SID: DEVPDB

Sourcing the PATCH File System ...

[applmgr@ebsdevapp 32]$ echo $FILE_EDITION

patch

[applmgr@ebsdevapp 32]$

[applmgr@ebsdevapp 32]$ sqlplus apps/devdb1

SQL*Plus: Release 10.1.0.5.0 - Production on Wed Nov 10 07:48:18 2021

Connected to:

Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production

With the Partitioning, Automatic Storage Management, OLAP, Advanced Analytics

and Real Application Testing options

SQL> select ad_zd.get_edition_type from dual;

GET_EDITION_TYPE

-----------------------------------------------------------------------------

PATCH

SQL> select ad_patch.is_patch_applied('R12',-1,32645734) from dual;

AD_PATCH.IS_PATCH_APPLIED('R12',-1,32645734)

--------------------------------------------------------------------------------

EXPLICIT

SQL> select BUG_NUMBER,CREATION_DATE,TRACKABLE_ENTITY_ABBR,LANGUAGE from ad_bugs where BUG_NUMBER='32645734';

BUG_NUMBER CREATION_ TRACKABLE_ENTITY_ABBR LANG

------------------------------ --------- ------------------------------ ----

32645734 10-NOV-21 fnd AR

32645734 10-NOV-21 fnd US

SQL> select ad_patch.is_patch_applied('R12',-1,32902510) from dual;

AD_PATCH.IS_PATCH_APPLIED('R12',-1,32902510)

-----------------------------------------------------------------------------

EXPLICIT

SQL> select BUG_NUMBER,CREATION_DATE,TRACKABLE_ENTITY_ABBR,LANGUAGE from ad_bugs where BUG_NUMBER='32902510';

BUG_NUMBER CREATION_ TRACKABLE_ENTITY_ABBR LANG

------------------------------ --------- ------------------------------ ----

32902510 10-NOV-21 fnd AR

32902510 10-NOV-21 fnd US

SQL>

###--- I have not applied this patch bcoz 32645734 had applied 32902510 internally:

[applmgr@ebsdevapp JWS_FOLDER]$ adop phase=apply patches=32902510,32902510_AR:u32902510.drv patchtop=/u02/ftp/JWS_FOLDER (patch shows already applied please cross check again)

Enter the APPS password:

Enter the SYSTEM password:

Enter the WLSADMIN password:

. . . . .

Applying patch 32902510.

[WARNING] Skipping patch 32902510 as it has already been applied.

[WARNING] You can reapply a patch by adding options=forceapply to the adop command line.

Applying patch 32902510_AR:u32902510.drv.

[WARNING] Skipping patch 32902510_AR as it has already been applied.

[WARNING] You can reapply a patch by adding options=forceapply to the adop command line.

The apply phase completed successfully.

adop exiting with status = 0 (Success)

[applmgr@ebsdevapp JWS_FOLDER]$

[applmgr@ebsdevapp 32]$ echo $FILE_EDITION

patch

[applmgr@ebsdevapp 32]$

SQL> select ad_patch.is_patch_applied('R12',-1,32902510) from dual;

AD_PATCH.IS_PATCH_APPLIED('R12',-1,32902510)

-----------------------------------------------------------------------------

EXPLICIT

SQL>

###--- Run adadmin and regenerate jar files on patch file system. options 1 then 4 before running finalize cutover cleanup (approx 30 Mins for jar files generation)

[applmgr@ebsdevapp 32]$ echo $FILE_EDITION

patch

[applmgr@ebsdevapp 32]$

It is better to run in screen session under root user:

[applmgr@ebsdevapp 32]$ adadmin

AD code level : [C.12]

*** Maintaining the Patch File System ***

*** Edition Enabled User ***

AD Administration Main Menu

--------------------------------------------------

1. Generate Applications Files menu

2. Maintain Applications Files menu

3. Compile/Reload Applications Database Entities menu

4. Maintain Applications Database Entities menu

5. Exit AD Administration

Enter your choice [5] : 1

Generate Applications Files

----------------------------------------

1. Generate message files

2. Generate form files

3. Generate report files

4. Generate product JAR files

5. Return to Main Menu

Enter your choice [5] : 4

Do you wish to force regeneration of all jar files? [No] ? YES

Enter your choice [5] :

###-- to monitor jar file generation, check log

tailf $NE_BASE/EBSapps/log/adadmin/log/adadmin.log

###-- Close the Application Patching Cycle:

It is better to run adop phases in screen session under root user:

[applmgr@ebsdevapp ~]$ adop phase=finalize,cutover,cleanup (approx 25 Mins)

Section 5: Configuring and Enabling Java Web Start

###--- update context variable from browser to “jws”

[applmgr@ebsdevapp ~]$ adstrtal.sh.sh apps/devdb1

[applmgr@ebsdevapp ~]$ grep s_forms_launch_method $CONTEXT_FILE

<config_option type="techstack" oa_var="s_forms_launch_method">browser</config_option>

[applmgr@ebsdevapp ~]$

###--- Profile options need to update:

- Enable Java Web Start Yes

- ICX: Forms Launcher http://ebsdevapp.areefdba.com:8002/forms/frmservlet

###--- stop and run autoconfig

[applmgr@ebsdevapp ~]$ adstpall.sh apps/devdb1

[applmgr@ebsdevapp ~]$ adautocfg.sh

grep deny $EBS_DOMAIN_HOME/config/config.xml ß deny

grep networkRetries $ORA_CONFIG_HOME/10.1.2/forms/server/appsweb.cfg (value 30)

grep FORMS_CATCHTERM $ORA_CONFIG_HOME/10.1.2/forms/server/default.env (value 0)

grep s_forms_catchterm $CONTEXT_FILE (Doc ID 745711.1) (Doc ID 744143.1)

grep s_forms_time $CONTEXT_FILE

###--- Finally Start Application:

[applmgr@ebsdevapp ~]$ adstrtal.sh.sh apps/devdb1

6.8 Using Multiple Forms Sessions with Java Web Start

Change preference for multiple forms Sessions with Java Web Start

Settings(Gear) -> preferences -> Forms Launch -> Always Launch New Forms Session

Run fsclone now or later:

[applmgr@ebsdevapp ~]$ adop phase=fs_clone (approx 2 hrs)

6.5 Microsoft Edge Browser setting in active directory

Policy need to set for remove keep and select jnlp files by system admin in active directory:

1.) List of file types that should be automatically opened on download

2.) URLs where AutoOpenFileTypes can apply

3.) Manage QuickView Office files capability in Microsoft Edge

================================================================================================================

Know Issues:

- Slowness issue in EBS is faced when implemented JWS with above step in PROD (Multinode Application):

there are 3 types of fixes in this below steps please read carefully (Dated: 20-11-2021)

1: remove access for Slave nodes which resolved JWS slowness caused by load balnceing between master & slave nodes

2: Delete slave done completely from EBS Configuration

2.1 ADOP issue fixes after deleteing Slave node information which have entriesi in adop_valid_nodes

PROD Application node details

PROD OCI Master node is --- ebsprodapp3

PROD OCI Slave 1 node --- ebsprodapp4

PROD OCI DMZ Slave 2 node --- ebsprodpubapp1

PROD OCI Load balanacer: --- https://ebsprodapp.areefdba.com.sa

PROD OCI was configured with SSL

###################---- For JWS issue

- remove slave node application access to do that

----------------

monitor Master node FMW Ebs_web log for errors to troubleshoot and finalize to remove access of slave apps nodes

To find all EBS_web logs:

find $IAS_ORACLE_HOME/instances -iname EBS_web*.log

ls -ltrh $IAS_ORACLE_HOME/instances/EBS_web*/diagnostics/logs/OHS/EBS_web/EBS_web*.log

in this case it is under:

find $IAS_ORACLE_HOME/instances/EBS_web_OHS -iname EBS_web*.log

[applmgr@ebsprodapp3 EBS_web]$

[applmgr@ebsprodapp3 EBS_web]$ ls -ltr $IAS_ORACLE_HOME/instances/EBS_web_OHS/diagnostics/logs/OHS/EBS_web/EBS_web.log <-- master node log file app3

-rw-r-----. 1 applmgr oinstall 561673 Nov 20 13:17 /u01/OCI/fs2/FMW_Home/webtier/instances/EBS_web_OHS/diagnostics/logs/OHS/EBS_web/EBS_web.log

[applmgr@ebsprodapp3 EBS_web]$

[applmgr@ebsprodapp3 EBS_web]$ ls -ltr $IAS_ORACLE_HOME/instances/EBS_web_OHS0/diagnostics/logs/OHS/EBS_web/EBS_web.log <-- slave node log file app4

-rw-r-----. 1 applmgr oinstall 12484 Nov 19 01:51 /u01/OCI/fs2/FMW_Home/webtier/instances/EBS_web_OHS0/diagnostics/logs/OHS/EBS_web/EBS_web.log

[applmgr@ebsprodapp3 EBS_web]$

[applmgr@ebsprodapp3 EBS_web]$ ls -ltr /u01/OCI/fs2/FMW_Home/webtier/instances/EBS_web_OHS1/diagnostics/logs/OHS/EBS_web/EBS_web.log

-rw-r-----. 1 applmgr oinstall 4794 Nov 19 01:51 /u01/OCI/fs2/FMW_Home/webtier/instances/EBS_web_OHS1/diagnostics/logs/OHS/EBS_web/EBS_web.log <-- slave node log file app1

as we are providing access to only master node i.e app3 we will monitor this file behavior

[applmgr@ebsprodapp3 EBS_web]$ tailf -100 $IAS_ORACLE_HOME/instances/EBS_web_OHS/diagnostics/logs/OHS/EBS_web/EBS_web.log

[2021-11-19T22:23:27.3769+03:00] [OHS] [ERROR:32] [OHS-9999] [core.c] [host_id: ebsprodapp3] [host_addr: 172.168.10.24] [tid: 140513411856128] [user: applmgr] [ecid: 005oI^hmxP25yWW6LzFg6Q0001T^00001w] [rid: 0] [VirtualHost: main] (110)Connection timed out: proxy: HTTP: attempt to connect to 172.168.10.28:7211 (ebsprodapp4.areefdba.com) failed

[2021-11-19T22:24:50.6796+03:00] [OHS] [ERROR:32] [OHS-9999] [core.c] [client_id: 172.168.8.19] [host_id: ebsprodapp3] [host_addr: 172.168.10.24] [tid: 140513275488000] [user: applmgr] [ecid: 005oI^uVDIU5yWW6LzFg6Q0001T^00003k] [rid: 0] [VirtualHost: main] ap_proxy: trying GET /OA_HTML/AppsLogin at backend host '172.168.10.28/7211; got exception 'NO_RESOURCES: [os error=115, line 1611 of URL.cpp]: apr_socket_connect call failed with error=70007, host=172.168.10.28, port=7211 '

Here we can see node-2 with ip 28(app4) is also attempting to connect and getting failed and application is getting confused to select between app3 and app4

So we decided to remove slave node(app4) and restart the application which finally fixed log hanging/slowness issues

###############################################################################################################

1 step is remove access of all application node form apps.cfg and also mod_wl_ohs.conf

1 ans

$IAS_ORACLE_HOME/instances/EBS_web_OHS/config/OHS/EBS_web/apps.conf

-------------------------------------

find $IAS_ORACLE_HOME/instances -type f $ -iname \apps.conf -o -iname \mod_wl_ohs.conf $

find $IAS_ORACLE_HOME/instances -iname apps.conf

find $IAS_ORACLE_HOME/instances/EBS_web_OHS*/config/OHS/EBS_web -iname apps.conf

cd $IAS_ORACLE_HOME/instances/EBS_web_OHS/config/OHS/EBS_web/apps.conf

cp apps.conf apps.conf_bkp -- take backup before modifying apps.conf file

[applmgr@ebsprodapp3~]$ grep ebsprodapp4 $IAS_ORACLE_HOME/instances/EBS_web_OHS*/config/OHS/EBS_web/apps.conf

[applmgr@ebsprodapp3~]$ grep ebsprodapp4 $IAS_ORACLE_HOME/instances/EBS_web_OHS*/config/OHS/EBS_web/mod_wl_ohs.conf

[applmgr@ebsprodapp3 EBS_web]$ vi apps.conf

######################

# for oacore

######################

ProxyPass balancer://oacorecluster_oamedia

ProxyPassReverse balancer://oacorecluster_oamedia

</Location>

BalancerMember http://ebsprodapp3.areefdba.com:7211/OA_HTML/media

BalancerMember http://ebsprodapp4.areefdba.com:7211/OA_HTML/media <--- Remove app4 slave node entries 1/5

</Proxy>

ProxyPass balancer://oacorecluster_oajava

ProxyPassReverse balancer://oacorecluster_oajava

</Location>

BalancerMember http://ebsprodapp3.areefdba.com:7211/OA_HTML/classes

BalancerMember http://ebsprodapp4.areefdba.com:7211/OA_HTML/classes <--- Remove app4 slave node entries 2/5

</Proxy>

ProxyPass balancer://oacorecluster_oacgi/OA_HTML/txkFNDWRR.pl

ProxyPassReverse balancer://oacorecluster_oacgi/OA_HTML/txkFNDWRR.pl

</Location>

BalancerMember http://ebsprodapp3.areefdba.com:7211

BalancerMember http://ebsprodapp4.areefdba.com:7211 <--- Remove app4 slave node entries 3/5

</Proxy>

######################

# for forms

######################

ProxyPass balancer://formscluster_oamedia

ProxyPassReverse balancer://formscluster_oamedia

</Location>

BalancerMember http://ebsprodapp3.areefdba.com:7411/OA_HTML/media

BalancerMember http://ebsprodapp4.areefdba.com:7411/OA_HTML/media <--- Remove app4 slave node entries 4/5

</Proxy>

ProxyPass balancer://formscluster_oajava

ProxyPassReverse balancer://formscluster_oajava

</Location>

BalancerMember http://ebsprodapp3.areefdba.com:7411/OA_HTML/classes

BalancerMember http://ebsprodapp4.areefdba.com:7411/OA_HTML/classes <--- Remove slave node entries 5/5

</Proxy>

###############################################################################################################

2) stop clear fnd nodes and then add RAC db nodes by autoconfig and add only application master node(app3) by autoconfig:

[applmgr@ebsprodapp3 ~]$ sqlplus apps/apps

SQL> exec fnd_conc_clone.setup_clean;

SQL> select node_name from fnd_nodes;

no rows selected

Run autoconfig of DB-RAC1, DB-RAC2, again on DB-RAC1. Then on app3 only:

SQL> select node_name from fnd_nodes;

NODE_NAME

--------------------------------------------------------------------------------

ebsprodapp3

AUTHENTICATION

PRD1

PRD2

SQL>

by doing this we successfully resolved the slowness issue caused by JWS Patching. So we decided to remove slave node completely and reconfigure it back again.

######---- delete multiple slave application nodes (app4):

[applmgr@ebsprodapp3 ~]$ cd $AD_TOP/patch/115/bin

[applmgr@ebsprodapp3 ~]$ perl $AD_TOP/patch/115/bin/adProvisionEBS.pl ebs-delete-node -contextfile=$CONTEXT_FILE -hostname=ebsprodapp4.areefdba.com -logfile=del.log

######---- fsclone issue which failed previously and deleted most of folders and files in patch FS:

- ADop_valid_nodes tables has entries of all multi node application

- missing contextfile in Patch FS to verify check in table (select * from fnd_oam_context_files)

$ADJVAPRG oracle.apps.ad.autoconfig.oam.CtxSynchronizer action=upload contextfile=/u01/OCI/fs1/inst/apps/PRODPDB_ebsprodapp3/appl/admin/PRODPDB_ebsprodapp3.xml logfile=/tmp/patchctxupload.log

- rename existing folder 10.1.2 in Patch FS so it will copy all folders and files from Run FS

select * from fnd_nodes;

select * from adop_valid_nodes;-- for update -- delete app4

select * from fnd_oam_context_files; -- check PSF context file

syntax for adding missing context file in Patch FS as per table fnd_oam_context_files record

$ADJVAPRG oracle.apps.ad.autoconfig.oam.CtxSynchronizer action=upload contextfile=/u01/OCI/fs1/inst/apps/PRODPDB_ebsprodapp3/appl/admin/PRODPDB_ebsprodapp3.xml logfile=/tmp/patchctxupload.log

now fsclone should complete sucessfully:

[applmgr@ebsprodapp3 ~]$ adop phase=fs_clone force=yes

================================================================================================================

Thanks for Reading

Regards,

Mohammed Areefuddin.

Suggested Topics :

Linux	DATABASE	RMAN	RAC	EBS
5.7 Install	DATABASE Install		11201 Install	R1226 Install
Open Filer Instl	Active DataGaurd	Rman DataGuard	12102 RAC INSTAL	R1229 M7 Clone
DNS in Linux 7	WIN-LINUX MIGRATE	RMAN DB CLONE	RAC DataGuard	Pluggable DB Clone
lpadmin cups	ASMCMD ASM Migrt	RMAN ASM Migrt	RAC DB Clone	appsutil for DB
	11204 M-Upgrade		RAC - RAC Clone	JDK JRE upgrade
	12102 M-Upgrade		12C-19C RAC UPGRADE	Add EBS Node
	Flashback DB			ADOP in R12.2.9
				12102 EBS UPGRADE
Linux Basics	DATABASE Basics	RMAN Basics	RAC Basic	EBS Basics

Sunday, November 14, 2021

Java Web Start Implementation on EBS R12.2.9

No comments:

Post a Comment