Step by Step installing Oracle 11g R2 on Oracle Solaris 10

1) Create necessary groups and a user

groupadd oinstall
groupadd dba
useradd -g oinstall -G dba -d /home/oracle -s /usr/bin/bash oracle
passwd oracle

2) Create necessary folder for the installation

mkdir -p /u01/oracle/product/11.2.0/db_1
mkdir /u01/oracle/tmp
chown -R oracle:oinstall /u01/oracle

3) Change kernel parameters

projadd -U oracle -K "project.max-shm-memory=(priv,4g,deny)" oracle
projmod -sK "project.max-sem-nsems=(priv,256,deny)" oracle
projmod -sK "project.max-sem-ids=(priv,100,deny)" oracle
projmod -sK "project.max-shm-ids=(priv,100,deny)" oracle
echo "set maxuprc=16384" >> /etc/system
echo "set max_nprocs=30000" >> /etc/system
echo "set shmsys:shminfo_shmmax=4294967295" >> /etc/system

Now reboot the machine and login with an oracle user.
Let’s create a new swap file with 1Gb size, as it’s required for the Oracle installation

mkfile 1024m /u01/oracle/orcl_swap
swap -a /u01/oracle/orcl_swap

Now change the .profile file of the oracle user and set necessary environment variables:
edit /home/oracle/.profile

export ORACLE_BASE=/u01/oracle
export ORACLE_HOME=$ORACLE_BASE/product/11.2.0/db_1
export PATH=$ORACLE_HOME/bin:$PATH
export TMP=/u01/oracle/tmp
export TMPDIR=/u01/oracle/tmp
export DISPLAY=:0.0

Now create an “installation” directory under /u01/oracle
Then mount the cdrom device and copy the installation files to that directory
Extract both files uzing unzip utility, and start the installation

unzip solaris.x64_11gR2_database_1of2.zip
unzip solaris.x64_11gR2_database_2of2.zip
cd database

./runInstaller