Thursday, 28 April 2016

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

SAP HANA Vora provides an in-memory processing engine which can scale up to thousands of nodes, both on premise and in cloud. Vora fits into the Hadoop Ecosystem and extends the Spark execution framework.

Concepts and Requirements:

Sap HANA VORA 1.2 consists of the two following main components:
  • SAP HANA Vora Engine: 
SAP HANA Vora instances hold data in memory and boost the performance.
  • SAP HANA Vora Spark Extension Library:
    • Provides access to SAP HANA Vora through Spark.
    • Makes available additional functionality, such as a hierarchy implementation.
Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

These two components are included inside the Vora packages which are available as follows and you could choose based on your Hadoop distribution.
  • SAP HANA Vora for Ambari: VORA_AM<version>.TGZ
  • SAP HANA Vora for Cloudera: VORA_CL<version>.TGZ
  • SAP HANA Vora for MapR: VORA_MR<VERSION>.TGZ
Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation


Vora 1.2 supports the following operation systems:
  • SUSE Linux Enterprise Server (SLES) 11 SP3
  • Red Hat Enterprise Linux (RHEL) 6.7 and 7.2
You should also follow the Installation and Administration guide for the compatibility pack installations: http://help.sap.com/hana_vora
Following table shows you the combination of operating system, cluster provisioning tool, and Hadoop distribution:

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

Remember that the minimal setup for Vora 1.2 is :
  • 4 cores
  • 8 GB of RAM
  • 20 GB of free disk space for HDFS data
  • Note: You can’t install Vora 1.2 on a single node
In order to have the Vora 1.2 running, you have to have the following Vora services installed and configured and I will walk you through their installment and configurations on the clusters.
  • SAP HANA Vora Base: Vora libraries and binaries. Installs on all hosts.
  • SAP HANA Vora Catalog: Vora distributed metadata store. Installs on one node and usually on DLOG node.
  • SAP HANA Vora Discovery Service: Manages service registrations and installs on all nodes. In server mode installs on 3 nodes(Max 7) and selects the bootstrapping host. In client mode, installs on all remaining nodes. Note: You can’t install DS server and client both on the same node.
  • SAP HANA Vora Distributed Log: Provides persistence for Vora Catalog. Install usually on the master node(5 nodes recommended).
  • SAP HANA Vora Thriftserver: Gateway compatible with Hive JDBC connector. Usually install on the jumpbox where DS, DLOG and Catalog servers are not installed.
  • SAP HANA Vora Tools: Web UI for Vora 1.2 modeler. Install on the same node as Vora Thriftserver.
  • SAP HANA Vora V2Server: Vora Engine. Installs on all worker nodes ( Datanodes)
The installation and configuration should either happen at the same time for all the services or you should follow the following order to make sure of handling the dependencies:

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

The following schema shows you the architecture for clusters with 4 nodes and the assignment of different Vora 1.2 services which we will set up in this document:
One Master node, One Server node and two workers.

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

*** Our assumption is that you have your Hadoop clusters set up with HDFS 2.6.x or 2.7.1, ZooKeeper 3.4.6, Spark 1.5.2, Yarn cluster manager 2.7.1 components.

Installing Vora 1.2 Services:

Step 1) Adding Vora Base: You have to add Vora base on all nodes and they have to be installed as clients as shown below.

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

— no extra configuration is needed.
— you can click on the proceed button as is shown below even if you get the error since you’re not using MapReduce jobs:

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

— Click on complete.

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

— notice that the Vora base is now added to your services:

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

Step 2) Now we add Vora discovery as 3 Vora discovery servers and one client.

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation


Adding the Vora Discovery client:

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

-- Vora discovery servers need extra configurations:
— in vora_discovery_bootstrap add the master DNS
— in vora_discovery_servers add your server DNS’s

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

— proceed and deploy the service
notice that vora discovery service is now installed:

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation


Step 3) Now we add Vora Distributed Log service :

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

— we install DLOG servers on the same machines where we installed our Discovery Servers.

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

— No extra configurations are needed.
— click Next-> click Proceed anyway—>click  Complete
— Notice that vora DLOG is now added to the services:

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

Step 4) Next step is to install Vora Catalog:

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation


— Install Catalog on your master node:

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

— click Next->click Proceed anyway—>click Complete

— Notice that vora Catalog is added to the services:

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

Step 5) Time to install V2Server as shown below:

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

— extra configuration: add the Vora V2Server Worker service to worker1 and worker2 nodes and remove it from your server node.

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

— click Next->click Proceed anyway—>click Complete

— Notice that vora V2Server is now added to the services:

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

Step 6) Time to install Vora Thriftserver and Vora Tools:

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

— you have to add more configurations to the thrift server as it’s shown below:
— add vora_thriftserver_java_home = /usr/lib/jvm/java --this value depends on where JAVA installed on your system
— add vora_thriftserver_spark_home =  /usr/hdp/2.3.4.0-3485/spark --this is your Spark Home value

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

— click Next-> click Proceed anyway—>click Complete

— Notice that vora thriftServer and Vora tools  are now added to the services:

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

Now click on HDFS, MaprReduce2 and YARN services which are in red and restart all affected as shown below:

Vora 1.2 installation Cheat sheet: Concepts, Requirements and Installation

Congratulations!! You now have Vora 1.2 services installed on your clusters.

Step 7) To validate your Vora:
— SSH to your worker1 node and run:
— source /etc/vora/vora-env.sh
— $VORA_SPARK_HOME/bin/start-spark-shell.sh

and you should now see the SQL contexts (Vora SQL Context and Spark SQL Context) bieng available.

Source: scn.sap.com

No comments:

Post a Comment