Home >> Big Data Hadoop >> What are the different components of a Hive architecture in Big Data Hadoop

What are the different components of a Hive architecture in Big Data Hadoop

Hive Architecture consists of a –

User Interface – 
UI component of the Hive architecture calls the execute interface to the driver.
Driver create a session handle to the query and sends the query to the compiler to generate an execution plan for it.
Metastore - Sends the metadata to the compiler for the execution of the query on receiving the sendMetaData request.

Compiler- 
Compiler generates the execution plan which is a DAG (Directed Acyclic Graph)of stages where each stage is either a metadata operation, a map or reduce job or an operation on HDFS.

Execute Engine- 
Execution engine is responsible for submitting each of these stages to the relevant components by managing the dependencies between the various stages in the execution plan generated by the compiler.

Directed Acyclic Graph-
Directed Acyclic Graph (DAG) is a tool that depicts the structure of basic blocks, helps to see the flow of values flowing among the basic blocks, and offers optimization too. DAG provides easy transformation on basic blocks. DAG can be understood here:

Leaf nodes represent identifiers, names or constants.
Interior nodes represent operators.
Interior nodes also represent the results of expressions or the identifiers/name where the values are to be stored or assigned.

Post Your Comment

Next Questions
How can you prevent a large job from running for a long time
What is a Hive Metastore
Explain about the different types of join in Hive
How can you configure remote metastore mode with Hive
How data transfer happens from HDFS to Hive
Hbase Vs Hive
Hive What is the use of Hcatalog
Where is table data stored in Apache Hive by default
Hive Difference between partitioning and bucketing
Explain about the different types of partitioning in Hive
How will you read and write HDFS files in Hive
What are the components of a Hive query processor
Differentiate between describe and describe extended
Will the reducer work or not if you use Limit 1 in any HiveQL query
Hive Explain about SORT BY, ORDER BY, DISTRIBUTE BY and CLUSTER BY
What is difference between hive internal table and external table
Why you should choose Hive instead of Hadoop MapReduce
How will you optimize Hive performance
Hive Difference between Sort By and Order By
Sqoop vs Flume
What is the default file format to import data using Apache Sqoop
we have around 300 tables in a database. I want to import all the tables from the database except the tables named Table298, Table 123, and Table299. How can I do this without having to import the tables one by one using sqoop
How can you execute a free form SQL query in Sqoop to import the rows in a sequential manner
How will you list all the columns of a table using Apache Sqoop
What is the difference between Sqoop and DistCP command

Copyright ©2022 coderraj.com. All Rights Reserved.