Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

MapReduce code generated by Hive

Where does Apache HiveQL store the Map/Reduce code it generates?

like image 227
user1653240 Avatar asked Feb 28 '26 23:02

user1653240


1 Answers

I believe Hive doesn't really generate Map/Reduce code in the sense as you could get from Java, because it is interpreted by the Hive query planner.

If you want to get an idea of what kind of operations your Hive queries generate, you could prefix your queries with EXPLAIN and you will see the abstract syntax tree, the dependency graph, and the plan of each stage. More info on EXPLAIN here.

If you really want to see some Map/Reduce jobs, you could try YSmart which will translate your HiveQL statements into working Java Map/Reduce code. I haven't used it personally, but I know people who have and said good things about it.

like image 97
Charles Menguy Avatar answered Mar 02 '26 15:03

Charles Menguy