cloudera cdh - Apache NiFi Hive Processors with Hive 1.1 (CDH 5.7.1) -
i work cloudera manager cdh 5.7.1, supports hive 1.1.0. nifi 1.0.0-beta uses hive 1.2.1.
when try use selecthiveql processor, following error: required field 'client_protocol' unset!
, means there's version mismatch between hive client , server.
any suggestions solve problem?
i thought building nifi hive-jdbc
dependency version 1.1.0
instead of default 1.2.1
, hope there's better solution.
since nifi apache project, builds apache jars (such hive , hadoop). there vendor-specific profiles , build properties can use build nifi particular hadoop distribution.
for example try following build nifi distro cdh 5.7.1:
mvn clean install -dskiptests -pcloudera -dhadoop.version=2.6.0-cdh5.7.1 -dhive.version=1.1.0-cdh5.7.1 -dhbase.version=1.2.0-cdh5.7.1
the hive processors use hadoop libraries provided nifi hadoop libraries nar, , other nars (like hadoop/hdfs processors) use same libraries nar, best approach build whole thing. otherwise can try replace hadoop/hive/hbase-related nars , see if works.
Comments
Post a Comment