irpas技术客

hive insert、select组合动态插入分区表_张三。。_hive insert into select

大大的周 6578

使用waterdrop操作hive的时候遇到一个问题,按照sql的insert、select组合插入应该使用下面的语句:

INSERT INTO table t_ads_gsddy_jzfdl_day

SELECT a.senid AS senid,a.jlsj AS jlsj,a.v AS v,a.name AS name,'水电' AS stage ,partition_year AS partition_year FROM t_ads_gsddy_sjjzfdl_day a

运行发现报错,查看表结构之后,发现要插入的表有分区,于是修改之后:

INSERT INTO table t_ads_gsddy_jzfdl_day PARTITION(partition_year)

SELECT a.senid AS senid,a.jlsj AS jlsj,a.v AS v,a.name AS name,'水电' AS stage ,partition_year AS partition_year FROM t_ads_gsddy_sjjzfdl_day a

但是waterdrop却又报错了,提示设置partition=true或者使用静态分区

思考了一下,发现默认是静态插入,所以采用了以下语句

SET hive.exec.dynamic.partition=true;? ? ? ? ? ????????????????? ? ? ?--开启动态分区,默认是false

SET hive.exec.dynamic.partition.mode=nonstric;??????? ?????????-- 开启允许所有分区都是动态的,否则必须要有静态分区才能使用。

INSERT INTO table t_ads_gsddy_jzfdl_day PARTITION(partition_year)

SELECT a.senid AS senid,a.jlsj AS jlsj,a.v AS v,a.name AS name,'水电' AS stage ,partition_year AS partition_year FROM t_ads_gsddy_sjjzfdl_day a

最后提示插入成功!!!

回头试了下,在开启了动态分区的情况下,不指定分区使用常规的insert、select进行插入,发现也是可以的

SET hive.exec.dynamic.partition=true;

SET hive.exec.dynamic.partition.mode=nonstric;

INSERT INTO table t_ads_gsddy_jzfdl_day

SELECT a.senid AS senid,a.jlsj AS jlsj,a.v AS v,a.name AS name,'水电' AS stage ,partition_year AS partition_year FROM t_ads_gsddy_sjjzfdl_day a


1.本站遵循行业规范,任何转载的稿件都会明确标注作者和来源;2.本站的原创文章,会注明原创字样,如未注明都非原创,如有侵权请联系删除!;3.作者投稿可能会经我们编辑修改或补充;4.本站不提供任何储存功能只提供收集或者投稿人的网盘链接。

标签: #hive #Insert #into #select #TABLE