记录apache doris使用过程中出现的问题

谁借莪１个温暖的怀抱￠ 2022-11-20 10:58 2244阅读 0赞

# 1，执行创建语句过程中出现： #

\[Err\] 1064 - errCode = 2, detailMessage = Failed to find enough host in all backends. need: 3

原因：

语句中指定了 PROPERTIES("replication\_num" = "3");

结果BE只有2个：

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70][]

查看对应节点的日志：.

==> ./be.WARNING.log.20200921-141304 <==  
W1026 18:13:39.139992 19091 utils.cpp:101\] fail to get master client from cache. host=192.168.6.143, port=9020, code=7  
W1026 18:13:39.140386 19091 task\_worker\_pool.cpp:1185\] finish report olap table state failed. status:-1, master host:192.168.6.143, port:9020  
W1026 18:13:40.391201 19089 utils.cpp:101\] fail to get master client from cache. host=192.168.6.143, port=9020, code=7  
W1026 18:13:40.391471 19089 task\_worker\_pool.cpp:1060\] finish report task failed. status:-1, master host:192.168.6.143port:9020  
W1027 10:00:31.385262  2359 data\_dir.cpp:128\] open file filed, error: IO error: failed to open cluster id file /wyyt/software/doris/be/storage/cluster\_id  
W1027 10:00:31.385926  2359 data\_dir.cpp:95\] \_init\_cluster\_id failed, error: IO error: failed to open cluster id file /wyyt/software/doris/be/storage/cluster\_id  
W1027 10:00:31.385958  2359 storage\_engine.cpp:192\] Store load failed, status=IO error: failed to open cluster id file /wyyt/software/doris/be/storage/cluster\_id, path=/wyyt/software/doris/be/storage  
W1027 10:00:31.386071  2353 storage\_engine.cpp:148\] \_init\_store\_map failed, error: Internal error: init path failed, error=IO error: failed to open cluster id file /wyyt/software/doris/be/storage/cluster\_id;  
W1027 10:00:31.386106  2353 storage\_engine.cpp:96\] open engine failed, error: Internal error: init path failed, error=IO error: failed to open cluster id file /wyyt/software/doris/be/storage/cluster\_id;  
F1027 10:00:31.386186  2353 doris\_main.cpp:189\] fail to open StorageEngine, res=init path failed, error=IO error: failed to open cluster id file /wyyt/software/doris/be/storage/cluster\_id;

找到原因之后，解决问题。我这里是打开文件失败，权限给755试试，然后重启BE节点。

如果重启失败，直接删除  be.pid ，再重启

# 2，日志权限用户变更了 #

![20201028174101233.png][]

启动服务的时候是什么用户就是什么用户

# 3，创建doris表报错 #

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 1][]

原因：字段长度数字加起来不能超过10W。如果要改，可以设置，但是不推荐

![20201030104115839.png][]

# 4，磁盘满了  #

ErrorReason\{code=errCode = 2, msg='failed to create task: errCode = 2, detailMessage = disk 6189104187500640169 on backend 11001 exceed limit usage'

导致所有的任务暂停；

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 2][]

# 5,开启物化视图 #

create materialized view test\_p\_user\_view as select user\_id,user\_name from test\_p\_user limit 8;  
ERROR 1064 (HY000): errCode = 2, detailMessage = The materialized view is coming soon

解决：可以在master上执行这个命令 ADMIN SET FRONTEND CONFIG ("enable\_materialized\_view" = "true");

目前物化视图只支持duplicate key 表，而且0.12只支持部分,0.13版本会完善

# 6，hive数据导入到doris流程 #

1，在doris创建对应的表

![2020110319015818.png][]

2，执行语句

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 3][]

# 7，type:LOAD\_RUN\_FAIL; msg:errCode = 2, detailMessage = there is no scanNode Backend   #

从hdfs导入大表导致be节点挂掉

解决方案：对fe进行参数设置

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 4][]

任务要显示指定内存：

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 5][]

**查看be日志，查看core文件，查看是否是OOM。**

参考：[https://blog.csdn.net/weixin\_42135997/article/details/80732658][https_blog.csdn.net_weixin_42135997_article_details_80732658]

[https://blog.csdn.net/qq\_15437667/article/details/83934113?utm\_medium=distribute.pc\_aggpage\_search\_result.none-task-blog-2~all~sobaiduend~default-1-83934113.nonecase&utm\_term=linux%20%E6%80%8E%E4%B9%88%E7%9C%8Bcore%E6%96%87%E4%BB%B6&spm=1000.2123.3001.4430][https_blog.csdn.net_qq_15437667_article_details_83934113_utm_medium_distribute.pc_aggpage_search_result.none-task-blog-2_all_sobaiduend_default-1-83934113.nonecase_utm_term_linux_20_E6_80_8E_E4_B9_88_E7_9C_8Bcore_E6_96_87_E4_BB_B6_spm_1000.2123.3001.4430]

# 8,突然之间执行不了命令 #

![20201104183345927.png][]

查看be节点，是Alive状态。

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 6][]

查看be节点日志 be.INFO be.WARN 日志都没发现啥

后来发现是一个节点的磁盘出问题了 ，以后遇到这种问题，就晓得怎么排查了。。

# 9，broker 导入hdfs数据规则 #

1)验证了broker导入hdfs数据，导入数据使用uniq模式的情况下。相同主键覆盖不是有序，而是按照第二个字段的长度来替换的（第二个字段长度最大，相同长度则取时间最新的。），如果第二个字段一样，同理，比较第三个字段长度。

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 7][]

结果数据：

![20201105105724184.png][]

# 10，Doris broker导入数据失败 #

type:LOAD\_RUN\_FAIL; msg:errCode = 2, detailMessage = all partitions have no load data

原始表数据为null。没数据

![20201105172715577.png][]

# 11，同时执行多个broker任务导致BE节点挂掉 #

原因：应该是内存不足的原因导致BE死掉。

解决方案：broker 单节点限制每次1个G，或者更小

# 12，routine laod 报错  errCode = 2, detailMessage = failed to send task: errCode = 2, detailMessage = failed #

BE的任务并发是默认 max\_routine\_load\_task\_num\_per \* be数量

比如be节点有3个，那么所有的并发是 5\*3

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 8][]

# 13，通过insert into  #

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 9][]

# 14，导入任务失败 #

![20201119151525696.png][]

内存不够，修改内存

# 15,ETL\_QUALITY\_UNSATISFIED; msg:quality not good enough to cancel #

###  ###

异常说明：数据质量不好，导致不能doris不能解析或者解析失败而取消导入任务

可能原因：

1. varchar字段太长；分隔符问题

2.  [too\_many\_filtered\_rows][too_many_filtered_rows]

解决方案

长文本不要导入；长文本导入截断；数据中包含分隔符

16，使用broker导入数据到doris之后，发现内存没有释放

解决方案：

尝试升级doris版本为0.13.15，验证这个问题：

地址：[https://cloud.baidu.com/doc/PALO/s/Ikivhcwb5][https_cloud.baidu.com_doc_PALO_s_Ikivhcwb5]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 10][]

17，出现的错误

doris版本为 0.13.11 补丁版本。

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 11][]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 12][]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 13][]

18，出现be节点的data目录很大，有的be节点目录很正常。

初步判断原因集群负载有问题，routine load写入太频繁

查看表是否正常：

![20210207135447877.png][]

修改routine load参数  ，设置为60s

(  
 'desired\_concurrent\_number'='3',  
** 'max\_batch\_interval' = '60',**  
 'max\_batch\_rows' = '300000',  
 'max\_batch\_size' = '209715200',  
 'strict\_mode' = 'false',  
 'format' = 'json'  
)

# 19，doris版本 0.14.7 升级之后解决之前存在的问题 Too Many Tasks ................ #

![20210408103348839.png][]

20，doris 0.14.7 内网3个fe部署之后写入数据以后，fe有节点挂掉，具体日志：

> 2021-08-27 09:09:25,172 ERROR (heartbeat mgr|19) \[BDBJEJournal.write():166\] catch an exception when writing to database. sleep and retry. journal id 1526718  
> com.sleepycat.je.rep.InsufficientAcksException: (JE 7.3.7) Transaction: -16160910  VLSN: 31,775,195, initiated at: 09:09:22.  Insufficient acks for policy:SIMPLE\_MAJORITY. Need replica acks: 1. Missing replica acks: 1. Timeout: 2000ms. FeederState=192.168.7.5\_9010\_1625132780567(2)\[MASTER\]  
> Current feeds:  
>  192.168.7.7\_9010\_1625192915300: feederVLSN=31,775,198 replicaTxnEndVLSN=31,775,193  
>  192.168.7.4\_9010\_1625132697001: feederVLSN=31,775,198 replicaTxnEndVLSN=31,775,191
> 
>         at com.sleepycat.je.rep.impl.node.DurabilityQuorum.ensureSufficientAcks(DurabilityQuorum.java:205) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.rep.stream.FeederTxns.awaitReplicaAcks(FeederTxns.java:189) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.rep.impl.RepImpl.postLogCommitHookInternal(RepImpl.java:1426) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.rep.impl.RepImpl.postLogCommitHook(RepImpl.java:1385) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.rep.txn.MasterTxn.postLogCommitHook(MasterTxn.java:226) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.txn.Txn.commit(Txn.java:772) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.txn.Txn.commit(Txn.java:625) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.txn.Txn.operationEnd(Txn.java:1803) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.Database.put(Database.java:1506) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.Database.put(Database.java:1556) ~\[je-7.3.7.jar:7.3.7\]  
>         at org.apache.doris.journal.bdbje.BDBJEJournal.write(BDBJEJournal.java:159) \[palo-fe.jar:3.4.0\]  
>         at org.apache.doris.persist.EditLog.logEdit(EditLog.java:849) \[palo-fe.jar:3.4.0\]  
>         at org.apache.doris.persist.EditLog.logHeartbeat(EditLog.java:1265) \[palo-fe.jar:3.4.0\]  
>         at org.apache.doris.system.HeartbeatMgr.runAfterCatalogReady(HeartbeatMgr.java:154) \[palo-fe.jar:3.4.0\]  
>         at org.apache.doris.common.util.MasterDaemon.runOneCycle(MasterDaemon.java:58) \[palo-fe.jar:3.4.0\]  
>         at org.apache.doris.common.util.Daemon.run(Daemon.java:116) \[palo-fe.jar:3.4.0\]  
> 2021-08-27 09:09:27,884 WARN (Thread-49|192) \[BDBJEMetricHandler.write():117\] write metric data into bdb error, key:192.168.7.7:8030\_query\_err\_rate\_1630026555000  
> com.sleepycat.je.rep.InsufficientAcksException: (JE 7.3.7) Transaction: -16160912  VLSN: 31,775,198, initiated at: 09:09:23.  Insufficient acks for policy:SIMPLE\_MAJORITY. Need replica acks: 1. Missing replica acks: 1. Timeout: 2000ms. FeederState=192.168.7.5\_9010\_1625132780567(2)\[MASTER\]  
> Current feeds:  
>  192.168.7.7\_9010\_1625192915300: feederVLSN=31,775,199 replicaTxnEndVLSN=31,775,196  
>  192.168.7.4\_9010\_1625132697001: feederVLSN=31,775,199 replicaTxnEndVLSN=31,775,191
> 
>         at com.sleepycat.je.rep.impl.node.DurabilityQuorum.ensureSufficientAcks(DurabilityQuorum.java:205) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.rep.stream.FeederTxns.awaitReplicaAcks(FeederTxns.java:189) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.rep.impl.RepImpl.postLogCommitHookInternal(RepImpl.java:1426) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.rep.impl.RepImpl.postLogCommitHook(RepImpl.java:1385) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.rep.txn.MasterTxn.postLogCommitHook(MasterTxn.java:226) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.txn.Txn.commit(Txn.java:772) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.txn.Txn.commit(Txn.java:625) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.txn.Txn.operationEnd(Txn.java:1803) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.Database.put(Database.java:1506) ~\[je-7.3.7.jar:7.3.7\]  
>         at org.apache.doris.metric.collector.BDBJEMetricHandler.write(BDBJEMetricHandler.java:115) ~\[palo-fe.jar:3.4.0\]  
>         at org.apache.doris.metric.collector.BDBJEMetricHandler.writeDouble(BDBJEMetricHandler.java:109) ~\[palo-fe.jar:3.4.0\]  
>         at org.apache.doris.metric.collector.MetricCollector.parseFeMetricJsonAndWriteMetric(MetricCollector.java:217) ~\[palo-fe.jar:3.4.0\]  
>         at org.apache.doris.metric.collector.MetricCollector.writeMetric(MetricCollector.java:105) ~\[palo-fe.jar:3.4.0\]  
>         at org.apache.doris.metric.collector.MetricCollector.lambda$init$0(MetricCollector.java:77) ~\[palo-fe.jar:3.4.0\]  
>         at java.lang.Thread.run(Thread.java:748) \[?:1.8.0\_162\]  
> 2021-08-27 09:09:33,338 WARN (Thread-49|192) \[BDBJEMetricHandler.write():117\] write metric data into bdb error, key:192.168.7.7:8030\_quantile0.75\_1630026555000  
> com.sleepycat.je.rep.InsufficientAcksException: (JE 7.3.7) Transaction: -16160913  VLSN: 31,775,200, initiated at: 09:09:27.  Insufficient acks for policy:SIMPLE\_MAJORITY. Need replica acks: 1. Missing replica acks: 1. Timeout: 2000ms. FeederState=192.168.7.5\_9010\_1625132780567(2)\[MASTER\]  
> Current feeds:  
>  192.168.7.7\_9010\_1625192915300: feederVLSN=31,775,202 replicaTxnEndVLSN=31,775,198  
>  192.168.7.4\_9010\_1625132697001: feederVLSN=31,775,202 replicaTxnEndVLSN=31,775,196
> 
>         at com.sleepycat.je.rep.impl.node.DurabilityQuorum.ensureSufficientAcks(DurabilityQuorum.java:205) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.rep.stream.FeederTxns.awaitReplicaAcks(FeederTxns.java:189) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.rep.impl.RepImpl.postLogCommitHookInternal(RepImpl.java:1426) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.rep.impl.RepImpl.postLogCommitHook(RepImpl.java:1385) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.rep.txn.MasterTxn.postLogCommitHook(MasterTxn.java:226) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.txn.Txn.commit(Txn.java:772) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.txn.Txn.commit(Txn.java:625) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.txn.Txn.operationEnd(Txn.java:1803) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.Database.put(Database.java:1506) ~\[je-7.3.7.jar:7.3.7\]  
>         at org.apache.doris.metric.collector.BDBJEMetricHandler.write(BDBJEMetricHandler.java:115) ~\[palo-fe.jar:3.4.0\]  
>         at org.apache.doris.metric.collector.BDBJEMetricHandler.writeDouble(BDBJEMetricHandler.java:109) ~\[palo-fe.jar:3.4.0\]  
>         at org.apache.doris.metric.collector.MetricCollector.parseFeMetricJsonAndWriteMetric(MetricCollector.java:247) ~\[palo-fe.jar:3.4.0\]  
>         at org.apache.doris.metric.collector.MetricCollector.writeMetric(MetricCollector.java:105) ~\[palo-fe.jar:3.4.0\]  
>         at org.apache.doris.metric.collector.MetricCollector.lambda$init$0(MetricCollector.java:77) ~\[palo-fe.jar:3.4.0\]  
>         at java.lang.Thread.run(Thread.java:748) \[?:1.8.0\_162\]  
> 2021-08-27 09:09:37,283 ERROR (heartbeat mgr|19) \[BDBJEJournal.write():166\] catch an exception when writing to database. sleep and retry. journal id 1526718  
> com.sleepycat.je.rep.InsufficientAcksException: (JE 7.3.7) Transaction: -16160914  VLSN: 31,775,202, initiated at: 09:09:30.  Insufficient acks for policy:SIMPLE\_MAJORITY. Need replica acks: 1. Missing replica acks: 1. Timeout: 2000ms. FeederState=192.168.7.5\_9010\_1625132780567(2)\[MASTER\]  
> Current feeds:  
>  192.168.7.7\_9010\_1625192915300: feederVLSN=31,775,205 replicaTxnEndVLSN=31,775,200  
>  192.168.7.4\_9010\_1625132697001: feederVLSN=31,775,205 replicaTxnEndVLSN=31,775,196
> 
>         at com.sleepycat.je.rep.impl.node.DurabilityQuorum.ensureSufficientAcks(DurabilityQuorum.java:205) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.rep.stream.FeederTxns.awaitReplicaAcks(FeederTxns.java:189) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.rep.impl.RepImpl.postLogCommitHookInternal(RepImpl.java:1426) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.rep.impl.RepImpl.postLogCommitHook(RepImpl.java:1385) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.rep.txn.MasterTxn.postLogCommitHook(MasterTxn.java:226) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.txn.Txn.commit(Txn.java:772) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.txn.Txn.commit(Txn.java:625) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.txn.Txn.operationEnd(Txn.java:1803) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.Database.put(Database.java:1506) ~\[je-7.3.7.jar:7.3.7\]  
>         at com.sleepycat.je.Database.put(Database.java:1556) ~\[je-7.3.7.jar:7.3.7\]  
>         at org.apache.doris.journal.bdbje.BDBJEJournal.write(BDBJEJournal.java:159) \[palo-fe.jar:3.4.0\]  
>         at org.apache.doris.persist.EditLog.logEdit(EditLog.java:849) \[palo-fe.jar:3.4.0\]  
>         at org.apache.doris.persist.EditLog.logHeartbeat(EditLog.java:1265) \[palo-fe.jar:3.4.0\]  
>         at org.apache.doris.system.HeartbeatMgr.runAfterCatalogReady(HeartbeatMgr.java:154) \[palo-fe.jar:3.4.0\]  
>         at org.apache.doris.common.util.MasterDaemon.runOneCycle(MasterDaemon.java:58) \[palo-fe.jar:3.4.0\]  
>         at org.apache.doris.common.util.Daemon.run(Daemon.java:116) \[palo-fe.jar:3.4.0\]  
> 2021-08-27 09:09:40,305 WARN (Thread-49|192) \[BDBJEMetricHandler.write():117\] write metric data into bdb error, key:192.168.7.7:8030\_quantile0.95\_1630026555000  
> com.sleepycat.je.rep.InsufficientAcksException: (JE 7.3.7) Transaction: -16160916  VLSN: 31,775,205, initiated at: 09:09:33.  Insufficient acks for policy:SIMPLE\_MAJORITY. Need replica acks: 1. Missing replica acks: 1. Timeout: 2000ms. FeederState=192.168.7.5\_9010\_1625132780567(2)\[MASTER\]  
>

如下图：

![watermark_type_ZHJvaWRzYW5zZmFsbGJhY2s_shadow_50_text_Q1NETiBA6buE55Oc54KW5ZWk6YWS6bit_size_20_color_FFFFFF_t_70_g_se_x_16][]初步判断是不是心跳超时时间设置的太短了，因为测试这个版本没有调整任何参数。   
后来判断是不是fe元数据同步副本的时候写入失败，重试失败。

重启了3次才起来：

![watermark_type_ZHJvaWRzYW5zZmFsbGJhY2s_shadow_50_text_Q1NETiBA6buE55Oc54KW5ZWk6YWS6bit_size_20_color_FFFFFF_t_70_g_se_x_16 1][]

[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70]: /images/20221120/1b340c30bff04a91b7d168769760686b.png
[20201028174101233.png]: https://img-blog.csdnimg.cn/20201028174101233.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 1]: https://img-blog.csdnimg.cn/20201030104020716.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz,size_16,color_FFFFFF,t_70
[20201030104115839.png]: https://img-blog.csdnimg.cn/20201030104115839.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 2]: https://img-blog.csdnimg.cn/20201030145535272.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz,size_16,color_FFFFFF,t_70
[2020110319015818.png]: https://img-blog.csdnimg.cn/2020110319015818.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 3]: https://img-blog.csdnimg.cn/20201103190138998.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 4]: https://img-blog.csdnimg.cn/20201104145006846.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 5]: https://img-blog.csdnimg.cn/20201104145037688.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz,size_16,color_FFFFFF,t_70
[https_blog.csdn.net_weixin_42135997_article_details_80732658]: https://blog.csdn.net/weixin_42135997/article/details/80732658
[https_blog.csdn.net_qq_15437667_article_details_83934113_utm_medium_distribute.pc_aggpage_search_result.none-task-blog-2_all_sobaiduend_default-1-83934113.nonecase_utm_term_linux_20_E6_80_8E_E4_B9_88_E7_9C_8Bcore_E6_96_87_E4_BB_B6_spm_1000.2123.3001.4430]: https://blog.csdn.net/qq_15437667/article/details/83934113?utm_medium=distribute.pc_aggpage_search_result.none-task-blog-2~all~sobaiduend~default-1-83934113.nonecase&utm_term=linux%20%E6%80%8E%E4%B9%88%E7%9C%8Bcore%E6%96%87%E4%BB%B6&spm=1000.2123.3001.4430
[20201104183345927.png]: https://img-blog.csdnimg.cn/20201104183345927.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 6]: https://img-blog.csdnimg.cn/20201104183411299.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 7]: https://img-blog.csdnimg.cn/202011051057122.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz,size_16,color_FFFFFF,t_70
[20201105105724184.png]: https://img-blog.csdnimg.cn/20201105105724184.png
[20201105172715577.png]: https://img-blog.csdnimg.cn/20201105172715577.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 8]: https://img-blog.csdnimg.cn/20201109190120227.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 9]: https://img-blog.csdnimg.cn/20201119143638518.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz,size_16,color_FFFFFF,t_70
[20201119151525696.png]: https://img-blog.csdnimg.cn/20201119151525696.png
[too_many_filtered_rows]: http://demoworld.tech/c/Apache_Doris_Load_too_many_filtered_rows
[https_cloud.baidu.com_doc_PALO_s_Ikivhcwb5]: https://cloud.baidu.com/doc/PALO/s/Ikivhcwb5
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 10]: https://img-blog.csdnimg.cn/2021010815433837.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 11]: https://img-blog.csdnimg.cn/20210113105508719.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 12]: https://img-blog.csdnimg.cn/20210113105516878.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz_size_16_color_FFFFFF_t_70 13]: https://img-blog.csdnimg.cn/2021011310554830.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMxODY2Nzkz,size_16,color_FFFFFF,t_70
[20210207135447877.png]: https://img-blog.csdnimg.cn/20210207135447877.png
[20210408103348839.png]: https://img-blog.csdnimg.cn/20210408103348839.png
[watermark_type_ZHJvaWRzYW5zZmFsbGJhY2s_shadow_50_text_Q1NETiBA6buE55Oc54KW5ZWk6YWS6bit_size_20_color_FFFFFF_t_70_g_se_x_16]: https://img-blog.csdnimg.cn/20210827092759483.png?x-oss-process=image/watermark,type_ZHJvaWRzYW5zZmFsbGJhY2s,shadow_50,text_Q1NETiBA6buE55Oc54KW5ZWk6YWS6bit,size_20,color_FFFFFF,t_70,g_se,x_16
[watermark_type_ZHJvaWRzYW5zZmFsbGJhY2s_shadow_50_text_Q1NETiBA6buE55Oc54KW5ZWk6YWS6bit_size_20_color_FFFFFF_t_70_g_se_x_16 1]: https://img-blog.csdnimg.cn/20210827093935429.png?x-oss-process=image/watermark,type_ZHJvaWRzYW5zZmFsbGJhY2s,shadow_50,text_Q1NETiBA6buE55Oc54KW5ZWk6YWS6bit,size_20,color_FFFFFF,t_70,g_se,x_16