易观方舟Argo数据流开启不了,各项服务都正常,怎么办?

朱楠@Argo运营 3个月前
176次浏览 0人关注 复制链接 所属标签: 数据流 无法开启

背景:
目前所有服务都能启动,但就是无法开启数据流。
点击以后提示再开启中,然后转圈半天之后又回到关闭状态。。。

19条回答
高俊 3个月前

看一下日志

tail -300f /opt/soft/log/ark-streaming/${appkey}/event0stream.log

tail -300f /opt/soft/log/ark-streaming/${appkey}/profile0stream.log


有用0 评论0
用户1581494472 3个月前

tail -300f /opt/soft/log/ark-streaming/${appkey}/event0stream.log



2020-02-12 11:30:47.856 [RunnerStream-7eeefe9dbc34306e_event0] INFO  cn.analysys.ark.streaming.scheduler.main.f -start execute newStream:/ark/streaming/schedule/ark1.analysys.xyz/waitrun7eeefe9dbc34306e_event_0_20200212104139
2020-02-12 11:30:47.857 [RunnerStream-7eeefe9dbc34306e_event0] INFO  cn.analysys.ark.streaming.common.zk.a -节点已经存在:/ark/streaming/lock/schedule/7eeefe9dbc34306e_event_0_20200212104139
2020-02-12 11:30:47.857 [RunnerStream-7eeefe9dbc34306e_event0] INFO  c.a.ark.streaming.common.zk.ArkStreamingZKClient -创建锁的类型为=>newStream,创建节点为=>/ark/streaming/lock/schedule/7eeefe9dbc34306e_event_0_20200212104139
2020-02-12 11:30:47.943 [RunnerStream-7eeefe9dbc34306e_event0] INFO  cn.analysys.ark.streaming.scheduler.main.f -Lock success
2020-02-12 11:30:47.945 [RunnerStream-7eeefe9dbc34306e_event0] INFO  cn.analysys.ark.streaming.common.zk.a -准备开始创建节点/ark/streaming/schedule/ark1.analysys.xyz/running/7eeefe9dbc34306e_event_0_20200212104139
2020-02-12 11:30:47.947 [RunnerStream-7eeefe9dbc34306e_event0] INFO  cn.analysys.ark.streaming.common.zk.a -完成添加节点:/ark/streaming/schedule/ark1.analysys.xyz/running/7eeefe9dbc34306e_event_0_20200212104139
2020-02-12 11:30:47.950 [RunnerStream-7eeefe9dbc34306e_event0] INFO  cn.analysys.ark.streaming.common.zk.a -删除节点:/ark/streaming/schedule/ark1.analysys.xyz/waitrun/7eeefe9dbc34306e_event_0_20200212104139
2020-02-12 11:30:47.950 [RunnerStream-7eeefe9dbc34306e_event0] INFO  cn.analysys.ark.streaming.common.zk.a -删除zk节点[/ark/streaming/schedule/ark1.analysys.xyz/waitrun/7eeefe9dbc34306e_event_0_20200212104139]成功
2020-02-12 11:30:47.952 [RunnerStream-7eeefe9dbc34306e_event0] INFO  cn.analysys.ark.streaming.scheduler.main.f -Release lock success
2020-02-12 11:30:47.952 [RunnerStream-7eeefe9dbc34306e_event0] INFO  cn.analysys.ark.streaming.scheduler.main.f -start handle business
2020-02-12 11:30:48.265 [RunnerStream-7eeefe9dbc34306e_event0] INFO  cn.analysys.ark.streaming.common.zk.a -节点已经存在:/ark/streaming/stop/7eeefe9dbc34306e
2020-02-12 11:30:48.265 [RunnerStream-7eeefe9dbc34306e_event0] INFO  cn.analysys.ark.streaming.common.zk.a -删除zk节点[/ark/streaming/schedule/ark1.analysys.xyz/waitrun/7eeefe9dbc34306e_event_0_20200212104139]成功
2020-02-12 11:30:48.268 [RunnerStream-7eeefe9dbc34306e_event0] INFO  cn.analysys.ark.streaming.common.zk.a -删除节点:/ark/streaming/schedule/ark1.analysys.xyz/running/7eeefe9dbc34306e_event_0_20200212104139
2020-02-12 11:30:48.268 [RunnerStream-7eeefe9dbc34306e_event0] INFO  cn.analysys.ark.streaming.common.zk.a -删除zk节点[/ark/streaming/schedule/ark1.analysys.xyz/running/7eeefe9dbc34306e_event_0_20200212104139]成功
2020-02-12 11:30:48.269 [RunnerStream-7eeefe9dbc34306e_event0] ERROR cn.analysys.ark.streaming.scheduler.main.f -java.lang.NullPointerException
	at cn.analysys.ark.streaming.common.redis.ToolRedis.getValueByKey(ToolRedis.java:177)
	at cn.analysys.ark.streaming.service.b.a(ArkServiceEventImpl.java:168)
	at cn.analysys.ark.streaming.scheduler.main.f.a(StreamingRunningRunner.java:121)
	at cn.analysys.ark.streaming.scheduler.main.f.run(StreamingRunningRunner.java:69)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

2020-02-12 11:30:48.270 [RunnerStream-7eeefe9dbc34306e_event0] INFO  cn.analysys.ark.streaming.service.f -释放锁:/ark/streaming/lock/metadata/db_7eeefe9dbc34306e/event_write
2020-02-12 11:30:48.270 [RunnerStream-7eeefe9dbc34306e_event0] INFO  cn.analysys.ark.streaming.service.f -释放锁完成:/ark/streaming/lock/metadata/db_7eeefe9dbc34306e/event_write
2020-02-12 11:30:48.270 [RunnerStream-7eeefe9dbc34306e_event0] INFO  cn.analysys.ark.streaming.scheduler.main.f -Release lock success
2020-02-12 11:30:48.270 [RunnerStream-7eeefe9dbc34306e_event0] INFO  cn.analysys.ark.streaming.common.zk.a -删除zk节点[/ark/streaming/running/7eeefe9dbc34306e/ASK_EVENT_VVV_7eeefe9dbc34306e/0]成功

tail -300f /opt/soft/log/ark-streaming/${appkey}/profile0stream.log

2020-02-12 10:47:29.308 [RunnerStream-7eeefe9dbc34306e_profile0] ERROR cn.analysys.ark.streaming.bufferdb.kudu.utils.b -func singleSave error : org.apache.kudu.client.NonRecoverableException: MANUAL_FLUSH is enabled but the buffer is too big
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduSession.apply(KuduSession.java:93)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1035)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1043)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1043)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1043)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1043)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1043)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1043)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1043)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1043)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1043)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1043)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1043)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:901)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:836)
	at cn.analysys.ark.streaming.bufferdb.kudu.dao.a.addMapkey(ArkBufferDbKuduDataDao.java:138)
	at cn.analysys.ark.streaming.service.c.b(ArkServiceProfileImpl.java:760)
	at cn.analysys.ark.streaming.service.c.a(ArkServiceProfileImpl.java:376)
	at cn.analysys.ark.streaming.service.c.a(ArkServiceProfileImpl.java:328)
	at cn.analysys.ark.streaming.service.c.a(ArkServiceProfileImpl.java:215)
	at cn.analysys.ark.streaming.service.c.b(ArkServiceProfileImpl.java:161)
	at cn.analysys.ark.streaming.scheduler.main.f.a(StreamingRunningRunner.java:123)
	at cn.analysys.ark.streaming.scheduler.main.f.run(StreamingRunningRunner.java:69)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduSession.apply(AsyncKuduSession.java:597)
		at org.apache.kudu.client.KuduSession.apply(KuduSession.java:79)
		... 25 more

2020-02-12 10:53:38.328 [RunnerStream-7eeefe9dbc34306e_profile0] ERROR cn.analysys.ark.streaming.bufferdb.kudu.utils.b -func singleSave error : org.apache.kudu.client.NonRecoverableException: MANUAL_FLUSH is enabled but the buffer is too big
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduSession.apply(KuduSession.java:93)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1035)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1043)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1043)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1043)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1043)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1043)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1043)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1043)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1043)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1043)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1043)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:1043)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:901)
	at cn.analysys.ark.streaming.bufferdb.kudu.utils.b.a(KuduUtil.java:837)
	at cn.analysys.ark.streaming.bufferdb.kudu.dao.a.addMapkey(ArkBufferDbKuduDataDao.java:138)
	at cn.analysys.ark.streaming.service.c.b(ArkServiceProfileImpl.java:760)
	at cn.analysys.ark.streaming.service.c.a(ArkServiceProfileImpl.java:376)
	at cn.analysys.ark.streaming.service.c.a(ArkServiceProfileImpl.java:328)
	at cn.analysys.ark.streaming.service.c.a(ArkServiceProfileImpl.java:215)
	at cn.analysys.ark.streaming.service.c.b(ArkServiceProfileImpl.java:161)
	at cn.analysys.ark.streaming.scheduler.main.f.a(StreamingRunningRunner.java:123)
	at cn.analysys.ark.streaming.scheduler.main.f.run(StreamingRunningRunner.java:69)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduSession.apply(AsyncKuduSession.java:597)
		at org.apache.kudu.client.KuduSession.apply(KuduSession.java:79)
		... 25 more

2020-02-12 10:54:06.186 [RunnerStream-7eeefe9dbc34306e_profile0] ERROR cn.analysys.ark.streaming.bufferdb.kudu.utils.b -func addMapkey err ,xhwo is :妞妞
2020-02-12 10:54:09.834 [RunnerStream-7eeefe9dbc34306e_profile0] ERROR cn.analysys.ark.streaming.bufferdb.kudu.dao.d -errorsCount2::1
2020-02-12 10:54:11.834 [RunnerStream-7eeefe9dbc34306e_profile0] INFO  cn.analysys.ark.streaming.common.zk.a -准备开始创建节点/ark/streaming/stop/7eeefe9dbc34306e
2020-02-12 10:54:11.836 [RunnerStream-7eeefe9dbc34306e_profile0] INFO  cn.analysys.ark.streaming.common.zk.a -完成添加节点:/ark/streaming/stop/7eeefe9dbc34306e
2020-02-12 10:54:11.836 [RunnerStream-7eeefe9dbc34306e_profile0] INFO  cn.analysys.ark.streaming.common.zk.a -删除zk节点[/ark/streaming/schedule/ark1.analysys.xyz/waitrun/7eeefe9dbc34306e_profile_0_20200212104139]成功
2020-02-12 10:54:11.838 [RunnerStream-7eeefe9dbc34306e_profile0] INFO  cn.analysys.ark.streaming.common.zk.a -删除节点:/ark/streaming/schedule/ark1.analysys.xyz/running/7eeefe9dbc34306e_profile_0_20200212104139
2020-02-12 10:54:11.838 [RunnerStream-7eeefe9dbc34306e_profile0] INFO  cn.analysys.ark.streaming.common.zk.a -删除zk节点[/ark/streaming/schedule/ark1.analysys.xyz/running/7eeefe9dbc34306e_profile_0_20200212104139]成功
2020-02-12 10:54:11.838 [RunnerStream-7eeefe9dbc34306e_profile0] ERROR cn.analysys.ark.streaming.scheduler.main.f -java.lang.RuntimeException: flush data to kudu failed !
	at cn.analysys.ark.streaming.bufferdb.kudu.dao.d.flushData(ArkRowSetKuduImpl.java:137)
	at cn.analysys.ark.streaming.service.c.a(ArkServiceProfileImpl.java:1046)
	at cn.analysys.ark.streaming.service.c.a(ArkServiceProfileImpl.java:375)
	at cn.analysys.ark.streaming.service.c.a(ArkServiceProfileImpl.java:328)
	at cn.analysys.ark.streaming.service.c.a(ArkServiceProfileImpl.java:215)
	at cn.analysys.ark.streaming.service.c.b(ArkServiceProfileImpl.java:161)
	at cn.analysys.ark.streaming.scheduler.main.f.a(StreamingRunningRunner.java:123)
	at cn.analysys.ark.streaming.scheduler.main.f.run(StreamingRunningRunner.java:69)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

2020-02-12 10:54:11.838 [RunnerStream-7eeefe9dbc34306e_profile0] INFO  cn.analysys.ark.streaming.service.f -释放锁:/ark/streaming/lock/metadata/db_7eeefe9dbc34306e/profile
2020-02-12 10:54:11.838 [RunnerStream-7eeefe9dbc34306e_profile0] INFO  cn.analysys.ark.streaming.service.f -释放锁完成:/ark/streaming/lock/metadata/db_7eeefe9dbc34306e/profile
2020-02-12 10:54:11.838 [RunnerStream-7eeefe9dbc34306e_profile0] INFO  cn.analysys.ark.streaming.scheduler.main.f -Release lock success
2020-02-12 10:54:11.840 [RunnerStream-7eeefe9dbc34306e_profile0] INFO  cn.analysys.ark.streaming.common.zk.a -删除节点:/ark/streaming/running/7eeefe9dbc34306e/ASK_PROFILE_VVV_7eeefe9dbc34306e/0
2020-02-12 10:54:11.840 [RunnerStream-7eeefe9dbc34306e_profile0] INFO  cn.analysys.ark.streaming.common.zk.a -删除zk节点[/ark/streaming/running/7eeefe9dbc34306e/ASK_PROFILE_VVV_7eeefe9dbc34306e/0]成功





有用0 评论0
高俊 3个月前

你是不是属性特别多,而且都是字符串类型

有用0 评论1
登录后可参与回答,请 登录
用户1581494472 3个月前

埋点系统没有怎么用,属性也不多。 

有用0 评论
高俊 3个月前

什么版本?我看一下代码


有用0 评论0
高俊 3个月前

重启一下kudu看看呢?

有用0 评论3
登录后可参与回答,请 登录
用户1581494472 3个月前

重启完 kudu,  之后,还是打不开... 

有用0 评论
登录后可参与回答,请 登录
dohkoxiaozu 回复 用户1581494472 2个月前

请问你的数据流开启中问题解决了吗?

有用0 评论
登录后可参与回答,请 登录
朱楠@Argo运营 回复 dohkoxiaozu 1个月前

你好,请问你的问题还没解决吗?

有用0 评论
用户1581494472 3个月前
stderr: 
Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/ARK_KUDU/1.9.0/package/scripts/kudu-tserver.py", line 77, in <module>
    KuduTserver().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 329, in execute
    method(env)
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 855, in restart
    self.start(env)
  File "/var/lib/ambari-agent/cache/common-services/ARK_KUDU/1.9.0/package/scripts/kudu-tserver.py", line 26, in start
    Execute(cmd)
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 262, in action_run
    tries=self.resource.tries, try_sleep=self.resource.try_sleep)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 72, in inner
    result = function(command, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 102, in checked_call
    tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 150, in _call_wrapper
    result = _call(command, **kwargs_copy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 303, in _call
    raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of 'service kudu-tserver start' returned 1. Failed to start Kudu Tablet Server. Return value: 1[FAILED]
 stdout:
2020-02-12 16:57:57,498 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2020-02-12 16:57:57,801 - Stack Feature Version Info: stack_version=2.6, version=2.6.1.0-129, current_cluster_version=2.6.1.0-129 -> 2.6.1.0-129
2020-02-12 16:57:57,807 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
User Group mapping (user_group) is missing in the hostLevelParams
2020-02-12 16:57:57,808 - Group['root'] {}
2020-02-12 16:57:57,809 - Group['ranger'] {}
2020-02-12 16:57:57,809 - Group['hadoop'] {}
2020-02-12 16:57:57,809 - Group['ark'] {}
2020-02-12 16:57:57,809 - Group['users'] {}
2020-02-12 16:57:57,810 - Group['presto'] {}
2020-02-12 16:57:57,810 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2020-02-12 16:57:57,811 - User['streaming'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2020-02-12 16:57:57,811 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2020-02-12 16:57:57,811 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users']}
2020-02-12 16:57:57,812 - User['root'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2020-02-12 16:57:57,812 - User['ranger'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'ranger']}
2020-02-12 16:57:57,813 - User['kafka'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2020-02-12 16:57:57,813 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2020-02-12 16:57:57,814 - User['ark'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2020-02-12 16:57:57,814 - User['hcat'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2020-02-12 16:57:57,814 - User['isuhadoop'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2020-02-12 16:57:57,815 - User['presto'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2020-02-12 16:57:57,815 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2020-02-12 16:57:57,816 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2020-02-12 16:57:57,849 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] due to not_if
2020-02-12 16:57:57,849 - Group['hdfs'] {}
2020-02-12 16:57:57,850 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': [u'hadoop', u'hdfs']}
2020-02-12 16:57:57,850 - FS Type: 
2020-02-12 16:57:57,850 - Directory['/etc/hadoop'] {'mode': 0755}
2020-02-12 16:57:57,863 - File['/usr/hdp/current/hadoop-client/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2020-02-12 16:57:57,864 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777}
2020-02-12 16:57:57,882 - Execute[('setenforce', '0')] {'not_if': '(! which getenforce ) || (which getenforce && getenforce | grep -q Disabled)', 'sudo': True, 'only_if': 'test -f /selinux/enforce'}
2020-02-12 16:57:57,915 - Skipping Execute[('setenforce', '0')] due to not_if
2020-02-12 16:57:57,915 - Directory['/opt/soft/log/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'hadoop', 'mode': 0775, 'cd_access': 'a'}
2020-02-12 16:57:57,917 - Directory['/var/run/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'root', 'cd_access': 'a'}
2020-02-12 16:57:57,917 - Directory['/tmp/hadoop-hdfs'] {'owner': 'hdfs', 'create_parents': True, 'cd_access': 'a'}
2020-02-12 16:57:57,920 - File['/usr/hdp/current/hadoop-client/conf/commons-logging.properties'] {'content': Template('commons-logging.properties.j2'), 'owner': 'hdfs'}
2020-02-12 16:57:57,921 - File['/usr/hdp/current/hadoop-client/conf/health_check'] {'content': Template('health_check.j2'), 'owner': 'hdfs'}
2020-02-12 16:57:57,925 - File['/usr/hdp/current/hadoop-client/conf/log4j.properties'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
2020-02-12 16:57:57,932 - File['/usr/hdp/current/hadoop-client/conf/hadoop-metrics2.properties'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2020-02-12 16:57:57,933 - File['/usr/hdp/current/hadoop-client/conf/task-log4j.properties'] {'content': StaticFile('task-log4j.properties'), 'mode': 0755}
2020-02-12 16:57:57,933 - File['/usr/hdp/current/hadoop-client/conf/configuration.xsl'] {'owner': 'hdfs', 'group': 'hadoop'}
2020-02-12 16:57:57,936 - File['/etc/hadoop/conf/topology_mappings.data'] {'owner': 'hdfs', 'content': Template('topology_mappings.data.j2'), 'only_if': 'test -d /etc/hadoop/conf', 'group': 'hadoop'}
2020-02-12 16:57:57,968 - File['/etc/hadoop/conf/topology_script.py'] {'content': StaticFile('topology_script.py'), 'only_if': 'test -d /etc/hadoop/conf', 'mode': 0755}
2020-02-12 16:57:58,353 - Execute['echo "Running cmd: service kudu-tserver stop"'] {}
2020-02-12 16:57:58,385 - Execute['service kudu-tserver stop'] {}
2020-02-12 16:57:58,546 - Pid file /var/run/kudu/kudu-tserver-kudu.pid is empty or does not exist
2020-02-12 16:57:58,555 - File['/etc/kudu/conf/tserver.gflagfile'] {'content': Template('kudu_tserver.j2'), 'mode': 0644}
2020-02-12 16:57:58,556 - File['/etc/default/kudu-tserver'] {'content': Template('default_kudu_tserver.j2'), 'mode': 0644}
2020-02-12 16:57:58,557 - Directory['/data1/kudu/tserver'] {'owner': 'kudu', 'create_parents': True, 'mode': 0755}
2020-02-12 16:57:58,557 - Changing permission for /data1/kudu/tserver from 700 to 755
2020-02-12 16:57:58,557 - Directory['/data1/kudu/tserver'] {'owner': 'kudu', 'create_parents': True, 'mode': 0755}
2020-02-12 16:57:58,557 - Directory['/opt/soft/log/kudu'] {'owner': 'kudu', 'create_parents': True, 'mode': 0755}
2020-02-12 16:57:58,558 - Execute['echo "Running cmd: service kudu-tserver start"'] {}
2020-02-12 16:57:58,588 - Execute['service kudu-tserver start'] {}

Command failed after 1 tries


有用0 评论0
高俊 3个月前

给你一个jar包,将/opt/soft/streaming/jars/streaming.jar这个软连接指定到这个jar包上。ambari上重启streaming

有用0 评论1
登录后可参与回答,请 登录
用户1581494472 3个月前


替换了 JAR 包,sha1: SHA1(streaming-manager-0.3.18.2-proto3-pg.jar)= 993d1520a69300570233e22ab6199b6698421685

重启了 Streaming...  

还是失败 


有用0 评论
高俊 3个月前

能远程你吗

有用0 评论0
高俊 3个月前

重启下kafka,kudu解决。

流失败是因为写入kudu失败,kudu服务的状态不正常。重启kudu即可。

页面点启动流但起不来,是因为kafka状态不正常导致的。重启kafka解决。

有用1 评论1
登录后可参与回答,请 登录
朱楠@Argo运营 3个月前

谢谢高老师!

有用0 评论
用户1581494472 3个月前

感谢

有用0 评论0