用eclipse插件执行时发生以下错误.AccessControlException: Permission denied

ゞ浴缸里的玫瑰 2022-06-06 05:27 103阅读 0赞

hadoop2.6.5版本，用eclipse插件执行时发生以下错误。

可以看出来我的输出文件output权限对于非supergroup没有写入的权限。该如何解决这个问题呢？

org.apache.hadoop.security.AccessControlException: Permission denied: user=new, access=WRITE, inode="/output":root:supergroup:drwxr-xr-x
    	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkFsPermission(FSPermissionChecker.java:271)
    	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:257)
    	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:238)
    	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:179)
    	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:6547)
    	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:6529)
    	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkAncestorAccess(FSNamesystem.java:6481)
    	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInternal(FSNamesystem.java:4290)
    	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInt(FSNamesystem.java:4260)
    	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:4233)
    	at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:853)
    	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:600)
    	at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
    	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:619)
    	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:975)
    	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2040)
    	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2036)
    	at java.security.AccessController.doPrivileged(Native Method)
    	at javax.security.auth.Subject.doAs(Subject.java:415)
    	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692)
    	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2034)

我已经有很多执行经验可以排除其他问题，记忆中hdfs-site.xml中有一个参数涉及权限验证

dfs.permissions.enabled 启用权限检查，确认客户端用户ing，所属组别等权限认证

If "true", enable permission checking in HDFS. If "false", permission checking is turned off, but all other behavior is unchanged. Switching from one parameter value to the other does not change the mode, owner or group of files or directories.

**解决方法1：在hdfs-site.xml中添加下面参数，重启后就可以执行**

<property>
        <name>dfs.permissions.enabled</name>
        <value>false</value>
      </property>

**解决方法2：我是在windows执行的程序，所以会被认为是other组的用户没有写权限**

**所以我们可以把程序达成jar包上传到hdfs系统中运行。也可以修改输出文件的写权限。**