Apache Hadoop3.3.1-HDFS指令fsck

古城微笑少年丶 2022-08-28 00:37 144阅读 0赞

# 1. fsck介绍 #

HDFS supports the fsck command to check for various inconsistencies. It is designed for reporting problems with various files, for example, missing blocks for a file or under-replicated blocks. Unlike a traditional fsck utility for native file systems, this command does not correct the errors it detects. Normally NameNode automatically corrects most of the recoverable failures. By default fsck ignores open files but provides an option to select all files during reporting. The HDFS fsck command is not a Hadoop shell command. It can be run as bin/hdfs fsck. For command usage, see fsck. fsck can be run on the whole file system or on a subset of files.

# 2.用例语法 #

Usage:
    
       hdfs fsck <path>
              [-list-corruptfileblocks |
              [-move | -delete | -openforwrite]
              [-files [-blocks [-locations | -racks | -replicaDetails | -upgradedomains]]]
              [-includeSnapshots] [-showprogress]
              [-storagepolicies] [-maintenance]
              [-blockId <blk_Id>] [-replicate]

# 3. 指令选项描述 #

COMMAND_OPTION	Description
    path	Start checking from this path.
    -delete	Delete corrupted files.
    -files	Print out files being checked.
    -files -blocks	Print out the block report
    -files -blocks -locations	Print out locations for every block.
    -files -blocks -racks	Print out network topology for data-node locations.
    -files -blocks -replicaDetails	Print out each replica details.
    -files -blocks -upgradedomains	Print out upgrade domains for every block.
    -includeSnapshots	Include snapshot data if the given path indicates a snapshottable directory or there are snapshottable directories under it.
    -list-corruptfileblocks	Print out list of missing blocks and files they belong to.
    -move	Move corrupted files to /lost+found.
    -openforwrite	Print out files opened for write.
    -showprogress	Deprecated. A dot is print every 100 files processed with or without this switch.
    -storagepolicies	Print out storage policy summary for the blocks.
    -maintenance	Print out maintenance state node details.
    -blockId	Print out information about the block.
    -replicate	Initiate replication work to make mis-replicated blocks satisfy block placement policy.
    Runs the HDFS filesystem checking utility. See fsck for more info.