如何使用Tika提取文件内容

Love The Way You Lie 2023-01-08 05:27 461阅读 0赞

# 如何使用Tika提取文件内容 #

![在这里插入图片描述][20210119112922595.png]

## 什么是Tika？ ##

*  Tika全名Apache Tika，是用于文件类型检测和从各种格式的文件中提取内容的一个库。
 *  Tika使用现有的各种文件解析器和文档类型的检测技术来检测和提取数据。
 *  使用Tika，可以轻松提取到的不同类型的文件内容，如电子表格，文本文件，图像，PDF文件甚至多媒体输入格式，在一定程度上提取结构化文本以及元数据。
 *  Tika提供用于解析不同文件格式的一个通用API。它采用83个现有的专业解析器库，所有这些解析器库是根据一个叫做Parser接口单一接口封装。

## Tika支持的文件格式 ##

<table> 
 <thead> 
  <tr> 
   <th align="center">文件格式</th> 
   <th align="center">类库</th> 
   <th align="center">Tika中的类</th> 
  </tr> 
 </thead> 
 <tbody> 
  <tr> 
   <td align="center">XML</td> 
   <td align="center">org.apache.tika.parser.xml</td> 
   <td align="center">XMLParser</td> 
  </tr> 
  <tr> 
   <td align="center">HTML</td> 
   <td align="center">org.apache.tika.parser.htmll and it uses Tagsoup Library</td> 
   <td align="center">HtmlParser</td> 
  </tr> 
  <tr> 
   <td align="center">MS-Office compound document Ole2 till 2007 ooxml 2007 onwards</td> 
   <td align="center">org.apache.tika.parser.microsoftorg.apache.tika.parser.microsoft.ooxml and it uses Apache Poi library</td> 
   <td align="center">OfficeParser(ole2)OOXMLParser(ooxml)</td> 
  </tr> 
  <tr> 
   <td align="center">OpenDocument Format openoffice</td> 
   <td align="center">org.apache.tika.parser.odf</td> 
   <td align="center">OpenOfficeParser</td> 
  </tr> 
  <tr> 
   <td align="center">portable Document Format(PDF)</td> 
   <td align="center">org.apache.tika.parser.pdf and this package uses Apache PdfBox library</td> 
   <td align="center">PDFParser</td> 
  </tr> 
  <tr> 
   <td align="center">Electronic Publication Format (digital books)</td> 
   <td align="center">org.apache.tika.parser.epub</td> 
   <td align="center">EpubParser</td> 
  </tr> 
  <tr> 
   <td align="center">Rich Text format</td> 
   <td align="center">org.apache.tika.parser.rtf</td> 
   <td align="center">RTFParser</td> 
  </tr> 
  <tr> 
   <td align="center">Compression and packaging formats</td> 
   <td align="center">org.apache.tika.parser.pkg and this package uses Common compress library</td> 
   <td align="center">PackageParser and CompressorParser and its sub-classes</td> 
  </tr> 
  <tr> 
   <td align="center">Text format</td> 
   <td align="center">org.apache.tika.parser.txt</td> 
   <td align="center">TXTParser</td> 
  </tr> 
  <tr> 
   <td align="center">Feed and syndication formats</td> 
   <td align="center">org.apache.tika.parser.feed</td> 
   <td align="center">FeedParser</td> 
  </tr> 
  <tr> 
   <td align="center">Audio formats</td> 
   <td align="center">org.apache.tika.parser.audio and org.apache.tika.parser.mp3</td> 
   <td align="center">AudioParser MidiParser Mp3- for mp3parser</td> 
  </tr> 
  <tr> 
   <td align="center">Imageparsers</td> 
   <td align="center">org.apache.tika.parser.jpeg</td> 
   <td align="center">JpegParser-for jpeg images</td> 
  </tr> 
  <tr> 
   <td align="center">Videoformats</td> 
   <td align="center">org.apache.tika.parser.mp4 and org.apache.tika.parser.video this parser internally uses Simple Algorithm to parse flash video formats</td> 
   <td align="center">Mp4parser FlvParser</td> 
  </tr> 
  <tr> 
   <td align="center">java class files and jar files</td> 
   <td align="center">org.apache.tika.parser.asm</td> 
   <td align="center">ClassParser CompressorParser</td> 
  </tr> 
  <tr> 
   <td align="center">Mobxformat (email messages)</td> 
   <td align="center">org.apache.tika.parser.mbox</td> 
   <td align="center">MobXParser</td> 
  </tr> 
  <tr> 
   <td align="center">Cad formats</td> 
   <td align="center">org.apache.tika.parser.dwg</td> 
   <td align="center">DWGParser</td> 
  </tr> 
  <tr> 
   <td align="center">FontFormats</td> 
   <td align="center">org.apache.tika.parser.font</td> 
   <td align="center">TrueTypeParser</td> 
  </tr> 
  <tr> 
   <td align="center">executable programs and libraries</td> 
   <td align="center">org.apache.tika.parser.executable</td> 
   <td align="center">ExecutableParser</td> 
  </tr> 
 </tbody> 
</table>

## 图形用户界面(GUI) ##

*  Tika 提供了一个jar文件访问图形化界面。
 *  下载链接：[https://archive.apache.org/dist/tika/tika-app-1.25.jar][https_archive.apache.org_dist_tika_tika-app-1.25.jar]
 *  Win+R打开命令行窗口，运行`java -jar jar文件路径`来打开GUI界面。
 *  点击open，选择文件即可解析成相应类型。

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNjI5OTg4_size_16_color_FFFFFF_t_70]

## 代码实现 ##

### Maven依赖： ###

<dependencies>
          
            <dependency>
                <groupId>org.apache.tika</groupId>
                <artifactId>tika-parsers</artifactId>
                <version>1.17</version>            
            </dependency>
            
            <dependency>
                <groupId>org.apache.pdfbox</groupId>
                <artifactId>jbig2-imageio</artifactId>
                <version>3.0.0</version>
            </dependency>
            
            <dependency>
                <groupId>org.xerial</groupId>
                <artifactId>sqlite-jdbc</artifactId>
                <version>3.8.11.2</version>
            </dependency>
    
            <dependency>
                <groupId>org.apache.poi</groupId>
                <artifactId>poi</artifactId>
                <version>3.17</version>
            </dependency>       
        </dependencies>

> 注：*第二第三两个依赖并不是必须，没有也不影响，只是运行时会报警告⚠*

### Tika提取pdf文件内容 ###

public String paserPdf() {
        
    
        try {
        
            File file = new File("C:\\Users\\FileRecv\\test1.pdf");
    
            BodyContentHandler handler = new BodyContentHandler();
            Metadata metadata = new Metadata();
            FileInputStream fileInputStream = new FileInputStream(file);
            ParseContext parseContext = new ParseContext();
    
            //提取图像信息
            //JpegParser JpegParser = new JpegParser();
            //提取PDF
            PDFParser pdfParser = new PDFParser();
            pdfParser.parse(fileInputStream,handler,metadata,parseContext);
    
            return handler.toString();
            /*String[] names = metadata.names();
            for (String name : names) {
                System.out.println("name:"+metadata.get(name));
            }*/
        } catch (Exception e) {
        
            e.printStackTrace();
        }
    
        return "";
    }

### Tika提取Excel内容 ###

public String parseExcel() {
        
    
        try {
        
            File file = new File("C:\\Users\\FileRecv\\book1.xlsx");
    
            BodyContentHandler handler = new BodyContentHandler();
            Metadata metadata = new Metadata();
            FileInputStream fileInputStream = new FileInputStream(file);
            ParseContext parseContext = new ParseContext();
    
            OOXMLParser msofficeparser = new OOXMLParser();
            msofficeparser.parse(fileInputStream, handler, metadata, parseContext);
            return handler.toString();
        } catch (Exception e) {
        
            e.printStackTrace();
        }
        return "";
    }

### Tika提取文本文档 ###

public String parseTxt() {
        
    
        try {
        
            File file = new File("C:\\Users\\FileRecv\\笔记.txt");
    
            BodyContentHandler handler = new BodyContentHandler();
            Metadata metadata = new Metadata();
            FileInputStream fileInputStream = new FileInputStream(file);
            ParseContext parseContext = new ParseContext();
    
            TXTParser txtParser = new TXTParser();
            txtParser.parse(fileInputStream, handler, metadata, parseContext);
            return handler.toString();
        } catch (Exception e) {
        
            e.printStackTrace();
        }
        return "";
    }

### Tika语言检测 ###

public String LanguageDetection() throws IOException, TikaException, SAXException {
        
    
        Parser parser = new AutoDetectParser();
        File file = new File("C:\\Users\\FileRecv\\笔记.txt");
    
        BodyContentHandler handler = new BodyContentHandler();
        Metadata metadata = new Metadata();
        FileInputStream fileInputStream = new FileInputStream(file);
        ParseContext parseContext = new ParseContext();
    
        parser.parse(fileInputStream,handler,metadata,parseContext);
        LanguageIdentifier languageIdentifier = new LanguageIdentifier(handler.toString());
        return languageIdentifier.getLanguage();
    }

### Tika获取文件格式，提取doc文件 ###

public String getContext() throws IOException, TikaException {
        
        File file = new File("C:\\Users\\FileRecv\\oracle安装教程.docx");
        Tika tika = new Tika();
        //获取格式
        String detect = tika.detect(file);
        //获取内容
        String filecontent = tika.parseToString(file);
        
        return detect;
    
        /*File file = new File("C:\\Users\\PANSOFT\\Documents\\Tencent Files\\944916258\\FileRecv\\oracle安装教程.docx");
        FileInputStream inputStream = new FileInputStream(file);
        XWPFDocument document = new XWPFDocument(inputStream);
        XWPFWordExtractor wordExtractor = new XWPFWordExtractor(document);
        String doc = wordExtractor.getText();
        return doc;*/
    }

[20210119112922595.png]: /images/20221119/8a057b5d57964f74abded9de9d3b79ed.png
[https_archive.apache.org_dist_tika_tika-app-1.25.jar]: https://archive.apache.org/dist/tika/tika-app-1.25.jar
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNjI5OTg4_size_16_color_FFFFFF_t_70]: /images/20221119/848dc9b4500042958370b06ee3440032.png