opencv+ArcFace人脸识别

短命女 2023-10-03 09:57 83阅读 0赞

前几天逛知乎看到有免费的工具来做人脸识别，觉得很有意思；心血来潮，想自己也搞一个人脸识别；不得不说虹软ArcFace真的是太好用了；对于我这种完全不懂人脸识别算法的人，也可以构建出人脸识别的应用；只需要调用封装好的API就行了。
环境准备：

  • 1.到虹软ArcFace官网下载虹软ArcFacezip格式的压缩文件，解压后将libs文件夹copy到自己的工程下，注意libs文件下有一个：arcsoft-sdk-face-3.0.0.0.jar，添加工程对jar的路径依赖；

  • 2.maven下载opencv;

    1. <dependency>
    2.     <groupId>org.bytedeco</groupId>
    3.     <artifactId>javacv-platform</artifactId>
    4.     <version>1.4.1</version>
    5. </dependency>
    7. <dependency>
    8.     <groupId>org.bytedeco.javacpp-presets</groupId>
    9.     <artifactId>opencv-platform</artifactId>
    10.     <version>3.4.1-1.4.1</version>
    11. </dependency>
    13. <!-- jna:调用windows系统的API~-->
    14. <dependency>
    15.     <groupId>net.java.dev.jna</groupId>
    16.     <artifactId>jna</artifactId>
    17.     <version>5.8.0</version>
    18. </dependency>
    19. <dependency>
    20.     <groupId>net.java.dev.jna</groupId>
    21.     <artifactId>jna-platform</artifactId>
    22.     <version>5.8.0</version>
    23. </dependency>

项目的结构：
在这里插入图片描述

arcFace

从官方下载的zip文件节后，samplecode文件夹下FaceEngineTest.java是官方给出的示例代码；下面是人脸特征对比部分的代码：

  1. //从官网获取
  2.         String appId = "";
  3.         String sdkKey = "";
  4.         //加载dll文件，就是最开始准备的libs下面的dll文件路径；      
  5.         FaceEngine faceEngine = new FaceEngine("E:/Project/2021/face-learning/libs/WIN64");
  6.         //激活引擎
  7.         int errorCode = faceEngine.activeOnline(appId, sdkKey);
  9.         if (errorCode != ErrorInfo.MOK.getValue() && errorCode != ErrorInfo.MERR_ASF_ALREADY_ACTIVATED.getValue()) {
  11.             System.out.println("引擎激活失败");
  12.         }
  15.         ActiveFileInfo activeFileInfo=new ActiveFileInfo();
  16.         errorCode = faceEngine.getActiveFileInfo(activeFileInfo);
  17.         if (errorCode != ErrorInfo.MOK.getValue() && errorCode != ErrorInfo.MERR_ASF_ALREADY_ACTIVATED.getValue()) {
  19.             System.out.println("获取激活文件信息失败");
  20.         }
  22.         //引擎配置
  23.         EngineConfiguration engineConfiguration = new EngineConfiguration();
  24.         engineConfiguration.setDetectMode(DetectMode.ASF_DETECT_MODE_IMAGE);
  25.         engineConfiguration.setDetectFaceOrientPriority(DetectOrient.ASF_OP_ALL_OUT);
  26.         engineConfiguration.setDetectFaceMaxNum(10);
  27.         engineConfiguration.setDetectFaceScaleVal(16);
  28.         //功能配置
  29.         FunctionConfiguration functionConfiguration = new FunctionConfiguration();
  30.         functionConfiguration.setSupportAge(true);
  31.         functionConfiguration.setSupportFace3dAngle(true);
  32.         functionConfiguration.setSupportFaceDetect(true);
  33.         functionConfiguration.setSupportFaceRecognition(true);
  34.         functionConfiguration.setSupportGender(true);
  35.         functionConfiguration.setSupportLiveness(true);
  36.         functionConfiguration.setSupportIRLiveness(true);
  37.         engineConfiguration.setFunctionConfiguration(functionConfiguration);
  40.         //初始化引擎
  41.         errorCode = faceEngine.init(engineConfiguration);
  43.         if (errorCode != ErrorInfo.MOK.getValue()) {
  45.             System.out.println("初始化引擎失败");
  46.         }
  47.         //人脸检测
  48.         ImageInfo imageInfo = ImageFactory.getRGBData(new File("C:\\Users\\Pictures\\b0488b9ed27271eab692bd0097fe67ce.jpeg"));
  49.         List<FaceInfo> faceInfoList = new ArrayList<FaceInfo>();
  50.         errorCode = faceEngine.detectFaces(imageInfo.getImageData(), imageInfo.getWidth(), imageInfo.getHeight(), imageInfo.getImageFormat(), faceInfoList);
  51.         System.out.println(faceInfoList);
  53.         //特征提取
  54.         FaceFeature faceFeature = new FaceFeature();
  55.         errorCode = faceEngine.extractFaceFeature(imageInfo.getImageData(), imageInfo.getWidth(), imageInfo.getHeight(), imageInfo.getImageFormat(), faceInfoList.get(0), faceFeature);
  56.         System.out.println("特征值1大小：" + faceFeature.getFeatureData().length);
  59.         //人脸检测2
  60.         ImageInfo imageInfo2 = ImageFactory.getRGBData(new File("C:\\Users\\Pictures\\WIN_20210628_13_25_19_Pro.jpg"));
  61.         List<FaceInfo> faceInfoList2 = new ArrayList<FaceInfo>();
  62.         errorCode = faceEngine.detectFaces(imageInfo2.getImageData(), imageInfo2.getWidth(), imageInfo2.getHeight(),imageInfo.getImageFormat(), faceInfoList2);
  63.         System.out.println(faceInfoList);
  65.         //特征提取2
  66.         FaceFeature faceFeature2 = new FaceFeature();
  67.         errorCode = faceEngine.extractFaceFeature(imageInfo2.getImageData(), imageInfo2.getWidth(), imageInfo2.getHeight(), imageInfo.getImageFormat(), faceInfoList2.get(0), faceFeature2);
  68.         System.out.println("特征值2大小：" + faceFeature2.getFeatureData().length);
  70.         //特征比对
  71.         FaceSimilar faceSimilar = new FaceSimilar();
  72.         errorCode = faceEngine.compareFaceFeature(faceFeature, faceFeature2, faceSimilar);
  74.         System.out.println("相似度：" + faceSimilar.getScore());

上面这段代码流程：

  • 1.FaceEngine引擎 对象创建（加载dll文件）
  • 2.激活引擎
  • 3.引擎配置,功能配置
  • 4.初始化引擎
  • 5.分别做2张图片的：人脸检测：imageInfo（人脸信息），特征提取：faceFeatur（人脸特征）
  • 6.对比2张图片的人脸特征，得出相似度FaceSimilar

opencv

用opencv调用摄像头，获取实时的人脸信息；

  1. OpenCVFrameGrabber grabber = new OpenCVFrameGrabber(0);
  2.     Java2DFrameConverter converter =  new Java2DFrameConverter();
  3.     grabber.start();   //开始获取摄像头数据
  4.     Frame frame = grabber.grab();//获取此刻的图像数据
  5.     BufferedImage bufferedImage = converter.convert(frame);//opencv：用Java2DFrameConverter将Frame转化成BufferedImage 
  6.     ImageInfo imageInfo =ImageFactory.bufferedImage2ImageInfo(bufferedImage);//ArcFace：获取到人脸信息；

opencv_ArcFace

将上面的代码整合一下

  1. public class TestArcFace{
  3.     static  String appId = "";
  4.     static String sdkKey = "";
  5.     static String enginePath ="E:/Project/2021/face-learning/libs/WIN64";
  6.     static OpenCVFrameGrabber grabber = new OpenCVFrameGrabber(0);
  7.     static Java2DFrameConverter converter =  new Java2DFrameConverter();
  10.     public static void main(String[] args) throws Throwable{
  12.         FaceEngine faceEngine = getFaceEngine();//获取FaceEngine
  13.         grabber.start();//开启摄像头
  14.         FaceFeature bossFace = getFaceFeature(faceEngine,getImageInfoFromPicture("")).get(0);//从boss的单人照中获取boss脸部特征
  15.         boolean bossComing=false;
  16.         while(!bossComing){
  17.     //检测boss是否出现摄像头中；
  18.             List<FaceFeature> captureFaces  = getFaceFeature(faceEngine,getImageInfoFromCamera());//捕获出现在镜头中的人脸特征
  19.             for (FaceFeature captureFace : captureFaces) {
  20.     //遍历list检测捕获到的人脸特征
  21.                 FaceSimilar faceSimilar = getFaceSimilar(faceEngine,captureFace,bossFace);
  22.                  if(samePeople(faceSimilar,0.8f)){
  23.     //boss出现
  24.                      bossComing=true;
  25.                      break;
  26.                  }
  27.             }
  28.             Thread.sleep(100);//每隔100ms检测一次，检测boss是否出现在镜头中。。
  29.         }
  30.         User32.INSTANCE.LockWorkStation();//锁屏
  31.         grabber.stop();
  32.         faceEngine.unInit();
  33. }
  38.     public static FaceEngine getFaceEngine(){
  40.         FaceEngine faceEngine = new FaceEngine(enginePath);
  41.         int errorCode = faceEngine.activeOnline(appId, sdkKey);
  42.         if (errorCode != ErrorInfo.MOK.getValue() && errorCode != ErrorInfo.MERR_ASF_ALREADY_ACTIVATED.getValue()) {
  44.             System.out.println("引擎激活失败");
  45.         }
  46.         ActiveFileInfo activeFileInfo=new ActiveFileInfo();
  47.         errorCode = faceEngine.getActiveFileInfo(activeFileInfo);
  48.         if (errorCode != ErrorInfo.MOK.getValue() && errorCode != ErrorInfo.MERR_ASF_ALREADY_ACTIVATED.getValue()) {
  50.             System.out.println("获取激活文件信息失败");
  51.         }
  54.         //引擎配置
  55.         EngineConfiguration engineConfiguration = new EngineConfiguration();
  56.         engineConfiguration.setDetectMode(DetectMode.ASF_DETECT_MODE_IMAGE);
  57.         engineConfiguration.setDetectFaceOrientPriority(DetectOrient.ASF_OP_ALL_OUT);
  58.         engineConfiguration.setDetectFaceMaxNum(10);//图片中人脸数
  59.         engineConfiguration.setDetectFaceScaleVal(30);//人脸相对于所在图片的长边的占比,建议16
  60.         //功能配置
  61.         FunctionConfiguration functionConfiguration = new FunctionConfiguration();
  62.         functionConfiguration.setSupportAge(true);
  63.         functionConfiguration.setSupportFace3dAngle(true);
  64.         functionConfiguration.setSupportFaceDetect(true);
  65.         functionConfiguration.setSupportFaceRecognition(true);
  66.         functionConfiguration.setSupportGender(true);
  67.         functionConfiguration.setSupportLiveness(true);
  68.         functionConfiguration.setSupportIRLiveness(true);
  69.         engineConfiguration.setFunctionConfiguration(functionConfiguration);
  70.         //初始化引擎
  71.         errorCode = faceEngine.init(engineConfiguration);
  72.         if(ErrorInfo.MOK.getValue()!= errorCode){
  74.             throw new RuntimeException("初始化引擎失败。。。errorCode："+errorCode);
  75.         }
  76.         return faceEngine;
  77.     }
  78.     /*
  79.     获取图片中人脸信息
  80.      */
  81.     public static ImageInfo getImageInfoFromPicture(String picturePath){
  83.         return ImageFactory.getRGBData(new File(picturePath));
  84.     }
  85.     /*
  86.     从摄像头中获取到人脸信息;
  87.      */
  88.     public static ImageInfo getImageInfoFromCamera() throws FrameGrabber.Exception {
  90.         Frame frame = grabber.grab();
  91.         BufferedImage bufferedImage = converter.convert(frame);
  92.         return ImageFactory.bufferedImage2ImageInfo(bufferedImage);
  93.     }
  95.     /*
  96.     获取ImageInfo人脸特征
  97.      */
  98.     public  static List<FaceFeature> getFaceFeature(FaceEngine faceEngine,ImageInfo imageInfo){
  102.         List<FaceInfo> faceInfoList = new ArrayList<FaceInfo>();
  103.         List<FaceFeature> faceFeatures = new ArrayList<>();
  104.         //提取人脸信息
  105.         faceEngine.detectFaces(imageInfo.getImageData(),imageInfo.getWidth(),imageInfo.getHeight(),imageInfo.getImageFormat(),faceInfoList);
  106.         if(!faceInfoList.isEmpty()){
  108.             //提取人脸特征
  109.             for (FaceInfo faceInfo : faceInfoList) {
  111.                 FaceFeature faceFeature = new FaceFeature();
  112.                 faceEngine.extractFaceFeature(imageInfo.getImageData(),imageInfo.getWidth(),imageInfo.getHeight(),imageInfo.getImageFormat(),faceInfo,faceFeature);
  113.                 faceFeatures.add(faceFeature);
  114.             }
  115.         }else{
  117.             System.out.println("faceInfoList is empty");
  118.         }
  119.         return faceFeatures;
  120.     }
  122.     /*
  123.     对比FaceFeature，获取相似度
  124.      */
  125.     public static FaceSimilar getFaceSimilar(FaceEngine faceEngine,FaceFeature captureFaceFeature,FaceFeature target){
  127.         FaceSimilar faceSimilar = new FaceSimilar();
  128.         faceEngine.compareFaceFeature(captureFaceFeature,target,faceSimilar);
  129.         return faceSimilar;
  130.     }
  133.     /*
  134.     判断是否是同一个人，
  135.     score：自定义设置 ；
  136.     当相似度超过score，判定是同一人；
  137.      */
  138.     public static boolean samePeople(FaceSimilar faceSimilar,float score){
  140.         return faceSimilar.getScore()>score?true:false;
  141.     }
  143. }

发表评论

表情：
评论列表 （有 0 条评论，83人围观）

还没有评论，来说两句吧...

相关阅读

    相关 人脸识别

    计划 实现了一个基于 PCA 的人脸识别 方法 ，我 称之为 “ 特征点方法 ”， 所有的功能简单而且实用 。 下面，我使用一个简单的MATLAB脚本 说明 它的用法

    ╰半夏微凉°╰半夏微凉°/ 0 赞/ 523 阅读

    相关 人脸识别

    人脸检测 [长文干货！走近人脸检测：从 VJ 到深度学习（上）][VJ] [长文干货！走近人脸检测：从VJ到深度学习（下）][VJ 1]

    朱雀朱雀/ 0 赞/ 468 阅读

    相关 人脸识别系统_人脸注册

        基于上次的人脸检测后，一直纠结人脸注册，照片存放方式，我想到了两种方式，1.数据库存照片存放的路径，2.数据库存放照片的二进制码。但是针对我的毕业设计我想要是存路径的话

    ￡神魔★判官ぃ￡神魔★判官ぃ/ 0 赞/ 476 阅读

    相关 人脸识别系统_人脸检测

    项目：基于人脸识别的无卡ATM机模拟系统 主要实现内容： 包括实现AMT机模拟人脸识别和密码输入、PC端模拟实现储户数据库服务器系统。 1. ATM模拟端实现采用手

    亦凉亦凉/ 0 赞/ 482 阅读

    相关 人脸识别杂谈

    Gabor 及 LBP 特征描述子是迄今为止在人脸识别领域最为成功的两种人工设计局部描述子。 对各种人脸识别影响因子的针对性处理也是那一阶段的研究热点，比如人脸光照归一化、人

    古城微笑少年丶古城微笑少年丶/ 0 赞/ 516 阅读