Android 人脸识别+人脸匹配(OpenCV+JavaCV)

╰+哭是因爲堅強的太久メ 2021-09-14 02:58 949阅读 0赞

http://m.blog.csdn.net/sky286753213/article/details/11887913

项目源码 http://download.csdn.net/detail/sky286753213/6617075

之前不想上传源码是因为代码写的实在很烂,参考价值不是很大,主要代码都在CameraActivity中

这里吐下槽,目前Android人脸识别技术分享的感觉很少

我也是参考一些资料和别人的代码加以改进

上个项目中用到的技术现在有些遗忘了,把关键性的代码给大家分享下

  1. public void DetectFace() {
  2.         Mat image = Highgui.imread(FACE);
  3.         MatOfRect faceDetections = new MatOfRect();
  4.         mJavaDetector.detectMultiScale(image, faceDetections);
  6.         for (Rect rect : faceDetections.toArray()) {
  7.             Core.rectangle(image, new Point(rect.x, rect.y), new Point(rect.x
  8.                     + rect.width, rect.y + rect.height), new Scalar(0, 255, 0));
  9.             // 把检测到的人脸重新定义大小后保存成文件
  10.             Mat sub = image.submat(rect);
  11.             Mat mat = new Mat();
  12.             Size size = new Size(100, 100);
  13.             Imgproc.resize(sub, mat, size);
  14.             Highgui.imwrite(FACEDONE, mat);
  15.         }
  16.     }

FACE和FACEDONE为两个路径 一个是拍照完成的图片路径,另一个是生成的人脸图片的路径

这里使用了OpenCV中的人脸识别方法,方法很简单,把你的照片路径带进去他会检测到这张图片里有多少个人头,然后进行循环输出人脸图片

这里需要注意下的是 如果进行人脸比对的话需要每张图片的大小一样,否则会报异常

另外,想使用OpenCV之前还需定义一个BaseLoaderCallback对象来加载识别的人脸xml库

  1. private BaseLoaderCallback mLoaderCallback = new BaseLoaderCallback(this) {
  3.         public void onManagerConnected(int status) {
  4.             switch (status) {
  5.             case LoaderCallbackInterface.SUCCESS: {
  6.                 mJavaDetector = new CascadeClassifier(
  7.                         "/sdcard/FaceDetect/haarcascade_frontalface_alt2.xml");
  8.             }
  9.                 break;
  10.             default: {
  11.                 super.onManagerConnected(status);
  12.             }
  13.                 break;
  14.             }
  15.         }
  16.     };

然后在OnResume中加载BaseLoaderCallback对象

  1. OpenCVLoader.initAsync(OpenCVLoader.OPENCV_VERSION_2_4_5, this,
  2.                 mLoaderCallback);

人脸匹配使用的是JavaCV中的匹配方法

该方法的博客一会附上连接

  1. public int Identification() {
  2.         FaceRecognizer fr = createFisherFaceRecognizer();
  3.         MatVector mv = new MatVector(faceList.size());
  4.         CvMat cvMat = CvMat.create(faceList.size(), 1, CV_32SC1);
  5.         for (int i = 0; i < faceList.size(); i++) {
  6.             IplImage img = cvLoadImage(faceList.get(i).getPath(),
  7.                     CV_LOAD_IMAGE_GRAYSCALE);
  8.             mv.put(i, img);
  9.             cvMat.put(i, 0, i);
  10.         }
  11.         fr.train(mv, cvMat);
  12.         IplImage testImage = cvLoadImage(
  13.                 Environment.getExternalStorageDirectory()
  14.                         + "/FaceDetect/faceDone.jpg", CV_LOAD_IMAGE_GRAYSCALE);
  15.         return fr.predict(testImage);
  17.     }

faceList中放的是人脸图片文件夹里所有人脸图片的路径

循环把他们放入MatVector和CvMat中

然后对FaceRecognizer进行训练

  1. /FaceDetect/faceDone.jpg

这个路径是经过上面识别方法处理完图片后所输出的人脸图片的路径

predict()方法把刚才的人脸图片放入训练模型中进行匹配 会返回一个模型中的索引值

获取到索引值后就大功告成了

下面一个方法可以获取到两张图片的相似度,最大值是100

  1. public double CmpPic(String path) {
  2.         int l_bins = 20;
  3.         int hist_size[] = { l_bins };
  5.         float v_ranges[] = { 0, 100 };
  6.         float ranges[][] = { v_ranges };
  8.         IplImage Image1 = cvLoadImage(Environment.getExternalStorageDirectory()
  9.                 + "/FaceDetect/faceDone.jpg", CV_LOAD_IMAGE_GRAYSCALE);
  10.         IplImage Image2 = cvLoadImage(path, CV_LOAD_IMAGE_GRAYSCALE);
  12.         IplImage imageArr1[] = { Image1 };
  13.         IplImage imageArr2[] = { Image2 };
  15.         CvHistogram Histogram1 = CvHistogram.create(1, hist_size,
  16.                 CV_HIST_ARRAY, ranges, 1);
  17.         CvHistogram Histogram2 = CvHistogram.create(1, hist_size,
  18.                 CV_HIST_ARRAY, ranges, 1);
  20.         cvCalcHist(imageArr1, Histogram1, 0, null);
  21.         cvCalcHist(imageArr2, Histogram2, 0, null);
  23.         cvNormalizeHist(Histogram1, 100.0);
  24.         cvNormalizeHist(Histogram2, 100.0);
  26.         return cvCompareHist(Histogram1, Histogram2, CV_COMP_CORREL);
  27.     }

带入两张图片的路径即可,这里不在阐述

下面是源码,写的很烂,仅供参考

  1. package com.comdosoft.face;
  3. import static com.googlecode.javacv.cpp.opencv_contrib.createFisherFaceRecognizer;
  4. import static com.googlecode.javacv.cpp.opencv_core.CV_32SC1;
  5. import static com.googlecode.javacv.cpp.opencv_highgui.CV_LOAD_IMAGE_GRAYSCALE;
  6. import static com.googlecode.javacv.cpp.opencv_highgui.cvLoadImage;
  7. import static com.googlecode.javacv.cpp.opencv_imgproc.CV_COMP_CORREL;
  8. import static com.googlecode.javacv.cpp.opencv_imgproc.CV_HIST_ARRAY;
  9. import static com.googlecode.javacv.cpp.opencv_imgproc.cvCalcHist;
  10. import static com.googlecode.javacv.cpp.opencv_imgproc.cvCompareHist;
  11. import static com.googlecode.javacv.cpp.opencv_imgproc.cvNormalizeHist;
  12. import java.io.BufferedOutputStream;
  13. import java.io.File;
  14. import java.io.FileOutputStream;
  15. import java.util.ArrayList;
  16. import java.util.List;
  17. import java.util.Timer;
  18. import java.util.TimerTask;
  19. import org.opencv.android.BaseLoaderCallback;
  20. import org.opencv.android.LoaderCallbackInterface;
  21. import org.opencv.android.OpenCVLoader;
  22. import org.opencv.core.Core;
  23. import org.opencv.core.Mat;
  24. import org.opencv.core.MatOfRect;
  25. import org.opencv.core.Point;
  26. import org.opencv.core.Rect;
  27. import org.opencv.core.Scalar;
  28. import org.opencv.core.Size;
  29. import org.opencv.highgui.Highgui;
  30. import org.opencv.imgproc.Imgproc;
  31. import org.opencv.objdetect.CascadeClassifier;
  32. import android.app.Activity;
  33. import android.app.ProgressDialog;
  34. import android.content.Intent;
  35. import android.content.pm.ActivityInfo;
  36. import android.graphics.Bitmap;
  37. import android.graphics.BitmapFactory;
  38. import android.graphics.Matrix;
  39. import android.hardware.Camera;
  40. import android.os.Bundle;
  41. import android.os.Environment;
  42. import android.os.Handler;
  43. import android.os.Message;
  44. import android.view.LayoutInflater;
  45. import android.view.SurfaceHolder;
  46. import android.view.SurfaceView;
  47. import android.view.View;
  48. import android.view.ViewGroup;
  49. import android.view.Window;
  50. import android.view.WindowManager;
  51. import android.widget.ImageView;
  52. import android.widget.Toast;
  53. import com.comdosoft.pojo.FacePojo;
  54. import com.googlecode.javacv.cpp.opencv_contrib.FaceRecognizer;
  55. import com.googlecode.javacv.cpp.opencv_core.CvMat;
  56. import com.googlecode.javacv.cpp.opencv_core.IplImage;
  57. import com.googlecode.javacv.cpp.opencv_core.MatVector;
  58. import com.googlecode.javacv.cpp.opencv_imgproc.CvHistogram;
  60. public class CameraActivity extends Activity implements SurfaceHolder.Callback,
  61.         Camera.PictureCallback {
  62.     private List<FacePojo> faceList = new ArrayList<FacePojo>();
  64.     private ProgressDialog proDialog;
  65.     private CascadeClassifier mJavaDetector;
  66.     private SurfaceView mSurfaceView;
  67.     private SurfaceHolder holder;
  68.     private Camera camera;
  70.     private String FACE = "/sdcard/FaceDetect/face.jpg";
  71.     private String FACEDONE = "/sdcard/FaceDetect/faceDone.jpg";
  72.     private int index;
  73.     private int type;
  74.     private int t = 2;
  75.     private int angle = 0;
  76.     private boolean flag = true;
  77.     private double value;
  78.     private Toast toast;
  79.     private FacePojo fp;
  80.     private int cameraCount;
  81.     private CameraUtil cu = new CameraUtil();
  82.     private int[] iconArr = new int[] { R.drawable.icon1, R.drawable.icon2,
  83.             R.drawable.icon3 };
  85.     private BaseLoaderCallback mLoaderCallback = new BaseLoaderCallback(this) {
  87.         public void onManagerConnected(int status) {
  88.             switch (status) {
  89.             case LoaderCallbackInterface.SUCCESS: {
  90.                 mJavaDetector = new CascadeClassifier(
  91.                         "/sdcard/FaceDetect/haarcascade_frontalface_alt2.xml");
  92.             }
  93.                 break;
  94.             default: {
  95.                 super.onManagerConnected(status);
  96.             }
  97.                 break;
  98.             }
  99.         }
  100.     };
  102.     private Handler updateUI = new Handler() {
  103.         @Override
  104.         public void handleMessage(Message msg) {
  105.             switch (msg.what) {
  106.             case 1:
  107.                 proDialog.dismiss();
  108.                 Intent intent = new Intent();
  109.                 if (type == 0 || type == 1) {
  110.                     index = Identification();
  111.                     fp = faceList.get(index);
  112.                     value = CmpPic(fp.getPath()) * 100;
  113.                 }
  114.                 // Toast.makeText(getApplicationContext(),
  115.                 // "相似度:" + value + "--" + num, 0).show();
  116.                 if (value < 70 && type != 2) {
  117.                     intent.setClass(getApplicationContext(), SignFail.class);
  118.                     startActivity(intent);
  119.                 } else {
  120.                     if (type == 0) {
  121.                         Bundle bundle = new Bundle();
  122.                         bundle.putString("id", fp.getId());
  123.                         bundle.putString("name", fp.getName());
  124.                         intent.putExtras(bundle);
  125.                         intent.setClass(getApplicationContext(), SignIn.class);
  126.                         startActivity(intent);
  127.                     } else if (type == 1) {
  128.                         Intent intent2 = getIntent();
  129.                         Bundle bundle2 = new Bundle();
  130.                         bundle2.putInt("status", 1);
  131.                         bundle2.putString("id", fp.getId());
  132.                         bundle2.putString("name", fp.getName());
  133.                         intent2.putExtras(bundle2);
  134.                         setResult(RESULT_OK, intent2);
  135.                         finish();
  136.                     } else if (type == 2) {
  137.                         Intent intent2 = getIntent();
  138.                         setResult(RESULT_OK, intent2);
  139.                         finish();
  140.                     }
  141.                 }
  142.                 break;
  143.             }
  144.         }
  145.     };
  147.     private Timer dataTimer = new Timer();
  148.     private Handler dataHandler = new Handler() {
  149.         @Override
  150.         public void handleMessage(Message msg) {
  151.             super.handleMessage(msg);
  152.             int msgId = msg.what;
  153.             switch (msgId) {
  154.             case 1:
  155.                 if (flag && t == -1) {
  156.                     // camera.autoFocus(null);
  157.                     camera.takePicture(null, null, CameraActivity.this);
  158.                     flag = false;
  159.                 }
  160.                 if (flag) {
  161.                     timeDown();
  162.                 }
  163.             }
  164.         }
  166.     };
  168.     @Override
  169.     protected void onCreate(Bundle savedInstanceState) {
  170.         super.onCreate(savedInstanceState);
  172.         getWindow().clearFlags(
  173.                 WindowManager.LayoutParams.FLAG_FORCE_NOT_FULLSCREEN);
  174.         getWindow().addFlags(WindowManager.LayoutParams.FLAG_FULLSCREEN);
  175.         requestWindowFeature(Window.FEATURE_NO_TITLE);// 设置横屏模式以及全屏模式
  176.         setContentView(R.layout.camera);// 设置View
  178.         proDialog = new ProgressDialog(this);
  180.         Intent bundle = getIntent();
  181.         type = bundle.getIntExtra("type", 0);
  183.         mSurfaceView = (SurfaceView) findViewById(R.id.camera);
  184.         holder = mSurfaceView.getHolder();
  185.         holder.addCallback(this);
  186.         holder.setType(SurfaceHolder.SURFACE_TYPE_PUSH_BUFFERS);// 指定Push Buffer
  187.     }
  189.     @Override
  190.     protected void onStart() {
  191.         super.onStart();
  192.         LoadFaceData();
  193.     }
  195.     @Override
  196.     protected void onResume() {
  197.         super.onResume();
  198.         if (getRequestedOrientation() != ActivityInfo.SCREEN_ORIENTATION_LANDSCAPE) {
  199.             setRequestedOrientation(ActivityInfo.SCREEN_ORIENTATION_LANDSCAPE);
  200.         }
  201.         OpenCVLoader.initAsync(OpenCVLoader.OPENCV_VERSION_2_4_5, this,
  202.                 mLoaderCallback);
  203.     }
  205.     public void onPictureTaken(byte[] data, Camera camera) {
  206.         try {
  207.             String path = Environment.getExternalStorageDirectory()
  208.                     + "/FaceDetect/face.jpg";
  209.             // data2file(data, path);
  210.             Bitmap bitmap = BitmapFactory.decodeByteArray(data, 0, data.length);
  211.             Matrix matrix = new Matrix();
  212.             // 设置图像的旋转角度
  213.             matrix.setRotate(angle);
  214.             // 旋转图像，并生成新的Bitmap对像
  215.             bitmap = Bitmap.createBitmap(bitmap, 0, 0, bitmap.getWidth(),
  216.                     bitmap.getHeight(), matrix, true);
  217.             cu.writePhoto(bitmap, bitmap.getWidth(), bitmap.getHeight(), path);
  218.             if (type == 2) {
  219.                 proDialog.setMessage("正在检测...");
  220.             } else {
  221.                 proDialog.setMessage("正在识别...");
  222.             }
  223.             proDialog.show();
  224.             Thread loginThread = new Thread(new LoginFailureHandler());
  225.             loginThread.start();
  226.         } catch (Exception e) {
  227.         }
  228.         camera.startPreview();
  229.     }
  231.     class LoginFailureHandler implements Runnable {
  233.         public void run() {
  234.             DetectFace();
  235.             Message message = new Message();
  236.             message.what = 1;
  237.             updateUI.sendMessage(message);
  238.         }
  239.     }
  241.     public void surfaceCreated(SurfaceHolder holder) {
  242.         try {
  243.             camera = Camera.open(camera());// 摄像头的初始化
  244.             camera.setPreviewDisplay(holder);
  245.             dataTimer.schedule(new TimerTask() {
  247.                 @Override
  248.                 public void run() {
  249.                     Message message = new Message();
  250.                     message.what = 1;
  251.                     dataHandler.sendMessage(message);
  252.                 }
  254.             }, 0, 2000);
  255.         } catch (Exception e) {
  256.         }
  258.     }
  260.     public void surfaceChanged(SurfaceHolder holder, int format, int width,
  261.             int height) {
  262.         Camera.Parameters parameters = camera.getParameters();
  263.         // parameters.setPreviewSize(1280, 800);
  264.         camera.setParameters(parameters);// 设置参数
  265.         int flag = getWindowManager().getDefaultDisplay().getRotation();
  266.         angle = 450 - flag * 90;
  267.         if (angle >= 360) {
  268.             angle = angle - 360;
  269.         }
  270.         camera.setDisplayOrientation(angle);
  271.         camera.startPreview();// 开始预览
  273.     }
  275.     public void surfaceDestroyed(SurfaceHolder holder) {
  276.         camera.setPreviewCallback(null);
  277.         camera.stopPreview();
  278.         camera.release();
  279.         camera = null;
  281.     }
  283.     // private void data2file(byte[] w, String fileName) throws Exception {//
  284.     // 将二进制数据转换为文件的函数
  285.     // FileOutputStream out = null;
  286.     // try {
  287.     // out = new FileOutputStream(fileName);
  288.     // out.write(w);
  289.     // out.close();
  290.     // } catch (Exception e) {
  291.     // if (out != null)
  292.     // out.close();
  293.     // throw e;
  294.     // }
  295.     // }
  297.     public void DetectFace() {
  298.         Mat image = Highgui.imread(FACE);
  299.         MatOfRect faceDetections = new MatOfRect();
  300.         mJavaDetector.detectMultiScale(image, faceDetections);
  302.         int k = 0;
  304.         for (Rect rect : faceDetections.toArray()) {
  305.             Core.rectangle(image, new Point(rect.x, rect.y), new Point(rect.x
  306.                     + rect.width, rect.y + rect.height), new Scalar(0, 255, 0));
  307.             // 把检测到的人脸重新定义大小后保存成文件
  308.             Mat sub = image.submat(rect);
  309.             Mat mat = new Mat();
  310.             Size size = new Size(100, 100);
  311.             Imgproc.resize(sub, mat, size);
  312.             Highgui.imwrite(FACEDONE, mat);
  313.             k++;
  314.         }
  316.         if (k == 0) {
  317.             cu.writePhoto(BitmapFactory.decodeFile(FACE), 100, 100, FACEDONE);
  318.         }
  319.     }
  321.     public int Identification() {
  322.         FaceRecognizer fr = createFisherFaceRecognizer();
  323.         MatVector mv = new MatVector(faceList.size());
  324.         CvMat cvMat = CvMat.create(faceList.size(), 1, CV_32SC1);
  325.         for (int i = 0; i < faceList.size(); i++) {
  326.             IplImage img = cvLoadImage(faceList.get(i).getPath(),
  327.                     CV_LOAD_IMAGE_GRAYSCALE);
  328.             mv.put(i, img);
  329.             cvMat.put(i, 0, i);
  330.         }
  331.         fr.train(mv, cvMat);
  332.         IplImage testImage = cvLoadImage(
  333.                 Environment.getExternalStorageDirectory()
  334.                         + "/FaceDetect/faceDone.jpg", CV_LOAD_IMAGE_GRAYSCALE);
  335.         return fr.predict(testImage);
  337.     }
  339.     public void LoadFaceData() {
  340.         File[] files = new File("/sdcard/FaceData/").listFiles();
  341.         File f;
  342.         String id;
  343.         String name;
  344.         faceList.clear();
  345.         for (int i = 0; i < files.length; i++) {
  346.             f = files[i];
  347.             if (!f.canRead()) {
  348.                 return;
  349.             }
  350.             if (f.isFile()) {
  351.                 id = f.getName().split("_")[0];
  352.                 name = f.getName().substring(f.getName().indexOf("_") + 1,
  353.                         f.getName().length() - 4);
  354.                 faceList.add(new FacePojo(id, name, Environment
  355.                         .getExternalStorageDirectory()
  356.                         + "/FaceData/"
  357.                         + f.getName()));
  358.             }
  359.         }
  360.     }
  362.     public double CmpPic(String path) {
  363.         int l_bins = 20;
  364.         int hist_size[] = { l_bins };
  366.         float v_ranges[] = { 0, 100 };
  367.         float ranges[][] = { v_ranges };
  369.         IplImage Image1 = cvLoadImage(Environment.getExternalStorageDirectory()
  370.                 + "/FaceDetect/faceDone.jpg", CV_LOAD_IMAGE_GRAYSCALE);
  371.         IplImage Image2 = cvLoadImage(path, CV_LOAD_IMAGE_GRAYSCALE);
  373.         IplImage imageArr1[] = { Image1 };
  374.         IplImage imageArr2[] = { Image2 };
  376.         CvHistogram Histogram1 = CvHistogram.create(1, hist_size,
  377.                 CV_HIST_ARRAY, ranges, 1);
  378.         CvHistogram Histogram2 = CvHistogram.create(1, hist_size,
  379.                 CV_HIST_ARRAY, ranges, 1);
  381.         cvCalcHist(imageArr1, Histogram1, 0, null);
  382.         cvCalcHist(imageArr2, Histogram2, 0, null);
  384.         cvNormalizeHist(Histogram1, 100.0);
  385.         cvNormalizeHist(Histogram2, 100.0);
  387.         return cvCompareHist(Histogram1, Histogram2, CV_COMP_CORREL);
  388.     }
  390.     public void writePhoto(Bitmap bmp) {
  391.         File file = new File("/sdcard/FaceDetect/faceDone.jpg");
  392.         try {
  393.             Bitmap bm = Bitmap.createBitmap(bmp, 0, 0, 100, 100);
  394.             BufferedOutputStream bos = new BufferedOutputStream(
  395.                     new FileOutputStream(file));
  396.             if (bm.compress(Bitmap.CompressFormat.JPEG, 100, bos)) {
  397.                 bos.flush();
  398.                 bos.close();
  399.             }
  400.         } catch (Exception e) {
  401.             e.printStackTrace();
  402.         }
  403.     }
  405.     public void timeDown() {
  406.         LayoutInflater inflater = getLayoutInflater();
  407.         View layout = inflater.inflate(R.layout.custom,
  408.                 (ViewGroup) findViewById(R.id.llToast));
  409.         ImageView image = (ImageView) layout.findViewById(R.id.tvImageToast);
  410.         image.setImageResource(iconArr[t--]);
  411.         toast = new Toast(getApplicationContext());
  412.         toast.setDuration(Toast.LENGTH_SHORT);
  413.         toast.setView(layout);
  414.         toast.show();
  415.     }
  417.     public int camera() {
  418.         Camera.CameraInfo cameraInfo = new Camera.CameraInfo();
  419.         cameraCount = Camera.getNumberOfCameras(); // get cameras number
  421.         for (int camIdx = 0; camIdx < cameraCount; camIdx++) {
  422.             Camera.getCameraInfo(camIdx, cameraInfo);
  423.             if (cameraInfo.facing == Camera.CameraInfo.CAMERA_FACING_FRONT) {
  424.                 try {
  425.                     return camIdx;
  426.                 } catch (RuntimeException e) {
  427.                     e.printStackTrace();
  428.                 }
  429.             }
  430.         }
  431.         return 1;
  432.     }
  433. }

发表评论

表情：
评论列表 （有 0 条评论，949人围观）

还没有评论，来说两句吧...

相关阅读

    相关 人脸识别

    计划 实现了一个基于 PCA 的人脸识别 方法 ，我 称之为 “ 特征点方法 ”， 所有的功能简单而且实用 。 下面，我使用一个简单的MATLAB脚本 说明 它的用法

    ╰半夏微凉°╰半夏微凉°/ 0 赞/ 527 阅读

    相关 人脸识别

    人脸检测 [长文干货！走近人脸检测：从 VJ 到深度学习（上）][VJ] [长文干货！走近人脸检测：从VJ到深度学习（下）][VJ 1]

    朱雀朱雀/ 0 赞/ 472 阅读

    相关 人脸识别系统_人脸注册

        基于上次的人脸检测后，一直纠结人脸注册，照片存放方式，我想到了两种方式，1.数据库存照片存放的路径，2.数据库存放照片的二进制码。但是针对我的毕业设计我想要是存路径的话

    ￡神魔★判官ぃ￡神魔★判官ぃ/ 0 赞/ 482 阅读

    相关 人脸识别系统_人脸检测

    项目：基于人脸识别的无卡ATM机模拟系统 主要实现内容： 包括实现AMT机模拟人脸识别和密码输入、PC端模拟实现储户数据库服务器系统。 1. ATM模拟端实现采用手

    亦凉亦凉/ 0 赞/ 486 阅读