mongodb备份和恢复实操

阳光穿透心脏的1/2处 2022-07-16 13:41 179阅读 0赞

可以全部备份，备份单个库，备份单个表。

一、执行命令如下（我这里是备份单个库）

mongodb备份恢复版本不通有一些差异，最好看实际的帮助文档

备份（mongoexport和mongodump）

./mongoexport -d userPortrait -c Portraits -o /bak.json（成功）  
./mongodump -h 10.101.200.120 --port 27017 -d userPortrait -o /tmp/wolf.bak (成功)  
  
如果设置验证需要加用户名密码如下  
mongodump -d myTest -u superuser -p 123456  --authenticationDatabase admin -o /backup/mongodb/myTest\_bak\_201507021653.bak    
  
  
恢复（mongoimport和mongorestore ）  
mongoimport --host=127.0.0.1 --port=27101 -drop -d userPortrait -c Portraits --file /tmp/bak.json（成功）  
mongoimport -h 127.0.0.1:27101 -drop -d HRM -c Portraits --file /tmp/bak.json  
mongoimport -h 127.0.0.1:27101 -drop -d HRM --file /tmp/bak.json  
  
  
mongorestore  --host 10.249.100.249:27101 -drop -d userPortrait  /tmp/userPortrait（成功）  
mongorestore  --host 10.249.100.249:27101 -drop -d HRM  /tmp/userPortrait（成功）(修改导出时的库名)

==========================================================================================

二、实际操作如下

源  
\[root@tshopapicenter bin\]\# ./mongo -port 27017  
MongoDB shell version: 3.2.1  
connecting to: 127.0.0.1:27017/test  
Server has startup warnings:   
2016-10-14T08:48:22.407+0800 I CONTROL  \[initandlisten\] \*\* WARNING: You are running this process as the root user, which is not recommended.  
2016-10-14T08:48:22.407+0800 I CONTROL  \[initandlisten\]   
2016-10-14T08:48:22.408+0800 I CONTROL  \[initandlisten\]   
2016-10-14T08:48:22.408+0800 I CONTROL  \[initandlisten\] \*\* WARNING: /sys/kernel/mm/transparent\_hugepage/enabled is 'always'.  
2016-10-14T08:48:22.408+0800 I CONTROL  \[initandlisten\] \*\*        We suggest setting it to 'never'  
2016-10-14T08:48:22.408+0800 I CONTROL  \[initandlisten\]   
2016-10-14T08:48:22.409+0800 I CONTROL  \[initandlisten\] \*\* WARNING: /sys/kernel/mm/transparent\_hugepage/defrag is 'always'.  
2016-10-14T08:48:22.409+0800 I CONTROL  \[initandlisten\] \*\*        We suggest setting it to 'never'  
2016-10-14T08:48:22.409+0800 I CONTROL  \[initandlisten\]   
> show dbs  
BID           0.108GB  
BID\_DB        0.000GB  
DEVLAND       0.054GB  
LAND          0.000GB  
TBID          0.049GB  
TLAND         0.003GB  
devplat       0.101GB  
handbtest     0.000GB  
local         0.000GB  
mongoDBFile   0.001GB  
userPortrait  0.811GB  
wlb           0.000GB  
\[root@tshopapicenter mongodb\]\# cd bin  
\[root@tshopapicenter bin\]\# ./mongodump -h 10.101.200.120 --port 27017 -d userPortrait -o /tmp/wolf.bak  
2016-11-19T12:00:00.712+0800    writing userPortrait.Portraits to   
2016-11-19T12:00:05.874+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#..........\]  userPortrait.Portraits  19705/32858  (60.0%)  
2016-11-19T12:00:06.712+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#.........\]  userPortrait.Portraits  21737/32858  (66.2%)  
2016-11-19T12:00:09.712+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#........\]  userPortrait.Portraits  23112/32858  (70.3%)  
2016-11-19T12:00:12.712+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#.......\]  userPortrait.Portraits  24048/32858  (73.2%)  
2016-11-19T12:00:15.712+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#......\]  userPortrait.Portraits  25047/32858  (76.2%)  
2016-11-19T12:00:18.712+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#......\]  userPortrait.Portraits  26006/32858  (79.1%)  
2016-11-19T12:00:21.712+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#.....\]  userPortrait.Portraits  27314/32858  (83.1%)  
2016-11-19T12:00:24.712+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#....\]  userPortrait.Portraits  28094/32858  (85.5%)  
2016-11-19T12:00:27.712+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#...\]  userPortrait.Portraits  29973/32858  (91.2%)  
2016-11-19T12:00:31.451+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#..\]  userPortrait.Portraits  31301/32858  (95.3%)  
2016-11-19T12:00:33.712+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#.\]  userPortrait.Portraits  32707/32858  (99.5%)  
2016-11-19T12:00:33.746+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\]  userPortrait.Portraits  32858/32858  (100.0%)  
2016-11-19T12:00:33.746+0800    done dumping userPortrait.Portraits (32858 documents)  
压缩  
scp  
\[root@localhost tmp\]\# scp 10.101.200.120:/tmp/userPortrait.tar .  
导入目标库  
\[root@localhost tmp\]\# mongorestore  --host 10.249.100.249:27101 -drop -d userPortrait  /tmp/userPortrait  
2016-11-19T12:49:37.259+0800    building a list of collections to restore from /tmp/userPortrait dir  
2016-11-19T12:49:37.259+0800    reading metadata for userPortrait.Portraits from /tmp/userPortrait/Portraits.metadata.json  
2016-11-19T12:49:37.368+0800    restoring userPortrait.Portraits from /tmp/userPortrait/Portraits.bson  
2016-11-19T12:49:40.259+0800    \[\#\#\#\#\#...................\]  userPortrait.Portraits  170.8 MB/765.2 MB  (22.3%)  
2016-11-19T12:49:43.259+0800    \[\#\#\#\#\#\#\#\#\#...............\]  userPortrait.Portraits  293.4 MB/765.2 MB  (38.3%)  
2016-11-19T12:49:46.259+0800    \[\#\#\#\#\#\#\#\#\#\#\#.............\]  userPortrait.Portraits  372.3 MB/765.2 MB  (48.7%)  
2016-11-19T12:49:49.259+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#...........\]  userPortrait.Portraits  427.6 MB/765.2 MB  (55.9%)  
2016-11-19T12:49:52.259+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#.......\]  userPortrait.Portraits  562.7 MB/765.2 MB  (73.5%)  
2016-11-19T12:49:55.259+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#..\]  userPortrait.Portraits  714.6 MB/765.2 MB  (93.4%)  
2016-11-19T12:49:56.576+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\]  userPortrait.Portraits  765.2 MB/765.2 MB  (100.0%)  
2016-11-19T12:49:56.576+0800    restoring indexes for collection userPortrait.Portraits from metadata  
2016-11-19T12:49:56.606+0800    finished restoring userPortrait.Portraits (32858 documents)  
2016-11-19T12:49:56.606+0800    done  
  
  
root@localhost db\]\# mongo -port 27101  
MongoDB shell version: 3.2.6  
connecting to: 127.0.0.1:27101/test  
Server has startup warnings:   
2016-11-19T10:34:43.745+0800 I CONTROL  \[initandlisten\] \*\* WARNING: You are running this process as the root user, which is not recommended.  
2016-11-19T10:34:43.746+0800 I CONTROL  \[initandlisten\]   
2016-11-19T10:34:43.746+0800 I CONTROL  \[initandlisten\]   
2016-11-19T10:34:43.746+0800 I CONTROL  \[initandlisten\] \*\* WARNING: /sys/kernel/mm/transparent\_hugepage/enabled is 'always'.  
2016-11-19T10:34:43.746+0800 I CONTROL  \[initandlisten\] \*\*        We suggest setting it to 'never'  
2016-11-19T10:34:43.746+0800 I CONTROL  \[initandlisten\]   
2016-11-19T10:34:43.746+0800 I CONTROL  \[initandlisten\] \*\* WARNING: /sys/kernel/mm/transparent\_hugepage/defrag is 'always'.  
2016-11-19T10:34:43.746+0800 I CONTROL  \[initandlisten\] \*\*        We suggest setting it to 'never'  
2016-11-19T10:34:43.746+0800 I CONTROL  \[initandlisten\]   
> show dbs  
HRM    0.000GB  
local  0.000GB  
> show dbs  
HRM           0.000GB  
local         0.000GB  
userPortrait  0.811GB  
  
  
导入时修改库名  
\[root@localhost tmp\]\# mongorestore  --host 10.249.100.249:27101 -drop -d HRM  /tmp/userPortrait  
2016-11-19T13:57:07.943+0800    building a list of collections to restore from /tmp/userPortrait dir  
2016-11-19T13:57:07.990+0800    reading metadata for HRM.Portraits from /tmp/userPortrait/Portraits.metadata.json  
2016-11-19T13:57:07.990+0800    restoring HRM.Portraits from /tmp/userPortrait/Portraits.bson  
2016-11-19T13:57:10.944+0800    \[\#\#\#.....................\]  HRM.Portraits  96.9 MB/765.2 MB  (12.7%)  
2016-11-19T13:57:13.944+0800    \[\#\#\#\#\#...................\]  HRM.Portraits  183.3 MB/765.2 MB  (23.9%)  
2016-11-19T13:57:16.944+0800    \[\#\#\#\#\#\#\#.................\]  HRM.Portraits  223.8 MB/765.2 MB  (29.2%)  
2016-11-19T13:57:19.944+0800    \[\#\#\#\#\#\#\#\#................\]  HRM.Portraits  261.8 MB/765.2 MB  (34.2%)  
2016-11-19T13:57:22.944+0800    \[\#\#\#\#\#\#\#\#\#\#..............\]  HRM.Portraits  319.7 MB/765.2 MB  (41.8%)  
2016-11-19T13:57:25.944+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#...........\]  HRM.Portraits  416.2 MB/765.2 MB  (54.4%)  
2016-11-19T13:57:28.944+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#...........\]  HRM.Portraits  419.0 MB/765.2 MB  (54.7%)  
2016-11-19T13:57:31.944+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#..........\]  HRM.Portraits  448.2 MB/765.2 MB  (58.6%)  
2016-11-19T13:57:34.944+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#..........\]  HRM.Portraits  463.6 MB/765.2 MB  (60.6%)  
2016-11-19T13:57:37.944+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#........\]  HRM.Portraits  513.2 MB/765.2 MB  (67.1%)  
2016-11-19T13:57:40.944+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#......\]  HRM.Portraits  592.3 MB/765.2 MB  (77.4%)  
2016-11-19T13:57:43.944+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#....\]  HRM.Portraits  666.9 MB/765.2 MB  (87.1%)  
2016-11-19T13:57:46.944+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#..\]  HRM.Portraits  702.2 MB/765.2 MB  (91.8%)  
2016-11-19T13:57:49.944+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#..\]  HRM.Portraits  720.1 MB/765.2 MB  (94.1%)  
2016-11-19T13:57:52.944+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#..\]  HRM.Portraits  727.3 MB/765.2 MB  (95.0%)  
2016-11-19T13:57:54.669+0800    \[\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\]  HRM.Portraits  765.2 MB/765.2 MB  (100.0%)  
2016-11-19T13:57:54.669+0800    restoring indexes for collection HRM.Portraits from metadata  
2016-11-19T13:57:54.691+0800    finished restoring HRM.Portraits (32858 documents)  
2016-11-19T13:57:54.691+0800    done  
\[root@localhost tmp\]\# df -h  
Filesystem            Size  Used Avail Use% Mounted on  
/dev/mapper/VolGroup-lv\_root  
                       26G   16G  8.9G  65% /  
tmpfs                 1.9G     0  1.9G   0% /dev/shm  
/dev/sda1             477M   52M  400M  12% /boot  
/dev/mapper/datavg-lv\_data  
                       20G  2.9G   16G  16% /data

=================================================================================================================================

三、查看帮助

\[root@localhost tmp\]\# mongoexport --help  
Usage:  
  mongoexport <options>  
  
  
Export data from MongoDB in CSV or JSON format.  
  
  
See http://docs.mongodb.org/manual/reference/program/mongoexport/ for more information.  
  
  
general options:  
      --help                                      print usage  
      --version                                   print the tool version and exit  
  
  
verbosity options:  
  -v, --verbose=<level>                           more detailed log output (include multiple times for more verbosity, e.g. -vvvvv,  
                                                  or specify a numeric value, e.g. --verbose=N)  
      --quiet                                     hide all log output  
  
  
connection options:  
  -h, --host=<hostname>                           mongodb host to connect to (setname/host1,host2 for replica sets)  
      --port=<port>                               server port (can also use --host hostname:port)  
  
  
authentication options:  
  -u, --username=<username>                       username for authentication  
  -p, --password=<password>                       password for authentication  
      --authenticationDatabase=<database-name>    database that holds the user's credentials  
      --authenticationMechanism=<mechanism>       authentication mechanism to use  
  
  
namespace options:  
  -d, --db=<database-name>                        database to use  
  -c, --collection=<collection-name>              collection to use  
  
  
output options:  
  -f, --fields=<field>\[,<field>\]\*                 comma separated list of field names (required for exporting CSV) e.g. -f  
                                                  "name,age"  
      --fieldFile=<filename>                      file with field names - 1 per line  
      --type=<type>                               the output format, either json or csv (defaults to 'json')  
  -o, --out=<filename>                            output file; if not specified, stdout is used  
      --jsonArray                                 output to a JSON array rather than one object per line  
      --pretty                                    output JSON formatted to be human-readable  
  
  
querying options:  
  -q, --query=<json>                              query filter, as a JSON string, e.g., '\{x:\{$gt:1\}\}'  
      --queryFile=<filename>                      path to a file containing a query filter (JSON)  
  -k, --slaveOk                                   allow secondary reads if available (default true)  
      --readPreference=<string>|<json>            specify either a preference name or a preference json object  
      --forceTableScan                            force a table scan (do not use $snapshot)  
      --skip=<count>                              number of documents to skip  
      --limit=<count>                             limit the number of documents to export

--sort=<json>                               sort order, as a JSON string, e.g. '\{x:1\}'

\[root@localhost tmp\]\# mongoimport --help  
Usage:  
  mongoimport <options> <file>  
  
  
Import CSV, TSV or JSON data into MongoDB. If no file is provided, mongoimport reads from stdin.  
  
  
See http://docs.mongodb.org/manual/reference/program/mongoimport/ for more information.  
  
  
general options:  
      --help                                      print usage  
      --version                                   print the tool version and exit  
  
  
verbosity options:  
  -v, --verbose=<level>                           more detailed log output (include multiple times for more verbosity, e.g. -vvvvv,  
                                                  or specify a numeric value, e.g. --verbose=N)  
      --quiet                                     hide all log output  
  
  
connection options:  
  -h, --host=<hostname>                           mongodb host to connect to (setname/host1,host2 for replica sets)  
      --port=<port>                               server port (can also use --host hostname:port)  
  
  
authentication options:  
  -u, --username=<username>                       username for authentication  
  -p, --password=<password>                       password for authentication  
      --authenticationDatabase=<database-name>    database that holds the user's credentials  
      --authenticationMechanism=<mechanism>       authentication mechanism to use  
  
  
namespace options:  
  -d, --db=<database-name>                        database to use  
  -c, --collection=<collection-name>              collection to use  
  
  
input options:  
  -f, --fields=<field>\[,<field>\]\*                 comma separated list of field names, e.g. -f name,age  
      --fieldFile=<filename>                      file with field names - 1 per line  
      --file=<filename>                           file to import from; if not specified, stdin is used  
      --headerline                                use first line in input source as the field list (CSV and TSV only)  
      --jsonArray                                 treat input source as a JSON array  
      --type=<type>                               input format to import: json, csv, or tsv (defaults to 'json')  
  
  
ingest options:  
      --drop                                      drop collection before inserting documents  
      --ignoreBlanks                              ignore fields with empty values in CSV and TSV  
      --maintainInsertionOrder                    insert documents in the order of their appearance in the input source  
  -j, --numInsertionWorkers=<number>              number of insert operations to run concurrently (defaults to 1)  
      --stopOnError                               stop importing at first insert/upsert error  
      --upsert                                    insert or update objects that already exist  
      --upsertFields=<field>\[,<field>\]\*           comma-separated fields for the query part of the upsert  
      --writeConcern=<write-concern-specifier>    write concern options e.g. --writeConcern majority, --writeConcern '\{w: 3,  
                                                  wtimeout: 500, fsync: true, j: true\}' (defaults to 'majority')  
      --bypassDocumentValidation                  bypass document validation

\[root@localhost tmp\]\# mongodump --help  
Usage:  
  mongodump <options>  
  
  
Export the content of a running server into .bson files.  
  
  
Specify a database with -d and a collection with -c to only dump that database or collection.  
  
  
See http://docs.mongodb.org/manual/reference/program/mongodump/ for more information.  
  
  
general options:  
      --help                                                print usage  
      --version                                             print the tool version and exit  
  
  
verbosity options:  
  -v, --verbose=<level>                                     more detailed log output (include multiple times for more verbosity,  
                                                            e.g. -vvvvv, or specify a numeric value, e.g. --verbose=N)  
      --quiet                                               hide all log output  
  
  
connection options:  
  -h, --host=<hostname>                                     mongodb host to connect to (setname/host1,host2 for replica sets)  
      --port=<port>                                         server port (can also use --host hostname:port)  
  
  
authentication options:  
  -u, --username=<username>                                 username for authentication  
  -p, --password=<password>                                 password for authentication  
      --authenticationDatabase=<database-name>              database that holds the user's credentials  
      --authenticationMechanism=<mechanism>                 authentication mechanism to use  
  
  
namespace options:  
  -d, --db=<database-name>                                  database to use  
  -c, --collection=<collection-name>                        collection to use  
  
  
query options:  
  -q, --query=                                              query filter, as a JSON string, e.g., '\{x:\{$gt:1\}\}'  
      --queryFile=                                          path to a file containing a query filter (JSON)  
      --readPreference=<string>|<json>                      specify either a preference name or a preference json object  
      --forceTableScan                                      force a table scan  
  
  
output options:  
  -o, --out=<directory-path>                                output directory, or '-' for stdout (defaults to 'dump')  
      --gzip                                                compress archive our collection output with Gzip  
      --repair                                              try to recover documents from damaged data files (not supported by all  
                                                            storage engines)  
      --oplog                                               use oplog for taking a point-in-time snapshot  
      --archive=<file-path>                                 dump as an archive to the specified path. If flag is specified without  
                                                            a value, archive is written to stdout  
      --dumpDbUsersAndRoles                                 dump user and role definitions for the specified database  
      --excludeCollection=<collection-name>                 collection to exclude from the dump (may be specified multiple times to  
                                                            exclude additional collections)  
      --excludeCollectionsWithPrefix=<collection-prefix>    exclude all collections from the dump that have the given prefix (may  
                                                            be specified multiple times to exclude additional prefixes)  
  -j, --numParallelCollections=                             number of collections to dump in parallel (4 by default)

\[root@localhost tmp\]\# mongorestore --help  
Usage:  
  mongorestore <options> <directory or file to restore>  
  
  
Restore backups generated with mongodump to a running server.  
  
  
Specify a database with -d to restore a single database from the target directory,  
or use -d and -c to restore a single collection from a single .bson file.  
  
  
See http://docs.mongodb.org/manual/reference/program/mongorestore/ for more information.  
  
  
general options:  
      --help                                      print usage  
      --version                                   print the tool version and exit  
  
  
verbosity options:  
  -v, --verbose=<level>                           more detailed log output (include multiple times for more verbosity, e.g. -vvvvv,  
                                                  or specify a numeric value, e.g. --verbose=N)  
      --quiet                                     hide all log output  
  
  
connection options:  
  -h, --host=<hostname>                           mongodb host to connect to (setname/host1,host2 for replica sets)  
      --port=<port>                               server port (can also use --host hostname:port)  
  
  
authentication options:  
  -u, --username=<username>                       username for authentication  
  -p, --password=<password>                       password for authentication  
      --authenticationDatabase=<database-name>    database that holds the user's credentials  
      --authenticationMechanism=<mechanism>       authentication mechanism to use  
  
  
namespace options:  
  -d, --db=<database-name>                        database to use  
  -c, --collection=<collection-name>              collection to use  
  
  
input options:  
      --objcheck                                  validate all objects before inserting  
      --oplogReplay                               replay oplog for point-in-time restore  
      --oplogLimit=<seconds>\[:ordinal\]            only include oplog entries before the provided Timestamp  
      --archive=<filename>                        restore dump from the specified archive file.  If flag is specified without a  
                                                  value, archive is read from stdin  
      --restoreDbUsersAndRoles                    restore user and role definitions for the given database  
      --dir=<directory-name>                      input directory, use '-' for stdin  
      --gzip                                      decompress gzipped input  
  
  
restore options:  
      --drop                                      drop each collection before import  
      --writeConcern=<write-concern>              write concern options e.g. --writeConcern majority, --writeConcern '\{w: 3,  
                                                  wtimeout: 500, fsync: true, j: true\}' (defaults to 'majority')  
      --noIndexRestore                            don't restore indexes  
      --noOptionsRestore                          don't restore collection options  
      --keepIndexVersion                          don't update index version  
      --maintainInsertionOrder                    preserve order of documents during restoration  
  -j, --numParallelCollections=                   number of collections to restore in parallel (4 by default)  
      --numInsertionWorkersPerCollection=         number of insert operations to run concurrently per collection (1 by default)  
      --stopOnError                               stop restoring if an error is encountered on insert (off by default)  
      --bypassDocumentValidation                  bypass document validation