Warning: World-writable config file '/mnt/MOUNTED_DIR/db_back/server.name.com/full/2014-09-14_03-30-03/backup-my.cnf' is ignored
xtrabackup version 2.2.3 based on MySQL server 5.6.17 Linux (x86_64) (revision id: )
incremental backup from 14111243331989 is enabled.
xtrabackup: cd to /mnt/MOUNTED_DIR/db_back/server.name.com/full/2014-09-14_03-30-03
xtrabackup: This target seems to be already prepared.
xtrabackup: xtrabackup_logfile detected: size=1891237888, start_lsn=(14156284223024)
xtrabackup: using the following InnoDB configuration for recovery:
xtrabackup: innodb_data_home_dir = ./
xtrabackup: innodb_data_file_path = ibdata1:10M:autoextend
xtrabackup: innodb_log_group_home_dir = /mnt/MOUNTED_DIR/db_back/server.name.com/incremental/2014-09-16_03-30-03
xtrabackup: innodb_log_files_in_group = 1
xtrabackup: innodb_log_file_size = 1891237888
xtrabackup: page size for /mnt/MOUNTED_DIR/db_back/server.name.com/incremental/2014-09-16_03-30-03/ibdata1.delta is 16384 bytes
InnoDB: Failed to set O_DIRECT on file /mnt/MOUNTED_DIR/db_back/server.name.com/incremental/2014-09-16_03-30-03/ibdata1.delta: OPEN: Invalid argument, continuing anyway. O_DIRECT is known to result in 'Invalid argument' on Linux on tmpfs, see MySQL Bug#26662.
Applying /mnt/MOUNTED_DIR/db_back/server.name.com/incremental/2014-09-16_03-30-03/ibdata1.delta to ./ibdata1...
xtrabackup: page size for /mnt/MOUNTED_DIR/db_back/server.name.com/incremental/2014-09-16_03-30-03/currclick_mdl/mdl_assign.ibd.delta is 16384 bytes
Applying /mnt/MOUNTED_DIR/db_back/server.name.com/incremental/2014-09-16_03-30-03/currclick_mdl/mdl_assign.ibd.delta to ./currclick_mdl/mdl_assign.ibd...
xtrabackup: page size for /mnt/MOUNTED_DIR/db_back/server.name.com/incremental/2014-09-16_03-30-03/currclick_mdl/mdl_assignfeedback_comments.ibd.delta is 16384 bytes
Applying /mnt/MOUNTED_DIR/db_back/server.name.com/incremental/2014-09-16_03-30-03/currclick_mdl/mdl_assignfeedback_comments.ibd.delta to ./currclick_mdl/mdl_assignfeedback_comments.ibd...
xtrabackup: page size for /mnt/MOUNTED_DIR/db_back/server.name.com/incremental/2014-09-16_03-30-03/currclick_mdl/mdl_assignfeedback_editpdf_annot.ibd.delta is 16384 bytes
Applying /mnt/MOUNTED_DIR/db_back/server.name.com/incremental/2014-09-16_03-30-03/currclick_mdl/mdl_assignfeedback_editpdf_annot.ibd.delta to ./currclick_mdl/mdl_assignfeedback_editpdf_annot.ibd...
xtrabackup: page size for /mnt/MOUNTED_DIR/db_back/server.name.com/incremental/2014-09-16_03-30-03/currclick_mdl/mdl_assignfeedback_editpdf_cmnt.ibd.delta is 16384 bytes
Applying /mnt/MOUNTED_DIR/db_back/server.name.com/incremental/2014-09-16_03-30-03/currclick_mdl/mdl_assignfeedback_editpdf_cmnt.ibd.delta to ./currclick_mdl/mdl_assignfeedback_editpdf_cmnt.ibd...
xtrabackup: page size for /mnt/MOUNTED_DIR/db_back/server.name.com/incremental/2014-09-16_03-30-03/currclick_mdl/mdl_assignfeedback_editpdf_quick.ibd.delta is 16384 bytes
..........
..........
..........
..........
InnoDB: Doing recovery: scanned up to log sequence number 14157965325011 (100%)
InnoDB: Starting an apply batch of log records to the database...
InnoDB: Progress in percent: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99
InnoDB: Apply batch completed
InnoDB: In a MySQL replication slave the last master binlog file
InnoDB: position 0 329970412, file name data3-bin.001806
InnoDB: Last MySQL binlog file position 0 1066483592, file name data1-bin.003053
InnoDB: 128 rollback segment(s) are active.
InnoDB: Waiting for purge to start
InnoDB: 5.6.17 started; log sequence number 14157965325011
[notice (again)]
If you use binary log and don't use any hack of group commit,
the binary log position seems to be:
InnoDB: Last MySQL binlog file position 0 1066483592, file name data1-bin.003053
xtrabackup: starting shutdown with innodb_fast_shutdown = 1
InnoDB: FTS optimize thread exiting.
InnoDB: Starting shutdown...
2014-09-16 07:25:32 4ab76940 InnoDB: Assertion failure in thread 1253534016 in file buf0flu.cc line 2503
InnoDB: Failing assertion: UT_LIST_GET_LEN(buf_pool->flush_list) == 0
InnoDB: We intentionally generate a memory trap.
InnoDB: Submit a detailed bug report to http://bugs.mysql.com.
InnoDB: If you get repeated assertion failures or crashes, even
InnoDB: immediately after the mysqld startup, there may be
InnoDB: corruption in the InnoDB tablespace. Please refer to
InnoDB: http://dev.mysql.com/doc/refman/5.6/en/forcing-innodb-recovery.html
InnoDB: about forcing recovery.
innobackupex: Error:
innobackupex: ibbackup failed at /usr/bin/innobackupex line 2610. 541514,1 Bot
Here is the recent log:
140916 05:43:38 innobackupex: Starting ibbackup with command: xtrabackup --defaults- file="/ mnt/MOUNTED_ DIR/db_ back/server. name.com/ full/2014- 09-14_03- 30-03/backup- my.cnf" --defaults- group=" mysqld" --prepare --target- dir=/mnt/ MOUNTED_ DIR/db_ back/server. name.com/ full/2014- 09-14_03- 30-03 --incremental- dir=/mnt/ MOUNTED_ DIR/db_ back/server. name.com/ incremental/ 2014-09- 16_03-30- 03 --tmpdir=/tmp
Warning: World-writable config file '/mnt/MOUNTED_ DIR/db_ back/server. name.com/ full/2014- 09-14_03- 30-03/backup- my.cnf' is ignored DIR/db_ back/server. name.com/ full/2014- 09-14_03- 30-03 (14156284223024 ) data_home_ dir = ./ data_file_ path = ibdata1: 10M:autoextend log_group_ home_dir = /mnt/MOUNTED_ DIR/db_ back/server. name.com/ incremental/ 2014-09- 16_03-30- 03 log_files_ in_group = 1 log_file_ size = 1891237888 DIR/db_ back/server. name.com/ incremental/ 2014-09- 16_03-30- 03/ibdata1. delta is 16384 bytes DIR/db_ back/server. name.com/ incremental/ 2014-09- 16_03-30- 03/ibdata1. delta: OPEN: Invalid argument, continuing anyway. O_DIRECT is known to result in 'Invalid argument' on Linux on tmpfs, see MySQL Bug#26662. DIR/db_ back/server. name.com/ incremental/ 2014-09- 16_03-30- 03/ibdata1. delta to ./ibdata1... DIR/db_ back/server. name.com/ incremental/ 2014-09- 16_03-30- 03/currclick_ mdl/mdl_ assign. ibd.delta is 16384 bytes DIR/db_ back/server. name.com/ incremental/ 2014-09- 16_03-30- 03/currclick_ mdl/mdl_ assign. ibd.delta to ./currclick_ mdl/mdl_ assign. ibd... DIR/db_ back/server. name.com/ incremental/ 2014-09- 16_03-30- 03/currclick_ mdl/mdl_ assignfeedback_ comments. ibd.delta is 16384 bytes DIR/db_ back/server. name.com/ incremental/ 2014-09- 16_03-30- 03/currclick_ mdl/mdl_ assignfeedback_ comments. ibd.delta to ./currclick_ mdl/mdl_ assignfeedback_ comments. ibd... DIR/db_ back/server. name.com/ incremental/ 2014-09- 16_03-30- 03/currclick_ mdl/mdl_ assignfeedback_ editpdf_ annot.ibd. delta is 16384 bytes DIR/db_ back/server. name.com/ incremental/ 2014-09- 16_03-30- 03/currclick_ mdl/mdl_ assignfeedback_ editpdf_ annot.ibd. delta to ./currclick_ mdl/mdl_ assignfeedback_ editpdf_ annot.ibd. .. DIR/db_ back/server. name.com/ incremental/ 2014-09- 16_03-30- 03/currclick_ mdl/mdl_ assignfeedback_ editpdf_ cmnt.ibd. delta is 16384 bytes DIR/db_ back/server. name.com/ incremental/ 2014-09- 16_03-30- 03/currclick_ mdl/mdl_ assignfeedback_ editpdf_ cmnt.ibd. delta to ./currclick_ mdl/mdl_ assignfeedback_ editpdf_ cmnt.ibd. .. DIR/db_ back/server. name.com/ incremental/ 2014-09- 16_03-30- 03/currclick_ mdl/mdl_ assignfeedback_ editpdf_ quick.ibd. delta is 16384 bytes
xtrabackup version 2.2.3 based on MySQL server 5.6.17 Linux (x86_64) (revision id: )
incremental backup from 14111243331989 is enabled.
xtrabackup: cd to /mnt/MOUNTED_
xtrabackup: This target seems to be already prepared.
xtrabackup: xtrabackup_logfile detected: size=1891237888, start_lsn=
xtrabackup: using the following InnoDB configuration for recovery:
xtrabackup: innodb_
xtrabackup: innodb_
xtrabackup: innodb_
xtrabackup: innodb_
xtrabackup: innodb_
xtrabackup: page size for /mnt/MOUNTED_
InnoDB: Failed to set O_DIRECT on file /mnt/MOUNTED_
Applying /mnt/MOUNTED_
xtrabackup: page size for /mnt/MOUNTED_
Applying /mnt/MOUNTED_
xtrabackup: page size for /mnt/MOUNTED_
Applying /mnt/MOUNTED_
xtrabackup: page size for /mnt/MOUNTED_
Applying /mnt/MOUNTED_
xtrabackup: page size for /mnt/MOUNTED_
Applying /mnt/MOUNTED_
xtrabackup: page size for /mnt/MOUNTED_
..........
..........
..........
..........
InnoDB: Doing recovery: scanned up to log sequence number 14157965325011 (100%)
InnoDB: Starting an apply batch of log records to the database...
InnoDB: Progress in percent: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99
InnoDB: Apply batch completed
InnoDB: In a MySQL replication slave the last master binlog file
InnoDB: position 0 329970412, file name data3-bin.001806
InnoDB: Last MySQL binlog file position 0 1066483592, file name data1-bin.003053
InnoDB: 128 rollback segment(s) are active.
InnoDB: Waiting for purge to start
InnoDB: 5.6.17 started; log sequence number 14157965325011
[notice (again)]
If you use binary log and don't use any hack of group commit,
the binary log position seems to be:
InnoDB: Last MySQL binlog file position 0 1066483592, file name data1-bin.003053
xtrabackup: starting shutdown with innodb_ fast_shutdown = 1 GET_LEN( buf_pool- >flush_ list) == 0 bugs.mysql. com. dev.mysql. com/doc/ refman/ 5.6/en/ forcing- innodb- recovery. html innobackupex line 2610.
541514, 1 Bot
InnoDB: FTS optimize thread exiting.
InnoDB: Starting shutdown...
2014-09-16 07:25:32 4ab76940 InnoDB: Assertion failure in thread 1253534016 in file buf0flu.cc line 2503
InnoDB: Failing assertion: UT_LIST_
InnoDB: We intentionally generate a memory trap.
InnoDB: Submit a detailed bug report to http://
InnoDB: If you get repeated assertion failures or crashes, even
InnoDB: immediately after the mysqld startup, there may be
InnoDB: corruption in the InnoDB tablespace. Please refer to
InnoDB: http://
InnoDB: about forcing recovery.
innobackupex: Error:
innobackupex: ibbackup failed at /usr/bin/