It seems, if we take backup with --compact option and if we don't use --rebuild -indexes option during the apply log then while access the secondary-index data got corrupted. Even server crashed. So it makes sense that "--compact option should automatically trigger the --rebuild-indexes "
after that copy the backup data to datadir and started mysql. MySQL started successfully but when tries to access secondary index and the table status got below error.
mysql> select * from nil_test where city = 'ahmedabad';
ERROR 2013 (HY000): Lost connection to MySQL server during query
mysql>
mysql> show create table nil_test \G
ERROR 2006 (HY000): MySQL server has gone away
No connection. Trying to reconnect...
Connection id: 1
Current database: test
InnoDB: Page directory corruption: infimum not pointed to
2014-07-01 14:40:04 7f536c6d8700 InnoDB: Page dump in ascii and hex (16384 bytes):
...
InnoDB: End of page dump
2014-07-01 14:40:04 7f536c6d8700 InnoDB: uncompressed page, stored checksum in field1 3735928559, calculated checksums for field1: crc32 177807968, innodb 3475755373, none 3735928559, stored checksum in field2 3735928559, calculated checksums for field2: crc32 177807968, innodb 1624572976, none 3735928559, page LSN 0 0, low 4 bytes of LSN at page end 0, page number (if stored to page already) 0, space id (if created with >= MySQL-4.1.1 and stored already) 0
InnoDB: Page may be a freshly allocated page
09:10:04 UTC - mysqld got signal 11 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
We will try our best to scrape up some info that will hopefully help
diagnose the problem, but since we have already crashed,
something is definitely wrong and this may fail.
Please help us make Percona Server better by reporting any
bugs at http://bugs.percona.com/
key_buffer_size=16777216
read_buffer_size=131072
max_used_connections=1
max_threads=153
thread_count=1
connection_count=1
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 77355 K bytes of memory
Hope that's ok; if not, decrease some variables in the equation.
Thread pointer: 0x7f539fc09e80
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 7f536c6d7e40 thread_stack 0x30000
/usr/sbin/mysqld(my_print_stacktrace+0x2c)[0x7f539d84262c]
/usr/sbin/mysqld(handle_fatal_signal+0x3cb)[0x7f539d58faab]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x10340)[0x7f539ba59340]
/usr/sbin/mysqld(+0x816684)[0x7f539d944684]
/usr/sbin/mysqld(+0x7f8329)[0x7f539d926329]
/usr/sbin/mysqld(+0x8a2d32)[0x7f539d9d0d32]
/usr/sbin/mysqld(+0x8a9228)[0x7f539d9d7228]
/usr/sbin/mysqld(+0x79b277)[0x7f539d8c9277]
/usr/sbin/mysqld(_ZN7handler27multi_range_read_info_constEjP15st_range_seq_ifPvjPjS3_P13Cost_estimate+0xcf)[0x7f539d4badaf]
/usr/sbin/mysqld(_ZN10DsMrr_impl16dsmrr_info_constEjP15st_range_seq_ifPvjPjS3_P13Cost_estimate+0x48)[0x7f539d4c4428]
/usr/sbin/mysqld(+0x619cc8)[0x7f539d747cc8]
/usr/sbin/mysqld(_ZN10SQL_SELECT17test_quick_selectEP3THD6BitmapILj64EEyybN8st_order10enum_orderE+0xb38)[0x7f539d754f18]
/usr/sbin/mysqld(+0x66aa40)[0x7f539d798a40]
/usr/sbin/mysqld(_ZN4JOIN8optimizeEv+0x7d9)[0x7f539d79b219]
/usr/sbin/mysqld(_Z12mysql_selectP3THDP10TABLE_LISTjR4ListI4ItemEPS4_P10SQL_I_ListI8st_orderESB_S7_yP13select_resultP18st_select_lex_unitP13st_select_lex+0x1f6)[0x7f539d644e16]
/usr/sbin/mysqld(_Z13handle_selectP3THDP13select_resultm+0x165)[0x7f539d645745]
/usr/sbin/mysqld(+0x351e5a)[0x7f539d47fe5a]
/usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x2086)[0x7f539d620e46]
/usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x618)[0x7f539d625fb8]
/usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0x236b)[0x7f539d6289ab]
/usr/sbin/mysqld(_Z24do_handle_one_connectionP3THD+0x22d)[0x7f539d5ed50d]
/usr/sbin/mysqld(handle_one_connection+0x40)[0x7f539d5ed590]
/usr/sbin/mysqld(pfs_spawn_thread+0x140)[0x7f539dab4c40]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x8182)[0x7f539ba51182]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d)[0x7f539b17430d]
Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (7f5354005210): is an invalid pointer
Connection ID (thread ID): 45
Status: NOT_KILLED
You may download the Percona Server operations manual by visiting http://www.percona.com/software/percona-server/. You may find information
in the manual which will help you identify the cause of the crash.
140701 14:40:04 mysqld_safe Number of processes running now: 0
140701 14:40:04 mysqld_safe mysqld restarted
It seems, if we take backup with --compact option and if we don't use --rebuild -indexes option during the apply log then while access the secondary-index data got corrupted. Even server crashed. So it makes sense that "--compact option should automatically trigger the --rebuild-indexes "
root@nilnandan- Dell-XPS: ~# innobackupex --compact --user=root --password=root /home/nilnandan /backup/
innobackupex --apply-log /home/nilnandan /backup/ 2014-07- 01_15-13- 41/
after that copy the backup data to datadir and started mysql. MySQL started successfully but when tries to access secondary index and the table status got below error.
mysql> select * from nil_test where city = 'ahmedabad';
ERROR 2013 (HY000): Lost connection to MySQL server during query
mysql>
mysql> show create table nil_test \G
ERROR 2006 (HY000): MySQL server has gone away
No connection. Trying to reconnect...
Connection id: 1
Current database: test
******* ******* ******* ****** 1. row ******* ******* ******* ******
Table: nil_test
Create Table: CREATE TABLE `nil_test` (
`id` int(11) DEFAULT NULL,
`name` varchar(10) DEFAULT NULL,
`city` varchar(10) DEFAULT NULL,
`phone` int(11) DEFAULT NULL,
KEY `city_phone` (`city`,`phone`)
) ENGINE=InnoDB DEFAULT CHARSET=latin1
1 row in set (0.01 sec)
This is the content of error log:
InnoDB: Page directory corruption: infimum not pointed to bugs.percona. com/
2014-07-01 14:40:04 7f536c6d8700 InnoDB: Page dump in ascii and hex (16384 bytes):
...
InnoDB: End of page dump
2014-07-01 14:40:04 7f536c6d8700 InnoDB: uncompressed page, stored checksum in field1 3735928559, calculated checksums for field1: crc32 177807968, innodb 3475755373, none 3735928559, stored checksum in field2 3735928559, calculated checksums for field2: crc32 177807968, innodb 1624572976, none 3735928559, page LSN 0 0, low 4 bytes of LSN at page end 0, page number (if stored to page already) 0, space id (if created with >= MySQL-4.1.1 and stored already) 0
InnoDB: Page may be a freshly allocated page
09:10:04 UTC - mysqld got signal 11 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
We will try our best to scrape up some info that will hopefully help
diagnose the problem, but since we have already crashed,
something is definitely wrong and this may fail.
Please help us make Percona Server better by reporting any
bugs at http://
key_buffer_ size=16777216 size=131072 connections= 1 size)*max_ threads = 77355 K bytes of memory
read_buffer_
max_used_
max_threads=153
thread_count=1
connection_count=1
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size + sort_buffer_
Hope that's ok; if not, decrease some variables in the equation.
Thread pointer: 0x7f539fc09e80 mysqld( my_print_ stacktrace+ 0x2c)[0x7f539d8 4262c] mysqld( handle_ fatal_signal+ 0x3cb)[ 0x7f539d58faab] 64-linux- gnu/libpthread. so.0(+0x10340) [0x7f539ba59340 ] mysqld( +0x816684) [0x7f539d944684 ] mysqld( +0x7f8329) [0x7f539d926329 ] mysqld( +0x8a2d32) [0x7f539d9d0d32 ] mysqld( +0x8a9228) [0x7f539d9d7228 ] mysqld( +0x79b277) [0x7f539d8c9277 ] mysqld( _ZN7handler27mu lti_range_ read_info_ constEjP15st_ range_seq_ ifPvjPjS3_ P13Cost_ estimate+ 0xcf)[0x7f539d4 badaf] mysqld( _ZN10DsMrr_ impl16dsmrr_ info_constEjP15 st_range_ seq_ifPvjPjS3_ P13Cost_ estimate+ 0x48)[0x7f539d4 c4428] mysqld( +0x619cc8) [0x7f539d747cc8 ] mysqld( _ZN10SQL_ SELECT17test_ quick_selectEP3 THD6BitmapILj64 EEyybN8st_ order10enum_ orderE+ 0xb38)[ 0x7f539d754f18] mysqld( +0x66aa40) [0x7f539d798a40 ] mysqld( _ZN4JOIN8optimi zeEv+0x7d9) [0x7f539d79b219 ] mysqld( _Z12mysql_ selectP3THDP10T ABLE_LISTjR4Lis tI4ItemEPS4_ P10SQL_ I_ListI8st_ orderESB_ S7_yP13select_ resultP18st_ select_ lex_unitP13st_ select_ lex+0x1f6) [0x7f539d644e16 ] mysqld( _Z13handle_ selectP3THDP13s elect_resultm+ 0x165)[ 0x7f539d645745] mysqld( +0x351e5a) [0x7f539d47fe5a ] mysqld( _Z21mysql_ execute_ commandP3THD+ 0x2086) [0x7f539d620e46 ] mysqld( _Z11mysql_ parseP3THDPcjP1 2Parser_ state+0x618) [0x7f539d625fb8 ] mysqld( _Z16dispatch_ command19enum_ server_ commandP3THDPcj +0x236b) [0x7f539d6289ab ] mysqld( _Z24do_ handle_ one_connectionP 3THD+0x22d) [0x7f539d5ed50d ] mysqld( handle_ one_connection+ 0x40)[0x7f539d5 ed590] mysqld( pfs_spawn_ thread+ 0x140)[ 0x7f539dab4c40] 64-linux- gnu/libpthread. so.0(+0x8182) [0x7f539ba51182 ] 64-linux- gnu/libc. so.6(clone+ 0x6d)[0x7f539b1 7430d]
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 7f536c6d7e40 thread_stack 0x30000
/usr/sbin/
/usr/sbin/
/lib/x86_
/usr/sbin/
/usr/sbin/
/usr/sbin/
/usr/sbin/
/usr/sbin/
/usr/sbin/
/usr/sbin/
/usr/sbin/
/usr/sbin/
/usr/sbin/
/usr/sbin/
/usr/sbin/
/usr/sbin/
/usr/sbin/
/usr/sbin/
/usr/sbin/
/usr/sbin/
/usr/sbin/
/usr/sbin/
/usr/sbin/
/lib/x86_
/lib/x86_
Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (7f5354005210): is an invalid pointer
Connection ID (thread ID): 45
Status: NOT_KILLED
You may download the Percona Server operations manual by visiting www.percona. com/software/ percona- server/. You may find information
http://
in the manual which will help you identify the cause of the crash.
140701 14:40:04 mysqld_safe Number of processes running now: 0
140701 14:40:04 mysqld_safe mysqld restarted