MariaDB got into 100%CPU usage and crashed after "a long semaphore wait"
| Affects | Status | Importance | Assigned to | Milestone | |
|---|---|---|---|---|---|
| MariaDB |
New
|
Undecided
|
Unassigned | ||
Bug Description
Relevant log info is below. Please note that it seems that threads 1336707392 and 1319799104 failed to release the lock correctly. We've observed the same issue twice in the last 3 months after upgrade to MariaDB 5.5.25, haven't seen it with MySQL 5.2.25 (and earlier)
InnoDB: Warning: a long semaphore wait:
--Thread 1282283840 has waited at dict0dict.c line 296 for 316.00 seconds the semaphore:
X-lock on RW-latch at 0x1995280 '&dict_
a writer (thread id 1319799104) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file dict0dict.c line 293
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1303419200 has waited at dict0dict.c line 296 for 438.00 seconds the semaphore:
X-lock on RW-latch at 0x1995280 '&dict_
a writer (thread id 1319799104) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file dict0dict.c line 293
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1283340608 has waited at dict0dict.c line 293 for 436.00 seconds the semaphore:
S-lock on RW-latch at 0x1995280 '&dict_
a writer (thread id 1319799104) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file dict0dict.c line 293
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1333008704 has waited at dict0dict.c line 293 for 438.00 seconds the semaphore:
S-lock on RW-latch at 0x1995280 '&dict_
a writer (thread id 1319799104) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file dict0dict.c line 293
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1326139712 has waited at btr0cur.c line 560 for 425.00 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1328781632 has waited at btr0cur.c line 560 for 425.00 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1322969408 has waited at btr0cur.c line 560 for 425.00 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1330895168 has waited at btr0cur.c line 553 for 425.00 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1311344960 has waited at btr0cur.c line 560 for 425.00 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1322441024 has waited at btr0cur.c line 553 for 425.00 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1308703040 has waited at btr0cur.c line 560 for 425.00 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1302362432 has waited at btr0cur.c line 560 for 425.00 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1294965056 has waited at btr0cur.c line 560 for 425.00 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1317157184 has waited at btr0cur.c line 553 for 425.00 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1293379904 has waited at btr0cur.c line 553 for 425.00 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1276471616 has waited at btr0cur.c line 560 for 425.00 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1331423552 has waited at btr0cur.c line 553 for 425.00 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1284925760 has waited at btr0cur.c line 553 for 425.00 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1292323136 has waited at btr0cur.c line 553 for 425.00 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1338820928 has waited at dict0dict.c line 293 for 433.00 seconds the semaphore:
S-lock on RW-latch at 0x1995280 '&dict_
a writer (thread id 1319799104) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file dict0dict.c line 293
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1320327488 has waited at btr0cur.c line 553 for 425.00 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1320855872 has waited at btr0cur.c line 553 for 425.00 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1272772928 has waited at btr0cur.c line 560 for 425.00 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1291266368 has waited at btr0cur.c line 553 for 425.00 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1295493440 has waited at btr0cur.c line 560 for 425.00 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1316100416 has waited at btr0cur.c line 553 for 425.00 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1302890816 has waited at btr0cur.c line 560 for 425.00 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1324554560 has waited at dict0dict.c line 293 for 432.00 seconds the semaphore:
S-lock on RW-latch at 0x1995280 '&dict_
a writer (thread id 1319799104) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file dict0dict.c line 293
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1325611328 has waited at btr0cur.c line 553 for 425.00 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1307117888 has waited at btr0cur.c line 560 for 424.00 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1289152832 has waited at btr0cur.c line 560 for 425.00 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1336707392) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
InnoDB: ###### Starts InnoDB Monitor for 30 secs to print diagnostic info:
InnoDB: Pending preads 0, pwrites 0
InnoDB: ###### Diagnostic info printed to the standard error stream
=======
120910 16:45:04 INNODB MONITOR OUTPUT
=======
Per second averages calculated from the last 242 seconds
-----------------
BACKGROUND THREAD
-----------------
srv_master_thread loops: 2122676 1_second, 2122451 sleeps, 210540 10_second, 56893 background, 55523 flush
srv_master_thread log flush and writes: 1161231
----------
SEMAPHORES
----------
OS WAIT ARRAY INFO: reservation count 1807911, signal count 3648211
--Thread 1282283840 has waited at dict0dict.c line 296 for 499.00 seconds the semaphore:
X-lock on RW-latch at 0x1995280 '&dict_
a writer (thread id 1319799104) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file dict0dict.c line 293
Last time write locked in file /home/buildbot/
--Thread 1303419200 has waited at dict0dict.c line 296 for 499.00 seconds the semaphore:
X-lock on RW-latch at 0x1995280 '&dict_
a writer (thread id 1319799104) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file dict0dict.c line 293
Last time write locked in file /home/buildbot/
--Thread 1283340608 has waited at dict0dict.c line 293 for 497.00 seconds the semaphore:
S-lock on RW-latch at 0x1995280 '&dict_
a writer (thread id 1319799104) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file dict0dict.c line 293
Last time write locked in file /home/buildbot/
--Thread 1333008704 has waited at dict0dict.c line 293 for 499.00 seconds the semaphore:
S-lock on RW-latch at 0x1995280 '&dict_
a writer (thread id 1319799104) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file dict0dict.c line 293
Last time write locked in file /home/buildbot/
--Thread 1294965056 has waited at btr0cur.c line 560 for 17.000 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1302890816 has waited at btr0cur.c line 560 for 17.000 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1276471616 has waited at btr0cur.c line 560 for 17.000 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1322441024 has waited at btr0cur.c line 553 for 17.000 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1302362432 has waited at btr0cur.c line 560 for 17.000 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1331423552 has waited at btr0cur.c line 553 for 17.000 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1284925760 has waited at btr0cur.c line 553 for 17.000 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1289681216 has waited at btr0cur.c line 560 for 17.000 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1281755456 has waited at btr0cur.c line 560 for 17.000 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1322969408 has waited at btr0cur.c line 560 for 17.000 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1317157184 has waited at btr0cur.c line 553 for 17.000 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1289152832 has waited at btr0cur.c line 560 for 17.000 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1326139712 has waited at btr0cur.c line 553 for 17.000 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1311344960 has waited at btr0cur.c line 560 for 16.000 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1308703040 has waited at btr0cur.c line 560 for 16.000 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1295493440 has waited at btr0cur.c line 560 for 16.000 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1338820928 has waited at dict0dict.c line 293 for 494.00 seconds the semaphore:
S-lock on RW-latch at 0x1995280 '&dict_
a writer (thread id 1319799104) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file dict0dict.c line 293
Last time write locked in file /home/buildbot/
--Thread 1328781632 has waited at btr0cur.c line 560 for 15.000 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1307117888 has waited at btr0cur.c line 560 for 15.000 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1320855872 has waited at btr0cur.c line 553 for 14.000 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1325611328 has waited at btr0cur.c line 553 for 14.000 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1293379904 has waited at btr0cur.c line 553 for 14.000 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1272772928 has waited at btr0cur.c line 560 for 14.000 seconds the semaphore:
S-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1291266368 has waited at btr0cur.c line 553 for 14.000 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1324554560 has waited at dict0dict.c line 293 for 493.00 seconds the semaphore:
S-lock on RW-latch at 0x1995280 '&dict_
a writer (thread id 1319799104) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file dict0dict.c line 293
Last time write locked in file /home/buildbot/
--Thread 1284397376 has waited at lock0lock.c line 5166 for 14.000 seconds the semaphore:
Mutex at 0x2aaadb31e1c0 '&kernel_mutex', lock var 1
waiters flag 1
--Thread 1316100416 has waited at btr0cur.c line 553 for 13.000 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1208248640 has waited at srv0srv.c line 2681 for 19.000 seconds the semaphore:
Mutex at 0x2aaadb31e1c0 '&kernel_mutex', lock var 1
waiters flag 1
--Thread 1301834048 has waited at trx0trx.c line 998 for 19.000 seconds the semaphore:
Mutex at 0x2aaadb31e1c0 '&kernel_mutex', lock var 1
waiters flag 1
--Thread 1292323136 has waited at btr0cur.c line 553 for 12.000 seconds the semaphore:
X-lock on RW-latch at 0x1d84e978 '&new_index->lock'
a writer (thread id 1320327488) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file btr0cur.c line 560
Last time write locked in file /home/buildbot/
--Thread 1337764160 has waited at trx0trx.c line 795 for 12.000 seconds the semaphore:
Mutex at 0x2aaadb31e1c0 '&kernel_mutex', lock var 1
waiters flag 1
--Thread 1300248896 has waited at lock0lock.c line 5166 for 5.0000 seconds the semaphore:
Mutex at 0x2aaadb31e1c0 '&kernel_mutex', lock var 1
waiters flag 1
--Thread 1309759808 has waited at srv0srv.c line 2302 for 5.0000 seconds the semaphore:
Mutex at 0x199f5a0 '&srv_innodb_
waiters flag 1
--Thread 1306061120 has waited at lock0lock.c line 5166 for 4.0000 seconds the semaphore:
Mutex at 0x2aaadb31e1c0 '&kernel_mutex', lock var 1
waiters flag 1
Mutex spin waits 365265782, rounds 417845859, OS waits 114229
RW-shared spins 2402624, rounds 47117854, OS waits 1315097
RW-excl spins 420795, rounds 15377363, OS waits 346204
Spin rounds per wait: 1.14 mutex, 19.61 RW-shared, 36.54 RW-excl
--------
FILE I/O
--------
I/O thread 0 state: waiting for completed aio requests (insert buffer thread)
I/O thread 1 state: waiting for completed aio requests (log thread)
I/O thread 2 state: waiting for completed aio requests (read thread)
I/O thread 3 state: waiting for completed aio requests (read thread)
I/O thread 4 state: waiting for completed aio requests (read thread)
I/O thread 5 state: waiting for completed aio requests (read thread)
I/O thread 6 state: waiting for completed aio requests (write thread)
I/O thread 7 state: waiting for completed aio requests (write thread)
I/O thread 8 state: waiting for completed aio requests (write thread)
I/O thread 9 state: waiting for completed aio requests (write thread)
Pending normal aio reads: 0 [0, 0, InnoDB: Warning: a long semaphore wait:
--Thread 1282283840 has waited at dict0dict.c line 296 for 572.00 seconds the semaphore:
X-lock on RW-latch at 0x1995280 '&dict_
a writer (thread id 1319799104) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file dict0dict.c line 293
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1303419200 has waited at dict0dict.c line 296 for 572.00 seconds the semaphore:
X-lock on RW-latch at 0x1995280 '&dict_
a writer (thread id 1319799104) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file dict0dict.c line 293
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1283340608 has waited at dict0dict.c line 293 for 570.00 seconds the semaphore:
S-lock on RW-latch at 0x1995280 '&dict_
a writer (thread id 1319799104) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file dict0dict.c line 293
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1333008704 has waited at dict0dict.c line 293 for 572.00 seconds the semaphore:
S-lock on RW-latch at 0x1995280 '&dict_
a writer (thread id 1319799104) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file dict0dict.c line 293
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1338820928 has waited at dict0dict.c line 293 for 567.00 seconds the semaphore:
S-lock on RW-latch at 0x1995280 '&dict_
a writer (thread id 1319799104) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file dict0dict.c line 293
Last time write locked in file /home/buildbot/
InnoDB: Warning: a long semaphore wait:
--Thread 1324554560 has waited at dict0dict.c line 293 for 566.00 seconds the semaphore:
S-lock on RW-latch at 0x1995280 '&dict_
a writer (thread id 1319799104) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file dict0dict.c line 293
Last time write locked in file /home/buildbot/
InnoDB: ###### Starts InnoDB Monitor for 30 secs to print diagnostic info:
InnoDB: Pending preads 0, pwrites 0
0, 0] , aio writes: 0 [InnoDB: ###### Diagnostic info printed to the standard error stream
0, 0, 0, 0] ,
ibuf aio reads: 0, log i/o's: 0, sync i/o's: 0
Pending flushes (fsync) log: 0; buffer pool: 0
36543764 OS file reads, 65997093 OS file writes, 42422761 OS fsyncs
0.09 reads/s, 16384 avg bytes/read, 0.17 writes/s, 0.07 fsyncs/s
-------
INSERT BUFFER AND ADAPTIVE HASH INDEX
-------
Ibuf: size 23, free list len 19918, seg size 19942, 7700684 merges
merged operations:
insert 10610436, delete mark 933283, delete 141330
discarded operations:
insert 76, delete mark 3, delete 0
Hash table size 12749951, node heap has 11507 buffer(s)
0.79 hash searches/s, 1.71 non-hash searches/s
---
LOG
---
Log sequence number 1777144910787
Log flushed up to 1777144910695
Last checkpoint at 1777091336513
Max checkpoint age 84223550
Checkpoint age target 81591565
Modified age 53574274
Checkpoint age 53574274
0 pending log writes, 0 pending chkp writes
37431704 log i/o's done, 0.05 log i/o's/second
-------
BUFFER POOL AND MEMORY
-------
Total memory allocated 7038684505; in additional pool allocated 8388608
Internal hash tables (constant factor + variable factor)
Adaptive hash index 290538464 (101999608 + 188538856)
Page hash 6375736 (buffer pool 0 only)
Dictionary cache 27413647 (25501328 + 1912319)
File system 166272 (82672 + 83600)
Lock system 16043040 (15938152 + 104888)
Recovery system 0 (0 + 0)
Dictionary memory allocated 1912319
Buffer pool size 393215
Buffer pool size, bytes 6442434560
Free buffers 0
Database pages 381708
Old database pages 140884
Modified db pages 9811
Pending reads 1
Pending writes: LRU 0, flush list 0, single page 0
Pages made young 87460057, not young 0
0.12 youngs/s, 0.00 non-youngs/s
Pages read 36541068, created 1670636, written 27658935
0.09 reads/s, 0.02 creates/s, 0.12 writes/s
Buffer pool hit rate 982 / 1000, young-making rate 24 / 1000 not 0 / 1000
Pages read ahead 0.00/s, evicted without access 0.04/s, Random read ahead 0.00/s
LRU len: 381708, unzip_LRU len: 0
I/O sum[19]:cur[108], unzip sum[0]:cur[0]
--------------
ROW OPERATIONS
--------------
0 queries inside InnoDB, 0 queries in queue
14 read views open inside InnoDB
---OLDEST VIEW---
Normal read view
Read view low limit trx n:o 507FC267
Read view up limit trx id 507FB5A1
Read view low limit trx id 507FC267
Read view individually stored trx ids:
Read view trx id 507FC266
Read view trx id 507FC265
Read view trx id 507FB671
Read view trx id 507FB5A1
-----------------
Main thread process no. 2460, id 1250208064, state: flushing log
Number of rows inserted 32662555, updated 9445518, deleted 1226635, read 44711799991
0.05 inserts/s, 0.02 updates/s, 0.00 deletes/s, 1.73 reads/s
------------
TRANSACTIONS
------------
Trx id counter 507FDD2A
Purge done for trx's n:o < 507FC268 undo n:o < 0
History list length 874
LIST OF TRANSACTIONS FOR EACH SESSION:
---TRANSACTION 0, not started
mysql tables in use 1, locked 1
MySQL thread id 15587529, OS thread handle 0x5065f940, query id 139300824 10.240.35.52 wepay init
INSERT INTO `prefills` (`name`, `email`, `zip`) VALUES ('xxxx', '<email address hidden>', 76039)
---TRANSACTION 507FDD1F, not started
MySQL thread id 15587759, OS thread handle 0x4e51d940, query id 139300819 10.240.170.61 wepay
---TRANSACTION 507FDD10, not started
MySQL thread id 15587481, OS thread handle 0x4d803940, query id 139300749 10.240.35.50 wepay
---TRANSACTION 0, not started
| Elena Stepanova (elenst) wrote | #1 |
| Aleksey Sanin (aleksey-l) wrote | #2 |
| Aleksey Sanin (aleksey-l) wrote | #3 |
Hi Alexey,
Have you already upgraded to 5.5.27, and if so, do you still observe the crash?
There was a problem (or several problems) in XtraDB, which just *might* be the reason of the issue that you observe. Here is one possible entry point to the bunch of related bug reports: https:/
Please let us know if upgrade helped.
Thanks.