Salut la guilde,
J'ai un mystère ... bien mystérieux* sur un serveur Debian.
Si quelqu'un à une idée pour m'aider à comprendre le problème : je suis preneur.
D'avance merci
Hugues
* Principalement parce que je suis développeur, pas administrateur système :-)
---------------------------------------------------
*Le contexte : *
2 serveurs dédiés (Debian 9), sur lesquels tournent des applications en Apache /
PHP / MariaDB
L'un chez OVH, l'autre chez Online.
Ils sont synchronisés entre eux par GlusterFS pour un point de montage commun et
par le plugin Galera de MariaDB pour les bases
Tout roule depuis plus d'1 an
Les serveurs sont à jour de mises à jour (dépôts stretch main)
*
*
*Les symptômes : *
Depuis 3 jours, Le serveur B, à 3h du matin ... part en couilles sucette.
La surveillance Nagios (sur une 3eme machine) me lève des alarmes de LOAD
AVERAGE CRITICAL : 15.02,15.06,15.00
Et, bien sur, les applications deviennent - quasiment - inutilisables.
A chaque fois un reboot résous le problème ... jusqu’à la prochaine fois
*Les - tentatives - d'analyse :*
- Aucune tache cron ne se lance à 3h du mat' (Y'en a chaque heure, mais aucune
spécifiquement à 3h)
- htop voit le load average, mais pas les process en cause
Pour essayer de comprendre ce qui se passe à à 3h du mat :
- cat /var/log/syslog.1 |grep "Jul 25 03:" > syslog.txt
Ce que je comprends, c'est que Apache se met à redémarrer en boucle (Lignes 5 &
127 de la PJ)
je met aussi tout les /var/log/* qui ont "quelque chose à 3h du mat'" :
- cat /var/log/message |grep "Jul 25 03:" > message.txt
- cat /var/log/kern.log |grep "Jul 25 03:" > kern.log.txt
- cat /var/log/daemon.log |grep "Jul 25 03:" > daemon.log.txt
Jul 25 03:00:01 b CRON[5526]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:00:01 b CRON[5527]: (root) CMD (/mnt/beerp_replica/certbot/restart-apache.sh)
Jul 25 03:00:01 b CRON[5528]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:00:01 b CRON[5529]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:00:01 b systemd[1]: Stopping The Apache HTTP Server...
Jul 25 03:01:42 b systemd[1]: apache2.service: State 'stop-final-sigterm' timed out. Killing.
Jul 25 03:01:42 b systemd[1]: apache2.service: Killing process 2479 (apache2) with signal SIGKILL.
Jul 25 03:01:42 b systemd[1]: apache2.service: Killing process 2504 (apache2) with signal SIGKILL.
Jul 25 03:01:42 b systemd[1]: apache2.service: Killing process 2549 (apache2) with signal SIGKILL.
Jul 25 03:01:42 b systemd[1]: apache2.service: Killing process 2591 (apache2) with signal SIGKILL.
Jul 25 03:01:42 b systemd[1]: apache2.service: Killing process 2904 (apache2) with signal SIGKILL.
Jul 25 03:01:42 b systemd[1]: apache2.service: Killing process 2927 (apache2) with signal SIGKILL.
Jul 25 03:02:01 b CRON[5654]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:02:01 b CRON[5655]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:02:01 b CRON[5656]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:02:09 b smartd[516]: Device: /dev/sdb [SAT], SMART Usage Attribute: 190 Airflow_Temperature_Cel changed from 62 to 63
Jul 25 03:02:39 b kernel: [39630.364778] INFO: task apache2:2479 blocked for more than 120 seconds.
Jul 25 03:02:39 b kernel: [39630.364854] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u2
Jul 25 03:02:39 b kernel: [39630.364915] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 25 03:02:39 b kernel: [39630.364987] apache2 D 0 2479 1 0x00000004
Jul 25 03:02:39 b kernel: [39630.364994] ffff8f1034866800 ffff8f1034866800 ffff8f1055698080 ffff8f105f218980
Jul 25 03:02:39 b kernel: [39630.365002] ffff8f1034b96000 ffffacfcc3acfd58 ffffffffa8615aa9 0000000000018980
Jul 25 03:02:39 b kernel: [39630.365008] 00000001c0730155 ffff8f105f218980 ffff8f10558650d0 ffff8f1055698080
Jul 25 03:02:39 b kernel: [39630.365015] Call Trace:
Jul 25 03:02:39 b kernel: [39630.365031] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:02:39 b kernel: [39630.365038] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:02:39 b kernel: [39630.365053] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:02:39 b kernel: [39630.365061] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:02:39 b kernel: [39630.365069] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:02:39 b kernel: [39630.365078] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365087] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365097] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:02:39 b kernel: [39630.365104] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:02:39 b kernel: [39630.365111] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:02:39 b kernel: [39630.365116] INFO: task apache2:2504 blocked for more than 120 seconds.
Jul 25 03:02:39 b kernel: [39630.365178] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u2
Jul 25 03:02:39 b kernel: [39630.365237] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 25 03:02:39 b kernel: [39630.365308] apache2 D 0 2504 1 0x00000004
Jul 25 03:02:39 b kernel: [39630.365313] ffff8f1056723000 0000000000000000 ffff8f1017564040 ffff8f105f418980
Jul 25 03:02:39 b kernel: [39630.365320] ffff8f105b670040 ffffacfcc44afd58 ffffffffa8615aa9 0000000000018980
Jul 25 03:02:39 b kernel: [39630.365326] 00000001c0730155 ffff8f105f418980 ffff8f101754f8a0 ffff8f1017564040
Jul 25 03:02:39 b kernel: [39630.365332] Call Trace:
Jul 25 03:02:39 b kernel: [39630.365340] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:02:39 b kernel: [39630.365347] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:02:39 b kernel: [39630.365356] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:02:39 b kernel: [39630.365362] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:02:39 b kernel: [39630.365370] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:02:39 b kernel: [39630.365377] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365386] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365393] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:02:39 b kernel: [39630.365398] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:02:39 b kernel: [39630.365403] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:02:39 b kernel: [39630.365407] INFO: task apache2:2549 blocked for more than 120 seconds.
Jul 25 03:02:39 b kernel: [39630.365468] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u2
Jul 25 03:02:39 b kernel: [39630.365527] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 25 03:02:39 b kernel: [39630.365600] apache2 D 0 2549 1 0x00000004
Jul 25 03:02:39 b kernel: [39630.365605] ffff8f105754a000 0000000000000000 ffff8f10150fa000 ffff8f105f258980
Jul 25 03:02:39 b kernel: [39630.365611] ffff8f105b646000 ffffacfcc3fb7d58 ffffffffa8615aa9 ffffffffa80bd17f
Jul 25 03:02:39 b kernel: [39630.365618] 00000000c0730155 ffff8f105f258980 ffff8f1057492710 ffff8f10150fa000
Jul 25 03:02:39 b kernel: [39630.365624] Call Trace:
Jul 25 03:02:39 b kernel: [39630.365631] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:02:39 b kernel: [39630.365637] [<ffffffffa80bd17f>] ? __wake_up_common+0x4f/0x90
Jul 25 03:02:39 b kernel: [39630.365643] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:02:39 b kernel: [39630.365652] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:02:39 b kernel: [39630.365657] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:02:39 b kernel: [39630.365665] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:02:39 b kernel: [39630.365673] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365681] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365687] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:02:39 b kernel: [39630.365693] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:02:39 b kernel: [39630.365698] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:02:39 b kernel: [39630.365701] INFO: task apache2:2591 blocked for more than 120 seconds.
Jul 25 03:02:39 b kernel: [39630.365763] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u2
Jul 25 03:02:39 b kernel: [39630.365822] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 25 03:02:39 b kernel: [39630.365893] apache2 D 0 2591 1 0x00000004
Jul 25 03:02:39 b kernel: [39630.365897] ffff8f105567ec00 ffff8f105567ec00 ffff8f1055940140 ffff8f105f218980
Jul 25 03:02:39 b kernel: [39630.365903] ffff8f1015145000 ffffacfcc3f33d58 ffffffffa8615aa9 0000000000018980
Jul 25 03:02:39 b kernel: [39630.365910] 00000001c0730155 ffff8f105f218980 ffff8f101754f260 ffff8f1055940140
Jul 25 03:02:39 b kernel: [39630.365915] Call Trace:
Jul 25 03:02:39 b kernel: [39630.365923] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:02:39 b kernel: [39630.365929] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:02:39 b kernel: [39630.365937] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:02:39 b kernel: [39630.365943] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:02:39 b kernel: [39630.365951] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:02:39 b kernel: [39630.365958] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365966] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365972] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:02:39 b kernel: [39630.365977] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:02:39 b kernel: [39630.365982] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:02:39 b kernel: [39630.365986] INFO: task apache2:2904 blocked for more than 120 seconds.
Jul 25 03:02:39 b kernel: [39630.366047] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u2
Jul 25 03:02:39 b kernel: [39630.366106] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 25 03:02:39 b kernel: [39630.366177] apache2 D 0 2904 1 0x00000004
Jul 25 03:02:39 b kernel: [39630.366181] ffff8f1055789400 0000000000000000 ffff8f1015297040 ffff8f105f358980
Jul 25 03:02:39 b kernel: [39630.366187] ffff8f105b661100 ffffacfcc3fdfd58 ffffffffa8615aa9 0000000000018980
Jul 25 03:02:39 b kernel: [39630.366193] 00000001c0730155 ffff8f105f358980 ffff8f10574920d0 ffff8f1015297040
Jul 25 03:02:39 b kernel: [39630.366199] Call Trace:
Jul 25 03:02:39 b kernel: [39630.366207] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:02:39 b kernel: [39630.366213] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:02:39 b kernel: [39630.366221] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:02:39 b kernel: [39630.366227] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:02:39 b kernel: [39630.366234] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:02:39 b kernel: [39630.366242] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.366250] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.366256] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:02:39 b kernel: [39630.366261] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:02:39 b kernel: [39630.366266] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:02:39 b kernel: [39630.366270] INFO: task apache2:2927 blocked for more than 120 seconds.
Jul 25 03:02:39 b kernel: [39630.366331] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u2
Jul 25 03:02:39 b kernel: [39630.366390] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 25 03:02:39 b kernel: [39630.366462] apache2 D 0 2927 1 0x00000004
Jul 25 03:02:39 b kernel: [39630.366467] ffff8f1055ab7800 0000000000000000 ffff8f10599a9000 ffff8f105f2d8980
Jul 25 03:02:39 b kernel: [39630.366473] ffff8f105b657080 ffffacfcc468fd58 ffffffffa8615aa9 ffffffffa80bd17f
Jul 25 03:02:39 b kernel: [39630.366479] 00000000c0730155 ffff8f105f2d8980 ffff8f10152093f0 ffff8f10599a9000
Jul 25 03:02:39 b kernel: [39630.366485] Call Trace:
Jul 25 03:02:39 b kernel: [39630.366492] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:02:39 b kernel: [39630.366497] [<ffffffffa80bd17f>] ? __wake_up_common+0x4f/0x90
Jul 25 03:02:39 b kernel: [39630.366503] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:02:39 b kernel: [39630.366512] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:02:39 b kernel: [39630.366517] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:02:39 b kernel: [39630.366525] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:02:39 b kernel: [39630.366532] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.366540] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.366547] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:02:39 b kernel: [39630.366552] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:02:39 b kernel: [39630.366557] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:03:13 b systemd[1]: apache2.service: Processes still around after final SIGKILL. Entering failed mode.
Jul 25 03:03:13 b systemd[1]: Stopped The Apache HTTP Server.
Jul 25 03:03:13 b systemd[1]: apache2.service: Unit entered failed state.
Jul 25 03:03:13 b systemd[1]: apache2.service: Failed with result 'timeout'.
Jul 25 03:03:13 b systemd[1]: Starting The Apache HTTP Server...
Jul 25 03:03:13 b systemd[1]: Started The Apache HTTP Server.
Jul 25 03:04:01 b CRON[5742]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:04:01 b CRON[5743]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:04:01 b CRON[5744]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:04:18 b named[564]: resolver priming query complete
Jul 25 03:04:18 b named[564]: managed-keys-zone: Unable to fetch DNSKEY set '.': timed out
Jul 25 03:04:39 b kernel: [39751.185812] INFO: task apache2:2479 blocked for more than 120 seconds.
Jul 25 03:04:39 b kernel: [39751.185927] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u2
Jul 25 03:04:39 b kernel: [39751.185995] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 25 03:04:39 b kernel: [39751.186067] apache2 D 0 2479 1 0x00000004
Jul 25 03:04:39 b kernel: [39751.186076] ffff8f1034866800 ffff8f1034866800 ffff8f1055698080 ffff8f105f218980
Jul 25 03:04:39 b kernel: [39751.186083] ffff8f1034b96000 ffffacfcc3acfd58 ffffffffa8615aa9 0000000000018980
Jul 25 03:04:39 b kernel: [39751.186090] 00000001c0730155 ffff8f105f218980 ffff8f10558650d0 ffff8f1055698080
Jul 25 03:04:39 b kernel: [39751.186096] Call Trace:
Jul 25 03:04:39 b kernel: [39751.186110] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:04:39 b kernel: [39751.186117] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:04:39 b kernel: [39751.186131] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:04:39 b kernel: [39751.186139] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:04:39 b kernel: [39751.186147] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:04:39 b kernel: [39751.186155] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.186165] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.186173] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:04:39 b kernel: [39751.186179] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:04:39 b kernel: [39751.186185] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:04:39 b kernel: [39751.186190] INFO: task apache2:2504 blocked for more than 120 seconds.
Jul 25 03:04:39 b kernel: [39751.186253] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u2
Jul 25 03:04:39 b kernel: [39751.186313] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 25 03:04:39 b kernel: [39751.186384] apache2 D 0 2504 1 0x00000004
Jul 25 03:04:39 b kernel: [39751.186389] ffff8f1056723000 0000000000000000 ffff8f1017564040 ffff8f105f418980
Jul 25 03:04:39 b kernel: [39751.186396] ffff8f105b670040 ffffacfcc44afd58 ffffffffa8615aa9 0000000000018980
Jul 25 03:04:39 b kernel: [39751.186402] 00000001c0730155 ffff8f105f418980 ffff8f101754f8a0 ffff8f1017564040
Jul 25 03:04:39 b kernel: [39751.186408] Call Trace:
Jul 25 03:04:39 b kernel: [39751.186416] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:04:39 b kernel: [39751.186423] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:04:39 b kernel: [39751.186432] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:04:39 b kernel: [39751.186438] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:04:39 b kernel: [39751.186445] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:04:39 b kernel: [39751.186453] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.186462] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.186469] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:04:39 b kernel: [39751.186474] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:04:39 b kernel: [39751.186480] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:04:39 b kernel: [39751.186483] INFO: task apache2:2549 blocked for more than 120 seconds.
Jul 25 03:04:39 b kernel: [39751.186544] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u2
Jul 25 03:04:39 b kernel: [39751.186603] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 25 03:04:39 b kernel: [39751.186674] apache2 D 0 2549 1 0x00000004
Jul 25 03:04:39 b kernel: [39751.186678] ffff8f105754a000 0000000000000000 ffff8f10150fa000 ffff8f105f258980
Jul 25 03:04:39 b kernel: [39751.186685] ffff8f105b646000 ffffacfcc3fb7d58 ffffffffa8615aa9 ffffffffa80bd17f
Jul 25 03:04:39 b kernel: [39751.186691] 00000000c0730155 ffff8f105f258980 ffff8f1057492710 ffff8f10150fa000
Jul 25 03:04:39 b kernel: [39751.186697] Call Trace:
Jul 25 03:04:39 b kernel: [39751.186705] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:04:39 b kernel: [39751.186710] [<ffffffffa80bd17f>] ? __wake_up_common+0x4f/0x90
Jul 25 03:04:39 b kernel: [39751.186716] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:04:39 b kernel: [39751.186725] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:04:39 b kernel: [39751.186730] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:04:39 b kernel: [39751.186738] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:04:39 b kernel: [39751.186746] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.186754] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.186760] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:04:39 b kernel: [39751.186766] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:04:39 b kernel: [39751.186771] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:04:39 b kernel: [39751.186774] INFO: task apache2:2591 blocked for more than 120 seconds.
Jul 25 03:04:39 b kernel: [39751.186835] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u2
Jul 25 03:04:39 b kernel: [39751.186895] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 25 03:04:39 b kernel: [39751.186965] apache2 D 0 2591 1 0x00000004
Jul 25 03:04:39 b kernel: [39751.186970] ffff8f105567ec00 ffff8f105567ec00 ffff8f1055940140 ffff8f105f218980
Jul 25 03:04:39 b kernel: [39751.186976] ffff8f1015145000 ffffacfcc3f33d58 ffffffffa8615aa9 0000000000018980
Jul 25 03:04:39 b kernel: [39751.186982] 00000001c0730155 ffff8f105f218980 ffff8f101754f260 ffff8f1055940140
Jul 25 03:04:39 b kernel: [39751.186988] Call Trace:
Jul 25 03:04:39 b kernel: [39751.186996] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:04:39 b kernel: [39751.187002] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:04:39 b kernel: [39751.187010] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:04:39 b kernel: [39751.187016] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:04:39 b kernel: [39751.187023] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:04:39 b kernel: [39751.187031] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.187039] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.187045] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:04:39 b kernel: [39751.187050] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:04:39 b kernel: [39751.187055] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:06:01 b CRON[5829]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:06:01 b CRON[5830]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:06:01 b CRON[5831]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:08:01 b CRON[5910]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:08:01 b CRON[5911]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:08:01 b CRON[5912]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:09:01 b CRON[5928]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Jul 25 03:09:01 b systemd[1]: Starting Clean php session files...
Jul 25 03:09:02 b systemd[1]: Started Clean php session files.
Jul 25 03:10:01 b CRON[6030]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:10:01 b CRON[6031]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:10:01 b CRON[6032]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:10:01 b CRON[6033]: (root) CMD ( /mnt/beerp_replica/meteofrance.sh)
Jul 25 03:11:07 b glustershd[1562]: [2019-07-25 01:11:07.262943] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-beerp_replica-client-0: server 188.165.206.31:49154 has not responded in the last 1 seconds, disconnecting.
Jul 25 03:11:43 b glustershd[1562]: [2019-07-25 01:11:43.330195] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-beerp_replica-client-0: server 188.165.206.31:49154 has not responded in the last 1 seconds, disconnecting.
Jul 25 03:12:01 b CRON[6152]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:12:01 b CRON[6153]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:12:01 b CRON[6154]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:12:19 b mnt-beerp_replica[1643]: [2019-07-25 01:12:19.440920] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-beerp_replica-client-0: server 188.165.206.31:49154 has not responded in the last 1 seconds, disconnecting.
Jul 25 03:14:01 b CRON[6242]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:14:01 b CRON[6243]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:14:01 b CRON[6244]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:16:01 b CRON[6364]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:16:01 b CRON[6365]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:16:01 b CRON[6366]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:17:01 b CRON[6438]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Jul 25 03:18:01 b CRON[6490]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:18:01 b CRON[6491]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:18:01 b CRON[6492]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:20:01 b CRON[6593]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:20:01 b CRON[6595]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:20:01 b CRON[6596]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:22:01 b CRON[6737]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:22:01 b CRON[6738]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:22:01 b CRON[6739]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:24:01 b CRON[6824]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:24:01 b CRON[6825]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:24:01 b CRON[6826]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:26:01 b CRON[6952]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:26:01 b CRON[6953]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:26:01 b CRON[6956]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:28:01 b CRON[7085]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:28:01 b CRON[7086]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:28:01 b CRON[7087]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:30:01 b CRON[7181]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:30:01 b CRON[7182]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:30:01 b CRON[7183]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:32:01 b CRON[7336]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:32:01 b CRON[7337]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:32:01 b CRON[7338]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:34:01 b CRON[7443]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:34:01 b CRON[7444]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:34:01 b CRON[7445]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:36:01 b CRON[7556]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:36:01 b CRON[7557]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:36:01 b CRON[7558]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:38:01 b CRON[7679]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:38:01 b CRON[7680]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:38:01 b CRON[7681]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:39:01 b CRON[7724]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Jul 25 03:39:01 b systemd[1]: Starting Clean php session files...
Jul 25 03:39:01 b systemd[1]: Started Clean php session files.
Jul 25 03:40:01 b CRON[7842]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:40:01 b CRON[7844]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:40:01 b CRON[7845]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:42:01 b CRON[7982]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:42:01 b CRON[7983]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:42:01 b CRON[7984]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:44:01 b CRON[8041]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:44:01 b CRON[8042]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:44:01 b CRON[8043]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:46:01 b CRON[8114]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:46:01 b CRON[8115]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:46:01 b CRON[8116]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:48:01 b CRON[8200]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:48:01 b CRON[8201]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:48:01 b CRON[8202]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:50:01 b CRON[8259]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:50:01 b CRON[8260]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:50:01 b CRON[8261]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:52:01 b CRON[8364]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:52:01 b CRON[8365]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:52:01 b CRON[8366]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:54:01 b CRON[8428]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:54:01 b CRON[8429]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:54:01 b CRON[8430]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:56:01 b CRON[8509]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:56:01 b CRON[8508]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:56:01 b CRON[8510]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:58:01 b CRON[8601]: (root) CMD (sleep 60; sudo -u www-data php /var/www/sygsi/dev/import.php)
Jul 25 03:58:01 b CRON[8602]: (root) CMD (sleep 60; sudo -u www-data php /ver/www/sygsi/test/import.php)
Jul 25 03:58:01 b CRON[8603]: (root) CMD ( sleep 60; sudo -u www-data php /var/www/sygsi/sage/import.php)
Jul 25 03:02:39 b kernel: [39630.364987] apache2 D 0 2479 1 0x00000004
Jul 25 03:02:39 b kernel: [39630.364994] ffff8f1034866800 ffff8f1034866800 ffff8f1055698080 ffff8f105f218980
Jul 25 03:02:39 b kernel: [39630.365002] ffff8f1034b96000 ffffacfcc3acfd58 ffffffffa8615aa9 0000000000018980
Jul 25 03:02:39 b kernel: [39630.365008] 00000001c0730155 ffff8f105f218980 ffff8f10558650d0 ffff8f1055698080
Jul 25 03:02:39 b kernel: [39630.365015] Call Trace:
Jul 25 03:02:39 b kernel: [39630.365031] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:02:39 b kernel: [39630.365038] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:02:39 b kernel: [39630.365053] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:02:39 b kernel: [39630.365061] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:02:39 b kernel: [39630.365069] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:02:39 b kernel: [39630.365078] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365087] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365097] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:02:39 b kernel: [39630.365104] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:02:39 b kernel: [39630.365111] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:02:39 b kernel: [39630.365308] apache2 D 0 2504 1 0x00000004
Jul 25 03:02:39 b kernel: [39630.365313] ffff8f1056723000 0000000000000000 ffff8f1017564040 ffff8f105f418980
Jul 25 03:02:39 b kernel: [39630.365320] ffff8f105b670040 ffffacfcc44afd58 ffffffffa8615aa9 0000000000018980
Jul 25 03:02:39 b kernel: [39630.365326] 00000001c0730155 ffff8f105f418980 ffff8f101754f8a0 ffff8f1017564040
Jul 25 03:02:39 b kernel: [39630.365332] Call Trace:
Jul 25 03:02:39 b kernel: [39630.365340] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:02:39 b kernel: [39630.365347] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:02:39 b kernel: [39630.365356] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:02:39 b kernel: [39630.365362] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:02:39 b kernel: [39630.365370] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:02:39 b kernel: [39630.365377] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365386] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365393] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:02:39 b kernel: [39630.365398] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:02:39 b kernel: [39630.365403] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:02:39 b kernel: [39630.365600] apache2 D 0 2549 1 0x00000004
Jul 25 03:02:39 b kernel: [39630.365605] ffff8f105754a000 0000000000000000 ffff8f10150fa000 ffff8f105f258980
Jul 25 03:02:39 b kernel: [39630.365611] ffff8f105b646000 ffffacfcc3fb7d58 ffffffffa8615aa9 ffffffffa80bd17f
Jul 25 03:02:39 b kernel: [39630.365618] 00000000c0730155 ffff8f105f258980 ffff8f1057492710 ffff8f10150fa000
Jul 25 03:02:39 b kernel: [39630.365624] Call Trace:
Jul 25 03:02:39 b kernel: [39630.365631] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:02:39 b kernel: [39630.365637] [<ffffffffa80bd17f>] ? __wake_up_common+0x4f/0x90
Jul 25 03:02:39 b kernel: [39630.365643] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:02:39 b kernel: [39630.365652] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:02:39 b kernel: [39630.365657] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:02:39 b kernel: [39630.365665] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:02:39 b kernel: [39630.365673] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365681] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365687] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:02:39 b kernel: [39630.365693] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:02:39 b kernel: [39630.365698] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:02:39 b kernel: [39630.365893] apache2 D 0 2591 1 0x00000004
Jul 25 03:02:39 b kernel: [39630.365897] ffff8f105567ec00 ffff8f105567ec00 ffff8f1055940140 ffff8f105f218980
Jul 25 03:02:39 b kernel: [39630.365903] ffff8f1015145000 ffffacfcc3f33d58 ffffffffa8615aa9 0000000000018980
Jul 25 03:02:39 b kernel: [39630.365910] 00000001c0730155 ffff8f105f218980 ffff8f101754f260 ffff8f1055940140
Jul 25 03:02:39 b kernel: [39630.365915] Call Trace:
Jul 25 03:02:39 b kernel: [39630.365923] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:02:39 b kernel: [39630.365929] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:02:39 b kernel: [39630.365937] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:02:39 b kernel: [39630.365943] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:02:39 b kernel: [39630.365951] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:02:39 b kernel: [39630.365958] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365966] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365972] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:02:39 b kernel: [39630.365977] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:02:39 b kernel: [39630.365982] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:02:39 b kernel: [39630.366177] apache2 D 0 2904 1 0x00000004
Jul 25 03:02:39 b kernel: [39630.366181] ffff8f1055789400 0000000000000000 ffff8f1015297040 ffff8f105f358980
Jul 25 03:02:39 b kernel: [39630.366187] ffff8f105b661100 ffffacfcc3fdfd58 ffffffffa8615aa9 0000000000018980
Jul 25 03:02:39 b kernel: [39630.366193] 00000001c0730155 ffff8f105f358980 ffff8f10574920d0 ffff8f1015297040
Jul 25 03:02:39 b kernel: [39630.366199] Call Trace:
Jul 25 03:02:39 b kernel: [39630.366207] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:02:39 b kernel: [39630.366213] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:02:39 b kernel: [39630.366221] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:02:39 b kernel: [39630.366227] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:02:39 b kernel: [39630.366234] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:02:39 b kernel: [39630.366242] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.366250] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.366256] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:02:39 b kernel: [39630.366261] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:02:39 b kernel: [39630.366266] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:02:39 b kernel: [39630.366462] apache2 D 0 2927 1 0x00000004
Jul 25 03:02:39 b kernel: [39630.366467] ffff8f1055ab7800 0000000000000000 ffff8f10599a9000 ffff8f105f2d8980
Jul 25 03:02:39 b kernel: [39630.366473] ffff8f105b657080 ffffacfcc468fd58 ffffffffa8615aa9 ffffffffa80bd17f
Jul 25 03:02:39 b kernel: [39630.366479] 00000000c0730155 ffff8f105f2d8980 ffff8f10152093f0 ffff8f10599a9000
Jul 25 03:02:39 b kernel: [39630.366485] Call Trace:
Jul 25 03:02:39 b kernel: [39630.366492] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:02:39 b kernel: [39630.366497] [<ffffffffa80bd17f>] ? __wake_up_common+0x4f/0x90
Jul 25 03:02:39 b kernel: [39630.366503] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:02:39 b kernel: [39630.366512] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:02:39 b kernel: [39630.366517] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:02:39 b kernel: [39630.366525] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:02:39 b kernel: [39630.366532] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.366540] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.366547] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:02:39 b kernel: [39630.366552] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:02:39 b kernel: [39630.366557] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:04:39 b kernel: [39751.186067] apache2 D 0 2479 1 0x00000004
Jul 25 03:04:39 b kernel: [39751.186076] ffff8f1034866800 ffff8f1034866800 ffff8f1055698080 ffff8f105f218980
Jul 25 03:04:39 b kernel: [39751.186083] ffff8f1034b96000 ffffacfcc3acfd58 ffffffffa8615aa9 0000000000018980
Jul 25 03:04:39 b kernel: [39751.186090] 00000001c0730155 ffff8f105f218980 ffff8f10558650d0 ffff8f1055698080
Jul 25 03:04:39 b kernel: [39751.186096] Call Trace:
Jul 25 03:04:39 b kernel: [39751.186110] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:04:39 b kernel: [39751.186117] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:04:39 b kernel: [39751.186131] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:04:39 b kernel: [39751.186139] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:04:39 b kernel: [39751.186147] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:04:39 b kernel: [39751.186155] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.186165] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.186173] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:04:39 b kernel: [39751.186179] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:04:39 b kernel: [39751.186185] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:04:39 b kernel: [39751.186384] apache2 D 0 2504 1 0x00000004
Jul 25 03:04:39 b kernel: [39751.186389] ffff8f1056723000 0000000000000000 ffff8f1017564040 ffff8f105f418980
Jul 25 03:04:39 b kernel: [39751.186396] ffff8f105b670040 ffffacfcc44afd58 ffffffffa8615aa9 0000000000018980
Jul 25 03:04:39 b kernel: [39751.186402] 00000001c0730155 ffff8f105f418980 ffff8f101754f8a0 ffff8f1017564040
Jul 25 03:04:39 b kernel: [39751.186408] Call Trace:
Jul 25 03:04:39 b kernel: [39751.186416] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:04:39 b kernel: [39751.186423] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:04:39 b kernel: [39751.186432] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:04:39 b kernel: [39751.186438] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:04:39 b kernel: [39751.186445] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:04:39 b kernel: [39751.186453] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.186462] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.186469] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:04:39 b kernel: [39751.186474] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:04:39 b kernel: [39751.186480] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:04:39 b kernel: [39751.186674] apache2 D 0 2549 1 0x00000004
Jul 25 03:04:39 b kernel: [39751.186678] ffff8f105754a000 0000000000000000 ffff8f10150fa000 ffff8f105f258980
Jul 25 03:04:39 b kernel: [39751.186685] ffff8f105b646000 ffffacfcc3fb7d58 ffffffffa8615aa9 ffffffffa80bd17f
Jul 25 03:04:39 b kernel: [39751.186691] 00000000c0730155 ffff8f105f258980 ffff8f1057492710 ffff8f10150fa000
Jul 25 03:04:39 b kernel: [39751.186697] Call Trace:
Jul 25 03:04:39 b kernel: [39751.186705] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:04:39 b kernel: [39751.186710] [<ffffffffa80bd17f>] ? __wake_up_common+0x4f/0x90
Jul 25 03:04:39 b kernel: [39751.186716] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:04:39 b kernel: [39751.186725] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:04:39 b kernel: [39751.186730] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:04:39 b kernel: [39751.186738] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:04:39 b kernel: [39751.186746] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.186754] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.186760] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:04:39 b kernel: [39751.186766] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:04:39 b kernel: [39751.186771] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:04:39 b kernel: [39751.186965] apache2 D 0 2591 1 0x00000004
Jul 25 03:04:39 b kernel: [39751.186970] ffff8f105567ec00 ffff8f105567ec00 ffff8f1055940140 ffff8f105f218980
Jul 25 03:04:39 b kernel: [39751.186976] ffff8f1015145000 ffffacfcc3f33d58 ffffffffa8615aa9 0000000000018980
Jul 25 03:04:39 b kernel: [39751.186982] 00000001c0730155 ffff8f105f218980 ffff8f101754f260 ffff8f1055940140
Jul 25 03:04:39 b kernel: [39751.186988] Call Trace:
Jul 25 03:04:39 b kernel: [39751.186996] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:04:39 b kernel: [39751.187002] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:04:39 b kernel: [39751.187010] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:04:39 b kernel: [39751.187016] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:04:39 b kernel: [39751.187023] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:04:39 b kernel: [39751.187031] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.187039] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.187045] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:04:39 b kernel: [39751.187050] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:04:39 b kernel: [39751.187055] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:00:01 b systemd[1]: Stopping The Apache HTTP Server...
Jul 25 03:01:42 b systemd[1]: apache2.service: State 'stop-final-sigterm' timed out. Killing.
Jul 25 03:01:42 b systemd[1]: apache2.service: Killing process 2479 (apache2) with signal SIGKILL.
Jul 25 03:01:42 b systemd[1]: apache2.service: Killing process 2504 (apache2) with signal SIGKILL.
Jul 25 03:01:42 b systemd[1]: apache2.service: Killing process 2549 (apache2) with signal SIGKILL.
Jul 25 03:01:42 b systemd[1]: apache2.service: Killing process 2591 (apache2) with signal SIGKILL.
Jul 25 03:01:42 b systemd[1]: apache2.service: Killing process 2904 (apache2) with signal SIGKILL.
Jul 25 03:01:42 b systemd[1]: apache2.service: Killing process 2927 (apache2) with signal SIGKILL.
Jul 25 03:02:09 b smartd[516]: Device: /dev/sdb [SAT], SMART Usage Attribute: 190 Airflow_Temperature_Cel changed from 62 to 63
Jul 25 03:03:13 b systemd[1]: apache2.service: Processes still around after final SIGKILL. Entering failed mode.
Jul 25 03:03:13 b systemd[1]: Stopped The Apache HTTP Server.
Jul 25 03:03:13 b systemd[1]: apache2.service: Unit entered failed state.
Jul 25 03:03:13 b systemd[1]: apache2.service: Failed with result 'timeout'.
Jul 25 03:03:13 b systemd[1]: Starting The Apache HTTP Server...
Jul 25 03:03:13 b systemd[1]: Started The Apache HTTP Server.
Jul 25 03:04:18 b named[564]: resolver priming query complete
Jul 25 03:04:18 b named[564]: managed-keys-zone: Unable to fetch DNSKEY set '.': timed out
Jul 25 03:09:01 b systemd[1]: Starting Clean php session files...
Jul 25 03:09:02 b systemd[1]: Started Clean php session files.
Jul 25 03:11:07 b glustershd[1562]: [2019-07-25 01:11:07.262943] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-beerp_replica-client-0: server 188.165.206.31:49154 has not responded in the last 1 seconds, disconnecting.
Jul 25 03:11:43 b glustershd[1562]: [2019-07-25 01:11:43.330195] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-beerp_replica-client-0: server 188.165.206.31:49154 has not responded in the last 1 seconds, disconnecting.
Jul 25 03:12:19 b mnt-beerp_replica[1643]: [2019-07-25 01:12:19.440920] C [rpc-clnt-ping.c:160:rpc_clnt_ping_timer_expired] 0-beerp_replica-client-0: server 188.165.206.31:49154 has not responded in the last 1 seconds, disconnecting.
Jul 25 03:39:01 b systemd[1]: Starting Clean php session files...
Jul 25 03:39:01 b systemd[1]: Started Clean php session files.
Jul 25 03:02:39 b kernel: [39630.364778] INFO: task apache2:2479 blocked for more than 120 seconds.
Jul 25 03:02:39 b kernel: [39630.364854] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u2
Jul 25 03:02:39 b kernel: [39630.364915] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 25 03:02:39 b kernel: [39630.364987] apache2 D 0 2479 1 0x00000004
Jul 25 03:02:39 b kernel: [39630.364994] ffff8f1034866800 ffff8f1034866800 ffff8f1055698080 ffff8f105f218980
Jul 25 03:02:39 b kernel: [39630.365002] ffff8f1034b96000 ffffacfcc3acfd58 ffffffffa8615aa9 0000000000018980
Jul 25 03:02:39 b kernel: [39630.365008] 00000001c0730155 ffff8f105f218980 ffff8f10558650d0 ffff8f1055698080
Jul 25 03:02:39 b kernel: [39630.365015] Call Trace:
Jul 25 03:02:39 b kernel: [39630.365031] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:02:39 b kernel: [39630.365038] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:02:39 b kernel: [39630.365053] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:02:39 b kernel: [39630.365061] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:02:39 b kernel: [39630.365069] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:02:39 b kernel: [39630.365078] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365087] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365097] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:02:39 b kernel: [39630.365104] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:02:39 b kernel: [39630.365111] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:02:39 b kernel: [39630.365116] INFO: task apache2:2504 blocked for more than 120 seconds.
Jul 25 03:02:39 b kernel: [39630.365178] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u2
Jul 25 03:02:39 b kernel: [39630.365237] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 25 03:02:39 b kernel: [39630.365308] apache2 D 0 2504 1 0x00000004
Jul 25 03:02:39 b kernel: [39630.365313] ffff8f1056723000 0000000000000000 ffff8f1017564040 ffff8f105f418980
Jul 25 03:02:39 b kernel: [39630.365320] ffff8f105b670040 ffffacfcc44afd58 ffffffffa8615aa9 0000000000018980
Jul 25 03:02:39 b kernel: [39630.365326] 00000001c0730155 ffff8f105f418980 ffff8f101754f8a0 ffff8f1017564040
Jul 25 03:02:39 b kernel: [39630.365332] Call Trace:
Jul 25 03:02:39 b kernel: [39630.365340] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:02:39 b kernel: [39630.365347] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:02:39 b kernel: [39630.365356] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:02:39 b kernel: [39630.365362] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:02:39 b kernel: [39630.365370] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:02:39 b kernel: [39630.365377] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365386] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365393] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:02:39 b kernel: [39630.365398] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:02:39 b kernel: [39630.365403] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:02:39 b kernel: [39630.365407] INFO: task apache2:2549 blocked for more than 120 seconds.
Jul 25 03:02:39 b kernel: [39630.365468] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u2
Jul 25 03:02:39 b kernel: [39630.365527] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 25 03:02:39 b kernel: [39630.365600] apache2 D 0 2549 1 0x00000004
Jul 25 03:02:39 b kernel: [39630.365605] ffff8f105754a000 0000000000000000 ffff8f10150fa000 ffff8f105f258980
Jul 25 03:02:39 b kernel: [39630.365611] ffff8f105b646000 ffffacfcc3fb7d58 ffffffffa8615aa9 ffffffffa80bd17f
Jul 25 03:02:39 b kernel: [39630.365618] 00000000c0730155 ffff8f105f258980 ffff8f1057492710 ffff8f10150fa000
Jul 25 03:02:39 b kernel: [39630.365624] Call Trace:
Jul 25 03:02:39 b kernel: [39630.365631] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:02:39 b kernel: [39630.365637] [<ffffffffa80bd17f>] ? __wake_up_common+0x4f/0x90
Jul 25 03:02:39 b kernel: [39630.365643] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:02:39 b kernel: [39630.365652] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:02:39 b kernel: [39630.365657] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:02:39 b kernel: [39630.365665] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:02:39 b kernel: [39630.365673] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365681] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365687] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:02:39 b kernel: [39630.365693] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:02:39 b kernel: [39630.365698] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:02:39 b kernel: [39630.365701] INFO: task apache2:2591 blocked for more than 120 seconds.
Jul 25 03:02:39 b kernel: [39630.365763] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u2
Jul 25 03:02:39 b kernel: [39630.365822] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 25 03:02:39 b kernel: [39630.365893] apache2 D 0 2591 1 0x00000004
Jul 25 03:02:39 b kernel: [39630.365897] ffff8f105567ec00 ffff8f105567ec00 ffff8f1055940140 ffff8f105f218980
Jul 25 03:02:39 b kernel: [39630.365903] ffff8f1015145000 ffffacfcc3f33d58 ffffffffa8615aa9 0000000000018980
Jul 25 03:02:39 b kernel: [39630.365910] 00000001c0730155 ffff8f105f218980 ffff8f101754f260 ffff8f1055940140
Jul 25 03:02:39 b kernel: [39630.365915] Call Trace:
Jul 25 03:02:39 b kernel: [39630.365923] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:02:39 b kernel: [39630.365929] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:02:39 b kernel: [39630.365937] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:02:39 b kernel: [39630.365943] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:02:39 b kernel: [39630.365951] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:02:39 b kernel: [39630.365958] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365966] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.365972] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:02:39 b kernel: [39630.365977] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:02:39 b kernel: [39630.365982] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:02:39 b kernel: [39630.365986] INFO: task apache2:2904 blocked for more than 120 seconds.
Jul 25 03:02:39 b kernel: [39630.366047] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u2
Jul 25 03:02:39 b kernel: [39630.366106] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 25 03:02:39 b kernel: [39630.366177] apache2 D 0 2904 1 0x00000004
Jul 25 03:02:39 b kernel: [39630.366181] ffff8f1055789400 0000000000000000 ffff8f1015297040 ffff8f105f358980
Jul 25 03:02:39 b kernel: [39630.366187] ffff8f105b661100 ffffacfcc3fdfd58 ffffffffa8615aa9 0000000000018980
Jul 25 03:02:39 b kernel: [39630.366193] 00000001c0730155 ffff8f105f358980 ffff8f10574920d0 ffff8f1015297040
Jul 25 03:02:39 b kernel: [39630.366199] Call Trace:
Jul 25 03:02:39 b kernel: [39630.366207] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:02:39 b kernel: [39630.366213] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:02:39 b kernel: [39630.366221] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:02:39 b kernel: [39630.366227] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:02:39 b kernel: [39630.366234] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:02:39 b kernel: [39630.366242] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.366250] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.366256] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:02:39 b kernel: [39630.366261] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:02:39 b kernel: [39630.366266] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:02:39 b kernel: [39630.366270] INFO: task apache2:2927 blocked for more than 120 seconds.
Jul 25 03:02:39 b kernel: [39630.366331] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u2
Jul 25 03:02:39 b kernel: [39630.366390] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 25 03:02:39 b kernel: [39630.366462] apache2 D 0 2927 1 0x00000004
Jul 25 03:02:39 b kernel: [39630.366467] ffff8f1055ab7800 0000000000000000 ffff8f10599a9000 ffff8f105f2d8980
Jul 25 03:02:39 b kernel: [39630.366473] ffff8f105b657080 ffffacfcc468fd58 ffffffffa8615aa9 ffffffffa80bd17f
Jul 25 03:02:39 b kernel: [39630.366479] 00000000c0730155 ffff8f105f2d8980 ffff8f10152093f0 ffff8f10599a9000
Jul 25 03:02:39 b kernel: [39630.366485] Call Trace:
Jul 25 03:02:39 b kernel: [39630.366492] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:02:39 b kernel: [39630.366497] [<ffffffffa80bd17f>] ? __wake_up_common+0x4f/0x90
Jul 25 03:02:39 b kernel: [39630.366503] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:02:39 b kernel: [39630.366512] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:02:39 b kernel: [39630.366517] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:02:39 b kernel: [39630.366525] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:02:39 b kernel: [39630.366532] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.366540] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:02:39 b kernel: [39630.366547] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:02:39 b kernel: [39630.366552] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:02:39 b kernel: [39630.366557] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:04:39 b kernel: [39751.185812] INFO: task apache2:2479 blocked for more than 120 seconds.
Jul 25 03:04:39 b kernel: [39751.185927] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u2
Jul 25 03:04:39 b kernel: [39751.185995] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 25 03:04:39 b kernel: [39751.186067] apache2 D 0 2479 1 0x00000004
Jul 25 03:04:39 b kernel: [39751.186076] ffff8f1034866800 ffff8f1034866800 ffff8f1055698080 ffff8f105f218980
Jul 25 03:04:39 b kernel: [39751.186083] ffff8f1034b96000 ffffacfcc3acfd58 ffffffffa8615aa9 0000000000018980
Jul 25 03:04:39 b kernel: [39751.186090] 00000001c0730155 ffff8f105f218980 ffff8f10558650d0 ffff8f1055698080
Jul 25 03:04:39 b kernel: [39751.186096] Call Trace:
Jul 25 03:04:39 b kernel: [39751.186110] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:04:39 b kernel: [39751.186117] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:04:39 b kernel: [39751.186131] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:04:39 b kernel: [39751.186139] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:04:39 b kernel: [39751.186147] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:04:39 b kernel: [39751.186155] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.186165] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.186173] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:04:39 b kernel: [39751.186179] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:04:39 b kernel: [39751.186185] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:04:39 b kernel: [39751.186190] INFO: task apache2:2504 blocked for more than 120 seconds.
Jul 25 03:04:39 b kernel: [39751.186253] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u2
Jul 25 03:04:39 b kernel: [39751.186313] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 25 03:04:39 b kernel: [39751.186384] apache2 D 0 2504 1 0x00000004
Jul 25 03:04:39 b kernel: [39751.186389] ffff8f1056723000 0000000000000000 ffff8f1017564040 ffff8f105f418980
Jul 25 03:04:39 b kernel: [39751.186396] ffff8f105b670040 ffffacfcc44afd58 ffffffffa8615aa9 0000000000018980
Jul 25 03:04:39 b kernel: [39751.186402] 00000001c0730155 ffff8f105f418980 ffff8f101754f8a0 ffff8f1017564040
Jul 25 03:04:39 b kernel: [39751.186408] Call Trace:
Jul 25 03:04:39 b kernel: [39751.186416] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:04:39 b kernel: [39751.186423] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:04:39 b kernel: [39751.186432] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:04:39 b kernel: [39751.186438] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:04:39 b kernel: [39751.186445] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:04:39 b kernel: [39751.186453] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.186462] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.186469] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:04:39 b kernel: [39751.186474] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:04:39 b kernel: [39751.186480] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:04:39 b kernel: [39751.186483] INFO: task apache2:2549 blocked for more than 120 seconds.
Jul 25 03:04:39 b kernel: [39751.186544] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u2
Jul 25 03:04:39 b kernel: [39751.186603] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 25 03:04:39 b kernel: [39751.186674] apache2 D 0 2549 1 0x00000004
Jul 25 03:04:39 b kernel: [39751.186678] ffff8f105754a000 0000000000000000 ffff8f10150fa000 ffff8f105f258980
Jul 25 03:04:39 b kernel: [39751.186685] ffff8f105b646000 ffffacfcc3fb7d58 ffffffffa8615aa9 ffffffffa80bd17f
Jul 25 03:04:39 b kernel: [39751.186691] 00000000c0730155 ffff8f105f258980 ffff8f1057492710 ffff8f10150fa000
Jul 25 03:04:39 b kernel: [39751.186697] Call Trace:
Jul 25 03:04:39 b kernel: [39751.186705] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:04:39 b kernel: [39751.186710] [<ffffffffa80bd17f>] ? __wake_up_common+0x4f/0x90
Jul 25 03:04:39 b kernel: [39751.186716] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:04:39 b kernel: [39751.186725] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:04:39 b kernel: [39751.186730] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:04:39 b kernel: [39751.186738] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:04:39 b kernel: [39751.186746] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.186754] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.186760] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:04:39 b kernel: [39751.186766] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:04:39 b kernel: [39751.186771] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Jul 25 03:04:39 b kernel: [39751.186774] INFO: task apache2:2591 blocked for more than 120 seconds.
Jul 25 03:04:39 b kernel: [39751.186835] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u2
Jul 25 03:04:39 b kernel: [39751.186895] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 25 03:04:39 b kernel: [39751.186965] apache2 D 0 2591 1 0x00000004
Jul 25 03:04:39 b kernel: [39751.186970] ffff8f105567ec00 ffff8f105567ec00 ffff8f1055940140 ffff8f105f218980
Jul 25 03:04:39 b kernel: [39751.186976] ffff8f1015145000 ffffacfcc3f33d58 ffffffffa8615aa9 0000000000018980
Jul 25 03:04:39 b kernel: [39751.186982] 00000001c0730155 ffff8f105f218980 ffff8f101754f260 ffff8f1055940140
Jul 25 03:04:39 b kernel: [39751.186988] Call Trace:
Jul 25 03:04:39 b kernel: [39751.186996] [<ffffffffa8615aa9>] ? __schedule+0x239/0x6f0
Jul 25 03:04:39 b kernel: [39751.187002] [<ffffffffa8615f92>] ? schedule+0x32/0x80
Jul 25 03:04:39 b kernel: [39751.187010] [<ffffffffc07307ea>] ? request_wait_answer+0xba/0x1f0 [fuse]
Jul 25 03:04:39 b kernel: [39751.187016] [<ffffffffa80bd740>] ? prepare_to_wait_event+0xf0/0xf0
Jul 25 03:04:39 b kernel: [39751.187023] [<ffffffffc0730998>] ? __fuse_request_send+0x78/0x80 [fuse]
Jul 25 03:04:39 b kernel: [39751.187031] [<ffffffffc0733d2d>] ? fuse_simple_request+0xbd/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.187039] [<ffffffffc0739ed7>] ? fuse_setlk+0x177/0x190 [fuse]
Jul 25 03:04:39 b kernel: [39751.187045] [<ffffffffa826434a>] ? SyS_flock+0x11a/0x1a0
Jul 25 03:04:39 b kernel: [39751.187050] [<ffffffffa8003b7d>] ? do_syscall_64+0x8d/0x100
Jul 25 03:04:39 b kernel: [39751.187055] [<ffffffffa861a88e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
