oracle数据库故障不通然后恢复
访问量:1513
创建时间:2023-03-23
现象： oracle12数据库(安装在centos7上)系统，这两天偶尔有3-5分钟的不通告警。
很奇怪，一般情况下，数据库服务故障，操作系统其他监控应该正常(比如内存，cpu,网络等)，但是是其他监控也没有数据，而且服务卡了。本来以为是系统卡死，内存不够或者cpu卡了，看监控也没有问题，
查看/var/log/messages日志
Mar 22 14:50:01 myoracledb systemd: Started Session 12493 of user root.
Mar 22 15:00:01 myoracledb systemd: Started Session 12494 of user root.
Mar 22 15:01:01 myoracledb systemd: Started Session 12495 of user root.
Mar 22 15:09:49 myoracledb systemd: Time has been changed
Mar 22 15:11:58 myoracledb systemd: Time has been changed
Mar 22 15:12:12 myoracledb systemd: Started Session 12496 of user root.
Mar 22 15:13:28 myoracledb chronyd[7798]: Forward time jump detected!
Mar 22 15:13:28 myoracledb chronyd[7798]: Can't synchronise: no selectable sources
Mar 22 15:13:37 myoracledb systemd-logind: New session 12497 of user root.
Mar 22 15:13:37 myoracledb systemd: Started Session 12497 of user root.
Mar 22 15:13:37 myoracledb dbus[7681]: [system] Activating service name='org.freedesktop.problems' (using servicehelper)
Mar 22 15:13:37 myoracledb dbus[7681]: [system] Successfully activated service 'org.freedesktop.problems'
Mar 22 15:16:42 myoracledb chronyd[7798]: Selected source 5.79.108.34
Mar 22 15:16:42 myoracledb chronyd[7798]: System clock wrong by 5.577459 seconds, adjustment started
Mar 22 15:17:47 myoracledb chronyd[7798]: Selected source 119.28.206.193
排查是chronyd 同步时间导致系统故障。关闭chronyd服务
[root@myoracledb ~]# systemctl status chronyd
● chronyd.service - NTP client/server
Loaded: loaded (/usr/lib/systemd/system/chronyd.service; enabled; vendor preset: enabled)
Active: active (running) since 日 2023-01-08 01:49:24 CST; 2 months 13 days ago
Docs: man:chronyd(8)
man:chrony.conf(5)
Process: 7810 ExecStartPost=/usr/libexec/chrony-helper update-daemon (code=exited, status=0/SUCCESS)
Process: 7744 ExecStart=/usr/sbin/chronyd $OPTIONS (code=exited, status=0/SUCCESS)
Main PID: 7798 (chronyd)
Tasks: 1
CGroup: /system.slice/chronyd.service
└─7798 /usr/sbin/chronyd
1月 30 12:46:01 myoracledb chronyd[7798]: Source 193.182.111.143 replaced with 5.79.108.34
3月 22 15:13:28 myoracledb chronyd[7798]: Forward time jump detected!
3月 22 15:13:28 myoracledb chronyd[7798]: Can't synchronise: no selectable sources
3月 22 15:16:42 myoracledb chronyd[7798]: Selected source 5.79.108.34
3月 22 15:16:42 myoracledb chronyd[7798]: System clock wrong by 5.577459 seconds, adjustment started
3月 22 15:17:47 myoracledb chronyd[7798]: Selected source 119.28.206.193
3月 23 13:20:38 myoracledb chronyd[7798]: Forward time jump detected!
3月 23 13:20:38 myoracledb chronyd[7798]: Can't synchronise: no selectable sources
3月 23 13:23:52 myoracledb chronyd[7798]: Selected source 119.28.206.193
3月 23 13:23:52 myoracledb chronyd[7798]: System clock wrong by 5.809386 seconds, adjustment started
[root@myoracledb ~]# systemctl stop chronyd
[root@myoracledb ~]# systemctl disable chronyd
Removed symlink /etc/systemd/system/multi-user.target.wants/chronyd.service.
登陆评论:
使用GITHUB登陆