Recently, I applied some small updates that were due on a server that acts simply as a backup point for other servers in the network to export tarballs and the like. I have a couple NFS exports and the system has run quite stable. But after this last reboot it came back up but suddenly none of my other servers could connect to it. The nfs-service keeps failing on startup:
I wasn't sure if the rpc.nfsd was a service or not and it appears not to be:
so off to the logs I go:
I'm not using any NFSv4, and my export is pretty simple:
But there sure seems to be a lot of RPC errors from rpc.statd and the status of rpcbind is inactive and masked:
So I'm really stuck and I'm not sure what to consider next. It looks like rpcbind is having issues but I can't figure out how to decide why. Any wisdom would be greatly appreciated.
My system:
Code:
$ sudo systemctl status nfs-server× nfs-server.service - NFS server and services Loaded: loaded (/lib/systemd/system/nfs-server.service; enabled; preset: enabled) Drop-In: /run/systemd/generator/nfs-server.service.d └─order-with-mounts.conf Active: failed (Result: exit-code) since Wed 2024-06-05 12:46:12 PDT; 4min 34s ago Process: 528 ExecStartPre=/usr/sbin/exportfs -r (code=exited, status=0/SUCCESS) Process: 529 ExecStart=/usr/sbin/rpc.nfsd (code=exited, status=1/FAILURE) Process: 550 ExecStopPost=/usr/sbin/exportfs -au (code=exited, status=0/SUCCESS) Process: 551 ExecStopPost=/usr/sbin/exportfs -f (code=exited, status=0/SUCCESS) Main PID: 529 (code=exited, status=1/FAILURE) CPU: 14msJun 05 12:46:12 server3 systemd[1]: Starting nfs-server.service - NFS server and services...Jun 05 12:46:12 server3 rpc.nfsd[529]: rpc.nfsd: writing fd to kernel failed: errno 111 (Connection refused)Jun 05 12:46:12 server3 rpc.nfsd[529]: rpc.nfsd: unable to set any sockets for nfsdJun 05 12:46:12 server3 systemd[1]: nfs-server.service: Main process exited, code=exited, status=1/FAILUREJun 05 12:46:12 server3 systemd[1]: nfs-server.service: Failed with result 'exit-code'.Jun 05 12:46:12 server3 systemd[1]: Stopped nfs-server.service - NFS server and services.
Code:
$ sudo systemctl status rpc.nfsdUnit rpc.nfsd.service could not be found.
Code:
2024-06-05T13:45:01.918598-07:00 server3 systemd[1]: auth-rpcgss-module.service - Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab).2024-06-05T13:45:01.935181-07:00 server3 systemd[1]: Starting nfs-idmapd.service - NFSv4 ID-name mapping service...2024-06-05T13:45:01.943100-07:00 server3 systemd[1]: Starting nfs-mountd.service - NFS Mount Daemon...2024-06-05T13:45:01.943334-07:00 server3 rpc.idmapd[6345]: Setting log level to 02024-06-05T13:45:01.946211-07:00 server3 systemd[1]: rpc-gssd.service - RPC security service for NFS client and server was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab).2024-06-05T13:45:01.946324-07:00 server3 rpc.mountd[6344]: Failed to register (mountd, 1, udp): svc_reg() err: RPC: Remote system error - Connection refused2024-06-05T13:45:01.946626-07:00 server3 systemd[1]: Starting rpc-statd.service - NFS status monitor for NFSv2/3 locking....2024-06-05T13:45:01.946683-07:00 server3 rpc.mountd[6344]: Failed to register (mountd, 1, tcp): svc_reg() err: RPC: Remote system error - Connection refused2024-06-05T13:45:01.946934-07:00 server3 systemd[1]: rpc-svcgssd.service - RPC security service for NFS server was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab).2024-06-05T13:45:01.946985-07:00 server3 rpc.mountd[6344]: Failed to register (mountd, 1, udp6): svc_reg() err: RPC: Remote system error - Connection refused2024-06-05T13:45:01.947020-07:00 server3 systemd[1]: Started nfs-idmapd.service - NFSv4 ID-name mapping service.2024-06-05T13:45:01.947060-07:00 server3 rpc.mountd[6344]: Failed to register (mountd, 1, tcp6): svc_reg() err: RPC: Remote system error - Connection refused2024-06-05T13:45:01.947086-07:00 server3 systemd[1]: Started nfs-mountd.service - NFS Mount Daemon.2024-06-05T13:45:01.947121-07:00 server3 rpc.mountd[6344]: Failed to register (mountd, 2, udp): svc_reg() err: RPC: Remote system error - Connection refused2024-06-05T13:45:01.947146-07:00 server3 systemd[1]: rpc-statd.service: Control process exited, code=exited, status=1/FAILURE2024-06-05T13:45:01.947190-07:00 server3 rpc.mountd[6344]: Failed to register (mountd, 2, tcp): svc_reg() err: RPC: Remote system error - Connection refused2024-06-05T13:45:01.947216-07:00 server3 systemd[1]: rpc-statd.service: Failed with result 'exit-code'.2024-06-05T13:45:01.947248-07:00 server3 rpc.mountd[6344]: Failed to register (mountd, 2, udp6): svc_reg() err: RPC: Remote system error - Connection refused2024-06-05T13:45:01.947278-07:00 server3 systemd[1]: Failed to start rpc-statd.service - NFS status monitor for NFSv2/3 locking..2024-06-05T13:45:01.947313-07:00 server3 rpc.mountd[6344]: Failed to register (mountd, 2, tcp6): svc_reg() err: RPC: Remote system error - Connection refused2024-06-05T13:45:01.947337-07:00 server3 systemd[1]: Starting nfs-server.service - NFS server and services...2024-06-05T13:45:01.948596-07:00 server3 rpc.mountd[6344]: Failed to register (mountd, 3, udp): svc_reg() err: RPC: Remote system error - Connection refused2024-06-05T13:45:01.948685-07:00 server3 rpc.mountd[6344]: Failed to register (mountd, 3, tcp): svc_reg() err: RPC: Remote system error - Connection refused2024-06-05T13:45:01.948893-07:00 server3 rpc.mountd[6344]: Failed to register (mountd, 3, udp6): svc_reg() err: RPC: Remote system error - Connection refused2024-06-05T13:45:01.948967-07:00 server3 rpc.statd[6347]: Version 2.6.2 starting2024-06-05T13:45:01.949007-07:00 server3 rpc.statd[6347]: Flags: TI-RPC2024-06-05T13:45:01.949038-07:00 server3 rpc.mountd[6344]: Failed to register (mountd, 3, tcp6): svc_reg() err: RPC: Remote system error - Connection refused2024-06-05T13:45:01.949062-07:00 server3 rpc.mountd[6344]: mountd: No V2 or V3 listeners created!2024-06-05T13:45:01.949227-07:00 server3 rpc.mountd[6348]: Version 2.6.2 starting2024-06-05T13:45:01.949307-07:00 server3 rpc.statd[6347]: Failed to register (statd, 1, udp): svc_reg() err: RPC: Remote system error - Connection refused2024-06-05T13:45:01.949335-07:00 server3 rpc.statd[6347]: Failed to register (statd, 1, tcp): svc_reg() err: RPC: Remote system error - Connection refused2024-06-05T13:45:01.949359-07:00 server3 rpc.statd[6347]: Failed to register (statd, 1, udp6): svc_reg() err: RPC: Remote system error - Connection refused2024-06-05T13:45:01.949383-07:00 server3 rpc.statd[6347]: Failed to register (statd, 1, tcp6): svc_reg() err: RPC: Remote system error - Connection refused2024-06-05T13:45:01.949408-07:00 server3 rpc.statd[6347]: failed to create RPC listeners, exiting2024-06-05T13:45:01.950718-07:00 server3 kernel: [ 3532.882449] svc: failed to register nfsdv3 RPC service (errno 111).2024-06-05T13:45:01.950726-07:00 server3 kernel: [ 3532.882472] svc: failed to register nfsaclv3 RPC service (errno 111).2024-06-05T13:45:01.980874-07:00 server3 rpc.nfsd[6350]: rpc.nfsd: writing fd to kernel failed: errno 111 (Connection refused)2024-06-05T13:45:01.980948-07:00 server3 rpc.nfsd[6350]: rpc.nfsd: unable to set any sockets for nfsd2024-06-05T13:45:01.981021-07:00 server3 systemd[1]: nfs-server.service: Main process exited, code=exited, status=1/FAILURE2024-06-05T13:45:01.985394-07:00 server3 systemd[1]: nfs-server.service: Failed with result 'exit-code'.2024-06-05T13:45:01.985654-07:00 server3 systemd[1]: Stopped nfs-server.service - NFS server and services.2024-06-05T13:45:01.986072-07:00 server3 rpc.idmapd[6345]: exiting on signal 152024-06-05T13:45:01.986217-07:00 server3 systemd[1]: Stopping nfs-idmapd.service - NFSv4 ID-name mapping service...2024-06-05T13:45:01.986352-07:00 server3 systemd[1]: Stopping nfs-mountd.service - NFS Mount Daemon...2024-06-05T13:45:01.986640-07:00 server3 systemd[1]: nfs-idmapd.service: Deactivated successfully.2024-06-05T13:45:01.986736-07:00 server3 rpc.mountd[6348]: Caught signal 15, un-registering and exiting.2024-06-05T13:45:01.986867-07:00 server3 systemd[1]: Stopped nfs-idmapd.service - NFSv4 ID-name mapping service.2024-06-05T13:45:02.007528-07:00 server3 systemd[1]: nfs-mountd.service: Deactivated successfully.2024-06-05T13:45:02.007763-07:00 server3 systemd[1]: Stopped nfs-mountd.service - NFS Mount Daemon.
Code:
/mnt/vol01 192.168.8.11(rw,no_root_squash,subtree_check)
Code:
$ sudo systemctl status rpcbind○ rpcbind.service Loaded: masked (Reason: Unit rpcbind.service is masked.) Active: inactive (dead)
My system:
Code:
$ uname -aLinux server3 6.1.0-21-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.90-1 (2024-05-03) x86_64 GNU/Linux
Statistics: Posted by Gorf — 2024-06-05 20:52 — Replies 1 — Views 39