-
Bug
-
Resolution: Done
-
High
-
I was trying to run Ping xapp example in ric_plt_xapp_frame_py project (https://gerrit.o-ran-sc.org/r/gitweb?p=ric-plt%2Fxapp-frame-py.git;a=summary) and the xapp is going into crashloopback after few minutes without any error logs.
ricxappframe -py version (2.0.0)
issue is related to crashing of pod as explained below.
Following are the logs of the Ping xapp
root@near-rtric :~# kubectl logs -n ricxapp ricxapp-hw-python1-7f68697c57-scnkx --follow1642063682 1/RMR [INFO] ric message routing library on SI95/g mv=3 flg=02 (f25dc7f 4.0.5 built: May 7 2020) ping is healthy? True 1642063683 1/RMR [INFO] sends: ts=1642063683 src=service-ricxapp-hw-python1-rmr.ricxapp:4564 target=127.0.0.1:4562 open=0 succ=0 fail=0 (hard=0 soft=0) ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True 1642063714 1/RMR [INFO] sends: ts=1642063714 src=service-ricxapp-hw-python1-rmr.ricxapp:4564 target=127.0.0.1:4562 open=0 succ=0 fail=0 (hard=0 soft=0) ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True 1642063745 1/RMR [INFO] sends: ts=1642063745 src=service-ricxapp-hw-python1-rmr.ricxapp:4564 target=127.0.0.1:4562 open=0 succ=0 fail=0 (hard=0 soft=0) ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True ping is healthy? True root@near-rtric :~# cd E-Release/hw-python/root@near-rtric :~# kubectl get po -n ricxappNAME READY STATUS RESTARTS AGE ricxapp-hw-go-644cb685fb-clwsw 1/1 Running 0 19h ricxapp-hw-python1-7f68697c57-scnkx 0/1 CrashLoopBackOff 389 24h |
As you can see the Ping xapp runs for sometime and then without any error logs exits and goes into crashloopback.
Following is the output of describe pod.
| Events: Type Reason Age From Message ---- ------ ---- ---- ------- Warning Unhealthy 35m (x1861 over 24h) kubelet, near-rtric Readiness probe failed: Get http://10.244.0.100:8080/ric/v1/health/ready: dial tcp 10.244.0.100:8080: connect: connection refused Warning Unhealthy 5m50s (x1195 over 24h) kubelet, near-rtric Liveness probe failed: Get http://10.244.0.100:8080/ric/v1/health/alive: dial tcp 10.244.0.100:8080: connect: connection refused Warning BackOff 44s (x4931 over 24h) kubelet, near-rtric Back-off restarting failed container |
So its the Readiness and liveness probe failing.I tried to increase the initialDelaySeconds and periodSeconds but still no help.
