Monitoring and Debugging

Log Management

If you have chosen to install the cluster via the provided installer, logs can be found on the host machine at:

- /var/log/pods or /var/log/containers - for the individual pods/containers;

- /var/log/apiserver - for the Kubernetes API server.

The application logs are ephemeral and connected with each application lifecycle. If the application is restarted, then its log will disappear. 

Troubleshooting

The Labforward support team can assist with support bundles. A support bundle is a compressed folder with relevant files intended to help investigate cluster issues, such as, but not limited to:

• Application logs;
• Replicated configurations;
• Cluster metadata;
• Kubernetes manifests.

The admin can create the support bundle at any moment and attach it to a support request.

Create Support Bundle

1. Open the admin console;

2. Press Troubleshooting → Support Bundles → Generate a support bundle. The support bundle will be created based on Replicated's configuration;

Send the Support Bundle to Labforward

There are two options to send the support bundle:

1. Send it directly to Labforward via the admin console. In this case, please inform in the support request that the support bundle was already sent:

2. Download and attach the tar.gz to the Labforward support request.

Host Support Bundle

In some situations, investigating some host details might be required, such as if the admin console is offline. In this scenario, use the Host Support Bundle, which is independent of Kubernetes.

To install it, run:

curl -L https://github.com/replicatedhq/troubleshoot/releases/latest/download/support-bundle_linux_amd64.tar.gz  | tar xzvf -

curl -L https://github.com/replicatedhq/troubleshoot/releases/latest/download/support-bundle_linux_amd64.tar.gz  | tar xzvf -

Then, run the following command to generate a tar file including information about the host:

./support-bundle --load-cluster-specs https://raw.githubusercontent.com/replicatedhq/troubleshoot-specs/main/in-cluster/default.yaml https://raw.githubusercontent.com/replicatedhq/troubleshoot-specs/main/host/default.yaml

The command above will collect data from the cluster and host. If it fails, the cluster is likely offline. In this case, collect the support bundle only for the host with the command:

./support-bundle https://raw.githubusercontent.com/replicatedhq/troubleshoot-specs/main/host/default.yaml

Redactors - Data Security

Multiple redactors review all data inside the support bundles. They will hide sensitive information, such as IPs, secrets, and passwords, preventing them from leaving the customer's domain. For more details, check Redactor (KOTS Only) | Replicated Docs .