Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] mongo cluster cannot get RECOVERABLE-TIME with datafile logfile backup #4984

Closed
JashBook opened this issue Sep 4, 2023 · 1 comment
Assignees
Labels
bug kind/bug Something isn't working
Milestone

Comments

@JashBook
Copy link
Collaborator

JashBook commented Sep 4, 2023

Describe the bug
mongo cluster cannot get RECOVERABLE-TIME with datafile logfile backup

kbcli version
Kubernetes: v1.26.3-aliyun.1
KubeBlocks: 0.6.2-beta.0
kbcli: 0.6.2-beta.0

To Reproduce
Steps to reproduce the behavior:

  1. create mongo cluster
  2. enable logfile schedule
  3. datafile backup
  4. Insert data every 5s
  5. See error
    describe cluster
kbcli cluster describe mongo-mluszj
Name: mongo-mluszj	 Created Time: Sep 04,2023 10:28 UTC+0800
NAMESPACE   CLUSTER-DEFINITION   VERSION       STATUS    TERMINATION-POLICY   
default     mongodb              mongodb-5.0   Running   WipeOut              

Endpoints:
COMPONENT   MODE        INTERNAL                                               EXTERNAL   
mongodb     ReadWrite   mongo-mluszj-mongodb.default.svc.cluster.local:27017   <none>     

Topology:
COMPONENT   INSTANCE                 ROLE        STATUS    AZ                 NODE                                       CREATED-TIME                 
mongodb     mongo-mluszj-mongodb-0   primary     Running   cn-zhangjiakou-a   cn-zhangjiakou.192.168.0.11/192.168.0.11   Sep 04,2023 10:28 UTC+0800   
mongodb     mongo-mluszj-mongodb-1   secondary   Running   cn-zhangjiakou-a   cn-zhangjiakou.192.168.0.10/192.168.0.10   Sep 04,2023 10:28 UTC+0800   
mongodb     mongo-mluszj-mongodb-2   secondary   Running   cn-zhangjiakou-a   cn-zhangjiakou.192.168.0.9/192.168.0.9     Sep 04,2023 10:28 UTC+0800   

Resources Allocation:
COMPONENT   DEDICATED   CPU(REQUEST/LIMIT)   MEMORY(REQUEST/LIMIT)   STORAGE-SIZE   STORAGE-CLASS   
mongodb     false       100m / 100m          512Mi / 512Mi           data:20Gi      kb-default-sc   

Images:
COMPONENT   TYPE      IMAGE                                                     
mongodb     mongodb   registry.cn-hangzhou.aliyuncs.com/apecloud/mongo:5.0.14   

Data Protection:
AUTO-BACKUP   BACKUP-SCHEDULE   TYPE     BACKUP-TTL   LAST-SCHEDULE   RECOVERABLE-TIME   
Disabled      <none>            <none>   7d           <none>          <none>             

Show cluster events: kbcli cluster list-events -n default mongo-mluszj

get logfile backup yaml

kubectl get backup 8500f671-mongo-mluszj-default-logfile  -oyaml     
apiVersion: dataprotection.kubeblocks.io/v1alpha1
kind: Backup
metadata:
  annotations:
    dataprotection.kubeblocks.io/target-pod-name: mongo-mluszj-mongodb-0
    kubeblocks.io/cluster-snapshot: '{"metadata":{"name":"mongo-mluszj","namespace":"default","creationTimestamp":null},"spec":{"clusterDefinitionRef":"mongodb","clusterVersionRef":"mongodb-5.0","terminationPolicy":"WipeOut","componentSpecs":[{"name":"mongodb","componentDefRef":"mongodb","replicas":3,"resources":{"limits":{"cpu":"100m","memory":"512Mi"},"requests":{"cpu":"100m","memory":"512Mi"}},"volumeClaimTemplates":[{"name":"data","spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"20Gi"}}}}],"serviceAccountName":"kb-mongo-mluszj"}],"affinity":{"podAntiAffinity":"Preferred","tenancy":"SharedNode"},"resources":{"cpu":"0","memory":"0"},"storage":{"size":"0"},"monitor":{}},"status":{}}'
    kubeblocks.io/reconcile: "2023-09-04T02:35:36.804278107Z"
  creationTimestamp: "2023-09-04T02:34:24Z"
  generation: 1
  labels:
    app.kubernetes.io/instance: mongo-mluszj
    app.kubernetes.io/managed-by: kubeblocks
    apps.kubeblocks.io/component-name: mongodb
    dataprotection.kubeblocks.io/autobackup: "true"
    dataprotection.kubeblocks.io/backup-policy: mongo-mluszj-mongodb-backup-policy
    dataprotection.kubeblocks.io/backup-repo-name: backuprepo-kbcli-test
    dataprotection.kubeblocks.io/backup-type: logfile
    dataprotection.kubeblocks.io/cluster-uid: 8500f671-f06f-4a39-b411-d58e230df3dd
  name: 8500f671-mongo-mluszj-default-logfile
  namespace: default
  resourceVersion: "5990092"
  uid: 485c7f6f-cd45-4c68-b333-a6cba48f882d
spec:
  backupPolicyName: mongo-mluszj-mongodb-backup-policy
  backupType: logfile
status:
  availableReplicas: 1
  backupToolName: mongodb-pitr-backup-tool
  expiration: "2023-09-11T02:34:24Z"
  manifests:
    backupLog:
      startTime: "2023-09-04T02:34:30Z"
      stopTime: "2023-09-04T02:52:22Z"
    backupTool:
      filePath: /default/mongo-mluszj-8500f671-f06f-4a39-b411-d58e230df3dd/mongodb/8500f671-mongo-mluszj-default-logfile
      uploadTotalSize: 29K
      volumeName: pvc-898b8108-c236-4d1c-bc93-37f084930cac
  persistentVolumeClaimName: pvc-backuprepo-kbcli-test-m9xnxk
  phase: Running
  sourceCluster: mongo-mluszj
  startTimestamp: "2023-09-04T02:34:24Z"
  totalSize: 29K

get datafile backup yaml

kubectl get backup backup-default-mongo-mluszj-20230904103536 -o yaml
apiVersion: dataprotection.kubeblocks.io/v1alpha1
kind: Backup
metadata:
  annotations:
    dataprotection.kubeblocks.io/target-pod-name: mongo-mluszj-mongodb-0
    kubeblocks.io/cluster-snapshot: '{"metadata":{"name":"mongo-mluszj","namespace":"default","creationTimestamp":null},"spec":{"clusterDefinitionRef":"mongodb","clusterVersionRef":"mongodb-5.0","terminationPolicy":"WipeOut","componentSpecs":[{"name":"mongodb","componentDefRef":"mongodb","replicas":3,"resources":{"limits":{"cpu":"100m","memory":"512Mi"},"requests":{"cpu":"100m","memory":"512Mi"}},"volumeClaimTemplates":[{"name":"data","spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"20Gi"}}}}],"serviceAccountName":"kb-mongo-mluszj"}],"affinity":{"podAntiAffinity":"Preferred","tenancy":"SharedNode"},"resources":{"cpu":"0","memory":"0"},"storage":{"size":"0"},"monitor":{}},"status":{}}'
  creationTimestamp: "2023-09-04T02:35:37Z"
  finalizers:
  - dataprotection.kubeblocks.io/finalizer
  generation: 1
  labels:
    app.kubernetes.io/instance: mongo-mluszj
    app.kubernetes.io/managed-by: kubeblocks
    apps.kubeblocks.io/component-name: mongodb
    dataprotection.kubeblocks.io/backup-repo-name: backuprepo-kbcli-test
    dataprotection.kubeblocks.io/backup-type: datafile
    dataprotection.kubeblocks.io/cluster-uid: 8500f671-f06f-4a39-b411-d58e230df3dd
    kubeblocks.io/backup-protection: retain
  name: backup-default-mongo-mluszj-20230904103536
  namespace: default
  resourceVersion: "5983894"
  uid: 4349a595-fe02-4825-af04-83d1f8ea27b6
spec:
  backupPolicyName: mongo-mluszj-mongodb-backup-policy
  backupType: datafile
status:
  backupToolName: mongodb-physical-backup-tool
  completionTimestamp: "2023-09-04T02:35:45Z"
  duration: 9s
  expiration: "2023-09-11T02:35:37Z"
  manifests:
    backupTool:
      filePath: /default/mongo-mluszj-8500f671-f06f-4a39-b411-d58e230df3dd/mongodb/backup-default-mongo-mluszj-20230904103536
      volumeName: pvc-898b8108-c236-4d1c-bc93-37f084930cac
  persistentVolumeClaimName: pvc-backuprepo-kbcli-test-m9xnxk
  phase: Completed
  sourceCluster: mongo-mluszj
  startTimestamp: "2023-09-04T02:35:37Z"

Expected behavior
mongo cluster datafile logfile backup success.

Screenshots
If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

  • OS: [e.g. iOS]
  • Browser [e.g. chrome, safari]
  • Version [e.g. 22]

Additional context
Add any other context about the problem here.

@JashBook JashBook added the kind/bug Something isn't working label Sep 4, 2023
@JashBook JashBook added this to the Release 0.7.0 milestone Sep 4, 2023
@wangyelei
Copy link
Contributor

fixed at release 0.6

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug kind/bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants