API version compatibility fix

sameershaikh@Sameers-MacBook-Pro eni % kubectl apply -f csi_file_1.1.5_staging.yaml
configmap/ibm-vpc-file-csi-configmap created
serviceaccount/ibm-vpc-file-node-sa created
clusterrole.rbac.authorization.k8s.io/vpc-file-driver-registrar-role created
clusterrolebinding.rbac.authorization.k8s.io/vpc-file-driver-registrar-binding created
clusterrole.rbac.authorization.k8s.io/vpc-file-external-resizer-role created
clusterrolebinding.rbac.authorization.k8s.io/vpc-file-external-resizer-binding created
serviceaccount/ibm-vpc-file-controller-sa created
clusterrole.rbac.authorization.k8s.io/vpc-file-provisioner-role created
clusterrolebinding.rbac.authorization.k8s.io/vpc-file-provisioner-binding created
csidriver.storage.k8s.io/vpc.file.csi.ibm.io created
daemonset.apps/ibm-vpc-file-csi-node created
deployment.apps/ibm-vpc-file-csi-controller created
storageclass.storage.k8s.io/ibmc-vpc-file-10iops-tier created
storageclass.storage.k8s.io/ibmc-vpc-file-5iops-tier created
storageclass.storage.k8s.io/ibmc-vpc-file-3iops-tier created
storageclass.storage.k8s.io/ibmc-vpc-file-dp-profile unchanged
storageclass.storage.k8s.io/ibmc-vpc-file-retain-10iops-tier created
storageclass.storage.k8s.io/ibmc-vpc-file-retain-5iops-tier created
storageclass.storage.k8s.io/ibmc-vpc-file-retain-3iops-tier created
storageclass.storage.k8s.io/ibmc-vpc-file-retain-dp-profile unchanged
storageclass.storage.k8s.io/ibmc-vpc-file-custom created

sameershaikh@Sameers-MacBook-Pro eni % kubectl describe pod ibm-vpc-file-csi-controller-74594f7db-2nvxz -n kube-system
Name:                 ibm-vpc-file-csi-controller-74594f7db-2nvxz
Namespace:            kube-system
Priority:<PHONE_NUMBER>
Priority Class Name:  system-cluster-critical
Service Account:      ibm-vpc-file-controller-sa
Node:                 <IP_ADDRESS>/<IP_ADDRESS>
Start Time:           Wed, 19 Jul 2023 13:16:03 +0530
Labels:               app=ibm-vpc-file-csi-controller
                      app.kubernetes.io/name=ibm-vpc-file-csi-driver
                      pod-template-hash=74594f7db
Annotations:          cni.projectcalico.org/containerID: 21de54920f331a115e8a7c1481f0c7c07c6a9af55c687912e92115335bb698db
                      cni.projectcalico.org/podIP: <IP_ADDRESS>/32
                      cni.projectcalico.org/podIPs: <IP_ADDRESS>/32
Status:               Running
IP:                   <IP_ADDRESS>
IPs:
  IP:           <IP_ADDRESS>
Controlled By:  ReplicaSet/ibm-vpc-file-csi-controller-74594f7db
Containers:
  csi-provisioner:
    Container ID:  containerd://74ef4ebe9a7df2f21594f80e1a17232b4b42016b41b6574361b8106a763126cf
    Image:         icr.io/ext/sig-storage/csi-provisioner:v3.4.1
    Image ID:      icr.io/ext/sig-storage/csi-provisioner@sha256:df1110dc0ddbe261bb636c6b10bd6f34f01fab5eeddf3f087ca5fd9df5835aca
    Port:          <none>
    Host Port:     <none>
    Args:
      --v=5
      --csi-address=$(ADDRESS)
      --timeout=600s
      --feature-gates=Topology=true
      --leader-election=true
    State:          Running
      Started:      Wed, 19 Jul 2023 13:16:05 +0530
    Ready:          True
    Restart Count:  0
    Limits:
      cpu:     80m
      memory:  160Mi
    Requests:
      cpu:     20m
      memory:  40Mi
    Environment:
      ADDRESS:  /csi/csi-vpc-file.sock
    Mounts:
      /csi from socket-dir (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-kvc5v (ro)
  csi-resizer:
    Container ID:  containerd://026bbc9cd6caa5b7821d75c93f35b94443681d6afb21dcd7672de0454585f593
    Image:         icr.io/ext/sig-storage/csi-resizer:v1.7.0
    Image ID:      icr.io/ext/sig-storage/csi-resizer@sha256:0c01b8ad3aea43b0cf7fc24a96c159d8975852eb6215eba6e27ca552776515de
    Port:          <none>
    Host Port:     <none>
    Args:
      --v=5
      --csi-address=/csi/csi-vpc-file.sock
      --timeout=900s
    State:          Running
      Started:      Wed, 19 Jul 2023 13:16:06 +0530
    Ready:          True
    Restart Count:  0
    Limits:
      cpu:     80m
      memory:  160Mi
    Requests:
      cpu:        20m
      memory:     40Mi
    Environment:  <none>
    Mounts:
      /csi from socket-dir (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-kvc5v (ro)
  liveness-probe:
    Container ID:  containerd://8da40c33ed7b2a9157980521dd385cd51dc8188912cb9333b3b37e578c717c32
    Image:         icr.io/ext/sig-storage/livenessprobe:v2.9.0
    Image ID:      icr.io/ext/sig-storage/livenessprobe@sha256:cb76cd4aaa340ad0b3d95f554924946ae39f5ed5ed5cdf0fb30b0db7214d64aa
    Port:          <none>
    Host Port:     <none>
    Args:
      --csi-address=/csi/csi-vpc-file.sock
    State:          Running
      Started:      Wed, 19 Jul 2023 13:16:06 +0530
    Ready:          True
    Restart Count:  0
    Limits:
      cpu:     20m
      memory:  40Mi
    Requests:
      cpu:        5m
      memory:     10Mi
    Environment:  <none>
    Mounts:
      /csi from socket-dir (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-kvc5v (ro)
  iks-vpc-file-driver:
    Container ID:  containerd://af91cfc06a76bad7f2bd3a8d7856ccee91b11b9cdac9285c3c4b0edfae258f65
    Image:         sam3984/ibm-vpc-file-csi-driver:api-final
    Image ID:      docker.io/sam3984/ibm-vpc-file-csi-driver@sha256:6ede8aa6b4fa35bd40d75224a742d28e82ff9c87a6e4fb0cfe74ccd3a931f67c
    Port:          9808/TCP
    Host Port:     0/TCP
    Args:
      --v=5
      --endpoint=$(CSI_ENDPOINT)
      --lock_enabled=false
      --sidecarEndpoint=$(SIDECAREP)
    State:          Running
      Started:      Wed, 19 Jul 2023 13:16:06 +0530
    Ready:          True
    Restart Count:  0
    Limits:
      cpu:     300m
      memory:  600Mi
    Requests:
      cpu:     75m
      memory:  150Mi
    Liveness:  http-get http://:healthz/healthz delay=10s timeout=3s period=10s #success=1 #failure=5
    Environment Variables from:
      ibm-vpc-file-csi-configmap  ConfigMap  Optional: false
      ibm-cloud-provider-data     ConfigMap  Optional: false
    Environment:
      SIDECAREP:      /csi/providerfile.sock
      POD_NAME:       ibm-vpc-file-csi-controller-74594f7db-2nvxz (v1:metadata.name)
      POD_NAMESPACE:  kube-system (v1:metadata.namespace)
      VPC_ID:         <set to the key 'vpc_id' of config map 'ibm-cloud-provider-data'>  Optional: false
    Mounts:
      /csi from socket-dir (rw)
      /etc/storage_ibmc from customer-auth (ro)
      /etc/storage_ibmc/cluster_info from cluster-info (ro)
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-kvc5v (ro)
      /var/run/secrets/tokens from vault-token (rw)
  storage-secret-sidecar:
    Container ID:  containerd://42dbce774c20967d289e85eda29404bac5f745601a4d0801cf63c9ad565dc251
    Image:         icr.io/obs/armada-storage-secret:v1.2.24
    Image ID:      icr.io/obs/armada-storage-secret@sha256:13877a9bdbc721d45ee926ec30c5ecb70d67dab5d96508385368971f1f23f633
    Port:          <none>
    Host Port:     <none>
    Args:
      --endpoint=$(ENDPOINT)
    State:          Running
      Started:      Wed, 19 Jul 2023 13:16:07 +0530
    Ready:          True
    Restart Count:  0
    Limits:
      cpu:     12m
      memory:  20Mi
    Requests:
      cpu:     3m
      memory:  5Mi
    Environment:
      ENDPOINT:  unix:/sidecardir/providerfile.sock
    Mounts:
      /etc/storage_ibmc from customer-auth (ro)
      /sidecardir from socket-dir (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-kvc5v (ro)
      /var/run/secrets/tokens from vault-token (rw)
Conditions:
  Type              Status
  Initialized       True
  Ready             True
  ContainersReady   True
  PodScheduled      True
Volumes:
  socket-dir:
    Type:       EmptyDir (a temporary directory that shares a pod's lifetime)
    Medium:
    SizeLimit:  <unset>
  customer-auth:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  storage-secret-store
    Optional:    false
  cluster-info:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      cluster-info
    Optional:  false
  vault-token:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  600
  kube-api-access-kvc5v:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   Burstable
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 600s
                             node.kubernetes.io/unreachable:NoExecute op=Exists for 600s
Events:
  Type    Reason     Age    From               Message
  ----    ------     ----   ----               -------
  Normal  Scheduled  2m22s  default-scheduler  Successfully assigned kube-system/ibm-vpc-file-csi-controller-74594f7db-2nvxz to <IP_ADDRESS>
  Normal  Pulling    2m21s  kubelet            Pulling image "icr.io/ext/sig-storage/csi-provisioner:v3.4.1"
  Normal  Pulled     2m20s  kubelet            Successfully pulled image "icr.io/ext/sig-storage/csi-provisioner:v3.4.1" in 336.507134ms (336.518011ms including waiting)
  Normal  Created    2m20s  kubelet            Created container csi-provisioner
  Normal  Started    2m20s  kubelet            Started container csi-provisioner
  Normal  Pulling    2m20s  kubelet            Pulling image "icr.io/ext/sig-storage/csi-resizer:v1.7.0"
  Normal  Pulled     2m20s  kubelet            Successfully pulled image "icr.io/ext/sig-storage/csi-resizer:v1.7.0" in 343.686091ms (343.708092ms including waiting)
  Normal  Created    2m20s  kubelet            Created container csi-resizer
  Normal  Started    2m19s  kubelet            Started container csi-resizer
  Normal  Pulled     2m19s  kubelet            Container image "icr.io/ext/sig-storage/livenessprobe:v2.9.0" already present on machine
  Normal  Created    2m19s  kubelet            Created container liveness-probe
  Normal  Started    2m19s  kubelet            Started container liveness-probe
  Normal  Pulling    2m19s  kubelet            Pulling image "sam3984/ibm-vpc-file-csi-driver:api-final"
  Normal  Pulled     2m19s  kubelet            Successfully pulled image "sam3984/ibm-vpc-file-csi-driver:api-final" in 392.11668ms (392.130163ms including waiting)
  Normal  Created    2m19s  kubelet            Created container iks-vpc-file-driver
  Normal  Started    2m19s  kubelet            Started container iks-vpc-file-driver
  Normal  Pulling    2m19s  kubelet            Pulling image "icr.io/obs/armada-storage-secret:v1.2.24"
  Normal  Pulled     2m18s  kubelet            Successfully pulled image "icr.io/obs/armada-storage-secret:v1.2.24" in 316.449315ms (316.492544ms including waiting)
  Normal  Created    2m18s  kubelet            Created container storage-secret-sidecar
  Normal  Started    2m18s  kubelet            Started container storage-secret-sidecar
sameershaikh@Sameers-MacBook-Pro eni % kubectl get pvc
NAME            STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS                  AGE
pv-file-1       Bound    pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd   10Gi       RWX            ibmc-vpc-file-5iops-tier      3h48m
pv-file-5       Bound    pvc-172f7a9e-c01d-463b-8b92-fa3d7390ea47   10Gi       RWX            ibmc-vpc-file-5iops-tier      14h
volume-secret   Bound    pvc-1fa0c036-cfbc-4682-8fca-2c4ae75f9d70   10Gi       RWX            ibmc-vpc-file-dp-eni-custom   20h
sameershaikh@Sameers-MacBook-Pro eni % kubectl get pods -o wide
NAME                          READY   STATUS    RESTARTS   AGE     IP             NODE         NOMINATED NODE   READINESS GATES
testpodrwm-85bc7b9d76-j76z6   1/1     Running   0          3h46m   <IP_ADDRESS>   <IP_ADDRESS>   <none>           <none>
testpodrwm-85bc7b9d76-k542q   1/1     Running   0          3h46m   <IP_ADDRESS>   <IP_ADDRESS>   <none>           <none>
testpodrwm-85bc7b9d76-msfxh   1/1     Running   0          3h46m   <IP_ADDRESS>   <IP_ADDRESS>   <none>           <none>
sameershaikh@Sameers-MacBook-Pro eni %

Volume Expansion of existing profiles
sameershaikh@Sameers-MacBook-Pro demo % kubectl edit pvc pv-file-1
persistentvolumeclaim/pv-file-1 edited
sameershaikh@Sameers-MacBook-Pro demo %

{"level":"info","ts":"2023-07-19T07:55:38.237Z","caller":"vpcfilevolume/get_file_share.go:46","msg":"Equivalent curl command","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707","URL":"https://us-south-stage01.private.iaasdev.cloud.ibm.com/v1/shares/%7Bshare-id%7D?generation=2&maturity=beta&version=2023-05-30","Operation":{"Name":"GetFileShare","Method":"GET","PathPattern":"/v1/shares/{share-id}"}}
{"level":"info","ts":"2023-07-19T07:55:39.117Z","caller":"provider/get_volume.go:51","msg":"Successfully retrieved volume details from VPC backend","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707","VolumeDetails":{"crn":"crn:v1:staging:public:is:us-south-1:a/77f2bceddaeb577dcaddb4073fe82c1c::share:r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/shares/r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1","id":"r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1","name":"pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd","size":10,"iops":3000,"resource_group":{"href":"https://resource-controller.test.cloud.ibm.com/v2/resource_groups/300b9469ee8676f9a038ecdf408c1a9d","id":"300b9469ee8676f9a038ecdf408c1a9d","name":"Default"},"initial_owner":{},"profile":{"href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/share/profiles/tier-5iops","name":"tier-5iops"},"created_at":"2023-07-19T04:00:07Z","lifecycle_state":"stable","mount_targets":[{"id":"r134-09a2016b-620f-4351-821f-15ff22dba7ed","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/shares/r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1/mount_targets/r134-09a2016b-620f-4351-821f-15ff22dba7ed","name":"vending-enviably-uncouth-ceremony"}],"zone":{"name":"us-south-1","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/regions/us-south/zones/us-south-1"}}}
{"level":"info","ts":"2023-07-19T07:55:39.118Z","caller":"provider/util.go:274","msg":"Entry of FromProviderToLibVolumeAccessPoint method...","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707"}
{"level":"info","ts":"2023-07-19T07:55:39.118Z","caller":"provider/util.go:302","msg":"Exit from FromProviderToLibVolumeAccessPoint method...","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707"}
{"level":"info","ts":"2023-07-19T07:55:39.118Z","caller":"provider/get_volume.go:32","msg":"Basic validation for volume ID...","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707","VolumeID":"r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1"}
{"level":"info","ts":"2023-07-19T07:55:39.118Z","caller":"provider/get_volume.go:39","msg":"Getting volume details from VPC provider...","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707","VolumeID":"r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1"}
{"level":"info","ts":"2023-07-19T07:55:39.118Z","caller":"vpcfilevolume/get_file_share.go:46","msg":"Equivalent curl command","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707","URL":"https://us-south-stage01.private.iaasdev.cloud.ibm.com/v1/shares/%7Bshare-id%7D?generation=2&maturity=beta&version=2023-05-30","Operation":{"Name":"GetFileShare","Method":"GET","PathPattern":"/v1/shares/{share-id}"}}
2023/07/19 07:55:39 TIME TAKEN BY FUNCTION GetFileShare IS 880.667942ms
2023/07/19 07:55:39 TIME TAKEN BY FUNCTION GetFileShare IS 447.141441ms
{"level":"info","ts":"2023-07-19T07:55:39.565Z","caller":"provider/get_volume.go:51","msg":"Successfully retrieved volume details from VPC backend","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707","VolumeDetails":{"crn":"crn:v1:staging:public:is:us-south-1:a/77f2bceddaeb577dcaddb4073fe82c1c::share:r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/shares/r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1","id":"r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1","name":"pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd","size":20,"iops":3000,"resource_group":{"href":"https://resource-controller.test.cloud.ibm.com/v2/resource_groups/300b9469ee8676f9a038ecdf408c1a9d","id":"300b9469ee8676f9a038ecdf408c1a9d","name":"Default"},"initial_owner":{},"profile":{"href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/share/profiles/tier-5iops","name":"tier-5iops"},"created_at":"2023-07-19T04:00:07Z","lifecycle_state":"updating","mount_targets":[{"id":"r134-09a2016b-620f-4351-821f-15ff22dba7ed","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/shares/r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1/mount_targets/r134-09a2016b-620f-4351-821f-15ff22dba7ed","name":"vending-enviably-uncouth-ceremony"}],"zone":{"name":"us-south-1","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/regions/us-south/zones/us-south-1"}}}
{"level":"info","ts":"2023-07-19T07:55:39.565Z","caller":"provider/util.go:274","msg":"Entry of FromProviderToLibVolumeAccessPoint method...","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707"}
{"level":"info","ts":"2023-07-19T07:55:39.565Z","caller":"provider/util.go:302","msg":"Exit from FromProviderToLibVolumeAccessPoint method...","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707"}
{"level":"info","ts":"2023-07-19T07:55:39.565Z","caller":"provider/expand_volume.go:50","msg":"Successfully validated inputs for ExpandVolume request... ","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707"}
{"level":"info","ts":"2023-07-19T07:55:39.565Z","caller":"provider/expand_volume.go:59","msg":"Calling VPC provider for volume expand...","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707"}
{"level":"info","ts":"2023-07-19T07:55:39.565Z","caller":"vpcfilevolume/expand_volume.go:47","msg":"Equivalent curl command and payload details","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707","URL":"https://us-south-stage01.private.iaasdev.cloud.ibm.com/v1/shares/r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1?generation=2&maturity=beta&version=2023-05-30","Payload":{"size":20},"Operation":{"Name":"ExpandVolume","Method":"PATCH","PathPattern":"/v1/shares/{share-id}"}}
2023/07/19 07:55:39 TIME TAKEN BY FUNCTION ExpandVolume IS 374.659792ms
{"level":"info","ts":"2023-07-19T07:55:39.940Z","caller":"provider/expand_volume.go:71","msg":"Successfully accepted volume expansion request, now waiting for volume state equal to available","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707"}
{"level":"info","ts":"2023-07-19T07:55:39.940Z","caller":"provider/wait_for_valid_volume_state.go:35","msg":"Getting file share details from VPC file provider...","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707","VolumeID":"r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1"}
{"level":"info","ts":"2023-07-19T07:55:39.940Z","caller":"vpcfilevolume/get_file_share.go:46","msg":"Equivalent curl command","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707","URL":"https://us-south-stage01.private.iaasdev.cloud.ibm.com/v1/shares/%7Bshare-id%7D?generation=2&maturity=beta&version=2023-05-30","Operation":{"Name":"GetFileShare","Method":"GET","PathPattern":"/v1/shares/{share-id}"}}
2023/07/19 07:55:40 TIME TAKEN BY FUNCTION GetFileShare IS 298.323704ms
{"level":"info","ts":"2023-07-19T07:55:40.238Z","caller":"provider/wait_for_valid_volume_state.go:43","msg":"Getting file share details from VPC provider...","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707","volume":{"crn":"crn:v1:staging:public:is:us-south-1:a/77f2bceddaeb577dcaddb4073fe82c1c::share:r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/shares/r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1","id":"r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1","name":"pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd","size":20,"iops":3000,"resource_group":{"href":"https://resource-controller.test.cloud.ibm.com/v2/resource_groups/300b9469ee8676f9a038ecdf408c1a9d","id":"300b9469ee8676f9a038ecdf408c1a9d","name":"Default"},"initial_owner":{},"profile":{"href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/share/profiles/tier-5iops","name":"tier-5iops"},"created_at":"2023-07-19T04:00:07Z","lifecycle_state":"updating","mount_targets":[{"id":"r134-09a2016b-620f-4351-821f-15ff22dba7ed","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/shares/r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1/mount_targets/r134-09a2016b-620f-4351-821f-15ff22dba7ed","name":"vending-enviably-uncouth-ceremony"}],"zone":{"name":"us-south-1","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/regions/us-south/zones/us-south-1"}}}
I0719 07:55:44.195066       1 server.go:153] GRPC call: /csi.v1.Identity/Probe
I0719 07:55:44.195113       1 server.go:154] GRPC request:
I0719 07:55:44.195245       1 server.go:159] GRPC response:
{"level":"info","ts":"2023-07-19T07:55:44.195Z","caller":"ibmcsidriver/identity.go:85","msg":"CSIIdentityServer-Probe...","RequestID":"955a49bc-e817-4123-bba7-8b126836fad0","Request":{}}
{"level":"info","ts":"2023-07-19T07:55:49.980Z","caller":"watcher/pv_watcher.go:162","msg":"Entry updateVolume()","RequestID":"b6dd5057-986a-41f8-a110-4ccf7626e25c","obj":{"metadata":{"name":"pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd","uid":"9fd1cfe4-d117-492b-9b9b-3fe70b5311c6","resourceVersion":"586453","creationTimestamp":"2023-07-19T04:00:20Z","annotations":{"pv.kubernetes.io/provisioned-by":"vpc.file.csi.ibm.io"},"finalizers":["kubernetes.io/pv-protection"],"managedFields":[{"manager":"Go-http-client","operation":"Update","apiVersion":"v1","time":"2023-07-19T04:00:20Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:pv.kubernetes.io/provisioned-by":{}}},"f:spec":{"f:accessModes":{},"f:capacity":{},"f:claimRef":{".":{},"f:apiVersion":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:csi":{".":{},"f:driver":{},"f:volumeAttributes":{".":{},"f:clusterID":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:iops":{},"f:nfsServerPath":{},"f:storage.kubernetes.io/csiProvisionerIdentity":{},"f:tags":{},"f:volumeCRN":{},"f:volumeId":{}},"f:volumeHandle":{}},"f:mountOptions":{},"f:nodeAffinity":{".":{},"f:required":{}},"f:persistentVolumeReclaimPolicy":{},"f:storageClassName":{},"f:volumeMode":{}}}},{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-07-19T04:00:20Z","fieldsType":"FieldsV1","fieldsV1":{"f:status":{"f:phase":{}}},"subresource":"status"},{"manager":"csi-resizer","operation":"Update","apiVersion":"v1","time":"2023-07-19T07:55:49Z","fieldsType":"FieldsV1","fieldsV1":{"f:spec":{"f:capacity":{"f:storage":{}}}}}]},"spec":{"capacity":{"storage":"20Gi"},"csi":{"driver":"vpc.file.csi.ibm.io","volumeHandle":"r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1:r134-09a2016b-620f-4351-821f-15ff22dba7ed","volumeAttributes":{"clusterID":"ciocmnc205mphmigkus0","failure-domain.beta.kubernetes.io/region":"us-south","failure-domain.beta.kubernetes.io/zone":"us-south-1","iops":"3000","nfsServerPath":"fsf-dal1095b-vs91-stg-fz.adn.networklayer.com:/a110205a_260d_4ece_909b_d0cd0d33aed0","storage.kubernetes.io/csiProvisionerIdentity":"1689699646153-8081-vpc.file.csi.ibm.io","tags":"","volumeCRN":"crn:v1:staging:public:is:us-south-1:a/77f2bceddaeb577dcaddb4073fe82c1c::share:r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1","volumeId":"r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1:r134-09a2016b-620f-4351-821f-15ff22dba7ed"}},"accessModes":["ReadWriteMany"],"claimRef":{"kind":"PersistentVolumeClaim","namespace":"default","name":"pv-file-1","uid":"60c0ecab-e6b9-42da-a803-9290d9b3dbdd","apiVersion":"v1","resourceVersion":"567593"},"persistentVolumeReclaimPolicy":"Delete","storageClassName":"ibmc-vpc-file-5iops-tier","mountOptions":["hard","nfsvers=4.1","sec=sys"],"volumeMode":"Filesystem","nodeAffinity":{"required":{"nodeSelectorTerms":[{"matchExpressions":[{"key":"failure-domain.beta.kubernetes.io/region","operator":"In","values":["us-south"]},{"key":"failure-domain.beta.kubernetes.io/zone","operator":"In","values":["us-south-1"]}]}]}}},"status":{"phase":"Bound"}}}
{"level":"info","ts":"2023-07-19T07:55:49.981Z","caller":"ibmcloudprovider/volume_provider.go:99","msg":"IBMCloudStorageProvider-GetProviderSession...","RequestID":"b6dd5057-986a-41f8-a110-4ccf7626e25c"}
{"level":"info","ts":"2023-07-19T07:55:49.981Z","caller":"utils/init_provider.go:67","msg":"Fetching provider session","RequestID":"b6dd5057-986a-41f8-a110-4ccf7626e25c"}
{"level":"info","ts":"2023-07-19T07:55:49.981Z","caller":"utils/init_provider.go:73","msg":"Calling provider/utils/init_provider.go GenerateContextCredentials","RequestID":"b6dd5057-986a-41f8-a110-4ccf7626e25c"}
{"level":"info","ts":"2023-07-19T07:55:49.981Z","caller":"utils/init_provider.go:92","msg":"Generating generateContextCredentials for ","RequestID":"b6dd5057-986a-41f8-a110-4ccf7626e25c","Provider ID":""}
{"level":"info","ts":"2023-07-19T07:55:49.981Z","caller":"utils/init_provider.go:97","msg":"Calling provider/init_provider.go ForIAMAccessToken","RequestID":"b6dd5057-986a-41f8-a110-4ccf7626e25c"}
{"level":"info","ts":"2023-07-19T07:55:49.981Z","caller":"iam/token_exchange_iks.go:96","msg":"Fetching using secret provider","RequestID":"b6dd5057-986a-41f8-a110-4ccf7626e25c"}
{"level":"info","timestamp":"2023-07-19T07:55:49.981Z","caller":"secret_provider/managed_secret_provider.go:107","msg":"Connecting to sidecar","name":"secret-provider","secret-provider-type":"managed-secret-provider"}
{"level":"info","timestamp":"2023-07-19T07:55:49.983Z","caller":"secret_provider/managed_secret_provider.go:130","msg":"Fetched IAM token for default secret","name":"secret-provider","secret-provider-type":"managed-secret-provider"}
{"level":"info","ts":"2023-07-19T07:55:49.983Z","caller":"iam/token_exchange_iks.go:102","msg":"Successfully fetched iam token","RequestID":"b6dd5057-986a-41f8-a110-4ccf7626e25c"}
I0719 07:55:49.984044       1 event.go:285] Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd", UID:"9fd1cfe4-d117-492b-9b9b-3fe70b5311c6", APIVersion:"v1", ResourceVersion:"586453", FieldPath:""}): type: 'Warning' reason: 'VolumeMetaDataSaved' unsupported Operation
{"level":"info","ts":"2023-07-19T07:55:49.983Z","caller":"provider/provider.go:144","msg":"Entering OpenSession","RequestID":"b6dd5057-986a-41f8-a110-4ccf7626e25c"}
{"level":"info","ts":"2023-07-19T07:55:49.983Z","caller":"metrics/metrics.go:73","msg":"Time to complete","RequestID":"b6dd5057-986a-41f8-a110-4ccf7626e25c","OpenSession":0.000020131}
{"level":"info","ts":"2023-07-19T07:55:49.983Z","caller":"utils/init_provider.go:86","msg":"Successfully fetched provider session","RequestID":"b6dd5057-986a-41f8-a110-4ccf7626e25c"}
{"level":"info","ts":"2023-07-19T07:55:49.983Z","caller":"ibmcloudprovider/volume_provider.go:115","msg":"Successfully got the provider session","RequestID":"b6dd5057-986a-41f8-a110-4ccf7626e25c","ProviderName":"VPC-SHARE"}
{"level":"info","ts":"2023-07-19T07:55:49.983Z","caller":"watcher/pv_watcher.go:167","msg":"volume to update ","RequestID":"b6dd5057-986a-41f8-a110-4ccf7626e25c","volume":{"volumeID":"r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1:r134-09a2016b-620f-4351-821f-15ff22dba7ed","provider":"g2","volumeType":"share","capacity":20,"iops":"3000","tier":null,"creationTime":"0001-01-01T00:00:00Z","attributes":{"clusterid":"ciocmnc205mphmigkus0","status":"created"},"crn":"crn:v1:staging:public:is:us-south-1:a/77f2bceddaeb577dcaddb4073fe82c1c::share:r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1","volume_tags":["clusterID:ciocmnc205mphmigkus0","reclaimpolicy:Delete","storageclass:ibmc-vpc-file-5iops-tier","namespace:default","pvc:pv-file-1","pv:pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd","provisioner:vpc.file.csi.ibm.io"]}}
{"level":"warn","ts":"2023-07-19T07:55:49.983Z","caller":"watcher/pv_watcher.go:170","msg":"Unable to update the volume","RequestID":"b6dd5057-986a-41f8-a110-4ccf7626e25c","error":"unsupported Operation"}
{"level":"info","ts":"2023-07-19T07:55:49.983Z","caller":"watcher/pv_watcher.go:177","msg":"Exit updateVolume()","RequestID":"b6dd5057-986a-41f8-a110-4ccf7626e25c"}
{"level":"info","ts":"2023-07-19T07:55:50.239Z","caller":"vpcfilevolume/get_file_share.go:46","msg":"Equivalent curl command","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707","URL":"https://us-south-stage01.private.iaasdev.cloud.ibm.com/v1/shares/%7Bshare-id%7D?generation=2&maturity=beta&version=2023-05-30","Operation":{"Name":"GetFileShare","Method":"GET","PathPattern":"/v1/shares/{share-id}"}}
{"level":"info","ts":"2023-07-19T07:55:50.495Z","caller":"provider/wait_for_valid_volume_state.go:43","msg":"Getting file share details from VPC provider...","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707","volume":{"crn":"crn:v1:staging:public:is:us-south-1:a/77f2bceddaeb577dcaddb4073fe82c1c::share:r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/shares/r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1","id":"r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1","name":"pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd","size":20,"iops":3000,"resource_group":{"href":"https://resource-controller.test.cloud.ibm.com/v2/resource_groups/300b9469ee8676f9a038ecdf408c1a9d","id":"300b9469ee8676f9a038ecdf408c1a9d","name":"Default"},"initial_owner":{},"profile":{"href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/share/profiles/tier-5iops","name":"tier-5iops"},"created_at":"2023-07-19T04:00:07Z","lifecycle_state":"stable","mount_targets":[{"id":"r134-09a2016b-620f-4351-821f-15ff22dba7ed","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/shares/r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1/mount_targets/r134-09a2016b-620f-4351-821f-15ff22dba7ed","name":"vending-enviably-uncouth-ceremony"}],"zone":{"name":"us-south-1","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/regions/us-south/zones/us-south-1"}}}
{"level":"info","ts":"2023-07-19T07:55:50.495Z","caller":"provider/wait_for_valid_volume_state.go:45","msg":"Volume got valid (stable) state","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707","VolumeDetails":{"crn":"crn:v1:staging:public:is:us-south-1:a/77f2bceddaeb577dcaddb4073fe82c1c::share:r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/shares/r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1","id":"r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1","name":"pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd","size":20,"iops":3000,"resource_group":{"href":"https://resource-controller.test.cloud.ibm.com/v2/resource_groups/300b9469ee8676f9a038ecdf408c1a9d","id":"300b9469ee8676f9a038ecdf408c1a9d","name":"Default"},"initial_owner":{},"profile":{"href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/share/profiles/tier-5iops","name":"tier-5iops"},"created_at":"2023-07-19T04:00:07Z","lifecycle_state":"stable","mount_targets":[{"id":"r134-09a2016b-620f-4351-821f-15ff22dba7ed","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/shares/r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1/mount_targets/r134-09a2016b-620f-4351-821f-15ff22dba7ed","name":"vending-enviably-uncouth-ceremony"}],"zone":{"name":"us-south-1","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/regions/us-south/zones/us-south-1"}}}
{"level":"info","ts":"2023-07-19T07:55:50.495Z","caller":"metrics/metrics.go:73","msg":"Time to complete","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707","WaitForValidVolumeState":10.555244584}
{"level":"info","ts":"2023-07-19T07:55:50.495Z","caller":"provider/expand_volume.go:77","msg":"Volume got valid (stable) state","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707","VolumeDetails":{"crn":"crn:v1:staging:public:is:us-south-1:a/77f2bceddaeb577dcaddb4073fe82c1c::share:r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/shares/r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1","id":"r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1","name":"pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd","size":20,"iops":3000,"resource_group":{"href":"https://resource-controller.test.cloud.ibm.com/v2/resource_groups/300b9469ee8676f9a038ecdf408c1a9d","id":"300b9469ee8676f9a038ecdf408c1a9d","name":"Default"},"initial_owner":{},"profile":{"href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/share/profiles/tier-5iops","name":"tier-5iops"},"created_at":"2023-07-19T04:00:07Z","lifecycle_state":"updating","mount_targets":[{"id":"r134-09a2016b-620f-4351-821f-15ff22dba7ed","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/shares/r134-1b5b0032-bb92-4966-9aa1-e7da611c7ea1/mount_targets/r134-09a2016b-620f-4351-821f-15ff22dba7ed","name":"vending-enviably-uncouth-ceremony"}],"zone":{"name":"us-south-1","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/regions/us-south/zones/us-south-1"}}}
{"level":"info","ts":"2023-07-19T07:55:50.495Z","caller":"metrics/metrics.go:73","msg":"Time to complete","RequestID":"f7c74789-dd2d-48cf-8bd8-c55b5c590707","ExpandVolume":11.377455142}
2023/07/19 07:55:50 TIME TAKEN BY FUNCTION GetFileShare IS 256.238155ms

After deleting the pod only I got the pvc value has expanded until that was showing below

Events:
  Type     Reason                    Age    From                                  Message
  ----     ------                    ----   ----                                  -------
  Normal   Resizing                  7m34s  external-resizer vpc.file.csi.ibm.io  External resizer is resizing volume pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd
  Warning  ExternalExpanding         7m34s  volume_expand                         Ignoring the PVC: didn't find a plugin capable of expanding the volume; waiting for an external controller to process this PVC.
  Normal   Resizing                  7m33s  external-resizer vpc.file.csi.ibm.io  External resizer is resizing volume pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd
  Warning  VolumeResizeFailed        7m21s  external-resizer vpc.file.csi.ibm.io  Mark PVC "default/pv-file-1" as file system resize required failed: can't patch status of  PVC default/pv-file-1 with Operation cannot be fulfilled on persistentvolumeclaims "pv-file-1": the object has been modified; please apply your changes to the latest version and try again
  Normal   FileSystemResizeRequired  7m20s  external-resizer vpc.file.csi.ibm.io  Require file system resize of volume on node

kubectl delete pod testpodrwm-85bc7b9d76-j76z6
pod "testpodrwm-85bc7b9d76-j76z6" deleted

VolumeMode:    Filesystem
Used By:       testpodrwm-85bc7b9d76-7vf5w
               testpodrwm-85bc7b9d76-j76z6
               testpodrwm-85bc7b9d76-k542q
               testpodrwm-85bc7b9d76-msfxh
Events:
  Type     Reason                      Age   From                                  Message
  ----     ------                      ----  ----                                  -------
  Normal   Resizing                    25m   external-resizer vpc.file.csi.ibm.io  External resizer is resizing volume pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd
  Warning  ExternalExpanding           25m   volume_expand                         Ignoring the PVC: didn't find a plugin capable of expanding the volume; waiting for an external controller to process this PVC.
  Normal   Resizing                    25m   external-resizer vpc.file.csi.ibm.io  External resizer is resizing volume pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd
  Warning  VolumeResizeFailed          25m   external-resizer vpc.file.csi.ibm.io  Mark PVC "default/pv-file-1" as file system resize required failed: can't patch status of  PVC default/pv-file-1 with Operation cannot be fulfilled on persistentvolumeclaims "pv-file-1": the object has been modified; please apply your changes to the latest version and try again
  Normal   FileSystemResizeRequired    25m   external-resizer vpc.file.csi.ibm.io  Require file system resize of volume on node
  Normal   FileSystemResizeSuccessful  5m1s  kubelet                               MountVolume.NodeExpandVolume succeeded for volume "pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd" <IP_ADDRESS>

Using existing old profile PVC and create new deployment

sameershaikh@Sameers-MacBook-Pro demo % kubectl get pvc
NAME            STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS                  AGE
pv-file-1       Bound    pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd   30Gi       RWX            ibmc-vpc-file-5iops-tier      4h43m
pv-file-5       Bound    pvc-172f7a9e-c01d-463b-8b92-fa3d7390ea47   10Gi       RWX            ibmc-vpc-file-5iops-tier      15h
volume-secret   Bound    pvc-1fa0c036-cfbc-4682-8fca-2c4ae75f9d70   10Gi       RWX            ibmc-vpc-file-dp-eni-custom   21h
sameershaikh@Sameers-MacBook-Pro demo % cp vpcfiledeployment.yaml  vpcfiledeployment_new.yaml
sameershaikh@Sameers-MacBook-Pro demo % vi vpcfiledeployment_new.yaml
sameershaikh@Sameers-MacBook-Pro demo % kubectl apply -f vpcfiledeployment_new.yaml
deployment.apps/testpodrwm-1 created
sameershaikh@Sameers-MacBook-Pro demo % kubectl get pods -o wide | grep testpodrwm-1
testpodrwm-1-5cd6d9dc5d-b8xn6   1/1     Running   0          22s     <IP_ADDRESS>   <IP_ADDRESS>   <none>           <none>
testpodrwm-1-5cd6d9dc5d-bn7g4   1/1     Running   0          22s     <IP_ADDRESS>   <IP_ADDRESS>   <none>           <none>
testpodrwm-1-5cd6d9dc5d-n572t   1/1     Running   0          22s     <IP_ADDRESS>   <IP_ADDRESS>   <none>           <none>

sameershaikh@Sameers-MacBook-Pro demo % kubectl exec -it testpodrwm-1-5cd6d9dc5d-b8xn6 -- /bin/bash
root@testpodrwm-1-5cd6d9dc5d-b8xn6:/# df -h
df: cannot read table of mounted file systems: No such file or directory
root@testpodrwm-1-5cd6d9dc5d-b8xn6:/# lsblk
NAME   MAJ:MIN RM  SIZE RO TYPE MOUNTPOINT
vdb    252:16   0  372K  0 disk
vdc    252:32   0   44K  0 disk
vda    252:0    0  100G  0 disk
|-vda2 252:2    0   99G  0 part /etc/resolv.conf
`-vda1 252:1    0    1G  0 part
root@testpodrwm-1-5cd6d9dc5d-b8xn6:/# cd /myvolumepath/
root@testpodrwm-1-5cd6d9dc5d-b8xn6:/myvolumepath# mkdir sam
root@testpodrwm-1-5cd6d9dc5d-b8xn6:/myvolumepath# cd sam/
root@testpodrwm-1-5cd6d9dc5d-b8xn6:/myvolumepath/sam# touch sam.txt
root@testpodrwm-1-5cd6d9dc5d-b8xn6:/myvolumepath/sam# echo "saaa" > sam.txt
root@testpodrwm-1-5cd6d9dc5d-b8xn6:/myvolumepath/sam# cat sam.txt %                                                                                sameershaikh@Sameers-MacBook-Pro demo % kubectl exec -it testpodrwm-1-5cd6d9dc5d-b8xn6 -- /bin/bash
root@testpodrwm-1-5cd6d9dc5d-b8xn6:/# cd myvolumepath/
root@testpodrwm-1-5cd6d9dc5d-b8xn6:/myvolumepath# cat sam/
cat: sam/: Is a directory
root@testpodrwm-1-5cd6d9dc5d-b8xn6:/myvolumepath# cat sam/sam.txt
saaa
root@testpodrwm-1-5cd6d9dc5d-b8xn6:/myvolumepath# exit
exit

Delete existing deployment and file share with old profiles
sameershaikh@Sameers-MacBook-Pro demo % kubectl delete -f vpcfiledeployment_new.yaml
deployment.apps "testpodrwm-1" deleted

kubectl get pods -o wide | grep testpodrwm-1
sameershaikh@Sameers-MacBook-Pro demo %

"nodeAffinity":{"required":{"nodeSelectorTerms":[{"matchExpressions":[{"key":"failure-domain.beta.kubernetes.io/zone","operator":"In","values":["us-south-1"]},{"key":"failure-domain.beta.kubernetes.io/region","operator":"In","values":["us-south"]}]}]}}},"status":{"phase":"Released"}}}
{"level":"info","ts":"2023-07-19T08:56:21.769Z","caller":"ibmcloudprovider/volume_provider.go:99","msg":"IBMCloudStorageProvider-GetProviderSession...","RequestID":"f2d1081e-234b-444d-a544-924a33d04889"}
{"level":"info","ts":"2023-07-19T08:56:21.769Z","caller":"utils/init_provider.go:67","msg":"Fetching provider session","RequestID":"f2d1081e-234b-444d-a544-924a33d04889"}
{"level":"info","ts":"2023-07-19T08:56:21.769Z","caller":"utils/init_provider.go:73","msg":"Calling provider/utils/init_provider.go GenerateContextCredentials","RequestID":"f2d1081e-234b-444d-a544-924a33d04889"}
{"level":"info","ts":"2023-07-19T08:56:21.769Z","caller":"utils/init_provider.go:92","msg":"Generating generateContextCredentials for ","RequestID":"f2d1081e-234b-444d-a544-924a33d04889","Provider ID":""}
{"level":"info","ts":"2023-07-19T08:56:21.769Z","caller":"utils/init_provider.go:97","msg":"Calling provider/init_provider.go ForIAMAccessToken","RequestID":"f2d1081e-234b-444d-a544-924a33d04889"}
{"level":"info","ts":"2023-07-19T08:56:21.769Z","caller":"iam/token_exchange_iks.go:96","msg":"Fetching using secret provider","RequestID":"f2d1081e-234b-444d-a544-924a33d04889"}
{"level":"info","timestamp":"2023-07-19T08:56:21.769Z","caller":"secret_provider/managed_secret_provider.go:107","msg":"Connecting to sidecar","name":"secret-provider","secret-provider-type":"managed-secret-provider"}
I0719 08:56:21.769126       1 server.go:153] GRPC call: /csi.v1.Controller/DeleteVolume
{"level":"info","timestamp":"2023-07-19T08:56:21.774Z","caller":"secret_provider/managed_secret_provider.go:130","msg":"Fetched IAM token for default secret","name":"secret-provider","secret-provider-type":"managed-secret-provider"}
{"level":"info","ts":"2023-07-19T08:56:21.774Z","caller":"iam/token_exchange_iks.go:102","msg":"Successfully fetched iam token","RequestID":"f2d1081e-234b-444d-a544-924a33d04889"}
{"level":"info","ts":"2023-07-19T08:56:21.774Z","caller":"provider/provider.go:144","msg":"Entering OpenSession","RequestID":"f2d1081e-234b-444d-a544-924a33d04889"}
{"level":"info","ts":"2023-07-19T08:56:21.774Z","caller":"metrics/metrics.go:73","msg":"Time to complete","RequestID":"f2d1081e-234b-444d-a544-924a33d04889","OpenSession":0.000009724}
{"level":"info","ts":"2023-07-19T08:56:21.774Z","caller":"utils/init_provider.go:86","msg":"Successfully fetched provider session","RequestID":"f2d1081e-234b-444d-a544-924a33d04889"}
{"level":"info","ts":"2023-07-19T08:56:21.774Z","caller":"ibmcloudprovider/volume_provider.go:115","msg":"Successfully got the provider session","RequestID":"f2d1081e-234b-444d-a544-924a33d04889","ProviderName":"VPC-SHARE"}
I0719 08:56:21.769142       1 server.go:154] GRPC request: volume_id:"r134-46fa35c4-2104-4a3f-a10a-89d95ada2235:r134-e47471a0-0e03-4df1-bd55-013e9ed6873b"
{"level":"info","ts":"2023-07-19T08:56:21.774Z","caller":"ibmcsidriver/controller.go:169","msg":"CSIControllerServer-DeleteVolume... ","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","Request":{"volume_id":"r134-46fa35c4-2104-4a3f-a10a-89d95ada2235:r134-e47471a0-0e03-4df1-bd55-013e9ed6873b"}}
{"level":"info","ts":"2023-07-19T08:56:21.775Z","caller":"ibmcloudprovider/volume_provider.go:99","msg":"IBMCloudStorageProvider-GetProviderSession...","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
{"level":"info","ts":"2023-07-19T08:56:21.775Z","caller":"utils/init_provider.go:67","msg":"Fetching provider session","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
{"level":"info","ts":"2023-07-19T08:56:21.775Z","caller":"utils/init_provider.go:73","msg":"Calling provider/utils/init_provider.go GenerateContextCredentials","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
{"level":"info","ts":"2023-07-19T08:56:21.775Z","caller":"utils/init_provider.go:92","msg":"Generating generateContextCredentials for ","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","Provider ID":""}
{"level":"info","ts":"2023-07-19T08:56:21.775Z","caller":"utils/init_provider.go:97","msg":"Calling provider/init_provider.go ForIAMAccessToken","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
{"level":"info","ts":"2023-07-19T08:56:21.775Z","caller":"iam/token_exchange_iks.go:96","msg":"Fetching using secret provider","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
{"level":"info","timestamp":"2023-07-19T08:56:21.775Z","caller":"secret_provider/managed_secret_provider.go:107","msg":"Connecting to sidecar","name":"secret-provider","secret-provider-type":"managed-secret-provider"}
{"level":"info","ts":"2023-07-19T08:56:21.774Z","caller":"watcher/pv_watcher.go:167","msg":"volume to update ","RequestID":"f2d1081e-234b-444d-a544-924a33d04889","volume":{"volumeID":"r134-46fa35c4-2104-4a3f-a10a-89d95ada2235:r134-e47471a0-0e03-4df1-bd55-013e9ed6873b","provider":"g2","volumeType":"share","capacity":null,"iops":null,"tier":null,"creationTime":"0001-01-01T00:00:00Z","attributes":{"clusterid":"ciocmnc205mphmigkus0","status":"deleted"},"crn":"crn:v1:staging:public:is:us-south-1:a/77f2bceddaeb577dcaddb4073fe82c1c::share:r134-46fa35c4-2104-4a3f-a10a-89d95ada2235"}}
I0719 08:56:21.775540       1 event.go:285] Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-172f7a9e-c01d-463b-8b92-fa3d7390ea47", UID:"7e792dbb-c2c7-4eff-86d8-a916788da842", APIVersion:"v1", ResourceVersion:"592235", FieldPath:""}): type: 'Warning' reason: 'VolumeMetaDataSaved' unsupported Operation
{"level":"warn","ts":"2023-07-19T08:56:21.775Z","caller":"watcher/pv_watcher.go:170","msg":"Unable to update the volume","RequestID":"f2d1081e-234b-444d-a544-924a33d04889","error":"unsupported Operation"}
{"level":"info","ts":"2023-07-19T08:56:21.775Z","caller":"watcher/pv_watcher.go:177","msg":"Exit updateVolume()","RequestID":"f2d1081e-234b-444d-a544-924a33d04889"}
{"level":"info","timestamp":"2023-07-19T08:56:21.776Z","caller":"secret_provider/managed_secret_provider.go:130","msg":"Fetched IAM token for default secret","name":"secret-provider","secret-provider-type":"managed-secret-provider"}
{"level":"info","ts":"2023-07-19T08:56:21.776Z","caller":"iam/token_exchange_iks.go:102","msg":"Successfully fetched iam token","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
{"level":"info","ts":"2023-07-19T08:56:21.777Z","caller":"provider/provider.go:144","msg":"Entering OpenSession","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
{"level":"info","ts":"2023-07-19T08:56:21.777Z","caller":"provider/provider.go:167","msg":"","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","apiConfig.ContextID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3 "}
{"level":"info","ts":"2023-07-19T08:56:21.777Z","caller":"metrics/metrics.go:73","msg":"Time to complete","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","OpenSession":0.000028815}
{"level":"info","ts":"2023-07-19T08:56:21.777Z","caller":"utils/init_provider.go:86","msg":"Successfully fetched provider session","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
{"level":"info","ts":"2023-07-19T08:56:21.777Z","caller":"ibmcloudprovider/volume_provider.go:115","msg":"Successfully got the provider session","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","ProviderName":"VPC-SHARE"}
{"level":"info","ts":"2023-07-19T08:56:21.777Z","caller":"provider/get_volume.go:32","msg":"Basic validation for volume ID...","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","VolumeID":"r134-46fa35c4-2104-4a3f-a10a-89d95ada2235"}
{"level":"info","ts":"2023-07-19T08:56:21.777Z","caller":"provider/get_volume.go:39","msg":"Getting volume details from VPC provider...","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","VolumeID":"r134-46fa35c4-2104-4a3f-a10a-89d95ada2235"}
{"level":"info","ts":"2023-07-19T08:56:21.777Z","caller":"vpcfilevolume/get_file_share.go:46","msg":"Equivalent curl command","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","URL":"https://us-south-stage01.private.iaasdev.cloud.ibm.com/v1/shares/%7Bshare-id%7D?generation=2&maturity=beta&version=2023-05-30","Operation":{"Name":"GetFileShare","Method":"GET","PathPattern":"/v1/shares/{share-id}"}}
2023/07/19 08:56:22 TIME TAKEN BY FUNCTION GetFileShare IS 1.024276169s
{"level":"info","ts":"2023-07-19T08:56:22.801Z","caller":"provider/get_volume.go:51","msg":"Successfully retrieved volume details from VPC backend","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","VolumeDetails":{"crn":"crn:v1:staging:public:is:us-south-1:a/77f2bceddaeb577dcaddb4073fe82c1c::share:r134-46fa35c4-2104-4a3f-a10a-89d95ada2235","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/shares/r134-46fa35c4-2104-4a3f-a10a-89d95ada2235","id":"r134-46fa35c4-2104-4a3f-a10a-89d95ada2235","name":"pvc-172f7a9e-c01d-463b-8b92-fa3d7390ea47","size":10,"iops":3000,"resource_group":{"href":"https://resource-controller.test.cloud.ibm.com/v2/resource_groups/300b9469ee8676f9a038ecdf408c1a9d","id":"300b9469ee8676f9a038ecdf408c1a9d","name":"Default"},"initial_owner":{},"profile":{"href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/share/profiles/tier-5iops","name":"tier-5iops"},"created_at":"2023-07-18T20:51:42Z","lifecycle_state":"stable","mount_targets":[{"id":"r134-e47471a0-0e03-4df1-bd55-013e9ed6873b","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/shares/r134-46fa35c4-2104-4a3f-a10a-89d95ada2235/mount_targets/r134-e47471a0-0e03-4df1-bd55-013e9ed6873b","name":"repeal-elk-acre-chatter"}],"zone":{"name":"us-south-1","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/regions/us-south/zones/us-south-1"}}}
{"level":"info","ts":"2023-07-19T08:56:22.801Z","caller":"provider/util.go:274","msg":"Entry of FromProviderToLibVolumeAccessPoint method...","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
{"level":"info","ts":"2023-07-19T08:56:22.801Z","caller":"provider/util.go:302","msg":"Exit from FromProviderToLibVolumeAccessPoint method...","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
{"level":"info","ts":"2023-07-19T08:56:22.801Z","caller":"ibmcsidriver/controller.go:209","msg":"Deleting VolumeAccessPoint...","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
{"level":"info","ts":"2023-07-19T08:56:22.801Z","caller":"provider/delete_volume_access_point.go:38","msg":"Validating basic inputs for delete AccessPoint method...","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","deleteAccessPointRequest":{"volumeID":"r134-46fa35c4-2104-4a3f-a10a-89d95ada2235","accessPointID":"r134-e47471a0-0e03-4df1-bd55-013e9ed6873b"}}
{"level":"info","ts":"2023-07-19T08:56:22.801Z","caller":"provider/delete_volume_access_point.go:49","msg":"Checking if volume AccessPoint is already deleted ","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
{"level":"info","ts":"2023-07-19T08:56:22.801Z","caller":"provider/get_volume.access_point.go:34","msg":"Validating basic inputs for GetVolumeAccessPoint method...","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","volumeAccessPointRequest":{"volumeID":"r134-46fa35c4-2104-4a3f-a10a-89d95ada2235","accessPointID":"r134-e47471a0-0e03-4df1-bd55-013e9ed6873b"}}
{"level":"info","ts":"2023-07-19T08:56:22.801Z","caller":"provider/get_volume.access_point.go:55","msg":"Getting VolumeAccessPoint from VPC provider...","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
{"level":"info","ts":"2023-07-19T08:56:22.801Z","caller":"vpcfilevolume/get_file_share_target.go:46","msg":"Equivalent curl command","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","URL":"https://us-south-stage01.private.iaasdev.cloud.ibm.com/v1/shares/%7Bshare-id%7D/mount_targets/%7Btarget-id%7D?generation=2&maturity=beta&version=2023-05-30","Operation":{"Name":"GetFileShareTarget","Method":"GET","PathPattern":"/v1/shares/{share-id}/mount_targets/{target-id}"}}
2023/07/19 08:56:23 TIME TAKEN BY FUNCTION GetFileShareTarget IS 615.651357ms
{"level":"info","ts":"2023-07-19T08:56:23.417Z","caller":"provider/get_volume.access_point.go:77","msg":"Successfully retrieved volume AccessPoint","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","volumeAccessPointResponse":{"volumeID":"r134-46fa35c4-2104-4a3f-a10a-89d95ada2235","AccessPointID":"r134-e47471a0-0e03-4df1-bd55-013e9ed6873b","status":"stable","mount_path":"fsf-dal1095a-vs91-stg-fz.adn.networklayer.com:/234bc893_f759_4cb4_8ce4_90753d0821c6","created_at":"2023-07-18T20:51:54Z"}}
{"level":"info","ts":"2023-07-19T08:56:23.417Z","caller":"provider/get_volume.access_point.go:48","msg":"Volume access point response","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","volumeAccessPointResponse":{"volumeID":"r134-46fa35c4-2104-4a3f-a10a-89d95ada2235","AccessPointID":"r134-e47471a0-0e03-4df1-bd55-013e9ed6873b","status":"stable","mount_path":"fsf-dal1095a-vs91-stg-fz.adn.networklayer.com:/234bc893_f759_4cb4_8ce4_90753d0821c6","created_at":"2023-07-18T20:51:54Z"}}
{"level":"info","ts":"2023-07-19T08:56:23.417Z","caller":"provider/delete_volume_access_point.go:53","msg":"Found volume AccessPoint","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","currentVolAccessPoint":{"volumeID":"r134-46fa35c4-2104-4a3f-a10a-89d95ada2235","AccessPointID":"r134-e47471a0-0e03-4df1-bd55-013e9ed6873b","status":"stable","mount_path":"fsf-dal1095a-vs91-stg-fz.adn.networklayer.com:/234bc893_f759_4cb4_8ce4_90753d0821c6","created_at":"2023-07-18T20:51:54Z"}}
{"level":"info","ts":"2023-07-19T08:56:23.417Z","caller":"provider/delete_volume_access_point.go:57","msg":"Deleting volume AccessPoint from VPC provider...","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
{"level":"info","ts":"2023-07-19T08:56:23.417Z","caller":"vpcfilevolume/delete_file_share_target.go:46","msg":"Equivalent curl command","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","URL":"https://us-south-stage01.private.iaasdev.cloud.ibm.com/v1/shares/%7Bshare-id%7D/mount_targets/%7Btarget-id%7D?generation=2&maturity=beta&version=2023-05-30","Operation":{"Name":"DeleteFileShareTarget","Method":"DELETE","PathPattern":"/v1/shares/{share-id}/mount_targets/{target-id}"}}
2023/07/19 08:56:23 TIME TAKEN BY FUNCTION DeleteFileShareTarget IS 455.042682ms
{"level":"info","ts":"2023-07-19T08:56:23.872Z","caller":"vpcfilevolume/delete_file_share_target.go:57","msg":"DeleteFileShareTarget successfull","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
{"level":"info","ts":"2023-07-19T08:56:23.872Z","caller":"provider/delete_volume_access_point.go:65","msg":"No volume access point found for","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","currentVolumeAccessPoint":{"volumeID":"r134-46fa35c4-2104-4a3f-a10a-89d95ada2235","AccessPointID":"r134-e47471a0-0e03-4df1-bd55-013e9ed6873b","status":"stable","mount_path":"fsf-dal1095a-vs91-stg-fz.adn.networklayer.com:/234bc893_f759_4cb4_8ce4_90753d0821c6","created_at":"2023-07-18T20:51:54Z"}}
{"level":"info","ts":"2023-07-19T08:56:23.872Z","caller":"provider/delete_volume_access_point.go:77","msg":"Successfully deleted volume AccessPoint from VPC provider","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","resp":{"Status":"","StatusCode":200,"Proto":"","ProtoMajor":0,"ProtoMinor":0,"Header":null,"Body":null,"ContentLength":0,"TransferEncoding":null,"Close":false,"Uncompressed":false,"Trailer":null,"Request":null,"TLS":null}}
{"level":"info","ts":"2023-07-19T08:56:23.873Z","caller":"metrics/metrics.go:73","msg":"Time to complete","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","DeleteVolumeAccessPoint":1.071977203}
{"level":"info","ts":"2023-07-19T08:56:23.873Z","caller":"ibmcsidriver/controller.go:216","msg":"DeleteVolumeAccessPoint response","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","response":{"Status":"","StatusCode":200,"Proto":"","ProtoMajor":0,"ProtoMinor":0,"Header":null,"Body":null,"ContentLength":0,"TransferEncoding":null,"Close":false,"Uncompressed":false,"Trailer":null,"Request":null,"TLS":null}}
{"level":"info","ts":"2023-07-19T08:56:23.873Z","caller":"provider/wait_for_delete_volume_access_point.go:36","msg":"Validating basic inputs for WaitForDeleteVolumeAccessPoint method...","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","deleteAccessPointRequest":{"volumeID":"r134-46fa35c4-2104-4a3f-a10a-89d95ada2235","accessPointID":"r134-e47471a0-0e03-4df1-bd55-013e9ed6873b"}}
{"level":"info","ts":"2023-07-19T08:56:23.873Z","caller":"provider/get_volume.access_point.go:34","msg":"Validating basic inputs for GetVolumeAccessPoint method...","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","volumeAccessPointRequest":{"volumeID":"r134-46fa35c4-2104-4a3f-a10a-89d95ada2235","accessPointID":"r134-e47471a0-0e03-4df1-bd55-013e9ed6873b"}}
{"level":"info","ts":"2023-07-19T08:56:23.873Z","caller":"provider/get_volume.access_point.go:55","msg":"Getting VolumeAccessPoint from VPC provider...","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
{"level":"info","ts":"2023-07-19T08:56:23.873Z","caller":"vpcfilevolume/get_file_share_target.go:46","msg":"Equivalent curl command","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","URL":"https://us-south-stage01.private.iaasdev.cloud.ibm.com/v1/shares/%7Bshare-id%7D/mount_targets/%7Btarget-id%7D?generation=2&maturity=beta&version=2023-05-30","Operation":{"Name":"GetFileShareTarget","Method":"GET","PathPattern":"/v1/shares/{share-id}/mount_targets/{target-id}"}}
{"level":"info","ts":"2023-07-19T08:56:23.978Z","caller":"provider/get_volume.access_point.go:48","msg":"Volume access point response","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","volumeAccessPointResponse":null,"error":"{Code:AccessPointWithAPIDFindFailed, Type:VolumeAccessPointFindFailed, Description:No mount target could be found for the specified file share ID 'r134-46fa35c4-2104-4a3f-a10a-89d95ada2235' and mount target ID 'r134-e47471a0-0e03-4df1-bd55-013e9ed6873b', BackendError:Trace Code:4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3, Share mount target with ID 'r134-e47471a0-0e03-4df1-bd55-013e9ed6873b' for share 'r134-46fa35c4-2104-4a3f-a10a-89d95ada2235' was not found Please check List the targets for the share and see if the mount target ID you are trying to find is in the list., RC:400}"}
{"level":"info","ts":"2023-07-19T08:56:23.978Z","caller":"provider/wait_for_delete_volume_access_point.go:57","msg":"Volume AccessPoint delete is complete","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
{"level":"info","ts":"2023-07-19T08:56:23.978Z","caller":"metrics/metrics.go:73","msg":"Time to complete","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","WaitForDeleteVolumeAccessPoint":0.104772032}
{"level":"info","ts":"2023-07-19T08:56:23.978Z","caller":"ibmcsidriver/controller.go:224","msg":"VolumeAccessPoint deleted successfully","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
{"level":"info","ts":"2023-07-19T08:56:23.978Z","caller":"ibmcsidriver/controller.go:226","msg":"Deleting Volume...","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
{"level":"info","ts":"2023-07-19T08:56:23.978Z","caller":"provider/delete_volume.go:36","msg":"Validating basic inputs for DeleteVolume method...","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","VolumeDetails":{"volumeID":"r134-46fa35c4-2104-4a3f-a10a-89d95ada2235","provider":"","volumeType":"","capacity":null,"iops":null,"tier":null,"creationTime":"0001-01-01T00:00:00Z"}}
{"level":"info","ts":"2023-07-19T08:56:23.978Z","caller":"provider/get_volume.go:32","msg":"Basic validation for volume ID...","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","VolumeID":"r134-46fa35c4-2104-4a3f-a10a-89d95ada2235"}
{"level":"info","ts":"2023-07-19T08:56:23.978Z","caller":"provider/get_volume.go:39","msg":"Getting volume details from VPC provider...","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","VolumeID":"r134-46fa35c4-2104-4a3f-a10a-89d95ada2235"}
{"level":"info","ts":"2023-07-19T08:56:23.978Z","caller":"vpcfilevolume/get_file_share.go:46","msg":"Equivalent curl command","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","URL":"https://us-south-stage01.private.iaasdev.cloud.ibm.com/v1/shares/%7Bshare-id%7D?generation=2&maturity=beta&version=2023-05-30","Operation":{"Name":"GetFileShare","Method":"GET","PathPattern":"/v1/shares/{share-id}"}}
2023/07/19 08:56:23 TIME TAKEN BY FUNCTION GetFileShareTarget IS 104.602777ms
I0719 08:56:24.186601       1 server.go:153] GRPC call: /csi.v1.Identity/Probe
I0719 08:56:24.186629       1 server.go:154] GRPC request:
I0719 08:56:24.186889       1 server.go:159] GRPC response:
{"level":"info","ts":"2023-07-19T08:56:24.186Z","caller":"ibmcsidriver/identity.go:85","msg":"CSIIdentityServer-Probe...","RequestID":"3e32a364-906d-4d29-877e-45363bf68e3e","Request":{}}
{"level":"info","ts":"2023-07-19T08:56:24.307Z","caller":"provider/get_volume.go:51","msg":"Successfully retrieved volume details from VPC backend","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","VolumeDetails":{"crn":"crn:v1:staging:public:is:us-south-1:a/77f2bceddaeb577dcaddb4073fe82c1c::share:r134-46fa35c4-2104-4a3f-a10a-89d95ada2235","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/shares/r134-46fa35c4-2104-4a3f-a10a-89d95ada2235","id":"r134-46fa35c4-2104-4a3f-a10a-89d95ada2235","name":"pvc-172f7a9e-c01d-463b-8b92-fa3d7390ea47","size":10,"iops":3000,"resource_group":{"href":"https://resource-controller.test.cloud.ibm.com/v2/resource_groups/300b9469ee8676f9a038ecdf408c1a9d","id":"300b9469ee8676f9a038ecdf408c1a9d","name":"Default"},"initial_owner":{},"profile":{"href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/share/profiles/tier-5iops","name":"tier-5iops"},"created_at":"2023-07-18T20:51:42Z","lifecycle_state":"stable","mount_targets":[],"zone":{"name":"us-south-1","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/regions/us-south/zones/us-south-1"}}}
{"level":"info","ts":"2023-07-19T08:56:24.307Z","caller":"provider/delete_volume.go:58","msg":"Deleting file share from VPC provider...","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
{"level":"info","ts":"2023-07-19T08:56:24.307Z","caller":"provider/delete_volume.go:60","msg":"Calling VPC client for file share deletion...","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
2023/07/19 08:56:24 TIME TAKEN BY FUNCTION GetFileShare IS 328.797092ms
{"level":"info","ts":"2023-07-19T08:56:24.307Z","caller":"vpcfilevolume/delete_file_share.go:45","msg":"Equivalent curl command","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","URL":"https://us-south-stage01.private.iaasdev.cloud.ibm.com/v1/shares/%7Bshare-id%7D?generation=2&maturity=beta&version=2023-05-30","Operation":{"Name":"DeleteFileShare","Method":"DELETE","PathPattern":"/v1/shares/{share-id}"}}
2023/07/19 08:56:24 TIME TAKEN BY FUNCTION DeleteVolume IS 572.246324ms
{"level":"info","ts":"2023-07-19T08:56:24.879Z","caller":"provider/delete_volume.go:97","msg":"Getting volume details from VPC provider...","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","VolumeID":"r134-46fa35c4-2104-4a3f-a10a-89d95ada2235"}
{"level":"info","ts":"2023-07-19T08:56:24.879Z","caller":"vpcfilevolume/get_file_share.go:46","msg":"Equivalent curl command","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","URL":"https://us-south-stage01.private.iaasdev.cloud.ibm.com/v1/shares/%7Bshare-id%7D?generation=2&maturity=beta&version=2023-05-30","Operation":{"Name":"GetFileShare","Method":"GET","PathPattern":"/v1/shares/{share-id}"}}
2023/07/19 08:56:25 TIME TAKEN BY FUNCTION GetFileShare IS 402.813114ms
{"level":"info","ts":"2023-07-19T08:56:25.282Z","caller":"provider/util.go:165","msg":"UNEXPECTED RESULT, Re-attempting execution ..","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","attempt..":2,"retry-gap":10,"max-retry-Attempts":10,"stopRetry":false}
I0719 08:56:34.195047       1 server.go:153] GRPC call: /csi.v1.Identity/Probe
I0719 08:56:34.195076       1 server.go:154] GRPC request:
{"level":"info","ts":"2023-07-19T08:56:34.195Z","caller":"ibmcsidriver/identity.go:85","msg":"CSIIdentityServer-Probe...","RequestID":"c6b6f5fe-7711-4b41-aab8-493fbbbfe5d0","Request":{}}
I0719 08:56:34.195203       1 server.go:159] GRPC response:
{"level":"info","ts":"2023-07-19T08:56:35.282Z","caller":"vpcfilevolume/get_file_share.go:46","msg":"Equivalent curl command","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","URL":"https://us-south-stage01.private.iaasdev.cloud.ibm.com/v1/shares/%7Bshare-id%7D?generation=2&maturity=beta&version=2023-05-30","Operation":{"Name":"GetFileShare","Method":"GET","PathPattern":"/v1/shares/{share-id}"}}
2023/07/19 08:56:35 TIME TAKEN BY FUNCTION GetFileShare IS 39.356251ms
{"level":"info","ts":"2023-07-19T08:56:35.322Z","caller":"provider/delete_volume.go:110","msg":"Volume got deleted.","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","volumeID":"r134-46fa35c4-2104-4a3f-a10a-89d95ada2235"}
{"level":"info","ts":"2023-07-19T08:56:35.322Z","caller":"provider/delete_volume.go:73","msg":"Successfully deleted volume from VPC provider","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
{"level":"info","ts":"2023-07-19T08:56:35.322Z","caller":"metrics/metrics.go:73","msg":"Time to complete","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","DeleteVolume":11.34371468}
{"level":"info","ts":"2023-07-19T08:56:35.322Z","caller":"ibmcsidriver/controller.go:233","msg":"Volume deleted successfully","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3"}
{"level":"info","ts":"2023-07-19T08:56:35.322Z","caller":"metrics/metrics.go:99","msg":"Time to complete","RequestID":"4145ed54-f5c3-4f3d-96cb-cffb1d03c6f3","DeleteVolume":13.547419464}
I0719 08:56:35.322329       1 server.go:159] GRPC response:

sameershaikh@Sameers-MacBook-Pro demo % kubectl get pvc
NAME            STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS                  AGE
pv-file-1       Bound    pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd   30Gi       RWX            ibmc-vpc-file-5iops-tier      4h57m
volume-secret   Bound    pvc-1fa0c036-cfbc-4682-8fca-2c4ae75f9d70   10Gi       RWX            ibmc-vpc-file-dp-eni-custom   21h

sameershaikh@Sameers-MacBook-Pro demo % kubectl get pv | grep file
pvc-1fa0c036-cfbc-4682-8fca-2c4ae75f9d70   10Gi       RWX            Delete           Bound         default/volume-secret   ibmc-vpc-file-dp-eni-custom               21h
pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd   30Gi       RWX            Delete           Bound         default/pv-file-1       ibmc-vpc-file-5iops-tier                  4h57m
sameershaikh@Sameers-MacBook-Pro demo %

New provisioning with old profiles
sameershaikh@Sameers-MacBook-Pro demo % kubectl apply -f vpcfilepvc.yaml
persistentvolumeclaim/pv-file-beta created

sameershaikh@Sameers-MacBook-Pro demo % kubectl get pvc
NAME            STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS                  AGE
pv-file-1       Bound    pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd   30Gi       RWX            ibmc-vpc-file-5iops-tier      4h59m
pv-file-beta    Bound    pvc-92b73821-8f31-48ee-aba4-2c3925713ce9   10Gi       RWX            ibmc-vpc-file-5iops-tier      30s
volume-secret   Bound    pvc-1fa0c036-cfbc-4682-8fca-2c4ae75f9d70   10Gi       RWX            ibmc-vpc-file-dp-eni-custom   21h
sameershaikh@Sameers-MacBook-Pro demo %

{"level":"info","ts":"2023-07-19T08:58:44.187Z","caller":"ibmcsidriver/identity.go:85","msg":"CSIIdentityServer-Probe...","RequestID":"b29ff880-1798-4261-8e6e-93e630d7a1a2","Request":{}}
I0719 08:58:52.713895       1 server.go:153] GRPC call: /csi.v1.Controller/CreateVolume
I0719 08:58:52.713916       1 server.go:154] GRPC request: name:"pvc-92b73821-8f31-48ee-aba4-2c3925713ce9" capacity_range:<required_bytes:10737418240 > volume_capabilities:<mount:<mount_flags:"hard" mount_flags:"nfsvers=4.1" mount_flags:"sec=sys" > access_mode:<mode:MULTI_NODE_MULTI_WRITER > > parameters:<key:"billingType" value:"hourly" > parameters:<key:"classVersion" value:"1" > parameters:<key:"encrypted" value:"false" > parameters:<key:"encryptionKey" value:"" > parameters:<key:"profile" value:"tier-5iops" > parameters:<key:"region" value:"" > parameters:<key:"resourceGroup" value:"" > parameters:<key:"tags" value:"" > parameters:<key:"zone" value:"" > accessibility_requirements:<requisite:<segments:<key:"failure-domain.beta.kubernetes.io/region" value:"us-south" > segments:<key:"failure-domain.beta.kubernetes.io/zone" value:"us-south-3" > > requisite:<segments:<key:"failure-domain.beta.kubernetes.io/region" value:"us-south" > segments:<key:"failure-domain.beta.kubernetes.io/zone" value:"us-south-1" > > preferred:<segments:<key:"failure-domain.beta.kubernetes.io/region" value:"us-south" > segments:<key:"failure-domain.beta.kubernetes.io/zone" value:"us-south-3" > > preferred:<segments:<key:"failure-domain.beta.kubernetes.io/region" value:"us-south" > segments:<key:"failure-domain.beta.kubernetes.io/zone" value:"us-south-1" > > >
{"level":"info","ts":"2023-07-19T08:58:52.714Z","caller":"ibmcsidriver/controller.go:74","msg":"CSIControllerServer-CreateVolume... ","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","Request":{"name":"pvc-92b73821-8f31-48ee-aba4-2c3925713ce9","capacity_range":{"required_bytes":10737418240},"volume_capabilities":[{"AccessType":{"Mount":{"mount_flags":["hard","nfsvers=4.1","sec=sys"]}},"access_mode":{"mode":5}}],"parameters":{"billingType":"hourly","classVersion":"1","encrypted":"false","encryptionKey":"","profile":"tier-5iops","region":"","resourceGroup":"","tags":"","zone":""},"accessibility_requirements":{"requisite":[{"segments":{"failure-domain.beta.kubernetes.io/region":"us-south","failure-domain.beta.kubernetes.io/zone":"us-south-3"}},{"segments":{"failure-domain.beta.kubernetes.io/region":"us-south","failure-domain.beta.kubernetes.io/zone":"us-south-1"}}],"preferred":[{"segments":{"failure-domain.beta.kubernetes.io/region":"us-south","failure-domain.beta.kubernetes.io/zone":"us-south-3"}},{"segments":{"failure-domain.beta.kubernetes.io/region":"us-south","failure-domain.beta.kubernetes.io/zone":"us-south-1"}}]}}}
{"level":"info","ts":"2023-07-19T08:58:52.714Z","caller":"ibmcsidriver/controller_helper.go:176","msg":"Ignoring storage class parameter","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","ClassParameter":"classVersion"}
{"level":"info","ts":"2023-07-19T08:58:52.714Z","caller":"ibmcsidriver/controller_helper.go:243","msg":"Volume size in bytes","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","capacity":10737418240}
{"level":"info","ts":"2023-07-19T08:58:52.714Z","caller":"ibmcsidriver/controller_helper.go:249","msg":"Volume size in GiB","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","capacity":10}
{"level":"info","ts":"2023-07-19T08:58:52.714Z","caller":"ibmcsidriver/controller.go:102","msg":"Volume request after masking encryption key","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","Volume":{"provider":"","volumeType":"","capacity":10,"iops":null,"tier":null,"region":"us-south","az":"us-south-3","creationTime":"0001-01-01T00:00:00Z","name":"pvc-92b73821-8f31-48ee-aba4-2c3925713ce9","resource_group":{"id":"300b9469ee8676f9a038ecdf408c1a9d"},"encryption_key":{"crn":"********"},"profile":{"name":"tier-5iops"}}}
{"level":"info","ts":"2023-07-19T08:58:52.714Z","caller":"ibmcloudprovider/volume_provider.go:99","msg":"IBMCloudStorageProvider-GetProviderSession...","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b"}
{"level":"info","ts":"2023-07-19T08:58:52.714Z","caller":"utils/init_provider.go:67","msg":"Fetching provider session","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b"}
{"level":"info","ts":"2023-07-19T08:58:52.714Z","caller":"utils/init_provider.go:73","msg":"Calling provider/utils/init_provider.go GenerateContextCredentials","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b"}
{"level":"info","ts":"2023-07-19T08:58:52.714Z","caller":"utils/init_provider.go:92","msg":"Generating generateContextCredentials for ","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","Provider ID":""}
{"level":"info","ts":"2023-07-19T08:58:52.714Z","caller":"utils/init_provider.go:97","msg":"Calling provider/init_provider.go ForIAMAccessToken","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b"}
{"level":"info","ts":"2023-07-19T08:58:52.714Z","caller":"iam/token_exchange_iks.go:96","msg":"Fetching using secret provider","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b"}
{"level":"info","timestamp":"2023-07-19T08:58:52.714Z","caller":"secret_provider/managed_secret_provider.go:107","msg":"Connecting to sidecar","name":"secret-provider","secret-provider-type":"managed-secret-provider"}
{"level":"info","timestamp":"2023-07-19T08:58:52.717Z","caller":"secret_provider/managed_secret_provider.go:130","msg":"Fetched IAM token for default secret","name":"secret-provider","secret-provider-type":"managed-secret-provider"}
{"level":"info","ts":"2023-07-19T08:58:52.717Z","caller":"iam/token_exchange_iks.go:102","msg":"Successfully fetched iam token","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b"}
{"level":"info","ts":"2023-07-19T08:58:52.717Z","caller":"provider/provider.go:144","msg":"Entering OpenSession","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b"}
{"level":"info","ts":"2023-07-19T08:58:52.717Z","caller":"provider/provider.go:167","msg":"","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","apiConfig.ContextID":"27f727e6-0d12-4554-ad18-e51a927d042b "}
{"level":"info","ts":"2023-07-19T08:58:52.717Z","caller":"metrics/metrics.go:73","msg":"Time to complete","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","OpenSession":0.000022443}
{"level":"info","ts":"2023-07-19T08:58:52.717Z","caller":"utils/init_provider.go:86","msg":"Successfully fetched provider session","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b"}
{"level":"info","ts":"2023-07-19T08:58:52.717Z","caller":"ibmcloudprovider/volume_provider.go:115","msg":"Successfully got the provider session","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","ProviderName":"VPC-SHARE"}
{"level":"info","ts":"2023-07-19T08:58:52.717Z","caller":"provider/get_volume.go:63","msg":"Basic validation for volume Name...","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","VolumeName":"pvc-92b73821-8f31-48ee-aba4-2c3925713ce9"}
{"level":"info","ts":"2023-07-19T08:58:52.717Z","caller":"provider/get_volume.go:69","msg":"Getting volume details from VPC provider...","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","VolumeName":"pvc-92b73821-8f31-48ee-aba4-2c3925713ce9"}
{"level":"info","ts":"2023-07-19T08:58:52.717Z","caller":"vpcfilevolume/list_file_shares.go:47","msg":"Equivalent curl command","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","URL":"https://us-south-stage01.private.iaasdev.cloud.ibm.com/v1/shares?generation=2&maturity=beta&version=2023-05-30","Operation":{"Name":"ListFileShares","Method":"GET","PathPattern":"/v1/shares"}}
2023/07/19 08:58:53 TIME TAKEN BY FUNCTION ListFileShares IS 1.040151905s
2023/07/19 08:58:53 TIME TAKEN BY FUNCTION GetFileShareByName IS 1.040222476s
{"level":"info","ts":"2023-07-19T08:58:53.757Z","caller":"provider/get_volume.go:81","msg":"Successfully retrieved volume details from VPC backend","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","VolumeDetails":null}
{"level":"info","ts":"2023-07-19T08:58:53.757Z","caller":"provider/util.go:222","msg":"Volume details are empty","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b"}
{"level":"info","ts":"2023-07-19T08:58:53.757Z","caller":"ibmcsidriver/controller.go:132","msg":"Creating Volume...","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b"}
{"level":"info","ts":"2023-07-19T08:58:53.757Z","caller":"provider/create_volume.go:42","msg":"Basic validation for CreateVolume request... ","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","RequestedVolumeDetails":{"provider":"","volumeType":"","capacity":10,"iops":null,"tier":null,"region":"us-south","az":"us-south-3","creationTime":"0001-01-01T00:00:00Z","name":"pvc-92b73821-8f31-48ee-aba4-2c3925713ce9","resource_group":{"id":"300b9469ee8676f9a038ecdf408c1a9d"},"profile":{"name":"tier-5iops"}}}
{"level":"info","ts":"2023-07-19T08:58:53.757Z","caller":"provider/create_volume.go:47","msg":"Successfully validated inputs for CreateVolume request... ","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b"}
{"level":"info","ts":"2023-07-19T08:58:53.757Z","caller":"provider/create_volume.go:70","msg":"Calling VPC provider for volume creation...","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b"}
{"level":"info","ts":"2023-07-19T08:58:53.757Z","caller":"vpcfilevolume/create_file_share.go:46","msg":"Equivalent curl command and payload details","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","URL":"https://us-south-stage01.private.iaasdev.cloud.ibm.com/v1/shares?generation=2&maturity=beta&version=2023-05-30","Payload":{"name":"pvc-92b73821-8f31-48ee-aba4-2c3925713ce9","size":10,"resource_group":{"id":"300b9469ee8676f9a038ecdf408c1a9d"},"profile":{"name":"tier-5iops"},"zone":{"name":"us-south-3"}},"Operation":{"Name":"CreateFileShare","Method":"POST","PathPattern":"/v1/shares"}}
I0719 08:58:54.194961       1 server.go:153] GRPC call: /csi.v1.Identity/Probe
I0719 08:58:54.194988       1 server.go:154] GRPC request:
I0719 08:58:54.195113       1 server.go:159] GRPC response:
{"level":"info","ts":"2023-07-19T08:58:54.195Z","caller":"ibmcsidriver/identity.go:85","msg":"CSIIdentityServer-Probe...","RequestID":"ebc241c7-6811-47cb-87c8-213d0c313fdf","Request":{}}
2023/07/19 08:58:54 TIME TAKEN BY FUNCTION CreateFileShare IS 737.409646ms
{"level":"info","ts":"2023-07-19T08:58:54.495Z","caller":"provider/create_volume.go:82","msg":"Successfully created volume from VPC provider...","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","VolumeDetails":{"crn":"crn:v1:staging:public:is:us-south-3:a/77f2bceddaeb577dcaddb4073fe82c1c::share:r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/shares/r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","id":"r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","name":"pvc-92b73821-8f31-48ee-aba4-2c3925713ce9","size":10,"iops":3000,"resource_group":{"href":"https://resource-controller.test.cloud.ibm.com/v2/resource_groups/300b9469ee8676f9a038ecdf408c1a9d","id":"300b9469ee8676f9a038ecdf408c1a9d","name":"Default"},"initial_owner":{},"profile":{"href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/share/profiles/tier-5iops","name":"tier-5iops"},"created_at":"2023-07-19T08:58:54Z","lifecycle_state":"pending","mount_targets":[],"zone":{"name":"us-south-3","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/regions/us-south/zones/us-south-3"}}}
{"level":"info","ts":"2023-07-19T08:58:54.495Z","caller":"provider/create_volume.go:84","msg":"Waiting for volume to be in valid (stable) state","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","VolumeDetails":{"crn":"crn:v1:staging:public:is:us-south-3:a/77f2bceddaeb577dcaddb4073fe82c1c::share:r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/shares/r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","id":"r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","name":"pvc-92b73821-8f31-48ee-aba4-2c3925713ce9","size":10,"iops":3000,"resource_group":{"href":"https://resource-controller.test.cloud.ibm.com/v2/resource_groups/300b9469ee8676f9a038ecdf408c1a9d","id":"300b9469ee8676f9a038ecdf408c1a9d","name":"Default"},"initial_owner":{},"profile":{"href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/share/profiles/tier-5iops","name":"tier-5iops"},"created_at":"2023-07-19T08:58:54Z","lifecycle_state":"pending","mount_targets":[],"zone":{"name":"us-south-3","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/regions/us-south/zones/us-south-3"}}}
{"level":"info","ts":"2023-07-19T08:58:54.495Z","caller":"provider/wait_for_valid_volume_state.go:35","msg":"Getting file share details from VPC file provider...","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","VolumeID":"r134-63ecf3f0-07b0-41bb-ae44-a5669065912b"}
{"level":"info","ts":"2023-07-19T08:58:54.495Z","caller":"vpcfilevolume/get_file_share.go:46","msg":"Equivalent curl command","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","URL":"https://us-south-stage01.private.iaasdev.cloud.ibm.com/v1/shares/%7Bshare-id%7D?generation=2&maturity=beta&version=2023-05-30","Operation":{"Name":"GetFileShare","Method":"GET","PathPattern":"/v1/shares/{share-id}"}}
2023/07/19 08:58:54 TIME TAKEN BY FUNCTION GetFileShare IS 333.215567ms
{"level":"info","ts":"2023-07-19T08:58:54.828Z","caller":"provider/wait_for_valid_volume_state.go:43","msg":"Getting file share details from VPC provider...","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","volume":{"crn":"crn:v1:staging:public:is:us-south-3:a/77f2bceddaeb577dcaddb4073fe82c1c::share:r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/shares/r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","id":"r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","name":"pvc-92b73821-8f31-48ee-aba4-2c3925713ce9","size":10,"iops":3000,"resource_group":{"href":"https://resource-controller.test.cloud.ibm.com/v2/resource_groups/300b9469ee8676f9a038ecdf408c1a9d","id":"300b9469ee8676f9a038ecdf408c1a9d","name":"Default"},"initial_owner":{},"profile":{"href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/share/profiles/tier-5iops","name":"tier-5iops"},"created_at":"2023-07-19T08:58:54Z","lifecycle_state":"pending","mount_targets":[],"zone":{"name":"us-south-3","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/regions/us-south/zones/us-south-3"}}}
I0719 08:59:04.186957       1 server.go:153] GRPC call: /csi.v1.Identity/Probe
I0719 08:59:04.186982       1 server.go:154] GRPC request:
I0719 08:59:04.187113       1 server.go:159] GRPC response:
{"level":"info","ts":"2023-07-19T08:59:04.187Z","caller":"ibmcsidriver/identity.go:85","msg":"CSIIdentityServer-Probe...","RequestID":"71333057-4856-4a72-bfeb-8027183931fb","Request":{}}
{"level":"info","ts":"2023-07-19T08:59:04.828Z","caller":"vpcfilevolume/get_file_share.go:46","msg":"Equivalent curl command","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","URL":"https://us-south-stage01.private.iaasdev.cloud.ibm.com/v1/shares/%7Bshare-id%7D?generation=2&maturity=beta&version=2023-05-30","Operation":{"Name":"GetFileShare","Method":"GET","PathPattern":"/v1/shares/{share-id}"}}
{"level":"info","ts":"2023-07-19T08:59:05.165Z","caller":"provider/wait_for_valid_volume_state.go:43","msg":"Getting file share details from VPC provider...","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","volume":{"crn":"crn:v1:staging:public:is:us-south-3:a/77f2bceddaeb577dcaddb4073fe82c1c::share:r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/shares/r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","id":"r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","name":"pvc-92b73821-8f31-48ee-aba4-2c3925713ce9","size":10,"iops":3000,"resource_group":{"href":"https://resource-controller.test.cloud.ibm.com/v2/resource_groups/300b9469ee8676f9a038ecdf408c1a9d","id":"300b9469ee8676f9a038ecdf408c1a9d","name":"Default"},"initial_owner":{},"profile":{"href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/share/profiles/tier-5iops","name":"tier-5iops"},"created_at":"2023-07-19T08:58:54Z","lifecycle_state":"stable","mount_targets":[],"zone":{"name":"us-south-3","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/regions/us-south/zones/us-south-3"}}}
{"level":"info","ts":"2023-07-19T08:59:05.165Z","caller":"provider/wait_for_valid_volume_state.go:45","msg":"Volume got valid (stable) state","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","VolumeDetails":{"crn":"crn:v1:staging:public:is:us-south-3:a/77f2bceddaeb577dcaddb4073fe82c1c::share:r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/shares/r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","id":"r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","name":"pvc-92b73821-8f31-48ee-aba4-2c3925713ce9","size":10,"iops":3000,"resource_group":{"href":"https://resource-controller.test.cloud.ibm.com/v2/resource_groups/300b9469ee8676f9a038ecdf408c1a9d","id":"300b9469ee8676f9a038ecdf408c1a9d","name":"Default"},"initial_owner":{},"profile":{"href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/share/profiles/tier-5iops","name":"tier-5iops"},"created_at":"2023-07-19T08:58:54Z","lifecycle_state":"stable","mount_targets":[],"zone":{"name":"us-south-3","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/regions/us-south/zones/us-south-3"}}}
{"level":"info","ts":"2023-07-19T08:59:05.165Z","caller":"metrics/metrics.go:73","msg":"Time to complete","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","WaitForValidVolumeState":10.67049682}
2023/07/19 08:59:05 TIME TAKEN BY FUNCTION GetFileShare IS 336.831072ms
{"level":"info","ts":"2023-07-19T08:59:05.165Z","caller":"provider/create_volume.go:89","msg":"Volume got valid (stable) state","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","VolumeDetails":{"crn":"crn:v1:staging:public:is:us-south-3:a/77f2bceddaeb577dcaddb4073fe82c1c::share:r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/shares/r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","id":"r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","name":"pvc-92b73821-8f31-48ee-aba4-2c3925713ce9","size":10,"iops":3000,"resource_group":{"href":"https://resource-controller.test.cloud.ibm.com/v2/resource_groups/300b9469ee8676f9a038ecdf408c1a9d","id":"300b9469ee8676f9a038ecdf408c1a9d","name":"Default"},"initial_owner":{},"profile":{"href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/share/profiles/tier-5iops","name":"tier-5iops"},"created_at":"2023-07-19T08:58:54Z","lifecycle_state":"pending","mount_targets":[],"zone":{"name":"us-south-3","href":"https://us-south-stage01.iaasdev.cloud.ibm.com/v1/regions/us-south/zones/us-south-3"}}}
{"level":"info","ts":"2023-07-19T08:59:05.165Z","caller":"provider/create_volume.go:100","msg":"VolumeResponse","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","volumeResponse":{"volumeID":"r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","provider":"VPC-SHARE","volumeType":"vpc-share","capacity":10,"iops":"3000","tier":null,"region":"us-south","az":"us-south-3","creationTime":"2023-07-19T08:58:54Z","crn":"crn:v1:staging:public:is:us-south-3:a/77f2bceddaeb577dcaddb4073fe82c1c::share:r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","volume_access_points":[]}}
{"level":"info","ts":"2023-07-19T08:59:05.165Z","caller":"metrics/metrics.go:73","msg":"Time to complete","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","CreateVolume":11.408288894}
{"level":"info","ts":"2023-07-19T08:59:05.165Z","caller":"ibmcsidriver/controller.go:139","msg":"Volume Created","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","Volume":{"volumeID":"r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","provider":"VPC-SHARE","volumeType":"vpc-share","capacity":10,"iops":"3000","tier":null,"region":"us-south","az":"us-south-3","creationTime":"2023-07-19T08:58:54Z","crn":"crn:v1:staging:public:is:us-south-3:a/77f2bceddaeb577dcaddb4073fe82c1c::share:r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","volume_access_points":[]}}
{"level":"info","ts":"2023-07-19T08:59:05.165Z","caller":"ibmcsidriver/controller_helper.go:434","msg":"Creating VolumeAccessPoint...","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b"}
{"level":"info","ts":"2023-07-19T08:59:05.165Z","caller":"provider/create_volume_access_point.go:45","msg":"Validating basic inputs for CreateVolumeAccessPoint method...","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","volumeAccessPointRequest":{"volumeID":"r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","vpc_id":"r134-760e83aa-ada4-4442-a444-2543ee7680d6"}}
{"level":"info","ts":"2023-07-19T08:59:05.165Z","caller":"provider/create_volume_access_point.go:59","msg":"Checking if volume accessPoint is already created by other thread","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b"}
{"level":"info","ts":"2023-07-19T08:59:05.166Z","caller":"provider/get_volume.access_point.go:34","msg":"Validating basic inputs for GetVolumeAccessPoint method...","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","volumeAccessPointRequest":{"volumeID":"r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","vpc_id":"r134-760e83aa-ada4-4442-a444-2543ee7680d6"}}
{"level":"info","ts":"2023-07-19T08:59:05.166Z","caller":"provider/get_volume.access_point.go:84","msg":"Getting VolumeTargetList from VPC provider...","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b"}
{"level":"info","ts":"2023-07-19T08:59:05.166Z","caller":"vpcfilevolume/list_file_share_targets.go:46","msg":"Equivalent curl command","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","URL":"https://us-south-stage01.private.iaasdev.cloud.ibm.com/v1/shares/%7Bshare-id%7D/mount_targets?generation=2&maturity=beta&version=2023-05-30","Operation":{"Name":"ListFileShareTargets","Method":"GET","PathPattern":"/v1/shares/{share-id}/mount_targets"}}
2023/07/19 08:59:05 TIME TAKEN BY FUNCTION ListFileShareTargets IS 304.087029ms
{"level":"error","ts":"2023-07-19T08:59:05.470Z","caller":"provider/get_volume.access_point.go:117","msg":"Volume AccessPoint not found","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b"}
{"level":"info","ts":"2023-07-19T08:59:05.470Z","caller":"provider/get_volume.access_point.go:48","msg":"Volume access point response","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","volumeAccessPointResponse":null,"error":"{Code:AccessPointWithVPCIDFindFailed, Type:VolumeAccessPointFindFailed, Description:No mount target could be found for the specified file share ID 'r134-63ecf3f0-07b0-41bb-ae44-a5669065912b' and VPC ID r134-760e83aa-ada4-4442-a444-2543ee7680d6, BackendError:no volume access point found, RC:400}"}
{"level":"info","ts":"2023-07-19T08:59:05.470Z","caller":"provider/create_volume_access_point.go:68","msg":"Creating volume accessPoint from VPC provider...","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b"}
{"level":"info","ts":"2023-07-19T08:59:05.470Z","caller":"vpcfilevolume/create_file_share_target.go:48","msg":"Equivalent curl command and payload details","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","URL":"https://us-south-stage01.private.iaasdev.cloud.ibm.com/v1/shares/%7Bshare-id%7D/mount_targets?generation=2&maturity=beta&version=2023-05-30","Payload":{"vpc":{"id":"r134-760e83aa-ada4-4442-a444-2543ee7680d6"}},"Operation":{"Name":"CreateFileShareTarget","Method":"POST","PathPattern":"/v1/shares/{share-id}/mount_targets"},"PathParameters":"r134-63ecf3f0-07b0-41bb-ae44-a5669065912b"}
2023/07/19 08:59:06 TIME TAKEN BY FUNCTION FileShareService.CreateFileShareTarget IS 582.331739ms
{"level":"info","ts":"2023-07-19T08:59:06.052Z","caller":"vpcfilevolume/create_file_share_target.go:56","msg":"Successfully created the file share target","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b"}
{"level":"info","ts":"2023-07-19T08:59:06.052Z","caller":"metrics/metrics.go:73","msg":"Time to complete","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","FileShareService.CreateFileShareTarget":0.582290073}
{"level":"info","ts":"2023-07-19T08:59:06.052Z","caller":"provider/create_volume_access_point.go:83","msg":"Successfully created volume accessPoint from VPC provider","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","volumeAccessPointResponse":{"volumeID":"","AccessPointID":"r134-6d47a7d1-5722-4345-b77b-bc925536df1b","status":"pending","mount_path":"","created_at":"2023-07-19T08:59:05Z"}}
{"level":"info","ts":"2023-07-19T08:59:06.052Z","caller":"metrics/metrics.go:73","msg":"Time to complete","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","CreateVolumeAccessPoint":0.88671082}
{"level":"info","ts":"2023-07-19T08:59:06.052Z","caller":"ibmcsidriver/controller_helper.go:440","msg":"Volume Access Point Created","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","Volume Access Point":{"volumeID":"r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","AccessPointID":"r134-6d47a7d1-5722-4345-b77b-bc925536df1b","status":"pending","mount_path":"","created_at":"2023-07-19T08:59:05Z"}}
{"level":"info","ts":"2023-07-19T08:59:06.052Z","caller":"ibmcsidriver/controller_helper.go:445","msg":"Waiting for CreateVolumeAccessPoint...","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b"}
{"level":"info","ts":"2023-07-19T08:59:06.052Z","caller":"provider/wait_for_create_volume_access_point.go:35","msg":"Getting volume target details from VPC file provider...","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","VolumeID":"r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","VPCID":"r134-760e83aa-ada4-4442-a444-2543ee7680d6"}
{"level":"info","ts":"2023-07-19T08:59:06.052Z","caller":"provider/wait_for_create_volume_access_point.go:37","msg":"Validating basic inputs for WaitForCreateVolumeAccessPoint method...","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","volumeAccessPointTemplate":{"volumeID":"r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","accessPointID":"r134-6d47a7d1-5722-4345-b77b-bc925536df1b","vpc_id":"r134-760e83aa-ada4-4442-a444-2543ee7680d6"}}
{"level":"info","ts":"2023-07-19T08:59:06.052Z","caller":"provider/get_volume.access_point.go:34","msg":"Validating basic inputs for GetVolumeAccessPoint method...","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","volumeAccessPointRequest":{"volumeID":"r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","accessPointID":"r134-6d47a7d1-5722-4345-b77b-bc925536df1b","vpc_id":"r134-760e83aa-ada4-4442-a444-2543ee7680d6"}}
{"level":"info","ts":"2023-07-19T08:59:06.052Z","caller":"provider/get_volume.access_point.go:55","msg":"Getting VolumeAccessPoint from VPC provider...","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b"}
{"level":"info","ts":"2023-07-19T08:59:06.052Z","caller":"vpcfilevolume/get_file_share_target.go:46","msg":"Equivalent curl command","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","URL":"https://us-south-stage01.private.iaasdev.cloud.ibm.com/v1/shares/%7Bshare-id%7D/mount_targets/%7Btarget-id%7D?generation=2&maturity=beta&version=2023-05-30","Operation":{"Name":"GetFileShareTarget","Method":"GET","PathPattern":"/v1/shares/{share-id}/mount_targets/{target-id}"}}
2023/07/19 08:59:06 TIME TAKEN BY FUNCTION GetFileShareTarget IS 566.01226ms
{"level":"info","ts":"2023-07-19T08:59:06.618Z","caller":"provider/get_volume.access_point.go:77","msg":"Successfully retrieved volume AccessPoint","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","volumeAccessPointResponse":{"volumeID":"r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","AccessPointID":"r134-6d47a7d1-5722-4345-b77b-bc925536df1b","status":"stable","mount_path":"fsf-dal1395b-vs91-stg-fz.adn.networklayer.com:/2880c8ba_a092_4a3c_9d28_708ea664fe0c","created_at":"2023-07-19T08:59:05Z"}}
{"level":"info","ts":"2023-07-19T08:59:06.619Z","caller":"provider/get_volume.access_point.go:48","msg":"Volume access point response","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","volumeAccessPointResponse":{"volumeID":"r134-63ecf3f0-07b0-41bb-ae44-a5669065912b","AccessPointID":"r134-6d47a7d1-5722-4345-b77b-bc925536df1b","status":"stable","mount_path":"fsf-dal1395b-vs91-stg-fz.adn.networklayer.com:/2880c8ba_a092_4a3c_9d28_708ea664fe0c","created_at":"2023-07-19T08:59:05Z"}}
{"level":"info","ts":"2023-07-19T08:59:06.619Z","caller":"metrics/metrics.go:73","msg":"Time to complete","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","WaitForCreateVolumeAccessPoint":0.566286418}
{"level":"info","ts":"2023-07-19T08:59:06.619Z","caller":"ibmcsidriver/controller_helper.go:453","msg":"VolumeAccessPoint is in stable state","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","Volume Access Point":"r134-6d47a7d1-5722-4345-b77b-bc925536df1b"}
{"level":"info","ts":"2023-07-19T08:59:06.619Z","caller":"metrics/metrics.go:99","msg":"Time to complete","RequestID":"27f727e6-0d12-4554-ad18-e51a927d042b","CreateVolume":13.904798785}

Verifying custom and DP2 profile
sameershaikh@Sameers-MacBook-Pro eni % kubectl get sc ibmc-vpc-file-dp-eni-custom -o yaml
allowVolumeExpansion: true
apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
  annotations:
    kubectl.kubernetes.io/last-applied-configuration: |
      {"allowVolumeExpansion":true,"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{},"name":"ibmc-vpc-file-dp-eni-custom"},"mountOptions":["hard","nfsvers=4.1","sec=sys"],"parameters":{"billingType":"hourly","classVersion":"1","csi.storage.k8s.io/provisioner-secret-name":"${pvc.name}","csi.storage.k8s.io/provisioner-secret-namespace":"${pvc.namespace}","encrypted":"false","encryptionKey":"","iops":"","isENIEnabled":"true","primaryIPAddress":"","primaryIPID":"","profile":"dp2","region":"","resourceGroup":"","securityGroupIDs":"","subnetID":"","tags":"","zone":""},"provisioner":"vpc.file.csi.ibm.io","reclaimPolicy":"Delete"}
  creationTimestamp: "2023-07-19T16:15:30Z"
  name: ibmc-vpc-file-dp-eni-custom
  resourceVersion: "627044"
  uid: 6e508bf8-6ae0-4b09-a99f-e5c1f6b73f0d
mountOptions:
- hard
- nfsvers=4.1
- sec=sys
parameters:
  billingType: hourly
  classVersion: "1"
  csi.storage.k8s.io/provisioner-secret-name: ${pvc.name}
  csi.storage.k8s.io/provisioner-secret-namespace: ${pvc.namespace}
  encrypted: "false"
  encryptionKey: ""
  iops: ""
  profile: dp2
  region: ""
  resourceGroup: ""
  tags: ""
  zone: ""
provisioner: vpc.file.csi.ibm.io
reclaimPolicy: Delete
volumeBindingMode: Immediate
sameershaikh@Sameers-MacBook-Pro eni %

Verifying Custom profile
sameershaikh@Sameers-MacBook-Pro eni % kubectl apply -f vpcfilecustom.yaml
persistentvolumeclaim/custom-default-profile created
sameershaikh@Sameers-MacBook-Pro eni % kubectl get pvc
NAME                     STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS               AGE
custom-default-profile   Bound    pvc-56c580b2-60f7-454b-a909-22921891eed9   10Gi       RWX            ibmc-vpc-file-custom       2m31s
custom-file              Bound    pvc-08e1b36f-9854-47bc-8a8d-dbffcc758c93   10Gi       RWX            ibmc-vpc-file-custom       8h
pv-file-1                Bound    pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd   30Gi       RWX            ibmc-vpc-file-5iops-tier   14h
pv-file-beta             Bound    pvc-92b73821-8f31-48ee-aba4-2c3925713ce9   10Gi       RWX            ibmc-vpc-file-5iops-tier   9h

sameershaikh@Sameers-MacBook-Pro eni % kubectl apply -f custom-deployment.yaml
deployment.apps/testpodrwm configured

sameershaikh@Sameers-MacBook-Pro eni % kubectl get pods
NAME                               READY   STATUS        RESTARTS   AGE
testpodrwm-6448db6764-4rgq5        1/1     Running       0          20s
testpodrwm-6448db6764-mgbpp        1/1     Running       0          22s
testpodrwm-6448db6764-rb2d5        1/1     Running       0          25s

Verifying custom with secret
sameershaikh@Sameers-MacBook-Pro eni % kubectl get sc ibmc-vpc-file-dp-custom -o yaml
allowVolumeExpansion: true
apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
  annotations:
    kubectl.kubernetes.io/last-applied-configuration: |
      {"allowVolumeExpansion":true,"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{},"name":"ibmc-vpc-file-dp-custom"},"mountOptions":["hard","nfsvers=4.1","sec=sys"],"parameters":{"billingType":"hourly","classVersion":"1","csi.storage.k8s.io/provisioner-secret-name":"${pvc.name}","csi.storage.k8s.io/provisioner-secret-namespace":"${pvc.namespace}","encrypted":"false","encryptionKey":"","iops":"400","profile":"custom-iops","region":"","resourceGroup":"","tags":"","zone":""},"provisioner":"vpc.file.csi.ibm.io","reclaimPolicy":"Delete"}
  creationTimestamp: "2023-07-19T18:24:07Z"
  name: ibmc-vpc-file-dp-custom
  resourceVersion: "637819"
  uid: 422e37c3-0090-4abd-aba5-967532de77ba
mountOptions:
- hard
- nfsvers=4.1
- sec=sys
parameters:
  billingType: hourly
  classVersion: "1"
  csi.storage.k8s.io/provisioner-secret-name: ${pvc.name}
  csi.storage.k8s.io/provisioner-secret-namespace: ${pvc.namespace}
  encrypted: "false"
  encryptionKey: ""
  iops: "400"
  profile: custom-iops
  region: ""
  resourceGroup: ""
  tags: ""
  zone: ""
provisioner: vpc.file.csi.ibm.io
reclaimPolicy: Delete
volumeBindingMode: Immediate

sameershaikh@Sameers-MacBook-Pro eni % kubectl apply -f volume-secret.yaml
secret/volume-secret created
sameershaikh@Sameers-MacBook-Pro eni % kubectl apply -f pvc-secret.yaml
persistentvolumeclaim/volume-secret created
sameershaikh@Sameers-MacBook-Pro eni %
sameershaikh@Sameers-MacBook-Pro eni %
sameershaikh@Sameers-MacBook-Pro eni % kubectl get pv
^C
sameershaikh@Sameers-MacBook-Pro eni % kubectl get pvc
NAME                     STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS               AGE
custom-default-profile   Bound    pvc-56c580b2-60f7-454b-a909-22921891eed9   10Gi       RWX            ibmc-vpc-file-custom       13m
custom-file              Bound    pvc-08e1b36f-9854-47bc-8a8d-dbffcc758c93   10Gi       RWX            ibmc-vpc-file-custom       8h
pv-file-1                Bound    pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd   30Gi       RWX            ibmc-vpc-file-5iops-tier   14h
pv-file-beta             Bound    pvc-92b73821-8f31-48ee-aba4-2c3925713ce9   10Gi       RWX            ibmc-vpc-file-5iops-tier   9h
volume-secret            Bound    pvc-660141f1-794b-41c3-ba58-4a44964bf440   10Gi       RWX            ibmc-vpc-file-dp-custom    39s

sameershaikh@Sameers-MacBook-Pro eni % kubectl get secret volume-secret -o yaml
apiVersion: v1
data:
  iops: MTAw
  region: ""
  zone: ""
kind: Secret
metadata:
  annotations:
    kubectl.kubernetes.io/last-applied-configuration: |
      {"apiVersion":"v1","kind":"Secret","metadata":{"annotations":{},"name":"volume-secret","namespace":"default"},"stringData":{"iops":"100","region":"","zone":""},"type":"vpc.block.csi.ibm.io"}
  creationTimestamp: "2023-07-19T18:25:34Z"
  name: volume-secret
  namespace: default
  resourceVersion: "638017"
  uid: d0e495e3-2c8d-4f47-9f6e-0091870b5b46
type: vpc.block.csi.ibm.io
sameershaikh@Sameers-MacBook-Pro eni %

Invalid IOPS value for size dp2 profile
I0719 18:36:24.195497       1 server.go:153] GRPC call: /csi.v1.Controller/CreateVolume
I0719 18:36:24.195527       1 server.go:154] GRPC request: name:"pvc-5771972d-c9fe-47c1-ab90-d7c313813a0d" capacity_range:<required_bytes:17179869184000 > volume_capabilities:<mount:<mount_flags:"hard" mount_flags:"nfsvers=4.1" mount_flags:"sec=sys" > access_mode:<mode:MULTI_NODE_MULTI_WRITER > > parameters:<key:"billingType" value:"hourly" > parameters:<key:"classVersion" value:"1" > parameters:<key:"encrypted" value:"false" > parameters:<key:"encryptionKey" value:"" > parameters:<key:"iops" value:"100" > parameters:<key:"profile" value:"dp2" > parameters:<key:"region" value:"" > parameters:<key:"resourceGroup" value:"" > parameters:<key:"tags" value:"" > parameters:<key:"zone" value:"" > secrets:<key:"iops" value:"100" > secrets:<key:"region" value:"" > secrets:<key:"zone" value:"" > accessibility_requirements:<requisite:<segments:<key:"failure-domain.beta.kubernetes.io/region" value:"us-south" > segments:<key:"failure-domain.beta.kubernetes.io/zone" value:"us-south-1" > > requisite:<segments:<key:"failure-domain.beta.kubernetes.io/region" value:"us-south" > segments:<key:"failure-domain.beta.kubernetes.io/zone" value:"us-south-3" > > preferred:<segments:<key:"failure-domain.beta.kubernetes.io/region" value:"us-south" > segments:<key:"failure-domain.beta.kubernetes.io/zone" value:"us-south-1" > > preferred:<segments:<key:"failure-domain.beta.kubernetes.io/region" value:"us-south" > segments:<key:"failure-domain.beta.kubernetes.io/zone" value:"us-south-3" > > >
{"level":"error","ts":"2023-07-19T18:36:24.195Z","caller":"ibmcsidriver/controller_helper.go:405","msg":"overrideParams","RequestID":"a2bf3f1a-fb33-4d36-af11-a8062490c64b","Secret Parameters":"invalid IOPS: <100> for capacity: <16000GiB>. Should be in range [2000 - 96000]"}
{"level":"error","ts":"2023-07-19T18:36:24.196Z","caller":"ibmcsidriver/controller.go:106","msg":"Unable to extract parameters","RequestID":"a2bf3f1a-fb33-4d36-af11-a8062490c64b","error":"invalid IOPS: <100> for capacity: <16000GiB>. Should be in range [2000 - 96000]"}
{"level":"error","ts":"2023-07-19T18:36:24.196Z","caller":"messages/messages.go:62","msg":"FAILED CSI ERROR","RequestID":"a2bf3f1a-fb33-4d36-af11-a8062490c64b","error":"{RequestID: a2bf3f1a-fb33-4d36-af11-a8062490c64b , Code: InvalidParameters, Description: Failed to extract parameters, BackendError: invalid IOPS: <100> for capacity: <16000GiB>. Should be in range [2000 - 96000], Action: Please provide valid parameters}"}
E0719 18:36:24.196134       1 server.go:157] GRPC error: rpc error: code = InvalidArgument desc = {RequestID: a2bf3f1a-fb33-4d36-af11-a8062490c64b , Code: InvalidParameters, Description: Failed to extract parameters, BackendError: invalid IOPS: <100> for capacity: <16000GiB>. Should be in range [2000 - 96000], Action: Please provide valid parameters}
{"level":"info","ts":"2023-07-19T18:36:24.195Z","caller":"ibmcsidriver/controller.go:74","msg":"CSIControllerServer-CreateVolume... ","RequestID":"a2bf3f1a-fb33-4d36-af11-a8062490c64b","Request":{"name":"pvc-5771972d-c9fe-47c1-ab90-d7c313813a0d","capacity_range":{"required_bytes":17179869184000},"volume_capabilities":[{"AccessType":{"Mount":{"mount_flags":["hard","nfsvers=4.1","sec=sys"]}},"access_mode":{"mode":5}}],"parameters":{"billingType":"hourly","classVersion":"1","encrypted":"false","encryptionKey":"","iops":"100","profile":"dp2","region":"","resourceGroup":"","tags":"","zone":""},"secrets":{"iops":"100","region":"","zone":""},"accessibility_requirements":{"requisite":[{"segments":{"failure-domain.beta.kubernetes.io/region":"us-south","failure-domain.beta.kubernetes.io/zone":"us-south-1"}},{"segments":{"failure-domain.beta.kubernetes.io/region":"us-south","failure-domain.beta.kubernetes.io/zone":"us-south-3"}}],"preferred":[{"segments":{"failure-domain.beta.kubernetes.io/region":"us-south","failure-domain.beta.kubernetes.io/zone":"us-south-1"}},{"segments":{"failure-domain.beta.kubernetes.io/region":"us-south","failure-domain.beta.kubernetes.io/zone":"us-south-3"}}]}}}
{"level":"info","ts":"2023-07-19T18:36:24.195Z","caller":"ibmcsidriver/controller_helper.go:190","msg":"Ignoring storage class parameter","RequestID":"a2bf3f1a-fb33-4d36-af11-a8062490c64b","ClassParameter":"classVersion"}
{"level":"info","ts":"2023-07-19T18:36:24.195Z","caller":"ibmcsidriver/controller_helper.go:257","msg":"Volume size in bytes","RequestID":"a2bf3f1a-fb33-4d36-af11-a8062490c64b","capacity":17179869184000}
{"level":"info","ts":"2023-07-19T18:36:24.195Z","caller":"ibmcsidriver/controller_helper.go:263","msg":"Volume size in GiB","RequestID":"a2bf3f1a-fb33-4d36-af11-a8062490c64b","capacity":16000}
{"level":"info","ts":"2023-07-19T18:36:24.195Z","caller":"ibmcsidriver/controller.go:102","msg":"Volume request after masking encryption key","RequestID":"a2bf3f1a-fb33-4d36-af11-a8062490c64b","Volume":{"provider":"","volumeType":"","capacity":16000,"iops":"100","tier":null,"creationTime":"0001-01-01T00:00:00Z","name":"pvc-5771972d-c9fe-47c1-ab90-d7c313813a0d","resource_group":{},"encryption_key":{"crn":"********"},"profile":{"name":"dp2"}}}
{"level":"info","ts":"2023-07-19T18:36:24.196Z","caller":"metrics/metrics.go:99","msg":"Time to complete","RequestID":"a2bf3f1a-fb33-4d36-af11-a8062490c64b","CreateVolume":0.000193307}
I0719 18:36:32.607949       1 server.go:153] GRPC call: /csi.v1.Identity/Probe
I0719 18:36:32.607978       1 server.go:154] GRPC request:
{"level":"info","ts":"2023-07-19T18:36:32.608Z","caller":"ibmcsidriver/identity.go:85","msg"

Volume expansion for dp2 profile
sameershaikh@Sameers-MacBook-Pro eni % kubectl apply -f custom-deployment-secret.yaml
deployment.apps/testpodrwm-sec created

sameershaikh@Sameers-MacBook-Pro eni % kubectl get pods -o wide
NAME                               READY   STATUS              RESTARTS   AGE     IP             NODE           NOMINATED NODE   READINESS GATES
testpodrwm-beta-84b94c4fb4-jf8mc   1/1     Running             0          7h27m   <IP_ADDRESS>   <IP_ADDRESS>   <none>           <none>
testpodrwm-beta-84b94c4fb4-pp82x   1/1     Running             0          7h27m   <IP_ADDRESS>   <IP_ADDRESS>   <none>           <none>
testpodrwm-beta-84b94c4fb4-tzf4p   1/1     Running             0          7h27m   <IP_ADDRESS>   <IP_ADDRESS>   <none>           <none>
testpodrwm-sec-5d56fbbc5b-7b45z    0/1     ContainerCreating   0          18s     <none>         <IP_ADDRESS>     <none>           <none>
testpodrwm-sec-5d56fbbc5b-8vvtz    0/1     ContainerCreating   0          18s     <none>         <IP_ADDRESS>     <none>           <none>
testpodrwm-sec-5d56fbbc5b-psnvl    0/1     ContainerCreating   0          18s     <none>         <IP_ADDRESS>     <none>           <none>
sameershaikh@Sameers-MacBook-Pro eni % kubectl get pods -o wide
NAME                               READY   STATUS              RESTARTS   AGE     IP             NODE           NOMINATED NODE   READINESS GATES
testpodrwm-beta-84b94c4fb4-jf8mc   1/1     Running             0          7h27m   <IP_ADDRESS>   <IP_ADDRESS>   <none>           <none>
testpodrwm-beta-84b94c4fb4-pp82x   1/1     Running             0          7h27m   <IP_ADDRESS>   <IP_ADDRESS>   <none>           <none>
testpodrwm-beta-84b94c4fb4-tzf4p   1/1     Running             0          7h27m   <IP_ADDRESS>   <IP_ADDRESS>   <none>           <none>
testpodrwm-sec-5d56fbbc5b-7b45z    0/1     ContainerCreating   0          21s     <none>         <IP_ADDRESS>     <none>           <none>
testpodrwm-sec-5d56fbbc5b-8vvtz    0/1     ContainerCreating   0          21s     <none>         <IP_ADDRESS>     <none>           <none>
testpodrwm-sec-5d56fbbc5b-psnvl    0/1     ContainerCreating   0          21s     <none>         <IP_ADDRESS>     <none>           <none>
sameershaikh@Sameers-MacBook-Pro eni % kubectl get pods -o wide
NAME                               READY   STATUS              RESTARTS   AGE     IP             NODE           NOMINATED NODE   READINESS GATES
testpodrwm-beta-84b94c4fb4-jf8mc   1/1     Running             0          7h27m   <IP_ADDRESS>   <IP_ADDRESS>   <none>           <none>
testpodrwm-beta-84b94c4fb4-pp82x   1/1     Running             0          7h27m   <IP_ADDRESS>   <IP_ADDRESS>   <none>           <none>
testpodrwm-beta-84b94c4fb4-tzf4p   1/1     Running             0          7h27m   <IP_ADDRESS>   <IP_ADDRESS>   <none>           <none>
testpodrwm-sec-5d56fbbc5b-7b45z    0/1     ContainerCreating   0          22s     <none>         <IP_ADDRESS>     <none>           <none>
testpodrwm-sec-5d56fbbc5b-8vvtz    0/1     ContainerCreating   0          22s     <none>         <IP_ADDRESS>     <none>           <none>
testpodrwm-sec-5d56fbbc5b-psnvl    0/1     ContainerCreating   0          22s     <none>         <IP_ADDRESS>     <none>           <none>
sameershaikh@Sameers-MacBook-Pro eni % kubectl get pvc
NAME                     STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS               AGE
custom-default-profile   Bound    pvc-56c580b2-60f7-454b-a909-22921891eed9   10Gi       RWX            ibmc-vpc-file-custom       38m
custom-file              Bound    pvc-08e1b36f-9854-47bc-8a8d-dbffcc758c93   10Gi       RWX            ibmc-vpc-file-custom       8h
pv-file-1                Bound    pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd   30Gi       RWX            ibmc-vpc-file-5iops-tier   14h
pv-file-beta             Bound    pvc-92b73821-8f31-48ee-aba4-2c3925713ce9   10Gi       RWX            ibmc-vpc-file-5iops-tier   9h
volume-secret            Bound    pvc-467faf79-0e28-4d1b-a3b7-1e99b746df47   10Gi       RWX            ibmc-vpc-file-dp-custom    61s
sameershaikh@Sameers-MacBook-Pro eni % kubectl get pods -o wide
NAME                               READY   STATUS    RESTARTS   AGE     IP             NODE           NOMINATED NODE   READINESS GATES
testpodrwm-beta-84b94c4fb4-jf8mc   1/1     Running   0          7h27m   <IP_ADDRESS>   <IP_ADDRESS>   <none>           <none>
testpodrwm-beta-84b94c4fb4-pp82x   1/1     Running   0          7h27m   <IP_ADDRESS>   <IP_ADDRESS>   <none>           <none>
testpodrwm-beta-84b94c4fb4-tzf4p   1/1     Running   0          7h27m   <IP_ADDRESS>   <IP_ADDRESS>   <none>           <none>
testpodrwm-sec-5d56fbbc5b-7b45z    1/1     Running   0          31s     <IP_ADDRESS>   <IP_ADDRESS>     <none>           <none>
testpodrwm-sec-5d56fbbc5b-8vvtz    1/1     Running   0          31s     <IP_ADDRESS>   <IP_ADDRESS>     <none>           <none>
testpodrwm-sec-5d56fbbc5b-psnvl    1/1     Running   0          31s     <IP_ADDRESS>   <IP_ADDRESS>     <none>           <none>
sameershaikh@Sameers-MacBook-Pro eni % kubectl get pvc
NAME                     STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS               AGE
custom-default-profile   Bound    pvc-56c580b2-60f7-454b-a909-22921891eed9   10Gi       RWX            ibmc-vpc-file-custom       39m
custom-file              Bound    pvc-08e1b36f-9854-47bc-8a8d-dbffcc758c93   10Gi       RWX            ibmc-vpc-file-custom       8h
pv-file-1                Bound    pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd   30Gi       RWX            ibmc-vpc-file-5iops-tier   14h
pv-file-beta             Bound    pvc-92b73821-8f31-48ee-aba4-2c3925713ce9   10Gi       RWX            ibmc-vpc-file-5iops-tier   9h
volume-secret            Bound    pvc-467faf79-0e28-4d1b-a3b7-1e99b746df47   10Gi       RWX            ibmc-vpc-file-dp-custom    69s
sameershaikh@Sameers-MacBook-Pro eni %
sameershaikh@Sameers-MacBook-Pro eni % kubectl edit pvc volume-secret
persistentvolumeclaim/volume-secret edited
sameershaikh@Sameers-MacBook-Pro eni % kubectl get pvc
NAME                     STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS               AGE
custom-default-profile   Bound    pvc-56c580b2-60f7-454b-a909-22921891eed9   10Gi       RWX            ibmc-vpc-file-custom       40m
custom-file              Bound    pvc-08e1b36f-9854-47bc-8a8d-dbffcc758c93   10Gi       RWX            ibmc-vpc-file-custom       8h
pv-file-1                Bound    pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd   30Gi       RWX            ibmc-vpc-file-5iops-tier   14h
pv-file-beta             Bound    pvc-92b73821-8f31-48ee-aba4-2c3925713ce9   10Gi       RWX            ibmc-vpc-file-5iops-tier   9h
volume-secret            Bound    pvc-467faf79-0e28-4d1b-a3b7-1e99b746df47   10Gi       RWX            ibmc-vpc-file-dp-custom    2m9s
sameershaikh@Sameers-MacBook-Pro eni % kubectl get pvc
NAME                     STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS               AGE
custom-default-profile   Bound    pvc-56c580b2-60f7-454b-a909-22921891eed9   10Gi       RWX            ibmc-vpc-file-custom       40m
custom-file              Bound    pvc-08e1b36f-9854-47bc-8a8d-dbffcc758c93   10Gi       RWX            ibmc-vpc-file-custom       8h
pv-file-1                Bound    pvc-60c0ecab-e6b9-42da-a803-9290d9b3dbdd   30Gi       RWX            ibmc-vpc-file-5iops-tier   14h
pv-file-beta             Bound    pvc-92b73821-8f31-48ee-aba4-2c3925713ce9   10Gi       RWX            ibmc-vpc-file-5iops-tier   9h
volume-secret            Bound    pvc-467faf79-0e28-4d1b-a3b7-1e99b746df47   20Gi       RWX            ibmc-vpc-file-dp-custom    2m13s
sameershaikh@Sameers-MacBook-Pro eni % kubectl describe pvc volume-secret
Name:          volume-secret
Namespace:     default
StorageClass:  ibmc-vpc-file-dp-custom
Status:        Bound
Volume:        pvc-467faf79-0e28-4d1b-a3b7-1e99b746df47
Labels:        <none>
Annotations:   pv.kubernetes.io/bind-completed: yes
               pv.kubernetes.io/bound-by-controller: yes
               volume.beta.kubernetes.io/storage-provisioner: vpc.file.csi.ibm.io
               volume.kubernetes.io/storage-provisioner: vpc.file.csi.ibm.io
Finalizers:    [kubernetes.io/pvc-protection]
Capacity:      20Gi
Access Modes:  RWX
VolumeMode:    Filesystem
Used By:       testpodrwm-sec-5d56fbbc5b-7b45z
               testpodrwm-sec-5d56fbbc5b-8vvtz
               testpodrwm-sec-5d56fbbc5b-psnvl
Events:
  Type     Reason                      Age                    From                                                                                Message
  ----     ------                      ----                   ----                                                                                -------
  Normal   Provisioning                2m26s                  vpc.file.csi.ibm.io_ibm-vpc-file-csi-controller-74594f7db-5dffj_39ff02e9-1ab1-45d5-9458-d84465c3dd79  External provisioner is provisioning volume for claim "default/volume-secret"
  Normal   ExternalProvisioning        2m23s (x2 over 2m26s)  persistentvolume-controller                                                                           waiting for a volume to be created, either by external provisioner "vpc.file.csi.ibm.io" or manually created by system administrator
  Normal   ProvisioningSucceeded       2m10s                  vpc.file.csi.ibm.io_ibm-vpc-file-csi-controller-74594f7db-5dffj_39ff02e9-1ab1-45d5-9458-d84465c3dd79  Successfully provisioned volume pvc-467faf79-0e28-4d1b-a3b7-1e99b746df47
  Warning  ExternalExpanding           50s                    volume_expand                                                                                Ignoring the PVC: didn't find a plugin capable of expanding the volume; waiting for an external controller to process this PVC.
  Normal   Resizing                    49s                    external-resizer vpc.file.csi.ibm.io                                                                  External resizer is resizing volume pvc-467faf79-0e28-4d1b-a3b7-1e99b746df47
  Normal   Resizing                    36s (x2 over 50s)      external-resizer vpc.file.csi.ibm.io                                                                  External resizer is resizing volume pvc-467faf79-0e28-4d1b-a3b7-1e99b746df47
  Warning  VolumeResizeFailed          36s                    external-resizer vpc.file.csi.ibm.io                                                                  Mark PVC "default/volume-secret" as file system resize required failed: can't patch status of  PVC default/volume-secret with Operation cannot be fulfilled on persistentvolumeclaims "volume-secret": the object has been modified; please apply your changes to the latest version and try again
  Warning  VolumeResizeFailed          33s                    external-resizer vpc.file.csi.ibm.io                                                                  Mark PVC "default/volume-secret" as file system resize required failed: can't patch status of  PVC default/volume-secret with Operation cannot be fulfilled on persistentvolumeclaims "volume-secret": the object has been modified; please apply your changes to the latest version and try again
  Normal   FileSystemResizeRequired    33s                    external-resizer vpc.file.csi.ibm.io                                                                  Require file system resize of volume on node
  Normal   FileSystemResizeSuccessful  14s                    kubelet                                                                                MountVolume.NodeExpandVolume succeeded for volume "pvc-467faf79-0e28-4d1b-a3b7-1e99b746df47" <IP_ADDRESS>
sameershaikh@Sameers-MacBook-Pro eni %
``