ScanStruct ignore or exclude some fields

Is your feature request related to a problem? Please describe.
When listing rows in a table, it's often necessary to count the total without the limit. However we don't want this column to end up in the main struct.
SELECT
  *,
  (SELECT COUNT(*) from mytable) as total_count
FROM mytable
LIMIT 0, 10

I suppose there are other use cases

Describe the solution you'd like
The ideal would be to specify a list of props to ignore and eventually getting the columns back in an other var.
query.ScanStructs(&rows, ["total_count"])

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Dialect

[ ] postgres
[ ] mysql
[ ] sqlite3

Additional context
Add any other context or screenshots about the feature request here.

Hi @bodinsamuel , maybe the PR https://github.com/doug-martin/goqu/pull/308, can solve your problem.
And as @doug-martin does not respond in the repo for a long time. Maybe you can use my fork, https://github.com/XIELongDragon/goqu/tree/experimental


[Security Tooling] Test

Security Tooling Support Request
Tool

[ ] KICS
[ ] Invicti / OWASP ZAP
[ ] GitGuardian
[x] Trivy
[ ] Veracode (initial setup, GitHub integration)

Issue Description

done


Unexpected behavior caused by examples/signal package

Hi,
First, thanks for the package!
I have an issue with this line: https://github.com/pions/webrtc/blob/master/examples/internal/signal/signal.go#L40
The line causes unexpected behavior in your demos if someone like me tries to establish a Unix pipe straight to FFMPEG, like one could with the save-to-disk example. The problem is that fmt.Println() writes to os.Stdout. That is, when using a Unix pipe or write operator (e.g., | or >) the line causes the output to be prepended with an empty line (imagine cat key.txt | ./save-to-disk > out.ivf, here out.ivf is 1 byte file with an empty line because of the signal package). This behavior then breaks encoders, like FFMPEG, if coupled like cat key.txt | ./save-to-disk | ffmpeg -i out.webm -y.
If you are okay with removing the line, please let me know and I can open a PR for it.
Thanks again for the project!

Hey @toldjuuso!
We need to document this better, but save-to-disk doesn't output the ivf via stdout. We updated it so it puts out a ivf and opus file now! and it directly saves it for you :)
I would love a PR fixing the documentation though! Hopefully all that makes sense.
We could probably update it to do stdio also to make it easier on people (and make it a command line argument)

Ah yes, I meant it becomes a problem if someone modifies the demo to do it via stdout, like I did. Only in this case is the internal package a problem, and I thought the extra Println is a bug.
Anyhow, the diff to make it pipe-compliant is not that hard, I can push the code sometime soon, and you could take a look at what you want to incorporate.

@toldjuuso
Yea that changes works for me! Mind just moving the fmt.Println up a layer, so we won't see a behavior difference but still make it easy for people to make changes like this :)
thanks @toldjuuso

The initial streaming code is now here: https://github.com/toldjuuso/handover2019okwuibe/blob/master/main.go
I will eventually tidy it up a bit so the HTTP server is removed and you can get an example of it. I'll open PR once that's done.

Hey @toldjuuso
Anything I can do to help with this? We have finished up our v2.0.0 rush so happy to help!

Hi, thanks for letting me know, I will soon update to v2.0.0 and see if everything works on my end. If it does, I will make a PR with the stuff I have.

Further, I think this issue can be closed, we can continue on the PR later on.


Fix hex memo handling

Can you please descript what this PR fixes? is there an issue ?

@johnnyluo
I need this PR to test VultiConnect for signing a swap transaction. For the swap transaction, I will send a simple keysign payload with ABI binary data (without swap payload). Since it's in hex, we don't need to convert it to UTF-8 and then to bytes; we can directly convert hex to bytes.
If the memo is not in hex, then we can convert it to UTF-8 and obtain the bytes.

@johnnyluo
Example of swap using rango I did it yesterday with vulticonnect and 2 android phone based on this branch
https://arbiscan.io/tx/0x9df2b0fdac80d29b64df00e5d20bc7de159b036ad168050762be98396d7217fc

@johnnyluo
Here’s an example of a swap using Rango that I completed yesterday with VultiConnect and two Android phones, based on this branch.
https://arbiscan.io/tx/0x9df2b0fdac80d29b64df00e5d20bc7de159b036ad168050762be98396d7217fc

Thanks


New release?

I am looking to make use of the data bag fallback attribute, are there plans to make a new release soon?

Hi @jonathanmorley,
Can you wait until this Sunday? I want to review the pending PRs before releasing it.

sure

Version 1.12.0 released.


emcee 3.1.4 [fix py38] :snowflake:

emcee 3.1.4 :snowflake:
Destination channel: Snowflake
Links

PKG-5381
dev_url (pypi): https://github.com/dfm/emcee/tree/v3.1.4
conda-forge: https://github.com/conda-forge/emcee-feedstock/blob/main/recipe/meta.yaml
pypi: https://pypi.org/project/emcee/3.1.4
pypi inspector: https://inspector.pypi.io/project/emcee/3.1.4

Explanation of changes:

add py38, add upstream tests, bump build number

Linter check found the following problems:
ERROR conda.cli.main_run:execute(125): `conda run conda-lint /tmp/abs_6f3g2o23qp/clone` failed. (See above for error)
The following problems have been found:
===== ERRORS =====

clone/recipe/meta.yaml:49: invalid_url: https://emcee.readthedocs.io : Not reachable: 403
clone/recipe/meta.yaml:39: invalid_url: https://emcee.readthedocs.io : Not reachable: 403
===== Final Report: =====
2 Errors and 0 Warnings were found


Some weird behaviour

Hey,
I tried to read a simple UTF8 txt file from a zip archive.
use async_zip::read::fs::ZipFileReader;
use tokio::io::AsyncReadExt;

#[tokio::main]
async fn main() {
    let zip = ZipFileReader::new("resources.zip".to_string()).await.unwrap();
    let (index, entry) = zip.entry("content.txt").unwrap();
    let mut entry_reader = zip.entry_reader(index).await.unwrap();

    let file_length = entry.uncompressed_size().unwrap();

    let mut buffer = String::with_capacity(file_length as usize);
    let bytes_read = entry_reader.read_to_string(&mut buffer).await.unwrap();
    println!("{}:{}", bytes_read, buffer);
}

I get an error that the file is not utf8-encoded:
thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: Custom { kind: InvalidData, error: "stream did not contain valid UTF-8" }', src\main.rs:13:69

So I just did a hack to see what bytes actually are inside the file:
use async_zip::read::fs::ZipFileReader;
use tokio::io::AsyncReadExt;

#[tokio::main]
async fn main() {
    let zip = ZipFileReader::new("resources.zip".to_string()).await.unwrap();
    let (index, entry) = zip.entry("content.txt").unwrap();
    let mut entry_reader = zip.entry_reader(index).await.unwrap();

    let file_length = entry.uncompressed_size().unwrap();

    let mut buffer = Vec::with_capacity(file_length as usize);
    let bytes_read = entry_reader.read_to_end(&mut buffer).await.unwrap();
    println!("{}:{}", bytes_read, unsafe{ std::str::from_utf8_unchecked(&buffer) });
}

The console output is the following:
30:
vETF]�:       $

Is there something I'm doing wrong? It seems really weird.
In case you are interested, I can send you the zip file.

You aren't doing anything wrong in your example. If I take an archive written via ZipFileWriter::write_entry_whole(), it works perfectly fine.
If you could provide the ZIP file being used, that would be very helpful.
It could just be that it's using some feature of the specification which we don't currently support, and there's not a sanity check for it.

Yes, I just tried a zip file with an uncompressed txt file to ensure that its not the compression breaking things
Here is a google drive link :)
https://drive.google.com/file/d/1XDp8qIiQn9kNKECEKeoKRHuEGnuoGcKO/view?usp=sharing

It seems the local file header contains differing extra field data than in the central directory. My assumption was that they'd always be in sync, but that seems to be incorrect based on this spec note:

Extra Field records that MAY contain information about a file that SHOULD
not be exposed SHOULD NOT be stored in the Local Header and SHOULD only
be written to the Central Directory where they can be encrypted.  This
design currently does not support streaming.

We currently just seek directly to the data offset using the file name length & extra field length present within the central directory header. So when the two are out of sync, we seek to the wrong place and start reading garbled data.
There doesn't seem to be any way around this other than to always read the local file header as well, which is quite annoying given most of the data is redundant when you have the central directory header.
In the meantime, you could use the read::stream::ZipFileReader implementation as that uses the local file header only.

okay, thank you! Just for your information, it was a simple zip file I created with 7zip


Feature/missing configurations for b2k

Please review my PR.

This PR is included in version 0.18.0 :tada:


align "Architecture Analysis" and "Architectural Understanding"

both are currently described - one should be removed, imho.

5.3 Architectural Understanding
Develop and document an understanding of internal structures, concepts, architectural approaches and important decisions of the [SuD].
and "Architecture Analysis" is currently a category, as proposed by @lilienth
in the analyse-phase
I'm currently unsure, I have to admit...

I would never propose that Architecture Analysis is on the same level than QualA and QuanA. There must be a missunderstanding. If the term "category" refers to Qualitative Analysis and Quantitative Analysis and a category is a category for practices, than Architecture Analysis is not a category. As I wrote in #133.
If ATAM is a practice than Architecture Analysis should be a practice too. ATAM comprises IMHO various  other practices as "Hierachical-Quality-Model", "Issue-Tracker-Analysis", "Pre-Interview-Questionaire" and so on. Architecture Analysis comprises different practices as well. IMHO there is a hierarchy in the practices presented in 5.3.

thx Carola, we should discuss that face2face (JAX?).
Currently, I'll leave ArcAnalysis as "category". One big difference between ATAM and ArcAnalysis is
that ATAM is known in the industry as a "method" and has been extensively published...
ArcAnalysis imho covers more ground than ATAM - maybe your forthcoming book could advance the
term to a "method" :-) ?


Really type crossDatasetReference

https://www.sanity.io/docs/cross-dataset-reference-type
https://www.sanity.io/docs/cross-dataset-references
Functionally, it's pretty much exactly the same as reference.

[ ] /types should treat it the same, including using _referenced
[ ] /zod should treat it the same
[ ] /faker has the hardest job. How can we have it reference docs in another dataset? That dataset should have the same types (right?) but how can I sync across datasets? I'm not even confident we know the current dataset while this is happening.

For now, I don't think I'm going to do this. This gets super weird really fast. They all need some kind of knowledge about the other dataset's schema to type anything properly or to generate the right runtime stuff. There'd have to be another layer: raw values, expanded alias values, expanded across dataset values.
 I know the current work on this is somewhat lacking even for a normal schema type, but I'm rarely even aware this type exists. 🤷


Can't provision serviceinstance of api service.

Bug Report
What happened:
Did create application which had one api service defined which is sending traffic outside kyma. Application was created in kyma-slack namespace. In namespace gh-connector i had function which want to use api service exposed by application from kyma-slack namespace. Did create application mapping in gh-connector namespace to bind application to it. When trying to create service instance with following yaml file.
apiVersion: servicecatalog.k8s.io/v1beta1
kind: ServiceInstance
metadata:
  name: kyma-slack
  namespace: gh-connector
spec:
  serviceClassExternalName: kyma-prow-dev-null-a12ce

I've got error message.
Error from server (could not find a single ServiceClass with "servicecatalog.k8s.io/spec.externalName" = "kyma-prow-dev-null-a12ce", found 2): error when creating "kymaSlackServiceInstanceForGhConnector.yaml": admission webhook "mutating.serviceinstances.servicecatalog.k8s.io" denied the request: could not find a single ServiceClass with "servicecatalog.k8s.io/spec.externalName" = "kyma-prow-dev-null-a12ce", found 2

What you expected to happen:
Successful creation of service instance which would allow me to bind it to function in gh-connector namespace.
How to reproduce it (as minimally and precisely as possible):
Create application with api service and bind it to another namespace. Try to provision service instance with example serviceinstance yaml file provided earlier.
Anything else we need to know?:
No
Environment:

Kubernetes version (use kubectl version):
1.16.6
service-catalog version:
image: eu.gcr.io/kyma-project/external/quay.io/kubernetes-service-catalog/service-catalog:v0.3.0-6-g8e85904-dirty
Cloud provider or hardware configuration:
gke
Do you have api aggregation enabled?
no
Do you see the configmap in kube-system?
Does it have all the necessary fields?
kubectl get cm -n kube-system extension-apiserver-authentication -o yaml and look for requestheader-XXX fields
Install tools:
Did install kyma with kymacli using release version 1.16.
Did you use helm? What were the helm arguments? Did you --set any extra values?
Didn't use helm.
Are you trying to use ALPHA features? Did you enable them?
Did not enable alpha features.

Hi @dekiel
The problem is that you created such manifests:
apiVersion: servicecatalog.k8s.io/v1beta1
kind: ServiceInstance
metadata:
  name: kyma-slack
  namespace: gh-connector
spec:
  serviceClassExternalName: kyma-prow-dev-null-a12ce

as you can see you specified only serviceClassExternalName and no servicePlanExternalName. If you define only class name then the Service Catalog sets the default service plan if only one plan exists. In your case error says that  it found 2 and cannot decide which one to use, so you need to do it manually
could not find a single ServiceClass with "servicecatalog.k8s.io/spec.externalName" = "kyma-prow-dev-null-a12ce", found 2

What you need to do is to create a Service Instance with servicePlanExternalName parameters:
apiVersion: servicecatalog.k8s.io/v1beta1
kind: ServiceInstance
metadata:
  name: kyma-slack
  namespace: gh-connector
spec:
  serviceClassExternalName: kyma-prow-dev-null-a12ce
  servicePlanExternalName: {specific_name}

to get the plan name you can execute the kubectl get serviceplans -n {your_namespace} command, e.g.:
$ kubectl get clusterserviceplans
NAME                       EXTERNAL-NAME      BROKER       CLASS        AGE
mariadb-10-3-22            10-3-22            minibroker   mariadb      34m
mariadb-10-1-28            10-1-28            minibroker   mariadb      34m
mariadb-10-1-29            10-1-29            minibroker   mariadb      34m
mariadb-10-1-30            10-1-30            minibroker   mariadb      34m
mariadb-10-1-31            10-1-31            minibroker   mariadb      34m
mariadb-10-1-32            10-1-32            minibroker   mariadb      34m
mariadb-10-1-33            10-1-33            minibroker   mariadb      34m
mariadb-10-1-34            10-1-34            minibroker   mariadb      34m
mariadb-10-1-34-debian-9   10-1-34-debian-9   minibroker   mariadb      34m

as you can see, there is the EXTERNAL-NAME column and information about the CLASS that this plan correlates to.
See the bellow comment for more possible configurations:
https://github.com/kubernetes-sigs/service-catalog/blob/f83ebf922fd676cf75b5541d9980737da9f91203/pkg/apis/servicecatalog/v1beta1/types.go#L782-L791

In case when plan is not set, SC (to be more specific mutation webhook for SI) tries to find "default" plan.
IMO there is a bug in the mutation webhook, in list functionality. ServiceClasses should be searched within a namespace scope:
err := d.client.List(ctx, serviceClassesList, client.MatchingLabels(map[string]string{
  filterLabel: util.GenerateSHA(filterValue),
}), client.InNamespace(instance.Namespace))

(I will test this solution and make PR)

@dekiel Can we close this issue?

@dekiel Can we close this issue?

Thanks guys for explanation and help. Before fix, adding servicePlanExternalName did the trick.

Thanks guys for explanation and help. Before fix, adding servicePlanExternalName did the trick.


correct spelling of Louisiana

simple update to fix spelling error, which causes the hover text to be incorrect.

Fixed on another PR


Cmake improvements

Some improvements in CMake for possible system-wide installed package.
Related to Fedora package review: https://bugzilla.redhat.com/show_bug.cgi?id=2162851

It seems that CLA bot does not work. Github does not auto-complete that user id and even manually it does not help. @microsoft-github-copilot is the only thing offered from microsoft-github prefix. I am doing the response wrong way?


Ability to Convert Case, issue 8079

Ability to convert selection between upper and lower Case, or Capitalise.
closes #8079

Updated enum name and placed in method argument.

Travis has a small issue with your code style ;) https://travis-ci.org/godotengine/godot/jobs/225345800
You may want to setup the pre-commit hooks from misc/hooks/ if they're compatible with your dev system, and/or configure your IDE to run clang-format automatically to avoid such issues. More docs on this soon™.

Fixed clang formatting.


exportarr prefers port from config.xml instead of CLI flag

Hi there,
I've tried to get exportarr running on kubernetes, but it seems that exportarr preferes the port of the config.xml instead of the port configured via CLI flag --url. I belive the same error also exists for radarr, readarr, sonarr and prowlarr.
I declared in my current set up a kubernetes service to forward incoming traffic to each instance of a lidarr pod. The port where the application (pod) is listening on is the default - like for lidarr 8686.
To access lidarr via app or browser I need to change the service type from ClusterIP to LoadBalancer. This is no problem for me, because the kubernetes cluster is running locally and can not access via internet. For user-friendliness I've changed the port of the service from 8686 to 80. Lidarr can therefore be opened directly in the browser without specifying a port, because port 80 is the default. The incoming data traffic is therefore forwarded from port 80 of the kubernetes service to port 8787 of the lidarr instance.
Now to exportarr. I have provided the config.xml of lidarr via volumeMount to exportarr and specified the absolute file path via the --config flag. Since exportarr now reads the config and finds the port 8787 there, exportarr tries to reach the lidarr API via this port. However, this is not possible because the port is not released by the service.
2024-03-03T15:12:18.758Z        INFO    Starting exportarr      {"app_name": "exportarr", "version": "v1.5.3", "buildTime": "2023-06-14T18:41:40.589Z", "revision": "952a768edf22789f6b07005cdce18898c1ef3a2a"}
2024-03-03T15:12:18.760Z        INFO    Starting HTTP Server    {"interface": "<IP_ADDRESS>", "port": 9707}
2024-03-03T15:13:00.728Z        INFO    Sending HTTP request    {"url": "http://lidarr:8686/api/v1/system/status"}
2024-03-03T15:13:00.730Z        INFO    Sending HTTP request    {"url": "http://lidarr:8686/api/v1/health"}
2024-03-03T15:13:00.731Z        INFO    Sending HTTP request    {"url": "http://lidarr:8686/api/v1/artist"}
2024-03-03T15:13:00.731Z        INFO    Sending HTTP request    {"url": "http://lidarr:8686/api/v1/queue?page=1"}
2024-03-03T15:13:00.731Z        INFO    Sending HTTP request    {"url": "http://lidarr:8686/api/v1/history"}
2024-03-03T15:13:00.731Z        INFO    Sending HTTP request    {"url": "http://lidarr:8686/api/v1/rootfolder"}
2024-03-03T15:13:02.778Z        ERROR   Error getting rootfolder        {"collector": "rootfolder", "error": "Failed to execute HTTP Request(http://lidarr:8686/api/v1/rootfolder): Get \"http://lidarr:8686/api/v1/rootfolder\": Error sending HTTP Request: dial tcp <IP_ADDRESS>:8686: connect: connection refused"}

My exportarr deployment. The URL of the flag --url points to the service lidarr, port 80.
apiVersion: apps/v1
kind: Deployment
metadata:
  annotations:
    deployment.kubernetes.io/revision: "1"
    meta.helm.sh/release-name: lidarr
    meta.helm.sh/release-namespace: media
  labels:
    app.kubernetes.io/instance: lidarr
    app.kubernetes.io/managed-by: Helm
    app.kubernetes.io/name: lidarr-exportarr
    app.kubernetes.io/version: 1.4.5
    helm.sh/chart: lidarr-0.1.0-exportarr
  name: lidarr-exportarr
  namespace: media
spec:
  progressDeadlineSeconds: 600
  replicas: 1
  revisionHistoryLimit: 10
  selector:
    matchLabels:
      app.kubernetes.io/instance: lidarr
      app.kubernetes.io/name: lidarr-exportarr
  strategy:
    rollingUpdate:
      maxSurge: 25%
      maxUnavailable: 25%
    type: RollingUpdate
  template:
    metadata:
      creationTimestamp: null
      labels:
        app.kubernetes.io/instance: lidarr
        app.kubernetes.io/name: lidarr-exportarr
    spec:
      containers:
      - args:
        - lidarr
        - --config=/config/config.xml
        - --port=9707
        - --url=http://lidarr:80
        image: ghcr.io/onedr0p/exportarr:v1.5.3
        imagePullPolicy: IfNotPresent
        livenessProbe:
          failureThreshold: 5
          httpGet:
            path: /healthz
            port: monitoring
            scheme: HTTP
          periodSeconds: 10
          successThreshold: 1
          timeoutSeconds: 1
        name: exportarr
        ports:
        - containerPort: 9707
          name: monitoring
          protocol: TCP
        readinessProbe:
          failureThreshold: 5
          httpGet:
            path: /healthz
            port: monitoring
            scheme: HTTP
          periodSeconds: 10
          successThreshold: 1
          timeoutSeconds: 1
        resources:
          limits:
            cpu: 500m
            memory: 256Mi
          requests:
            cpu: 100m
            memory: 64Mi
        terminationMessagePath: /dev/termination-log
        terminationMessagePolicy: File
        volumeMounts:
        - mountPath: /config
          name: config
      dnsPolicy: ClusterFirst
      restartPolicy: Always
      schedulerName: default-scheduler
      securityContext: {}
      terminationGracePeriodSeconds: 30
      volumes:
      - name: config
        persistentVolumeClaim:
          claimName: lidarr-config

UPDATE
The bug also exists in the latest version - v1.6.2.
Workaround

Remove the volume mount of the config.xml file.
Start lidarr
Extract the API key via GUI
Define the API key via --api-key flag.
Exportarr use the specified port as part of the --url flag as expected

Volker

You should definitely be using the cluster dns address to have exportarr find lidarr, not using the load balancer address. So the url arg should be:
--url=http://lidarr.namespace.svc.cluster.local:8686

Then it can use the apikey defined in the config.xml

re: ordering, that's correct. The order config is applied is:
Defaults -> Env -> Flags -> XMLConfig
We can change that pretty easily (it probably makes sense for it to be Defaults -> XML -> Env ->Flags), but the behavior's been that way for a bunch of years at this point, so it would be another breaking change, though I think it's unlikely folks were counting on that ordering. @onedr0p, not sure how you feel about changing the order

I think it's fine the way we have it? The issue seems more about not using the correct address for exportarr to connect to lidarr.

Hi @rtrox and @onedr0p,
Defaults -> Env -> Flags -> XMLConfig would also have been my expected order.

As OP stated they are using a load balancer svc instead of an ingress to access Lidarr from outside the cluster...

That is correct. An ingress is also not necessary. TLS/SSL does not need to be terminated as the k8s cluster is located locally. This makes the ingress superfluous at this point.

and not using cluster dns to access it within the cluster I suspect that is the case.

I find the terminology of Cluster DNS somewhat confusing. I explicitly specify the DNS name of the LoadBalancer in the url. This could also have been called lidarr.media or lidarr.media.svc as the service dns spec describes. The host name does not have to match the host name of the config.xml. The configured domain name of the cluster like cluster.local should be skipped, because this domain name can be different from k8s environment to k8s environment. Alternatively, I could make the domain name of the cluster configurable in the Helm chart. However, the domain name of the cluster is not known to every administrator who is able to deploy an application. For this reason I like to avoid this if not absolutely necessary.
I deployed exportarr again with the extend version of the DNS name of the service like lidarr.media.svc for testing purpose. It seems, that this issue still exists:
2024-03-04T07:53:19.750Z        INFO    Starting exportarr      {"app_name": "exportarr", "version": "v1.6.2", "buildTime": "2024-02-28T20:53:28.098Z", "revision": "0cb318682ee0733e460aae27b6acdb0aa1045162"}
2024-03-04T07:53:19.752Z        INFO    Starting HTTP Server    {"interface": "<IP_ADDRESS>", "port": 9707}
2024-03-04T07:53:57.705Z        INFO    Sending HTTP request    {"url": "http://lidarr.media.svc:8686/api/v1/history"}
2024-03-04T07:53:57.706Z        INFO    Sending HTTP request    {"url": "http://lidarr.media.svc:8686/api/v1/rootfolder"}
2024-03-04T07:53:57.706Z        INFO    Sending HTTP request    {"url": "http://lidarr.media.svc:8686/api/v1/queue?page=1"}
2024-03-04T07:53:57.707Z        INFO    Sending HTTP request    {"url": "http://lidarr.media.svc:8686/api/v1/system/status"}
2024-03-04T07:53:57.706Z        INFO    Sending HTTP request    {"url": "http://lidarr.media.svc:8686/api/v1/health"}
2024-03-04T07:53:57.707Z        INFO    Sending HTTP request    {"url": "http://lidarr.media.svc:8686/api/v1/artist"}
2024-03-04T07:53:59.761Z        ERROR   Error getting history   {"collector": "history", "error": "Failed to execute HTTP Request(http://lidarr.media.svc:8686/api/v1/history): Get \"http://lidarr.media.svc:8686/api/v1/history\": Error sending HTTP Request: dial tcp <IP_ADDRESS>:8686: connect: connection refused"}
2024-03-04T07:54:01.812Z        ERROR   Error getting rootfolder        {"collector": "rootfolder", "error": "Failed to execute HTTP Request(http://lidarr.media.svc:8686/api/v1/rootfolder): Get \"http://lidarr.media.svc:8686/api/v1/rootfolder\": Error sending HTTP Request: dial tcp <IP_ADDRESS>:8686: connect: connection refused"}
2024-03-04T07:54:08.051Z        ERROR   Error getting health: Failed to execute HTTP Request(http://lidarr.media.svc:8686/api/v1/health): Get "http://lidarr.media.svc:8686/api/v1/health": Error sending HTTP Request: dial tcp <IP_ADDRESS>:8686: connect: connection refused    {"collector": "systemHealth"}
2024-03-04T07:54:08.051Z        ERROR   Error getting queue     {"collector": "queue", "error": "Failed to execute HTTP Request(http://lidarr.media.svc:8686/api/v1/queue?page=1): Get \"http://lidarr.media.svc:8686/api/v1/queue?page=1\": Error sending HTTP Request: dial tcp <IP_ADDRESS>:8686: connect: connection refused"}
2024-03-04T07:54:12.970Z        ERROR   Error creating client   {"collector": "lidarr", "error": "Failed to execute HTTP Request(http://lidarr.media.svc:8686/api/v1/artist): Get \"http://lidarr.media.svc:8686/api/v1/artist\": Error sending HTTP Request: dial tcp <IP_ADDRESS>:8686: connect: connection refused"}

Furthermore, I've tried deploying exportarr with the fully qualified domain name of the service lidarr.media.svc.cluster.local, but also this does not work.
2024-03-04T07:58:44.148Z        INFO    Starting exportarr      {"app_name": "exportarr", "version": "v1.6.2", "buildTime": "2024-02-28T20:53:28.098Z", "revision": "0cb318682ee0733e460aae27b6acdb0aa1045162"}
2024-03-04T07:58:44.162Z        INFO    Starting HTTP Server    {"interface": "<IP_ADDRESS>", "port": 9707}
markus@markus-pc:~/workspace/charts/charts.cryptic.systems/lidarr/lidarr (master *=)$ kubectl logs lidarr-exportarr-5b6fbc996f-87g7t -f
2024-03-04T07:58:44.148Z        INFO    Starting exportarr      {"app_name": "exportarr", "version": "v1.6.2", "buildTime": "2024-02-28T20:53:28.098Z", "revision": "0cb318682ee0733e460aae27b6acdb0aa1045162"}
2024-03-04T07:58:44.162Z        INFO    Starting HTTP Server    {"interface": "<IP_ADDRESS>", "port": 9707}
2024-03-04T08:03:01.562Z        INFO    Sending HTTP request    {"url": "http://lidarr.media.svc.cluster.local:8686/api/v1/history"}
2024-03-04T08:03:01.562Z        INFO    Sending HTTP request    {"url": "http://lidarr.media.svc.cluster.local:8686/api/v1/queue?page=1"}
2024-03-04T08:03:01.562Z        INFO    Sending HTTP request    {"url": "http://lidarr.media.svc.cluster.local:8686/api/v1/rootfolder"}
2024-03-04T08:03:01.562Z        INFO    Sending HTTP request    {"url": "http://lidarr.media.svc.cluster.local:8686/api/v1/system/status"}
2024-03-04T08:03:01.563Z        INFO    Sending HTTP request    {"url": "http://lidarr.media.svc.cluster.local:8686/api/v1/health"}
2024-03-04T08:03:01.563Z        INFO    Sending HTTP request    {"url": "http://lidarr.media.svc.cluster.local:8686/api/v1/artist"}
2024-03-04T08:03:03.598Z        ERROR   Error creating client   {"collector": "lidarr", "error": "Failed to execute HTTP Request(http://lidarr.media.svc.cluster.local:8686/api/v1/artist): Get \"http://lidarr.media.svc.cluster.local:8686/api/v1/artist\": Error sending HTTP Request: dial tcp <IP_ADDRESS>:8686: connect: connection refused"}
2024-03-04T08:03:09.919Z        ERROR   Error getting history   {"collector": "history", "error": "Failed to execute HTTP Request(http://lidarr.media.svc.cluster.local:8686/api/v1/history): Get \"http://lidarr.media.svc.cluster.local:8686/api/v1/history\": Error sending HTTP Request: dial tcp <IP_ADDRESS>:8686: connect: connection refused"}
2024-03-04T08:03:12.051Z        ERROR   Error getting rootfolder        {"collector": "rootfolder", "error": "Failed to execute HTTP Request(http://lidarr.media.svc.cluster.local:8686/api/v1/rootfolder): Get \"http://lidarr.media.svc.cluster.local:8686/api/v1/rootfolder\": Error sending HTTP Request: dial tcp <IP_ADDRESS>:8686: connect: connection refused"}
2024-03-04T08:03:12.052Z        ERROR   Error getting queue     {"collector": "queue", "error": "Failed to execute HTTP Request(http://lidarr.media.svc.cluster.local:8686/api/v1/queue?page=1): Get \"http://lidarr.media.svc.cluster.local:8686/api/v1/queue?page=1\": Error sending HTTP Request: dial tcp <IP_ADDRESS>:8686: connect: connection refused"}
2024-03-04T08:03:16.964Z        ERROR   Error getting health: Failed to execute HTTP Request(http://lidarr.media.svc.cluster.local:8686/api/v1/health): Get "http://lidarr.media.svc.cluster.local:8686/api/v1/health": Error sending HTTP Request: dial tcp <IP_ADDRESS>:8686: connect: connection refused        {"collector": "systemHealth"}

Some debugging steps you might find useful...
❯ kubectl run tmp-shell --rm -i --tty --image nicolaka/netshoot
If you don't see a command prompt, try pressing enter.
                    dP            dP                           dP
                    88            88                           88
88d888b. .d8888b. d8888P .d8888b. 88d888b. .d8888b. .d8888b. d8888P
88'  `88 88ooood8   88   Y8ooooo. 88'  `88 88'  `88 88'  `88   88
88    88 88.  ...   88         88 88    88 88.  .88 88.  .88   88
dP    dP `88888P'   dP   `88888P' dP    dP `88888P' `88888P'   dP

Welcome to Netshoot! (github.com/nicolaka/netshoot)
Version: 0.12

 tmp-shell  ~  dig +short sonarr.default.svc.cluster.local
<IP_ADDRESS>

 tmp-shell  ~  curl sonarr.default.svc.cluster.local:8989
<!doctype html><html lang="en"><head><meta charset="utf-8"/>
....

 tmp-shell  ~  telnet sonarr.default.svc.cluster.local 8989
Connected to sonarr.default.svc.cluster.local

Hi @onedr0p,
here is the configuration issue:
telnet sonarr.default.svc.cluster.local 8989

I don't want to publish the service ports 8989 of sonarr or port 8787 of lidarr, because than I also need to specify this port in the URL in my browser. As I already mentioned, I use the port 80 instead. This is the default port for HTTP and is not required to define in the URL.

You made it seem like the load Balancer address is doing the :8686 to :80 port mapping but this was not clear.

Exactly, I realize the port mapping via the service and exportarr does not seems to support this, because exportarr priorize the configured port of the config.xml instead of the passed CLI flag --url.

One option you might not have considered is to use the containers I build for Lidarr / Radarr / Sonarr which allow you to define the API Key, PORT etc.. in the container env vars. You can pre-set the API key this way and have exportarr and Lidarr pull from the same Kubernetes secret without having to provide the config.xml

However, I really like the configuration with config.xml. The reason for this is relatively simple. When the API key is generated in the GUI, it is also saved in the config.xml. This means that exportarr can react to this via fs.Notify and read in the API key again. The option to define the API key via environment variable does not offer this possibility.

@volker-raschek - from what it sounds like, you have this set up in a pretty non-standard way. What you're describing here (using one port mapping for access, and another for internal access) is exactly what ingresses are meant for. You can see an example using exportarr, nginx-ingress, and external-dns here.
Given the non-standard setup, I think @onedr0p and I are agreed that we shouldn't make a breaking change to the config parsing which would impact other users. If you need help setting up ingresses, or troubleshooting the network issues @onedr0p mentioned, I think the folks in the k8s-at-home discord would be more than happy to help troubleshoot with you in the support channel, but I'm going to go ahead and close this issue for now!

Couple things I wanted to add are:

Exactly, I realize the port mapping via the service and exportarr does not seems to support this, because exportarr priorize the configured port of the config.xml instead of the passed CLI flag --url.

You should be using cluster DNS and not taking the full trip to the load balacer IP and back to access exportarr since both the arr and exportarr are deployed in the same cluster. If this doesn't work you're are doing things in a very very non standard way. I get you don't want to use an Ingress and want to access the service on a IP without a port but this doesn't prevent you from using cluster DNS in a standard way. The container has a port of 8787 and the load balancer has an IP of 80.

However, I really like the configuration with config.xml. The reason for this is relatively simple. When the API key is generated in the GUI, it is also saved in the config.xml. This means that exportarr can react to this via fs.Notify and read in the API key again. The option to define the API key via environment variable does not offer this possibility.

Restarting the exportarr pod because of a API key change isn't bad nor inconvenient. I don't get what efficiency you are trying to gain here even the arr apps need to be restarted to change the API key.

Hi @rtrox and @onedr0p, thanks for the answers.

@volker-raschek - from what it sounds like, you have this set up in a pretty non-standard way -- what you're describing here (using one port mapping for access, and another for internal access) is the perfect usecase for an ingress. If it's helpful, you can see an example using exportarr, nginx-ingress, and external-dns here.

Yes, I am very familiar with how ingress, external-dns and metallb work. All these applications also run in the cluster, but I don't want to use ingress for the deployment of arr applications.
The ingress is given a static IP address by metallb. All HTTP traffic is routed to this IP address via the router. This means that the lidarr application would be accessible via the nginx, when the internal DNS name is know to third party persons. I simply don't want that. After all, the application can also run without a reverse proxy.

You should be using cluster DNS...

I think I have now understood what you mean by this. You mean the DNS name assigned by external-dns to the service of type LoadBalancer of lidarr. Please correct me if I am wrong.
That is a valid point. But why does the HTTP request from exportarr to lidarr have to leave the virtual network of the kubernetes environment to reach lidarr? This makes absolutely no sense to me if I can use the internal DNS name of the LoadBalancer. Finally, kubernetes offers the functionality of direct communication between rolled out applications/services. This option is not supported here because the port of the config.xml overrides the port specification in the CLI flag --url and the port corresponds to the port of the Lidarr application and not the Liadarr service.

Restarting the exportarr pod because of an API key change isn't bad nor inconvenient.

This may be a matter of opinion, but I strongly assume that you would also dislike it if a restart of the cert-manager were necessary if you changed the issuer of an Ingress and the cert-manager needed a restart for this change.
What I'm actually getting at is that it should be up to the user how the exportarr provides the API key of an arr application. Whether by environment variable or config.xml is up to the user. Only latestr would make it possible to react to changes in config.xml. This is a very common procedure in kubernetes/microservices, which you could also build on here. I am aware that exportarr does not have this option yet, but it would be easy to implement and automatically supported for each config.xml setup.
Examples of fs.Notify are not only changes to a config file, which usually occur less frequently. However, the scenario that new certificates are generated by the cert-manager occurs much more frequently in the microservice environment. These are mounted in the container file system. The application is able to inform itself via fs.Notify that the certificates have been renewed and restarts the web server process accordingly. This eliminates the need to restart the entire application and does not require any manual interaction.
Volker


Bug: Issue with Network File not responding when opened in Network Drive

Description
When attempting to open the "Network" file in the network drive, nothing happens and the application indicates that it is not responding, before closing without any error reporting. Furthermore, the application does not reopen once it is closed.
Steps To Reproduce

Open "Files"
Find the "Network Drives" category
Expand it
Click on the "Network" file

Requirements

eg. Fix crash that occurs when...
eg. Correct action happens when clicking...

Files Version
Version : <IP_ADDRESS>
Windows Version
Windows 11 22H2 22621.1555
Log file
debug.log

Thank you for reporting this issue.

It was my pleasure, and I believe you can see that I am actively trying to identify any significant bugs or errors that may exist, as I recognize the vast potential of your application.

I noticed that by reproducing this bug there was no longer any problem that occurs on version 2.4.80

I have this problem again in version 1.4.81

Finally by uninstalling and reinstalling Files all works again as before

@Lukiluc29 thanks for the update, please let us know if the issue occurs again.


Added example for memento design pattern.

Please provide a valid description to the PR

Please provide a valid description to the PR

I have added description and please help to review 🙇


bump nginx to 1.10.0

Description
Bumps nginx to 1.10.0. Will be released tied to k8s minor version release for aks so we follow the addon breaking change policy.
https://github.com/kubernetes/ingress-nginx/releases/tag/controller-v1.10.0
The breaking changes for our customers are

This version dropped Opentracing and zipkin modules, just Opentelemetry is supported as of this release
This version dropped support for GeoIP (legacy). Only GeoIP2 is supported

This will be clearly communicated when this is released.
Type of change
Please delete options that are not relevant.

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[x] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

How Has This Been Tested?
e2e, unit, locally
Checklist:

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my code
[x] I have commented my code, particularly in hard-to-understand areas
[x] I have made corresponding changes to the documentation
[x] My changes generate no new warnings
[x] I have added tests that prove my fix is effective or that my feature works
[x] New and existing unit tests pass locally with my changes
[x] Any dependent changes have been merged and published in downstream modules

/ok-to-test sha=f0bd064

Pull Request Test Coverage Report for Build<PHONE_NUMBER>
Details

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 79.45%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
2656

Relevant Lines:
3343

💛  - Coveralls


Feature Request: Array Operations

Will there be support for the newer array operations?
From the docs:
var washingtonRef = db.collection("cities").doc("DC");

// Atomically add a new region to the "regions" array field.
washingtonRef.update({
    regions: firebase.firestore.FieldValue.arrayUnion("greater_virginia")
});

// Atomically remove a region from the "regions" array field.
washingtonRef.update({
    regions: firebase.firestore.FieldValue.arrayRemove("east_coast")
});

https://firebase.google.com/docs/firestore/manage-data/add-data#update_elements_in_an_array

@JonesM87 Did you find a workaround for this in the meantime?

@troydcthompson I just stored the field data/array locally, made any manipulations I needed to, then updated the doc field. The arrays I'm manipulation are pretty small so this seems ok for now but does mean  an additional read from the db.

@jamesdaniels I'm using latest version but still don't know how to implement this

import firebase from 'firebase/app' needs to be imported as well?

I am also facing this array update issue how to do that using angular fire


e2e flake: TestClusterRestoreS3

 --- FAIL: TestClusterRestoreS3 (75.72s)
     --- FAIL: TestClusterRestoreS3/restore_cluster_from_backup_on_S3 (0.00s)
         --- FAIL: TestClusterRestoreS3/restore_cluster_from_backup_on_S3/restore_from_the_same_name_cluster (75.72s)
         	restore_test.go:110: container "etcd" in pod "test-etcd-szd6n-0000" is waiting to start: PodInitializing

It seems like the container has crashed:
Error: --initial-cluster must include test-etcd-szd6n-0000=http://test-etcd-szd6n-0000:2380 given --initial-advertise-peer-urls=http://test-etcd-szd6n-0000:2380

@hongchaodeng What was the full flag set we provided to the container?

@xiang90
We should be passing "test-etcd-szd6n-0000=http://test-etcd-szd6n-0000:2380"

It happened again.
etcd cmd shown:
pod (test-etcd-lisy7-0000): status (Failed), cmd ([/bin/sh -c sleep 5; /usr/local/bin/etcd --data-dir=/var/etcd/data --name=test-etcd-lisy7-0000 --initial-advertise-peer-urls=http://test-etcd-lisy7-0000:2380 --listen-peer-urls=http://<IP_ADDRESS>:2380 --listen-client-urls=http://<IP_ADDRESS>:2379 --advertise-client-urls=http://test-etcd-lisy7-0000:2379 --initial-cluster=test-etcd-lisy7-0000=http://test-etcd-lisy7-0000:2380 --initial-cluster-state=new --initial-cluster-token=b2fa1523-51ab-4afa-861b-b7a239334711])

etcd container level log:
Error:  --initial-cluster must include test-etcd-lisy7-0000=http://test-etcd-lisy7-0000:2380 given --initial-advertise-peer-urls=http://test-etcd-lisy7-0000:2380

@xiang90
I have managed to reproduce it.
It seems like if service name is not a valid one, the error will appear.
For example, if we start etcd:
/usr/local/bin/etcd --data-dir=/var/etcd/data --name=test-etcd-0000 --initial-advertise-peer-urls=http://test-etcd-0000:2380 --listen-peer-urls=http://<IP_ADDRESS>:2380 --listen-client-urls=http://<IP_ADDRESS>:2379 --advertise-client-urls=http://test-etcd-0000:2379 --initial-cluster=test-etcd-0000=http://test-etcd-0000:2380 --initial-cluster-state=new --initial-cluster-token=b2fa1523-51ab-4afa-861b-b7a239334711

Suppose "test-etcd-0000" is not a valid service name.
We will see
--initial-cluster must include test-etcd-0000=http://test-etcd-0000:2380 given --initial-advertise-peer-urls=http://test-etcd-0000:2380

I have a theory why it failed:

the first cluster was deleted
while the second was created, the first cluster was still being deleted. Unfortunately, the second failed to create svc because the first still existed around. The first later deleted them.
the etcd pod of the second cluster failed with above message.

@xiang90
If so, I think this problem will be solved by our lazy deletion.

@hongchaodeng Can you somehow confirm your assumption?

Sure. We can add more logging and correlate them.

is this fixed?

@xiang90
Should be fixed. This is actually rarely seen.


2.2.2 Security Management (FMT) TSS

Why does there need to be a Supporting document when the assurance activities are identical to those specified in the PP-Module for Server Virtualization Systems itself, except the ommision of the reference to Table 2 in the TSS paragraph; "The evaluator shall
verify that for each management function and role specified in , the defined role is able to perform all mandatory functions as well as all optional or selection-based functions claimed in the ST.
Added value of additional document not clear

Fixed the missing table reference. There has to be an SD because that's what the CC says.

Fixed the missing table reference. There has to be an SD because that's what the CC says.


Update network policy doc

What this PR does / why we need it?:

Add doc for network policy.

Does this PR introduce a user-facing change?

[X] User guide
[ ] CHANGELOG.md

Which issue(s) this PR fixes:

Fixes WASdev/websphere-liberty-operator#90.

@leochr The PR has changes for the probe doc updates. I'll fix after the probe doc updates are merged into main.

@leochr I rebased to include probe doc updates so PR is good to review now.


Feature Request: HomeKit notifications

Problem
Would be nice to receive a notification when a zone starts/stops watering
Solution
Maybe the valves can also have open/closed sensors
Alternatives
No response
Additional context
No response

I think this might be a HomeKit limitation? I can't find any mention of notifications for irrigation systems or valves. Maybe someone will have better luck?

@tu00tf We are thinking of doing contact sensors or motions sensors.

contact sensors :D, i was using them when i was on HA.

Got it! Makes sense.

@iondarie, another option could be to implement pushover notifications. I've done this in a couple of other plugins I've written and it works quite well.  There is however a one-time $5 purchase required

@mantorok1 one-time purchase for every user? sorry to ask but i really don't know much about pushover

@mantorok1 one-time purchase for every user? sorry to ask but i really don't know much about pushover

Yeah it's per user so you'd have to purchase it for each person you want to receive the notifications.

@iondarie I have added an option to enable a contact sensor to be notified when a zone has run can you test it out?
@, can you try Beta:

@tu00tf and @iondarie, I have made some suggestions. Can you try the new beta?
Beta:

Just to confirm: my program ran through all 6 zones this morning without any sign of the contact sensor.

okay, I hope I have this fixed. Can you try the new beta?
Beta:

Okay what about next one?

@tu00tf But you have it enabled in the rainbird app?


IUrlHelper and support for RouteOptions.LowercaseUrls

I have the following setting:
services.Configure<RouteOptions>(opt => opt.LowercaseUrls = true);

When I generate URL from my controller, query parameters are named like in C#, for example
query?Property=x
I expected it to be query?property=x, ideally in camel case. So query?propertySomething=x
It would be nice if IUrlHelper implementation or RouteValueDictionary or something else respected this setting.
Example invocation:
Url.Action(nameof(MyAction), myModel);

//myModel
class MyModel
{
    public int PropertySomething { get; set; }
}

Thanks for contacting us, @enemyofthedawn.
We've moved this issue to the Backlog milestone. This means that it is not going to happen for the coming release. We will reassess the backlog following the current release and consider this item at that time. However, keep in mind that there are many other high priority features with which it will be competing for resources.

Also it would be nice if IUrlHelper could generate hyphenated query strings, and some possibility to choose convention to use when generating links (camelcase etc.)

Fixed by acea87a

@lecoque - if you'd be willing to send a PR, I think we'd be willing to take something like this

Or maybe some action so you can write your function that controls the naming.

I don't want to add too many options to the framework by default - as you point out there are a lot of different schemes for generating query strings. I'd rather add a hook that lets application developers customize it.


Feature: AudioProfile Volume

Allow a different volume setting on AudioProfile's.
Use Case:

I go to change the music played when selecting/creating a character. I can do this easily with AudioProfile's however I am stuck with the volume of the audio clip. I would need to bounce out the audio file again to have a reduced volume.

If we had a Volume level on the AudioProfile or somewhere clever then we could have better control over such things. And use the same clip at different levels in different places with different AudioProfile's.

This is a great request.  I haven't had time to explore if there is any volume normalization feature available in Unity, and up until now I'd been manually making copies of certain sounds in audacity and changing the levels on the new copy.
If there is no such thing as volume normalization in Unity, then that would probably have to be part of this to really make sense.
For example, if you have your master effect set low, but one particular sound effect set high, I think it should still respect the overall low setting while still getting the local boost to a higher volume so a really quiet sound that is manually boosted can still be heard when the master volume is low without blasting too high in case someone is wearing headphones etc.
I wonder if Unity can detect the "average" loudness of a sound clip.


assessment rspec

...code to work.

Hey, I thought this might trip some of you up. No need to alter the math.rb file on this one (you didn't need a class to test). You can simply test methods by describing them, then running an expectation on those methods. That's why I created that example in the comments. So this is what we were looking for:
`describe '#square' do
it 'returns the square of the number' do
expect(square(2)).to eq 4
expect(square(3)).to eq 9
expect(square(4)).to eq 16
end
end
describe '#cube' do
it 'returns the cube of the number' do
expect(cube(2)).to eq 8
expect(cube(3)).to eq 27
expect(cube(4)).to eq 64
end
end
describe '#perimeter' do
it 'returns the perimeter of the square with the given side length' do
expect(perimeter(2)).to eq 8
expect(perimeter(3)).to eq 12
expect(perimeter(4)).to eq 16
end
end
describe '#cube_surface_area' do
it 'returns the surface area of a cube with given side length' do
expect(cube_surface_area(2)).to eq 24
expect(cube_surface_area(3)).to eq 54
expect(cube_surface_area(4)).to eq 96
end
end
`


ReadSignal Products

(signal0, signal1).map(...) for larger tuples. Is it easier if we have signal flattening (#4)

Implemented for tuples of arity 10 and below


Ability to modify 'location' with my own reducer?

Hey all, thanks for making this library, it feels great to finally have router state in redux.
I'm in a situation where I'd like to modify the 'location' in the store with my own reducer. When I try to modify it now, the store is updated but the url change is not reflected in the browser.
Here's the situation:
I have an action+reducer that runs to handle an api response that includes a list of images. In our app, the images can be reordered and we want to have the image order stored in the url for easy sharing.
So ideally, the same reducer that handles the image response also adds the ordered list of images to the url in the redux store, and as users reorder the images the url is updated.
This doesn't work though. I've also tried using redux-thunk to dispatch the url change separately but it doesn't have access to the store to get the list of ids.
Please let me know what you think and if this is possible, or if there's a better approach. Thanks!

The store state isn't bidirectional. Either dispatch the appropriate action or don't use this library (you shouldn't) and talk directly to the router/history.


PgSync Daemon is not clearing the cache items

PGSync version: 1.1.24
Postgres version: 11.8
Elasticsearch version:
v7.10.0
Python version: 3.7.9
Problem Description:
The replication slot keep growing at times and when we look at the pgsync daemon logs, we could see lots of cache items pending to process.
This problem is happening only when we have some bulk update done to the database by a script in the backend.
This script update almost 80% of the data which could be what is creating this cache items.
However, it never clear it out. and we always had to delete the replication slot and bootstrap again to restore.
This is also causing spike in RDS at times.
Error Message (if any):
Polling db my_db: 40,385 cache items

happening to me as well! thanks for reporting @CE-Creates, RDS has to scale up due to the amount of storage required

Did you setup REPLICATION_SLOT_CLEANUP_INTERVAL as described here ?
If you did the above do you have either POLL_TIMEOUT or REDIS_POLL_INTERVAL set to a sufficiently high value.
Maybe you can turn on logging, (or run with -v) set REPLICATION_SLOT_CLEANUP_INTERVAL to a low value and check if the cleanup is being triggered at all

PS: Cache items is a bit misleading. This is not items to process but items that HAVE been processed

are you running pgsync as a cron or a daemon? if its the latter you might want to schedule pgsync to run closer to the time you perform your bulk data load

are you running pgsync as a cron or a daemon? if its the latter you might want to schedule pgsync to run closer to the time you perform your bulk data load

We are running it as a daemon

PS: Cache items is a bit misleading. This is not items to process but items that HAVE been processed

Is there a metric that shows how many items are pending to be synced.
Till now, we were referring to this cache items value for that.
During this period, the db transaction log spiked from 2.3 GB to 9.1 GB.
If cache items count is that of "have been processed", why is replication slot size not reducing?
Polling db my_db: 40,385 cache items
Polling db my_db: 40,385 cache items

Did you setup REPLICATION_SLOT_CLEANUP_INTERVAL as described here ?
If you did the above do you have either POLL_TIMEOUT or REDIS_POLL_INTERVAL set to a sufficiently high value.
Maybe you can turn on logging, (or run with -v) set REPLICATION_SLOT_CLEANUP_INTERVAL to a low value and check if the cleanup is being triggered at all

We have the following configured
REPLICATION_SLOT_CLEANUP_INTERVAL = 900
POLL_TIMEOUT = 0.5
We have not set REDIS_POLL_INTERVAL so I assume it must be using a default value

I see you are using a REPLICATION_SLOT_CLEANUP_INTERVAL of 15 mins(default).
Try dropping that down a to a lower interval.
I will change the default to 5 mins.
In any case bursts of bulk data imports will result in this
clearing the replication slot manually is not ideal. Its better to set it to a low interval

Thank you @toluaina
I did the following today:

set REPLICATION_SLOT_CLEANUP_INTERVAL to 300 ( 5 minutes )
deleted replication slot as it was getting huge
bootstrap
ran the daemon

I could see the following now in the log ( 0 cache items )
Polling db my_db: 0 cache items
Polling db my_db: 0 cache items
Polling db my_db: 0 cache items
Polling db my_db: 0 cache items
Polling db my_db: 0 cache items

So far so good. But I am sure it will burst every time the script i mentioned above run .
Ideally we used to run it everyday morning, now we are running it manually to have a control of this issue.

@toluaina
I just noticed something today morning
I ran a script this morning which changed a lot of data (30% of the database entries).
As expected, pgsync log was showing cache items
Polling db my_db: 23.162 cache items
I was expecting it to be down to 0 but it didnt happen.
the replication slot went up to 2 GB
I decided to stop pgsync and start the daemon again.
When restarted, the replication slot got cleared up and the log started showing 0 cache items

As mentioned before, cache items are the items processed so far so there is nothing abnormal there.
The replication slot gets cleanup up at intervasl defined by REPLICATION_SLOT_CLEANUP_INTERVAL

Closing this too. Feel free to re-open if this issue is still an issue :)

I am also experiencing this.  I found a few related issues but this one is probably most similar.  I can sync if I periodically run pgsync but in daemon mode the 'cache items' increase but no changes are reflected in ES.  In my case I noticed one document with the same id showing up  once a second:
2021-05-06 23:07:57.807:DEBUG:pgsync.sync: on_notify: {'xmin': 60518827, 'new': {'id': 'xxxxxx-cd3b-41d2-a8ea-aef7aa798246', 'operator_id': None}, 'old': {'id': 'xxxxxxx-cd3b-41d2-a8ea-aef7aa79
8246', 'operator_id': None}, 'tg_op': 'UPDATE', 'table': 'users', 'schema': 'public'}

Its always the same doc _id.  Not sure if this is related or just some continuous DB activity.
I have tried changing some of the ENV VARs like REPLICATION_SLOT_CLEANUP_INTERVAL but I can't seem to get changes to show up in ES until I run it manually.

REPLICATION_SLOT_CLEANUP_INTERVAL

Yes, i am facing same problem, some one could help me?


Update playingSoundsMusic.md

Adds
Handling autoplay & unlocking audio on first user interaction
https://playground.babylonjs.com/#KBA3JY#4
Edit;
Seems like the first part is not needed.
autoplaying sound objects plays correctly after audio is unlocked.

Question about your comment - do you need to update the docs, or want to leave it as is?


Azure Arc Data Controller on Minikube

Hello,
I am trying to evaluate Azure Arc Data Services in my local environment using Minikube. I created a Minikube cluster on my local machine (Windows 11, Build 21H2) with 4 cores and 8 GB memory.
I followed the procedure in the Azure docs, signing into my Azure subscription and using the wizard in Azure Data Studio to provision the Azure Arc Data Controller in the indirectly-connected mode. All of the necessary resources are provisioned in Minikube, but no Azure resources are created. The notebook cell with the az arcdata dc create command just hangs. I have the necessary CLI extensions installed and network access to Azure (no corporate firewall).
Here are the resources created in my namespace, arcdcns, after 45 minutes:

As this is a local cluster, I used the minikube tunnel command to accommodate for the controller-external-svc, logsui-external-svc, and metricsui-external-svc services being LoadBalancers. I was able to access the Grafana UI on port 3000, and I was also able to connect to my data controller from within Azure Data Studio.
What factors are preventing the Azure resource from being created? Does direct connectivity mode have any architectural differences that are better suited for this local scenario?
Thank you.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 0bf35526-d3ab-0727-89b3-875f2c25dc90
Version Independent ID: b016cf16-d96a-6f13-2a1c-5f4f30426727
Content: Create data controller in Azure Data Studio - Azure Arc
Content Source: articles/azure-arc/data/create-data-controller-indirect-azure-data-studio.md
Service: azure-arc
Sub-service: azure-arc-data
GitHub Login: @twright-msft
Microsoft Alias: twright

@saimachi Thanks for the feedback! We are currently investigating and will update you shortly.

@saimachi Thanks for the feedback! We are currently investigating and will update you shortly.

@saimachi, can you please check if you have any failing pods for this deployment using kubectl get pods -A?
If you see failing pods, please use kubectl describe command on that pod to get more details.

Hi @AnuragSingh-MSFT,
Thanks for your comment, but from the image I posted, it appears that all pods are running. Are there any other debug steps I can try?

@saimachi, There are some logs that you may refer:
Minikube: minikube logs
Azure arc Data Service: Log files
You may also use kubectl get datacontroller --namespace=<namespace> to get the current status. I have observed that the "DeployingMonitoring" stage takes very long time.
Also, please note that the complete process may take significant amount of time depending on hardware, number of nodes, network connectivity etc. The complete process is highlighted in this post: Build a hybrid cloud database platform with Azure Arc

@saimachi, There are some logs that you may refer:
Minikube: minikube logs
Azure arc Data Service: Log files
You may also use kubectl get datacontroller --namespace=<namespace> to get the current status. I have observed that the "DeployingMonitoring" stage takes very long time.
Also, please note that the complete process may take significant amount of time depending on hardware, number of nodes, network connectivity etc. The complete process is highlighted in this post: Build a hybrid cloud database platform with Azure Arc

.

@saimachi, We will now proceed to close this thread as we have not heard back from you. If there are further questions regarding this matter, please tag me in your reply and reopen the issue. We will gladly continue the discussion.

@saimachi  - you did all the right things.  You're just at the point where you need to do the next step which is to export out the data and upload it to Azure. Please see this article: https://docs.microsoft.com/en-us/azure/azure-arc/data/upload-usage-data


Required vgpu e2e test lanes fail on release-1.3 and earlier release branches

Following an upgrade of the CI worker nodes to cgroups v2 - the vgpu e2e test lanes are failing.
The kind nodes seem to be missing some required cgroups for the VMs to start successfully.
{ Failure tests/mdev_configuration_allocation_test.go:285
Unexpected Warning event received: testvmi-n8wkz,95d8517d-d61b-4682-8a5f-242a4cca111d: server error. command SyncVMI failed: "failed to read pod cpuset: open /sys/fs/cgroup/cpuset.cpus.effective: no such file or directory"
Expected
    <string>: Warning
not to equal
    <string>: Warning
tests/watcher/watcher.go:195}

source:  https://prow.ci.kubevirt.io/view/gs/kubevirt-prow/pr-logs/pull/kubevirt_kubevirt/13317/pull-kubevirt-e2e-kind-1.27-vgpu-1.3/1859543022560088064
This issue is not seen on vgpu lanes running against the main & release-1.4 branches - these lanes are using the updated vgpu provider kind-1.30-vgpu which uses a newer version of kind.

/assign

Issue resolved by https://github.com/kubevirt/project-infra/pull/3777
/close


possibility to use filter-on with *:transfer:

For devs running wallet type dApps where user account history across multiple tokens is important, running a node with the mongo plugin is important.
However the amount of data / time / space it takes to sync a full node is growing... see #5797 .
Would it be possible to implement a filter that allows a wildcard receiver? Something like:
filter-on: *:transfer:
This would limit the amount of data a node needs to write to the db for transfer history, which is what most wallet type dApps are after.

The Mongo plugin has provided this feature since 1.3.0.  See PR #5670 for details.
The syntax is filter-on = :transfer: or filter-on = 0:transfer:0.

This is an excellent question @ajose01, thank you for asking it.  For the life of me I can not find a simple list of filters with even a light dictionary of what is behind each filter.  This is very helpful.


add hyprland source code

When Vaxry insisted on using his own cursed config language, we asked him to pick something that already works.
https://github.com/hyprwm/hyprlang
He refused and spent more time on the thing that nobody asked for, instead of fixing bugs.
A long time ago, I wanted his compositor's config to be more compatible with Nix.
I made something to translate JSON and serialize it as the Hyprland config language.
https://github.com/hyprland-community/hyprland-nix/tree/master/hm-module


Peer dependency problems

Hi @mikkopaderes and thanks for this project, it's been a blessing!
Our app has been running nicely with the current version of the add-on for months. For whatever reason, we've ended up with<EMAIL_ADDRESS>installed as a dev dependency. That's not been a problem until today, when I tried to test the app against the latest version of Ember, via ember-try. When I did, it refused to play ball because your add-on has<EMAIL_ADDRESS>as a peer dependency. I tried rolling back to that version but that broke the app - auth doesn't appear to be working properly and that's preventing the adaptor resolving requests 😢
Currently, the only way I can get the app working is with @9.0.1 as a dev dependency.
Before I throw myself into another day of debugging, is there a rationale for having the legacy dependency as a peer? I note that @9.0.1 is in your own dev dependencies, so it seems odd at first glance.
Any context / thoughts would be greatly appreciated 👍🏻

Great, many thanks for confirming 👍🏻

Resolved by #167


Add mrkarstrom

Adding my username

Awesome!

Thanks for contributing 👍

Thank you! This will be alot of fun🙌
lör 18 feb. 2023 kl. 14:18 skrev Sriparno Roy @.***>:

Thanks for contributing 👍
—
Reply to this email directly, view it on GitHub
https://github.com/EddieHubCommunity/hacktoberfest-practice/pull/2521#issuecomment-1435668034,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ATZLGK7RQILD5FAFFPCIRRLWYDD2BANCNFSM6AAAAAAU73VI4U
.
You are receiving this because you were mentioned.Message ID:
@.***
com>

--

Med vänliga hälsningar, Magnus Karström
@.***


Svelte-Apollo Example

[x] Example of how to use Svelte and Hasura with Nhost
[x] Followed Code of conduct and Contribution guidelines

Hello Animesh, thank you for your contribution.
Please have a look at these adjustments:
https://github.com/Sonichigo/nhost/pull/2

I'll make it consistent and then update would require a bit of time though.

Thanks, @Sonichigo. Can you mark all resolved comments as "resolved" by clicking "Resolve conversation"?
I'll take another look at the code later today. Thanks again for this example.

Had to add x-hasura-admin-secret in form of .env as when I used Authorization:`Bearer ${accessToken}`  in header got this response went through a lot of docs and qns on Stackoverflow but wasn't able to solve the issue.

@elitan Can you take a look at code once if it's ready to be merged or not?

Can you use pnpm and workspace:* like in other examples. Like this.

Relationships and permissions are not tracked in Hasura. This is what I see when I start the app:

Closing because stale. Happy to reopen in the future if there is interest.


ISO IS document review

Generated DOC and PDF versions of ISO Rice International Standard were compared against the ISO IS model. Following differences were noticed:
Difference 1. In footnote description, number of the footnote is not subscripted in PDF, unlike in DOC. PDF matches the original.
Generated DOC:

Original:

Difference 2.  Footnotes in tables are marked differently. PDF uses style: a, b, c, etc., while DOC uses style a), b), c), etc. PDF matches the original.
Generated DOC:

Original:

Difference 3.  Caution is rendered differently.
Generated DOC:

Original:

Difference 4.  Warning is rendered differently.
Generated DOC:

Original:

Difference 5.  Different cross-referencing of Formula B.1 from subsection B.6:
Generated DOC:

Original:

Difference 6.  Subfigures have different titles. They are marked with: a), b), etc. in PDF, while they are marked in the format "Figure x.y-1", "Figure x.y-2", etc. in DOC. PDF matches the original.
Generated DOC:

Original:

Difference 7.  At the end of the document, DOC doesn't add an information about ICS number and on how much pages was the price based.
Original/generated PDF:

Difference 1, footnote rendering, is NOT supported in the Word template provided by ISO, which does not even use the parenthesis (let along sizing the footnote reference differently from the footnote anchor). Will not action unless confirmed by ISO, they may want the Word document to keep default footnote rendering. (So may need to revert https://github.com/metanorma/metanorma-iso/issues/301). @ronaldtse Please escalate to ISO.
Difference 2, footnote rendering of table footnotes. This was overgeneralisation of footnote rendering in https://github.com/metanorma/metanorma-iso/issues/301.
Difference 3 and Difference 4, admonition rendering. Have already fixed rendering in IEC, moving that code up to ISO.
Difference 5. The Rice model document is violating ISO policy on this point:
https://www.iso.org/sites/directives/current/part2/index.xhtml#_idTextAnchor372

Use, for example, the following forms for references to mathematical formulae:

“see 10.1, Formula (3)”;
“see A.2, Formula (A.5)”.

I therefore will not action this.
Difference 6. Confirmed in ISO/IEC DIR 2.
Difference 7. In fact that is already implemented, but only for documents with Published status:

Of the points gone through,

Difference 1 to be escalated.
Difference 5 rejected.

Difference 1. Let’s not forget that the Word output and PDF output are for different purposes. Word is for review (track changes) and submission to ISO/CS. PDF is only for review and reading. This discrepancy is acceptable. There is no need to escalate this to ISO because they will provide the same sort of answer.
Difference 5. The ISO Rice document was authored a couple years ago and contains a number of errors, and is likely to deviate from current Directives. So we have to be aware of that.

In that case, ticket closed.


Is there a reserved API interface for generating SVG files

I now have a json data file with a size of 1kb. When I open the file with wavedrom-editor.exe, the sequence diagram loaded by the software will not be smooth to look at. After exporting the SVG file, it is smooth to look at the sequence diagram.So I want to know if there is an API interface that allows me to export SVG files directly.
Looking forward to your reply. Thank you!

You can try using WaveDrom Command Line Tool wavedrom-cli https://github.com/wavedrom/cli

@drom Sorry, I don't know how to use it.But it doesn't seem to be what I want. What I want is for the data generated in the code to be invoked by one of its interfaces to generate the SVG file directly.Just like that, but it doesn't produce SVG files very quickly...


Unable to set a revision

Hapistrano sets the release to the correct revision by resetting the head of the git repository while the current branch is master. However, if you want to deploy using a different branch, which has diverged from master, git reset origin/<new-branch> will have unstaged changes after reset.

On 520ebc4 I modified the setReleaseRevision function to use git checkout. Let me know what do you think.


0.5 small things to be fixed now

Describe your bug here.

Source
What is your build target?
HTML5
Did you edit anything in this build? If so, mention or summarize your changes.

Aight, imma check out the official release
El sáb., 11 de diciembre de 2021 9:21 a. m., CrusherMods <
@.***> escribió:

I think they fixed anti aliasing but idk about screenshakes but I think I
did use screenshakes so
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/ShadowMario/FNF-PsychEngine/issues/1930#issuecomment-991680376,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AWV472BX3SRXGBLA3RGMG33UQNT7FANCNFSM5J2S4XKQ
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.


Added jshint detection in addition to jsl

Added the jshint syntax-checker from mkitt at factorylabs into the javascript.vim file  (https://github.com/factorylabs/vimfiles/blob/master/home/.vim/syntax_checkers/javascript.vim)
It still behaves as before, checking for jsl first, then jshint if it didn't find jsl.

Is this behavior documented anywhere? I lost about a half hour trying to figure out why I couldn't get jshint working with Syntastic, and googling for this commit gave me my answer.
If it is documented, my apologies! :)

#84 is probably more relevant.
It looks like the errorformat for jshint is out of date. I may get around to updating it myself one day, but i dont use it so its fairly low on my list.


[HW3] Cells fitness

Hi,
Without changing css attrs, cells are not fit in game windows with the given rows(10) and cols(10)
Thanks,
Siavash Kavousi

Hey, you are free to modify css but  you can assume all levels are 9x9 in your impl.

I've already assumed that :D


TS Config not being loaded.

{
  "compilerOptions": {
    "module": "commonjs",
    "noImplicitAny": true,
    "removeComments": true,
    "preserveConstEnums": true,
    "target": "ES6",
    "jsx": "react"
  },
  "exclude": [
    "public",
    "node_modules"
  ]
}

Above is the contents of my tsconfig.json when I run tsc my-file.tsx I get the error below.
$ tsc main.tsx
src/ts/main.tsx(5,1): error TS1148: Cannot compile modules unless the '--module' flag is provided.
src/ts/main.tsx(5,9): error TS2305: Module '"react"' has no exported member 'React'.
src/ts/main.tsx(6,24): error TS2497: Module '"react-dom"' resolves to a non-module entity and cannot be imported using t
his construct.
src/ts/main.tsx(10,12): error TS17004: Cannot use JSX unless the '--jsx' flag is provided.
src/ts/main.tsx(14,17): error TS2605: JSX element type 'App' is not a constructor function for JSX elements.
  Property 'setState' is missing in type 'App'.
src/ts/main.tsx(14,17): error TS17004: Cannot use JSX unless the '--jsx' flag is provided.

Information.
$ ls
node_modules  package.json  public  main.tsx  tsconfig.json  typings
$ tsc --version
message TS6029: Version 1.7.0-dev.20151006
$ uname -a
CYGWIN_NT-10.0 DESKTOP 2.0.4(0.287/5/3) 2015-06-09 12:22 x86_64 Cygwin

I believe you (currently) cannot target ES6, and also target a different module system. If you are targeting ES6, then it writes our ES6 import/export syntax. Can you try just using one or the other and let us know if that works?
Note: We (TypeScript) realize this is impractical, as lots of engines (such as Node) support ES6 features (such as classes, arrow functions, generators, etc...), but still only support CommonJS module syntax. The next release will allow for targeting ES6 emit while also specifying a different module system.

Above is the contents of my tsconfig.json when I run tsc my-file.tsx I get the error below.

do not pass files to the compiler if you want it to use your tsconfig.json. either run it with no options e.g. tsc and it will look up all files in this directory automatically, or using --project  e.g tsc --p <path to folder containing tsconfig.json.

@mhegazy that is the one, maybe that needs writing up somewhere?

here you go: https://github.com/Microsoft/TypeScript/wiki/tsconfig.json#using-tsconfigjson

@mhegazy thanks!


add parallel support to wdist_state function

EEG data is often much higher temporal resolution than fMRI. As such, EEG inputs from my co-worker were often downsampled before being put into GSBS. This lowered the run time of course, but may have downsampled activity to the point of reducing the accuracy in finding event boundaries.
After putting GSBS through some profilers (namely cProfile and Scalene) it was determined that the early iterations dominated the run time and were spent in the spent in wdist_state function. Run time then begins to fall off significantly once the first few boundaries have been placed.
Since this function calculates all possible boundaries, a thread pool is well suited. This threadpool computes each boundary on its own and reports the results. This is then handled by the usual mechanism inside of GSBS.
Parallelizing the entire function had the unfortunate result of slowing down the final call where stateopt is inhabited. To avoid this, the implementation simply branches on when stateopt is None or not.
Results were verified to be correct by running with and without the changes on a known dataset. The exact same event boundary values were found.
Observed speed increase on a supercomputing cluster node with 64 cores takes the runtime from ~6 hours to ~12 minutes.

If anyone has any other tests and would like to verify things work properly, that'd be great!

This is fantastic Tyler! We will test this and get back to you about it.


Dead Letter queue autoforward

In the first paragraph there is this sentence:
Also, it is not possible to chain a subqueue, such as a deadletter queue, to another queue or topic.
But we have tested this scenario using the property SubscriptionDescription.ForwardDeadLetteredMessagesTo and the auto forward works.
Is this an error on the documentation or is something that is not fully supported and we should not use it?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 35341297-d419-96bf-7ba7-d7916f6a6d13
Version Independent ID: b47f0495-66b4-ab5b-e927-743d6c99808f
Content: Auto-forwarding Azure Service Bus messaging entities
Content Source: articles/service-bus-messaging/service-bus-auto-forwarding.md
Service: service-bus-messaging
GitHub Login: @axisc
Microsoft Alias: aschhab

@mambru Thanks for the feedback! We will investigate and get back to you on this.

@mambru I've confirmed internally that the doc is indeed out of date.
I have a raised a PR to remove that line from the doc.

@mambru Thanks for contributing to MS Docs! We will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion and we will reopen the issue.


Publish Sphinx docs to webpage

Users should be able to read documentation without looking at the source repository. We can either use Github pages or readthedocs. I have a preference for the latter.

Fixed in #61.


Minor docs fixes

It doesn't look like I actually have to change anything for the "new" typedefs to work.

This is not the bit that will fail :-). The bit that will cause problems is generating markdown from doxygen xml.

@hamishwillee I looked at the markdown output and it looked ok. Of course, we'll still have to actually check the links, etc.

Great! We can check links as a post process even. I'm OK for you to merge this if the check failed are OK


Option to limit number of iterations by CPU time [patch]

I've added --timelimit option to zopflipng that stops iteration after the given
number of seconds has elapsed, as measured by clock() function that's supposed
to measure CPU time used.

This allows placing hard upper limit on how long optimization will take, e.g.
when server needs to respond with optimized image on time or when impatient
user is waiting for large image to optimize.

The time limit has the same inaccuracy as number of iterations:
ZopfliLZ77Optimal() may be called several times (e.g. when strategy==3),
multiplying actual number of iterations done, and so time. I did not try to
compensate for that.

Original issue reported on code.google.com by<EMAIL_ADDRESS>on 16 Jul 2013 at 2:59
Attachments:

0001-Option-to-limit-number-of-iterations-by-CPU-time.patch

PR #52


Fixed merge conflict

Also fixed couple of typos.
cc: @blackdwarf , @mairaw

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/core/preview3/tools/dotnet-msbuild.md
:white_check_mark:Succeeded
View
Details

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

Thanks @svick! I have an issue to go over those docs as soon as possible. That's a good catch.


Implement choice of options using key initials

Also apply code style (VS Code) to the bash script & correct the statement in the GPT prompt

Could you separate the formatting from the actual changes? It is hard to see the real changes in all these formatting diffs.

Sorry @thomas-endres-tng, my VS Code setup auto formats code on save, I should probably be more wary of this. Anyway, a nice little exercise in git to rebase my work upon the merged pull request.


dtreduce

I just opened https://github.com/JuliaLang/julia/issues/34311 to ask for better Julia support for a scenario where one has multiple worker processes, where each has multiple threads.
In such a scenario, it would be useful to have a dtreduce function which works across all the threads across all the worker processes. This would be different from dreduce which only uses one thread in each worker process.
It would probably be advisable to keep the current behavior of dreduce to keep it compatible with @distributed and pmap. Keeping the ability to have one per-process reducers is usefull, for example if the invoke @threads internally.

This is already implemented in #133. It'll be in the next release. You can pass threads_basesize = typemax(Int) if you don't want to use threads.

Keeping the ability to have one per-process reducers is usefull, for example if the invoke @threads internally.

This is not necessary because Julia's scheduler is depth-first: https://julialang.org/blog/2019/07/multithreading  If you use @threads inside (e.g.) Map(f) then it will automatically use multiple cores.
Though this may be a good idea if you use external libraries that are not aware of Julia's scheduler. https://github.com/JuliaLang/julia/issues/32786


Incorrect code highlight in Shell Script editor

Does this issue occur when all extensions are disabled?: Yes

VS Code Version: 1.66.1
OS Version: Linux x64 5.13.0-27-generic (Linux Mint 20.3 Cinnamon)

Steps to Reproduce:

Just type the code, as in screenshot, to see, that for some reason RegEx in if clause disturbs code highlight:

I found out, that when one removes the nested round brackets (capturing group with index 2), highlighting continues to work correctly.

@tkitynski can you please share a copy-pastable example that I can use to reproduce the issue?

You're welcome:
#!/bin/bash

if [[ "${foo}" =~ ^(([^:]*)/)$ ]]; then
	declare bar="no highlight";
	declare baz="highlight works back again";
fi;

Thanks, I can repro it. It seems that the meta.scope.logical-expression.shell scope is not getting closed.
We get our shell script syntax highlighting grammar from https://github.com/atom/language-shellscript, but the grammar we use there is no longer being updated. Linking to https://github.com/microsoft/vscode/issues/77675, which track finding and adopting a better maintained grammar.


Update Task example

This PR

Cleans up .gitignore
Updates the local dev script to use similar styling to the new roc-lang.org website
Updates the Task example

I've made changes with a more educational focus.
I'm still going to update ### Write to a file and ### List the contents of a directory tomorrow.

Thanks @lukewilliamboswell, I think this is a substantial improvement compared to the old Task example!


Consider: Rename .grab to .select

.grab as a method name is a bit odd, and is an artifact of the early experimental phases of the project. I'd like to phase that out by:

introducing a .select method that shadows .grab.
update documentation to use .select instead of .grab
add a console warning to .grab calls, pointing the user to .select
in the future, fully deprecate .grab and remove it from the codebase.

Also consider overloading this function and join grabOne's functionally with it.

grabOne might be called property or prop (as in lodash), if you're looking for suggestions.

Is this still open for discussion? or are things pretty settled? with the .select method existing here now based off of sanity's select() method it makes this a little more complex to reason about.
I guess there are some discrepancies in naming that we could unify if we want to. If we wanted to go more off of a GROQ convention, we could do .grab() -> .project() & leave .select() as is. Or we could choose to deviate from GROQ based naming conventions and rename .select() -> .conditional().
I guess another interesting api feature to help reason about things would be spread/merge, which would be nice to adopt here in the near future
Personally, I think it might be nice to base naming as closely to one api source as possible. Whether that be GROQ, Zod or whatever else.
Coming into the library, I found it helpful when methods were named more closely resembling their GROQ counter parts to make it easier to reason about the underlying GROQ query that's being built and referencing any relevant GROQ documentation. That being said, I agree that .project() sounds a little funky, and maybe it's fine that .grab() is our only deviation from GROQ naming conventions because of that 🤷


Docker: building, non-existent files

This line https://github.com/inveniosoftware/invenio/blob/master/Dockerfile#L83 seems to be expecting a git clone of the invenio repository in the / directory inside the container. Is there some special way to build the Dockerfile apart from docker build .? If so, is it intentional that the basic docker build . does not work?

cc @crepererum

I was thinking that this is maybe expecting some kind of volume mapping that is not mentioned (maybe is, sorry) or instead of the COPY we might use the ADD instruction.

This line https://github.com/inveniosoftware/invenio/blob/master/Dockerfile#L83 seems to be expecting a git clone of the invenio repository in the / directory inside the container.

Nope, it copies the listed files into the /code directory of the container (the path gets created because it does not exist at this point). It does not checkout the project in any root folder.

Is there some special way to build the Dockerfile apart from docker build .?

Should their be one?

If so, is it intentional that the basic docker build . does not work?

Can explain why it is not working?
For COPY vs ADD see

https://docs.docker.com/articles/dockerfile_best-practices/#add-or-copy
http://www.centurylinklabs.com/dockerfile-add-vs-copy/

The reason why we are not cloning the repo directly into the container is that you might want to make some changes to the code before letting Docker copying over everything. Making the modifications after the pull would be a lot of pain and does not provide any advantages. If you want to make live changes to the code (e.g. for development reasons), take a look at the Docker Compose config which maps the source directory directly into the container.


NTR for PMID:36980258

decreased number of interphase microtubules
increased actomyosin contractile ring recoil distance after laser ablation
increased actomyosin contractile ring recoil time after laser ablation

increased actomyosin contractile ring recoil distance after laser ablation
increased actomyosin contractile ring recoil time after laser ablation
This seems to combine a phenotype and a method.
Maybe it would be better to describe it as after microtubule "disruption/trauma/collapse"? so that it is not specific to the method  (assuming the microtubules are ablated here?)

I thought so as well, but I don't think there is any other way of doing it. Just in case, I will remove "laser" from the definition. I think ablation is good because it implies a relatively localised cut, which you would not be able to get with a drug.

OK!


Ask confirmation before pushing next image

What does this PR do?
Someone pushed next tag occasionally from the PR, which broke all new installations which tried to use next image.
With make docker it's really easy to override occasionally next image which I also did a few times and had to quickly fix.
Now if you have locally set IMG with your own repo - everything will work as previously.
But when you try to push quay.io/devfile/devworkspace-controller:next, you'll need to confirm it.
I also thought about env var which would allow to avoid confirmation, but so far CI does not use make install.
It also helps to prevent another mistake, when I deployed https://github.com/che-incubator/devworkspace-che-operator I did not success since I have IMG=sleshchenko/che-workspace-controller:local in my bashrc, so, not to conflict, I renamed IMG to DWO_IMG to use unique name for that parameter.
What issues does this PR fix or reference?
no issue is created
Is it tested? How?
unset IMG
make docker
...
 ---> Using cache
 ---> 28aface1225a
Successfully built 28aface1225a
Successfully tagged quay.io/devfile/devworkspace-controller:next
Are you sure we want to push quay.io/devfile/devworkspace-controller:next? [y/N] n
Makefile:286: recipe for target 'docker-push' failed
make: *** [docker-push] Error 1

/test v5-devworkspaces-operator-e2e

/retest

/test v5-devworkspaces-operator-e2e


Module Error

AttributeError: module 'httpcore' has no attribute 'NetworkBackend'

Are you deploying with docker?

l solved this error but. new error..
untimeError: Event loop is closed
Task was destroyed but it is pending!

Got same issue here:
Traceback (most recent call last):   File "/usr/local/lib/python3.9/runpy.py", line 188, in _run_module_as_main     mod_name, mod_spec, code = _get_module_details(mod_name, _Error)   File "/usr/local/lib/python3.9/runpy.py", line 147, in _get_module_details     return _get_module_details(pkg_main_name, error)   File "/usr/local/lib/python3.9/runpy.py", line 111, in _get_module_details     __import__(pkg_name)   File "/wbb/wbb/__init__.py", line 30, in <module>     from motor.motor_asyncio import AsyncIOMotorClient as MongoClient   File "/usr/local/lib/python3.9/site-packages/motor/motor_asyncio.py", line 18, in <module>     from . import core, motor_gridfs   File "/usr/local/lib/python3.9/site-packages/motor/core.py", line 21, in <module>     import pymongo   File "/usr/local/lib/python3.9/site-packages/pymongo/__init__.py", line 92, in <module>     from pymongo.mongo_client import MongoClient   File "/usr/local/lib/python3.9/site-packages/pymongo/mongo_client.py", line 66, in <module>     from pymongo import (   File "/usr/local/lib/python3.9/site-packages/pymongo/uri_parser.py", line 46, in <module>     from pymongo.srv_resolver import _HAVE_DNSPYTHON, _SrvResolver   File "/usr/local/lib/python3.9/site-packages/pymongo/srv_resolver.py", line 23, in <module>     from dns import resolver   File "/usr/local/lib/python3.9/site-packages/dns/resolver.py", line 30, in <module>     import dns._ddr   File "/usr/local/lib/python3.9/site-packages/dns/_ddr.py", line 12, in <module>     import dns.nameserver   File "/usr/local/lib/python3.9/site-packages/dns/nameserver.py", line 5, in <module>     import dns.asyncquery   File "/usr/local/lib/python3.9/site-packages/dns/asyncquery.py", line 38, in <module>     from dns.query import (   File "/usr/local/lib/python3.9/site-packages/dns/query.py", line 67, in <module>     _CoreNetworkBackend = httpcore.NetworkBackend AttributeError: module 'httpcore' has no attribute 'NetworkBackend'

Got same issue here: Traceback (most recent call last): File "/usr/local/lib/python3.9/runpy.py", line 188, in _run_module_as_main mod_name, mod_spec, code = _get_module_details(mod_name, _Error) File "/usr/local/lib/python3.9/runpy.py", line 147, in _get_module_details return _get_module_details(pkg_main_name, error) File "/usr/local/lib/python3.9/runpy.py", line 111, in _get_module_details __import__(pkg_name) File "/wbb/wbb/__init__.py", line 30, in <module> from motor.motor_asyncio import AsyncIOMotorClient as MongoClient File "/usr/local/lib/python3.9/site-packages/motor/motor_asyncio.py", line 18, in <module> from . import core, motor_gridfs File "/usr/local/lib/python3.9/site-packages/motor/core.py", line 21, in <module> import pymongo File "/usr/local/lib/python3.9/site-packages/pymongo/__init__.py", line 92, in <module> from pymongo.mongo_client import MongoClient File "/usr/local/lib/python3.9/site-packages/pymongo/mongo_client.py", line 66, in <module> from pymongo import ( File "/usr/local/lib/python3.9/site-packages/pymongo/uri_parser.py", line 46, in <module> from pymongo.srv_resolver import _HAVE_DNSPYTHON, _SrvResolver File "/usr/local/lib/python3.9/site-packages/pymongo/srv_resolver.py", line 23, in <module> from dns import resolver File "/usr/local/lib/python3.9/site-packages/dns/resolver.py", line 30, in <module> import dns._ddr File "/usr/local/lib/python3.9/site-packages/dns/_ddr.py", line 12, in <module> import dns.nameserver File "/usr/local/lib/python3.9/site-packages/dns/nameserver.py", line 5, in <module> import dns.asyncquery File "/usr/local/lib/python3.9/site-packages/dns/asyncquery.py", line 38, in <module> from dns.query import ( File "/usr/local/lib/python3.9/site-packages/dns/query.py", line 67, in <module> _CoreNetworkBackend = httpcore.NetworkBackend AttributeError: module 'httpcore' has no attribute 'NetworkBackend'

https://github.com/TheHamkerCat/WilliamButcherBot/pull/220/commits/f29daaf093e47e20ab00b274f1fcdd45c7926a54


Remove paywalled tutorial link for Storybook

Swapping out a paid Storybook video link for free text tutorials!

🎉

Whoops, didn't even notice this landed on the master branch by accident. Fixing ...

Ah, sorry about that, I meant to reopen this against next.  Apologies

It's fixed, thanks!


Fix missing extra input topics

pls add this to the atm fraud defaults under streams-app

this option should also be added, I've commented in https://github.com/bakdata/kpops/issues/194 as these seem related


Add sample pyuniprot data to include in testing

The test harness should also load the sample data using PyUniProt's population function so then the functionality of this library that depends on PyUniProt can be properly tested

cannot we just query with limit=N in tests?

@aramgrigoryan We're going to no use PyUniProt at all, if you still think that's possible.


Translate strings to spanish

Greetings. This pull request translates the application into Spanish for one of the few 3D model viewers.

Thank a lot for your translation @sguinetti 🥇
Kind regards


Usability update

@homu r+

:pushpin: Commit b6a7895 has been approved by smo-key

:hourglass: Testing commit b6a7895 with merge 338c1ed...

:sunny: Test successful - status


Youtube download fails for age restricted videos

Age restricted videos download fails with current code.
It is necessary to add cookies argument to ydl_opt:
ydl_opt = {'cookiefile': 'PATH_TO_COOKIES/cookies.txt',
                  'outtmpl':os.path.join(DOWNLOAD_DIR, '%(id)s.%(ext)s'),
                  'format': 'mp4'}

To get cookies file one can use cookies.txt extension in chrome
https://chrome.google.com/webstore/detail/cookiestxt/njabckikapfpffapmjgojcnbfjonfjfg
The following list of links are the ones that fails without cookies.
https://www.youtube.com/watch?v=DpQBo4gb6Lw
https://www.youtube.com/watch?v=xVfPBzDnI2Q
https://www.youtube.com/watch?v=UKBuDqU8qTM
https://www.youtube.com/watch?v=kld-iYpdjyo
https://www.youtube.com/watch?v=WWyeuvpHmfc
https://www.youtube.com/watch?v=yB6fjM1UUC0
https://www.youtube.com/watch?v=uO2zGO5ydBc
https://www.youtube.com/watch?v=DkjTJcCXipY
https://www.youtube.com/watch?v=ecRog9N1Qf0
https://www.youtube.com/watch?v=qYonJ4w6SZs
https://www.youtube.com/watch?v=Z9K13eBUwJM
https://www.youtube.com/watch?v=Hfs4AlBmg70
https://www.youtube.com/watch?v=88LcRU7uEFE
https://www.youtube.com/watch?v=GDejMONyY4U
https://www.youtube.com/watch?v=Jt6_hinpKpk
https://www.youtube.com/watch?v=oZaUkhs_H-s
https://www.youtube.com/watch?v=GJr8wKk8-YA
https://www.youtube.com/watch?v=e3hXj7S3QyA
https://www.youtube.com/watch?v=pQdl0apLT70
https://www.youtube.com/watch?v=5vKPYV5w6pw
https://www.youtube.com/watch?v=Eq7_uD2yN5Y
https://www.youtube.com/watch?v=RASKiMoxhOE
https://www.youtube.com/watch?v=d2SCftR5sWc
https://www.youtube.com/watch?v=bhA2ckvE-TQ
https://www.youtube.com/watch?v=kN-2mc561GY
https://www.youtube.com/watch?v=QeuzUfHIWYU
https://www.youtube.com/watch?v=krPRThe7R4g
https://www.youtube.com/watch?v=JV0D-YkWHD8
https://www.youtube.com/watch?v=CyeT8rEQOpQ
https://www.youtube.com/watch?v=fdvMUP8qvzw
https://www.youtube.com/watch?v=ezY7QrSWeWw
https://www.youtube.com/watch?v=DyzL2sahobA
https://www.youtube.com/watch?v=GdyJqgxlSxs
https://www.youtube.com/watch?v=K1r3m5OrmB4
https://www.youtube.com/watch?v=gDjeTHGWX9c
https://www.youtube.com/watch?v=IFhWIS-Gwps
https://www.youtube.com/watch?v=HeK6zbf8I9Y
https://www.youtube.com/watch?v=zRZ9PJguIfE

Hi @apbraga . Thank you for your contribution! I have merged your commit.

Happy to help! Great work putting the dataset together. 👍👍