Correcting customer_managed_key in variables.tf based on this documen…

…tation https://registry.terraform.io/providers/hashicorp/azurerm/latest/docs/resources/postgresql_flexible_server#customer_managed_key-1
Description
Solves  https://github.com/Azure/terraform-azurerm-avm-res-dbforpostgresql-flexibleserver/issues/21
In variables.tf variable customer_managed_key should be corrected so that it can match what the resource "azurerm_postgresql_flexible_server" "this" in main.tf is referencing to.
This should be the definition of customer_manged_key in variables.tf:

variable "customer_managed_key" {
type = object({
key_vault_key_id = string
geo_backup_key_vault_key_id = string
geo_backup_user_assigned_identity_id = optional(object({
resource_id = string
}), null)
primary_user_assigned_identity = optional(object({
resource_id = string
}), null)
#key_name = string
#key_version = optional(string, null)
})
default = null
description = <<DESCRIPTION

A map describing customer-managed keys to associate with the resource. This includes the following properties:

key_vault_key_id - (Required) The ID of the Key Vault Key..
geo_backup_key_vault_key_id - (Optional) The ID of the geo backup Key Vault Key
geo_backup_user_assigned_identity_id - (Optional) The geo backup user managed identity id for a Customer Managed Key. Should be added with identity_ids
primary_user_assigned_identity - (Optional) Specifies the primary user managed identity id for a Customer Managed Key. Should be added with identity_ids
DESCRIPTION
}

so that it can match this block in```

resource "azurerm_postgresql_flexible_server" "this":
dynamic "customer_managed_key" {
for_each = var.customer_managed_key == null ? [] : [var.customer_managed_key]

content {
  key_vault_key_id                     = customer_managed_key.value.key_vault_key_id
  geo_backup_key_vault_key_id          = customer_managed_key.value.geo_backup_key_vault_key_id
  geo_backup_user_assigned_identity_id = customer_managed_key.value.geo_backup_user_assigned_identity_id
  primary_user_assigned_identity_id    = customer_managed_key.value.primary_user_assigned_identity_id
}
}

Currently in variables.tf this is the configuration for customer_managed_key. This one should be corrected. Below is the current configuration:
variable "customer_managed_key" {
type = object({
key_vault_resource_id = string
key_name = string
key_version = optional(string, null)
user_assigned_identity = optional(object({
resource_id = string
}), null)
})
default = null
description = <<DESCRIPTION
A map describing customer-managed keys to associate with the resource. This includes the following properties:

key_vault_resource_id - The resource ID of the Key Vault where the key is stored.
key_name - The name of the key.
key_version - (Optional) The version of the key. If not specified, the latest version is used.
user_assigned_identity - (Optional) An object representing a user-assigned identity with the following properties:
resource_id - The resource ID of the user-assigned identity.

Type of Change

[ ] Non-module change (e.g. CI/CD, documentation, etc.)
[x ] Azure Verified Module updates:

[ ] Bugfix containing backwards compatible bug fixes

[x ] Someone has opened a bug report issue, and I have included "Closes #{bug_report_issue_number}" in the PR description.
[ ] The bug was found by the module author, and no one has opened an issue to report it yet.

[ ] Feature update backwards compatible feature updates.
[ ] Breaking changes.
[x ] Update to documentation

Checklist

[ x] I'm sure there are no other open Pull Requests for the same update/change
[ ] My corresponding pipelines / checks run clean and green without any errors or warnings
[ ] I did run all  pre-commit checks

(default - no company specified) I have sole ownership of intellectual
property rights to my Submissions and I am not making Submissions in the
course of work for my employer.

Am Di., 12. Nov. 2024 um 14:05 Uhr schrieb
microsoft-github-policy-service[bot] @.***>:

@nerisa1995 https://github.com/nerisa1995 please read the following
Contributor License Agreement(CLA). If you agree with the CLA, please reply
with the following information.
@microsoft-github-policy-service agree [company="{your company}"]
Options:

(default - no company specified) I have sole ownership of
intellectual property rights to my Submissions and I am not making
Submissions in the course of work for my employer.

@microsoft-github-policy-service agree

(when company given) I am making Submissions in the course of work
for my employer (or my employer has intellectual property rights in my
Submissions by contract or applicable law). I have permission from my
employer to make Submissions and enter into this Agreement on behalf of my
employer. By signing below, the defined term “You” includes me and my
employer.

@microsoft-github-policy-service agree company="Microsoft"
Contributor License Agreement Contribution License Agreement
This Contribution License Agreement (“Agreement”) is agreed to by the
party signing below (“You”),
and conveys certain license rights to Microsoft Corporation and its
affiliates (“Microsoft”) for Your
contributions to Microsoft open source projects. This Agreement is
effective as of the latest signature
date below.

Definitions.
“Code” means the computer software code, whether in human-readable
or machine-executable form,
that is delivered by You to Microsoft under this Agreement.
“Project” means any of the projects owned or managed by Microsoft
and offered under a license
approved by the Open Source Initiative (www.opensource.org).
“Submit” is the act of uploading, submitting, transmitting, or
distributing code or other content to any
Project, including but not limited to communication on electronic
mailing lists, source code control
systems, and issue tracking systems that are managed by, or on behalf
of, the Project for the purpose of
discussing and improving that Project, but excluding communication
that is conspicuously marked or
otherwise designated in writing by You as “Not a Submission.”
“Submission” means the Code and any other copyrightable material
Submitted by You, including any
associated comments and documentation.
Your Submission. You must agree to the terms of this Agreement
before making a Submission to any
Project. This Agreement covers any and all Submissions that You, now
or in the future (except as
described in Section 4 below), Submit to any Project.
Originality of Work. You represent that each of Your Submissions
is entirely Your original work.
Should You wish to Submit materials that are not Your original work,
You may Submit them separately
to the Project if You (a) retain all copyright and license information
that was in the materials as You
received them, (b) in the description accompanying Your Submission,
include the phrase “Submission
containing materials of a third party:” followed by the names of the
third party and any licenses or other
restrictions of which You are aware, and (c) follow any other
instructions in the Project’s written
guidelines concerning Submissions.
Your Employer. References to “employer” in this Agreement include
Your employer or anyone else
for whom You are acting in making Your Submission, e.g. as a
contractor, vendor, or agent. If Your
Submission is made in the course of Your work for an employer or Your
employer has intellectual
property rights in Your Submission by contract or applicable law, You
must secure permission from Your
employer to make the Submission before signing this Agreement. In that
case, the term “You” in this
Agreement will refer to You and the employer collectively. If You
change employers in the future and
desire to Submit additional Submissions for the new employer, then You
agree to sign a new Agreement
and secure permission from the new employer before Submitting those
Submissions.
Licenses.

Copyright License. You grant Microsoft, and those who receive the
Submission directly or
indirectly from Microsoft, a perpetual, worldwide, non-exclusive,
royalty-free, irrevocable license in the
Submission to reproduce, prepare derivative works of, publicly
display, publicly perform, and distribute
the Submission and such derivative works, and to sublicense any or all
of the foregoing rights to third
parties.
Patent License. You grant Microsoft, and those who receive the
Submission directly or
indirectly from Microsoft, a perpetual, worldwide, non-exclusive,
royalty-free, irrevocable license under
Your patent claims that are necessarily infringed by the Submission or
the combination of the
Submission with the Project to which it was Submitted to make, have
made, use, offer to sell, sell and
import or otherwise dispose of the Submission alone or with the
Project.
Other Rights Reserved. Each party reserves all rights not
expressly granted in this Agreement.
No additional licenses or rights whatsoever (including, without
limitation, any implied licenses) are
granted by implication, exhaustion, estoppel or otherwise.

Representations and Warranties. You represent that You are
legally entitled to grant the above
licenses. You represent that each of Your Submissions is entirely Your
original work (except as You may
have disclosed under Section 3). You represent that You have secured
permission from Your employer to
make the Submission in cases where Your Submission is made in the
course of Your work for Your
employer or Your employer has intellectual property rights in Your
Submission by contract or applicable
law. If You are signing this Agreement on behalf of Your employer, You
represent and warrant that You
have the necessary authority to bind the listed employer to the
obligations contained in this Agreement.
You are not expected to provide support for Your Submission, unless
You choose to do so. UNLESS
REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING, AND EXCEPT FOR THE
WARRANTIES
EXPRESSLY STATED IN SECTIONS 3, 4, AND 6, THE SUBMISSION PROVIDED
UNDER THIS AGREEMENT IS
PROVIDED WITHOUT WARRANTY OF ANY KIND, INCLUDING, BUT NOT LIMITED TO,
ANY WARRANTY OF
NONINFRINGEMENT, MERCHANTABILITY, OR FITNESS FOR A PARTICULAR PURPOSE.
Notice to Microsoft. You agree to notify Microsoft in writing of
any facts or circumstances of which
You later become aware that would make Your representations in this
Agreement inaccurate in any
respect.
Information about Submissions. You agree that contributions to
Projects and information about
contributions may be maintained indefinitely and disclosed publicly,
including Your name and other
information that You submit with Your Submission.
Governing Law/Jurisdiction. This Agreement is governed by the
laws of the State of Washington, and
the parties consent to exclusive jurisdiction and venue in the federal
courts sitting in King County,
Washington, unless no federal subject matter jurisdiction exists, in
which case the parties consent to
exclusive jurisdiction and venue in the Superior Court of King County,
Washington. The parties waive all
defenses of lack of personal jurisdiction and forum non-conveniens.
Entire Agreement/Assignment. This Agreement is the entire
agreement between the parties, and
supersedes any and all prior agreements, understandings or
communications, written or oral, between
the parties relating to the subject matter hereof. This Agreement may
be assigned by Microsoft.

—
Reply to this email directly, view it on GitHub
https://github.com/Azure/terraform-azurerm-avm-res-dbforpostgresql-flexibleserver/pull/24#issuecomment-2470481105,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ARLMOARYQHNFWEWK5UH5KKD2AH4KBAVCNFSM6AAAAABRUAPZ2GVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINZQGQ4DCMJQGU
.
You are receiving this because you were mentioned.Message ID:
<Azure/terraform-azurerm-avm-res-dbforpostgresql-flexibleserver/pull/24/c2470481105
@github.com>

Good Day!
Should the parameter  geo_backup_key_vault_key_id = string not be optional? In order to reflect the resource block as per documentation?
    geo_backup_key_vault_key_id = optional(string)

In addition perhaps there is no need for object variables for the resource id. That seems to follow the initial code which does not currently work. I've created a similar PR for MySQL Flexible Server AVM.
`variable "customer_managed_key" {
type = object({
key_vault_key_id = string
geo_backup_key_vault_key_id = optional(string)
geo_backup_user_assigned_identity_id = optional(string)
primary_user_assigned_identity_id = optional(string)
})
default     = null
description = <<DESCRIPTION
A map describing customer-managed keys to associate with the resource. This includes the following properties:

key_vault_key_id - (Required) The ID of the Key Vault Key..
geo_backup_key_vault_key_id - (Optional) The ID of the geo backup Key Vault Key
geo_backup_user_assigned_identity_id - (Optional) The geo backup user managed identity id for a Customer Managed Key. Should be added with identity_ids
primary_user_assigned_identity_id - (Optional) Specifies the primary user managed identity id for a Customer Managed Key. Should be added with identity_ids
DESCRIPTION
}`

Thank you @nerisa1995 and @theccz, this has been taken care by the following PR so correspondingly closing this one
https://github.com/Azure/terraform-azurerm-avm-res-dbforpostgresql-flexibleserver/pull/29


Fix fee validation in publisher and clarify publish docstring

There was a bug in publisher  which made it not accept Fee dict strucutre without addresses in them.
Also clarified publish docstring what fee dict would look like.

          1 Error

:no_entry_sign:
Please include a CHANGELOG entry.

          1 Message

:book:
See http://keepachangelog.com/en/0.3.0/ for details on good changelog guidelines

  Generated by :no_entry_sign: Danger


Update to Bevy 0.11

This PR updates bevy-fast-tilemap to Bevy 0.11.
The main changes (besides applying rustfmt and cargo clippy suggestions) are the usage of add_plugins(...) and add_systems(...) everywhere as the old add_plugin(...) and add_system(...) functions have been deprecated. A few other changes were needed, such as:

Add the finish(...) function to FastTileMapPlugin and move the render pipeline configuration there
Derive Event for Bevy events
Update dependencies to only use the required features
Update shader to remove unused imports and explicitly specify imported types and functions
Update examples/layers.rs to include usage of the new build_and_set() function

Tested all examples and they seem to work as expected.

Hey @msklosak thanks for your contribution :-) Looks really good to me. Seems a side-effect of the new bevy is that winit now doesn't compile anymore for pure linux targets but I personally can live with that.


draft: Add Notifications as a static plugin

Description
Draft for debugging only.
Adds the Notifications plugins as static ones.

/hold

There is no more need for this, closing


fabric8 console hangs

I have tried installing using gofabric8 several times and many different way the last couple of days without success. When I don't use the --pv=false flag the gogs and nexus pods never starts.
Using --pv=false makes all the pods start up correctly but I can not get the fabric8 console started.
I am using kubernetes, not openshift. To remove any mistake by me during installation of kubernets I used Google Container Engine to create a container cluster. I used machines with 4vCPU and 15GB memory.
I just tried using gofabric8 version 0.4.66
I have go version 1.6.3
After installing fabric8 using

gofabric8 deploy --pv=false

and verifying that all pods have started I browse to the console. I have to enter username and password which I get from the google console. Then the fabric8 console starts loading, but it seems to hang. I see the top menu (fabric8 and teams), but the left menu remains empty and the page itself just displays a little circle spinning around. It has done so for an hour now.
Please help me solve this.

@chbe8475 can you tell us a little more about your setup please?  Before you used GKE what were you using?
There's a few different ways to access the console depending on whether you're running locally with minikube, on your own cluster using your own router or the fabric8 ingress controller (this gets  automatically deployed during gofabric8 deploy if running on a cluster).  FWIW we have a blog explaining these options a bit better here
fabric8 does its best to figure out the external URL for apps running on the different permutations.  It does this by running the exposecontroller pod which watches kubernetes services and adds an annotatation of fabric8.io/exposeUrl that should contain the url you can access each service on using
gofabric8 service [service name]

So the places to start looking are:

did the gofabric8 deploy command finish successfully?
if running on a cluster do you have a wildcard DNS pointing to the external IP that the nginx-ingress controller pod has been deployed on?  The node name that the pod is running on should have been printed in the summary of gofabric8 deploy
is the exposecontroller pod running
does the fabric8 service have the fabric8.io/exposeUrl annotation
does the exposecontroller pod have any errors kubectl logs exposecontroller-xxxx

These steps will help start to investigate whats going on, let us know what the outcome is please.

gofabric8 deploy` finished succesfully
Actually my cluster is only one server, the master node, so that should not be any problems. Or am I wrong?
kubectl get pods says the following about the exposecontroller
exposecontroller-4135967088-pgbb3         1/1       Running   0          1h
How do I find this?
No errors, only Info.

However, I see now that the kubectl get service fabric8 ends with

1h		3s		35	{service-controller }			WarningCreatingLoadBalancerFailed	Error creating load balancer (will retry): Failed to create load balancer for service default/fabric8: failed to create target pool ae386773c7a4911e6b44742010a80018: googleapi: Error 403: Quota 'TARGET_POOLS' exceeded. Limit: 50.0, quotaExceeded

I will look at that and make sure I got enough target pools.

RE: the exceeded quotas on GKE - we've seen this and have an FAQ on it http://fabric8.io/guide/getStarted/gke.html#google-container-engine-quotas we are moving away from the loadbalancer type in favour of ingress as that blog above describes.
We've still left the   type: LoadBalancer on services whilst we properly move to using Ingress.  Do you have a wildcard DNS setup?  If you do, you could try to replace   type: LoadBalancer with     type: ClusterIP and remove the NodePort if one exists.
kubectl edit svc fabric8

You can see the ingress routes created by running
kubectl get ing

This should show the URL including your wildcard DNS domain provided you ran gofabric8 deploy --domain your.domain.io

Actually my cluster is only one server, the master node, so that should not be any problems. Or am I wrong?

Ok so on your one node cluster (I'm assuming that's not the GKE instance), if you dont have a wildcard DNS setup so unable to use the NGINX ingress router,  then you can use NodePort but this is not recommended in clusters of more that one node.
To do this we can edit the exposecontroller config map
kubectl edit configmap exposecontroller

replace the expose-rule: foo with expose-rule: node-port and delete the exposecontroller pod so that it recreates the exposeURL on each service.  You should then be able to run
gofabric8 service fabric8

And this will now use the node port.

How do I find this?
You can run

kubectl get svc fabric8 -o=yaml

No errors, only Info.
Thats good

I might have confused you :-)
I did not use the domain flag, so I am using the default vagrant.f8 domain. I have set up a wildcard DNS for vagrant.f8 locally on my ubuntu. I have created a one node cluster in GKE onto which I have deployed fabric8 from my local ubuntu desktop.
I tried to replace the LoadBalancer with ClusterIP but then I could not reach the console at all.

It turns out I had messed up my wildcard DNS. I set it to the kubernetes cluster server, not the node on which the ingress controller was running. I found that ip address by typing kubectl describe node "node-name"
I have now got fabric8 up and running.

@chbe8475 that's great news! phew :)
I think we can do better at helping people figure out whats going on and this issue has helped figure out what steps we can ask and hopefully automate with a gofabric8 diagnose command
https://github.com/fabric8io/gofabric8/issues/166

Hi,
I am trying to setup fabric8 on a one node k8 cluster. After executing the command gofabric8 deploy --domain=devops.xyz  --namespace=kube-system the console hangs.
Below us my pod setup:
fabric8-system   ingress-nginx-2447702149-3dwmw            1/1       Running   0          8m
kube-system      configmapcontroller-4273343753-kh054      1/1       Running   0          8m
kube-system      etcd-ubuntu                               1/1       Running   3          1d
kube-system      exposecontroller-3484910906-f3rxq         1/1       Running   2          8m
kube-system      fabric8-3715037739-trc7m                  2/2       Running   0          8m
kube-system      fabric8-docker-registry-125311296-dqblb   1/1       Running   0          8m
kube-system      fabric8-forge-1088523184-j1lkb            1/1       Running   0          8m
kube-system      gogs-3561158243-zkmtd                     1/1       Running   0          8m
kube-system      jenkins-56914896-1vjkm                    1/1       Running   0          8m
kube-system      kube-apiserver-ubuntu                     1/1       Running   3          1d
kube-system      kube-controller-manager-ubuntu            1/1       Running   3          1d
kube-system      kube-dns-692378583-33nvt                  3/3       Running   9          1d
kube-system      kube-proxy-xg45z                          1/1       Running   3          1d
kube-system      kube-scheduler-ubuntu                     1/1       Running   3          1d
kube-system      nexus-2230784709-pzwp1                    1/1       Running   0          8m
kube-system      weave-cortex-agent-2343136017-2b5j5       1/1       Running   3          1d
kube-system      weave-cortex-node-exporter-8t4gc          1/1       Running   3          1d
kube-system      weave-flux-agent-3149276939-c84js         1/1       Running   3          1d
kube-system      weave-net-6x3f3                           2/2       Running   10         1d
kube-system      weave-scope-agent-sfthz                   1/1       Running   3          1d

And as per above output everything is working fine.
Would you please suggest where can be the problem?

@noorulhaq  i also faced it , Have you solved it?


Update pages-data-merge to latest

After making all changes to the cask:

[x] brew cask audit --download {{cask_file}} is error-free.
[x] brew cask style --fix {{cask_file}} left no offenses.
[x] The commit message includes the cask’s name and version.

since the .app location changed (it was moved into a subdirectory), this cask can not be installed wo those changes.


Parametrics updates from EPRI CRADA work

When filtering columns, the graphs clear and attempt to update based on filtered value. Graphs should not be affected by how the list is filtered.
I'm not sure we need both the right-click column fill functions and Quick Setup. The fill functions seem to replicate the functionality of Quick Setup. I would recommend limiting the right-click shortcut functions to filtering and sorting the table, and adding any functions for filling tables to Quick Setup.
There are some issues with how the fill functions work:

Fill functions seem to work only after clicking another column in the table. I would expect them to work after clicking the command in the shortcut window.

After using the Fill Down Sequence option, when I type a value in the column it automatically changes. I expect fill functions to stop after I leave the shortcut menu.

"Fill down evenly" is not clear: Does it fill cells between the first and last rows?


#39 Uncaught Exception in yaml

Description
closes #39 Uncaught Exception in yaml

Processing this pull request

Processing this pull request

Merged into branches master, iso6 in a811c279513578b7cba93010fa121497800b2f40


[ci:component:github.com/gardener/logging:v0.49.0->v0.50.0]

Release Notes:
Build an image containing the bare minimum of libs for `tunef2s` to work alongside `lsblk` and `awk`.

/kind enhancement
/cc @vlvasilev @Kristian-ZH


Fixes broken template (capitalisation of the NamingPrefix value leads to rollback)

Issue #, if available:
Description of changes:
The current template won't build. It will fail to build DB1Cluster and then do a rollback because it cannot find "WebApp1-dbsubnetgroupwp".
The reason for this seems to be that (despite the capitalisation in the parameter) DB1SubnetGroup gets created with an all lower case DBSubnetGroupName. This issue has been mentioned in a few places, e.g.: https://forums.aws.amazon.com/thread.jspa?threadID=280574 and  https://www.reddit.com/r/aws/comments/8v8dmj/workaround_for_cloudformations_inability_to_find/
This PR fixes the Lab template by simply changing NamingPrefix default value to be all lower case.
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Thank you @mlauritzen  resolved in https://github.com/awslabs/aws-well-architected-labs/commit/ce992527cd15740e2e534e9f9ff6e18665893b81
Unfortunately due to camelcase being nice to read and desirable, and RDS subnet groups not supporting the workaround is to hard name the subnet group.


Fixed a few spelling errors

:+1:

:+1:

Thank you for your contribution. It's now live as AutoFixture 3.23.1.


--fp16 utlizes significantly higher memory and results in OOM

What is your question?
fp16 seems to take up  >2x memory on GPU compared to fp32. I have been under the assumption that fp16 in addition to be faster is more memory optimized as well. using --memory-efficient-fp16 does reduce memory optimization (slightly) to less than fp32. I'm using the wav2vec 2.0 examples
What have you tried?
Pytorch 1.6.0, Pytorch 1.7.0 prebuilt wheels with support for CUDA 10.2
Pytorch 1.7.0 prebuilt wheel with support for CUDA 11.0
Pytorch 1.7.0 from source with support for CUDA Compute 3.5
What's your environment?

fairseq Version: commit 108f7204f6ccddb676e6d52006da219ce96a02dc
PyTorch Version: 1.7.0
OS: Ubuntu 20.04
How you installed fairseq : source
Build command you used (if compiling from source): pip install -e .
Python version: 3.8.5
CUDA/cuDNN version: 11.0/<IP_ADDRESS>-1 (same issue with CUDA 10.2 and cuDNN 7.6.5)
GPU models and configuration: RTX 2070 Super, Tesla K40 (pytorch 1.7.0 was compiled with support for sm3.5)
Any other relevant information:
https://github.com/huggingface/transformers/issues/8403 -- seems to indicate issues exist with pytorch versions 1.6 and later (likely due to native AMP)
https://discuss.pytorch.org/t/fp16-training-with-feedforward-network-slower-time-and-no-memory-reduction/95560

I notice that memory usage grows whenever overflow is detected and loss scale is changed. This could just be a coincidence though.

Just fyi: Nvidia doc was written that mixed precision training requires Volta or Turing architecture. So i dont think K40 supports FP16, but RTX2070 Super should support that.

I'm aware that K40 does not support FP16, but AFAIK one can still do fp16 on non supported architectures/devices with no real performance benefit (it may even be slower like 10 series GPUs).  The issue I'm raising has to  do with increased memory utilization with --fp16 enabled.

--fp16 enables mixed precision training, where we maintain both an FP16 and FP32 copy of the model weights (the latter is used in the optimizer), and all activations/gradients are stored in FP16.
Thus you will see increased memory usage from model weights (1.5x larger than FP32 alone), but less memory usage from the forward/backward pass activations/gradients.
--memory-efficient-fp16 gets rid of the FP32 model copy and only maintains FP32 momentum in the optimizer. Thus you'll see 0.5x memory usage from the model weights, 0.5x memory usage in the forward/backward, and 1.0x memory usage in the optimizer (relative to FP32).

--fp16 enables mixed precision training, where we maintain both an FP16 and FP32 copy of the model weights (the latter is used in the optimizer), and all activations/gradients are stored in FP16.
Thus you will see increased memory usage from model weights (1.5x larger than FP32 alone), but less memory usage from the forward/backward pass activations/gradients.
--memory-efficient-fp16 gets rid of the FP32 model copy and only maintains FP32 momentum in the optimizer. Thus you'll see 0.5x memory usage from the model weights, 0.5x memory usage in the forward/backward, and 1.0x memory usage in the optimizer (relative to FP32).

This sounds amazing for --memory-efficient-fp16 argument, but how would i do that if i do not not load from command line but using these lines
from fairseq.models.transformer import TransformerModel
de2en = TransformerModel.from_pretrained(.....)
de2en.half()

I use half to make it fp16 do not know how to make it --memory-efficient-fp16


Webpack support.

If I use webpack there is issue with templates loading.
to make component usable I have to copy templates (in case of bootstrap module it is dynamic-form-bootstrap.component.html) to the root of my application.
Webpack use require statement to load templates and only in this case it parses such files.
Request: make plugin flexible and works both with systemjs like now and allow to use it with webpack.

Thanks for your request. Will try to take care of this as soon as possible!

Will be fixed in beta.3 via inline templates


Misleading non persistent message in instantiate message

Description
"Non-persistent disk. The changes will be lost once the VM is shut down"
should read
"Non-persistent disk. The changes will be lost once the VM is terminated (ie changes to DONE state)"
Progress Status

[ ] Branch created
[ ] Code committed to development branch
[ ] Testing - QA
[ ] Documentation
[ ] Release notes - resolved issues, compatibility, known issues
[ ] Code committed to upstream release/hotfix branches
[ ] Documentation committed to upstream release/hotfix branches

Code and documentation updated (see commits above)
No test needed.


Design the app #18

Design #18| Designing the layout of the app. The goal of this ticket is to enhance the user experience by creating a visually appealing and user-friendly interface. Most changes are done on the CSS File to style the component. An image of the HTML logo was added, and the colour can be easily changed for future themes.

Thank you for the feedback.  I applied the changes ✨. Let me know if there's anything else or if there's anything I can do to improve.

Thanks for contributing to the project 🥳


upgraded to next SNAPSHOT

jenkins retest this.

Jenkins retest this please

jenkins retest this.

jenkins retest this.

ok all merged/deployed now, so one more time. please jenkins retest this.

+1


Dynamic product group difficulties with "AND" queries

Description:
It has been noticed that several "And" queries in a dynamic product group can lead to errors. No results are then displayed, or the second query is simply ignored. This occurs, for example, when filtering on a category. Rule 1 -> Category is one of. Rule 2 in a dynamic product group, "Price/strike price" is greater than 0. This product group now summarises all strike prices from a category. However, this is only possible if the products have been manually added to the category and have yet to be added dynamically.

[public] Shopware automated response: This issue is linked to the internal issue: NEXT-31760
[created from NEXT-31760, comment 514434]


Bower/Wiredep need "main" in bower.json

Hello and thanks for this project!
I work on an app that's still using Bower/Wiredep to inject JS/CSS into projects. Right now I'm getting this error:

Running "wiredep:app" (wiredep) task
simplebar was not injected in your file.
Please go take a look in "<PROJECT_PATH>/bower_components/simplebar" for the file you need, then manually include it in your file.

I did some research and it seems like simplebar needs this in the .bower.json:
"main": [
  "dist/simplebar.js",
  "dist/simplebar.css"
],

https://github.com/bower/spec/blob/master/json.md#main
I was going to file a PR to add this, but I couldn't figure out how the .bower.json was getting generated. If you're still interested in supporting Bower and could give me a tip, I'd be glad to file that PR.
Thanks!

Hey!
So Simplebar doesn't do anything specific regarding Bower. I didn't even know it was on Bower! It's probably from a very old version.
If you can use npm, I think I would prefer to unregister Simplebar from Bower instead of supporting it, except if it's blocking for anyone.
What blocks you from importing it from npm instead of Bower?

Yeah, I've realized Wiredep is unmaintained and Bower is on the ropes. I had been using Wiredep to auto-inject dependencies, but realized it was pulling in unused code - so I'm removing it from my project anyway.
Will use npm, thanks for looking in to it!


some JS build needs private artifactory

@chrischrischris @auniverseaway for node modules, we can't do a build without VPN
14256 verbose stack FetchError: request to<EMAIL_ADDRESS>failed, reason: unable to get local issuer certificate
i guess this is something we should fix :-)
to reproduce,

get out of the VPN,
rm ~/.m2/repository/com/adobe/dx
mvn

i guess if people outside of the VPN want to build our stuff, we need this fixed


#192 fix - splited the description

TODOs:

Delete irrelevant notes after confirmation
Add documentation to functions and additions
Delete  spaces ?

Please note:

Most of the additions are marked with a note like:
Addition required for description splitting (Omer)

Still need to delete comments, notes and irrelevant parts.
I want to fix around my code a little for readability and add documentation.
Just waiting for confirmation.
@galraij Should we keep adding the rest of the csv fields?

Ideally we would want our database to be identical to the CSV we get from the LAMAS to allow advanced searched in the future. This is also standing with the open data principle that we try to stick to and let people get through the DOWNLOAD CSV option the closest possible file to the source one (we cannot give the actual source file).
Also- there are two other files that contains info about the accidents that one day we will incorporate as well: one that contains info about the injured (group age, driver/passenger, etc) and one about the vehicles (motorcycle, truck, etc). I don't know if this should be incorporated to the same database or to another one... I guess you would know better.
ב-12 במאי 2015, בשעה 12:59, omerxx<EMAIL_ADDRESS>כתב/ה:

Still need to delete comments, notes and irrelevant parts.
I want to fix around my code a little for readability and add documentation.
Just waiting for confirmation.
@galraij Should we keep adding the rest of the csv fields?
—
Reply to this email directly or view it on GitHub.

Adding to what @galraij said, I think we should add the fields gradually, first taking the easiest and most important ones. It's better than trying do take them all at once and delaying it because it's harder.
@omerxx, you should update your branch before we can merge the pull request.
If you don't have an upstream remote yet, add it like this:
git remote add upstream https://github.com/hasadna/anyway

Then pull the changes to your local branch:
git pull --rebase upstream master

After resolving any resulting conflicts (follow the instructions that appear on the screen), push again to update your pull request:
git push -f

Once @danielhers approves this I'll move on to the rest of the data.
@galraij  regarding the injured and vehicles involved - I guess this should be presented in another dialog box which will be optional as a link from the marker.. this is a new project I don't mind starting to collect this data too

@danielhers
Using the green to arrow in pyCharm to update and then committing the changes is not enough?
Can I simply fork again and then push my project again from the local copy?

The green arrow sends your commits to your fork. The blue one updates your local clone from your fork, but not from upstream. To update from upstream, use the command I showed.
You do not need to fork again.

Not sure why do I have so many commits (?) or where did half the conversation go..
I've pushed what I've done so far but it can't be merged yet because it only shows Integers and some of the addreses.
I need to find a solution to the client side interpetation

Your rebase didn't go well.
You can try to do:
git reset --hard upstream/master
git cherry-pick 01f8a04

As for client side interpretation, as I said, I think you need to take localization.py and "translate" it to JS.

I'll start translating this to json and have marker.js pull the data from the new localization file.
I guess when that's done, we'd have to remove localization.py and all relevant calls and imports

Right, I think so too.
On Thu, May 14, 2015 at 12:34 PM omerxx<EMAIL_ADDRESS>wrote:

I'll start translating this to json and have marker.js pull the data from
the new localization file.
I guess when that's done, we'd have to remove localization.py and all
relevant calls and imports
—
Reply to this email directly or view it on GitHub
https://github.com/hasadna/anyway/pull/250#issuecomment-101984235.

I have the JSON and JS addition ready, but when trying to run it locally I get a 404 not found for the new JSON file I've added.
Any ideas?
snapshot attached

I have the JSON and JS addition ready. Trying to test it locally I get a 404 file not found for the JSON
In the js I'm calling the json file straight forward: $.getJSON('../localize.json', function(data) ...

Right, it would load on the client unless you add it to the assets... see here: https://github.com/hasadna/anyway/blob/master/templates/index.html#L299
I suppose you could just make it a normal js file with the definitions of the variables, add it to the assets and simple use the variables.

I already have this as a JSON. can a json file get loaded to the assets too?

I don't see why not. I think you can just add it and use the variables from it.

Don't know, changing the assets don't play well with my new file..
I'll try something else

Yeah, so you'll just need to add to the beginning of the file something
like localization =, for it to be a valid js assignment.
On Fri, May 15, 2015 at 5:14 PM omerxx<EMAIL_ADDRESS>wrote:

Don't know, changing the assets don't play well with my new file..
I'll try something else
[image: image]
https://cloud.githubusercontent.com/assets/12237955/7654446/d2cf4624-fb25-11e4-9a66-eb430825f09e.png
—
Reply to this email directly or view it on GitHub
https://github.com/hasadna/anyway/pull/250#issuecomment-102410424.

JSON don't allow identifiers other than it's own syntax
I can merge it into marker.js body. it won't be the most elegant solution but it'll do the job..

@danielhers  I've pushed my fix.
Please let me know if it's okay

Why not just make it a separate js file?
On May 15, 2015 5:29 PM, "omerxx"<EMAIL_ADDRESS>wrote:

JSON don't allow identifiers other than it's own syntax
I can merge it into marker.js body. it won't be the most elegant solution
but it'll do the job..
—
Reply to this email directly or view it on GitHub
https://github.com/hasadna/anyway/pull/250#issuecomment-102414344.

@danielhers  I've followed every step you mentioned.
Eventually after loosing track over the many changes done in the meantime I was working I've decided to delete my fork and reimplement the changes.
I've git pull --rebase upstream master as required before, making sure I'm up to date.
Once done, I've committed my changes and pushed them.
Yet, my fork shows some 433 commits..
I've pushed my fix a couple of minutes ago. If it's okay then you can pull it.
If not and I should do something else let me know what it is.


Recompute metrics branch

Due to the fix in PR #184, some metrics need to be recomputed.
Affected metrics are:

ARI
NMI
isolated labels

Still having issues with the actual execution of the pipeline...

pipeline is now working in dryrun and on dummy dataset

A few questions:

Do we really want to merge this, or just use this branch to recompute the metrics? It seems this is otherwise just quite a specific case that is then built into our metrics script and function.
Where is the output stored? It would be good if we can replace the metrics.csv output to include the new outputs from this run. That will probably not be possible via Snakemake as another rule already has metrics.csv as an output.

I agree that we probably don't want this merged in master
The output will be in a separate file called metrics_recomp.csv. We can then impute these scores into a copy of the old metrics.csv before plotting

That sounds good to me. I would ideally like to have all the individual metrics.csv results updated as well though (post-processing?) so we don't store incorrect benchmarking information. Could you make another script for that? We can then just run update_timestamp.py afterwards on everything.

@danielStrobl Could you rerun from this branch?

That sounds good to me. I would ideally like to have all the individual metrics.csv results updated as well though (post-processing?) so we don't store incorrect benchmarking information. Could you make another script for that? We can then just run update_timestamp.py afterwards on everything.

This hack only changes the time of the metrics computation, not the integration. Do we time the metrics as well?

This hack only changes the time of the metrics computation, not the integration. Do we time the metrics as well?

The script (aka "hack" ^^) just updates the timestamp of all files involved in the snakemake pipeline... preprocessed files, integration outputs, and metrics runs. So it should still work.

Oh, I meant the clustering  recompilation hack... It shouldn't affect the timing of integration and metrics are not timed afaik?
I think it is useful to update the old metrics script, but it doesn't have to be part of the pipeline.

I think we're talking about different things here... maybe we can quickly discuss this f2f? Or via chat ;).

Didn't want to change my working branch as there's still stuff running from
that. But I'll also add it to master
On Wed, 11 Nov 2020, 19:09 MalteDLuecken<EMAIL_ADDRESS>wrote:

@danielStrobl https://github.com/danielStrobl Are you sure you wanted
to commit an updated viz notebook to a branch we will not merge?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/theislab/scib/pull/185#issuecomment-725577813, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AMEEABT7LN7QUMJGRWIF3JDSPLHOBANCNFSM4SEOOQ5A
.

@danielStrobl @mumichae is there anything in here worth adding to the main repo or scib-pipeline? I imagine recomputing a single metric or a subset of metrics is not a bad function to have in general.

@danielStrobl @mumichae is there anything in here worth adding to the main repo or scib-pipeline? I imagine recomputing a single metric or a subset of metrics is not a bad function to have in general.

I agree, that might be a nice feature  to add to the pipeline

I agree, that might be a nice feature  to add to the pipeline

I think in general having a snakemake rule where the user can define outputs themselves is maybe not a bad idea... I'm not sure I would integrate it with the rest of the pipeline though. Then we could just have a different output filename?

I think in general having a snakemake rule where the user can define outputs themselves is maybe not a bad idea... I'm not sure I would integrate it with the rest of the pipeline though. Then we could just have a different output filename?


Fix building v1.0.4 with RTOS and without manual protection

Hi! When I updated the library to version v1.0.4, my project began to build with errors...
In my project the library is built with options
LWPRINTF_CFG_OS=1
LWPRINTF_CFG_OS_MANUAL_PROTECT=0

The problem turned out to be just a typo in code

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Thanks. I will release v1.0.5.


App does not compile after upgrade to 1.17:  isInitialRoute has been removed from RouteSettings

After upgrading my application to 1.17, I noticed that the isInitialRoute property has been removed from the RouteSettings class;
After investigation, I've seen that it has been removed in a commit in February:
https://github.com/flutter/flutter/commit/52a53119242554e6646501b7707cb9e9cb246593#comments
Is there any reasons for removing this ? My app is currently breaking right now because of that. Also, if we were using this before and it is now deprecated, how are we supposed to reproduce the same behaviour in our app ?
Thank you very much

For anyone looking for an explanation to this, I found this myself: https://flutter.dev/docs/release/breaking-changes/route-navigator-refactoring


Update free-programming-books.md

Added my free eBook under the Angular.js section.

Please add the author name!

I have added the author name.

Thanks for making you book free! If it has an Open License, consider adding it to Unglue.it and Archive.org.


Export report with image

Hi,
How to export the PoC with image? Or I need to do it manually?

unstale


Investigate why CI on academy repo uses local node address by default

https://github.com/valory-xyz/agent-academy-4/actions/runs/3058912313/jobs/4935800044

I'm still not sure why it was using the local node address by default, but I've updated the framework to use the node addressed explicitly specified by the user and if not the remote node address only.
https://github.com/valory-xyz/open-aea/pull/329

https://github.com/valory-xyz/open-aea/pull/329#discussion_r973985621


No issue just a question.

Hello,
first of all thanks for sharing your AStar implementation on github. Can you answer me why you also have a
IList Incoming { get; }
in your INode interface, maybe i missing something in the Code?
From your implementation of the AStar i see you only use the Outgoing List for the algorithm, which is self explained.

Hey,
Good observation. the incoming list is not used when calculating the path. But it makes it a lot easier to increase the traversal time to reach a specific node. Otherwise you would need another lookup structure to find all edges going to a specific node.
I guess this technically means that it doesn't have to be part of the INode interface! (I could leave it on the concrete Node class that implements INode. Which I didn't realize before.

I'll keep this question open for now, to potentially address it in potential v4, as its a breaking change to remove these members.

Yeah that's fine, i will use your implementations in a different way for my Grid. The MinHeap is really nice :)


Japanese Specs Localized

Japanese   NumberWith

DimensionModel | added: 0 | notapplicable: 3
TemperatureModel | added: 0 | notapplicable: 8
Japanese Datetime

DatePeriodExtractor | added: 0 | not applicable: 6
DateTimeExtractor | added: 0 | not applicable: 2
DateTimeModel | added: 0 | not applicable: 4
DateTimePeriodExtractor | added: 0 | not applicable: 2
DateTimePeriodParser | added: 0 | not applicable: 2
DurationExtractor | added: 0 | not applicable: 0
DurationParser | added: 0 | not applicable: 0
HolidayExtractor | added: 0 | not applicable: 0
HolidayParser | added: 0 | not applicable: 0
DateExtractor | added: 0 | corrected: 31
DateParser | added: 0 | corrected: 63
DatePeriodParser | added: 0 | corrected: 6
DateTimeParser | added: 0 | corrected: 36

More stats to be added about newly added cases with the implementation of the relevant types


Update version: CertifyTheWeb.CertifySSLManager version 6.0.0

Pull request has been created with Komac v1.6.0 :rocket:
Microsoft Reviewers: Open in CodeFlow

Thanks @mdanish-kh we'll look into it.


How to add gradient color through html like the way we add color ?? ()

i want something like this for gradient color.

i want something like this for gradient color.

.


Compatibility with Homer2

The Homer2 user guide states that the following fields in the NIRS format need to be present as a minimum requirement:  SD, d, t, s, ml, and aux (Page 4 in the Homer2 user guide).
The lumomat NIRS output currently does not support the outputs of aux and s in the case of no event markers.

Here I get s but not aux, so this may have changed slightly

@nidadu could you take @Giuseppe-1993 through this with the aim of getting a PR together?

Fixed in #58, released in v1.9.0.


⚠ Text Filter API Endpoint has degraded performance

In a84ba9e, Text Filter API Endpoint (http://textfilter.roblox.com/) experienced degraded performance:

HTTP code: 200
Response time: 3031 ms

Resolved: Text Filter API Endpoint performance has improved in 85df55c.


Stub domains sample is missing server key

The sample yaml for Stub Domains should look as follows:
apiVersion: v1
kind: ConfigMap
metadata:
  name: coredns-custom
  namespace: kube-system
data:
  test.server: |
    abc.com:53 {
        errors
        cache 30
        proxy . <IP_ADDRESS>
    }
    my.cluster.local:53 {
        errors
        cache 30
        proxy . <IP_ADDRESS>
    }

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 2f95537e-770a-739c-0175-4447a995f8b2
Version Independent ID: 6c9a1132-05af-70f1-5a2b-8dad56de9cc3
Content: Customize CoreDNS for Azure Kubernetes Service (AKS)
Content Source: articles/aks/coredns-custom.md
Service: container-service
GitHub Login: @jnoller
Microsoft Alias: jnoller

Thanks for the feedback! We are currently investigating and will update you shortly.

@logankp I am assigning this to the content author to review and update as needed.
@jnoller can you take a look?
CC @iainfoulds

This doc update has been made in a separate PR and changes are live.
@MicahMcKittrick-MSFT @Karishma-Tiwari-MSFT #please-close


Batch aliases

This PR adds aliases for batch operations to improve discoverability. While it's nice we have the overloaded get, put, and delete operations, it's not immediately obvious that it performs a batch operation to consumers.

IMO we should pick one or the other. A single method that does both, or two different methods. Meaning that we remove the ability to pass in an array into get or delete.

I think that's fair. IMO separate methods is more clear, discoverable, and more closely matches the actual DynamoDB API. Obviously, Faceteer exists to abstract away some of the details of Dynamo, but the combination of single operations and batch operations hides the fact that these work quite differently under the hood.
For instance, I wouldn't suspect that
await PostFacet.put([{ id: '1' }, { id: '2' }]);

and
await Promise.all([PostFacet.put({ id: '1' }), PostFacet.put({ id: '2' })])

are any different in execution. I would assume the former just implements the latter as a convenience.

@bill-kerr That makes sense.
Should we stick with the batch naming convention? On one hand it matches DynamoDB better, but the way Faceteer does batch updates is slightly different.
Dynamo DB only lets you put 25 items in a batch at once, but faceteer handles that for you and splits items across multiple batch requests as needed. So one batch faceteer call could call several Dynamo DB calls.

@bill-kerr That makes sense.
Should we stick with the batch naming convention? On one hand it matches DynamoDB better, but the way Faceteer does batch updates is slightly different.
Dynamo DB only lets you put 25 items in a batch at once, but faceteer handles that for you and splits items across multiple batch requests as needed. So one batch faceteer call could call several Dynamo DB calls.

That's true. I'm ok with calling it putMany or putBatch or something else--and we'll just make the documentation clearly state that it is performing a batch operation and, if necessary, batching the batches for us.


Add a simple text to a simple file

Description of the new feature / enhancement
Enter a text string creates a text file and happen the entered input in it.
Similar to:

mimic echo command
mimic r-click on desktop ; create new text file ; write ; close file

Variations:

format file : md ; txt ; docx ; odt etc.
functions : create file ; add/happen to a pre-existing file.
other function: create and edit csv file with option to edit table by typing text1;text2;...;textn
other function : create and happen for onenote

Scenario when this would be used?

Add a fleeting note for thoughts lasering your mind.
Edit a frequently used document such as a daily log

Cut clicks from the following:

r-click from desktop ; create new file ; write ; close file
type echo comand from consol terminal

Also: substitute task creation by using the mardown syntax [ ] for .md case.
Supporting information
Similar to add a task syntax from todo flowlauncher plugin : see pic below

Proxy result, from same source : pic below

No result from search in this thread using:

keywords : run ; text ; file ; happen ; create
is:open is:issue label:Idea-Enhancement label:Run-Plugin

while neat idea, i don't see us adding this.  Would be an interesting community member plugin but i don't see PowerToys team building this out


BAU — Check in build directory when building release tarball

For some reasons, sometimes when I do a release, the script the creates a tarball not of the build directory but of the directory above, which at that point does not seem to contain a build directory. It then merrily uploads this to GitHub. This is kind of dangerous, so check we’re actually in the build directory before creating the tarball.

Hmm strange.
Ideally the set -e flag would be on for these executions. Probably the cd is silently failing. You could also add an || exit 1 on the cd but I prefer yours since it actively tells you what's wrong 👍

Yeah, I would have just set -e but I don’t know if that would work with the rest of the script.


Builds on https://github.com/replicate/cog/pull/155

We pass through environment, so is the problem that buildkit doesn't check for terminal capabilities / TERM=dumb? Could we do that check inside Cog and pass that through to Docker as a --progress option, instead of adding an extra option?

BuildKit does check for term capabilities, but Emacs shell (and probably others) don't report it correctly. I assume that's the reason Docker and Docker Compose chose to add the --progress flag.

Gotchya. But Emacs shell sets TERM=dumb, right? Maybe we could detect that and automatically set --progress=plain, to make up for Docker's deficiency. (We should also submit a patch to Docker to fix this...)
We should probably also have this option, but I'm thinking this might actually improve this for you, so you don't need to remember to pass the option!

Superseded by https://github.com/replicate/cog/pull/187


Unclear documentation on how to generate a tumor-only panel for CNV

I have a fairly complex analysis which involves doing tumor-only variant calling with MuTect + a panel of normals already made and CNVkit for CNV. For the CNV analysis only there is a large (60) number of samples that are there just to provide a reference. However, the pipeline tries to find cases in the batch (they're all the same batch) and fails:

Traceback (most recent call last):
  File "/opt/bcbio/anaconda/bin/bcbio_nextgen.py", line 238, in <module>
    main(**kwargs)
  File "/opt/bcbio/anaconda/bin/bcbio_nextgen.py", line 46, in main
    run_main(**kwargs)
  File "/opt/bcbio/anaconda/lib/python3.6/site-packages/bcbio/pipeline/main.py", line 45, in run_main
    fc_dir, run_info_yaml)
  File "/opt/bcbio/anaconda/lib/python3.6/site-packages/bcbio/pipeline/main.py", line 89, in _run_toplevel
    for xs in pipeline(config, run_info_yaml, parallel, dirs, samples):
  File "/opt/bcbio/anaconda/lib/python3.6/site-packages/bcbio/pipeline/main.py", line 178, in variant2pipeline
    samples = structural.run(samples, run_parallel, "standard")
  File "/opt/bcbio/anaconda/lib/python3.6/site-packages/bcbio/structural/__init__.py", line 184, in run
    for xs in to_process.values()))
  File "/opt/bcbio/anaconda/lib/python3.6/site-packages/bcbio/distributed/multi.py", line 28, in run_parallel
    return run_multicore(fn, items, config, parallel=parallel)
  File "/opt/bcbio/anaconda/lib/python3.6/site-packages/bcbio/distributed/multi.py", line 86, in run_multicore
    for data in joblib.Parallel(parallel["num_jobs"], batch_size=1, backend="multiprocessing")(joblib.delayed(fn)(*x) for x in items):
  File "/opt/bcbio/anaconda/lib/python3.6/site-packages/joblib/parallel.py", line 917, in __call__
    if self.dispatch_one_batch(iterator):
  File "/opt/bcbio/anaconda/lib/python3.6/site-packages/joblib/parallel.py", line 759, in dispatch_one_batch
    self._dispatch(tasks)
  File "/opt/bcbio/anaconda/lib/python3.6/site-packages/joblib/parallel.py", line 716, in _dispatch
    job = self._backend.apply_async(batch, callback=cb)
  File "/opt/bcbio/anaconda/lib/python3.6/site-packages/joblib/_parallel_backends.py", line 182, in apply_async
    result = ImmediateResult(func)
  File "/opt/bcbio/anaconda/lib/python3.6/site-packages/joblib/_parallel_backends.py", line 549, in __init__
    self.results = batch()
  File "/opt/bcbio/anaconda/lib/python3.6/site-packages/joblib/parallel.py", line 225, in __call__
    for func, args, kwargs in self.items]
  File "/opt/bcbio/anaconda/lib/python3.6/site-packages/joblib/parallel.py", line 225, in <listcomp>
    for func, args, kwargs in self.items]
  File "/opt/bcbio/anaconda/lib/python3.6/site-packages/bcbio/utils.py", line 55, in wrapper
    return f(*args, **kwargs)
  File "/opt/bcbio/anaconda/lib/python3.6/site-packages/bcbio/distributed/multitasks.py", line 324, in detect_sv
    return structural.detect_sv(*args)
  File "/opt/bcbio/anaconda/lib/python3.6/site-packages/bcbio/structural/__init__.py", line 205, in detect_sv
    for svdata in caller_fn(items):
  File "/opt/bcbio/anaconda/lib/python3.6/site-packages/bcbio/structural/cnvkit.py", line 57, in run
    return _cnvkit_by_type(items, background)
  File "/opt/bcbio/anaconda/lib/python3.6/site-packages/bcbio/structural/cnvkit.py", line 71, in _cnvkit_by_type
    return _run_cnvkit_population(items, background)
  File "/opt/bcbio/anaconda/lib/python3.6/site-packages/bcbio/structural/cnvkit.py", line 154, in _run_cnvkit_population
    ckouts = _run_cnvkit_shared(inputs, background)
  File "/opt/bcbio/anaconda/lib/python3.6/site-packages/bcbio/structural/cnvkit.py", line 207, in _run_cnvkit_shared
    if tz.get_in(["depth", "bins", "normalized"], inputs[0]):
IndexError: list index out of range

That's because inputs is empty because (obviously) there are no cases in this batch.
A typical entry for one of these samples:

 - algorithm:
       aligner: false
       effects: vep
       effects_transcripts: canonical
       exclude_regions:
       - polyx
       - lcr
       - altcontigs
       - highdepth
       mark_duplicates: true
       min_allele_fraction: 1
       mixup_check: qsignature
       platform: illumina
       quality_format: Standard
       realign: false
       recalibrate: false
       svcaller: cnvkit
       tools_off: upload_alignment
       variant_regions: oneseq_liftover
       variantcaller: false
     analysis: variant2
     description: SC-99
     files:
     - /bioinformatics/einar/normals/SC-99-ready.bam
     genome_build: hg38
     metadata:
       batch: pon_build
       sex: female
       svclass: control

Case samples are, instead:
- algorithm:
       aligner: bwa
       background:
         variant: /bioinformatics/einar/MuTect_PoN.hg38.vcf.gz
       effects: vep
       effects_transcripts: canonical
       exclude_regions:
       - polyx
       - lcr
       - altcontigs
       - highdepth
       mark_duplicates: true
       min_allele_fraction: 1
       mixup_check: qsignature
       platform: illumina
       quality_format: Standard
       realign: false
       recalibrate: false
       svcaller: cnvkit
       tools_off:
       - fastqc
       - contamination
       - viral
       - coverage_qc
       variant_regions: oneseq_liftover
       variantcaller:
       - mutect2
       - vardict
     analysis: variant2
     description: S8
     files:
     - /data/sequencing/nextseq500/S8_S13_R1_001.fastq.gz
     - /data/sequencing/nextseq500/S8_S13_R2_001.fastq.gz
     genome_build: hg38
     metadata:
       batch: S8_vs_reference
       phenotype: tumor
       sex: female

As you can see, the controls are tagged with svclass but the sampels aren't. I can't seem to find why bcbio wants to use the controls as a paired case/control sample. The docs only mention the use of svclass.
The template used to generate everything was

---
details:
  - analysis: variant2
    genome_build: hg38
    algorithm:
        aligner: bwa
        mark_duplicates: true
        recalibrate: false
        realign: false
        variantcaller: false
        platform: illumina
        quality_format: Standard
        variant_regions: my_regions
        effects_transcripts: canonical
        effects: vep
        min_allele_fraction: 1
        mixup_check: qsignature
        tools_off:
          - fastqc
          - contamination
          - viral
          - coverage_qc
    metadata:
        sex: female
upload:
    dir: ../final/
globals:
    oneseq_liftover: /data/bioinformatics/regions/Agilent_OneSeq_BackBone_Genes_merged.hg38.bed

What's wrong here? I can provide (privately) the full YAML file.

Ok, as far as I can read, this works by having the reference in the same batch as the tumor. However this means that it is impossible to do a background analysis and variant calling in the same step. Did I understand correctly?

Luca;
Thanks for the detailed report and apologies about the confusion. You're exactly right that the idea is to build a panel of normals and do the actual analysis in two separate runs. Setting up the panel of normals is a one time operation and then once you have the PoN in place you can avoid needing to include the control samples in your other analyses. Hope this will work for you.

Hope this clarification helped!


Projects including this file are unable to export XLIFFs in Xcode 6.3 and up.

When attempting to export an XLIFF with this class in the project in Xcode 6.2, an error is thrown but the XLIFF export succeeds. As of Xcode 6.3 and higher however, XLIFF export completely fails. I will be working on a solution, but I wanted to raise the issue.
Here is the error from Xcode 6.2.
Bad entry in file Classes/Utilities/Catagories/Time Ago/NSDate+TimeAgo.m
(line = 15): Argument is not a literal string.

A fix for this seems to be to move the NSLocalizedStringFromTableInBundle macro from the .m file to the .h file. You can also just remove the macro or modify it to use NSBundle's explicit localized string method. XLIFF export complains because it's detecting a variable being used in the NSLocalizedString() call.

As this repository is archived, I'm closing this issue, but leaving the solution here for anyone who needs it.


getting error on post deployment script copied from github

2024-05-31T20:29:46.3467993Z ##[error]Index operation failed; the array index evaluated to null.
2024-05-31T20:29:46.4946227Z ##[error]PowerShell exited with code '1'.
Developer has created and deleted the  trigger
-armTemplate "$(System.DefaultWorkingDirectory)/_ADF CI Option 2 Build Pipeline/ArmTemplates/ARMTemplateForFactory.json" -ResourceGroupName "$(ResourceGroup)" -DataFactoryName "$(FactoryName)" -predeployment $false -deleteDeployment $true
this is how it was set for post deployment  but getting this vague error

@ndtesting
It would be great if you could add a link to the documentation you are following for these steps? This would help us redirect the issue to the appropriate team. Thanks!!

@ndtesting
Can you provide the document which you have followed?

@PesalaPavan hello,
I'm facing the same issue: "Index operation failed; the array index evaluated to null." in the post-deployment script.
The script is PrePostDeploymentScript.Ver2.ps1.
Another user already opened an issue that looks related to this one here (issue #608), but without really sharing the solution.
Can you please provide some assistance?

@anthonynassar , @ndtesting
Can you provide the documentation which you followed, then We will investigate and update as appropriate.

@PesalaPavan, the documentation can be found in the same repository of the script above.
Here is the link : https://github.com/Azure/Azure-DataFactory/blob/main/SamplesV2/ContinuousIntegrationAndDelivery/README.md

@ndtesting
Thank you for bringing this to our attention.
I've delegated this to content author @nabhishek, who will review it and offer their insightful opinions.

@nabhishek
Could you please review add comments on this, update as appropriate.

I am also facing the same issue, used the same code as instructed in the projects

Hi @ndtesting, and thanks for your dedication to our documentation. Unfortunately, at this time we have been unable to review your issue in a timely manner and we sincerely apologize for the delayed response. The requested updates have not been made since the creation of this issue, and the timeline for resolution may vary based on resourcing, so we've created an internal work item to incorporate your suggestions. We are closing this issue for now, but feel free to comment here as necessary. #please-close


Increasing the test watch timeout due to timeouts

The tests are sometimes timing out which is causing flaky tests. This change increases the timeout period to give the tests longer to complete.
Issue: #39045

Problem

The k3s provisioning tests appear to be timing out.
Solution

Increase the timeout.
Testing

This is in the tests.
Engineering Testing
Manual Testing

Automated Testing

QA Testing Considerations

Regressions Considerations

Nope, this doesn't fix it as this isn't a timeout being hit. Something else is occurring.


Gen embeddings

Below are the changes made on the gen_embeddings branch:

two scripts in models sub-folder, one that generates embeddings on the tweet data (i.e., gen_embeddings_v1.py) and the second, which generates the mean embeddings for the misinformation narratives (i.e., gen_mean_embeddings_v1.py)
two scripts in features sub-folder, one that performs SVD dimension reduction to 2D for tweet embeddings (i.e., dimen_reduce_embeds_v1.py), and the second, which uses the saved SVD model generated in the first script and applies the transformation to the misinformation mean embeddings (i.e., dimen_reduce_narratives_v1.py)
a script in the visualization sub-folder that serves as the initial prototype for the front-end visualization, rendered via streamlit/bokeh, and includes scatterplot of tweet embeddings with mean misinfo narratives, and a sidebar to adjust the size of the visualization and to select which day's data you want to gather (i.e., streamlit_dev3.py)
additionally, config files have been added to all the sub-folders

Don't forget to squash and rebase your commits. Once you've made the above corrections and squashed commits I'll approve. Try to do this in the next couple days so you don't forget about it.


Midi or Mackey support for Creative Cloud

I believe a couple of people may have asked similar questions before. Wondering if this could get prioritized seeing the changes in inputs from Adobe recently?

I second the midi compatibility request. It'd be amazing! Thanks!


"poor man's double precision"

Reported by Ansley B Manke on 14 Dec 2005 16:54 UTC
Context is the Engineering LAS, where variables in the datasets contain x and y
locations, and more than double precision is needed to represent the values.
Regarding the issue in the engineering server, where we have longitudes that run
from 130.010 to 130.020 ...  Suppose these values were in a double precision
netCDF variable (which they very well may be in the near future.)  We could read
these faithfully in Ferret's single precision variables as long as one detail of
our implementation is done in the "right" way.  Namely, if we used the
scale/offset capability (syntax may be off)
SET VARIABLE/offset=-130.0  my_longitude
This would subtract 130 from each value "as it is read".   The result would be a
single precision variable that had all of the needed precision -- but we would
have a separate obligation to keep track of the "offset=-130".  The key to doing
the implementation correctly is that if the input variable is double (or long),
then it should be read in as a double temporarily so that the scale/offset
calculation can be done in double precision.
- steve

P.S. For a full implementation to satisfy the engineering LAS needs we would
also need to have a command like
ppl xoffset -130
(or maybe a Ferret native command instead of a PPL command)
This would tell the PLOT+ axis labelling routine to add 130 onto the coordinates
that it labels.  With luck, these two things are all that we would need.  As a
side benefit the quality of the PLOT+ fonts would look much better, because they
are degraded by precision-losing axis scaling.
Migrated-From: http://dunkel.pmel.noaa.gov/trac/ferret/ticket/1369

Comment by<EMAIL_ADDRESS>on 8 Feb 2006 22:58 UTC
Implemented for X and Y axes, applying a longitude or latitude offset.
For example, say a variable called XAX has data like {144.002, 144.0034,
144.005}.  There's also a variable called YAX (which can be treated similarly).
Then we can read and plot the locations as:
set data filename.nc
let xlon = 144
set var/offset=-1*xlon xax
plot/vs/set xax,yax
ppl xvaloff xlon
ppl plot
Changes are in this code:
fmt/src/cd_read.F
fmt/src/SOURCE_FILES
fmt/src/cd_read_scale.c  (new)
fer/plt/disp_reset.F
ppl/plot/prmtiv.F
ppl/plot/pplcmd_f.F
ppl/plot/daxis.F
ppl/plotlib/SOURCE_FILES
ppl/plotlib/numcde_off.F (new)
ppl/plotlib/xaxis1.F
ppl/plotlib/yaxis1.F


[feat] Make sanitize repo return plug.Result

Fix #45

@tohanss Minor merge conflict to resolve here


Change the README so that the example usage works

We changed the variantId option from -v to -V previously to avoid conflicts with the verbose flag, but didn't update the README to reflect that.

+1

+1


Failed to load UMD bundle for MSAView, JBrowsePluginMSAView is undefined in Dev version used on a local browser

yarn --version
1.22.19
jbrowse --version
@jbrowse/cli/2.5.0 linux-x64 node-v20.2.0
cd ~/jbrowse-components/products/jbrowse-web
yarn start

I am trying to use react/msaview plugin for browsing aligned proteins dataset. When I use the (Dev version locally)
I can view JBRowse app on the browser at localhost:3000 but I am unable to install the MSAView plugin, clicking on install in the plugin store panel does not add  MSA view. When I include the "plugin" in config.json, I get an error message:
Error: Failed to load UMD bundle for MSAView, JBrowsePluginMSAView is undefined
The Desktop AppImage does not show this problem, installs the MSAview plugin OK, but is slow for browsing the sequences in the MSA viewer.
Is there anything I can do to get the plugin installable for (http://localhost/) access or if there is a way to use JBrowse to browse MSAs  faster.

it appears you are using the 'dev version' e.g. a clone of our git repo, can you type e.g. "git rev-parse HEAD"  to show what commit you are on AND/OR update to the latest "main" branch?
also I am curious about the slowness you see, do you have an example MSA file that I could try out to reproduce?

git rev-parse HEAD
c2454aa9e1b62563da513dd3c91d0ff0dd47de45

the snippet in the plugins.json may want to be
{
    "name": "MsaView", // not MSAView
    "url": "https://unpkg.com/jbrowse-plugin-msaview/dist/jbrowse-plugin-msaview.umd.production.min.js"
}

the issue where installing from plugin store was not working was a good catch and I fixed it on latest main

Thanks ! Works perfectly.


fix: change login page logic

What type of PR is this?
bug

Which issue does this PR fix:
Closes #48
What does this PR do / Why do we need it:
Changes logic zui uses to determine wether authentication is enabled or not on the zot instance it connects to
If an issue # is not available please add repro steps and logs from IPAMD/CNI showing the issue:
Testing done on this change:

Automation added to e2e:

Will this break upgrades or downgrades. Has updating a running cluster been tested?:
Does this change require updates to the CNI daemonset config files to work?:

Does this PR introduce any user-facing change?:

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Does this PR fix: https://github.com/project-zot/zot/issues/1423?


Deferred mutual exclusivity

Given an operation which has a Condition which is mutually exclusive, currently the operation would be gain this exclusion lock when it is added to the queue.
This doesn't seem like it would be ideal, because it is very easy to create a deadlock where an operation is mutually exclusive with a child or dependent operation.  The child cannot start until the parent finishes, and the parent is waiting for the child to finish before it starts.

@swiftlyfalling what do you think about this? This does actually work in the sense that now an operation "grabs" the mutually exclusive token only just before it runs, instead of when it gets added to the queue. I'm just trying to think through what the consequences of that are if you add operations which are all mutually exclusive on the same category to the queue.

@danthorpe: These changes no longer prevent mutually exclusive operations from executing concurrently.
A new test case, that fails with the new code but succeeds with the prior code:
(This takes advantage of the ConcurrencyRegistrar and RegistersWhenRunningOperation that were added with the recent GroupOperation changes.)
class MutualExclusiveTests2: OperationTests {

    private class ConcurrencyRegistrar {
        private let _sharedRunningOperations = Protector([NSOperation]())
        private let _maxConcurrentOperationsDetectedCount = Protector(Int(0))
        var maxConcurrentOperationsDetectedCount: Int {
            get {
                return _maxConcurrentOperationsDetectedCount.read { $0 }
            }
        }
        private func recordOperationsCount(currentOperationsCount: Int) {
            _maxConcurrentOperationsDetectedCount.write { (inout ward: Int) in
                if currentOperationsCount > ward {
                    ward = currentOperationsCount
                }
            }
        }
        func registerRunning(op: NSOperation) {
            _sharedRunningOperations.write { (inout ward: [NSOperation]) in
                ward.append(op)
                self.recordOperationsCount(ward.count)
            }
        }
        func deregisterRunning(op: NSOperation) {
            _sharedRunningOperations.write { (inout ward: [NSOperation]) in
                if let foundOperation = ward.indexOf(op) {
                    ward.removeAtIndex(foundOperation)
                }
            }
        }
        func atLeastOneOperationIsRunning(otherThan exception: NSOperation? = nil) -> Bool {
            return _sharedRunningOperations.read { ward -> Bool in
                for op in ward {
                    if op !== exception {
                        return true
                    }
                }
                return false
            }
        }
    }
    private class RegistersWhenRunningOperation: Operation {
        private weak var concurrencyRegistrar: ConcurrencyRegistrar?
        private let microsecondsToSleep: useconds_t
        init(microsecondsToSleep: useconds_t, registrar: ConcurrencyRegistrar) {
            self.concurrencyRegistrar = registrar
            self.microsecondsToSleep = microsecondsToSleep
            super.init()
        }
        override func execute() {
            concurrencyRegistrar?.registerRunning(self)
            usleep(microsecondsToSleep)
            concurrencyRegistrar?.deregisterRunning(self)
            finish()
        }
    }

    func test__mutually_exclusive_operation_are_run_exclusively() {
        let numOperations = 3
        let childDelayMicroseconds: useconds_t = 500000 // 0.5 seconds
        let concurrency = ConcurrencyRegistrar()
        let operations: [RegistersWhenRunningOperation] = (0..<numOperations).map { _ -> RegistersWhenRunningOperation in
            let op = RegistersWhenRunningOperation(microsecondsToSleep: childDelayMicroseconds, registrar: concurrency)
            let condition = MutuallyExclusive<RegistersWhenRunningOperation>()
            op.addCondition(condition)
            return op
        }
        queue.maxConcurrentOperationCount = numOperations

        let startTime = CFAbsoluteTimeGetCurrent()
        waitForOperations(operations[0], operations[1], operations[2]) // modify if numOperations is changed
        let endTime = CFAbsoluteTimeGetCurrent()
        let duration = Double(endTime) - Double(startTime)

        XCTAssertEqual(concurrency.maxConcurrentOperationsDetectedCount, 1)
        for i in operations.enumerate() {
            XCTAssertTrue(i.element.finished, "Child operation [\(i.index)] did not finish")
        }
        XCTAssertGreaterThanOrEqual(duration, Double(useconds_t(operations.count) * childDelayMicroseconds) / 1000000.0)
    }
}

Thanks @swiftlyfalling - that's pretty much what I expected.


fix: use prefix in state bucket #87

Use prefix for the terraform state bucket so there are no conflicts

If the state bucket is unique, how would Terraform know which bucket to reference to refresh the existing state if you initialize Terraform on a new host?

My requirement might have been unclear. With "prefix," I meant "prod-" or "sandbox-", not the "bucket_prefix" key.

It is a problem, if the bucket name is dynamic then it will have to be manually updated since terraform does not allow variables in the backend bucket resource.
Prod and sandbox can use the same bucket, their states are stored in a directory named by key, eg
key            = "{{cookiecutter.project_slug}}.sandbox.json"

The original issue was creating a project with the same name using cookiecutter resulted in a confict over the bucket name.

If the bucket prefix is random, we can't use it to track Terraform state. We need a static bucket id that can be committed to source control. cookie-cutter generates a template, and the source is modifiable by the developer using it. If duplicate project names cause duplicate bucket names, this can be resolved in the generated project. If we handle differences between staging and prod already, we can close this PR without merging it.

Differences between staging and prod are managed by the key attribute in the backend. Bucket name conflicts will need to be resolved manually.


How to redeclare Sass variables

Hi,
It's been a while since I last used Sass and I'm wondering how I can use personal value for some Sass variables instead of redeclaring CSS variables.
Is there a way to do something like that:
$color-primary: rgb(4, 120, 87);
$color-secondary: rgb(6, 182, 212);
$colorCool: $color-primary;
$colorCoolDarker: $color-primary;
@import "baseline";
@include typographyBaseline();

Thanks a lot and in advance !

Just for testing, editing the node_modules/typography-baseline.scss/sass/baseline/colors.variables.scss file, adding !default at each variable permits to override it. But is there another way ?

this is my mistake; those variables should have had !default so they could have been overridable.
However, I need to revisit this approach since the Dart Sass team has plans to deprecate old import methods.

Created #4 specifically to making this work for newer versions of sass.
A branch should be opened, however, so that the variables can be properly overwritten in the mean time.

Some things have changed while I was away from Sass :-) Thanks for the reading ! And thanks in advance for the improvements you'll make to this project :)

Notes for me when I tackled this next week:

this isn't just a case of setting !default or !global on a bunch of variables
Issue is partly that the variables are added to maps
Issue might be that variables are added to maps added to maps accessed inside of typographyBaseline(); the mutated version of the variable isn't updated b/c variables are storing value, not reference (IDK how Sass behaves in this regard)
Most likely, need to change how the variables are exported in their variable files.
That probably means changing import strategy
Also means I probably need to rewrite this whole thing for Dart Sass

other note for me:
easy way to test this module is to just use the debug.scss:
@import '../sass/_baseline';

$baseTitleSize: 13em;
$titleFontFamily: 'Comic Sans MS';
@include typographyBaseline(headings, $exclude: cssVariables )


Add jacoco integration tests

[ ] it/jacoco-executor-direct
[x] it/jacoco-executor-java

Is it possible to include support of JaCoCo for DIRECT executor?

Yes, but needs a lot of classloading extra work.

It's implementation will be done here: https://github.com/sormuras/junit-platform-isolator/issues/7


Every --cluster job performs os.walk(".snakemake/incomplete") causing a deadlock

Snakemake version
Reproduces on 6.7.0, but should go as far as 5.27.0

Describe the bug
Jobs submitted using --cluster option perform os.walk(".snakemake/incomplete"), which on extremely large directory sizes make jobs hang up on getdents() calls.
Logs

Minimal example
# cat Snakefile
rule Test:
    output: "output/{n}"
    shell: "mv trace {output}"
# snakemake --cores=1 --cluster="strace -f -o trace" output/{1,2,3}
<snip>
# grep -Er -A4 "openat.*incomplete\"" output
output/3:21478 openat(AT_FDCWD, ".snakemake/incomplete", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 3
output/3-21478 fstat(3, {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
output/3-21478 getdents64(3, 0x266e1e0 /* 2 entries */, 32768) = 48
output/3-21478 getdents64(3, 0x266e1e0 /* 0 entries */, 32768) = 0
output/3-21478 close(3)                          = 0
--
output/2:21458 openat(AT_FDCWD, ".snakemake/incomplete", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 3
output/2-21458 fstat(3, {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
output/2-21458 getdents64(3, 0xea21a0 /* 2 entries */, 32768) = 48
output/2-21458 getdents64(3, 0xea21a0 /* 0 entries */, 32768) = 0
output/2-21458 close(3)                          = 0
--
output/1:21468 openat(AT_FDCWD, ".snakemake/incomplete", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 3
output/1-21468 fstat(3, {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
output/1-21468 getdents64(3, 0x1ee51e0 /* 2 entries */, 32768) = 48
output/1-21468 getdents64(3, 0x1ee51e0 /* 0 entries */, 32768) = 0
output/1-21468 close(3)                          = 0

Additional context
Causes problems when .snakemake is on NFS
Was introduced in #663, cc @mhulsman @johanneskoester

Thanks for reporting this! Scandir is quick on the filesystem I'm using, so I hadn't noticed this issue. But the problem indeed has to be in filling the _incomplete_cache, which is not necessary for these single-job runs. So the proposed fix should address it.
However, that the cache is filled is a bit unexpected to me, as I thought these cluster jobs run with '--ignore-incomplete'. So maybe we need have a look why it still calls Persistence.incomplete at all.

Yes, the wrapper would preferably be as thin and lightweight as possible. If you can manage to cut that check out, that would be even better fix, @mhulsman.

Turns out the reason that incomplete is called by the wrapper is that only CPUExecutor adds in 'ignore-incomplete', but not ClusterExecutor. Not sure why, maybe for clusters that do automatic restarts of failed jobs? But even then... Anyway, probably safer to keep the proposed fix.

In HTCondor a job can be preempted to be restarted again later. I don't recall batch systems that would restart jobs that are explicitly failing.

I don't recall batch systems that would restart jobs that are explicitly failing.

Actually I retract that. The condor's option max_retries does a restart on a non-zero exit code.


tests: Works on travis, fails on my buildbox.

This is really about the #231 PR. However, since the current master doesnt build, there is no way to reproduce test errors there.
On #231, commit 6dd5782, the  run_tests completes successfully on travis. However, on my local test box the same test fails, with lots of messages like
timer_tests.short_intervals
/home/mk/cxx-serial/cxx-serial/tests/unit/unix_timer_tests.cc:24: Failure
The difference between r+1 and 0 is 11, which exceeds 1, where
r+1 evaluates to -11,
0 evaluates to 0, and
1 evaluates to 1.

My local box is pretty fast, a Ryzen 7 gen3. OTOH, the Debian machine I use for testing is a vm under VirtualBox.
But then again, I guess the travis build also runs on a vm.

After porting the tests to cppunit I can run the tests on my native, Fedora without any hypervisor layer. Same results, slightly better formatted:
Test Results:
Run:  2   Failures: 2   Errors: 0

1) test: SerialTimerTest::testOverlappingLongIntervals (F) line: 76 unix_timer_tests.cc
double equality assertion failed
- Expected: -14
- Actual  : -36
- Delta   : 5
- check 2 on 0

2) test: SerialTimerTest::testShortIntervals (F) line: 42 unix_timer_tests.cc
double equality assertion failed
- Expected: 0
- Actual  : -68
- Delta   : 1

It's a bit unfortunate that the delays are random and thus not possible to reproduce.

The tests are broken since the assume the for example usleep(5000) actually creates a 5 ms delay. However, there are no such guarantees, the delay is never shorter but typically somewhat longer.
The tests needs to be patched taking the actual, elapsed time into account rather than blindly trusting usleep()

Attaching updated tests, These are cppunit tests, not directly usable in current, catkin context. They also relies on C++11, which somehow makes the timer tests obsolete (since C++11 has platform-indepented timers built in). Nevertheless, enclosed tests works on both Linux and Macos, basically validating the pre-C++11 code with C++11 primitives.
unix_timer_tests.cc.gz


generateStaticParams with pgsql spam pulls database during dev

Describe the Bug
I'm developing an app using postgres as the db provider. I have a page with a dynamic route segment: /products/[slug].  During local development, when exporting a generateStaticParams  function inside of this page, [⣻] Pulling schema from database... is being spammed at an alarming rate:
.
This happens upon every page refresh.

Link to the code that reproduces this issue
https://github.com/Wtiben/payload-generateStaticParams-demo
Reproduction Steps
Checkout the repo  and run docker compose up.
Navigate to a random product page, for example: http://localhost:3000/products/abc.
Upon page load the schema is being pulled from database repeatedly:

In this simple example the amount of spam appears to be limited and i'm not exactly sure which factors worsen it, but it's still observable. In a real-life app, it's considerably worse.
Which area(s) are affected? (Select all that apply)
db-postgres, area: core
Environment Info
Binaries:
  Node: 23.1.0
  npm: N/A
  Yarn: N/A
  pnpm: N/A
Relevant Packages:
  payload: 3.1.0
  next: 15.0.0
  @payloadcms/db-postgres: 3.1.0
  @payloadcms/email-nodemailer: 3.1.0
  @payloadcms/graphql: 3.1.0
  @payloadcms/next/utilities: 3.1.0
  @payloadcms/payload-cloud: 3.1.0
  @payloadcms/richtext-lexical: 3.1.0
  @payloadcms/translations: 3.1.0
  @payloadcms/ui/shared: 3.1.0
  react: 19.0.0-rc-65a56d0e-20241020
  react-dom: 19.0.0-rc-65a56d0e-20241020
Operating System:
  Platform: win32
  Arch: x64
  Version: Windows 11 Enterprise
  Available memory (MB): 65452
  Available CPU cores: 16

@Wtiben I have the same issue using Neon Postgres

@ashxdev I didn't find any other solution other than the aforementioned workaround, but that does at least seem to do the trick. Thanks @KoenRijpstra.


Error in assignID: surface-property with name 'ceiling' does not exist.

Failed to load mods: Error in assignID: surface-property with name 'ceiling' does not exist.
Source: nauvis-factory-floor (planet).
factorissimo-2-notnotmelon 1.5.1

Duplicate of #11


Prevent hack&slash when the player is already dead

(Discussion)
Now the concept of dead does not exist, so the implementation goal could be ambiguous.
According to the dungeon world rule...
A character who is reduced to 0 HP immediately takes his Last Breath. ... (ellipsis) ... Depending on the outcome of the Last Breath the character may become stable. A stable character stays at 0 HP but is alive and unconscious. If they receive healing they regain consciousness and may return to battle or seek safety.
So, in my opinion, if HP becomes zero, preventing all actions except sleeping could be a good first step. (+ preventing HP from becoming negative)
The Last Breath stage & receiving healing from other players could be implemented in the future.
@jckdotim What do you think?

can i try this issue?


Colour labels don't "stick" to files

Description
experimental labels don't apply permanently  to files.
Steps To Reproduce

apply label to file
navigate to new folder
navigate back to previous folder
label is gone

Expected behavior
label applies permanently to file
Files Version
2.1.2
Windows Version
Windows 11 22000.466 21H2
Relevant Assets/Logs
debug.log
debug_fulltrust.log

Where are the files you're trying to tag? In a local drive? In a network drive?

ah yes I've just retested it. It works on a local drive, but not with network drives. Are a lot of my stability issues due to the fact I'm primarily running a network drive?

@xx88xx very likely, we currently use a different set of APIs for network drives.

I have the same issue except that this happen even on local drive but not all the folders are affected
I am on VM
Here are all the labels that stays after refreshing the window

You need to have write permissions to the folder to be able to tag it.

Is this still an issue in <IP_ADDRESS>?


Broken ipv6

Trying to get cert on ipv6-connected machine:
Started Check and renew ACME TLS certificates.
acme-client: /var/lib/acme/certs/DOMAIN/privkey.pem: domain key exists (not creating)
acme-client: /var/lib/acme/accounts/letsencrypt.pem: account key exists (not creating)
acme-client: https://acme-v01.api.letsencrypt.org/directory: directories
acme-client: acme-v01.api.letsencrypt.org: DNS: 2a02:26f0:2d:480::3d5
acme-client: acme-v01.api.letsencrypt.org: DNS: 2a02:26f0:2d:487::3d5
acme-client: acme-v01.api.letsencrypt.org: DNS: <IP_ADDRESS>
acme-client: 2a02:26f0:2d:480::3d5: tls_connect_socket: acme-v01.api.letsencrypt.org, ssl verify setup failure
acme-client: https://acme-v01.api.letsencrypt.org/directory: bad comm
acme-client: bad exit: netproc(1745): 1
<EMAIL_ADDRESS>Main process exited, code=exited, status=1/FAILURE

Although ipv6 works like a charm:
$ curl -v https://acme-v01.api.letsencrypt.org/
*   Trying 2a02:26f0:2d:480::3d5...
* Connected to acme-v01.api.letsencrypt.org (2a02:26f0:2d:480::3d5) port 443 (#0)
...
* SSL connection using TLSv1.2 / ECDHE-RSA-AES256-GCM-SHA384
...
*  SSL certificate verify ok.
> GET / HTTP/1.1
> Host: acme-v01.api.letsencrypt.org
...
>
< HTTP/1.1 200 OK
...

What version of libtls do you have?

I see that @Prototik uses my package from Arch Linux AUR.  It uses libressl version 2.4.3, but with acme-client 0.1.11 they worked perfectly. Now I tried to compile with libressl 2.5.0, and it seems that the error no longer exists.
By the way the problem is not only with ipv6

Yes, it's a libtls problem.  I'm adding some compatibility glue right now.

Can you please check the current version of the GitHub source for whether this is fixed?  On older versions of libtls, I now load the certificate directly into memory instead of relying on the broken ca_file function.  Note: I use the CA file in /etc/ssl/cert.pem by default.  On my Mac, it's in /usr/local/etc/libressl/cert.pem.  This works on my Alpine linux, old OpenBSD, Mac, and FreeBSD systems.

will check

Fixed in 0.1.14, which has these changes.  Thank you for checking and reporting!

@repsac-by probably you need to use an aur/libressl package instead building own version.
But anyway thanks everypne for the help, works nicely.

sorry for off topic
@Prototik, libressl из aur имеет пометку EXPRIMENTAL ONLY и полностью заменяет системный openssl, это совсем не решение.  Я просто не хотел торопиться с переходом на libressl 2.5.0, по крайней мере я не предполагал, что там есть какие то новые функции которые могут потребоваться здесь так скоро.

@repsac-by хм, тогда, возможно, стоит создать пакет libressl, который не будет заменять системный openssl. В любом случае - спасибо за пакетик.


Update introduction.md

It should be "compete" not "complete"
Summary
Describe your changes here.
Fixes #Issue_Number (if available)

Good catch @shchauh! I will approve and merge this PR. Thanks


MySQL - Urgent security issues in lodash and sql

I've just discovered (using npm audit) that there are some urgent and some minor issues.
• Package sql suffers from a not fixed SQL injection vulnerability (not yet fixed)
• Package lodash suffers from two urgent prototype pollution issues (fixed in 4.17.11 and 4.11.17 respectively)
Please consider updating lodash soon

@julian-weinert and @identithree this has been resolved and is now published. There are no reliance on SQL or other packages moving forward on mysql. 🎉


Support for mp3 audio playback (now that the license program is terminated/patents expired)

Godot version:
3.2
OS/device including version:
All
Issue description:
Currently out of the box godot only supports wav and oggvorbis audio playback. Now mp3 being the most popular format and it's licensing program has been terminated and patents expired and aren't being renewed this would mean mp3 is free game now if I'm not mistaken.
https://hackaday.com/2017/05/14/patents-on-mp3-format-due-to-expire/

I really hope they do add mp3 support. It'd save me from a real headache. If they aren't planning, how possible is it to "manuallly" implement mp3 support?

@tempdoom Wouldn't Ogg Vorbis fit your use case? The only use I see for supporting MP3 audio is using existing MP3 audio (where you don't have a lossless/uncompressed source), which is unlikely when you're legally using such audio.

Using existing mp3 is my use case personally. I was working on a podcast
player and ran into a wall.
On Tue, Mar 26, 2019, 6:01 AM Hugo Locurcio<EMAIL_ADDRESS>wrote:

@tempdoom https://github.com/tempdoom Wouldn't Ogg Vorbis fit your use
case? The only use I see for supporting MP3 audio is using existing MP3
audio (where you don't have a lossless/uncompressed source), which is
unlikely when you're legally using such audio.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/godotengine/godot/issues/27236#issuecomment-476576402,
or mute the thread
https://github.com/notifications/unsubscribe-auth/APoMI-Psu45KhFSINxZKkB4_DGII_6jaks5vaf35gaJpZM4b8jKY
.

For me it's that I'd like to allow custom audio files (specifically music) to be imported to the app, and most people's phone music libraries use mp3s. This is more for android than apple, as there are it seems some more hoops to jump through with apple, but that I can do fairly easily. I already use .ogg files in the default app.

I really hope they do add mp3 support. It'd save me from a real headache. If they aren't planning, how possible is it to "manuallly" implement mp3 support?

If you're still interested in this, I wrote a rudimentary module for MP3 support through Minimp3: https://github.com/DeleteSystem32/godot-minimp3
Currently working on performance improvements.

Feature and improvement proposals for the Godot Engine are now being discussed and reviewed in a dedicated Godot Improvement Proposals (GIP) (godotengine/godot-proposals) issue tracker. The GIP tracker has a detailed issue template designed so that proposals include all the relevant information to start a productive discussion and help the community assess the validity of the proposal for the engine.
The main (godotengine/godot) tracker is now solely dedicated to bug reports and Pull Requests, enabling contributors to have a better focus on bug fixing work. Therefore, we are now closing all older feature proposals on the main issue tracker.
If you are interested in this feature proposal, please open a new proposal on the GIP tracker following the given issue template (after checking that it doesn't exist already). Be sure to reference this closed issue if it includes any relevant discussion (which you are also encouraged to summarize in the new proposal). Thanks in advance!

Note that there's already an open proposal about this: https://github.com/godotengine/godot-proposals/issues/85


Encryption at rest updates

Addresses #4471
Changes made:

Added doc for debug encryption-status
Updated the encryption doc with link to the debug command doc
Added a known issue for higher CPU usage
Updated the sidebar nav
Removed the experimental label

To do: Figure out how to make the rocksdb.encryption.algorithm metric info show up on the Custom Charts doc

This change is

http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/ecb12d20afca3edd4debcfda1f59373c20ec7632/

http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/c0d3c6a87137f565fd78d7da8c9587ee8a95629b/

http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/d43b0e7696677aaff13c87d5e29753a288b90aa9/

@mberhault Do we also want to document the encryption-status command? If yes, can you point me to the PR?

Seems we have the same question. I'm not convinced we need encryption-status, but it can be added if we want to be thorough. The PR was https://github.com/cockroachdb/cockroach/pull/28582
It's definitely a debug command in the sense that it just dumps a bit list of details: key metadata (never the key contents), and information about per-file encryption.

As I understand it, the encryption-active-key command is the user-friendly command. encryption status seems more oriented towards the developers, and also displays the data keys, which I am not sure if we want the users to easily access. And we don't document all debug commands - just a select few. I agree that we probably shouldn't document it.

http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/b4065aa802cc6a199c4b87b1ec3cb3c031d0b72f/

Sounds good. Anyone curious will probably just check the list of available commands.
LGTM again. Thanks for the changes!

v19.1/debug-encryption-active-key.md, line 2 at r4 (raw file):
Previously, lhirata wrote…
This should be title case

Ah, good catch. That's true for the other encryption debug page you added recently, too, Amruta.

http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/49d8f69229ccb649f7361c206dc5b0a25ea0ba09/

http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/b527301028f4e7773594ce890af3c47ed687b314/

http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/edf00afb26144e8de2cade1077c58dc3bf0663cc/