[Bug]:  not updating object of array?

Which packages are impacted?

[X] remix-validated-form
[X] @remix-validated-form/with-zod
[ ] @remix-validated-form/with-yup
[ ] zod-form-data

What version of these packages are you using?
"remix-validated-form": "^4.6.11",
"@remix-run/react": "1.15.0",
"@remix-validated-form/with-zod": "^2.0.5",
Please provide a link to a minimal reproduction of the issue.
http://www.google.com
Steps to Reproduce the Bug or Issue
Just create object of arrays:
{
slots: [{
day: 'monday',
intervals: [...]
}]
}
Expected behavior
It's not updating the fields value.
export default function AccountSchedule() {
  const {defaultValues} = useLoaderData<typeof loader>();
  const data = useActionData<ActionData>();

  return (
    <ValidatedForm
      validator={validator}
      method="post"
      defaultValues={defaultValues} << default Values change on link route
    >
      <FieldArray name="slots">
        {(slots, helpers, error) => { << slots stay the same
          console.log(slots);
          return <ScheduleSlotsFields slots={slots} helpers={helpers} />;
        }}
      </FieldArray>
      {data && JSON.stringify(data, null, 2)}
      <SubmitButton />
    </ValidatedForm>
  );
}

Screenshots or Videos
https://user-images.githubusercontent.com/115714/236705296-88a317c4-5a40-4c36-9252-fa3543b68a80.mov
Platform

OS: [macOS]
Browser: [Chrome]

Additional context
The defaultValues is not updating the inner form?

I added a key to fieldArray which fixed the problem.
<FieldArray name="slots" key={defaultValues.name}>

Hi! It's a bit hard to tell what, exactly, the issue is here. Are you saying that the field array doesn't update when the default values of the form itself changes?

They are updating, but the UI is not :)=

Hi! Could you test this again using v5? Field arrays now generate a key that can be used to help clear this type of issue up. I noticed just now that you're not using a key at all in the example you provided, so that could be the issue.

I'm going to close this issue for now, because I believe that the changes in v5 should enable this use-case. Please feel free to re-open with an updated reproduction if the issue persits.
Thanks!


Missing required property writer.staging.dir

Gobblin MapReduce job- Pull from Kafka to HDFS failed while in initialization.
I have 1 maser and 6 slave nodes for HDFS and YARN.
I am sure writer.staging.dir is present in both Gobblin system configuration file and job configuration file. And they are consistent.
Here is the error message:
WARN [KafkaSource] Previous offset for partition tianjin-smart-city-1:0 does not exist. This partition will start from the earliest offset: 68333550
WARN [KafkaSource] Previous offset for partition tianjin-smart-city-1:1 does not exist. This partition will start from the earliest offset: 0
WARN [KafkaSource] Previous offset for partition tianjin-smart-city-1:2 does not exist. This partition will start from the earliest offset: 0
WARN [KafkaSource] Previous offset for partition tianjin-smart-city-1:3 does not exist. This partition will start from the earliest offset: 0
WARN [KafkaSource] Avg event size for partition tianjin-smart-city-1:0 not available, using default size 1024
WARN [KafkaSource] Avg event size for partition tianjin-smart-city-1:1 not available, using default size 1024
WARN [KafkaSource] Avg event size for partition tianjin-smart-city-1:2 not available, using default size 1024
WARN [KafkaSource] Avg event size for partition tianjin-smart-city-1:3 not available, using default size 1024
ERROR [MRJobLauncher] Collected 0 task states while expecting 4 task states
Exception in thread "main" java.lang.IllegalArgumentException: Missing required property writer.staging.dir
        at com.google.common.base.Preconditions.checkArgument(Preconditions.java:93)
        at gobblin.util.WriterUtils.getWriterStagingDir(WriterUtils.java:55)
        at gobblin.util.JobLauncherUtils.cleanStagingData(JobLauncherUtils.java:172)
        at gobblin.runtime.AbstractJobLauncher.cleanupStagingData(AbstractJobLauncher.java:460)
        at gobblin.runtime.AbstractJobLauncher.launchJob(AbstractJobLauncher.java:285)
        at gobblin.runtime.mapreduce.CliMRJobLauncher.run(CliMRJobLauncher.java:60)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at gobblin.runtime.mapreduce.CliMRJobLauncher.main(CliMRJobLauncher.java:133)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

And my job configuration file is listed:
job.name=Pull-From-Kafka-To-HDFS
job.group=Kafka
job.description=Kafka Extractor for Gobblin
job.lock.enabled=false

writer.staging.dir=/tianjin/task-staging

source.class=gobblin.source.extractor.extract.kafka.KafkaSimpleSource
converter.classes=gobblin.converter.IdentityConverter
extract.namespace=gobblin.extract.kafka

topic.whitelist=tianjin-smart-city-1
topic.name=tianjin-smart-city-1
kafka.brokers=kafka-1:9092

writer.builder.class=gobblin.writer.SimpleDataWriterBuilder
bootstrap.with.offset=earliest

writer.partition.level=hourly
writer.partition.pattern=YYYY/MM/dd/HH

mr.job.max.mappers=500

I have checked DEBUG level log, but find no information helps to address the problem.

Hi @Evangileon I wasn't able to reproduce your problem. Can you let us know your sysconfig file, as well as what properties are in the State object when it throws that exception?

@Evangileon are you using the script gobblin-mapreduce.sh to run the job? Can you share with us the command you used and the environment variables you set?

I encounter the same probleam. My command is bin/gobblin-mapreduce.sh --jt ip:port --fs hdfs://xxx --workdir hdfs://xxx/tmp/test/gobblin_work --conf /home/data/test/gobbin_config/kafka_hdfs.pull。
job.name=PullFromKafka
job.group=Kafka
job.description=Kafka Extractor for Gobblin
job.lock.enabled=false
source.class=gobblin.source.extractor.extract.kafka.KafkaSimpleSource
#extract.namespace=gobblin.extract.kafka
writer.destination.type=HDFS
#writer.output.format=AVRO
writer.fs.uri=hdfs://xxx
data.publisher.type=gobblin.publisher.TimePartitionedDataPublisher
topic.whitelist=test
bootstrap.with.offset=earliest
kafka.brokers=ip1:port1,ip2:port2
writer.partition.level=hourly
writer.partition.pattern=YYYY/MM/dd/HH
writer.builder.class=gobblin.writer.SimpleDataWriterBuilder
#writer.builder.class=gobblin.writer.AvroTimePartitionedWriterBuilder
writer.file.path.type=tablename
writer.partition.column.name=header.time
mr.job.max.mappers=20
extract.limit.enabled=true
extract.limit.type=time
#(other possible values: rate, count, pool)
extract.limit.time.limit=15
extract.limit.time.limit.timeunit=minutes
Can anyone help me?

@zhaolmtravelsky you don't have writer.staging.dir in your kafka_hdfs.pull. Is it in another config file?

@zliu41 @liyinan926 My command was gobblin-mapreduce.sh --conf pipeline.pull.
I have tried define writer.staging.dir explicitly in job configuration file, but it never worked.
After I modified yarn-site.xml and mapred-site.xml files to minimum configuration, I addressed the issue. Because configuration of Java heap size is too large, so that worker instance failed at initialization. Therefore Node Manager could not get the configuration object serialized from master node. It just reported some variable missing.

@zliu41
writer.staging.dir in the gobblin-mapreduce fiile.  Is it in the wrong file?


Optional Build Logs

It is nice to default to the cleanliness of not displaying build logs, but it would be cool if the user could see them.  I remember @ahmetb indicating it might be hard to implement, but something like the following would be cool:
[ ! ] Attempting to build this application with its Dockerfile. Press Esc at any time to see the build output.
[ ! ] FYI, running the following command:
        docker build -t gcr.io/jw-demo/hello-netcat hello-netcat

Sending build context to Docker daemon  74.75kB
Step 1/2 : FROM alpine
 ---> a24bb4013296
Step 2/2 : ENTRYPOINT while :; do nc -k -l -p $PORT -e sh -c 'echo -e "HTTP/1.1 200 OK\n\n hello, world"'; done
 ---> Using cache
 ---> c5c6654985d8
Successfully built c5c6654985d8
Successfully tagged gcr.io/jw-demo/hello-netcat:latest

[ ✓ ] Built container image gcr.io/jw-demo/hello-netcat
[ ! ] FYI, running the following command:
        docker push gcr.io/jw-demo/hello-netcat
[ ✓ ] Pushed container image to Google Container Registry.
[ ! ] FYI, running the following command:
        gcloud run deploy hello-netcat\
          --project=jw-demo\
          --platform=managed\
          --region=us-central1\
          --image=gcr.io/jw-demo/hello-netcat\
          --allow-unauthenticated
[ ✓ ] Successfully deployed service hello-netcat to Cloud Run.
* This application is billed only when it's handling requests.
* Manage this application at Cloud Console:
        https://console.cloud.google.com/run/detail/us-central1/hello-netcat?project=jw-demo
* Learn more about Cloud Run:
        https://cloud.google.com/run/docs
[ ✓ ] Your application is now live here:
        https://hello-netcat-weurlhfjnq-uc.a.run.app

Should be doable. But most projects e.g. even the Go binaries are likely to have screens full of build messages that the user might fail to keep track of. Similarly docker-build tends to treat stderr as red (90% of the time causing false alarms to the user).

Thanks for filing the feedback so fast! Agreed, it would be really nice to opt-in to the logs, and preferably even to configure the button to always display logs (so that we can show what our project logs look like)

Yeah, there could also be an app.json flag.

I resisted not to say yet another flag, but it seems inevitable. :)

For the record, we do collect those logs already, but we only print if we fail.
And I just realized why it currently isn't possible to stream.
It's because we have an animation printing [ /|\_/... ] Building container image and while that's going on, we can't stream stuff to the output stream as it would mess with the animation.

Yeah, the app.json creep is real.
In this case we could disable the spinner.
BTW, for some reason the spinner doesn't work (sometimes or all the time?). #182


Should i hard-masked the assemblies firstly

Hi !
I used your pipeline  pangenome-graph-from-assemblies to construct a VCF file, but I noticed that some of the variants have an unusually high number of alleles. see belows:
1       18300   .       GACACACAACACACAC        GACAGACAGACACACACAC,GACAGACAGACAGACAGACACAC,GACAGACAGACAGACAGACAGACACACACACACACACACAC,G,GACACACACACACACACACACAC,GACAGACAGACAGACACACACACACACAC
1       19171   .       CAAAAAAAA       CAA,CAAA,CAAAAAAAAAAAA,CAAAAAAAAAAAAAAAAAAAA,CAAAAAAAAAAAAAAAAAAAAA,CAAAAAAAAAAAAAAAAAAAAAA,CAAAAA,CAAAA,CAAAAAAAAAA,C,CA,CAAAAAAAAAAA
I suspect that this may be due to repetitive sequences in my input assemblies, which were directly obtained from hifiasm assembly results without being masked.

I assume these are variants in repetitive sequences? I guess it's not unusual to see a lot of different alleles there


Azure File shares cannot be accessed from a container running on a Windows agent

Is this a request for help?
No

Is this an ISSUE or FEATURE REQUEST?
ISSUE

What version of acs-engine?
0.9.1

Orchestrator and version (e.g. Kubernetes, DC/OS, Swarm)
kubernetes 1.8.2
What happened:
When accessing an Azure Files share from a container running on a Windows agent, I get the following error:
System error 1783 has occurred.

The stub received bad data.

This is independent from the template. I tried it with and without custom VNET, with a single Windows agent and with multiple Windows agents. I tried with older versions of acs-engine (0.8, 0.7) and with other kubernetes versions (1.7.x) - the behaviour is always the same. The problem suddenly appeared at the beginning of October. In September this problem was not there.
How to reproduce it (as minimally and precisely as possible):

Create an Azure Storage account xyz and add a file share myshare to this account.
Deploy a kubernetes cluster with acs-engine, which contains at least one Windows agent.
Run kubectl run -it servercore --image microsoft/windowsservercore
Try to mount the share in the container: net use Z: \\xyz.file.core.windows.net\myshare /u:AZURE\xyz <your_key>. You receive the following error:

System error 1783 has occurred.

The stub received bad data.

But if you create a new Azure VM (Windows Server 2016 with Containers), and run a container like this:
docker run -it --name servercore microsoft/windowsservercore
then the mount operation succeeds.

@JiangtianLi This will take some investigation. When you have some spare cycles, could you kindly look into this?

@chweidling Can you let me know what is your kubelet version and windows os version, e.g., the output of the following?
kubectl get no -o wide

@andyzhangx Can you take a look since this is related to Azure File?

@JiangtianLi kubectl get no -o wide returns
NAME                    STATUS    ROLES     AGE       VERSION                    EXTERNAL-IP   OS-IMAGE                      KERNEL-VERSION                                           CONTAINER-RUNTIME
11123k8s9000            Ready     <none>    22m       v1.8.2-18+3d35a4c5aec26c   <none>        <unknown>                     10.0 16299 (16299.15.amd64fre.rs3_release.170928-1534)   docker://Unknown
k8s-master-11123980-0   Ready     master    22m       v1.8.2                     <none>        Debian GNU/Linux 8 (jessie)   4.11.0-1014-azure                                        docker://1.12.6

On the Windows agent, the output of ver is
Microsoft Windows [Version 10.0.16299.19]

I have tried a k8s cluster based on current rs3 image, it works well. I could be due to the network code change, as I could see, there is Ethernet adapter vEthernet change, l2bridge works, while Container NIC not works. @JiangtianLi, do you have more knowledge about this?
C:\>ipconfig
Windows IP Configuration
Ethernet adapter vEthernet (4a54c3a966850a5d23b75a161b3c7b54acb8ca293e215c0d0f9eca3dfbc70f33_l2bridge):
   Connection-specific DNS Suffix  .   Does networking work (POD to POD, outbound)? The first non-working cluster has the correct networking config though.
@chweidling Your cluster is RS3. Did you create the container with 1709 tag?

My deployment is created with this file:
{
  "apiVersion": "vlabs",
  "properties": {
    "orchestratorProfile": {
      "orchestratorType": "Kubernetes",
      "orchestratorRelease": "1.8"
    },
    "masterProfile": {
      "count": 1,
      "dnsPrefix": "chw-jf",
      "vmSize": "Standard_D2s_v3"
    },
    "agentPoolProfiles": [
      {
        "name": "backend",
        "availabilityProfile": "AvailabilitySet",
        "count": 3,
        "osType": "Windows",
        "vmSize": "Standard_D4s_v3"
      }
    ],
    "windowsProfile": {
      "adminUsername": "XXX",
      "adminPassword": "XXX"
    },
    "linuxProfile": {
      "adminUsername": "XXX",
      "ssh": {
        "publicKeys": [
          {
            "keyData": "ssh-rsa XXXX"
          }
        ]
      }
    },
    "servicePrincipalProfile": {
      "clientId": "XXX",
      "secret": "XXX"
    }
  }
}

The container/pod was crreated with
kubectl run -it core --image microsoft/windowsservercore
Currently I cannot deploy any Windows container on a cluster created with acs-engine 0.9.3. (When running the container, there is an error The operating system of the container does not match the operating system of the host.)
Further remarks: When I deploy with acs-engine 0.8.0, I have the following output of kubectl get nodes -o wide:
NAME                    STATUS    ROLES     AGE       VERSION                   EXTERNAL-IP   OS-IMAGE                      KERNEL-VERSION                                                      CONTAINER-RUNTIME
11123acs9000            Ready     <none>    2m        v1.8.0-8+cbbb894c1a1b70   <none>        <unknown>                     10.0 14393 (14393.1715.amd64fre.rs1_release_inmarket.170906-1810)   docker://Unknown
k8s-master-11123980-0   Ready     master    2m        v1.8.0                    <none>        Debian GNU/Linux 8 (jessie)   4.4.0-98-generic                                                    docker://1.12.6

@chweidling acs-engine 0.8.0 deploys RS1 Windows in the cluster and Windows POD uses microsoft/windowsservercore image. acs-engine 0.9.3 deploys RS3 Windows in the cluster and Windows POD uses microsoft/windowsservercore:1709 image. To clarify, is the Azure File issue on cluster deployed by acs-engine 0.9.3?

@JiangtianLi The Azure File issue is on an 0.8.0 deployment. But, 0.8.0 deployments were working until middle of October. Then suddenly the issue was there. The same issue I have when I use Azure Container Service to deploy a kubernetes cluster.
Also with acs 0.9.1 I had this problem. At the moment I cannot deploy a Windows container with 0.9.3 in order to test it because of the The operating system of the container does not match the operating system of the host. problem.

@chweidling
Try with following example to deploy a windows pod:
https://github.com/andyzhangx/Demo/blob/master/windows/azurefile/rs3/windowsservercore-pod-azurefile.yaml
You could find detailed examples here:
https://github.com/andyzhangx/Demo/blob/master/windows/azurefile/rs3/windowsservercore-pod-azurefile.yaml
This version should work for mounting azure file

@andyzhangx: Thank you for the hint. With a 1709 image I could mount the file share inside my container.
This issue is resolved.

Thanks @andyzhangx !


Feature Request: Add MD5/SHA* hashes for assets attached to releases

My understanding is assets attached to a release are uploaded by the releasing party. It would beneficial for the release announcement if hashes of those files were also supplied.

@gdevenyi Good idea. We will add this to the process for the next release.

The process for generating the hashes is documented in #768


make the code inline+block published output nicer (NextJS)

Please Select if your Request is Either something new or an Enhancement

[x] Enhancement of an existing Feature.
[ ] Request of a new feature.

Please select the area your request applys to. (Multiple selections are Possible)

[ ] Onboard. Initial vault setup and import/export pods
[ ] Create. Note creation, lookup, snippets and templates
[ ] Retrieve. Backlinks, references, graph view
[ ] Structure. Refactoring, multi-vault and schemas
[x] Publish. Sharing your repo with the world
[ ] Misc (Choose this if your not sure)

Is your feature request related to a problem? Please describe

cannot differentiate code blocks easily

Describe the solution you'd like

with the light gray background like on 11ty
and the standard light red colour (works well on light/dark themes)

Describe alternatives you've considered
Additional context

This is a good point. The same can be said about both in-line code and code blocks. Here is a screenshot that includes a mixture of:

Headers
Normal text
In-line code (text wrapped in backticks such as this example)
Code blocks, such as

# This example
echo "Hello world" | grep Hello

Looks like code syntax flavor isn't present, either, so could be a few separate issues if wanting to break down into smaller tasks.

Can't recall exactly on top of my head but I remember we had some blockers with prismjs (what we are using to do syntax highlighting for code blocks). Regardless. Thanks for submitting the issue :) We'll let you know when this gets resolved

this should be fixed in v70 of Dendron. please post here if not, otherwise this issue will auto close in 4 days


fix: Ensure that threads are dropped when using child threads

Uses a very naive approach to determine if there still exists thread
references by scanning every thread. Could be faster but this fixes the
immediate issue.

bors r+


fix: less hacky/more consistent pinboard pinner detection

:moyai:

explanation (This is a masterpiece)

🗿

thanks!


[main] Upgrade to latest dependencies

Cron -knative-prow-robot
/cc knative-sandbox/channel-wg-leads
/assign knative-sandbox/channel-wg-leads
Produced by: knative-sandbox/knobots/actions/update-deps
Details:
bumping knative.dev/pkg dd0db4b...51cfaab:
  > 51cfaab Added inverse functions for the ptr package (# 2172)
  > cf1994e Update community files (# 2171)
  > 4cdacd0 add concurrency for each controller (# 2160)
  > e117baa Replace reference to obsolete xip.io service (# 2169)
  > a1bc850 Print proper warning logs from API warnings (# 2168)
  > a421cf1 upgrade to latest dependencies (# 2167)
  > 6b252df Update community files (# 2165)
bumping knative.dev/reconciler-test 88c8473...2a6d91d:
  > 2a6d91d upgrade to latest dependencies (# 222)
  > 9f3a27b Update community files (# 221)
  > 4d687fd Fix eventshub race (# 218)

/lgtm
/approve


Add more load balancing strategies & Extensibility

What should we add or change to make your life better?

In short, I would like to:

Have a generic ILoadBalancingStrategy
Have several implementations of this ILoadBalancingStrategy
Make this extensible somehow

Why is this important to you?
I would like to have more choices when I choose the load balancing strategy.
 The ILoadBalacingStrategy interface has a single Balance method which takes as parameters the list of available endpoints and the load balancing options.
I am unsure how to handle the configuration for the algorithms. Right now I have added configuration to the BackEndConfig.BackEndLoadBalancingOptions, which felt a little odd. :-)

Updated title to be clearer.

Why these algorithms specifically? Have you had situations elsewhere that these were able to address?

 It's not clear that it gains anything by being integrated directly into the LoadBalancer.

A deficit round robin load balancing strategy: to allow round robin taking into account a quantum (see Deficit round robin) and thus providing a "fairer" round robin load balancing strategy

The description sounds like a credit based LeastRequests strategy. I don't see any obvious benefits over the existing algorithms?

A traffic allocation load balancing strategy: to allow inspection into traffic allocation of the endpoints (no matter how that is measured)

Is this an abstract version of LeastBusy with a customizable score? It's hard to know how useful this would be without some examples of how the score might be calculated and if the right primitives are available to do that calculation.

I am unsure how to handle the configuration for the algorithms. Right now I have added configuration to the BackEndConfig.BackEndLoadBalancingOptions, which felt a little odd. :-)

Yes, we do need to figure that out. RoundRobin is the only one so far that's needed any state, and that ones one property.
The ILoadBalancingStrategy abstraction I would hold off on until we worked out how you might flow such implementations and their configurations through the config system.

The ILoadBalancingStrategy abstraction I would hold off on until we worked out how you might flow such implementations and their configurations through the config system.

I will hold off on it until then.

When designing session affinity (https://github.com/microsoft/reverse-proxy/pull/174) we worked out an extensibility model that we should be able to apply here as well. Here's a comparison for what it might look like:

AffinitizedDestinationLookupMiddleware -> LoadBalancingMiddleware
ISessionAffinityProvider -> ILoadBalancingPolicy (new)
SessionAffinityOptions -> LoadBalancingOptions

ILoadBalancer would go away, LoadBalancingMiddleware would become responsible for resolving an IEnumrable<ILoadBalancingPolicy> from DI and finding the right policy for the request/cluster. The LoadBalancingMode enum would go away, we'd use a string name on the options to look up the policy. The five load balancing algorithms we currently support would each be moved to their own ILoadBalancingPolicy implementation. The default algorithm wouldn't change, we'd still use PowerOfTwoChoices.
Load balancing would also get it's own docs article that described how to select a policy, the available policies, and the extensibility mode.


Allow multiple OpenAPI doc builds in a single run

structure of config file changed to allow multiple OpenAPI page builds in a single run (see buildPages list). This was needed for DRS, and makes program more flexible overall

can now specify input OpenAPI, output HTML, output YAML, output JSON filenames for each redoc page

new command line parsing package
Allow --config value to override default .spec-docs.json
ga4gh theme minor update

@jb-adams The CI test workflow is failing. It usually preferable to review PRs once all the tests pass successfully, but in this case I can submit a review.

thanks @tschaffter I'll correct this

@tschaffter the build is working now. You will notice that I split the Github Actions workflows into 2 separate files: one for pushes, and one for PRs. The main difference is that coverage reporting (and publishing of the report) is only run on push builds. This is what was causing PR builds to break.
You'll see here that before this change, the npm run pushCoverageReport step was failing because the COVERALLS_REPO_TOKEN environment variable is unset during PR builds.

I'm still seeing package-lock.json in the repo. Can you confirm?

My bad, yes the lock file is still there.

You will notice that I split the Github Actions workflows into 2 separate files

@jb-adams What about using a single workflow to avoid the duplication of the test code and use an if: statement to jobs to execute them conditionally?

@jb-adams What about using a single workflow to avoid the duplication of the test code and use an if: statement to jobs to execute them conditionally?

Yeah that sounds good but I didn't quite know how to implement :p I'll do a bit of research. Do you know of any environment variable that basically captures "is this a PR build? -> true/false"

ok, the CI has all been placed back into one workflow, with if statements to control whether coverage reporting is run. You can see the successful push build on my fork here, and the successful PR build here.


Update manifests/m/Microsoft/VCRedist/2015+/arm64/14.30.30704.0/Microsoft.VCRedist.2015+.arm64.locale.en-US.yaml

Fixes an issue where this package has multiple different monikers
Microsoft Reviewers: Open in CodeFlow

[Policy] Needs-Attention

@wingetbot run

@wingetbot run


first run at overlays

Signed-off-by: jasmingacic<EMAIL_ADDRESS>Be gentle it is very crude at this point a lot of improv but hold on :D

Testing samples:
OpenApi spec:
components: {}
info:
  title: simple-api
  version: 0.1.0
openapi: 3.0.0
paths:
  /hello:
    get:
      responses:
        "200":
          content:
            application/json:
              example:
                message: Hello from a mocked response!
              schema:
                properties:
                  message:
                    type: string
                type: object
          description: A simple hello world!
  /validated:
    post:
      requestBody:
        content:
          application/json:
            schema:
              properties:
                name:
                  type: string
              required:
                - name
              type: object
      responses:
        "200":
          content:
            text/plain:
              example: Hello mocked Kusk!
              schema:
                type: string
          description: ""

Overlay sample:
overlays: 1.0.0
extends: ./test.yaml
actions:
  - target: "$"
    update:
      x-kusk:
        upstream:
          service:
            name: httpbin
            namespace: default
            port: 8080

run go run cmd/kusk/main.gp generate -i overlay.yaml
Output:

---
apiVersion: gateway.kusk.io/v1alpha1
kind: API
metadata:
  name: simple-api
  namespace: default
spec:
  fleet:
    name: kusk-gateway-envoy-fleet
    namespace: kusk-system
  spec: |
    components: {}
    info:
      title: simple-api
      version: 0.1.0
    openapi: 3.0.0
    paths:
      /hello:
        get:
          responses:
            "200":
              content:
                application/json:
                  example:
                    message: Hello from a mocked response!
                  schema:
                    properties:
                      message:
                        type: string
                    type: object
              description: A simple hello world!
      /validated:
        post:
          requestBody:
            content:
              application/json:
                schema:
                  properties:
                    name:
                      type: string
                  required:
                  - name
                  type: object
          responses:
            "200":
              content:
                text/plain:
                  example: Hello mocked Kusk!
                  schema:
                    type: string
              description: ""
    x-kusk:
      upstream:
        service:
          name: httpbin
          namespace: default
          port: 8080


Code for the asap-genetics repo

Description
Adding modules for the asapdiscovery-genetics repo,  including blast search, sequence alignment and structure alignment code. Code needs revision before approval.
Todos
Notable points that this PR has either accomplished or will accomplish.

[ ] Implement code for sequence and structure similarity between protein sequences

Questions

[ ] Question 1 ..

Status

[ ] Code needs revision
[ ] Structure alignment with ColabFold to be added

Developers certificate of origin

[x] I certify that this contribution is covered by the MIT license as defined in our LICENSE and adheres to the Developer Certificate of Origin.

I'll fix the test #910


MongoDB Community automatic decryption

Hi. I noticed the PersonHandler class is performing decryption on the application itself - the repository is done against a EncryptedPerson class. CSFLE on Community edition should support automatic decryption at the DB level, is there a reason why it is done manually here?

Marcel, could you please clarify the statement, "community edition should support automatic decryption at a DB level" ?
Since by default you data will remain encrypted at rest. CSFLE is how you can access your data in the client. Automatic field level encryption in the client is restricted to the enterprise version.
Let's us know if this helps?

From: Marcel Riera @.>
Sent: Thursday, June 10, 2021 11:46:17 PM
To: paychex/mongo-csfl-encryption-java-demo @.>
Cc: Subscribed @.***>
Subject: [paychex/mongo-csfl-encryption-java-demo] MongoDB Community automatic decryption (#2)
Hi. I noticed the PersonHandler class is performing decryption on the application itself - the repository is done against a EncryptedPerson class. CSFLE on Community edition should support automatic decryption at the DB level, is there a reason why it is done manually here?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHubhttps://github.com/paychex/mongo-csfl-encryption-java-demo/issues/2, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABXOU6II3KGJGU46O4Y5UNLTSGBITANCNFSM46P25PUQ.

Hey Visweshwar, thanks for the quick response.
Yes the automatic field level encryption feature is restricted to the enterprise edition. However, automatic decryption is still available for the Community edition as well.
I'm in the process of implementing encryption using MongoDB Community edition as a POC for our app and I saw your article (very well written by the way, thank you). I was curious if this example could leverage automatic decryption, removing the decryption part?
https://mongodb.github.io/mongo-java-driver/3.11/javadoc/com/mongodb/AutoEncryptionSettings.html
Automatic encryption is an enterprise only feature that only applies to operations on a collection. Automatic encryption is not supported for operations on a database or view and will result in error. To bypass automatic encryption, set bypassAutoEncryption=true in AutoEncryptionSettings.

Explicit encryption/decryption and automatic decryption is a community feature, enabled with the new com.mongodb.client.vault.ClientEncryption type.

Thanks


The default ApplicationInsights.config file example looks not correct

In your example on the page (see attachment) It differs only in ExcludedType => Event and in next section it  Includes Types => Event
Is it correct?
Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 2f4c906d-7abe-eab7-331a-120230344583
Version Independent ID: ab24ade5-5e4c-b430-c3f8-2a00073e9e81
Content: Telemetry sampling in Azure Application Insights - Azure Monitor
Content Source: articles/azure-monitor/app/sampling.md
Service: azure-monitor
Sub-service: application-insights
GitHub Login: @AaronMaxwell
Microsoft Alias: aaronmax

@VaclavRoncka - Thanks again for bringing this to our attention. We have updated the Doc and it will be live once its merged after the content freeze is done on 23rd.  We will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion and we will reopen the issue.


Saas Fulfilment Webhook Id is not a GUID

With reference to https://docs.microsoft.com/en-us/azure/marketplace/partner-center-portal/pc-saas-fulfillment-api-v2#implementing-a-webhook-on-the-saas-service, the expected payload received by Webhooks is defined as:
{
"id": "<this is a GUID operation id, you can call operations API with this to get status>",
"activityId": "",
"subscriptionId": "",
"publisherId": "<this is the publisher’s name>",
"offerId": "",
"planId": "",
"quantity": "<the number of seats, will be null if not per-seat saas offer>",
"timeStamp": "2019-04-15T20:17:31.7350641Z",
"action": "Unsubscribe",
"status": "NotStarted"
}
but the actual data id value received was a string which caused Json serialisation error:
Error converting value "org:guid,guid" to type 'System.Guid'. Path 'id', line 1, position 85.
And  "org:guid,guid" could not be used in subsequent calls to retrieve operation status.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: fe8750da-cb47-7396-8d1b-0abff019a0be
Version Independent ID: b19143ed-64c0-1554-5ac9-610513382609
Content: SaaS Fulfillment API v2
Content Source: articles/marketplace/partner-center-portal/pc-saas-fulfillment-api-v2.md
Service: marketplace
GitHub Login: @qianw211
Microsoft Alias: evansma

@jiahuachoo Thanks for the comment. We are actively looking into it. We will update you soon.

@qianw211 Can you please review this?

The same behaviour is observed with the resolve endpoint:
https://marketplaceapi.microsoft.com/api/saas/subscriptions/resolve?api-version=2018-08-31
returns:
{
"id": "NKVM-5HZ2-ASA-PGB",
"subscriptionName": "",
"offerId": "",
"planId": "",
"quantity": 1
}
whereas the document (https://docs.microsoft.com/en-us/azure/marketplace/partner-center-portal/pc-saas-fulfillment-api-v2) mentioned id is a guid.

@jiahuachoo This issue has been fixed.  New purchases will result in GUID.  Thanks!
#please-close

Can this issue be reopened.  The issue is happening again.  It appears to only occur when the update is initiated from the Marketplace.  if initiated from the ISV it seems to work as described in https://docs.microsoft.com/en-us/azure/marketplace/partner-center-portal/pc-saas-fulfillment-api-v2#implementing-a-webhook-on-the-saas-service
 {
   "id":"org:594e91a9-c6d8-4c2e-be51-722253734a9a,3bdea509-507a-59bd-10ff-e7deb9cd216d",
   "activityId":"aa821975-f8c4-4e99-8e12-f06a95486bd3",
   "subscriptionId":"subid",
   "publisherId":"publisher",
   "offerId":"offerid",
   "planId":"preview",
   "quantity":"4",
   "timeStamp":"2020-02-07T20:27:10.7294526Z",
   "action":"ChangeQuantity",
   "status":"Succeeded",
   "Success":true
}


storage.tag or storage.tags?

I think the subject says it all. Almost all of our stores are plural. However, it is storage.tag, not storage.tags.
My suggestion: make one an alias of the other, so that both work and refer to the same object.
(I bring it up because I keep typing storage.tags['name'] = object, getting an error, and having to correct it.)

I have the same problem :) So let's change that. For backwards compatibility let's keep both. Btw. We could have an AliasStore which is stored itself so a user could (not sure if that is recommended) add aliases. E.g. storage.frames -> storage.snapshots.
For now just add in the __init__ at some point : self.tags = self.tag

I have the same problem

Glad I'm not just crazy! :-)

We could have an AliasStore which is stored itself so a user could (not sure if that is recommended) add aliases.

I think that might be overly complicated, especially because it would mean that one research group's standard terminology when working with OPS might differ from another, making it hard for the community to help each other.
I think the simple alias for this case is the best idea.

Agreed. I originally wanted a really short word to, well, keep it short. We might just use storage['name'] = ... instead of storage.tags['name'], but I need to make sure that does not comflict with the netcdf API.
So let's just add this one line for now.

I can put this in as part of #662 or we do a separate one. The change is simple but need to update some examples as well.

Make it a separate PR, please.
Also, for the time being, can we have support for both words? This is already in use. We can deprecate it for 2.0, and update the examples to provide the preferred version, but we should stay backward-compatible. (Easy enough to have .tag map directly to .tags)


Migrate to Closure Compiler v20150126

Migrate to the latest version of the Closure Compiler i.e. v20150126

Done.


Updated theme to support ghost's builtin navigation helper.

As per  #19 - Updated theme to support ghost's builtin navigation helper. Added hack to tag.hbs to support tag specific rss.

Looks good, thanks! Too bad we don't have access to the tag helper anymore. :(


CompileError when I tried to generate projectSolution for Epic official Demo Lyra

Lots of same tpyeDefine errors in generated code file and this blocked the UnrealEdtor
When I tried to fix up those errors and  then recompiled it , this file will regenerate automatically

https://github.com/UnrealSharp/UnrealSharp/pull/251


"amdgpu_device_initialize: DRM version is 2.50.0" with two videocards: radeon+amdgpu

i have 2 videocards: radeon+amdgpu
and have error:
VK_ICD_FILENAMES=/etc/vulkan/icd.d/amd_icd64.json vulkaninfo
amdgpu_device_initialize: DRM version is 2.50.0 but this driver is only compatible with 3.x.x.
WARNING: [Loader Message] Code 0 : terminator_CreateInstance: Failed to CreateInstance in ICD 0.  Skipping ICD.
Cannot create Vulkan instance.
This problem is often caused by a faulty installation of the Vulkan driver or attempting to use a GPU that does not support Vulkan.
/build/vulkan-tools-KEbD_A/vulkan-tools-<IP_ADDRESS>+dfsg1/vulkaninfo/vulkaninfo.h:371: failed with ERROR_INCOMPATIBLE_DRIVER

but i have vulkan with mesa:
vulkaninfo
...
VK_LAYER_MESA_device_select (Linux device selection layer) Vulkan version 1.1.73, layer version 1:
        Layer Extensions: count = 0
        Devices: count = 6
                GPU id  : 0 (AMD RADV PITCAIRN (ACO))
                Layer-Device Extensions: count = 0
                GPU id  : 1 (llvmpipe (LLVM 10.0.1, 256 bits))
                Layer-Device Extensions: count = 0
                GPU id  : 2 (llvmpipe (LLVM 10.0.1, 256 bits))
                Layer-Device Extensions: count = 0
                GPU id  : 3 (AMD RADV PITCAIRN (ACO))
                Layer-Device Extensions: count = 0
                GPU id  : 4 (llvmpipe (LLVM 10.0.1, 256 bits))
                Layer-Device Extensions: count = 0
                GPU id  : 5 (AMD RADV PITCAIRN (ACO))
                Layer-Device Extensions: count = 0
...
VK_LAYER_MESA_overlay (Mesa Overlay layer) Vulkan version 1.1.73, layer version 1:
...
VkPhysicalDeviceDriverProperties:
---------------------------------
        driverID           = DRIVER_ID_MESA_RADV
        driverName         = radv
        driverInfo         = Mesa 20.3.0-devel (git-728061b 2020-09-30 focal-oibaf-ppa) (ACO)
        conformanceVersion = <IP_ADDRESS>
...

dpkg -S /etc/vulkan/icd.d/amd_icd64.json
amdvlk:amd64: /etc/vulkan/icd.d/amd_icd64.json

apt policy amdvlk
amdvlk:
  Installed: 2020.Q3.6
  Candidate: 2020.Q3.6
  Version table:
 *** 2020.Q3.6 500
        500 http://repo.radeon.com/amdvlk/apt/debian bionic/main amd64 Packages

lspci |grep VGA
00:01.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Richland [Radeon HD 8650G]
01:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Neptune XT [Radeon HD 8970M]

DRI_PRIME=0 glxinfo |grep "DRM" -i
    Device: AMD ARUBA (DRM 2.50.0 / 5.8.12-050812-lowlatency, LLVM 10.0.1) (0x990b)
OpenGL renderer string: AMD ARUBA (DRM 2.50.0 / 5.8.12-050812-lowlatency, LLVM 10.0.1)

DRI_PRIME=1 glxinfo |grep "DRM" -i
    Device: AMD Radeon(TM) HD8970M (PITCAIRN, DRM 3.38.0, 5.8.12-050812-lowlatency, LLVM 10.0.1) (0x6801)
OpenGL renderer string: AMD Radeon(TM) HD8970M (PITCAIRN, DRM 3.38.0, 5.8.12-050812-lowlatency, LLVM 10.0.1)

hwinfo --gfxcard
1)
  Model: "ATI Richland [Radeon HD 8650G]"
  Vendor: pci 0x1002 "ATI Technologies Inc"
  Device: pci 0x990b "Richland [Radeon HD 8650G]"
  SubVendor: pci 0x1462 "Micro-Star International Co., Ltd. [MSI]"
  SubDevice: pci 0x10ef
  Driver: "radeon"
  Driver Modules: "radeon"
2)
  Model: "Micro-Star International Co., Ltd. [MSI] Radeon R9 M290X"
  Vendor: pci 0x1002 "ATI Technologies Inc"
  Device: pci 0x6801 "Neptune XT [Radeon HD 8970M]"
  SubVendor: pci 0x1462 "Micro-Star International Co., Ltd. [MSI]"
  SubDevice: pci 0x1117 "Radeon R9 M290X"
  Driver: "amdgpu"
  Driver Modules: "amdgpu"

uname -a
Linux ... 5.8.12-050812-lowlatency #202009261732 SMP PREEMPT Sat Sep 26 17:38:20 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

ubuntu 20.04
Kernel command line: ... radeon.runpm=1 radeon.dpm=1 amdgpu.runpm=0 amdgpu.dpm=1 amdgpu.dc=1 radeon.si_support=0 radeon.cik_support=0 amdgpu.si_support=1 amdgpu.cik_support=1

This limitation is from libdrm
amdgpu_device.c, drm_public int amdgpu_device_initialize()
version = drmGetVersion(fd);
if (version->version_major != 3) {
fprintf(stderr, "%s: DRM version is %d.%d.%d but this driver is "
"only compatible with 3.x.x.\n",
func,
version->version_major,
version->version_minor,
version->version_patchlevel);
drmFreeVersion(version);
r = -EBADF;
goto cleanup;
}

can it be fixed?
need i create new issue in other project?

AMDVLK driver base on new amdgpu driver module.
For this vulkaninfo drm warning issue with AMDVLK, we will fix it.

any news?

Fixed in internal.

@jl452 please check if the issue is fixed with Q4.4 release

@jinjianrong fixed, thanks
VK_ICD_FILENAMES=/etc/vulkan/icd.d/amd_icd64.json vulkaninfo
...
        Device Group Properties (Group 0):
        ----------------------------------
                physicalDeviceCount: count = 1
                        AMD Radeon(TM) HD8970M (ID: 0)
                subsetAllocation = 0
        Device Group Present Capabilities (Group 0):
                AMD Radeon(TM) HD8970M (ID: 0)
                Can present images from the following devices:
                        AMD Radeon(TM) HD8970M (ID: 0)

dpkg -S /etc/vulkan/icd.d/amd_icd64.json
amdvlk:amd64
 *** 2020.Q4.5 500
        500 http://repo.radeon.com/amdvlk/apt/debian bionic/main amd64 Packages


Google Or Tools error when "make java" in linux

ORIGIN/../dependencies/install/lib'
objs/swig/sat_java_wrap.o: In function Swig::ExceptionMatches(JNIEnv_*, _jthrowable*, char const*)': sat_java_wrap.cc:(.text+0x299): multiple definition of Swig::ExceptionMatches(JNIEnv_, _jthrowable, char const*)'
objs/swig/constraint_solver_java_wrap.o:constraint_solver_java_wrap.cc:(.text+0x1501d): first defined here
collect2: error: ld returned 1 exit status
make: *** [lib/libjniortools.so] Error 1

Which distribution?

Which version of SWIG ?

Thanks for all of your reply, below are my running environments:
Swig: 3.0.5
Jdk:  1.8.0_262
Python 3.6.9
Ruby: 2.0.0p648 (2015-12-16)
gcc/g++: 4.9.2
cmake: 3.6.2
os: Centos 7
Try to make java version of google or-tools from "stable" branch.
By the way, actually I am trying to use flatzinc version of or-tools inside Java projects. The binary version only contains flatzinc-or-tools.exe/.so, and I don't want to only use them in command line tools. That's why I try "make java" version of or-tools.
Thanks a million!

I believe you need a later swig (3.0.12 at least IMO).
Le lun. 10 août 2020 à 17:10, frankcheng1991<EMAIL_ADDRESS>a
écrit :

Thanks for all of your reply, below are my running environments:
Swig: 3.0.5
Jdk: 1.8.0_262
Python 3.6.9
Ruby: 2.0.0p648 (2015-12-16)
gcc/g++: 4.9.2
cmake: 3.6.2
os: Centos 7
Try to make java version of google or-tools from "stable" branch.
By the way, actually I am trying to use flatzinc version of or-tools
inside Java projects. The binary version only contains
flatzinc-or-tools.exe/.so, and I don't want to only use them in command
line tools. That's why I try "make java" version of or-tools.
Thanks a million!
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/google/or-tools/issues/2132#issuecomment-671413571,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACUPL3LCPLB5LK6DUHWO3KLSAAEU3ANCNFSM4PZQD7XA
.

Note that the de solver has no API to get a solution. It only outputs to
stdout.
Le lun. 10 août 2020 à 17:24, Laurent Perron<EMAIL_ADDRESS>a écrit :

I believe you need a later swig (3.0.12 at least IMO).
Le lun. 10 août 2020 à 17:10, frankcheng1991<EMAIL_ADDRESS>a
écrit :

Thanks for all of your reply, below are my running environments:
Swig: 3.0.5
Jdk: 1.8.0_262
Python 3.6.9
Ruby: 2.0.0p648 (2015-12-16)
gcc/g++: 4.9.2
cmake: 3.6.2
os: Centos 7
Try to make java version of google or-tools from "stable" branch.
By the way, actually I am trying to use flatzinc version of or-tools
inside Java projects. The binary version only contains
flatzinc-or-tools.exe/.so, and I don't want to only use them in command
line tools. That's why I try "make java" version of or-tools.
Thanks a million!
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/google/or-tools/issues/2132#issuecomment-671413571,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACUPL3LCPLB5LK6DUHWO3KLSAAEU3ANCNFSM4PZQD7XA
.

gcc also looks a bit dated

The problem has been resolved by upgrading Swig from 3.0.5 to 3,0.12.
Thanks a lot again!
I will close this issue.


Can't refund a collective to collective transaction

I was trying to refund a transaction made by the up-we-rise collective: https://opencollective.com/up-we-rise/transactions to /brusselstogether
From the api logs on production:
 2019-04-15T20:45:04.507427+00:00 app[web.1]: error: GraphQL v1 error: paymentMethod.refundTransaction is not a function

Can we fix that?

There's a issue for that: https://github.com/opencollective/opencollective/issues/1656
The refund method for this payment method has never been implemented.

As a quick win, maybe they can be simply deleted instead of processing the refund like Stripe / Credit Cards.

We should keep collective to collective donations.
If it's on the same host, deleting these would do the job but I'd argue it's as easy to create the reverse transaction no? So that we have a trace which is always preferable.


added toast for notification

Describe the feature
added a toast feature for notification on login ,register and while reset password and previously it was just alert
Add ScreenShots

Record

[X] I agree to follow this project's Code of Conduct
[X] I'm a GSSOC'24 contributor
[X] I want to work on this issue

assign me this @anuragverma108

@huamanraj , i want to work on the issue #283 under Gssoc2024

@huamanraj , i want to work on the issue #283 under Gssoc2024

work on it but take care of the theme and design and responsive page!

@huamanraj i had made a made pull request of same @anuragverma108 has rejected that It was not assigned by a project admin

Done


access permissions per environment

see https://docs.wodby.com/team/

Now that RBAC is available in 1.0.0 - permissions can be set differently for production/development environments


Fixed issue #74 (string replace is no longer required)

Replacing spaces with '+' is no longer required for the search parameter within the driver_stats method.

This looks good to me, would you mind adding a test for this method in client_test.py? I am not sure why there isn't one in there already but it would be good for a sanity check that this returns real data


Move API headers inside the component

This is similar in spirit to https://github.com/Qiskit/documentation/issues/948. There, we were proposing getting rid of the header entirely, and we decided to not do it for a few reasons:

We like the visual design of having the header
Our search differentiates between headers vs body, and we want to keep the header as a search entry
The header should show up in the right page ToC (if it's the correct level w/ module pages)
The header makes the anchor link experience consistent with the rest of the platform and simpler to implement, such as avoiding issues with overloaded signatures (semi-related to https://github.com/Qiskit/qiskit_sphinx_theme/pull/458)

Unlike #948, this is not proposing removing headers entirely. Instead, it proposes moving the header inside the code component, and replacing the <h3>-<h6> element with <dl>, <dt>, and <dd> for better HTML semantics.
Before:

After (proof-of-concept):

Motivation
We noticed in https://github.com/Qiskit/qiskit/pull/12403#pullrequestreview-2058568298 that the header living above the code object and its margin-top is resulting in unclear API docs where it is not clear which text describes the code object.
This proposal is meant to make the code component more self-contained, that the entire definition is in one place and contained by the left colored bar.
@jakelishman is also correct in https://github.com/Qiskit/qiskit/pull/12403#issuecomment-2113278154 that the HTML semantics would be more appropriate to use <dl>, <dt>, and <dd> rather than <h3> because indeed these code components are giving a single self-contained definition, rather than defining a new heading section that applies to all content beneath it. Improving the HTML modeling better complies with semantic web, which helps accessibility and SEO. (Note that we can still style <dl> however we want!)
Implementation
Styling & levels
We will style the <dt> similar to <h3> - <h6>, although it should have less margin-top.
TBD if the <dt> should render differently based on the surrounding headers. For example, https://docs.quantum.ibm.com/api/qiskit/dev/circuit#bits-and-registers is an h3; should the <dt> look like an <h4> or <h3>?
Option 1: h4

Option 2: h3

For inline classes, what about their methods? Should they still look like a smaller header than their owning class?
example of inline class using h4 and h5

Note that the level we use for styling does not need to be the same as the level we use for the Page ToC! That is unlike the current implementation. This is more flexible.
Page ToC
The Page ToC code will need to be modified to read the <dt> from these components. We'll need to know the "level" because we only show h1-h3 on class pages and h2-h3 on module pages, so we should not show any <dt> where the level >3.
Search
We need to teach the search index script (parseDocument.ts) to treat these <dt>s as headers. We should probably always treat <dt> as a header for search - note that we don't ever use <dt> atm.
Anchor tag
We need to preserve this mechanism

Thank you so much for this! I know it's probably not the biggest priority, but it'll be great to have it.

This change looks sensible to me - as for styling I dont really have strong feelings between option 1 or 2, maybe option 2 is slightly nicer?


Text not visible with Todoist dark theme

Environment details

Operation system: Windows 10
Extension version: 1.11.1

Expected behavior
Click "Start timer" and see task name
Actual behavior
Task name is white text on a white background
Steps to reproduce the behavior

Apply Todoist dark theme (dark background, white text)
Click "Start Timer" on a task

Additional details
The Todoist dark theme was just released this week.

screenshots or screencapture

Hi!
Thank you for your submission. Fix has been already merged to master so, please hold on and wait for update 🙏


support SwiftUI

doesn't seem necessary to support SwiftUI.
It already exists in SwiftUI.
SwiftUI supports custom(_:size:relativeTo:)method for dynamic type, upper iOS14


Added variable for composer command path

Now we can specify a path for the composer command, avoiding the download

Q
A

Bug fix?
no

New feature?
yes

BC breaks?
no

Deprecations?
no

Fixed tickets
-

why are we need this feature?

Because sometimes we have composer on the server, but cannot be reached with a simple composer. On a server I use for deploy the command is composer.phar. With this setting we can avoid downloading composer

Yes. Can you add a PR to document about this feature ?

Docs added!

But you can always add it. In .bashrc:
alias composer='/bin/composer'

Ok, seems fair :+1:

@elfet I checked and I already had that line in my .bashrc
The problem lies in the commandExist function. The hash command doesn't "follow" aliases. Maybe you should change that to command.
http://stackoverflow.com/questions/592620/check-if-a-program-exists-from-a-bash-script

We keep composer.phar in project repository to keep its version under control - there were some situations when phar file on getcomposer was broken or installation based on the same composer.lock gave us different results on different composer.phar versions (dev vs prod)...
:+1: for feature

Thank you!

Awesome!

Another usecase: sometimes there are various PHP versions available for CLI and you want to ensure the correct one is used. With this change you can simply prepend it, thus :+1:


Add arm-linux-gnueabi-gcc build

Description
Add a build with arm-linux-gnueabi-gcc - compared to existing Arm builds, this allows building the programs and tests, in order to catch platform-dependent issues there too (previously we only cross-built the library to Arm).
See https://github.com/ARMmbed/mbedtls/pull/3449#issuecomment-675313720
See also. https://github.com/ARMmbed/mbedtls/issues/3299
Status
READY
Requires Backporting
Yes - testing improvement

[ ] 2.16
[ ] 2.7

Additional comments
The newly added test on Travis is expected to fail until #3449 is merged.
This PR depends on https://github.com/ARMmbed/mbedtls-test/issues/150 plus installing arm-linux-gnueabi on the Docker images used by Jenkins.

Thanks @mpg for this PR! Can we go one step further and use QEMU and syscall emulation to actually run our test suites? I've done this locally lately and it didn't require any change to the test scripts - once the tooling is setup correctly, the system will detect the target architecture for binaries automatically and transparently hook in QEMU.

Yes, sure, that would be a great improvement! But I'd rather take an incremental approach and add qemu in a follow-up PR - feel free to submit one if you already have something working locally.
(Also, I'm not sure if you're aware, but at the moment we can't easily update the Docker images used by our Jenkins CI, there are a couple of things we need to address before we can do that again, see https://github.com/ARMmbed/mbedtls-test/issues/150 - so for now we can only install additional software on Travis.)

@mpg Ok, let's leave it to another PR.

(Also, I'm not sure if you're aware, but at the moment we can't easily update the Docker images used by our Jenkins CI, there are a couple of things we need to address before we can do that again, see ARMmbed/mbedtls-test#150 - so for now we can only install additional software on Travis.)

Yes, @dgreen-arm told me about it, and that was the reason I didn't pursue adding Arm tests to the CI anymore (my main interest is getting tests for #1424), but I overlooked Travis, which is also a good start.

The CI is failing because Jenkins has a check to make sure it can run all the components, which makes sense, but prevents us from merging this PR before we've updated the Docker images, so this PR also depends on https://github.com/ARMmbed/mbedtls-test/issues/150

@ronald-cron-arm Thanks for your review! I've rebased to resolve the conflicts, and applied the suggested fix in the original commit since I was rebasing anyway.

From the CI it seems that the check to run build_arm_linux_gnueabi_gcc_arm5vte only if the gcc-arm-llinux-gnueabi is installed does not work.

From the CI it seems that the check to run build_arm_linux_gnueabi_gcc_arm5vte only if the gcc-arm-llinux-gnueabi is installed does not work.

Jenkins correctly reports "Unable to run all.sh components: build_arm_linux_gnueabi_gcc_arm5vte", so I think the check works and the Jenkins job notices it can't run this component (as opposed to trying to run it and then failing) but it was also designed to not silently skip components it can't run and fail instead. I think that part is fully expected as long as we haven't installed the toolchain in our Docker image (which is why this PR was stalled).
I'm more worried about the failure in Travis, apparently our install is not complete. (The test passes on my machine, so I must have the right package but now I need to identify which one it is.)

OK, Travis is passing now. Now we're waiting for https://github.com/ARMmbed/mbedtls-test/issues/165 to update the Docker image.

Jenkins correctly reports "Unable to run all.sh components: build_arm_linux_gnueabi_gcc_arm5vte", so I think the check works and the Jenkins job notices it can't run this component (as opposed to trying to run it and then failing) but it was also designed to not silently skip components it can't run and fail instead. I think that part is fully expected as long as we haven't installed the toolchain in our Docker image (which is why this PR was stalled).

ok thanks for the explanation.

Do you mind if I rebase this on recent development? This would avoid the distracting failure of the API/ABI checker.

Please go ahead and rebase.


Deploy: convert import data and misc improvements

Included PRs:

#186
#185
#183
#175
#179
#177

Also notable is that this deploy adds an Aptfile which is used by the Heroku apt buildpack so that we can install the binary for charlock_holmes. More in #186.


support more types

first commit: add support for more type nodes, don't allow combining standalone types, proper union and intersection type representations, add proper support for try block caught types
second commit: add a small integration test runner, each test folder must contain code.php, if the code is will result in lexer errors, lexer-error.txt must be created next to code.php containing the formatted error, if the code is will result in parser errors, parser-error.txt must be created next to code.php containing the formatted error.

@ryangjchandler let me know if i should split this into multiple PRs! was just playing around with the project and found myself doing too many things at once ^^"

Hey @azjezz, thanks for spending some time on this. I'll need all the help I can get to make this production-ready!
I'm fine with all these changes being in a single PR, so that's fine. Once we've got some releases etc, I'll likely move to a stricter separation in PRs for changelog purposes.
Couple of small comments from me, I'll check this out in a bit and run it through properly. Looks good at a quick glance though :^)

@ryangjchandler great! expect few more PRs then 😛

brought #122 and add support for callable and iterable, i also found a bug where uppercase type names are considered identifiers, fixed it :)


Fix incorrect parameter name

#58923

@cuwaters : Thanks for your contribution! The author(s) have been notified to review your proposed change.

#sign-off


EKG Assumes Local Connection & Won't Work If Remote - EKG.md

On EKG.MD we say "On our local machine, we can go to <IP_ADDRESS>:8080 in our browser and see the EKG monitoring information." If users have followed instructions they will not be able to perform this step unless they install a desktop and export the display. We need to provide instructions here for how to connect to the web browser from an external IP address. Am assuming here that EKG comes as part of the Cardano installation as there are no instructions to do so.

This issue is addressed in the very first paragraph:

For security reasons, EKG can normally only be used to monitor a node running on the local machine. In order to monitor a node running on an AWS instance, we must work around this. We will use port forwarding in this tutorial: When we use Open SSL to connect to our instance, we can forward port 8080 on our local machine to port 12788 on the AWS instance as follows:

ssh -L 8080:<IP_ADDRESS>:12788 -i  ec2-user@


Bug: Images disappear every 24h/ after redeploy

Files in active Storage get deleted every 24h/ after redeploy
Problem Description
Problem: Because of Heroku Internals, Images in the Active Storage get deleted after redeploy or restart (24h)
Expected: Images should be persistent throughout redeploy and restart

Steps For Reproduction

Create an Item with an Image and wait 24h/for a redeploy or (2.)
1b. Go to https://bookkeeper-blue-dev.herokuapp.com/items
click "show Item" for one of the items
The Image will not be visible

Information & Solution

Info (Heroku Doku)
A solution and best practices is described here^^

We will save the images in the database as blobs


TypeError: 'JavaPackage' object is not callable when running pydeequ

Describe the bug
I've got an exception when I try to run pydeequ: "TypeError: 'JavaPackage' object is not callable".
To Reproduce
Steps to reproduce the behavior:

pip install pydeequ==0.1.5
Code:

from pyspark.sql import SparkSession, Row
import pydeequ

spark = (SparkSession
    .builder
    .config("spark.jars.packages", pydeequ.deequ_maven_coord)
    .config("spark.jars.excludes", pydeequ.f2j_maven_coord)
    .getOrCreate())

df = spark.sparkContext.parallelize([
            Row(a="foo", b=1, c=5),
            Row(a="bar", b=2, c=6),
            Row(a="baz", b=3, c=None)]).toDF()

from pydeequ.analyzers import *

analysisResult = AnalysisRunner(spark) \
                    .onData(df) \
                    .addAnalyzer(Size()) \
                    .addAnalyzer(Completeness("b")) \
                    .run()

analysisResult_df = AnalyzerContext.successMetricsAsDataFrame(spark, analysisResult)
analysisResult_df.show()

Execute the code above
See error:
TypeError: 'JavaPackage' object is not callable

Expected behavior
I was expecting the results of the analyzer.
Screenshots
If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

Apache Spark 3.0.0
Scala 2.12
Pydeequ = 0.1.5

Additional context
I'm running it on a Databricks cluster.
Thank you for your help.

@NastasiaSaby The problem that jumps out at me is that you are using Spark 3.0, which we don't support yet. The latest Spark version we support is 2.4.7.
We can't support Spark 3.0 until Deequ compiles to Scala 2.12 (which is required for Spark 3.0). This is an issue with Deequ as well. Notably, this person opening this issue had the same error as you.

Thank you for your answer. I downgraded my cluster to Spark 2.4.5, Scala 2.11. Unfortunately, I'm still getting the error with this new stack trace:
TypeError                                 Traceback (most recent call last)
<command-726420478794624> in <module>
      1 from pydeequ.profiles import *
      2
----> 3 result = ColumnProfilerRunner(spark) \
      4     .onData(df) \
      5     .run()

/local_disk0/.ephemeral_nfs/envs/pythonEnv-3b335b2c-7675-473f-9bce-da0935f38d85/lib/python3.7/site-packages/pydeequ/profiles.py in __init__(self, spark_session)
     27         self._sc = spark_session.sparkContext
     28         self._jvm = spark_session._jvm
---> 29         self._ColumnProfilerRunner = self._jvm.com.amazon.deequ.profiles.ColumnProfilerRunner()
     30
     31     def onData(self, df):

I'm using the Databricks platform. Is there a known limitation?

I get the same issue

This is not linked to pyspark=3.0.1. I've got the issue with Spark 2.4.5 Scala 2.11.

We have not tested with databricks yet, but here is how you'd get started with an Amazon EMR cluster -- I presume there may be some overlap here! Copy and pasted below:
Your EMR cluster must be running Spark v2.4.6 in order to work with PyDeequ. Once you have a running cluster that has those components and a SageMaker notebook with the necessary permissions, you can configure a SparkSession object from the below template to connect to your cluster. If you need a refresher on how to connect a SageMaker Notebook to EMR, check out this AWS blogpost on using Sparkmagic.
Once you’re in the SageMaker Notebook, run the following JSON in a cell before you start your SparkSession to configure your EMR cluster.
%%configure -f
{ "conf":{
          "spark.pyspark.python": "python3",
          "spark.pyspark.virtualenv.enabled": "true",
          "spark.pyspark.virtualenv.type":"native",
          "spark.pyspark.virtualenv.bin.path":"/usr/bin/virtualenv",
          "spark.jars.packages": "com.amazon.deequ:deequ:1.0.3",
          "spark.jars.excludes": "net.sourceforge.f2j:arpack_combined_all"
         }
}

Start your SparkSession object in a cell after the above configuration by running spark, then use the SparkContext (default named sc) to install PyDeequ onto your cluster like so
sc.install_pypi_package('pydeequ')

I'm trying to run the example from the tutorials folder from my local machine. I'm getting the same error as the OP.
Spark Version: 2.4.7
pydeequ==0.1.5
Please look at the image attached below

same issue on spark version 2.4.3.
I'm using 2.4.3 hoping to load pydeequ to glue etl. Do you know if deequ is compatible with glue v2?

same issue on spark version 2.4.3.
I'm using 2.4.3 hoping to load pydeequ to glue etl. Do you know if deequ is compatible with glue v2?

using pyspark --jars {PATH_TO_DEEQ_JAR} resolves this error for me, i think this should be added to the installation steps.

@MOHACGCG I'm trying to find the path to deequ jar so as to try your solution. I'm looking under the virtual env path: /lib/Python3.7/site-packages/pyspark/jars.
However, I don't see any jar corresponding to deequ in there. So I'm considering downloading and copyting deequ jar under this path to be followed by your command referring to this location.
Do you think there is a better alternative to this?

@MOHACGCG The earlier attempt did not work. Also, I think the fourth statement in the code below should do the trick by default in adding the jar files. Cause 'pydeequ.deequ_maven_coord' evaluates to 'com.amazon.deequ:deequ:1.0.3'. Could you shed some light into this @gucciwang ?
spark = (SparkSession
.builder
.config("spark.driver.extraClassPath", classpath)
.config("spark.jars.packages", pydeequ.deequ_maven_coord)
.config("spark.jars.excludes", pydeequ.f2j_maven_coord)
.getOrCreate())

@MOHACGCG I'm trying to find the path to deequ jar so as to try your solution. I'm looking under the virtual env path: /lib/Python3.7/site-packages/pyspark/jars.
However, I don't see any jar corresponding to deequ in there. So I'm considering downloading and copyting deequ jar under this path to be followed by your command referring to this location.
Do you think there is a better alternative to this?

I just downloaded the jar from here and passed it on.

@bballamudi, you are correct!
At the beginning of each of our tutorials, we always start off with the following configuration when setting up our SparkSession. This leverages the maven coordinates of the Deequ jar, and subsequently excluding an outdated Fortran jar. By using the configuration we provide, the SparkSession will automatically fetch the jars from maven.
import pydeequ

import sagemaker_pyspark
from pyspark.sql import SparkSession, Row

classpath = ":".join(sagemaker_pyspark.classpath_jars()) # aws-specific jars

spark = (SparkSession
    .builder
    .config("spark.driver.extraClassPath", classpath)
    .config("spark.jars.packages", pydeequ.deequ_maven_coord)
    .config("spark.jars.excludes", pydeequ.f2j_maven_coord)
    .getOrCreate())

And if you're wondering why we also ref sagemaker_pyspark, it's just so that it allows our SparkSession to read in parquet files from S3. An example of it in action is with the PyDeequ Analyzers tutorial

Thanks @gucciwang for the insight. However, it was not working automatically as intended. Perhaps it was to do with my setup. I followed @MOHACGCG and it works now. Kindly make note of this in the readme file in the interest of larger audience.

experiencing the same issue. solved by using pyspark --jars /path-to-the-jar/deequ-1.0.5.jar
more info:
python version: 3.7.9
spark version: 2.4.7
scala version: 2.13.4

@SerenaLin2020 We have not tested PyDeequ with deequ-1.0.5.jar, so some functionalities may be impaired. Please try with deequ-1.0.3.jar and keep us updated! 😄

pyspark --jars /path-to-the-jar/deequ-1.0.5.jar

Hi SerenaLin2020 - Where did you put that code in your notebook?  Also, are you using a hosted community edition of Databricks?  Where did you physically put the jar file?  Or how did you find it's location?

I had the same issue running deequ in a SageMaker PySpark Processing Job. Solved with @MOHACGCG suggestion.

Download the jar from maven
Pass to SageMaker Spark Processing

Hi, is support for Spark version 3.1.1 supported. I'm currently on AWS emr-6.3.0. Running the below command:
import pydeequ
pydeequ.deequ_maven_coord
Returns: 'com.amazon.deequ:deequ:1.1.0_spark-2.4-scala-2.11'
I take this value (string) and add it to my .json config where all the custom spark config is maintained.
Running my application py files I get the same issue as the folks above.
I assume it is due to the support for the version of Spark.
Any timeline to the implementation for this?
Cheers

@SerenaLin2020 We have not tested PyDeequ with deequ-1.0.5.jar, so some functionalities may be impaired. Please try with deequ-1.0.3.jar and keep us updated! 😄

Tested PyDeequ with deequ-1.0.3.jar , pretty good with some basic metrics such as min, max, mean, compliance etc. Only found that pyspark scripts runs much slower than scala scripts(same logic and same data volume). Not sure if this is pyspark's issue or it's PyDeequ's issue.

@SerenaLin2020 Did you try this on a databricks cluster ?

@SerenaLin2020 Did you try this on a databricks cluster ?

No, I only run this on EMR cluster

I got it to working with databricks by directly installing the jar to the cluster.

I got it to working with databricks by directly installing the jar to the cluster.

Hi Vinura. Could you please let me know how did you do? I want to directly install the jar to the cluster

@MOHACGCG @preshen-goobiah @bballamudi  Can you explain how did you download the jar from maven? I found myself lost in trying to find the way to add the deequ jar to the jars folder.

I installed the following maven package
com.amazon.deequ:deequ:1.1.0_spark-3.0-scala-2.12
you need to check wthr they have an exact match for your cluster and add it as a maven package on the databricks cluster. @anusha610 if you are running it on locally use the spark object as follows,
spark = (SparkSession
.builder
.config("spark.jars.packages", 'com.amazon.deequ:deequ:1.1.0_spark-3.0-scala-2.12')
.config("spark.jars.excludes", pydeequ.f2j_maven_coord)
.getOrCreate())

I installed the following maven package directly instead of pydeequ.deequ_maven_coord
com.amazon.deequ:deequ:1.1.0_spark-3.0-scala-2.12
you need to check wthr they have an exact match for your cluster and add it as a maven package on the databricks cluster. @anusha610 if you are running it on locally(using dbconnect) use the spark object as follows,
spark = (SparkSession .builder .config("spark.jars.packages", 'com.amazon.deequ:deequ:1.1.0_spark-3.0-scala-2.12') .config("spark.jars.excludes", pydeequ.f2j_maven_coord) .getOrCreate())

Hi @vinura , I'm still getting the exact same error even after using your method. Please help. I use Spark 3.0.1 and Scala 2.12

@MOHACGCG  @vinura  - Could you please suggest the script changes for this fix?
Issue: Am facing the similar error using DataBricks with below pydeequ version
Error:  TypeError: 'JavaPackage' object is not callable
python version: 3.7.9
pyspark - 2.4.0
scala version: 2.13.4
- **pydeequ-1.0.1** version

Tried:
Downloaded the suggested Jars and uploaded to Databricks filestore and passed the same for spark session
import pydeequ
import sagemaker_pyspark
from pyspark.sql import SparkSession, Row
classpath = ":".join(sagemaker_pyspark.classpath_jars()) # aws-specific jars
spark = (SparkSession
    .builder
    .config("spark.driver.extraClassPath", classpath)
    .config("spark.jars.packages", '/FileStore/jars/deequ_1_0_5.jar')
    .config("spark.jars.excludes", pydeequ.f2j_maven_coord)
    .getOrCreate())

Attached screenshot of error

Could you please suggest with appropriate version, steps and scripts for data-bricks implementations

If anyone struggles with this. I found this worked for me:

Download the deequ jar corresponding to the correct spark version
In your spark-defaults.conf file add the path of your jar file your downloaded in step1 to the lines below
spark.driver.extraClassPath, spark.executor.extraClassPath

Thanks @gucciwang for the insight. However, it was not working automatically as intended. Perhaps it was to do with my setup. I therefore followed @MOHACGCG instruction in the above comment and it works now. Kindly make note of this in the readme file in the interest of larger audience.

Hello, how did you solve it?
I am running spark in a hadoop cluster, with the following config:
Spark 2.4.4
Scala 2.11.12
And I am creating the spark session like this:
spark = (SparkSession
.builder
.appName("PyDeeQu")
.config("spark.jars", "PATH_TO/deequ-1.1.0_spark-2.4-scala-2.11.jar")
.config("spark.jars.packages", pydeequ.deequ_maven_coord)
.config("spark.jars.excludes", pydeequ.f2j_maven_coord)
.config("spark.sql.execution.arrow.enabled", "true")
.config("spark.sql.sources.partitionOverwriteMode","dynamic")
.getOrCreate())
I keep getting this error: TypeError: 'JavaPackage' object is not callable, and I don't know why...

It works fine with following configuration,
Use https://mvnrepository.com/artifact/com.amazon.deequ/deequ
to pick the deeque version and spark version for spark.jars.package
from pyspark.sql import SparkSession, DataFrame
import pydeequ

def create_spark():
    """Function to get Spark Configuration"""
    spark = (
        SparkSession.builder.config(
            "spark.jars.packages", "com.amazon.deequ:deequ:2.0.1-spark-3.2"
        )
        .config("spark.jars.excludes", pydeequ.f2j_maven_coord)
        .getOrCreate()
    )
    return spark

@vinura , i followed above one . However i have to add two lines of code to state Spark version in "Azure databricks"
from pyspark.sql import SparkSession, DataFrame
import os
os.environ['SPARK_VERSION'] = '3.2'
import pydeequ
spark = SparkSession.builder.config("spark.jars.packages", "com.amazon.deequ:deequ:2.0.1-spark-3.2").config("spark.jars.excludes", pydeequ.f2j_maven_coord).getOrCreate()
The below spark session worked for 3.2
from pyspark.sql import SparkSession, DataFrame
import os
os.environ['SPARK_VERSION'] = '3.2'
import pydeequ
spark2 = SparkSession.builder.appName('xyz').getOrCreate()

@Bhavanabuddy I added the spark version when using databricks connect (IDE/pyCharm) but not when using databricks notebooks.
Either way, I hope this fixes all the problems.

It troubled me for 2 days as well on EMR. Configuration I was trying:
emr-7.2.0,
pyspark: 3.5.1,
Deequ: 1.4.0
When I was using below code, I was continuously getting TypeError: 'JavaPackage' object error
spark = SparkSession.builder.appName("TestDQ") \
    .config("spark.jars.packages", pydeequ.deequ_maven_coord) \
    .config("spark.jars.excludes", pydeequ.f2j_maven_coord) \
    .config("spark.sql.parquet.int96RebaseModeInRead", "CORRECTED") \
    .getOrCreate()

Solution worked for me:

Installed pydeequ==1.4.0 using bootstrap script
pass com.amazon.deequ:deequ:2.0.8-spark-3.5 while spark-submit. e.g. spark-submit --packages com.amazon.deequ:deequ:2.0.8-spark-3.5
while initializing spark, used below code:

spark = SparkSession.builder.appName("TestDQ") \
    .config("spark.jars.excludes", pydeequ.f2j_maven_coord) \
    .config("spark.sql.parquet.int96RebaseModeInRead", "CORRECTED") \
    .getOrCreate()

Thanks

I was able to combine some of the above solutions and other solutions and get pydeeque working on Azure Databricks in a notebook. Here are the details, if helpful for anyone.
From this link, I downloaded the appropriate JAR file to match my Spark version. In my case, that was deequ_2_0_1_spark_3_2.jar. I then installed this file using the JAR type under Libraries in my cluster configurations.
The following then worked, ran in different cells.
%pip install pydeequ

%sh export SPARK_VERSION=3.2.1

df =<EMAIL_ADDRESS>
from pyspark.sql import SparkSession

import pydeequ

spark = (SparkSession
    .builder
    .getOrCreate())

from pydeequ.analyzers import *

analysisResult = AnalysisRunner(spark) \
                    .onData(df) \
                    .addAnalyzer(Size()) \
                    .addAnalyzer(Completeness("b")) \
                    .run()

analysisResult_df = AnalyzerContext.successMetricsAsDataFrame(spark, analysisResult)
analysisResult_df.show()

I was able to combine some of the above solutions and other solutions and get pydeeque working on Azure Databricks in a notebook. Here are the details, if helpful for anyone.
From this link, I downloaded the appropriate JAR file to match my Spark version. In my case, that was deequ_2_0_1_spark_3_2.jar. I then installed this file using the JAR type under Libraries in my cluster configurations.
The following then worked, ran in different cells.
%pip install pydeequ

%sh export SPARK_VERSION=3.2.1

df =<EMAIL_ADDRESS>
from pyspark.sql import SparkSession

import pydeequ

spark = (SparkSession
    .builder
    .getOrCreate())

from pydeequ.analyzers import *

analysisResult = AnalysisRunner(spark) \
                    .onData(df) \
                    .addAnalyzer(Size()) \
                    .addAnalyzer(Completeness("b")) \
                    .run()

analysisResult_df = AnalyzerContext.successMetricsAsDataFrame(spark, analysisResult)
analysisResult_df.show()

@ethanwicker connected with you on linkinin regarding this. Do you think Unity catalog was enabled in your account during this work?


SeedSigner Icons v2

This PR is for a v2.0 update to the SeedSigner Icon Set. @jdlcdl recently brought to my attention that the icon set is in need of an update, as it has not been updated since the v0.5.0 release.
I could use help with additional testing to ensure I didn’t break anything with this change. Especially with icon sizing (it looks like the SeedSigner icons draw smaller than FontAwesome icons). I've outlined a couple of visual defects below.
Huge thanks to @jdlcdl for the help troubleshooting this PR -- it would have been impossible without him. I’ve included his modified version of the @kdmukai screenshot_generator tool. It's hugely useful for testing, with really solid improvements. This can be removed if we don’t want to revive it right now.

Screenshots:

Before
After

Full list of icons
[SeedSigner Design System (v0.6)]
(https://github.com/easyuxd/seedsigner-design-system#iconography)
Changes:

Renamed seedsigner-glyphs.otf to seedsigner-icons.otf
Updated seedsigner-icons.otf
Renamed SeedSignerCustomIconConstants to SeedSignerIconConstants
Updated SeedSignerIconConstants names and Unicode values in src/seedsigner/gui/components.py
Updated "blue" icon color to "0084FF" for better contrast

Defects:

Resolved: New icons draw smaller on the Home Screen grid tiles. I could use help increasing their size to 40x40px.

QR Brightness overlay - New up/down chevrons may have affected padding @overcat

Changing ICON_LARGE_BUTTON_SIZE from 36 to 60 for me made the old custom icons much larger on the MainMenu at least, not sure where else.  It doesn't look like it messed with the text size.

This morning I had a chance, with fresh eyes and coffee, to really take a look at these changes.  I hear "Try a different color shirt with those!" almost daily, so forgive me for not having noticed the improvements at first glance yesterday.
On a large desktop screen with 2 browsers open side by side:

a link to my branch as the BEFORE
and the link to yours, as the AFTER

...it was much easier for me to take my time and appreciate your fine work.
@kdmukai really did wonderful work with the screenshots_generator, they're so useful: like acceptance testing for folks with a sense of style (who can help folks like me picking clothes).
Over time, we'll do better to keep these updated and get more screens working.  Also, to

Haha. Thank you for the kind words, and for the before and after. 🙏
I added links and thumbnails to the before and after at the top.

Omigosh this makes me so happy to see the screenshot generator revived and being so useful!!
Looks like the ToolsAddressExplorerAddressTypeView demo data could probably use some tweaking (that screen should also be displaying the fingerprints of each signer). Will also have to check if the centering if just off because of the lack of fingerprints.

When I run the screenshot generator pytest it does not appear to work. I get this warning.

Any ideas on how to resolve?

When I run the screenshot generator pytest it does not appear to work. I get this warning.

I'm aware of this warning and I have not yet tracked it down.  Otherwise, on the pi from where you ran it, there should be a ../seedsigner-screenshots directory with a README.md and many pngs, if it did anything.
While I was working on this branch here for @easyuxd to have a tight feedback loop while implementing his new icon set, I made many less-than-ideal hacks just to get these working... to that end.
I don't truly believe that the screenshots code (everything in tests/screenshot_generator/) is actually ready for merge quite yet.   I was going to suggest to easyuxd that as a last commit to this pr, he perform:
git rm -r tests/screenshot_generator

(or for you to do similar during merge) so that this code is removed from this particular pr, but so that it remains available for him to use so that he can see his design changes immediately.
That would afford me the time to do some much needed cleanup, as well, as to get feedback from @kdmukai who is sure to have plenty of good ideas, having created it.
If the tests/screenshots_generator do get merged, they will become part of the codebase and I will then issue pr's with any cleanup that I have, and Keith will be sure to see it and can do so too.  Regardless, since these reside outside of src/ they do not get in the way of a 0.7.0 release because they won't make it into the image... but everything else easyuxd has done in the pr might still be worthy of making it into 0.7.0.
@Easyuxd, if you'd like help removing the screenshots_generator code from this pr so that its lack of readiness doesn't delay the rest of this pr, please let me know.

Looks like the ToolsAddressExplorerAddressTypeView demo data could probably use some tweaking (that screen should also be displaying the fingerprints of each signer). Will also have to check if the centering if just off because of the lack of fingerprints.

Wow, nice catch!  The left-aligned text didn't even catch my eye, nor that something is missing.  These are the two screens that appear directly after scanning a wallet descriptor from "tools / address explorer / scan wallet descriptor".
Imagine much prettier than these photos... but they still reflect the layout and info on screen.

I'm aware of this warning and I have not yet tracked it down. Otherwise, on the pi from where you ran it, there should be a ../seedsigner-screenshots directory with a README.md and many pngs, if it did anything.

Thank you! I was looking in the seedsigner repo folder and did not expect it to be written one level higher.

As of cd65820,
ACK tested.
All images are being generated (though more could be generated and plenty of organization to do).  These look really nice.  You probably don't know this, but sometimes I find myself just scrolling up and down these screenshots, thinking "Wow... it really is a nice interface!"

Thank you, @jdlcdl and @kdmukai
@jdlcdl Are the conflicts just from changing SeedSignerCustomIconConstants to SeedSignerIconConstants? I should be able to mark as resolved, no?

@jdlcdl Are the conflicts just from changing SeedSignerCustomIconConstants to SeedSignerIconConstants? I should be able to mark as resolved, no?

Yes, there are 4 conflicts currently and they're mostly related to the change of the constant name, you'd want to select your changes and remove the others.  However, in the psbt_views.py conflict, there is also a recent bug fix where you want a little of both fixes.  Your icon constants name is good, but the way 'dev' refers to "buttons" instead of "self.buttons" needs to be applied else a recent but recently fixed soon returns.

As of f6c1152,
All tests are passing whether run on raspi or desktop.
All screenshots that are known to run are working on raspi as well as your desktop, which is really nice!

8bb6d25 almost brought a tear to my eye. <3

@newtonick
Conflicts resolved, with the help of @jdlcdl.

ACK tested
viewed before and afters as of d27e9e3.  Nice job on the merge conflicts, and especially your latest cleanup-commits,  craftsman!

ACK Tested


Feature: debug.warn behaves like console.log

Allows to pass comma delimited messages to debug.warn
This makes debugging a bit easier:
No need to concatenate elements
Instead of writing:
DEBUG.warn('One' + ' two' + ' three');

Just write
DEBUG.warn('One', 'two', 'three');

Log JavaScript objects
DEBUG.warn('data:', data);

could also simplify the code that calls it (in lib/base.js) - though it would still work as is


Add info about Protostar

I thought it would be a good idea to add Protostar to the list of Cairo tools!

@piotmag769 - thanks great addition!


Update trigger dest

Issue #, if available:
fix #3915
fix #3926
Description of changes:
Update destMap so that files needed in src are copied over.
This includes:
index.js for lambda event.handler
event.json for mocking
package.json for node build
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Codecov Report

Merging #3928 into master will decrease coverage by 0.11%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #3928      +/-   ##
==========================================
- Coverage   59.21%   59.10%   -0.12%
==========================================
  Files         306      310       +4
  Lines       13978    14005      +27
  Branches     2798     2801       +3
==========================================
  Hits         8277     8277
- Misses       5264     5290      +26
- Partials      437      438       +1

Impacted Files
Coverage Δ

...es/amplify-util-mock/src/utils/error-serializer.ts
0.00% <0.00%> (ø)

packages/amplify-util-mock/src/utils/git-ignore.ts
0.00% <0.00%> (ø)

.../amplify-util-mock/src/utils/lambda/loadMinimal.ts
0.00% <0.00%> (ø)

...amplify-util-mock/src/utils/mock-data-directory.ts
0.00% <0.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update eae2551...15ad365. Read the comment docs.


Add Shooting Bay Privilege

Due to a Policy change, we need to add a Shooting Bay privilege to the App. Only three clubs have permission to use the bays and others are trying to add events there.
Is this going to be a problem?

Shooting Bay should have access to delete and edit all of those types of events.

Just put an entry on the calendar for ARPC for Thursday 4/15 from 7 - 9 pm. I am unable to delete or edit that entry or any other entry on the calendar except for those for AGC Action Shooting.
I am not trying to delete this entry, however am using this as an example.
Thank you

The 'Shooting Bay' Privilege now has access to edit and delete Shooting Bay calendar events.


docs(hub/plugin) add session plugin docs

Summary
Add session plugin documentation. Needs an image from @chuca.
Checklist:

[x] Commit message & atomicity checked
[x] Documentation
[x] Adheres to Kong style guide
[x] Spellchecked my updates
[ ] Ready to be merged

@h3xar0n feel free to implement them directly.

Destroyer of happiness 💔 😢


tuw_geometry: 0.0.9-2 in 'humble/distribution.yaml' [bloom]

Increasing version of package(s) in repository tuw_geometry to 0.0.9-2:

upstream repository: https://github.com/tuw-robotics/tuw_geometry.git
release repository: https://github.com/tuw-robotics/tuw_geometry-release.git
distro file: humble/distribution.yaml
bloom version: 0.11.2
previous version for package: 0.0.9-1

tuw_geometry
* connand2d files added
* Contributors: Markus Bader

@maxbader could you fix the conflicts here ?

Humble is held for sync https://discourse.ros.org/t/preparing-for-humble-sync-2023-06-29/32110

I'm going to close this PR since it doesn't appear to have any changes.


How to freeze the ViT part during full parameter fine-tuning of Qwen2-vl?

It has been added to the document; you can use --sft_type full --freeze_vit true.
https://github.com/modelscope/ms-swift/blob/main/docs/source/Multi-Modal/qwen2-vl最佳实践.md#图像ocr微调


Option to choose a project language

Is your feature request related to a problem? Please describe:
All javascript apps i generated are provided in typescript (tsx)
Describe the solution you'd like:
A clear and concise description of what you want to happen.
An option to choose the language a project should be generated with:

Additional context:

You can already choose from 14 different languages in the section above the footer.
While these languages may be JavaScript-based, they include various frameworks and options.
Regarding TypeScript Projects
If you're experiencing issues where all generated apps are provided in TypeScript (TSX) despite your preferences:
Ensure you're selecting the correct language in the options. If you still encounter this issue, I would keep this open and contact support to have them investigate further.


(tr)uSDX support?

Hello, thank you for an amazing piece of software.
I've got a trusdx that I'm trying to get working, and I wonder if a setting can be added to control the DTR/RTS serial port lines - for trusdx they should be:

DTR: high
RTS: low

See this video from the creator of trusdx for context:
https://www.youtube.com/watch?v=W5M2C7rW0b0&t=174s

It was an issue with my radio causing reboots when the USB cable is connected. I upgraded the firmware to 2.00t. This is a beta version, and needs a baud rate of 115200. After changing those settings, it's working in CAT mode.
这太棒了，谢谢！


TypeORM - Circular dependency and one minor bug

Describe the bug
Minor bug: After building a project, there is require is not defined error in compiled server app.js, for some reason, browser template gets compiled into the final app.js (This is not happening in Sapper). It should be just removed, it shouldn't affect functionality.

After removing this, the primary problem occurs.
ColumnTypeUndefinedError2: Column type for ProductImage#url is not defined and cannot be guessed. Make sure you have turned on an "emitDecoratorMetadata": true option in tsconfig.json. Also make sure you have imported "reflect-metadata" on top of the main entry file in your application (before any entity imported).If you are using JavaScript instead of TypeScript you must explicitly provide a column type.

Well firstly, it looks like reflect-metadata doesn't work much good. Also I encountered various circular dependencies issues (Product.ts is referencing ProductImage.ts and vice-versa) (mainly in Sapper).
To Reproduce
Reproduction repository
pnpm install
pnpm run build

Expected behavior
TypeORM should work just fine.
Information about your SvelteKit Installation:

Diagnostics
System:
OS: Windows 10 10.0.19042
Binaries:
Node: 15.13.0 - C:\Program Files\nodejs\node.EXE
Yarn: 1.22.4 - ~\AppData\Roaming\npm\yarn.CMD
npm: 7.7.6 - C:\Program Files\nodejs\npm.CMD
npmPackages:
@sveltejs/kit: next => 1.0.0-next.96
svelte: ^3.29.0 => 3.37.0
vite: ^2.1.0 => 2.1.5

Severity
Because of this problem, I can't use TypeORM, and since it's not working also in Sapper, I can't use it at all with combination of Svelte SSR.
Thanks.

I guess that the underlying problem is that you use Vite there, which uses ESBuild, which does not support the emitDecoratorMetadata setting. You need to find a Vite plugin that transpiles TS/JS files with the tsc compiler.

Please don't report two problems in a single ticket. It makes it very hard to manage
Since this ticket seems to be primarily about TypeORM, I'm closing as a duplicate of https://github.com/sveltejs/kit/issues/798


Please, remove *.js dist files

Keeping those dist files in the repo causes huge pain when merging.
I think they should be removed and added to the .gitignore file.
If people want the built version, they shouln't go to github, built versions should be stored elsewhere. Or they should run jake to build it themselves.
It shouldn't be hard to set up travis to push built versions to the github pages.

So what is the aws s3 url for https://github.com/Leaflet/Leaflet/releases/tag/v1.0.0-beta.1 or beta.2? \
http://leaflet-cdn.s3.amazonaws.com/build/leaflet-1.0.0-beta1.zip ? Is there a url which outputs the entire possible list of downloads avail?

Partial list is here, http://leafletjs.com/download.html. Honestly this breaks bower completely as other dependent libraries have no idea what version they will be on. I guess we should switch to npm for angular-leaflet-directive.
As a possible compromise why not publish the dis/.*.js only on tagging? This would have the same effect as publishing to npm and keeping your development complications down on merging.

@nmccready that's exactly what we do already. The fact beta1 didn't have dist files commited is a bug, I'll figure out what's going on before pushing beta2.

Ha, well we may change to npm; but I can't make that decision on my own.

In theory angular-leaflet-directive should support npm, but is currently targeted towards bower more.

On a side note I feel your pain on angular-google-maps I have to support meteor too. So I am managing 3 package managers. Total nightmare to add the 3rd (meteor). See this feed for same type of complaints https://github.com/mbostock/d3/pull/2130#issuecomment-64965388 :)

Seems like JSPM is a new hotness now.

Why not just finally convert to CommonJS or ES6 modules @mourner? That'll solve lots of problems (including global builds compiled from the project index.js file which simply just imports everything?).
For example: https://github.com/infamous/motor/blob/joe/package.json#L18 and https://github.com/infamous/motor/blob/joe/src/index.js
That library is work-in-progress, but the build scripts are useful. See here for details on how that package.json file was designed. It supports many build-system use cases. The only thing missing is support for bower, in which case the build-global script would be a big stepping stone for that.
Just do it, you can probably convert in like, a day.

Seems like JSPM is a new hotness now.

Hereby I predict that NPM will eventually win over any "new hotness" package managers that appear every single day. I'll be really happy when that happens.
@trusktr for background on ES6 modules in Leaflet, see #3229. I thought about converting to it or CommonJS some day, but it's not a priority right now. And we don't have as many problems with the current setup as you suggest. Also, CommonJS/ES6 won't save us from Bower issues.

JSPM another shinny thing .. kill me now :skull:

JSPM another shinny thing

If you learn more about it, you'd be happy to know that jspm is just a tool and a registry that makes possible to use both bower and npm registry in one project.

I did look into and yes its another layer of management to deal with for many projects.  I am not necessarily bashing jspm. But it would be nice if they worked together to just update npm instead of adding something else.
Just venting , anyways the community will decide.

is just a tool and a registry that makes possible to use both bower and npm registry in one project.

Yep, JSOM doesn't replace NPM. It uses NPM (plus bower, github, and other sources). It's a package manager that lets you specify where packages come from, including NPM.


Update init.luau

Little bit of abstraction + added >= and <=

@veternitzz @ryolikescode I've forked this fork and supported daisy-chaining, test-cases, and updated the docs:
https://github.com/ryolikescode/switch-luau/pull/1
Let me know if you would like any additional changes from this.


Hey! Just found out that your repository copies code from mine. Can I get credits? Thank you!

Hello Avinash!
I just randomly stumbled onto this repository. It was weird to find out that you have copied most of the working code from my repository https://github.com/TheFairBear/Super-SlowMo. Can I please get credits? Thank you!

Yes, I did use your code as base mostly in the train.py. But I also added things from scratch trying to get the network to converge and make the repository more accessible. I have added your repository in the references. Thanks for your work!