error: trust anchor presented twice running unbound-host -D

Hi,
to verify DNSSEC I run this command:
`unbound-host -D -C /etc/unbound/unbound.conf -v -dd go.dnscheck.tools'
The output includes some errors:
❯ unbound-host -D -C /etc/unbound/unbound.conf -v -dd go.dnscheck.tools
[1707251423] libunbound[279036:0] debug: switching log to stderr
[1707251423] libunbound[279036:0] debug: module config: "validator iterator"
[1707251423] libunbound[279036:0] notice: init module 0: validator
[1707251423] libunbound[279036:0] info: adding trusted key . DNSKEY IN
[1707251423] libunbound[279036:0] error: trust anchor presented twice
[1707251423] libunbound[279036:0] error: could not parse auto-trust-anchor-file /var/lib/unbound/root.key line 2
[1707251423] libunbound[279036:0] error: error reading auto-trust-anchor-file: /var/lib/unbound/root.key
[1707251423] libunbound[279036:0] error: validator: error in trustanchors config
[1707251423] libunbound[279036:0] error: validator: could not apply configuration settings.
[1707251423] libunbound[279036:0] error: module init for module validator failed
resolve error: initialization failure

auto-trust-anchor-file exists with correct permission:
❯ ll /var/lib/unbound/root.key
-rw-r--r-- 1 root root 758 Feb  6 21:22 /var/lib/unbound/root.key
  ~
❯ file /var/lib/unbound/root.key
/var/lib/unbound/root.key: ASCII text, with very long lines (491)
  ~

Please advise how to fix this issue.

This happened because the trust anchor is both in the config file that is passed with the -C option, and is also added by the -D option. The -C power user option can be used for many configuration options, and debugging. In this case, if you leave out the -D option, it would work and not have the double trust anchor. Without the -C option likely also works, but then the potential other options in that config file are also not present.

Thanks.
This error message is gone using command unbound-host -C /etc/unbound/unbound.conf -v -dd go.dnscheck.tools, however the command completes with error:
❯ unbound-host -C /etc/unbound/unbound.conf -v -dd go.dnscheck.tools
[1707422628] libunbound[993812:0] debug: switching log to stderr
[1707422628] libunbound[993812:0] debug: module config: "validator iterator"
[1707422628] libunbound[993812:0] notice: init module 0: validator
[1707422628] libunbound[993812:0] notice: init module 1: iterator
[1707422628] libunbound[993812:0] debug: target fetch policy for level 0 is 0
[1707422628] libunbound[993812:0] debug: target fetch policy for level 1 is 0
[1707422628] libunbound[993812:0] debug: target fetch policy for level 2 is 0
[1707422628] libunbound[993812:0] debug: target fetch policy for level 3 is 0
[1707422628] libunbound[993812:0] debug: target fetch policy for level 4 is 0
[1707422628] libunbound[993812:0] debug: Reading root hints from /etc/unbound/root.hints
[1707422628] libunbound[993812:0] info: DelegationPoint<.>: 13 names (0 missing), 26 addrs (0 result, 26 avail) parentNS
resolve error: initialization failure

If you add more -dd flags, say -dddd it increases the verbosity to a higher level, 4 is a good value here. It could also be specified in the unbound.conf. Then the output likely contains more information about what went wrong and caused the initialisation to fail. I presume it is likely due to the config file that is passed, that seems to be from a file location for the full server, instead of a selection of options for the unbound-host command. But the higher detail output likely contains more information.

Running unbound-host with more flags -dddd, but I cannot identify the cause for this issue:
❯ unbound-host -C /etc/unbound/unbound.conf -v -dddd go.dnscheck.tools
[1707500448] libunbound[1251932:0] debug: switching log to stderr
[1707500448] libunbound[1251932:0] debug: module config: "validator iterator"
[1707500448] libunbound[1251932:0] notice: init module 0: validator
[1707500448] libunbound[1251932:0] debug: reading autotrust anchor file /var/lib/unbound/root.key
[1707500448] libunbound[1251932:0] info: trust point . : 1
[1707500448] libunbound[1251932:0] info: assembled 0 DS and 1 DNSKEYs
[1707500448] libunbound[1251932:0] info: DNSKEY:: .     86400   IN      DNSKEY  257 3 8 AwEAAaz/tAm8yTn4Mfeh5eyI96WSVexTBAvkMg
JzkKTOiW1vkIbzxeF3+/4RgWOq7HrxRixHlFlExOLAJr5emLvN7SWXgnLh4+B5xQlNVz8Og8kvArMtNROxVQuCaSnIDdD5LKyWbRd2n9WGe2R8PzgCmr3EgVLrjyBx
WezF0jLHwVN8efS3rCj/EWgvIWgb9tarpVUDK/b58Da+sqqls3eNbuv7pr+eoZG+SrDK6nWeL3c6H5Apxz7LjVc1uTIdsIXxuOLYA4/ilBmSVIzuDWfdRUfhHdY6+c
n8HFRm+2hM8AnXGXws9555KrUB5qihylGa8subX2Nn6UwNR1AkUTV74bU= ;{id = 20326 (ksk), size = 2048b}

[1707500448] libunbound[1251932:0] info: file /var/lib/unbound/root.key
[1707500448] libunbound[1251932:0] info: last_queried:<PHONE_NUMBER> Fri Feb  9 07:14:03 2024
[1707500448] libunbound[1251932:0] info: last_success:<PHONE_NUMBER> Fri Feb  9 07:14:03 2024
[1707500448] libunbound[1251932:0] info: next_probe_time:<PHONE_NUMBER> Fri Feb  9 18:55:24 2024
[1707500448] libunbound[1251932:0] info: query_interval: 43200
[1707500448] libunbound[1251932:0] info: retry_time: 8640
[1707500448] libunbound[1251932:0] info: query_failed: 0
[1707500448] libunbound[1251932:0] info: [  VALID  ] .  86400   IN      DNSKEY  257 3 8 AwEAAaz/tAm8yTn4Mfeh5eyI96WSVexTBAvkMg
JzkKTOiW1vkIbzxeF3+/4RgWOq7HrxRixHlFlExOLAJr5emLvN7SWXgnLh4+B5xQlNVz8Og8kvArMtNROxVQuCaSnIDdD5LKyWbRd2n9WGe2R8PzgCmr3EgVLrjyBx
WezF0jLHwVN8efS3rCj/EWgvIWgb9tarpVUDK/b58Da+sqqls3eNbuv7pr+eoZG+SrDK6nWeL3c6H5Apxz7LjVc1uTIdsIXxuOLYA4/ilBmSVIzuDWfdRUfhHdY6+c
n8HFRm+2hM8AnXGXws9555KrUB5qihylGa8subX2Nn6UwNR1AkUTV74bU= ;{id = 20326 (ksk), size = 2048b} ;;state:2 ;;pending_count:0 last:
Fri Jan 19 23:38:57 2024
[1707500448] libunbound[1251932:0] debug: validator nsec3cfg keysz 1024 mxiter 150
[1707500448] libunbound[1251932:0] debug: validator nsec3cfg keysz 2048 mxiter 500
[1707500448] libunbound[1251932:0] debug: validator nsec3cfg keysz 4096 mxiter 2500
[1707500448] libunbound[1251932:0] notice: init module 1: iterator
[1707500448] libunbound[1251932:0] debug: target fetch policy for level 0 is 0
[1707500448] libunbound[1251932:0] debug: target fetch policy for level 1 is 0
[1707500448] libunbound[1251932:0] debug: target fetch policy for level 2 is 0
[1707500448] libunbound[1251932:0] debug: target fetch policy for level 3 is 0                                       [15/1975]
[1707500448] libunbound[1251932:0] debug: target fetch policy for level 4 is 0
[1707500448] libunbound[1251932:0] debug: Reading root hints from /etc/unbound/root.hints
[1707500448] libunbound[1251932:0] info: DelegationPoint<.>: 13 names (0 missing), 26 addrs (0 result, 26 avail) parentNS
[1707500448] libunbound[1251932:0] info:   M.ROOT-SERVERS.NET. * A AAAA
[1707500448] libunbound[1251932:0] info:   L.ROOT-SERVERS.NET. * A AAAA
[1707500448] libunbound[1251932:0] info:   K.ROOT-SERVERS.NET. * A AAAA
[1707500448] libunbound[1251932:0] info:   J.ROOT-SERVERS.NET. * A AAAA
[1707500448] libunbound[1251932:0] info:   I.ROOT-SERVERS.NET. * A AAAA
[1707500448] libunbound[1251932:0] info:   H.ROOT-SERVERS.NET. * A AAAA
[1707500448] libunbound[1251932:0] info:   G.ROOT-SERVERS.NET. * A AAAA
[1707500448] libunbound[1251932:0] info:   F.ROOT-SERVERS.NET. * A AAAA
[1707500448] libunbound[1251932:0] info:   E.ROOT-SERVERS.NET. * A AAAA
[1707500448] libunbound[1251932:0] info:   D.ROOT-SERVERS.NET. * A AAAA
[1707500448] libunbound[1251932:0] info:   C.ROOT-SERVERS.NET. * A AAAA
[1707500448] libunbound[1251932:0] info:   B.ROOT-SERVERS.NET. * A AAAA
[1707500448] libunbound[1251932:0] info:   A.ROOT-SERVERS.NET.  Not that often is a config file passed like that.
The particular error, 'initialization failure', is returned in one of the following cases: libevent cannot be setup, but this it not actually in use for the command given, or: the module stack cannot start, the local zones cannot get configured, the auth zones cannot get configured, the edns strings option cannot get configured. What is the configuration for these items? I would think unbound would print out the error as the problem why that configuration failed to be applied.
The printout at high verbosity, thanks for that, it includes the module config: .. printout and then the initialization of the validator and iterator modules. That looks fine. So it is not the module stack setup. Next are the localzones and auth zones and ednsstrings option, in the code, so one of those perhaps fails but does not print out the error. The config for these items it perhaps the cause for it, like comment and uncomment to test or if that is not it, it is maybe something else.

Could you please point out which information is required to continue analysis?

Could you try to comment out items in the config, to see which one causes the failure to start? So that, with a small config, the failure can be reproduced, and then say what config causes the problem?

After completing this try & error exercise I have identified the root cause:
tls-cert-bundle: /etc/ssl/certs/ca-certificates.crt
This file exists:
❯ file /etc/ssl/certs/ca-certificates.crt
/etc/ssl/certs/ca-certificates.crt: PEM certificate

The only code path that I see that does not print an error there is if unbound is compiled without openssl. But I think this is very unlikely, I guess you have openssl (unbound -V) compiled in. But perhaps this is a code repo checkout, and make clean; make can resolve a dependency problem? Does that fix it perhaps? For it prints for this option when the file does not exist and so on errors like: "error: error in SSL_CTX verify crypto ..". But the file exists and looks okay, so not sure what is going on.

I would conclude that unbound is compiled /w openssl:
❯ unbound -V
Version 1.13.1

Configure line: --build=x86_64-linux-gnu --prefix=/usr --includedir=${prefix}/include --mandir=${prefix}/share/man --infodir=${prefix}/share/info --sysconfdir=/etc --localstatedir=/var --disable-option-checking --disable-silent-rules --libdir=${prefix}/lib/x86_64-linux-gnu --libexecdir=${prefix}/lib/x86_64-linux-gnu --disable-maintainer-mode --disable-dependency-tracking --disable-rpath --with-pidfile=/run/unbound.pid --with-rootkey-file=/var/lib/unbound/root.key --with-libevent --with-libnghttp2 --with-pythonmodule --enable-subnet --enable-dnstap --enable-systemd --with-chroot-dir= --with-dnstap-socket-path=/run/dnstap.sock --libdir=/usr/lib
Linked libs: libevent 2.1.12-stable (it uses epoll), OpenSSL 3.0.2 15 Mar 2022
Linked modules: dns64 python subnetcache respip validator iterator

BSD licensed, see LICENSE in source package for details.
Report bugs to<EMAIL_ADDRESS>or https://github.com/NLnetLabs/unbound/issues

After renaming /etc/ssl/certs/ca-certificates.crt the error remains the same.
❯ sudo mv /etc/ssl/certs/ca-certificates.crt /etc/ssl/certs/ca-certificates.crt.old
❯ sudo unbound-host -C /etc/unbound/unbound.conf -v -d go.dnscheck.tools
[1707750340] libunbound[2290284:0] notice: init module 0: validator
[1707750340] libunbound[2290284:0] notice: init module 1: iterator
resolve error: initialization failure

For me, this is with the code repo version, it prints errors when the file does not exist. So I think something is wrong, but perhaps a version upgrade to the latest or code repo version could improve matters? But I am not sure, I could not from version differences see what would cause the error to be not printed, but there are some changes in the error printout and handling for the option in question. It would be nice if you could try with the latest version or the code repo version; otherwise it if then persists it is possible to try versions with extra debug around the routines that fail, because then it happens with the latest code and not for me, for a nonexistent file.

Yes certainly, the option is not needed by the unbound-host lookups, that are not using DoT. So disabling it works around the issue.


Better support for projections in flux refinements

Right now, it seems like it's not possible to use projections in a few scenarios. Say I have the following structs:
#[refined_by(x: int)]
pub struct S2 {
   #[field(u32[x])]
    x: u32
}

#[refined_by(s: S2)]
pub struct S1 {
   #[field(S2[s])]
    s: S2
}

This does not work:
#[sig(fn (&S1[@s]) -> u32[s.s.x])] //~ERROR here - s.s is ok but s.s.x results in an unexpected token
fn get_inner(s1: &S1) -> u32 {
    s1.s.x
}

And neither does this:

defs! {
  fn new_s2() -> S2 {
        S2 { x: 0 }
  }

  fn index_new_s2() ->  int {
       new_s2().x //~ERROR unexpected token when using `.` on `new_s2()`
  }
}

It would be helpful from an ergonomic standpoint if we could support this sort of thing.

Is this mostly a parsing issue? i.e. are these things supported "internally" ?

I'd need to look at the code again to be 100% sure but I don't think this is currently supported - the left side of "dot" expressions are parsed as an identifier and this is propagated through surface -> fhir. We would need to parse the left side as an expression and change the representation through surface and fhir. I don't think this is too bad though - I can take a stab at it.

This is supported in rty and the encoding into fixpoint should handle it as well (modulo bugs arising because we've never tested it). We need to change the surface syntax and fhir, and consequently sort checking/elaboration.

I think the parsing may be a pain here... 🙃


Preparing Orchestrator for the After (NSF) Times

The NSF Award supporting the current phase of Pangeo Forge development has a little over a year remaining in it. So this is an opportune moment to strategize about where we (and I, with my remaining full time funded effort) want to get Pangeo Forge Orchestrator by the conclusion of this funding cycle. Here is a first pass at some priorities (with big 🙏 to @yuvipanda for so much thoughtful brainstorming on these points):
🔸 State-minimization
Minimizing state managed by Orchestrator reduces the operational and maintenance burden of Pangeo Forge Cloud. A basic assumption here is that the future operator of Pangeo Forge Cloud will value the tradeoff of reduced maintenance and greater ease of federated participation in exchange for some performance cost of decentralization.
Here are forms of state we currently manage and/or deploy from this repo, which we probably can drop:

A postgres database (this can be replaced by relying more heavily on Github, including the Check Runs API, which can stand in for our own RecipeRun table).
Bakery config (this can exist external to this repository)

Dropping the database has implications for the frontend site https://pangeo-forge.org/, but these can be worked around by either re-imagining what that site is used for (perhaps it does not need a dashboard) and/or having that site populated with data directly from the GitHub API.
Factoring bakery config into separate repos, in earlier iterations bakery repositories were defined for generic bakery types (AWS, GCP, etc.). As the definition of bakeries shifts to "just a Beam runner", so can the way in which bakery repos are formatted. In order for a bakery repo to be pluggable with Pangeo Forge Cloud, I think it needs to define some contractual set of config that Pangeo Forge Cloud can use to deploy a job to that bakery.

🤔 Should Pangeo Forge Cloud make deployments itself? Or perhaps a bakery needs to run it's own agent, for that purpose? This would be something like https://github.com/pangeo-forge/cloudrun-recipe-handler, from which the core FastAPI service can be factored out to be reusable across various deployment targets?

This points to the possibility that bakeries as defined in meta.yaml would become simply, the name of a GitHub repo.
🔹 What is orchestrator (i.e. Pangeo Forge Cloud)?
In this paradigm, orchestrator, or the core of Pangeo Forge Cloud, becomes "just" a GitHub App which understands a meta.yaml spec and can forward appropriately-formatted requests to the bakery "agent" service.
cc @rabernat
Edit: This is a very rough sketch, but wanted to get something out in the open to start a conversation, I'll continue to follow-on below as more thoughts develop.

In order for a bakery repo to be pluggable with Pangeo Forge Cloud, I think it needs to define some contractual set of config that Pangeo Forge Cloud can use to deploy a job to that bakery.

Yep, this was part of the motivation for https://github.com/yuvipanda/pangeo-forge-cloud-federation/ (although I think there have been other bits like that too)

@yuvipanda, as we discussed yesterday, I believe a natural way to prototype all of this is by refactoring pangeo-forge-orchestrator to move all of the NSF-funded bakery components into their own repo(s), leaving only the core GitHub App functionality here.

Charles and I just discussed this, and I'm 100% on board with the idea that we should work to simplify, decouple, and make stateless the Pangeo Forge service.

We had a great discussion of this issue on today's Coordination Meeting. Minutes in the linked doc; copying here for reference:

Extra props to Yuvi here!!! (He has provided a huge amount of design guidance on this.)
Implications for frontend (no database)
Actions vs. App

Actions can run everything except production deployments (for situations where the recipe contributor does not also own the deployment creds), including pruned test with LocalDirectRunner, linting
Actions can easily deploy to prod if the recipe contributor also owns the deployment creds
In situations where some org/institution/company wants to support a beam runner for a group of users (lab members, employees, community, etc.), without granting them ownership of executor creds

What is a bakery? Where does the interface between Actions/App + bakery?

Bakery is a beam runner
new Bakery should also run an Agent service to deploy the jobs to the runner. This allows bakeries to “own” their deployment creds, and not have to hand them over to the GitHub App.
GitHub App POSTs to Bakery Agent to deploy

Questions:

[Ryan] What becomes of the website? The main feature which is missing is a catalog. Catalogs are very stateful. Catalogs are the essence of state. Something else needs to provide a catalog.
[Yuvi] The state has not disappeared, it’s just stored in GitHub. The source of truth lives alongside the recipes, on GitHub. The frontend can cache data from GitHub, but not have the source of truth.
[Yuvi] Catalog for end users to find data is one type of state. Another type of state is operational logs. Separation of these concerns will be valuable.
[Yuvi] In the conda-forge analogy, Anaconda hosts catalog and build artifacts (i.e. data).
[Ryan] Target for data are public dataset programs (OSN, AWS, etc.)
Home for the catalog(s) remains an open question. Earthmover is building catalog tooling, which may be part of the answer.
[Charles/Yuvi] Moving towards a multi-instance world, like Jupyterhub, etc. The pangeo-forge github org becomes a public demonstration, but not the only instance.

Thinking aloud about what a minimal prototype of this new system would require:

[ ] pangeo-forge-orchestrator PR that:

Removes database and associated routes
Removes bakery infrastructure (i.e. dataflow status monitoring submodule + terraform)
We should probably eventually rename pangeo-forge-orchestrator to just, pangeo-forge/deployment-service or something more descriptive and narrowly-scoped (after this refactor is complete).

[ ] GCP Bakery repository which deploys:

dataflow-status-monitoring
https://github.com/pangeo-forge/cloudrun-recipe-handler, but adapted into some form of bakery deployment "agent"
when the bakery agent is deployed (using https://github.com/google-github-actions/deploy-cloudrun?), this repo should use the deployments api to record the public url at which the agent service is running. ultimately, the GitHub app can query this deployment object to determine where to send webhooks.

Note: Short term, the easiest way to link these two services is to deploy The GitHub App on either Heroku or GCP App Engine. (Because the GitHub App is stateless, there is nothing design-wise difficult about deploying it to a serverless platform, but Columbia IT limitations make that impossible using our GCP account.) The GCP Bakery Agent can run on GCP Cloud Run. To invoke the Bakery Agent, the GitHub App can be logged into a gcloud session using a service account key with GCP Cloud Run Invoker permissions for the Bakery Agent (this account key would need to be handed off to The GitHub App deployment repo, by the Bakery Agent developers.)

Here is a sequence diagram outlining the proposed new architecture. Note the main differences with the existing system are:

No database (state is captured as GitHub check runs only).
Previously, GitHub App deployed jobs directly to the Beam Runner. Now, the Bakery Agent does this.

sequenceDiagram
    Feedstock Repo->>GitHub App:event webhook
    GitHub App-->>Feedstock Repo:creates check run (queued)
    GitHub App->>Bakery Agent:notifies: event
    Bakery Agent->>Beam Runner:deploys job
    Bakery Agent-->>GitHub App:notifies: job deployed
    GitHub App-->>Feedstock Repo:updates check run (in progress)
    Beam Runner->>Beam Runner Status Monitor:notifies: job complete
    Beam Runner Status Monitor-->>Bakery Agent:notifies: job complete
    Bakery Agent-->>GitHub App:notifies: job complete
    GitHub App-->>Feedstock Repo:updates check run (completed)

I am not 100% decided on the best interface between the GitHub App and the Bakery Agent. Following the example above, The GitHub App could simply pass along some parsed version of the event payload, leaving it up to the Agent to decide what action to take in response to the event:
sequenceDiagram
    Feedstock Repo->>GitHub App:event webhook
    GitHub App->>Bakery Agent:notifies: event

Alternatively (and I think I'm a bit more partial to this approach), the GitHub App could generate the appropriate pangeo-forge-runner command for the given event type, and then pass it along to the Bakery Agent:
sequenceDiagram
    Feedstock Repo->>GitHub App:event webhook
    GitHub App-->>GitHub App:generates `pangeo-forge-runner` cmd for event
    GitHub App->>Bakery Agent:POSTs cmd

This latter approach allows the Bakery Agent to (mostly) just be an invoker of pangeo-forge-runner commands, and it can have much less knowledge of GitHub Events. This feels like the right separation of concerns to me: GitHub App handles GitHub-y things, and insulates Bakery Agent from that layer.
In either approach, The GitHub App should pass the name of the GitHub actor that triggered the event along to the Bakery Agent, as I am assuming some sort of allow-list of actors will be how the Bakery Agent decides whether or not to actually complete a given deployment request. (That is, anyone could specify a particular bakery in their meta.yaml, but eventually, not all bakeries may be for public use.)


Consuming metadata from Dynamics CRM Online

Hi,
I'm consuming a Dynamics CRM Online OData web service and while trying to get the metadata I get the following exception:
System.AggregateException: One or more errors occurred. ---> System.Xml.XmlException: For security reasons DTD is prohibited in this XML document. To enable DTD processing set the DtdProcessing property on XmlReaderSettings to Parse and pass the settings into XmlReader.Create method. at Microsoft.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task) at Microsoft.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccess(Task task) at Simple.OData.Client.ODataClient.d__25.MoveNext() --- End of inner exception stack trace --- at System.Threading.Tasks.Task`1.GetResultCore(Boolean waitCompletionNotification)
Here is my code:
ICredentials credentials = new NetworkCredential(security.IntegrationUser, Crypto.DecryptStringAES(security.IntegrationPassword));
ODataClientSettings settings = new ODataClientSettings(serviceConfiguration.ServiceBaseUrl, credentials);
settings.IncludeAnnotationsInResults = true;
this.client = new ODataClient(settings);
var metadata = this.client.GetMetadataAsync().Result;
Can you please advise?
Regards,
Kiril

Hi Kirill,
What happens if you try to fetch metadata from the browser? Try service {service_url}/$metadata Does it work? What do you get?

Hi,
thank you for your reply!
If i fetch the metadata from the browser all looks good - i get the metadata as expected. I forgot to mention, that i already use this code with Dynamics NAV 2016 and Dynamics NAV Online and it all works as expected.
Thanks!
Kiril

Then it's not easy to guess what might have happened. Can you run a test with Fiddler (or another network traffic watcher) and check what the service return to metadata request. I don't think there's any failure in the library, it's just unable to retrieve metadata.

Thank you for pointing me to Fiddler, this way i figured out that authentication was failing and the client was being redirected to the login page and was trying to interpret that page as the metadata document. Now i'm facing another problem but i'm still working on it and will get back on that in a bit.
Thanks!
Kiril


Advanced setup using one FQDN

Hello all,
I followed the Advanced Docker Setup with Traefik and have been trying to get it running on an Azure VM. However, due to the VM limitation, it can only provide one FQDN per VM.
I played around with the docker-compose.yml files and tried to setup VIRTUAL_HOST to a path on the FQDN (123.example.com/home)  and changed the router rule to
traefik.http.routers.teslamate.rule=Host(``${FQDN_TM}``) && PathPrefix(``/home``),
and in the logs I can see Access TeslaMateWeb.Endpoint at http://123.example.com/home
When I go to the site, I am prompted to login, but after I log in, I see a Not Found error, and the log shows

teslamate_1  |20:28:38.443 [info] GET /home
teslamate_1  | 20:28:38.443 [info] Sent 404 in 225µs
teslamate_1  | 20:28:38.444 [info] Converted error Phoenix.Router.NoRouteError to 404 response

I wonder if I need to add additional labels in traefik rules to make this work? Thank you for you help!

@bastrik I was able to get two FQDN's pointed to one VM in azure via powershell. When I get home, I'll see if I still have my notes - maybe they will be helpful.

@bastrik Here's the guide I used to create multiple PublicIP's routed to multiple PrivateIP's on the same Azure VM:
https://docs.microsoft.com/en-us/azure/virtual-network/virtual-network-multiple-ip-addresses-powershell
Some gotchas, may be obvious but worth calling out since the guide is assuming a Windows VM:

Using Linux, you would open port 24 for SSH - not 3389 for RDP
You essentially create two publicIP's in Azure, and map them to discreet PrivateIP's in Azure. On the VM, you'll manually assign both PrivateIP's by editing the eth0 config.
When all is said and done you'll have two FQDN's both pointed at the same TeslaMate install.

Hope that helps!

Thanks for the doc! Confirming that this did the trick.
Marking this as closed.


cargo xtask lint fails on windows due to jemalloc-sys

We keep running into variations of this and sadly features are only opt-in on the command line. We also can't gate features on platform in Cargo.toml files which would keep us forwards compatible if --all-features is specified on the command line.

https://github.com/rust-analyzer/rust-analyzer/blob/master/xtask/src/lib.rs#L125


[move-prover] Refactored options creation for better reuse #250_173

Motivation
This PR enhances https://github.com/diem/move/pull/439 by making it easier to specify prover options for applications outside of core Move. Without this refactoring, the options have to be passed as strings or the entire run_move_prover function needs to be copied to customize them. The refactoring enables "outside" prover users to reuse run_move_prover by replicating/augmenting code in a much shorter execute function only.

/canary

:sunny: Canary successful


feat: Enhanced Bulk Minting: Add Support for Onchain Attributes

Thank you for your contribution to the Koda - Generative Art Marketplace.
👇 __ Let's make a quick check before the contribution.
PR Type

[x] Bugfix
[x] Feature
[x] Supported description file type: json and txt.
CSV continued to https://github.com/kodadot/nft-gallery/issues/11282

Needs Design check

@exezbcz please review

Needs QA check

@kodadot/qa-guild please review

Context

[x] Closes #11149

Screenshot 📸

[x] My fix has changed something on UI; a screenshot is best to understand changes for others.

minted nft example: https://canary.kodadot.xyz/ahk/gallery/462-9 \ https://canary.kodadot.xyz/ahk/gallery/462-10

modal seems to be broken

attributes component not working if the item is not populated

✅ All fixed


Loading models in Angular

I'm trying to load the "models" downloaded in my project, it compiles but showing this following error in console:

All examples I have found are in Vanilla or Node.js, so I have  doubts if I'm loading the models in right place of Angular class, the current code of class is:
`
@ViewChild('videoPlayer') videoplayer : HTMLVideoElement;
async ngOnInit() {
Promise.all([
await faceapi.nets.tinyFaceDetector.loadFromUri('./models'),
await faceapi.nets.faceLandmark68Net.loadFromUri('./models'),
await faceapi.nets.faceRecognitionNet.loadFromUri('./models'),
await faceapi.nets.faceExpressionNet.loadFromUri('./models')
]).then(() => {
this.startVideo();
})
}
async startCanvas(){
// const canvas = faceapi.createCanvasFromMedia(this.videoplayer);
setInterval(async () => {
  const detections = await faceapi.detectAllFaces(this.videoplayer,
    new faceapi.TinyFaceDetectorOptions()).withFaceLandmarks().withFaceExpressions();
    console.log(detections);
}, 100)

}
startVideo(){
navigator.getUserMedia(
{ video: {} },
stream => {
this.videoplayer.srcObject = stream;
},
err => console.error(err)
);
}`
Current path of "models" folder:

Am I putting the models in a wrong place or I should to change where my code load the "models" in page?

Hello, try moving the models folder to assets.

I have no idea how to implement this in angular. can you please share github of working code in angular?

@thelionleo take a look in a project named "projeto-tcc" in my profile, I did the implementation for Angular, just configure and access localhost:800/tests to see the results

Hello, try moving the models folder to assets.

I did the changes as you sugested, I had to make other changes to models loading correctly, for example, instead of calling the model loaders on init and inside a Promise.all(), I have to load them inside a async function and call it in ngAfterViewInit().
If someone have difficult to load the plugin in project, see "projeto-tcc" in my profile, it's not finished yet but is possible to see this plugin working in tests page.

@thelionleo take a look in a project named "projeto-tcc" in my profile, I did the implementation for Angular, just configure and access localhost:800/tests to see the results

there's too much happening there.  is it an implementation of face-api? would it be too much to ask if you can create a new github for me for angular? just the basics to get me started.

@thelionleo Here is my repo I have implemented the Face-api.js in angular.


Pool chars used for base64url-encoding and -decoding

#23 part 4
depends on aspnet/HttpAbstractions#563

nits:

correct name of a field in AntiforgerySerializationContext
avoid allocations when returning an AntiforgerySerializationContext in (unlikely) case Stream is unused

/cc @rynowak

Before

After

:shipit:

Thx for the sign-off @rynowak. I'd like your perspective on aspnet/HttpAbstractions#563, especially @Tratcher's recent comment.

:up::date:

478edc1


Screen size

Does the clock need to be adaptive to screen size? I know it needs to be 5:3.

The 5:3 limitation imposed by ClockCustomizer does look really ugly on widescreen devices. Can we remove this or make it an optional setting? I'd prefer to make a responsive landscape clock that looks good at 5:3 and other aspect ratios as well.
Also, things would look a lot better if ClockCustomizer hides the status bar and enforces landscape view.

I do think the reason the 5:3 aspect ratio is required is because the Lenovo clocks for this contest is a 5:3 I could be wrong I'm not exactly sure what the aspect ratio is I'm just assuming that based on the contest description.

My question is, do we need to use the forced 5:3 from the starter repo, or is it okay to remove that and allow it to be responsive on various aspect ratios?

I could be mistaken but I believe the reason 5:3 aspect ratio is required is because the Lenovo clock and smart display probably has a 5:3 ratio

It will only be judged with 5:3 aspect ration, but if it looks good with others, that's great!


adding a user port to the mocked amlight topology

tested new mocked Amlight.json

Should this replace the existing amlight.json?

Thought about it:  I decided to keep it separately as I don't want to touch the python code here at this stage, though I ran all the related unit tests agains it before the PR.
Instead, I'll create a separate unittest in PCE to use this new json to close that issue: maximal isolation...

And I have that big PR waiting for merge here and in sdx-lc...


Add commit log flush size to commit log header information

Right now, if you write a commit log with a specific flush size and then later try to read it with a different one, you'll get a cryptic error like io.EOF when trying to bootstrap the commitlog. We should encode the flush size into the commitlog itself and then we can compare the configured flush size against the one on disk and emit a proper error if they mismatch

@robskillington


Cargo should use standard logging framework

Cargo can be invoked with a command line interface, as well as non-interactively.
In the latter case, Cargo may e.g. be used as part of a Continuous Integration pipeline.
For that use case, it is important to reduce noise in the build output. Moreover, it is important to see regular timestamps in order to determine where most time is spent in the pipeline.
Cargo writes a line for every dependency package that is builds, which means a lot of information is output that can be considered noise, in this use case. Currently, Cargo can only be made completely silent using the --quiet argument. However, this does not even report errors. This makes this option unattractive to this use case. Cargo also doesn't include timestamps in its output.
Similar to most other long-running command line utilities, Cargo should only use a standard logging framework, configurable by the caller. This would make it easy to:

Allow the caller to filter what to log.
Include accurate timestamps and other details in log entries.

This change should not be complex in terms of design. In case a concern about aesthetics overrides the previous concerns, and suppose it could not be addressed within the proposed solution, then the solution can be limited to a non-interactive context.

The logging framework and profiling info is already available I see in ARCHITECTURE.md. I propose to let it subsume the main user visible console reporting code in https://github.com/rust-lang/cargo/blob/dc83ead224d8622f748f507574e1448a28d8dcc7/src/cargo/core/shell.rs.

Currently, Cargo can only be made completely silent using the --quiet argument. However, this does not even report errors. This makes this option unattractive to this use case. Cargo also doesn't include timestamps in its output.

I just checked and warnings and errors are reported with --quiet at this time.  Does that change the need for this request?

The logging framework and profiling info is already available I see in ARCHITECTURE.md. I propose to let it subsume the main user visible console reporting code in

I've used logging frameworks in the past for the primary output of my programs and the quality isn't as good.  When I tend to shift my focus to the quality of my output, I end up dropping it.
Focusing on specific asks, rather than the implementation:

Allow the caller to filter what to log.
Include accurate timestamps and other details in log entries.

I feel like filtering would be a large ask with limited value, partly from it being hard to get  the filters right.  I think it would be better to focus on the use cases for filtering to see if there are alternatives.  If its just because the output is viewed as noisy generally, then I think that is what we should focus on, rather than on people trying to slice and dice the output.
As for timestamping, the motivation given is to "determine where most time is spent in the pipeline" but that won't really help unless we say when things start, and not just when they end.   As an alternative, we now have --timings; you could run that and artifact it.  When you really just want timestamps for each line, an approach I've taken before is to write wrapper programs that monitor output and do things like add timing information or produce JUnit output.


NPCs don't move

Short range pathfinding added in 9979723 for hostile NPCs. Currently working on getting it to a functioning state.

With 5aec392 in unstable-dev, short-range pathfinding works for cases where a path exists and crashes when a path does not exist.

Short-ranged pathfinding for hostile NPCs is functional as of 9ee0960.


Code and data set availability

Hi
Could you give a date on which the code and data set will be available.
Regards

I tried to replicate your results but I couldn't even implement your network. If I got the paper right the input has shape [256 x 32]. Then If we do 8 convolutions with kernel [3 x 3] and output sizes as reported in Tab.1 we get: [1 x 256 x 32] -> [64 x 128 x 16] -> [64 x 128 x 8] -> .... [1024 x 2 x 1] -> [1024 x 1 x 1]. In the last case Layer Normalization won't work as the layer size is [1 x 1]. Mybe I just don't get the model right but it is unclear. Please, share the details if you can't share the code

@mkudinov TL;DR: First, you're right. But the result will not change.
Fortunately, the exact implementation according to the paper works equally well. Let me clarify 2 mistakes.
class Convlayers():
...
self.forward = Sequential([
  conv2d_1x3,
  ELU(),
  BN_1x3,   # Set BN as LayerNorm2d
  conv2d_3x1,
  ELU(),
  BN_3x1])  # Set BN as LayerNorm2d
...
class FingerPrinter():
...
# settings for Convlayers
input_shape=(256,32,1)
front_hidden_ch=[128, 128, 256, 256, 512, 512, 1024, 1024]
front_strides=[[(1,2), (2,1)], [(1,2), (2,1)],  # --> (128, 16, 128) --> (64, 8, 128)
                        [(1,2), (2,1)], [(1,2), (2,1)], # --> (32, 8, 256) --> (16, 4, 256)
                        **[(1,1), (2,1)], [(1,2), (2,1)],** # --> (8, 4, 512) --> (4, 2, 512)
                        **[(1,1), (2,1)], [(1,1), (2,1)]**  # --> (2, 1, 1024) --> (1, 1, 1024)

In paper, I described every strides as [(1,2),(2,1)] for simplicity (?). But it should be corrected as in my code. The result would not change much though.
So we repeat the Conv layers 8 times. As you commented, LN in 8th Convlayer is ignorable.

@oldmonkABA Hi, please read the news.

@mimbres  Will wait for the full code. Meanwhile will check out what you have uploaded


Fix link to this repo's npm package site in CHANGELOG.md

[x] Tests and linter pass
[x] Code coverage does not decrease (if any source code was changed)
[x] Appropriate docs were updated (if necessary)

Codecov Report

Merging #243 into master will decrease coverage by 0.13%.
The diff coverage is n/a.

@@            Coverage Diff            @@
##           master    #243      +/-   ##
=========================================
- Coverage   97.94%   97.8%   -0.14%
=========================================
  Files          11      11
  Lines        2088    2094       +6
  Branches      125     128       +3
=========================================
+ Hits         2045    2048       +3
  Misses         25      25
- Partials       18      21       +3

Impacted Files
Coverage Δ

test/service-object.ts
97.39% <0%> (-0.63%)
:arrow_down:

src/service-object.ts
97.52% <0%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5eca394...ac433b3. Read the comment docs.


Add pagination to update available

Description
Add pagination to the list of update available for device
Fixes # (THEEDGE-2821)
Type of change
What is it?

[X] Bug fix (non-breaking change which fixes an issue)
[X] New feature (non-breaking change which adds functionality)
[ ] Documentation update
[ ] Tests update
[ ] Refactor

Checklist:

[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] I have added tests that prove my fix is effective or that my feature works
[X] New and existing unit tests pass locally with my changes
[X] I run make pre-commit to check fmt/vet/lint/test-no-fdo

Codecov Report
Base: 36.94% // Head: 37.47% // Increases project coverage by +0.53% :tada:

Coverage data is based on head (12202c1) compared to base (2fb17d3).
Patch coverage: 77.77% of modified lines in pull request are covered.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1622      +/-   ##
==========================================
+ Coverage   36.94%   37.47%   +0.53%
==========================================
  Files          66       66
  Lines        8757     8806      +49
==========================================
+ Hits         3235     3300      +65
+ Misses       5133     5108      -25
- Partials      389      398       +9

Impacted Files
Coverage Δ

pkg/models/images.go
100.00% <ø> (ø)

pkg/routes/devices.go
37.43% <55.55%> (-0.07%)
:arrow_down:

pkg/services/devices.go
50.37% <78.43%> (+0.49%)
:arrow_up:

pkg/services/commits.go
39.74% <88.88%> (+39.74%)
:arrow_up:

pkg/routes/updates.go
32.81% <100.00%> (+0.92%)
:arrow_up:

pkg/services/errors.go
41.17% <100.00%> (+6.23%)
:arrow_up:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

/retest

/retest

@mergify queue edge-api

/retest

@mergifyio refresh

@mergifyio queue

@mergifyio refresh edge-api

@mergifyio queue edge-api

@mergifyio refresh

/retest

/lgtm

@mergifyio refresh

/retest

@Mergifyio requeue

@mergifyio rebase

@mergifyio requeue


Add gradient fns for log and abs

This adds gradient functions for log and abs.
I have used and tested these locally for cross entropy and mean absolute error loss functions. If you would like having these in your library too, I am happy to upstream them from my experiment repo too.

thanks! Abs looks great but I think the gradient for log is failing:
https://app.circleci.com/pipelines/github/facebookresearch/shumai/667/workflows/d449cbda-f5e8-463a-83cf-35c1f9588c8f/jobs/1844/parallel-runs/0/steps/0-113

cross entropy and mean absolute error loss functions.

oh yea, we definitely need better loss function coverage! would really appreciate that :)

I can address the failing logs by moving the allowed error up to above 0.1. The amount of error increases with the absolute value of the gradient. Perhaps we allow a error % for this function?
Though doing so still doesn't seem to prevent the finite diff from producing nans (at least in the console). I haven't quite worked out what is causing them.

FYI: I think you may have "expected" and "actual" around the wrong way here. Should the "finite diff" be the expected value?

I have fixed the tests by moving the input tensor away from log's undefined 0. Similar to what I do for the loss function.


Update Developer Guide for Remind command

Codecov Report

Merging #87 (c5de83e) into master (f872a97) will increase coverage by 1.18%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##             master      #87      +/-   ##
============================================
+ Coverage     67.96%   69.14%   +1.18%
- Complexity      443      467      +24
============================================
  Files            83       90       +7
  Lines          1489     1653     +164
  Branches        154      176      +22
============================================
+ Hits           1012     1143     +131
- Misses          425      451      +26
- Partials         52       59       +7

Impacted Files
Coverage Δ

.../seedu/address/logic/parser/AddressBookParser.java
84.21% <0.00%> (-4.68%)
:arrow_down:

...c/main/java/seedu/address/model/person/Person.java
92.77% <0.00%> (-3.15%)
:arrow_down:

src/main/java/seedu/address/ui/PersonCard.java
0.00% <0.00%> (ø)

.../java/seedu/address/model/util/SampleDataUtil.java
20.00% <0.00%> (ø)

.../java/seedu/address/storage/JsonAdaptedPerson.java
100.00% <0.00%> (ø)

...a/seedu/address/logic/parser/AddCommandParser.java
100.00% <0.00%> (ø)

...ain/java/seedu/address/model/person/Insurance.java
71.42% <0.00%> (ø)

...address/model/person/CriticalIllnessInsurance.java
100.00% <0.00%> (ø)

...eedu/address/model/person/DisabilityInsurance.java
100.00% <0.00%> (ø)

...va/seedu/address/model/person/HealthInsurance.java
100.00% <0.00%> (ø)

... and 5 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


#73 Add tests for folding edge cases.

This resolves #73.

[Current coverage][cc-pull] is 92.07%

Merging [#74][cc-pull] into [master][cc-base-branch] will increase coverage by 1.37%

@@             master        #74   diff @@
==========================================
  Files            78         78
  Lines           967        971     +4
  Methods           0          0
  Messages          0          0
  Branches        174        175     +1
==========================================
+ Hits            877        894    +17
+ Misses           54         46     -8
+ Partials         36         31     -5

Powered by Codecov. Last updated by [9c6bd46...c729119][cc-compare]
[cc-base-branch]: https://codecov.io/gh/parsingdata/metal/branch/master?src=pr
[cc-compare]: https://codecov.io/gh/parsingdata/metal/compare/9c6bd4683c25431e6aece05a44a1574006f9f5ef...c729119d45f99e62a8f735012eb0fb3ff4f58e86?src=pr
[cc-pull]: https://codecov.io/gh/parsingdata/metal/pull/74?src=pr


Automate Eclipse project import?

Can we do that, should we not bother and just do it on base box?

http://jenkins-ci.org/content/official-jenkins-lts-docker-image

Import completed.

I give up, maybe someone else can figure this out, closing for now...


fix(APIV2): Make tipracks always calibrate from top

overview
"Calibrate to bottom" when enabled prevents tiprack calibration working as described in #4417. This should fix that.
Fixes  #4417.
changelog
Prevents calibration to bottom having any effect for tipracks.
review requests
Haven't tested this as I don't have a dev environment setup yet, but can confirm things are broken at present and logically this should work.

Thanks for the test!


Using Webpack 2 Externals causes syntax error

Do you want to request a feature or report a bug?
Bug

What is the current behavior?
When externals config option is provided an array of external modules, it produces an output which causes syntax error in the bundle.
If the current behavior is a bug, please provide the steps to reproduce.

Add a module to externals array
Import it in a file
Build using webpack 2.2.0
Check output.

Github repo of buggy behavior
Example:
    externals: [
        'buttercup-importer'
    ]

File:
import test from 'buttercup-importer';
console.log(test);

Output:
/* 1 */
/***/ (function(module, exports) {

module.exports = buttercup-importer;

/***/ }),

What is the expected behavior?
The output should not cause syntax error. Correct output:
/* 1 */
/***/ (function(module, exports) {

module.exports = require("buttercup-importer");

/***/ }),

Please mention other relevant information such as the browser version, Node.js version, webpack version and Operating System.
Webpack: 2.2.0
Node: 7.4

Never mind, found the issue. libraryTarget option needs to be set in order to fix this. More:
https://webpack.js.org/configuration/output/#output-librarytarget
I think externals docs should be more clear.

I have the same problem, and I agree, this is not very clear. What should libraryTarget be set to and why?


consider using systemd instead cron

a la https://home-assistant.io/docs/autostart/systemd/

also still pending


core.#Start Feedback

Saving as a placeholder to collect all the core.#Start feedback in it's current state and future state. It will be tied into the core.#Start Epic #2398

@jpadams assigning to you since you've been talking to the user directly. If we want to collect this feedback in discussions instead then I'd be open to that. We just need a single place to put all the feedback, so Eric can reference it as he completes the Epic above.


Angular froala integration

Hi @jadjoubran ,
i tried to integrate WYSIWYG (Froala) from this repo -- https://github.com/froala/angular-froala
in this starter but with no success. Is there anything out of the ordinary i need to do? It will be nice if you lay down some kind of how to...

Hi @yunus89
You need to install it using bower with the --save argument as mentioned here
and then add froala in index.modules.js
If this still doesn't work, let me know what error you're getting and I'll try to help

@yunus89 any updates?

Yeah, it didn't work. Got following error
vendor.js:13294 TypeError: element.froalaEditor is not a function
at Object.ctrl.createEditor (http://localhost:8000/js/vendor.js:92019:50)
at Object.ctrl.init (http://localhost:8000/js/vendor.js:91986:26)
at link (http://localhost:8000/js/vendor.js:92079:18)
at http://localhost:8000/js/vendor.js:9519:44
at invokeLinkFn (http://localhost:8000/js/vendor.js:9525:9)
at nodeLinkFn (http://localhost:8000/js/vendor.js:8932:11)
at compositeLinkFn (http://localhost:8000/js/vendor.js:8260:13)
at nodeLinkFn (http://localhost:8000/js/vendor.js:8927:24)
at http://localhost:8000/js/vendor.js:9264:13
at processQueue (http://localhost:8000/js/vendor.js:15627:28) <textarea froala="" ng-      model="myHtml" class="ng-pristine ng-untouched ng-valid ng-isolate-scope" id="froala-0">(anonymous function) @ vendor.js:13294
    https://ghbtns.com/github-btn.html?user=jadjoubran&repo=laravel5-angular-material-starter&type=star&count=true&size=large Failed to load resource: net::ERR_NAME_NOT_RESOLVED

Go to view page source, then vendor.js and check if you see any occurrences for froala

Yes.
/*!
 * froala_editor v2.2.1 (https://www.froala.com/wysiwyg-editor)
 * License https://froala.com/wysiwyg-editor/terms/
 * Copyright 2014-2016 Froala Labs
 */

Have you added the froala module to your index.module.js?
And did you run gulp? (or you can just have `gulp watch running from the beginning)

    angular.module('app.components', [
    'ui.router', 'ngMaterial', 'ngStorage',
    'restangular', 'angular-loading-bar', 'froala'
   ]);

Just gulp && gulp watch again, no changes

The issue should be posted on froala/angular-froala
I can try one more thing though
Show me your controller and view code

Just create component normal way. In the component .html added <textarea froala ng-model="myHtml"></textarea>
Next call component in a page.

@yunus89 I'd suggest you try setting up froala in a fresh Angular installation (not this starter package) and see if it works
and then do the same using this repo

had similar issue, fixed by adding froala-wysiwyg-editor/js/ to grunt too

Thanks for contributing @tot-ra! 😄


Separate package for client?

I think most of the dependencies that get installed with pip install whisper-live are only needed for the server, not the client. How can I use the client without installing all the server's packages (torch, triton, ..)?

@powellnorma you are right, the dependencies installed with pip are combined for both server and client. And currently, there is no way of installing whisper-live from pip only for the client.


Fix reading BulkAvatarData packets.

This should fix the following error reported in the browser's console log when some avatars (e.g., Kalila's) are present in the domain:
Uncaught RangeError: Offset is outside the bounds of the DataView

I have been running with PR and have not had any problems and none of those error messages.
I approve this PR


[SPARK-11955][SQL] Mark optional fields in merging schema for safely pushdowning filters in Parquet

JIRA: https://issues.apache.org/jira/browse/SPARK-11955
Currently we simply skip pushdowning filters in parquet if we enable schema merging.
However, we can actually mark particular fields in merging schema for safely pushdowning filters in parquet.

Test build #46611 has started for PR 9940 at commit e24529d.

Test build #46611 has finished for PR 9940 at commit e24529d.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/46611/
Test FAILed.

Merged build finished. Test FAILed.

retest this please.

Test build #46626 has started for PR 9940 at commit e24529d.

Test build #46626 has finished for PR 9940 at commit e24529d.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/46626/
Test FAILed.

Test build #46656 has started for PR 9940 at commit ff4ef4c.

Test build #46656 has finished for PR 9940 at commit ff4ef4c.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/46656/
Test PASSed.

ping @liancheng @yhuai

I don't really get the idea of this one, what exactly does "oneSide" mean?

@liancheng the naming might a little confusing. It means that the fields only exist in one of the merging schemas. For example, when we want to merge two schema: {a: Int, b: String, c: Double} and {a: Int, c: Double}, then the b: String is only existing in one schema.
In other words, this patch tried to mark the differences between merged schemas.

Oh I see, so basically it indicates that a field doesn't exist in schemata of all part-files, and we try to skip filters that involve this kind of fields when doing filter push-down. Right?

Yes, you are right.

Test build #46848 has started for PR 9940 at commit 4536b72.

Test build #46848 has finished for PR 9940 at commit 4536b72.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/46848/
Test PASSed.

Merged build finished. Test PASSed.

Is it a regression?

Hi @yhuai Can you explain more? What you meant about regression?

oh, I thought it's a bug fix (so, I was wondering if it's a regression from 1.5 or not). But, it is actually an improvement?

@yhuai I think so. We completely skip pushdown filters now if schema merging is enabled. This patch is to improve that.

@yhuai Here is the background: Parquet filter push-down is disabled when schema merging is turned on because of PARQUET-389.
I'm somewhat hesitant to have this change. On one hand, I do want to have filter push-down in case of schema merging since it's generally a very useful optimization. On the other hand, this change is a little bit hacky, since schema metadata is not intended to be used in this way.
Anyway, at least, let's have two more updates for this PR:

Rename oneSide to something more intuitive
Schema metadata is persisted together with the schema, this temporary metadata entry should be cleared before saving the Parquet file.

Renamed oneSide to particular.
I will update this for the second point later.

Test build #46881 has started for PR 9940 at commit 2a4e471.

Test build #46881 has finished for PR 9940 at commit 2a4e471.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/46881/
Test PASSed.

Merged build finished. Test PASSed.

Test build #47229 has started for PR 9940 at commit db8ffa3.

Test build #47229 has finished for PR 9940 at commit db8ffa3.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/47229/
Test PASSed.

Test build #47241 has started for PR 9940 at commit 40533a7.

ping @liancheng
I tried to update this for your suggestions. Now the metadata will be removed before saving Parquet file. Besides, I also add more test cases.

Test build #47241 has finished for PR 9940 at commit 40533a7.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):\n  *  public abstract static class PrefixComputer\n

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/47241/
Test PASSed.

Merged build finished. Test PASSed.

@viirya Thanks for your efforts! Would you mind me revisiting this after 1.6 release? I would like see whether we can have PARQUET-389 fixed in Parquet community ASAP, so that we may not need to work around it in Spark 1.7/2.0.

@liancheng Sure. Thank you!

@liancheng Can we revisit this now? Or we want to wait a bit longer?

Overall LGTM except for several minor issues.
Another thing is that, we probably want to use a more special name (something like _OPTIONAL_) to avoid naming conflict with user defined metadata keys.

Test build #50190 has started for PR 9940 at commit 1a11770.

Test build #50190 has finished for PR 9940 at commit 1a11770.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/50190/
Test PASSed.

Merged build finished. Test PASSed.

Thanks! I'm going to merging this to master.

Hey guys -- this patch is severely under documented. It also isn't great to introduce something in the metadata to tag a column as optional.

Also do you actually see a real use case for this issue, or are you just thinking it might be useful to optimize this?

FYI https://github.com/apache/spark/pull/14074
I'm actually thinking we should perhaps revert this patch, but I don't want to do it when we are so close to rc.

This is introduced for real use case and it is very useful. Actually this patch is developed to fix the problem when I was in previous company which is a heavy Spark user for machine learning and ETL. In practice, schema merging is common because of schema expansion. Instead of reverting this, I would suggest we can fix this issues (documenting and hide the API you just did). It surely causes performance regression in such cases without this patch.

OK thanks.


Skip mklabel gpt if already gpt

was there a bug which led to this PR?

In some test scenarios it would fail to mklabel gpt, and would need a partprobe. I don't anticipate that would happen in any real world scenarios, but it seemed like a decent change anyway since there is no need to mklabel gpt if it already is gpt, and I'd be grateful too :)

@andymcc yup! sure this is a decent change, my concern is more about the way it's done. I'm usually not really enthusiastic about output parsing/screen-scraping even if I know sometimes there is no choice.
Perhaps this could help :
[root@ceph-osd0 ~]# blkid /dev/sda -t PTTYPE="gpt"
/dev/sda: PTTYPE="gpt"
[root@ceph-osd0 ~]# echo $?
0
[root@ceph-osd0 ~]# blkid /dev/sdb -t PTTYPE="gpt"
[root@ceph-osd0 ~]# echo $?
2
[root@ceph-osd0 ~]#

this could replace this task
it's just an idea, what do you think?

@guits - thanks for the response! Sorry I took a while getting back, I was  out last week with no access.
I'll give that a go - my initial test suggests it wont work for basically the same reason, it fails to initially set the partition table to gpt, so it returns a 2 (similar to using parted). I'll do a few more tests and see if i can come up with something else.

Ok I have a pretty good way to change this that I think is better for all.
The parted module does the trick pretty well.
I think we could probably skip the list before hand and the conditionals, but I'm guessing there was a pretty good reason for those, so I've left them in place for now.


Add Juergen Helmelt as contributor & local maintainer

Agreed on TSC 20221116

Add Juergen as Egeria contributor
Add Juergen as maintainer for the following 2 repositories (and any related future ones)

egeria-connector-integration-topic-strimzi
egeria-connector-integration-event-schema

Updated contributors.md (in Egeria repo only)
Added to contributors Team for 'read' access across all repos
Added to new Team specifically for 'maintain' access on these two repos

NOTE

Any changes on the specific repos are best done by the new contributor - ie in terms of CODEOWNERS etc

Trying to find out how to setup Egeria contributors badge


Android: Choose from Library URI doesn't work after app re-launches

On Android (Pixel XL, Android 7.1.1), I can save the URI from the popup dialog and use it to load images after the app re-launches later only if the URI is from the camera option. If I select a photo from my library, I can use that URI successfully until I re-launch the app, and then the URI doesn't load the image any more.
Allowed Permissions: Camera, Phone, Storage
Options used:
   var img_options = {       title: 'Select car picture',       storageOptions: {         skipBackup: false,         path: 'images'       },       noData: true,       mediaType: 'photo',     };

This is with the latest version of this library

Please check latest version of library. It should work fine.

@chriskonstad Could you check this bug with latest version (0.25.4)?

Closing due to inactivity. If anyone sees this issue again please reopen.

Closing due to inactivity. If anyone sees this issue again please reopen.

I have the same issue in a 0.27.1.
I have a list of images in my app. I choose photo from Library, add it to array of images and save uri to the storage. Image with this uri correctly loads into
After app re-launch  is empty. But after I choose the same image from Library and there are 2 identical images in my list - both of them become visible on a page.


usb: protocol field in descriptor for CDC ACM should default to zero

The protocol field here at https://github.com/zephyrproject-rtos/zephyr/blob/4304b4c38b23d7d4a5d9bf258eb6705fcd5f373f/subsys/usb/usb_descriptor.c#L207
should default to 0x00 (meaning "no protocol") instead of 0x01 (meaning "I'm actively advertising that I support the AT V.250 protocol" AKA V25TER).
Although this field has been ignored by major OSs during the last decades, this creates a big deal of problems with ModemManager sending unexpected AT commands when plugging in a dev board. This has been mitigated up to some point by having ID_MM_DEVICE_IGNORE udev rules all over the place, which is just a stopgap measure.
This is a simple change, but I don't want to send a pull request before more work in #4661 is done due to fear of merge conflicts. Also, some applications might want to advertise support for some AT command set or ethernet emulation or a vendor protocol (see table here), which is related to #4661 (refactor usb descriptors) and #6593 (let developers specify some values when putting together the usb descriptors).
cc @finikorg @jfischer-phytec-iot

@IvanSanchez OK with the change proposed, are you going to send a PR?

@finikorg I'd rather wait for #4661.

@finikorg can you submit a PR to fix this, looks like #4661 will never happen!

@nashif done


Update to latest egui master

What

Closes https://github.com/rerun-io/rerun/issues/5018

egui now also has a 300ms delay between stopping the mouse pointer over something and showing the tooltip, as discussed during standup.
This expands the egui "style" panel to a debug panel with the egui "inspection" ui in it.

Checklist

[x] I have read and agree to Contributor Guide and the Code of Conduct
[x] I've included a screenshot or gif (if applicable)
[x] I have tested the web demo (if applicable):

Using newly built examples: app.rerun.io
Using examples from latest main build: app.rerun.io
Using full set of examples from nightly build: app.rerun.io

[x] The PR title and labels are set such as to maximize their usefulness for the next release's CHANGELOG

PR Build Summary
Docs preview
Examples preview
Recent benchmark results
Wasm size tracking

uh-oh, we're still patched on egui_tiles it seems


French Language

I tried to add the French Language.
Description
I tried to add the French Language to the already existing system. I did not translate the Admin Panel part because I don't see the use for it.
Motivation and Context
I tried to add the French Language to the already existing system. I did not translate the Admin Panel part because I don't see the use for it.
How Has This Been Tested?
I am currently running it in my website and It works fine for me
Types of changes

[x] New feature (non-breaking change which adds functionality)

Checklist:

[x] My code follows the code style of this project.

Hello, thanks for the contribution, I think they corrected those messages, you can incorporate without problems to the CMS. There are still several translations missing, but for the moment, at least, something is something.

Hello. I fixed the problems pointed out here. I will continue the translations further on.

Excellent, thanks for correcting the suggestions.


Smart (relative) links based on article title or slug

Finally tackles a long standing problem with outdated links described
in #82.
Since we now have article slug history trackling (if you rename
an article, its original slug & title will still take you to it) this feature
is ready for prime time.
It's now possible to link to any article either via its full title or its slug:
[[This is an article title]]

[[this-is-an-article-slug]]

This is especially convenient because it takes domains and paths
out of the equation.
However, I'll need to make a rake task to migrate existing URLs that
match valid article titles and hardcode the ORIENTATION_DOMAIN
or use relative paths.

@adamfortuna This one's for you. ;-)


Type-safety regressions in the latest beta

Describe the bug
This commit seems to make the type checking much faster, however there're few regressions in cases of typechecking.

redirect method types aren't using RegisteredRouter types.
RouterState matches aren't using RegisteredRouter types. I am using something like this  export const useMatches = () => useRouterState({ select: state => state.matches }); currently instead of the built-in useMatches, because the workaround had proper types. Now both of them don't use our router type.

Your Example Website or App
https://stackblitz.com/edit/github-kmrmjb?file=src%2Fmain.tsx
Steps to Reproduce the Bug or Issue
Redirect being untyped:

Import redirect from router
Try to invoke redirect with inexistent path
It doesn't type-error

useRouterState matches and/or useMatches

Use the hook
Try to access matches' e.g. context
Observe incorrect types

Expected behavior
Redirect should have proper types based on RegisteredRouter.
There should be a way to access matches in a type-safe way, e.g. to access all rendered routes contexts.
Screenshots or Videos
No response
Platform

OS: macOS
Browser: Safari
Version: 17.0 beta

Additional context
No response

Easily fixable with the new types
On Aug 23, 2023 at 7:19 AM -0600, Paweł Błaszczyk @.***>, wrote:

Describe the bug
This commit seems to make the type checking much faster, however there're few regressions in cases of typechecking.
• redirect method types aren't using RegisteredRouter types.
• RouterState matches aren't using RegisteredRouter types. I am using something like this export const useMatches = () => useRouterState({ select: state => state.matches }); currently instead of the built-in useMatches, because the workaround had proper types. Now both of them don't use our router type.
Your Example Website or App
https://stackblitz.com/edit/github-kmrmjb?file=src%2Fmain.tsx
Steps to Reproduce the Bug or Issue
Redirect being untyped:

Import redirect from router
Try to invoke redirect with inexistent path
It doesn't type-error

useRouterState matches and/or useMatches

Use the hook
Try to access matches' e.g. context
Observe incorrect types

Expected behavior
Redirect should have proper types based on RegisteredRouter.
There should be a way to access matches in a type-safe way, e.g. to access all rendered routes contexts.
Screenshots or Videos
No response
Platform
• OS: macOS
• Browser: Safari
• Version: 17.0 beta
Additional context
No response
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you are subscribed to this thread.Message ID: @.***>

The redirect seems to be fixed, RouterState matches doesn't though.
Updated playground to latest router version: https://stackblitz.com/edit/github-kmrmjb?file=src%2Fmain.tsx


Menu Problem in Reverie

Hi, trying out Reverie and loving it, but stumped on why the menu isnt working as expected.
Firstly, The primary menu is created in Wordpress Menus but it does not show up as the current menu in the page.
Secondly, the menu is not inserting the DL in front of the menu and therefore is creating incorrect code:

Dont know why, any help much appreciated and thanks for the great work on reverie so far.
Bodhi

Hi, solved the problem, just needed to select where i wanted the menu to be inserted. thanks.

Glad to hear :)


[PROPOSAL][CCI] Logs collection, processing and metrics collection

What are you proposing?
Add a service or may be a script for collecting and analyzing logs, crashes, etc. like sentry, loki or graphana
What problems are you trying to solve?
It'll help to calculate and store statistics of errors appearance ratio. Also, it'll be very helpfull for opensearch newbies (like me) to create new issues

Do you have any ideas for a good python framework for this? It probably makes sense to limit the options to open source, so that the library can remain open source.

@Refffy I did a presentation for collecting logs from Python into OpenSearch. I wonder if it would make sense to integrate something like that here.
https://gist.github.com/dtaivpp/a9b00957aa7d9cfe33e92aff8d50c835
Above is a gist and below is the video of this.
https://youtu.be/-8CNa4T2Jaw
Is something like this what you were thinking of?

I see so more of like an APM type workflow so that you get more context. Might be worth exploring adding traces to this. Here is another good place to read:
https://opentelemetry-python.readthedocs.io/en/latest/api/trace.html

@Refffy, @dtaivpp Please feel free to take up this issue and raise a PR with your proposed solution. Thanks :)

Hi @saimedhi! This sounds like a fun proposal to work on! Can I request assignment on this issue?

@dblock that was my interpretation as well. Something similar to was @dtaivpp mentioned.

@dblock What do you think is best way to address this issue? I was thinking of integrating the log collection script that David mentioned.. Does that make sense to you?

Closed via https://github.com/opensearch-project/opensearch-py/issues/331.


Right click -> "Open in VLC"

Lots of people want to use VLC to always play their media. This feature would help out in situations where our player is too limited (like we don't currently handle multi-audio files due to Chrome limitations).

I went open an issue about this. Would be interesting to let the VLC how default player.

or mpv player for the other platforms
https://github.com/mpv-player/mpv

I can handle this. However, it seems like the current method of streaming with VLC assumes that webtorrent-desktop already began trying to stream it (since the only current usage of it is when it tries to stream a file and finds out it can't play it). Is there a cleaner way of approaching this other than letting webtorrent begin to stream the file and then immediately calling dispatch('vlcPlay') ?

https://github.com/feross/webtorrent-desktop/pull/674

Can this be closed now that we have the preference item, or do we want to be able to open specific files in an external player?

@mathiasvr I think let's close this for now. We've made the situation A LOT better with the preference item.
The long term solution is to just improve our player so that 90% of users won't want to use an external player. There will always be the super nerds out there who want to set an external player (and the pref item is for them!)


Line of Sight

From @joebayles on September 28, 2015 18:19
https://nsec.esri.com/arcgis/home/item.html?id=bdb59e3de7904449aa92acb329873b4b

[ ] Delete?

Copied from original issue: ArcGIS/mil-intel-desktop-solutions-templates#130

@joebayles - changed https://nsec.esri.com/arcgis/home/item.html?id=bdb59e3de7904449aa92acb329873b4b to Demo Review group.
@kgonzago - in the future, we will want to move this from Vermont to the Monterey, CA area and release to the Try it Live experience as discussed when you were in CA in 09/2015.

:+1:

@jrweakland noted.


Fixed HomePage route issue #178

https://github.com/user-attachments/assets/bd524c55-c88b-4ebd-b197-3d5c14b574e1

@mansiruhil13 plz add gssoc-ext label to this PR too


Add new custom action to AdvancedPaste module

Summary of the Pull Request
This pull request introduces a new custom action with a corresponding hotkey, integrated throughout the application as follows:

Custom Action Implementation: Added in dllmain.cpp with constants defined in AdvancedPasteConstants.h.
Telemetry: Integrated tracking for the custom action within trace.cpp and trace.h.
User Interface Enhancements: Updated MainPage.xaml with new UI elements specific to the custom action, alongside event handlers in Program.cs.
Helper Methods: Added necessary helper methods in CustomActionHelper.cs.

Testing:
This update was manually tested to confirm:

The hotkey and custom action function as intended.
Telemetry logs are correctly generated.
UI elements display and respond accurately.

PR Checklist

[x] Closes: #xxx
[x] Communication: I've discussed this with core contributors already. If work hasn't been agreed, this work might be rejected
[x] Tests: Added/updated and all pass
[x] Localization: All end user facing strings can be localized
[x] Dev docs: Added/updated
[x] New binaries: Added on the required places

[x] JSON for signing for new binaries
[x] WXS for installer for new binaries and localization folder
[x] YML for CI pipeline for new test projects
[x] YML for signed pipeline

[x] Documentation updated: If checked, please file a pull request on our docs repo and link it here: #xxx

Detailed Description of the Pull Request / Additional comments

Add new custom action and hotkey in dllmain.cpp
Define new custom action's constants in AdvancedPasteConstants.h
Add telemetry for new custom action in trace.cpp and trace.h
Add new UI elements for custom action in MainPage.xaml
Add event handlers for new UI elements in Program.cs
Add helper methods for custom action in CustomActionHelper.cs

Validation Steps Performed
All tests passed, confirming feature reliability.

Where is the associated issue. What does the action do

A PR should be very topic centralized. This feels like a like of things. Namely the history.md

Hey @crutkas, that action is for a custom action on advanced paste. Actually, I'm new to contributing, so from next time, I'll try to raise topic-specific PRs for specific issues. Thanks for making me aware of the contributing standards!

@sanskaarz  This also touches a lot of things outside the core concept as well.  PRs from a hygiene perspective if at all possible be limited to a single core topic.

The PR in the current state doesn't add a feature, as the only code it seems to add is a sleep call for 2 seconds. If you'd like to add a feature please file an issue for it which gives a description of exactly what the feature does and how it can be used, as long with some screenshots of it in use!
For bookkeeping we'll close this PR for now, but look forwards to any contributions in the future!

@sanskaarz  This also touches a lot of things outside the core concept as well.  PRs from a hygiene perspective if at all possible be limited to a single core topic.

For Sure @crutkas ❤

The PR in the current state doesn't add a feature, as the only code it seems to add is a sleep call for 2 seconds. If you'd like to add a feature please file an issue for it which gives a description of exactly what the feature does and how it can be used, as long with some screenshots of it in use!
For bookkeeping we'll close this PR for now, but look forwards to any contributions in the future!
Sure @craigloewen-msft

Sure @craigloewen-msft


Stroke position is different for Decoration vs SVG output

Bug Description
Flutter only supports inner strokes (aka borders) on BoxDecoration, but the SVG export is currently using centered strokes on shapes. This means that strokes display differently if a rectangle is exported as a Container vs as a SVG shape.
If possible, perhaps SVG export could either use inner (for consistency), or support all three options with a warning for Containers.

Unfortunately, this isn't easily solved within the current framework. SVG only supports center strokes, and Flutter only supports inner strokes.
It may be possible to default to inner strokes via the clipping approach mentioned in the link above, but that adds complexity and may have runtime performance implications.

Note that unsupported Container strokes currently generate a warning, but SVG strokes do not. We should add the latter.

Note that unsupported Container strokes currently generate a warning, but SVG strokes do not. We should add the latter.


[Event Request] report 15000060 "Remittance - export (BBS)" (Norwegian Localization)

Can you add event OnBeforeGenJnlLineOnPreDataItem in report 15000060 "Remittance - export (BBS)"?

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. We will update this issue with information about availability.

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. We will update this issue with information about availability.


Support external ressources cache check

New steps to support external resources browser cache check, this can be useful when using private CDNs.

Check for a specific host
browser cache must be enabled from "([^"]*)" (png|jpeg|gif|ico|js|css) resources
Check for self hosted only, same behaviour as the old one
browser cache must be enabled for (png|jpeg|gif|ico|js|css) self hosted resources
Check for any host
browser cache must be enabled for (png|jpeg|gif|ico|js|css) resources

Thank you for your contribution! It looks like a super useful feature.
What do you think about defining an only step? I'm thinking about something like this:
@Then /^browser cache must be enabled for (.+\..+|external|internal) (png|jpeg|gif|ico|js|css) resources$
Thank you again!

Thanks for your efforts, Andrei. You have done such a great job.
I will try to review and merge it in the next weeks.

Hi @mortola ,
did you had a chance to take a look at the PR?
Thanks

I'm sorry I couldn't review it faster. I have just merged it.
Thank you for your contribution!


pythonPackage.pypcap: 1.2.3 -> 1.3.0

Description of changes

Bump pypcap to its latest release 1.3.0:

https://github.com/pynetwork/pypcap/blob/master/Changelog.md#pypcap-130-2022-09-05
https://pypi.org/project/pypcap/1.3.0/
https://github.com/pynetwork/pypcap/pull/109

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[x] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
22.11 Release Notes (or backporting 22.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 194248 run on x86_64-linux 1

2 packages built:

python310Packages.pypcap
python39Packages.pypcap


Academic papers

Hello, timmyfaraday, this is a great job.
Can you show some academic papers about stochastic optimal power flow, i.e. StochasticPowerModels.jl.
Thank you very much.

The paper describing the work is submitted to PSCC2022 Porto, and currently under review. Therefore, it is not yet available. If the other authors are okay with it, I'm willing to share the submitted draft with you. Just send an email to<EMAIL_ADDRESS>


721 isnt responding to my local network

Has any one else run into this issue? No matter how I approach the Art Kit it will not allow me to upload my images tokens or meta data.
Ive tried applying it locally through 1 file. Then again opening my whole collection using a zip file. Aswell as pointing the url to my local host and my IFPS hosted file.

ME TOO


ADR for Model-as-a-Service

Motivation and Context

Related to: https://github.com/microsoft/semantic-kernel/issues/6530, https://github.com/microsoft/semantic-kernel/issues/3992
Description

Contribution Checklist

[ ] The code builds clean without any errors or warnings
[ ] The PR follows the SK Contribution Guidelines and the pre-submission formatting script raises no violations
[ ] All unit tests pass, and I have added new tests where possible
[ ] I didn't break anyone :smile:

Is this available for c#?


Should be possible to host on subdomain in SINGLE_TENANT_MODE

Lines like root_url(subdomain: current_subdomain) in conjunction with the email_helper mean that if you are hosting in SINGLE_TENANT_MODE then your subdomain will be trimmed off.

Good point, thanks! Feel free to open a PR with a fix, otherwise I'll look into it asap.


ci: Delete conflicting outputs of build_runner

Current dependencies on/for this PR:

main

PR #75   👈

This stack of pull requests is managed by Graphite.

Merge activity

Jan 24, 5:59 AM: @Mr-Pepe merged this pull request with Graphite.


Corrected def newinstall to scipipe instead

I wanted to add KT as a reviewer but I could not find him.

Ugh, this is fallout from a cleanup done in DM-7556... I'm not sure what I was thinking there...


[backport v2.8.next1] Add vGPU allocatable warning banner

This is a backport for https://github.com/rancher/dashboard/pull/11017
Fixes https://github.com/rancher/dashboard/issues/11009

@a110605 let us know if there's anything else for you to look at here since with Francesco out, we'll need someone else to merge. If you feel everything's OK based on your own concerns, then you can approve & merge.

@a110605 let us know if there's anything else for you to look at here since with Francesco out, we'll need someone else to merge. If you feel everything's OK based on your own concerns, then you can approve & merge.

Hi @gaktive , the vGPU allocatable number in dropdown is introduced in PR https://github.com/rancher/dashboard/pull/11399.
Without https://github.com/rancher/dashboard/pull/11399, this PR banner is meanless.
As I synced with Franesco last time, this PR should wait for https://github.com/rancher/dashboard/pull/11399 merge first. (correct me if I wrong)

@gaktive I spoke with @a110605 and this is awaiting backend changes- moving to 2.8.next2


BUG REPORTIn mobile view Navbar icon is not working

Description
Im mobile view the navigation bar button to open the menu do not work.
Screenshots

Additional information
No response
What browser are you seeing this bug on?
No response
Checklist

[X] I have checked the existing issues
[X] I have read the Contributing Guidelines
[X] I have read the Code Of Conduct
[X] The changes don't break the code

Go ahead @vidhiisaxena

@vidhiisaxena Update?

Working on it will create a final PR tomorrow 😊


Alternative design for citation and DOI on dataset page

I like that both the citation and DOI are mentioned in the gray box at the top of the dataset page, but I find the current design with the two "labels" a bit ugly.
Current version

Alternative version

I added another dt dd group, with the label "citation"
I spaced all dts evenly, so they line up vertically
Instead of a label, I made the citation a regular link, which would point to the same location as now: the full citation at the bottom of the dataset page. It could be named "Full citation" or "How to cite this dataset"
The DOI remains a label, but with enough padding on the left so it doesn't stick to the Full citation" link.

I like the attention to details. Thank you. I'm still not to happy with this page overall I must admit, but may a lot of small improvements a la this one can bring it forward.

Just to be contrarian I like the "quote" label, it is consistent with other sites that try and get users to cite content, e.g. http://search.crossref.org (see below).

The CrossRef site also displays citations in a popup:

This supports multiple styles that users might want, at the moment GBIF has its own style that isn't terribly useful.

I agree that providing the citation in multiple formats would be really useful. Maybe the link text should say "Cite this dataset" which then unfolds a box where a citation format can be chosen and copied. Also look at Zenodo for inspiration.

I'd like to provide multiple citation formats. There has been some internal disagreement on the usage of this, but this is +2 for it. Thanks. This will also require some changes in the APIs and ideally do the same for downloads.

See my issue https://github.com/gbif/portal-feedback/issues/33 (which probably belongs here). CiteProc generates multiple citation formats (this is the same tool used by CrossRef, Zenodo, Mendeley, etc.).

DataCite's DOI Citation Formatting service, which uses citeproc.js, can be used to generate a citation in various formats. For example, https://citation.datacite.org/format?doi=10.15468/aomfnb&style=apa returns a citation for the eBird dataset in APA style.
The same thing can be done using DataCite's DOI content negotiation service, whereby the backend calls the DOI Citation Formatting service.  For example, $ curl -LH "Accept: text/x-bibliography; style=apa" https://doi.org/10.15468/aomfnb returns the same citation for the eBird dataset in APA style. Note this content negotiation service is currently in testing and goes into production 9 May. It is described in detail in this blog post.

I'm closing this in favour of https://github.com/gbif/portal-feedback/issues/33 and will stick with the blue box - sorry Peter. Adding different version to download the citation sounds good to me.


Click on Stage triggered even when it should not

In project https://scratch.mit.edu/projects/305593150/ if you can click on the stage to activate the zoom feature. It seems that the click on the Stage is triggered even when you click on a sprite. For example, if I click the "reset" sprite, that is supposed to bring the view back to the starting point, what I get instead is a zoom, the click on the sprite is not taken into account (or at least the click on the Stage is triggered anyway, even if it should not)

I tried converting again the project https://scratch.mit.edu/projects/305593150/, but the "converting" rotating shape goes on forever (both in Chrome and Firefox)

@PullJosh Not sure what the system is like ATM to ensure leopardjs.com's code sandbox generation uses up-to-date leopard and sb-edit dependencies? Either way not ideal that this would fail silently (I get a 504 gateway timeout error that the Leopard site doesn't detect/show an error for), network response below:
GET https://leopardjs.com/api/305593150/codesandbox
504 Gateway Timeout

An error occurred with your deployment

FUNCTION_INVOCATION_TIMEOUT

(nb: other projects still load)
Haven't yet tested this project locally to see if it does error locally with current Leopard code and/or just before recent changes. Something must've changed either in the codebase or on the site to prevent the project from loading since it did load back when this issue was opened in 2020.


No Object Tags?

Hello, first of all, great functions.. Been looking for some kind of solution like this for a while.
I have tested everything as per the instructions and it seems to be working well. However, objects in my s3 bucket are not being tagged. But I am not sure why no tags are applied, and no errors are being generated.
As far as permissions, these are already basically s3:* but ive also given full perms on my test environment setup but... still no tags.

Solved, lambda function was literally using 1mb more than allocated and dying.


Add more sample images to spec/files/taylor_swift/

These are used for tests and for sample data, and I'm shooting for a few more taylor swift pictures for some of the typical dev seed data.
Since it's a repo commit, anything at a mb or less is probably better than anything larger.

all png's would be easiest to glob too


As a volunteer, I want to ask the chatbot for help so it can guide me on how to submit a report.

Description:
Acceptance Criteria:
Definition of Done:

This is regarding the user asking for help on how to submit a report. This is not the user story related to asking for help because the volunteer is in danger.

Need to discuss what level of detail of help is expected in order to develop help conversation flow charts.

I'd expect them to know a fair amount/be trained well enough for most things. The help can give just a list of potential commands (help, report, etc). I also think it should give just a little more context for what the potential responses mean. What does 1-5 mean for severity? I'd keep this as simple as possible with the idea we can always add more QnA style stuff into it later. Either via code or the MS QnA resources.


output channel confuse location when there are multiple vscode window

VSCode Version: 1.9.1
OS Version: Darwin x64 16.4.0

Steps to Reproduce:

Open two vscode window

In one vscode window (such as cc) , call a command which will create an output channel when click confirm button

As I expected, this output channel will show in current vscode window, but it showed in another window which opened project aop

This is my code, it will be called through RPC when user do some operation in electron GUI
seekAdd(params) {
  const output = vscode.window.createOutputChannel('seek');
  output.show();
  output.appendLine('\n开始添加模板...');
  ...
},

What should I do if I want the output channel show in vscode window which call that command ?

vscode.window should always target the window where the command is executed. I have tried this multiple times and it always works for me.
The problem might be the dialog which somehow confuses electron what is the active window.
@huangtengfei Can you also reproduce this when there is no dialog?
If no then I believe this is the electron issue
@bpasero vscode.window - we get from electron what is the active window, right?

@isidorn vscode.window is just our API namespace and has nothing to do with Electron actually. It always executes in the same renderer where the extension runs that triggers it.

@isidorn I tried with no electron dialog, code like this
const seekAdd = vscode.commands.registerCommand('extension.seekAdd', function () {
  const statusBar = vscode.window.setStatusBarMessage('$(watch)\t 正在启动添加场景界面...');
  setTimeout(function () {
    statusBar.dispose();
  }, 3000);
  // electronProcess = spawnElectron({
  //     appPath: path.join(__dirname, 'app'),
  //     sockPath,
  //     envParams: {
  //         ELECTRON_CURR_VIEW: 'add',
  //         ELECTRON_CURR_DIR: currDir
  //     }
  //     // others options in the future
  // });
  const output = vscode.window.createOutputChannel('seek');
  output.show();
  output.appendLine('start add...');
})

It executed correctly (output channel show in vscode window where the command is executed).

I agree that the electron window confused the active vscode window.

@bpasero well according to this bug it seems like opening an electron dialog confuses vscode.window and it does not execute in the same renderer where the extension runs, but in the other renderer

Did you try to reproduce?

@bpasero I tried to reproduce it but if I add electron code there will be a dialog, then output channel will confuse location. So I just comment out these code like this

I agree what @isidorn said. It seems like opening an electron dialog confuses vscode.window renderer.

I was unable to reproduce this using the following extension.
While the 10s timeout is waiting I would manually open the VSCode about dialog and output would get appended to the correct window.
@huangtengfei please try to give us a reproducable sample. Since the spawnElectron process is something specific for your extension and I do not have access to it
'use strict';
// The module 'vscode' contains the VS Code extensibility API
// Import the module and reference it with the alias vscode in your code below
import * as vscode from 'vscode';

// this method is called when your extension is activated
// your extension is activated the very first time the command is executed
export function activate(context: vscode.ExtensionContext) {

    // Use the console to output diagnostic information (console.log) and errors (console.error)
    // This line of code will only be executed once when your extension is activated
    console.log('Congratulations, your extension "isidorext" is now active!');

    // The command has been defined in the package.json file
    // Now provide the implementation of the command with  registerCommand
    // The commandId parameter must match the command field in package.json
    let disposable = vscode.commands.registerCommand('extension.sayHello', () => {
        // The code you place here will be executed every time your command is executed

        // Display a message box to the user
        setTimeout(() => {
            const output = vscode.window.createOutputChannel('seek');
            output.show();
            output.append('hello from isidorrr');
        }, 10000);
    });

    context.subscriptions.push(disposable);
}

// this method is called when your extension is deactivated
export function deactivate() {
}

@isidorn This is a demo with electron -> vscode-electron-demo
And you can install this extension for testing multiple vscode window

@huangtengfei could not reproduce. I nicely installed your extension and the electron window is opening in the same window. No matter what I do no output is added in any of the windows.
Though even if I got to reproduce this issue I believe it is an electron bug, so I would recommend you got over to the electron repository and file an issue there https://github.com/electron/electron
Apart from that we can keep this issue open as other people might be able to help. I also recommend asking on stack overflow

I tried several times on my colleague's computer, this bug reproduced every time.
you can see the process from this gif > test-vscode.gif
And I do not think this is electron's bug because it is vscode that cannot get current window after electron dialog be closed...

@huangtengfei Can you still reproduce this with latest vscode insiders?
https://code.visualstudio.com/insiders/


Feature/wdl dag improvements

This branch focuses on two things:

Upgrading DAG for WDL to match functionality of CWL DAGs
WDL parser now resolves imports that are HTTP/HTTPS or local files (note that Cromwell does not currently support HTTP/HTTPS imports)

[x] Check that you pass the basic style checks and unit tests by running mvn clean install

Coverage increased (+0.05%) to 73.117% when pulling a69b24cba7ebbfb6179694f693d269b153952f78 on feature/wdl_dag_improvements into 1b12b958daad9e8b8736f6188bb020ef1f06b48e on develop.


TextSearchQueryNew has conflicting options

Testing #223154
From the API:
export interface TextSearchQueryNew {
		/**
		 * The text pattern to search for.
		 */
		pattern: string;

		/**
		 * Whether or not `pattern` should match multiple lines of text.
		 */
		isMultiline?: boolean;

		/**
		 * Whether or not `pattern` should be interpreted as a regular expression.
		 */
		isRegExp?: boolean;

		/**
		 * Whether or not the search should be case-sensitive.
		 */
		isCaseSensitive?: boolean;

		/**
		 * Whether or not to search for whole word matches only.
		 */
		isWordMatch?: boolean;
	}

What is the behavior supposed to be in the following cases:

The pattern contains \n.
The pattern contains \n and isMultiline is false.
The pattern is a regex and isCaseSessitive is false.
The pattern contains whitespace and isWordMatch is true.

The pattern contains \n.

If regex is not on, it just looks for \n literally.

The pattern contains \n and isMultiline is false.

I believe that this actually acts as if isMultiline is true (if I'm interpreting this code correctly). Any time that you have regex enabled and explicitly match a newline, it will be multi-line. I should probably document this.

The pattern is a regex and isCaseSessitive is false.

Any characters in the regex will also match the other case. ie: [a-z] should also match all characters, not just lowercase letters.

The pattern contains whitespace and isWordMatch is true.

It will look for the whitespace, and will look for line boundaries on either side of the search string.

I can also add extra examples for corner cases so that this is more clear.