Add Hightouch integration docs

Hey there!
I’m a docs manager at Hightouch, a reverse ETL platform. We’d love to add some documentation about the Statsig destination we just built. Hopefully directly submitting a PR is the right way to go about this, but please let me know if there’s any other steps to take.

Hey there! I made some minor changes to your PR over here https://github.com/statsig-io/docs/pull/758.
Thanks for building this integration. I'd love to try it out! Do you have a demo account I can use?

Awesome, thanks so much @kenny-statsig , looks great.
Re: trial, we don't have official demo account AFAIK, just encourage folks to get on a free account. LMK if that doesn't work for some reason, and I can see if we can set something up.
And thanks for the call out re: rate limits, will definitely add!

default rate limit of 10 req/s and 4500 req/15min on Console API

Hey @kenny-statsig , just wanted to double check on the rate limit piece: you mention the default values--is there a way to change them?

default rate limit of 10 req/s and 4500 req/15min on Console API

Hey @kenny-statsig , just wanted to double check on the rate limit piece: you mention the default values--is there a way to change them? Was looking in the Console API docs and might've missed it

These are rate limits that we set internally. The only way to change them is to upgrade to an enterprise account.

Committed


Add catalog subsets

This idea is about creating small subsets of providers from catalogs with very small efforts.
Concept example:
import dependency_injector as di

class Services(di.AbstractCatalog):

    """Example services catalog."""

    users = di.Provider()

    auth = di.Provider()

    photos = di.Provider()

class View1(BaseView):

    services = Services('users', 'auth')

    def handle_request(self, request):
        pass

class View2(BaseView):

    services = Services('users', 'photos')

    def handle_request(self, request):
        pass

I reopen this feature for further devopment. Currently there are two problems: autocomplete of provider names doesn't work and "go to definition" of providers doesn't work also...

It was decided to change terminology and use "Bundle" instead of "Subset".
Final syntax:
import dependency_injector as di

class Services(di.AbstractCatalog):

    """Example services catalog."""

    users = di.Provider()

    auth = di.Provider()

    photos = di.Provider()

class View1(BaseView):

    services = Services.Bundle(Services.users, Services.auth)

    def handle_request(self, request):
        pass

class View2(BaseView):

    services = Services.Bundle(Services.users, Services.photos)

    def handle_request(self, request):
        pass

There is a bug with injection catalog bundles. Investigating...

Fixed!


Ads: Auction mode issue and improvements

Owner posts a product, Stock 100
Buyers can make an offer, with any amount of items AND money, that works well
Owner can see the offers in notification/add-offers
Owner can accept an offer and if so, the Problems/Bugs start:
Problems:

The '_sys_status_offer' missing key on 'ads-manage/my-ads' page.
The Product is no longer listed in the shop, even if the stock is filled well
The Product's stock does not change correctly
The Counter in the Category shows the wrong number of items.

Update 'Shipped' and similar language keys (in action buttons) to say 'Mark as Shipped'.

In addition, Say items were 100 items stocked and a buyer makes an offer with certain number of items and amount. When offer was accepted and buyer pays for items accepted......the "accept offer block" continues to be visible for the buyer after payment, allowing the buyer to repurchase items using a previous offer agreement. This is incorrect working (especially when seller price had changed in the future).
Solution: Accepted offer should be cancelled automatically after buyer's payment and "accept offer block" should be hidden.... allowing buyer to make new offer to seller which is subject to new acceptance of offer.

Review: 'Mark as Shipped' and 'Mark as Recieved' button are not dispayed in the actions view button on frontend, even though they are activated in navigation app in studio


[FR] Manufacturing Documentation Output

Please verify that this feature request has NOT been suggested before.

[X] I checked and didn't find a similar feature request

Problem statement
I like how you can add documents to parts. In theory I see this being used to store Drawings, assembly documentation, Gerber files and other CAD files/outputs etc. It would be good to be able to configure output packages to export these documents.
The benefit of this is that with the push of a button, you could roll up all of the relevant documents related to that product and produce an output .zip file. Ideally, you could save multiple output configurations so you could export packages depending on the target recipient. For example, you could configure one .zip output that went to a contract manufacturer, PCB fab house, cable harness manufacturer etc. and then another .zip file that goes to certification bodies and another .zip file that is shared internally.
I imagine this would be significant effort. It didn't look like it had been suggested yet, so thought I would put the idea out there. It is not directly related to inventory management side of things but Inventree does have "Build Orders" and I think this does relate to building products.
I would be interested in developing myself, but most likely it will be too large of a project for me.
Suggested solution
In the case of producing an assembled product. It would would be handy if there was say a separate menu tab under the part view called "Documentation Package" or "OutJob" or something where you could build an output file based on the attached documents of the assembly part and the attached documents of the sub-parts (BOM items) - as some of the assembly sub-parts themselves might have assembly instructions etc.
Or it could be a separate tool/plugin.
Ideally, you can have the option of included exported BOMs in the packages as well.
Describe alternatives you've considered
Not really possible unless done outside of InvenTree as it would be quite labor intensive to open each part and sub-part to download attached documents each time.
Examples of other systems
There are other Document Management systems that do this.
Altium Designer is an example of a PCB CAD program that has a similar concept where you can design output packages like this.
Do you want to develop this?

[X] I want to develop this.

@mredp-evos an interesting idea! We have a discussion underway for improved manufacturing support in general.
Note that attachments can be "tagged" with custom tags, so it would be relatively easy to add a specific tag to the "documentation" attachments for a particular part. And a custom plugin could easily allow you to zip the files and provide them for download!

In regards to a PDM this is also interesting


How to Include cosmos-db system properties.

Hi !
How can I write query in way that it will include cosmos-db system properties ?
This is the way I'm connecting to  cosmos-db.
_g = g .ConfigureEnvironment(env => env
                    .UseModel(GraphModel.FromBaseTypes<Vertex, Edge>(lookup => lookup
                        .IncludeAssembliesOfBaseTypes()))
                    .UseCosmosDb(builder => builder
                        .At(uri, database, graphName)
                        .AuthenticateBy(authKey)));

Current query to get User vertex which does not return system properties.
   await _g.V<User>();

Raw gremlin query that returns _ts (system property) from CosmosDb
g.withStrategies(ProjectionStrategy.build().IncludeSystemProperties('_ts').create())
.V().hasLabel("User")

Thank you !

Unfortunately currently not possible.

Okay !
Thank you for your response.

Is there any chance in in getting this included?

@iAmBipinPaul, @jurkrit Please have a look at https://docs.gremlinq.net/extensions/, specifically at the Gremlin.Extensions.Strategies package.


⚠ Jenkins Plugins Artifactory has degraded performance

In 083d56c, Jenkins Plugins Artifactory (https://get.jenkins.io/plugins/artifactory/) experienced degraded performance:

HTTP code: 200
Response time: 1069 ms

Resolved: Jenkins Plugins Artifactory performance has improved in afb8354 after 13 hours, 49 minutes.


List dependencies

Add this information to information or about or help page for playground
List versions playground relies on.

language server
emulator
cadence
...

done and deployed to production, closing


Quick Wins

Read through the commit titles for a changelog - all quick wins and bug fixes.

Data import has been successful, all looks good on deployment.


⚠ Bofrost.at has degraded performance

In ffa7b64, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 1432 ms

Resolved: Bofrost.at performance has improved in 9dae8d1.


coreclr: disable i686 build

The hydra build 1 fails with
error: Detected non x86_64 target processor.  Not supported!

This is not the right way. Set platforms = [ "x86_64-linux" ];.

On Wed, Jul 22, 2015, at 09:49 AM, lethalman wrote:

This is not the right way. Set platforms = [ "x86_64-linux" ];.

Ah, okay. Done.

Thanks.


Is it possible to use all transformations in Xaml?

I saw a sample for the grey scale transformation in xaml, however when I try to use others like CornersTransformation I get an error about "no default constructor found".  Am I missing something?

@ravensorb  Just use something like:
<fftransformations:SomeTransformation>
    <x:Arguments>
      <x:String>
        stringConstructorValue
      </x:String>
    </x:Arguments>
</fftransformations:SomeTransformation>

or
make a custom class which inherits from transformation:
public class MyTransformation : SomeTransformation
{
  public MyTransformation() : base("someParameter")
  {
  }
}

then use it in XAML as: <local:MyTransformation/>

Ok, thanks -- that was were I was heading. If I have time, I might take a shot at the properties and do a PR this weekend :)

Sure, If you have something feel free to make a PR :)

If you submit a PR we will accept it with pleasure :)


Broken deployment-error link

Just received an unspecified error message after my files where uploaded:
...
> Error! Your deployment failed. Please retry later. More: https://err.sh/now-cli/deployment-error

The link https://err.sh/now-cli/deployment-error redirects to https://github.com/zeit/now-cli/blob/master/errors/deployment-error.md which does not exist.
Would suggest to either fix the redirect or create the doc file in case it is missing.
Using now-cli v2.

@kolja-esders is there a way to reproduce this error?

If you look for the URL in the source you can find it here in the deployment process.
Changing the URL there should fix the issue.

I can see where the url is in the code, but would like to understand what kind of deployment error lead to it, so I know how specific the documentation needs to be.

I'm seeing the same message and broken URL. I'm not seeing any info about what kind of error it is.
❯ now
(node:82442) ExperimentalWarning: The http2 module is an experimental API.
> Deploying ~/src/gmaps-next under adamlogic
> Using project gmaps-next
> https://gmaps-next-ejammmyi3.now.sh [v2] [2s]
> Error! Your deployment failed. Please retry later. More: https://err.sh/now-cli/deployment-error

Is there a way to get some details about the failure?

Thanks for reporting this! We'll fix it.

had the same problem, logs exposed this:
{ Error: Invalid tag name "latest@latest@latest@latest@latest@latest@latest@latest@latest@latest@latest@latest@latest@latest@latest@latest@latest@latest@latest@latest@latest@latest@latest": Tags may not have any characters that encodeURIComponent encodes.
what caused is was either

I added now*.json to .gitignore
I tried to deploy with a different now.json file (under a different project name)
?

Why was my comment marked as off topic? I have the same error message
Error! Your deployment failed. Please retry later. More: https://err.sh/now-cli/deployment-error
Thought was providing you debug information...

Perhaps it would be interesting to see what @adamlogic output of now logs https://gmaps-next-ejammmyi3.now.sh is, to see whether it's the same underlying issue.


Learning the scroll effect in Kivy (Python)

Topic Suggestion
Learning the scroll effect in Kivy (Python)
Proposed article introduction
[Kivy]
The scroll effect is an animation in a website or an application triggered by scroll action. It makes it easier to make dynamic and interactive websites or other applications hence improving the experience.
The scroll effect helps the interactive websites or applications to bring more delightful content through the scroll. This keeps the readers or the users of the website hooked and spending more time on your site.
When you want to break content into a few sections, Adding a transition to the new section gives users a visual break cue. It suggests a section ends and a new one starts.
Key takeaways
-Making the scroll effect in Kivy
-The learner will know the Two types of scroll effects in Kivy.
-The learner will be able to apply the 2 effects on Kivy projects.
Article quality
The article is a tutorial-based in python language to help learners create the scroll effect on their Kivy projects and make them more dynamic.

I'm closing this topic-suggestion due to inactivity.
It can be reopened.


US08.02.01

As an approver, I want the list of submitted expense claims to be sorted by starting date of travel, in order from oldest to most recent, so that older claims are considered first.

Done gotto push tho


Initial upload of a GRPC implementation for Helidon

This PR introduces a new module, pbj-grpc-helidon. This is a Helidon specific module (for version 4.0.8+) that provides the glue between HTTP2 (implemented by Helidon) and PBJ service endpoints (generated by PBJ based on a service definition in the protobuf schema files).
This PR does not introduce changes to the compiler to generate service interfaces or stubs. Rather, it assumes some other PR will do that, and it focuses on defining the runtime API and the Helidon module. Changes to the compiler will be done by #255.
In this PR:

The build is upgraded to Java 21. The consensus node uses Java 21, as does Helidon.
The module pbj-grpc-helidon is added
The interface ServiceInterface is added to pbj-runtime

gRPC
gRPC is an HTTP2-based protocol for message passing. The specification and the documentation show how this is done. Both application/grpc+proto (protobuf based messages) and application/grpc+json (JSON-encoded protobuf) are supported.
A separate specification for web-grpc exists, but is not supported by this PR.
pbj-grpc-helidon
Public API in this module used directly by users include PbjRouting, and GrpcStatus.
Public API in this module used by Helidon directly include PbjProtocolSelector, PbjProtocolProvider, PbjProtocolConfigProvider, and PbjConfig.
All other entities are private to the module.
Design
Helidon uses the ServiceLoader to identify the ProtocolConfigProvider (used for configuration) and the Http2SubProtocolProvider to delegate HTTP2 calls to. Our implementation of Http2SubProtocolProvider, PbjProtocolProvider, is simply used to create (based on some provided configuration) the Http2SubProtocolSelector. This selector is where all the real works happens. For this module, that is PbjProtocolSelector.
If you look into the PbjProtocolSelector, you will find the subProtocol method. This method is called by Helidon. It is the main entry point for handling HTTP2 routes supported by this system. After some preliminary checks, it delegates to a "handler" (PbjErrorProtocolHandler or PbjProtocolHandler) to handle appropriate details (reading from and writing to HTTP2 streams).
The PbjProtocolHandler will delegate to a ServiceInterface to handle a particular method invocation, in such a way as to avoid all reflection. It provides a callback to the ServiceInterface through which the ServiceInterface can send start a request, stream messages, and close a request. The implementation of this callback handles all the glue with HTTP2.
That is, the classes in pbj-grpc-helidon are the glue between the HTTP code of Helidon (that knows nothing about gRPC or PBJ), and the PBJ ServiceInterfaces, which know nothing about HTTP2.

A couple questions we should probably answer in the documentation for this PR:
What is the advantage of this approach over the existing Helidon gRPC implementation?
Could (or does) this work leverage the Helidon implementation to reduce the amount we must build ourselves?

A couple questions we should probably answer in the documentation for this PR: What is the advantage of this approach over the existing Helidon gRPC implementation? Could (or does) this work leverage the Helidon implementation to reduce the amount we must build ourselves?

@jsync-swirlds, I'll add these to the issue itself (since it is more about the motivation rather than the solution)

Could (or does) this work leverage the Helidon implementation to reduce the amount we must build ourselves?

I have put a message on their issue: https://github.com/helidon-io/helidon/issues/5418. I will try to create a PR for Helidon that creates the right abstraction for us, such that our module could be truly minimal and hopefully avoid having to duplicate any work with what they're doing.


Add "research" site and Researcher account

oops that was a relic typo when I was messing around with things!

:+1: looks great except for the sqlite default; good to merge after that!

awesome, I'll get to work making this show up on staging and get my study branch ready for merge! :)

Sent from my phone.

On Apr 29, 2015, at 2:55 PM, Madeleine Price Ball<EMAIL_ADDRESS>wrote:
Merged #178.
—
Reply to this email directly or view it on GitHub.

awesome, nice to be making some concrete progress :)
On Wed, Apr 29, 2015 at 5:59 PM, Beau Gunderson<EMAIL_ADDRESS>wrote:

awesome, I'll get to work making this show up on staging and get my study
branch ready for merge! :)

Sent from my phone.

On Apr 29, 2015, at 2:55 PM, Madeleine Price Ball <
<EMAIL_ADDRESS>wrote:
Merged #178.

—
Reply to this email directly or view it on GitHub.

—
Reply to this email directly or view it on GitHub
https://github.com/PersonalGenomesOrg/open-humans/pull/178#issuecomment-97600571
.


Add Podcast: The Data Canteen

As per the instructions provided in https://github.com/TrigonaMinima/dspods/blob/gh-pages/README.md
This PR:

Adds posts/2021-03-10-the_data_canteen.md
Adds assets/images/pods/data_canteen.png
Adds entry #36 to podcasts.md

Hey,
Thanks for the addition. After making the following changes, I merged it locally.

Replaced the png image with the webp image (better format according to the web standards).
Removed the freq/duration/status/pub date. They'll be automatically populated tonight.
Squashed all the commits into one.

Podcast page: https://dspods.netlify.app/the_data_canteen/
Exact commit: 1f28154bef7d6af46fcff7a1c4aefad86cb3ff04)
Closing the PR.


sqls is deprecated, use sqlls instead

⚠ Please verify that this bug has NOT been reported before.

[X] I checked all existing issues and didn't find a similar issue

Description
Hi its me again :P
It seems like the sql language server sqls is public archive.
nvim-lspconfig have decided to deprecate it and will remove it in version 0.2.0 (See here)
They suggest replacing it with sqlls, which is already available in nvim-lspconfig (See here)
It can be downloaded on npm, however there is no dedicated nixos package yet, so that would have to be done in a derivation using node2nix or similar means... which probably bloats this flake quite a bit.
I don't know what the best way to proceed here is, but i thought it probably should be an issue, just for completeness sake...
👟 Reproduction steps
{
  inputs = {
    nixpkgs.url = "nixpkgs/nixos-23.05";
    neovim-flake = {
      url = "github:notashelf/neovim-flake";
      inputs.nixpkgs.follows = "nixpkgs";
    };
  };

  outputs = {
    nixpkgs,
    neovim-flake,
    ...
  }: let
    configModule = {
      config = {
        vim.languages = {
          enableLSP = true;
          sql.enable = true;
        };
      };
    };
    pkgs = import nixpkgs {
      system = "x86_64-linux";
    };
    customNeovim = neovim-flake.lib.neovimConfiguration {
      modules = [configModule];
      inherit pkgs;
    };
  in {
    packages.x86_64-linux.default = customNeovim.neovim;
  };
}

👀 Expected behavior
Starts up fine
😓 Actual Behavior
When starting vim, you are prompted with a deprecation warning before you enter the editor.
💻 Metadata

system: "x86_64-linux"  - host os: Linux 6.1.44, NixOS, 23.05 (Stoat), 23.05.20230809.9034b46  - multi-user?: yes  - sandbox: yes  - version: nix-env (Nix) 2.13.5  - channels(root): "home-manager-22.11.tar.gz, nixos-23.05"  - nixpkgs: /nix/var/nix/profiles/per-user/root/channels/nixos

📝 Relevant log output
sqls is deprecated, use sqlls instead.
This feature will be removed in lspconfig version 0.2.0
Press ENTER or type command to continue

I'm very well aware of this issue, and have been meaning to resolve it for a while now. Unfortunately my last attempt has resulted in a failure thanks to, well, the best (worst) efforts of the nodejs ecosystem.
We are (currently) blocked by https://github.com/NixOS/nixpkgs/issues/203887 - I take another shot at packaging it soon.

Super cool, thanks!!

I'm afraid I can't get sqlls to work as a nixpkgs package. I'll take another look when I have more time.

Revisiting, the package still does not compile due to the default package.json having some fields that nixpkgs cannot conform to - will try with a patched package.json and get it in either nixpkgs or our own packages.


Have PTX share code with LLVM

Converted the rendering to use pattern matcher. Currently I'm just checking if the two versions output the same code for common use cases in the test_ptx.py script

Bounty locked, good luck!

You can use [pr] to check if it's identical, if that's what you are targeting (not required, but free test)

I'm going to merge this since it's cleaner and passes process replay.
But I think for the bounty there's at least 20 lines to lose here that will change the output, but not affect functionality. Ex: why is DEFINE_ACC 13 lines, why is bool casting 4 lines?


Support 5.1.1 and 5.1.2 imports

Allow importing of 5.1.1 and 5.1.2 feeds, validating against the spec determined by the import.
In many places, however, the patch level does not matter, so ignore it there.

in postgres.clj:
 (defn store-spec-version [{:keys [spec-version import-id] :as ctx}]
   (when @spec-version
     (korma/update results
       (korma/set-fields {:spec_version @spec-version})
       (korma/where {:id import-id})))

Should we be storing the patch level here? I can see where it could be useful as a debugging aid, but also where it could be an unnecessary distinction.

@sduckett To the first question: yes, we should be able to remove the 5.0 spec, since it's not used anywhere. I'll do that.
To the second question: The spec version with the patch level is used to determine the XML spec that drives some validations. I think we should keep the patch level since it has a real effect on validations.

To the second question: The spec version with the patch level is used to determine the XML spec that drives some validations. I think we should keep the patch level since it has a real effect on validations.

For validations, yes, we'd need the patch version, but we use whatever is contained in the spec-version atom; we never return to the results table to drive our validation choices.


Parameterize service.protocol for opensearch-dashboards

Description
This will allow users to specify the protocol for the service definition, which is currently hardcoded to TCP.
Allows for better integration e.g. with Istio.
Issues Resolved
https://github.com/opensearch-project/helm-charts/issues/532
Check List

[ ] Commits are signed per the DCO using --signoff

For any changes to files within Helm chart directories:

[ ] Helm chart version bumped
[ ] Helm chart CHANGELOG.md updated to reflect change

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@prudhvigodithi Can you also take a look at this PR?

Hey @enes-zed the LGTM, thanks for your contribution, can you please update the chart README.md, CHANGELOG.md and Chart.yaml, here is the sample merged PR https://github.com/opensearch-project/helm-charts/pull/530/files.
Also do you think this change is useful for opensearch chart as well?
Thank you
@getsaurabh02

@enes-zed any update on the PR?


Unexpected behavior of gn with nowrapscan

Steps to reproduce:

Set the nowrapscan option.
Insert the text foo bar baz and move the cursor to the beginning of the line.
/bar/e
gn

The expected behavior is that bar is selected, which happens if wrapscan is set. However, the observed behavior is that only the b in bar is selected.
The bug only occurs on the last instance of the pattern in the file. It happens if the cursor is anywhere within the last instance except at the beginning, in which case behavior is as expected.
vim 8.0 with patches 1-586 on Arch Linux.

thanks for the clear explanation, this commit fixes it

The patch does not implement the expected behavior—it seems to cause the gn command to simply fail. As per :h gn, the command should select the match if it is currently on the match. (Furthermore, the patch introduces inconsistent behavior in that gn with pattern bar and text foo bar| baz bar with cursor at | selects the first bar, but without the last word it fails under the patch.)

@chrisbra The patch does not implement the expected behavior—it seems to cause the gn command to simply fail. As per :h gn, the command should select the match if it is currently on the match. (Furthermore, the patch introduces inconsistent behavior in that gn with pattern bar and text foo bar| baz bar with cursor at | selects the first bar, but without the last word it fails under the patch.)

It fails, because nowrapscan is set. I would say this is expected behaviour.

Sorry, I misunderstood. I think you are right. Please check this patch

The new patch does result in the expected behavior, thanks!


libaio i686 is missing at listener/database creation

Before manually installing libaio 32 bits I get the following error when running netca or dbca:
TASK [oradb-create : Create database(s)] ************************************************************************************
failed: [ansible-node1] ...
...
oracle.sysman.assistants.dbca.Dbca.main(Dbca.java:189)"], "stdout": "UnsatisfiedLinkError exception loading native library: njni11\njava.lang.UnsatisfiedLinkError: /u01/app/oracle/<IP_ADDRESS>/db1/lib/libnjni11.so: libaio.so.1: cannot open shared object file: No such file or directory", "stdout_lines": ["UnsatisfiedLinkError exception loading native library: njni11", "java.lang.UnsatisfiedLinkError: /u01/app/oracle/<IP_ADDRESS>/db1/lib/libnjni11.so: libaio.so.1: cannot open shared object file: No such file or directory"]}
After installing the missing package it runs OK.

Sure, I'll add it to the default packages, but I don't really understand what is going on with your system ;-)
I've used this on at least 50 different rhel6 (6.5 to 6.9) installs, and I've never seen the issues you're having. It's really weird...

Fixed with d005460f1cbb91d2ee71d92a5400934c09b51ee6

Thanks.

Thanks


What about results without coco pretrain?

Hi! Thanks for your code. I wonder what are the results if we do not use coco pretrained detr ?

hi @hehao13 , the results will be 8-10 points lower.


added_references

@Stanislaw-bnk there is only 1 step missing, please sign your commits

@Stanislaw-bnk Thanks for these improvements. Please sign commits as requested by Artur above.

@Stanislaw-bnk reminder ping

@macpijan I've tried to sign the commits but to do so, I requested a help from @artur-rs. Unfortunately, he didn't manage to find time before his vacation.

@Stanislaw-bnk please refer to publicly available documentation. In 3mdeb there are also other people who can help you solve this minor issue.


Missing documentation about logs and terminal

There is no description about the capabilities to access the logs and the terminal in the documentation

@jfermi Please have a look at this.


fix broken deploy step in pipeline: specify additional params for kubectl

fix the issue preventing the cdp-environment pipeline to complete successfully

The reason the pipeline currently fails is because of an issue in cdp-deployment-templates: the expected config for the test deployment has not been updated following config changes to include envoy. A PR has been raised to fix the issue in that repop


Schur gemm test

Add transA, transB option to Schur gemm test.
Add multi-stream gemm for comparison. This chops into tiles and executes a gemm for each tile in separate streams, using Queue's fork mechanism.

One check failure on Intel. Seems unrelated to the schur-gemm changes? Maybe just an issue with testing on intel now.
4 routines FAILED: dev-batch-hemm, dev-batch-herk, dev-batch-syrk, dev-batch-her2k

Yeah, for now Intel seems to have unrelated problems, so we will ignore those until there's a more stable oneMKL release.


Fails to browse messages on MSK

Issue submitter TODO list

[X] I've looked up my issue in FAQ
[X] I've searched for an already existing issues here
[X] I've tried running master-labeled docker image and the issue still persists there
[X] I'm running a supported version of the application which is listed here

Describe the bug (actual behavior)
It fails to browse messages of a topic. It is published to MSK where the Kafka version is 2.8.1. I can see topic details and associating consumers but not able to browse messages. The details of the topic is shown below.

Expected behavior
I should be able to browse messages.
Your installation details
App version - 727f384
Docker compose file
version: "3"

services:
  kafka-ui:
    image: provectuslabs/kafka-ui:master
    container_name: kafka-ui
    ports:
      - "8080:8080"
    networks:
      - kafkanet
    environment:
      AWS_ACCESS_KEY_ID: $AWS_ACCESS_KEY_ID
      AWS_SECRET_ACCESS_KEY: $AWS_SECRET_ACCESS_KEY
      AWS_SESSION_TOKEN: $AWS_SESSION_TOKEN
      KAFKA_CLUSTERS_0_NAME: msk
      KAFKA_CLUSTERS_0_BOOTSTRAPSERVERS: $BOOTSTRAP_SERVERS
      # KAFKA_CLUSTERS_0_DISABLELOGDIRSCOLLECTION: true # only for MSK serverless
      KAFKA_CLUSTERS_0_PROPERTIES_SECURITY_PROTOCOL: SASL_SSL
      KAFKA_CLUSTERS_0_PROPERTIES_SASL_MECHANISM: AWS_MSK_IAM
      KAFKA_CLUSTERS_0_PROPERTIES_SASL_CLIENT_CALLBACK_HANDLER_CLASS: software.amazon.msk.auth.iam.IAMClientCallbackHandler
      KAFKA_CLUSTERS_0_PROPERTIES_SASL_JAAS_CONFIG: software.amazon.msk.auth.iam.IAMLoginModule required;

networks:
  kafkanet:
    name: kafka-network

Steps to reproduce

Create a MSK cluster (version 2.8.1)
Deploy a source connector with the following properties listed at the end. The source connector is created by MSK Data Generator
Run the docker compose file

    # connector configuration
    "connector.class"                = "com.amazonaws.mskdatagen.GeneratorSourceConnector",
    "tasks.max"                      = "1",
    "key.converter"                  = "org.apache.kafka.connect.storage.StringConverter",
    "key.converter.schemas.enable"   = false,
    "value.converter"                = "org.apache.kafka.connect.json.JsonConverter",
    "value.converter.schemas.enable" = false,
    # msk data generator configuration
    "genkp.order.with"              = "to-replace",
    "genv.order.order_id.with"      = "#{Internet.uuid}",
    "genv.order.product_id.with"    = "#{Code.isbn10}",
    "genv.order.quantity.with"      = "#{number.number_between '1','5'}",
    "genv.order.customer_id.with"   = "#{number.number_between '100','199'}",
    "genv.order.customer_name.with" = "#{Name.full_name}",
    "global.throttle.ms"            = "500",
    "global.history.records.max"    = "1000",
    # single message transforms
    "transforms"                            = "copyIdToKey,extractKeyFromStruct,cast",
    "transforms.copyIdToKey.type"           = "org.apache.kafka.connect.transforms.ValueToKey",
    "transforms.copyIdToKey.fields"         = "order_id",
    "transforms.extractKeyFromStruct.type"  = "org.apache.kafka.connect.transforms.ExtractField$Key",
    "transforms.extractKeyFromStruct.field" = "order_id",
    "transforms.cast.type"                  = "org.apache.kafka.connect.transforms.Cast$Value",
    "transforms.cast.spec"                  = "quantity:int8"

Screenshots
No response
Logs
Below shows the logs. It indicates 0 records polled.
2023-06-29 05:41:40,918 INFO  [boundedElastic-7] o.a.k.c.u.AppInfoParser: Kafka version: 3.3.1
2023-06-29 05:41:40,918 INFO  [boundedElastic-7] o.a.k.c.u.AppInfoParser: Kafka commitId: e23c59d00e687ff5
2023-06-29 05:41:40,918 INFO  [boundedElastic-7] o.a.k.c.u.AppInfoParser: Kafka startTimeMs:<PHONE_NUMBER>918
2023-06-29 05:41:43,880 INFO  [boundedElastic-7] o.a.k.c.Metadata: [Consumer clientId=kafka-ui-consumer-1688017300912, groupId=null] Cluster ID: vlkbd43bTb2JRIvX3phegA
2023-06-29 05:41:47,396 INFO  [boundedElastic-7] o.a.k.c.Metadata: [Consumer clientId=kafka-ui-consumer-1688017300912, groupId=null] Resetting the last seen epoch of partition order-0 to 0 since the associated topicId changed from null to IfdlNP7BTP2KsEe_mIqT7w
2023-06-29 05:41:47,396 INFO  [boundedElastic-7] o.a.k.c.Metadata: [Consumer clientId=kafka-ui-consumer-1688017300912, groupId=null] Resetting the last seen epoch of partition order-2 to 0 since the associated topicId changed from null to IfdlNP7BTP2KsEe_mIqT7w
2023-06-29 05:41:47,396 INFO  [boundedElastic-7] o.a.k.c.Metadata: [Consumer clientId=kafka-ui-consumer-1688017300912, groupId=null] Resetting the last seen epoch of partition order-1 to 0 since the associated topicId changed from null to IfdlNP7BTP2KsEe_mIqT7w
2023-06-29 05:41:51,200 INFO  [boundedElastic-7] o.a.k.c.c.KafkaConsumer: [Consumer clientId=kafka-ui-consumer-1688017300912, groupId=null] Assigned to partition(s): order-2, order-0, order-1
2023-06-29 05:41:51,201 INFO  [boundedElastic-7] o.a.k.c.c.KafkaConsumer: [Consumer clientId=kafka-ui-consumer-1688017300912, groupId=null] Seeking to offset 0 for partition order-2
2023-06-29 05:41:51,201 INFO  [boundedElastic-7] o.a.k.c.c.KafkaConsumer: [Consumer clientId=kafka-ui-consumer-1688017300912, groupId=null] Seeking to offset 0 for partition order-0
2023-06-29 05:41:51,201 INFO  [boundedElastic-7] o.a.k.c.c.KafkaConsumer: [Consumer clientId=kafka-ui-consumer-1688017300912, groupId=null] Seeking to offset 0 for partition order-1
2023-06-29 05:41:52,203 DEBUG [boundedElastic-7] c.p.k.u.e.ForwardRecordEmitter: 0 records polled
2023-06-29 05:41:53,206 DEBUG [boundedElastic-7] c.p.k.u.e.ForwardRecordEmitter: 0 records polled
2023-06-29 05:41:54,211 DEBUG [boundedElastic-7] c.p.k.u.e.ForwardRecordEmitter: 0 records polled
2023-06-29 05:41:54,212 DEBUG [boundedElastic-7] c.p.k.u.e.ForwardRecordEmitter: Polling finished

log.log
Additional context
I checked with the kpow CE and there is not problem to browse messages.

Hi, most likely, it's related to network.
I recommend tuning polling configuration, documented here
kafka.polling.pollTimeoutMs, kafka.polling.partitionPollTimeout, kafka.polling.noDataEmptyPolls
Let us know how it goes

Have you by chance enabled compression on your MSK topics? I think KafkaUI does not yet support browsing such topics: https://github.com/provectus/kafka-ui/issues/4005

@Haarolean
Thanks for the suggestion. However it didn't have luck after updating those config values. Let me try again later.
@krumft
No, messages are not compressed.

Most likely it's related to polling timeouts. We've implemented one more set of changes aimed to fix such issues within #4088. We'll release 0.7.2 this week, please check it out once it's out and let us know how it works.


sync is leaving behind yml-e files

Hi, running sync leaves my repo with a bunch of odd files:
$ rake translation:sync
cp -p config/locales/en.yml config/locales/en.yml.ORIG
* Downloading YAML source editions.
* Applying YAML source editions.
* Updating POT file.
* Generating POT file from YAML files.
* Saving new PO files.
* Creating new MO files.
* Saving new translation YAML files.
* Saving new localization YAML files (with non-string values).
* Collecting YAML localization entries

----------
Use this URL to translate: http://translation.io/david-a-wheeler/cii-best-practices-badge
----------
Removing bogus trailing whitespace (bug workaround).
cd config/locales/ && sed -i -e 's/ $//' *.yml && cd ../..
mv config/locales/en.yml.ORIG config/locales/en.yml
Now run: git commit -as -m 'rake translation:sync'
$ git status
 M config/locales/.translation_io
 M config/locales/translation.fr.yml
?? config/locales/en.yml-e
?? config/locales/localization.de.yml-e
?? config/locales/localization.fr.yml-e
?? config/locales/localization.ja.yml-e
?? config/locales/localization.zh-CN.yml-e
?? config/locales/translation.de.yml-e
?? config/locales/translation.fr.yml-e
?? config/locales/translation.ja.yml-e
?? config/locales/translation.zh-CN.yml-e

The first two (modified) files are just what I expect. But then all of the config/locales/*.yml-e files shouldn't be there. Obviously, I delete them and may add an additional sync task to do so automatically.
But I thought I'd report this in case anyone else sees the same thing. I'm on OS X while my colleague on Linux doesn't this issue.
Cc @david-a-wheeler

This may be because you didn't have the file .translation_io in config/locales. I have since check that file into git, and I hope that fixes it.

I did git pull on master before filing the issue and got https://github.com/linuxfoundation/cii-best-practices-badge/blob/master/config/locales/.translation_io so that's not it.

Hi @dankohn,
My guess is that "sed" doesn't behave the same on Linux and MacOS. I use MacOS and when I type man sed I can see this:
-i extension
             Edit files in-place, saving backups with the specified extension.

And just after -i there is -e in your example. So that should be the issue here.
I hope it helped.

That totally explains it, thank you.


performance problem on azure webapp

Hello,
Has anyone tested gotenberg 7.X on the Azure WebApp Container? I notice a big performance problem.
I am using the chromium module.
Example:
the page www.google.com with an azure webapp :
{"level":"info","ts":1647275737.2735093,"logger":"api","msg":"request handled","trace":"0ebb7e78-81cc-460a-a237-68976cb0e5ef","remote_ip":"<IP_ADDRESS>:44078","host":"XXXXX.azurewebsites. net", "uri":"/forms/chromium/convert/url", "method": "POST", "path":"/forms/chromium/convert/url", "referer":"", "user_agent": "curl/7. 74.0","status":200,"latency":5003025615,"latency_human":"5.003025615s","bytes_in":962,"bytes_out":99785}
on the other hand, locally or on a VM :
{"trace": "a5426090-3b6f-4362-9897-5b0538e94e81", "remote_ip": "<IP_ADDRESS>", "host": "localhost:3000", "uri": "/forms/chromium/convert/url", "method": "POST", "path": "/forms/chromium/convert/url", "referer": "", "user_agent": "curl/7. 74.0", "status": 200, "latency":<PHONE_NUMBER>, "latency_human": "2.263561023s", "bytes_in": 962, "bytes_out": 99785}
We go from 2 to 5 sec.
With the parameters (at random) :
--form 'url="https://www.google.com"' --form scale=0.8 --form marginTop=0 --form marginBottom=0 --form marginLeft=0 --form marginRight=0 --form landscape=0 --form paperWidth=8.5 --form paperHeight=11 -o test.pdf
do you have an idea?

[IMO, the culprits are the CPU/memory. You can check the demo for a better idea.

Thanks for the feedback, I've already tested putting more resources, it doesn't improve the performance.
I'll try again on the azure webapp container with version 6 : www.google.com + same parameters.
{"bytes_in":"968","bytes_out":"87672","host":"XXXXX.azurewebsites.net","latency":"1400119342","latency_human":"1.400119342s","level":"info","method":"POST","msg":"request handled","op":"context.Context.LogRequestResult","path":"/convert/url","referer":"","remote_ip":"XXXXX","status":200,"time":"2022-03-15T10:57:17Z","trace":"9UJwxmqHNIXrWCChAYIfw9HVApkO4HHu","uri":"/convert/url","user_agent":"curl/7.74.0"}
There is a difference between the 2 versions (1.40 sec vs 5sec). We are using version 6 in production and we want to migrate to version 7, but we have big performance problems.
Are there any good practices to know when using the chromium module?
One solution is not to use azure webapp container but we want to test anyway.

The big difference is that Gotenberg v6 has a long-running Chrome instance, but there are memory leaks overtime. Gotenberg v7 starts and stops a specific Chrome browser per conversion.
That would explain the performance difference between the two versions.
To mitigate the Chrome bootstrap time, you cannot do a lot alas. But having a good CPU/SSD certainly helps.
On the demo, converting the same URL takes between 3-5s.

Thanks for the feedback.


Iss 174

Fixes for https://github.com/sdrogers/vimms/issues/174. Also in general, this fix allows all controllers to dump their scans, their associated scan parameters, and any metadata we provide for that scan. Useful when we need to know which scan params produce which scans.
Changes:

When making an MS1 or MS2 scan, we can now pass an additional metadata field, e.g. below we store metadata from the target (t) and the adduct used to make this MS2 scan.

                    metadata = {}
                    if t.adduct is not None:
                        metadata['adduct'] = t.adduct
                    if t.metadata is not None:
                        metadata.update(t.metadata) # copy the rest of metadata from target

                    dda_scan_params = self.get_ms2_scan_params(t.mz, 1e3, precursor_scan_id, self.isolation_width, \
                                                        self.mz_tol, self.rt_tol)
                                                        self.mz_tol, self.rt_tol, metadata=metadata)

The metadata is not used for any computation. It is just stored as part of the scan_params object for that scan, so it can be dumped with the rest of the scan parameters.

Call the method dump_scans in the base controller to dump all scan information, including everything in the scan params as CSV format, e.g. for printing

        controller.dump_scans(print)

You can also dump to file by passing a suitable function to dump_scans, e.g.
def csv_to_file(output):
    with open(fname, 'a') as out:
        out.write(output)

fname = 'output.csv'
controller.dump_scans(csv_to_file)

Example output from targeted controller: simulated_targeted_std1_Positive_scans.zip

Looks perfect, thanks!


Rever Timestamp to DateTime

When we store data we use DateTime and Value but when we search DataPoint return Timestamp as long and Value ..
DataPoint should have a propertie with DateTime avaliable or should exist one Extension method capable of transform timestamp into DateTime

I beleive DateTimeExtensions should be public and something like code below should be avaliable
public static DateTime GetFromTick(this long timestamp)
{
        var ticks = (timestamp * TicksPeriodMs) + EpochTicks;
        return new DateTime(ticks);
}


Target lower .NET Standard

Right now you're targeting netstandard 1.6, is there a reason for that? I'd try targeting 1.3.

Hi David, as far as I know I had to target >= 1.6 because FSharp.Core doesn't target anything lower.

Hmmmmm, we should figure out why

It could be a reminder from the previous Microsoft.FSharp.Core.netcore package which was the FSharp NuGet lib for .NET Core while it was still in development. Perhaps it is as simple that they didn't bother with targeting anything lower than 1.6 whilst in development and now forgot to check if they can actually target a lower version. I will see if I find something otherwise I can open an issue and ask.

I've just had a go at this on the train. We can use one of the PCL profiles, which line up to 1.0 & 1.1, then ourselves target netstandard 1.3. However I've tried the following and the packages won't restore:
<TargetFramework>netstandard1.3</TargetFramework>
<PackageTargetFallback Condition=" '$(TargetFramework)' == 'netcoreapp1.3' ">$(PackageTargetFallback);portable-net45+win8;</PackageTargetFallback>

@davidfowl is my understanding correct? Any suggestions?

Also, in the package description for FSharp.Core the bits in the brackets don't appear to be the official TFMs, or am I wrong about that?

Reopening because #6 has added RazorLight which has targets NETStandard 1.6 again. I have opened an issue to lower it at least to NETStandard 1.5.

@dustinmoris FSharp.Core will not be lowered, see https://github.com/Microsoft/visualfsharp/issues/2501

Well if we can't target a lower netstandard, how about targeting net451 as well like Kestrel?

Meh, might not be worth it at this point. Kestrel has also changed to target net46

ok thanks everyone, I will close this issue then.


Best use guide?

Is there something like a best-use guide for U-Sleep?
For example to answer questions such as:

Which sets of channels work best
Are more channels always better than fewer channels?
should data be bipolar referenced or average referenced or not references

Hi @skjerns! Unfortunately, we do not currently have something like that. I can only say that the pre-trained U-Sleep v1.0 model (the one at https://sleep.ai.ku.dk) usually performs best the more channels it receives. The majority vote is not necessarily much better than the predictions made in the single "best performing" channel. However, using more channels relieves you from figuring out which channel is best for your data (again, usually).
As for referencing, our current understanding is that this has little to no influence on performance. That is, referencing is probably unnecessary or may even be used as a data-augmentation technique (e.g., it may be beneficial to feed in many possible deriviations to augment dataset size and improve robustness). Actually, it turns out U-Sleep v1.0 can work with highly arbitrary channel derivations (see https://arxiv.org/pdf/2209.11173.pdf if you are interested).

Thanks, that's good to know :)
And thanks again for making everything open source and open access, this is truly needed!


Update README from branch exmaple

Updates
I updated the readme file, Please review and accept

Thoughts
I probably shouldn't, but okay . :+1:


Move unit tests out of parser.rs when possible

A lot of the unit tests in parser.rs are testing non-public helper parser functions, so they can't move out or they would lose access to the non-public parser functions. However, for the tests that are only using public APIs, we should move them out to tests/some_test.rs.

My understanding is that the top level tests is intended for integration tests, while unit tests should be kept in sub modules of the module they are testing. The rust docs seem to agree with this. So your change here isn't what I would expect.
So I would like to move the tests to a submodule, if that's ok. It will make it easier to browse the code; currently I'm finding it difficult to read and navigate due to the tests interspersed with the code.  Alternatively, I'm open to suggestions for how to navigate better (I use vim).

So I would like to move the tests to a submodule, if that's ok.

Yes, this sounds great. We should probably move the tests I moved to ./tests/foo.rs to ./src/test.rs.

It will make it easier to browse the code; currently I'm finding it difficult to read and navigate due to the tests interspersed with the code.

Unfortunately, many of the unit tests are testing private functions, which means that they do need to be in the same module as the function they're testing. So I'm not sure what to do with these tests. We could move them to the bottom of the file, if you think that it is easier to separate tests and "real" code. Right now the tests are near the things they are testing. Not clear which is better to me.
I use racer with emacs, and everything I hear is that racer works well with vim too. It provides a "jump to the definition of this type/function/variable" command that I use frequently. Do you have racer set up?
Finally, I think we could split parser.rs into multiple files. At the very least, the abbreviation parsing seems completely uncoupled from DIE parsing, and could be split out into abbrevs.rs.


Intellisense often not working

Issue Type: Bug
Intellisense is very on/off. Sometimes it works - most times it doesn't. Otherwise - great product
Azure Data Studio version: Azure Data Studio 1.11.0 (460c739a8d90bdbbde39e01abfb8ecdc278ea787, 2019-09-06T17:14:33.682Z)
OS version: Darwin x64 18.7.0

System Info

Item
Value

CPUs
Intel(R) Core(TM) i7-4770HQ CPU @ 2.20GHz (8 x 2200)

GPU Status
2d_canvas: enabledflash_3d: enabledflash_stage3d: enabledflash_stage3d_baseline: enabledgpu_compositing: enabledmultiple_raster_threads: enabled_onnative_gpu_memory_buffers: enabledoop_rasterization: disabled_offprotected_video_decode: unavailable_offrasterization: enabledskia_deferred_display_list: disabled_offskia_renderer: disabled_offsurface_synchronization: enabled_onvideo_decode: enabledviz_display_compositor: disabled_offwebgl: enabledwebgl2: enabled

Load (avg)
2, 2, 2

Memory (System)
16.00GB (2.95GB free)

Process Argv

Screen Reader
no

VM
25%

Extensions (1)

Extension
Author (truncated)
Version

poor-sql-formatter
WSR
0.1.0

There's already some open issues tracking general performance of Intellisense such as #4817 so I'm going to close this, keep an eye there for any updates!
As a note there was specifically a bug in 1.11 though that made it so Intellisense wasn't working on saved files. See #7161 for details. You can use the current insiders version which has that fix - otherwise we should have the next stable release out next week which will also contain that fix.

Thanks!
Den 29. sep. 2019 kl. 19.09 skrev Charles Gagnon <notifications<EMAIL_ADDRESS>There's already some open issues tracking general performance of Intellisense such as #4817https://github.com/microsoft/azuredatastudio/issues/4817 so I'm going to close this, keep an eye there for any updates!
As a note there was specifically a bug in 1.11 though that made it so Intellisense wasn't working on saved files. See #7161https://github.com/microsoft/azuredatastudio/issues/7161 for details. You can use the current insiders version which has that fix - otherwise we should have the next stable release out next week which will also contain that fix.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/microsoft/azuredatastudio/issues/7416?email_source=notifications&email_token=ABUINEGQJPATEOGIWBPSNDTQMDOL5A5CNFSM4I3RMPYKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD73Z22Y#issuecomment-536321387, or mute the threadhttps://github.com/notifications/unsubscribe-auth/ABUINECPKNXW5TPCBZ2ZJJTQMDOL5ANCNFSM4I3RMPYA.


splitting by RG; TODO convert and merge

Remove PM IDs from the @RG field in BAM files
Closes #3

Close #3


ttnn docs main page and OP list

https://tenstorrent-metal.github.io/tt-metal/latest/ttnn/operations.html
Need top-level categories to help users navigate:

MM/Conv/Linear
TMs
Transformer OPs (split, convcat heads)
Reductions
Unary
Binary
Ternary
Relational

Per: @muthutt. The ops to uplift into the doc (i.e.) is in branch, mcw-ops/ttnn

@davorchap and @muthutt https://github.com/tenstorrent-metal/tt-metal/pull/4700/commits/1b61f94e348a99a67df85a7ea45303ba9b180cb2
I have grouped the ops in this commit. Please share you comments


CDS-51927 Support for Metadata conditions in  On New Artifact Triggers

https://harness.atlassian.net/browse/CDS-51927 -  Support for Metadata conditions in  On New Artifact Triggers
Harness Developer Pull Request
Thanks for helping us make the Developer Hub better. The PR will be looked at
by the maintainers.
What Type of PR is This?

[ ] Issue
[ ] Feature
[ ] Maintenance/Chore

If tied to an Issue, list the Issue(s) here:

Issue(s)

House Keeping
Some items to keep track of. Screen shots of changes are optional but would help the maintainers review quicker.

[ ] Tested Locally
[ ] Optional Screen Shoot.

broke the build.
the update is now covered in this PR:
https://github.com/harness/developer-hub/pull/1920/files#diff-1b3d29362635472245bbda0f50a09a31897388638d61f2b90faa12763ecb6d77R224


JPX decoder

Way better than nothing...
Has limited functionality and few known issues:

http://dl.dropbox.com/u/3837794/Mac Install Flow (Final).pdf from #1066
color intensity

@pdfjsbot test

initial issue ref #268

@pdfjsbot lint

#1066 fixed now
@pdfjsbot test


Fix apiadminlogin ts spec

Summary
Fix the apiAdminLogin() function signature, in the Typescript declaration.
Ticket Link
None
Related Pull Requests
This is a small improvement over an already merged MR, where the apiAdminLogin() function signature issue was observed https://github.com/mattermost/mattermost-webapp/pull/11365
Release Note
NONE

/e2e-test

Successfully triggered e2e testing!
https://git.internal.mattermost.com/qa/cypress-ui-automation/-/pipelines/256551


Show All menu is greyed out only after clicking

Testing #55389
The screencasting tool I use can't capture the menu bar but the reproduce steps are simple

Close the last vscode window
Menubar only shows Code-Insiders, File, Window and Help
Click Code-Insiders -> Show All

Show All is not greyed out and the last step does nothing (this is as expected). However after clicking it, Show All is greyed out.
The last step does nothing.

@rebornix these actions are provided by the os and enablement is determined by them. I could get the same behavior using iTerm2


Env Viz and Inspector: gutter click leads to spurious error messages

Example 1:

Example 2:

this followed by a removal of Line 3 leads to:

Background: gutter click is implemented by inserting debugger; in the program.

Breakpoint also does not move when the code is edited, allowing cases such as the following:

I'm referring to the telegram discussion in SA 2021 INSPECT about this, from May 19, 2020.
The most economical solution is the following, suggested by @openorclose :
(1) The frontend keeps track of gutter clicks and marks them with red dots, but does not insert any "debugger;" into the program.
(2) "Run" parses the program in a loop:

the program as is
the program with the first breakpoint added as "debugger;"
the program with the second breakpoint added as "debugger;"
etc
The first time the parser chokes on the program, we know that the "debugger;" statement was in the wrong place. Then we issue an error message:
"Breakpoint in line xxx is not at the beginning of a statement."

If there is no line where the breakpoint can be inserted (the breakpoint exceeds the end of the program), the frontend will issue the same error message.

The breakpoints are taken directly from the ace editor, so moving breakpoints is going to be a bit complicated. Best case is they implement that feature on their side. Otherwise we will have to listen on edits made in the editor and move the breakpoints. I think a separate issue can be made for that.

Yes, that's right. We can live with breakpoints fixed to specific line numbers. It's what-you-see-is-what-you-get. Users will just have to move the breakpoints after inserting lines. No big deal. Good to keep the implementation simple.


Change render strategy of supporter list in modal

Tasks

[ ] Change render strategy of supporter list in modal. Use our standard way instead of react-virtualized

References

Thread discussion

2


cardano-tracer: Windows tests error

cardano-tracer-test.exe returns Windows-specific error after tests.
The error message is:
cardano-tracer-test.exe: SetEvent: Invalid handle
Steps to reproduce
This error is a random one: sometimes it occurs, sometimes is not, sometimes I see even two equal error messages. These are some examples from Hydra CI:

Once after tests failed: https://hydra.iohk.io/build/12743309/nixlog/1
Twice after tests failed: https://hydra.iohk.io/build/12735019/nixlog/1
Once even after tests passed: https://hydra.iohk.io/build/12723698/nixlog/1

Please note that the same tests are passed on Linux and on macOS.
Also, please note that this error occurs during concurrent running (default for tasty) as well as sequential running (with TASTY_NUM_THREADS as "1").

@deepfire Yes. As you can see here (https://hydra.iohk.io/build/12735019/nixlog/1), the total time of tests is 40.08s. But in parallel mode, all tests take ~15s.

Unfortunately, Windows tests for Logs were temporarily disabled (because it was a blocker for node' team). It will be fixed later.


add Azure Eventhubs image target

@sputnik13 Is this v1.2-debian-azureeventhubs is available in fluentd-kubernetes-daemonset for use. We are using fluentd daemonset for collecting logs and trying to find out a plugin to send those logs to azure eventhubs. It seems you tried the same here. So just thought to check with you for some help.


TypeError: Failed to execute 'fetch' on 'Window': parameter 2 ('init') is not an object.

Please can anyone tell me what this error is about and how to resolve it? I am new to Javascript so may this is a basic mistake or error.
My code showing error:
fetch('https://cfw-takehome.developers.workers.dev/api/variants', method="no-cors").then(response => response.json()).then(json => console.log(json))
Error screenshot:

Thanks:)

method="no-cors"

That looks like a Python syntax. You want it to be an object for the second argument of fetch(). Please take a look at the Fetch API documentation for reference: https://developer.mozilla.org/en-US/docs/Web/API/Fetch_API/Using_Fetch

@zllovesuki Thanks for the quick response I was able to resolve above error and also submitted my project:)


File Resource not connecting to network share

Apologies if there is a better place for this, please let me know if there is a better place.
I am looking to use Lability to setup a bare bones lab for incoming employees so they don't have to transfer around large ISO images to their company laptops or worry with missing a step during setup. I have a Domain controller that gets stood up and it works great for that. My next step is getting a SQL server to install. My intended method of install was going to be copy the SQL install files to the VM using a File resource then install using the SQLServer resource.
The issue I'm running into is the File copy from the VM host (which is accessible and verified) because of group policy limitation of getting files as a guest from a file share. If I go in and disable the right GPO (Lanman Server -> Access shares as guest) then it works fine. I have tried adding in a credential field to the File resource, but it seems to ignore it. My File resource is setup as (from the MOF on the SQL host):
instance of MSFT_FileDirectoryConfiguration as $MSFT_FileDirectoryConfiguration1ref
{
ResourceID = "[File]SQLInstallerCopy";
 Type = "Directory";
 Ensure = "Present";
 DestinationPath = "C:\\SQLInstaller";
 ModuleName = "PSDesiredStateConfiguration";
 SourceInfo = "C:\\Users\\Administrator\\source\\repos\\DSC-Lability\\Basic-Lab.ps1::215::9::File";
 Recurse = True;
 SourcePath = "\\\\x.x.x.x\\ISOs\\SQL_2019_standard";
 Credential = $MSFT_Credential1ref;
 PsDscRunAsCredential = $MSFT_Credential1ref;

ModuleVersion = "1.0";

 ConfigurationName = "Delinea_Lab";

};

According to the documentation, this should work. The errors I get are:
PS C:\BootStrap> Start-DscConfiguration -Path C:\Bootstrap -Wait -Force
You can't access this shared folder because your organization's security policies block unauthenticated guest access. These policies
help protect your PC from unsafe or malicious devices on the network. An error occurs when accessing the network share with the
specified credential. Please make sure the credential is correct and the network share is accessible. Note that Credential should
not be specified with the local path. The related file/directory is: \\x.x.x.x\ISOs\SQL_2019_standard.
    + CategoryInfo          : NotSpecified: (:) [], CimException
    + FullyQualifiedErrorId : Windows System Error 1272
    + PSComputerName        : localhost

The SendConfigurationApply function did not succeed.
    + CategoryInfo          : NotSpecified: (root/Microsoft/...gurationManager:String) [], CimException
    + FullyQualifiedErrorId : MI RESULT 1
    + PSComputerName        : localhost

PS C:\BootStrap>

Any help is appreciated.

Sorry - only just seen this as I'm updating the module. Have you looked at using custom resources (files you can copy to VMs disk)?


[move-prover] cascade the variance parameter in type unification process

Previously the variance parameter is only effective on the top-level.
This commit additionally allows the type compatibility rule to be
propogated recursively to all sub-types in the type unification process
(via the Variance::Allow option).
The old behavior, outermost co-varianec only, can be requested with
Variance::Shallow. And Variance::Disallow completely disables the
type compatibility rules.
For the only two call sites of the Substitution::unify() function,

Variance::Allow is requested for ExpTranslator::translate_call()
to give more freedom in the type inference process. The effect of
this change is shown in the new test case added (which is also
in the comments).
Variance::Shallow is requested for ExpTranslator::check_type()
to be more conservative in type checking.

Motivation
Complete the type-compatibility rules in the type unification process.
Have you read the Contributing Guidelines on pull requests?
Yes
Test Plan

CI
A new test case

/land


Put arti-rest headers for ios in separate subdirectory

Because XCode copies all headers from all Swift Packages into one single
directory, the headers must be unique. So using a name like Headers
will most probably collide.
This PR uses a different name for the header directory.
Closes #58

The most important change is in build_xcf.sh, where instead of putting the header files and modulemaps into Headers/module.modulemap, it puts them into arti-rest/module.modulemap, so that it can be used at the same time as other swift packages.


Data Visualization

Per a group meeting discussion, we laid out a number of goals for data visualization and the outline of a path forward.
Goals

Save and load trajectory sets (a map from a string name to a saved trajectory object). #104

Each saved trajectory would be

A VectorXd of times
A MatrixXd of data points
A vector of strings, naming the rows of the data matrix
The string name of the trajectories (also the map key)

A saved trajectory set would also include meta data

Date/time
Name
Description
Git commit number (to be parsed automatically)
Git dirty flag (parsed automatically, true if there are uncommitted changes)

Visualize a saved trajectory

Maybe eventually visualize multiple trajectories

Visualize single and multiple saved states

Multipose visualization #144

Visualize kinematics

Points (as points) and axes #174
Vectors as arrows

Trace forward kinematic paths over trajectories

Plot trajectories (matplotlib)

Plot forward kinematic trajectories

Just throwing out a idea: visualizing the planned trajectory online (e.g. COM trajectory, swing foot trajectory) like what Agility Robotics does in this video: https://youtu.be/2CYOrkwJzag

Some of this list has been addressed. I've updated the main comment accordingly. @yminchen @Jianshu-Hu @yangwill  I'm guessing you're using some mechanism to visualize saved trajectories. Is this something in master that we can point to?

The feature exists in master and can be seen in run_dircon_jumping.cc and visualize_trajectory.cc in examples/Cassie/. However it requires a decent amount of boilerplate code, so I'm working on creating a specific API for saving/loading/visualizing dircon trajectories.


Relation without ActiveRecord

Is it possible to have a table joined to an AR instance without having AR class. I am creating an extension which manages tags(in external table) and this table doesn't have a corresponding AR class. I want to achieve something like this:
$posts = Post::find()->with('properties')->one();
//and then accessing properties like this
echo $posts->properties['name'];

Is this possible ?

Relations can not queried without an ActiveRecord class, which declares them. This is obvious.


the pretrained resenet model under shapenet

hi,friend,your work is really charming, I want to follow this project. could you release the pretrained resenet model under shapenet?

Hi, It is released in the README.md.
Maybe i did not understand your question?

Closing this since the issue is stale, feel free to reopen. Thanks a lot for for playing around with AtlasNet.
Cheers,
Thibault


call to photonphase from psrpipe

In psrpipe.py, the call to photonphase has the argument -orb, which was changed to -orbfile in PINT.
This causes psrpipe to crash if a par file is provided.

Hmm, I'm mystified. As far as I can tell, the PINT call has been --orbfile for 5 years. Not sure what happened.

I just tested it and although the option is really --orbfile, it seems to accept --orb as an alternative:
% photonphase --orb<PHONE_NUMBER>_pipe/ni2070020466.orb<PHONE_NUMBER>_pipe/cleanfilt.evt refit.par
works with no crash for me.

Sorry, this was just a mix up of errors.  argparse has no problem with shortened arguments as long as there are no ambiguities.  --orbfile and --orb both work just fine
Closing.


added CRS mapping to/from CF 1.8; added to_proj4_dict

Addresses #226
This will need a good review.
I am unsure about what the CF unit mapped to. It is either units or vunits. I am guessing vunits at the moment, but it is only a guess.
Others I think are just another maping to datum, but not sure. Maybe there is a vdatum in PROJ I am missing.

geoid_name (OGC WKT VERT_DATUM - ex GEOID12B)
geopotential_datum_name (OGC WKT VERT_DATUM - ex NAVD88)

datum is just horizontal I believe.

I am learning towards unit mapping to units as it seems the z coordinate will also have units, and that would correspond to the vunits I would think.

@snowman2 This is amazing. I think some good people to look at this would be @dopplershift, @mraspaud, and @pnuu. I'll try to find time to review this in the next couple days.

Looks good. I just wonder if a warning should be issued if a parameter doesn't map to CF (instead of silently ignoring them).

The popping was from another iteration where I was rasing an exception when a parameter didn't match. I think @jswhit has a valid point about warning the user. If we do warn the user, the current copy/pop implementation should stay. If not, it can be changed.
I added warnings in the docs, but those aren't always read. So, putting it in the code will make it more likely that the user will notice.

It seems there is a warning raised almost every single time the function to_cf is called.
  /home/snowal/scripts/pyproj/pyproj/crs.py:362: UserWarning: PROJ parameters not mapped to CF: ('k', 'no_defs', 'type')
    "PROJ parameters not mapped to CF: {}".format(tuple(skipped_params))

t /home/snowal/scripts/pyproj/pyproj/crs.py:362: UserWarning: PROJ parameters not mapped to CF: ('no_defs', 'type')
    "PROJ parameters not mapped to CF: {}".format(tuple(skipped_params))

test/test_crs_cf.py::test_cf_from_utm
  /home/snowal/scripts/pyproj/pyproj/crs.py:362: UserWarning: PROJ parameters not mapped to CF: ('zone', 'no_defs', 'type')
    "PROJ parameters not mapped to CF: {}".format(tuple(skipped_params))

test/test_crs_cf.py::test_cf_rotated_latlon
  /home/snowal/scripts/pyproj/pyproj/crs.py:362: UserWarning: PROJ parameters not mapped to CF: ('o_proj', 'type')
    "PROJ parameters not mapped to CF: {}".format(tuple(skipped_params))

That is kind of annoying, but good to know as well. So, I am not sure how I feel about it.
Thoughts?

My initial reaction is to mark certain parameters as "can't be converted" by storing them with None values in the dictionary and detecting None in the conversion function. It isn't that we don't know how to convert them, it is that we know we can't convert them.
Side note: You can remove the pass line of the except block's now.

I like the idea of having a separate exclusions list in there for known skipped PROJ params. I think having this could also allow users to lookup which params are not supported by CF. It would probably also be good to have a separate one for known CF parameters not supported by PROJ. I think raising a warning for parameters not in either of those lists would be useful. But, open to opinions.
Another question in my mind is: Would it be better to only ignore parameters such as "nodefs" & "type" and warn for other ones such as "zone" or "k"?

You can remove the pass line of the except block's now.
That's neat. When was the feature introduced?

Or, we could follow the current method in pyproj with an errcheck parameter to turn on/off warnings and then let the user turn on the warning to check and see what parameters are skipped with the default of being off. This would be a simpler route and would alleviate the need to manage more lists.

I'm interested in the idea of ignoring for some, warning for others. I could see it being a fine line though. I like the idea of an option for the user too.
For the pass thing, I only meant that you added skipped_params.append(proj_param) to the except: part of the code so you no longer need the pass which you added in your previous version of the code.

I am leaning towards the errcheck option. Simple is always nice.

For the pass thing, ..

Ahhh, makes sense now. Thanks for the clarification :)

Looks like y'all are using longitude_of_projection_origin=proj_dict.get('lon_0'), as well for another projection. Is it a special case for omerc to use lonc?

Also looks like sweep=sweep_axis mapping is missing in the mappings in this PR.

@painter1, we are working on mapping the CF parameters to PROJ parameters and would appreciate it if you could clarify our questions about lonc and alpha with the oblique_mercator CF projection in this issue. Thanks!

Looking at the PROJ code here, it seems like alpha is the default and gamma is the backup. Also lonc is mentioned without lon_0 being referenced. So, I think it is likely that lonc and alpha are the ones to use.

Recent changes look good to me. Thanks.

Thanks for the review @djhoese, you had some good points/catches.

@jswhit are your concerns about warning the user resolved with the current implementation?

@jswhit are your concerns about warning the user resolved with the current implementation?

Yes - that looks good to me.

Update: I am now very confident that lonc and alpha are the way to go with the coordinate_operation addition:
>>> from pyproj import CRS
>>> crs = CRS({
...         "proj": "omerc",
...         "lat_0": 10,
...         "lonc": 15,
...         "alpha": 0.35,
...         "gamma": 0.55,
...         "k": 1,
...         "x_0": 0,
...         "y_0": 0,
...         "ellps": "WGS84",
...         "units": "m",
...         "no_defs": None,
...         "type": "crs",
...     })
>>> crs.coordinate_operation
CONVERSION["unknown",
    METHOD["Hotine Oblique Mercator (variant B)",
        ID["EPSG",9815]],
    PARAMETER["Latitude of projection centre",10,
        ANGLEUNIT["degree",0.0174532925199433],
        ID["EPSG",8811]],
    PARAMETER["Longitude of projection centre",15,
        ANGLEUNIT["degree",0.0174532925199433],
        ID["EPSG",8812]],
    PARAMETER["Azimuth of initial line",0.35,
        ANGLEUNIT["degree",0.0174532925199433],
        ID["EPSG",8813]],
    PARAMETER["Angle from Rectified to Skew Grid",0.55,
        ANGLEUNIT["degree",0.0174532925199433],
        ID["EPSG",8814]],
    PARAMETER["Scale factor on initial line",1,
        SCALEUNIT["unity",1],
        ID["EPSG",8815]],
    PARAMETER["Easting at projection centre",0,
        LENGTHUNIT["metre",1],
        ID["EPSG",8816]],
    PARAMETER["Northing at projection centre",0,
        LENGTHUNIT["metre",1],
        ID["EPSG",8817]]]
>>> crs = CRS({
...             "proj": "omerc",
...             "lat_0": 10,
...             "lon_0": 15,
...             "alpha": 0.35,
...             "gamma": 0.35,
...             "k": 1,
...             "x_0": 0,
...             "y_0": 0,
...             "ellps": "WGS84",
...             "units": "m",
...             "no_defs": None,
...             "type": "crs",
...         })
>>> crs.coordinate_operation
CONVERSION["unknown",
    METHOD["Hotine Oblique Mercator (variant B)",
        ID["EPSG",9815]],
    PARAMETER["Latitude of projection centre",10,
        ANGLEUNIT["degree",0.0174532925199433],
        ID["EPSG",8811]],
    PARAMETER["Longitude of projection centre",0,
        ANGLEUNIT["degree",0.0174532925199433],
        ID["EPSG",8812]],
    PARAMETER["Azimuth of initial line",0.35,
        ANGLEUNIT["degree",0.0174532925199433],
        ID["EPSG",8813]],
    PARAMETER["Angle from Rectified to Skew Grid",0.35,
        ANGLEUNIT["degree",0.0174532925199433],
        ID["EPSG",8814]],
    PARAMETER["Scale factor on initial line",1,
        SCALEUNIT["unity",1],
        ID["EPSG",8815]],
    PARAMETER["Easting at projection centre",0,
        LENGTHUNIT["metre",1],
        ID["EPSG",8816]],
    PARAMETER["Northing at projection centre",0,
        LENGTHUNIT["metre",1],
        ID["EPSG",8817]]]


Dask cache tuning

🐛 Tune dask cache
Chatting with @jni about the dask cache... we need to do a few things to tune performance:

think more about what the default size should be.  If the cache is large, but still not as large as the dataset, then looping a dataset with the play button will just continuously swap the cache, and potentially cause more overhead than if it was off altogether
don't resize after created: If a user creates a Layer with a dask array, the cache is created... if they then resize with resize_dask_cache(100), it works, but if they create a new Layer, I think the cache will go back to the default size.  which it should not
possibly modify scoring algorithm: cachey lets you modify the scoring algorithm for cache eviction.  by default, it's score += compute_time / num_bytes * (1 + eps) ** tick_time.

I just want to add that (1) is definitely a problem I'm encountering now. A small or disabled cache makes play much much smoother than the default 1/2RAM cache, for a 15GB dataset (200 x 75MB timepoints).

and just to be explicit (in case someone stumbles on to this), if you'd like to disable the cache, for now, you need to do it after you add a layer with a dask array, and probably each time:
import napari
from napari.utils import resize_dask_cache

napari.view_image(big_dask_array)
resize_dask_cache(0)

As noted in #1206 by @tlambert03

Let's maybe leave #1205 open for input on tuning the default cache size (which this PR does not change)

let's maybe close it now :joy:


Intermittently /dev/shm files are not created (eCAL 5.10 and docker)

Describe the bug
I am running into an issue where intermittently my local eCAL applications are not using shared memory. Restarting my applications generally resolves the issue. This is usually observed when my applications launch on system start up, but it is intermittent.
I am running my eCAL applications in separate docker containers, and I am using --network host --ipc host --pid host.
Also, I am trying to force only shared memory usage via the following ecal.ini settings
[publisher]
use_inproc                = 0
use_shm                   = 2
use_tcp                   = 0
use_udp_mc                = 0

When the /dev/shm files are missing the pub/sub data does appear to be flowing, so it's not like the connections are broken.
To Reproduce

Boot the system
Observe eCAL applications have launched
Check /dev/shm and observe it does not have files created for the publishers and subscribers
Restart the applications
Observe that a bunch of /dev/shm files are then created

Expected behavior
I am expecting that /dev/shm files were created always and an application restart is not necessary
Desktop (please complete the following information):

OS: Ubuntu
Version 22.04 (docker base image for my applications are based on 22.04)

Additional context
At this point, I'm more interested in learning the details of how eCAL chooses which transport to use so that I can better debug issues like this. Given that the use_shm is the only non-zero option in the .ini file, does eCAL still try to determine which transport to use dynamically in this case? Can someone point me to this logic in the eCAL source code?
I am wondering if there's some kind of race condition at play here. I believe I encounter this issue mostly on a cold system boot.

I cannot really say why this happens to you, I think we need to dig a little deeper. But what I would guess right now, is that your docker containers start before the OS has fully initialized the network.
On startup, an eCAL node will join a well-known UDP multicast group and listen to a well known port. By default, it is <IP_ADDRESS>:14000. It can be changed in the ecal.ini, even though there usually isn't a reason to do that. We call this the monitoring layer and if you start the eCAL Monitor you will see a graphical representation of the messages sent on that layer. If your interfaces aren't up, yet, the multicast group cannot be joined, the monitoring layerwill not be able to match publishers and subscribers and no data will flow between your nodes.
Keep in mind, that this is necessary either way, even for pure-local SHM communication, as this lets the eCAL nodes discover each other before they even start sending data via SHM.
Debugging
If you see this happening, you can execute the following command:
netstat -g

This will print the multicast joins for all interfaces. I guess it will show up something invalid or unwanted, there.
Forcing SHM
To force SHM, you should switch the layer to 1 (->ON). Your current setting is 2 (-> Auto), which will only publish data via SHM if there are local subscribers. When setting SHM to 1 you should immediatelly see some files in /dev/shm. This will however probably not help you, as subscriber doesn't know about the filenames.
[publisher]
use_inproc                = 0
use_shm                   = 1
use_tcp                   = 0
use_udp_mc                = 0

Future
The next eCAL release (5.11) will bring two features related to this:

A shared-memory-based monitoring layer that will not depend on network interfaces for local communication
An option to join the multicast group on all interfaces, so if you switch interfaces later you will not have to restart eCAL nodes

@bsirang one question: when you are saying this is happening with 5.10, does it also mean it didn't happen with 5.9?
(We have internally encountered some problems which occured after 5.9 to 5.10 upgrade, and even though we did our best, we were not able to pinpoint them exactly. So we changed the strategy to leave things as they are for now and do some major internal cleanup and better testing for 5.11).
Also when you say, that the data is flowing with no shm files, @FlorianReimold is that anyhow releated to the unlinking of SHM files? But I guess non of those commits are in any of the releases yet.

At this point, I'm more interested in learning the details of how eCAL chooses which transport to use so that I can better debug issues like this. Given that the use_shm is the only non-zero option in the .ini file, does eCAL still try to determine which transport to use dynamically in this case? Can someone point me to this logic in the eCAL source code?

Also, our configuration, is more than "suboptimal". Basically, it's possible to missconfigure your system so that actually no communication is taking place. eg. by putting udp = 2 and shm=0, then you won't see any local communication unless there is an external subscriber on a different host, in which case a subscriber on the same host will also see the udp traffic.
For eCAL 6 (and maybe earlier if we find a good strategy for converting the ini files), we plan to do it differently.
There would be a intraprocess, interprocess, interprocess config items, which you can set to the appropriate layers (shm, upd, tcp, ...) and not vice versa.

@FlorianReimold What's interesting is that in the cases where the /dev/shm files do not exist, communication still seemed functional, so it was as if UDP was being used rather than SHM. I didn't sniff packets to prove that though.
I should mention also that when my applications start up in this state, if I try to then run another tool that subscribers after the system is up, I get shm_open failures due to file not found, which to me implies that the subscriber believes that shm should exist.
I was also thinking it smelled like a race condition related to networking bringup. I will make the config change to use_shm = 1 to see if my problem goes away.
@KerstinKeller It may or may not have happened in v5.9. I actually don't know because I wasn't initially trying to force shm when I was on v5.9, and hadn't done any analysis. Regarding the unlinking of shm files, I am aware of that issue also as I have noticed shm files don't get cleaned up. I did see the issue related to it, so I am also waiting on that fix.

Is there a release date for v5.11? I am looking forward to the upgrade.

I have more interesting and confusing findings.
First, the switch to
[publisher]
use_inproc                = 0
use_shm                   = 1
use_tcp                   = 0
use_udp_mc                = 0

Didn't seem to help. I still encountered a scenario where my applications were up but /dev/shm looked like this:
$ ls -l /dev/shm/
total 32
-rw-rw-rw- 1 root root  104 Oct  6 11:21 ecal_shutdown_process_14324_evt
-rw-rw-rw- 1 root root  104 Oct  6 12:10 ecal_shutdown_process_16424_evt
-rw-rw-rw- 1 root root  104 Oct  6 12:22 ecal_shutdown_process_16897_evt
-rw-rw-rw- 1 root root  104 Oct  6 12:35 ecal_shutdown_process_17139_evt
-rw-rw-rw- 1 root root  104 Oct  6 12:43 ecal_shutdown_process_17372_evt
-rw-rw-rw- 1 root root  104 Oct  6 12:45 ecal_shutdown_process_17500_evt
-rw------- 1 root root 4096 Oct  6 11:20 PHS-7107
-rw----rw- 1 root root 4096 Oct  6 11:20 PHS-7640

I didn't have ecal_mon_gui readily available in this environment, but I have a CLI tool that can print the topics.proto data, and I found that the tlayer field was in fact set to tl_ecal_shm for all of my publishers.
{
 "rclock": 2,
 "hid": 0,
 "hname": "my-hostname",
 "pid": 12532,
 "pname": "/path/to/app/foobar",
 "uname": "foobar",
 "tid": "30917891712",
 "tname": "/battery/state",
 "direction": "publisher",
 "ttype": "proto:trellis.core.TimestampedMessage",
 "tdesc": "CtQBChlnb29nbGUvcHJvdG9idWYvYW55LnByb3RvEg9nb29nbGUucHJvdG9idWYiJgoDQW55EhAKCHR5cGVfdXJsGAEgASgJEg0KBXZhbHVlGAIgASgMQnYKE2NvbS5nb29nbGUucHJvdG9idWZCCEFueVByb3RvUAFaLGdvb2dsZS5nb2xhbmcub3JnL3Byb3RvYnVmL3R5cGVzL2tub3duL2FueXBiogIDR1BCqgIeR29vZ2xlLlByb3RvYnVmLldlbGxLbm93blR5cGVzYgZwcm90bzMK7wEKH2dvb2dsZS9wcm90b2J1Zi90aW1lc3RhbXAucHJvdG8SD2dvb2dsZS5wcm90b2J1ZiIrCglUaW1lc3RhbXASDwoHc2Vjb25kcxgBIAEoAxINCgVuYW5vcxgCIAEoBUKFAQoTY29tLmdvb2dsZS5wcm90b2J1ZkIOVGltZXN0YW1wUHJvdG9QAVoyZ29vZ2xlLmdvbGFuZy5vcmcvcHJvdG9idWYvdHlwZXMva25vd24vdGltZXN0YW1wcGL4AQGiAgNHUEKqAh5Hb29nbGUuUHJvdG9idWYuV2VsbEtub3duVHlwZXNiBnByb3RvMwrmAQomdHJlbGxpcy9jb3JlL3RpbWVzdGFtcGVkX21lc3NhZ2UucHJvdG8SDHRyZWxsaXMuY29yZRoZZ29vZ2xlL3Byb3RvYnVmL2FueS5wcm90bxofZ29vZ2xlL3Byb3RvYnVmL3RpbWVzdGFtcC5wcm90byJqChJUaW1lc3RhbXBlZE1lc3NhZ2USLQoJdGltZXN0YW1wGAEgASgLMhouZ29vZ2xlLnByb3RvYnVmLlRpbWVzdGFtcBIlCgdwYXlsb2FkGAIgASgLMhQuZ29vZ2xlLnByb3RvYnVmLkFueWIGcHJvdG8z",
 "tlayer": [
  {
   "type": "tl_ecal_shm",
   "version": 0,
   "confirmed": true,
   "parShm": ""
  }
 ],
 "tsize": 2499,
 "connectionsLoc": 3,
 "connectionsExt": 0,
 "messageDrops": 0,
 "did": "7018130021014966792",
 "dclock": "4487",
 "dfreq": 986,
 "attr": {}
}

However, when I run my CLI tool, which attempts to subscribe to the topic, I get this error
$ docker run -it -v /opt/deployment:/opt/deployment -v /opt/deployment/etc/ecal/ecal.ini:/etc/ecal/ecal.ini --network host --ipc host --pid=host ubuntu:22.04 /opt/deployment/bin/trellis-cli topic echo -w -r 1 -t /battery/state
shm_open failed : /_battery_state_30917984_shm errno: No such file or directory

My only thought at this point was that the docker containers were actually not using the hosts IPC namespace despite --ipc host flag. However, I ran this command
docker ps --quiet --all | xargs docker inspect --format '{{ .Name }}: IpcMode={{ .HostConfig.IpcMode }}'

Which confirmed that the docker containers were running with host IPC.
So I am puzzled how the /dev/shm files could be missing while the monitoring layer says shm is used, and while fields like connectionsLoc are showing a non-zero value.
Any thoughts?

@FlorianReimold / @KerstinKeller curious if you have any theories for how /dev/shm files may be missing while at the same time the monitoring layer is reporting tl_ecal_shm ?

Difficult to say, in theory there could just be something that deletes the files. So in order to make an educated guess, I will need more information:

How many docker containers are you using?
Are sender and receiver running in the same docker container or in different ones?
Where is your monitor running? On the host? In either docker container? In its own docker container?
Is the communication actually working for your latest example?

If you would get us a manual on how to reproduce your setup (e.g. some dockerfiles and shell commands) I could also try to reproduce and debug it and then maybe give a better explanation or even fix it.

At the moment we are running 14 containers
Sender and receivers are in different containers (all containers are launched with --network host --ipc host --pid host)
Monitor is running in another container via my CLI tool (I have the docker run command I used above in my other comment).
Surprisingly I believe the communication is working even in those cases where I don't see shm files. I need to dig deeper.

Do you have a method of using tcpdump or similar to sniff the UDP traffic? Perhaps I can do something like that to determine if UDP is being used in these cases.
I can try to get a basic example reproducing this issue if I get the time. Because it's intermittent it may be challenging if it depends on some timing of the start up of my applications.
Since @KerstinKeller mentioned some major cleanup in v5.11, I wonder if this will just go away when we upgrade.

I wonder if it makes sense that we can have a call / screenshare to take a deeper look.
We're not using ecal in conjunction with docker extensively, so some behaviors might have changed without us noticing.
There is some (too much?) logic in eCAL,  when trying to figure out how one eCAL publisher will communicate with interested subscribers.
If course it wants to send only on layers where other processes are listening.
When dealing with docker containers, it might not work as reliably, as the heuristics to figure out which layer to apply might fail.
I recall we did make some changes in the logic between 5.9 and 5.10.

I reproduced the issue after adding more instrumentation. I believe what's happening is the files are created, the subscribers are happy, and then the files are later deleted. Since the subscribers already had them open they are happy.
I believe they are getting deleted in my system environment due to this: https://superuser.com/questions/1117764/why-are-the-contents-of-dev-shm-is-being-removed-automatically
I will do more testing to confirm that the systemd RemoveIPC option is the culprit.

Ah, that's interesting! I didn't know about that. So basically your Docker containers are started before the user is logged in?

@FlorianReimold yes we run our eCAL services via systemd and they launch automatically on boot. They run as a user account with UID 1000, which is in the non-system UID range and thus systemd does the IPC garbage collection on it (which I didn't know was a feature).
I have not yet seen the problem after changing that configuration option, so I believe this issue can be closed.
It may be worth a call out in some documentation somewhere that some system services, such as systemd, may clean up /dev/shm files, which can cause problems.


Fix snack example

Just change line 14 import { Constants } from 'expo'; for import Constants from 'expo-constants';

Thanks for your help. I updated Snack and README.


code refactor - separate activation of imaging_report

cell_plot needs access to imaging module. This seems to be the kind of chicken-egg problem that is not allowed in python I believe (a.k.a. circular import problem). Am I missing something?

cell_plot needs access to an imaging module. This seems to be the kind of chicken-egg problem that is not allowed in python I believe (a.k.a. circular import problem). Am I missing something?

cell_plot does not need to import imaging. The 2 functions plot_cell_overlayed_image and plot_cell_traces indeed need imaging, but it's passed in as input argument. This is to avoid that chicken-egg problem, the idea is, by the time those 2 functions are to be called, the caller would already have imaging defined and can pass in as input argument.
Obviously this is not very elegant, would have been nice if cell_plot can know about the activated imaging module and just import it, but I haven't figured out yet how to best achieve that.

cell_plot needs access to an imaging module. This seems to be the kind of chicken-egg problem that is not allowed in python I believe (a.k.a. circular import problem). Am I missing something?

cell_plot does not need to import imaging. The 2 functions plot_cell_overlayed_image and plot_cell_traces indeed need imaging, but it's passed in as input argument. This is to avoid that chicken-egg problem, the idea is, by the time those 2 functions are to be called, the caller would already have imaging defined and can pass in as input argument. Obviously this is not very elegant, would have been nice if cell_plot can know about the activated imaging module and just import it, but I haven't figured out yet how to best achieve that.

Right there is no problem. It took me sometime to follow the imports. I think we are good with this.


Feat: Disable Text Selection on Website

Describe the feature
Prevent text selection on specific elements or the entire webpage using CSS and JavaScript. This enhances content protection by making it harder to copy text while maintaining a seamless user experience.
Add ScreenShots

Record

[X] I agree to follow this project's Code of Conduct
[X] I'm a GSSOC'24 contributor
[X] I want to work on this issue

@Suchitra-Sahoo /assign me the issue under GSSOC'24 please.

Sahil this feature is not required currently in the project.


clusteradm get klusterlet-info fails even with managed cluster context

I am trying to get the klusterlet-info of a managed cluster by trying to run the command clusteradm get klusterlet-info but the command fails with an error message `
Version details
clusteradm version
client		version	:v0.6.0
server release	version	:v1.26.3
default bundle	version	:0.11.0

Steps to reproduce:

Run the local-up.sh script to create 3 KinD clusters (1 hub and 2 managed clusters)

curl -L https://raw.githubusercontent.com/open-cluster-management-io/OCM/main/solutions/setup-dev-environment/local-up.sh | bash

Run the following command to get the klusterlet details.

multicluster clusteradm get klusterlet-info --context kind-cluster2

# k ctx kind-cluster2
Switched to context "kind-cluster2".
# clusteradm get klusterlet-info
Error: managed cluster oriented command should not running against non-managed cluster
# multicluster clusteradm get klusterlet-info --context kind-cluster2
Error: managed cluster oriented command should not running against non-managed cluster

As a workaround, I am able to run the below command and get the required details.
oc get klusterlet -o yaml

There are no ClusterClaim CRs in the managed cluster which is used to determine if a given context maps to  a hub or managed cluster.
# k get clusterclaim -A
No resources found

https://github.com/open-cluster-management-io/clusteradm/blob/v0.6.0/pkg/helpers/check/check.go#L57-L70
Maybe the issue is the code is looking for a v1 version of clusterclaim but clusteclaim is still on v1alpha1?
CC @ycyaoxdu

 # kubectl api-resources | grep clusterclaim
clusterclaims                                        cluster.open-cluster-management.io/v1alpha1   false        ClusterClaim

I am interested to work on this bug. Can this be assigned to me.

/assign anandf


[Feature Request]: Add copy to clipboard and retry buttons to chat interface

Is there an existing issue for the same feature request?

[X] I have checked the existing issues.

Is your feature request related to a problem?
no

Describe the feature you'd like
Please add "copy to clipboard" buttons next to both the question and the answers in the chat interface to easily copy the response text.
It would also be very helpful if there was a 'retry' button for questions in case there were timeouts, errors or just to attempt to get a better answer.
Describe implementation you've considered
Copy to clipboard buttons like in PrivateGPT's interface would be very useful:

A Retry/Regenerate button underneath the last response or under the last question like in chatgpt would help:

Documentation, adoption, use case
No response
Additional information
No response

Good feature.

I was thinking of something similar, so I'll post it here instead of opening a new issue. What I'd like is an "Export conversation" button - it could export the chat history to the clipboard or save it to a file (even plaintext will do).
I often want to share excerpts from a chat and usually it is more than a single message. Therefore I believe that the copy-to-clipboard option suggested by AnonTester could be slightly extended, allowing one to copy an individual message or the entire conversation.


Önerge

Azure documentation issue guidance
Thanks for opening an issue in the Azure technical documentation repository.
We use GitHub issues as the primary channel for customer and community feedback about the Azure documentation.
Creating an issue
We prefer that you create documentation feedback issues using the Feedback link on the published article - the feedback control on the doc page creates an issue that contains all the article details so you can focus on the feedback part.
You can also create a feedback issue here in the repo. If you do this, please make sure your issue lists:

[ ] The relevant Azure service or technology.
[ ] A link to the published documentation article that you have feedback about.
[ ] Clear, specific feedback that the author can act on.

Pull requests and article contributions
If you know the change that is needed in an article, we encourage you to submit the changes directly using a pull request. If the change is large, or if you want to contribute an entire article, follow these guidelines:

[ ] Don't surprise us with a big pull request or a pull request with a new article! Submit an issue that describes the details of the proposed large change or new article.
[ ] Include the service or technology area.

We'll route the issue to the appropriate content team for review and discussion.
Tech support and product feedback
If you would like to contact Microsoft about other things, such as product feedback or tech support, please review these guidelines:

If you need technical support using Azure, the paid and free support options are described here: https://azure.microsoft.com/support/options/.

Each article in the Azure technical documentation contains a product feedback button - it's best to submit product feedback directly from a relevant article. Otherwise, you can submit product feedback for most Azure products in the following product feedback forum: https://feedback.azure.com/d365community/forum/79b1327d-d925-ec11-b6e6-000d3a4f06a4.

### Tasks
- [ ] https://github.com/MicrosoftDocs/azure-docs/issues/119559
- [ ] Evet tabiki
- [ ] https://github.com/MicrosoftDocs/azure-docs/issues/119624
- [ ] https://github.com/MicrosoftDocs/azure-docs/issues/119556

### Tasks
- [ ] https://github.com/MicrosoftDocs/azure-docs/issues/119644

Open..

@yahyafurkann
It would be great if you could elaborate your query and add a link to the documentation you are following for these steps? This would help us redirect the issue to the appropriate team. Thanks!

@yahyafurkann
Since we have not heard back from you, we will now proceed to close this thread.
If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion and we will reopen the issue.