NextjsSite build fails when using Next 12.2 middleware

My issue: Nextjs removed the target: serverless option recently. If you try to use middleware (the latest 12.2 version not 12.1 or 12.0) then it throws a build-time error:
> Build error occurred
MiddlewareInServerlessTargetError: Next.js Middleware is not supported in the deprecated serverless target.
Please remove `target: "serverless" from your next.config.js to use Middleware.

The problem as I understand it is that NextjsSite is using @sls-next/lambda-at-edge which does not appear to be super actively maintained. It tries to force target: serverless by rewriting your nextjs config. Also it doesn't work with ESM configs. See my draft PR: https://github.com/serverless-nextjs/serverless-next.js/pull/2478
Proposed solution
This guy has a solution with code for building nextjs with target: standalone and deploying it with a single lambda function and CDK: https://github.com/vercel/next.js/discussions/33275#discussioncomment-3343424
I suppose that would be better than using @slsnext/lambda-at-edge? (it does use import lambdaAtEdgeCompat from '@sls-next/next-aws-cloudfront). It looks like pretty a pretty minimal setup for a nextjs server request handler, though needs some of the S3/CF resources which I think are already set up in NextjsSite.The handler and static file deployments looks relatively straightforward.
CDK example: https://github.com/iiroj/iiro.fi/commit/bd43222032d0dbb765e1111825f64dbb5db851d9

Any update on this ?

I started a discussion on Discord: https://discord.com/channels/983865673656705025/1007405063678996522

Any update on this ?

Need to look at this as well: https://github.com/sladg/nextjs-lambda

We are transition this repo to https://github.com/sst/v2 and are closing this issue for now. If it is still relevant please reopen it there - sorry for the trouble


Fixed urls moving away of toc entries

TOC entries have changed so make the links more future proof

Looks fine.


update readPicture to make it to read one complete frame at a time for the support of thread-decoding of multi-slice frame

.

So how about the PR https://github.com/cisco/openh264/pull/3306? Seems duplicated?


[Bugfixes] Multiple alignment/button bugfixes

Checklist

[x] I tested all changes
[x] Client: I followed the coding and design guidelines.
[x] Client: I documented the TypeScript code using JSDoc style.
[x] Client: I added multiple screenshots/screencasts of my UI changes
[x] Client: I translated all the newly inserted strings into German and English

Motivation and Context

Some buttons in Artemis are not aligned correctly.
Other not necessary buttons are removed.
Also the "Correction Round 1" Column is changed to "Assessment Action" in all assessment dashboards.
Description

Center align of the Test Run button:
 -->

Replace "Correction Round 1" with "Assessment actions" When there is only one round.
 -->

Change Buttons in the exercise overview: remove "View" Button for all types as you can simply click on the id/title of the exercise. Also modified programming exercise buttons to look cleaner.

Steps for Testing

Go to the exam overview of a course -> Test Runs -> see if the "Assess your testrun" button is vertically centered
Check in the [exercise-type]-exercise-assessment-dashboard that the last column(s) are correct according to the number of correctionrounds.
Check the buttons in the course -> exercise overview.

those are really nice changes! I have only one point which you could maybe address.
The alignment of the buttons in the Exam Management is off (Click on "Student Exams"):

we'll fix this in a follow-up

Generally looks good to me, well done! One thing I noticed that looks a bit weird imo:

Why are we displaying "Test Run" for every exercise in the exam summary?

Before the change there was a second ribbon overlaying the first "Test Run" ribbon in the same place. I thought in these places it would make more sense.


MNT: Suppress LineSearchWarning's in scipy.optimize tests

I tried to fix #4554.
Tell me if I did it correctly.

@dlax, I think I understood what you were saying. I updated the commit (I think more than one is not appropriate here).

Merged, thanks @nmayorov !


bruno: fix css issue with patch file

Description of changes
Fix a css issue in bruno due to electron version used in Nix as compared to bruno upstream that uses older EOL version.
Things done

Created a patch file with the fix

Reference patch file to patches attribute list in the package definition

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[x] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[x] sandbox = true

[x] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage

[x] Tested basic functionality of all binary files (usually in ./result/bin/)

24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

I have no idea how that happened. I was trying to clone and switch to my branch on a different machine but I was not able to. Only thing I recall was refreshing my fork.

It seems like refreshing the branch on my fork was not a good idea, it pulled all changes from master, while there are no conflicts not sure if that would be a good idea.
So I am thinking to start over and create a new branch to make the changes (and remember to not make any refresh of the branch with master), does that sound like a better plan? I just don't want to cause any issues with that might be some mistakes from my limited experience with git.

It seems like refreshing the branch on my fork was not a good idea, it pulled all changes from master, while there are no conflicts not sure if that would be a good idea.

What do you mean by "refreshing"? Just pulling your fix-bruno-tabs branch shouldn't create extra merge commits.

So I am thinking to start over and create a new branch to make the changes (and remember to not make any refresh of the branch with master), does that sound like a better plan? I just don't want to cause any issues with that might be some mistakes from my limited experience with git.

Yes, creating a new branch, recreating the changes and opening a new PR can work. Make sure to create the branch from master (or nixos-unstable to avoid potential mass rebuilds).
I think git checkout fix-bruno-tabs and git reset --hard d6c9297e46493e307005ff313c63528994c32cdf would fix your issue, but as a novice git user I'd go with starting from scratch too.

The following process should be applicable as far as all the git stuff goes:
When trying to bring in latest changes:
git rebase upstream/master This assumes that upstream is the remote name for the nixpkgs repo owned by the NixOS org. You can check this by running git remote -v. It should print out something similar to mine:
origin	git@github.com:kashw2/nixpkgs.git (fetch)
origin	git@github.com:kashw2/nixpkgs.git (push)
upstream	git@github.com:NixOS/nixpkgs.git (fetch)
upstream	git@github.com:NixOS/nixpkgs.git (push)

Following that you should be able to perform a force push to the current branch via git push origin $(git branch --show-current) --force.
This also assumes your local remote is called origin.
To fix the current merge commits in this PR. You can use an interactive rebase by running git rebase -i HEAD~4. This will provide you an interface with the commits in the branch.
You can either drop the commits by specifying drop instead of pick at the start of each commit, or you can squash them into the first commit (which would bring this PR up to date) making sure to remove the extra body of the commit when you do so it reads only: bruno: fix css with patch file

Tried rebase but it seems I messed up, so will start from new branch instead. But will do in a couple of hours


Request and use a shoot/adminkubeconfig, if possible

How to categorize this PR?

/area testing
/kind test
What this PR does / why we need it:
In case a gardener project namespace, shoot name and gardener kubeconfig are specified to the invocation of integration-tests/e2e, a shoot/adminkubeconfig will be requested. The reply will be stored unter "/tmp/shoot.config" and all environment variables are changed accordingly. The kubeconfig will expire after 24h hours. All conformance tests running longer would be considered a failure anyways.
Otherwise the existing contract prevails where a valid kubeconfig is supplied by the invoking entity.
Which issue(s) this PR fixes:
Fixes #435
Special notes for your reviewer:
/invite @dguendisch
cc @ialidzhikov
Release note:

Allow conformance testframework to request a short-lived shoot/adminkubeconfig

Okay, I now see that this change is rather related to the topic for which I already contacted you for advice in the beginning of January - the first item from the follow-up items in https://github.com/gardener/gardener/issues/6773. I was also planning these days to look again into it.
From the details I have so far I think we have 2 options:

Adapt the Shoot creation test in https://github.com/gardener/gardener/blob/7c63e2a6c5d46f9f1cb676602f864275ab8cab40/test/framework/shootcreationframework.go#L423-L425 to do not save the static token kubeconfig but to save a kubeconfig obtained from shoot/adminkubeconfig under $TM_KUBECONFIG_PATH/shoot.config.
Adapt usages of $TM_KUBECONFIG_PATH/shoot.config to do not rely on this downloaded kubeconfig but to request their own - as done in this PR. With this approach we no longer need $TM_KUBECONFIG_PATH/shoot.config as every test will be requesting its own kubeconfig.

I was thinking to tackle the problem by using 1. I guess if there are other usages of $TM_KUBECONFIG_PATH/shoot.config they also have implement a similar logic. WDYT about using option 1.?

The required adaptation (ref https://github.com/ialidzhikov/gardener/commit/f696498782467d2bba5361e60f4251e4dfa915df) if we prefer to proceed with option 1.
I don't know why in my initial email from January I suggested option 2. as the only possible option and overlook option 1. I am sorry again for this!
Although, I am also happy to hear your opinion on which option/approach you prefer.

Option 1 sounds reasonable to me especially as it would keep the "contract" of a shoot kubeconfig being available. I'm not aware of any tests with a runtime of +24h and they are still free to implement their own logic. Thanks for bringing up the topic!
To avoid some duplicate code in different repos, I would just close this PR.

I don't know why in my initial email from January I suggested option 2. as the only possible option and overlook option 1. I am sorry again for this!
Although, I am also happy to hear your opinion on which option/approach you prefer.

Absolutely nothing worry about :) I didn't think of it initially as well.
Also, I refreshed my knowledge on clients for this PR but otherwise didn't spend too much time on it.

Thank you @hendrikKahl for your help!
I created https://github.com/gardener/gardener/pull/7495, I will give it a test spin tomorrow morning and then promote to ready.


v113 HWInfo could not initialize.

I have opened HWInfo and it works fine in v112. But in v113 and new version of this plugin , i get this log.
2022/5/10 12:05:57: System.Exception: HWInfo is not running or reporting to gadget is not enabled.    在 FanControl.HWInfo.HWInfoPlugin.Initialize() 位置 C:\projects\fancontrol-hwinfo\HWInfoPlugin.cs:行号 16    在 FanControl.Domain.BackendProviders.Plugin.PluginBackendProvider.Open() 2022/5/10 12:05:57: HWInfo could not initialize.

Same here ....
10.05.2022 08:54:36: System.Exception: HWInfo is not running or reporting to gadget is not enabled.    bei FanControl.HWInfo.HWInfoPlugin.Initialize() in C:\projects\fancontrol-hwinfo\HWInfoPlugin.cs:Zeile 16.    bei FanControl.Domain.BackendProviders.Plugin.PluginBackendProvider.Open() 10.05.2022 08:54:36: HWInfo could not initialize.

Did you read the new README? It doesn't use the shared memory feature anymore.

Sorry I was too careless


Upgrade to camel-3.19.0

Switch from camel-3.19.0-SNAPSHOT to camel-3.19.0

@zbendhiba Yes this is the PR. I changed to title to make it clear.

@jamesnetherton

antora.yml is temporarily reverted to Camel 3.18.x to not break website.

I switched from draft to ready for merge

I think that this PR could be merged and once the doc for 3.19 is available we can update antora.yml

Workaround for the example project failure is here https://github.com/apache/camel-quarkus-examples/pull/114.


httpx: 1.0.4 -> 1.0.5

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://github.com/projectdiscovery/httpx/releases.
meta.description for httpx is: "Fast and multi-purpose HTTP toolkit"
meta.homepage for httpx is: "https://github.com/projectdiscovery/httpx"
meta.changelog for httpx is: ""
Updates performed

Golang update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS

The tests defined in passthru.tests, if any, passed

/nix/store/48zckdcj4kbjxmnck6pnk6y4p22nxidz-httpx-1.0.5/bin/httpx passed the binary check.

1 of 1 passed binary check by having a zero exit code.

1 of 1 passed binary check by having the new version present in output.

found 1.0.5 with grep in /nix/store/48zckdcj4kbjxmnck6pnk6y4p22nxidz-httpx-1.0.5

found 1.0.5 in filename of file in /nix/store/48zckdcj4kbjxmnck6pnk6y4p22nxidz-httpx-1.0.5

directory tree listing: https://gist.github.com/cea4072c53098d62bed7fee749513697

du listing: https://gist.github.com/a1f8699c2455d6e829eebb615b80ff46

Rebuild report (if merged into master) (click to expand)

4 total rebuild path(s)

1 package rebuild(s)

1 x86_64-linux rebuild(s)
1 i686-linux rebuild(s)
1 x86_64-darwin rebuild(s)
1 aarch64-linux rebuild(s)

First fifty rebuilds by attrpath
httpx

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/48zckdcj4kbjxmnck6pnk6y4p22nxidz-httpx-1.0.5 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A httpx https://github.com/r-ryantm/nixpkgs/archive/c920f18e00e255e5c725eef03b7f5b53c805f0b8.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/48zckdcj4kbjxmnck6pnk6y4p22nxidz-httpx-1.0.5
ls -la /nix/store/48zckdcj4kbjxmnck6pnk6y4p22nxidz-httpx-1.0.5/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

httpx

Maintainer pings
cc @fabaff @kalbasit for testing.

Result of nixpkgs-review pr 119499 run on x86_64-linux 1

1 package built:

httpx


Fixes the character sequence for ℕ in Emacs

The character sequence for obtaining the symbol for the set of natural numbers in Emacs is incorrect. The chapter on natural numbers says it is \bN when in fact it is \bn. The Verified Functional Programming in Agda book also says it is \bn.

It's \bN, see:
https://github.com/agda/agda/blob/master/src/data/emacs-mode/agda-input.el#L488
It was changed a while back, to allow for more consistent names for blackboard bold letters, e.g. using \bn for 𝕟.


Feature Request - usage of Modin with GPU acceleration

I am working in Kaggle environment and I encountered an interesting problem:
Right now, if you use GPU (P100) and run this code:
%pip install "modin[all]" -q

%pip install scikit-learn-intelex -q

import modin.pandas as mpd
import os
os.environ['MODIN_ENGINE']='Dask'
df=mpd.read_pickle('/input/dataframe.pkl')

y = df['target']

df.drop('target', axis = 1, inplace=True)
X=df

from sklearnex import patch_sklearn,config_context
patch_sklearn()

from sklearn.ensemble import RandomForestClassifier

with config_context(target_offload="gpu:0"):
    rf = RandomForestClassifier(n_jobs=-1, random_state=42)
    rf.fit(X.values, y.values)

I see there is no utilization of GPU. Maybe I am doing something wrong, but I did everything according to documentation.
Expected behavior
Usage of GPU for computations
Environment:

OS: PRETTY_NAME="Ubuntu 22.04.3 LTS"
VERSION_ID="22.04"
VERSION="22.04.3 LTS (Jammy Jellyfish)"
Compiler: ii  cuda-compiler-11-8                        11.8.0-1                                amd64        CUDA compiler
ii  g++                                       4:11.2.0-1ubuntu1                       amd64        GNU C++ compiler
ii  g++-11                                    11.4.0-1ubuntu1~22.04                   amd64        GNU C++ compiler
ii  gcc                                       4:11.2.0-1ubuntu1                       amd64        GNU C compiler
ii  gcc-11                                    11.4.0-1ubuntu1~22.04                   amd64        GNU C compiler
ii  gcc-12                                    12.3.0-1ubuntu1~22.04                   amd64        GNU C compiler
ii  libllvm15:amd64                           1:15.0.7-0ubuntu<IP_ADDRESS>               amd64        Modular compiler and toolchain technologies, runtime library
ii  libprotoc23:amd64                         3.12.4-1ubuntu<IP_ADDRESS>                 amd64        protocol buffers compiler library
ii  libxkbcommon0:amd64                       1.4.0-1                                 amd64        library interface to the XKB compiler - shared library
ii  protobuf-compiler                         3.12.4-1ubuntu<IP_ADDRESS>                 amd64        compiler for protocol buffer definition files
ii  rpcsvc-proto                              1.4.2-0ubuntu6                          amd64        RPC protocol compiler and definitions
Version: Python 3.10.12

@Master-sniffer  - scikit-learn-intelex doesn't support Nvidia GPUs, so this is not expected to work.
Also i guess in this case you just running stock scikit on GPU, for actual GPU offload to intel you have to import from sklearnex


dosen't implement 'accept' method

https://github.com/mkobuolys/flutter-design-patterns/blob/04514284d1e1a55241e3b3a5bd40533ed5ba6f2f/lib/design_patterns/visitor/file.dart#L7C45-L7C45
Hi , thanks for your amazing and inspiring repo,
I just found that in this File class, you didn't implement the 'accept' method of the iFile interface despite that you have used 'implement' keyword here

It's because the File class is abstract and used only as a base class. Then, specific file types (AudioFile, ImageFile, etc.) are forced to implement the accept method (e.g. https://github.com/mkobuolys/flutter-design-patterns/blob/04514284d1e1a55241e3b3a5bd40533ed5ba6f2f/lib/design_patterns/visitor/files/audio_file.dart).

done


Certificate chain verification fails

Please find the attached certificate chain and could you please check and let us know why certificate verification fails?
CertificateChain.zip

This is part of the CERTIFICATES response? If so

Is the entire SPDM certificate chain formatted as defined in the specification? With Length, RootHash, and Certificates fields?
Is the Certificates field ASN.1 DER-encoded?

Yes

Refer to the libspdm_x509_common_certificate_check API, please check where the failure occurred. Then we can tell you the possible reasons.
In addition, how do you enroll the cert? Is the Cert form the unit_test/sample_key? Or is the Cert generated by yourself?

In the root certificate I see

Validity
Not Before: Bad time value
Not After : Bad time value

So that would be flagged as a validation error. Also the Issuer and Subject are NULL.

Also the serial number of any of the certificates cannot be 0.

The serial number MUST be a positive integer assigned by the CA to each certificate.

But it fails while validating intermediate certificate. I see no problem in intermediate certificate. Do you see any problem in that?

Refer to the libspdm_x509_common_certificate_check API, please check where the failure occurred. Then we can tell you the possible reasons. In addition, how do you enroll the cert? Is the Cert form the unit_test/sample_key? Or is the Cert generated by yourself?

Yes, we generated the certificate using mbedtls library.

@PrakashK94 you can verify a certificate chain using OpenSSL's openssl verify command. Once that is clean, if there are still failures, then we can look at them more closely.

Yes, we are able to verify it using openssl command.

I have attached the script which verifies all three certificates present in the attached certificate chain using openssl command.
Please find the logs below,
ranjithkumara@BFGIND-9848 MINGW64 /e/DICE/Certificate_chain/RootCert/Certificates/SPDM_received_certificate/6-2-24
$ ./cverify.sh
v--------------------------------------------------------v
certificate: root.pem
verify using openssl:
note: if this fails it could be due to an incompatibility
between openssl and the device certificates
root.pem: OK
verify using pubkey, signature, and unsigned data:
Verified OK
^--------------------------------------------------------^
v--------------------------------------------------------v
certificate: inter.pem
verify using openssl:
note: if this fails it could be due to an incompatibility
between openssl and the device certificates
error inter.pem: verification failed
C = TW, O = AST, CN = Aspeed Tech
error 18 at 0 depth lookup: self signed certificate
verify using pubkey, signature, and unsigned data:
Verified OK
^--------------------------------------------------------^
v--------------------------------------------------------v
certificate: leaf.pem
verify using openssl:
note: if this fails it could be due to an incompatibility
between openssl and the device certificates
error leaf.pem: verification failed
C = IN, O = AMI, CN = American Megatrends
error 18 at 0 depth lookup: self signed certificate
verify using pubkey, signature, and unsigned data:
Verified OK
^--------------------------------------------------------^
Verify.zip

which verifies all three certificates

It's obviously not successful.

error 18 at 0 depth lookup: self signed certificate

Does intermediate certificate should have,

CA equals to FALSE?
Subject Name and Issuer Name should not match?

No.
Yes. And it is even stronger than that. The Issuer Name should match the Subject Name of the root certificate.

Are you saying that CA can be true/false as well as for intermediate certificate?

Are you saying that CA can be true or false for intermediate certificate?

CA should be TRUE. From 5280:

If certificate i is a version 3 certificate, verify that the basicConstraints extension is present and that cA is set to TRUE.


[ISSUE #1069]Add Shutdown struct

Which Issue(s) This PR Fixes(Closes)

Fixes #1069
Brief Description

How Did You Test This Change?

Summary by CodeRabbit

New Features

Introduced a new Shutdown module for managing shutdown signals in an asynchronous context.
Added methods to check shutdown status and wait for shutdown signals.

Tests

Implemented asynchronous tests to verify the functionality of the Shutdown struct.

🚀Thanks for your contribution🎉. CodeRabbit(AI) will review your code first🔥


Attachments leftovers (related to Chat Issue #224)

Related

Issue #224: Attachments leftovers (need core api changes)

Description
We need APIs to do next things:

rename files
move files to another folder
rename folders
move folder
remove folder
Bulk remove (currently it's done by calling remove one file in parallel)
Bulk download (not sure we need this)
Search for folders and files

@IlyaBondar states the issue is still valid. reopen it.


FR: Indirect jmps as calls

Summary
In a sample within the testfiles repo b87e9dd18a5533a09d3e48a7a1efbcf6 at offset 0x140007461 a jmp is issued rather than a call.  Causing the API not to be recognized by the feature extractor.
The function in Ghidra:

The small snippet of features extracted from that address
insn: 0x140007461: bytes(80 30 02 00 00 00 00 00 94 30 02 00 00 00 00 00 B0 30 02 00 00 00 00 00 CA 30 02 00 00 00 00 00 E0 30 02 00 00 00 00 00 F6 30 02 00 00 00 00 00 10 31 02 00 00 00 00 00 26 31 02 00 00 00 00 00 3A 31 02 00 00 00 00 00 4C 31 02 00 00 00 00 00 60 31 02 00 00 00 00 00 6E 31 02 00 00 00 00 00 80 31 02 00 00 00 00 00 A8 31 02 00 00 00 00 00 B4 31 02 00 00 00 00 00 C2 31 02 00 00 00 00 00 D0 31 02 00 00 00 00 00 DA 31 02 00 00 00 00 00 EC 31 02 00 00 00 00 00 04 32 02 00 00 00 00 00 1C 32 02 00 00 00 00 00 34 32 02 00 00 00 00 00 42 32 02 00 00 00 00 00 58 32 02 00 00 00 00 00 68 32 02 00 00 00 00 00 74 32 02 00 00 00 00 00 8A 32 02 00 00 00 00 00 A0 32 02 00 00 00 00 00 B6 32 02 00 00 00 00 00 C0 32 02 00 00 00 00 00 D0 32 02 00 00 00 00 00 DE 32 02 00 00 00 00 00)
insn: 0x140007461: mnemonic(jmp)
insn: 0x140007461: characteristic(cross section flow)

Motivation
To ensure API are caught by the feature extractor
Describe alternatives you've considered
I haven't consider any additional alternatives.
I'm unsure if patching this issue will lead to unexpected behaviour.
Additional context
I think the expected outcome would be for the API to be recognized and for the JMP instruction to be preserved in the extracted features.

Agreed, we should be able to extract the api feature in such cases.
As a heads up this is part of the __raise_securityfailure library function in the above example.


MiniDom is Dead Slow

When dealing with a lot of files (100+), minidom starts to become the bottleneck in an application really quickly. Parsing 1000 small (>10kb each) takes a bit over 2 minutes (cProfile output edited to show only relevant sections):
 ncalls  tottime  percall  cumtime  percall filename:lineno(function)
   1000    0.035    0.000  129.661    0.130 env/lib/python2.6/site-packages/dexml/__init__.py:281(parse)
   1000    0.006    0.000  124.224    0.124 env/lib/python2.6/site-packages/dexml/__init__.py:527(_make_xml_node)
   1000    0.016    0.000  124.216    0.124 /System/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/xml/dom/minidom.py:1914(parse)
   1000    0.012    0.000  124.200    0.124 /System/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/xml/dom/expatbuilder.py:911(parse)
   1000    0.012    0.000  123.583    0.124 /System/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/xml/dom/expatbuilder.py:197(parseFile)
   2470    1.172    0.000  123.507    0.050 {built-in method Parse}
 256003    0.137    0.000  120.444    0.000 /private/var/tmp/python/python-56~121/2.6/python/Modules/pyexpat.c:604(StartElement)
 256003   42.367    0.000  120.303    0.000 /System/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/xml/dom/expatbuilder.py:743(start_element_handler)
1249305   68.778    0.000   68.971    0.000 /System/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/xml/dom/minidom.py:349(__init__)
 256003    8.334    0.000    8.334    0.000 /System/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/xml/dom/minidom.py:652(__init__)

Unfortunately, I couldn't find a good drop-in replacement for minidom. PyXML is deprecated and broken, and libxml2dom and qtxmldom aren't very friendly to install (I'm working on OS X right now).
The main functional alternatives are either SAX or ElementTree based. I've never used SAX, and ElementTree seems to have a lot more community support.
Would you be open to replacing minidom with ElementTree?

Thanks for reaching out. Unfortunately I am no longer actively maintaining this project, so I'm going to move it into archive mode:
https://rfk.id.au/blog/entry/archiving-open-source-projects/


Error when running from home folder

I invoked warriorjs from ~ on OSX Yosemite and it complained because I already had a .profile file.
Welcome to WarriorJS

/opt/some/folder/node_modules/warriorjs/lib/Profile.js:316
        throw new Error('Invalid .profile file. Try changing the directory und
              ^
Error: Invalid .profile file. Try changing the directory under you are running warriorjs.
    at Function.decode (/opt/some/folder/v0.10.38/lib/node_modules/warriorjs/lib/Profile.js:316:15)
    at Function.load (/opt/some/folder/nvm/v0.10.38/lib/node_modules/warriorjs/lib/Profile.js:322:57)
    at Game.start (...Game.js:56:46)
    at Runner.run (...Runner.js:42:18)
    at Object.<anonymous> (...warriorjs:6:8)
    at Module._compile (module.js:456:26)
    at Object.Module._extensions..js (module.js:474:10)
    at Module.load (module.js:356:32)
    at Function.Module._load (module.js:312:12)
    at Function.Module.runMain (module.js:497:10)

Dublicate of #3 .
Also look at the error message "Try changing the directory under you are running warriorjs."
Says all, doesn't it :smile:

Will take the missing "which" into account. Thanks!


Please help me for nginx custom log format issue with goacccess

Please find my log output for nginx (access.log)
<IP_ADDRESS> - - [31/Mar/2016:03:10:51 +0530] "GET /api/check_delivery.php?authkey=9450AW2qTKYe453be757c&requestid=36626f6a3530323439383831 HTTP/1.1" control.msg91.com 404 39 "-" "-" "-" "control.msg91.com" "-" to: <IP_ADDRESS>:8080: upstream_response_time 0.003 request_time 0.003

My nginx custom log format :

$remote_addr - $remote_user [$time_local] "$request" $host'
'$status $body_bytes_sent "$http_referer" '
'"$http_user_agent" "$http_x_forwarded_for" "$server_name"';

and my which i am using in goaccess conf file:
time-format %H:%M:%S
date-format %d/%b/%Y
log_format %^[%d:%^] "%r" %s %b "%R" "%u" "%^ %h"

and after running this I am getting below error:
GoAccess - version 0.9.8 - Mar 31 2016 14:11:22
Config file: /usr/local/etc/goaccess.conf

Fatal error has occurred
Error occured at: src/goaccess.c - main - 1017
Nothing valid to process. Verify your date/time/log format.

Please help me out...
thanks in advance

It seems like the sample log does not match the fields you posted from nginx. After $body_bytes_sent there is "$http_referer" and "$http_user_agent", then there are a bunch of other fields within quotes?

i think for your log format this should work;
log_format %h %^ %^ [%d:%t %^] "%r" %v %s %b "%R" "%u" "%^" "%v"
or
log_format %h %^ %^ [%d:%t %^] "%m %r %H" %v %s %b "%R" "%u" "%^" "%v"
however thats not the log file you have posted.
this is in the logs also;
"-" to: <IP_ADDRESS>:8080: upstream_response_time 0.003 request_time 0.003
try this;
log_format %h %^ %^ [%d:%t %^] "%r" %v %s %b "%R" "%u" "%^" "%v" "%^" %^ %^:%^: %^ %^ ^% %L  (maybe this works, i'm not 100% sure given the log line provided)

Thanks a lot "jamitupya" this entry worked for me:
log_format %h %^ %^ [%d:%t %^] "%r" %v %s %b "%R" "%u" "%^" "%v"

Can you please help me with logformat for this:
<IP_ADDRESS> - - [10/Aug/2015:05:51:30 +0000] GET /general/pc/skin HTTP/1.1 "200" 11048 "https://test.test.com/?" "Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident/5.0)" "-"

@lavanyapallapa Try this:
log-format %h %^[%d:%t %^] %m %U %H "%s" %b "%R" "%u" %^
date-format %d/%b/%Y
time-format %T

Thank you so much.
It worked.

<IP_ADDRESS> - - [2017-04-05T00:00:12+08:00] "GET /merger?page=3 HTTP/1.1" 200 49913 "https://www.itjuzi.com/merger?page=3" "Mozilla/5.0 (comp
atible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)" <IP_ADDRESS> 3.020
Any idea about this>? @allinurl

@singleseeker This should work:
log-format %h %^[%dT%t+%^] "%r" %s %b "%R" "%u" %^ %T
date-format %Y-%m-%d
time-format %H:%M:%S

@allinurl can you help with this custom nginx format?
$remote_addr - [$proxy_add_x_forwarded_for] - $remote_user [$time_local] "$request" $status $body_bytes_sent "$http_referer" "$http_user_agent" $request_length $request_time [$proxy_upstream_name] $upstream_addr $upstream_response_length $upstream_response_time $upstream_status

sample:
<IP_ADDRESS> - <IP_ADDRESS> - - [27/Apr/2017:13:24:49 +0000] "GET /system/search?query=5682097-3&_=1493299482749 HTTP/1.1" 200 231 "https://my-site.com/" "Mozilla/5.0 (Windows NT 6.1; Trident/7.0; rv:11.0) like Gecko" 599 0.081 <IP_ADDRESS>:80 231 0.081 200

I already tried distinct format like the next one without success:
log-format %h - [%^] - %^ [%d:T%t+%^] "%m %U %H" %s %b "%R" "%u" %^ %T %^ %^ %^ %^

Thanks in advance!

@aledbf
Please try this:
goaccess log --log-format='%h %^[%d:%t %^] "%r" %s %b "%R" "%u" %^ %T %^' --date-format=%d/%b/%Y --time-format=%T

@allinurl it works. Thanks!

I have the following NGINX custom log format:
log_format main '$remote_addr - $remote_user [$time_local]  '
'"$request" $status $body_bytes_sent '
'"$http_referer" "$http_user_agent" $request_time';
However, I can't get the following syntax to work:
goaccess -f access.log --log-format='%h %^[%d:%t %^] "%r" %s %b "%R" "%u" %T^' --date-format=%d/%b/%Y --time-format=%T
Sample data:
<IP_ADDRESS> - - [29/Jun/2017:00:00:13 -0500]  "GET /channels/usa/photos/2015.jpg HTTP/1.1" 200 15356 "-"
Any thoughts on what I'm doing wrong?


[wolt app bug] ui text lost

Bug report
Describe the bug

Steps to reproduce
Steps to reproduce the behavior:
when as gesture use the wolt app, in the profile page, tap the continue with another service the all button's text is "button"
unrelated question
What's page transition used in restaurants and stores page when tap the list card  to detail page?

Hi!
I am closing this issue because this is not relevant to WoltModalSheet package, and the bug description is not clear.

What's page transition used in restaurants and stores page when tap the list card to detail page?

The WoltApp that customers make order is native app, not Flutter app. In the native app, custom transitions are used.


Won't update The Undermine Journal

Probably due to the reported version:

This addon updates twice a week with fresh market data. The actual curse client doesn't seem to have an issue, so perhaps there's something in the manifest you can check?

Hey!
lcurse won't update anything if the version doesn't change.
But you can enforce an update by removing the version info in the list in lcurse and hit update afterwards.
if you want it automated, create a cronjob which removes the version info from that addon from the addons.json in ~/.lcurse/. This will lead to the result you want.

The reported version is a YYYYMMDD timestamp in the curse client though. Maybe they're using a weird field in their manifest. The cronjob would work, but I'm not going to do that. That's just silly. Do you think I should contact the author(s) and bug them about their reported version?

if they append the YYYYMMDD thing to the version 7.0.3.YYYYMMDD would do. lcurse won't look into the manifest as this would need a download of the addon before and when I start to download each addon before lcurse knows the version ....... No way.

and don't try to compare lcurse with the curse client. the curse client uses the curse REST API to get informations about the addons.
lcurse uses their website and parses the displayed info.

How about an option to force an update in the lcurse interface then?

Clear the version field of the specific addon in lcurse gui and hit Ctrl+U


SOTC footer link needs to be changed

I think this is a carry-over from the main site, but noun project icon links to https://stateof.creativecommons.org/website-icons which is not a page. Where can I edit the footer of SOTC?

@janeatcc That link is in the text widget in the Footer Bottom Right region. So go to Appearance > Widgets and edit that widget.

Thanks!


core: introduce interceptors

Fixes #916
Doc preview:

... further down ...

Do interceptors cascade from services to service objects? I kind of expect that they would because other properties (projectId) do.

Yep, all service object requests go through the parent service. So if you set an interceptor on a service (Storage), all requests made from child service objects (Bucket, File) will have be affected.
Maybe we should support one level up as well? Interceptors on the "require('gcloud')" level, so all Services are affected?

Maybe we should support one level up as well? Interceptors on the "require('gcloud')" level, so all Services are affected?

Yes! I love that

@callmehiphop updated the heck out of this one. There was some rethinking involved. PTAL.


Release Google.Cloud.Bigtable.Admin.V2 version 2.8.0

Changes in this release:
New features

Add ListHotTablets API method and protobufs (commit 56eea19)

Documentation improvements

Update cpu_utilization_percent limit (commit 01b008d)
Remove the limitation of all clusters in a CMEK instance must use the same key (commit 01b008d)

Created release for Google.Cloud.Bigtable.Admin.V2-2.8.0


from_archive now supports radius searches, multiple campaigns and returning data from any cadence type

Here are the major changes.from archive now

can return multiple hits, but by default only returns one
allows radius searching
allows multiple campaigns, quarters and months to be searched with lists
allows multiple cadence types to be searched with cadence='any' (or 'all')
allows a SkyCoord to be passed as the target
has a verbose argument to silence the output

The behavior is the same for TPFs and LCFs. Here's a demo:
Note this fixes #101 and fixes #102
If you ask for a file with multiple quarters it will warn the user

Otherwise it gives back the file

If you ask for multiple quarters it will give back a list of tpfs

If you do a radius search it will give you the nearest files. You can increase the limit for more files.

You can do both at the same time, a radius search with multiple quarters. The order that they are returned by is by target, then by quarter, then by month.

You can also suppress all that nasty output with the verbose keyword.

I can't reproduce the problem that appveyor is having on my machine... @barentsen do you have any idea why those things are breaking?

I've found a weird MAST portal error with the 'split' campaigns.
If you look for a TPF using the MAST api where the target was observed in a split campaign (e.g. C9-1 and C9-2) there appears to be an error with the first part. The URLs get confused and so they can't download the first one.
This is the best MWE I can come up with

There's an issue with the current implementation of from_archive where it doesn't accept split campaigns........problematic....

This is the way forward!  Thanks @christinahedges!


yarn prisma generate is running on install, even if I'm not using prisma

<EMAIL_ADDRESS>is broken, I cannot install it, it fails with:
👾 install | pnpm i --no-frozen-lockfile
Scope: all 10 workspace projects
 WARN  7 deprecated subdependencies found<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>Packages: +34
++++++++++++++++++++++++++++++++++
Progress: resolved 1455, reused 1425, downloaded 0, added 0, done
node_modules/.pnpm/pothos-plugin-effect@1.0.0_@pothos+core@3.41.0_effect<EMAIL_ADDRESS>Running postinstall script, failed in 283ms
.../node_modules/pothos-plugin-effect postinstall$ yarn prisma generate
│ yarn run v1.22.19
│ error Could not open cafile: EISDIR: illegal operation on a directory, read
│ error Command "prisma" not found.
│ info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.
└─ Failed in 283ms at /Users/victor/Projects/PMS/pms-core/node_modules/.pnpm/pothos-plugin-effect@1.0.0_@pothos+core@3.41.0_effect<EMAIL_ADDRESS> ELIFECYCLE  Command failed with exit code 1.
/Users/victor/Projects/PMS/pms-core/node_modules/.pnpm/projen@0.79.7_constructs@10.3.0/node_modules/projen/src/task-runtime.ts:204
          throw new Error(
                ^

installing prisma as a dependency does not help either
imo postintall script should not be part of this package.

Thank you for report an issue. I just published snapshot version which removed postinstalll script on package.json. Let me know it resolved:
pnpm i<EMAIL_ADDRESS>

works, thanks


0.6.0

Current dependencies on/for this PR:

main

PR #74   👈

This comment was auto-generated by Graphite.


Exclude img in link from fancybox

PR Type
What kind of change does this PR introduce?

[ ] Bugfix.
[x] Feature.
[ ] Code style update (formatting, local variables).
[ ] Refactoring (no functional changes, no api changes).
[ ] Build related changes.
[ ] CI related changes.
[ ] Documentation content changes.
[ ] Other... Please describe:

What is the current behavior?

Click on a img in link won't open link, but show a fancybox.
What is the new behavior?
Click on a img in link just open link as usual.

Screens with this changes: http://recordit.co/pp1DR0EjJw
Link to demo site with this changes: https://blog.maple3142.net/404.html

How to use?
Add image in link.
Does this PR introduce a breaking change?

[ ] Yes.
[x] No.

Please, read #1799 pull before we will or not will merge this.


Add example of embedding a compose component in an existing JS-based React app

https://github.com/JetBrains/compose-jb/tree/master/examples/web-with-react

Please check the following ticket on YouTrack for follow-ups to this issue. GitHub issues will be closed in the coming weeks.


added secret STAT315 id 547

Added the secret STAT ID, Stat ID was 547, but assumed it was supposed to be 047 for the context of the file

Finished reviewing


In the description of the chart on artifact hub it says that:

The itzg/minecraft image stores the saved games and mods under /data.

This confused me because I didn't even know that kubernetes had writable directories inside containers.
How would I go about accessing data to configure mods?

This confused me because I didn't even know that kubernetes had writable directories inside containers.

Yep, any volume can be mounted read/write when it makes sense.
As for how to access the data, it will vary based upon the volume type you use. In general though, you can kubectl exec into the pod's minecraft server container and use the pre-installed nano text editor to make text changes.
Here's some more background on the /data mount point of the minecraft image:
https://github.com/itzg/docker-minecraft-server#data-directory

That interesting, because when I tried to use cp to copy a plug in over to /data/bukkit, I got told that it was a read-only filesystem, even when I later tried wget using exec!

As for how to access the data, it will vary based upon the volume type you use.
You can select a volume type? I was just running this bear on a raspberry pi cluster

I believe the default is emptyDir, which is basically a managed host directory similar to what Docker does by default with volumes.

oh ok


[OPIK-641] create guardrails integration

Details
Added the integration with guardrails.
After tracking the Guard instance, every validator starts producing traces with results to Opik. "pass" and "fail" tags are added to the corresponding traces based on the validation result.
Example:
from guardrails import Guard, OnFailAction
from guardrails.hub import CompetitorCheck, ToxicLanguage

import opik
from opik.integrations.guardrails.guardrails_tracker import track_guardrails

competitor_check = CompetitorCheck(
    ["Apple", "Microsoft", "Google"], on_fail=OnFailAction.NOOP
)
toxic_check = ToxicLanguage(
    threshold=0.5, validation_method="sentence", on_fail=OnFailAction.NOOP
)
guard: Guard = Guard().use_many(competitor_check, toxic_check)
guard = track_guardrails(guard, project_name="guardrails-example")

guard.validate(
    "An apple a day keeps a doctor away. This is good advice for keeping your health."
)  # Both the guardrails pass

Issues
Resolves #
Testing
integration tests are added
Documentation
docstrings are added

@japdubengsub the PR ready for review but the integration test will likely be updated. Current version pulls quite heavy dependencies that take 2.5 minutes to install.


lodash: Problems in types definitions for implicit/explicit chain

Hi, I have a problem with lodash.d.ts.
I get a type error with the following example.
var x: number = _([1,2,3]).max(); // type error: Type 'LoDashWrapper<number>' is not assignable to type 'number'.
var y: number = _.chain([1,2,3]).max().value(); // fine

We can confirm that the both lines work well in a JavaScript console.
> _([1,2,3]).max()
3
> _.chain([1,2,3]).max()
LodashWrapper {__wrapped__: Array[3], __actions__: Array[1], __chain__: true}
> _.chain([1,2,3]).max().value()
3

With the implicit chaining _(array) and the max function, the result value is returned instantly. The same problem occurs for min. Also, the type definition of last function holds the opposite problem.
var x: number = _([1,2,3]).last(); // fine
var y: number = _.chain([1,2,3]).last().value(); // type error: Property 'value' does not exist on type 'number'.

The both lines should be accepted. Could you please fix the type definitions?

@chrootsu ?

The PR with the fix was created

Thank you @chrootsu for changing the type definition for _.max. I intended to point out the problems of the difference between _(array) and _.chain(array); the former creates an array wrapper with implicit chaining and the latter creates a wrapper with explicit chaining. However in most case and in my product as well, implicit chaining is widely used and I've never used _.chain. Distinguishing the both kinds of wrappers in lodash.d.ts will be a tough work while most people would not use explicit chaining so I keep this issue closed. Thanks anyway.

@itchyny, glad I could help. ^_^
Yep, I know about malfunction of _.chain and have a set of commits with the almost complete fix of the issue. I will try to test it and send a PR in the next few days or at the weekend. Thanks for your report.


what happened with microsoft translation api?

no more translations from MSFT appear in the reader

This was re-added as Azure.


Spelling fix

This is just a spelling error I found in the docs.
Also, I just wanted to say that I found this project at QHack, and I think it is great!  :)

Thank you for the kind words and for finding the error! It will get changed with the release of version 0.3.0.


can you provide a best txt. thanks!

No description provided.

Hi @Aurora-CLW ,
I personally use sub7 to sub9 subscription links.


Files not showing up in the mount

Hello everyone,
I have been having a problem for the past few days, where newly added files in the GDrive folder do not show up in the mount.
Viewing GDrive (encrypted with rclone) contains 7 folders, while the local mount only shows 6 folders.
I really haven't edited anything in the settings for the past 3 months, any idea why I'm getting this?
Thanks

+1 same issue

@katsikhs @Loomaanaatii
ever found a solution for this?
regards

How exactly do you combine plexdrive and rclone encryption?

@felixbuenemann I don't have the gdrive encrypted (for now)

I don' want create new ticket but I've got plexdrive 5.1 and similar issue. Some of the folder on my team drive I can see some not. The same with files inside folders. I was confused why and when I try too change file or folder name then I can see file/folder as normal. Looks like older files/folder does not show up?


training for other genomes, e.g. bacteria genome error

Dear bwa-meme team:
when using bacterial genome as reference I have the following error (genome are highly fragmented and are assembled from meagenome):
(base) [jzhao399@login-phoenix-3 Competitive_mapping]$ build_rmis_dna.sh ./all_mags_rename.new.fasta
Training top-level pwl model layer
Training second-level linear model layer (num models = 268435456)
[2nd layer]Computing lower bound stats...
[2nd layer]Fixing empty models...
Computing last level errors...
Average gap: 0.8713072761893272
Total Partial model num: 0, Leaf of partial model num: 0
Total last layer model num: 268435456
Partial start at idx:268435456
Model build time: 103312 ms
Average model error: 1.914389257033157 (0.0000020606146782561575%)
Average model L2 error: 78.10451166276728
Average model log2 error: 1.9188643583795388
Max model log2 error: 7.189824558880018
Max model error on model 79172320: 146 (0.0001571518132585239%)
thread 'main' panicked at 'index out of bounds: the len is 0 but the index is 0', rmi_lib/src/codegen.rs:399:28
note: run with RUST_BACKTRACE=1 environment variable to display a backtrace
Any idea? I installed everything via condo,
Thanks,
Jianshu

Hi, thank you for reporting the error.
I just fixed this issue in the recent commit 3028bc0f3b8f65ad8010c223cd53dc5db65e60e7.
You may be able to run BWA-MEME with the recent commit.
I will update the Bioconda package soon after I fix another issue.
Thank you

Hello,
training was successful but core dumped when mapping:
[jzhao399@atl1-1-02-003-5-r Competitive_mapping]$ bwa-meme mem -7 -t 12 -o all_fasta_meme.sam ./all_mags_rename.new.fasta T4AerOil_R1.fa T4AerOil_R2.fa
Looking to launch executable "/storage/home/hcoda1/4/jzhao399/p-ktk3-0/bin/bwa-meme_mode3.avx512bw", simd = _mode3.avx512bw
Launching executable "/storage/home/hcoda1/4/jzhao399/p-ktk3-0/bin/bwa-meme_mode3.avx512bw"
Executing in AVX512 mode!!

SA compression enabled with xfactor: 8
Ref file: ./all_mags_rename.new.fasta
Entering FMI_search
Reading other elements of the index from files ./all_mags_rename.new.fasta
Index prefix: ./all_mags_rename.new.fasta
Read 0 ALT contigs
Reading reference genome..
Binary seq file = ./all_mags_rename.new.fasta.0123
Reference genome size: 92903796 bp
Done reading reference genome !!

Memory pre-allocation for Chaining: 1703.8604 MB
Memory pre-allocation for BSW: 2875.4043 MB
[M::memoryAllocLearned::MEME] Reading Learned-index models into memory
[Learned-Config] MODE:3 SEARCH_METHOD: 1 MEM_TRADEOFF:1 EXPONENTIAL_SMEMSEARCH: 1 DEBUG_MODE:0 Num 2nd Models:268435456 PWL Bits Used:28
[M::memoryAllocLearned::MEME] Loading RMI model and Pac reference file took 5.331 sec
[M::memoryAllocLearned::MEME] Reading suffix array into memory
[M::memoryAllocLearned::MEME] Loading pos_packed file took 5.675 sec
[M::memoryAllocLearned::MEME] Generating SA, 64-bit Suffix and ISA in memory
[M::memoryAllocLearned::MEME] Runtime-build-index took 1.483 sec
Memory pre-allocation for BWT: 657.5362 MB

Threads used (compute): 12
No. of pipeline threads: 2

[0000] read_chunk: 120000000, work_chunk_size: 120000263, nseq: 1019142
[0000][ M::kt_pipeline] read 1019142 sequences (120000263 bp)...
[0000] Reallocating initial memory allocations!!
[0000] Calling mem_process_seqs.., task: 0
[0000] 1. Calling kt_for - worker_bwt
[0000] read_chunk: 120000000, work_chunk_size: 120000132, nseq: 1044040
Segmentation fault (core dumped)
without -7 option, it was successful and the same with BWA-MEM2. Can you please provide an email so that I share those reads and reference genome with you?
Thanks,
Jianshu

Sure, can you send the files to<EMAIL_ADDRESS>Thank you!

Dear Jianshu,
Can you please send the files to<EMAIL_ADDRESS>I am not sure my university mail system is working correctly.
Thank you

In the recent commit 9751b4bd50c4126db63a8d8886a87a5c8782bc92,  we fixed the error in BWA-MEME which might be related to your case.
We also tested BWA-MEME works without segmentation fault in 4 different bacteria genomes. ( https://www.ebi.ac.uk/ena/browser/view/GCA_000226275, https://www.ebi.ac.uk/ena/browser/view/GCA_000512185, https://www.ebi.ac.uk/ena/browser/view/GCA_000300175, https://www.ebi.ac.uk/ena/browser/view/GCA_000021305)
Please reopen this issue and let us know if you still have the same error.
Thank you


Video conference mute -- Video / GIF display

Description of the new feature / enhancement
Hey, you guys are awesome and the present features are heaven.
but I would like to suggest an enhancement for the VCM image display when the camera is off.
--> In my opinion video / GIF  displayed when the camera is muted, would be awesome.
so that people can place their own video recording / GIF when the camera is mute.
Scenario when this would be used?

In teams/zoom meetings where a person is in a difficult situation and needs to be away from the camera, but also he should
compulsorily attend the meeting live.

many online classes conducted by professors are giving attendance based on persons who kept their camera ON.
students who don't want to attend boring lectures or content that is available online and understandable better online, could use
this feature saves their time and upskills their learning better.

In exams that are video proctored. (IYKYK)

Supporting information
No response

VCM is in maintenance mode. Happy to accept a PR but not a feature we're actively developing anymore. /dup https://github.com/microsoft/PowerToys/issues/21473


[WIP] Add reset css

some more experiments with to reset the global CSS and allow custom widget styles.
the updates seems to break some babel configs.
especially: https://github.com/zouhir/preact-widget-scripts/blob/master/configs/babelrc.js
and ExtractTextPlugin seems deprecated.

for what is: https://github.com/zouhir/preact-widget-scripts/blob/master/configs/babelrc.js ?
seems most presets and plugins are already loaded even without doing babelConfig.presets.push("preact-widget-scripts/babel") ?

closing in favor of #11


Cannot set Owner for newly created filesystems

It is currently not possible to set permissions when creating new datasets. This presents a problem when creating and exporting NFS mounts as by default the permissions are unsuitable.
It would be good to add this functionality in. I can have a go at this myslf when I have some time.

Can you elaborate? Which permissions are you referring to? Do you mean things like owner, group, and mode for the root directory of the newly-created dataset?
What exactly is the problem you're seeing? Do you have a playbook that replicates the problem?

@arensb

When creating zfs datasets I want the ability to set the uid and gid of the owner as well as the access modes. Similar to what is available in storage/pools/permissions (essentially chown user/group; chmod 0644)
When creating NFS shares I want the ability to set the maproot user and maproot group options. Often NFS shares from truenas dont work for me without these options.

The reason I need these is that when creating datasets and nfs shares with default options and mounting them on clients, any attempts to interact with the filesystem result in permission denied errors as the user on the client and on the remote server don't match. I hope that makes sense.

After checking over the code I can see that it may already be possible, in which case it would be a good idea to update the documentation to reflect that.

I want the ability to set the uid and gid of the owner as well as the access modes. Similar to what is available in storage/pools/permissions (essentially chown user/group; chmod 0644)

Why not just use ansible.builtin.file?

I'm not seeing a way to set ownership or permisssions when adding a datset in either the console, the TrueNAS API documentation, or zfs create. This suggests that the ownership and permissions are something set after creation. That is, you can achieve the desired effect with truenas.filesystem followed by file.
Unless there's something to be gained by rolling permissions into truenas.filesystem, I'd prefer not to complicate it this way.

Ah yes you are right, I didnt even consider using ansible.builtin.file for some reason. I think I can achieve the desired behavior using those, thanks. I will close this.


⚠ Mobitopup has degraded performance

In 782efa2, Mobitopup (https://napcard.voz.tech) experienced degraded performance:

HTTP code: 200
Response time: 26390 ms

Resolved: Mobitopup performance has improved in 8822851.


[SPARK-9602] remove "Akka/Actor" words from comments

https://issues.apache.org/jira/browse/SPARK-9602
Although we have hidden Akka behind RPC interface, I found that the Akka/Actor-related comments are still spreading everywhere. To make it consistent, we shall remove "actor"/"akka" words from the comments...

Merged build triggered.

Merged build started.

Test build #39705 has started for   PR 7936 at commit e8296a3.

LGTM

Test build #39705 has finished for   PR 7936 at commit e8296a3.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
  case class BoundPortsResponse(rpcEndpointPort: Int, webUIPort: Int, restPort: Option[Int])

Merged build finished. Test PASSed.

I've merged this. Thanks!

@rxin Thanks!


DBZ-8237 Don't use unbounded number of processing threads in async engine

Backport of PR #5858
Backport Apicurio fix
Adjust GH wrokflow to checkout the same branch as one against PR was made

https://issues.redhat.com/browse/DBZ-8237

@vjuranek Applied, thanks!


Enabling updates to accept empty strings for User's profile for optional fields

Made changes such that gorm can update fields with blank values as well
It was treating them as not-changed before
Fixes(#1771)

@kishansagathiya snapshot fabric8-wit image is available for testing.  docker pull docker.io/fabric8/fabric8-wit:SNAPSHOT-PR-1772-1

@kishansagathiya could you please add tests to show that we can make optional fields like "bio" from populated to not-populated ?

Codecov Report

Merging #1772 into master will increase coverage by 0.05%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master    #1772      +/-   ##
==========================================
+ Coverage   57.28%   57.34%   +0.05%
==========================================
  Files         129      129
  Lines       15254    15254
==========================================
+ Hits         8738     8747       +9
+ Misses       5811     5800      -11
- Partials      705      707       +2

Impacted Files
Coverage Δ

account/identity.go
51.57% <100%> (ø)
:arrow_up:

account/user.go
44.85% <100%> (ø)
:arrow_up:

controller/workitem.go
80.15% <0%> (-0.59%)
:arrow_down:

remoteworkitem/scheduler.go
61.22% <0%> (+14.28%)
:arrow_up:

remoteworkitem/jira.go
100% <0%> (+23.8%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8a65bcb...a7dbfa7. Read the comment docs.

I think we actually can remove most fields from the users table in WIT DB because they are not used by WIT. Like bio, URL, full name, etc.

@kishansagathiya snapshot fabric8-wit image is available for testing.  docker pull docker.io/fabric8/fabric8-wit:SNAPSHOT-PR-1772-2


[HW] Kumari Anushka

Name: Kumari Anushka
Email<EMAIL_ADDRESS>Linkedin Profile: https://www.linkedin.com/in/kumari-anushka-1410/
Attach the homework step I screenshots below:

Attach the homework step II screenshots below:

Hey Kumari Anushka, great job! Congrats! Here is your badge! https://api.badgr.io/public/assertions/c1iqvQnnS3ezvkY6xm9YbA


Overflow issue on selected date!

Please check the size of the selected day widget, refer the screenshot

Hi @Puspharaj. This issue this issue was resolved in version 1.1.1. Is this your version bug?

I'm on 1.1.2 and am facing the same issue

Please check the size of the selected date widget @ikicodedev, it's getting overflowed at bottom by 1.0 pixel. Even I am using the latest version of the package 1.1.2 as @thilojaeggi said.

Hi, I'm on 1.1.2 and I have same issue

i have this problem on the tablet. it is possible set the height of the component?

is there any update regarding this issue?

duplicate of #21

are there any solutions

Hi,
check this one please: https://github.com/ikicodedev/calendar_timeline/pull/65
Also, you can use my fork and add it into pubspec.yaml
calendar_timeline:
git:
url: https://github.com/ViktorKirjanov/calendar_timeline
ref: master # branch


BUG: LiteDatabase connection string filename can't contain multiple "." characters

Trying to create a LiteDatabase instance with the filename "hello.world.ldb" fails with the following error when try to add data:
Message: LiteDB.LiteException : Invalid format: Collection
However, naming it "hello-world.ldb" works OK.
Period "." is a valid filename character. This should work.

Damn! A name containing "~" fails also.
This is killing me! I need a separator character in my filenames and everything seems to fail.
The following are invalid under Windows, but other characters should be allowed:
< (less than)

(greater than)
: (colon - sometimes works, but is actually NTFS Alternate Data Streams)
" (double quote)
/ (forward slash)
\ (backslash)
| (vertical bar or pipe)
? (question mark)

(asterisk)
All control codes (<= 31)

Question - does LiteDB allow Unicode filenames?

Hi! With the objective of organizing our issues, we are closing old unsolved issues. Please check the latest version of LiteDB and open a new issue if your problem/question/suggestion still applies. Thanks!


Update create version to latest

Updated version to 3.6 (the latest HDI version)
Updated R Server portion to properly link RStudio once the cluster is deployed
Updated R Server portion to include necessary Spark config

#sign-off


physic: Bring forward Frequency inline with Electrical Resistance style improvements.

Brings style improvements from #324
Minor wording changes in tests.
Changes non exported error name  errerrUnderflowsInt64 to errOverflowsInt64Negative
change dtoi's mag= -1*mag to mag= -mag and n= -1*n to n= -n as mentioned in a comment.

Codecov Report

Merging #329 into master will increase coverage by 0.01%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master     #329      +/-   ##
==========================================
+ Coverage   70.05%   70.06%   +0.01%
==========================================
  Files         100      100
  Lines        8839     8837       -2
==========================================
  Hits         6192     6192
+ Misses       2491     2489       -2
  Partials      156      156

Impacted Files
Coverage Δ

conn/physic/units.go
100% <100%> (ø)
:arrow_up:

devices/lepton/lepton.go
88.41% <0%> (+1.21%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f5f1f47...10a5be1. Read the comment docs.


Add SushiSwap

Hi Matthew, thanks for your contribution. :)
The SushiSwap integration needs some more work on the backend. We are on it and will merge your PR as soon as we prepared everything.

Hi Matthew, thanks for your contribution. :)
The SushiSwap integration needs some more work on the backend. We are on it and will merge your PR as soon as we prepared everything.


bugfix patch operation in quic

Signed-off-by: Shelley-BaoYue<EMAIL_ADDRESS>
What type of PR is this?

What this PR does / why we need it:
Which issue(s) this PR fixes:

Fixes #
Special notes for your reviewer:
Does this PR introduce a user-facing change?:

Codecov Report
Base: 45.39% // Head: 45.39% // No change to project coverage :thumbsup:

Coverage data is based on head (62f4dae) compared to base (f38e2b6).
Patch has no changes to coverable lines.

Additional details and impacted files
@@           Coverage Diff           @@
##           master      #66   +/-   ##
=======================================
  Coverage   45.39%   45.39%
=======================================
  Files          81       81
  Lines        9573     9573
=======================================
  Hits         4346     4346
  Misses       5033     5033
  Partials      194      194

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


[BUG]: CSM Replication - secret file requirement for both sites not documented

Bug Description
I may be missing something here but while creating secrets for replication use its required to
have details of both clusters in secret file on both the sides (siteA and SiteB)  this is not mentioned anywhere, having hard time in finding which page unless someone from engineering helps on this.
This applies to both CSM Operator and Helm
https://dell.github.io/csm-docs/docs/deployment/csmoperator/drivers/powerflex/
Logs
N/A
Screenshots
No response
Additional Environment Information
No response
Steps to Reproduce
N/A
Expected Behavior
Documentation should outlines requirement for secret to contain details about both clusters in replication pair.
CSM Driver(s)
CSM 1.8
Installation Type
CSM Operator and Helm
Container Storage Modules Enabled
Replication
Container Orchestrator
N/A
Operating System
N/A

We have captured this requirement at a replication doc section here. Will that help?

link: 18350


IMPROVE - Fix Label with Large Dynamic Type on AddMaintenanceView

Describe the feature you want to improve

When the dynamic type size of the AddMaintenanceView is at the largest size the date label is cut off by the date picker
When it's at this size change the label to be above the date picker (so that it isn't cut off anymore, see screenshot)

Describe alternatives you've considered

Another alternative is to limit the dynamic type size to the largest that it can go without clipping, see this article

I would prefer changing the layout before limiting the dynamic type size

Hi @mikaelacaron
I'd like to work on this one.

@abhinaypratap I'll assign it to you! (you are the first to comment), @BuiHuyTam if you could find another issue to work on, that would be great! thanks!


[DropdownMenu] Sub menu keep always open when click outside the browser viewport

Bug report
Current Behavior
Using the DropdownMenu, with sub menus, they keep open when I click on developer tools.

Expected behavior
I expected to close when I click outside by default and doesn't matter where.
Reproducible example
CodeSandbox Template
Your environment

Software
Name(s)
Version

Radix Package(s)
@radix-ui/react-dropdown-menu
2.0.5

React
n/a
18.2.0

Browser
Arc
0.111.0

Node
n/a
v16.18.1

npm/yarn
yarn
1.22.10

Operating System
macOS Ventura
13.4.1

Thank you for the report. The issue is already being tracked in #1441
Duplicate of #1441


feature(middleware/routerchecker): avoid sending dirty data to opentelemetry system and logic servers.

@CodeMonkeyLeet please review this pr

@1046102779 Can you submit a proposal issue for this PR that describes the behavior you want for the middleware checker? I'm not sure I understand the problem you're trying to solve based on the screenshots, or why the PR contains changes for both the pulsar pubsub component and a new route checker middleware.

When a bad request for NORTH-SOURTH-TRAFFIC enters a dapr cluster, it won't be intercepted and it will be sended to   opentelemetry system and logic server.
the PR supported custom router rule to intercept invalid requests, and it won't  send dirty data  to opentelemetry system and logic server.

Can I consider it as a route filter? If so, it may implement more than metrics. We need more discussion about it.
/cc @yaron2 @artursouza

@1046102779 can you please fix the failing build?

@artursouza please merge the pr. thks

I need a docs issue for this before merging.

I need a docs issue for this before merging.

issue: https://github.com/dapr/docs/issues/1894

@artursouza +1

Need an issue to track enablement in dapr runtime.

Adding automerge and tagging for 1.6


WIP: Fix triggers

We implements new postNewTrigger and patchTrigger with #119. So this PR is closed.


nsc-events-nestjs_Sprint-5_Restrict-Access-to-User-Routes_34

Since all routes can be guarded from a top level authGuard I added the imports and then the authguard on line 20, since we also already have a jwt.strategy written I just used that for the auth. All of this trickles down to all of the below user routes. Proceeded to deleted un-needed authguards.
EDIT, added tests for these routes.
Closes #34
Here are tests,

use the signup route and use the token retrieved to login to the next routes.

Attempt to create a user without auth.

Create a user with auth.

Attempt to update a user without auth.

Attempt to update a user with auth token.

Attempt to delete a user without Auth.

Attempt to delete a user with auth.

Hi Jeremy, the code looks good but CI/CD is failing because the test is not implemented. Please uncomment and update the test. Review the activity controller test if needed.

I have uploaded a Jest mock test which should hopefully fix this issue.

@theGaryLarson looks like there was an update to this PR. Are the changes requested now satisfied?

This looks great, and thank you for providing some pictures! I'm able to create/update/delete an account using the proper endpoints. This is minor and can be added later but I'd recommend providing a message for the update and delete endpoints (primarily for the admin/creator)

Yeah I didn't know what best practice was in this case to I just left it with the response 200 code.

Looks like some checks still aren't going through with the CI/CD. I just re-ran the tests in case something got hung up (it happens sometimes) but that wasn't the case. Maybe troubleshooting this with @theGaryLarson tonight would be a good idea.

Reopened and fixed the checks. Just need to confirm that @theGaryLarson is satisfied per the pending change request.


gen_nccl_ops.nccl_all_reduce will influence optimizer!!!

My version is tf 1.13, I use multi-GPUs to  train a model, when i minimize the loss in 0-gpu, 1-gpu's is not minimized, there is someting strange.
so this is my code

then when i run the code , it will keep stopping at a point. After debuging, i find that when  i use nccl_all_reduce in syncBN, this will appear, like this

when i comment the two line, everything is ok.
By th way, i minimize all losses in all gpus using compute_gradient and apply_gradient, when using nccl_reduce_all,  the model could't converge, after commentting it everything  is ok.
I think it's a bug.

@zihao-lu,
Can you please paste the complete code (rather than sharing the screenshot) so that it would be easy for us to reproduce your issue. Thanks!

@zihao-lu,
Can you please respond to the comment. Thanks!

Automatically closing due to lack of recent activity. Please update the issue when new information becomes available, and we will reopen the issue. Thanks!


Provide perfetto UI as a customizable component

We had been planning on using catapult trace viewer as a component in a trace event viewing web app. As it’s getting long in the tooth, we’re now evaluating perfetto.
We have our own input files that need to be preprocessed, and/or fetched from a specific server, so we can’t just use the standalone app. It would be great if we could host perfetto as a component, and possibly customize some of its behavior.

Can you clarify which features you want to control as an embedder?
We have already a mode where you can communicate with the ui via windo.open() + postMessage.
RIght now the postMessage has only one API which is "please load this trace".
We could consider extending that postMessage API, but I'd like to understand how.
We can't make the all the internals of the UI a public API, that's unmaintainable

Two things:
We need to be able to navigate to a page from a url that contains a moniker of our own, then fetch a file from our own server. That could maybe be done in the way you're describing, if you can pass a url to open.
The other scenario is that we load local collections of logs that need to be normalized/merged into a single trace event file. That one is harder to accommodate, as we need to run our own normalization/merging code. We could do that in batch as a separate step, but we wanted to use the same tool for both scenarios.
Totally get the surface area maintainability issue. But maybe a semi-opaque component that can be hosted in a page and handed a trace file?

We need to be able to navigate to a page from a url that contains a moniker of our own, then fetch a file from our own server. That could maybe be done in the way you're describing, if you can pass a url to open.

That one you could do today already, we do the same in our dashboards. You just fetch() the file and pass the blob via postMessage (it's super undocumented, but here's an example: https://jsfiddle.net/g7oktr0q/5/)

The other scenario is that we load local collections of logs that need to be normalized/merged into a single trace event file. That one is harder to accommodate, as we need to run our own normalization/merging code. We could do that in batch as a separate step, but we wanted to use the same tool for both scenarios.

This really depends on the full details. Merging N traces is in principle just a cat (traces are protobuf and are designed to be cat-ed together). However devil hides into details:

Will you have colliding TIDs/PIDs?
How about timestamps?

But maybe a semi-opaque component that can be hosted in a page and handed a trace file?

That works already (% doc): window.open() +postMessage is the way to go.
We are having a discussion on whether we should allow doing the same in an .
Don't have a final answer there, the security model of iframes is a more subtle.

This really depends on the full details. Merging N traces is in principle just a cat (traces are protobuf and are designed to be cat-ed together). However devil hides into details:

In our case (a custom scenario), it isn't just merging, it's normalizing - we're ingesting text log files in various formats that we convert to trace event JSON format. The timestamps are in the same time space, PIDs/TIDs we map using trace event meta events.

We are having a discussion on whether we should allow doing the same in an .
Don't have a final answer there, the security model of iframes is a more subtle.

That might work if there were a way to transfer the JSON across the iframe boundary. Haven't looked at iframes in years, maaybe that would work?

That might work if there were a way to transfer the JSON across the iframe boundary. Haven't looked at iframes in years, maaybe that would work?

in the same ways it works for window.open, via postMessage.
the caveat is that we might add X-Frame-Options: DENY at some point in the future because of the security implications of having an iframe.
I can't speculate too much right know, there are options but we didn't take any decision yet (it boils down on whether the UI will have some oauth tokens for gdrive integration and the like)

Sorry to resurrect an old issue but I'm trying to do something similar for WebPageTest as well and move the embedded trace viewer away from the vulcanized legacy viewer and to perfetto.
I can set the CORS header since I own the server that the traces are on but it looks like the CSP on ui.perfetto.dev blocks connecting to other hosts.
I can go down the window.open() embedding path and postmessage the trace files over but the main drawback with that is there is no way to share a permalink to a trace result (and it looks like iframe embedding is blocked so that won't work either).
If possible I'd rather not have to maintain a separate install of the UI on my domain and keep it up to date. Is there any way to loosen up the CSP to allow cross-domain connections or is there another way you can think of to get a permalink to work?

I can set the CORS header since I own the server that the traces are on but it looks like the CSP on ui.perfetto.dev blocks connecting to other hosts.

yes IIRC the url= arg supports only fetch from GCS because of CSP.  Out of curiosity, were are you contents coming from? Extending CSP is technically possible, although it's not a scalable solution.

can go down the window.open() embedding path and postmessage the trace files over but the main drawback with that is there is no way to share a permalink to a trace result (and it looks like iframe embedding is blocked so that won't work either).

Here's my thought: instead of completely denying the permalink from window.open traces, we could echo back the URL that the opener passes (via window.open, see below). That URL should point to a non-perfetto URL that would essentially guarantee to re-do the same window.open.
Recently extended the post_message_handler.ts to accept a .url argument (below)
Example:
 perfettoWindow.postMessage(perfetto: {title: 'Trace name', url: 'https://my-server.com/page_that_will_do_the_postmessage', buffer: arrayBuffer});

So the change required here would be: when a trace is pushed via window.open(), instead of completely disabling re-share, turn the "permalink" feature into something that echos back the original URL. The UI state won't be serialized (it's fixable but requires more work, and we are re-architecting that anyways so let's not go there) but the link to the trace would be valid. (@chromy)
@pmeenan would this fix your use case?

The trace files are coming from http://www.webpagetest.org though any private instance will be serving them from their own domain (like https://webpagetest.httparchive.org).
I don't think echoing the url back will help much since the results pages themselvs are already sharable and permalinked.
i.e. Here is a test result for cnn.com: https://www.webpagetest.org/result/201012_DiA4_2264567da8abc26034bab714450d1382/
To the left of the waterfall is a link to download the trace file or view it in an embedded view.  The viewer currently opens a build of perfetto hosted on the origin server so it can open the trace by URL and the view page URL along with the trace reference are in the URL bar and directly sharable: https://www.webpagetest.org/chrome/perfetto/index.html#!/viewer?url=https%3A%2F%2Fwww.webpagetest.org%2Fgetgzip.php%3Ftest%3D201012_DiA4_2264567da8abc26034bab714450d1382%26file%3D1_trace.json
(be patient, it's a pretty massive trace file)

I don't think echoing the url back will help much since the results pages themselvs are already sharable and permalinked.

What I am suggesting is NOT echoing the url of the trace itself, rather echoing the URL of a page you own (so knows how too deal with fetch and cors) that will take care of doing the right window.open (so you are back to the nice UX of "one click to open the trace").
I am envisioning this.

You have a html page (can be fully client side, no need of server side code) like:
https://www.webpagetest.org/open_trace_in_perfetto.html#trace_url=201012_DiA4_2264567da8abc26034bab714450d138

That page has some simple javascript that does something like:
blob = fech(location.fragment)
wnd = window.open(ui.perfetto.dev)
wnd.postMessage({buffer: blob, url: location.href})

When you click on "share" on the perfetto UI, it will print out https://www.webpagetest.org/open_trace_in_perfetto.html#trace_url=201012_DiA4_2264567da8abc26034bab714450d1382
That URL will bring you back to step 1 and will work effectively like permalink today.

Does it make sense?

That might be workable but not a great user experience.  It would need to go to a landing page of some kind that has a button on it that would open the actual trace viewer (otherwise the popover/under protections without user gesture would kick in).
That might still be workable but the experience of loading a large trace is also somewhat "less great".  The trace needs to be fetched in it's entirety on the landing page and then postmessage'd to the new window while a urlfetcher load gives a nice progress indication at the top of perfetto as well.
Maybe something like this:

Landing page starts with a grayed out button to launch the viewer
Trace fetch runs immediately and provides progress information
Once the trace fetch is complete then the button becomes available to open the perfetto UI
Once perfetto loads, the in-memory trace data is posted to perfetto

It might be cleaner if there is a way to stream the data in chunks instead of having to post the whole thing.  I imagine there are probably a few copies of the raw trace data kept in memory during the post otherwise.

That might be workable but not a great user experience.

I know but I can't think to those many other options. If you have some alternative to propose I am all ears.
Unfortunately I don't think the answer here can be keep expanding the CSP policy

. It would need to go to a landing page of some kind that has a button on it that would open the actual trace viewer (otherwise the popover/under protections without user gesture would kick in).

You could do what most sites do, that is: tell people to allow popups in the browser for the domain if they can't be bothered clicking on an extra button.

It might be cleaner if there is a way to stream the data in chunks instead of having to post the whole thing. I imagine there are probably a few copies of the raw trace data kept in memory during the post otherwise.

Sure. That requires some change to the postmessage handler. Patches welcome

Update: we are implementing the "echo-back URL" here: r.android.com/1469529
Example: https://jsfiddle.net/nahck81j/1/

Awesome, thanks.

@primiano

We are having a discussion on whether we should allow doing the same in an .

This would definitely be useful, since the "Load" button is now in another window than the viewer.    Jumping between windows when doing a refresh get's annoying quickly.
Also, thanks for publishing the example.    I am trying to replace my bundled copy of Catapult with a thin page embedding Perfetto, and the JS example helped me get bootstrapped!

For posterity I just added a new doc page with a revised jsfiddle example @
https://perfetto.dev/docs/visualization/deep-linking-to-perfetto-ui

@primiano
In my understanding, you explained how we pass the data to the new window(https://ui.perfetto.dev/) via postMessage above.
But I'm curious if it's possible just to pass the trace data(which I have) to perfetto and display(embed) the view in my html rather than open a new perfetto ui.
@carl-mastrangelo
Have you got to embed perfetto in your page?

@primiano
In my understanding, you explained how we pass the data to the new window(https://ui.perfetto.dev/) via postMessage above.
But I'm curious if it's possible just to pass the trace data(which I have) to perfetto and display(embed) the view in my html rather than open a new perfetto ui.
@carl-mastrangelo
Have you got to embed perfetto in your page?

I am interested in this as well. Any plans to support embedding perfetto UI in an embedded iframe? Thanks

Any plans to support embedding perfetto UI in an embedded iframe?

No, that will realistically never happen from the main ui.perfetto.dev instance. There are too many security risks that come from an iframe. If you need an iframe fork the codebase and host it on an origin you control.

Any plans to support embedding perfetto UI in an embedded iframe?

No, that will realistically never happen from the main ui.perfetto.dev instance. There are too many security risks that come from an iframe. If you need an iframe fork the codebase and host it on an origin you control.

I was thinking of vulcanized catapult trace_viewer_full.html that I can embed.

I was thinking of vulcanized catapult trace_viewer_full.html like version that I can embed.

It doesn't work:

Too many features  (Webusb, serviceworker, cache storage) in chrome and other browsers work only behind a secure origin (https or localhost). file:// schemes are not considered secure.
Web workers (which we use extensively) don't work from a vulcanized file, they need to be spawned off a dedicated js entrypoint.

Too many features  (Webusb, serviceworker, cache storage) in chrome and other browsers work only behind a secure origin (https or localhost). file:// schemes are not considered secure.

We can serve the trace_viewer_full.html from localhost/HTTPS, so that should not be an issue.

Web workers (which we use extensively) don't work from a vulcanized file, they need to be spawned off a dedicated js entrypoint.

Would Embedded workers suffice?
Mentioned here: https://developer.mozilla.org/en-US/docs/Web/API/Web_Workers_API/Using_web_workers

Sorry folks but we are not going to add yet another bundling option that we have to maintain, hoping that every time we add a new delendency on a web platform feature that will keep working on a vulcanized HTML.thst slows down velocity of the project for a benefit that is marginal (i don't fully understand the rationale behind the request)
If you are hosting the file on a https server then why don't you host the static site as-is, without vulcanization?

Apologies - I am just trying to understand the technical feasibility of such an approach - fully understand you not wanting to add, support or maintain such a feature

Closing because I think we've answered everything relevant here.


Improve subscription deployment's management group id detection

When subscriptions are configured through the subscription-ci pipeline, the management group id is inferred by the folder structure where the subscription's parameters JSON file is located.
For example:

FullPath = CanadaESLZ-main/pubsec/LandingZones/Prod/xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx_generic-subscription.json
RelativePath = CanadaESLZ-main/pubsec/LandingZones/Prod/
MgmtGroup = pubsecLandingZonesProd

Notice that we've taken the relative path and removed the parent folder CanadaESLZ-main/, then removed the / to create the management group id.  We chose this path so that long folder paths does not hit any folder path limits.
This approach works along as as customers use the management group id of the parent as the prefix.  For example:
   pubsec
    - pubsecLandingZones
       - pubSecLandingZonesProd

But it now longer works when the management group ids are customized to remove the prefixes.  To support the scenario where the management group ids does not include the prefix of the parent management group, I propose the following changes:

Add a new parameter to common.yml:  generateSubscriptionManagementGroupIdFromFolderHierarchy with values of either true or false.  Default value = true so respect the current implementation.

Update .pipelines/templates/jobs/deploy-subscription.yml so that this flag is used when determining the management group.

Example:
Folder Structure:

  pubsec
    \ LandingZones
      \ Prod

When true:  current implementation.  Output will be pubsecLandingZonesProd
When false:  use the folder name of the subscription JSON.  Output will be Prod

A possible solution using enumerator instead of boolean.  This allows for different schemes in the future.
#!/bin/bash

readarray -t dparts < <(echo "CanadaESLZ-poc/pubsec/LandingZones/DevTest/4f9f8765-911a-4a6d-af60-4bc0473268c0_generic-subscription_canadacentral.json" | tr "/" "\n")

#subscriptionManagementGroupUsing='FolderName'
subscriptionManagementGroupUsing='FolderHeirarchy'

case $subscriptionManagementGroupUsing in
 FolderName)
  echo 'By folder name: ' ${dparts[@]:${#dparts[@]}-2:1}
  ;;
 *)
  echo 'By heirarchy: ' ${dparts[@]:1:${#dparts[@]}-2}
  ;;
esac

@SenthuranSivananthan the script logic already handles flattening the structure - both pre and post MG hierarchy configuration improvements. Basically, it takes the folder elements from the full path between the base subscription config folder (config/subscriptions/DevOpsOrg-Branch), joins them together, and uses that as the target management group id. So for example, in our legacy structure where we specified only the MG id in structure.bicep, we'd have  an MG with id pubsecLandingZonesDevTest. We would then store the subscription JSON config in the path pubsec/LandingZones/DevTest, however we could also just as easily store it in the folder pubsecLandingZonesDevTest. For that matter (going crazy the other way) we could even store it in this path: pubsec/L/a/n/d/i/n/g/Z/o/n/e/s/DevTest, which we wouldn't do because what would be the point, but just to show the flexibility of the existing script logic both ways. To summarize, existing script logic supports either nested folder or flat folder locations for the subscription JSON config files, so I think we can close this issue without code changes unless I'm not understanding the ask.

Converting to a documentation issue.

I see your point.  I think we can document as:

Scenario 1: If a customer chooses to prefix their management group names based on the parent's name, then they can create MG folders in config/subscription without the prefix at each level.  This is the current implementation where we would automatically concatenate the folder hierarchy to generate the target MG name.

Scenario 2: If a customer choses to not use the prefix, then they can create folders at the config/subscription level without any nested folders.  This would essentially by pass the concatenation logic we have in place to support the first scenario.


RFC: specifying the shape of the transformed output in n-dimensional FFT APIs

This RFC proposes that n-dimensional FFT APIs should support specifying a placeholder value when specifying the shape of the transformed output.
Prior Art
In PyTorch, when specifying the shape of the transformed output, one can specify a placeholder value of -1 to indicate that a dimension should not be padded.
>>>  a = torch.tensor([[[0, 0, 0],
...         [0, 0, 0],
...         [0, 0, 0]],
...
...        [[1, 1, 1],
...         [1, 1, 1],
...         [1, 1, 1]],
...
...        [[2, 2, 2],
...         [2, 2, 2],
...         [2, 2, 2]]])
>>> y = torch.fft.fftn(a, s=(a.shape[1],3))
>>> y
tensor([[[ 0.+0.j,  0.+0.j,  0.+0.j],
         [ 0.+0.j,  0.+0.j,  0.+0.j],
         [ 0.+0.j,  0.+0.j,  0.+0.j]],

        [[ 9.+0.j,  0.+0.j,  0.+0.j],
         [ 0.+0.j,  0.+0.j,  0.+0.j],
         [ 0.+0.j,  0.+0.j,  0.+0.j]],

        [[18.+0.j,  0.+0.j,  0.+0.j],
         [ 0.+0.j,  0.+0.j,  0.+0.j],
         [ 0.+0.j,  0.+0.j,  0.+0.j]]])
>>> y = torch.fft.fftn(a, s=(-1,3))
>>> y
tensor([[[ 0.+0.j,  0.+0.j,  0.+0.j],
         [ 0.+0.j,  0.+0.j,  0.+0.j],
         [ 0.+0.j,  0.+0.j,  0.+0.j]],

        [[ 9.+0.j,  0.+0.j,  0.+0.j],
         [ 0.+0.j,  0.+0.j,  0.+0.j],
         [ 0.+0.j,  0.+0.j,  0.+0.j]],

        [[18.+0.j,  0.+0.j,  0.+0.j],
         [ 0.+0.j,  0.+0.j,  0.+0.j],
         [ 0.+0.j,  0.+0.j,  0.+0.j]]])

This is especially convenient when not wanting to access the array shape (as might be the case for accelerator libraries).
In contrast, NumPy does not support a placeholder, requiring that, in order for a dimension to not be padded, one must specify the existing dimension size.
>>> np.fft.fftn(a, s=(3, 3))
array([[[ 0.+0.j,  0.+0.j,  0.+0.j],
        [ 0.+0.j,  0.+0.j,  0.+0.j],
        [ 0.+0.j,  0.+0.j,  0.+0.j]],

       [[ 9.+0.j,  0.+0.j,  0.+0.j],
        [ 0.+0.j,  0.+0.j,  0.+0.j],
        [ 0.+0.j,  0.+0.j,  0.+0.j]],

       [[18.+0.j,  0.+0.j,  0.+0.j],
        [ 0.+0.j,  0.+0.j,  0.+0.j],
        [ 0.+0.j,  0.+0.j,  0.+0.j]]])
>>> np.fft.fftn(a, s=(-1, 3))
Traceback (most recent call last):
  File "/.../numpy/fft/_pocketfft.py", line 80, in _get_forward_norm
    raise ValueError(f"Invalid number of FFT data points ({n}) specified.")
ValueError: Invalid number of FFT data points (-1) specified.

Proposal
This RFC proposes that the proposed FFT specification adopt PyTorch's API and support -1 as a valid value to indicate that a dimension should not be padded (or truncated).
Questions

Does this RFC present overriding backward compatibility concerns?
Is there an alternative approach which would be better?

As far as I can tell, this is a minor convenience feature and it doesn't matter much either way. It will require a bit of extra checking for parsing s, but given that in the majority of usage it is expected for s to be None the extra overhead doesn't matter I'd say.
@peterbell10 do you have an opinion on this, since you implemented it in PyTorch? Are you happy for it to be added to numpy.fft and scipy.fft?

This is already implemented in scipy.fft and dates back to scipy.fftpack. numpy.fft does support having None values inside the tuple as a placeholder, but I don't think this is documented anywhere. It's just a side effect of NumPy's fftn calling fft in a loop, which in turn supports n=None.
I will say that supporting s=(None,) in PyTorch wouldn't be possible currently, so having -1 be the standard placeholder works better there.

I will say that supporting s=(None,) in PyTorch wouldn't be possible currently

Thanks for sharing, @peterbell10. What would be the technical issue here?

My wording was a bit too strong, it's possible but would require either some significant work to implement List[Optional[T]] in PyTorch's C++ code-generation, or require extra python wrapper code that would be a divergence from the C++ torch api.


Flattr account is restricted

The Flattr button leads to a 400 Bad Request page saying that the owner is restricted.
Link: https://flattr.com/submit/auto?user_id=has207&url=http://github.com/has207&title=flexmock&language=en_GB&tags=github&category=software

I'm the new maintainer of flexmock and the official repo is now at https://github.com/bkabrda/flexmock; I'll close this, but I'll ping @has207 since he still deserves all the credit!

I deleted all references to this now, fun to know somebody tried to actually click it :)


Choices with enum types don't use labels but values in (some) templates

Choices fields can be implemented with enumeration types which allows setting both a value and a human-readable label for each choice.
We use them so we can set English defaults in the database (= values) and display project-specific German wordings (= labels) for predefined choices to our content managers. This mirrors how we handle fields, which have English field names and German verbose names.
Describe the bug
The labels display fine in forms (create/edit views) but the detail view only shows the values.
The note in this SO answer / the comments below potentially describe what the problem is (?) though I haven't been able to work out why the labels work as expected in form-based views. Looked at crispy forms as well but couldn't find anything that would have explained it. Was also wondering if it could have to do with (a lack of) handling of gettext_lazy.
Django 5.0 slightly changed how enumeration types are handled; they are now meant to be set like this:
        choices=YEAR_IN_SCHOOL_CHOICES,

vs. how it's been done so far:
        choices=YEAR_IN_SCHOOL_CHOICES.choices,

see also info box at the end of the section in the docs for 5.0... but I don't know if this fixes this and I'm not aware of any plans for us to switch to 5.0 soon-ish, so...
Screenshots
Edit view:

Detail view:

for a model mixin which looks like this:
from django.utils.translation import gettext_lazy as _

class StatusMixin(models.Model):
    class ProgressStates(models.TextChoices):
        CREATED = "created", _("neu angelegt")
        ...(snip)...

    progress_status = models.CharField(
        max_length=255,
        choices=ProgressStates.choices,
        null=True,
        verbose_name=_("Bearbeitungsstatus"),
    )
    ...(snip)...

Now, I don't know if we should solve this individually, on the project level – e.g. with helper methods like the example given in the SO post – or if we want to solve this more generally, for everyone, in Core.
We use choices quite a bit this way in our project, so would have to create multiples of these helper methods.
Django's built-in get_FOO_display() instance method, which can be used in templates as well, only helps so much in this case, btw., because it requires substituting the field name it should apply to for FOO.

I'll create a draft PR with what I came up with as potential solution in Core...

Just, FTR: we are using Django's model_to_dict for generating the list of fields and value in the display view

Yes, I kept it because I didn't know if it'd be preferable to keep it or replace it with something else (and if so, with what) but changed how values are set.

Moving some of the comments I left in the linked PR here because this seems like the better place for discussion:

I'll note I ran into problems with some fields while experimenting with getting the labels to display, but don't quite remember anymore what I did/was trying to do. IIRC the problems were related to (direct or indirect?) lookups of model names, either via _meta or attname (which might be one and the same), and it happened with fields I wasn't actually aware of. Something something autofields? ... It's possible model_to_dict filters those out and that's part of the reason I ended up sticking with it after all (?!).
I.e. this ^ is something to keep in mind for future refactoring.

...

Ok, I think I know now: _get_FIELD_display() does not work for many-to-one relationships.
When I look up all fields with self.instance._meta.get_fields() and try to use _get_FIELD_display() on them, I get "'ManyToOneRel' object has no attribute 'attname'" errors for: uri, triple_set_from_subj,  triple_set_from_obj.
... So I'm assuming this means we won't be able to display foreign key in our display views? Which hadn't occurred to me yet, because while we've included them in our models, we haven't actually set any yet.
What's the solution to this?

On a related note:

Ok, it looks like this is now solved.
Detail view displays the ProgressStates labels just fine: