[Drilldown Menu] error on resize window

Hello
First, sorry for my poor english.
I have a bug with a little code and i can't find any solution. So I dev with django under linux and i can reproduce it without django:

yarn init --yes

yarn add --dev foundation-cli

./node_modules/.bin/foundation new

I put test_dropdown_and_drill_menu

my choice is first (little install with only sass preprocessor)

the foundation-sites is 6.4.3
inside the test_dropdown_and_drill_menu, i change index.html as below (i put my app.scss):
https://codepen.io/anon/pen/QQmdRL
After launch gulp to compile .scss to .css, i have this error when i resize shortly chromium/firefox:

TypeError: Right-hand side of 'instanceof' is not an object
at ResponsiveMenu._checkMediaQueries (foundation.responsiveMenu.js:289)
at ResponsiveMenu._init (foundation.responsiveMenu.js:242)
at ResponsiveMenu._setup (foundation.responsiveMenu.js:205)
at ResponsiveMenu.Plugin (foundation.core.js:553)
at new ResponsiveMenu (foundation.responsiveMenu.js:184)
at HTMLUListElement. (foundation.core.js:356)
at Function.each (jquery.js:354)
at jQuery.fn.init.each (jquery.js:189)
at String. (foundation.core.js:338)
at Function.each (jquery.js:354)

Normaly, dropdown menu is disable and drill menu is activated as on doc

I can not reproduce this with a codepen with Foundation Sites 6.4.3
https://codepen.io/DanielRuf/pen/gveWaP

Can you provide a complete codepent with your markup and styles?

there is no problem with codepen but with local installation, i have it

If it is not reproducible in any of the codepen modes (full, debug and so on) it might be an issue with your integration or some thirdparty code.
You can download the codepen with all files at the bottom right and test if the code works on your machine too without codepen around it.

https://codepen.io/DanielRuf/share/zip/gveWaP/
https://codepen.io/DanielRuf/full/gveWaP/
https://codepen.io/DanielRuf/debug/gveWaP

the solution is here:
https://github.com/zurb/foundation-sites/issues/10520#issuecomment-364719137

Thanks for the update and reporting this.


OOM error when running with more than one mpi rank

Hello,
Thank you for a great package! I am trying one of your examples and it runs fine with one mpi process (never runs out of memory). But fails on an OOM error with more mpi processes (I checked, the devices are less than 1% memory occupied).
With one process, success:
$JULIA_DEPOT_PATH/bin/mpiexecjl -n 1 julia<EMAIL_ADDRESS>./ParallelStencil/miwpY/miniapps/acoustic_waves_multixpu/acoustic3D_multixpu.jl
Global grid: 127x127x127 (nprocs: 1, dims: 1x1x1)
Animation directory: ./viz3D_out/
Total steps=1000, time=1.636e+01 sec (@ T_eff = 7.90 GB/s)

With 2 processes, failure:
$JULIA_DEPOT_PATH/bin/mpiexecjl -n 2 julia<EMAIL_ADDRESS>./ParallelStencil/miwpY/miniapps/acoustic_waves_multixpu/acoustic3D_multixpu.jl
Global grid: 252x127x127 (nprocs: 2, dims: 2x1x1)
ERROR: LoadError: Out of GPU memory trying to allocate 15.628 MiB
Effective GPU memory usage: 1.03% (416.000 MiB/39.586 GiB)
CUDA allocator usage: 0 bytes
Memory pool usage: 0 bytes (0 bytes allocated, 0 bytes cached)
Stacktrace:
 [1] #alloc#202
   @./CUDA/mVgLI/src/pool.jl:266 [inlined]
 [2] alloc
   @ ./CUDA/mVgLI/src/pool.jl:258 [inlined]
 [3] CUDA.CuArray{Float64, 3}(#unused#::UndefInitializer, dims::Tuple{Int64, Int64, Int64})
   @ ./CUDA/mVgLI/src/array.jl:28
 [4] CuArray
   @ ./CUDA/mVgLI/src/array.jl:109 [inlined]
 [5] CuArray
   @./CUDA/mVgLI/src/array.jl:110 [inlined]
 [6] zeros
   @ ./CUDA/mVgLI/src/array.jl:409 [inlined]
 [7] acoustic3D()
   @ Main ./ParallelStencil/miwpY/miniapps/acoustic_waves_multixpu/acoustic3D_multixpu.jl:40
 [8] top-level scope
   @ ./ParallelStencil/miwpY/miniapps/acoustic_waves_multixpu/acoustic3D_multixpu.jl:86

I appreciate any hints you may have about why this is happening.
Cheers!

Here is a smaller reproducer (which again, works with 1 process) if it helps:
$JULIA_DEPOT_PATH/bin/mpiexecjl -n 2 julia<EMAIL_ADDRESS>-e "using ParallelStencil,MPI,ImplicitGlobalGrid;@init_parallel_stencil(CUDA, Float64, 3); siz=31; me, dims, nprocs, coords, comm = init_global_grid(siz,siz,siz);select_device();@show sum(@zeros(siz,siz,siz))"
Global grid: 60x31x31 (nprocs: 2, dims: 2x1x1)
ERROR: Out of GPU memory trying to allocate 232.742 KiB
Effective GPU memory usage: 1.03% (416.000 MiB/39.586 GiB)
CUDA allocator usage: 0 bytes
Memory pool usage: 0 bytes (0 bytes allocated, 0 bytes cached)

Hi @raminammour,
Thanks for reporting. I just tried your MVE and it works fine for my both with -n 1 and -n 2. Before we further dive into debugging, are you sure that running on more than one MPI process, each MPI process has access to its own GPU (and thus be sure that both MPI process are not trying to init on the same GPU) ? This could be a reason for the error you get.
Also, what type of multi-GPU system are you running on, how many GPU per node ?

Hey, thanks for the reply.
These are nodes with 4 gpus, I reserve with slurm and just tried to be more explicit: srun -n 4 --gres=gpu:4 --cpus-per-gpu=1 --pty bash -l". Is there a way to make sure that each mpi process has a dedicated gpu? (seems that the slurm installation we have does not recognize ntasks-per-gpuorbind-gpu` options).

Welcome,  maybe you could you try with running -n 2 on 2 nodes with 1 GPU per node to see if this fixes the error and confirms there is an issue regarding GPU overriding by multiple MPI processes ?
Another try could be to add --ntasks-per-node=4 instead of --cpus-per-gpu=1 (but I don't have much experience with SLURM)

Is there a way to make sure that each mpi process has a dedicated gpu?

On the application side, it should be handled by select_device() from here, which gets local MPI rank (per node) and assigns it as GPU_ID. You could check it by printing the output as such
$JULIA_DEPOT_PATH/bin/mpiexecjl -n 2 julia<EMAIL_ADDRESS>-e "using ParallelStencil,MPI,ImplicitGlobalGrid;@init_parallel_stencil(CUDA, Float64, 3); siz=31; me, dims, nprocs, coords, comm = init_global_grid(siz,siz,siz);@show me=select_device();@show sum(@zeros(siz,siz,siz))"

Seems to be correctly selecting different devices
--------------------------------------------------------------------------
Global grid: 60x31x31 (nprocs: 2, dims: 2x1x1)
me = select_device() = 1
me = select_device() = 0

I simplified further and getting segfaults with  CUDA and MPI interaction. I will investigate further, and come back here if the error is not coming from upstream.
For now feel free to close the issue if you see fit, or keep it open and I will notify you of any resolution.
Cheers!

Indeed, seems to be ok regarding device selection. Could you try running on different nodes ?

I simplified further and getting segfaults with CUDA and MPI interaction

That's not nice. Do you use CUDA-aware MPI ?
You certainly did already, but these two resources may give further hints on how to set-up the environment to run Multi-GPU:

slurm + 1 GPU/node
no slurm + 4 GPUs/node.

yeah, MPI reports that it has_cuda() but segfaults still :(

Could you maybe try export IGG_CUDAAWARE_MPI=0 to disable CUDA-awareness within ImplicitGlobalGrid.jl ?

This machine is using OpenMPI.
export IGG_CUDAAWARE_MPI=0 does not fix the OOM error above.

Does the MPI install use UCX instead of openib ? I had issues getting MPI to work properly if OpenMPI was configured with UCX.

I am on a managed system, so cannot play with any installations unfortunately.

If you have multiple nodes, it would be interesting to see if the error occurs when running one one GPU/node on 2 nodes.
Also, do you get any errors running on 2 MPI processes with Thread backend ?

It works with one gpu per node with two mpi processes, but not 2 gpus on one node!

Interesting.

What type of node and GPUs are you running on ?
Which version of MPI, CUDA is installed (both in Julia and system ones) ?
Could you check with your sysadmin if the slurm launchparams are the correct ones for the type of job you are trying to run on multi-GPU per node.

I simplified further and getting segfaults with CUDA and MPI interaction. I will investigate further, and come back here if the error is not coming from upstream.

Hi @raminammour , do I understand right that you could reproduce the issue without ImplicitGlobalGrid and ParallelStencil? Then, you would best write in the GPU section in Julia Discourse in order to get help. I would guess that something is wrong with the GPU memory allocation to your processes independent of what code you run...

Thank you both for helping!
Yes, @omlins, I was able to get a segfault just using MPI and CUDA with a broadcast/receive pattern. The OOM I am getting above sometimes leads to a segfault, which leads me to believe that there is UB behavior somewhere, as you say with the allocation of memory on the GPUs.
We have factorial combinations of cuda drivers, compilers, MPI's and different little things that are making my life difficult in building a reproducible example. Also the system is new, and these things get ironed out in the first few weeks in my experience (as admins correct things). When I manage to do so I will file upstream or discuss on discourse as you advise.
Feel free to close here for now, we can re-open if I determine that the issue pertains to ParallelStencil or ImplicitGlobalGrid, which are great, regardless :)

OK, I will close the issue then. Don't hesitate to open a topic on Julia discourse - it could well be that somebody will immediately know what's going on...
PS: thanks for your nice words about ParallelStencil and ImplicitGlobalGrid!


cmake

Why

more easy for developer who use cmake-gui
add more option for developer  like  "Warning for all project or a single target" "ASAN for all project or a single target"
manager a lot of cmake in different file like "build.cmake" "install.cmake" . It will be uesfule for future develop .for example if you want to add http module , you need to only change module.cmake. And you should turn on warning or ASAN for http-module only.

What is changing

for user
cmake-build api  has changed  if you want to compile some of the all project in CLI. You shuld use -Dcore_rpc=ON Dstruct_pack=ON . And you can use cmake-gui more easyily  .....
for developre
add some function for developers and  cmake become easyier to read

Example

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.hyj seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.

please sign CLA

I am trying to fix some bug and sign CLA

fix all problem mentioned above


Create 593. ValidSquare.py

Pull Request Template
What have you Changed(must)
Write here what you have changed in the codebase
Issue no.(must) -
Pr will be close and marked as spam. If issue number not found or issue was assigned to someone else.
Marking as spam can block your account from HacktoberFest.
Self Check(Tick After Making pull Request)

[x] This issue was assigned to me if not it will be marked as spam.
[x] My file is in the proper folder
[x] I am following clean code and Documentation.
[x] I have added the title and what program will do first in the file
[x] I have named the file as (Problem #). (Problem Title(in Camel Case)).(extension)
ex. 2. AddToNumbers.py

README - How to Contribute

added a solution for a leetcode problem #593 Valid Square

@ViswanadhamVamsi you have to mention the issue number in the PR Body.


feat(spanner): update query option samples with optimizerStatisticsPackage

Original PR #1425.

@skuruppu Looks great, thank you for making those changes! For future reference, it's better if you keep the updates in the previous PR!


Fix/font family floating label sidebar active and sample profile image

Hello @Honeyloveet this  PR is a fix for the following issues.

Renaming of the variables for the font-family types to make it generic
updating the font family settings where it is used across the app
changing the sample profile image used for the profile, top-navbar and general settings page to the svg format which is of a better quality than the png file.
Setting the active menu item on the sidebar when navigation is done via other means without clicking the sidebar menu.
Floating label being activated by default on some input fields without being engaged or clicked.

Kindly review and merge.
Thank you

@tamsay Great job well done.


Refactor to Flask-RESTful

Flask-RESTful offers some nice features specific to REST APIs.  I especially like how they handle request parsing, which provides a standardized validation framework, deals with GET params and json attributes in a singular way.  This could be very handy if we do want to keep both the GET and POST variations on the address parser.

I took a stab at this a while back, and it honestly wasn't all I was hoping it would be.  If I'm remembering correctly, it did provide several conveniences, was a little too opinionated (inflexible) in others.  I may check it out again, or one of the alternatives like flask-marshmallow in the future, but for now I'm closing this out.


[control plane][FE] clicking one push record will take user to activity log tab and apply the filter

a/c:
In push history tab, clicking each record will take user to activity log tab and apply the filter from the push record

env
time range

clicking each record will take user to activity log tab and apply the filter from the push record
--->time range is not applied after clicking each record

@cheng0504 ready to test


WIP: meson: Remove propagated native C compiler

Motivation for this change
Now that we have a Meson release containting 1, Meson will work fine
without a native compiler, so we don't need this trick anymore.
Fixes #58831
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[ ] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[ ] Fits CONTRIBUTING.md.

CC @leotaku

Version 0.56.0 of Meson has recently been merged into Nixpkgs, so I think it would make sense to un-draft this PR and try getting it merged.

@leotaku Thanks for letting me know!


8bit Optimisers and resolved potential setup.py issues

The commit to setup.py was to resolve dependency issues on my machine, as certain features are deprecated in later versions of lightning and torchmetrics, these versions still have these features but present deprecation warnings, feel free to change these as you see necessary
Also, regarding 8bit, replacing nn.Linear() with its 8bit equivalent (bnb.nn.Linear8bitLt() | which seems to be only for inference) seems to break tensors, so I've opted for merely implementing the optimisers

Looks good! Sorry, slight merge conflicts but once resolved will merge

Also, for
import bitsandbytes as bnb

can you do some error checking? In some systems like mine, this causes an exception even when it's installed like
CUDA Setup failed despite GPU being available.

Also, for
import bitsandbytes as bnb

can you do some error checking? In some systems like mine, this causes an exception even when it's installed like
CUDA Setup failed despite GPU being available.

Sure, will do, sorry for the late reply

Thanks!

Thanks!

I've discovered this is a windows only issue, which requires some workarounds to fix, I've implemented error checking however for systems without these tweaks, I suggest reading the commit comment

@korakoe ah, can you do something like https://github.com/huggingface/diffusers/blob/main/examples/textual_inversion/textual_inversion.py for this? They mainly check if bitsandbytes can load and if not just discard it pretty much like you said

@korakoe ah, can you do something like https://github.com/huggingface/diffusers/blob/main/examples/textual_inversion/textual_inversion.py for this? They mainly check if bitsandbytes can load and if not just discard it pretty much like you did but will be great if it's abstracted away into a function

Sure, will do, although I can’t seem to find how they did it in this script, other scripts seem to use an import error instead and import it when it’s needed

@korakoe Ah, sorry. Yup, like the other scripts. Thanks a bunch

@korakoe Ah, sorry. Yup, like the other scripts. Thanks a bunch

Done, also resolved merge conflicts while I was at it


feat(rlp)!: implement RlpEncoder pre-sizing for all RlpEncodable types and list encodings

Description
This change makes it mandatory for all RlpEncodable types to implement explicit rlpSize of the encoded RLP, without actually encoding it. Additionally, it adds support for providing RLP list encoding header size to avoid having to copy the data.

Solution

#137  👈
master

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @ArtificialPB and the rest of your teammates on  Graphite


Memory leak io.netty.handler.codec.DefaultHeaderImpl

I am created simple status check web application with helidon.
This program receive 1-3 request per second,
crashed by OutOfMemoryError at several hours.
Environment Details

Helidon Version: 1.1.0
Helidon SE
JDK version: Oracle 8_212
OS: Windows
Docker version (if applicable):

Problem Description
Checked some test with jvisualvm.
In operation, -Xmx option 128m, crashed at several hours,
Test1, -Xms option 16ms and 1 request per second, crashed at 15min.
Test2, -Xms option 16ms and 3 request per second, crashed at 5min.

request from chrome browser.

DefaultHeaderImpl increase each request, and was not GC.
Steps to reproduce
Sample Code
`public class HelidonStatusServer {
public static void main(String[] args) {
	new WatcherRunner().start();

	WebServer.create(
            ServerConfiguration.builder().port(8088).timeout(60_000).build(),
            Routing.builder()
            .get("/status", new StatusHandler())
            .register("/", StaticContentSupport.builder(Paths.get("www"))
                    .welcomeFileName("index.html").build())
            .build()
    ).start();
}

public static class StatusHandler implements Handler {

    @Override
    public void accept(ServerRequest req, ServerResponse res) {
    	res.headers().contentType(MediaType.APPLICATION_JSON);
    	res.headers().add("Access-Control-Allow-Origin", "*");
        res.send(StatusStore.toJson());
    }
}

}`
visualvm screenshot filtered netty packages

@umishu I have confirmed that this issue has already been fixed by PR #695 (and #702), which will be available in the next release.


[usbdev] usbdev seq PR

This PR contains usbdev_av_buffer seq

@jdonjdon Please review it.
Thanks

@jdonjdon kindly review it.
Thanks.

@jdonjdon kindly review it.
Thanks

@jdonjdon kindly review it.
Thanks

There was issue in dv smoketest  and fixed.
@Saad22386 Please rebase this PR.


Weird behavior of thumbnails in .ova VM

I built the .ova, so I feel a bit like I'm tattling on myself here, but I want to know if anyone else is seeing this and/or if there's a fix, in case I should make a new VM without this issue:
When I first start up a VM from the 8 1.1.0 .ova, even if I've run it before, media on the most recently created nodes does not show up properly. There's a collection "Cat Pictures" with a thumbnail that comes with the VM that has the problem, and new content I've added later shows the same thing.
See here, when I first start up the VM and go to localhost:8000:

After a minute or two:

The item with the lobster riding a cat is a Collection. The other one is an Image. The Media is listed, but does not show up when accessed directly (metadata does), until a few minutes in. In both cases, the Thumbnail was added on its own and tagged as a thumbnail, instead of being generated from an original file, which I suspect is at the heart of this, but... what's happening?

I am seeing similar behavior. For me, it's the thumbnail of the dog pulling on the shoe laces ("Small puppy") that is last to load. It's always this one. But, if I load a new image, its thumbnail show up as intended, without the delay.
A more general pattern I've noticed is that since derivatives are generated asynchronously after the user submits the ingest form, they often take a few seconds (for most images anyway, big video files might be different) to show up. This is in contrast to Islandora 7, where all derivatives were generated before the user's form submit action completed. Not sure if that's in play here, but probably not if the thumbnails take a few seconds to show up independent of when they were create/generated.

What I find most odd is that this happens every time I start up the same VM. It's not a first-time loading thing, it's persistent in the same VM after shutting down and restarting. They always show up eventually, but they're not there for the first few minutes.
Probably not a concern for production, if it's just happening when the site is unpacking its toys, but I don't want the VM to give a bad impression. And I'd like to know if this is indicative of anything more serious.

This may not be anything new. I noticed it because the VM has a special view on the front page showing pretty much all of the nodes, with images built from the thumbnails. Older VMs either didn't have content when first started, or it's a click or two in, giving things time to catch up and maybe concealing this?
Interesting that you're seeing it on a different image @mjordan. I have it only when the thumbnail is loaded manually, so far, but "Small Puppy" was ingested with Migrate from CSV.

Huh, after adding a few more objects, it appears to me that the image that is late to load is consistently the one in the upper-right corner of that front page View's table. So maybe it has nothing to do with the image itself but the way that the table's markup is being rendered.

Maybe try adding a different output formatter to the View to see if the same image(s) load late?

Nope - I changed the sort on the View to title and the same images are loading late. 🤷♂

Definitely not just the view. If I go directly to the media, there's a blank space the same dimension as the eventual image.

@whikloj had a look and found that the thumbnail was being served from Flysystem. It got put into Fedora on upload because it's not a derivative; it's a direct upload tagged as a thumbnail. This is known behavior, but probably not ideal.

Known issue.


Issues with DerbyMaster and derby.properties design

Describe the bug
fhir-persistence-schema project has com.ibm.fhir.database.utils.derby.DerbyMaster which provides an abstraction for an AutoCloseable embedded derby instance thats used by both tests and "bootstrapping" code (when persistence type is derby and bootstrap is set to true--which is the default config).
Currently, whenever instantiated from a test, it logs the following warning:
WARNING: Failed to create derby.properties file!
Given the current design, this will always happen unless you happen to have a derby dir under the current working directory of the launched application.
And even then, derby will not use this derby.properties file unless its launched from that particular directory (like in the network derby case).
To Reproduce
Execute any test that invokes DerbyMaster
Expected behavior
DerbyMaster should have a more flexible design and we should have a better approach for providing derby.properties.
Additional context
Additionally, the current design of DerbyMaster doesn't seem compatible with our VersionHistoryService and, while adding a migration test for #833 I found that the DEBUG property doesn't work when launched as a test because derby only checks the working directory for the derby.properties file.

yes, the adding of the properties file for derby is for the performance issue that we found in pipeline integration test, and there is always derby directory there, so it worked well for integration tests.


apps will not update

LineageOS for microg, 16.0-202000416-microg-gts210vewifi
I installed most apps using F-Droid.  They installed just fine, and update in F-Droid just fine.
I needed some apps not in F-Droid, so I installed them using APK Pure (3.17.5).  They (seemed) to install fine.  The problem is that any apps needing updates via APK Pure will not update, they all always lead to this (very unhelpful) message from APK Pure:  "App not installed".
How do I determine where the problem is and how to fix it?

You probably need to put an issue with APK Pure. I don't think it is an microg issue, as F-Droid and Aurora Store both work fine.

Apps from F-droid have a different signature to those from APK Pure / Aurora Store / Google Play Store. Hence when you try to an app that you installed using F-droid with an update from elsewhere then you get that message because of a signature mismatch. It is a security feature of Android which cannot be disabled ie if you have a banking app then someone can make a fake update then they get full access to the apps stored data. The solution is to uninstall the F-droid version of the app, which also deletes all of its data, then install the newer version from APK Pure.


Can we dynamicaly change the view in a step depending o the previous step

Hi,
Thank you for your work on the library ;-)
I would like to know if there is any to dynamicaly change the view content of a step to make it reflect answer of the previous steps?
Best regards
Richard

Answering myself.
I did not find a a way to replace the view inside the step so i created a layout containing the different view i want and i pass this layout to the step. Then I set the visibility of the view inside this layout.
If you think of something cleaner.... do not hesitate.

Closing this issue because you already answered yourself a long time ago.


SUIRCATA: Won't load custom-rules.xml anymore since 21.7.3 upgrade

Important notices
Before you add a new report, we ask you kindly to acknowledge the following:

[X] I have read the contributing guide lines at https://github.com/opnsense/core/blob/master/CONTRIBUTING.md
[X] I am convinced that my issue is new after having checked both open and closed issues at https://github.com/opnsense/core/issues?q=is%3Aissue

Describe the bug
You could put custom rules in
/usr/local/opnsense/scripts/suricata/metadata/rules/
and these would be loaded and appear
Services > Intrusion Detection > Administration > Download
To Reproduce
Place a suitable custom-rule.xml file in the correct directory, the new ruleset never gets loaded.
Expected behavior
The ruleset would get loaded and appear in Services > Intrusion Detection > Administration > Download
Describe alternatives you considered
Rollback is the only alternative
Screenshots
I can upload if required
Additional context
Probably the issue began with the first release of 21.7.3 but I never noticed my custom IPS rules were no longer getting loaded
Environment
OPNsense 21.7.3_3 (amd64, OpenSSL).
Intel(R) Core(TM) i5-10210U CPU @ 1.60GHz (8 cores)
Network Intel® I210-AT

If the download tab contains rulesets, it's likely an issue with your definition. All standard (and plugin) rulesets are registered equally.

Oh no!
You're right, I updated the URL and forgot to escape the ampersand!
My fault, thanks.


WandbLogger model artifacts do not have best aliases when using save_top_k> 0

Bug description
When using WandbLogger and ModelCheckpoint with save_top_k > 0, the model artifacts on Wandb do not have best aliases -- instead they only show best_k and latest aliases for the last model artifact that was uploaded to WandB. Note that this artifact version may not be the actual best, but only one of the best_k.
How to reproduce the bug
As per the reproduction code below, this happens because _scan_checkpoints override the best model tag with best_k.
The below code is an extension of test_scan_checkpoints tests/tests_pytorch/loggers/test_logger.py
from pathlib import Path
import random
import tempfile
from unittest.mock import patch

from lightning.pytorch.loggers.utilities import _scan_checkpoints

checkpoint_callback_mock = patch("lightning.pytorch.callbacks.ModelCheckpoint")
save_top_k = 5
# Randomly assign one of the checkpoints to be the best
best_i = random.randint(0, max(save_top_k - 1, 0))
with tempfile.TemporaryDirectory() as tmpdir:
    best_k_models = {}
    for i in range(save_top_k):
        ckpt_path = Path(tmpdir) / f"{i}.ckpt"
        ckpt_path.write_text("")
        best_k_models[ckpt_path] = i
        if i == best_i:
            checkpoint_callback_mock.best_model_path = ckpt_path
            checkpoint_callback_mock.best_model_score = i
    checkpoint_callback_mock.best_k_models = best_k_models
    logged_model_time = {}
    checkpoints = _scan_checkpoints(checkpoint_callback_mock, logged_model_time)

    # This passes because the number of checkpoints is correct
    assert len(checkpoints) == save_top_k

    if save_top_k > 0:
        # This fails because the tag is now `best_k`
        assert checkpoints[best_i][-1] == "best"

Error messages and logs
assert checkpoints[best_i][-1] == "best"
AssertionError

Environment

Current environment
I used the latest code on master from this commit: b2b6449be7b50973ab3f1d7fce6d72cb96c3b75f
#- Lightning Component (e.g. Trainer, LightningModule, LightningApp, LightningWork, LightningFlow):
#- PyTorch Lightning Version (e.g., 1.5.0):
#- Lightning App Version (e.g., 0.5.2):
#- PyTorch Version (e.g., 2.0):
#- Python version (e.g., 3.9):
#- OS (e.g., Linux):
#- CUDA/cuDNN version:
#- GPU models and configuration:
#- How you installed Lightning(`conda`, `pip`, source):
#- Running environment of LightningApp (e.g. local, cloud):

More info
In its current form it is unclear to me what is the usefulness of the best_k alias altogether when logging to Wandb: as per the Wandb conventions, the tags/aliases are unique for an artifact in the sense that two different versions of the same artifact can not have the same tag (if ModelCheckpoint outputted an ordering of checkpoints based on the score instead, then tags best_1, best_2, best_3, etc, could be useful).
As a possible solution to resolve this bug, I think resorting back to the following logic makes sense:
     aliases = ["latest", "best"] if p == checkpoint_callback.best_model_path else ["latest"]

cc @awaelchli @morganmcg1 @borisdayma @scottire @parambharat

Hi @DrSleep , Thanks for raising this issue. I have tested and fixed this issue. Please review this PR and let me know if this fixes the issue.
Here's a sample wandb workspace  that has the corresponding artifacts.
Here's a colab to reproduce the runs in the workspace above.

Hi, @parambharat , yes, this works perfect. Thank you!


Wrong width when padding was not included in width

function _fixWidthWithCss  ,when settings.includePadding=false(css,box-sizing:border-box),you will get the table width,not the td or th width.

Do you have a PR, I would love to have this fixed


Cross posting

@feruzm commits include support for cross post reading. Could you help me testing while i am preparing cross post sending tool.

@feruzm done


Add ability to tell type of errors returned by client

cc @xichen2020 @martin-mao

LGTM

Coverage decreased (-0.05%) to 77.531% when pulling 1a643fb689941624d82bd49b07ab7c5d4579aefc on client-errors into c2406837b02f56c36b7aa24087410bb0f0824f89 on master.


log: command not found

When using the prepare_vm_disks.sh script with a Azure VM CustomScript extension together with one of the "non official" Linux images in the marketplace I get the following error:
./prepare_vm_disks.sh: line 140: log: command not found
./prepare_vm_disks.sh: line 146: log: command not found

Please provide us with the following information:

This issue is for a:
- [x] bug report
- [ ] feature request
- [ ] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)

Minimal steps to reproduce
Create a custom script extension with the following settings section:
{
  "fileUris": ["https://raw.githubusercontent.com/Azure-Samples/compute-automation-configurations/master/prepare_vm_disks.sh"],
  "commandToExecute": "./prepare_vm_disks.sh"
}

Any log messages given by the failure
./prepare_vm_disks.sh: line 140: log: command not found
./prepare_vm_disks.sh: line 146: log: command not found

Expected/desired behavior
Either use standard Shell commands for logging or include log function in script.
OS and Version?
publisher = "azurecyclecloud"
offer     = "azure-cyclecloud-vm"
sku       = "cyclecloud-77"
version   = "7.7.3"

Image is based on CentOS 7.5
Versions

Mention any other details that might be useful

Thanks! We'll be in touch soon.

Sorry you ran into issues, @raidlman.
This has been updated in https://github.com/Azure-Samples/compute-automation-configurations/pull/9


UVI Request

--- UVI JSON ---
{
  "vendor_name": "Linux",
  "product_name": "Kernel",
  "product_version": "versions from v5.4 to before v5.14.14",
  "vulnerability_type": "unspecified",
  "affected_component": "unspecified",
  "attack_vector": "unspecified",
  "impact": "unspecified",
  "credit": "",
  "references": [
    "https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/commit/?id=4e3b0468e6d7f3c38ce52320803769b49ba87930",
    "https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/commit/?id=3b4241817601a2f59beea471baa51763d7262232"
  ],
  "extended_references": [
    {
      "type": "commit",
      "value": "4e3b0468e6d7f3c38ce52320803769b49ba87930",
      "note": "introduced"
    },
    {
      "type": "commit",
      "value": "3b4241817601a2f59beea471baa51763d7262232",
      "note": "fixed"
    }
  ],
  "reporter": "joshbressers",
  "reporter_id": 1692786,
  "notes": "",
  "description": "net: mscc: ocelot: avoid overflowing the PTP timestamp FIFO\n\nThis is an automated ID intended to aid in discovery of potential security vulnerabilities. The actual impact and attack plausibility have not yet been proven.\nThis ID is fixed in Linux Kernel version v5.14.14 by commit 3b4241817601a2f59beea471baa51763d7262232, it was introduced in version v5.4 by commit 4e3b0468e6d7f3c38ce52320803769b49ba87930. For more details please see the references link."
}
--- UVI JSON ---

This issue has been assigned UVI-2021-1002094


Load with Facade

A number of performance monitors recommend loading intercom with a facade.  Is there a method to load intercom with next-intercom using a facade?

Hi by default it lazy loads the module including the js required.


Fix repo home UI when there is no repo description

Fix #30502 by a new approach.

What is the point of the .IsRepositoryAdmin condition here?

Don't show "no description" to non-admin users, I think it's not bad.

What is the point of the .IsRepositoryAdmin condition here?

Don't show "no description" to non-admin users, the same as before, I think it's not bad.

But why? I don't understand the reason why the rendering of a placeholder would depend on user permission level. It makes no sense.

What is the point of the .IsRepositoryAdmin condition here?

Don't show "no description" to non-admin users, the same as before, I think it's not bad.

But why? I don't understand the reason why the rendering of a placeholder would depend on user permission level. It makes no sense.

I think the "no description" here makes no sense to end users, and it makes the UI looks ugly. So it's not bad to hide it for non-admin users.
It is different from the "no description"  in an empty issue, without that dummy message, the empty issue UI looks strange, so it is good to have it for everyone.

I do agree we should hide No description for all users like GitHub also does, if we can make the edit UI still available to users with that permission.

Removed the "no-description" in<PHONE_NUMBER>90ead469a1cdfc7fb2c912a6b7d851

The search code box seems strange ( no space to the filename, maybe it should be in the right side? also may need considering long file path) in file view page, maybe related to this PR?

-> Fix code search input for different views #30678


Ionic v2 - Beta 11 -  ion-checkbox triggering "ionChange" when the view enters.

Short description of the problem:
As soon as an ion-checkbox is rendered, beta 11 is now triggering its ionChange function.
<ion-checkbox item-right [(ngModel)]="item.checked"
                (ionChange)="RemoveRecipeFromDiary(item,menuType.name);"></ion-checkbox>

I didn't see any comments in the changelog about this directive being changed. Any idea what happened ?
Thanks
What behavior are you expecting?
I am expecting during init / first time the view enters, the checkbox's "ionChange" event shouldn't be fired.
Other information: (e.g. stacktraces, related issues, suggestions how to fix, stackoverflow links, forum links, etc)
N/A
Which Ionic Version? 2.x
Plunker that shows an example of your issue
PS: Plunker is at beta 10. Can you please update when you get a chance ?
Run ionic info from terminal/cmd prompt: (paste output below)
Cordova CLI: Not installed
Gulp version:  CLI version 3.9.1
Gulp local:   Local version 3.9.1
Ionic Framework Version: 2.0.0-beta.11
Ionic CLI Version: 2.0.0-beta.32
Ionic App Lib Version: 2.0.0-beta.18
ios-deploy version: 1.8.6
ios-sim version: 5.0.3
OS: Mac OS X El Capitan
Node Version: v0.12.7
Xcode version: Xcode 7.3.1 Build version 7D1014

I changed it to (click) for now with ngModel. This was probably my fault.
<ion-checkbox item-right [(ngModel)]="item.checked"
                (click)="RemoveRecipeFromDiary(item,menuType.name);"></ion-checkbox>

i am using ionChange event on textBox as
<ion-checkbox color="dark" [(ngModel)]="s.isTrue" (ionChange)="eval(s)">
But when i am printing the arguments in eval() unction ,I am getting an event (event details below)
_isAsync
:
false
_isScalar
:
false
closed
:
false
hasError
:
false
isStopped
:
false
observers
:
Array[0]
length
:
0
proto
:
Array[0]
thrownError
:
null
proto
:
e


Knative service can't federate properly.

What happened:
federate failed.
What you expected to happen:
federate success.
How to reproduce it (as minimally and precisely as possible):
First install k8s & knative,Then run some scripts below to deploy and federate a knative service.
cat <<EOF | kubectl apply -f -
apiVersion: serving.knative.dev/v1
kind: Service
metadata:
  name: stock-service-example
  namespace: default
spec:
  template:
    metadata:
      name: stock-service-example-first
    spec:
      containers:
      - image: registry.cn-chengdu.aliyuncs.com/kn-sample/rest-api-go
        env:
          - name: RESOURCE
            value: stock
EOF
kubefedctl enable services.serving.knative.dev --federated-group kubefed.serving.knative.dev

kubectl patch clusterrole kubefed-role --type='json' -p='[{"op": "add", "path": "/rules/1", "value": {
            "apiGroups": [
                "kubefed.serving.knative.dev"
            ],
            "resources": [
                "*"
            ],
            "verbs": [
                "get",
                "watch",
                "list",
                "update"
            ]
        }
}]'
kubefedctl federate namespace default
kubefedctl federate -n default ksvc stock-service-example

Run cmd kubectl logs -n kube-federation-system   kubefed-controller-manager-648f8dff-kqnft
got following message
E0922 00:12:03.580251       1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.6/tools/cache/reflector.go:125: Failed to list serving.knative.dev/v1, Kind=Service: the server could not find the requested resource

Environment:

Kubernetes version (1.18.6)
KubeFed version(0.3.1-113-g6eeeac232)
Scope of installation (cluster)

/kind bug

Is the kufedecluster healthy? Can you share the status of the federated service you just created?

@ysjjovo I would suppose that the Service CRD is missing on the target cluster.

@makkes Yes, serving.knative.dev/v1 needs to be federated to the target clusters.

Expanding on my comment a bit: @ysjjovo, you'd need to run something like
$ kubefedctl enable customresourcedefinitions.apiextensions.k8s.io
[...]
$ kubefedctl federate crd services.serving.knative.dev

Is the kubefedecluster healthy? Can you share the status of the federated service you just created?

Thanks for your reply!Federated service describe info below
[root@adm18 kn-istio]# kubectl get fksvc
NAME                    AGE
stock-service-example   124m
[root@adm18 kn-istio]# kubectl describe fksvc stock-service-example
Name:         stock-service-example
Namespace:    default
Labels:       <none>
Annotations:  <none>
API Version:  kubefed.serving.knative.dev/v1beta1
Kind:         FederatedService
Metadata:
  Creation Timestamp:  2020-09-21T22:18:19Z
  Generation:          1
  Managed Fields:
    API Version:  kubefed.serving.knative.dev/v1beta1
    Fields Type:  FieldsV1
    fieldsV1:
      f:spec:
        .:
        f:placement:
          .:
          f:clusterSelector:
            .:
            f:matchLabels:
        f:template:
          .:
          f:spec:
            .:
            f:template:
              .:
              f:metadata:
                .:
                f:creationTimestamp:
                f:name:
              f:spec:
                .:
                f:containerConcurrency:
                f:containers:
                f:timeoutSeconds:
            f:traffic:
    Manager:         kubefedctl
    Operation:       Update
    Time:            2020-09-21T22:18:19Z
  Resource Version:  14841
  Self Link:         /apis/kubefed.serving.knative.dev/v1beta1/namespaces/default/federatedservices/stock-service-example
  UID:               48443050-089a-4bb1-99ae-7667faeb9627
Spec:
  Placement:
    Cluster Selector:
      Match Labels:
  Template:
    Spec:
      Template:
        Metadata:
          Creation Timestamp:  <nil>
          Name:                stock-service-example-first
        Spec:
          Container Concurrency:  0
          Containers:
            Env:
              Name:   RESOURCE
              Value:  stock
            Image:    registry.cn-chengdu.aliyuncs.com/kn-sample/rest-api-go
            Name:     user-container
            Readiness Probe:
              Success Threshold:  1
              Tcp Socket:
                Port:  0
            Resources:
          Timeout Seconds:  300
      Traffic:
        Latest Revision:  true
        Percent:          100
Events:                   <none>

Expanding on my comment a bit: @ysjjovo, you'd need to run something like
$ kubefedctl enable customresourcedefinitions.apiextensions.k8s.io
[...]
$ kubefedctl federate crd services.serving.knative.dev

Thanks,I do as you say,it succesed!I don't understand why it works,because I already install crd services.serving.knative.dev on all of the member clusters.

@ysjjovo you need to enable the type.


impl Format for core::fmt::Arguments

I was using defmt today an I realised that there isn't an implementation for core::fmt::Arguments.
Is there a reason that it cannot be implemented?
I'm also interested in working on this.
PS: I know I can use Display2Format(&Arguments) but was curious to hear if there are particular reason why there isn't an impl for Arguments. I suspect that the reason is the potential size of the Arguments.

I don't see why we should not have a Format implementation for it. If I understand the docs correctly it will be evaluated during compile-time and not use core::fmt code on the device.
But I am wondering what is your usecase?

After publishing the issue I realised that Arguments cannot be stand-alone, still not sure why though...
I was looking for a way to use format_args! to create a single message to be used across defmt for logging and writing to a log file because right now I need to put it in something like heapless::String to remove the duplication.
Maybe implementing Format for Arguments is not needed as I it can't be used alone to be put in a variable?!

I am not sure if I understand @elpiel. Could you give an example of what you are trying to achieve?

Using formatting that's not supported by defmt, like floating point numbers with given precision info!("{}", format_args!("Battery: {0:.2}%", batter_percentage))

Now I understand. We opted for the adapter types (Display2Format and Debug2Format) because users won't accidentally use the inefficient formatting but need to opt into it explicitly.

Ok, got it, thanks!

Is there a way to do this, though? I'm trying to write panic messages for when core panicks and it doesn't get picked up by defmt automatically, and payload() is a black box of information that sometimes cannot be downref'd to a &'static str.


Update README.md

Changing path to diagram
What does this PR do?
Brief explanation of the code or documentation change you've made
How should this be manually tested?
Include commands to run your new feature, and also post-run commands to validate that it worked. (please use code blocks to format code samples)
Is there a relevant Issue open for this?
Provide a link to any open issues that describe the problem you are solving.
Who would you like to review this?
cc: @tomassedovic @bogdando PTAL

Just a doc change.


FFmpeg's nearly unlimited output causes ffmpeg-sidecar to hang without a timeout

I'm converting a video(with some strange .ts extension) to a 3-seconds gif using ffmpeg-sidecar. Command like
ffmpeg -loglevel level+warning -hide_banner -i "/path/to/bipbop-gear1-all.ts" -t 3 -an -vf "fps=10,scale=-1:200:flags=lanczos,split[s0][s1];[s0]palettegen=max_colors=164:stats_mode=diff[p];[s1][p]paletteuse=dither=floyd_steinberg:diff_mode=rectangle" -compression_level 9 -quality 85 -c:v gif -y "/path/to/thumbnail.gif"

However, ffmpeg cli output nearly unlimited lines of warning, like
[Parsed_palettegen_4 @ 0x600001574bb0] [warning] The input frame is not in sRGB, colors may be off
[Parsed_palettegen_4 @ 0x600001574bb0] [warning] The input frame is not in sRGB, colors may be off
...(tons of lines...)
[Parsed_palettegen_4 @ 0x600001574bb0] [warning] The input frame is not in sRGB, colors may be off
[Parsed_palettegen_4 @ 0x600001574bb0] [warning] The input frame is not in sRGB, colors may be off

but, ffmpeg cli just exits(not sure exit 0 or not 0) after about ~7 seconds, which I think reasonable.
When it comes to ffmpeg-sidecar in Rust
    let exit_status = FfmpegCommand::new()
        .args([
            "-loglevel", "level+warning",
            "-hide_banner",
            "-i", filepath,
            "-t", "3",
            "-an",
            "-vf", "fps=10,scale=-1:200:flags=lanczos,split[s0][s1];[s0]palettegen=max_colors=164:stats_mode=diff[p];[s1][p]paletteuse=dither=floyd_steinberg:diff_mode=rectangle",
            "-compression_level", "9",
            "-quality", "85",
            "-c:v", "gif",
            "-y",
            &thumbnail_path_buf.to_string_lossy()
        ])
        .spawn()?
        .wait()?;

    if exit_status.success() {
        Ok(...)
    } else {
        Err(...)
    }

FfmpegCommand(FfmpegChild maybe) thread just hangs at .wait()?
Maybe adding timeout parameter would be better? like the ffmpeg cli do internally? Or, I have to set a timer, and invoke handle FfmpegChild.quit/kill(maybe) when timeout, not very convenient.
You can download the test video at http://www.live555.com/liveMedia/public/h264-in-mp2t/bipbop-gear1-all.ts

Thanks for providing a test video, I will take a look.


Getting Error in cupy module(cupy.append())

Getting Error in cupy module(cupy.append()):-
error:- Getting Error in cupy module(cupy.append())
full error:- File "GPU_Code_CUML.py", line 478, in
result = sse_numba(symbol,look_back)
File "GPU_Code_CUML.py", line 420, in sse_numba
actual_price_start_date_plus_five = cupy.append(actual_price_start_date_plus_five, ['nan'], axis=None)
AttributeError: module 'cupy' has no attribute 'append'
This was my code line in which i am getting error:-
actual_price_start_date_plus_five = [218.39 211.01 216.55 215.44 216.51 217.23 214.46 211.08
212.42 210.39 210.11 213.86 213.87 213.86 213.87 215.23 214.07 216.21
215.37 214.24 214.36 214.29]
actual_price_start_date_plus_five = cupy.append(actual_price_start_date_plus_five, ['nan'], axis=None)
and i want to append "nan" five time in actual_price_start_date_plus_five.
Where I am doing wrong and how to use cupy.append in my code.
link cupy = "https://docs.cupy.dev/en/v9.0.0a2/reference/generated/cupy.append.html#cupy.append".

Conditions (you can just paste the output of python -c 'import cupy; cupy.show_config()')

CuPy version = 8.1.0
OS/Platform = Ubuntu 18.04 amd64(AWS)
CUDA version = 10.1
cuDNN version (V == 7.6)

Code to reproduce
Error messages, stack traces, or logs

cupy.append() was just added recently (#4112), so it won't be available in CuPy v8.x. If needed you can pip install the pre-release versions (v9.0.0b1, for example).

Can you suggest to me how to update the cupy version on the conda environment?
Because I download rapids through conda.
cmd:-
conda create -n rapids-0.17 -c rapidsai -c nvidia -c conda-forge
-c defaults rapids-blazing=0.17 python=3.7 cudatoolkit=10.1
So should I try...... conda install cupy==v9.0.0b1?

The pre-release versions are not available on any of the conda channels, so you must install it via pip. You can safely do so in a conda environment and usually it'd just work. The caveat in your case is that the RAPIDS stack depends on CuPy from conda-forge, so you should force-remove it first (otherwise all packages depending on it would also be removed), and then do pip install 'cupy-cuda101==v9.0.0b1'. This should work (though I didn't try).

As this issue seems to be solved, let us close this. Feel free to reopen it if needed 😄

As this issue seems to be solved, let us close this. Feel free to reopen it if needed 😄


[Sample] Add a policy for Consul Service Mesh for TLS Min - Mesh Configuration

Problem Statement
We want to create a policy for Consul service mesh to add a policy for the mesh configuration. The policy will check the TLS Min version to ensure that whenever the mesh is configured, there is a minimum version of TLS set for all the service mesh proxies.
Solution Description
Here is an example of a sample policy:
apiVersion: kyverno.io/v1
kind: ClusterPolicy
metadata:
 name: consul-mesh-policy
 annotations:
   policies.kyverno.io/title: Consul TLS Min
   policies.kyverno.io/category: Service Mesh Policy Check
   policies.kyverno.io/severity: medium
   policies.kyverno.io/subject: 'Service Mesh'
   policies.kyverno.io/description: >-
     This policy will check the TLS Min version to ensure that whenever the mesh is configured, there is a minimum version of TLS set for all the service mesh proxies.
spec:
 validationFailureAction: enforce
 background: true
 rules:
   - name: check-for-tls-version
     match:
       resources:
         kinds:
           - Mesh
     validate:
       message: The minimum versior of TLS is TLS v1_2
       pattern:
         spec:
             tls:
               incoming:
                 tlsMinVersion: TLSv1_2

Example "Good" Resource
No response
Example "Bad" Resource
No response
Other Comments
https://developer.hashicorp.com/consul/docs/connect/config-entries/mesh
Slack discussion
https://kubernetes.slack.com/archives/CLGR9BJU9/p1667314129192989
Troubleshooting

[X] I have read and followed the documentation AND the troubleshooting guide.
[X] I have verified the policy does not exist in the samples library.

cc @ashwinexe

Please follow the contribution guidelines and open a PR against this repository. Please add one positive (passing) and one negative (failing) test case using the Kyverno CLI. There are many examples in this repo of such tests which you may use to model yours.

Closed in #474


？？？

same as github.com/djimenez/iconv-go  ？？？？？？？？

Chinese branded making it different :P

There is no FOLK concept in Chinese

Apparently, they need to learn how to use "folk".

Apparently, they need to learn how to use "fork".


product refresh

product refresh

I work at google (yyzhang@google.com).  please grant me cla.  thanks

@y33zhang for CLA bot to recognize you, you need to register your github username at go/github and use your @google.com address to author your commits.

ahh, noob github user here ;).  Is there a way to retroactively set my google.com address on previous commits?

@y33zhang, yeah you can git commit --amend --author="Author Name<EMAIL_ADDRESS>

@daspecster thanks a lot, just amended the commit email address.  Is there anything else I need to do to get past the cla check?

Well that was easy! LGTM modulo the misspelling.
We can merge over the CLA-bot issue.

I couldn't find those new types in the API docs?

@daspecster - those are getting updated later today

@dhermes - still can't get cla check to pass.  can you help merge over the cla issue?  thanks!

@dhermes - can you help provide an ETA on when the docs will be refreshed/updated on the live site?  Thanks!

https://googlecloudplatform.github.io/google-cloud-python/latest/storage-buckets.html#google.cloud.storage.bucket.Bucket.storage_class
https://googlecloudplatform.github.io/google-cloud-python/latest/storage-blobs.html#google.cloud.storage.blob.Blob.storage_class

You just made me realize that readthedocs.org is not picking up the correct version (probably due to dependency caching). When I fix that the RTD docs will also be updated at:
http://google-cloud-python.readthedocs.io/en/latest/storage-buckets.html
http://google-cloud-python.readthedocs.io/en/latest/storage-blobs.html

Just because the docs are updated doesn't mean the google-cloud-storage package on PyPI is. We'd need to do a release for that.


Add Fedora support for command-not-found plugin

Fedora support by comment from this issue to close #3482.
/cc @robbyrussell

@robbyrussell how I can with this PR? :)

This is an identical copy of the solution provided in this comment in @ai's linked issue, so I don't think it needs any more proof.
/cc @robbyrussell: good to go! :+1:

@robbyrussell any updates :)

@robbyrussell what is block this PR for merge?

Hi @ai, we'll get this merged soon.


Fix install locations for pkgconfig and cmake

Per @eli-schwartz's recommendations, this PR fixes the pkgconfig file locations. In an attempt to also future-proof it for CMake's config files, we now install them to libdir as well.

@slurps-mad-rips I was reading the CMake files more closely - after this change, there are still two references to CMAKE_INSTALL_DATADIR. Is this intentional? Should they point to LIBDIR as well or not? The second in particular refers to ${CMAKE_INSTALL_DATADIR}/cmake/pugixml and I'm not sure how this interacts with references to ${CMAKE_INSTALL_LIBDIR}/cmake/pugixml elsewhere.

Ahh damn. You're right. That will make it an issue. It needs to be changed to CMAKE_INSTALL_LIBDIR for those values as well. I'll have a PR up in a moment


NOWTICE ME MEMEHOOVY WEMEHOOVY UWU

AAAAAAAAAAAAAAAAAAA

You simp too hard

AAAAAAAAAAAAAAAAAAA

You simp too hard

Yeah this is just too much


[Feature Request] set $segment for fetchOperations

Feature Request
What's the feature you think Backpack should have?
I try to explain my situation.
Our admin panel is huge and complex and so we grouped routes.
Every controller group has a prefix and a name
So we have routes like users/activity/create
instead of activity/create
and names of users.activity.create
instead of activity.create
So in un activity controller we have
CRUD::setRoute(config('backpack.base.route_prefix') . 'users/activity');

But when we use fetchOperations, we loose the name.
we have users/activity/fetch/students named only as activity.fetchStudents
The problem is: we have also an ActivityController under manager (name and prefix).
In this 2nd controller, in a different folder and namespace, we CANNOT have another specific fetchStudents function because this will always create a route named activity.fetchStudents
So i think that

setupFetchOperation should take in care what setRoute has already setup instead of using only singular entity name as segment
a documented way to workarounde this

Have you already implemented a prototype solution, for your own project?
I actually workaround overriding setupFetchOperationRoutes
Do you see this as a core feature or an add-on?
fetch it's already part of pro addon

Hey @realtebo I've been investigating the possibility you proposed and it's not feasible. We already pass the $segment into fetch operation route setup:
protected function setupFetchOperationRoutes($segment, $routeName, $controller)
    {
        // get all method names on the current model that start with "fetch" (ex: fetchCategory)
        // if a method that looks like that is present, it means we need to add the routes that fetch that entity
        preg_match_all('/(?<=^|;)fetch([^;]+?)(;|$)/', implode(';', get_class_methods($this)), $matches);

        if (count($matches[1])) {
            foreach ($matches[1] as $methodName) {
                Route::post($segment.'/fetch/'.Str::kebab($methodName), [
                    'as'        => $segment.'.fetch'.Str::studly($methodName),
                    'uses'      =><EMAIL_ADDRESS>                    'operation' => 'FetchOperation',
                ]);
            }
        }
    }

At the time the routes are setup the setRoute() in setup() hasn't run yet.
I think the "easy" workaround is to name your fetch methods differently. fetchUserStudents and fetchManagerStudents. That way you will have the distinction and non-conflicting names.
Another solution is like you did, overwrite the setup of the routes and customize the generated names as needed.
Sorry can't provide much more help here.
Cheers


[Question] Is icloud-drive-docker usable when Advanced Data Protection is enabled ?

Hi ! Sorry if it's the wrong place to ask, did not found anywhere else to ask this question.
I assume that icloud-drive-docker will cease working if I turn on Advanced Data Protection, hence enabling e2e encryption for iCloud Drive files and iCloud Photos files. Am I correct ? Or is there any way to give icloud-drive-docker the ability to use the e2e encryption key ?
Thanks !

Sorry, duplicate.


Invalid id token when try to login on My Account or Console

Description:
When the IS is deployed using the operator, cannot log in to My Account and the new Console (Can only log into the old carbon console)
Suggested Labels:
bug
Affected Product Version:
Tested with IS 5.11.0 and possibly affect versions 6.x.x. too
OS, DB, other environment details and versions:

Ubuntu 22.04.2 LTS
minikube v1.29.0 on Ubuntu 22.04
Kubernetes v1.26.1 on Docker 20.10.23

Steps to reproduce:

Deploy the IS using the operator
Go to https:///myaccount page and enter credentials of a user to login
Receive error in browser console saying Uncaught (in promise) Invalid id_token in the token response:....

Description:
When the IS is deployed using the operator, cannot log in to My Account and the new Console (Can only log into the old carbon console)
Suggested Labels:
bug
Affected Product Version:
Tested with IS 5.11.0 and possibly affect versions 6.x.x. too
OS, DB, other environment details and versions:

Ubuntu 22.04.2 LTS
minikube v1.29.0 on Ubuntu 22.04
Kubernetes v1.26.1 on Docker 20.10.23

Steps to reproduce:

Deploy the IS using the operator
Go to https:///myaccount page and enter credentials of a user to login
Receive error in browser console saying Uncaught (in promise) Invalid id_token in the token response:....

I'm working on this to find a solution

Closing this because fixed by https://github.com/wso2/k8s-wso2is-operator/pull/17


RuntimeError: Error(s) in loading state_dict for DetectionModel

Describe the bug
Error occur when training process finish. I ran training with script below:
sparseml.yolov5.train \
  --cfg yolov5s.yaml \
  --data ./datasets/RDRR/RDRR.yaml \
  --batch-size 64 --patience 50 --imgsz 256 \
  --recipe ./v5sparse/recipe/v5s/pruned85_quant.md \
  --hyp ./yolov5-master/data/hyps/hyp.scratch-low.yaml \
  --weights zoo:cv/detection/yolov5-s/pytorch/ultralytics/coco/base-none \
  --gradient-accum-steps 4 --optimizer SGD \
  --project yolov5-deepsparse --name yolov5s-sgd-pruned85-quantized-original

recipe is downloaded from sparsezoo, hyp file is from neuralmagic's yolov5 fork.
Training process is fine until ....
Model summary: 214 layers, 7111327 parameters, 7111327 gradients, 16.2 GFLOPs

Traceback (most recent call last):
  File "/home/joshua/v5sparse/bin/sparseml.yolov5.train", line 8, in <module>
    sys.exit(train())
  File "/home/joshua/v5sparse/lib/python3.8/site-packages/torch/distributed/elastic/multiprocessing/errors/__init__.py", line 345, in wrapper
    return f(*args, **kwargs)
  File "/home/joshua/v5sparse/lib/python3.8/site-packages/sparseml/yolov5/scripts.py", line 41, in train
    train_run(**vars(opt))
  File "/home/joshua/v5sparse/lib/python3.8/site-packages/yolov5/train.py", line 731, in run
    main(opt)
  File "/home/joshua/v5sparse/lib/python3.8/site-packages/yolov5/train.py", line 631, in main
    train(opt.hyp, opt, device, callbacks)
  File "/home/joshua/v5sparse/lib/python3.8/site-packages/yolov5/train.py", line 496, in train
    model = attempt_load(f, device)
  File "/home/joshua/v5sparse/lib/python3.8/site-packages/yolov5/models/experimental.py", line 87, in attempt_load
    else load_sparsified_model(ckpt, device=device or "cpu")
  File "/home/joshua/v5sparse/lib/python3.8/site-packages/yolov5/utils/neuralmagic/utils.py", line 116, in load_sparsified_model
    model.load_state_dict(ckpt["ema"] or ckpt["model"], strict=True)
  File "/home/joshua/v5sparse/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1604, in load_state_dict
    raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format(
RuntimeError: Error(s) in loading state_dict for DetectionModel:
        Missing key(s) in state_dict: "model.0.conv.quant.activation_post_process.scale", "model.0.conv.quant.activation_post_process.zero_point", "model.0.conv.quant.activation_post_process.fake_quant_enabled", "model.0.conv.quant.activation_post_process.observer_enabled", "model.0.conv.quant.activation_post_process.scale",

I made some omissions because the key is too long.
Expected behavior
The script should train and save the model perfectly.
Environment
Include all relevant environment information:

OS : Ubuntu 20.04
Python version: 3.8
SparseML version or commit hash: sparseml==1.4.2
ML framework version(s): torch==1.12.0+cu116
Other Python package versions [e.g. SparseZoo, DeepSparse, numpy, ONNX]:

yolov5==6.2.0
torchvision==0.13.0+cu116
onnx==1.12.0
onnxruntime==1.14.1

Errors
I put the full error message into error.txt.
error.txt
How can I fix this?

Hi @JueXiuHuang
We wanted to follow up with you and see if you're able to provide confirmation on the recipe used? Thank you so much!
Jeannie / Neural Magic

As it's been some time with no further comments @JueXiuHuang , we are going to go ahead and close this issue. If you would like to continue the conversation, please re-open the issue.
Thank you!
Jeannie / Neural Magic


Unnecessary big Fields

Fields like the lastUpdate or lastBBoxUpdate in FhysicsObject.kt dont need ot be an Int they can easily work as a Short or less.

To insignificant.
Plus lastBBoxUpdate was removed. the only remaining fields like this is lastUpdate. Implementing this suggestion would only save 6003Bytes with 2000 objects.


Check AgendaBasedSimulator against KDD implementation

See https://github.com/iai-group/UserSimConvRec/blob/master/simulation/user/movies/movies_simulated_user.py

Closing this issue as the current implementation seems to consider the same cases as the KDD implementation.


Can't save files with new 9.2 version most of the time

Open a file via right click (Edit with Visual Code)

Save (or "save as root" extension)

get Error, see below

did not get that error with 9.0 and 9.1

Error Messages:
Process returned exit code 1:
dd: failed to open '/home/jack/docker/homepage/config/services.yaml': Permission denied
-bash: line 37: /home/jack/docker/homepage/config/services.yaml: Permission denied
io.xpipe.core.process.ProcessOutputException: Process returned exit code 1:
dd: failed to open '/home/jack/docker/homepage/config/services.yaml': Permission denied
-bash: line 37: /home/jack/docker/homepage/config/services.yaml: Permission denied
at io.xpipe.core.process.ProcessOutputException.of(ProcessOutputException.java:53)
at io.xpipe.ext.proc.a.a(SourceFile:432)
at io.xpipe.ext.proc.a$2.close(SourceFile:115)
at io.xpipe.app.util.FileBridge.lambda$openIO$5(FileBridge.java:206)
at io.xpipe.app.util.FileBridge.handleWatchEvent(FileBridge.java:99)
at io.xpipe.app.util.FileBridge.lambda$init$0(FileBridge.java:59)
at io.xpipe.app.core.AppFileWatcher$WatchedDirectory.handleWatchEvent(AppFileWatcher.java:189)
at io.xpipe.app.core.AppFileWatcher$WatchedDirectory.update(AppFileWatcher.java:154)
at io.xpipe.app.core.AppFileWatcher.lambda$startWatcher$1(AppFileWatcher.java:75)
at java.lang.Thread.run(Thread.java:1583)
I'm on mac installed with homebrew

So according to the error, it can't open the file. If you open a terminal in that directory, and try to edit the files manually, does that also happen? What are the file permissions on that file? Is that a local file or remote?

So how are you opening the file browser session? You should be able to open any directory as root in xpipe. If you are opening it as a normal user, then according to the permissions this fails as intended.
There should have been no changes to this behavior in 9.2, at least not intentional. Can you try downgrading to 9.1, maybe by downloading a separate portable version, and check this in 9.1?

Yeah so you would either have to change the owner of that file or use the button in the file browser to open a directory as root and edit it in that session.


Custom build

This should enable anyone to fine-tune their kontra Sprite file to only include the functionality they want. Enabled through https://github.com/straker/rollup-plugin-kontra.
// rollup.config.js
import kontra from 'rollup-plugin-kontra'

export default {
  entry: 'entry.js',
  dest: 'bundle.js',
  plugins: [
    kontra({
      // enable only velocity and rotation functionality
      velocity: true,
      rotation: true
    })
  ]
}

Coverage remained the same at 100.0% when pulling 6e29cac85219204400132f8ec8278d5fc51ba552 on customBuild into 16e349fa90916cf40915a0fd08e0377dd77e7221 on v7.


Feature request: Allow "Custom configuration" for proxy and such, but require specific GUI access for this

I have a feature request, and that is to add a "Custom configuration" option for all items including Proxy and such.
But, since this allow the GUI user to execute arbitary commands as discussed here:
https://forum.opnsense.org/index.php?topic=6516.0
I would suggest adding a extra option inside:
Effective Privileges
which is called: GUI --> Custom config
That is default off for all except the "System administrator" default account (even if you create a new account with Administrator privileges) and then you have to manually add that privilege to allow custom configs.

Sorry, we're not going to add custom entries in the configuration, administrators can deploy their own overwrites using the mechanisms in place:
https://github.com/opnsense/core/blob/master/src/opnsense/service/templates/OPNsense/Proxy/squid.conf#L281-L282
https://github.com/opnsense/core/blob/master/src/opnsense/service/templates/OPNsense/Proxy/squid.conf#L291-L292

franco said it could be discussed, and I think its a easier solution if you could just change it from web interface.
By requiring a specific privilege that must manually added to user account, you avoid the main problem with "Arbitary code execution" as the privilege is default off for every user and must be enabled by system administrator.
For even more security, the privilege could be locked so only system administrator (the default account) can add that privilege, so even a user with privilege editing rights cannot add that privilege.

There are more problems with leaving arbitrary configuration entries in the configuration, they might break working setups after upgrades, leading to people complaining about issues which are close to impossible to catch.
Personally, I wouldn't suggest adding custom text input to core, since it encourages user to copy-paste arbitrary data into their configuration which they might not always understand and is eventually impossible to validate using any model.
Usually the best approach is to functionally describe the feature you're seeking, sometimes it's rather easy to just add a checkbox or some input to help people out and make things accessible for the next use seeking something similar. During the course of time we've added more features for people.
In case you really need a plain squid.conf file for your application, there are two different options in my opinion:

Use custom templates like described earlier
Build a plugin which injects your config text it into the configuration, specifically for your needs, which we might gain a spot in our plugins repository as long as it comes with a [very] big disclaimer.

Hm, does that mean I can include custom config related before and after authentication phase? Like custom regexp blacklists?

Yes, flat files or generated content. We do have several web proxy plugins after all. ;)

I think I have a great idea <3


reduce mem multiplier for blast pulsar jobs

using 3.3 means that each job gets slightly more than a quarter of the RAM and only three jobs can run at a time.  Reduce it to 3.1 so that a 4th job can fit.

I remember us calculating that in the office.  I think the discrepancy is because we didn't factor the difference between 1000 and 1024


Translate architecture/config into Japanese

refs #105

Coverage remained the same at 87.72% when pulling 220a0a4875c7185d1f7da6e7b1ef5dbd06de10c1 on translate-doc/architecture/config into ca8ca45af80b3843a1a12802bcc55a04c147f5df on develop.

LGTM 👍


Delete an XP Entry vs. minus amount

Evening, just a simple question.  Doing an audit on my server, and I have some entries in the !xp system; is there a way to delete an entry in the xp log or do you have to just minus the entry out?
Thanks in advance!!!!!

You can edit the cvar to remove a log entry, but the point of the log is to keep track of all changes, even mistakes, so there's no built-in delete function.

Ok, makes sense. Thank you for the reply!!!!!Sent from my iPhoneOn Feb 5, 2024, at 7:08 AM, Byron Pettigrew @.***> wrote:
You can edit the cvar to remove a log entry, but the point of the log is to keep track of all changes, even mistakes, so there's no built-in delete function.
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: @.***>


feat: Created items database in server and updated context

Describe your changes
New items route that stores items array. Refactored ItemsContext file to fetch data from items route in the server.
Issue ticket number and link
ISSUE #36
https://github.com/kbventures/ecommerce/issues/36
Name of Contributor
@rickansen
Type of change
New feature and Refactor
Please delete options that are not relevant.

[x] New feature (non-breaking change which adds functionality)
[x] Breaking change (fix or feature that would cause existing functionality to not work as expected)

Checklist before requesting a review

[x] I have performed a self-review of my code
[ ] I have commented my code, particularly in hard-to-understand areas
[x] My code does not generate any new warnings or errors
[ ] New and existing unit tests pass locally with my changes (if relevant)

Overall looks good! Left a comment on a few things and after that I can merge it in.


Any idea to how get Canvas content and save this as an image?

https://github.com/nativescript-community/ui-canvas/blob/6e76d7b305938f7638d2071f62306de717465c6b/src/canvas.ios.ts#L1240
I see that the setBitmap are not present in iOS, do you have any workaround for this scenario?
Thks!

you are trying to save a CanvasView to image ?

this should work https://github.com/enchev/nativescript-screenshot

you are trying to save a CanvasView to image ?

Yep, I drew something in my Canvas and now I want get the image to send them using social share

this should work https://github.com/enchev/nativescript-screenshot

I'm already looking to this plugin but in fact, I think that it's not I want

@luiguild then explain in more details what you want to achieve . maybe with code ?

So, for an example, I have a Canvas in my view, I draw something nice and after that I would "export" that draw to a "jpg"/"png" file. In the Canvas Web API we can do it getting the blob content, it would be a way also...

@luiguild I created an extended class of CanvasView and did something like this in it:
getScaledImage(scale: number = 2.5): ImageSource {
        const canvas = new Canvas(Math.round(this.canvasWidth * scale), Math.round(this.canvasHeight * scale));
        const width = canvas.getWidth();
        const height = canvas.getHeight();
        if (isIOS) {
            canvas.scale(1, -1, width / 2, height / 2);
        }
        this.draw(canvas, width / this.getMeasuredWidth(), true);
        const src = new ImageSource();
        src.setNativeSource(canvas.getImage());
        return src;
}

I dont do my drawings in an external callback function but I do it in other subclasses with a custom function:
protected draw(canvas: Canvas, ratio: number, forImage?: boolean): void {

}

@luiguild I forgot to mention these:
get canvasWidth(): number {
    return this.getMeasuredWidth() / this.density;
}

get canvasHeight(): number {
    return this.getMeasuredHeight() / this.density;
}

@stemyke @luiguild sorry to come back late on this.
There is actually already a much simpler way to do this Canvas.getImage
You can see an example here and the image is saved in the phone gallery here

@farfromrefug Yes, but I wanted it to be scaled. I am already using canvas.getImage() in it.

@stemyke i think i did it in my example app, right? But glad you got it


Long transpile time for simple circuits

Environment

Qiskit Terra version:  0.39.4
Python version: 3.7.9
Operating system: Darwin

What is happening?
Transpiling a simple circuit for a 100+ qubit IBM System such as 'ibm_sherbrooke' takes way longer than expected.
I am attaching here the diagram of the circuit that was used and the result of profiling the transpiling time of the circuit against 'ibm_sherbrooke'.

How can we reproduce the issue?
from qiskit import *
from qiskit_ibm_provider import IBMProvider
import numpy as np

qc = QuantumCircuit(4)
qc.rx(np.pi*0.95, range(4))
qc.measure_all()

prov = IBMProvider()
backend = prov.get_backend('ibm_sherbrooke')

%%prun
qc_trans = transpile(qc, backend, optimization_level=3)

What should happen?
I don't think that it should take that long.
Any suggestions?
No response

I think this will be fixed by: https://github.com/Qiskit/qiskit-terra/pull/9148 based on the profile timings there it looks like it's being caused by vf2layout trying really hard to try to find which permutation of qubits have the lowest noise in a very naive way. For your circuit it's basically evaluating 10334625 different possible layout permutations which takes a long time. #9148 should fix this by figuring out the lowest noise qubits and selecting those directly.

Hi Matthew, thanks for the reply. 10334625 is definitely a huge number of options! ;) Glad to hear that there is already a fix for it!


Fix build process with bazel version 0.20.0

http_archive and git_repository commands were deprecated as native built-ins. The 2 load commands add that functionality back with a drop-in replacement. See: https://docs.bazel.build/versions/master/be/workspace.html#git_repository for info docs.
Also ignoring .idea folder

I didn't check on 0.18, but I figure anyone starting up from scratch will
be on 0.20+ if it's buildable on it.
On Mon, Dec 3, 2018 at 1:55 PM Simon Yun<EMAIL_ADDRESS>wrote:

@simonyun requested changes on this pull request.
In .gitignore
https://github.com/ConsultingMD/fhir/pull/3#discussion_r238452164:

@@ -3,3 +3,4 @@

Ignore IntelliJ + Bazel project files
.ijwb/
+.idea/
nit: can you move this up one line to keep things sorted?
In WORKSPACE
https://github.com/ConsultingMD/fhir/pull/3#discussion_r238452466:

@@ -1,5 +1,8 @@
workspace(name = "com_google_fhir")

+load("@bazel_tools//tools/build_defs/repo:http.bzl", "http_archive")
i'm assuming this doesn't break anything in 0.18; did you verify?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/ConsultingMD/fhir/pull/3#pullrequestreview-180998330,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ATncikTbf7K5Y8R7Z7Rj__p43n8P8EEIks5u1Z20gaJpZM4Y_eUn
.


Please update the isError public

Thanks for this pod and all your effort.
I was using the older version (0.1.9) when I tried to update the pod to version(0.3.0).
I found out that isError variable is Private.
I'm doing the OTP code check at server side, so I have to wait for the API response to show error or proceed with my flow.
Could you please fix this or provide another solution for it?
Appreciate your quick response. Thanks!

Hello, thank you for your feedback.
I see, yes it is a bug, please use the older one version.
I will fix that in the next release.

The problem has been fixed, please update to the latest version.


Docstring comments

Fake branch to comment on docstrings.

Codecov Report
Attention: 46 lines in your changes are missing coverage. Please review.

Comparison is base (622bdd6) 89.47% compared to head (f3b5602) 90.73%.
Report is 64 commits behind head on beta/v4.0.

Files
Patch %
Lines

weaviate/collections/classes/aggregate.py
50.84%
29 Missing :warning:

weaviate/collections/classes/filters.py
83.87%
10 Missing :warning:

weaviate/collections/classes/config.py
81.81%
2 Missing :warning:

weaviate/collections/batch/rest.py
0.00%
1 Missing :warning:

weaviate/collections/collections.py
85.71%
1 Missing :warning:

weaviate/collections/data.py
50.00%
1 Missing :warning:

weaviate/collections/filters.py
90.00%
1 Missing :warning:

weaviate/connect/v4.py
66.66%
1 Missing :warning:

Additional details and impacted files
@@              Coverage Diff              @@
##           beta/v4.0     #799      +/-   ##
=============================================
+ Coverage      89.47%   90.73%   +1.25%
=============================================
  Files            175      168       -7
  Lines          18407    17824     -583
=============================================
- Hits           16470    16172     -298
+ Misses          1937     1652     -285

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


BTC fee rate set lower then expected - caching issue?

This happens sometimes for both BTC transfers and Ordinal sends and played a role in what was described here: https://github.com/hirosystems/wallet/issues/3639 the fix for that does not solve this issue.
Fee selection options are lower than one would expect based on current activities. In the case of Ordinals sends no fee-options are available (yet) but a similar issue can occur.
In a recent case fees were set to ~15 sat/vB while the fees at the time were nowhere near that: closer to 100 sats/vByte.
I noticed this once myself after having signed out and signed in again, there was no difference but reinstalling the wallet resulted in the fee selection page showing the correct fee options (based on mempool averages of that moment). Could this be a caching issue? I thought we cleared that on sign out already.
Fara already did some digging and found:

This does not always occur, and I have not been able to reliably reproduce. If the cause/solution can't be pinpointed perhaps these enhancements can get priority instead to make it easier for users to deal with a situation like this:

Increase fee (RBF): https://github.com/hirosystems/wallet/issues/3416
Set custom fee: https://github.com/hirosystems/wallet/issues/3597  (especially helpful when RBF-ing)
Set custom fee when sending Ordinals: https://github.com/hirosystems/wallet/issues/3655

@314159265359879 are you still seeing this reported. The issue seems quite old. We've done work on fees recently, and are about to release custom fees. The query options are set to:
staleTime: 1000 * 60,
refetchOnWindowFocus: false,
refetchOnMount: false,

@kyranjamie I know you've made some changes to fees recently, do you think this issue might be outdated?

@fbwoolf I saw a case last week when there was a sudden (~day long) spike in bitcoin activity. I was unable to determine what version of the wallet they were using but assume a recent one. It is possible we have seen less cases because it is mostly fixed by the changes or because the fee market has been less erratic/volatile.
I think it is safe to close this when RBF is live because then there is a clear/accepted workaround anyway.

Let's place this in the backlog for now then and return to it for prioritization post-RBF if it's still relevant.


revisions don't play nice with dependencies that were installed with "--devel"

Basically, if formula B depends on formula A, and A has been installed with --devel, then B won't recognize A's installation unless A isn't marked with a revision.
This problem currently exists with GHC and cabal-install, but you can verify the problem with a much easier-to-use pair of formulae: tomcat and tomcat-native. If you brew install --devel tomcat, then brew missing tomcat-native will report that nothing is missing and brew install tomcat-native will even build successfully. However, if you edit the tomcat formula so that it has a revision, then brew missing tomcat-native will still report that nothing is missing but upon running brew install tomcat-native it will try to install tomcat as a dependency.
For example, running brew install --devel tomcat on the following formula will install Tomcat 8 to /usr/local/Cellar/tomcat/8.0.5_2 (note the "_2" suffix)
require 'formula'

class Tomcat < Formula
  homepage 'http://tomcat.apache.org/'
  url 'http://www.apache.org/dyn/closer.cgi?path=tomcat/tomcat-7/v7.0.53/bin/apache-tomcat-7.0.53.tar.gz'
  sha1 '269a01f03ed22e5ad7fa33dec300ef40cac96440'
  revision 2

  option "with-fulldocs", "Install full documentation locally"

  devel do
    url "http://www.apache.org/dyn/closer.cgi?path=tomcat/tomcat-8/v8.0.5/bin/apache-tomcat-8.0.5.tar.gz"
    sha1 "dc21157e8577132999f090859be2c4468e841c23"

    resource "fulldocs" do
      url "http://www.apache.org/dyn/closer.cgi?path=/tomcat/tomcat-8/v8.0.5/bin/apache-tomcat-8.0.5-fulldocs.tar.gz"
      version "8.0.5"
      sha1 "8d27a447e1d38d6491d47e15d66c4bc9b03ef55f"
    end
  end

  resource 'fulldocs' do
    url 'http://www.apache.org/dyn/closer.cgi?path=/tomcat/tomcat-7/v7.0.53/bin/apache-tomcat-7.0.53-fulldocs.tar.gz'
    version '7.0.53'
    sha1 '4a6585ee59d7fef1e144652227986f9e390b048c'
  end

  # Keep log folders
  skip_clean 'libexec'

  def install
    # Remove Windows scripts
    rm_rf Dir['bin/*.bat']

    # Install files
    prefix.install %w{ NOTICE LICENSE RELEASE-NOTES RUNNING.txt }
    libexec.install Dir['*']
    bin.install_symlink "#{libexec}/bin/catalina.sh" => "catalina"

    (share/'fulldocs').install resource('fulldocs') if build.with? 'fulldocs'
  end
end

It's plausible that the actual issue isn't with the dependency-resolution; perhaps revision-versions are being mistakenly propagated. If that's the case, what do you think about being able to put revisions into {stable,devel,head} do blocks?

We'll accept PRs for this but we're not actively working on it at this time.


cannot remote debug

Try to remote debug...
Action: appService.StartRemoteDebug
Error type: Error
Error Message: Unable to establish connection to application: WebApp is started, but port is unreachable

Version: 0.10.0
OS: darwin

Repro steps:

deploy a simple express/node app to app services on a B1 plan
set a breapoint in routes/index.js
right click on site and choose Start Remote Debugging

Results in the Output pane for App Services:
Fetching site configuration...
Checking app settings...
Updating site configuration to set remote debugging...
Updating site configuration done...
Starting tunnel proxy...
[WebApp Tunnel] Checking status, body: {"port":2222,"state":"STARTED","canReachPort":true,"msg":""}
[WebApp Tunnel] Checking status, body: {"port":49494,"state":"STARTING","canReachPort":false,"msg":"Unable to connect to WebApp"}
[WebApp Tunnel] Checking status, body: {"port":49494,"state":"STARTING","canReachPort":false,"msg":"Unable to connect to WebApp"}
[WebApp Tunnel] Checking status, body: {"port":49494,"state":"STARTING","canReachPort":false,"msg":"Unable to connect to WebApp"}
[WebApp Tunnel] Checking status, body: {"port":49494,"state":"STARTED","canReachPort":false,"msg":"Unable to connect to WebApp"}
Error: Unable to establish connection to application: WebApp is started, but port is unreachable

This is a limitation of overriding npm start on older node images and a fix is being tested in<EMAIL_ADDRESS>Since you're using the default express generator scaffolded app, you'll need to be on node runtime version 10.1.0 or override your debug start command so that app service can correctly initialize the app for debugging.
Try this again on 10.1.0 and verify that you're able to connect.

I'm going to close this since it's a known limitation of the existing images. See #774 for the updated start config shipping more broadly.


[FEATURE] Singular and _search api for Conversational Memory

Background
We created a Conversational Memory CRUD API per #1150 to deal with long term storage of conversations for conversational applications. In this API, we identify two resources: ConversationMeta, and Interaction. A ConversationMeta contains some information about the Conversation as a whole, whereas an Interaction is the (call-and-response) individual unit of a Conversation - a Conversation is made up of Interactions. We store ConversationMetas and Interactions in two separate indices.
Is your feature request related to a problem?
We need singular APIs to get just one Interaction or one ConversationMeta
We also need a _search endpoint for ConversationMetas and Interactions to execute more complicated queries over conversational data
What solution would you like?
Four new actions/rest endpoints

GetConversation (gets a single ConversationMeta by id, does not retrieve interactions)
GetInteraction (gets a single interaction by id)
SearchConversations (executes an arbitrary search query over the .conversation-meta index, retains access control guarantees)
SearchInteractions (executes an arbitrary search query over a set of interactions by conversation_id, retains access control guarantees)

This may require a little rethinking on the rest endpoint naming front
What alternatives have you considered?
SearchInteractions over all interactions the user has access to
Do you have any additional context?
PR 1196

Should we also add an UpdateInteraction API of some kind? In order to add to the "additional info" field or something

Looks similar to this issue https://github.com/opensearch-project/ml-commons/issues/1284

@jngz-es thoughts? Is there anything specifically that you would want out of these that isn't encompassed in standard _search api?

I'm likely going to need to change the API endpoints a little. Thoughts?
Current:
CreateConversation  -> /_plugins/_ml/memory/conversation
CreateInteraction   -> /_plugins/_ml/memory/conversation/{conversation_id}
GetConversations    -> /_plugins/_ml/memory/conversation
GetInteractions     -> /_plugins/_ml/memory/conversation/{conversation_id}
DeleteConversation  -> /_plugins/_ml/memory/conversation/{conversation_id}

Proposed change:
CreateConverasation  -> /_plugins/_ml/memory/conversation/_create
CreateInteractions   -> /_plugins/_ml/memory/conversation/{conversation_id}/_create
GetConversations(pl) -> /_plugins/_ml/memory/conversation/_list
GetInteractions(pl)  -> /_plugins/_ml/memory/conversation/{conversation_id}/_list
DeleteConversation   -> /_plugins/_ml/memory/conversation/{conversation_id}/_delete
GetConversation(sg)  -> /_plugins/_ml/memory/conversation/{conversation_id}
GetInteraction(sg)   -> /_plugins/_ml/memory/conversation/{conversation_id}/{interaction_id}
SearchConversations  -> /_plugins/_ml/memory/conversation/_search
SearchInteractions   -> /_plugins/_ml/memory/conversation/{conversation_id}/_search

 New API Spec
GetInteraction
Gets an interaction by id

Parameter
Type
Required

conversation_id
string
yes

interaction_id
string
yes

Returns the interaction as json (if you have access)
GetConversation
Gets a conversation by id

Parameter
Type
Required

conversation_id
string
yes

Returns the conversation meta object as json (if you have access)
SearchConversations
Execute a search query over the conversations index

Parameter
Type
Required

query
OS Query
yes

Returns the search results (conversation meta documents), opensearch style. essentially this is a wrapper around standard opensearch _search API that tacks on access controls if applicable
SearchInteractions
Execute a search query over the interactions of a conversation

Parameter
Type
Required

conversation_id
string
yes

query
OS Query
yes

Returns the search results (interaction documents), opensearch style. Essentially this is a wrapper around the standard opensearch _search API that adds a filter for the correct conversation id and checks access controls for the conversation.

I'm likely going to need to change the API endpoints a little. Thoughts? Current:
CreateConversation  -> /_plugins/_ml/memory/conversation
CreateInteraction   -> /_plugins/_ml/memory/conversation/{conversation_id}
GetConversations    -> /_plugins/_ml/memory/conversation
GetInteractions     -> /_plugins/_ml/memory/conversation/{conversation_id}
DeleteConversation  -> /_plugins/_ml/memory/conversation/{conversation_id}

Proposed change:
CreateConverasation  -> /_plugins/_ml/memory/conversation/_create
CreateInteractions   -> /_plugins/_ml/memory/conversation/{conversation_id}/_create
GetConversations(pl) -> /_plugins/_ml/memory/conversation/_list
GetInteractions(pl)  -> /_plugins/_ml/memory/conversation/{conversation_id}/_list
DeleteConversation   -> /_plugins/_ml/memory/conversation/{conversation_id}/_delete
GetConversation(sg)  -> /_plugins/_ml/memory/conversation/{conversation_id}
GetInteraction(sg)   -> /_plugins/_ml/memory/conversation/{conversation_id}/{interaction_id}
SearchConversations  -> /_plugins/_ml/memory/conversation/_search
SearchInteractions   -> /_plugins/_ml/memory/conversation/{conversation_id}/_search

I like the new conventions, do we need both get and search APIs? Eg GetConversations(pl) we should be able to get it with SearchConversations with a match all query.
{
  "query": {
    "match_all": {}
  },
  "size": 1000
}

I haven't looked at the PR #1504 , if we are using the same code underneath its good.

Get (pl) returns the last couple conversations (or interactions) sorted by creation time. basically just a shortcut to
{
  "query": {
    "match_all": {}
  },
  "sort": [
    {
      "create_time": {
        "order": "desc"
      }
    }
  ]
}

and, of course, tacking on the access controls. The idea was that for most use-cases, get (pl) is all an application needs

What do you think about:
CreateConverasation  -> /_plugins/_ml/memory/conversation/_create
CreateInteractions   -> /_plugins/_ml/memory/interaction/{conversation_id}/_create
GetConversations(pl) -> /_plugins/_ml/memory/conversation/
GetInteractions(pl)  -> /_plugins/_ml/memory/interaction/{conversation_id}/_list
DeleteConversation   -> /_plugins/_ml/memory/conversation/{conversation_id}/_delete
GetConversation(sg)  -> /_plugins/_ml/memory/conversation/{conversation_id}
GetInteraction(sg)   -> /_plugins/_ml/memory/interaction/{interaction_id}
SearchConversations  -> /_plugins/_ml/memory/conversation/_search
SearchInteractions   -> /_plugins/_ml/memory/interaction/{conversation_id}/_search

@HenryL27 makes sense. Looking at PR #1504 I understand the user experience is great with these APIS,   I see we created bunch of boiler plate just to serve these requests and transport actions, I would love to just re-use the search transport actions for Get REST APIs with some optional params WDYT?

@dhrubo-os I haven't seen too much need for single interaction _delete, although I an see how it could be useful (some kind of "undo last interaction" interaction model).
I don't love putting "interaction" in the Interaction-based endpoints; the purpose of the 'conversation' token is to say that this is a special kind of memory for conversations - I think Jing has several other kinds of memory coming down the line? grouping them all together at this level makes sense to me. The model I went with was "if there's a conversation id in the endpoint, it's the same kind of action as it would be if there wasn't, just do it over the interactions of the conversation specified rather than all of the conversation meta-objects"
One idea (from @austintlee) was to allow _search over multiple conversations' interactions similarly to how multi-index search works, e.g. /_plugins/_ml/memory/conversation/cid1,cid2,cid3/_search. I feel like that could be extended to search over all interactions somehow (/_plugins/_ml/memory/conversation/all/_search) - might be cleaner than throwing interaction into half of the endpoints. Idk. I like keeping conversations and interactions tightly coupled if possible.

@saratvemulapalli well, yes, there is a lot of boilerplate. I'm not convinced that it can all be stripped away. For example, the TransportActions all need to exist because this is where we check the feature flag. For the plural Get (and another motivation for it existing outside of _search) there was some thought of supporting databases other than an OpenSearch index under the storage interface, and all databases do not necessarily support OpenSearch search queries - so all storage implementations might not support the search action - so Get (pl) and Search should be decoupled at the transport layer.
There are probably a couple of simplifications I can do, but they would be in places that are already pretty simple, so I'm not sure it's worth it (for example maybe GetConversation can take a straight GetRequest instead of a GetConversationRequest. But that's already only like 12 lines of real code, and I'd need to add in more translation logic to the restHandler...)

I don't love putting "interaction" in the Interaction-based endpoints; the purpose of the 'conversation' token is to say that this is a special kind of memory for conversations - I think Jing has several other kinds of memory coming down the line? grouping them all together at this level makes sense to me.

From this context, I agree that to put all the endpoints under /_plugins/_ml/memory/conversation makes more sense.
I'm just worried that, these apis aren't quite self explanatory? Like looking at the api endpoints only, I can't tell what I can expect from the api specially /_plugins/_ml/memory/conversation/{conversation_id}/_list vs /_plugins/_ml/memory/conversation/{conversation_id}
If we can increase the readability of these api endpoints, I'm completely fine with keeping all under conversation.

I find they read a little better if you fill in the conversation id. but maybe I'm too close to the code, idk.
GET /_plugins/_ml/memory/conversation/oh_ert28b3y4vhowi/_list
GET /_plugins/_ml/memory/conversation/oh_ert28b3y4vhowi
GET /_plugins/_ml/memory/conversation/_list
GET /_plugins/_ml/memory/conversation/oh_ert28b3y4vhowi/o32nv494t49hwe

On the verb topic, I came across a similar discussion happening on the AI Workflow side.  They are sticking with GET, DELETE, POST and PUT as opposed to having the verbs appear at the end of the URLs.
https://github.com/opensearch-project/opensearch-ai-flow-framework/issues/49#issuecomment-1753581596

hmm...
well, the rest of ml-commons puts the verbs in the URI, so I prioritize matching that convention over other plugins. Also, since I have many kinds of GET (sg, pl, search), there's only so much multiplexing that can be done, so I think the URI path (haha) is cleaner.

If we know what APIs we will introduce for the new general memory layer, let's make sure the convention is consistent at least within all things memory.  If Henry doesn't mind making another change later, maybe we can proceed with a plan to refactor, if necessary, at a later time once we have the rest of the APIs finalized.  I am not saying we have to do what AI Workflows does.  It looks like there isn't one standard across OpenSearch so maybe that ship has already sailed...

^^ it would be very good to know what the other memory APIs will look like / be

@ylwu-amzn is there any design or proposal for this memory layer?  Will it also support role-based access control?


chore: UDF container should crash on exceptions

On any exception received in the user code or the execution make the UDF container restart.
This can help to fix any transient issues that might be from the code, or if any exceptions are propagated from the UDF.
TODO:

Multiproc restart will work after #161
Reduce sends context cancelled on restart which doesn't make the numa container restart as it retries directly on that error.

What is the status of this PR? is it ready for review?


⚠ Bofrost.be has degraded performance

In 5399e6f, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 2543 ms

Resolved: Bofrost.be performance has improved in df9cbd5.