Handle missing timesteps in construct_single_presto_input

When using construct_single_presto_input, the code conveniently handles the normalization of the inputs and construction of the mask. If certain inputs (bands) are missing, the respective mask values are automatically set to 1. However, there seems to be no way to deal with certain missing timesteps in the inputs. Imagine a monthly compositing of Sentinel-2 resulting in no valid observations for some month. Either we can deal with it by linearly interpolating the missing values, but it seems Presto should actually be able to natively deal with missing timesteps by setting the respective mask value to 1.
At the moment, the only way to do it is by keeping track of missing value positions in the original inputs and after the call to construct_single_presto_input setting the mask of these positions to 1. Would there be a more convenient way of doing this? Thinking of certain no-data values that can be treated by this method as missing and setting the mask in correspondance.
Specific side note on automatic computation of NDVI: we were testing with NaN inputs for S2 to see how the code behaves. Interestingly, this line actually makes up a valid NDVI value of 0 in x when the inputs are invalid.

@gabrieltseng I should come back to this. It looks to me now that Presto expects the same elements to be masked across an entire batch? https://github.com/nasaharvest/presto/blob/main/presto/presto.py#L369
Or do I misunderstand this? Still thinking about the case where in some samples we could miss some values. This results in a batch where not all elements are equally masked. Is this something Presto cannot handle?

Hi Kristof,
You are right - we currently don't support masking interim timesteps in construct_single_presto_input (although the model itself will have no problem with this).
The reason for this is an artifact of how we export the data (e.g. since we select the least cloudy pixel for Sentinel-2, we should never have a missing pixel, just the least cloudy one). However, I can update this function to make this easier.
With respect to the consistent number of masked tokens within a batch, that is correct. The reason for this is that within the model, we end up passing a tensor of shape [batch_size, num_unmasked_tokens, token_dimension] around. This requires num_unmasked_tokens to be consistent for all items in the batch.

With respect to the consistent number of masked tokens within a batch, that is correct.

Following up on this, we're trying to create our own DataLoader in a first attempt to finetune pretrained Presto on our data. We just start from a dataframe where every row is a sample so we have to refactor a bit to make it compatible with the way Presto needs the data.
I'm a bit confused about this step. It seems to call the make_mask method, returning a mask with dimensionality (12, 17). So I'm wondering: is one and the same generated mask applied to an entire batch? Or is every sample in the batch masked differently?
In case of the former, I'm not sure how currently the code applies this mask to the entire batch. And in case of the latter, it seems that make_mask always generates slightly different amounts of masked elements which violates the requirement of having same number of masked tokens within a batch.
Would you be able to clarify?

is one and the same generated mask applied to an entire batch? Or is every sample in the batch masked differently?

Every sample in the batch is masked differently. make_mask is called from the MaskParams object, which has a ratio attribute - this is passed to make_mask, and defines how many tokens should be masked. We keep this ratio constant throughout training.
However, this is just the case for pre-training; our finetuning code is available here. This code assumes a static mask for the whole task (of shape [timesteps, dimensions], which we then expand so that is has shape [batch_size, timesteps, dimensions].

We keep this ratio constant throughout training.

This is indeed what I thought, so I don't really understand why every call to make_mask with a fixed mask_ratio of 0.75 yields different amounts of masked values?
from presto.dataops.masking import make_mask

for i in range(10):
    print(f'Number of masked elements: {make_mask("group_bands", mask_ratio=0.75)[0].sum()}')

Number of masked elements: 148
Number of masked elements: 135
Number of masked elements: 156
Number of masked elements: 150
Number of masked elements: 142
Number of masked elements: 129
Number of masked elements: 126
Number of masked elements: 125
Number of masked elements: 160
Number of masked elements: 176

However, this is just the case for pre-training; our finetuning code is available here. This code assumes a static mask for the whole task (of shape [timesteps, dimensions], which we then expand so that is has shape [batch_size, timesteps, dimensions].

Gotcha, but I'm puzzled by things like num_outputs, which seems to tell me that instances of FineTuningModel are actually meant to have a classification head to finetune Presto on a downstream task. What I was trying to do is "continue" Presto pre-training a bit in a self-supervised way without labels on a lot samples from WorldCereal, to get the model used to some different preprocessing techniques that were used. You think it doesn't make sense?

mask_ratio ensures the same number of tokens are masked. Since a token represents a grouping of a certain number of input variables, this can result in a different number of masked values which would result in the same number of masked tokens.
For example, one token is S1 VV and VH (2 values) and one token is S2 RGB (3 values). So if I were to only mask one token, I might sometimes mask 2 values or 3 values.
The FineTuningModel replaces the decoder with a classification / regression head for finetuning. If you plan on continuing to pre-train the model, then you should use the full Presto model (i.e. what you obtain if you call encoder_decoder = Presto.load_pretrained()).

Right, but then it brings me back to the original issue where the mask tensor holds original mask values (so not tokens yet) which like you say can have a different quantity for different samples in a batch. Then the part below fails:
File ~/git/presto/presto/presto.py:372, in Encoder.mask_tokens(x, mask)
    367 @staticmethod
    368 def mask_tokens(x, mask):
    369     summed = mask.sum(
    370         dim=(1, 2)
    371     )  # summed tells me the number of masked elements per batch idx
--> 372     assert summed.max() == summed.min(), f"{summed.max()}, {summed.min()}"
    374     batch_size = x.shape[0]
    375     removed_elements_per_batch = int(summed.max() / mask.shape[2])

AssertionError: 11520, 10368

And yes, at the moment we work with the full Presto model.

Then the part below fails:

Could you share the code snippet you use to generate the masks? Within a batch, the same number of tokens must be passed / masked (this is what the assert statament was designed to check for).

Okay yeah indeed, some example code is more practical to discuss. I made a notebook here which takes a sample WorldCereal dataframe and attempts to transform it into something Presto accepts: https://github.com/kvantricht/presto/blob/worldcereal/notebooks/presto_pretrain_finetune.ipynb
As you can see at the end of the notebook, the error messages is about the masks. Hopefully this helps to identify where I'm doing something awfully wrong!

FYI, when taking batch_size of 1 and putting all dynamic world data to 0 (currently it gets set to 9 which gives an out of bounds error as Presto decoder expects DW classes between 0 and 8 it seems), then the training loops starts, so technically, we're getting close.

Okay - I think the cause of the error in the dataloader is that the masking function assumes nothing is masked. However, when using construct_single_presto_input some things are masked (e.g. dynamic world), so the calculations in the masking function to mask a certain number of tokens become incorrect.
This requires a re-write of the masking function, but shouldn't be too complicated. I can give this a shot in the next few days.

@kvantricht , I opened a PR into the branch you shared (https://github.com/kvantricht/presto/pull/1) which shows those changes.
I've added a description there of exactly the changes I made

Amazing Gabi, it runs here now as well with batch size 4096. I will keep you posted on the outcome!


Some pages in the preview do not render

Some pages in the documentation PR previews are not rendering, for example /run/dynamic-circuits-considerations:

I don't think this was caused by the most recent docker image deploy as previews created before the most recent deploy also have the same problem: https://qiskit-docs-preview-pr-1507.1799mxdls7qz.us-south.codeengine.appdomain.cloud/build/interoperate-qiskit-qasm3

I don't think this was caused by the most recent docker image deploy as previews created before the most recent deploy also have the same problem:

Note that every PR was updated to use the new docker image, i.e. the "preview" app rather than full web app. To see if it works with the web app, you'd need to use the :latest tag in Dockerfile rather than :open-source, but that should only be done locally and not in CI.


Why is 0001-Bazel-support.patch applied?

Whys is mkl_dnn submodule-directory not used directly?
Instead , this patch is applied.
https://github.com/Vertexwahn/rules_oidn/blob/main/0001-Bazel-support.patch
(the source-tree/behaviour should be as close as possible to the original repo)

The patch is applied since Bazel assumes includes to be relative to the workspace - see https://bazel.build/docs/bazel-and-cpp#include-paths


What about hooks?

Where do we place our hooks?

+1

+1

It looks like this feature is supported per the PR statement for hooks, https://auth0.com/blog/introducing-auth0-hooks/. Any help much appreciated!

I think they are encouraging you to use auth0-cli to provision hooks like a web task. It is how I ended up doing to deploy hooks to auth0.


Bitvec int lemmas

This introduces lemma support for BitVec.ofInt/BitVec.toInt as well as lemmas upstreamed from Std and Mathlib for reasoning about emod and bmod.

I pushed some very minor changes to proofs. Looks good to me otherwise.
PR title should be feat: ...


When present, IslandUtils removes the Mod button from ModMenu in the escape menu

Issue is as described in the title
With IslandUtils disabled

With IslandUtils enabled

This occurs on Minecraft 1.19.4 with Fabric API 0.76.0

Same issue!

Fixed in Hotfix 1.3.2
Thank you!


WIP: ENH: Update to the new ImageJ installation path

Depending on: https://github.com/imagej/pyimagej/issues/21 https://github.com/scijava/scyjava/issues/5

@ctrueden issue created to improve the ImageJ image support: https://github.com/InsightSoftwareConsortium/itk-jupyter-widgets/issues/137


BanksBankStander & Created Bank Plugin Descriptor

This pull request introduces the BanksBankStander script, designed to automate simple bank skilling activities in Old School RuneScape. The script allows players to efficiently perform tasks such as fetching items from the bank and combining them, enhancing the skilling experience.
Changes:
Added the BanksBankStander package containing the script implementation.
Implemented the script logic for fetching items from the bank, combining them, and handling sleep durations for synchronization.
Modified the plugin descriptor to include the developer name for attribution.
Benefits:
Offers an automated solution for repetitive bank skilling tasks, saving time and effort for players.
Enhances the skilling experience by streamlining the process of gathering and combining items.
Testing:
Tested the script functionality to ensure correct behavior in various scenarios, including starting with items in the inventory and starting without items.
Verified the synchronization and sleep durations to prevent script errors or inefficiencies.
Additional Notes:
The script is designed to be easily customizable and extensible for future updates or specific user requirements.
Feedback and suggestions for improvements are welcome to further enhance the script's functionality and usability.

Script looks neat, goodjob. My only concern is the obscurity of finding the item ids, which might be pretty annoying. Would it be possible to allow ids and names.
Could we change the firstItemId and secondItemId to type string. This allows for names or numbers to be put in the config field.
We could then parse the config field in our script by writing an extra method that checks if the input is a number
public static Integer TryParseInt(String someText) {
   try {
      return Integer.parseInt(someText);
   } catch (NumberFormatException ex) {
      return null;
   }
}
// This is just pseudo code
 Integer firstItemId = TryParseInt(config.firstItemId());
  if (firstItemId == null) {
      Rs2Inventory.hasItemAmount(config.firstItemId(), config.firstItemIdAmount());
  } else {
      Rs2Inventory.hasItemAmount(firstItemId, config.firstItemIdAmount());
  }

This allows for names or ids to be put it and more flexibility to the end user.

Added flexibility to item identification in fetch and combine methods

Modified the fetchItems() and combineItems() methods to handle cases where item identifiers can be either item IDs or names.
Implemented logic to check if an item identifier is null and handle it appropriately in both methods.
Updated the hasItems() method to accommodate the changes made in fetchItems() and combineItems().

This update allows users to input either item IDs or names for both items, providing more flexibility in item identification.

Please take out the code for the bankscript plugin. I want to discuss the bank pin plugin with you before implementing this.
We will add that feature in a seperate PR. Please also change the title to only include the bankstanding plugin.
Thanks!


Added (and fixed) filtering for surveyors and homes

Resolves #179

Thanks @mzagaja ! I was reasonably optimistic it was okay but didn't want to just blanket-ignore flagged security issues…


Feature request: #47493

I do some code refactoring and add an additional code description on comment for this code which addressing this thread. Rest assured, there are no other API that will be affected by this PR.
Implements #47493

@deeb02, the gentlest of bumps on this. Can I have a few seconds of your time for looking on this? 😄

This PR changes the semantic of the API in a backward incompatible way, without achieving anything important. The current API is valid and follows the original math from the original paper as far as I can tell.


NIFI-12987 allow controller service type to be searchable

Summary
NIFI-12987
Modeling after the ProcessorMetadataMatcher code which allows searching on processor type, this PR modifies ControllerServiceNodeMatcher to allow searching on controller service type.
Tracking
Please complete the following tracking steps prior to pull request creation.
Issue Tracking

[x] Apache NiFi Jira issue created

Pull Request Tracking

[x] Pull Request title starts with Apache NiFi Jira issue number, such as NIFI-00000
[x] Pull Request commit message starts with Apache NiFi Jira issue number, as such NIFI-00000

Pull Request Formatting

[x] Pull Request based on current revision of the main branch
[x] Pull Request refers to a feature branch with one commit containing changes

Verification
Please indicate the verification steps performed prior to pull request creation.
Build

[x] Build completed using mvn clean install -P contrib-check

[x] JDK 21

Licensing

[n/a] New dependencies are compatible with the Apache License 2.0 according to the License Policy
[n/a] New dependencies are documented in applicable LICENSE and NOTICE files

Documentation

[n/a] Documentation formatting appears as expected in rendered files

Thanks for reviewing @pvillard31!


trace_exec: drop uid filter on sys_exit_execve

trace_exec: drop uid filter on sys_exit_execve
As discussed in PR 2965, if the uid changes between sys_enter_execve and sys_exit_execve, maps will not be cleaned properly.
This PR removed the uid check in sys_exit_execve, for both image-based and builtin gadgets.

Requires rebasing and regenerate ebpf objects after #3031


Enable Huge Pages on 2 x86 Perf Machines (test-packet-ubuntu1604-x64-2 & test-softlayer-ubuntu1604-x64-1)

Proposed Changes
I would request to enable huge pages on the perf machines. This would enhance our footprint measurements for Open Liberty with Daytrader7. Thanks!
Currently, we just have to machine labelled with ci.role.perf: https://ci.adoptopenjdk.net/label/ci.role.perf/
Justification
Please refer to this prerequisite for perf testing: https://github.com/AdoptOpenJDK/openjdk-tests/issues/1136.
Related Machines
https://ci.adoptopenjdk.net/computer/test-packet-ubuntu1604-x64-2/
https://ci.adoptopenjdk.net/computer/test-softlayer-ubuntu1604-x64-1/

Do you have the information on  how to enable it?

@sxa555 I've listed some general notes on how to enable huge pages. Those steps might vary a bit depending on the OS version. We want to make these huge pages persistent so that they are enabled even after a reboot.

Set the number of hugepages accordingly depending on how much memory (i.e. MemTotal) the machine has. The system won't reboot if you allocate more hugepages than the system memory can support.
Check memory

cat /proc/meminfo

Hugepages formula:

HugePages_Total (i.e. # of hugepages)* Hugepagesize (i.e. Size of hugepage) =< MemTotal

sudo sysctl -w vm.nr_hugepages=<HugePages_Total>
echo "vm.nr_hugepages=<HugePages_Total>" >> /etc/sysctl.conf

How much would you recommend for your use relative to the total memory? I could set the number of HugePages to 1 and that would meet your formula but I'm guessing you'd like more :-)

@piyush286 Could you post an output of cat /proc/meminfo? It will give me an idea of the MemTotal and Hugepagessize values

Hugepagesize can be set to 2048 kB. We should set the total memory allocated for huge pages to around 70% of the total memory.
Just an example from one of our machines:
[jbench@perfxposh ~]$ cat /proc/meminfo
MemTotal:       791701028 kB
Hugepagesize:       2048 kB

So can probably do some sort of calculation along the lines of:
MEM=`awk '/^MemTotal:/{print$2}' /proc/meminfo`
HUGEPAGESIZE=`awk '/^Hugepagesize:/{print$2}' /proc/meminfo`
HUGEPAGES=`echo $MEM \* .7 / HUGEPAGESIZE | bc`

and set it to $HUGEPAGES (assuming you agree the logic looks sound ;-) )

@Haroon-Khel Did we ever finish this? Do you have access to the machines and can implement this if it hasn't already been set?

@sxa555 No, I was waiting for a response from @piyush286 to agree with the logic from your previous comment. But I can complete this now as the logic makes sense. However, I do not have root access to either machine

Key added to test-packet-ubuntu1604-x64-2 and test-softlayer-ubuntu1604-x64-1
Side note: We should also consider renaming these to be perf- instead of test- for consistency with some of the newer macstadium boxes ...

For test-packet-ubuntu1604-x64-2 Ive set the HugePages_Total to 2789. Though its entry in /proc/meminfo has become 638. Though I suspect that this will correct itself after a reboot since I have also added vm.nr_hugepages=2789 to /etc/sysctl,conf

If you need to reboot the machines then feel to do it as long as the executors on the machine are idle in jenkins e.g. test-packet-ubuntu1604-x64-1 and test-packet-ubuntu1604-x64-2

@piyush286 @Haroon-Khel Where are we with this one? Is it complete now or do I have to move it into the April milestone?

It is still half complete. I couldnt figure out how to enable huge pages on test-softlayer-ubuntu1604-x64-1 since its configuration was different than expected, as said above

As far as I can tell, the test-softlayer-ubuntu1604-x64-1 machine doesn't exist anymore. I don't think this has been replaced? Or at least, it hasn't been labelled as such in the inventory, so I think we can close this issue

https://ci.adoptopenjdk.net/computer/test-packet-ubuntu1604-x64-1/ is the only xLinux machine that has ci.role.perf at present ... We need to sort out the OS on that, but this probably shouldn't be considered closed until that machine is verified to have had the changes.

@smlambert Is this still a requirement that we need to push forward with?

Let's close for now.  We can come back and raise a new request at a later time if needed.


Make SQL console error messages easier to copy

Minor nuisance: when I get an error message in the "SQL Console: Messages" panel and right-click > copy values, it returns a string that was selected elsewhere in the interface rather than the error message I clicked on. Ran into this as part of experiencing #4

Upstream issue: https://github.com/mtxr/vscode-sqltools/issues/987


[FEATURE] Integration test using run-api.sh and github action

By implementing IntegrationTest.java and IntegrationTestUtils.java, This feature is not needed anymore


Add raw input and sensitivity

Involves quite a large refactor of input handlers for more flexibility. Stored enabled handlers to configuration. Adds global sensitivity setting (will be per-device in the future; just keeping things simple for now).

While I still replicated delta spike, it has magically stopped replicating the last few runs, and it also can't be replicated by @peppy, so I'm going to go ahead and merge this 👍 .


Rotation constraints are ignored during one handed movement

Overview
Manipulationhandler has section "constraints on rotation". These are applied when doing two handed rotation, but are ignored when doing one handed movement.
Note: after this bug fix, the rotation mode "gravity aligned face user" is no longer needed, so I would recommend removing it (or marking it as deprecated somehow).
Steps to reproduce
Configure handler for one handed movement - face user, and then set "rotation constraint" to "y only".
Expected Behavior
Object will face user, but rotate only about Y axis
Actual Behavior
Object faces the user, including rotation about the x axis.
Unity Editor Version
Mixed Reality Toolkit Release Version

@julenka Marking as deprecated/obsolete would be best.

@julenka the current implementation of constraints is that they're only applied to one hand manipulations that don't perform any auto orientations on the object. I suppose that was done because some of the rotation modes wouldn't make sense with the constraints in place.
So constraints currently work for:

rotateaboutgrabpoint
rotateaboutobjectcenter

We could move that code that scales the rotations out of that specific section and apply it to all rotation modes instead

We could move that code that scales the rotations out of that specific section and apply it to all rotation modes instead

That's what I was thinking. I had written the original code, but when I revisited my own design last week I found it confusing / not intuitive that the rotation constraints did not apply to the one hand modes.


code-refactoring: Gitops 3126 implement notifications controller

What type of PR is this?
/kind chore
What does this PR do / why we need it:
Implemented notifications controller.
NOTE: this PR just adds the package files and tests, this code is not invoked at any point yet
Have you updated the necessary documentation?

[ ] Documentation update is required by this PR.
[ ] Documentation has been updated.

Which issue(s) this PR fixes:
Fixes #?
GITOPS-3126: https://issues.redhat.com/browse/GITOPS-3126
How to test changes / Special notes to the reviewer:
Unit tests are yet included. Coming soon.

some general comments about the unit tests

We should really avoid using the test name as a variable for conditional checks, I don' think that is good coding practice. If needed lets split the test up into multiple tests

there is no need to try and preserve/restore resourceName and resourceLabels. These variables are re-initialized each cycle, and setting them to something in a test is not going to break the operator

If the operator is not handling a case in the reconciliation cycle, there is no need to add a test for it. Let us simplify the test cases to create/update/delete scenarios

LGTM, thanks a lot @ciiay !!


make it slightly easier to read configs

makes the files slightly longer, but also much easier for humans to read, and no harder for the computer

See the description of the indent =  arg here


[Bug][Storage] fix core dump when backend start

Proposed changes
due to a->tablet_schema() is nullptr
Problem Summary:
Describe the overview of changes.
Checklist(Required)

Does it affect the original behavior: (Yes/No/I Don't know)
Has unit tests been added: (Yes/No/No Need)
Has document been added or modified: (Yes/No/No Need)
Does it need to update dependencies: (Yes/No)
Are there any changes that cannot be rolled back: (Yes/No)

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

Which PR introduced this bug?

introdeced by #10136.
We have another fix solution, so I will close this pr.


fix: dashboard filter scope bug

SUMMARY
this PR is to fix a logic  issue in dashboard filter scope: when filter_box is deep nested in a tab, user could not exclude it from another tab properly.
TEST PLAN
added unit test to cover this complicated use case.
@ktmud @etr2460

for scopes array, empty means not applicable to any tab. by default, scopes value is [ROOT_ID], which means apply to all.


Fixed an issue where TimeSlice was duplicating ticks

Addresses #387
Disclaimer: Last time I sent a pull request the build failed with what seemed to be some compiler differences between mono and native .Net. I'm not expecting issues here because the changes are simple, but in case those become famous last words here is a standard developer excuse:

Thanks for the great PR +10 bonus points @lithast :) Bonus points are tradable for free live trading subscriptions on QC. Send me your email<EMAIL_ADDRESS>and I'll send you a license.

No problems Micheal, I have checked in those changes. Thanks Jared, I've flicked you a quick email.


linux: update

Motivation for this change
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[ ] Fits CONTRIBUTING.md.

Sorry, I just pushed these updates. My workflow is usually not GitHub-centric.
I appreciate the PR!
FYI, the commits have been cherry-picked into the stable branches as well.


Add auto publish release with asset

When a tag is pushed, this automatically builds the asset, creates a draft release on the tag, and upload the asset to the release.
You can then modify the release description and publish.
Feel free to close if it's unwanted.
I used it in my own fork while debugging the formatting issue on Windows. https://github.com/princemaple/elixir-ls/releases

Let me know if there is anything you want changed.

ping @axelson


Show add reaction button on message tap

This issue addresses the add reaction button visibility on mobile web. The goal is to make the add reaction button visible on message tap, similar to the message controls.

An additional task suggested is to disable the compose message box on message tap, and instead show the compose message box when pressing the message button at the bottom of the screen.
I also found #18137 which is related and still open, not sure if this should be added or separate.

CZO thread
@zulipbot add "area: emoji" "area: mobile web" "UI experiment" "UX"

@zulipbot add "in progress"

It's a bit confusing to me that the Add Reaction doesn't appear on long press (compose).

The goal is to make the add reaction button visible on message tap, similar to the message controls.

I'd expect it to appear whenever the message controls are visible.

@zulipbot claim


1.10.2 MCMultiPart

I am trying to run MCMultipart 1.3.0, which i need for some mods like Refined Storage.
Mekinism1.10.2- <IP_ADDRESS>4 seems to load an older version MCMultiPart1.2.0

its mostly due to them using deploader which is not meant to used anymore i told aidan on twitter and once on here but dont think anyone noticed


Update hubble e2e example to create visualization tutorial

Update hubble e2e example to create visualization tutorial

Rename to Creating Visualizations Tutorial
Added final result gif/image and expectation at top of page
Updated images to be even clearer in what should be clicked/done

Preview is available here:http://developers-pr1065.previews.kube001.services.stellar-ops.com

Preview is available here:http://developers-pr1065.previews.kube001.services.stellar-ops.com


ROX-8301: Add force option to the detection service

Description
Previously, only the roxctl image scan command had the ability to force a refetch within the image enricher. This is specifically useful when testing images within a pipeline continuously.
The PR added the following:

force option for every request within the detection service.
force flag to the commands roxctl image check, roxctl deployment check, allowing both to force a re-scan of the referenced images.

Checklist

[ ] Investigated and inspected CI test results
[ ] Unit test and regression tests added
[ ] Evaluated and added CHANGELOG entry if required
[ ] Determined and documented upgrade steps
[ ] Documented user facing changes (create PR based on openshift/openshift-docs and merge into rhacs-docs)

If any of these don't apply, please comment below.
Testing Performed

see added unit tests + CI passing.

Current dependencies on/for this PR:

master

PR #5277   👈

This comment was auto-generated by Graphite.

@srcporter had created https://github.com/stackrox/stackrox/pull/4766, looks like this PR covers more

@srcporter had created #4766, looks like this PR covers more

Oh, I didn't know that PR from @srcporter existed, my bad otherwise I would have left comments on that one.
I'll take a look to check whether they are covering the same.

Closing in favor of #4766 .


libsForQt5.kpmcore: 22.08.0 -> 22.12.0

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://repology.org/metapackage/kpmcore/versions.
meta.description for libsForQt5.kpmcore is: "KDE Partition Manager core library"
meta.homepage for libsForQt5.kpmcore is: "https://invent.kde.org/system/kpmcore"
meta.changelog for libsForQt5.kpmcore is: ""
Updates performed

Version update

To inspect upstream changes
Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 22.08.1 with grep in /nix/store/0cyyg2drl8iwl9d3jfnxbl5kfgk526lm-kpmcore-22.08.1
found 22.08.1 in filename of file in /nix/store/0cyyg2drl8iwl9d3jfnxbl5kfgk526lm-kpmcore-22.08.1

Rebuild report (if merged into master) (click to expand)

8 total rebuild path(s)

8 package rebuild(s)

First fifty rebuilds by attrpath
calamares
calamares-nixos
libsForQt5.kpmcore
libsForQt512.kpmcore
libsForQt514.kpmcore
libsForQt515.kpmcore
partition-manager
plasma5Packages.kpmcore

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/0cyyg2drl8iwl9d3jfnxbl5kfgk526lm-kpmcore-22.08.1 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A libsForQt5.kpmcore https://github.com/r-ryantm/nixpkgs/archive/c38c885a4520de18a5aa0d2d874420185b711739.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/0cyyg2drl8iwl9d3jfnxbl5kfgk526lm-kpmcore-22.08.1
ls -la /nix/store/0cyyg2drl8iwl9d3jfnxbl5kfgk526lm-kpmcore-22.08.1/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

2 packages marked as broken and skipped:

libsForQt512.kpmcore
libsForQt514.kpmcore

4 packages built:

calamares
calamares-nixos
libsForQt5.kpmcore
partition-manager

Maintainer pings
cc @peterhoeg @oxalica for testing.

Umm. Seems not going well. But the version of kpmcore and partition-manager already diverges on master.
https://github.com/NixOS/nixpkgs/blob/34fde40edd9bf8a8f071cfbfd05965921b16bf66/pkgs/development/libraries/kpmcore/default.nix#L8-L9

partition-manager seems to be currently broken, probably due to the divergence

Are you running it via nix-shell? It needs to be installed via environment.systemPackages for the policy kit files to be used.

Similar issue when installed via environment.systemPackages. Also no disks detected.

Did some digging, seems like the issue with kpmcore is stemming from this commit: https://invent.kde.org/system/kpmcore/-/commit/6b260fa84e75944fd15c3fff1a77723086af2038
Pretty much since everything is in /nix/store, and it expects / or /usr, it's rejecting calls.
Adding the following to the patch phase would fix it, but not sure if disabling the prefix check all together is the best. Maybe patching it to check /nix/store would be a better solution?
    substituteInPlace src/backend/corebackend.cpp \
      --replace /usr/share/polkit-1/actions/org.kde.kpmcore.externalcommand.policy $out/share/polkit-1/actions/org.kde.kpmcore.externalcommand.policy
    substituteInPlace src/util/externalcommandhelper.cpp \
      --replace "(trustedPrefixes.find(prefix.path()) == trustedPrefixes.end())" "(false)"

@vlinkz

Pretty much since everything is in /nix/store, and it expects / or /usr, it's rejecting calls.
Adding the following to the patch phase would fix it,

Thanks for the work. Could you please open a PR for this? I'm not using KDE now.

Created pr: #191822

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://repology.org/metapackage/kpmcore/versions.
meta.description for libsForQt5.kpmcore is: "KDE Partition Manager core library"
meta.homepage for libsForQt5.kpmcore is: "https://invent.kde.org/system/kpmcore"
meta.changelog for libsForQt5.kpmcore is: ""
Updates performed

Version update

To inspect upstream changes
Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 22.08.2 with grep in /nix/store/8idhqvvpfwx4j63grda7cap24kb7b0mq-kpmcore-22.08.2
found 22.08.2 in filename of file in /nix/store/8idhqvvpfwx4j63grda7cap24kb7b0mq-kpmcore-22.08.2

Rebuild report (if merged into master) (click to expand)

8 total rebuild path(s)

8 package rebuild(s)

First fifty rebuilds by attrpath
calamares
calamares-nixos
libsForQt5.kpmcore
libsForQt512.kpmcore
libsForQt514.kpmcore
libsForQt515.kpmcore
partition-manager
plasma5Packages.kpmcore

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/8idhqvvpfwx4j63grda7cap24kb7b0mq-kpmcore-22.08.2 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A libsForQt5.kpmcore https://github.com/r-ryantm/nixpkgs/archive/7480ba1065df6121e6f5ebd18759347d0163522b.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/8idhqvvpfwx4j63grda7cap24kb7b0mq-kpmcore-22.08.2
ls -la /nix/store/8idhqvvpfwx4j63grda7cap24kb7b0mq-kpmcore-22.08.2/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

2 packages marked as broken and skipped:

libsForQt512.kpmcore
libsForQt514.kpmcore

4 packages built:

calamares
calamares-nixos
libsForQt5.kpmcore
partition-manager

Maintainer pings
cc @peterhoeg @oxalica for testing.

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://repology.org/metapackage/kpmcore/versions.
meta.description for libsForQt5.kpmcore is: "KDE Partition Manager core library"
meta.homepage for libsForQt5.kpmcore is: "https://invent.kde.org/system/kpmcore"
meta.changelog for libsForQt5.kpmcore is: ""
Updates performed

Version update

To inspect upstream changes
Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 22.08.3 with grep in /nix/store/5fkqs220pzq9fkrw08sv03g7al5rg4bm-kpmcore-22.08.3
found 22.08.3 in filename of file in /nix/store/5fkqs220pzq9fkrw08sv03g7al5rg4bm-kpmcore-22.08.3

Rebuild report (if merged into master) (click to expand)

8 total rebuild path(s)

8 package rebuild(s)

First fifty rebuilds by attrpath
calamares
calamares-nixos
libsForQt5.kpmcore
libsForQt512.kpmcore
libsForQt514.kpmcore
libsForQt515.kpmcore
partition-manager
plasma5Packages.kpmcore

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/5fkqs220pzq9fkrw08sv03g7al5rg4bm-kpmcore-22.08.3 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A libsForQt5.kpmcore https://github.com/r-ryantm/nixpkgs/archive/0a1efbcda36ddec7f3e33a34e5367536a85195b1.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/5fkqs220pzq9fkrw08sv03g7al5rg4bm-kpmcore-22.08.3
ls -la /nix/store/5fkqs220pzq9fkrw08sv03g7al5rg4bm-kpmcore-22.08.3/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

2 packages marked as broken and skipped:

libsForQt512.kpmcore
libsForQt514.kpmcore

4 packages built:

calamares
calamares-nixos
libsForQt5.kpmcore
partition-manager

Maintainer pings
cc @peterhoeg @oxalica for testing.

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://repology.org/metapackage/kpmcore/versions.
meta.description for libsForQt5.kpmcore is: "KDE Partition Manager core library"
meta.homepage for libsForQt5.kpmcore is: "https://invent.kde.org/system/kpmcore"
meta.changelog for libsForQt5.kpmcore is: ""
Updates performed

Version update

To inspect upstream changes
Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 22.12.0 with grep in /nix/store/kad0kmhbiz8h4s3q03cb27zav8hgh2x1-kpmcore-22.12.0
found 22.12.0 in filename of file in /nix/store/kad0kmhbiz8h4s3q03cb27zav8hgh2x1-kpmcore-22.12.0

Rebuild report (if merged into master) (click to expand)

5 total rebuild path(s)

5 package rebuild(s)

First fifty rebuilds by attrpath
calamares
calamares-nixos
libsForQt5.kpmcore
partition-manager
plasma5Packages.kpmcore

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/kad0kmhbiz8h4s3q03cb27zav8hgh2x1-kpmcore-22.12.0 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A libsForQt5.kpmcore https://github.com/r-ryantm/nixpkgs/archive/9a46e101667c84df1401952abbf0ec8024157f55.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/kad0kmhbiz8h4s3q03cb27zav8hgh2x1-kpmcore-22.12.0
ls -la /nix/store/kad0kmhbiz8h4s3q03cb27zav8hgh2x1-kpmcore-22.12.0/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

4 packages built:

calamares
calamares-nixos
libsForQt5.kpmcore
partition-manager

Maintainer pings
cc @peterhoeg @oxalica for testing.

Superseded.


API doc build is broken

The Dart API doc build for angular.io is broken, apparently by this morning's sync to github.
I don't think the cause is f4d856c8be853649a36da0be19f7d7b3925dbf71 (since Patrice tested those) or e10e2b501e246b47dffffe1dfe579039bc562233 (since I tested those). Apparently, we need better testing of doc comments.
For now, @naomiblack is working around this issue by using the b22 version of angular-dart.
@chalin could you please take a look?
/cc @thso

How we doin' here?

This was fixed.


Scroll does not hide after decreasing container height

I set the property to class ps:
max-height: 130px
When the height of the inner container exceeds 130px a scroll appears.
But when the height of the inner container dynamically decreases and becomes less than 130px, the scroll does not disappear.
Scroll disappears only after scrolling the mouse wheel, although there is no scrolling

@KatyaV97 I have the same issue, did you find any solutions for this ?

Did you try to call ps.update()?

@florianjea Nop, i just added a key field to perfect scrollbar component which affects the container height.
So its fixed now :)
like this
<perfect-scrollbar
        :options="{
          swipeEasing: true,
          wheelPropagation: true,
        }"
        :key="searchText"
        class="flex-1 text-sm"
      >

so when the searchText changes and update the results it updates the scroll view now.

@florianjea Nop, i just added a key field to perfect scrollbar component which affects the container height. So its fixed now :)
like this
<perfect-scrollbar
        :options="{
          swipeEasing: true,
          wheelPropagation: true,
        }"
        :key="searchText"
        class="flex-1 text-sm"
      >

so when the searchText changes and update the results it updates the scroll view now.

@florianjea Nop, i just added a key field to perfect scrollbar component which affects the container height. So its fixed now :)
like this
<perfect-scrollbar
        :options="{
          swipeEasing: true,
          wheelPropagation: true,
        }"
        :key="searchText"
        class="flex-1 text-sm"
      >

so when the searchText changes and update the results it updates the scroll view now.

searchText is a ref of the container?

Nop, searchText is the v-modal of the search input.
So it will change when i try to filter the list by name.

@vishnu-exerp thank you! It helped me


Hacked wallet recovery favicon / icon on google searches

I think we should change this to be the app icon.
Weirdly, the app uses public/assets/flashbotRecovery/thumbnail.jpg instead of public/thumbnail.jpg.
And the metaheader seem to not work: https://www.heymeta.com/results?url=hackedwalletrecovery.com
This one:

What we currently have

Completed! #55


Class Diagram -- Login dataflow

This is documenting the data objects and their relationships with each other.

This should essentially be an ER diagram modeling the back-end database


Plot data after getting results

Hello!
I want to know how can i generate the cluster expression levels, cluster size progression and the posterior matrix dendrogram graphics after getting the results, using the .txt result files as input. The thing is i ran dpgp on a high performance cluster but it did not generate the graphics that i get when running it on my pc, and it would be difficult for me tu run it again. Thank you and i am looking forward to your input on this topic.

Check out bin/DP_GP_cluster_post_gibbs_sampling.py, the usage is pretty well described, so you should be able to figure it out.


Update text for mobile data

Add paragraph for mobile data based on anything Rebecca sends over or other articles produced on this.

Done.


atuin: 18.3.0 -> 18.4.0

Things done
See https://github.com/atuinsh/atuin/releases/tag/v18.4.0
Replaces #368682

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
25.05 Release Notes (or backporting 24.11 and 25.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

Ugh, forgot to run the formatter. I'll do that on a bit.

@ofborg build atuin atuin.tests

nixpkgs-review result
Generated using nixpkgs-review.
Command: nixpkgs-review pr 369322

x86_64-linux

:white_check_mark: 1 package built:

atuin

nixpkgs-review result
Generated using nixpkgs-review.
Command: nixpkgs-review pr 369322

aarch64-linux

:white_check_mark: 1 package built:

atuin

aarch64-darwin

:white_check_mark: 1 package built:

atuin

FYI @r-vdp I updated the description with a Closes instead of Replaces since that's a keyword to trigger automatic action on merge.


H2 vulnerability

Which version and edition of Flyway are you using?
Latest, via flyway/flyway Docker image.
If this is not the latest version, can you reproduce the issue with the latest one as well? (Many bugs are fixed in newer releases and upgrading will often resolve the issue)
N/A
Which client are you using? (Command-line, Java API, Maven plugin, Gradle plugin)
Command line with Docker.
Which database are you using? (Type & version)
PostgreSQL 14.1 (latest)
Which operating system are you using?
Windows with WSL
What did you do? (Please include the content causing the issue, any relevant configuration settings, the SQL statement(s) that failed (if any), and the command you ran)
Trivy is run against our Docker images before they're deployed.
What did you expect to see?
The Flyway image usually runs without any issues raised by Trivy.
What did you see instead?
Flyway is flagged with an H2 vulnerability affecting versions below 2.0.206. Flyway is on version 2.0.202.
I'm not familiar with H2 so this may not be an issue directly affecting Flyway, incorrectly flagged by Trivy.

Thank you for bringing this to our attention. We will investigate further and get back to you as soon as possible.


Datetime Validator option functions not being called

In the documentation, it states
"validate.js allows the validators object and validator options to be a function that should return the constraints/options".
I am trying to make a Date Range field that will correctly validate ranges where the start is after the end, or the end is before the start, as invalid. I have implemented an earliest option on a date constraint for my date_end field as follows:
date: {
    earliest: function(val, attr, opts, attrs){
                  return moment.utc(attrs.date_start);
              }
}

Additionally I have defined a parse function on the validator as follows:
parse: function(value, options) {
            return +moment.utc(value);
       },

However on inspection, I find that the value getting passed to my parse function is not the return value of the above function, but the function object itself, which is evaluated by +moment.utc as NaN
Shouldn't my parse be getting the return value of my earliest function instead of the function itself? This seems to be what is described in the documentation.
Thanks for a great library otherwise!

The value returned from your first example should be the options for the date validator meaning it should be an object with options, see which ones that are available here: http://validatejs.org/#validators-datetime

Ah I see. Thanks for clearing that up!


xh: 0.9.1 -> 0.9.2

Motivation for this change
Update to upstream package
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[ ] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 117694 at eafe38db run on x86_64-linux 1

1 package built successfully:

xh

1 suggestion:

error: no-flags-array
checkFlagsArray is only intended to be used in Bash, not as a Nix attribute.
Near pkgs/tools/networking/xh/default.nix:24:3:
   |
24 |   checkFlagsArray = [ "--skip=basic_options" ];
   |   ^


Colorscheme change it self after saving

Hello, sorry for asking you again. I've a trouble (actualy not a problem but it's inconvenience at appearance). I open VIM and lightline colorscheme didn't have problem in all mode, but after I make changes and save it, lightline colorscheme change it self. I try different default colorscheme like PaperColor, jellybeans, solarized but didn't solve it. What configuration for this problem ?
Here the screenshot :
when opening VIM :

after make changes, and saving it :

Colorscheme change only on NORMAL MODE and INSERT MODE. In VISUAL and V-BLOCK MODE it's still look good like when I open VIM for the first time.
in VISUAL MODE :

Thank's for your help :)

What happens if you move colorscheme  lucius after the lightline config?

nothing happen. still change it self after saving.

Comment out this line: https://github.com/nickiesiva/dotfiles/blob/f3c657d8c26f232f1096de6f7f378737c69a277d/.vimrc#L169

Thank's a lot. It's work.


[1.20.1] Tool Belt - General Incompatability

General inability to use the tool belt at all leads to issues when equipped in the belt slot

Do u think this can be fixed at all? 😔

More info on why such is a problem is required and I kinda hope that the API changes for 1.21 will fix the issues

so no plans for 1.20.1? 🥺


getPngStream gets slower quickly

On the first seconds the png stream is real-time, like a video, but then it gets a consistent ~1s delay between.
I am wondering if Node's buffers / pipes get slammed?

Was anyone able to get this working? I have a pretty fast frame rate but there is a consistent delay of about 1 to 1.5 seconds.


Unable to load pre-trained weights

Steps i have done
1.Cloned the repo and downloaded weights
2.sh download.sh
3.run python config.py --mode prepro
4. run python config.py --mode demo
error
Exception in thread Thread-1:
Traceback (most recent call last):
  File "/home/kamalraj/anaconda2/lib/python2.7/threading.py", line 801, in __bootstrap_inner
    self.run()
  File "/home/kamalraj/anaconda2/lib/python2.7/threading.py", line 754, in run
    self.__target(*self.__args, **self.__kwargs)
  File "/mnt/d/ML exp/Fast-Reading-Comprehension/demo.py", line 74, in demo_backend
    saver.restore(sess, tf.train.latest_checkpoint(config.save_dir))
  File "/home/kamalraj/anaconda2/lib/python2.7/site-packages/tensorflow/python/training/saver.py", line 1755, in restore
    {self.saver_def.filename_tensor_name: save_path})
  File "/home/kamalraj/anaconda2/lib/python2.7/site-packages/tensorflow/python/client/session.py", line 905, in run
    run_metadata_ptr)
  File "/home/kamalraj/anaconda2/lib/python2.7/site-packages/tensorflow/python/client/session.py", line 1137, in _run
    feed_dict_tensor, options, run_metadata)
  File "/home/kamalraj/anaconda2/lib/python2.7/site-packages/tensorflow/python/client/session.py", line 1355, in _do_run
    options, run_metadata)
  File "/home/kamalraj/anaconda2/lib/python2.7/site-packages/tensorflow/python/client/session.py", line 1374, in _do_call
    raise type(e)(node_def, op, message)
InvalidArgumentError: Assign requires shapes of both tensors to match. lhs shape= [91588,300] rhs shape= [91589,300]
         [[Node: save/Assign_375 = Assign[T=DT_FLOAT, _class=["loc:@word_mat"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/device:C
PU:0"](word_mat, save/RestoreV2:375)]]

Caused by op u'save/Assign_375', defined at:
  File "/home/kamalraj/anaconda2/lib/python2.7/threading.py", line 774, in __bootstrap
    self.__bootstrap_inner()
  File "/home/kamalraj/anaconda2/lib/python2.7/threading.py", line 801, in __bootstrap_inner
    self.run()
  File "/home/kamalraj/anaconda2/lib/python2.7/threading.py", line 754, in run
    self.__target(*self.__args, **self.__kwargs)
  File "/mnt/d/ML exp/Fast-Reading-Comprehension/demo.py", line 73, in demo_backend
    saver = tf.train.Saver()
  File "/home/kamalraj/anaconda2/lib/python2.7/site-packages/tensorflow/python/training/saver.py", line 1293, in __init__
    self.build()
  File "/home/kamalraj/anaconda2/lib/python2.7/site-packages/tensorflow/python/training/saver.py", line 1302, in build
    self._build(self._filename, build_save=True, build_restore=True)
  File "/home/kamalraj/anaconda2/lib/python2.7/site-packages/tensorflow/python/training/saver.py", line 1339, in _build
    build_save=build_save, build_restore=build_restore)
  File "/home/kamalraj/anaconda2/lib/python2.7/site-packages/tensorflow/python/training/saver.py", line 796, in _build_internal
    restore_sequentially, reshape)
  File "/home/kamalraj/anaconda2/lib/python2.7/site-packages/tensorflow/python/training/saver.py", line 471, in _AddRestoreOps
    assign_ops.append(saveable.restore(saveable_tensors, shapes))
  File "/home/kamalraj/anaconda2/lib/python2.7/site-packages/tensorflow/python/training/saver.py", line 161, in restore
    self.op.get_shape().is_fully_defined())
  File "/home/kamalraj/anaconda2/lib/python2.7/site-packages/tensorflow/python/ops/state_ops.py", line 280, in assign
    validate_shape=validate_shape)
  File "/home/kamalraj/anaconda2/lib/python2.7/site-packages/tensorflow/python/ops/gen_state_ops.py", line 58, in assign
    use_locking=use_locking, name=name)
  File "/home/kamalraj/anaconda2/lib/python2.7/site-packages/tensorflow/python/framework/op_def_library.py", line 787, in _apply_op_helper
    op_def=op_def)
  File "/home/kamalraj/anaconda2/lib/python2.7/site-packages/tensorflow/python/framework/ops.py", line 3271, in create_op
    op_def=op_def)
  File "/home/kamalraj/anaconda2/lib/python2.7/site-packages/tensorflow/python/framework/ops.py", line 1650, in __init__
    self._traceback = self._graph._extract_stack()  # pylint: disable=protected-access

InvalidArgumentError (see above for traceback): Assign requires shapes of both tensors to match. lhs shape= [91588,300] rhs shape= [91589,300]
         [[Node: save/Assign_375 = Assign[T=DT_FLOAT, _class=["loc:@word_mat"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/device:C
PU:0"](word_mat, save/RestoreV2:375)]]

Hi @kamalkraj  could you please tell me which version of spacy you're using for this environment? The version I used for this specific model is 2.0.9. If you're not using 2.0.9 please delete the data directory and run the preprocessing step again after upgrading spacy to the latest version.

i have used spacy 2.0.2

@kamalkraj please let me know if it works with spacy==2.0.9?

Yeah ,It worked .Thanks


ember emitter generates the pulse but don´t send it

i tried using latest stable embers and the dev builds, i also found an similar problem in reddit, the mod list is this

This is Valkyrien Warfare's fault, not embers, that mod changes the physics of things, so i assume a fix would be to blacklist ember's energy, no idea how it works though.


[Bug]: Object property inference error

Is there an existing issue for this?

[X] I have searched the existing issues

Description
When I use optional chaining, the system defaults to inferring that the property value is undefined, but in reality, the property has a value.
Steps To Reproduce

fetch data and successful
bind value to widget
use ? Optional chaining
show the property is undefined
remove ?
display the correct value

incorrect

correct
Public Sample App
No response
Environment
Production
Issue video log
No response
Version
Appsmith Community v1.9.37

@fguizc thank you for reporting this

@arunvjn could you please investigate and RCA this?

This looks like a bug with peek overlay.
cc: @bharath31 @hetunandu


Enforce kebab-case in file and folder names for main content and drops unused assets

NOTE: this PR has a seeded error to test the GitHub action. I'll removed it once the test is confirmed to work.

Contributes to #780
Drops unused resources
Renames files under the directories "assets content static" to ensure that they names are in kebab-case
Adds NPM scripts to support the checks
Adds a GitHub action to check filenames

NOTE: this PR has a seeded error to test the GitHub action. I'll removed it once the test is confirmed to work.

Confirming that both the new check-filenames and edit check-formatting jobs work (report errors as expected): https://github.com/open-telemetry/opentelemetry.io/actions/runs/5532928921/jobs/10095700285?pr=3019


test fix node-fetch vulnerability by upgrading nextJS

Running npm audit raised a vulnerability issue with node-fetch and recommended that we install<EMAIL_ADDRESS>to resolve the vulnerability.
This updates next from v11 to v12.

Closing as this branch was used to test upgrading nextJS to fix a vulnerability. Fix done without needing to upgrade NextJS.


fixes broken netlify build

fix broken eslint

Deploy preview processing.
Built with commit 65fb9a4195076bee497d59dd3567f1e4cdfa9b13
https://app.netlify.com/sites/open-sauced/deploys/59dbbcd5a6188f40d4a13c36


Lane and poles are the same color in semantic segmentation

Hi,
I obtained the images from Camera Segmentation but I discovered that "RoadLines" and "Poles" classes have the same color in the images (153, 153, 153).
How can I fix this problem?
Thanks

Hi @Capuz93,
You're right! The road lines used to be (157, 234, 50). It can be modifies in CityScapesPalette.h.
I'm not sure what's the color in CityScapes, can't seem to find road lines there. When I did that I was using the labels here.

Thanks.
I changed the values in CityScapesPalette.h but the color of lanes and poles are still the same.
What should I have to do?
Thanks

Ok I fixed it. I changed label_pixel_converter.h.
Thanks

Wait, don't close it until we fix it too :sweat_smile:


Add SEP TC for Monitoring

Signed-off-by: mwaykole<EMAIL_ADDRESS>

==============================================================================
Run STARBURST Query And Check Values Are Not Empty :: Verifies the... | PASS |
------------------------------------------------------------------------------
Tests.Ai Apps.Starburst.Managed Starburst Monitoring :: Test suite... | PASS |
1 test, 1 passed, 0 failed
==============================================================================
Tests.Ai Apps.Starburst                                               | PASS |
1 test, 1 passed, 0 failed
==============================================================================
Tests.Ai Apps                                                         | PASS |
1 test, 1 passed, 0 failed
==============================================================================
Tests                                                                 | PASS |
1 test, 1 passed, 0 failed


Customizable SVM for PSM post-processing

Introduces a new uNode that can post-process search results in a similar manner to Percolator. SVM parameters (e.g. the kernel) can be changed via the UController params.
to do:

add documentation
add tests
extend basic functionality with more experimental features

looks cool Lukas! Unfortunately still has conflicts with uparams :(
Can you fix this ?

Sure, I'll fix it on the week end!

Hi Lukas,
I'm sorry, I had to fix a bug in uparams, now it's conflicting with you version again :/

No problem. My quick merge attempt failed, I'll try to fix it when I'm at my work station.

Should be fixed now!


BREAD creates singular table name but uses plural

Laravel Version: 5.5
Voyager Version: 1.0.2
PHP Version: 7.1

Description:
If I create table with singular name, I cant open it for browsing
Steps To Reproduce:
Create new database with name "ket"
Add BREAD to it
open "/admin/ket"
you will get error "Base table or view not found: 1146 Table 'intr.kets' doesn't exist (SQL: select * from kets order by created_at desc)"
But in database its saved as "ket" not "kets"

https://laravel.com/docs/5.5/eloquent#eloquent-model-conventions should answer your question.  If you create a table that doesn't follow Laravel conventions, you will need to modify the model class manually to make it work.
This is not a Voyager issue.

Would it be reasonable to add a flash warning about doing this?
Or prevent poor naming unless you request a model file be created?


Empty spaces in the table

[Enter feedback here]
The below table has blank spaces in the field of >8 and <=16 TiB’s ”IOPS per file” and ”Throughput per file”.
What values do they have actually?

File size
>=0 and <=128 GiB
>128 and <= 512 GiB
>0.5 and <=1 TiB
>1 and <=2 TiB
>2 and <=4 TiB
>4 and <=8 TiB
>8 and <=16 TiB

IOPS per file
500
2300
5000
7500
7500
12,500

Throughput per file
100 MiB/s
150 MiB/s
200 MiB/s
250 MiB/s
250 MiB/s
480 MiB/s

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 4dff594a-77ba-dca2-e3ae-f3a7bf0c3e1d
Version Independent ID: b496ce1e-c8e6-8fe4-d41d-6f57606f5034
Content: Resource limits - Azure SQL Managed Instance
Content Source: articles/azure-sql/managed-instance/resource-limits.md
Service: sql-managed-instance
Sub-service: service-overview
GitHub Login: @vladai78
Microsoft Alias: vladiv

@naokitakeda14 Thank you for the feedback. This is being assigned to the content author to evaluate and update as appropriate.

Hi @naokitakeda14 , thanks for contacting Microsoft! The table has been updated, and that extra column has been removed. I'll go ahead and close out this Git Issue but please feel free to comment should you need anything further.
Thanks again for helping improve our documentation and I hope you have a wonderful rest of your day!
Masha from the SQL Docs team
#please-close
#reassign:niko-neugebauer


What is the expected syntax for date fields?

Your environment

Terraform Provider Version: 1.0.2

Connect Server Version: 1.2.0

OS: macOS 11.6.1

Terraform Version: 1.0.6
What happened?
I've been unable to find acceptable Terraform syntax for creating a date-typed 1Password field. Attempts so far have all resulted in "400 Bad Request" results back from terraform apply. Here are five potential formats that I've tried, along with one string-typed field to show that the date formatting succeeds.
locals {
  date  = "2021-10-29T23:26:27Z"
  vault = "[redacted vault ID]"
}

resource "onepassword_item" "secret-date-metadata" {
  vault    = local.vault
  title    = "Test of date field creation"
  category = "password"
  password = "bibbity bobbity boo plus my birthdate"

  section {
    label = "Dates"

    field {
      type  = "DATE"
      label = "Expiration date as date"

      # All of these potential values result in "400 Bad Request" from terraform apply
      # value = local.date
      # value = formatdate("YYYY/MM/DD", local.date)
      # value = formatdate("MM/DD/YYYY", local.date)
      # value = "2021/10/29"
      value =<PHONE_NUMBER>
    }

    field {
      type  = "STRING"
      label = "Expiration date as string"
      value = formatdate("YYYY/MM/DD", local.date)
    }
  }
}

What did you expect to happen?
I expected at least one of those five value-setting lines to set a value without an error. I arrived at the<PHONE_NUMBER> epoch date by looking at how the JSON data came back from the op CLI after setting a date field interactively, but setting it also failed.
Ideally, I'd like to find a date format acceptable to 1Password Connect's Terraform provider that can be emitted by Terraform's formatdate function (epoch date is not on that list).
Steps to reproduce

Plug in a valid vault ID in the locals block, and apply the above file.

Notes & Logs
│ Error: Unable to update item. Receieved "400 Bad Request" for "/v1/vaults/[redacted-vault-ID]/items/l3bwryhvzkf3eyx2aye2xh3nyu"
│
│   with onepassword_item.secret-date-metadata,
│   on date-format.tf line 5, in resource "onepassword_item" "secret-date-metadata":
│    5: resource "onepassword_item" "secret-date-metadata" {

When I passed in an invalid date format, I noticed the Terraform provider hinted about the format.
Since so many applications use RFC3339 to exchange dates I made a feature request #135 to support it.

Currently, the valid format is YYYY-MM-DD. It will print more user-friendly error in this PR #150
See the documentation for the details


[TF 2.0 API Docs] tf.math.acos

System information

TensorFlow version: 2.0
Doc Link: https://www.tensorflow.org/versions/r2.0/api_docs/python/tf/math/acos

Describe the documentation issue
Documentation for tf.math.acos is created from a generated file, python/ops/gen_math_ops.py. It would be excellent to have a link to the files that are used to generate gen_math_ops.py - so a user could make modifications quickly, without having to search through tensorflow/tensorflow.
tf.math.acos could use a clear description, usage examples, and example visuals. A great template to model this on could be numpy.arccos.
Users also experience obfuscated errors from unexpected arguments (ex: strings, Booleans, and even just ints). Some examples are shared below. The file used to generate this error is located here. All tf.math.* operations and the operations they influence (e.g., tf.linspace) would experience these same obfuscated XLA errors.
InvalidArgumentError: Invalid cast from floating point type to S32 in ConstantR0WithType.
	 [[{{node Acos}}]] [Op:Acos]

InternalError: Could not find valid device for node.
Node: {{node Acos}}
All kernels registered for op Acos :
  device='XLA_CPU'; T in [DT_FLOAT, DT_DOUBLE, DT_INT32, DT_COMPLEX64, DT_INT64, DT_COMPLEX128, DT_HALF]
  device='XLA_CPU_JIT'; T in [DT_FLOAT, DT_DOUBLE, DT_INT32, DT_COMPLEX64, DT_INT64, DT_COMPLEX128, DT_HALF]
  device='CPU'; T in [DT_DOUBLE]
  device='CPU'; T in [DT_FLOAT]
 [Op:Acos]

We welcome contributions by users. Will you be able to update submit a PR (use the doc style guide) to fix the doc Issue?
I shall certainly try! :)

Hi @dynamicwebpaige. I searched through the tensorflow repo, and it looks like one needs to edit the .pbtxt files inside tensorflow/tensorflow/core/api_def/base_api to modify the documentation. Can you confirm this?

@Sudeepam97 I believe that the gen_math_ops.py file is generated from tensorflow.bzl. There are C++ kernels located here for each op - most of the mathematical operations live in that repo. :slightly_smiling_face:
cc: @MarkDaoust @lamberta to keep me honest, though! Do we have a recommended process for updating those docs?

@Sudeepam97 Just confirmed that you are correct! Apologies for the confusion - the .pbtxtfiles in /base_api still create the documentation for several of the TF 2.0 math endpoints.
Let me take a look at your PR; we might need to tweak the syntax a little bit (format is a special flavor of markdown). Check out this endpoint for a usage example.

@dynamicwebpaige, that's great! Please take your time to review the PR, I'll be happy to work on any changes that are necessary. :smile:
I seem to understand how to modify the API docs now. I can work on other similar issues as well.

@dynamicwebpaige
Created 5 PRs covering some of the math functions. Working on other functions.

I would love contributing to this. Please tell me how to proceed as I am newcomer.

@SSaishruthi are there any ops left to do

Just a note for people working on this: if you add python doctests, please make sure to do so in Python files, not in base_api/api_def files as those are the APIs for other languages too.

#42496

Looks like the changes made to tf.math.acos and tf.math.add were not merged with the previous PRs. I have opened a new PR to address this. Since this is my first PR I'm limiting the number of changes I make to only the .pbtxt files. Once I get this sorted out I will begin to modify .Docs in math_ops.cc to reflect the changes.

is anyone working on this issue? @dynamicwebpaige

#42619 solved this
The nightly version has updated docstring.


Add Mutating/ValidatingAdmissionWebhook to Admission Control List

In order to support Istio automatic sidecar injection in Kubernetes 1.9, these two experimental admission controllers are required.
https://kubernetes.io/docs/admin/admission-controllers/#is-there-a-recommended-set-of-admission-controllers-to-use
https://istio.io/docs/setup/kubernetes/sidecar-injection.html#automatic-sidecar-injection

Codecov Report

Merging #1141 into master will increase coverage by 0.1%.
The diff coverage is 100%.

@@            Coverage Diff            @@
##           master    #1141     +/-   ##
=========================================
+ Coverage   35.33%   35.44%   +0.1%
=========================================
  Files          63       63
  Lines        3741     3747      +6
=========================================
+ Hits         1322     1328      +6
  Misses       2207     2207
  Partials      212      212

Impacted Files
Coverage Δ

core/controlplane/config/config.go
62.09% <100%> (+0.27%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4724c4f...fc6bce6. Read the comment docs.

Note from @shraykay:
You need two additional flags for apiserver to actually use istio sidecar-injection:
--proxy-client-cert-file=/etc/kubernetes/ssl/apiserver.pem
--proxy-client-key-file=/etc/kubernetes/ssl/apiserver-key.pem

You can add it by manually editing userdata/cloud-config-controller.

@shraykay LGTM! Thanks for your contribution 👍


Replaced jQuery .size() method with .length in form behavior

.size() was depreciated in jQuery 1.8
This must have been missed back when the bug #1586 was fixed in 1.7

Sorry I think I buggered up the PR. The commit I was trying to get through to the next branch is 	'Replaced jQuery .size() method with .length' (a7b51b0)

I had the same PR problems. :smiley:
It happens when you create a branch from master and try to merge into next. If you are not very experienced with pull requests the contributing guide is a bit short...

Added