LUCENE-10532: remove @Slow annotation

This annotation is such an antipattern, it is so harmful to our codebase.

gives the impression that "slow tests are ok"
it is like "support for slow tests"
allows certain privileged ppl to skip slow tests (those that know the gradle magic)
probably same people are the ones writing slow tests, not having to live with consequences
causes differences across runs of different devs for no good reason

we don't need this annotation. we can work together to keep the tests fast. if tests are slow we can all share the pain until we fix the test to be fast.
this thing is a real antipattern, i think the idea came from solr, but well, look at their tests. let's not be like them.

I'm fine with this. Reasons for Slow (and other test groups) are various. I use Slow in projects where certain tests are indeed slow by nature - have to unpack the distribution/ fork processes or start networking layers. These are typically integration tests. They run on the CI but they're not mandatory for local developer runs. I don't think this is needed in Lucene either.

Thanks @cpoerschke for correcting my dyslexia :)

I'm fine with this. Reasons for Slow (and other test groups) are various. I use Slow in projects where certain tests are indeed slow by nature - have to unpack the distribution/ fork processes or start networking layers. These are typically integration tests. They run on the CI but they're not mandatory for local developer runs. I don't think this is needed in Lucene either.

I like the idea of the test groups actually, it came up on another PR: https://github.com/apache/lucene/pull/633 . I just think lucene would do better with different test groups to better test what we need (e.g. something like suggested @Concurrent.  The @Slow doesn't help us IMO.


Allow passing Cargo args through tool section

Stack:

#1164 ⬅
#1161
#1159
#1157
#1143
#1155

⚠ Part of a stack created by spr. Do not merge manually using the UI - doing so may have unexpected results.

Discussed offline


Fixes nullable lists

main change is to make the following correct, although the changes got a bit wider than i'd like and I'm sure there's still issues with the IsNullable method assuming it should look at the first or last byte (unsure if you've ever read on how this byte array works)
    //public IEnumerable<Test> Tests { get; set; } = new List<Test>();
            Assert.Contains("tests: [Test!]!", schemaString);
            //public IEnumerable<Test>? Tests2 { get; set; }
            Assert.Contains("tests2: [Test!]\r\n", schemaString);
            //public IEnumerable<Test?> Tests3 { get; set; } = new List<Test>();
            Assert.Contains("tests3: [Test]!", schemaString);
            //public IEnumerable<Test?>? Tests4 { get; set; }
            Assert.Contains("tests4: [Test]\r\n", schemaString);

Pulled in a MIT piece of code from .NET Foundation that provides Nullable Info. makes it much easier to figure out what's nullable and what's not.


Custom component import css

Hello!
I want to use a third party library for my custom adminjs component but it requires css or scss file to be imported. If I import css I get an error that I should use a plugin (which one?). How can I get out of the situation with little bloodshed?
Thanks for considering my request!

Not sure if anyone has a better way, but what I did was use styled-components, wrapped the imported 3rd party component into a container div, then used styled components to apply CSS to that container.
eg:
MarkdownPreview.tsx
const MarkdownPreview = ({ text }: MarkdownEditorProps) => {
  return (
    <MarkdownContainer>
      <MDEditor.Markdown source={text} />
    </MarkdownContainer>
  )
}

export { MarkdownPreview }

MarkdownContainer.tsx
const MarkdownContainer = styled.div`
  @media (prefers-color-scheme: light) {
    .wmde-markdown,
    .wmde-markdown-var {
      color-scheme: dark;
      --color-prettylights-syntax-comment: #8b949e;
      --color-prettylights-syntax-constant: #79c0ff;
      --color-prettylights-syntax-entity: #d2a8ff;
   ...
  // copy the code from the css file into here

You can also use styled-component's css: https://github.com/SoftwareBrothers/adminjs-design-system/blob/master/src/utils/datepicker.styles.ts
and import it into your own styled component, but the end result is the same

Hey @dziraf, any idea to do this with scss? My custom component does import scss file.
Thanks


Custom branding fixes

#435
Check List

[x] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

LGTM. Thanks!


Two functions at the same address will only show up in the symbol list once

We can have two functions starting at the same address as long as they have different architectures. However, only one of them will show up in the symbol list.
Also, it would be convenient to annotate the functions with an arch different from the default one. So we can disambiguate between them.

This is actually quite difficult to do. If you're in this scenario you can just switch to linear view and scroll around.


Typo fix

Removing superfluous pronoun ('the your')

Learn Build status updates of commit c7362f8:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/msbuild/msbuild.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the learn.microsoft.com contributor guidesPost your question in the Learn support channel

@JanKrivanek - thanks for fixing this.


Defining a pipeline operator?

I see rhai has operator overloading. Will it be possible to define a pipeline operator? If so, can someone provide the code to do so?
thanks.

What do you mean... something like |>?

@mationai  Just out of curiosity, does it work?


fixed #93 added supported hawkular version

You can do either of 2 things.
Either run mvn license:format to auto format licenses
or
on this line change 2016 to 2017
Maven way is more preferred.

thanks @shubhamvashisht


Figure Out Offers and Deals for Banner/Modal

Objectives/Description:
Determine the specific offers and deals to be highlighted in the New Year's Eve limited-time offer modal on the salon website. Two highlighted offers include:

20% off on the user's first visit.
The first 100 customers will get their beard trimmed for free.

Designing Tasks:

Clearly define and finalize the details for the 20% off offer and the free beard trimming offer.
Ensure that the offers are appealing and encourage users to subscribe to the newsletter.

Acceptance Criteria:
Specific details for both offers (discount percentage, conditions, etc.) are defined.
Offers are compelling and aligned with the salon's theme and archetype.
Additional Information:
Consider any additional terms or conditions associated with the offers.
Consult with the team members or stakeholders to finalize offer details.

Completed the design specific requirements


[Auto-generated] Check & update dependencies (pyproject.toml)

Update dependencies (pyproject.toml)
Automatically created PR based on the 'CI - Check pyproject.toml dependencies' workflow in SINTEF/ci-cd.

Codecov Report

Merging #176 (40a48a4) into ci/dependency-updates (7f40a65) will not change coverage.
The diff coverage is n/a.

@@                  Coverage Diff                   @@
##           ci/dependency-updates     #176   +/-   ##
======================================================
  Coverage                  75.58%   75.58%
======================================================
  Files                         15       15
  Lines                        598      598
======================================================
  Hits                         452      452
  Misses                       146      146

Flag
Coverage Δ

linux
75.58% <ø> (ø)

windows
?

Flags with carried forward coverage won't be shown. Click here to find out more.


cargo command unavailable after automatic Rust installation

After an automatic installation of Rust, the cargo command is not immediately available.
The command only works if the environment is explicitly configured by running
. $HOME/.cargo/env for bash/zsh or
source $HOME/.cargo/env.fish for fish shell.

Fixed with https://github.com/Gentleman-Programming/Gentleman.Dots/issues/15
Could you please check ? :)

It works!
SO: Linux Mint
Terminal: Bash


fix(deps): use latest node lts

Checking if everything's working on acc right now.

Everything seems to be working fine :)


What is the max FPS for real time pose estimation?

Hi,
I would like to do very low latency real time skeleton tracking.
is the FPS limited?
Does anyone know if it's possible to have like 30 or 60 fps? Maybe with a powerfull CPU or GPU?

Hi, this repository is about running Blazepose on the cameras provided by Luxonis (https://docs.luxonis.com/en/latest/). The FPS is limited by the capacity of the MyriadX chip. The max FPS you can get (26 fps) is given in the README of this repo.


rename column. Add new fields to device

Description
Add new fields to device table to accommodate new values for device groups
Fixes # (issue)
Type of change
What is it?

[ ] Bug fix (non-breaking change which fixes an issue)
[X] New feature (non-breaking change which adds functionality)
[ ] Documentation update
[ ] Tests update
[ ] Refactor

Checklist:

[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] I have added tests that prove my fix is effective or that my feature works
[X] New and existing unit tests pass locally with my changes
[X] I run go fmt ./... to check that my code is properly formatted
[X] I run go vet ./... to check that my code is free of common Go style mistakes

Codecov Report

Merging #575 (d7e215f) into main (56b5890) will decrease coverage by 0.01%.
The diff coverage is 0.00%.

@@            Coverage Diff             @@
##             main     #575      +/-   ##
==========================================
- Coverage   21.23%   21.22%   -0.02%
==========================================
  Files          33       33
  Lines        3513     3515       +2
==========================================
  Hits          746      746
- Misses       2659     2661       +2
  Partials      108      108

Impacted Files
Coverage Δ

pkg/routes/updates.go
4.46% <0.00%> (ø)

pkg/services/updates.go
2.84% <0.00%> (-0.03%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 56b5890...d7e215f. Read the comment docs.

/retest

@acosferreira needs rebase

/retest


tags filter does not 'match whole word only '

tags filter does not 'match whole word only' - for example, searching the artist "mana" will download "mana-ko" and "aoi manabu", everything with mana in it.
My syntax was the same as yours :
NHENTAI_TAGS = ['artist:"mana"']
Making the results jump from 200 to 1460

Hi, thank you for the issue. I could recreate the problem and am looking into it.

I have looked into it. It seems like this is not something the nHentai search API supports. Please correct me if I'm wrong, I got my information from here. If you find out how to filter by whole words using the search API, I'm willing to include these instructions into my readme or do small patches if anything needs to be changed.
Of course there must be some way to query for the artist directly, but even if I found out how, using that would mean combination of multiple tags is not done server-side anymore, but client-side. That would cause way too much unnecessary network traffic and metadata download times would shoot up with every tag specified instead of decreasing. I'm not willing to do that.

Ok, then can't be helped. It could be added on the readme. I used Bulk Renaming Utility to filter the files, which can be useful for those who can't do python scripts. Thank you for looking into this.

Has been added to the readme!
Yeah the only way I can think of is doing what you're doing and filter them by the tags contained in the ComicInfo.xml after it has all been downloaded.


[SPARK-34237][SQL] Add more metrics (fallback, spill) to object hash aggregate

What changes were proposed in this pull request?

This PR is to add two more metrics for ObjectHashAggregateExec, i.e. the spill size, and number of fallback to sort-based aggregation.
Why are the changes needed?

As object hash aggregate fallback mechanism is special - it will fallback to sort-based aggregation based on number of keys seen so far 0. This fallback logic sometimes is sub-optimal and leads to unnecessary sort, and performance degradation in run-time. The first step to help user/developer debug is to add more related metrics on UI, e.g. spill size, and number of fallback to sort-based aggregation. (spill size metrics was already added for hash aggregate 1)
Does this PR introduce any user-facing change?

Added two more metrics on Spark UI for operator ObjectHashAggregateExec. Screenshot is attached below.
How was this patch tested?

Added unit test in SQLMetricsSuite.scala.
Tested on spark shell locally and verified the metrics shown up on UI.

without fallback and with fallback separately

cc @cloud-fan and @sameeragarwal could you help to take a look when you have time? Thanks.

cc @cloud-fan and @sameeragarwal could you help to take a look when you have time? Thanks.

Test build #134488 has started for PR 31340 at commit 73b8afc.

Test build #134488 has started for PR 31340 at commit 73b8afc.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39074/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134488/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134488/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39074/

cc @maropu, thanks.

cc @maropu, thanks.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134630/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134630/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39218/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39218/

thanks, merging to master!

thanks, merging to master!

Thanks @maropu and @cloud-fan for review!

Thanks @maropu and @cloud-fan for review!


☂ Next HALO features

Next HALO features
Globally addressible identity

Updating the credetials system to make identify accounts (identities) by a DID
Integration with a DID resolver to enable loose coupling between the DID and the root key of the identity (IdentityKey)
Support did:key and did:plc methods

did:plc

spec
Registry specified in config
Self hosted or https://plc.directory (hosted by BlueSky)
Client-side caching for DID documents
DID document should contain the root identity key as on of the verification keys with the #dxos tag.
DID document may contain an IPFS CID linking to public profile data

Decide on the encoding https://ipld.io/docs/codecs/known/
Public profile data should be cached client-side
Evicting outdated documents from cache
Retry strategy for when registry is unavailable
Cache support for ETag header?

New identities that are created should register the DID document on configured registry

DID generation and signing is fully client-side registry access is not authenticated

Public profile

Globally adressible DID documentes allow for a public user profile
With did:plc only a subset of devices will be able to mutate the DID document - those having "recovery keys"
Initially only some devices will be able to mutate the profile document (change the identity display name for example)
A a profile sync protocol between devices might be devised in the future

UCAN

https://github.com/ucan-wg/spec
UCAN is a superset of the current HALO Credentils
UCANs natively support DIDs
Consider switching from the credentials encoding to UCAN
Deside on the ontology of the control feed messages: UCAN, signed-message, control-message
Space permissions:

data:read/write
presence:read/write
https://github.com/dxos/dxos/issues/4346#issuecomment-1741384593

Default space permissions for peers without membership: read-only on data and/or presence:read/write

Credential state machiene

Credential state machiene must ensure total order
State machiene must be able to be reverted in case the total oreder changes
Initially we might just trigger a fault and restart the app in case the order changess

Contact book

Synced list of contacts between peers
Integrates with the DID documents and public profile
Invitation-like flow to add new peers to the contact book
Ability to add peers manually by their DID
Offline space invitaions for peers from the contact book

Tasks [todo]

Create a @dxos/did-plc package

Data models
Client for the did:plc registry
DID document signing and hashing functions

Create a @dxos/credentials-ucan ucan package with a UCAN-based credentials state machiene

Possible spin-off into a generic @dxos/ucan package

Integration into ECHO [TODO]


Resolution of the dependency failed, .Net Core

I am getting an error while trying resolving with Unity.
Microsoft.Practices.Unity.ResolutionFailedException occurred
HResult=0x80131500
Message=Resolution of the dependency failed, type = "Dell.EMC.CPM.Core.MessageCenter.Sender.ISenderService", name = "(none)".
Exception occurred while: Calling constructor Microsoft.Practices.Unity.InterceptionExtension.PolicyInjectionBehavior(Microsoft.Practices.Unity.InterceptionExtension.CurrentInterceptionRequest interceptionRequest, Microsoft.Practices.Unity.InterceptionExtension.InjectionPolicy[] policies, Microsoft.Practices.Unity.IUnityContainer container).
Exception is: NullReferenceException - Object reference not set to an instance of an object.
Inner Exception 1:
NullReferenceException: Object reference not set to an instance of an object.
I am using Unity.Interception.NetCore Unity.NetCore nuget packages in my C# core console application.
Search the web and didn't find any clue why I am getting this error. Here is my code:
My Interface:
public interface ISenderService
{
    [CommandSaving]
    Task<MessageResponse> SendRequest(MessageRequest req);
}

My derived class:
public class MassTransitSenderService : ISenderService
{
    ...
    public async Task<MessageResponse> SendRequest(MessageRequest req)
    {
     ...
    }
}

HandlerAttribute class:
public class CommandSavingAttribute : HandlerAttribute
{
    public string Topic               // Topic is a named parameter
    { get; set; }

    public override ICallHandler CreateHandler(IUnityContainer container)
    {
        return new CommandSavingCallHandler();
    }

}

ICallHandler class:
    public class CommandSavingCallHandler : ICallHandler
    {

        public IMethodReturn Invoke(IMethodInvocation input, GetNextHandlerDelegate getNext)
        {
            Logger.Log("Log CommandSavingCallHandler");
        }

and the code of the resolving:
    var container = new UnityContainer();

    container.RegisterType<ISenderService, MassTransitSenderService>(
        new InterceptionBehavior<PolicyInjectionBehavior>(),
        new Interceptor<InterfaceInterceptor>());

    container.AddNewExtension<Interception>();

    container.Configure<Interception>().SetInterceptorFor<ISenderService>(
        new InterfaceInterceptor());
    var massTransitsenderService = container.Resolve<ISenderService>();

When I delete the [CommandSaving] that located in my interface above the function I want to Intercepate, I get not error.
Any ideas what is the problem?

Try with the latest. Just deployed numerous fixes...

Hi, I don`t see any update, I have Unity.Interception.NetCore and Unity.NetCore versions 4.0.2 installed.

I did not realize it at first but neither of these packages related to this project. You might want to check with the authors.


Cannot attach logs to errors in New Relic with Monolog 3

We have this Monolog processor
final class NewrelicTraceProcessor implements ProcessorInterface
{
    public function __invoke(array $record): array
    {
        $metadata = newrelic_get_linking_metadata();

        $record['span.id']  = $metadata['span.id'] ?? null;
        $record['trace.id'] = $metadata['trace.id'] ?? null;

        return $record;
    }
}

It makes logs being sent to NR look like so:
{
  "channel": "app",
  "context.alert.expired": "null",
  "context.alert.id": 12844,
  "context.alert.reached":<PHONE_NUMBER>,
  "context.alert.type": "price",
  "context.handler": "Haushalt\\Bl\\DomainBundle\\Application\\Offer\\Handler\\DispatchPriceAlertReachedNotificationHandler",
  "context.offerId":<PHONE_NUMBER>,
  "datetime": "2022-07-13T11:21:58.446984+02:00",
  "entity.guid": "MzIxODc4M3xFWFR8U0VSVklDRXwtODA3OTcwMzc0MDUwOTAyNjc3NQ",
  "entity.guids": "MzIxODc4M3xBUE18QVBQTElDQVRJT058NzQxMTE5ODE5|MzIxODc4M3xFWFR8U0VSVklDRXwtODA3OTcwMzc0MDUwOTAyNjc3NQ",
  "entity.name": "fe-bl-service",
  "entity.type": "SERVICE",
  "extra.uid": "2b4344d",
  "hostname": "h2-wrk1-p02",
  "index": 0,
  "level": 200,
  "level_name": "INFO",
  "Logfile": "/home/h2-fe-bl-service/deployer/current/var/log/prod.log",
  "message": "Dispatching Reached Alert",
  "newrelic.source": "api.logs",
  "service_name": "fe-bl-service",
  "span.id": "b4d0c933685c5c33",
  "timestamp":<PHONE_NUMBER>000,
  "trace.id": "d3c0d394d1c78be8"
}

This is vital for eg. this button to work

because NR attempts to search through logs based on filter trace.id:{traceId}
If we move this to context, this will stop working, NR will not find any logs and button will be disabled. \Monolog\LogRecord allows custom info added only nested under context or extra keys, which is an issue here.

Yeah this should be in an extension/wrapper for the formatter used on your newrelic handler IMO. The processor was an abuse which admittedly worked well before :)
That said if this is standard newrelic functionality why not send a PR to add it by default in the newrelic handler? Or is it an optional thing? It could be made optional then..

Because handler bundled with monolog doesn't use newrelic logs functionality, it just handles errors and even for that one how it works is that it marks current transaction as error. We log to file via stream handler and forward it to NR via fluentbit.
Yeah I guess there could be a custom formatter, but it wouldn't be straightforward. Why did you find it necessary to disallow adding this info outside of context/extra keys?

Because handler bundled with monolog doesn't use newrelic logs functionality, it just handles errors and even for that one how it works is that it marks current transaction as error. We log to file via stream handler and forward it to NR via fluentbit.

OK sorry I am not super familiar with it and forgot that :)

Yeah I guess there could be a custom formatter, but it wouldn't be straightforward. Why did you find it necessary to disallow adding this info outside of context/extra keys?

Because PHP 8.1 finally made it reasonably possible to switch from arrays to more structured objects. This however means that it's not so possible to smash random data on the records anymore. It has to go in context or extra.
I think a custom formatter shouldn't be much more work than the processor tbh. I assume you do write a json formatted file right now?
If so you could do smth like:
final class NewrelicTraceFormatter extends JsonFormatter
{
    protected function normalizeRecord(LogRecord $record): array
    {
        $normalized = parent::normalizeRecord($record);
        $metadata = newrelic_get_linking_metadata();

        $normalized['span.id']  = $metadata['span.id'] ?? null;
        $normalized['trace.id'] = $metadata['trace.id'] ?? null;

        return $normalized;
    }
}

Indeed if it's as simple as that that might be good enough. I'll try it, thanks.

For SEO: The same situation exists for Google Cloud Logging/StackDriver. E.g. if you wish to include a trace ID with logging.googleapis.com/trace it is expected at the top-level.


Wrong website?

This repo has the website link https://seal.io/.  I was hoping to learn more about walrus, so I clicked it.  But it took me to some gpustack thing, which looks unrelated?
Are walrus docs available at another location?  If so, please update the link.

Sorry for the confusion. The repository is no longer actively maintained. We will archive shortly.


create meta package [RFC]

What does this PR do?
Creating meta-package Lightning as an umbrella for pytorch and app
this support installing from source as well as building packages for:

lightning_app as standalone
pytorch_lightning as standalone
lightning including both above + meta package

Before submitting

[x] Was this discussed/approved via a GitHub issue? (not for typos and docs)
[x] Did you read the contributor guideline, Pull Request section?
[x] Did you make sure your PR does only one thing, instead of bundling different changes together?
[ ] Did you make sure to update the documentation with your changes? (if necessary)
[ ] Did you write any new necessary tests? (not for typos and docs)
[ ] Did you verify new and existing tests pass locally with your changes?
[ ] Did you list all the breaking changes introduced by this pull request?
[ ] Did you update the CHANGELOG? (not for typos, docs, test updates, or minor internal changes/refactors)

PR review
Anyone in the community is welcome to review the PR.
Before you start reviewing, make sure you have read the review guidelines. In short, see the following bullet-list:

[x] Is this pull request ready for review? (if not, please submit in draft mode)
[x] Check that all items from Before submitting are resolved
[x] Make sure the title is self-explanatory and the description concisely explains the PR
[x] Add labels and milestones (and optionally projects) to the PR so it can be classified

Did you have fun?
Make sure you had fun coding 🙃
cc @tchaton @rohitgr7 @justusschock @awaelchli @borda

This is the minimal structure with several Todo which shall be addressed in following PRs
the major missing please is updating the Release workflow, but lets keep this PR focused :rabbit:

I still wonder if we really need such a complex and hacky solution for the wrapper.

in other words, you are asking why we have two packages in one repo?


Relay release

@hekike have you seen todays Relay release? You may be interested in middleware for express provided by FB team.

@gyzerok yes. Exciting and graffiti should move forward to support it, but I didn't really have time to dig deeper.

@gyzerok @hekike just noticed this when I moved https://github.com/RisingStack/graffiti-mongoose/issues/22 over. I don't think we're far off. Feel free to contribute your thoughts.


Added SuSE support and params to corosync

Hello,
I've added SuSE support and parametrized the module to more easily extend it for other operating systems.

Closing due to inactivity. Please feel free to open another PR for Suse support.


Enhance kubectl direct get to support custom columns

Any kubectl get ... -o custom-columns still goes to the slower CLI-based route.

I think I'll split this into two: first, we can tackle -o custom-columns; once that has proven out, we can add support for -o custom-columns-file


Error when trying to download default model.

Hi there, I have been following the install instructions youtube video posted a month ago, and everything is working smoothly up until the step to click the "Download Model" shelf button.
When I do this, I get the following output in the console:
Traceback (most recent call last):
  File "E:\resources/houdini/plugins/MLOPs/scripts/python\mlops_utils.py", line 318, in on_accept
    ensure_huggingface_model_local(model_name, download_dir)
  File "E:\resources/houdini/plugins/MLOPs/scripts/python\mlops_utils.py", line 209, in ensure_huggingface_model_local
    from diffusers import StableDiffusionPipeline
  File "C:\Program Files\Side Effects Software\Houdini 19.5.682\python39\lib\site-packages-forced\shiboken2\files.dir\shibokensupport\__feature__.py", line 142, in _import
    return original_import(name, *args, **kwargs)
  File "E:\resources\houdini\plugins\MLOPs\data\dependencies\python\diffusers\__init__.py", line 3, in <module>
    from .configuration_utils import ConfigMixin
  File "C:\Program Files\Side Effects Software\Houdini 19.5.682\python39\lib\site-packages-forced\shiboken2\files.dir\shibokensupport\__feature__.py", line 142, in _import
    return original_import(name, *args, **kwargs)
  File "E:\resources\houdini\plugins\MLOPs\data\dependencies\python\diffusers\configuration_utils.py", line 34, in <module>
    from .utils import (
  File "C:\Program Files\Side Effects Software\Houdini 19.5.682\python39\lib\site-packages-forced\shiboken2\files.dir\shibokensupport\__feature__.py", line 142, in _import
    return original_import(name, *args, **kwargs)
  File "E:\resources\houdini\plugins\MLOPs\data\dependencies\python\diffusers\utils\__init__.py", line 21, in <module>
    from .accelerate_utils import apply_forward_hook
  File "C:\Program Files\Side Effects Software\Houdini 19.5.682\python39\lib\site-packages-forced\shiboken2\files.dir\shibokensupport\__feature__.py", line 142, in _import
    return original_import(name, *args, **kwargs)
  File "E:\resources\houdini\plugins\MLOPs\data\dependencies\python\diffusers\utils\accelerate_utils.py", line 24, in <module>
    import accelerate
  File "C:\Program Files\Side Effects Software\Houdini 19.5.682\python39\lib\site-packages-forced\shiboken2\files.dir\shibokensupport\__feature__.py", line 142, in _import
    return original_import(name, *args, **kwargs)
  File "E:\resources\houdini\plugins\MLOPs\data\dependencies\python\accelerate\__init__.py", line 3, in <module>
    from .accelerator import Accelerator
  File "C:\Program Files\Side Effects Software\Houdini 19.5.682\python39\lib\site-packages-forced\shiboken2\files.dir\shibokensupport\__feature__.py", line 142, in _import
    return original_import(name, *args, **kwargs)
  File "E:\resources\houdini\plugins\MLOPs\data\dependencies\python\accelerate\accelerator.py", line 31, in <module>
    from .checkpointing import load_accelerator_state, load_custom_state, save_accelerator_state, save_custom_state
  File "C:\Program Files\Side Effects Software\Houdini 19.5.682\python39\lib\site-packages-forced\shiboken2\files.dir\shibokensupport\__feature__.py", line 142, in _import
    return original_import(name, *args, **kwargs)
  File "E:\resources\houdini\plugins\MLOPs\data\dependencies\python\accelerate\checkpointing.py", line 24, in <module>
    from .utils import (
  File "C:\Program Files\Side Effects Software\Houdini 19.5.682\python39\lib\site-packages-forced\shiboken2\files.dir\shibokensupport\__feature__.py", line 142, in _import
    return original_import(name, *args, **kwargs)
  File "E:\resources\houdini\plugins\MLOPs\data\dependencies\python\accelerate\utils\__init__.py", line 116, in <module>
    from .megatron_lm import (
  File "C:\Program Files\Side Effects Software\Houdini 19.5.682\python39\lib\site-packages-forced\shiboken2\files.dir\shibokensupport\__feature__.py", line 142, in _import
    return original_import(name, *args, **kwargs)
  File "E:\resources\houdini\plugins\MLOPs\data\dependencies\python\accelerate\utils\megatron_lm.py", line 32, in <module>
    from transformers.modeling_outputs import (
  File "C:\Program Files\Side Effects Software\Houdini 19.5.682\python39\lib\site-packages-forced\shiboken2\files.dir\shibokensupport\__feature__.py", line 142, in _import
    return original_import(name, *args, **kwargs)
  File "E:\resources\houdini\plugins\MLOPs\data\dependencies\python\transformers\__init__.py", line 26, in <module>
    from . import dependency_versions_check
  File "C:\Program Files\Side Effects Software\Houdini 19.5.682\python39\lib\site-packages-forced\shiboken2\files.dir\shibokensupport\__feature__.py", line 142, in _import
    return original_import(name, *args, **kwargs)
  File "E:\resources\houdini\plugins\MLOPs\data\dependencies\python\transformers\dependency_versions_check.py", line 57, in <module>
    require_version_core(deps[pkg])
  File "E:\resources\houdini\plugins\MLOPs\data\dependencies\python\transformers\utils\versions.py", line 117, in require_version_core
    return require_version(requirement, hint)
  File "E:\resources\houdini\plugins\MLOPs\data\dependencies\python\transformers\utils\versions.py", line 111, in require_version
    _compare_versions(op, got_ver, want_ver, requirement, pkg, hint)
  File "E:\resources\houdini\plugins\MLOPs\data\dependencies\python\transformers\utils\versions.py", line 44, in _compare_versions
    raise ImportError(
ImportError: accelerate>=0.20.3 is required for a normal functioning of this module, but found accelerate==0.18.0.
Try: pip install transformers -U or pip install -e '.[dev]' if you're working with git main

I have checked and I don't have another PYTHONPATH environment variable set in the Windows system.
I am using Windows 10, Houdini 19.5.682
Any guidance would be great.. thanks!

Same Issue on Houdini 19.5.605 and 19.5.303

Hi, update MLOPs and reinstall dependencies. I believe this is fixed!

Thanks Paul, it's working now!


Prom rules are being interpreted as templates!

Hi, I have my rules in a separate directory, linted like so:
for rules in rules/*.yml
do
	yamllint $rules
	docker run -v $(pwd)/rules:/rules -i --rm --entrypoint=promtool prom/prometheus check rules /rules/$(basename $rules)
done

https://github.com/VictoriaMetrics/operator/blob/master/docs/quick-start.MD
Now I have trying for a long while to include the rules into my VMrule, like so
apiVersion: operator.victoriametrics.com/v1beta1
kind: VMRule
metadata:
  namespace: {{ .Release.Namespace }}
  name: {{ printf "%s-%s" (include "alert.fullname" $) "awslimits" | trunc 63 | trimSuffix "-" }}
  labels: {{ include "alert.labels" $ | nindent 4 }}
spec:
  {{ .Files.Get "rules/awslimits.yml" | indent 2 }}

But it keeps failing like so:
AML parse error on alert/templates/alerts/awslimits.yml: error converting YAML to JSON: yaml: invalid map key: map[interface {}]interface {}{"AWS service: {{ $labels.aws_service }} usage on account:{{ $labels.aws_account }} is....":interface {}(nil)}
This is because my rules contain Grafana templates. Now if escape using ` around the string, I get:
Error: UPGRADE FAILED: YAML parse error on alert/templates/alerts/awslimits.yml: error converting YAML to JSON: yaml: line 22: found character that cannot start any token
So I am really unsure how to proceed. When converting it into a string I get the error:
spec in body must be of type object: "string"

Hello, you can look how its implemented at k8s stack helm chart:
https://github.com/VictoriaMetrics/helm-charts/blob/master/charts/victoria-metrics-k8s-stack/templates/rules/etcd.yaml
rules are escaped with python script: https://github.com/VictoriaMetrics/helm-charts/blob/master/charts/victoria-metrics-k8s-stack/hack/sync_rules.py#L160
this script converts basic alerting rules into helm escaped.

That seems pretty complex to run a script to escape it!

I ended up escaping differently and get further...


What happened to ssdt unit test documentation

I was about to read the ssdt unit test docs again... And they're gone. Will they be back?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 5416573b-dd99-f3c9-1707-32fb38023788
Version Independent ID: 45ebd856-0161-4ea2-2833-d1ec165ebc97
Content: Visual Studio testing tools - Visual Studio
Content Source: docs/test/improve-code-quality.md
Product: visual-studio-dev15
GitHub Login: @gewarren
Microsoft Alias: gewarren

@stevestein I can't seem to find SSDT unit test docs either. Can you help? This link (https://msdn.microsoft.com/en-us/library/jj851212(v=vs.103).aspx) redirects to previous-versions but I can't seem to find the docs there.

@RubixRevenge I believe this happened accidentally, and we are hoping to resolve it soon. Thanks for alerting us to this!

@RubixRevenge We have removed the redirects that were causing those topics to "go missing". The links should all be working now. Thank you so much for letting us know!

Google search results are still pointing me to the redirect pages. Assuming
it takes a while for the Google search results to update, how do I search
for the pages I need?
Henry Wyckoff
<EMAIL_ADDRESS>On Fri, Jun 15, 2018 at 11:40 AM, Genevieve Warren<EMAIL_ADDRESS>
wrote:

@RubixRevenge https://github.com/RubixRevenge We have removed the
redirects that were causing those topics to "go missing". The links should
all be working now. Thank you so much for letting us know!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/MicrosoftDocs/visualstudio-docs/issues/1118#issuecomment-397708754,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ARLhUI5-76EfJtJAIMf714LfE0KVuIL6ks5t8_-NgaJpZM4UnQBn
.

Can you try this link and then navigate from there using the table of contents? https://msdn.microsoft.com/en-us/library/jj851200(v=vs.103).aspx

I"m still getting "Previous versions".
I've already tried the docs.microsoft search without success. And I don't
look forward to crawling through the site -- I've spent enough time on this
as it is. I already have my Google search terms set up for easy access.
I'll check next week in the hope that the Google search results are
refreshed.  If not, I'll drop a line here.
Henry Wyckoff
<EMAIL_ADDRESS>On Fri, Jun 15, 2018 at 12:23 PM, Genevieve Warren<EMAIL_ADDRESS>
wrote:

Can you try this link and then navigate from there using the table of
contents? https://msdn.microsoft.com/en-us/library/jj851200(v=vs.103).aspx
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/MicrosoftDocs/visualstudio-docs/issues/1118#issuecomment-397719045,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ARLhUKp--vmmpR54AmtPFfUhNTxtx1sgks5t9AmjgaJpZM4UnQBn
.

Henry, I think this must be a caching issue for you because everything is working for me, including the Google search results. The docs are still on MSDN so you won't find them on docs.microsoft.com.

Good idea. I forced Chrome to clear the cache and the correct page is
loading now. Thank you for your help.
Henry Wyckoff
<EMAIL_ADDRESS>On Fri, Jun 15, 2018 at 12:32 PM, Genevieve Warren<EMAIL_ADDRESS>
wrote:

Henry, I think this must be a caching issue for you because everything is
working for me, including the Google search results. The docs are still on
MSDN so you won't find them on docs.microsoft.com.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/MicrosoftDocs/visualstudio-docs/issues/1118#issuecomment-397721236,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ARLhUBPYHbP_nJdsir6wLPagsguVkD4Kks5t9AvMgaJpZM4UnQBn
.


Clarify who/what an account represents in signup page

With Nightscout we expect to see more accounts that are managed by legal guardians, that are representing data from another individual. (In this case, minors.)
We'd like to make sure these users understand how to operate these accounts: each account represents an individual. It should only be yourself, or someone you are a legal guardian for.
(Note: accounts with data from children is OK by the terms of use, provided that data isn't coming from the child directly – COPPA forbids collecting data directly from a child. "If we become aware that we have directly collected personal information from a child under 13, we will delete that information.")

Suggested change – in the sign up form (account creation), after "Your imported data will be private by default." add "An account should represent an individual – your personal data, or someone for whom you are a legal guardian."
Old version:

New version:

Feedback invited, especially from @danamlewis!

I like! Although, I wonder about going one step further and also adding: "If you would like to upload data from multiple people (i.e. yourself and your child, or multiple children), make sure to create an account for each individual's data."
Also, should the new sentence(s) be a line down from the privacy line? Otherwise I think eyes may skip over them.

I tend to avoid adding too much wording -- the failure mode is that people don't read it.
Adding a new line sounds good though! I'll try that and deploy.


fix: non-scoped package handling

Fixes #2359
Fixes parsing of npm package names when non-scoped.

@ianlewis let's also add an e2e / regression tests, tracked in https://github.com/slsa-framework/slsa-github-generator/issues/2368


download the cdn promise polyfill for IE only, IE 11 is also the mini…

…mum now

Coverage remained the same at 87.839% when pulling 99eb387286aacf56261413638b26463142cba086 on f223-ie-promise into 3ef6b569b4da7c7bf673141a7a6ff3e8f15e0c6e on master.


Using a secondary color modus-button doesn't display correctly

Prerequisites

[X] I have searched for duplicate or closed issues
[X] I have read the contributing guidelines

Describe the issue
Using a secondary color modus-button doesn't appear to work correctly.
<modus-button color="secondary">Secondary</modus-button>

Reduced test cases

Go to: https://coliff.github.io/modus-web-components-example/#buttons
Check the button to the right of the first Primary button
If you hover over it it shows the hover state.

What operating system(s) are you seeing the problem on?
Windows
What browser(s) are you seeing the problem on?
Microsoft Edge
What is the issue regarding ?
@trimble-oss/modus-web-components
What version of npm package are you using ?
Latest
Priority
Medium
What product/project are you using Modus Components for ?
Modus
What is your team/division name ?
Modus
Are you willing to contribute ?
Yes
Are you using Modus Web Components in production ?
No response

Primary button has this:

Secondary button has this:

SO I'll add those fallback values to fix this issue.

This is also an issue with the danger button as reported by Olivia Dendinger on Google Chat.

It seems that the issue occurs when the theme file located at<EMAIL_ADDRESS>is not referenced, as the fallback colors appear to be missing.

@enowak1031 @coliff I fixed the issue because while investigating I was also able to fix it.


Fix Qt UI High DPI scaling

closes #2959

After looking at the suggestion on the original issue,maybe I'll need to adjust the css to use pt instead of px aswell to get the scaling working .

Closing pr for now,since the css needs to be changed for it to be scalable.Will reopen once its done

Have you checked if this is an issue after https://github.com/dashpay/dash/pull/3217 was merged?

Nope,thanks for that info,was trying to see why my change didn't do much.Will look into that pr


Create a repo: solang-substrate-ci

I've got a request for a new repository. solang-substrate-ci will be a fork of the substrate contracts node with our own additions we need on our CI. We'll publish solang-substrate-ci container images to use on the Solang CI.

GitHub repo to create: solang-substrate-ci
Project to be added to: Solang
Teams with which access

Team name: Solang Commiters
Role: Admin

If possible, could you please fork this is the repository instead of creating a new empty one?

Thanks a lot!


Add Spring-security to server-chassis

Signed-off-by: Liviu Popa<EMAIL_ADDRESS>

WIll be created from a new branch from my fork


Error loading when loading models other than BrainStem

I updated gltf-test Minimal glTF library and tested some models.
https://cdn.rawgit.com/cx20/gltf-test/b12768e1aad9853a53f583d5a9c568b02a3aae33/index.html
Models such as Box, RiggedFigure, BrainStem can be displayed.
However, I get an error when trying to display Avocado or Duck.
Duck.gltf result
index.js:460
Uncaught TypeError: Failed to execute 'uniform4fv' on 'WebGL2RenderingContext': No function was found that matched the signature provided.
    at drawPrimitive (index.js:460)
    at drawNode (index.js:518)
    at drawNode (index.js:534)
    at drawScene (index.js:542)
    at render (index.js:660)
    at MinimalGLTFLoader.glTFLoader.onload (index.js:675)
    at MinimalGLTFLoader.glTFLoader.glTFLoader._checkComplete (minimal-gltf-loader.js:697)
    at loadArrayBufferCallback (minimal-gltf-loader.js:941)
    at XMLHttpRequest.xobj.onreadystatechange (minimal-gltf-loader.js:1319)

I think that a model without vertex color probably has become an error.

Thanks @cx20 for the report! I've fixed the issue at the latest commit:
https://github.com/shrekshao/minimal-gltf-loader/commit/85492f33e1dad2ee2bfed83f90d2eced3567700d
It's a typo in the renderer example


Allow psr cache 2

This PR seems fine to me, since this project is not affected by any of its changes. Could it be reviewed?

@frankdejonge Is it possible to merge this and also allow || ^3.0 so that this library can be as portable as possible? As far as I can tell this library doesn't rely on a specific version of PSR-6.


nixos/sshServe: use bash as default shell for nix-ssh user

Description of changes
Using the user-set default shell (which is intended for non-system users) for the nix-ssh user can lead to unpredictable behavior, such as fish complaining about the unwritable home directory on every connection. Bash is guaranteed to be available and work as expected, so explicitly use it instead.
Current issue, when users.defaultUserShell = pkgs.fish;:
> nix store ping --store 'ssh-ng://nix-ssh@host?ssh-key=nix-builder.key'
Store URL: ssh-ng://nix-ssh@host
error: can not save history
warning-path: Unable to locate data directory derived from $HOME: '/var/empty/.local/share/fish'.
warning-path: The error was 'Operation not permitted'.
warning-path: Please set $HOME to a directory where you have write access.

error: can not save universal variables or functions
warning-path: Unable to locate config directory derived from $HOME: '/var/empty/.config/fish'.
warning-path: The error was 'Operation not permitted'.
warning-path: Please set $HOME to a directory where you have write access.

Version: 2.18.1
Trusted: 1

Store operations don't completely fail, but do spam useless errors like this.
When only setting users.users."nix-ssh".useDefaultShell = false;:
> nix store ping --store 'ssh-ng://nix-ssh@host?ssh-key=nix-builder.key'
Store URL: ssh-ng://nix-ssh@host
error: cannot open connection to remote store 'ssh-ng://nix-ssh@host': error: protocol mismatch, got 'This account is currently not available.'

Setting users.users."nix-ssh".shell = pkgs.bashInteractive;:
> nix store ping --store 'ssh-ng://nix-ssh@host?ssh-key=nix-builder.key'
Store URL: ssh-ng://nix-ssh@host
Version: 2.18.1
Trusted: 1

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[x] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/prs-ready-for-review/3032/3143


[10.1.x] ISPN-11209 Max Idle changes caused a REPL read performance regression

Make sure to not calculate segment if segmentation is disabled
Add in interface to prevent additional if/else blocks

https://issues.redhat.com/browse/ISPN-11209

Merged, thanks Will!


Laravel 5.7

I saw composer.json was already updated, could you please tag a release now 5.7 is out? ❤

Fixed in 1.1.0 :)

Packagist is not updating (again)... https://packagist.org/packages/beyondcode/laravel-view-xray
Maybe the new integration will work better 😅


recipe for lispy should pull in another clojure file

I did read the relevant section of the docs, but I wasn't able to find where the default recipe for lispy actually lives (sorry).
With the default recipe, which does pull in the file lispy-clojure.clj, I get errors:
error in process filter: lispy--clojure-middleware-load: CompilerException java.io.FileNotFoundException: /home/blake/.emacs.d/straight/build/lispy/lispy-clojure-test.clj (No such file or directory), compiling:(/home/blake/.emacs.d/straight/build/lispy/lispy-clojure.clj:588:1)

error in process filter: CompilerException java.io.FileNotFoundException: /home/blake/.emacs.d/straight/build/lispy/lispy-clojure-test.clj (No such file or directory), compiling:(/home/blake/.emacs.d/straight/build/lispy/lispy-clojure.clj:588:1)

This is because, in spite of the name of the file, it is required functionality and the lispy-clojure namespace tries to load it dynamically. Since the straight recipe leaves it out, it isn't available and this breaks lispy.
My fix is to use this recipe:
  :straight
  (lispy :type git :files (:defaults "lispy-clojure.clj" "lispy-clojure-test.clj") :host github :repo "abo-abo/lispy"
    )

I would be happy to make a PR that fixes the default recipe, if someone can point me to it.

The recipe for lispy I get with straight-get-recipe is:
(lispy :type git :files (:defaults "lispy-clojure.clj") :host github :repo "abo-abo/lispy")

Which I believe is the same as melpa's lispy recipe.

I wasn't able to find where the default recipe for lispy actually lives

Check out straight-recipe-repositories, and straight-recipes-REPO-(retrieve|list). In this case, the recipe is retrieved from MELPA.
straight.el does not maintain any package recipes. That would be way too much work. Instead, I have it steal other people's data! :)

in spite of the name of the file, it is required functionality

If that's the case, it's a problem on MELPA's end. The MELPA package does not include this file either.

What was the resolution here? I notice that the MELPA recipe has not been changed.

I opened https://github.com/abo-abo/lispy/issues/401 to ask the maintainer. If this makes sense, I'll make a PR on MELPA.

It is broken for me without overriding the recipe, like this
use-package lispy
  :straight
  (lispy :type git
         :files (:defaults "lispy-clojure.clj" "lispy-clojure-test.clj")
         :host github
         :repo "abo-abo/lispy")
  ;; ...
  )

The file lispy-clojure-test.clj is really not required functionality and lispy-clojure.clj shouldn't throw in its absence. That's been fixed in abo-abo/lispy master.


Amplify Console Monitoring improvements and Real-Time Access Logs

Is your feature request related to a problem? Please describe.
Currently, for our amplify deployed website, there is no way to monitor incoming requests, cache hit rates, latency, and error rates which is very important for DevOps. Access logs do actually provide some information for all of this, but they take up to 1 hour to appear, meaning if there is something wrong that we don't notice ourselves it can take up to 1 hour to find out about it.
Describe the solution you'd like
Ideally, we would like to monitor the Cloudfront instance which is created by the amplify app. We are interested in monitoring incoming requests, cache hit rate, latency, and error rates.
Having real-time or 5min late access logs would work for us too since we could reuse the current setup we have now to monitoring everything we need.
Additional context
At the moment we have a setup where we schedule a Cloudwatch job to trigger a lambda function every 5 minutes, which will call amplify to generate access logs, then we upload them to S3, trigger SNS to forward to Splunk, and connect that with Grafana for monitoring. We perform multiple deployments throughout the day, and our website is one of the most visited ones in Norway, so having good up-to-date monitoring is crucial for us.
We are still live with our old solution where we primarily use S3+Cloudfront+Cloudwatch, and the amplify solution is running in a shadow now. The only thing really holding us back from fully switching to amplify is monitoring, because we don't want to go live without knowing what is working and what is not, so it would be great to get some improvements with this 😊

Hi @arnaskro,
Thanks for reaching out. We are in the process of surfacing CloudFront metrics to the Console, will update this thread once its out :)

I can't believe how fast you guys are 🎉
This morning I opened up amplify console and to my surprise, there are 3 new features: CloudFront metrics, alarms and Dark Mode 🥳 You just made my day! Thank you and keep up the good work 🤩

The documentation for monitoring Cloudwatch metrics and setting alarms is now available at this link:
https://docs.aws.amazon.com/amplify/latest/userguide/access-logs.


RuntimeError: Bad magic number in .pyc file

the whole:
[>] Enter uninspected file path : C:\Users\paulr\Downloads\DECOMPILEMAINL\Silence.pyc
RuntimeError: Bad magic number in .pyc file
[>] The code is finished
it was a .pyc file and in pycdc it says
WARNING: Decompyle incomplete

You have to decompile your original file with the right version of Python.
As example to fix that, use pyinstxtractor on your executable file.
In the logs, you'll have the Python version used to compile the original code.
Then, install this version on your computer if you don't already have it, and do the same thing but executing it with this version, it will give you uncorrupted files.
(ex: py -3.9 pyinstxtractor file.exe)


Removing legacyBehavior param from pkg/client

Now that we have deleted preV1beta3 APIs, this is not required anymore.

@bgrant0607 @caesarxuchao @krousey

Shippable:
_output/local/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/client/request_test.go:211: too many arguments in call to NewRequest
Otherwise LTGM.

Fixed the test. Shippable is green now!


Add support for Windows built in TTS

Hi, just a suggestion I guess.  I used https://github.com/DeepHorizons/tts as a fairly easy glue to tie Windows TTS stuff into voicebox as just another engine:
https://github.com/jason-kane/coh_npc_voices/blob/voice-editor/src/coh_npc_voices/engines.py#L18-L32
Obviously room for improvement, but it works well enough.
It's handy as a free local option on windows.
Nice library, saved me all kinds of time.  Thank you.

Hi there, thanks for the recommendation, definitely looks easy enough to add. I've somehow managed not to have any Windows machines in my possession, so I can't fully test it myself, but your example works so that's good enough for me :)
I will come back to this once this grad school semester is over. Glad you found the library useful!

Finally got around to this -- I ended up adding a new Pyttsx3TTS class (docs), which supports using the built-in offline TTS engines in Windows and macOS, as well as espeak on Ubuntu.
It is available in the latest version, 0.0.10. You should be able to use it by just running:
pip install -U "voicebox-tts[pyttsx3]"
Hope this covers your use case!


tiny mistype on page 34

original content on page 34

Storage devices such as HDDs adn SSDs present a native block size with 512k and 4k..

should be

Storage ----------------------------------------------------------------------512B and 4k..

Thanks for finding and reporting the typo! We'll fix it in the next revision.


test User.UsersByIds

check commit bf783ea49edba1886b81811d56aa136f6ea30e87 to review the changes.
I pushed into master instead in the branch (sorry...)

PR accepted and merged.


Bug: ChromeDriver 98.0.4758.48 has a bug

Hello,
there was a bug in ChromeDriver 98.0.4758.48 https://bugs.chromium.org/p/chromedriver/issues/detail?id=3999.
It is fixed now in https://chromedriver.storage.googleapis.com/index.html?path=98.0.4758.102/
Would it be possible to rebuild the docker images (especially jdk-11) in the docker hub with the fix, please?
Thank you in advance

Apologies for not replying sooner, I didn't receive a notification.
ChromeDriver has now been upgraded to 100.0.4896.60 - does that resolve your problem?

Closing until further feedback.


Adds .NET7 targets

Description

Adds .NET7 targets
Docker images moved to .NET7
Integration tests moved to .NET7
Nuget packages packed with .NET6/7

Todo:

[x] This doubles build/unit test times, try to reduce these

Testing

Unit tests run on 6/7
Existing tests pass

FHIR Team Checklist

[x] Update the title of the PR to be succinct and less than 50 characters
[ ] Add a milestone to the PR for the sprint that it is merged (i.e. add S47)
[x] Tag the PR with the type of update: Bug, Dependencies, Enhancement, or New-Feature
[x] Tag the PR with Azure API for FHIR if this will release to the Azure API for FHIR managed service (CosmosDB or common code related to service)
[x] Tag the PR with Azure Healthcare APIs if this will release to the Azure Healthcare APIs managed service (Sql server or common code related to service)
[ ] CI is green before merge
Review squash-merge requirements

Semver Change (docs)
Patch|Skip|Feature|Breaking (reason)

@apurvabhaleMS, @LTA-Thinking, if approved, please merge too. Or take over the PR if needed


No such file or directory: 'datasets/metadata/lvis-21k_clip_a+cname.npy'

Thanks for open-sourcing the great work of Detic for the community!
I encountered the problem when trying to reproduce the result of cross-dataset evaluation in MODEL_ZOO.md
python train_net.py --num-gpus 2 --config-file configs/Detic_LCOCOI21k_CLIP_SwinB_896b32_4x_ft4x_max-size.yaml --eval-only DATASETS.TEST "('objects365_v2_val',)" MODEL.RESET_CLS_TESTS True MODEL.TEST_CLASSIFIERS "('datasets/metadata/o365_clip_a+cnamefix.npy',)" MODEL.TEST_NUM_CLASSES "(365,)" MODEL.MASK_ON False MODEL.WEIGHTS models/Detic_LCOCOI21k_CLIP_SwinB_896b32_4x_ft4x_max-size.pth

The reported issue is as follows:
FileNotFoundError: [Errno 2] No such file or directory: 'datasets/metadata/lvis-21k_clip_a+cname.npy'

It is reported that there should be a pre-computed embedding of lvis-21k using CLIP. The corresponding instruction is under Metadata.
python tools/dump_clip_features.py --ann datasets/lvis/lvis_v1_val_lvis-21k.json --out_path datasets/metadata/lvis-21k_clip_a+cname.npy

It seems that the lvis_v1_val_lvis-21k.json could be generated by running python tools/create_lvis_21k.py with replacing the default value of lvis_path with datasets/lvis/lvis_v1_val.json. For now I am facing the same issue as in #48. Is there any other way to get access to the file lvis_v1_val_lvis-21k.json instead of building it up from scratch? Thanks.

Hi,
Sorry for the inconvenience and my late reply. You can find the file here.
Best,
Xingyi

Thanks for your help!

This link cannot be opened, could you please send it again, thank you very much @xingyizhou @xing0047


openldap: 2.4.51 -> 2.4.55

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://repology.org/metapackage/openldap/versions.
meta.description for openldap is: "An open source implementation of the Lightweight Directory Access Protocol"
meta.homepage for openldap is: "https://www.openldap.org/"
meta.changelog for openldap is: ""
Updates performed

Version update

To inspect upstream changes
Impact

Checks done (click to expand)

built on NixOS

The tests defined in passthru.tests, if any, passed

0 of 0 passed binary check by having a zero exit code.

0 of 0 passed binary check by having the new version present in output.

found 2.4.55 with grep in /nix/store/f3gmqfbl7sxxfwjzr7h5jrkn5l8amrgq-openldap-2.4.55

directory tree listing: https://gist.github.com/ba0fa602250412e4cbce97443b1cddc8

du listing: https://gist.github.com/125a5160156a282fd63cedd76c7d9339

Rebuild report (if merged into master) (click to expand)

5448 total rebuild path(s)

2007 package rebuild(s)

2007 x86_64-linux rebuild(s)
1597 i686-linux rebuild(s)
272 x86_64-darwin rebuild(s)
1572 aarch64-linux rebuild(s)

First fifty rebuilds by attrpath
Sylk
_389-ds-base
adapta-gtk-theme
adminer
adtool
aerc
afew
almanah
alot
alpine
amarok
amarok-kf5
apacheHttpd
apacheHttpd_2_4
apostrophe
appimage-run
appimagekit
aprutil
aptly
arc-theme
arcanist
areca
arx-libertatis
asciidoc-full
asciidoc-full-with-plugins
astroid
atom
atom-beta
autofs5
aws-adfs
azureus
balsa
bareos
baresip
bcompare
bibata-cursors
bibata-cursors-translucent
bibata-extra-cursors
birdfont
blueman
bolt
bomi
bookworm
browserpass
btrbk
buildah
buildah-unwrapped
cabal2nix
calamares
calligra

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/f3gmqfbl7sxxfwjzr7h5jrkn5l8amrgq-openldap-2.4.55 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A openldap https://github.com/r-ryantm/nixpkgs/archive/0a17c0432c85086ce884241a7dee5245b09ca2ab.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/f3gmqfbl7sxxfwjzr7h5jrkn5l8amrgq-openldap-2.4.55
ls -la /nix/store/f3gmqfbl7sxxfwjzr7h5jrkn5l8amrgq-openldap-2.4.55/bin

Pre-merge build results
NixPkgs review skipped

Maintainer pings
cc @lovek323 for testing.

Closing so the bot will open a new PR with conflict resolved.


YOUKU not working

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like this: [x])
Use the Preview tab to see what your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.03.20. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

[x] I've verified and I assure that I'm running youtube-dl 2018.03.20

Before submitting an issue make sure you have:

[x] At least skimmed through the README, most notably the FAQ and BUGS sections
[x] Searched the bugtracker for similar issues including closed ones
[x] Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

[x] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
Add the -v flag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):
youtube-dl.exe http://v.youku.com/v_show/id_XMzQ3NTgzODEyNA==.html?spm=a2hzp.8253869.0.0 -v

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['http://v.youku.com/v_show/id_XMzQ3NTgzODEyNA==.html?spm=a2hzp.8253869.0.0', '-v']
[debug] Encodings: locale cp936, fs mbcs, out cp936, pref cp936
[debug] youtube-dl version 2018.03.20
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.16299
[debug] exe versions: ffmpeg 3.3.3, ffprobe 3.3.3
[debug] Proxy map: {}
[youku] XMzQ3NTgzODEyNA: Retrieving cna info
[youku] XMzQ3NTgzODEyNA: Downloading JSON metadata
ERROR: Youku server reported error -6004: 客户端无权播放,201; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpbt_jbnlh\build\youtube_dl\YoutubeDL.py", line 785, in extract_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpbt_jbnlh\build\youtube_dl\extractor\common.py", line 440, in extract
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpbt_jbnlh\build\youtube_dl\extractor\youku.py", line 189, in _real_extract
youtube_dl.utils.ExtractorError: Youku server reported error -6004: 客户端无权播放,201; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
<end of log>

Description of your issue, suggested solution and other information
Cannot download video form youku.com, which can play w/o problem.
Test Url:
http://v.youku.com/v_show/id_XMzQ3NTgzODEyNA==.html?spm=a2hzp.8253869.0.0

What is the solution?


#135842529 search users endpoint

What does this PR do?
Adds api/search/users endpoint
Description of Task to be completed?
Returns the information of the searched user.
How should this be manually tested?
Any background context you want to provide?
It is an authenticated endpoint thus can only be accessed once you are authenticated.
What are the relevant pivotal tracker stories?
#135842529
Screenshots (if appropriate)
postman screenshot

Questions:

Critical
@andela-wmaina why do we have a hashed password in the response?!


Naabu instead nmap for uncommon web ports detection

Already tested, works faster and there is a module in axiom here:
eval axiom-scan subdomains/subdomains.txt -m naabu -p $UNCOMMON_PORTS_WEB -o .tmp/nmap_uncommonweb.txt $DEBUG_STD && uncommon_ports_checked=$(cat .tmp/nmap_uncommonweb.txt | cut -d ':' -f2 | sort -u | sed -e 'H;${x;s/\n/,/g;s/^,//;p;};d')

Also requires naabu's installation on reconftw and change is reconftw.sh

Done here https://github.com/six2dez/reconftw/commit/bdeb262a10a1d6fb4852eb458a7f1ecdf50e8758


VisibleDeprecationWarning of augmentations.py

I got it by python .\train.py

augmentations.py:238: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray
mode = random.choice(self.sample_options)

If I ignore this warning, will there be any problems?
Do you not see this warning?

I have the same problem when I use pytorch1.7 with CUDA11 in 3090 GPU, but I don't think this will cause any problem.

Excuse me，have you already solved this problem？I met the same one too.

I changed the code in the transforms.py
# before
mode = random.choice(self.sample_options)

# after
random_idx = random.randint(0, len(self.sample_options) - 1)
mode = self.sample_options[random_idx]

I changed the code in the transforms.py
# before
mode = random.choice(self.sample_options)

# after
random_idx = random.randint(0, len(self.sample_options) - 1)
mode = self.sample_options[random_idx]

I changed the code in the transforms.py
# before
mode = random.choice(self.sample_options)

# after
random_idx = random.randint(0, len(self.sample_options) - 1)
mode = self.sample_options[random_idx]

random_idx needs to be changed to the following:
random_idx = random.randint(len(self.sample_options))


Navigate branches

I'm constantly trying to use , and . to navigate between branches in the branch tab. This is basically just a copy of the implementation used in the status tab.

@stoivo This is the first time I'm working on *.sublime-syntax, but I think I'm creating a selector meta.git-savvy.branches.branch to match in branch.py:743, the same as the one above (meta.git-savvy.status.file). I could be mistaken though?

Yes, you are creating a selector, but to the status view. You are editing status.sublime-syntax.

 Didn't notice that every tab had it's own syntax. I've removed these changes!

So it was only working because of a coincidence, I chose the same selector name as in branch.sublime-syntax!

Do you know why you have these two commits in you PR?
Merge pull request #1 from divmain/master … bd5fddb
Merge branch 'master' of github.com:divmain/GitSavvy	 be0bd1b
Maybe you can squash them to remove them?

This PR looks great, btw.  Add the final context changes to the keymap file, and we'll merge this in.

Closing this PR and I've created a new one: https://github.com/divmain/GitSavvy/pull/401


15.9.3 msbuild hangs

I just noticed issues in the past few days.  My VS 2017 Pro locks constantly.  If I change the solution build config it locks. If I change a project assembly version it locks.  If I build it locks.
When it locks up task manager is showing MSBuild.exe (sometimes 2-3 instances under this VS 2017 process instance) running at 25%.  My desktop has 4 cores so that means it is running 1 core at 100%.  Restarts have not changed anything.  It is always the MSbuild.exe that is locking up my visual studio for several minutes.  When those processes complete what they are doing then visual studio becomes usable again.  Any ideas?
Windows 10 Pro
Visual Studio 2017 Pro 15.9.3
I also noticed now in the Visual Studio Installer it now shows a "Visual Studio Build Tools 2017 (2)" item installed (version 15.9.2) as well as the usual "Visual Studio Professional 2017" (version 15.9.3).  The build tools must have been added in a recent update?

Can you please use the Visual Studio feedback tool to report the hang? It collects a lot of information related to VS that should be useful to diagnose your problem. Please link the feedback item here and we can investigate further.
Build Tools has existed for a long time and an update to VS itself shouldn't have caused it to be installed. If you don't need it, it would be interesting to try uninstalling it, but its presence should not cause hangs.
Also, obligatory context questions:

Did you notice this immediately after updating to 15.9.3?
Were you on 15.9.2 before?
Does this happen for all solutions, or only some? What about a trivial new project?
If you check out an old version of your code do you see the same problem?

Will do on the feedback tool.  I always feel like those feedback things go into black holes in most apps.  Good to hear it actually reaches someone.
As far as I know I don't use MSBuild outside of visual studio.  I'll try to remove it.
I'm not sure exactly when I installed 15.9.3.  I would assume the beginning of this week. The issues started presenting themselves on Wednesday.  At least that's when I noticed it get bad enough that it was making development difficult.
Yes, I was previously on 15.9.2.
I've only been using 2 solutions recently.  1 is mostly just class library projects, EF and web.api.  That one builds fine.  The one I'm having issues with is a front end website project so heavy on MVC, web.api, angular, javascript, etc.  That is the one with issues.
Is there a way to have MSbuild be verbose when it is executing or export a log?  Maybe it is something MSBuild is executing or a certain task it is taking a long time on and seeing that may quickly narrow down the cause.

@davkean as well in this case this anything to do with the project system.

I've been doing testing.  I don't think the issue is isolated to MSBuild as far as I can tell.  It does however seem to be isolated to a single solution.
For this solution, the behavior I'm seeing is when I open the solution in VS, VS goes not responding for several minutes before I can use it.  This also happens when closing the solution, when executing a build, and when using msdeploy via publish it freezes prior to requesting authentication and at the very end of the publish before it marks it in the output window as complete.
Any suggestions how I can troubleshoot VS to see what it is having issues with?  I'm not seeing any visible errors or errors during the build output that are pointing me in the right direction.  I think I need more of VS application diagnostic logging..

Thanks. That's helpful for at least the build issues, which could be related to the other issues.  After running the build logging it shows the MVC project getting stuck for many minutes on the WebCompiler.CompilerBuildTask.  This is the Web Essentials 2017 less/css compiler.  I've re-installed with no luck and had no response from issues on their repo.  I'll keep looking into that.

That led me to the answer. I ended up pulling down the WebCompiler source and stepping through it.  Basically, it was probably looping thousands of files within the project when running.  Probably, also why it made the UI look like it was hanging.  I put the solution related to the WebCompiler here:
https://github.com/madskristensen/WebCompiler/issues/397
I'll close this issue out. Feel free to post updates though if you have questions.

The legacy project system (used for .NET Framework-based/Xamarin/UWP projects) blocks the UI on design-time builds. Long design-time builds can lead to pauses like you've found.


Cannot run any flutter commands on deepnote.com

Hello,
I am trying to use the Flutter SDK online on deepnote.com VM. I am unable to get it to work. I have tried various fixes suggested online, but none solved my issue.
Steps to Reproduce

Create a new project on deepnote.com
Open a terminal instance and download a flutter release.
Try running flutter commands. (flutter doctor)

Logs
Expected Output:
The command should print relevant information.
Actual output:
Waiting for another flutter command to release the startup lock...

Even non existing commands return the above result.

What fixed have I tried?

Delete the flutter/bin/cache/lockfile file; The file isn't present.
Kill all running dart and flutter commands; There aren't any running.

Is there anyway to fix this issue? Is flutter not compatible with online amazon instances(Which are what deepnote VMs are)?
Thank you.

@kphanipavan
Since deepnote.com is a 3rd party, I'd suggest you to open this issue in dedicated repo (where deepnote's integration with Flutter is maintained and tracked).
This doesn't seem to be an issue in flutter framework. Closing from here.


What's the plan to make the document as Internet standard?

Thanks for the good job for enhance the RTMP specs,   I'm glad to ask for any plan to publish the document as Internet standard?  Isn't possible to propose the document to IETF like HLS spec and make it more popular and used by more company in the world?

The suggestion is a good one and is an internal topic as well...

This is not a priority right now, will reopen if in fact this is a must have.


Enhanced support for lists, maps, strings

Is your feature request related to a problem? Please describe.
We have several related requests for transforming maps and lists. We also have the list_to_map and map_to_list processors. Can we combine them somehow?
Describe the solution you'd like
Create a cohesive processor (or set of processors) for supporting array and map transformations.
Issues

[ ] #3961
[ ] #3962
[ ] #3963
[ ] #3964
[ ] #3965

#3867 also falls under this category.


ci-cd: Create different environments

Description:

Create environments for dev, qa [Branches]
Create different docker versions for those environments

Complete


Maximized terminal window height shrinks on tab close on mac

On mac, when maximized: Closing a tab (out of two), returning down to a single tab shrinks the height of the terminal window by the size of the (no-longer visible) tab strip height.
Expected: window height should remain the same - maximized.
Note: this also happens when the terminal window is not maximized but the issue is noticeable mostly when it is maximized.

This is not an issue with OMZ but with your terminal emulator.


joined nodes.json files locally

as recommened "many files, long loadtimes in case of timeout"
files joined via cronjob ob  https://github.com/eulenfunk/mapconfig/blob/master/allnodes.sh

Thanks.


extend v2 dynamic buffer support to ostream, icy_stream, http, websocket et al

any user-facing function/object will need to handle v2 dynamic_buffers.

motifavting use case: ref #1893

I don' think that's worth doing.


The Smithing table cannot be used

Click Smithing table
Nothing happened

Isn't this an issue on the main branch of Geyser?


delete data from series between date range

hello,
is it possible to delete some data in cassandra for range timestamp
but without deleting the whole serie ?

No cush interface right now I'm afraid. Generally we'd recommend that you configure Cassandra to automatically delete data after a period of time using some time-based compaction.

Closing due to age, feel free to re-open if this is still an issue.


fix(loader): syntax error - unexpected end of input

Please makes sure the items are checked before submitting your PR, thank you!

[x] Rebase before creating a PR to keep commit history clear.


fix: Removed europe region and converted jitter values from s to ms

Description
Removed the region Europe as it is not needed as of now.
Converted jitter values from s to ms.
List which issues are fixed by this PR. You must list at least one issue.

Europe listed in the Regions.
Jitter values appearing in s

Pre-launch Checklist

[x] The Documentation is updated accordingly, or this PR doesn't require it.
[x] I updated/added relevant documentation.
[x] I listed at least one issue that this PR fixes in the description above.
[x] I added new tests to check the change I am making, or this PR is test-exempt.
[x] All existing and new tests are passing.

Merging:

Squash merge to dev
Merge commit to publish-alpha and main

Let's merge this after the release


Fix draft inputs. Try and fix message overlap

Having a hard time trying to reproduce the chat overlap messages. During the process of debugging i saw we're entirely re-creating our chat classes due to our router using unique keys for any route paths (which change when you change conversations). We no longer do this
A side effect of this is the input isn't torn down and recreated each time which means it kept its value (which is a bug anyways as we're supposed to keep the draft values, thats also fixed
I'm clearing the cellCache when convos change (likely doesn't do anything since the whole thing was being blown away, but let's just see). i also updated react-virtualized to latest (shouldn't affect anything)

@keybase/react-hackers take a peek

@chromakode updated


how to change the color of non-transparent part with a png file?

I know there is fill() method to fill color, but my image is irregular,so I can't do that with fill() method ,what else can I do to resolve my problem ?

The colorize() method seems to be what you're looking for?

@TechKat thanks,although  I gave up using this package and at last, I have tried this method colorize() , but this method just takes or takes out colour from the origin image  , my goal is filling the image where there is untransparent  with exactly color varible , but I can't find a method like this,finally I used the original ImageMagic and solved this problem , thank you again !


Gatekeeper prevents streaming output

Gatekeeper prevents streaming output
Summary
I have a PHP based website that has a feature that sends already partly output to the requester. Below you can find a simple php example for this logic.
<?php
echo "starting script ... you should see output every 1 second
\n";

for ($i=1; $i<=50; $i++) {
    echo "index: $i; ob_level: " . ob_get_level() . "; ob_length: ". ob_get_length() . "
\n";

    if ($i % 10 === 0) {
        flush();
        ob_flush();
        sleep(1);
    }
}

When using Gatekeeper before this website with this feature, only the complete output is displayed at the requester and not already the parts of the output.
Environment

I'm using the docker image: quay.io/keycloak/keycloak-gatekeeper:latest
Louketo: 10.0.0

Expected Results
I would like to have a way to configure gatekeeper to return already parts of the output of a website instead of the complete output.
Actual Results
see summary
Steps to reproduce

Let a webserver e.g. apache serve the above-mentioned PHP test script.
Configure Gatekeeper to protect the test script
Open a browser and

call the test script directly at the apache, you should see that every second there will be new lines printed
call the test script via the gatekeeper. Only the complete output of the script will be displayed.

Additional Information
During my research, I have found out that there is a similar issue related to Nginx, were the internal buffer from Nginx is preventing this kind of logic to work. Maybe it's a similar reason here as well.

Had a similar, related issue with "streaming" requests.
Use case
Using MJPEG-streamer to expose a webcam.
The way this "stream" is implemented (http handler here), is by sending a
Content-Type: multipart/x-mixed-replace;boundary=...
Multipart response body, and sending an infinite amount of
Content-Type: image/jpeg parts as frames, as long as the connection is open.
The upstream server flushes response body data whenever it can buffer a frame.
This particular software exposes such a stream on GET /?action=stream.
Expected result
Louketo is able to proxy this request as an unbuffered, infinite response body.
Actual result
While buffering is not an obvious issue here, the stream is closed after 10 seconds.
A workaround for this would be to set --server-write-timeout=0s, to disable the timeout.
Reproducing
Requirements

Docker + Docker Compose
A V4L2 device on /dev/video0.
A testing authentication OIDC client, which allows http://localhost:3000/* redirect urls.

Start up this compose file with docker-compose up.
# docker-compose.yml
version: '3.7'
services:
  oidc-gate:
    image: quay.io/louketo/louketo-proxy
    command: >-
      --server-write-timeout=0s
      --upstream-url=http://webcam:80
      --listen=:3000
      --enable-default-deny=true
      --discovery-url=https://example-keycloak/auth/realms/local-testing
      --client-id=local-app
      --client-secret=12345678-1234-1234-1234-123456789012
      --encryption-key=AgXa7xRcoClDEU0ZDSH4X0XhL5Qy2Z2j
    ports:
      - 3000:3000

  webcam:
    image: sixsq/mjpg-streamer
    devices:
      # Streams from a V4L2 camera. Like a laptop/usb webcam.
      - /dev/video0
    ports:
      # Runs on :80 internally,
      # we expose 8080 for testing without auth.
      - 8080:80

GET http://localhost:8080/?action=stream should serve the upstream server's MJPEG stream correctly.
GET http://localhost:3000/?action=stream should first require authentication, then stream indefinitely.
Change the --server-write-timeout=0s option to --server-write-timeout=3s and docker-compose up the changes.
GET http://localhost:3000/?action=stream will end the stream after 3 seconds.

Additional Information
Other reverse proxy setups, do not require changing such a timeout in the first place.
For example I've also proxied this through Caddy. There the reverse_proxy directive needs an option flush_interval -1.

The proxy buffers responses by default for wire efficiency:

flush_interval is a duration value that defines how often Caddy should flush the buffered response body to the client. Set to -1 to disable buffering.

This is closer to the problem @pahrens is observing, because Caddy will disable buffering of the response this way.
Setting this to -1 also avoids any timeout issues. Caddy will just happily send an infinite response body.
Which makes a lot of sense, because no buffers means no latency, no congestion (for the proxy), no memory hogging...
It becomes a problem of the upstream and client to set sane timeouts.

I've poked a little bit at the provided PHP example.
Using a similar repro as I shared for my use-case:
# docker-compose.yml
version: '3.7'
services:
  oidc-gate:
    image: quay.io/louketo/louketo-proxy
    command: >-
      --server-write-timeout=0s
      --upstream-url=http://php:80
      --listen=:3000
      --enable-default-deny=true
      --discovery-url=https://example-keycloak/auth/realms/local-testing
      --client-id=local-app
      --client-secret=12345678-1234-1234-1234-123456789012
      --encryption-key=AgXa7xRcoClDEU0ZDSH4X0XhL5Qy2Z2j
    ports:
      - 3000:3000

  php:
    image: php:apache
    volumes:
      - ./stream-example.php:/var/www/html/index.php
    ports:
      - 8080:80

Used tech
The way PHP streams the response here is using Transfer-Encoding: chunked.
PHP will handle the encoding of this for you through the flush functions.
Additionally, my PHP response included Content-Encoding: gzip and is reported as 596 B, compressed.
Observations
The proxied response also reports Transfer-Encoding: chunked, but no gzip.
The reported size is 2.20 KB. So it would appear the proxy has decompressed for us.
Using a curl --raw request with the needed auth cookies shows it also doesn't have the original chunks.
Instead I got 3 chunks: 800 bytes, 4 bytes, 0 bytes.
800
starting script ... you should see output every 1 second

index: 1; ob_level: 0; ob_length:

index: 2; ob_level: 0; ob_length:

index: 3; ob_level: 0; ob_length:

index: 4; ob_level: 0; ob_length:

index: 5; ob_level: 0; ob_length:

index: 6; ob_level: 0; ob_length:

index: 7; ob_level: 0; ob_length:

index: 8; ob_level: 0; ob_length:

index: 9; ob_level: 0; ob_length:

index: 10; ob_level: 0; ob_length:

index: 11; ob_level: 0; ob_length:

index: 12; ob_level: 0; ob_length:

index: 13; ob_level: 0; ob_length:

index: 14; ob_level: 0; ob_length:

index: 15; ob_level: 0; ob_length:

index: 16; ob_level: 0; ob_length:

index: 17; ob_level: 0; ob_length:

index: 18; ob_level: 0; ob_length:

index: 19; ob_level: 0; ob_length:

index: 20; ob_level: 0; ob_length:

index: 21; ob_level: 0; ob_length:

index: 22; ob_level: 0; ob_length:

index: 23; ob_level: 0; ob_length:

index: 24; ob_level: 0; ob_length:

index: 25; ob_level: 0; ob_length:

index: 26; ob_level: 0; ob_length:

index: 27; ob_level: 0; ob_length:

index: 28; ob_level: 0; ob_length:

index: 29; ob_level: 0; ob_length:

index: 30; ob_level: 0; ob_length:

index: 31; ob_level: 0; ob_length:

index: 32; ob_level: 0; ob_length:

index: 33; ob_level: 0; ob_length:

index: 34; ob_level: 0; ob_length:

index: 35; ob_level: 0; ob_length:

index: 36; ob_level: 0; ob_length:

index: 37; ob_level: 0; ob_length:

index: 38; ob_level: 0; ob_length:

index: 39; ob_level: 0; ob_length:

index: 40; ob_level: 0; ob_length:

index: 41; ob_level: 0; ob_length:

index: 42; ob_level: 0; ob_length:

index: 43; ob_level: 0; ob_length:

index: 44; ob_level: 0; ob_length:

index: 45; ob_level: 0; ob_length:

index: 46; ob_level: 0; ob_length:

index: 47; ob_level: 0; ob_length:

index: 48; ob_level: 0; ob_length:

index: 49; ob_level: 0; ob_length:

index: 50; ob_level: 0; ob_length: <
4
br>

0

Now,

Transfer-Encoding is a hop-by-hop header, that is applied to a message between two nodes, not to a resource itself. Each segment of a multi-node connection can use different Transfer-Encoding values. If you want to compress data over the whole connection, use the end-to-end Content-Encoding header instead.

This suggests, removing the chunks and buffering, is perfectly within spec.
However decompressing Content-Encoding: gzip and removing the header is not allowed according to spec.

Digging into this more, I found the issue.
Cause, default flushing behaviour
The proxy dependency goproxy does not control how flushing is done. So it defaults to what the go standard library implements for both the upstream and downstream clients.
https://github.com/elazarl/goproxy/blob/0581fc3aee2d07555835bed1a876aca196a4a511/proxy.go#L180
The io.Copy of the body here, will copy the data as soon as it's available (each chunk PHP flushes), but the Go default is to flush to downstream every certain amount of bytes. Regardless of how long it takes to fill up that buffer.
Flushing manually
To flush sooner, the http.ResponseWriter may also implement http.Flusher and we can explicitly call .Flush().
See https://stackoverflow.com/a/30603654
That would flush whatever we have in the buffer so far, which may result in different sizes of chunks than PHP originally gave us. (Though that's acceptable in HTTP spec).
Adopting flush_interval from Caddy
Caddy is also written in Go, so we can compare implementations. Rather than io.Copy they use this
https://github.com/caddyserver/caddy/blob/e385be922569c07a0471a6798d4aeaf972facb5b/modules/caddyhttp/reverseproxy/streaming.go#L126
Which may be an interesting addition to goproxy. But I also managed to modify and implement this as middleware when directly using goproxy. By wrapping the response writer and implementing io.ReaderFrom, io.Copy will use our implementation, which can be based on Caddy's flushing rules.
I'll have a go at porting that to louketo next.

I got some of the way there with my WIP, feel free to check that out and use it.
But given #683's sunsetting of the project I won't put in the work to make a PR out of it.


Plaese add pkce support

For pkce to be enabled in grafana you only need to add "use_pkce = true " to the grafana.ini could we add this line to the operator so it can pass the value through?

Hi @atwin140 , we are happy to receive a PR to solve this issue.

Closing this, PR was merged. Thanks @atwin140


The codecov reports don't show up

@jcranky I asked the codecov support for help on that but I still don't have an answer.

fixed with #78


skip invalid link path during gc

Signed-off-by: Liang Zheng<EMAIL_ADDRESS>

Can you describe what is it you are trying to achieve with this PR?
Specifically, can you give us an example of when a stored registry link contains an invalid digest? That'd be mildly worrying, tbh

hi @milosgajdos, we use Harbor as our image repository, and Harbor uses Registry to manage images underneath. I've noticed that after running for a while, Harbor tends to leave behind a lot of residual data, as described in the #4330. I tried running garbage collection (GC) to reclaim resources, but encountered errors. It turns out that there are many invalid link files in the Registry. These link files are either empty or have invalid digests, which directly cause the GC to interrupt. Actually, we can skip these invalid link files instead of directly interrupting the GC.
~/go/src/github.com/distribution/distribution (link ✗) bin/registry garbage-collect cmd/registry/config-dev.yml -m
.......
deeproute-all/docker-repo/data-ocean/nginx
deeproute-all/docker-repo/data-ocean/prod/data-ocean-front-end
deeproute-all/docker-repo/data-ocean/qa/data-ocean-front-end
deeproute-all/docker-repo/dataocean/adas-web-term
deeproute-all/docker-repo/dataocean/dataocean-account-management-service
deeproute-all/docker-repo/dataocean/dataocean-adas-monitor
deeproute-all/docker-repo/dataocean/dataocean-adas-tar
deeproute-all/docker-repo/dataocean/dataocean-api-docs
deeproute-all/docker-repo/dataocean/dataocean-api-gateway
deeproute-all/docker-repo/dataocean/dataocean-authentication-service
deeproute-all/docker-repo/dataocean/dataocean-availability-service
deeproute-all/docker-repo/dataocean/dataocean-bag-construction
deeproute-all/docker-repo/dataocean/dataocean-bag-constructor
deeproute-all/docker-repo/dataocean/dataocean-car-transmit
deeproute-all/docker-repo/dataocean/dataocean-cloud-vehicle-communication
deeproute-all/docker-repo/dataocean/dataocean-data-agent
deeproute-all/docker-repo/dataocean/dataocean-data-agent-overseer
deeproute-all/docker-repo/dataocean/dataocean-data-construction
deeproute-all/docker-repo/dataocean/dataocean-data-migration
deeproute-all/docker-repo/dataocean/dataocean-data-provider-service
deeproute-all/docker-repo/dataocean/dataocean-data-transformation-service
deeproute-all/docker-repo/dataocean/dataocean-data-tube-service
deeproute-all/docker-repo/dataocean/dataocean-data-tunnel
deeproute-all/docker-repo/dataocean/dataocean-database-migration
deeproute-all/docker-repo/dataocean/dataocean-database-migration-data-managment-v2
deeproute-all/docker-repo/dataocean/dataocean-download-test
deeproute-all/docker-repo/dataocean/dataocean-dr-pipeline
deeproute-all/docker-repo/dataocean/dataocean-drfile-archive-serivce
deeproute-all/docker-repo/dataocean/dataocean-drtag
deeproute-all/docker-repo/dataocean/dataocean-file-download-service
deeproute-all/docker-repo/dataocean/dataocean-file-galaxy
failed to garbage collect: failed to mark: filesystem: filesystem: invalid checksum digest format

~/go/src/github.com/distribution/distribution (link ✗) ll /mnt/cephfs/docker/registry/v2/repositories/infra-operation/image/build-env-image/_manifests/revisions/sha256/a68799c5a48d4cfe46ea1e122245097441f14720b0488d1d162eea637e3b96f7/link
-rw-r--r-- 1 10000 71 Apr 28  2022 /mnt/cephfs/docker/registry/v2/repositories/infra-operation/image/build-env-image/_manifests/revisions/sha256/a68799c5a48d4cfe46ea1e122245097441f14720b0488d1d162eea637e3b96f7/link
~/go/src/github.com/distribution/distribution (link ✗) cat /mnt/cephfs/docker/registry/v2/repositories/infra-operation/image/build-env-image/_manifests/revisions/sha256/a68799c5a48d4cfe46ea1e122245097441f14720b0488d1d162eea637e3b96f7/link
~/go/src/github.com/distribution/distribution (link ✗) ll /mnt/cephfs/docker/registry/v2/repositories/deeproute-simulation/single-frame-task-images/_manifests/revisions/sha256/20f5baba4c1fdd30c9e13984365ed873b06a945afb877569219daee8870da30b/link
-rw-r--r-- 1 10000 0 Jun 24  2022 /mnt/cephfs/docker/registry/v2/repositories/deeproute-simulation/single-frame-task-images/_manifests/revisions/sha256/20f5baba4c1fdd30c9e13984365ed873b06a945afb877569219daee8870da30b/link

These link files are either empty or have invalid digests

I'd prefer looking into the underlying issue rather than adding a bandaid on a symptom.

These link files are either empty or have invalid digests

I'd prefer looking into the underlying issue rather than adding a bandaid on a symptom.

Maybe this should be considered quite common. Taking the example of pushing an image, it involves several HTTP requests. For the push process, the entire operation is non-atomic, so it's very likely that failures or other anomalies midway could lead to data anomalies or incompleteness. This is when running GC would cause errors. I think we can skip the anomalous data.

What happens to anomalous data if you leave them dangling in the storage and then a push with the same references is attempted?

What happens to anomalous data if you leave them dangling in the storage and then a push with the same references is attempted?

the link file will be overwritten if push the same references.

I'd prefer looking into the underlying issue rather than adding a bandaid on a symptom.

Honestly, both is probably the right way to go here.  If GC is leaving a lot of cruft behind that's concerning because it's not actually garbage collecting.  If every abnormal run of GC is stopping because it's hitting an error this could result in a lot of failed GC runs.  I'm in support of band-aiding it but perhaps filing an issue or something to look into the underlying cause as a follow-up.

So the question here for me is: is the GC leaving broken links behind or is it failed push. Because if it's the former I'm ok for merging this in, if it's the latter then we have a bigger problem on our hands 😓
Yeah maybe we can proceed with this and opening an issue to make note of it so it doesnt get forgotten. Might actioning this  @microyahoo


The strings 'Copy' and 'Command Palette' are not localized on the preview panel

Storage Explorer Version: 1.31.0-dev
Build Number: 20230731.1
Branch: main
Platform/OS: Windows 10/ Linux Ubuntu 20.04/MacOS Ventura 13.5 (Apple M1 Pro)
Language: All languages
Architecture: x64/x64/arm64
How Found: From running test cases
Regression From: Not a regression
Steps to Reproduce

Launch Storage Explorer -> Open 'Settings' -> 'Application -> Regional Settings'.
Select '中文(简体)' -> Restart Storage Explorer.
Expand one storage account -> Blob Containers.
Upload a text file -> Click 'Preview'.
Right click the preview panel.
Check whether the strings 'Copy' and 'Command Palette' are localized.

Expected Experience
The strings 'Copy' and 'Command Palette' are localized.
Actual Experience
The strings 'Copy' and 'Command Palette' are not localized.

Additional Context

This issue also reproduces for a json file.

This issue doesn't reproduce for 'Copy Rows' in the tabular preview panel.

These strings are provided by monaco editor, not us. We need to investigate how they could be localized.

There is no easy way to change those strings. I am going to won't fix this issue for now.