How InvokeMethodGrpcAsync Passes Request Headers More Elegantly

Ask your question here
If InvokeMethodGrpcAsync is used, the requests from service A -> sidecar and sidecar -> B should be gRpc communication, but currently InvokeMethodGrpcAsync does not provide custom Headers, I saw a similar problem: #852, through CreateInvocationInvoker can Doing custom Haeaders, but is this too much trouble, which means InvokeMethodGrpcAsync is completely useless for me?

If gRPC proxy is used, it means that my project will not be able to use DaprClient. I saw the example of using gRPC proxy, and I feel that it is very troublesome. #825, I need to register all service areas, in addition to the CreateInvocationInvoker method in the example, I can’t see what support DaprClient provides, and even the gRPC port information needs to be rewritten, which is too much trouble

I think adding direct custom Headers is the easiest and most effective way, I wonder if it is reasonable to do so? If not, can you tell me why? Looking forward to hearing back soon
public async Task<TResponse> InvokeMethodGrpcAsync<TRequest, TResponse>(string appId, string methodName, TRequest data, Metadata headers, CancellationToken cancellationToken = default)
    where TRequest : IMessage
    where TResponse : IMessage, new()
{
    ArgumentVerifier.ThrowIfNullOrEmpty(appId, nameof(appId));
    ArgumentVerifier.ThrowIfNullOrEmpty(methodName, nameof(methodName));

    var envelope = new Autogenerated.InvokeServiceRequest()
    {
        Id = appId,
        Message = new Autogenerated.InvokeRequest()
        {
            Method = methodName,
            ContentType = Constants.ContentTypeApplicationGrpc,
            Data = Any.Pack(data),
        },
    };

    var options = CreateCallOptions(headers: headers, cancellationToken);

    try
    {
        var response = await this.Client.InvokeServiceAsync(envelope, options);
        return response.Data.Unpack<TResponse>();
    }
    catch (RpcException ex)
    {
        throw new InvocationException(appId, methodName, ex);
    }
}

Using the gRPC proxy can achieve the effect of authentication, but doing so means that if I want to use gRPC calls, not only the caller, but also the called service needs to be re-implemented according to the gRPC standard, but from this I understand that the use of dapr does not reduce the workload, and it also passes through a layer of sidecar transit, which is a bit uncomfortable

I'm having the same problem, so what's the outcome of this proposal?
After using the proxy, the process is difficult to understand, and it increases a lot of workload.
My requirement is very simple: I can pass in the request header by calling the gRPC method, without doing any other operations, and I don't care.


Revise fatal errors

https://github.com/Whiffer/swiftdata-sectionedquery/blob/5435d9a061067460b0857e3f44d25fc0872146ea/Sources/SectionedQuery/SectionedQuery.swift#L95
I love this solution, but am a little concerned about the fatals. I think this is an opinion on the framework that should be revisited.
Proposals to consider
1. Convert fatalError to assertionFailure
Pros: Simplest solution. Avoids throwing fatals in production
Cons: Swallows the error if you don't find it in a pre-release
2. Pass an "Error Strategy"
enum ErrorStrategy {
   case fatal
   case assertion
   case log(Logger)

    func handle(_ error: any Error, file: StaticString = #file, line: UInt = #line) {
        ...
     }
}

Pros: defers to implementer. Default to fatal to maintain functionality
Cons: Not sure, what are your thoughts?
3. Pass an Error Handler
public protocol ErrorHandler {
    func handle(error: any Error, file: StaticString, line: UInt)
}

extension ErrorHandler {
   public static var fatal: ErrorHandler { FatalErrorHandler() }

   public func handle(_ error: any Error, file: StaticString = #file, line: UInt = #line) {
       handle(error: error, file: file, line: line)
   }
}

struct FatalErrorHandler: ErrorHandler {
   func handle(_ error: any Error, file: StaticString, line: UInt) {
        fatalError(error. localizedDescription, file: file, line: line)
   }
}

Pros: Customizable
Cons: More to maintain

You make a very good point.    I was not really expecting this package would ever need to be used as-is in a production App.
My initial thought is towards something simple that gives the implementer an option besides fatal error, which is most likely a variation of your option 1.  I will dig into this when I have some time to dedicate to an appropriate solution.  Thanks.

Makes sense. Agreed, surprised Apple hasn't addressed this. I'd say that while that's the case right now, we don't know how the framework evolves, including error usage.
Only point here would be that try? is just a catch under the hood but it's reassigning the result to optional (enum(Some) ) and then unwraps it. It's more concise to just catch the error:
private func fetchSectionedResults() {
    try {
        try fetchSectionedResultsWithError()
    } catch {
       assertionFailure(error.localizedDescription)
       // Maybe just
    }
}

private func fetchSectionedResultsWithError() throws {

        let fetchDescriptor = FetchDescriptor<Result>(predicate: self.configuration.predicate, sortBy: self.configuration.sortDescriptors)

        sections = try self.modelContext.fetch(fetchDescriptor)
              .map { $0[keyPath: self.configuration.sectionIdentifier] }
              .uniqued()
              .compactMap { sectionIdentifier in

                if let firstIndex = fetchResults.firstIndex(where: { sectionIdentifier == $0[keyPath: self.configuration.sectionIdentifier] } ),
                   let lastIndex = fetchResults.lastIndex(where: { sectionIdentifier == $0[keyPath: self.configuration.sectionIdentifier] } ) {

                    let sectionElements = Array(fetchResults[firstIndex...lastIndex])
                    return SectionedResults<SectionIdentifier, Result>.Section(id: sectionIdentifier, elements: sectionElements )
                } else {
                    assertionFailure("Internal consistency check failed. Unable to create a Section from the fetch results.")
                    return nil
                }
    }

I just based this off of your original gist in the WebUI, pardon any syntax errors or misunderstandings.

Thanks for pushing me to clean up the error handling and to help make the code more readable in the process.  BTW, I think the original fetchResults has to be saved in order for the compactMap to work.  I have retested the happy path, but I am still unable to create test cases for the unhappy path.   Anyway, I just committed my changes.  Thanks again.


[Bug] Random bug when launching application

Describe the bug
When I launch the application I sometimes get this message:
Connection id ""0HMC1H8AIR2MI"", Request id ""0HMC1H8AIR2MI:00000041"": An unhandled exception was thrown by the application.
Everything is working, I just get this error sometimes.
To Reproduce
Steps to reproduce the behavior:
Launch Application and pray it happens

Any help would be greatly appreciated

I can confirm this as well.


Customize/Improve user experience

Description:

Periodically check if tasks are overdue.
Implement custom fonts and icons.
Customize UI colors.

Added app's ability to periodically check if tasks are overdue, implement custom fonts and icons, and customize UI colors.

Added app's ability to periodically check if tasks are overdue, implement custom fonts and icons, and customize UI colors.


[stable/prometheus-operator] Readonly grafana user

Is this a request for help?:

Is this a BUG REPORT or FEATURE REQUEST? (choose one): Yes

Version of Helm and Kubernetes:
Kubernetes version
Client Version: version.Info{Major:"1", Minor:"12", GitVersion:"v1.12.0", GitCommit:"0ed33881dc4355495f623c6f22e7dd0b7632b7c0", GitTreeState:"clean", BuildDate:"2018-09-28T15:20:58Z", GoVersion:"go1.11", Compiler:"gc", Platform:"darwin/amd64"}
Server Version: version.Info{Major:"1", Minor:"10", GitVersion:"v1.10.11", GitCommit:"637c7e288581ee40ab4ca210618a89a555b6e7e9", GitTreeState:"clean", BuildDate:"2018-11-26T14:25:46Z", GoVersion:"go1.9.3", Compiler:"gc", Platform:"linux/amd64"}

Helm version
Client: &version.Version{SemVer:"v2.11.0", GitCommit:"2e55dbe1fdb5fdb96b75ff144a339489417b146b", GitTreeState:"clean"}
Server: &version.Version{SemVer:"v2.12.1", GitCommit:"02a47c7249b1fc6d8fd3b94e6b4babf9d818144e", GitTreeState:"clean"}

Which chart:
prometheus-operator
What happened:
I was using the grafana chart earlier and by default it was allowing read only access to Grafana for anyone having the URL. If any changes to be done, obviously need to login then we can give admin or other users if existing.
But with the grafana installation coming as part of prometheus-operator, it asking to login always and by default the admin user is existing.
I would like to avoid giving the admin credentials to all and have a read only user as well.
What you expected to happen:
Is it possible to make it like, anyone can access grafana and view graphs without credentials ? If not what is the correct way of creating a read only user ?
How to reproduce it (as minimally and precisely as possible):
Anything else we need to know:

I think the only security configuration change to the adminPassword, which is left unset on the default chart. You should be able to get the same behaviour with grafana.adminPassword=null
I believe the reasons for setting the password in the operator chart no longer apply, but it's there for backwards-compatibility.

If you want to keep the admin user, and add a read-only user, you can add the following to the grafana section of values.yaml:
  grafana.ini:
    auth.anonymous:
      enabled: true

Thanks for both replies. I have unset the admin password so that it generates a random one and also added the config to allow anonymous login, which allows now to view grafana without prompting for credentials. (I have my grafana installation behind oauth, so it confirms the proper email domain and gives a read only access.. secure enough I guess 😄 )

@r-divakaran Be aware that every helm upgrade will re-generate a new password but it will only be re-loaded by grafana when the grafana container restarts


NullPointerException during the initial phase of pig job

Hi,
I am facing a null pointer exception during the first job that get submitted by pig.
Version of pig is : Apache Pig version 0.11.0-cdh4.4.0 with CDH4.4 Hadoop.
Here is the full stack trace:
java.lang.NullPointerException
at java.io.File.(File.java:222)
at com.twitter.hdfsdu.pig.piggybank.ExtractSizes.exec(ExtractSizes.java:51)
at com.twitter.hdfsdu.pig.piggybank.ExtractSizes.exec(ExtractSizes.java:29)
at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:337)
at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:381)
at org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.getNext(PhysicalOperator.java:334)
at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.processPlan(POForEach.java:372)
at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNext(POForEach.java:297)
at org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:308)
at org.apache.pig.backend.hadoop.executionengine.physicalLayer.rel
All the mapper tasks succeed and at the end one mapper fails with this exception.
Also, the job says that it failed to read the offline file that is given as INPUT argument. It would be great if someone could provide some insights here and help with get this working.
thanks,
Nikhil

Any solution on this? We have also ran into this recently.

For anyone else with the issue, we resolved it by adding a null check in ExtractSizes.java for the path variable.  For some reason, our tsv output must have had an invalid line/file.
		if ( path == null ){
			return null;
		}
		File f = new File(path);


Tenant hierarchy doesn't work as expected in docker lasker verision

According to the documentation service catalogs, providers etc., of parent tenants service catalog should be visible to any child tenants.
https://pemcg.gitbooks.io/mastering-automation-in-cloudforms-4-2-and-manage/content/tenancy_and_automate/chapter.html
But for some reason It doesn't work as expected. I created a child tenant but child tenants can't see parent tenants service catalogs. Only way a child tenant can see parent tenant service catlog is that - parent tenant service catalog (ownership) should be part of a group and the user of child tenant should also be part of that group.
I've verified that it works in github version (morphy)
I checked the following code and there is no difference between this repo and docker lasker version.
https://github.com/ManageIQ/manageiq/blob/799aef5a071ac0ea6a4b130bf4c7cd75bbd4e1d1/lib/rbac/filterer.rb#L129-L157
Any idea what the issue could be in docker lasker version so I can patch it and workaround temporarily?
It seems like docker version (lasker) doesn't read filterer.rb at all. I changed the 'ServiceTemplateCatalog' => nil, or change it to 'ServiceTemplateCatalog' => descendant_ids but no changes takes place (parent tenant can still see child catalogs - if set to nil it should be tenant only)
Note: child tenant service catalog is visible to parent tenant though (its like reverse). According to @jrafanie, "For "ancestor_ids" above such as templates, a template owned by a parent tenant will be visible to child/descendant tenants. For "descendant_ids" from above such as services, a service owned by a child tenant group will be visible to parent/ancestor tenants."
Screenshots:
This is the parent tenant. You can see that AWS Ec2 Provisioning catalog owernship is administartors and you can also see the child tenant catalog.

I've created a user called test and its part of child-tenant-group and has a role of oder-service-catalog

Here is the screenshot of group child-tenant-group

Here is a screenshot of the role order-service-catalog

When I login as the test user, I can see only child tenant catalogs.

The same setup works fine in github version. I can see parent catalogs under test user account in github morpy verison.
Github Morphy version screenshots:
Parent tenant can see child tenant catalogs and parent tenant test catalog has administrators ownership.

User test is part of group child-tenant and with role order-service-catalog

Screenshot of group child-tenant

Screenshot of role order-service-catalog

When I login as user test I can see parent catalog.

I've figured out what the issue is. It turned the child group role had restriction set. If I set it to none then I can see all parent tenants catalogs.


Mismatching signatures in onFatalSaveFailure()

Model.onFatalSaveFailure() takes a single parameter, error, and doesn't use it at all.
Collection.onFatalSaveFailure() calls Model.onFatalSaveFailure() with 2 parameters, error and response.

Hmm cases like these are often "here are some arguments that you can use if you want to". I think we should require those arguments for the sake of consistency even if we don't use them today. There's no harm in passing them.
I think we should use strict types for all internal functions and where it makes sense otherwise. There are very few cases where inference makes more sense.

Keep in mind that these methods were intended to be overridden, so just because the default implementation doesn't use those args, I'd still like to make them available.

So in TS, should I mark those parameters as optional?

I think they should be required, even if the function doesn't use them.

Then Model.onFatalSaveFailure() will have to be changed to take 2 parameters.

All success methods should receive the response and all failures should receive the response and the error.


Delete several parts of engine crate

What have you changed?
Part of https://github.com/tikv/tikv/issues/6402. Follow up to https://github.com/tikv/tikv/pull/7029. First new commit is "engine: Remove some basic tests".
This is working toward removing the engine crate. It deletes the Mutable and Peekable traits in favor of the versions in engine_traits, and it deletes the impl of Iterable for DB. It also removes a bunch of reexports that are no longer used.
After this PR there is very little left in the engine crate. What is left is mostly used to set up and debug the engine.
After this PR and https://github.com/tikv/tikv/pull/7032, we'll move quickly toward completely parameterizing the raftstore crate over engines.
What is the type of the changes?

New feature (a change which adds functionality)
Improvement (a change which is an improvement to an existing feature)
Bugfix (a change which fixes an issue)
Engineering (engineering change which doesn't change any feature or fix any issue)
Misc (other changes)

How is the PR tested?

Unit test
Integration test
Manual test (add detailed scripts or steps below)
No code

Does this PR affect documentation (docs) or should it be mentioned in the release notes?

Does this PR affect tidb-ansible?

Refer to a related PR or issue link (optional)
Benchmark result if necessary (optional)
Any examples? (optional)

cc @Rustin-Liu

Merge conflicts fixed.

/merge

/merge


Clean up logging options

Fixes #1187
First part: #1213

Fix the --help to explain how to use --log to specifying a filename.

Reviewer checklist

[ ] Test coverage: stack test --coverage
[ ] Public API documentation: stack haddock

What I meant during the meeting: for the repl, the log file is not hardcoded anywhere. See https://github.com/kframework/kore/blob/master/kore/src/Kore/Repl/Data.hs#L179 and its parser https://github.com/kframework/kore/blob/master/kore/src/Kore/Repl/Parser.hs#L281 so the text change is wrong: you can specify the filename in the logger.
However, for kore-exec, the file name is hardcoded here: https://github.com/kframework/kore/blob/master/kore/src/Kore/Logger/Output.hs#L137 and the help text for the log flag is here https://github.com/kframework/kore/blob/master/kore/src/Kore/Logger/Output.hs#L157
Maybe what needs to be done here is just to change this type here https://github.com/kframework/kore/blob/master/kore/src/Kore/Logger/Output.hs#L99 to add a FilePath field to the second ctor and update the code accordingly...?


Adding missing NULL pointer check

CLA: trivial
In the provider store API, it is not necessary to provide both open and attach method at the same time and providing at least one of them is enough. Adding some null pointer checks to prevent exceptions in case of not providing both methods at the same time.

Checklist

[ ] documentation is added or updated
[ ] tests are added or updated

Hi
Does anyone knows why tests are failing? The failing test seems unrelated to me and it creates a lot of alerts,

This PR is in a state where it requires action by @openssl/committers but the last update was 30 days ago

This pull request is ready to merge

Merged to the master, 3.3 and 3.2 branches. This does not apply cleanly to 3.1 and 3.0 branches. Please open a separate PR against 3.0 branch if you want it fixed there.


[libSyntax] Support serializing the syntax tree as ByteTree

This PR hooks the ByteTree serializer up in SourceKit so that a ByteTree serialized syntax tree can actually be retrieved.

@swift-ci Please smoke test

@swift-ci Please smoke test


Adding NetCoreApp - Part 03

Refs #1769
Changes
Consolidate DependencyCollector.Tests and DependencyCollector.Shared.Tests
Checklist

[X] I ran Unit Tests locally.
[ ] CHANGELOG.md updated with one line description of the fix, and a link to the original issue if available.

For significant contributions please make sure you have completed the following items:

[ ] Design discussion issue #
[ ] Changes in public surface reviewed

The PR will trigger build, unit tests, and functional tests automatically. Please follow these instructions to build and test locally.
Notes for authors:

FxCop and other analyzers will fail the build. To see these errors yourself, compile localy using the Release configuration.

Notes for reviewers:

We support comment build triggers

/AzurePipelines run will queue all builds
/AzurePipelines run <pipeline-name> will queue a specific build

First thing I did, i took some screen shots to see how many tests i had at the begin and compare with the end result.
With this changes, I got the same results, BUT, we still have some files that weren't appearing in Test Explorer:

Should I add those as well?

Should I add those as well?

These Shared projects notoriously had hidden test classes.
We should include all tests that are on the file system.
Note that some of these hidden classes weren't being run before and may fail once you start running them.
Some of these failed tests may no longer be relevant so we'll have to investigate them

Should I add those as well?

These Shared projects notoriously had hidden test classes.
We should include all tests that are on the file system.
Note that some of these hidden classes weren't being run before and may fail once you start running them.
Some of these failed tests may no longer be relevant so we'll have to investigate them

Ok! let me update this!


[Fix] Ensure we set the eval/train flag correctly on accelerator model

What does this PR do?
Fixes #6876.
This PR is ready, with more information underneath.
We also require https://github.com/facebookresearch/fairscale/pull/587 to be merged and included in next release, but since we do not rely on the upstream release yet, this fix isn't going to change any FairScale related tests on CI. This will probably also block #6152 as we move from our own fork to the latest FairScale release.
In terms of testing, once #6152 is merged to deprecate the current Pipe implementation, this fix will come to fruition as the FairScale version will be reliant on the upstream release.
Overall however, I notice in many places we call train eval on just the lightning module, not the accelerator wrapped model. In the case of custom implementations like SDP, this is an issue. I swapped this to using self.model which should recursively set the lightning module when it is wrapped.
Before submitting

[x] Was this discussed/approved via a GitHub issue? (not for typos and docs)
[x] Did you read the contributor guideline, Pull Request section?
[x] Did you make sure your PR does only one thing, instead of bundling different changes together?
[x] Did you make sure to update the documentation with your changes? (if necessary)
[x] Did you write any new necessary tests? (not for typos and docs)
[x] Did you verify new and existing tests pass locally with your changes?
[ ] Did you update the CHANGELOG? (not for typos, docs, test updates, or internal minor changes/refactorings)

PR review
Anyone in the community is free to review the PR once the tests have passed.
Before you start reviewing make sure you have read Review guidelines. In short, see the following bullet-list:

[x] Is this pull request ready for review? (if not, please submit in draft mode)
[ ] Check that all items from Before submitting are resolved
[x] Make sure the title is self-explanatory and the description concisely explains the PR
[x] Add labels and milestones (and optionally projects) to the PR so it can be classified

Did you have fun?
Make sure you had fun coding 🙃

great catch!!! let's add comments here for when to use self.model vs when to directly use self.lightning_module

Thanks @ananthsub!
The difference from the names can be quite confusing, and in most cases the choice is clearer; if you want to access lightning_module internals/functions, use self.trainer.lightning_module. And eventually for FSDP or where you'd like to access the wrapped model, you can use self.trainer.model or self.model in the trainer :)

Ah great point, forgot lightning_module.eval() and lightning_module.train() are hooks. What's advised here? I could change the default to self.trainer.model.eval() and self.trainer.model.train() within the hooks or I could add this additional logic outside the hook. cc @awaelchli @tchaton

Ah great point, forgot lightning_module.eval() and lightning_module.train() are hooks. What's advised here? I could change the default to self.trainer.model.eval() and self.trainer.model.train() within the hooks or I could add this additional logic outside the hook. cc @awaelchli @tchaton

Sounds good to me !

Thanks @tchaton just a slight mistake I should be referring to the module hooks on_test_model_train on_test_model_eval on_predict_model_eval that will change.

@SeanNaren the test is failing

The test showed that we call the predict hook twice, I've remedied this and it now follows the same behaviour as run_evaluation and run_train


Some ADO tasks hang at 100% forever until the job timesout

Environment:
ADO online: https://dev.azure.com/Intentional
We are seeing that some of our long-running ADO tasks will remain in the 100% state until the job times out:

This has been observed with the dotnet test task and the jenkins queue job task

can you specify which tasks not working and which tasks works fine ?


Mkfifo pipe failed

If a testlab run has failed, for example because the provided app_apk path was wrong the plugin exits with:

Exit status of command 'tee instrumentation_output.txt < pipe & gcloud firebase test android run --type instrumentation --app /app/build/outputs/apk/yourapp/debug/app-yourapp-debug.apk --test /app/build/outputs/apk/androidTest/yourapp/debug/app-yourapp-debug-androidTest.apk --device model=Pixel2,version=27,locale=de_DE,orientation=portrait --timeout 30m  > pipe 2>&1' was 1 instead of 0. (FastlaneCore::Interface::FastlaneShellError)
.....
Uploading [/app/build/outputs/apk/yourapp/debug/app-yourapp-debug.apk] to Firebase Test Lab...
ERROR: (gcloud.firebase.test.android.run) [/app/build/outputs/apk/yourapp/debug/app-yourapp-debug.apk] not found or not accessible

In this case Action.sh("rm pipe") is not getting executed and therefore the pipe is not removed.
If you then provide the correct apk path and run fastlane again, you will get the following error:

[!] Exit status of command 'mkfifo pipe' was 1 instead of 0. (FastlaneCore::Interface::FastlaneShellError)
mkfifo: cannot create fifo 'pipe': File exists

I'm not sure what the best solution is to fix this.  Either check if the file already exists and if so, remove it before calling Action.sh("mkfifo pipe") or a better handling of the gloud firebase test error to make sure
Action.sh("rm pipe") is called regardless of whether gloucd test failed or not.
Kind regards
Flopsing

Hi @Flopsing,
Thanks for your issue report.
Your solutions look good. I will try to fix it as soon as possible :)
Cheers

I'm facing the same issue as @Flopsing . I just setup my environment and tried running the testlab but I'm getting [!] Exit status of command 'mkfifo pipe' was 1 instead of 0. (FastlaneCore::Interface::FastlaneShellError) mkfifo: cannot create fifo 'pipe': File exists

Sorry for the delay, I will try to fix it until the end of the week.

Fixed in version 0.2.1. Feel free to open the issue if something is wrong.

Thank you :)


[Error] gyro is not able to find and initialize private repositories

I tried to create a gyro manifest for a project that I am working on. Currently, I have the source stored in a private repository on GitHub. When running
gyro init haze/top_secret_super_secret_dont_share

I am met with this:
got http status code for https://api.github.com/repos/haze/top_secret_super_secret_dont_share: 404{"message":"Not Found","documentation_url":"https://docs.github.com/rest/reference/repos#get-a-repository"}

I think the actual issue here is that fetching a private repo requires a bearer token with an additional scope. Currently, gyro's bearer token is only used for reading user data (name and email) on the server side. The token is passed in plaintext as a header, so adding more scopes (especially scopes that provide data not available to the public) is a definite vulnerability.

I think it would be best to manage two different tokens, not everyone is going to both publish and use private repos. We could have a secrets or tokens subcommand that lets the user manage tokens and initiate the device polling thing for github by itself.
This also opens up avenues for other systems but I wouldn't worry about coming up with something too complicated since gyro is at its scope, I only want to maintain it and improve the UX for things it can already do.


Add more json methods to Ch. 20

New Topic Request
Add explanations of the dumps and loads method from the json module.
Chapter: 20
Section: 20.6 Json (JSON should also be in all caps.)
Why it's needed
dumps and loads are useful methods that students might as well learn alongside dump and load. Also it minimizes confusion later on when they might encounter the methods.

Added to Notion.


OCPBUGS-11369: E2E periodics test timeout failures improvement

Following some investigations in CPMSO e2e periodics failures I'm proposing the following changes:

e2e: extend to 2h the full rolling update timeout
we are hitting the 1h timeout quite frequently as draining the all CP nodes takes a while. Hence we bump this to avoid timing out.
e2e: periodics: bump wait time for machine replacement creation
in my observation it can take a bunch of seconds, 30 seconds, but even more than a
minute to succeed.
e2e: periodics: RunCheckUntil don't break e2e if temp errors on get/list
if the get()/list() errors it would break the Expect() which would fail
the entire E2Es.
Since we know temporary tcp connection issues with the API server can happen,
we want to make things a bit more robust by ignoring those errors and
checking again later.

TODO:
bug will follow for easy backporting.

/test help

/test e2e-aws-periodic-pre

/test e2e-aws-periodic-pre

/retest

Failed on install
/test e2e-aws-operator

/test e2e-aws-periodic-pre

/approve
/lgtm
lets see how the tests run

/jira refresh

Looked into the failures, nothing related to the improvements we are making:
cc. @JoelSpeed
e2e-aws-operator : some operators didn't recover in time after the rollout (timed out)
e2e-aws-ovn-etcd-scaling: unrelated. worker node should match or exceed machine count
e2e-aws-ovn-serial: unrelated. annotation not found for node patological event
e2e-aws-ovn-upgrade: unrelated. one second too long oauth disruption

/retest

/retest

/retest

/retest

/retest-required

/retest-required

/test unit

/test unit

/test unit

/test unit

/test unit

/test unit


Help required

I am having some problems to set up the add-to-org to my organization, in the an-oauth-application i dont know what to do in the number 2), "The homepage URL should be the URL to your production instance." wich production instance?
Can someone help me?

wich production instance?

Have you stood up an instance of Add to Org on a service like Heroku, AWS, or some other server?


Scikit image

not needed anymore since we merged https://github.com/emscripten-forge/recipes/pull/146


⚠ Fortnite has degraded performance

In 9609b45, Fortnite (https://fortnite.com) experienced degraded performance:

HTTP code: 200
Response time: 1613 ms

Resolved: Fortnite performance has improved in e612f59.


NU1108 Cycle detected

Severity	Code	Description	Project	File	Line	Suppression State
Error	NU1108	Cycle detected.
Fabulous.WPF -> Fabulous -> Fabulous.XamarinForms 1.1.0 -> Fabulous (>= 1.0.0 && < 2.0.0).	Fabulous.WPF	C:\Projects\Fabulous\Fabulous.WPF\Fabulous.WPF.fsproj	1

@pipsy100
Sorry for the late reploy but is this issue happening after you create a new project ?
Maybe after the PR #902 is merged this issue should not be there anymore.


hot restart: conditionally build hot restart

(Split out of #1348, part of fixes for #128).
hot restart: conditionally build hot restart based on flag/architecture
Use --define=hot_restart=disabled to disable hot restart in a build.
Hot restart is always disabled for OS X.

Split out #1363 and #1365 for the watcher and hot restart changes. (I'll split more things out tomorrow.)

+1 on thanks for doing the investigative leg work here. @zuercher what you say makes sense, I agree that the complexity is unwarranted. We'll deal with this as needed. I've filed https://github.com/bazelbuild/bazel/issues/3510 to track this with the Bazel team, as it seems something they should support to make life easier for the rest of the world that just want a solution that works out of the box.


Allow building for pico by specifying a toolchain, same as 32blit

To build a project for pico just do:
cmake -DCMAKE_TOOLCHAIN_FILE=../../32blit-sdk/pico.toolchain ..

You may optionally override PICO_BOARD and PICO_SDK_PATH

How it works:
32blit-pico/CMakeLists.txt includes those two weird cmake files that set up the SDK. They claim that they must be included before project() however this does not seem to be the case because...
pico.toolchain is pico_arm_gcc.cmake and find_compiler.cmake from the pico-sdk. These normally have to be included before project... because they are actually toolchain files. Using them as such makes all this work. I have simply taken those two files and turned them into one file (ie pasting one into the other where it would normally import it). Then, at the end, I added a couple of defaults for the board and path variables.

Hmm, hopefully the Pico SDK doesn't change in a way that breaks this... I guess this is more how CMake is supposed to be used, but also not how the Pico SDK wants you to use it :shrug:
Anyway, having to do less special stuff for one platform is nice and this didn't appear to break the old setup.

I think the only reason this works for CI is because they have include guards on everything. So it will all get included multiple times if you do it the recommended way, but it is still in mostly the right order.
It probably will break, that's why this is a draft. Maybe we could add it as a submodule or use FetchContent to get a specific revision.


Jackson implementation doesn't encrypt fields that are to be encrypted by default

If you add an entry then save it, the protectOnSave attribute is not set on protected field so it's not encrypted.

v 2.2.2 released


multiple definition error when referenced by c++

VIC version 5.0.1 February 1, 2017
gcc 4.9.3; g++ 4.9.3
MinGW of RBuildTools 3.3

Feature Requests
I try to write an c++ extension of VIC to make it could be called by R easier. I found that some global variables were definited in the head files, including char vic_run_ref_str[MAXSTRING]; at line 95 of file vic/vic_run/include/vic_def.h, FILE *LOG_DEST; at line 61 of file vic/vic_run/include/vic_log.h, and double (*funcd)(double z, ... at line 177 of file vic/vic_run/include/vic_run.h.
It causes multiple definition error when I let several cpp files include the vic_run.h.
It seems to solved when I take them into a c file and place extern to their original definitions. Might it be proper?

@Sibada - thank you for the report.
To be honest, we don't have much experience with C++. In plain C, we protect includes with
#ifndef VIC_RUN_H
#define VIC_RUN_H
...
#endif

Does this not work with C++?
Before we make any changes to VIC to support C++, we'd want to get Travis setup to also test with a C++ compiler. I know @mschnorb and @jameshiebert also have interest in using VIC with C++ so its not a terrible idea to explore this with VIC.5.

extension of VIC to make it could be called by R easier

I recognize there may be some interest here as I've heard about this from others as well. Perhaps it would be worth opening a separate issue to discuss how that would work.

I'm not a C++ expert either, but IIRC we moved to C++ on VIC in our fork off of VIC 4.0.7 without much fuss using g++. I'd experiment with your compiler flags before you start ripping up code.

@jhamman Yeah, it seems that C++ do not support placing global parameters in the head file even the #ifndef  et al. were used, and I found that many other C and C++ developers suggest to place global parameters in a source file and used extern to define them in the head files.

@Sibada - I think I understand. It may be instructive to see which changes you made to support using VIC with a C++ compiler. Would it be possible for you to open a PR with just those changes? Even better if you can enable a travis build with a C++ compiler too.

@jhamman Those revises are applied on the master branch, might I should revise them on the develop branch and open the PR?
My revises includes add an extern to the h files:
// vic/vic_run/src/vic_def.h
extern size_t NR;       /**< array index for force struct that indicates
                             the model step avarage or sum */
extern size_t NF;       /**< array index loop counter limit for force
                             struct that indicates the SNOW_STEP values */
extern char   vic_run_ref_str[MAXSTRING];

// vic/vic_run/src/vic_run.h
extern double (*funcd)(double z, double es, double Wind, double AirDens, double ZO,
                double EactAir, double F, double hsalt, double phi_r,
                double ushear,
                double Zrh);

// vic/vic_run/src/vic_log.h
extern FILE *LOG_DEST;

And move the definitions to a c file:
// my_R_package/src/global.c
size_t              NR;
size_t              NF;

FILE *LOG_DEST;
char vic_run_ref_str[MAXSTRING];

double (*funcd)(double z, double es, double Wind, double AirDens, double ZO,
        double EactAir, double F, double hsalt, double phi_r,
        double ushear,
        double Zrh);

I also found that some C std library functions have no implements in windows platform, whatever VC or MinGW are used, including strptime, backtrace and backtrace_symbols.
I though in the R package some macro defines should be used like:
// vic/drivers/shared_all/src/vic_log.c
void
print_trace(void)
{
#ifndef _WIN32
    void  *array[50];
    size_t size;
    char **strings;
    size_t i;

    size = backtrace(array, 50);
    strings = backtrace_symbols(array, size);

    /* Note: we are ignoring the first and last stack frame
       the first is this function, the last is the linker, neither are
       particularly useful */
    fprintf(LOG_DEST,
            "---------------------------------------------------------------------------\n");
    fprintf(LOG_DEST, "Traceback (most recent call last):\n");
    for (i = size - 2; i > 0; i--) {
        fprintf(LOG_DEST, "%s\n", strings[i]);
    }

    free(strings);
#endif
}

And the strptime also needs a specified implement.

@Sibada - why don't you rebase your branch (from master to develop) and issue a pull request so we can see if this actually works. If this is all that is required, I think making these changes is possible, provided we can test them appropriately.


make feature table more readable

Y's and N's are very similar and hard to read. This simply replaces them with + and -

Nice, thanks for doing this, @Granitosaurus !
Really appreciate the contribution, there's definitely a ton of room for improvement in the documentation.


How to use images_from_array with different shape of images?

Hello.
Your examples include:
(trn, val, preproc) = vis.images_from_folder(
                         datadir='data/dogscats',
                         data_aug=data_aug,
                         train_test_names=['train', 'valid'],
                         target_size=(224,224), color_mode='rgb')

I have a X_train that is composed of images with different shapes.
I'm trying to use images_from_array: (I don't want to use images_from_directory because I have too many classes.
(train_data), (val_data), preproc = vision.images_from_array(x_train=X_train_orig,
                                                                     y_train=y_train_encoded,
                                                                     validation_data=(X_valid_orig, y_valid_encoded),
                                                                     data_aug=vision.get_data_aug(horizontal_flip=True),
                                                                     )

But I receieve ValueError: setting an array element with a sequence.
I'm trying to reshape them to the same size but i'm not sure it's the right way to do it.
I wonder if there is a way which is consistent with the model. For example if i'm using ResNet, it will use the resizing of ResNet with the same interpolation, etc.
How can I solve it?
Is there some parameter that I can pass to images_from_array or to data_aug?
Thanks

You could try storing your class labels in a CSV and using images_from_csv.  The target_size variable will resize your images automatically.  The images_from_array function does not support resizing. See this postfor more details/solutions.
See this post for a deep dive into image-resizing with transfer learning.


Get pedantic about and enforce style

Make pylint happy by either fixing various little nits or explicitly
disabling checks on a site-by-site basis. I've opted to boost the
programatically enforced line-length limit to 100 characters, but we
should still aim to stay <80 where possible.
This also adds a "make lint" which gets run during CI to ensure we stay
on our toes here.
:eyeglasses: @dellis23 @dwick

🐟 Cool!  Always helpful to get it started earlier before too many violations get cemented in.

(i'll fix the ci error in the morning. looks like differing versions of stuff from local.)

🐟 🎉

7c6fcf7909d1aba38c67835ee9a776b0b1f1c5b1


How to pass the selected input option from static_select-action (from blocks of User Interface 1 ) to another block of User Interface 2

Description
How to pass the selected input option from static_select-action (from blocks of User Interface 1 ) to another block of User Interface 2
Blocks of UI 1 in which we have do select the values using dropdown ::
@app.event("app_mention")
def mention_handler(body, say):
say(
    client.chat_postMessage(
    channel="XXXXXX",
    text="fallback",

    blocks=[
            {
                "type": "input",
                "element": {
                    "type": "static_select",
                    "placeholder": {
                        "type": "plain_text",
                        "text": "Select product",
                        "emoji": True
                    },
                    "options": [
                        {
                            "text": {
                                "type": "plain_text",
                                "text": "App Name 1",
                                "emoji": True
                            },
                            "value": "value-0"

                        },
                        {
                            "text": {
                                "type": "plain_text",
                                "text": "App Name 2",
                                "emoji": True
                            },
                            "value": "value-1"
                        },
                        {
                            "text": {
                                "type": "plain_text",
                                "text": "App Name 3",
                                "emoji": True
                            },
                            "value": "value-2"
                        }
                    ],
                    "action_id": "static_select-action"
                },
                "label": {
                    "type": "plain_text",
                    "text": "Select The Product That Has Failed: ",
                    "emoji": True
                }
            },
            {
                "type": "actions",
                "elements": [
                    {
                        "type": "button",
                        "text": {
                            "type": "plain_text",
                            "text": "Submit",
                            "emoji": True
                        },
                        "value": "click_me_123",
				        "action_id": "actionId-0"
                    }
                ]
            }
        ]
    )
)

Now the text names under value we select i.e value-0, value-2 must be returned in the Blocks of UI 2 (which when open when we click on submit button) in place of app name variable
@app.action("actionId-0")
def show_menu_options(ack,body,logger):
client.chat_postMessage(
channel="XXXXXX",
text="fallback",
    blocks=[
            {
               "type": "section",
                "text": {
                    "type": "mrkdwn",
                    "text": "*1) Copy & Post in XYZ channel:*"
                }
            },
            {
                "type": "context",
                "elements":[
                        {
                        "type": "plain_text",
                        "text": *"app name variable* :red_circle:",
                        "emoji": True
                        },
                    ]
            }
        ]
)

ack()
logger.info(body)

Please help me how to do it .. if you can give me the complete solution it would be really helpfull

Hi @SagarKNL 👋🏻 Thanks for reaching out!
First, I'll provide a short answer because it's quicker and may help you out immediately. If you need additional help, I can put together an example but it will take more time.
I noticed that you are using the say to send a message that includes a static select. This is a very uncommon pattern that isn't recommended. Instead, I'd recommend that you open a modal. This will allow you to manage your views more easily by:

Receive an app mention
Send a message with a button that opens a view
Open View 1 (UI 1)
On submission, read the data from View 1
Open View 2 (UI 2) and pass in the data from View 1

When you handle the submission of View 1 (UI 1), you can get the selected value of your static-select (static_select-action) and set its value in View 2. For example:
// On view submission
app.view('view_1_callback_id', async ({ ack, body, view, client }) => {
    const selectedOption = view.state.values.block_id_1['static_select-action'].selected_option;

    // Open View 2...
});

Let me know how that goes! 🙂

Hi Michael, as you said can you put an example as well !!
Thankyou in advance :)

Hi @SagarKNL, it seems that you're using bolt-python, not bolt-js. Can you take a look at the following resources?

https://slack.dev/bolt-python/concepts#updating-pushing-views
https://github.com/slackapi/bolt-python/tree/main/examples

To implement the scenario that @mwbrooks mentioned, you can

Receive an app mention

@app.event("app_mention")
def handle_mentions(body, client):
    pass

Send a message with a button that opens a view

def build_message_blocks_with_button() -> dict:
    # action_id will be used in the step 3
    pass

@app.event("app_mention")
def handle_mentions(body, say):
    say(blocks=build_message_blocks_with_button(), text="fallback text")

Open View 1 (UI 1)

def build_modal_view() -> dict:
    # callback_id will be used in the step 4
    pass

@app.action("the-action_id you set in the blocks")
def handle_button_clicks(body, client):
    ack()
    client.views_open(trigger_id=body["trigger_id"], view=build_modal_view())

On submission, read the data from View 1

def build_child_modal_view(state_values) -> dict:
    # the callnback_id set here will be used in the step 5
    pass

@app.view("the-callback_id you set in the modal")
def handle_view_submission(view, client):
    # data submission inputs
    state_values = view["state"]["values"]
    # push a new modal on top of the current one
   # if you are fine with replacing the existing one, you can go with `response_action="update"` instead
    ack(response_action="push", view=build_child_modal_view(state_values))

Open View 2 (UI 2) and pass in the data from View 1

@app.view("the-callback_id you set in the step 4")
def handle_view_submission(view, client):
    # data submission inputs
    state_values = view["state"]["values"]
    # do something
    # close the modal
    ack()

I hope this helps! If you have follow up questions, can you create a new question issue in https://github.com/slackapi/bolt-python instead? Good luck!


4654 Removing SWAT model instance resource type

Pull Request Checklist:

[x] Positive Test Case Written by Dev

[x] Automated Testing

[x] Sufficient User and Developer Documentation

[x] Passing Jenkins Build

[ ] Peer Code review and approval

Positive Test Case

Follow the steps below to locally test this:
Checkout develop branch and run hydroshare.
Create a composite resource. Create a model instance aggregation in that resource. Add some metadata for this aggregation.
Checkout the branch '4654-swat-model-instance-resource-type-remove'. Run ./hsctl managepy migrate.
Verify that you can see model instance aggregation and its metadata. Verify that you can edit metadata for the aggregation.
Verify you can create new model instance aggregation.

METRIC
VALUE

https://sonarqube.cuahsi-workstation.com:9000/dashboard?id=hydroshare-4710

@sblack-usu Here is the 2nd PR related to deprecated model resource types. for your review. Thanks.


For the test .py file.

I wonder where is the data file.
e.g.
Method TrAdaBoost , in the file named "testAmazom", line 10, where is the file "../data/processed_acl"?
Thans

This data is from https://www.cse.ust.hk/TL/index.html. Note that and the preprocessing step is required in order to transform the raw data into the form we need.

Hello, @vermouthdky is the preprocessing code available on Github or somewhere else?


Caption error

Command that caused the error
Caption
Image that caused the error
https://tenor.com/view/error-windows-windows-error-message-windows-application-error-gif-17157659
Steps to reproduce

post this link in direct messages _https://tenor.com/view/error-windows-windows-error-message-windows-application-error-gif-17157659_
run this cmd
caption The AI that took over the world after i uploaded the hol Rule34 catalog to theyer Database

Self-hosted instance?
No
Error file
Message: TypeError: Cannot read properties of undefined (reading 'has')
    at CaptionCommand.run (file:///home/esmBot/esmBot/classes/imageCommand.js:115:45)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
    at async default (file:///home/esmBot/esmBot/events/messageCreate.js:105:20)

Stack Trace: TypeError: Cannot read properties of undefined (reading 'has')
    at CaptionCommand.run (file:///home/esmBot/esmBot/classes/imageCommand.js:115:45)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
    at async default (file:///home/esmBot/esmBot/events/messageCreate.js:105:20)

Additional context
No response

permissions error with dms

Should be fixed with a438fe26df509c6fda6e0b2bc09af01cadb51715


Avoid location permission messages for AI Chat

Task/Issue URL:
Description
Steps to test this PR
Feature 1

[ ]
[ ]

UI changes

Before
After

!(Upload before screenshot)
(Upload after screenshot)

#5140  👈
develop

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @malmstein and the rest of your teammates on  Graphite


GA4 data?

Hi, is there any way we can adapt all the work done here to read GA4 events instead of GA360 ones?

Hey anyone managed to link this ML to GA4 data instead of GA360?

I haven't :(

Hi Carlos,
Here is update on my end - i found prebuild module for installation on the Looker Market - yourorganizationdomain.looker.com/marketplace/view/ga4 this will allow you to consume your GA4 data if you already have linked it in BigQuery

Whoa!! this is super useful! Many thanks
El vie, 6 ago 2021 a las 10:46, KalchoEPAM @.***>)
escribió:

Hi Carlos,
Here is update on my end - i found prebuild module for installation on the
Looker Market - yourorganizationdomain.looker.com/marketplace/view/ga4
this will allow you to consume your GA4 data if you already have linked it
in BigQuery
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/llooker/ga_360_new/issues/3#issuecomment-894107564,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AR5ZQHMXXHKDRY6GNMWSQX3T3OOPZANCNFSM44MU5DFQ
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&utm_campaign=notification-email
.


[BUG]  Longhorn show different counts of replicas for the same node

Describe the bug (🐛 if you encounter this issue)
I have a longhorn instance with 4 nodes and one of the nodes marked as unschedulable. The interesting thing is even though the node has 3 replicas, longhorn Web UI says it has 568 replicas. I don't have that much replicas.
To Reproduce
Steps to reproduce the behavior:
Expected behavior
A node expected to be marked as schedulable with the correct number of replicas.
Log or Support bundle
If applicable, add the Longhorn managers' log or support bundle when the issue happens.
You can generate a Support Bundle using the link at the footer of the Longhorn UI.
Environment

Longhorn version: 1.4.1
Installation method : helm
Kubernetes distro (e.g. RKE/K3s/EKS/OpenShift) and version: K3S 1.26.3

Number of management node in the cluster: 4
Number of worker node in the cluster: 4

Node config

OS type and version: Oracle Linux 9.1
CPU per node: 2
Memory per node: 256
Disk type(e.g. SSD/NVMe): SSD
Network bandwidth between the nodes: 10G

Underlying Infrastructure (e.g. on AWS/GCE, EKS/GKE, VMWare/KVM, Baremetal): Baremetal
Number of Longhorn volumes in the cluster: 39

Additional context

Also it shows only 3 replicas when I click on '568'

Thanks for your help. Checked replicas and surprisingly I have tons of stopped replicas which are not deleted.
kubectl get replicas -n longhorn-system | wc -l
Update the mutatingwebhookconfigurations accordingly, let's see what will happen.

BTW, you need to do as well
https://github.com/longhorn/longhorn/issues/5762#issue-1669167403
You can delete the stopped replicas whose label contains longhornnode: "null" by kubectl command.
These stopped replicas are not managed by longhorn system because of https://github.com/longhorn/longhorn/issues/5762. Due to the lack of the label, longhorn cannot recognize and delete them.

Update :
Yesterday I deleted more than 7k replicas that matches against label longhornnode=null and state=stopped. However, now I have 565 replicas that are stopped but longhornnode label pointed to the "unschedulable" node. I'm not sure whether they're in use or not.
Since, I have these 565 replicas exist, "unschedulable" state is still not being cleared. Do you think removing replicas associated to this "unschedulable" node is safe?

@batulziiy

However, now I have 565 replicas that are stopped but longhornnode label pointed to the "unschedulable" node.

Can you send a support bundle to<EMAIL_ADDRESS>However, theoretically, these replicas are managed by the longhorn-system. You don't need to delete them by yourself.

@batulziiy
I checked the replicas.
A normal and managed replica's labels are
    labels:
      longhorn.io/backing-image: "null"
      longhorndiskuuid: 6d9e4be6-8eec-4c35-accf-89f0633b91b5
      longhornnode: ickn-ny04-004
      longhornvolume: pvc-16991eb9-6ab7-4073-914d-eed60718f453

There are some unmanaged and stopped replicas with labels
    labels:
      longhorn.io/backing-image: "null"
      longhorndiskuuid: 2e156510-8c3e-4800-af08-f4eda6340ebe
      longhornnode: ickn-ny04-002

You can manually delete them as well.

tnx @derekbit and sorry for the delay in response. Deleted stopped replicas as your suggestion and now all the longhorn nodes are back to healthy. Deleted stopped replicas in loop with  below command :
while read -r line
do
    k delete replica "$line" -n longhorn-system
done < <(k get replicas -n longhorn-system --selector=longhornnode=ickn-ny04-002 --selector=longhorndiskuuid=2e156510-8c3e-4800-af08-f4eda6340ebe | grep stopped | awk '{print $1}')


feat(api): build API for games

Introduce basic backend for games (creating/storing/viewing/deleting/...) (Need to use tRPC)

Currently, this issue is ongoing with #2 (Just because they are intercepting)


v1.5.1

Coverage remained the same at 97.448% when pulling 0c9b8c939bc0eea04b5da2c35484cf281d02a8ce on v1.5.1 into c4f547d3327b677e6644f1840bcfe9af33dd0008 on devel.

👍


Update import-data.sh

path has changed in recent images

update to wokr with latest ubuntu image


Any chance to cut a more recent release?

Looks like the most recent release is from 2021 - https://github.com/Dynamoid/dynamoid/tags - any chance we can cut at least a minor release in the near future?  🙏

Hey. The next release is already prepared (https://github.com/Dynamoid/dynamoid/pull/592) - I need only to publish it. Will do it within the next several days.

Thank you very much!

Good to hear; thank you so much @andrykonchin for your work on this gem!

I've just released v3.8.0. Sorry for such delay.


Add a README to provide links to API providers

What does this PR do?
Add a README.md to this directory that links to API providers that support Meta Llama.
Before submitting

[X] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
[ ] Did you read the contributor guideline,
Pull Request section?
[ ] Was this discussed/approved via a Github issue? Please add a link
to it if that's the case.
[ ] Did you make sure to update the documentation with your changes?
[ ] Did you write any new necessary tests?

Thanks for contributing 🎉!

thanks @carljparker can we pls fix the spell check failures to merge.

@HamidShojanazeri Could you take another look? I fixed the spellcheck errors and also a linkcheck error that occurred.

thanks @carljparker we are in the process a refactor, it might be helpful to sync offline about the new structure.


pKa predictions from ChemAxon

I added the pKa predictions from ChemAxon

@dhimanray This adds several other files at the same time, e.g. an analysis script, as well as some sample user input and the experimental values (?). Did you intend to add those in the same PR?
Usually it is best to make each PR make a single logical group of changes that can be described in the title, so in this case I was expecting this one to only bring in the ChemAxon predictions (and clearly note that these are reference calculations) but not make changes to the analysis or experimental values.
Also, it would be good to update the relevant README.md file at the same time to explain what's changed here. Particularly, you'd probably add a README.md file in https://github.com/samplchallenges/SAMPL8/tree/master/physical_properties/pKa/relative_microstate_free_energy_predictions which explains that all the files come from submissions except the ChemAxon one, which is a reference calculation done aftterwards. Then you should also update the changelog in the base level README.md (https://github.com/samplchallenges/SAMPL8/blob/master/README.md in the part "Changes not in a release") to mention that you added this, and on what date it was added.

@davidlmobley I removed the analysis files from the PR keeping only the pKa chemaxon data and the updates in the README files.


Add LR warm up scheduling

Based off https://twitter.com/jack_kelly/status/1411615500371640320?s=19 might help with metnet training, should be easy to add and experiment with. Plan would be to add it to the generic model interface so we can try it on any of the models

Added for MetNet in #48


Connection Storms when recycling nodes in the cluster

We had to recycle some scylla nodes for some maintenance task. What we observed is that when a node is down and topology changes.  Scylla would receive a connection storm from the clients.  We use below configs for connecting to scylla:
  opts = [
    nodes: ["scylladb1:9042", "scylladb2:9042", "scylladb3:9042"],
    retry_strategy: DefaultRetryStrategy,
    pool_size: 25
  ]

  Supervisor.child_spec({Xandra.Cluster, opts})

and our DefaultRetryStrategy is defined below:
defmodule DefaultRetryStrategy do
  @behaviour Xandra.RetryStrategy
  @retry_count 5

  @impl true
  def new(options) do
    Keyword.get(options, :retry_count, @retry_count)
  end

  @impl true
  def retry(_error, _options, _retries_left = 0), do: :error

  @impl true
  def retry(_error, options, retries_left) do
    {:retry, options, retries_left - 1}
  end
end

Would be possible it's the auto-discovery that's causing the control connection probing the cluster indefinitely?

On the same setup as above, we were seeing client connections upto 70K per node on a 32 core node. This kills the node and it doesn't served the clients anymore. This situation can only be recovered if the clients are stopped - once stopped the node recovers in minutes. And then we have to start the clients back slowly.

We spent more time and located the real issue.
In the event of the node being offline for over a certain number of minutes (for maintenance, etc), DBConnection to that node will exit. And the pool supervisor in Xandra.Cluster is configured with default intensity, which is once hitting 1 restart out of 5 seconds, the pool supervisor will terminate all the children and exist with shutdown as the reason.
This cascades all the way back up to the application because we are all using the default supervisor intensity options. Eventually, application terminates, and our AWS auto-scaling kicks in and keeps restarting the application.
We use ScyllaDB, and ScyllaDB uses system.clients table to keep track of connections.  This table persists the client connections and uses compaction to clean up the stale connection record (which is not a good way to track transient data), and thus kills the node eventually due to a large number of connections being created and destroyed.
Proposed fix:
Introduce a GenServer called Xandra.Node in between the Xandra.Cluster's PoolSupervisor, and the Xandra's DBConnection. Trap the DBConnection exits, and use DBConnection.Backoff to manage the reconnect to the entire node with DBConnection. And able to mark the node as unavailable in the load balancing.

@yangou I’m closing this for inactivity. If you manage to reproduce this and post more info about DBConnection exiting, feel free to comment here and we'll take another look at this! Thanks for the report 💟


Peptides: distribution and mutation cliffs are not shown if selecting with filter applied

Platform version: 1.12.0
Package version: 1.6.1
Steps to reproduce: filter out some rows in the analysis and select Monomer-Positions or Clusters
Expected behavior: The distribution and mutation cliffs widget appear in property panel
Actual behavior: property panel shows filtering data instead

I couldn't reproduce this issue on any instance. I will contact the reporter for further investigation.


When I use it in vue3 jsx. A warning will occur on the console

Check that this is really a bug

[X] I confirm

Reproduction link
https://codesandbox.io/s/quirky-panini-p4jh1?file=/src/components/SwiperDemo.tsx
Bug description
When I use it in vue3. A warning will occur on the console；
Warnning:
Slot "default" invoked outside of the render function: this will not track dependencies used in the slot. Invoke the slot function inside the render function instead.
at
at
at
Expected Behavior
No Warnnings
Actual Behavior
No response
Swiper version
7.0.6
Platform/Target and Browser Versions
All
Validations

[X] Follow our Code of Conduct
[X] Read the docs.
[X] Check that there isn't already an issue that request the same feature to avoid creating a duplicate.
[X] Make sure this is a Swiper issue and not a framework-specific issue

Would you like to open a PR for this bug?

[ ] I'm willing to open a PR

Warning is not the error. And it is actually fine as everything works correctly. Just ignore this warning


⚠ Bofrost.de has degraded performance

In c13f007, Bofrost.de (https://www.bofrost.de) experienced degraded performance:

HTTP code: 200
Response time: 1299 ms

Resolved: Bofrost.de performance has improved in 9b4dc61.


Correct indenting

Ran into this when trying to use the example config directly

Oh awesome, thanks Matt!


cctag: 1.0.3 -> 1.0.4

Includes fixes for Boost 1.86.

Things done

Built on platform(s)

[ ] x86_64-linux
[x] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[x] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
25.05 Release Notes (or backporting 24.11 and 25.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

Annoying. I’m afraid I have no idea why since it doesn’t seem like their build system is conditioning on Darwin at all and I don’t see anything in our Boost package that would leave components out on Darwin. I’ll try to take a look later.

Annoying. I’m afraid I have no idea why since it doesn’t seem like their build system is conditioning on Darwin at all and I don’t see anything in our Boost package that would leave components out on Darwin. I’ll try to take a look later.

those directories are missing under darwin  boost.dev/lib/cmake but they exist under linux for some reason.

seems like darwin just doesn't need to link to libraries but has the headers? anyway, this fixes the build, checkPhase and the libraries.
fixes.diff
diff --git a/pkgs/development/libraries/cctag/cmake-no-apple-rpath.diff b/pkgs/development/libraries/cctag/cmake-no-apple-rpath.diff
new file mode 100644
index<PHONE_NUMBER>00..f878ba26a180
--- /dev/null
+++ b/pkgs/development/libraries/cctag/cmake-no-apple-rpath.diff
@@ -0,0 +1,25 @@
+diff --git a/CMakeLists.txt b/CMakeLists.txt
+index d0e35b6..fc19477 100644
+--- a/CMakeLists.txt
++++ b/CMakeLists.txt
+@@ -96,20 +96,6 @@ endif()
+ # set the path where we can find the findXXX.cmake
+ set(CMAKE_MODULE_PATH ${CMAKE_MODULE_PATH} "${PROJECT_SOURCE_DIR}/cmake")
+
+-if(APPLE)
+-
+-  # avoid the cmake policy warning about @rpath in MacOSX
+-  cmake_policy(SET CMP0042 NEW)
+-
+-  SET(CMAKE_MACOSX_RPATH TRUE) # initialize the MACOSX_RPATH property on all targets
+-  SET(CMAKE_SKIP_BUILD_RPATH  FALSE) # don't skip the full RPATH for the build tree
+-  # SET(CMAKE_BUILD_WITH_INSTALL_RPATH FALSE) # when building, don't use the install RPATH already
+-  SET(CMAKE_BUILD_WITH_INSTALL_RPATH TRUE) # when building, use the install RPATH already
+-                                           # probably not needed
+-  # SET(CMAKE_INSTALL_RPATH "") # the RPATH to be used when installing
+-  SET(CMAKE_INSTALL_RPATH_USE_LINK_PATH TRUE) # LC_RPATH for CUDA and OpenCV etc written into executable
+-endif(APPLE)
+-
+ # FIND BOOST
+ set(BOOST_REQUIRED_COMPONENTS "atomic;chrono;date_time;filesystem;program_options;serialization;system;thread;timer;math_c99")
+ if(WIN32)
diff --git a/pkgs/development/libraries/cctag/default.nix b/pkgs/development/libraries/cctag/default.nix
index 3259822d1601..40986061a56e 100644
--- a/pkgs/development/libraries/cctag/default.nix
+++ b/pkgs/development/libraries/cctag/default.nix
@@ -15,7 +15,7 @@ stdenv.mkDerivation rec {
   pname = "cctag";
   version = "1.0.4";

-  outputs = [ "lib" "dev" "out" ];
+  outputs = [ "out" "dev" ];

   src = fetchFromGitHub {
     owner = "alicevision";
@@ -36,8 +36,17 @@ stdenv.mkDerivation rec {

   patches = [
     ./cmake-install-include-dir.patch
+
+    # remove custom rpath settings as they break linking to the lib
+    ./cmake-no-apple-rpath.diff
   ];

+  # darwin boost doesn't have math_c99 libraries
+  postPatch = lib.optionalString stdenv.hostPlatform.isDarwin ''
+    substituteInPlace CMakeLists.txt --replace-warn ";math_c99" ""
+    substituteInPlace src/CMakeLists.txt --replace-warn "Boost::math_c99" ""
+  '';
+
   nativeBuildInputs = [
     cmake
   ];
@@ -52,8 +61,7 @@ stdenv.mkDerivation rec {
     opencv.cxxdev
   ];

-  # Tests are broken on Darwin (linking issue)
-  doCheck = !stdenv.hostPlatform.isDarwin;
+  doCheck = true;

   meta = with lib; {
     description = "Detection of CCTag markers made up of concentric circles";


⚠ Bofrost.es has degraded performance

In e80d618, Bofrost.es (https://www.bofrost.es) experienced degraded performance:

HTTP code: 200
Response time: 1446 ms

Resolved: Bofrost.es performance has improved in 93f00e6 after 7 minutes.


ConfigurationProfileBuilder withAwsCredentialsProviderHandler is not working

Describe the bug
I wanted to set an (existing) awsCredentialsProvider bean for the driver to use, rather than fallback to DefaultCredentialsProvider, and it didn't work. Looking at the code, ConfigurationProfileBuilder withAwsCredentialsProviderHandler never calls AwsCredentialsManager.setCustomHandler to actually use the provided AwsCredentialsProviderHandler.
Expected Behavior
ConfigurationProfileBuilder withAwsCredentialsProviderHandler should make sure that AwsCredentialsProviderHandler with awsCredentialsProvider is used by the driver in aws sdk calls.
What plugins are used? What other connection properties were set?
ConnectTimeConnectionPluginFactory, ExecutionTimeConnectionPluginFactory, AuroraInitialConnectionStrategyPluginFactory, AuroraConnectionTrackerPluginFactory, FailoverConnectionPluginFactory, IamAuthConnectionPluginFactory
Current Behavior
ConfigurationProfileBuilder.get().withAwsCredentialsProviderHandler((hostSpec, props) -> awsCredentialsProvider) isn't doing anything, so it's necessary to call: AwsCredentialsManager.setCustomHandler((hostSpec, props) -> awsCredentialsProvider);
Reproduction Steps
ConfigurationProfileBuilder.get().withAwsCredentialsProviderHandler((hostSpec, props) -> awsCredentialsProvider)
then observe that this awsCredentialsProvider is never used in aws sdk calls.
Possible Solution
No response
Additional Information/Context
No response
The AWS Advanced JDBC Driver version used
2.5.2
JDK version used
21.0.1
Operating System and version
unix

Hi @ivankhoosty ,
We have just merged in a fix. Could you kindly checkout our latest snapshot build and let us know if the issue still persists?
Thank you!

Hi @ivankhoosty,
The fix is now available in the recently released v2.5.3 of the driver. Since the fix is now released I will be closing this ticket. Please feel free to re-open or create a new ticket if you encounter any issues.
Thank you!

Hi @aaron-congo , sorry I couldn't test the snapshot, but just got 2.5.3 and the bug is fixed. many thanks


Use devDependencies instead

@Kflash @trueadm

@Kflash

This is more @trueadm but is inferno-component really a dependency of the core? Doesn't that sort of defeat the point of separating it if the idea was to be able to use inferno without the component class/model? Maybe it should register itself as a plugin in the core when included?

@tejacques well spotted, it's meant to be a devDependency

@trueadm @tejacques +1 about this question. First of all, root directory of our repository isn't a package - so inferno-component can't be a dependency at all. Second, if it is devDependency, I don't understand why -component only? You test files (in repository) not packages...

true @kuraga, when you remove that dependency do all the tests still pass okay after building node_modules?

Let's try... (repush code because local testing doesn't work for me)

@trueadm seems like it's ok

Build seems to fail?

@trueadm it failed before, same

@trueadm I can't rebase because files are broken, example. Just move all devDependencies to dependencies without duplicates.

@kuraga nice spot, fixed that.

@trueadm green, merge please! But there are two notes, let's talk in chat...


Create blank project user flow

Implement user workflow for creating a new blank project
Does not exist in current iteration
Deliverables:

+ button CTA in topnav bar
~Create New Project CTA in left sidebar~ (moved to #353)
CTA consumes backend API response and loads default/blank state project into editor

"For create blank project pass in empty lists of file templates. "

Save project id to localstorage

completed


React native compatibility?

try to install it and use it in react native but it give me this error
Error: Unable to resolve module 'react-dom'

any updates ?


⚠ St. Lawrence Global Observatory CKAN Sitemap has degraded performance

In 1e68b1a, St. Lawrence Global Observatory CKAN Sitemap (https://catalogue.ogsl.ca/sitemap/sitemap-1.xml) experienced degraded performance:

HTTP code: 200
Response time: 6344 ms

Resolved: St. Lawrence Global Observatory CKAN Sitemap performance has improved in 3c91dad after 12 minutes.


Quick sort and restack buttons missing from inventory UI

As of the recent update 1.3.1 the aforementioned buttons are missing from the inventory UI. The "Sort" button is still there but none of the others. Sorting still works using hotkeys though.

Fixed by having server host enable the config setting "AllowAreaStackingInMultiplayerWithoutMUC". Not sure if this is a new feature with update or if something broke, but this seems to resolve it.

Noted.  Thank you for the follow-up.


Windows parallelization

Hi! Thank you for the great project! Unfortunately I'm experiencing some issues, which could be caused by Windows (10 Pro) and I'm not sure how to solve them.
I installed autofaiss with conda into a new env with Python 3.6. First, I had problems with import:
ImportError: DLL load failed while importing _swigfaiss: The specified module could not be found.
I solved that by first installing openblass, numpy and faiss from conda-forge:
conda create --name faiss_env python=3.6
conda activate faiss_env
conda install conda-forge::blas=*=openblas
conda install -c conda-forge numpy
conda install -c conda-forge faiss
pip install autofaiss
Then I tried to run the example from README, but I have encountered an error in embedding_reader:
~\.conda\envs\faiss_env\lib\site-packages\embedding_reader\get_file_list.py in _get_file_list(path, file_format, sort_result)
     42     path = make_path_absolute(path)
     43     fs, path_in_fs = fsspec.core.url_to_fs(path)
---> 44     prefix = path[: path.index(path_in_fs)]
ValueError: substring not found

I found out that the problem is in the fsspec.core.url_to_fs method, namely in the private method _strip_protocol on the line 402 in fsspec\core.py:
urlpath = fs._strip_protocol(url)
This line changes backward slashes to forward slashes and therefore the substring path_in_fs is not found in the string path.
Now comes the incomprehensible part: when I changed the private method _strip_protocol to general method strip_protocol (I only deleted the leading underscore), the ValueError disapeared and the function preserved backward slashes in the path... but then another error appeared:
RuntimeError: Error in __cdecl faiss::FileIOWriter::FileIOWriter(const char *) at D:\a\faiss-wheels\faiss-wheels\faiss\faiss\impl\io.cpp:98: Error: 'f' failed: could not open C:\Users\USER\AppData\Local\Temp\tmp2jqscc1t for writing: Permission denied
This seems to me like the problem with parallelization and I don't know how to solve it. I suppose that the solution of the ValueError was not the correct one and there is still some problem with Windows implementation.
Can you give me some advice how to find out a solution to this?
Thanks!

Faiss is not supported on windows so you probably need to use Linux. You
could consider WSL2 for example
On Wed, Mar 16, 2022, 13:00 verakumova @.***> wrote:

Hi! Thank you for the great project! Unfortunately I'm experiencing some
issues, which could be caused by Windows (10 Pro) and I'm not sure how to
solve them.
I installed autofaiss with conda into a new env with Python 3.6. First, I
had problems with import:
ImportError: DLL load failed while importing _swigfaiss: The specified
module could not be found.
I solved that by first installing openblass, numpy and faiss from
conda-forge:
conda create --name faiss_env python=3.6
conda activate faiss_env
conda install conda-forge::blas=*=openblas
conda install -c conda-forge numpy
conda install -c conda-forge faiss
pip install autofaiss
Then I tried to run the example from README, but I have encountered an
error in embedding_reader:
~.conda\envs\faiss_env\lib\site-packages\embedding_reader\get_file_list.py in _get_file_list(path, file_format, sort_result)
42     path = make_path_absolute(path)
43     fs, path_in_fs = fsspec.core.url_to_fs(path)
---> 44     prefix = path[: path.index(path_in_fs)]
ValueError: substring not found
I found out that the problem is in the fsspec.core.url_to_fs method,
namely in the private method _strip_protocol on the line 402 in
fsspec\core.py:
urlpath = fs._strip_protocol(url)
This line changes backward slashes to forward slashes and therefore the
substring path_in_fs is not found in the substring path.
Now comes the incomprehensible part: when I changed the private method
_strip_protocol to general method strip_protocol (I only deleted the
leading underscore), the ValueError disapeared and the function preserved
backward slashes in the path... but then another error appeared:
RuntimeError: Error in __cdecl faiss::FileIOWriter::FileIOWriter(const
char *) at D:\a\faiss-wheels\faiss-wheels\faiss\faiss\impl\io.cpp:98:
Error: 'f' failed: could not open
C:\Users\USER\AppData\Local\Temp\tmp2jqscc1t for writing: Permission denied
This seems to me like the problem with parallelization and I don't know
how to solve it. I suppose that the solution of the ValueError was not the
correct one and there is still some problem with Windows implementation.
Can you give me some advice how to find out a solution to this?
Thanks!
—
Reply to this email directly, view it on GitHub
https://github.com/criteo/autofaiss/issues/113, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAR437SH6IVLKDT2SYHOAW3VAHEPBANCNFSM5Q3U2KXQ
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

Thank you for the quick reply. Actually, I'm able to run faiss on windows - I have the problem only with autofaiss. But from your reply I conclude that autofaiss is not supported on windows..
And would you happen to know why the change from private to public method 'helped'?

Can you try using a virtual env instead of conda ?
The build that is tested and that works with autofaiss is on pypi, which is
a different build than the conda one
On Thu, Mar 17, 2022, 14:00 verakumova @.***> wrote:

Thank you for the quick reply. Actually, I'm able to run faiss on windows

I have the problem only with autofaiss. But from your reply I conclude
that autofaiss is not supported on windows..
And would you happen to know why the change from private to public method
'helped'?

—
Reply to this email directly, view it on GitHub
https://github.com/criteo/autofaiss/issues/113#issuecomment-1070897683,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAR437Q6BXSTVC7NS3YSZKDVAMUFNANCNFSM5Q3U2KXQ
.
You are receiving this because you commented.Message ID:
@.***>

That's because NamedTemporaryFile will delete the temp folder before faiss access. For more infor in python documentation.
To fix this, simply pass delete=False to NamedTemporaryFile parameters in get_index_size func of autofaiss.

Ah the specific problem about temporary dir is that autofaiss writes there
and apparently you don't have permission to write there
Can you check why?
You're probably the first one to try autofaiss on windows
On Thu, Mar 17, 2022, 14:09 Romain Beaumont @.***> wrote:

Can you try using a virtual env instead of conda ?
The build that is tested and that works with autofaiss is on pypi, which
is a different build than the conda one
On Thu, Mar 17, 2022, 14:00 verakumova @.***> wrote:

Thank you for the quick reply. Actually, I'm able to run faiss on windows

I have the problem only with autofaiss. But from your reply I conclude
that autofaiss is not supported on windows..
And would you happen to know why the change from private to public method
'helped'?

—
Reply to this email directly, view it on GitHub
https://github.com/criteo/autofaiss/issues/113#issuecomment-1070897683,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAR437Q6BXSTVC7NS3YSZKDVAMUFNANCNFSM5Q3U2KXQ
.
You are receiving this because you commented.Message ID:
@.***>

@rom1504 that because NamedTemporaryFile of python (read more here ).
Whether the name can be used to open the file a second time, while the named temporary file is still open, varies across platforms (it can be so used on Unix; it cannot on Windows). If delete is true (the default), the file is deleted as soon as it is closed.
Autofaiss run just fine on Windows. Tested with anaconda.

Issue is immediately resolved with this pull request. (embedding-reader-pull-36)

Issue resulting in this error:
~\.conda\envs\faiss_env\lib\site-packages\embedding_reader\get_file_list.py in _get_file_list(path, file_format, sort_result)
     42     path = make_path_absolute(path)
     43     fs, path_in_fs = fsspec.core.url_to_fs(path)
---> 44     prefix = path[: path.index(path_in_fs)]
ValueError: substring not found

Is resolved completely in this pull request


Guard against network errors for Dark Sky

Description:
Sometimes when I'm starting up home-assistant, the docker container doesn't seem to get network connectivity in time, which causes a cascade of error logs. Along with those logs, though, I noticed that the Dark Sky component was failing to initialize because its network request failed (which caused an error in the UI).
It's a small change, but I've removed the assumption of a successful network request from the Dark Sky component's initialization, so that retries shouldn't encounter an uninitialized component.
Please correct me if I have the control flow wrong here or if this is completely unnecessary; I'm just starting to dig into the architecture, but I figured this kind of separation couldn't hurt anything, and it would help limit the error logs in situations like mine to the actual problem.
Checklist:

[X] The code change is tested and works locally.
[ ] Local tests pass with tox. Your PR cannot be merged unless tests pass
A couple of the tests time out on my Macbook Pro with the default tox config, but they're unrelated to this change. Any further pointers on getting this working are welcome.
[X] There is no commented out code in this PR.
[X] I have followed the development checklist

@balloob Perfect; thanks for the tip (and the welcome)! I hadn't run across that property yet in my code/doc exploration, but that's obviously better than the backflips I'm doing in this PR. I'll make that change here in a bit.


Download Minecraft JAR File from URL and run it.

If I have a Minecraft .JAR file and .JSON file located at 2 different urls, I was wondering if I could run it using a method. I've tried downloading it, storing it to a folder but I don't know how I would run it.
Describe the solution you'd like
I would want like a way to run it using CmlLib as this would be really useful for Auto Updaters as then they could get their jar file from a link and immediately run it.
Describe alternatives you've considered
I couldnt think of any alternative.
Additional context
I'm trying to make a launcher for a Minecraft PvP Client, I have a link to the JAR file and JSON file but I dont know how to run it.

If I understand correctly, the goal is to update the launcher ?
I can propose you another method in C#
using this NuGet package :
https://github.com/ravibpatel/AutoUpdater.NET
Otherwise, to execute a java app inside c# app : (i don't recommend that)
        private void DownloadAndStart(string version, string build)
        {
            WebClient wc = new WebClient(); // First download the .jar file
            wc.DownloadFileAsync(
                    // Param1 = Link of file
                    new System.Uri("LINKTOTHEJAR"),
                    // Param2 = Path to save
                    path + "\\mods"  /: here for exmeple .minecraft/mods (path = path to .minecraft)
                );
            System.Threading.Thread.Sleep(10000); // Wait 10 s SHOULD change this with an event handler to get the download finish event

            ProcessStartInfo ps = new ProcessStartInfo(GetJavaInstallationPath() + "\\bin\\java.exe", @"-jar PATH+FILE.jar"; // Exclusive to Windows due to .exe

            Process p = Process.Start(ps);
            p.WaitForExit();

        }

        private string GetJavaInstallationPath() // get the Javapath
        {
            string environmentPath = Environment.GetEnvironmentVariable("JAVA_HOME");
            if (!string.IsNullOrEmpty(environmentPath))
            {
                return environmentPath;
            }

            string javaKey = "SOFTWARE\\JavaSoft\\Java Runtime Environment\\";
            using (Microsoft.Win32.RegistryKey rk = Microsoft.Win32.Registry.LocalMachine.OpenSubKey(javaKey))
            {
                string currentVersion = rk.GetValue("CurrentVersion").ToString();
                using (Microsoft.Win32.RegistryKey key = rk.OpenSubKey(currentVersion))
                {
                    return key.GetValue("JavaHome").ToString();
                }
            }
        }

Hope that help

That looks quite interesting, I'll have to try that and get back to you.


Videos microservice fails to deploy

Traceback (most recent call last):
File "app.py", line 341, in
start_streams()
File "app.py", line 181, in start_streams
if is_ssm_parameter_set(SSM_VIDEO_CHANNEL_MAP_PARAM) and not USE_DEFAULT_IVS_STREAMS:
File "app.py", line 135, in is_ssm_parameter_set
response = ssm_client.get_parameter(Name=parameter_name)
File "/usr/local/lib/python3.8/site-packages/botocore/client.py", line 337, in _api_call
return self._make_api_call(operation_name, kwargs)
File "/usr/local/lib/python3.8/site-packages/aws_xray_sdk/ext/botocore/patch.py", line 38, in _xray_traced_botocore
return xray_recorder.record_subsegment(
File "/usr/local/lib/python3.8/site-packages/aws_xray_sdk/core/recorder.py", line 428, in record_subsegment
subsegment = self.begin_subsegment(name, namespace)
File "/usr/local/lib/python3.8/site-packages/aws_xray_sdk/core/recorder.py", line 292, in begin_subsegment
segment = self.current_segment()
File "/usr/local/lib/python3.8/site-packages/aws_xray_sdk/core/recorder.py", line 270, in current_segment
entity = self.get_trace_entity()
File "/usr/local/lib/python3.8/site-packages/aws_xray_sdk/core/recorder.py", line 390, in get_trace_entity
return self.context.get_trace_entity()
File "/usr/local/lib/python3.8/site-packages/aws_xray_sdk/core/context.py", line 99, in get_trace_entity
return self.handle_context_missing()
File "/usr/local/lib/python3.8/site-packages/aws_xray_sdk/core/context.py", line 124, in handle_context_missing
raise SegmentNotFoundException(MISSING_SEGMENT_MSG)
aws_xray_sdk.core.exceptions.exceptions.SegmentNotFoundException: cannot find the current segment/subsegment, please make sure you have a segment open
INFO in app: VIDEO_BUCKET: retail-demo-store-us-west-2
INFO in app: SSM_VIDEO_CHANNEL_MAP_PARAM: retaildemostore-ivs-video-channel-map
INFO in app: USE_DEFAULT_IVS_STREAMS: True
INFO in app: Starting video streams
cannot find the current segment/subsegment, please make sure you have a segment open

hot fix merged.
We need to check any remaining issues on custom stream, so I'll leave this issue open for now

Fairly expensive service. README FAILS to make any note of it anywhere funny :)

Fairly expensive service. README FAILS to make any note of video services it anywhere funny :)

Hi @aeggbeg. If you deploy with the default IVS streams enabled, there will be no cost for IVS in the account where the project is deployed.


EC2 and pricing updates [v2]

The EC2 Instance Type information contains some errors (especially the disk size for the m3 instances), conversion errors between GiB an M[i]B, disk count, ..
Also g2.8xlarge and t2.large are missing.

Wow, that must have been super tedious.  I'm surprised Amazon doesn't provide an API for this information.  It looked good to me apart from that missing comma, but I don't have a lot of context around AWS so someone else more familiar should probably review.

I only slightly improved the sorting of EC2 scraper written mainly by Tomaz Muraus, which basically used the data from https://a0.awsstatic.com/pricing/1/ec2/linux-od.min.js. That could also be used to fill in the data in <libcloud/compute/drivers/ec2.py>, but that's for another day.

@pmhahn that basically undoes https://github.com/apache/libcloud/pull/645 I think you made an error in merging (resyncing from trunk).

Yeah, there is contrib/scrape-ec2-prices.py, but it's possible that it's not working anymore since some of those .js files have been deprecated for a while now :disappointed:

@tonybaloney: My reading is, that #645 is wrong, since OUTSCALE_(SAS|INC)_REGION_DETAILS is a dictionary and the keys "eu-west-2", "us-east-2" are used multiple times:
$ curl -s https://raw.githubusercontent.com/apache/libcloud/trunk/libcloud/data/pricing.json | sed -rne '/^ {8}"/p' | sort | uniq -d
        "osc_inc_eu_west_2": {
        "osc_inc_us_east_2": {
        "osc_sas_eu_west_2": {
        "osc_sas_us_east_2": {
$ curl -s https://raw.githubusercontent.com/apache/libcloud/trunk/libcloud/compute/drivers/ec2.py | sed -rne "/^OUTSCALE_SAS_REGION_DETAILS/,/^}/{/^ {4}'/p}" | sort | uniq -d
    'eu-west-2': {
    'us-east-2': {
$ curl -s https://raw.githubusercontent.com/apache/libcloud/trunk/libcloud/compute/drivers/ec2.py | sed -rne "/^OUTSCALE_INC_REGION_DETAILS/,/^}/{/^ {4}'/p}" | sort | uniq -d
    'eu-west-2': {
    'us-east-2': {

@Kami: You wan't me not not update the EC2 pricing? At least adding the prices for g2.8xlarge and t2.large is required to not break the unit test.

@pmhahn yep good point, i see the mistake now.

LGTM

Ok @pmhahn I'll close and merge this. FYI @LordShion see above.


Updated the AFnetworking lib to 2.5.3

Update of the AFNetwoking library to fix the security issue related with the SSL connections

Please bump the library release as well.

(as in the stuff I can get from https://github.com/owncloud/ios-library/releases and is written down in the README)


solve some Problem with specific filenames

Solves Problems like:
Message: fopen(assets/attachment/=?UTF-8?Q?K=C3=BCndigung_Probezeit_(per_Boten).docx?=): failed to open stream:

Thank you!


eksctl: 0.122.0 -> 0.123.0

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://repology.org/metapackage/eksctl/versions.
meta.description for eksctl is: "A CLI for Amazon EKS"
meta.homepage for eksctl is: "https://github.com/weaveworks/eksctl"
meta.changelog for eksctl is: ""
Updates performed

Golang update

To inspect upstream changes

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 0.123.0 with grep in /nix/store/s75cnwmbwljgvn9nqiihmz5pwvhlq7b9-eksctl-0.123.0
found 0.123.0 in filename of file in /nix/store/s75cnwmbwljgvn9nqiihmz5pwvhlq7b9-eksctl-0.123.0

Rebuild report (if merged into master) (click to expand)

1 total rebuild path(s)

1 package rebuild(s)

First fifty rebuilds by attrpath
eksctl

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/s75cnwmbwljgvn9nqiihmz5pwvhlq7b9-eksctl-0.123.0 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A eksctl https://github.com/r-ryantm/nixpkgs/archive/f1e60a13ef6572314f68b33a5d3ec7351ae90ac8.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/s75cnwmbwljgvn9nqiihmz5pwvhlq7b9-eksctl-0.123.0
ls -la /nix/store/s75cnwmbwljgvn9nqiihmz5pwvhlq7b9-eksctl-0.123.0/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

eksctl

Maintainer pings
cc @xrelkd @Chili-Man for testing.

@ofborg eval


Documentation link broken

Error returned: "No input file specified."

Sorry about that, I'll get it moved to the Wiki here~

https://github.com/caffeinated/shinobi/wiki


Authorization: Bearer with/without quotes?

My API expects the header like so:
Authorization: Bearer eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9blablablablabla
But Angular-JWT sends the request with the token itself encapsulated in quotes:
Authorization: Bearer "eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9blablablablabla"
This makes the request fail. Any idea how to fix this? According to JWT.io the format should be:
Authorization: Bearer <token>

[EDIT] I just realized the quotes come from the way the token is stored in local storage using angular-storage.

Hi @Fossil01. Have you found out the way to remove quote when storing using angular-storage?

No, but I remove the quotes on every HTTP request:
app.config(function Config($httpProvider, jwtOptionsProvider, $locationProvider) {
	jwtOptionsProvider.config({
		tokenGetter: ['options', function(options) {
			// Skip authentication for these URL's
			if (options.url.substr(options.url.length - 5) == '.html' || options.url == API + '/login') {
				return null;
			}
			let token = localStorage.getItem('jwt')
			if (token) {
				token = token.replace(/^"(.*)"$/, '$1'); // Remove quotes from token start/end. This is a temp fix?!
				return token;
			}
		}],
		whiteListedDomains: ['SOMEWEBSITE.COM', 'localhost']
	});
	$httpProvider.interceptors.push('jwtInterceptor');
	// $locationProvider.html5Mode(true);
});

Thanks @Fossil01, I also have to do like this. Don't know why the author add quote to storage value.

Maybe author store all data in one JSON value in one key? I see several code part with this in different tutorial.

Hi @Fossil01,
This issue is not because of Angular-JWT. Its just because you set your token in local storage with string or you are getting it in string/with quotes:
Do not use JSON.stringify() Just do this:
localStorage.setItem('token', data.userToken);
and then logout and re-login to unset and reset the token.

@Fossil01 @giathinh910 @akalightowl
Use store.get('jwt') in tokenGetter.

@saurabhvedwal thank you!

I have this same problem but I didn't yet find out how to store JWT in LocalStorage without quotes, so I have to use ugly slicing when I'm sending JWT as Bearer token. Anybody help me?

I have this same problem but I didn't yet find out how to store JWT in LocalStorage without quotes, so I have to use ugly slicing when I'm sending JWT as Bearer token. Anybody help me?

Post your issue on Stackoverflow, link it here and I will help you.

Here it is: https://stackoverflow.com/questions/70313399/how-to-store-jwt-in-localstorage-but-not-as-a-string


Component parameter storage

Store non-secret component values inside the cluster using a ConfigMap. This will allow component references to be made from configurations independent of the main cluster configuration. (We could store the cluster's Facts here too)

done ages ago


customizing rulesets

Background

Changes

Testing

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.Rich Cassara seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


DO NOT MERGE: "release notes" for master/develop merge

I've spent some time recently poring over git logs to see if we have anything to be worried about in the upcoming master/develop merge, and I took notes on what I saw so I wouldn't have to do this again for the post-merge release. We won't be merging this, but in case anyone's interested here's a preview of what's in the pipeline.

This change is

I've de-duped this and https://github.com/cockroachdb/cockroach/issues/9781. Will open a new release note PR soon.


How to provide feedback to improve pronunciation?

And furthermore, do your model can compare and assess with the syllable sound like mmmmmm, iiiiiiffffff, .....


Auto restart app when it crashes?

I was wondering if Deis had any mechanism to restart a web server that crashes (Node.js) or if that should be implemented in my code.

Yes, we have a Restart=on-fail policy for the systemd units deployed via fleet.

closing as a dupe of #1282

Interesting, fleetctl cat appname.v1.service does show the Restart=on-fail but my crashed app doesn't seem to get restarted.