Cosmos DB data source for a resolver GraphQL Bad Request

For a write-request, is it mandatory to set  use-managed-identity="true" ?
Now when I submit a GrapQL request with this resolver to my CosmosDB data source:
<cosmosdb-data-source>
	<connection-info>
		<connection-string>AccountEndpoint=https://xxxx.documents.azure.com:443/;AccountKey=xxxx</connection-string>
		<database-name>xxxDB</database-name>
		<container-name>Settings</container-name>
	</connection-info>
	<write-request>
		<partition-key>
           "general"
        </partition-key>
		<set-body template="liquid">
            {"id" : "{{body.arguments.id}}"  ,
            "SettingKey" : "{{body.arguments.SettingKey}}",
           "SettingValue" : "{{body.arguments.SettingValue}}"}
        </set-body>
	</write-request>
</cosmosdb-data-source>

I get this error:
{
    "errors": [
        {
            "message": "CosmosDB exception received when resolving value for path Mutation/createWinkiSetting",
            "extensions": {
                "data": {
                    "source": "cosmosdb-resolver",
                    "message": "Cosmos exception received from Cosmos server/database. For details, see status code and contact your API administrator.",
                    "cosmosSource": null,
                    "cosmosStatusCode": "BadRequest"
                }
            }
        }
    ],
    "data": {
        "createWinkiSetting": null
    }
}

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: a269b752-a4ef-dded-6a60-126badb1cb3b
Version Independent ID: 777da19e-a17a-dc0b-562b-6109a2061108
Content: Azure API Management policy reference - cosmosdb-data-source
Content Source: articles/api-management/cosmosdb-data-source-policy.md
Service: api-management
GitHub Login: @dlepow
Microsoft Alias: danlep

@godfriedmeesters
Thanks for your feedback! We will investigate and update as appropriate.

Thanks, could you also elaborate in the documentation how exactly to get the Principal you talk about in https://learn.microsoft.com/en-us/azure/api-management/cosmosdb-data-source-policy#azure-cli-script-to-configure-the-managed-identity  (now you just say, "get it in the Azure portal")

Updated the description of the problem with more details.

It works when I remove the section

from the resolver ...

So with the write-request, I cannot use the partition-key, but strangely enought with a delete-request I can use the partition key
<delete-request>
		<id>@(context.GraphQL.Arguments["id"].ToString())</id>
		<partition-key>general</partition-key>
	</delete-request>

Also I am not allowed to put the partition-key after the set-body as is explained in the docs, only before the set-body is allowed in  Azure Portal resolved UI (while in your documentation you put partition-key after)

So in conclusion I think there are some mistakes in your documentation...

@godfriedmeesters - Thanks for your detailed  feedback. I will prepare a documentation update soon for the article on the cosmosdb-data-source policy.


CORTX-32355: rgw_integration: Add retry logic for admin user creation and reduce timeout value

In user creation, we were having timeout value of 10 minutes. hence deployment was been taking more time to configure server pod.
with latest logic,

we introduced retry count logic . max retry is 10
Reduced user creation timeout value from 1 minute to 30 sec.

Signed-off-by: Sachitanand Shelake<EMAIL_ADDRESS>Problem Statement

Problem statement

Design

For Bug, Describe the fix here.
For Feature, Post the link for design

Coding
Checklist for Author

[x] Coding conventions are followed and code is consistent

Testing
Checklist for Author

[x] Unit and System Tests are added
[x] Test Cases cover Happy Path, Non-Happy Path and Scalability
[x] Testing was performed with RPM

Impact Analysis
Checklist for Author/Reviewer/GateKeeper

[ ] Interface change (if any) are documented
[ ] Side effects on other features (deployment/upgrade)
[x] Dependencies on other component(s)

Review Checklist
Checklist for Author

[x] JIRA number/GitHub Issue added to PR
[x] PR is self reviewed
[x] Jira and state/status is updated and JIRA is updated with PR link
[x] Check if the description is clear and explained

Documentation
Checklist for Author

[x] Changes done to WIKI / Confluence page / Quick Start Guide

Triggered custom-build : https://eos-jenkins.colo.seagate.com/job/GitHub-custom-ci-builds/job/generic/job/custom-ci/7048/

Triggered new build with timeout as "30*4 = 120sec " per data pod endpoint
build : https://eos-jenkins.colo.seagate.com/job/GitHub-custom-ci-builds/job/generic/job/custom-ci/7071/

Triggered new build,
Build job  : https://eos-jenkins.colo.seagate.com/job/GitHub-custom-ci-builds/job/generic/job/custom-ci/7078/

Observed deployment was successful and user is created properly.
Server pod took ~ 45 secs to deploy.
Note wait time is 30 sec for each request. and on this setup, for first data pod, first user creation request got timed out and second request we were able to get proper response and deployment went ahead.
Deployment log :

RGW user creation log  :


Implemented rand_core traits

I also added configurable debug feature and serde support, through crate feature flags

Thank you so much!
I will test all of this out and if everything is good I'll merge.

You're welcome :wink:.
I used rand_pcg crate as reference.
I got DEFAULT_SEED by typing in "LCGRNG" into a phone dial btw, so you know where that comes from :smile:.
I tried using it with the sim crate but didn't test it much more than that.


Vendor dependencies

Download dependencies and add them to a /vendor directory within the project

Done in https://github.com/EtixLabs/cameradar/pull/107


Consider changing URLs of .NET assemblies not to end with .dll

I wanted to see the demo at https://blazor-demo.github.io/ and my corporate firewall blocked MicroApp.dll, while other dlls downloaded successfully. Since a lot of software is paranoid about downloading/transferring windows binaries, maybe it's worth obfuscating them a bit? Or, at least, renaming?

That's interesting - thanks for letting us know. We'll look at changing the URLs to YourAssembly_dll or something like that, though whether we do it by default may depend on whether we get more reports about this, and whether we can establish it's due to the name or deeper inspection of the payload contents.

@SteveSandersonMS just to drop my 2c here. It is not just corporate firewalls that suffer of the .dll-fobia. Some local anti-virus have this same problem too.

@galvesribeiro is right not to mention that if I wasn’t familiar with what’s going on and I saw a website trying to download a DLL I’d be out of there! Consider the perception when addressing this :)

@joeizy yeah, I totally agree with you that for the majority of cases block dlls is the right thing todo. That is Why we are talking about renaming it as we are sure what we are doing...

How about YourAssembly.blazor? It might be a nice way to promote the project (very very slightly) if any web devs folks look in the dev tools to see how the site was built? Or maybe it's just just me that sometimes spots that a site was a built with Vue.js or whatever and thinks "oh, nice" :)

How about simply .bin?

I like .bin or .blazor as well.

+1 “.bin”

.lib or .bin or .ilasm ?

So we can make an informed decision about this, it would really help if we had approximate repro steps (or at least some hint in that direction). We need to understand specifically whether it's a naming issue or a content issue, for example.
What specific firewall product is known to block .dll, either by default or in a common configuration? Can you point me to something I can install and try out? Or if not, do you have the name of it at least, and perhaps links to any of its configuration docs?

@SteveSandersonMS I think it is not a particular product. Multiple products, specially the ones heavily used by enterprises have tide config settings on file types specially the common ones like .exe, .dll, .so, etc.
The name itself is the first blocker but, one way to reduce this issue, is the same way we've dealing with ClickOnce since .Net 2.0. Signing assemblies.
The problem is that (1) it is not cheap, (2) the process to earn those certificates even if you can afford them is VERY complex and even not available in some countries and even if you get it, (3) the certificate for the company/developer usually takes a while to be trusted by the antivirus software database.
For MSFT released assemblies, it is not a big news as we know that every shipped assembly, even OSSed ones, are code signed by corpnet policy. But think about other developers, startups, and OSS projects. They will all suffer with that.

I remember that in the good old days when Silverlight was a thing, if we wanted to download assemblies on demand, we put them in a xap file (which in practice is a zip file) and then extracted them with
https://msdn.microsoft.com/en-us/library/cc190632(v=vs.95).aspx
Not sure if there was a reason for that (other than combining multiple dlls in a single file). I guess the Silverlight team should be familiar with the firewall issues if there are any.

The problem with bundling together is that if you need to update 1 of those dlls the whole package must be updated... Not cache or bandwidth friendly the Silverlight model...

I'm not suggesting to use bundling for Blazor. I'm just saying that apart from the bundling feature, maybe the Silverlight team was using xap files to avoid firewall issues. That's just a guess, of course.

Keep ".net" as extension

We're well into the realms of bikeshedding on this now.  Hence I'm specifically asking for concrete examples of actual firewall products that have trouble with this.

I think it is not a particular product

Nonetheless, examples of particular products, and under what configurations this happens, would help.

@SteveSandersonMS I understood that part. The point is that fix the issue for 1 particular antivirus/firewall will not cover all the others as we all know that each one has its own heuristic, database, settings for that. The only case that could cover both the naming and signature rules for everything, is:

Sign the assemblies as usual and;
Make sure the naming is not in the default blacklist

Specifc product names with config info, please! Then we'll at least have something concrete to go on when evaluating whether our solution is applicable. I know different products have different rules.

@SteveSandersonMS I've seen a few issues when using NOD32 from ESET and have seen the active scanner block downloading some binary files silently, these seem on the face of it to be Dynamic Link Libraries that do not have a digital signature.

Thanks for the info @grahamehorner. Do you know roughly what the repro steps would be? If I just installed NOD32 onto a (throwaway) Windows machine, is that enough to make it unable to open https://blazor-demo.github.io/? Or is any additional config needed?

From https://www.paloaltonetworks.com/documentation/80/pan-os/pan-os/threat-prevention/set-up-file-blocking:

File Blocking Profiles allow you to identify specific file types that you want to want to block or monitor. For most traffic (including traffic on your internal network) you will want to block files that are known to carry threats or that have no real use case for upload/download. Currently, these include batch files, DLLs, Java class files, help files, Windows shortcuts (.lnk), and BitTorrent files.

@SteveSandersonMS I'm awaiting a meeting with our IT Administration Team that remotely manages NOD32 and it's configuration to find out what (if anything) they have changed/customised, as I've also received an automated email for our NOD32 system stating that I have may violated corporate security policy by downloading/installing untrusted software.  I'll post back as/when I find out or have additional info.

I'm wondering if the .dlls could/would be blocked if they got packaged up into a .nupkg and unpacked/loaded by blazor after download ?

Currently, these include batch files, DLLs, Java class files, help files, Windows shortcuts (.lnk), and BitTorrent files.

That is what I'm saying... Regardless of the product, that is the default list of file types that would be blocked by any IT administrator in regular (usually non-IT-based) company...

BTW, if there is someone from the WPF team that worked with .xap, they can clearly tell anyone what they faced when they released "WPF in a Browser" back in the day and faced exactly same problem.
It took a while until all the anti-virus software start to trust on that extension.

I had the same issue. Tested the sample inside a corporate network. A DLL file was reported as being blocked. This basically makes it impossible to demo this to a colleague. Getting DLL files to be unblocked is probably a non-starter.
Looking at the official conventions page...
http://webassembly.github.io/spec/core/binary/conventions.html

The recommended extension for files containing WebAssembly modules in binary format is “.wasm” and the recommended Media Type is “application/wasm”.

So it would seem that the first thing to do is to rename the files to .wasm, and if they are still blocked, then the firewall needs to be unblocked.

I don't think that renaming the files to .wasm is a good idea. The DLLs are no Wasm modules, they are .NET assemblies which are (currently) interpreted by the Mono Wasm runtime (read more). Only the Mono runtime is a Wasm module. However, I also vote for renaming the DLLs to something else because of firewalls especially in enterprise scenarios.

Antivirus AVG version 18.1.3044 blocked the DLL files too when i tried to visit https://blazor-realworld.azurewebsites.net/

I don't think that renaming the files to .wasm is a good idea. The DLLs are no Wasm modules, they are .NET assemblies which are (currently) interpreted by the Mono Wasm runtime (read more). Only the Mono runtime is a Wasm module.

The problem is what that "something else" extension would be because none of the existing extensions apply (.NET MSIL payloads interpreted directly in the browser sandbox is a brand new concept in security) whereas wasm is already allowed by the corporate firewall.
The handling of .xap may not be a good reference from a security standpoint because it bypasses the browser security sandbox unlike wasm.
Yes, the DLL files contains MSIL so it is technically true, they are not strictly binary wasm. But they are named DLL because they are named after native Win32 DLLs even though they just share a fragment of the PE format and are mostly different internally anyway. Along the same lines, wasm is the "native" library format for Webassembly, and for the same reason that it made sense to name managed libraries DLL:s (even though they are nothing like native DLL:s internally), it can make sense to name them wasm. From a security perspective, DLL implies "local execution" whereas wasm implies "browser execution". To comply with the wasm format, perhaps the .NET assembly could be embedded as data to make it a valid wasm with the magic initial string and all.
The idea here is that there is an analogue: wasm is to MSIL what PE is to MSIL: a wrapper container format. Precendent:
https://docs.microsoft.com/en-us/dotnet/standard/assembly-format

The .NET binary format is based on the Windows PE file format. In fact, .NET class libraries are conformant Windows PEs, and appear on first glance to be Windows dynamic link libraries (DLLs) or application executables (EXEs). This is a very useful characteristic on Windows, where they can masquerade as native executable binaries and get some of the same treatment (for example, OS load, PE tools).
If the Blazor model does not play 100% well with existing firewalls it is almost a show stopper. It should flow through all firewalls effortlessly just like Javascript. If I was a firewall administrator, I am not sure if I would want to add a new white list entry for each new languages that has its own IL format.

it would be great if this could get prioritised for the next milestone.  Would realy allay people's fears that it's a  show-stopper due to potential corporate security blocks

@JonnyGibson As Steve mentioned earlier, we do plan to address this, but in the spirit of Blazor being an experiment project we're prioritizing work right now that is less well understood. We're pretty sure we know how to address this one.

Maybe a solution would be to let the developer define the extension for an app until firewalls and AV add support in the whitelist for whatever extension is decided on.

Regarding my previous comment on letting the developer define the extension this would also allow developers to create apps with different extensions to test out the firewall and Antivirus behaviour.

@jonparker @torhovland  it feels to me that as opposed to defining extensions which may or may not get blocked, we need to find a way that ensures its never blocked. No one is going to use a framework that is going to cause a web site to be blocked under some (quite likely) scenarios.
The idea to remove the extension seems reasonable and should be tried asap.  I haven't seen any other issues raised which are as close as this is to being a showstopper.

The idea to remove the extension seems reasonable and should be tried asap.

In order for us to test any fix we need to be able to reproduce or at least investigate as many problematic environments as possible. To help us with that please continue to provide details on your environments where you run into issues with Blazor apps getting blocked. Thank you everyone who has already reported on this!

I haven't seen any other issues raised which are as close as this is to being a showstopper.

In the long run we're not too concerned about this issue. We're pretty confident that we will be able to handle this issue with some form of app packaging or app transformation. But we're holding off on designing a solution until we have more data on what the specific problems are.

WebSense is the tool my corporate network uses to control web access.  I'm pretty sure that the issue blocking Blazor is just their explicit executable file download blocking.
https://www.websense.com/content/support/library/web/hosted/admin_guide/exten_block.aspx

Looks like AVG is blocking my blazor project. https://files.gitter.im/aspnet/Blazor/Oc8w/image.png

I can confirm I also had experience with AVG blocking my website. My friend couldn't access the website without disabling AVG. as far as I know he used the default antivirus settings.

DLL extension is non issue... With AOT compilation in the works, DLLs will not be distributed, as I understand DLLs are used for quicker dev loop.  Don't spend time on this, get AOT working, that's the goal.

A well... #897 was a duplicate.
This was my error

maybe we can set the extension as a parameter in UpdateIndex where we would get it from the command line (default "dll") : https://github.com/aspnet/Blazor/blob/dev/src/Microsoft.AspNetCore.Blazor.Build/Core/IndexHtmlWriter.cs
If I send a PR on this, would it be considered ?

Please fix this issue, it is the only item blocking me from testing this in the enterprise.

Quick fix suggestion if you are using IIS with the rewrite url module :

you can change in the output all ".*.dll files by .wasmnet or anything. his will edit the content of the script tag (https://docs.microsoft.com/en-us/iis/extensions/url-rewrite-module/creating-outbound-rules-for-url-rewrite-module)
rewrite this extension to dll so the good files will be send to the browser (or rename the dll files after deploying)

Just another idea:  I note that most of these firewall and security products don't block .zip files.  In fact, many times when trying to download a .dll file where I am blocked on some corporate network, I notice a .zip version of the same file will almost always pass the blocking.
So we could simply package MyLib.dll as MyLib.zip (containing a single MyLib.dll file inside the zip).  The problem is that the browser will natively be faster decompressing the files contents compared to if it was WASM/MONO using some .NET assembly to unzip the compressed archive's content.  There would be at least a 2x-3x slowdown for the unzip.
But there is a solution:  We could package the MyLib.dll file as MyLib.zip with ZERO compression used, then leave it up to the web server to compress the file (using whatever compression formats the client browser supported when requesting the file).  When the browser downloads that file, it will natively decompress the received content, before it hits Mono/WebAssembly.  So the Mono runtime would then just need to unpack the .zip file (which at this point is the original uncompressed zip archive).
I hope nobody is confused by the above.  I am just suggesting that we use .zip as an uncompressed container format; then let the web browser and web server handle compression and decompression the way they do normally for any requested file.  To give a concrete example:

2 MB mscorlib.dll gets .zipped into 2 MB mscorlib.zip (note we set compression to NONE).
Web browser requests mscorlib.zip (sending usual Accept-Encoding headers with compression methods supported).
Web server compresses content of mscorlib.zip down to 700 MB and sends that to server, so the package size would be the same as it is today)
Web browser (Chrome or Edge, etc) decompresses content natively, and the Mono runtime would receive the original 2 MB mscorlib.zip file, which WASM Mono can unpack to the original .dll really fast because there isn't any internal compression used on that original zip archive.

So that is just another suggestion to include in the bucket.  My thoughts on other ideas suggested:

I would hope it would be enough just to remove the extension, as in MyLib.dll becomes MyLib or the earlier MyLib_dll suggestion.
I also agree it should be possible to "package" the assembly as data inside a .wasm file (but still internally in IL format) in the same way .NET assemblies use the PE format and were given .dll as an extension.  So we could have a MyLib.wasm that internally stored the IL as data.  The only disadvantage I see here is when we have real AOT compilation it might be hard to visually tell if a .wasm file contained IL or Natively (WASM) compiled code.

.dll would be the proper extension and should be kept as default. Hiding the intention of the file by changing the extension to .zip isn't an optimal solution, since it produces confusion. It would probably be better to use no extension at all and name the file like somedllname_v1_0_0_4321_ab5e8d5b97d141aca3c54776e82d2355
(that is project name, file version and an SHA-256 hash)
A bigger problem is, that current AV scanners (heuristically) detect routines which fetch additional code. There is no real solution to that problem until AV vendors make adaptions to support .wasm.  So better contact the AV vendors and report as a bug, such that they can fix it.

I 100% agree with @MovGP0. AV vendors have to update their software.  I believe that every modern AV scanner checks content of every archive, zip, 7z, rar, etc. Changing file name extension or pseudo-packing is not a long term solution.

It just seems silly that this is an issue because the blocking is due to legacy reasons.  There are two scenarios with Blazor for DLLs:

IL code running interpreted in a browser:  In this case the IL code in the DLL is just raw DATA, and no more threat than a JPG or XML file the browser is processing.  This is because the downloaded IL is being completely interpreted.  The security product has no more business with this than it does with whatever GIF, XML or TXT file a website is processing.

or (in the future)

IL code compiled AOT to .wasm.  In this case the IL code would generate .WASM and the only issue should be how these security products handle .wasm files.

Another point about “packing” is that this is exactly what many javascript frameworks already do to reduce requests to the server: have some server side script dynamically combining multiple separate script filed into a single file.  I would personally love to see some intelligent server side handler that could dynamically combine 20 small (5k) DLLs to reduce initial server requests and let me as a developer optionally have some control over that during page load.
But I think the Blazor team has our feedback now and will do whatever is sensible and/or provide options.
I will point out that a view that we must wait until everyone updates their security products doesn’t work because it isn’t just products it is existing large companies that won’t realistically make configuration changes to their network infrastructure.  This will really hurt Blazor use because it is not just about AV scanners it is about trying to tell staff within an IT department of large company like News Corporation or Bhp Billiton to make network configuration changes.  Culture is changing, but there are still many staff in those departments that simply wouldn’t care (or would actively smile) if this caused Blazor issues ☹.

I believe that every modern AV scanner checks content of every archive, zip, 7z, rar, etc.
My personal experience over the last decade is that when in .zip form everything is usually fine.  Things are usually blocked if the files are .exe or .dll.  Within a zip archive most products would only block the zip file if they detect an actual known signature of malware within the zip archive (not just because there is a .dll inside).  But I acknowledge every product is different so there are not any guarantees here.
From: Andrzej-W<EMAIL_ADDRESS>Sent: Wednesday, 6 June 2018 5:38 AM
To: aspnet/Blazor<EMAIL_ADDRESS>Cc: jiggyswift<EMAIL_ADDRESS>Comment<EMAIL_ADDRESS>Subject: Re: [aspnet/Blazor] Consider changing URLs of .NET assemblies not to end with .dll (#172)

I 100% agree with @MovGP0https://github.com/MovGP0. AV vendors have to update their software.  I believe that every modern AV scanner checks content of every archive, zip, 7z, rar, etc. Changing file name extension or pseudo-packing is not a long term solution.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHubhttps://github.com/aspnet/Blazor/issues/172#issuecomment-394834055, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AmF6aIkiXWAVe282A0YSh_a7bgmGPGN7ks5t5t4OgaJpZM4SUpej.

I had two people from the Corporate Security Team come to my desk after I browsed the the mono wasm example site, which downloads a hello.exe. I think it was picked up by "Symantec Endpoint Protection".

Thanks Harry.  Did they give you time to pack everything into a box before walking you out the door?  Best story yet.
From: Harry McIntyre<EMAIL_ADDRESS>Sent: Thursday, 7 June 2018 8:36 PM
To: aspnet/Blazor<EMAIL_ADDRESS>Cc: jiggyswift<EMAIL_ADDRESS>Comment<EMAIL_ADDRESS>Subject: Re: [aspnet/Blazor] Consider changing URLs of .NET assemblies not to end with .dll (#172)
I had two people from the Corporate Security Team come to my desk after I browsed the the mono wasm example sitehttps://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.hipbyte.com%2F%257Elrz%2Fmono-wasm-hello&data=02|01||f21af207f881447e8d5d08d5cc627621|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|636639645608861860&sdata=Cp9wUKXElAX4z39zarw0DQOlhHo3ZY0MtSRdz8j5YDw%3D&reserved=0, which downloads a hello.exe. I think it was picked up by "Symantec Endpoint Protection".
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHubhttps://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Faspnet%2FBlazor%2Fissues%2F172%23issuecomment-395374377&data=02|01||f21af207f881447e8d5d08d5cc627621|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|636639645609018105&sdata=A9rl39HzRP7w9mzRkqPKrG4zsHJKkVIy2jwJ0e9nc3g%3D&reserved=0, or mute the threadhttps://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAmF6aG9lvmy2g93BQQmI-5mbrGICanCxks5t6QIPgaJpZM4SUpej&data=02|01||f21af207f881447e8d5d08d5cc627621|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|636639645609018105&sdata=yZhLQXXqqp0hLEtD3mTowdoI4EpBu5qNNR0UI4tZDm8%3D&reserved=0.

Maybe useful:
From https://www.cisco.com/c/en/us/td/docs/security/firepower/623/configuration/guide/fpmc-config-guide-v623/file_policies_and_advanced_malware_protection.html

The system can inspect up to three levels of nested files beneath the outermost archive file (level 0) if the file is an archive (such as .zip or .rar archive files). You can inspect archive files as large as the Maximum file size to store advanced access control setting.
If any individual file matches a file rule with a block action, the system blocks the entire archive, not just the individual file. The system can also block archives that exceed a specified level of nesting, or whose contents are encrypted or otherwise cannot be inspected.

Another link (scroll to "Files types feature"):
https://supportcenter.checkpoint.com/supportcenter/portal?eventSubmit_doGoviewsolutiondetails=&solutionid=sk105318&js_peid=P-14d3e69bf07-10000

I found a workaround described here : https://remibou.github.io/Change-Blazor-DLL-extension-with-ASPNET-Core/. It might not help for every case and AV but it's a starting point.

@RemiBou man... that is awesome :) Good catch on use URLRewrite for that! 👍


Setup failed despite GPU available

Hey,
Im on Cuda v11.8.
When trying to run bits and bites it gives me the following error:
_python -m bitsandbytes
warn(msg)
CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching in backup paths...
The following directories listed in your path were found to be non-existent: {WindowsPath('/usr/local/cuda/lib64')}
DEBUG: Possible options found for libcudart.so: set()
CUDA SETUP: PyTorch settings found: CUDA_VERSION=118, Highest Compute Capability: 8.6.
CUDA SETUP: To manually override the PyTorch CUDA version please see:https://github.com/TimDettmers/bitsandbytes/blob/main/how_to_use_nonpytorch_cuda.md
CUDA SETUP: Loading binary C:\Users\Jan Hammer\Pictures\kohya_ss\venv\lib\site-packages\bitsandbytes\libbitsandbytes_cuda118.so...
argument of type 'WindowsPath' is not iterable
CUDA SETUP: Problem: The main issue seems to be that the main CUDA runtime library was not detected.
CUDA SETUP: Solution 1: To solve the issue the libcudart.so location needs to be added to the LD_LIBRARY_PATH variable
CUDA SETUP: Solution 1a): Find the cuda runtime library via: find / -name libcudart.so 2>/dev/null
CUDA SETUP: Solution 1b): Once the library is found add it to the LD_LIBRARY_PATH: export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:FOUND_PATH_FROM_1a
CUDA SETUP: Solution 1c): For a permanent solution add the export from 1b into your .bashrc file, located at ~/.bashrc
CUDA SETUP: Solution 2: If no library was found in step 1a) you need to install CUDA.
CUDA SETUP: Solution 2a): Download CUDA install script: wget https://github.com/TimDettmers/bitsandbytes/blob/main/cuda_install.sh
CUDA SETUP: Solution 2b): Install desired CUDA version to desired location. The syntax is bash cuda_install.sh CUDA_VERSION PATH_TO_INSTALL_INTO.
CUDA SETUP: Solution 2b): For example, "bash cuda_install.sh 113 ~/local/" will download CUDA 11.3 and install into the folder ~/local
Traceback (most recent call last):
File "C:\Users\Jan Hammer\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 187, in _run_module_as_main
mod_name, mod_spec, code = _get_module_details(mod_name, Error)
File "C:\Users\Jan Hammer\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 146, in get_module_details
return get_module_details(pkg_main_name, error)
File "C:\Users\Jan Hammer\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 110, in get_module_details
import(pkg_name)
File "C:\Users\Jan Hammer\Pictures\kohya_ss\venv\lib\site-packages\bitsandbytes_init.py", line 6, in
from . import cuda_setup, utils, research
File "C:\Users\Jan Hammer\Pictures\kohya_ss\venv\lib\site-packages\bitsandbytes\research_init.py", line 1, in
from . import nn
File "C:\Users\Jan Hammer\Pictures\kohya_ss\venv\lib\site-packages\bitsandbytes\research\nn_init.py", line 1, in
from .modules import LinearFP8Mixed, LinearFP8Global
File "C:\Users\Jan Hammer\Pictures\kohya_ss\venv\lib\site-packages\bitsandbytes\research\nn\modules.py", line 8, in
from bitsandbytes.optim import GlobalOptimManager
File "C:\Users\Jan Hammer\Pictures\kohya_ss\venv\lib\site-packages\bitsandbytes\optim_init.py", line 6, in
from bitsandbytes.cextension import COMPILED_WITH_CUDA
File "C:\Users\Jan Hammer\Pictures\kohya_ss\venv\lib\site-packages\bitsandbytes\cextension.py", line 20, in
raise RuntimeError('''
RuntimeError:
CUDA Setup failed despite GPU being available. Please run the following command to get more information:
    python -m bitsandbytes

    Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
    to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
    and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues

(venv) C:\Users\Jan Hammer\Pictures\kohya_ss>_
Does anyone know what the issue could be?

same error , i tried cuda 11.7 and 11.8 in env but didnt solve

I encountered the same issue on CUDA 11.6 and fixed it by building bitsandbytes from source. Below is my bash script for reference:
pip3 uninstall -y bitsandbytes
git clone https://github.com/TimDettmers/bitsandbytes.git
cd bitsandbytes || exit
make CUDA_VERSION=116  # or 117, depending on the local CUDA version
export PYTHONPATH=$PYTHONPATH:<EEG_PATH_OF_BUILT_PACKAGE>  # add the built package to pythonpath in case there is import error
python setup.py install

@richardsun-voyager
<EGG_PATH_OF_BUILT_PACKAGE> refers to the directory where the built package (e.g., mine is like xxx.egg) is located. This is needed if the setup location is not included in PYTHONPATH yet

How can I find "EGG_PATH_OF_BUILT_PACKAGE" location @t170815518

It's needed when the package is not installed at the default place, and EGG_PATH_OF_BUILT_PACKAGE will be specified by the user.

I encountered the same issue on CUDA 11.6 and fixed it by building bitsandbytes from source. Below is my bash script for reference:
pip3 uninstall -y bitsandbytes
git clone https://github.com/TimDettmers/bitsandbytes.git
cd bitsandbytes || exit
make CUDA_VERSION=116  # or 117, depending on the local CUDA version
python setup.py install
export PYTHONPATH=$PYTHONPATH:<EGG_PATH_OF_BUILT_PACKAGE>  # needed if the package is installed in non-default location

thanks a lot! this solved my issues.

I encountered the same issue on CUDA 11.6 and fixed it by building bitsandbytes from source. Below is my bash script for reference:
pip3 uninstall -y bitsandbytes
git clone https://github.com/TimDettmers/bitsandbytes.git
cd bitsandbytes || exit
make CUDA_VERSION=116  # or 117, depending on the local CUDA version
python setup.py install
export PYTHONPATH=$PYTHONPATH:<EGG_PATH_OF_BUILT_PACKAGE>  # needed if the package is installed in non-default location

yes,it solved my issues

@jackyLens @GasolSun36 what gcc version did you use for this

Bitsandbytes was not supported windows before, but my method can support windows.（yuhuang）
1  open folder J:\StableDiffusion\sdwebui，Click the address bar of the folder and enter CMD
or WIN+R, CMD  。enter，cd /d J:\StableDiffusion\sdwebui
2  J:\StableDiffusion\sdwebui\py310\python.exe -m pip uninstall bitsandbytes
3 J:\StableDiffusion\sdwebui\py310\python.exe -m pip uninstall bitsandbytes-windows
4 J:\StableDiffusion\sdwebui\py310\python.exe -m pip install https://github.com/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.41.1-py3-none-win_amd64.whl
Replace your SD venv directory file（python.exe Folder） here（J:\StableDiffusion\sdwebui\py310）

I encountered the same issue on CUDA 11.6 and fixed it by building bitsandbytes from source. Below is my bash script for reference:
pip3 uninstall -y bitsandbytes
git clone https://github.com/TimDettmers/bitsandbytes.git
cd bitsandbytes || exit
make CUDA_VERSION=116  # or 117, depending on the local CUDA version
python setup.py install
export PYTHONPATH=$PYTHONPATH:<EGG_PATH_OF_BUILT_PACKAGE>  # needed if the package is installed in non-default location

I couldn't find Makefile in bitsandbytes directory and make CUDA_VERSION=116 doesn't work.
Could you tell me how to solve this problem.


Registration Page

Registration page:

[x] Should be built with Devise.

edit recipe is not working well

Thank you for your thorough review @rachaouldbabaali ! I'll make the changes and notify you soon


fix restoring from localStorage

fixes #714

Oops. We should probably update this API. It doesn’t make sense to call loadScene(null, undefined).

Yes, it looks funny :).


update dependency middleman to v4.5.1

taken from renovate

@Tallicia @peterhaochen47 @swalchemist Please update ci dockers using ruby to 3.0.x, see
https://endoflife.date/ruby
Then this update here would work.
Related deps is: build-uaa-singular-dockerimage, e.g. https://hush-house.pivotal.io/teams/cf-uaa/pipelines/dockerfiles/jobs/build-uaa-singular-dockerimage
btw. if you see other ruby usages, we should upgrade as well, thanks!

I have created a story #186350526 for this and will update on status for this following Monday's IPM.


Update stable to Ghidra v10.3

I just copied the HEAD patches over to stable. I think that's the only thing we need to do.

Oops, just fixing some build errors.

This should be ready now.

@tetsuo-cpp can you also include the changes from #180 in this PR, please

https://github.com/lifting-bits/sleigh/wiki/New-Ghidra-Release-Update-Checklist

Will do!
Thanks for preparing that doc, I'll refer to that.


Prevent compiler warning when compiled with -Wformat-pedantic

The issued warning is (from Clang):
warning: format specifies type 'void *' but the argument has type 'pointer'

Which version of clang?

Thanks for the PR, surprisingly this was already in C++11 version https://github.com/sparsehash/sparsehash-c11, but this version. I'd rathertake the static_cast over the c style cast though.
Cheers

@Dekken Yes, you're right with the cast, thanks for pointing out.
I was not aware of the C++11 version of the library. Is it stable enough for production use or is it still experimental? Thank you.

I have switched to using the C++11 version generally unless I have to use an older compiler. I haven't had any issues. Perhaps @donovanhide could comment?

Well, it's mostly the same code, with a lot of the baggage for configuration and traits removed and the tests converted to use googletest. I'm hesitant to merge it to this repository, because sparsehash is used in so many places...


Man-Page & More Concise Default Output

The output of running owl is quite long. What do you think about moving this into a man page and listing only very commonly used options when running owl?

Awesome :-)

I made a man page, muted the usage and updated the PKGBUILD.

You are fast!


More efficient 1D two body integrals

The trapezoidal method applied to a vector can be implemented as multiplying it by dx, halving the ends, and taking the sum of the elements.
Since we are applying the trapezoidal method to a product of 3 vectors, we can perform the first two steps on the vector which is available outside the double loop. We can then perform the first vector product inside the first loop, and only perform a dot product inside the double loop.
This is much faster than computing two vector products and applying the trapezoidal method inside the double loop.

Cool! 👯


after restart all tikv pods、pd pods、tidb pods，pitr task became to disabled

Bug Report

What version of TiKV are you using?
UTC Build Time:  2023-02-02 11:41:40
2023-02-03T05:29:54.644Z        INFO    k8s/client.go:132       it should be noted that a long-running command will not be inter
rupted even the use case has ended. For more information, please refer to https://github.com/pingcap/test-infra/discussions/129
./tidb-server -V
Release Version: v6.6.0-alpha
Edition: Community
Git Commit Hash: d28a8d84b5c3978156c29318529900a6e527be1b
Git Branch: heads/refs/tags/v6.6.0-alpha
UTC Build Time: 2023-02-01 11:50:11
GoVersion: go1.19.5
Race Enabled: false
TiKV Min Version: 6.2.0-alpha
Check Table Before Drop: false
Store: unistore
2023-02-03T05:29:54.845Z        INFO    k8s/client.go:132       it should be noted that a long-running command will not be inter
rupted even the use case has ended. For more information, please refer to https://github.com/pingcap/test-infra/discussions/129
./br -V
Release Version: v6.6.0-alpha
Git Commit Hash: d28a8d84b5c3978156c29318529900a6e527be1b
Git Branch: heads/refs/tags/v6.6.0-alpha
Go Version: go1.19.5
UTC Build Time: 2023-02-01 11:41:38
Race Enabled: false
What operating system and CPU are you using?
8c/32g
Steps to reproduce
1、enable pitr tasks
2、run workload
3、restart all tikv pods、pd pods、tidb pods
What did you expect?
after restart all tikv pods、pd pods、tidb pods，pitr task should be running
What did happened?
case：ha-all-comp-restart
after restart all tikv pods、pd pods、tidb pods，pitr task became to disabled

test-plan：https://tcms.pingcap.net/dashboard/executions/plan/1530066
clinic：https://clinic.pingcap.com.cn/portal/#/orgs/31/clusters/7195459875523993624?from=1675402183&to=1675403670
logs：MinIO Console (pingcap.net)
the time point of issue is abort 0203 13:41

/type bug
/severity major

/assign joccau

@joccau

/remove-label may-affects-4.0
/remove-label may-affects-4.0
/remove-label may-affects-4.0
/remove-label may-affects-4.0
/remove-label may-affects-4.0
/remove-label may-affects-4.0

/remove-label may-affects-5.0
/remove-label may-affects-5.1
/remove-label may-affects-5.2
/remove-label may-affects-5.3
/remove-label may-affects-5.4
/remove-label may-affects-6.0
/remove-label may-affects-6.1

/remove-label may-affects-6.2
/remove-label may-affects-6.3
/remove-label may-affects-6.4
/remove-label may-affects-6.5

/label affects-6.2
/label affects-6.5
/label affects-6.4
/label affects-6.3


Don't reach into package to specify transformer

We shouldn't do this:
https://github.com/rossyman/svelte-add-jest/blob/bd183665e8bd35b5d1487d526620dc095ee6a176/preset.ts#L203
Instead it should be just svelte-jester

I outlined my reasoning for doing this over here: https://github.com/rossyman/svelte-add-jest/issues/19#issuecomment-916218761 -- If this is something we can now resolve (i.e.: it automatically resolves the correct file), then I'll be happy to revert it back to svelte-jester specifically.

@bertybot Feel free to raise a PR 🙂


[WIP] Create documentation and samples for the Secret Store configuration provider

Description
Create documentation and samples for the Secret Store configuration provider
Issue reference
We strive to have all PR being opened based on an issue, where the problem or feature have been discussed prior to implementation.
Please reference the issue this PR will close: #256
Checklist
Please make sure you've completed the relevant tasks for this PR, out of the following list:

[x] Code compiles correctly
[ ] Created/updated tests
[ ] Extended the documentation

@amanbha I also have thee dockerfile and the manifest files to deploy this sample to K8s, should I add them under a kubernetes folder as part of the project?

Yes adding them to a k8s folder is fine.

Closing this PR for now based on this discussion


bug in training with LocalLogger

Hi, I'm getting this traceback when calling
162     trainer.fit(model_wrapper, datamodule=data_module, ckpt_path=checkpoint_path)
in src/misc/LocalLogger
---> 49 Image.fromarray(image).save(path)
AttributeError: 'Tensor' object has no attribute '__array_interface__'

changed to
        if isinstance(image, torch.Tensor):
            Image.fromarray(image.permute(1,2,0).numpy().astype(np.uint8)).save(path)
        else:
            Image.fromarray(image).save(path)

Hi, thank you for reporting this issue. It has been fixed.


Typos and outdated references in various files and scripts

I've created pull request https://github.com/woutervanwijk/Pi-MusicBox/pull/230 to fix a few small potential issues mainly in the create_musicbox.sh script:

'chown' and 'chmod' references are outdated.

create '/var/lib/mopidy/.config/mopidy' directory before symlink to it

add '-fn' option to symlinks to allow overwrite of existing links (useful when re-running scripts).

duplicate 'cifs-utils' in apt-get install routine.

it might be quite nice to do away with 'Create Pi MusicBox.rst' entirely. Duplicating that information is unnecessary and any important info should be in the script's comments.

I've thought about this as well but 'Create Pi MusicBox.rst' does contain some useful information not covered in the script. For example: how to build the image from scratch using a clean Raspbian install, as well as some optional performance optimisations to consider in post-installation.
Perhaps we can just remove the overlapping sections from 'Create Pi MusicBox.rst' and replace it with an instruction to run create_musicbox.sh instead?

Yep that's a better idea. In the long run if we can build up some accurate
docs to replace the now outdated user manual I think that'll be good. And
starting with creating the image seems as good a place as any.
On 28 Feb 2015 22:20, "John Cass"<EMAIL_ADDRESS>wrote:

I've thought about this as well but 'Create Pi MusicBox.rst' does contain
some useful information not covered in the script. For example: how to
build the image from scratch using a clean Raspbian install, as well as
some optional performance optimisations to consider in post-installation.
Perhaps we can just remove the overlapping sections from 'Create Pi
MusicBox.rst' and replace it with an instruction to run create_musicbox.sh
instead?
—
Reply to this email directly or view it on GitHub
https://github.com/woutervanwijk/Pi-MusicBox/issues/231#issuecomment-76551479
.

I'm happy that most of this was addressed when https://github.com/pimusicbox/pimusicbox/pull/230 was merged.


MVVM dirty check

Let's say that you have class FoobarViewModel {        var name = Observable<String>()        var phone = Observable<String>()        ... }
... How do you check whether the object itself has changed?
One of the things I'm struggling with right now is showing something on the screen when any of the object's sub properties have changed.
Any thoughts?

Changing properties (observables) does not change to owner object so there is no way to observe changes of FoobarViewModel instance. However, Observables are Signals, so if you also import ReactiveKit, you can do
merge(name, phone, ...).observeNext { _ in
  // either name or phone changed
}

to get notified when either of the properties change. If you care about individual properties values, you probably want:
combineLatest(name, phone, ...).observeNext { (name, phone) in
  // either name or phone changed (at least once)
}

That helps a lot.
How do you remove an binding on UITextField's bnd_controlEvents? I am needing to dynamically set this.

Nevermind. I think I found my own solution. Using dispose bags now. Thanks.


Make monitoring on the sidenav be helm chart specific (i.e, ensure we don't turn on v1 features when v2 installed)

In the cluster explorer side nav, make it so that monitoring side nav link is helm-chart-specific. This means that installing monitoring v2 does not enable UI forms for project monitoring v1 if the legacy flag is enabled.

@catherineluse to get a screenshot of what's appearing since there's an iFrame at play here.

Here's the steps to reproduce it:

Install V2 monitoring
Go to Global Settings > Feature Flags and enable the legacy feature flag
Go to cluster explorer in the cluster where V2 monitoring is installed
In the side nav, go to Legacy > Project > Monitoring (with a project selected in the top nav)

This V1 iFramed monitoring page appears:

Low bar for 2.6.5: modify the label to say V1 Project Monitoring Configuration if this appears with V2 installed.
Stretch: show all form elements disabled (or a blank page though it'll be weird)
Ideal: don't load this page at all (may have to be 2.6.6)

PR here:
https://github.com/rancher/ui/pull/4837

Ticket 5745 - Test Results
With Docker on a single-node instance:
Reproduced on rancher v2.6-054b5d195f115b91a5284e85270403ba6f3ac99b-head:

Fresh install of rancher v2.6-head
Provision a downstream RKE2 cluster
Once provisioned, enable v2 monitoring
From Global Settings > Feature Flags, activate the legacy feature flag
From RKE2's Cluster Explorer, from left-side menu, navigate down to Legacy > Projects > Monitoring
Reproduced - Page title reads Project Monitoring Configuration

Screenshot:
Step 6

Veri-FAILED on rancher v2.6-4bbee5995053eb52ef447ca82de2c90b1af8b21a-head:

Fresh install of rancher v2.6-head
Provision a downstream RKE2 cluster
Once provisioned, enable v2 monitoring
From Global Settings > Feature Flags, activate the legacy feature flag
From RKE2's Cluster Explorer, from left-side menu, navigate down to Legacy > Projects > Monitoring
Veri-FAILED - Page title reads Project Monitoring Configuration; expected to read V1 Project Monitoring Configuration

Screenshot:
Step 6


[WIP] Add uploadTime and modTime metadata to files

uploadTime is a time.Now field for when the file was uploaded to the Sia network.  modTime is a os.ModTime field for when the file was last modified as reported by the client filesystem.  Feature Request #2479

@lukechampine Can you tell me if I'm on the right path with this PR.  If you give me the go ahead I'll add these field to the API endpoint, siac renter files -v output, and update the documentation.

Doing this properly would mean adding uploadTime and modTime to the on-disk .sia format, which would imply adding compatibility code to convert old .sia files to the new format. I'm open to it, but it's a fair amount of work. Might be better to wait for the larger overhaul of the renter (Coming Soon™)

I think that's more than I want to tackle right now.  Hopefully renter overhaul comes soon!  I know several users are looking for this kind of metadata.


Not booting up all of a sudden

Storage Explorer Version:
Build Number:
Platform/OS:
Architecture:
Regression From:
Current Experience
Tried booting up and it would work. Then using activity monitor to shut down app and tried again and nothing. A few minutes later, I get the Microsoft Azure Storage Explorer quit unexpectedly. (image below)
I tried to restart the computer and booting up the app again, same issue. I installed the latest version and still same issue.
Not sure what happened, I know I've updated the Mac OS here and there but is that case? Thanks,

Closing due to lack of response. Please open a new issue if you're still having problems.

I have this same issue with 1.12.0.
Both on previous and current MacOS versions.


Adcm 1803 add fixture sdk_client_with_objects_ss

Created function that upload cluster and host provider bundles, create hosts and clusters with added services and components distributes over hosts.

@annademina Pls, fix Black (and any other checks) before requesting a review

bender build

bender build

bender build


v0.12.1

This release fixes issues with runs terminating prematurely

Checklist

[x] Used a personal fork of the feedstock to propose changes
[ ] Bumped the build number (if the version is unchanged)
[x] Reset the build number to 0 (if the version changed)
[x] Re-rendered with the latest conda-smithy (Use the phrase @conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
[x] Ensured the license file is being packaged.

@conda-forge-admin please rerender

Thanks for the PR, will merge if the render bot doesn't find anything it wants to change for us.

Thank you!


Changes user to 1000

This change simplifies the Dockerfile a bit by not adding a specific user, and therefore not needing the additional shadow-utils package for the user creation.
Testing looked good, replaced the current MCAD operator image with my own jbusche-nonroot-v1.29.58 and the mcad pod ran well and the security scan didn't complain about a root user issue.
./test/perf-test/perf.sh
Checking whether we have a valid cluster login or not...

Nice, looks like you're logged in
Checking MCAD Controller installation status

Nice, MCAD Controller is installed

How many appwrapper jobs do you want?20
...
All 20 jobs finished: 16:51:28
Total amount of time for 20 appwrappers is: 110 seconds

oc describe pod mcad-controller-mcad-5b95c56648-kz8dj |grep Image:
    Image:         image-registry.openshift-image-registry.svc:5000/opendatahub/mcad-controller:jbusche-nonroot-v1.29.58

@KPostOffice @z103cb Here's a PR with the USER 1000 implemented.

Testing with the curl moved to builder looks good:
oc describe pod mcad-controller-mcad-5b95c56648-pcjgg |grep Image:
    Image:         image-registry.openshift-image-registry.svc:5000/opendatahub/mcad-controller:jbusche-nonroot-v1.29.58

./test/perf-test/perf.sh
...
How many appwrapper jobs do you want?20
jobs number is 20
...
All 20 jobs finished: 16:14:01
Total amount of time for 20 appwrappers is: 110 seconds


How to configure ZIVID SDK in visual studio?

Hi,
I want to configure ZIVID SDK in Visual Studio through its Property pages instead of CMake.
Is it possible? And is there any tutorial on how to make it?

Hi Xiong,
You can find our tutorials related to C++ samples here:
https://support.zivid.com/en/latest/api-reference/samples/cpp.html#instructions
We don't have one specific to what you are trying to achieve, but that is for sure possible to do.
Please email us at<EMAIL_ADDRESS>to open a support case.


Loading big models is slow

Hi,
i am trying to deploy a trained ydf model (tfdf.keras.RandomForestModel) to a serverless FaaS-like inference service in order to save resources (only 2-3 invocations per day).
For this, the model needs to be loaded basically every time a prediction is done. However, loading the model takes more than 30 minutes, which is too long for this usecase. I am not a c++ dev, so my debugging efforts have been relatively limited up to now. Initially i only used the tfdf library, since then i have switched to the ydf python library, with no performance increase (which is probably to be expected since the use the same c++ backend). The only difference is, that the ydf library does not seem to actually load the model fully when calling
loaded_model = ydf.from_tensorflow_decision_forests(model_path)

but rather only when the first predict call is made.
The code
logger.info("predicting...")
live_predictions = loaded_model.predict(live_data)

is producing
2024-03-06 09:03:03.992 | INFO     | __main__:<module>:45 - predicting...
[INFO 24-03-06 09:33:24.2661 EST decision_forest.cc:700] Model loaded with 200 root(s), 2681168 node(s), and 1191 input feature(s).
[INFO 24-03-06 09:33:24.3790 EST abstract_model.cc:1344] Engine "RandomForestGeneric" built

As you can see, it takes ~30 minutes until the model is fully loaded. This happens on my local machine (M2 Air), but also on all other machines i tried (including x86 ones).
If you think that a model with these parameters is supposed to take this long to load, feel free to close this issue, but to me this seems a bit too slow judging by the fact that it is possible to load gigantic models like llama in sub 10 seconds.
Thanks in advance!

Hi @rstz ,
thanks for the fast response. The hyperparameters used for training were
{
  "categorical_algorithm": "CART",
  "max_depth": "16",
  "min_examples": "30",
  "num_trees": "200",
  "sparse_oblique_normalization": "MIN_MAX",
  "sparse_oblique_projection_density_factor": "8.0",
  "split_axis": "SPARSE_OBLIQUE",
}

However, i have trained this model as part of a grid search across a large number of hyperparameters and from what i can see, all models take this long to load.
The features are floats in the range [0;1], effectively only taking on the values {0,0.25,0.5,0.75,1}, however i suppose that doesnt make a difference.
The model dir looks like this size-wise:
306M	./assets
4,0K	./fingerprint.pb
496K	./keras_metadata.pb
6,6M	./saved_model.pb
8,0K	./variables

I havent tried to train the model with YDF directly, i can try to do that if you think that this might improve performance. Training the model with tfdf took ~72h (596400 examples and 1191 features).

Thank you! Instead of re-training the model, you can also load it in with YDF, then save it with YDF to a new directory and measure the time to re-load it
loaded_model = ydf.from_tensorflow_decision_forests(model_path)
loaded_model.save("/tmp/my_model")

start_time = time.time()
re_loaded_model = ydf.load_model("/tmp/my_model")
end_time = time.time()

elapsed_time = end_time - start_time
print("Elapsed time:", elapsed_time, "seconds")

That might help me narrow down if the issue is with the importer (which is mostly written in Python and is, presumably, not very fast) or somewhere in C++

Okay, thanks.
As i said from_tensorflow_decision_forests doesnt seem to load the model fully and neither does ydf.load_model.
The execution time for the script you provided is ~2 seconds, however, as soon as i try to use the loaded model (i.e. add a prediction to the script), it seems to actually load it and then does the prediction, which takes ~30 minutes. Subsequent predictions take less then 10 seconds.
I am unable to share this exact model, but i can provide a different one with similar properties suffering from the same issue:
https://www.comet.com/api/registry/model/item/download?modelItemId=bV0izwCSlrbc8ZpJJpiCfIrbp
Here is a csv with some sample data which you can use to make a prediction
sample_data.csv
This should behave the exact same, let me know if something doesnt work.

Okay, i just noticed that the provided model does, in fact, not suffer from the same issue. So here is the actual model im having the issue with instead:
https://www.comet.com/api/registry/model/item/download?modelItemId=AQcHxjrKLdCcZihkMPyOMcamV

Hi, quick update. I'm fairly sure I found the issue - the combination of hyperparameters you're using really creates very slow creation of the prediction engine (which, in Python, happens before the first call to predict).
Good news is that we can probably make this ~10 times faster fairly easily (on your model, I got 15 minutes loading time down to 1.6 minutes with a quick prototype). Now all I need to do is the usual software engineering - validate it, make sure the fix has a reasonable design, testing, releasing, ...

That sounds awesome, thank you so much!


[Docs]: Focus first invalid input after submit

Description
I think many users will ask this, so I'm opening a discussion to see if this should be handled by HouseForm. If not, then I think it would be great to have a section in the docs showing how to achieve this.
Describe the solution you'd like
No response
Describe alternatives you've considered
No response

I definitely think this shouldn't be handled by HouseForm's code, in particular because I don't know how we'd do this in a headless way, but also because I think this won't be the behavior of all forms.
I do like the idea of doing this with a docs guide instead, however. Let's rename this issue and change the labels

Maybe a new section recipes would be nice for this kind of things

I like the idea of recipes. If we were to add this would it be a step-by-step or just add a stackblitz example?

I have no strong preference either way - and could be convinced either way. I think if we do go "StackBlitz", let's at least add a little description


Make a gulp task to compile all templates and javascript into a single file

The directives for foundation for apps should be useable outside of the entire framework. I've created a few gulp tasks to compile the directives and helping things to /compile/foundation-tpls-min.js and /compile/foundation-tpls.js.
I've used ngHtml2Js for this.
Errors
Line 39 mediaQueries[key].replace would fail because mediaQueries was not converted from a string to JSON properly. Instead it the key was the JSON string and the value was null.
My Fix
I changed the code inside js/angular/services/foundation.core.js  in the parseStyleToObject function. I refactored the method instead of manually parsing the string to use the JSON.parse method.
This fails in travis so I undid it
Things to watch for
Oddly sometimes the way it pulls out media queries from the meta element sometimes will fail. The font-family is converted to '{"small": "0", "medium": "40rem", "large": "75rem", "xlarge": "90rem", "xxlarge": "120rem"}' which is unreadable by the parseStyleToObject function. If you replace the function with JSON.parse it works but when font-family goes to being a query string small=0&medium=40rem it breaks.

Hey, sorry for getting to this late. We definitely want to start using the template cache, since we're already running into problems with the hardcoded template paths we have, and it would also just make distributing our code easier.
We're trying to get 1.0.3 out the door today, but it would be nice to have this functionality in place for our next version, which will probably be 1.1. 1.0.3 will introduce a dist folder into the Bower package which has compiled CSS and JavaScript. For future versions it would make sense for the templates file to be in there as well.
Since the Gulpfile has been refactored quite a bit recently, would you like to re-do your PR against the new codebase? And thanks for your work! :)

Sure thing!

Awesome, thank you. You'll see that the new Gulpfile has a task called deploy:dist, which generates compiled assets for Bower and npm.


Port the update about shared mode from master

2 commits are to fix the critical bug XWALK-4966. Another 3 commits are to update the API doc and alert message.

@rakuco Please help to review and merge


Support for VS Code Extensions

The devcontainer spec supports pre-installing VS Code extensions. Could we support this with the code-server CLI (or even the official vscode-server for Remote SSH)?
This came up from a prospect at Kubecon

BTW, I currently do this outside the context of envbuilder after the container is built:
 # install and start code-server
  if ! which code-server > /dev/null; then
    curl -fsSL https://code-server.dev/install.sh | sh | tee code-server-install.log
  fi
  CODE_CLI=code-server
  if code; then
    CODE_CLI=code
  fi
  mkdir -p ~/.vscode-server/extensions

  set +e
  extensions=( $(sed 's/\/\/.*$//g' */.devcontainer/devcontainer.json | jq -r -M '[.customizations.vscode.extensions[]?, .extensions[]?] | .[]' ) )
  if [ "$${extensions[0]}" != "" ] && [ "$${extensions[0]}" != "null" ]; then
    for extension in "$${extensions[@]}"; do
      $CODE_CLI --extensions-dir ~/.vscode-server/extensions --install-extension "$extension"
    done
  fi
  set -e
fi

I confirm that support for installing VS Code Extensions based on devcontainer.json is highly anticipated by many users.

if ! which code-server > /dev/null; then
curl -fsSL https://code-server.dev/install.sh | sh | tee code-server-install.log
fi
CODE_CLI=code-server
if code; then
CODE_CLI=code
fi
mkdir -p ~/.vscode-server/extensions
set +e
extensions=( $(sed 's///.*$//g' */.devcontainer/devcontainer.json | jq -r -M '[.customizations.vscode.extensions[]?, .extensions[]?] | .[]' ) )
if [ "$${extensions[0]}" != "" ] && [ "$${extensions[0]}" != "null" ]; then
for extension in "$${extensions[@]}"; do
$CODE_CLI --extensions-dir ~/.vscode-server/extensions --install-extension "$extension"
done
fi
set -e

Hi! I would like to apply your solution. What place are you injected these code?

I've been exploring solutions to this issue and the approach that stands out the most is that we support installing extensions from devcontainer.json within Coder modules and via Dev Container features.
Currently, envbuilder lacks awareness of both VS Code Server and code-server. It makes sense for envbuilder to remain agnostic about specific customizations.
If we look at Codespaces, the VS Code extensions from devcontainer.json are installed as part of the integrated editor for the Codespaces container. The editor is not actually defined in the devcontainer.json, it's a feature of Codespaces. If envbuilder shipped with an integrated editor like Codespaces, then placing that logic within envbuilder would be sensible.
The use-case that we probably should enable (either via envbuilder itself of @devcontainer/cli) is to allow composing a devcontainer.json that is resolved from the projects devcontainer.json and features. Then documenting how to use this.
Examples of this exists in Tool Examples over at @devcontainers/cli.
We can observe that e.g. tool-vscode-server has scripts for both composing the devcontainer.json and installing extensions.
Related issues:

https://github.com/coder/envbuilder/issues/43
https://github.com/coder/envbuilder/issues/89

Side-note: I've also noticed that the "entrypoint" from Dev Container features doesn't get launched via envbuilder. Similarly, envbuilder doesn't respect the final CMD (or ENTRYPOINT?) in container images and replaces these with its own "sleep for infinity", even when the init script is ommited. It's a bit unclear to me how we should handle this.

I wonder if this is something our envbuilder Terraform provider we need to build can solve. It'd be excellent if the envbuilder provider can provide a raw json object of the full dev container file, which then the code-server module could consume (to then run code-server --install-extension ... on a loop).

Related: https://github.com/coder/envbuilder/issues/121

@bpmct I think pushing this information back to the provider could be challenging and have support for only a limited number of use-cases. One of the issues is that we should also consider the JSON pulled in via Dev container features, this is only available at build time or in the final image. Without a way to propagate this information from envbuilder to provider, it'd be challenging to do in a robust way.
Two options I think are feasible:

Allow running envbuilder read-configuration to have envbuilder produce the JSON
Provide a well-known place (or env variable) where the finalized JSON produced by envbuilder is available

I like option 1. since it's what @devcontainer/cli does and allows inclusion of additional JSON. If we match @devcontainer/cli API here and alias envbuilder -> devcontainer, we could make this a very generic solution for anyone building devcontainer functionality that just works :tm: in envbuilder.
Option 2 is more limited but means we don't need to support an API/CLI args.

I like option 1 too :)

This has now been broken out into separate features.

https://github.com/coder/envbuilder/issues/212
https://github.com/coder/envbuilder/issues/211
https://github.com/coder/envbuilder/issues/210
https://github.com/coder/modules/issues/253

Closing this issue as not planned.

Reopening this issue as this is what people will be searching for and the other issues are implementation details. Also pinning it as its commonly requested
Some questions

Can we do this as a Coder module?
Can we have this influence config on both web VS Code (code-server, VS Code Web) and VS Code desktop?


feat & fix: add an annotation to allow bypassing the validating webho…

…ok for emergency updates, fix the validation on meta & state stores
What's changed and what's your intention?
PLEASE DO NOT LEAVE THIS EMPTY !!!
Please explain IN DETAIL what the changes are in this PR and why they are needed:

Allow bypass the validating webhook with annotation risingwave.risingwavelabs.com/bypass-validating-webhook: "true". It's useful when a RisingWave resource is broken but updates will be blocked by the webhook.
Fix the validating webhook on meta & state stores.

Checklist

[ ] I have written the necessary docs and comments
[ ] I have added necessary unit tests and integration tests

Refer to a related PR or issue link (optional)

LGTM! I have two questions:

Do we need to release a new version for this fix?

The validation doesn't work in the current v0.4.1 release so it's possible to patch parameters of state store without this new feature. So it's not necessary to release a new version, but we can still do it.

Will all affected old tenants be fixed after this PR is rolled out? Or do we need any other operations?

No. We need to fix them manually.


TransactionScheduler: CLI and hookup for central-scheduler (#33890)

Problem
Summary of Changes
Fixes #

I would like to pool ASTRONUT TOKEN


Add OpenShift

Would love to have openshift on this :)
From https://access.redhat.com/support/policy/updates/openshift

Just to be clear - this page would track the "OpenShift Container Platform", which only applies with a valid RedHat subscription, and not OKD, the upstream OSS distribution?
In that case, we should perhaps make it clear, and rename the product to "Red Hat OpenShift".

Just to be clear - this page would track the "OpenShift Container Platform", which only applies with a valid RedHat subscription, and not OKD, the upstream OSS distribution?
In that case, we should perhaps make it clear, and rename the product to "Red Hat OpenShift".

You are right, I think this would be a good idea.

Yes, will validate dates and merge.

Just leaving a comment to say this all looks great to me! I'm also eager to see RedHat OpenShift added to endoflife.date, and this page would do exactly what I need! (Release dates and EOL dates all look correct to me too)

Thank you for your contributions @dadav and @SpangleLabs.


pca9685: added gpio pin API

Provide PWM functionality of PCA9685 via gpio Pin API.

gohci

Codecov Report

Merging #437 into master will increase coverage by 0.14%.
The diff coverage is 30.90%.

@@            Coverage Diff             @@
##           master     #437      +/-   ##
==========================================
+ Coverage   63.31%   63.46%   +0.14%
==========================================
  Files         120      121       +1
  Lines       12434    12489      +55
==========================================
+ Hits         7873     7926      +53
+ Misses       4353     4340      -13
- Partials      208      223      +15

Impacted Files
Coverage Δ

experimental/devices/pca9685/pins.go
26.92% <26.92%> (ø)

experimental/devices/pca9685/pca9685.go
62.96% <100.00%> (+62.96%)
:arrow_up:

experimental/devices/as7262/as7262.go
99.08% <0.00%> (+0.91%)
:arrow_up:

host/sysfs/thermal_sensor.go
83.84% <0.00%> (+2.30%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 03ec8a9...a682bff. Read the comment docs.

gohci

Thanks!


icon is not changing color state

hi, it would be good to have the icon change color based on the state of the ac; if it is 'on' to be orange (for example) and if it is 'off' wo be at regular color.

Might you need a suitable lovelace card? This component is an integration instead of a UI.


Add decorators for changing squape defined thing for own function

Would it be possible to include own decorator in squape to use squape contextmanager decorated functions over own function?
For instance we found reasonable on our test automation to make decorator to make possible to report whole function in section. Similarly settings changes may be needed over specific function:
Report section decorated:
from functools import wraps

import test
from squape import report

def main():
    test.log("Hello World")
    method_to_be_sectioned()
    complex_stuff(2, "Makkara", asdfasdf=1, randomvar="healthy")

def report_in_section(section_msg, section_description=""):
    def decorate_function_to_section(func):
        @wraps(func)
        def execute_func_in_section(*args, **kwargs):
            with report.section(section_msg, section_description):
                func(*args, **kwargs)
        return execute_func_in_section
    return decorate_function_to_section

@report_in_section("This method is executed in section", "BTW it just logs random")
def method_to_be_sectioned(repeat=2):
    for _ in range(repeat):
        test.log("This message should be inside sections")

@report_in_section("More complex method")
def complex_stuff(repeat, value, **kwargs):
    for _ in range(repeat):
        test.log(f"{value} is good")
    if 'randomvar' in kwargs:
        test.log(f"and also {kwargs['randomvar']}")

@juhoarvid Thank you for sharing a great idea 💯
While looking into that, I realized that squape's context managers are implemented with @contextmanager which internally uses ContextDecorator. That makes them usable also as decorators.
from squape.report import section

@section("This method is executed in section", "BTW it just logs random")
def method_to_be_sectioned(repeat=2):
    for _ in range(repeat):
        test.log("This message should be inside sections")

We should update the documentation! 😉
In case of sections, the current implementation does not support using function parameters as part of the decorator parameters.. Unfortunately, the below example won't work.
@section(f"Add {name}")
def add_person(name):
    ...

I think it would be great to handle such cases as well - for sure something worth investigating.

sections can be used as decorators and as context managers. The documentation has been updated.
Fixed in version v1.1


adding tag 2019-06 to python

Automation for azure-sdk-for-go

Automation for azure-sdk-for-python

Can one of the admins verify this patch?


CASMHMS-5468 CAPMC/CAPMC-lite tests for HMTH

Summary and Scope
This PR consists of the following changes:

Update CAPMC CT tests to use latest hms-test:4.0.0 image
Break out CAPMC CT tests into non-disruptive, disruptive, destructive, and build-pipeline-only test buckets
Adds many new API tests that execute in the runCT environment in the build pipeline (also able to run on live systems but need to be careful doing this for the disruptive and destructive tests)

Issues and Related PRs

Resolves CASMHMS-5468.

Testing

Tests run in the runCT build pipeline environment in GitHub Actions for each branch push and PR.
Also deployed and ran the non-disruptive tests on Mug and Surtur to verify that they behave as expected.

Risks and Mitigations
Adding many new API tests that will gate CAPMC changes if breakages occur.

Builds seem to be failing due to issue unrelated to this PR.

Builds finally succeeded.


APIPriorityAndFairness 1.20 beta placeholder PR

/milestone 1.20
/assign @reylejano-rxm
/sig api-machinery
/hold pending merge https://github.com/kubernetes/kubernetes/issues/96119

Hi @yue9944882
Would you have a chance to sketch in at least an initial version of the documentation for this feature? It'd be great to have that ready for initial review before KubeCon.

@sftim @annajung am closing this in favor of https://github.com/kubernetes/website/pull/24975
/close


Linux/Macos port

Everything is coded with multiplatform in mind (mostly). And I compiled the project on a virtualized Ubuntu. It was a couple months ago and a Linux port (a solid one) would be great.
Kudos if there is a possibility to produce binaries(packages) from a bot.

yes please that would be great to have a guid for linux or even compiled binaries!

I still have hope to find a contributor for the Mac/Linux port :)

Amazing Project @CedricGuillemet I have just started playing with building in a ubuntu:18.04 docker container. Which version of Ubuntu did you use to compile against?
I would be happy to follow through with build bot if you can share some build specifics with me.
(note: I am not the greatest C++ person)

Hi
Thank you for putting some time in the project :)
I tried with a Centos 7 virtual machine (a long time ago).
Most of the effort I put was in the cmake file. It needs a couple packages: libSDL-dev, opengl,...
Since that test I may have added some non cross platform. Let me know if that happens, I'll fix that quickly.

So I am back.
I have setup a build pipeline using azure pipeline. This is pretty fast and free for open source applications. It also supports Windows, OSX and Linux which is nice, cos no one really support OSX.
https://dev.azure.com/highway900/Imogen/_build/results?buildId=4
That is the build result with a fairly vanilla cut of master. The only change is setting the C++ standard to 17. This fixed numerous build errors like using auto.
The current errors can be fixed by including math.h but I assume that this is done some other way with VS? This is pretty interesting to me, cpp build systems are not my strong suite.
I can invite you to the azure project, or you could start one for the project. I just thought it might be an easy way to run the builds and create some release/build artifacts for many platforms automatically.
Cheers.

That looks nice! Is there a way to not create a repo on azure but use github instead?

The azure build system just points at my github fork of Imogen :) So there is no azure repository that I know of. I did allow access to azure to my fork.
You can also manage the configuration yml file from inside the github repo.

As far as I can tell the version of pyconfig.h is generated by python configure system (or copied from PC/pyconfig.h) in the cpython source. The version included in imogen is for VS c++ or wacom compiler specifically. The file is ignored in the cpython source
I will try to compile with the linux python3.7-dev package instead.

Compiling with an installed version of python3.7 and package lookup in CMakeLists fixed the python dependency.
Now the compiler semantics are appearing. I get a different set of errors for GCC and Clang. I will focus on Clang at the moment in the hope that translates to OSX easier. Changing the C++ standard  (11, 14, 17) also generates a variety of different errors. I am currently using 14 as 17 causes errors with pybind, which fits VS the best?

I don't know. I use vs2017 default settings. Focusing on Clang is a good idea.

I just tried to build current "dev-0.14" branch and got this error:
/home/redneck/programs/Imogen/src/EvaluationContext.cpp:26:10: fatal error: SDL.h: No such file or directory
 #include <SDL.h>
though i have this file (/usr/include/SDL/SDL.h).
Arch Linux.

The path for SDL is likely incorrect in the include.
‘#include <SDL/SDL.h>’
This is actually where ‘SDL.h’ is. I would suggest changing the cmakelists
file to search in the include subdirectory.
On Sun, 2 Jun 2019 at 04:34, axredneck<EMAIL_ADDRESS>wrote:

I just tried to build current "dev-0.14" branch and got this error:
/home/redneck/programs/Imogen/src/EvaluationContext.cpp:26:10: fatal
error: SDL.h: No such file or directory
#include <SDL.h>
though i have this file (/usr/include/SDL/SDL.h).
Arch Linux.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/CedricGuillemet/Imogen/issues/31?email_source=notifications&email_token=AAIMTYGBIWIWDAXD3BG5GNTPYK6KVA5CNFSM4GGGTT4KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODWXGFSY#issuecomment-497967819,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAIMTYB2BFZ5WJ33IRTMT73PYK6KVANCNFSM4GGGTT4A
.

Trying to compile dev-0.14 branch:
/home/redneck/programs/Imogen/src/Platform.h:101:2: error: #error unknown platform
 #error unknown platform

What's your compiler/OS? The platform.h sets the configuration and enables features based on the target. Currently, only Windows thru MSVC and emscripten are supported.

@CedricGuillemet Arch Linux as before, GCC 8.3.0

Hey! Are you looking for help with the Linux port?
I'm a graphic designer and I'm really excited to see Imogen being a thing, as I want to make generative PBR materials, but I don't want to become Adobe's servant for this.
I'd be really excited to help you develope the Linux port (the web build doens't seem to work well for me).
I'm running Ryzen 7 1700 / GTX 1060 6GB / 32GB RAM and Manjaro Linux.

I've truied building the newest git code on Linux, as well as the latest release. No success so far.
Building the latest release I git this error:
/data/Applications/Imogen-0.13.0/ext/python37/include/pyconfig.h:59:10: fatal error: io.h: No such file or directory
 #include <io.h>
          ^~~~~~
compilation terminated.

/

I have the same problem.

Trying to compile dev-0.14 branch:
/home/redneck/programs/Imogen/src/Platform.h:101:2: error: #error unknown platform
 #error unknown platform

I have the same issue.
#68

Yes, I broke the linux build with emscripten. Fixing it now.

Any plans for appimage releases?

@nafergo any plans for compile from sources first, the rest later.

Now it compiles but crashes:
Imogen: /home/redneck/programs/Imogen/ext/imgui_draw.cpp:1623: ImFont* ImFontAtlas::AddFontFromFileTTF(const char*, float, const ImFontConfig*, const ImWchar*): Assertion `0' failed.

It crashes because it doesn't find the font file. In your terminal run the app from the bin directory

Thank You, it works!

Doesn't compile again
CMake Error at ext/bgfx/cmake/3rdparty/glsl-optimizer.cmake:55 (list):
  list sub-command REMOVE_ITEM requires two or more arguments.
Call Stack (most recent call first):
  ext/bgfx/cmake/tools/shaderc.cmake:14 (include)
  ext/bgfx/cmake/tools.cmake:17 (include)
  ext/bgfx/CMakeLists.txt:61 (include)

Arch Linux, Imogen dev-0.14 branch.

Try updating the submodules.

Try updating the submodules
Already tried with no success.

Apparently, something is broken with bgfx, because I updated the submodules and now is failing for me also.

The error I'm getting is because of this change in bgfx
https://github.com/bkaradzic/bgfx/commit/855623e1534e9114847d8df3c2be52cb348e6493

I'm not sure (I didn't read all the imogen code) but maybe will be healthier to use Vulkan directly, cause bgfx is doing api changes.  You can use vukan on linux and windows and MolteVk or similar on macos.

I can't reproduce the issue with cmakegui + msvc :(

It happens if you update the submodules recursively cause they are making changes on bgfx, check
bkaradzic/bgfx@855623e

Can be fixed just by replacing VertexDecl  to VertexLayout.

But then I started to get more bgfx error, updating the submodules was a bad idea.

I've pushed an update. let if know if it solves something

I did git pull origin dev-0.14 and git submodule update, still the same issue:
CMake Error at ext/bgfx/cmake/3rdparty/glsl-optimizer.cmake:55 (list):
  list sub-command REMOVE_ITEM requires two or more arguments.


Add support for a g:racer_enabled option to easily enable and disable the plugin

I'd love it if there was a convenient way to disable the plugin for testing/usability purposes by setting some variable like
:let g:racer_enabled = 0

Trying to set the g:racer_cmd to "" means it gives errors saying it can't find the racer executable.

Why the feature is needed?
I don't understand.
vim-racer only works if you use vim-racer mappings.

Hmmm.... I think I've messed up which plugins are responsible for autocomplete. Sorry about that. Closing


datastore#dataset is ignored in documentation?

Looking at https://github.com/GoogleCloudPlatform/gcloud-node/blob/1f57dd607b4c52a48f88781cd185220d40683184/lib/datastore/index.js#L94
Looks like we chose to make this "Developer documentation"?
Seems weird that we'd have pubsub#topic documented but not datastore#dataset? (http://googlecloudplatform.github.io/gcloud-node/#/docs/master/pubsub?method=topic)
Was there a reason we chose to ! ignore that docstring?

I think it may have been a mistake. Sometimes a Developer doc block is stacked on top of a public doc block, so maybe a sloppy delete left the /*! Developer Documentation heading instead of the other. Good find, will fix!


Use template to accelerate query performance

Description

Codecov Report
Attention: 428 lines in your changes are missing coverage. Please review.

Comparison is base (bbc053f) 48.98% compared to head (92e493c) 48.92%.
Report is 27 commits behind head on master.

Files
Patch %
Lines

.../db/queryengine/plan/analyze/TemplatedAnalyze.java
5.63%
201 Missing :warning:

...queryengine/plan/planner/TemplatedLogicalPlan.java
0.00%
87 Missing :warning:

...gine/plan/planner/TemplatedLogicalPlanBuilder.java
0.00%
38 Missing :warning:

...ueryengine/plan/planner/OperatorTreeGenerator.java
24.32%
28 Missing :warning:

...he/iotdb/db/queryengine/plan/analyze/Analysis.java
16.66%
20 Missing :warning:

...ache/iotdb/tsfile/file/metadata/ChunkMetadata.java
57.14%
9 Missing :warning:

...eryengine/plan/analyze/ExpressionTypeAnalyzer.java
12.50%
7 Missing :warning:

...ache/iotdb/db/storageengine/buffer/ChunkCache.java
81.08%
7 Missing :warning:

.../dataregion/read/reader/chunk/DiskChunkLoader.java
56.25%
7 Missing :warning:

.../db/queryengine/plan/execution/QueryExecution.java
0.00%
4 Missing :warning:

... and 10 more

Additional details and impacted files
@@             Coverage Diff              @@
##             master   #11522      +/-   ##
============================================
- Coverage     48.98%   48.92%   -0.06%
- Complexity    24690    24753      +63
============================================
  Files          2777     2785       +8
  Lines        173971   174779     +808
  Branches      20822    20930     +108
============================================
+ Hits          85215    85519     +304
- Misses        88756    89260     +504

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


ArgumentNullException with BlendedInfixSuggester (v. 4.8.0-beta00014)

Good day.
We ran into an error when trying DoLookup with some specific key values.
We have a dictionary with single item that has key "D|B(C)". Then we try DoLookup for value "B(C)". It results in an error:
System.ArgumentNullException
  HResult=0x80004003
  Message=Value cannot be null. (Parameter 'value')
  Source=System.Private.CoreLib
  StackTrace:
   at System.String.StartsWith(String value, StringComparison comparisonType)
   at Lucene.Net.Search.Suggest.Analyzing.BlendedInfixSuggester.CreateCoefficient(IndexSearcher searcher, Int32 doc, ICollection`1 matchedTokens, String prefixToken)
   at Lucene.Net.Search.Suggest.Analyzing.BlendedInfixSuggester.CreateResults(IndexSearcher searcher, TopFieldDocs hits, Int32 num, String key, Boolean doHighlight, ICollection`1 matchedTokens, String prefixToken)
   at Lucene.Net.Search.Suggest.Analyzing.AnalyzingInfixSuggester.DoLookup(String key, IEnumerable`1 contexts, Int32 num, Boolean allTermsRequired, Boolean doHighlight)
   at Lucene.Net.Search.Suggest.Analyzing.BlendedInfixSuggester.DoLookup(String key, IEnumerable`1 contexts, Int32 num, Boolean allTermsRequired, Boolean doHighlight)
   at Lucene.Net.Search.Suggest.Analyzing.AnalyzingInfixSuggester.DoLookup(String key, IEnumerable`1 contexts, Boolean onlyMorePopular, Int32 num)
   at Lucene.Net.Search.Suggest.Analyzing.BlendedInfixSuggester.DoLookup(String key, IEnumerable`1 contexts, Boolean onlyMorePopular, Int32 num)
   at Lucene.Net.Search.Suggest.Lookup.DoLookup(String key, Boolean onlyMorePopular, Int32 num)
   at LucenNetIssue.Program.Main(String[] args) in C:\Users\monco\source\repos\LucenNetIssue\Program.cs:line 39

Code to reproduce.
using System;
using System.Collections.Generic;

using Lucene.Net.Analysis.Standard;
using Lucene.Net.Search.Suggest;
using Lucene.Net.Search.Suggest.Analyzing;
using Lucene.Net.Store;
using Lucene.Net.Util;

namespace LucenNetIssue
{
    class Program
    {
        static void Main(string[] args)
        {
            const LuceneVersion LUCENE_VERSION = LuceneVersion.LUCENE_48;

            var analyzer = new StandardAnalyzer(LUCENE_VERSION);

            var suggester = new BlendedInfixSuggester(LUCENE_VERSION,
                new MMapDirectory("search"),
                analyzer,
                analyzer,
                4,
                BlendedInfixSuggester.BlenderType.POSITION_LINEAR,
                1
            );

            var items = new[]
            {
                new PlaceItem
                {
                    Key = "D|B(C)"
                }
            };

            suggester.Build(new PlaceIterator(items));

            var result = suggester.DoLookup("B(C)", false, 5);
        }
    }

    class PlaceItem
    {
        public string Key { get; set; }
    }

    internal class PlaceIterator : IInputEnumerator
    {
        private readonly IEnumerator<PlaceItem> _enumerator;

        public BytesRef Current => _enumerator.Current is { } ? new BytesRef(_enumerator.Current.Key) : null;

        public IComparer<BytesRef> Comparer => null;
        public long Weight => 0;
        public BytesRef Payload => null;
        public bool HasPayloads => true;
        public ICollection<BytesRef> Contexts => Array.Empty<BytesRef>();
        public bool HasContexts => true;

        public PlaceIterator(IEnumerable<PlaceItem> placeItems)
        {
            _enumerator = placeItems.GetEnumerator();
        }

        public bool MoveNext() => _enumerator.MoveNext();
    }
}

TargetFramework: net5.0
Packages: Lucene.Net Version="4.8.0-beta00014", Lucene.Net.Suggest Version="4.8.0-beta00014".
Thanks for your attention.
UPD. If we change Key "D|B(C)" to "A|B(C)" or "B|B(C)" or "C|B(C)"then DoLookup will work.

@rclabo - Thanks for helping me debug this in Java.

This seems to be relevant https://issues.apache.org/jira/browse/LUCENE-6093

@Maxwellwr
Thanks for the info. I had a look at the LUCENE-6093 patch and it looks like a pretty straightforward fix. We aren't going out of our way to bring in changes from newer versions of Lucene, but if they affect usability, we are accepting PRs for patches from the community.
Here is the source to use if you need more context than the patch file: Lucene 4.10.4 suggest source code


Add support for Star Tree realtime segment generation.

Added support in IndexingConfig to specify StarTreeIndexSpec.
Added code that picks up star tree index spec from IndexingConfig
and passes it to segment generation.
Only enabled for LLC, as HLC will be phased out.
Added unit test for serialization/deserialization of star tree
spec using IndexingConfig.

Codecov Report

Merging #1339 into master will decrease coverage by 0.05%.
The diff coverage is 53.84%.

@@            Coverage Diff             @@
##           master    #1339      +/-   ##
==========================================
- Coverage   66.89%   66.84%   -0.06%
==========================================
  Files         781      781
  Lines       38117    38129      +12
  Branches     5004     5005       +1
==========================================
- Hits        25499    25486      -13
- Misses      10960    10978      +18
- Partials     1658     1665       +7

Impacted Files
Coverage Δ

...manager/realtime/HLRealtimeSegmentDataManager.java
77.34% <ø> (-2.21%)
:arrow_down:

.../linkedin/pinot/common/data/StarTreeIndexSpec.java
80% <ø> (ø)
:arrow_up:

...manager/realtime/LLRealtimeSegmentDataManager.java
68.83% <100%> (+0.06%)
:arrow_up:

...m/linkedin/pinot/common/config/IndexingConfig.java
68.96% <100%> (+1.69%)
:arrow_up:

.../pinot/core/realtime/impl/RealtimeSegmentImpl.java
70.49% <25%> (-0.61%)
:arrow_down:

...e/realtime/converter/RealtimeSegmentConverter.java
82.69% <40%> (-6.9%)
:arrow_down:

...pinot/core/operator/docidsets/OrBlockDocIdSet.java
87.67% <0%> (-10.96%)
:arrow_down:

...re/operator/docvalsets/UnSortedSingleValueSet.java
64.61% <0%> (-4.62%)
:arrow_down:

...time/converter/stats/RealtimeColumnStatistics.java
70.31% <0%> (-3.13%)
:arrow_down:

...ealtime/converter/RealtimeSegmentRecordReader.java
82.35% <0%> (-2.95%)
:arrow_down:

... and 15 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c25b2b9...b4d02ab. Read the comment docs.


[qwik-graphql-tailwind] Add JS Marathon/Drops to Courses

hey @kenslachtajr we already had the latest JS Marathon/Drops on courses:


remove moment locales which Coco does not use from webpack bundle

794kB -> 767kB

lol. finally i found that this pr breaks moment chinese locale since this cut the zh-HANS locale to zh but moment uses zh-cn 😂  that's why in recent year chinese time fallback to english time


HBASE-22742 [HBCK2] Add more log for hbck operations at master side

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

0
reexec
66
Docker mode activated.

_ Prechecks _

+1
dupname
0
No case conflicting files found.

+1
hbaseanti
0
Patch does not have any anti-patterns.

+1
@author
0
The patch does not contain any @author tags.

-0
test4tests
0
The patch doesn't appear to include any new or modified tests.  Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.

_ master Compile Tests _

+1
mvninstall
397
master passed

+1
compile
72
master passed

+1
checkstyle
93
master passed

+1
shadedjars
357
branch has no errors when building our shaded downstream artifacts.

+1
javadoc
44
master passed

0
spotbugs
314
Used deprecated FindBugs config; considering switching to SpotBugs.

+1
findbugs
311
master passed

_ Patch Compile Tests _

+1
mvninstall
376
the patch passed

+1
compile
69
the patch passed

+1
javac
69
the patch passed

+1
checkstyle
92
the patch passed

+1
whitespace
0
The patch has no whitespace issues.

+1
shadedjars
356
patch has no errors when building our shaded downstream artifacts.

+1
hadoopcheck
1137
Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.

+1
javadoc
44
the patch passed

+1
findbugs
322
the patch passed

_ Other Tests _

-1
unit
16576
hbase-server in the patch failed.

+1
asflicense
29
The patch does not generate ASF License warnings.

20807

Subsystem
Report/Notes

Docker
Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-412/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/412

Optional Tests
dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile

uname
Linux e4600925b8cd 4.4.0-154-generic #181-Ubuntu SMP Tue Jun 25 05:29:03 UTC 2019 x86_64 GNU/Linux

Build tool
maven

Personality
/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-412/out/precommit/personality/provided.sh

git revision
master / 747d000808

Default Java
1.8.0_181

unit
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-412/1/artifact/out/patch-unit-hbase-server.txt

Test Results
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-412/1/testReport/

Max. process+thread count
4857 (vs. ulimit of 10000)

modules
C: hbase-server U: hbase-server

Console output
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-412/1/console

versions
git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11

Powered by
Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

0
reexec
73
Docker mode activated.

_ Prechecks _

+1
dupname
0
No case conflicting files found.

+1
hbaseanti
0
Patch does not have any anti-patterns.

+1
@author
0
The patch does not contain any @author tags.

-0
test4tests
0
The patch doesn't appear to include any new or modified tests.  Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.

_ master Compile Tests _

+1
mvninstall
442
master passed

+1
compile
71
master passed

+1
checkstyle
95
master passed

+1
shadedjars
350
branch has no errors when building our shaded downstream artifacts.

+1
javadoc
47
master passed

0
spotbugs
317
Used deprecated FindBugs config; considering switching to SpotBugs.

+1
findbugs
314
master passed

_ Patch Compile Tests _

+1
mvninstall
373
the patch passed

+1
compile
69
the patch passed

+1
javac
69
the patch passed

+1
checkstyle
95
the patch passed

+1
whitespace
0
The patch has no whitespace issues.

+1
shadedjars
365
patch has no errors when building our shaded downstream artifacts.

+1
hadoopcheck
1195
Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.

+1
javadoc
43
the patch passed

+1
findbugs
306
the patch passed

_ Other Tests _

-1
unit
17093
hbase-server in the patch failed.

+1
asflicense
30
The patch does not generate ASF License warnings.

21415

Reason
Tests

Failed junit tests
hadoop.hbase.master.TestMasterShutdown

hadoop.hbase.client.TestSnapshotDFSTemporaryDirectory

hadoop.hbase.tool.TestSecureBulkLoadHFiles

Subsystem
Report/Notes

Docker
Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-412/2/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/412

Optional Tests
dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile

uname
Linux fb7b87a347a4 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux

Build tool
maven

Personality
/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-412/out/precommit/personality/provided.sh

git revision
master / fa77c75848

Default Java
1.8.0_181

unit
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-412/2/artifact/out/patch-unit-hbase-server.txt

Test Results
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-412/2/testReport/

Max. process+thread count
5185 (vs. ulimit of 10000)

modules
C: hbase-server U: hbase-server

Console output
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-412/2/console

versions
git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11

Powered by
Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.


Bundle a typing definition file for Typescript users.

It would be nice if this project bundled a typing definitions for Typescript users.  Right now, TS users either have to use this library without any type checking, or roll their own.
I've composed such a definition file and sent a PR out to the commonly used DefinitelyTyped project here.
react-native-contacts doesn't appear to be actively maintained, hence why I preferred that approach.  If this issue is approved by a maintainer, I'll work to add the typings here instead.

ok


MatMenu overlay position issue

Bug, feature request, or proposal:
Bug
What is the expected behavior?
MatMenu should use xPosition and yPosition, and overlap the trigger by default
What is the current behavior?
xPosition and yPosition are ignored, the overlay position is incorrect
What are the steps to reproduce?
https://stackblitz.com/edit/angular-ofiauh
What is the use-case or motivation for changing an existing behavior?

Which versions of Angular, Material, OS, TypeScript, browsers are affected?
angular 6.0.0.
Is there anything else we should know?
My issue is in a more complex environment, but the example I provided above is the simplest possible.

@isametal88 your example doesn't work, because you haven't included Material's structural styles which are required for the menu positioning. There's also a warning being logged from Material that these styles are missing. Here's a working fork of your example. The only change is adding the following to the style.css:
@import<EMAIL_ADDRESS>

Thank you so much for your quick response.
Yes, I was missing that part, my bad. Everything works properly now.
Thank you again.