streaming failed. [UDP] Multicast group join failed (setsockopt())

sender device info:

System: Windows 10
GPU:  GTX1070
CUDA: 11.1
ZED SDK: 3.4.2
OpenCV (yes)

receiver device info:

System: Ubuntu18.04
GPU: GTX750M
CUDA: 10.0
OpenCV (yes)

When I tried to run python streaming_sender.py, it shows

And, I ran ./ZED_Streaming_, it said:

sender device info:
1. System: Windows 10

2. GPU:  GTX1070

3. CUDA: 11.1

4. ZED SDK: 3.4.2

5. OpenCV (yes)

receiver device info:
1. System: Ubuntu18.04

2. GPU: GTX750M

3. CUDA: 10.0

4. OpenCV (yes)

When I tried to run python streaming_sender.py, it shows

And, I ran ./ZED_Streaming_, it said:
Opening the stream requires the IP of the sender Usage : ./ZED_Streaming_Receiver IP:[port] You can specify it now, then press ENTER, 'IP:[port]': <IP_ADDRESS>:30000 [ZED][Streaming] Error: Stream opening timeout [Sample][Error] Camera Open  | FAILURE : The function does not perform as expected. Exit program.

The IP adress you enter does not seem to be correct as it lloks like a multicast adress.
You need to enter the IP adress of the sender (the streaming is based on RTP unicast).
To get the IP of the sender, type ipconfig on your windows PC, and you should get a IPv4 adress under the form 192.168.X.X

The IP adress you enter does not seem to be correct as it lloks like a multicast adress.
You need to enter the IP adress of the sender (the streaming is based on RTP unicast).
To get the IP of the sender, type ipconfig on your windows PC, and you should get a IPv4 adress under the form 192.168.X.X

Oh, let me try it again. Thank you. And, there's a weird problem that happened to my PC. The ZED camera has no reaction (not working) toward the USB3.0 ports of the PC after I unplugged it from my PC to my Ubuntu laptop and replugged it back to the PC.

ipconfig

Hi, while I ran ipconfig, I got

Then, I ran ./ZED_Streaming_Receiver <IP_ADDRESS>: 30000 on Ubuntu, and it still gets [ZED][Streaming] Error: Stream opening timeout [Sample][Error] Camera Open | FAILURE : The function does not perform as expected. Exit program.

Can you try on the same ubuntu PC? ie :
./ZED_Streaming_sender
./ZED_Streaming_receiver localhost
to check first that it's working.
On windows, once an application communicates on the network, you must make sure that comms are authorized for the app (you should have a popup window that ask if you want this app to access the network).

Can you try on the same ubuntu PC? ie :
./ZED_Streaming_sender
./ZED_Streaming_receiver localhost
to check first that it's working.
On windows, once an application communicates on the network, you must make sure that comms are authorized for the app (you should have a popup window that ask if you want this app to access the network).

Thank you so much for the detailed explanation.
Unfortunately, it doesn't work.
When I ran the python scripts on PC (windows10), I got:

sender:

receiver:

When I ran the cpp scripts on PC (windows10), it ran successfully.

sender:

receiver:

I have a question think what the issue with the python scripts? How can I let it works?
Another question, how can I run the sender and plug the ZED on Ubuntu18 (the laptop), and run the receiver on the PC (windows10)? I plan to get a Jetson NX later and carry it outside to capture some data, connect the Jetson device and the laptops (windows 10 or Ubuntu18) through the Wifi hotspot provided by my phone.
The last question, if I place Jetson with ZED outdoor, is it possible for Jetson to send the data to my PC placed from home (theoretically say, the Jetson device and PC will use different internet and let Jetson send the data remotely)?
I'm an artist, so I'm not really familiar with programming. If you can help with these question, I appreciate a lot!


fs: Add mntent.h wrapper

I don't have a machine with Mac OS, so please someone check it.

Quick review: looks good.
Will review and test further.


Added support for referencing NuGet packages in C# scripts

This PR adds support for resolving NuGet packages in C# scripts
Example
#r "nuget:AutoMapper/6.0.0"

The feature is implemented by decorating the default MetadataReferenceResolver with a resolver that will know how to handle references to NuGet packages. The code for the NuGetMetadataReferenceResolver is currently maintained at this repo
https://github.com/seesharper/Dotnet.Script.NuGetMetadataResolver
The reason for keeping the NuGetMetadataReferenceResolver outside of this project is so that it can be used by other script runners such as https://github.com/filipw/dotnet-script

Thanks for the PR! My feedback is mostly nits to try and match the code style of the files you're changing. Also, the CI build is failing because IOmniSharpEnvironment.Path changed to IOmniSharpEnvironment.TargetDirectory.

Thanks for your feedback. I think I got them covered now :)

There is a related discussion in F# design repo: https://github.com/fsharp/fslang-design/issues/167
Currently the syntax F# is considering is:
#r "nuget: <package-name>, <package-version>"
It would be good if C# and F# used the same syntax.
To make this work for all nupkgs (specifically with CoreFX nupkgs) we'll need to be able to deal with both reference assemblies and implementation assemblies in the resolver. Also someone pointed out that batching the resolution (i.e. have an API that allows the compiler to resolve multiple #r's in one go) would be necessary to avoid perf issues with discovering dependencies.

It would be useful to write up some specification, how the resolver works. For example, does it check NuGet.config files for feeds, how is the lookup cached across script executions -- is there a script.assets.json file that csi /restore script.csx would create, etc.?

The challenge , revisited

Being able provide language services for scripts even if they provide no context in the form of a project.json/csproj file.

Being able to resolve references to NuGet packages in C# scripts.

So how do OmniSharp know if it should provide metadata for the full framework or .Net Core?
The PR uses information from the host process (OmniSharp) to determine if we are running .Net Core or the full framework. This is probably not good enough as @filipw pointed out as OmniSharp can provide language services for both runtimes regardless of the runtime that OmniSharp itself runs in.
So how can we provide OmniSharp with enough information about script target runtime?
What if we did something similar to SheBang on nix systems?
#!/bin/sh

we could do
#r "runtime:NetCoreApp1.1"

In my head, it sort of makes sense that we "reference" the runtime.
If we find multiple csx files with different "runtimes" we would have to handle this somehow though.

So how do OmniSharp know if it should provide metadata for the full framework or .Net Core?

I think for the sake of baby steps and incremental progress we could consider for now that for no known runtime context (such as CSI scripts) we just assume latest desktop FX, but maybe I'm being overly simplistic.
The natural next step would then be to graduate the discussion to how the CSX could manifest it's runtime environment.
I fear that if we dive into this now we will never get anything out as the scope would just be too large; not to mention such discussion really belongs in the Roslyn repo as that's the codebase that will drive this, and OmniSharp would merely consume it.

@seesharper Great write up. Could you add it to the readme.md of https://github.com/seesharper/Dotnet.Script.NuGetMetadataResolver?
Re the resolver implementation: One thing I'm worried about is specifying all transitive dependencies explicitly. That's not very script-friendly. Note that #r "assembly.dll" currently automatically references all transitive dependencies. So it would be odd if #r "nuget" didn't do that. Also inconvenient for the user, especially in the REPL. I'd prefer if the resolver found all dependencies and stored them in a .json file next to the script. If such file already exists it would just use it and skip the dependency resolution unless #r nuget directives in the script changed.
Re runtime: We already have support for #! -- it's just a comment for the compiler. But I imagine we can come up with some convention for specifying the host environment. I don't think we should be specifying runtime (Core CLR vs Desktop CLR) though but rather the target API set. For this purpose using #r on a (NETStandard.Library)[https://www.nuget.org/packages/NETStandard.Library/]" meta-package seems most fitting.
For example,
#r "nuget:NETStandard.Library, 1.6.1"
I think there are two categories of scripts:

csi runnable scripts
These are universal scripts that might use host variables and default imports defined by csi (such as Args) but require no other host-specific types/variables/imports.

custom host scripts
These are host-specific scripts that assume an environment created by some application that runs them. This is where we could use #!. Perhaps we could develop some convention that allows the app author to specify what the script environment looks like statically, to enable editors to provide intellisense.

Before discussing further I would just like to show you what kind of script developer happiness I'm aiming
for here. No project file or any other files besides the actual script file.

I am not giving up on this yet :)
I have created a new version of DotNet.Script.NuGetMetadataResolver that takes a new approach to resolving NuGet packages. Updated readme at https://github.com/seesharper/Dotnet.Script.NuGetMetadataResolver
Question is, should I abandon this PR and start a new PR based on the latest sources?

@tmat @DustinCampbell Could you take another look at this in the light of the changes I've made to
https://github.com/seesharper/Dotnet.Script.NuGetMetadataResolver and the simplified ScriptProjectSystem?

@tmat @DustinCampbell @filipw What do you say, guys. Is this happening or not?

Also looks like the branch needs to be updated with the latest changes.

Got it. I'll bring it up date and fix the issues you mentioned 👍

@david-driscoll @DustinCampbell PR is now up to date and hopefully most of the requested changes has been resolved

I have spent many hours on this PR and I think that I would be entitled to a response that either accepts or rejects this PR. Don't leave me hanging, guys

@seesharper sorry for the delay! 😇
Overall I think this is a very valuable addition, and because:

it's implemented as a resolver which is pluggable into any script host 👍
syntax-wise it aligns with future CSI functionality

there should be no issue having it in OmniSharp.
In fact, especially in the CSX area, OmniSharp has been really spearheading how the language tooling should behave, so I think it would be great to have this too.
That said, I have the following concerns:

it brings in a dependency on a 3rd party package. In the past we have had some unfortunate experience with depending on scriptcs binaries for script preprocessing so I am a bit worried what happens if we have issues on this functionality? Then we can't even fix it straight up, we will have to wait for you to release a new package
a feature like this should be possible to be toggled from the omnisharp.json similarly to how you can switch on/off the package restore here https://github.com/OmniSharp/omnisharp-roslyn/blob/cdd99aef194660835e61c58f19fb51ab3dabc52e/src/OmniSharp/config.json#L5
how are the errors reported? is everything sent into the OmniSharp log? what happens if nuget is not in my PATH (for example, at the moment it's not there on neither my OS X or my Windows). Shouldn't we ship nuget.exe with OmniSharp to facilitate this? or at least have an option to provide a path to it

Thanks for your response, @filipw 👍
I do share your concerns and I would be happy to hand over the code currently resided in DotNet.Script.NuGEtMetadataReferenceResolver.  The whole reason I made it a separate package was that script runners can use the exact same code when actually executing scripts.  Question is where this project should live? We could put it here. No problem for me.
If an error  occurs, the exception is logged and we fall back to the the way it used to work.
There is also logging going on inside the library, but because of the "OmniSharp" filter in the logger, this does not make it out to the console.
Shipping NuGet.Exe is probably not a bad idea since we then also can have a certain control of the actual NuGet version. Alternatively we could just document that we need Nuget >= "some version" and that it has to be in your path.
Feature toggling sounds great. Then we can ship this as an opt-in feature.
Now that I think about it, for version "1", we create a feature toggle and document minimum NuGet version and the "in you path" requirement

@seesharper I think we should built DotNet.Script.NuGetMetadataReferenceResolver into Roslyn at some point. Not sure when that would be at this moment, but I think that's the right place for this functionality long term.

@tmat I agree. Would that be a separate PR then? I just want to get the wheels moving on this one.

@seesharper Yes, that would be completely separate PR. We will need to do some design work in Roslyn in order to prepare for this change.

@filipw @DustinCampbell thoughts?  Should we perhaps use a source copy of DotNet.Script.NuGEtMetadataReferenceResolver to allow us to control it, or go with the package approach for now?

I think let's do the following - this feature should be updated to be opt in (as discussed earlier today), and can stay as external dependency for now.
if there are issues and we need flexibility in addressing them, we will pull it in (it's just a couple of classes)

What if we did this?
Put the code from DotNet.Script.MetadataReferenceResolver into a new project in the roslyn solution.
We can name this OmniSharp.Script.Nuget and publish a package from this project.
In this package we can also ship nuget.exe so that we can control the nuget version used,

I don't think using nuget.exe is a good idea. Do we need nuget.exe? Are there not nuget libraries providing APIs we can use?

I don't think using nuget.exe is a good idea. Do we need nuget.exe? Are there no nuget libraries providing APIs we can use?

We shouldn't do this. How would it run cross-platform if Mono isn't present?
There are definitely NuGet packages we can use.

The reason for depending on NuGet.exe is that the resolver was intended to be a NetStandard library so that it also can be used from .Net Core script runners. The https://www.nuget.org/packages/NuGet.PackageManagement package is only available for desktop and the only real option for creating the project.lock.json file we need for resolving metadata references is to feed the generated project.json to NuGet.exe. NuGet.exe still understands project.json as opposed to the DotNet cli that requires an old preview sdk to handle project.json.
"How would it run cross-platform if Mono isn't present?"
Will Omnisharp even run on *nix platform without Mono? I know there is an option to run OmniSharp as a .Net Core app, but I got the impression that this is something OmniSharp will move away from.

I know there is an option to run OmniSharp as a .Net Core app, but I got the impression that this is something OmniSharp will move away from.

Yes, that's the true. However, it's still a little weird that we would use nuget.exe. If you don't want to use the NuGet API, why not just shell out to "dotnet nuget" and require that users have the .NET CLI installed? That way, they could get a different version simply by have a global.json in their directory try. Note that there's a DotNetCliService in OmniSharp that this functionality could be added to.

:+1: on generic NuGet support via DotNetCliService. It might be useful once Cake support is added in order to dowload addins/tools cia NuGet...

@DustinCampbell

Yes, that's the true. However, it's still a little weird that we would use nuget.exe. If you don't want to use the NuGet API, why not just shell out to "dotnet nuget" and require that users have the .NET CLI installed? That way, they could get a different version simply by have a global.json in their directory try. Note that there's a DotNetCliService in OmniSharp that this functionality could be added to.

It is not that I don't want to use the NuGet API, it is just that it is not possible to create a resolver that will work with .Net Core script runners since we cannot make it a NetStandard library. Relying on "dotnet restore" is IMHO a more fragile solution as the user would need another file (global.json) to make this work unless the current sdk is the latest preview that actually supported project.json. NuGet.CommandLine is a single package containing a single file (NuGet.Exe) and is from what I can understand more maintainable than requiring an old sdk preview . We can ship this thing with whatever version of NuGet.CommandLine we desire and have full control of the version. It will require Mono on *nix platforms, but that is already a requirement to make OmniSharp work? Or at least it will be in the future if OmniSharp is moving away from a .Net Core host

since we cannot make it a NetStandard library

I'm not understanding this bit. Could you explain?

Relying on "dotnet restore" is IMHO a more fragile solution as the user would need another file (global.json) to make this work unless the current sdk is the latest preview that actually supported project.json

Ah yes, I'd forgotten that we're still using project.json for our scripting solution. @filipw, what's the lifetime of that? What would it take to move on?

This package https://www.nuget.org/packages/NuGet.PackageManagement which we would need to restore packages is a desktop only library and quite frankly I think the code would be more complex as the NuGet API is rather fine grained and the chance for doing something wrong is certainly possible. NuGet 4.0 (the one that ships with vs 2017) continues support for project.json and they have even improved the performance for project.json based projects.

"nuget update for UWP, WPF and other project.json based projects is now much faster. In our sample solution with 20 UWP projects, updating packages is 6 times faster than before. For packages.config based projects, nuget update is now about 20% faster."

Even if they decide to discontinue support for project.json some time in the future we can still ship a stable NuGet.CommandLine that support project.json.
What about csproj. Could we do csproj instead of project.json?
The problem here is that there is no easy way to get a list of metadata references like we do with project.json based projects.

I'm not sure I get why NuGet.PackageManagement being desktop-only is a problem. Note that we use the NuGet API  already within OmniSharp and we'll be using it more.

Also, I'm not sure we want to continue supporting project.json forever. I thought that was just a stop-gap until we had something better. @filipw?

It is not a problem if you only look at it in the perspective of OmniSharp. But on the execution side (script runners), I wanted this to be available as a NetStandard library. DotNet.Script for instance is a .net core script runner that could take advantage of this.

Could a .NET Script runner work if that script is .NET Framework? The changes here will always assume .NET Framework at design-time in VS Code. I get the sense that were mixing a bunch of runtime semantics here that might ultimately cause a ton of problems.

Absolutely, .net core is not a requirement, it's an opt-in option

If NuGet APIs are not available as a netstandard library we should follow up with NuGet team to fix that - would you mind filing an issue on https://github.com/NuGet/NuGet.Client to raise awareness about the issue?
BTW, not having good NuGet APIs was the main reason why we didn't ship nuget support with the first version of scripting. Since then our team haven't had the necessary resources to follow up on it. My hope is we can get back on it soon(ish) and work with NuGet team on APIs that we need for scripting.

@tmat Maybe we can get away with using https://www.nuget.org/packages/NuGet.Commands/4.0.0 which is NetStandard1.3, but the problem is that the NuGet API documentation is very scarce and I believe that trying to figure out how to put the various pieces together just to do a simple restore, is way more error prone than simply shell out to NuGet.exe which has all the batteries included. At least we should start there and move into using the API directly when proper documentation becomes available.

The NuGet v3 Client and NuGetGallery APIs are constantly evolving and we are working on having a stable surface area that we can document soon.

I really just want the get the ball rolling on this one and create an awesome scripting experience.
If we opt-in, we should not be stepping on anybody's toes either :)

Also, I'm not sure we want to continue supporting project.json forever. I thought that was just a stop-gap until we had something better. @filipw?

Let me explain the background/context a little bit.
OmniSharp supports two scripting modes: desktop-CLR CSX files and .NET Core CSX files. The 1st one is the primary use case and affects the vast majority of users.
In the desktop-CLR mode, CSI scripting and all of its features are supported straight up, as that's the default Roslyn scripting. This is the key functionality we want to have in OmniSharp. However, CSI is desktop CLR only. In fact it's not just CSI - the same applied to other alternative script runners like scriptcs and others, which are also desktop only. In other words, no one offered .NET Core-based C# scripting.
As a measure to fill that gap, I created a https://github.com/filipw/dotnet-script which plugs into .NET CLI and supports 1:1 the syntax of standard-CSI based scripting (no scriptcs or Cake-like customizations), and let's the users use .NET Core runtime for executing C# scripts. The extra thing - beyond the CSI standards - that this project does, it allows you to supply dependencies via project.json (similarly to the scripting experience offered by Azure Functions).
Since this is the only command line runner out there that supports .NET Core CSX, we also support it in OmniSharp at the moment, because syntax-wise it matches perfectly with CSI, it's just the runtime that's different. (Note that I will happily retire the whole project once https://github.com/dotnet/roslyn/issues/17666 is implemented and CSI can be used for .NET Core scripts). Ultimately, this is why we have the project.json bits in OmniSharp for CSX - they have nothing to do with CSI (which is our primary use case) but they just support your ability to do something with .NET Core scripting via the only .NET Core script runner out there. The fact that this solution uses project.json is not so much for "legacy" reasons, but rather because no one has ever defined how an external dependency specification should look like for CSX files. And since Azure Functions is the only product that offered such a feature, and it already exposed dependencies as project.json (and it still does - never moved to csproj), the .NET Core runner simply mimicked that.
Now to the point of @seesharper solution discussed here - it's implemented as a MetadataReferenceResolver which is the proper Roslyn extensibility point for this. It means it can be plugged in into a script runner (like CSI, or the aforementioned dotnet-script or Azure Functions or anything else), but it can also plugged into a tooling provider like OmniSharp, and guarantee uniform experience for dependency resolution both at runtime and design time. As such, I personally don't think it shouldn't take dependencies on anything from inside OmniSharp (like DotNetCliService) because that would break the symmetry between the tooling and the runtime.
While this feature will ultimately come into CSI, at the moment, the only realistic use case for the whole functionality in the immediate future is the .NET Core runner where I could just plug it in and let people experience something they will in the future in CSI. Because of that, it's a very much a niche scenario and personally - since this is a very much beta feature anyway, and only affecting users on .NET Core - I am fine with tying it to nuget.exe for now.

How would I go about creating a feature toggle for this?
Does it go into config.json?
How do I access this config inside the ScriptProjectSystem class?
What should be the name of the setting? EnableScriptNuGetReferences (default false)

OmniSharp already supports project system specific configuration, as long as it was added under the key matching the project system key (in this case Script). config.json is the "parent" of omnisharp.json and all the defaults go there, so yeah the false default should go in there and then users can override it via their omnisharp.json
It's passed in here https://github.com/OmniSharp/omnisharp-roslyn/blob/dev/src/OmniSharp.Script/ScriptProjectSystem.cs#L47 and can be read from there. See corresponding examples in MsBuild (https://github.com/OmniSharp/omnisharp-roslyn/blob/v1.17.0/src/OmniSharp.MSBuild/MSBuildProjectSystem.cs#L75) and .NET CLI (https://github.com/OmniSharp/omnisharp-roslyn/blob/v1.17.0/src/OmniSharp.DotNet/DotNetProjectSystem.cs#L105-L121).

@filipw @DustinCampbell @david-driscoll
Could you please review the latest changes.
I have added an option in config.json that makes all this opt-in.
The requested changes were a little outdated, but I think I've addressed most of them.
{
    "dotnet": {
        "alias": "default",
        "projects": "**/project.json",
        "enablePackageRestore": true,
        "packageRestoreTimeout": "180"
    },
    "formattingOptions": {
        "newLine": "\n",
        "useTabs": false,
        "tabSize": 4,
        "indentationSize": 4
    },
    "script": {
        "enableScriptNuGetReferences" : false
    }
}

FYI: Just tested this on a Mac and it works equally well there.

@seesharper thanks - looks got to me. There are still some small things @DustinCampbell pointed out but after that, as far as I'm concerned, we could take this in as an experimental scripting feature 👍
@DustinCampbell @david-driscoll what do you guys think?

actually one more thing - looks like the configuration is not being consumed at the moment. Did you forget a push?

@filipw @DustinCampbell @david-driscoll
The configuration is being consumed here
https://github.com/OmniSharp/omnisharp-roslyn/pull/813/files#diff-ed5a3c116a19423c18b1e630f80455b9R77
I have also updated to the latest version of Dotnet.Script.NuGetMetadataResolver (2.0.3) and this PR should be able to be merged.

I meant that NuGetMetadataReferenceResolver shouldn't be used at all if the setting is false

Ah, I see. The ScriptHelper class is a static class. Is there any way that I can access the configuration from within the ScriptHelper class?

@filipw Probably need to make the ScriptHelper class an instance class in order to pass in "IConfiguration" ?

that's OK - it could be a singleton similar to i.e. https://github.com/OmniSharp/omnisharp-roslyn/blob/dev/src/OmniSharp.Roslyn/MetadataHelper.cs#L32 + https://github.com/OmniSharp/omnisharp-roslyn/blob/89fa23cc1d3572795dceb612be7b1784630d7a8a/src/OmniSharp.Host/Startup.cs#L97

@filipw Now the NuGetMetadataResolver is only used when the "enableScriptNuGetReferences" option is "true"

@filipw @DustinCampbell @david-driscoll
Would appreciate you taking the time to review the (hopefully) final changes.

@filipw @DustinCampbell @david-driscoll
Is this happening, guys? It's getting a little tedious to constantly have to keep this branch up-to-date.

Thanks @DustinCampbell . Build passing. @david-driscoll , @filipw . Are we merging this now?

The merge button is unavailable until @david-driscoll approves

@david-driscoll Would really appreciate your final approval on this PR

Sorry missed the final approvals here... LGTM

Thanks a lot, @david-driscoll. Appreciate it 👍

This is great! Is there an issue anywhere tracking the addition of this to csi.exe?


feature request: rt-style

In Vue.js single file components have a <style> tag where you can write good old fashioned CSS which is scoped to the current component. Read more here.
Considering react-templates is clearly in favour of HTML vs JSX, why not go a step further and bring CSS into the game?
Why not create a new tag <rt-style> which can include CSS scoped to the current .rt file?
Is there any interest in such feature? Would it be accepted in the repo?

I proposed this in #137 where I discuss also a possible implementation.
I already have this working in a react-templates extension that I'm writing (called rioct but still in alpha stage), and I use the generated styles in production.
My experience is that pure CSS styles are better than react's inline styles, they are more powerful (@media etc) and more intuitive. And they make more sense in a templating language like react-templates.
Regarding your proposal:

I would prefer to <style> instead of <rt-style> because most HTML editor will recognize it and enable syntax colorization as well as intellisense

Why not create a new tag  which can include CSS scoped to the current .rt file?

with the term "scoped", do you mean it should create scoped styles (as in <style scoped></style>) ?
Scoped styles are rather problematic, they are not supported by all browsers, and, as far as I know create problems with event bubbling.

Awesome @nippur72 I'm closing this one then and continue there.

@PierBover are you still interested in the feature?
If you use webpack, support for a <style> tag can be easily added via react-style-tag and some hacking with react-templates-preprocess-loader.

I was interested but now I have realised that instead of adding packages and hacks to be able to work the way I want (no JSX, real HTML, encapsulated CSS, etc) it would make a lot more sense to simply drop React.
My current project is still small enough that a rewrite of the view code can be accomplished.
Honestly, I jumped into React for the hype, and I have realised there isn't really any real benefit in using it. There are many libraries out there that render many times faster and are much much lighter (like Inferno or PReact), and the API design makes more sense IMO.
I have found Aurelia.js to be the perfect replacement for our team. It's lighter than React, with a similar performance, and much more smart and elegant API. No need to implement react-templates for working HTML, some other thing to work with CSS, no need to implement MobX to get rid of the terrible setState(), etc.


Fix templates

With current templates helm template produces incorrect manifest, like so:
---kind: ConfigMap
apiVersion: v1

Also, limit is invalid field

#25 covered these items, so I'm going to close this PR. Thank you again


getPromptTokens() not fetching number of tokens used in the prompt

Bug description
I am using the chat client as below. This includes both user message and a system message.
response = chatClient.call(                     new Prompt(                             List.of(userMessage, systemMessage),                             OpenAiChatOptions.builder()                                     .withModel(openAiDto.getModel())                                     .withTemperature(openAiDto.getTemperature())                                     .withMaxTokens(1024)                                     .withSeed(42)                                     .build()                     ));
Now while trying to get the tokens used in the prompt, it is always returning 0. But when only single prompt(userMessage) is being used, it is giving correct response. Only when I am using both(userMessage, systemMessage), I am not getting anything other than 0.
response.getMetadata().getUsage().getPromptTokens()
Environment
Spring AI version 0.8.0. I am using Ollama (0.1.27) as the model server and using its OpenAI compatible endpoint.
Steps to reproduce
When I am using UserMessage, SystemPromptTemplate and System message, the issue is occurring.
Expected behavior
It should return the correct number of tokens used in the prompt.

Hi, I already fixed the Issue How I can push it


Zotero reference library removal and table update

Removed Zotero reference library and added pubmed version. In addition added tables in Rmarkdown format.

This has resolved issue #41


ROCm 6.0

Hi there!
Thanks for Omnitrace, it's a really nice tool.
Any plan for supporting ROcm 6.0 ? Is it as simple as adding it to your cpack action matrix or do we need more?
Thanks!
(@maartenarnst will be interested)

Hi @jrmadsen.
Just wanted to follow up on this issue and ask if you should already have had a chance to look at the 6.0 update?
On our side, we have tried to compile omnitrace with room 6.0 along the lines of what you do in your ci. We used ubuntu 22.04.
We ran into two difficulties.
The first difficulty concerns

https://github.com/AMDResearch/omnitrace/blob/518c83e0f937c2545236d1f9305e60fb3def4851/source/lib/core/gpu.cpp#L251

It seems the property gcnArch is no longer defined in ROCm 6.0. On our side, as a workaround, we commented out the line.
The second difficulty is that we get a bunch of errors like
In file included from /opt/rocm-6.0.0/include/hip/hip_runtime_api.h:8642,
                 from /opt/rocm-6.0.0/include/hip/hip_runtime.h:70,
                 from /opt/rocm-6.0.0/include/roctracer/roctracer_hip.h:26,
                 from /home/omnitrace-source/Develop/HELM/omnitrace-source/source/lib/omnitrace/library/roctracer.cpp:50:
/opt/rocm-6.0.0/include/hip/amd_detail/hip_prof_str.h: In function â const char* hipApiString(hip_api_id_t, const hip_api_data_t*)â :
/opt/rocm-6.0.0/include/hip/amd_detail/hip_prof_str.h:7171:33: error: â roctracerâ ahas not been declared
 7171 |       else { oss << "gridDim="; roctracer::hip_support::detail::operator<<(oss, data->args.__hipPopCallConfiguration.gridDim__val); }

It seems it's related to when hip_ostream_ops.h gets included. But I'm not sure what changed going from 5.7 to 6.0. As a workaround, I added #include "hip_ostream_ops.h" before #include <hip/amd_detail/hip_prof_str.h> at the end of the file hip_runtime_api.h. I guess that's for sure not a good workaround.
With these two works, we do get to the .sh file.

Hi @maartenarnst, I wasn’t aware of the first issue but I was aware of the second and fixed it in https://github.com/AMDResearch/omnitrace/pull/317. Unfortunately, right now the CI is failing because of some issues with the machines running the CI having issues with our MPI tests. @benrichard-amd is working on fixing that now. Once he’s completed this, we will be able to proceed. Having a new release with ROCm 6.0 seems feasible by the middle of next week.

OK, thanks for the update. Looking forward to it :)


U-Boot needs more than 35 seconds to load the kernel image

Description
U-Boot needs more than 35 seconds to load the kernel image.
My first test was on a Pi Zero W, which takes a similar amount of time with the same SD card.
Steps to reproduce the issue:

Build master tree
#MACHINE ??= "raspberrypi0-wifi"
MACHINE ??= "raspberrypi3"
ENABLE_UART = "1"
RPI_USE_U_BOOT = "1"

Describe the results you received:
Boot takes very long: 6954192 bytes read in 36838 ms (183.6 KiB/s)
Describe the results you expected:
Faster boot time.
Additional information you deem important (e.g. issue happens only occasionally):
U-Boot 2021.07 (Jul 05 2021 - 15:11:28 +0000)

DRAM:  948 MiB
RPI 3 Model B (0xa02082)
MMC:   sdhci_setup_cfg: Hardware doesn't specify base clock frequency
sdhci_setup_cfg: Hardware doesn't specify base clock frequency
sdhci@7e300000 - probe failed: -22
mmc@7e202000: 0sdhci_setup_cfg: Hardware doesn't specify base clock frequency

Loading Environment from FAT... Unable to read "uboot.env" from mmc0:1... In:    serial
Out:   vidconsole
Err:   vidconsole
Net:   No ethernet found.
starting USB...
Bus usb@7e980000: USB DWC2
scanning bus usb@7e980000 for devices... 3 USB Device(s) found
       scanning usb for storage devices... 0 Storage Device(s) found
Hit any key to stop autoboot:  0
switch to partitions #0, OK
mmc0 is current device
Scanning mmc 0:1...
Found U-Boot script /boot.scr
263 bytes read in 15 ms (16.6 KiB/s)
## Executing script at 02400000
6954192 bytes read in 36838 ms (183.6 KiB/s)
Saving Environment to FAT... OK
## Booting kernel from Legacy Image at 00080000 ...
   Image Name:   Linux-5.10.63-v7
   Image Type:   ARM Linux Kernel Image (uncompressed)
   Data Size:    6954128 Bytes = 6.6 MiB
   Load Address: 00008000
   Entry Point:  00008000
   Verifying Checksum ... OK
## Flattened Device Tree blob at 2eff8900
   Booting using the fdt blob at 0x2eff8900
   Loading Kernel Image
   Using Device Tree in place at 2eff8900, end 2f002fd5

Starting kernel ...

[    0.000000] Booting Linux on physical CPU 0x0
[    0.000000] Linux version 5.10.63-v7 (oe-user@oe-host) (arm-poky-linux-gnueabi-gcc (GCC) 11.2.0, GNU ld (GNU Binutils) 2.37.20210721) #1 SMP Thu Sep 16 20:32:19 UTC 2021
[    0.000000] CPU: ARMv7 Processor [410fd034] revision 4 (ARMv7), cr=10c5383d
[    0.000000] CPU: div instructions available: patching division code
[    0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing instruction cache
[    0.000000] OF: fdt: Machine model: Raspberry Pi 3 Model B Rev 1.2
[    0.000000] random: fast init done
[    0.000000] Memory policy: Data cache writealloc
[    0.000000] Reserved memory: created CMA memory pool at 0x1ec00000, size 256 MiB
[    0.000000] OF: reserved mem: initialized node linux,cma, compatible id shared-dma-pool
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000000000-0x000000003b3fffff]
[    0.000000]   Normal   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000000000-0x000000003b3fffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x000000003b3fffff]
[    0.000000] percpu: Embedded 20 pages/cpu s51340 r8192 d22388 u81920
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 240555
[    0.000000] Kernel command line: coherent_pool=1M 8250.nr_uarts=1 snd_bcm2835.enable_compat_alsa=0 snd_bcm2835.enable_hdmi=1 video=Composite-1:720x480@60i,margin_left=32,margin_right=32,margin_top=32,margin_bottom=32 vc_mem.mem_base=0x3ec00000 vc_mem.mem_size=0x40000000  dwc_otg.lpm_enable=0 console=ttyS0,115200 root=/dev/mmcblk0p2 rootfstype=ext4 rootwait
[    0.000000] Dentry cache hash table entries: 131072 (order: 7, 524288 bytes, linear)
[    0.000000] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] Memory: 679700K/970752K available (11264K kernel code, 1344K rwdata, 3304K rodata, 1024K init, 890K bss, 28908K reserved, 262144K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.000000] ftrace: allocating 34318 entries in 68 pages
[    0.000000] ftrace: allocated 68 pages with 2 groups
[    0.000000] rcu: Hierarchical RCU implementation.
[    0.000000]  Rude variant of Tasks RCU enabled.
[    0.000000]  Tracing variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 10 jiffies.
[    0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
[    0.000000] random: get_random_bytes called from start_kernel+0x3b0/0x598 with crng_init=1
[    0.000000] arch_timer: cp15 timer(s) running at 19.20MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x46d987e47, max_idle_ns:<PHONE_NUMBER>67 ns
[    0.000007] sched_clock: 56 bits at 19MHz, resolution 52ns, wraps every<PHONE_NUMBER>078ns
[    0.000023] Switching to timer-based delay loop, resolution 52ns
[    0.000300] Console: colour dummy device 80x30
[    0.000364] Calibrating delay loop (skipped), value calculated using timer frequency.. 38.40 BogoMIPS (lpj=192000)
[    0.000398] pid_max: default: 32768 minimum: 301
[    0.000599] LSM: Security Framework initializing
[    0.000843] Mount-cache hash table entries: 2048 (order: 1, 8192 bytes, linear)
[    0.000872] Mountpoint-cache hash table entries: 2048 (order: 1, 8192 bytes, linear)
[    0.002297] cgroup: Disabling memory control group subsystem
[    0.002571] CPU: Testing write buffer coherency: ok
[    0.003061] CPU0: thread -1, cpu 0, socket 0, mpidr 80000000
[    0.004299] Setting up static identity map for 0x100000 - 0x100060
[    0.004492] rcu: Hierarchical SRCU implementation.
[    0.005427] smp: Bringing up secondary CPUs ...
[    0.006573] CPU1: thread -1, cpu 1, socket 0, mpidr 80000001
[    0.008276] CPU2: thread -1, cpu 2, socket 0, mpidr 80000002
[    0.009874] CPU3: thread -1, cpu 3, socket 0, mpidr 80000003
[    0.010493] smp: Brought up 1 node, 4 CPUs
[    0.010515] SMP: Total of 4 processors activated (153.60 BogoMIPS).
[    0.010532] CPU: All CPU(s) started in HYP mode.
[    0.010547] CPU: Virtualization extensions available.
[    0.011508] devtmpfs: initialized
[    0.028510] VFP support v0.3: implementor 41 architecture 3 part 40 variant 3 rev 4
[    0.028946] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns:<PHONE_NUMBER>2750000 ns
[    0.028982] futex hash table entries: 1024 (order: 4, 65536 bytes, linear)
[    0.040361] pinctrl core: initialized pinctrl subsystem
[    0.041538] NET: Registered protocol family 16
[    0.045070] DMA: preallocated 1024 KiB pool for atomic coherent allocations
[    0.051132] audit: initializing netlink subsys (disabled)
[    0.052070] thermal_sys: Registered thermal governor 'step_wise'
[    0.052461] audit: type=2000 audit(0.050:1): state=initialized audit_enabled=0 res=1
[    0.052652] hw-breakpoint: found 5 (+1 reserved) breakpoint and 4 watchpoint registers.
[    0.052671] hw-breakpoint: maximum watchpoint size is 8 bytes.
[    0.052937] Serial: AMBA PL011 UART driver
[    0.072893] bcm2835-mbox 3f00b880.mailbox: mailbox enabled
[    0.090141] raspberrypi-firmware soc:firmware: Attached to firmware from 2021-09-14T16:52:56, variant start
[    0.100151] raspberrypi-firmware soc:firmware: Firmware hash is 1f74fc33fa785915fe0d7bd6d1cdfa220bc1ed7b
[    0.145309] Kprobes globally optimized
[    0.150444] bcm2835-dma 3f007000.dma: DMA legacy API manager, dmachans=0x1
[    0.152755] SCSI subsystem initialized
[    0.153040] usbcore: registered new interface driver usbfs
[    0.153112] usbcore: registered new interface driver hub
[    0.153201] usbcore: registered new device driver usb
[    0.153640] Advanced Linux Sound Architecture Driver Initialized.
[    0.154875] clocksource: Switched to clocksource arch_sys_counter
[    1.793778] VFS: Disk quotas dquot_6.6.0
[    1.793909] VFS: Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
[    1.794118] FS-Cache: Loaded
[    1.794395] CacheFiles: Loaded
[    1.794610] simple-framebuffer 3eaf0000.framebuffer: framebuffer at 0x3eaf0000, 0x10a800 bytes, mapped to 0x(ptrval)
[    1.794636] simple-framebuffer 3eaf0000.framebuffer: format=a8r8g8b8, mode=656x416x32, linelength=2624
[    1.799749] Console: switching to colour frame buffer device 82x26
[    1.803872] simple-framebuffer 3eaf0000.framebuffer: fb0: simplefb registered!
[    1.804356] sysfs: cannot create duplicate filename '/devices/platform/3eaf0000.framebuffer'
[    1.804381] CPU: 2 PID: 1 Comm: swapper/0 Not tainted 5.10.63-v7 #1
[    1.804392] Hardware name: BCM2835
[    1.804402] Backtrace:
[    1.804435] [<80afd578>] (dump_backtrace) from [<80afd8e8>] (show_stack+0x20/0x24)
[    1.804453]  r7:ffffffff r6:00000000 r5:60000013 r4:811e79dc
[    1.804473] [<80afd8c8>] (show_stack) from [<80b02510>] (dump_stack+0xc4/0xf0)
[    1.804496] [<80b0244c>] (dump_stack) from [<80404a90>] (sysfs_warn_dup+0x68/0x74)
[    1.804515]  r9:81054850 r8:811f1044 r7:00000000 r6:816b5b40 r5:81607840 r4:81760000
[    1.804536] [<80404a28>] (sysfs_warn_dup) from [<80404be8>] (sysfs_create_dir_ns+0xf8/0x10c)
[    1.804552]  r7:00000000 r6:81607840 r5:ffffffef r4:816f5010
[    1.804573] [<80404af0>] (sysfs_create_dir_ns) from [<80684428>] (kobject_add_internal+0xb8/0x370)
[    1.804588]  r6:811f13b0 r5:816f5010 r4:816f5010
[    1.804606] [<80684370>] (kobject_add_internal) from [<80684c60>] (kobject_add+0x64/0xcc)
[    1.804625]  r9:81054850 r8:bab13754 r7:00000000 r6:811f13b0 r5:816f5010 r4:00000000
[    1.804645] [<80684bfc>] (kobject_add) from [<807af390>] (device_add+0x108/0x7ac)
[    1.804658]  r3:00000000 r2:00000000
[    1.804671]  r6:811f13b0 r5:00000000 r4:816f5010
[    1.804693] [<807af288>] (device_add) from [<80901400>] (of_device_add+0x44/0x4c)
[    1.804711]  r10:81251000 r9:81054850 r8:bab13754 r7:00000000 r6:00000000 r5:00000000
[    1.804722]  r4:816f5000
[    1.804744] [<809013bc>] (of_device_add) from [<80901af0>] (of_platform_device_create_pdata+0xa4/0xd4)
[    1.804767] [<80901a4c>] (of_platform_device_create_pdata) from [<80901b40>] (of_platform_device_create+0x20/0x24)
[    1.804786]  r9:81054850 r8:0000014f r7:812fc6f4 r6:80e7bdb8 r5:00000000 r4:bab13704
[    1.804809] [<80901b20>] (of_platform_device_create) from [<81026f18>] (simplefb_init+0x7c/0x98)
[    1.804830] [<81026e9c>] (simplefb_init) from [<801022f0>] (do_one_initcall+0x50/0x280)
[    1.804846]  r7:00000000 r6:00000006 r5:8140f800 r4:81026e9c
[    1.804865] [<801022a0>] (do_one_initcall) from [<810013b4>] (kernel_init_freeable+0x2ac/0x30c)
[    1.804881]  r7:81054830 r6:00000006 r5:8140f800 r4:8108a858
[    1.804900] [<81001108>] (kernel_init_freeable) from [<80b0694c>] (kernel_init+0x18/0x134)
[    1.804918]  r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:80b06934
[    1.804929]  r4:00000000
[    1.804946] [<80b06934>] (kernel_init) from [<8010010c>] (ret_from_fork+0x14/0x28)
[    1.804958] Exception stack(0x81505fb0 to 0x81505ff8)
[    1.804971] 5fa0:                                     00000000 00000000 00000000 00000000
[    1.804988] 5fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[    1.805003] 5fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[    1.805016]  r5:80b06934 r4:00000000
[    1.805113] kobject_add_internal failed for 3eaf0000.framebuffer with -EEXIST, don't try to register things with the same name in the same directory.
[    1.816168] NET: Registered protocol family 2
[    1.816425] IP idents hash table entries: 16384 (order: 5, 131072 bytes, linear)
[    1.817866] tcp_listen_portaddr_hash hash table entries: 512 (order: 0, 6144 bytes, linear)
[    1.818012] TCP established hash table entries: 8192 (order: 3, 32768 bytes, linear)
[    1.818141] TCP bind hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    1.818338] TCP: Hash tables configured (established 8192 bind 8192)
[    1.818513] UDP hash table entries: 512 (order: 2, 16384 bytes, linear)
[    1.818575] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes, linear)
[    1.818939] NET: Registered protocol family 1
[    1.819877] RPC: Registered named UNIX socket transport module.
[    1.819896] RPC: Registered udp transport module.
[    1.819913] RPC: Registered tcp transport module.
[    1.819929] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    1.821174] hw perfevents: enabled with armv7_cortex_a7 PMU driver, 7 counters available
[    1.825395] Initialise system trusted keyrings
[    1.825692] workingset: timestamp_bits=14 max_order=18 bucket_order=4
[    1.835697] zbud: loaded
[    1.837850] FS-Cache: Netfs 'nfs' registered for caching
[    1.838749] NFS: Registering the id_resolver key type
[    1.838811] Key type id_resolver registered
[    1.838829] Key type id_legacy registered
[    1.839002] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[    1.839022] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering...
[    1.840196] Key type asymmetric registered
[    1.840217] Asymmetric key parser 'x509' registered
[    1.840277] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    1.840297] io scheduler mq-deadline registered
[    1.840314] io scheduler kyber registered
[    1.848963] Serial: 8250/16550 driver, 1 ports, IRQ sharing enabled
[    1.849829] bcm2835-aux-uart 3f215040.serial: there is not valid maps for state default
[    1.851687] bcm2835-rng 3f104000.rng: hwrng registered
[    1.852186] vc-mem: phys_addr:0x00000000 mem_base=0x3ec00000 mem_size:0x40000000(1024 MiB)
[    1.853060] gpiomem-bcm2835 3f200000.gpiomem: Initialised: Registers at 0x3f200000
[    1.859107] fb0: switching to vc4drmfb from simple
[    1.859573] Console: switching to colour dummy device 80x30
[    1.860680] vc4-drm soc:gpu: bound 3f600000.firmwarekms (ops vc4_fkms_ops)
[    1.860833] vc4-drm soc:gpu: bound 3fc00000.v3d (ops vc4_v3d_ops)
[    1.861891] [drm] Initialized vc4 0.0.0 20140616 for soc:gpu on minor 0
[    1.917125] Console: switching to colour frame buffer device 90x30
[    1.933771] vc4-drm soc:gpu: [drm] fb0: vc4drmfb frame buffer device
[    1.946840] brd: module loaded
[    1.959173] loop: module loaded
[    1.960881] Loading iSCSI transport class v2.0-870.
[    1.962554] libphy: Fixed MDIO Bus: probed
[    1.962876] usbcore: registered new interface driver lan78xx
[    1.962949] usbcore: registered new interface driver smsc95xx
[    1.962978] dwc_otg: version 3.00a 10-AUG-2012 (platform bus)
[    2.163572] Core Release: 2.80a
[    2.163594] Setting default values for core params
[    2.163627] Finished setting default values for core params
[    2.364020] Using Buffer DMA mode
[    2.364039] Periodic Transfer Interrupt Enhancement - disabled
[    2.364056] Multiprocessor Interrupt Enhancement - disabled
[    2.364074] OTG VER PARAM: 0, OTG VER FLAG: 0
[    2.364108] Dedicated Tx FIFOs mode
[    2.364582]
[    2.364601] WARN::dwc_otg_hcd_init:1072: FIQ DMA bounce buffers: virt = 9ed04000 dma = 0xded04000 len=9024
[    2.364640] FIQ FSM acceleration enabled for :
[    2.364640] Non-periodic Split Transactions
[    2.364640] Periodic Split Transactions
[    2.364640] High-Speed Isochronous Endpoints
[    2.364640] Interrupt/Control Split Transaction hack enabled
[    2.364733]
[    2.364742] WARN::hcd_init_fiq:457: FIQ on core 1
[    2.364754]
[    2.364763] WARN::hcd_init_fiq:458: FIQ ASM at 8087a21c length 36
[    2.364777]
[    2.364784] WARN::hcd_init_fiq:496: MPHI regs_base at bb810000
[    2.364812] dwc_otg 3f980000.usb: DWC OTG Controller
[    2.364881] dwc_otg 3f980000.usb: new USB bus registered, assigned bus number 1
[    2.364939] dwc_otg 3f980000.usb: irq 89, io mem 0x00000000
[    2.364996] Init: Port Power? op_state=1
[    2.365012] Init: Power Port (0)
[    2.365374] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10
[    2.365396] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    2.365416] usb usb1: Product: DWC OTG Controller
[    2.365435] usb usb1: Manufacturer: Linux 5.10.63-v7 dwc_otg_hcd
[    2.365454] usb usb1: SerialNumber: 3f980000.usb
[    2.366258] hub 1-0:1.0: USB hub found
[    2.366329] hub 1-0:1.0: 1 port detected
[    2.367917] usbcore: registered new interface driver usb-storage
[    2.368276] mousedev: PS/2 mouse device common for all mice
[    2.369766] bcm2835-wdt bcm2835-wdt: Broadcom BCM2835 watchdog timer
[    2.372369] sdhci: Secure Digital Host Controller Interface driver
[    2.372389] sdhci: Copyright(c) Pierre Ossman
[    2.373114] mmc-bcm2835 3f300000.mmcnr: could not get clk, deferring probe
[    2.374077] sdhost-bcm2835 3f202000.mmc: could not get clk, deferring probe
[    2.374481] sdhci-pltfm: SDHCI platform and OF driver helper
[    2.376332] ledtrig-cpu: registered to indicate activity on CPUs
[    2.376750] hid: raw HID events driver (C) Jiri Kosina
[    2.376933] usbcore: registered new interface driver usbhid
[    2.376951] usbhid: USB HID core driver
[    2.377363] ashmem: initialized
[    2.383111] Initializing XFRM netlink socket
[    2.383163] NET: Registered protocol family 17
[    2.383314] Key type dns_resolver registered
[    2.383483] Registering SWP/SWPB emulation handler
[    2.383657] registered taskstats version 1
[    2.383702] Loading compiled-in X.509 certificates
[    2.384591] Key type ._fscrypt registered
[    2.384610] Key type .fscrypt registered
[    2.384627] Key type fscrypt-provisioning registered
[    2.396299] uart-pl011 3f201000.serial: cts_event_workaround enabled
[    2.396407] 3f201000.serial: ttyAMA0 at MMIO 0x3f201000 (irq = 114, base_baud = 0) is a PL011 rev2
[    2.398666] bcm2835-aux-uart 3f215040.serial: there is not valid maps for state default
[    2.399355] printk: console [ttyS0] disabled
[    2.399496] 3f215040.serial: ttyS0 at MMIO 0x3f215040 (irq = 86, base_baud = 50000000) is a 16550
[    3.833640] printk: console [ttyS0] enabled
[    3.839003] bcm2835-power bcm2835-power: Broadcom BCM2835 power domains driver
[    3.848306] mmc-bcm2835 3f300000.mmcnr: mmc_debug:0 mmc_debug2:0
[    3.854408] mmc-bcm2835 3f300000.mmcnr: DMA channel allocated
[    3.861811] Indeed it is in host mode hprt0 = 00021501
[    3.941455] sdhost: log_buf @ (ptrval) (ded07000)
[    3.984211] mmc1: queuing unknown CIS tuple 0x80 (2 bytes)
[    3.991464] mmc1: queuing unknown CIS tuple 0x80 (3 bytes)
[    3.997102] mmc0: sdhost-bcm2835 loaded - DMA enabled (>1)
[    4.005949] of_cfs_init
[    4.008733] of_cfs_init: OK
[    4.012543] ALSA device list:
[    4.015594]   No soundcards found.
[    4.019779] Waiting for root device /dev/mmcblk0p2...
[    4.025821] mmc1: queuing unknown CIS tuple 0x80 (3 bytes)
[    4.034369] mmc1: queuing unknown CIS tuple 0x80 (7 bytes)
[    4.084906] usb 1-1: new high-speed USB device number 2 using dwc_otg
[    4.091619] Indeed it is in host mode hprt0 = 00001101
[    4.166941] mmc0: host does not support reading read-only switch, assuming write-enable
[    4.180775] mmc0: new high speed SDHC card at address aaaa
[    4.187535] mmcblk0: mmc0:aaaa SC16G 14.8 GiB
[    4.197599]  mmcblk0: p1 p2
[    4.214202] EXT4-fs (mmcblk0p2): mounted filesystem with ordered data mode. Opts: (null)
[    4.222572] VFS: Mounted root (ext4 filesystem) readonly on device 179:2.
[    4.232226] devtmpfs: mounted
[    4.245484] Freeing unused kernel memory: 1024K
[    4.258234] mmc1: new high speed SDIO card at address 0001
[    4.305526] Run /sbin/init as init process
[    4.335290] usb 1-1: New USB device found, idVendor=0424, idProduct=9514, bcdDevice= 2.00
[    4.343613] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    4.351821] hub 1-1:1.0: USB hub found
[    4.355774] hub 1-1:1.0: 5 ports detected
[    4.586438] systemd[1]: System time before build time, advancing clock.
[    4.680645] usb 1-1.1: new high-speed USB device number 3 using dwc_otg
[    4.712504] NET: Registered protocol family 10
[    4.718776] Segment Routing with IPv6
[    4.764256] systemd[1]: systemd 249.3+ running in system mode (-PAM -AUDIT -SELINUX -APPARMOR +IMA -SMACK +SECCOMP -GCRYPT -GNUTLS -OPENSSL +ACL +BLKID -CURL -ELFUTILS -FIDO2 -IDN2 -IDN -IPTC +KMOD -LIBCRYPTSETUP +LIBFDISK -PCRE2 -PWQUALITY -P11KIT -QRENCODE -BZIP2 -LZ4 -XZ -ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=hybrid)
[    4.808726] systemd[1]: Detected architecture arm.
[    4.835315] usb 1-1.1: New USB device found, idVendor=0424, idProduct=ec00, bcdDevice= 2.00
[    4.843808] usb 1-1.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    4.854156] smsc95xx v2.0.0

Seems to fixed in latest master branch which contains U-Boot 2021.10


SimpleStack Fixes migration

Here are the quick fixes present in SimpleStack

@vdaron Are you fixes contributed back to v3? I saw the other day that Mythz was accepting fixes on ServiceStack.Text v3, so I wonder if it makes sense to contribute them back? I'm looking at the best way to merge the changes there currently into our fork.
@mirthy Want to add me to the NServiceKit team? Maybe @vdaron  too? Looks like you have been active in the last month, but in the interest of moving the project further I'd like to join! Maybe you already have discussed how we can contribute fixes and reasonable things back to v3? Or how we merge their changes to NServiceKit? Only having 1 guy in the team vs https://github.com/orgs/ServiceStack/people is a bad look I think, for another wise great initiative.

@rykerwilliams I didn't push my commits to ServiceStack V3 because it looked like a dead branch.
Merged pull requests of ServiceStack.Textv3 could certainly be integrated into NServiceKit.Text.
Could you maybe contact their authors for approval ?
I'm already a commiter for NServicekit, do not hesitate to send pull requests ! Any effort is always appreciated.
NServicekit is a fork of the ServiceStackv3 branch to ensure project continuity under BSD licence.

@vdaron I will be sure to contact those committers on the v3 branch and let them know about the initiative here. I wanted to have the contributors here give thoughts on if / when to submit patches back to v3 and the process for merging the v3 changes to NServiceKit.
On pull requests: I have a few open now against the NServiceKit projects, mostly updates to the Travis CI build scripts and support for Mono, I'd love for you to have a look at them.


Fix for non-framework build

Fixed a mistype that prevented building SQLite.swift as non-framework sources.
Steps to reproduce:

download the source
create new XCode project
add SQLite.swift sources inside new project (just sources, not the actual .xcodeproj file)
build.

As result: sources are built as is and no framework is created -> reference to SQLite. becomes invalid.
Keeping in mind that Setter is referenced in this file earlier I assume this is a mistype.

thanks!


CARDS-2060: Weak SSL ciphers should be disabled in the proxy container whenever the proxy container is operating as an SSL-terminating reverse proxy

This PR implements CARDS-2060 by only allowing SSL ciphers that are considered by the security scanning team to not be weak.
Testing Instructions

Before starting the tests, please ensure that you have nmap installed. On Debian/Ubuntu, nmap can be installed with sudo apt install nmap.

Build the latest dev branch (including a Docker image) with mvn clean install -Pdocker.
cd compose-cluster
python3 generate_compose_yaml.py --dev_docker_image --ssl_proxy --self_signed_ssl_proxy --oak_filesystem --web_port_admin 443 --web_port_user 444
docker-compose build && docker-compose up -d
nmap --script ssl-enum-ciphers -p 443 localhost -oX ~/ssl_scan_dev_443.xml
nmap --script ssl-enum-ciphers -p 444 localhost -oX ~/ssl_scan_dev_444.xml
docker-compose down && docker-compose rm && docker volume prune -f && ./cleanup.sh
cd .. (switch back to the root of the git repository)
Build this (CARDS-2060) branch (including a Docker image) with mvn clean install -Pdocker.
cd compose-cluster
python3 generate_compose_yaml.py --dev_docker_image --ssl_proxy --self_signed_ssl_proxy --oak_filesystem --web_port_admin 443 --web_port_user 444
docker-compose build && docker-compose up -d
nmap --script ssl-enum-ciphers -p 443 localhost -oX ~/ssl_scan_cards-2060_443.xml
nmap --script ssl-enum-ciphers -p 444 localhost -oX ~/ssl_scan_cards-2060_444.xml
docker-compose down && docker-compose rm && docker volume prune -f && ./cleanup.sh
cd ../Utilities/Development
python3 scan_nmap_ssl_xml_for_weak_ciphers.py ~/ssl_scan_dev_443.xml - this should result in a failed test.
python3 scan_nmap_ssl_xml_for_weak_ciphers.py ~/ssl_scan_dev_444.xml - this should result in a failed test.
python3 scan_nmap_ssl_xml_for_weak_ciphers.py ~/ssl_scan_cards-2060_443.xml - this should result in a passed test.
python3 scan_nmap_ssl_xml_for_weak_ciphers.py ~/ssl_scan_cards-2060_444.xml - this should result in a passed test.

Must test if the site loads correctly in Chrome, Edge, Safari, Firefox, IE, and on mobile.


Modfiable alias was removed in Ruby 2.7

Up!
Without this, the interactor gem fails with given error message (here from our test suite):
      Failure/Error: context.fail!(error_message: message)

      NoMethodError:
        undefined method `[]=' for nil:NilClass


Repository cleanup

[ ] Add godocs for plugin interfaces
[ ] Improve readme that includes: codecov, godocs reference and example usages.
[ ] Add golangci-lint configuration + CI runs (copy from cloud or api)
[ ] Cleanup current code for golangci-lint runs

All done


Adding new data to existing corpus.

@gunthercox
When I add new Questions/Answers to the existing corpus(I used 'conversations') and then on training it again, the bot doesn't respond with the newly added questions.

Apologise in advance if the question has been asked.
Thank you.

If you are modifying chatterbot's codebase, you will likely need to
re-install chatterbot after the modification (pip install . --upgrade).
After than you should be able to call the train method to re-train the chat
bot with your updated data.

Um no. I'm not modifying the codebase. Rather, I added an extra entry to the corpus (english.conversations). However on querying that entry(Essentially a question with answer, refer the pics above) I get a random output, not what I trained it.
Thanks.

To be more specific:

I added the entry ["This is a test question?","Testing123"] to the english.conversations corpus

Now I created a bot and trained it with the already modified and saved conversations corpus.
So basically the program gets response from the bot for :  "This is a test question?".

This was followed by running the code. Instead of getting "Testing123" as the answer, I get some random answer as highlighted.

@melvinabraham any updates on this? Try to search your test statement exists in database.db or not, if it is there then your data is trained.
If you try to get more specific output you have to use comparison functions http://chatterbot.readthedocs.io/en/stable/logic/index.html#best-match-adapter

With reference to the previous answer, the bot was supposed to answer for "This is a test question" as "Testing123". On searching the database.db file for this question I found out that it exists:

Compiling the testcase:

Some other random output is obtained.

@melvinabraham thanks, did you added statement comparison adapters? And also please read http://chatterbot.readthedocs.io/en/stable/conversations.html#statement-comparison

@vkosuri Issue resolved! A comma went haywire in the .json file.
Sorry and thank you!

@melvinabraham no problem

@vkosuri
How do I link your awesome 'chatterbot' with my custom corpus with an android application?


java 17 record added.

java record instead of plain java pojo.

This looks super cool!!! As @SandraAhlgrimm and @mkheck you are working on updating this codebase for Devoxx, I'm putting both of you for the review.


New version: ViscousFlow v0.1.8

Registering package: ViscousFlow
Repository: https://github.com/jdeldre/ViscousFlow.jl
Created by: @jdeldre
Version: v0.1.8
Commit: 963a377a5e879a10435556a4f792abc91019ae17
Reviewed by: @jdeldre
Reference: https://github.com/jdeldre/ViscousFlow.jl/commit/963a377a5e879a10435556a4f792abc91019ae17#commitcomment-35722182

Your new version pull request does not meet the following guidelines for auto-merging:

The following dependencies do not have a compat entry that has an upper bound: ColorTypes, Compat, Cubature, DiffRules, DocStringExtensions, Documenter, FFTW, FastGaussQuadrature, FileIO, ForwardDiff, IterativeSolvers, JLD, LaTeXStrings, LinearMaps, PlotUtils, Plots, ProgressMeter, PyCall, PyPlot, RecipesBase, Reexport, Revise, SpecialFunctions, StaticArrays

Note that the guidelines are only required for the pull request to be merged automatically. However, it is strongly recommended to follow them, since otherwise the pull request needs to be manually reviewed and merged by a human.

If you want to prevent this pull request from being auto-merged, simply leave a comment. If you want to post a comment without blocking auto-merging, you must include the text [noblock] in your comment.


Login with fingerprint

Hello, I am creating an authentication system for a website without username and password. That is, by scanning the fingerprint the user will be able to log in directly. Then I need the key (or whatever it is called) of each user and look it up in the database. If the user previously registered his fingerprint he will be able to log in without username and password.
I'm trying to do it using this library and I'm afraid it's not possible. Is it possible? Is there any limitation to do what I need to do?
Thank you.

Which framework are you using?

Django

You can use django-passkeys or django-mfa2 which uses this library to achieve your requirements

jango-passkeys I don't know, I'll try it. django-mfa2 I've played with it a bit and the problem I see is that you need to indicate which user is logging in using the username. Then you enter the fingerprint to validate. So it's not quite what I need.
Isn't there any method in the library that, when touching the reader, returns the key to look it up in the database?
Thank you very much.

Your scenario is passkeys that the key identifies the user.

Thank you


[NEW GAME] Guess the number game

Description

This is a game in which the user has to guess a number from a given range. If the user guesses correctly then the game will show the user guesses the right number by displaying a message.

Screenshots
No response
Additional information

If the user guesses the number correctly then the game will greet the user with a message stating he guesses the right number.
Single player game

@panwar8279 please assign this game to me to contribute under GSSoC'23 program

Hi @Avdhesh-Varshney , I am assigning this issue to you. Kindly complete within a week. Make sure you will make your game in react because it's react based repository Good luck!


Appstudio update mvp-test-component

Pipelines as Code configuration proposal

Pipelines as Code CI/mvp-test-component-on-pull-request has successfully validated your commit.

StatusDurationName

✅ Succeeded
7 seconds
init

✅ Succeeded
14 seconds
clone-repository

✅ Succeeded
4 minutes
build-container

✅ Succeeded
16 seconds
sanity-inspect-image

✅ Succeeded
16 seconds
deprecated-base-image-check

✅ Succeeded
16 seconds
clair-scan

✅ Succeeded
56 seconds
clamav-scan

✅ Succeeded
11 seconds
sbom-json-check

✅ Succeeded
15 seconds
sanity-label-check

✅ Succeeded
14 seconds
sanity-optional-label-check

✅ Succeeded
7 seconds
show-summary

Pipelines as Code CI/mvp-test-component-on-pull-request has successfully validated your commit.

StatusDurationName

✅ Succeeded
7 seconds
init

✅ Succeeded
14 seconds
clone-repository

✅ Succeeded
4 minutes
build-container

✅ Succeeded
16 seconds
deprecated-base-image-check

✅ Succeeded
16 seconds
sanity-inspect-image

✅ Succeeded
16 seconds
clair-scan

✅ Succeeded
56 seconds
clamav-scan

✅ Succeeded
11 seconds
sbom-json-check

✅ Succeeded
15 seconds
sanity-label-check

✅ Succeeded
14 seconds
sanity-optional-label-check

✅ Succeeded
7 seconds
show-summary


Secure etcd deployment with TLS assets generated by kubeadm

Fixes #40
The following PR deploys a secure etcd cluster (listening on HTTPS for clients and peers).
The etcd role now:

Downloads the kubeadm binary directly from the kubernetes release "bucket". The kubeadm version is configurable via a variable.
Uses kubeadm to generate the keys and certificates required for secure etcd on the first etcd node.
Slurps and distributes generated certs to the rest of the etcd nodes

The kubernetes-masters role now:

Slurps the etcd certificates from the first etcd node and copies them to the master nodes
The etcd client endpoints variable now uses HTTPS instead of HTTP

Notes for reviewer:

Not sure if there's a way to avoid defining the kubernetes version in multiple roles. With this PR, we are adding one more place where the kubernetes (really kubeadm) version must be specified.

@alexbrand Can you have a look at this PR and see if you can resolve any merge conflcits?

@chuckha ptal

@scottslowe all set 👍

Closing as this is superseded by #181


Does it work at the moment?

I've manually tested downloading outdated mod versions, but the updater does not appear to actually update any mods - neither when going through all mods nor for named mods.
Does the updater currently work?

Disregard, didn't realize the username/token was required for updating/downloading - a specific error message would help I guess. Either way, it is working, thanks!


Reach capabilities get dropped in cv

Compiler version
main
Minimized code

import language.experimental.captureChecking
trait File:
  def write(x: String): Unit
def usingFile[R](op: File^ => R): R = ???
case class Box[+T](get: T)

def main(): Unit =
  val trick: Box[File^] -> Unit = (x: Box[File^]) =>
    val x1: Box[File^{x*}] = x
    val x2: File^{x*} = x.get
    x2.write("Hello")
  val bad: () -> Unit = usingFile[() -> Unit]: f =>
    val boxed: Box[File^] = Box(f)
    () => trick(boxed)
  bad()  // boom

Output
It compiles.
Expectation
It should not.
I am working on a fix.

Has been resolved.


Multicluster dataplane change for Service access

This PR is on top of #3463, it includes two commits, one is for data path change, another one is for changing Multi-cluster Service's Endpoint from Pod IP to Service ClusterIP.
Commit 1:
Add Multi-cluster feature in Agent

Add a new feature gate Multicluster and configs in antrea-agent.conf, and a few extra items in antrea-agent
cluster role including access to Gateway and ClusterInfoImport.
Rename the ServiceMarkTable to SNATMarkTable.
Add a controller for Gateway Nodes to watch Gateway and ClusterInfoImport's
events. It will set up a few openflow rules to forward cross-cluster traffic to remote Gateway Nodes.

Add a classification rule for cross-cluster traffic with global multicluster virtual
MAC aa:bb:cc:dd:ee:f0. A sample is like below:

 table=Classifier, priority=210,in_port="antrea-tun0",dl_dst=aa:bb:cc:dd:ee:f0 actions=load:0x1->NXM_NX_REG0[0..3],load:0x1->NXM_NX_REG0[9],resubmit(,SNATConntrackZone)

Add a rule in L3Forwarding table for cross-cluster request packets that modifies
the destination MAC to global multicluster virtual MAC. A sample is like below (the destination CIDR
is remote Service ClusterIP CIDR, the tunnel IP in NXM_NX_TUN_IPV4_DST is remote Gateway IP):

table=L3Forwarding, priority=200,ip,nw_dst=<IP_ADDRESS>/12 actions=mod_dl_src:ee:73:a5:81:09:c6,mod_dl_dst:aa:bb:cc:dd:ee:f0,load:0xab01b39->NXM_NX_TUN_IPV4_DST[],load:0x1->NXM_NX_REG0[4..7],resubmit(,L3DecTTL)

Add a rule in L3Forwarding table for cross-cluster reply packets. A sample is like below
(the destination IP is remote Gateway IP):

table=L3Forwarding, priority=200,ct_state=+rpl+trk,ip,nw_dst=<IP_ADDRESS> actions=mod_dl_src:ee:73:a5:81:09:c6,mod_dl_dst:aa:bb:cc:dd:ee:f0,load:0xab01b39->NXM_NX_TUN_IPV4_DST[],load:0x1->NXM_NX_REG0[4..7],resubmit(,L3DecTTL)

Add a rule to SNATMark table to match the packets of multi-cluster Service connection and perform DNAT in DNAT zone.

table=SNATMark, priority=210,ip,nw_dst=<IP_ADDRESS>/12 actions=ct(commit,table=SNAT,zone=65520,exec(load:0x1->NXM_NX_CT_MARK[5]))

Add a rule to SNAT table to perform SNAT for any remote cluster traffic.

table=SNAT, priority=200,ct_state=+new+trk,ip,nw_dst=<IP_ADDRESS>/12 actions=ct(commit,table=L2ForwardingCalc,zone=65521,nat(src=<IP_ADDRESS>),exec(load:0x1->NXM_NX_CT_MARK[4]))

Add a rule to UnSNAT table to perform de-SNAT if destination IP is local GatewayIP.

table=UnSNAT, priority=200,ip,nw_dst=<IP_ADDRESS> actions=ct(table=ConntrackZone,zone=65521,nat)

Add a rule in L2ForwardingCalc table to load the global virtual multi-cluster MAC's output to antrea-tun0

table=L2ForwardingCalc, priority=200,dl_dst=aa:bb:cc:dd:ee:f0 actions=load:0x1->NXM_NX_REG1[],load:0x1->NXM_NX_REG0[8],resubmit(,22)

Add a rule in Output table to match the multi-cluster traffic to forward the traffic from/to regular Node
through the same port.

table=Output, priority=210,reg0=0x200/0x200,reg1=0x1,in_port=1 actions=IN_PORT

Add a controller for regular Nodes to watch Gateway and ClusterInfoImport's events.
It will set up a few openflow rules to forward cross-cluster traffic to local Gateway Node.

Add a rule in L3Forwarding table for cross-cluster request packets, and
modify the destination MAC to global multicluster virtual MAC. A sample is like below
(the destination CIDR is remote Service ClusterIP CIDR, the tunnel IP in NXM_NX_TUN_IPV4_DST is local Gateway's Internal IP.):

table=L3Forwarding, priority=200,ip,nw_dst=<IP_ADDRESS>/12 actions=mod_dl_src:f2:08:93:0c:82:bd,mod_dl_dst:aa:bb:cc:dd:ee:ff,load:0xab0193b->NXM_NX_TUN_IPV4_DST[],load:0x1->NXM_NX_REG0[4..7],resubmit(,L3DecTTL)

Add a rule in L3Forwarding table for cross-cluster reply packets. A sample is like below
(the destination IP is remote Gateway IP, the tunnel IP in NXM_NX_TUN_IPV4_DST is local Gateway's Internal IP):

table=L3Forwarding, priority=200,ct_state=+rpl+trk,ip,nw_dst=<IP_ADDRESS> actions=mod_dl_src:f2:08:93:0c:82:bd,mod_dl_dst:aa:bb:cc:dd:ee:f0,load:0xab0193b->NXM_NX_TUN_IPV4_DST[],load:0x1->NXM_NX_REG0[4..7],resubmit(,L3DecTTL)

Add a rule in L2ForwardingCalc table to load the global virtual multi-cluster MAC's output to antrea-tun0

table=L2ForwardingCalc, priority=200,dl_dst=aa:bb:cc:dd:ee:f0 actions=load:0x1->NXM_NX_REG1[],load:0x1->NXM_NX_REG0[8],resubmit(,22)

Add unit test cases
Refine e2e test for data plane change

Signed-off-by: Lan Luo<EMAIL_ADDRESS>Co-authored-by: Hongliang Liu<EMAIL_ADDRESS>Commit 2:
Use Service ClusterIPs as MC Service's Endpoints

Use Service ClusterIPs instead of Pod IPs as MC Service's Endpoints.
The ServiceExport controller will only watch ServiceExport and
Service events, and wrap Service's ClusterIPs into a new Endpoint kind of
ResourceExport.
Includes local Serivce ClusterIP as multi-cluster Service's Endpoints as well.

Signed-off-by: Lan Luo<EMAIL_ADDRESS>

Codecov Report

Merging #3603 (0eb5ea5) into main (a04810a) will decrease coverage by 26.24%.
The diff coverage is n/a.

@@             Coverage Diff             @@
##             main    #3603       +/-   ##
===========================================
- Coverage   64.17%   37.93%   -26.25%
===========================================
  Files         278      115      -163
  Lines       27838    15351    -12487
===========================================
- Hits        17866     5823    -12043
- Misses       8054     9044      +990
+ Partials     1918      484     -1434

Flag
Coverage Δ

integration-tests
37.93% <ø> (?)

kind-e2e-tests
?

unit-tests
?

Flags with carried forward coverage won't be shown. Click here to find out more.

 The e2e is already triggered and passed last Friday in #3737,  I triggered a new one here, but jenkins is not triggered, I have contact @XinShuYang to take a look the jenkins issue, Could you help to review again? thanks.

/test-multicluster-dataplane-e2e

/test-multicluster-e2e

/test-multicluster-dataplane-e2e

/test-multicluster-dataplane-e2e

/test-multicluster-e2e

/test-multicluster-dataplane-e2e

/test-multicluster-dataplane-e2e

Hi @tnqn @jianjuns  Could you help to review again? thanks.
All comments have been addressed, @hongliangl  helped on refining the SNAT flows part, after adding a new mark, the flows will commit only for first packet which should be more efficient. thanks @hongliangl

/test-multicluster-dataplane-e2e

/test-multicluster-dataplane-e2e

@tnqn  I didn't find where the comment located, so replied here:

I mean there is a flow like this (<IP_ADDRESS> is the remote gateway IP):
nw_dst=<IP_ADDRESS>, ..., set_tunnel_ip: <IP_ADDRESS>
Is it expected? It seems cross-cluster traffic will be SNATed to the gateway IP which is same as tunnel IP?

Yes, it's expected for reply packets. Due to the cross-cluster traffic is SNATed to the GatewayIP, when the local Pod get the request from remote cluster, it will only see a packet with remote Gateway IP as src IP <IP_ADDRESS>, the reply packet will set the destination as <IP_ADDRESS>.

/test-multicluster-dataplane-e2e

/test-multicluster-dataplane-e2e

/test-multicluster-dataplane-e2e

/test-multicluster-dataplane-e2e

@tnqn I have renamed ServiceMarkTable to SNATMark table after sync with @hongliangl , and do the DNAT commit in this table for MC related traffic. Another part is the InstallMulticlusterClassifierFlows refinement, Could you help to take a look? thanks!

/test-multicluster-dataplane-e2e

/test-multicluster-dataplane-e2e

/test-multicluster-dataplane-e2e

/test-all

/test-integration

/test-multicluster-e2e
/test-multicluster-dataplane-e2e
/test-ipv6-only-e2e

/test-integration
/test-multicluster-e2e
/test-multicluster-dataplane-e2e
/test-ipv6-only-e2e

/test-integration

/test-multicluster-dataplane-e2e

/test-integration

@jianjuns  smee service is broken, the jenkins doesn't respond to the comment now, I will check with @XinShuYang.

/test-integration
/test-multicluster-e2e
/test-multicluster-dataplane-e2e
/test-ipv6-only-e2e

/test-conformance
/test-e2e
/test-networkpolicy

/test-integration

Integration test failed due to the table rename, I will fix this.

Sure. Please take care of such issues earlier next time.

Integration test failed due to the table rename, I will fix this.

Sure. Please take care of such issues earlier next time.

Yeah, I will, I didn't notice integration test will be impacted, will check the result in time next time.
btw, do we need to rerun all tests again? or just those failed cases?

Ideally run all tests of test-all.

/test-all

/test-all

/test-multicluster-dataplane-e2e

Since this change updates common flows, could you make sure ipv6-e2e and ipv6-only-e2e pass (except FQDNPolicyInCluster in ipv6-only-e2e)? We had issues with them several times and just fixed all of them except https://github.com/antrea-io/antrea/issues/3873, don't want to break them again when it's close to release.

/test-ipv6-only-e2e
/test-ipv6-e2e


(chore) - move wrongly placed import

In my PR the testing dep snuck into dependencies instead of devDependencies, apologies!

sailci not running for forks or?


feature: issue (#2060)

Codecov Report

Merging #2067 (393c99e) into master (e4c8cfc) will decrease coverage by 0.11%.
The diff coverage is 68.00%.

@@            Coverage Diff             @@
##           master    #2067      +/-   ##
==========================================
- Coverage   76.47%   76.36%   -0.12%
==========================================
  Files         517      516       -1
  Lines       46828    46618     -210
==========================================
- Hits        35810    35598     -212
- Misses       9041     9047       +6
+ Partials     1977     1973       -4

Flag
Coverage Δ

go-1.15-386
?

go-1.15-amd64
?

go-1.16-amd64
?

go-1.17-386
?

go-1.17-amd64
?

go-1.18-amd64
76.36% <68.00%> (-0.01%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

net/ghttp/ghttp.go
100.00% <ø> (ø)

net/ghttp/ghttp_request_param_request.go
63.26% <68.00%> (+0.97%)
:arrow_up:

os/gcron/gcron_schedule_fix.go
87.50% <0.00%> (-12.50%)
:arrow_down:

os/gspath/gspath_cache.go
75.43% <0.00%> (-12.29%)
:arrow_down:

contrib/registry/polaris/polaris_watcher.go
62.50% <0.00%> (-10.72%)
:arrow_down:

os/gfsnotify/gfsnotify_watcher_loop.go
75.63% <0.00%> (-7.57%)
:arrow_down:

net/gtcp/gtcp_pool.go
68.18% <0.00%> (-6.82%)
:arrow_down:

os/gfsnotify/gfsnotify_filefunc.go
70.12% <0.00%> (-3.90%)
:arrow_down:

contrib/drivers/oracle/oracle.go

net/ghttp/ghttp_server_router_group.go
87.41% <0.00%> (+1.04%)
:arrow_up:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

@LonelySally 我看了你最新的提交，老实说，我有点看不懂了。。

@LonelySally 我看了你最新的提交，老实说，我有点看不懂是在干啥。。

在项目启动的时候把符合checkAndCreateFuncInfo校验条件的结构体设置到inputTagsMap里,这里结构体名称作为map的key
在请求发生时,用结构体名称通过GetInputTagInfo取到启动时对应结构体的反射结果,再解析需要的tag标签组获取对应的tag值.首次获取时采取匹配(类似orm的表结构缓存),后续直接以结构体名称+tag名称(数组转字符串逗号分割做为key)方式取匹配结果.
emm...大概就是这么个流程

i recommend change it to high priority, because it makes in:header not only for swagger in api.


python311Packages.levenshtein: 0.24.0 -> 0.25.0

Diff: https://github.com/maxbachmann/Levenshtein/compare/refs/tags/v0.24.0...v0.25.0
Changelog: https://github.com/maxbachmann/Levenshtein/blob/refs/tags/v0.25.0/HISTORY.md
Description of changes

Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

Result of nixpkgs-review pr 288157 run on x86_64-linux 1

10 packages failed to build:

nitrokey-app2
nitrokey-app2.dist
pynitrokey (python311Packages.pynitrokey)
pynitrokey.dist (python311Packages.pynitrokey.dist)
python312Packages.autofaiss
python312Packages.autofaiss.dist
python312Packages.pdf2docx
python312Packages.pdf2docx.dist
python312Packages.videocr
python312Packages.videocr.dist

49 packages built:

adl
anime-downloader
anime-downloader.dist
apostrophe
atomic-operator
atomic-operator.dist
creds
creds.dist
ibus-engines.uniemoji
knowsmore
knowsmore.dist
ledger-autosync
ledger-autosync.dist
puddletag
puddletag.dist
python311Packages.autofaiss
python311Packages.autofaiss.dist
python311Packages.fire
python311Packages.fire.dist
python311Packages.fuzzywuzzy
python311Packages.fuzzywuzzy.dist
python311Packages.levenshtein
python311Packages.levenshtein.dist
python311Packages.nkdfu
python311Packages.nkdfu.dist
python311Packages.pdf2docx
python311Packages.pdf2docx.dist
python311Packages.thefuzz
python311Packages.thefuzz.dist
trytond (python311Packages.trytond)
trytond.dist (python311Packages.trytond.dist)
python311Packages.videocr
python311Packages.videocr.dist
python312Packages.fire
python312Packages.fire.dist
python312Packages.fuzzywuzzy
python312Packages.fuzzywuzzy.dist
python312Packages.levenshtein
python312Packages.levenshtein.dist
python312Packages.nkdfu
python312Packages.nkdfu.dist
python312Packages.thefuzz
python312Packages.thefuzz.dist
python312Packages.trytond
python312Packages.trytond.dist
sublime-music
sublime-music.dist
ulauncher
ulauncher.dist

pbr is still broken on Python 3.12.


Console Issue

Whenever i start the bot I get this error, any suggestions on how to fix it?

are you doing it with node or docker?
if with node try to do node . or just try reinstalling bridge

Although I can't say for sure I would assume that's the result you get if the device or account are IP banned or account banned, or the IP address you're trying to connect to doesn't exist. Double check the account and your IP address aren't banned and the server address is set correctly in whichever configuration you're using.

I also thought that but this would pop up

Thank you both for replies, while looking at it I got a new host for the bot and its now all working! So thanks!


[Bug]: Failed to download

All of the following criteria must be met

[X] All Requirements must be installed.
[X] Full Latest.log file included. If no file exists then leave this unchecked and state so.

All of the following are optional to answer

[ ] Tried reinstalling the Game.
[ ] Tried reinstalling MelonLoader.
[ ] Tried restarting PC.
[ ] Was able to see the Start Screen.

Describe the issue.
I download melon loader with all dependencies installed to run it. I run the game and it give me an error.
MelonLoader_22-04-20_18-14-13.074.log
Did you attach your log file?

[X] Yes, I attached my log file to the text box above.
[ ] No, I could not find a log file at {Game_Directory}\MelonLoader\Latest.log

Stop trying to cheat on crab game


[API] Create / Delete Layer API

Create / Delete Layer API
. ml_nnlayer_create(ml_nnlayer_h *nnlayer, ml_layer_type_e type);
: create InputLayer, FullyConnectedLayer instance
. ml_nnlayer_delete(ml_nnlayer_h *nnlayr)
: check validation and delete instance

Self evaluation:

Build test:	 [X]Passed [ ]Failed [ ]Skipped
Run test:	 [X]Passed [ ]Failed [ ]Skipped

Signed-off-by: jijoong.moon<EMAIL_ADDRESS>

:memo: TAOS-CI Version: 1.4.20191203. Thank you for submitting PR #76. Please a submit 1commit/1PR (one commit per one PR) policy to get comments quickly from reviewers. Your PR must pass all verificiation processes of cibot before starting a review process from reviewers. If you are new member to join this project, please read manuals in documentation folder and wiki page. In order to monitor a progress status of your PR in more detail, visit http://ec2-54-180-96-14.ap-northeast-2.compute.amazonaws.com/.


$(".orbit").orbit is not a function

hey out there,
was doing some testing with the foundation html framework. everything worked out pretty well.
i installed the package via http://foundation.zurb.com/files/foundation-download-2.1.4.zip
which seems to have everything compressed together in a couple of files.
my problem is, that i cant invoke the "orbit" function on a jquery wrapped element. anybodys having that issue as well?
thanks for help!

Make sure your not loading jQuery twice, it's already bundled in the foundation.js file so if your loading twice it will cause errors similar to what your describing.

hey th3fallen.
thanks very much. that`s the problem.
i am loading it in a new rails 3.2 app. is there a way i can make a foundation build myself without jquery?

If you grab the code from Github you'll get all the files broken out, including jQuery. For the downloaded one we package most of the files up to reduce requests.


add response duration to log

I started watching a couple of issues related to performance of code completions / intellisense on omnisharp-vscode. Today I added some logging to omnisharp-roslyn in order to drill that down further.
The open issues I am watching in vscode are

OmniSharp/omnisharp-vscode#4080
OmniSharp/omnisharp-vscode#4047
OmniSharp/omnisharp-vscode#4072
OmniSharp/omnisharp-vscode#3421
OmniSharp/omnisharp-vscode#4065

I can see now really long lasting /codecheck requests > 10.000 millis

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: an-dr-eas-k sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.


Add support for separate power collectors

As discussed in https://github.com/solectrus/hosting/issues/5:

Allow to define two or more plants which individual plane declination, plane azimuth, and kWp (and maybe lat/long)
Do separate API calls for each plant
Sum up the result

Reference: https://github.com/jbaesner/quarkus-forecast-collector

Hi @ledermann,
maybe you can add a little instruction on how to use the quarkus-forecast-collector in combination with oolectrus?

@Bart1909 There is an .env example. Because I don't use the quarkus-forecast-collector by myself (we have just one roof), maybe @jbaesner as author can help.

Hi @ledermann,
I filled the .env file with my data and entered the influx settings vom solectrus. It seams, that this is working right now.
I've deactivated the solectrus forecast collector then.
Maybe @jbaesner can tell if this is the correct way.
Best regards

@Bart1909 yes, you can specify as many orientations as you wish. As can be seen in the .env.example.
See for example:
FORECAST_CONFIGURATIONS=ROOF_1,ROOF_2

FORECAST_ROOF_1_LONGITUDE=13.3760
FORECAST_ROOF_1_LATITUDE=52.5191
FORECAST_ROOF_1_DECLINATION=30
FORECAST_ROOF_1_AZIMUTH=-180
FORECAST_ROOF_1_KWP=7

FORECAST_ROOF_2_LONGITUDE=13.3768
FORECAST_ROOF_2_LATITUDE=52.5186
FORECAST_ROOF_2_DECLINATION=30
FORECAST_ROOF_2_AZIMUTH=0
FORECAST_ROOF_2_KWP=8

@Bart1909 yes, you can specify as many orientations as you wish. As can be seen in the .env.example.
See for example:
FORECAST_CONFIGURATIONS=ROOF_1,ROOF_2

FORECAST_ROOF_1_LONGITUDE=13.3760
FORECAST_ROOF_1_LATITUDE=52.5191
FORECAST_ROOF_1_DECLINATION=30
FORECAST_ROOF_1_AZIMUTH=-180
FORECAST_ROOF_1_KWP=7

FORECAST_ROOF_2_LONGITUDE=13.3768
FORECAST_ROOF_2_LATITUDE=52.5186
FORECAST_ROOF_2_DECLINATION=30
FORECAST_ROOF_2_AZIMUTH=0
FORECAST_ROOF_2_KWP=8

Hi @jbaesner ,
okay and then setting the same influx settings as in solectrus is correct, right?


[FLINK-31779][docs] Track stable branch of externalized connector instead of specific release tag

What is the purpose of the change
Docs for externalized connectors should point to the branch where that version of the connector doc are published, otherwise documentation fixes are not visible until a new release is made. After this, we can safely delete all dedicated doc branches.
Brief change log

Track stable branch of externalized connector instead of specific release tag.

Verifying this change
This change is a trivial rework / code cleanup without any test coverage.
Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): no
The public API, i.e., is any changed class annotated with @Public(Evolving): no
The serializers: no
The runtime per-record code paths (performance sensitive): no
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no
The S3 file system connector: no

Documentation

Does this pull request introduce a new feature? no

It seems that:

flink-connector-mongodb has been released v1.0.0 already but does not have the v1.0 branch and the main  branch artifact version is still 1.0-SNAPSHOT. IIUC, after v1.0.0 released, it should be updated to 2.0-SNAPSHOT?
flink-connector-aws has been released v4.1.0 already but does not have the v4.1 branch. In Branch model, we can find the following description: branches are called v<major>.<minor>, for example v3.2. If I understand correctly, we should have a v4.1 branch.

@MartijnVisser Sorry to bother you, but I really want to hear your advice.

@reswqa I performed these releases so will fix the missing branches. For AWS connectors I would rather not promote main to 5.0-SNAPSHOT since this means we need to create PRs against both v4.x and main. This creates additional work on the developers and maintainers. But agree there should be a v4.1 branch

@dannycranmer Thank you for your willingness to help fix the branch missing problem.

For AWS connectors I would rather not promote main to 5.0-SNAPSHOT until we have breaking changes that require a 5.x, otherwise we need to create PRs against both v4.x and main.

I'm a little curious, why do we still have non-bugfix changes that need to be picked to the v4.0 branch even though v4.0.0 version has been released?

Minor (4.x) versions are not just for bug fixes, they are for non-breaking changes. A jump from 4.x to 5.x indicates a breaking change which we try to avoid. So ideally we stay on the 4.x path for longer. Right now we have released 4.0 and 4.1 and are working on 4.2.

Thanks for the clarification!

@flinkbot run azure

Ok, branches should be good. I have left the -docs branches there for now since open PRs might reference them. I will clean up later. Sorry for the inconvenience, I will update the release process incase it is wrong, or follow it better next time!

Never mind, thanks for fixing it so quickly 👍

Looks like CI is happy now!

@dannycranmer Would you taking a look at this changes?

Thanks @reswqa, LGTM


Simplify published release display name

As discussed in https://github.com/MinecraftFreecam/Freecam/pull/195#discussion_r1631149718, we can simplify the pattern used here to be shorter and less redundant.
I've changed it:
From "[Fabric] Freecam 1.2.4 for MC 1.20.4"
To "1.2.4 for MC 1.20.4 (fabric)"
Using the pattern, where project.name is the gradle (sub) project, i.e. fabric, neoforge, common, etc:
"${rootProject.mod_version} for MC ${rootProject.minecraft_version} (${project.name})"

1.2.4 (for MC 1.20.4 fabric) could also work :thinking:


Youtube-dl isn't ignoring when video format isn't available

I'm using youtube-dl for about almost a year. But today I faced a problem which wasn't there before. As I said, I can't download a full playlist of HD videos. I used -i and also used --ignore later but problem is still up. I used like this:

youtube-dl -f 136+251 -i --skip-unavailable-fragments "My_preferred_Link"
The result is:
[download] Downloading video 32 of 154
[youtube] 0ZOmylyFZQQ: Downloading webpage
ERROR: requested format not available
I tried to download with different OS but the result is still same. If you wanna try, my link was use this:
youtube-dl -f 136+251 -i --skip-unavailable-fragments "https://www.youtube.com/playlist?list=PLgH5QX0i9K3oAZUB2QXR-dZac0c9HNyRa"

Please help me out......Thanks in advance.......Rafi

I have the same problem - at least since last week. "-i" flag does not work. Please fix!


Add option of "existingSecret" for oneuptimeSecret and encryptionSecret

Is your feature request related to a problem? Please describe.
We can't use "external" secrets to add custom values for oneuptimeSecret and encryptionSecret. This makes insecure this secret when we want to upload the helm values file to a repository.
Describe the solution you'd like
Like in the configuration of externalPostgres, add to the configuration of the Helm chart to enable use custom existing secret.
Describe alternatives you've considered
If I'm right, in _helpers.tpl should be something like this:
- name: ONEUPTIME_SECRET
  {{- if $.Values.oneuptimeSecret }}
  value: {{ $.Values.oneuptimeSecret }}
  {{- else }}

  {{- if $.Values.externalOneuptimeSecret.existingSecret.name }}
  valueFrom:
    secretKeyRef:
        name: {{ printf "%s" $.Values.externalOneuptimeSecret.existingSecret.name }}
        key: {{ $.Values.externalOneuptimeSecret.existingSecret.passwordKey }}
  {{- else }}
  valueFrom:
    secretKeyRef:
      name: {{ printf "%s-%s" $.Release.Name "secrets"  }}
      key: oneuptime-secret
  {{- end }}
  {{- end }}

Same for ENCRYPTION_SECRET

This is merged in already. Closing this.


3rd party library did not work on Production

Please provide us with the following information:

angular-cli: 1.0.0-beta.5
node: 5.10.0
os: linux x64
The 3rd library did great in development. In prod,  the 3rd lib was not defined. I got the following logs:

ORIGINAL EXCEPTION: ReferenceError: tingle is not defined
ReferenceError: tingle is not defined
at a.removeItem (index.js:1)
at b._View_a1._handle_click_27_0 (a.template.js:710)
at eval (main.js:22)
at eval (main.js:13)
at eval (main.js:12)
at ZoneDelegate.invoke (zone.js:323)
at Object.inner.inner.fork.onInvoke (main.js:21)
at ZoneDelegate.invoke (zone.js:322)
at Zone.runGuarded (zone.js:230)
at a.runInnerGuarded (main.js:21)
Please help me solve this issue. Thanks so much.

Did you follow https://github.com/angular/angular-cli/wiki/3rd-party-libs for adding your third party library?
If you're trying to add javascript as script tags, you have to instead load it via SystemJS, see https://github.com/angular/angular-cli/issues/1015

Declaring it as global, then it works great.
Thanks so much.


Remove checkStyle

Why
We can remove checkStyle because it can only be used for Java and has been replaced completely by detekt.
So let's remove anything related to checkStyle accordingly 🎸
Who Benefits?
Developers will have a cleaner codebase with less chance for confusion
I think this is essential, because it helps with maintaining code quality

@Tuubz This one is optional imo since it's integrated without no issues, removing it will take our effort.

@luongvo Hmmm, if I'm not mistaken we're not using it anymore (we don't have any Java classes left in our code)
Wouldn't you say it would be essential to have it removed (to avoid confusion and to maintain clean code) 🙏
If we decide it to be optional, it would mean that we could add a flag to our script to include checkStyle 🤔

If we decide it to be optional, it would mean that we could add a flag to our script to include checkStyle 🤔

@Tuubz Hmm, I forgot this point, so I agree to set this task to be essential, we should remove checkStyle but it's not in rush.


Rationalize option names

Our option names do not match as described in https://github.com/chartjs/Chart.js/issues/5191.  E.g. global showLines vs. controller/dataset showLine. And pointBackgroundColor vs element.point.backgroundColor. We should make the option names match and remove the non-matching versions
Also, we should align the bubble and line options as described in https://github.com/chartjs/Chart.js/issues/5572

Closing since this is not going to make it into v3.


New release

Hi,
First of all, let me thank you for this, it's really helpful.
I'm using it to automatically verify backups and it's going great.
Unfortunately the latest release (1.0.2) does not include the "read_data_subset", although the code in the repository does. Would it be possible to release a new version?
Thanks!

@Edzilla2000 - Thanks for the reminder! I've just published a new release:
https://github.com/mtlynch/resticpy/releases/tag/1.0.3