TS server crashes and restarts

Issue Type: Bug
I work in a mono repo with 180+ npm packages using TypeScript.
The mono repo is using rush, the package.json and tsconfig files reference some parent files.
Some features are consistently slow (autocomplete, reference search) and "JS/TS langugage feature" regularly restarts automatically.

Yes it still reproduces after restarting with all extensions disabled.
Le mar. 22 sept. 2020 à 19:04, Matt Bierner<EMAIL_ADDRESS>a
écrit :

Does this reproduce with all extensions disabled
https://github.com/microsoft/vscode/wiki/Performance-Issues#run-with-extensions-disabled
?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/microsoft/vscode/issues/107249#issuecomment-696853231,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AA3APFWBF5TSUKDE4RH4FFTSHDKJNANCNFSM4RV7PXKQ
.

Can you share the project that causes this?
Also, have you followed the guidance for working with large TypeScript projects?


Fybrik application taxonomy - modifying for taxonomy generator

This PR makes the following changes:

[x] adds AppInfo and Interface to base.yaml and layers to validate Fybrik applications
[x] moves the JSON files in config/taxonomy/objects to charts/fybrik/files/taxonomy
[x] modifies Makefile and codegen spec in config/taxonomy to point to new path of taxonomy JSON files
[x] modifies Fybrik application webhook and webhook test to read from new fybrik_application.json taxonomy file in ConfigMap
[x] adds webhook test to validate against base taxonomy
[ ] modifies Reconciler to read from fybrik_application.json taxonomy file in ConfigMap

Dependent on merge of #760
Completes some tasks in #752

How different is the taxonomy.jason in testdata/basetaxonomy and testdata/enhencedtaxnonmy from the generated taxonomy using bases and examples?
Are there any differences? if no, can you think of a way for the files in testdata/basetaxonomy to be generated during (or before) the test run? and not to have duplicated in the git? I am worried about their long-run maintenance.

There are a lot of differences.. taxonomy.json in enhanced taxonomy checks the values and pairs of dataformat/protocol and also checks the intent and role and makes sure it is one of the values defined in the enum. The taxonomy.json in the base taxonomy does not check any values and seems unnecessary for a FybrikApplication since the FybrikApplication CRD checks everything that the base taxonomy checks (if AppInfo and Interface exist)


Beta 2

Remove @villedemontreal/lint-config :-)
Remove tslint and prettier scripts
Replace by lint with eslin/prettier
Use prettier config defaults

The scripts used by the library itself should be located in /scripts and not in src/scripts. If you look at https://github.com/etiennegingras/node-scripting/blob/beta-2/run you will see that the variable scriptsIndexModule points to ./scripts/index. It is in this Index file that you should export the scripts used by the library itself. Once the scripts have been moved from src/scripts to /scripts, we will have to adjust this Index /scripts/index.ts so that it exports these scripts... Then running ./run lint into the library itself should work.

The file https://github.com/etiennegingras/node-scripting/blob/beta-2/src/coreScriptBase.ts should be deleted because there is no more notion of "core" scripts provided by the library. Projects/libraries will now have to define their own scripts, including lint and lint-fix. It is in the API and library templates that we will put these default scripts.

We need to rework the /src/main.ts file so that no more core scripts are added automatically.

You can refer to my PR on Bitbucket for more details on these points.
Once these points have been worked on, I will revisit your PR. Thank you!

Also, the library should have a major version increase (ie: 2.0.0) because there are breaking changes.

Could you adjust the prettier config in order to use single quotes, to avoid all this noise in the diff, especially since it we are using all over the place in our code base!
See singleQuote option in https://prettier.io/docs/en/configuration.html
Tks.

@etiennegingras Est-ce que cette version est prête à être révisée?


I found an escape bug，at line 353 of the adafruit_miniesptool.py file

https://github.com/adafruit/Adafruit_CircuitPython_miniesptool/blob/c756294fbad3f37c6d936d36918df2f25f25a3cf/adafruit_miniesptool.py#L353
https://github.com/espressif/esptool/wiki/Serial-Protocol#low-level-protocol
Each SLIP packet begins and ends with 0xC0. Within the packet, all occurrences of 0xC0 and 0xDB are replaced with 0xDB 0xDC and 0xDB 0xDD, respectively. The replacing is to be done after the checksum and lengths are calculated, so the packet length may be longer than the size field below.
reply += b"\xDC"   ===>>  reply += b"\xDB"

hi not sure exactly what you're referring to, can you submit a PR with your fix?

Fixed via #25.

Fixed via #25.


Question: Commands, colors and initial events quests.

I hate to be a bother but I've been really digging deep into this plugin (making a personal guide as well)
I haven't been able to find a guide anywhere as far as the acceptable text colors and commands it will accept.
On text colors:
I checked the en.yml and saw that colors like silver and etc were used however when using them inquest text prompt "wordshere words here"
Some refuse to work, others do but from testing; Brown, Gray, lime, magenta, silver, orange, cyan and lightblue so far will not work.
I've juggled between minecraft text color codes and .
As well it seems text color codes absolutely do not work with objective display override.
I am fine with it being green just unsure if text codes are supposed to work there.
 On commands:

I am just completely lost on how to get command events to work.
Are they limited to only vanilla commands?
Some way to extend into other plugins commands?
   On initial events:

Every time I've set up a quest and inserted an 'initial event' it somehow gets removed and I am left with attaching the event to stage 1 instead.
Thanks for the time and work.

If it's text then here are the acceptable colors: https://hub.spigotmc.org/javadocs/bukkit/org/bukkit/ChatColor.html
Perhaps you were looking at this, which is used for particles and dyes: https://hub.spigotmc.org/javadocs/bukkit/org/bukkit/Color.html
As for the other questions you'll need to detail the steps you took.

Ah ok so the second link is indeed what I was looking at for chat colors and thought maybe quests plugin extended acceptable chat colors. Though I know better now apologies and thank you.
The steps I use for commands on events and quests are as follows.
/quests events
2-edit events
-eventname-
17-set commands to execute
Then during the commands prompt I've attempted using slash(/) and without slash and cannot get it to run some special commands.
.
I had wanted to possibly have quests run a ranking command to rank a player with bpermissions or similar. As well I wanted to have it possibly run the spawn command for mythic mobs.
Another command would be when the player triggers the event it would do a server announcement via broadcast command. "player has done xxx" or another.
A command to perhaps /press button /toggle lever
Of course these would rely on quests being able to prompt into other plugins commands.
Internally allowing an event to force a player into a quest, like a event that would use questsadmin @p or  and force them into another quest or progress the current quests stage.
The applications are immense if I could given the event triggers.
Those are just a few command options among others I can possible think of applying. I haven't been able to get anything like above to actually work.
As far as the other question I follow this process to insert a simple initial event that prompts text and gives the player a boat.
/quests editor
2-edit a quest
-questname-
8-set initial event
-eventname-
13-save
1-yes
/questsadmin reload
At this time quests are reloaded. Upon using /quests editor and going into the quest I just saved with an initial event the initial event is now (none) despite actions formerly took registered the initial event with (eventnamehere)
Speaking of events and the way they work I might ask why on a stage is each event trigger limited to one event, it would be very interesting to affix a specific event to specific chat words instead of one event for any of the chat words.  Combine the multiple chat event triggers with commands and the outcomes get interesting and endless.
I apologize to unload such a huge wall of text.

Sorry to put another small wall of text but I had forgotten to add the portion of text colors for the override objective portion.
/quests editor
1-create new quest
-named-
11- edit stages
1-add new stage
20- custom objective ----------Here is where I've attempted to use color codes only to have it display as:

As you can see option 22- set start text- Will display proper color codes as does 23-set finish test
I wasn't sure if custom objective display was locked at only green or if this was an issue.
However I have found an issue it is in regards to using color codes for a quests name.
Unfortunately the quest you see above I can no longer edit!
As after the quest is saved it applies the color codes and removes them, but they are still a part of the name.
The gui seems to think Color Code Test is an invalid name I even tried Color_Code_Test and with &4Color &3Code &2Test with no success.
The fate is the same for & color coding and <> Color coding.
Which leaves me to forcibly go into the quests.yml to edit the quest or remove the color coding.

For your first question regarding commands, I cannot duplicate that on my test server. I used "/bcast success!" as my test command. In the event editor (/quests events), I created a new eventIn the stage editor (inside /quests editor), I added a start event for my quest

Sorry about the close/re-open, accident.
For your first question regarding commands, I cannot duplicate that on my test server. I used Essentials' /bcast success! as my test command. In the event editor (/quests events), I created a new event and Set commands to execute as "bcast success!" without the / (using the / just runs the command). Then, in the stage editor (inside /quests editor), I set the start event for my quest as the event I just made. Upon taking the quest, I saw "[Broadcast] success!" in-chat.
For your second question about colors, quest names are not intended to support that. This is evident in your picture by the ")---" following your quest name keeping the green color instead of staying gold. If you would like to request this feature, please open a new Issue with that information and I'll get to it once the remaining bugs have been ironed out. For now, avoid using colors in quest names.
On that note, I actually will close this as your original question has been answered. Gracias! :)


BUGFIX replace refs of Options with Variations

request caching

saves 4 queries while checking isAvailable()

I think I need to remove the getter/setter for isAvailable(), as I can't get tests to pass. Maybe I'll split that part out for now.


Remove jQuery .attr from the branch/tag selector

Switched from jQuery .attr to plain javascript .setAttribute
Tested the cherry-pick from the branch/tag selector and it works as before

We have jQuery in Vue? Who let that through?

Maybe you 😆


WIP: try adding deployment for pvc gitsync

What issues does your PR fix?

Attempt to fix #283, although not sure if this PR is the right way of implementing it, I just wanted to kickstart something

What does your PR do?
This PR is a quick attempt to bring a single git-sync pod that would update the dags on a PVC, and the rest of the pods can just mount this diirectory instead of cloning the repos over and over again. I am not sure if this is the right way to go btw, I am open to feedback, and I haven really tested this yet.
There is a very good chance that this is a completely wrong way of implementing this, in which case I'd be totally okay to close the PR.
Checklist
For all Pull Requests

[ ] Commits are signed off
[ ] Commits have semantic messages
[ ] Documentation updated
[ ] Passes ct linting

For releasing ONLY

[ ] Chart.yaml version bumped
[ ] CHANGELOG.md updated

The more that I think about this, the more it doesn't make sense to try to keep three strategies to copy the files tbh.
Currently, if this PR or sth along the way goes forward, we'll have 3 ways of doing this:

git sync, running on every worker pod every time the task is launched, a.k.a status quo with gitSync.enabled: true
persistent volume: no git-sync, just some dag data in the volume
git sync + persistent volume: what this PR seems to propose

for the people that are currently using the first option, replacing it with number 3 doesn't really make any difference, with a small change though: if those people have DAGs that are creating files on the local volumes and whatever, that means that if we mount the shared volume directly on the pods, they might write stuff that are propagated to other pods as well, whereas in the status quo with git sync this never happens; therefore, rolling out option 3 would be a breaking change.
here's what I propose instead:

keep the current values file, and majority of the changes in this PR.

I am assuming this is kinda the right way of doing things, but regardless, the idea is to make it work with a separate deployment that populates a PV.

instead of running git-sync as an init container in every pod, do the following:

mount the PVC to a random location
run an barebones init container that copies the files from the PVC into the dags path in the values file

if we manage to do it this way, it'd mean that:

the chart could keep the backwards compatibility
we'd reduce the chance of unknown failures by a lot after an upgrade

it might very well be the case that the cluster admin is not on top of every DAG: in case someone had a DAG that does sth with the DAG directory, the end result of mounting the directory directly might cause a lot of trouble without no one noticing.

@thesuperzapper what do you think? I can try to advance this PR towards this way if you'd be up guiding me a bit.

I went ahead and attempted doing the change with the copy trick, but there are a couple of things not working still:

I changed the securityContext because I couldn't make the volume writeable otherwise, not sure if that's the right way though
for some reason the git secret is not being mounted with the correct permissions, and git sync is not accepting those permissions, hence failing to pull the images

I'll try to work on this soon again, but leaving in case you can tackle it.

I think I have managed to get it working: the contents are being properly mounted, scheduler is able to see and schedule tasks as well. My local setup is not that good, so I am not able to test the whole flow, but as far as these changes are concerned, I think it is in an okay shape.
the things missing are:

security contexts are a bit of a mess, I don't know what I am doing there, so they need to be double-checked for sure.
maybe there needs to be some sort of a signal that the contents are fetched before the worker pods start?

it might be the case that the first time this is deployed, maybe the scheduler runs the copy before the dags are fetched?
we might need to add another init container to check if the repo is fetched already.

I haven't really tested regular flows.

any feedback is appreciated.

Another usecase for sth like this:

currently if you have gitSync enabled, it means every pod will have a gitSync sidecar running.
The problem with this is that if GitHub is down for example, gitSync sidecars will bring all of the airflow pods down as well instead of gracefully handling the failure.
In that case, all the gitSync containers are failing to fetch the repo, which is, for some reason, causing them to restart all the pods continuously.
This means in the case of the Git repo being unaccessible, everything about Airflow is being down as well.

For processes like gitSync where maybe 90% of the fetch operations do not change anything, I'd like to be able to set some sort of a failure strategy for the gitSync operation so that it doesn't bring Airflow down for everyone, and work with the stale copy of the DAGs where necessary. Having a separate deployment allows doing that.

Any news on this PR ?

@ohayak @karakanb sorry for the delay in reviewing this (was moving countries, lol), I will take a look soon.
@karakanb I see that you still have WIP on this PR, is this ready for review (so I can target it for 8.7.0 of the chart)?


WrappedComponent.defaultProps is missing in mapStateToProps

class Foo extends React.Component {
  render() {
    return
this.props.bar

  }
}

Foo.defaultProps = {
  bar: 'baz'
}

module.exports = connect(function mapStateToProps(state, props) {
  console.log(props.bar) // undefined
})(Foo)

connect() returns a new component. If you'd like defaultProps to be present on it, you need to put defaultProps on it:
class Foo extends React.Component {
  render() {
    return
this.props.bar

  }
}

Foo = connect(function mapStateToProps(state, props) {
  console.log(props.bar)
})(Foo)

Foo.defaultProps = {
  bar: 'baz'
}

module.exports = Foo;

@gaearon shouldn't this be handled by the library? It doesn't feel very intuitive this way, and doing the opposite (delete-ing the defaultProps property from the wrapper element) could certainly help.

No, the current behavior makes sense based on both the tooling, the language syntax, and the conceptual idea of defining "original" components vs defining wrappers for them.

But this doesn't work with new syntax static defaultProps inside the class...

@gaearon Dan is the solution you mentioned still applicable or do we have a better solution to achieve this ?


Support for Groovy

Defining rules in Java using Lambda is awesome. But Groovy doesn't currently support Lambda; it uses Groovy closures.
Given how much I personally love Groovy and that Groovy scripting could be used to externalize (and version) RuleBooks, I think RuleBook needs to be Groovy too!

Given the differences between Groovy projects and Java 1.8+ projects (Jacoco vs Cobertura, JUnit vs Spock, etc.), I think it makes sense to move rulebook-groovy to another repo. That will probably be done this week.


[PDI-17622] Build Model step works fine in Spoon but fails from Kitchen

Build Completed
:fire: This pull request has some issues. It would be preferable to fix them in order for it to be just perfect. See below for more details. Some links are also available below for further assistance in addressing those issues.
Build Commands
mvn -B -f 'pom.xml' -pl 'engine,core' -P '!assemblies' -Dsurefire.runOrder=alphabetical -Daudit -amd clean install

Cleanup Commands
mvn -B -f 'pom.xml' -pl 'engine,core' -P '!assemblies' -amd build-helper:remove-project-artifact

Changed files
  core/src/main/java/org/pentaho/di/core/plugins/PluginRegistry.java
  engine/src/main/java/org/pentaho/di/job/entry/JobEntryCopy.java

Unit Test Coverage
These statistics help you identify how your changes have affected the coverage of the following files. If a file is not in this list, then its coverage was not affected by your changes. To get some help interpreting these metrics, please refer to Jacoco's documentation.

:warning: Coverage Changes (click to expand)
org.pentaho.di.core.plugins.PluginRegistry

Branch Change: -2.7% :small_red_triangle_down:
Complexity Change: -1.8% :small_red_triangle_down:
Instruction Change: -1.1% :small_red_triangle_down:
Line Change: -1.2% :small_red_triangle_down:
Method Change: -1.6% :small_red_triangle_down:

org.pentaho.di.job.entries.evaluatetablecontent.JobEntryEvalTableContent

Branch Change: -1.1% :small_red_triangle_down:
Complexity Change: -1.1% :small_red_triangle_down:
Instruction Change: -0.1% :small_red_triangle_down:

org.pentaho.di.job.entry.JobEntryCopy

Instruction Change: -0.1% :small_red_triangle_down:

org.pentaho.di.trans.steps.datagrid.DataGridMeta

Branch Change: -2% :small_red_triangle_down:
Complexity Change: -1.7% :small_red_triangle_down:
Instruction Change: -0.2% :small_red_triangle_down:

org.pentaho.di.trans.steps.dbproc.DBProcMeta

Instruction Change: -0.1% :small_red_triangle_down:

org.pentaho.di.trans.steps.dimensionlookup.DimensionLookupMeta

Method Change: -1% :small_red_triangle_down:

org.pentaho.di.trans.steps.memgroupby.MemoryGroupByMeta

Branch Change: -2.2% :small_red_triangle_down:
Complexity Change: -2.6% :small_red_triangle_down:
Instruction Change: -0.1% :small_red_triangle_down:
Line Change: -0.4% :small_red_triangle_down:

org.pentaho.di.trans.steps.rowgenerator.RowGeneratorMeta

Branch Change: -2.6% :small_red_triangle_down:
Complexity Change: -1.5% :small_red_triangle_down:
Instruction Change: -0.1% :small_red_triangle_down:

org.pentaho.di.trans.steps.singlethreader.SingleThreaderMeta

Instruction Change: -0.1% :small_red_triangle_down:

org.pentaho.di.trans.steps.googleanalytics.GaInputStepMeta

Branch Change: -1.9% :small_red_triangle_down:
Complexity Change: -1.1% :small_red_triangle_down:
Instruction Change: -0.2% :small_red_triangle_down:
Line Change: -0.3% :small_red_triangle_down:


Directory of Brewfiles?

My use case is that I'm using Stow to manage my dotfiles. If I do stow zsh to symlink my zsh config files, I might create ~/.config/homebrew/Brewfile.zsh. After I run stow on all of my packages, it would be really cool to be able to just do brew bundle --dir=~/.config/homebrew and have all of my dependencies installed automatically.
If this is not possible in the main homebrew-bundle project, is there at least some way to have ~/Brewfile include/require other brewfiles?
Sorry if this is a weird request. I'm trying to break my dotfiles up into separate components without strict dependencies on other components.

As a basic example, I tried putting these files in the same directory:
Brewfile:
brew 'readline'

load "Brewfile.subfile"

Brewfile.subfile:
brew 'xz'

and then ran brew bundle. I also tried it with require and include in the main Brewfile instead of load, but nothing worked.
I'm a bit of a Ruby n00b, so if I'm doing something dumb, feel free to break out the clue-by-four.

require and load only work if the referenced file is in Ruby's LOAD_PATH (a concept similar to PATH in the shell) or if the full path is given. include does something completely different. Since a Brewfile is just Ruby code, you can do something like this to load all Brewfile.* files in a directory:
Dir["#{File.dirname(__FILE__)}/Brewfile.*"].each do |sub_file|
  load sub_file
end

This will locate the files relative to the main Brewfile and in the order they are returned by Dir[].

As @UniqMartin said this should be possible with require or load from Ruby. Feel free to keep talking in here but closing this out. Thanks!

@cweagans Were you ever successful in getting this working? I am doing something similar, I have tried the code above but I just get
Error: Invalid Brewfile: wrong number of arguments (1 for 0) but if I run each file individually with
brew bundle --file=Brewfile-work it is fine

@REBELinBLUE What are the contents of your primary Brewfile (that, I suppose, is loading the others)? Have you copied my above snippet verbatim? What are the file names of the other Brewfiles you'd like to load from there?

Well mine is slightly different. I have 3 files all, work and personal
https://github.com/REBELinBLUE/dotfiles/blob/master/brewfiles/all is my main file, I was trying to include it in https://github.com/REBELinBLUE/dotfiles/blob/master/brewfiles/personal and https://github.com/REBELinBLUE/dotfiles/blob/master/brewfiles/work by using
load 'all' at the top but that gave me there error, so I renamed it to Brewfile.all just to try your snippet and used that instead and I still got the error, but if I run any of the files separately I don't get the error

load requires a full path (or the file needs to be in Ruby's search path, something that doesn't make sense for the Brewfiles). Can you try load "#{File.dirname(__FILE__)}/all" instead of load 'all'?

Sorry, I should have said I tried that as well

I'll post my Dotfiles later. Mobile right now. If I haven't replied here in 24 hrs, feel free to nag me publicly :)

I just checked and realized that the suggested approach cannot work because of how brew bundle reads and processes a Brewfile. I don't think there's currently a viable way to include a Brewfile from another. Making that work would require quite a few changes to the internals of brew bundle.
 (This should work right now, but is admittedly a bit ugly.)
Implement --dir= as an alternative to --file= that would process all files from the given directory  (as described in the top comment).
Implement another directive alongside brew, cask, and tap that can be used in a Brewfile and allows including the contents of another file.

(The latter two options would require someone to step up and implement this. As I'm not a maintainer of this project, I cannot say whether any of those additions is preferable and if it would be accepted.)

Ah well never mind, thanks anyway for your help

Ah, yeah, looking at it now, I am concatenating the brewfiles together as part of a shell script.

 (This should work right now, but is admittedly a bit ugly.)

I think this is the preferred option as it's a relatively niche use-case.

Thanks for the tip. I think I will be using a command like find -H . -name 'Brewfile' -print0 | xargs -0 cat | brew bundle --file=-, then. I haven't used brew bundle before, so am looking to work it into my process now!


Calculate mechanism state from Quaternion?

Hi,
I am trying some custom-built controller with Dojo simulator, but I could not find the full mechanism state I need.
I can get the mechanism state with "get_minimal_state(mechanism)", however it is just for one time step. The "Storage" variable stores full trajectories from simulation but it does not include the mechanism state (the closest one I guess is the Quaternion in "Storage.q").
Is there any built-in function in Dojo so that I can transfer those Quaternion to system states? If not, do you have any suggested approach for me to attempt?
Thanks for your help!

Please check out following functions for converting states:
minimal_to_maximal(mechanism, y)
maximal_to_minimal(mechanism, z)


Cannot build in VSTS - Dotnet command failed with non-zero exit code

Without making any changes to our project files, just regular code update, our builds started to fail from this monday - 21/08/2017. During the build, in the log, we get the following error at the Restore step:
Error: C:\Program Files\dotnet\dotnet.exe failed with return code: 1
And
Dotnet command failed with non-zero exit code on the following projects : d:\a\1\s\BD.YRD.Tests\BD.YRD.Tests.csproj
We have not made any changes to the Tests csproj. We only tried to remove the test project just to see if it builds but then it started to throw the same error for the main web project. We use hosted2017 agent. Our .net core project is 1.1.1.
Any ideas how to solve it?
This is the output from our .net info step:
2017-08-23T08:01:05.6316895Z ##[section]Starting: Info
2017-08-23T08:01:05.6596901Z ==============================================================================
2017-08-23T08:01:05.6596901Z Task         : .NET Core
2017-08-23T08:01:05.6606897Z Description  : Build, test and publish using dotnet core command-line.
2017-08-23T08:01:05.6606897Z Version      : 1.0.2
2017-08-23T08:01:05.6606897Z Author       : Microsoft Corporation
2017-08-23T08:01:05.6606897Z Help         : More Information
2017-08-23T08:01:05.6606897Z ==============================================================================
2017-08-23T08:01:07.3557124Z [command]"C:\Program Files\dotnet\dotnet.exe" --info d:\a\1\s\BD.YRD.Tests\BD.YRD.Tests.csproj
2017-08-23T08:01:09.3707368Z .NET Command Line Tools (2.0.0)
2017-08-23T08:01:09.3807382Z
2017-08-23T08:01:09.3807382Z Product Information:
2017-08-23T08:01:09.3857379Z  Version:            2.0.0
2017-08-23T08:01:09.4357389Z  Commit SHA-1 hash:  cdcd1928c9
2017-08-23T08:01:09.4357389Z
2017-08-23T08:01:09.4387377Z Runtime Environment:
2017-08-23T08:01:09.4387377Z  OS Name:     Windows
2017-08-23T08:01:09.4387377Z  OS Version:  10.0.14393
2017-08-23T08:01:09.4707381Z  OS Platform: Windows
2017-08-23T08:01:09.5137399Z  RID:         win10-x64
2017-08-23T08:01:09.5137399Z  Base Path:   C:\Program Files\dotnet\sdk\2.0.0
2017-08-23T08:01:09.5137399Z
2017-08-23T08:01:09.5137399Z
2017-08-23T08:01:09.5137399Z Microsoft .NET Core Shared Framework Host
2017-08-23T08:01:09.5137399Z
2017-08-23T08:01:09.5137399Z
2017-08-23T08:01:09.5137399Z
2017-08-23T08:01:09.5137399Z   Version  : 2.0.0
2017-08-23T08:01:09.5137399Z
2017-08-23T08:01:09.5137399Z   Build    : e8b8861ac7faf042c87a5c2f9f2d04c98b69f28d
2017-08-23T08:01:09.5137399Z
2017-08-23T08:01:09.5137399Z
2017-08-23T08:01:09.5137399Z
2017-08-23T08:01:09.5147402Z [command]"C:\Program Files\dotnet\dotnet.exe" --info d:\a\1\s\BD.YRD.Web\BD.YRD.Web.csproj
2017-08-23T08:01:09.5147402Z .NET Command Line Tools (2.0.0)
2017-08-23T08:01:09.5147402Z
2017-08-23T08:01:09.5147402Z Product Information:
2017-08-23T08:01:09.5147402Z  Version:            2.0.0
2017-08-23T08:01:09.5147402Z  Commit SHA-1 hash:  cdcd1928c9
2017-08-23T08:01:09.5147402Z
2017-08-23T08:01:09.5147402Z Runtime Environment:
2017-08-23T08:01:09.5147402Z  OS Name:     Windows
2017-08-23T08:01:09.5147402Z  OS Version:  10.0.14393
2017-08-23T08:01:09.5147402Z  OS Platform: Windows
2017-08-23T08:01:09.5147402Z  RID:         win10-x64
2017-08-23T08:01:09.5147402Z  Base Path:   C:\Program Files\dotnet\sdk\2.0.0
2017-08-23T08:01:09.5147402Z
2017-08-23T08:01:09.5147402Z
2017-08-23T08:01:09.5147402Z Microsoft .NET Core Shared Framework Host
2017-08-23T08:01:09.5147402Z
2017-08-23T08:01:09.5147402Z
2017-08-23T08:01:09.5147402Z
2017-08-23T08:01:09.5147402Z   Version  : 2.0.0
2017-08-23T08:01:09.5147402Z
2017-08-23T08:01:09.5147402Z   Build    : e8b8861ac7faf042c87a5c2f9f2d04c98b69f28d
2017-08-23T08:01:09.5147402Z
2017-08-23T08:01:09.5147402Z
2017-08-23T08:01:09.5147402Z
2017-08-23T08:01:09.5387414Z ##[section]Finishing: Info

Do you have a global.json in your project that locks you to a particular version of the SDK?

Hi chrisrpatterson, no we do not have global.json. Actually, that was the first thing I tried to do - adding a global.json with targetting the SDK that we use locally but that did not help, so I took it out again.

Can we get access to the customer's project or at least the full build log to investigate why 2.0 is failing to restore? You can send me mail at rlander@ms.

@jakubsvobodacz what is your account name and what is the name of the build definition in question?

Hi both,
Our vsts is on: https://nnit-code.visualstudio.com/YardstickApp
Build definition name: YardstickApp-ASP.NET Core-CI

logs_322.zip

@jakubsvobodacz i think he means @microsoft.com

@jakubsvobodacz I cannot access the VSTS account, what is the target framework of your test project and the "main" project?
from the error, it could be a variation of ,
https://developercommunity.visualstudio.com/content/problem/95070/could-not-load-file-or-assembly-systemruntime-vers.html

I deleted the test project. We did not have any tests. The project was basically empty for now. the Target framework for web project is .NET Core 1.1
then we have Database project with target platform Azure SQL db V12

@jakubsvobodacz so the problem still persists? Or there was no test project from the beginning?
From the log, the build try to restore the test project,
2017-08-23T08:24:15.0811604Z [command]"C:\Program Files\dotnet\dotnet.exe" restore d:\a\1\s\BD.YRD.Tests\BD.YRD.Tests.csproj
2017-08-23T08:24:20.0549811Z   Restoring packages for d:\a\1\s\BD.YRD.Tests\BD.YRD.Tests.csproj...
2017-08-23T08:24:20.0669831Z   Restoring packages for d:\a\1\s\BD.YRD.Web\BD.YRD.Web.csproj...

And then, it seems failed due to the p2p reference from the Tests.csproj to the Web.csproj
2017-08-23T08:25:20.8041720Z d:\a\1\s\BD.YRD.Tests\BD.YRD.Tests.csproj : error NU1105: Unable to find project information for 'd:\a\1\s\BD.YRD.Web\BD.YRD.Web.csproj'. The project file may be invalid or missing targets required for restore.

But we do not have any references in the csproj or I do not see any:

  <PropertyGroup>
    <TargetFramework>netcoreapp1.1</TargetFramework>
  </PropertyGroup>

  <PropertyGroup>
    <PackageTargetFallback>$(PackageTargetFallback);portable-net45+win8+wp8+wpa81;</PackageTargetFallback>
  </PropertyGroup>

  <PropertyGroup>
    <UserSecretsId>aspnet-BD.YRD.Web-002b42cb-017c-46ce-a7e1-d5a5c37ab084</UserSecretsId>
    <WebProject_DirectoryAccessLevelKey>0</WebProject_DirectoryAccessLevelKey>
  </PropertyGroup>

  <ItemGroup>
    <Compile Remove="Views\Shared\Components\**" />
    <Content Remove="Views\Shared\Components\**" />
    <EmbeddedResource Remove="Views\Shared\Components\**" />
    <None Remove="Views\Shared\Components\**" />
  </ItemGroup>

  <ItemGroup>
    <PackageReference Include="Microsoft.ApplicationInsights.AspNetCore" Version="2.0.0" />
    <PackageReference Include="Microsoft.AspNetCore" Version="1.1.1" />
    <PackageReference Include="Microsoft.AspNetCore.Authentication.Cookies" Version="1.1.1" />
    <PackageReference Include="Microsoft.AspNetCore.Authentication.OpenIdConnect" Version="1.1.1" />
    <PackageReference Include="Microsoft.AspNetCore.Mvc" Version="1.1.2" />
    <PackageReference Include="Microsoft.AspNetCore.StaticFiles" Version="1.1.1" />
    <PackageReference Include="Microsoft.Azure.KeyVault.Core" Version="2.0.4" />
    <PackageReference Include="Microsoft.EntityFrameworkCore.Design" Version="1.1.2" />
    <PackageReference Include="Microsoft.Extensions.Configuration.UserSecrets" Version="1.1.1" />
    <PackageReference Include="Microsoft.Extensions.Logging.Debug" Version="1.1.1" />
    <PackageReference Include="Microsoft.VisualStudio.Web.BrowserLink" Version="1.1.0" />
    <PackageReference Include="Microsoft.EntityFrameworkCore.SqlServer" Version="1.1.2" />
    <PackageReference Include="Microsoft.EntityFrameworkCore.SqlServer.Design" Version="1.1.2" PrivateAssets="All" />
    <PackageReference Include="Microsoft.EntityFrameworkCore.Tools" Version="1.1.1" />
    <PackageReference Include="Microsoft.Extensions.Configuration.Json" Version="1.1.2" />
    <PackageReference Include="Microsoft.VisualStudio.Web.CodeGeneration.Design" Version="1.1.0" />
    <PackageReference Include="WindowsAzure.Storage" Version="8.1.4" />
  </ItemGroup>
  <ItemGroup>
    <DotNetCliToolReference Include="BundlerMinifier.Core" Version="2.4.337" />
    <DotNetCliToolReference Include="Microsoft.Extensions.SecretManager.Tools" Version="1.0.0" />
    <DotNetCliToolReference Include="Microsoft.VisualStudio.Web.CodeGeneration.Tools" Version="1.0.0" />
    <DotNetCliToolReference Include="Microsoft.EntityFrameworkCore.Tools.DotNet" Version="1.0.0" />
  </ItemGroup>

</Project>```

@jakubsvobodacz Is this project BD.YRD.Web.csproj? Could you also show me BD.YRD.Tests.csproj?
As the error shows, there is a file "BD.YRD.Tests\BD.YRD.Tests.csproj", if you removed the test project, could you double check if it is building the latest branch? Could you run the build again to see if it still has the error on the test project file?
Also could you try to restore both  BD.YRD.Web.csproj,  BD.YRD.Tests.csproj and could you send the pre process log to me by build with
 dotnet restore BD.YRD.Tests.csproj /pp > TestsProjPreprocessResult.txt
 dotnet restore BD.YRD.Web.csproj /pp > WebProjPreprocessResult.txt

and send TestsProjPreprocessResult.txt and WebProjPreprocessResult.txt  to wul at microsoft.com?

Ok, we did not notice that the test project was still present in the master branch. I deleted it directly in our vsts and now the build succeeded.

We also had this error in VSTS today, after updating the global.json's sdk version from 1.0.0 to 1.1.0.
d:\a\1\s\src\Test\Test.csproj : error NU1105: Unable to find project information for 'd:\a\1\s\src\Web\Web.csproj'. The project file may be invalid or missing targets required for restore.
The build succeed's when I change the sdk version back to 1.0.0.
Apparently the VSTS hosted build agent doesn't have the 1.1.0 sdk installed? https://www.visualstudio.com/en-us/docs/build/concepts/agents/hosted#hosted-vs2017

I'm hitting this issue as well.
For me, it seems that BundlerMinifier.Core is the offender. If you remove that tool, restore succeeds.

After updating to .NET Core 2.0, we're experiencing the same issue on VSTS.  Any test project referencing a .NET Core app 2.0 web project fails with "error NU1105: Unable to find project information for {the web project}"  If we remove the test project, then everything builds fine on VSTS.  If we add a reference to the web project from other test files, those fail also.

@trbngr Thanks.  This worked for me.
For others, to be more specific, comment out:
<DotNetCliToolReference Include="BundlerMinifier.Core" Version="X.X.XXX" />
The PackageReference can stay.

Yep same with EF core
<DotNetCliToolReference Include="Microsoft.EntityFrameworkCore.Tools.DotNet" Version="2.0.0" PrivateAssets="All" />

If I commented this line all sln build successfully. If not -> csproj builded, solution isn't.

@verysimplenick what did you do to fix your issue? I'm having the same issue.

HI All,
I have added the SonarQube task in my build for code analysis of .NetCore task, and its start falling since i added the SonarQube, when i am disabling the SonarQubethan its building else throughing error , below is the error-
Time Elapsed 00:00:04.04
2017-11-20T09:20:11.9948934Z ##[error]Error: C:\Program Files\dotnet\dotnet.exe failed with return code: 1
2017-11-20T09:20:11.9961930Z [command]"C:\Program Files\dotnet\dotnet.exe" build d:\a\1\s\Microsoft.Procurement.PurchaseOrderValidator\Microsoft.Procurement.Validators.Tests\Microsoft.Procurement.Validators.Tests.csproj /p:DeployOnBuild=true /p:WebPublishMethod=Package /p:PackageAsSingleFile=true /p:SkipInvalidConfigurations=true /p:DesktopBuildPackageLocation=d:\a\1\a\WebApp.zip /p:DeployIisAppPath=direct
2017-11-20T09:20:14.5701747Z Microsoft (R) Build Engine version <IP_ADDRESS>001 for .NET Core
2017-11-20T09:20:14.5701747Z Copyright (C) Microsoft Corporation. All rights reserved.
2017-11-20T09:20:14.5701747Z
2017-11-20T09:20:17.8759397Z d:\a\1.sonarqube\bin\targets\SonarQube.Integration.targets(165,5): error MSB4062: The "IsTestFileByName" task could not be loaded from the assembly d:\a\1.sonarqube\bin\SonarQube.Integration.Tasks.dll. Could not load file or assembly 'Microsoft.Build.Utilities.v4.0, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a'. The system cannot find the file specified. Confirm that the  declaration is correct, that the assembly and all its dependencies are available, and that the task contains a public class that implements Microsoft.Build.Framework.ITask. [d:\a\1\s\Microsoft.Procurement.PurchaseOrderValidator\Microsoft.Procurement.PurchaseOrderValidator.Infrastructure\Microsoft.Procurement.PurchaseOrderValidator.Infrastructure.csproj]
2017-11-20T09:20:20.9121442Z
2017-11-20T09:20:20.9301436Z Build FAILED.
2017-11-20T09:20:20.9301436Z
2017-11-20T09:20:20.9321448Z d:\a\1.sonarqube\bin\targets\SonarQube.Integration.targets(165,5): error MSB4062: The "IsTestFileByName" task could not be loaded from the assembly d:\a\1.sonarqube\bin\SonarQube.Integration.Tasks.dll. Could not load file or assembly 'Microsoft.Build.Utilities.v4.0, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a'. The system cannot find the file specified. Confirm that the  declaration is correct, that the assembly and all its dependencies are available, and that the task contains a public class that implements Microsoft.Build.Framework.ITask. [d:\a\1\s\Microsoft.Procurement.PurchaseOrderValidator\Microsoft.Procurement.PurchaseOrderValidator.Infrastructure\Microsoft.Procurement.PurchaseOrderValidator.Infrastructure.csproj]
2017-11-20T09:20:20.9331460Z 0 Warning(s)
2017-11-20T09:20:20.9331460Z 1 Error(s)
2017-11-20T09:20:20.9331460Z

@singhbibek - create a new issue

@deanilvincent , yes fixed in nuget https://github.com/NuGet/Home/issues/5941

Guys, I was having the same problem reported by jakubsvobodacz, but I managed to succeed in the build with a combination of adjustments, which I share with you:

My csproj (not test)

  <ItemGroup>
    <PackageReference Include = "Microsoft.AspNetCore.All" Version = "2.0.3" />
       <! - <PackageReference Include = "Microsoft.NETCore.App" Version = "2.0.4" /> ->
  </ ItemGroup>

My csproj test project (XUnit)

<Project Sdk = "Microsoft.NET.Sdk">
  <PropertyGroup>
    <TargetFramework> netcoreapp2.0 </ TargetFramework>
    <IsPackable> false </ IsPackable>
    <RuntimeFrameworkVersion> 2.0.3 </ RuntimeFrameworkVersion>
  </ PropertyGroup>
  <PropertyGroup>
    <LangVersion> latest </ LangVersion>
  </ PropertyGroup>
  <ItemGroup>
    <PackageReference Include = "Microsoft.AspNetCore.All" Version = "2.0.3" />
    <PackageReference Include = "Microsoft.NET.Test.Sdk" Version = "15.5.0" />
    **<! - <PackageReference Include = "Microsoft.NETCore.App" Version = "2.0.4" /> ->**
    <PackageReference Include = "Moq" Version = "4.7.145" />
    <PackageReference Include = "xunit" Version = "2.3.1" />
    <PackageReference Include = "xunit.runner.visualstudio" Version = "2.3.1" />
  </ ItemGroup>
  <ItemGroup>
    <DotNetCliToolReference Include = "dotnet-xunit" Version = "2.3.1" />
  </ ItemGroup>
</ Project>

And most importantly, when I removed the global.json file that forced SDK 2.1.3, the build ran without any problems.

{
   "projects": ["src", "tst"],
   "sdk": {
     "version": "2.1.3"
   }
}

ITS REALLY .. fed up of this error what need to do .. tried in multiple ways now with the help of some solutions given here by various guys.. let see trying ..
now this is the last error what we all were facing.... by the way these vedio helped me but still facing ERROR
Error: C:\hostedtoolcache\windows\dncs\1.0.4\x64\dotnet.exe failed with return code: 1
Dotnet command failed with non-zero exit code on the following projects : D:\a\3\s\PMSite.csproj
https://docs.microsoft.com/en-us/vsts/pipelines/languages/dotnet-core?view=vsts&tabs=designer

Apparently, adding a Nuget Restore task before .NET Core Restore worked for me.

Closing as this is not a Tasks issue. There are fixes to apply to the csproj files to resolve the errors.


Cannot open VSCode snap package after October 2019 update!

Maybe worth noting: VSCode is installed as a snap package

VSCode Version:

code --version

1.40.0
86405ea23e3937316009fc27c9361deee66ffbf5
x64

OS Version: Manjaro Linux, kernel version: 5.3.8-1-MANJARO

Steps to Reproduce:

Open VSCode
Wait a couple of seconds and it closes by itself

Does this issue occur when all extensions are disabled?: Yes

Does running code --verbose say anything? Can you try download the tarball from the website and see if that opens?

Thank you @Tyriar for your reply, I'll try what you suggested in a few hours (when I get back to my computer at home)

Same issue on Ubuntu 18.04 after the 1.40 update. Code opens up, then hangs and crashes after about 4-10 seconds. Running code -n --disable-extensions --disable-gpu and all combinations of these flags gives the same behavior. code --verbose doesn't give any obvious errors.
Running gdb /usr/snap/code core against the core file shows a Seg Fault again with nothing I can make sense of.

I don't think I see any errors with code --verbose, but I can confirm that the tarball does NOT have this problem

I saw that version 1.40.1 was released, and I was hoping that the snap issue would be fixed, but the problem still exists

@farzadmf Is this still a problem?

@joaomoreno Unfortunately, I gave up on using the snap package after this 😞, so I guess I can close this since I have no information to add


tlogclient should limit the amount of times it tries to reconnect to

Right now the tlogclient can get stuck in an infinite loop if during a reconnect no tlogserver is available, and thus it will keep shifting and trying without success.
You can see it clearly for yourself how the infinite loop can happen (and has happened for some users): https://github.com/zero-os/0-Disk/blob/a60cf2b832cfa94ceafd4f0d2fec052cd47184fa/tlog/tlogclient/client.go#L323-L342

Even though the return parameter is error, and even though that result is handled by the callee, the function will in fact never return an error, and instead keep trying until it can return nil.
We also receive an input parameter which indicates the point in time at which we started retrying (as the callee uses time.Now()), this input parameter is not used;

There needs to be put some limit here:

Either we limit based on some maximum time of trying to reconnect;
Or we limit based on how many times we can retry each server or the total amount of retries;

But right now we simply keep trying, which is pointless, as in that scenario all hope is basically lost for the vdisk and we shouldn't block the entire system because of it, and instead exit with an error.

It might be a bit more invasive than what you had planned to do @chrisvdg, but what do you think about the following approach:
// reconnect to server
func (c *Client) reconnect(closedTime time.Time) error {
	defer c.resetServerUsedProperty()
	var err error

	log.Info("tlogclient reconnect")
	for {
		// try other server
		err = c.shiftServer()
		if err != nil {
			return err
		}

		// TODO: obviously you would also have to change the c.connect function
		// such that it gets the address from the new server structure
		if err = c.connect(); err == nil {
			// if reconnect success, sent all unflushed blocks
			// because we don't know what happens in servers.
			// it might crashed
			c.blockBuffer.SetResendAll()
			return nil
		}
	}
}

// shift server address move current active client to the back
// and use 2nd entry as main server
func (c *Client) shiftServer() error {
	c.mux.Lock()
	defer c.mux.Unlock()

	for i := range c.servers {
		if !c.servers[i].used {
			c.servers[i].used = true
			c.servers = append(c.servers[i+1:], c.servers[:i])
			return nil
		}
	}

	return errors.New("can't shift as all servers have been exchausted")
}

func (c *Client) resetServerUsedProperty() {
	c.mux.Lock()
	defer c.mux.Unlock()
	for i := range c.servers {
		c.servers[i].used = false
	}
}

// ...
// this last part is more pseudo-code, just to show you how simple the structure for the internal in-memory server type could stay
c.servers = []struct{
	address string
	used bool
}
// ...

Indeed a bit more invasive than I imagined this issue would be but this would allow to retry each server 1 time.
But why not for loop for the len(c.servers) then as order is guaranteed in slices, if it were a map we would indeed need to do something like this, no? Or does this also deal with the issue of when the servers get updated while retrying?

I don't think get it. We for loop the c.server, and the order is guaranteed as we are using a slice. Where do you see a map?
This approach would also deal with the issue of when the servers get updated yes, as all servers would be new, as you create/overwrite this in-memory body (again) when you re-load servers, and thus the used property would be false, once again.
This might mean that some servers which we retried before in the past get retried again (as in an extra time (or two)). This is OK, as you can assume that in most cases a config gets reloaded because AYS fixed some broken servers, or something like that.

I meant to for loop for each server in reconnect
Do we need that though? Looking at run where reconnect is called, will loop till it can be reconnected only with a log in between reconnect attempts. So the next time it will try to reconnect it will be with the updated servers anyways?

Yes you're right. While the loop does work functionally, you are indeed correct in stating that it is not needed. But you know, I was more trying to give code to help me describe a possible approach. Don't get too hang up on the details of the code.
You could replace:
for i := range c.servers {
    if !c.servers[i].used {
        c.servers[i].used = true
        c.servers = append(c.servers[i+1:], c.servers[:i]...)
        return nil
    }
}

return errors.New("can't shift as all servers have been exchausted")

with:
c.servers[0].failed = true
c.servers = append(c.servers[1:], c.servers[0])
if c.servers[0].failed {
    return errors.New("all servers have been exchausted")
}
return nil

As you're right, the order is static, so there is no need to go through a loop. As in, we can assume that a soon as we saw a server that we already shifted before, we could simply assume that we finished the list.
In this change I also use a failed property, instead of a used property, as I think it makes more sense. Because only when we shift a server back to the end, we know for sure that it has failed (been used) for sure, and thus only right before we do that we should update that property.
With that being said. You can even improve the design more. We could for example add a timestamp property which indicates when the server was last tried.
In that way you could also change the logic proposed above, from:
c.servers[0].failed = true
c.servers = append(c.servers[1:], c.servers[0])
if c.servers[0].failed {
    return errors.New("all servers have been exchausted")
}

to:
c.servers[0].failed = true
c.servers[0].shiftTime = time.Now()
c.servers = append(c.servers[1:], c.servers[0])
if c.servers[0].failed {
    if (time.Now().Subtract(c.servers[0].shiftTime) > someConstantDurationLimit {
      return nil // retry again anyhow, as it has been failed a long time ago...
    }
    return errors.New("all servers have been exchausted")
}

After some discussion with @GlenDC on telegram, I think (and assumed @GlenDC agree) that this issue is not suitable as mentor type, the solution still not clear and i think we might need to change the API.
For @chrisvdg , i feel sorry about this, but this work has started while i'm on vacation so i couldn't do anything at that time.
There are some obvious things which can be done by @chrisvdg  here:

report to AYS
give some delay between reconnect
limit the logging

After that, i will assign this issue to me.
FYI, Some parts of PR #548 that i don't like:

it doesn't retry the reconnect, doesn't handle network glitch
the change is too invasive (lock, channel that blocks, among other things) for such rare case (assumed that self healing do the work properly), but yeah we might need this in the end.
in case of a block failed to be sent, the sequence number in the nbd cache is not being reordered. It means that subsequent blocks will have wrong sequence

Retrying all the servers once and then propagate the error to AYS with STDERR sounds a reasonable solution. I also like that is mimic the same behavior as the one used for ardb connection as said by @GlenDC

having it just only tries once, does fit our policy that we apply also in the ARDB side, where we also just try a server once, before just giving up on it until further notice from AYS.

I can see two big issues here, CMIIW
(1) tlogclient.Send will block in case of all servers failed
one possible solution is to simply return error as already done by @chrisvdg at #548, but it is still not enough, we also need to do these things:

resend the block after the client become connected again. So we don't need to reorder the sequence number, and tlog stay consistent with nbd
set some flag to make nbd's SetBlock failed. It is to prevent our buffer become full. It is the same method as my PR at #613 when the ardb failed.

We also need the flag in tlogclient
As improvement, we can also only set the flag after the buffer is really full.
(2) current reconnection is very naive
It is something that definitely need to be improved, as pointed in my previous comment and in this issue description

Retrying all the servers once and then propagate the error to AYS with STDERR sounds a reasonable solution. I also like that is mimic the same behavior as the one used for ardb connection as said by

While it is true that simply reconnecting forever is stupid, i think we should not stick too hard with this  principle because:

reconnecting is cheap
sticking to 1 reconnect policy too hard might make the code much more complex, as what we have in #548

So, i think we should find the balance between not so stupid and not so complex code.


ramon tests didn't catch broken ID service

e.g. ocp/ca/test/ramon_test/id/1/2091/2046/113/ was throwing a 500 error, but all tests were passing. revisit on microns

Added test_annoid.py to microns in f2ccb9ea5e5b7c56fe547aaa1c43b271c301f388 . Should also add a test for multiple IDs (#245).


Blog app - creating a data model

Project requirements
In this PR I worked on the following:

I used the reference ERD diagram from the sneak peek to create the models

I created a new app. Giving it a meaningful name Tech Talent Potosi.

I initialized the project with Git.

The project has Postgres database set up.

I built the project schema.

I created and run all the necessary migration files.
Table and column names match the ERD diagram.
Foreign keys are included.
All columns that are foreign keys have a corresponding index.

Thank you for the feedback @HAMMAS-SALEEM, I already fixed the requirements.


Audit of ABNF

I've done a review / audit of the manually converted ABNF I did.  There's a couple of little things that showed up.  The initial changes are in the branch:
https://github.com/codalogic/jcrvalidator/tree/abnf-audit
This is relative to your arineng/master, and doesn't include the 'promote-type-choice' changes included.
I've then merged these changes into the 'promote-type-choice' branch, made a couple more changes and ended up with:
https://github.com/codalogic/jcrvalidator/tree/promote-type-choice

This is done. As for the 3 passing tests:

the first issue was that the parser was no longer producing a token in the result hash that allowed check_groups to determine a group_rule in a value_rule. I put in a simple token for the type_choice_signifier and a check for that.
The other two tests were things that parser was able to catch before... objects and arrays deeply embedded in value rules. The fact that the parser could ever do this was amazing. But it can't any more. However, the logic to catch these errors was already in group_check so I just moved the tests over.


Bus-Potatoes

[x] I have read the steps to getting a blot

[x] I am submitting art that...

[x] is algorithmically generated (will change each time the program is run)
[x] is drawable on a blot (fits in the work area & doesn't overlap too much)
[x] is original (not copied from somewhere else)

[ ] Optional, if you used a tutorial or based your art on something else, please include the link here:

[ ] Optional, if you remixed this from something else, mention it here:

Hey @agentdog, just checking in– any updates on how your art looks?

hey sorry this notification somehow got muted out, currently working on the changes

Seeing as this hasn't been updated in over 2 weeks, I'm going to close the PR for now. You're free to make a new one in the future with the same artwork if you'd like! Reach out to me @alexren on the slack if you have any questions!


Update Function doesn't allow you to update the runtime

I have a PR for this.  I just haven't submitted it yet.  You can expect it on Oct. 1st when Hacktoberfest kicks off.


SwaggerUI generating documentation for System.Guid

We're using Swashbuckle latest (v 6.0.0-beta90) and everything seems to be working perfectly fine for us, except for the swagger ui generation for GUID parameters.  They show up in the generated documentation as strings. I understand that GUIDs are pretty much a .NET only kind of thing, so I'd be okay with showing them in the UI as a UUID. Does anyone know how to do this?
example code:
/// <summary>
/// Returns a customer from the id provided
/// </summary>
/// <param name="id">UUID v4</param>
/// <returns></returns>
[HttpGet("{id:guid}")]
public IActionResult Get(Guid id)
{
      return Ok(Factory.Customers[id]);
}

If you notice the data type is "String" for Id:

https://github.com/domaindrivendev/Ahoy/pull/65 has a code snippet for the following in the configuration which we've implemented, and still no luck:
config.EnableSwagger(x =>
{
    x.MapType<Guid>(() => new Schema { type = "string", format = "uuid" });
});

I am also looking for the very same resolution for System.GUID. It would be great if it gets incorporated soon! Desperately looking for it.

I think Data Type "string" is correct in this case. As far as JSON / JSON Schema is concerned "Data Type" MUST be one of the six defined types (http://json-schema.org/latest/json-schema-core.html#rfc.section.4.2). So, it's still a "string", just with specific formatting which you've correctly included in the "format" field via MapType.
It's worth noting however, that "uuid" is not a supported value for "format" in the swagger spec. So, it's not surprising that the swagger-ui tool doesn't do anything with it.
You could argue that the swagger-ui should include an additional column where it displays "format" in addition to data type, but that's an issue for the swagger-ui repo (https://github.com/swagger-api/swagger-ui) and not Swashbuckle.

Thank you for the information, that's super helpful. I was not aware UUID was not a supported type (as well as date/time). It makes total sense to have them represented as strings in this case.


add Azure vpc peering connection test

About this change—what it does
Adds Azure VPC peering connection test.
To run this tests your Azure account must have "Application administrator" role assigned.

VPC peering connection test:
=== RUN   TestAccAivenAzureVPCPeeringConnection_basic
=== PAUSE TestAccAivenAzureVPCPeeringConnection_basic
=== CONT  TestAccAivenAzureVPCPeeringConnection_basic
--- PASS: TestAccAivenAzureVPCPeeringConnection_basic (987.20s)

and private link test:
=== RUN   TestAccAivenAzurePrivateLinkConnectionApproval_basic
=== PAUSE TestAccAivenAzurePrivateLinkConnectionApproval_basic
=== CONT  TestAccAivenAzurePrivateLinkConnectionApproval_basic
--- PASS: TestAccAivenAzurePrivateLinkConnectionApproval_basic (1002.83s)

AIVEN_AZURE_APP_ID is hardcoded here in chapter 7. But it's better put it in vars so code won't change if that id is replaced with a new one.


encrypted mount with key text, not file

Hi!
I'm trying to mount an encrypted repository for which I don't have the original key file. I have however the contents (text) of that file. I therefore placed that text in a new file in  ~/.attic/keys, making sure there are no extra spaces or newlines. I named this file arbitrarily...
This does not work:
~$ attic mount ~/mnt/home.attic ~/Downloads/mnt
Traceback (most recent call last):
  File "/usr/bin/attic", line 3, in <module>
    main()
  File "/usr/lib/python3/dist-packages/attic/archiver.py", line 715, in main
    exit_code = archiver.run(sys.argv[1:])
  File "/usr/lib/python3/dist-packages/attic/archiver.py", line 705, in run
    return args.func(args)
  File "/usr/lib/python3/dist-packages/attic/archiver.py", line 245, in do_mount
    manifest, key = Manifest.load(repository)
  File "/usr/lib/python3/dist-packages/attic/helpers.py", line 98, in load
    key = key_factory(repository, cdata)
  File "/usr/lib/python3/dist-packages/attic/key.py", line 34, in key_factory
    return KeyfileKey.detect(repository, manifest_data)
  File "/usr/lib/python3/dist-packages/attic/key.py", line 201, in detect
    path = cls.find_key_file(repository)
  File "/usr/lib/python3/dist-packages/attic/key.py", line 220, in find_key_file
    raise Exception('Key file for repository with ID %s not found' % id)
Exception: Key file for repository with ID 7a578ef0d4e9dd7a7e4cc9e831e626b304ea2efd9ee7beca064c67c060c7b430 not found

Does the key file need to be named specifically?
Thanks in advance!

How about temporarily renaming the repo / unmounting the repo and initializing a new encrypted one at same place? You should then get a new keyfile, named and formatted correctly, just having a new key. Then put the old key in there, rename / mount your original repo back into place.

Hmmm, I suspect I've done something very wrong, will return shortly with more results.

Yea, my bad.
I was meticulous about keeping those keys (in text form, not as files), but only for 2 of the 3 backups I had. I needed that third one. Managed to salvage that third keyfile though (from a broken laptop), so all is well that ends well!
Thanks for the help and sorry for waisting your time!


Crash in RequestHandler stream(request:)

After cancelling a Task, this preconditionFailure is triggered:
preconditionFailure(
"Tried to use a second iterator on response body stream. Multiple iterators are not supported.",
file: file, line: line
)
Workaround it to only call  continuation.finish(throwing: error) in the catch block of stream(request:) in RequestHandler and remove this:
 let data = try? await response.body.reduce(into: Data()) { $0.append(.init(buffer: $1)) }

@JSky74 Do you want to make a PR with that change? I can here in a little in not

@dylanshine Opened a PR.


[RFC] Goal for trition.ops.flash_attention

Hi! The flash attention implementation is really helpful as a reference. I noticed that the code currently makes some assumptions (e.g. about shapes and strides) and can silently produce incorrect results if used incorrectly.
I've seen some related issues and PRs (e.g. https://github.com/openai/triton/pull/2033, https://github.com/openai/triton/issues/2029, https://github.com/openai/triton/issues/2046, https://github.com/openai/triton/pull/2086) and am not clear what are the intended goals of this code. Two possibilities I can imagine:

[For developers] This code serves as a complex use case that helps to catch bugs. Covering more use cases (e.g. a different number of queries and keys) or making it "user-friendly" is not a priority.
[For users] This code is meant for users as an alternative to other flash attention implementations. Improving the user experience (e.g. no silently incorrect results) and expanding coverage of use cases are positives.

How do the core developers think about triton.ops.flash_attention? Would you welcome contributions to improve the user experience of this code (e.g. follow up on https://github.com/openai/triton/pull/2033)? On the one hand I think having a flash attention implementation on par with other libraries could help get folks interested in Triton; on the other hand I imagine the core devs aren't looking to have to maintain more code without a good reason. I'd be happy to help add features to this code if that aligns with what the core devs want.

I myself have been hoping for a repository of more advanced applications of triton.
However, it seems that the core concern in this repo is the compiler correctness and performance.
The application code with more production concerns ideally live somewhere else. Perhaps called triton-extra or poseidon. I would be keen to contribute there without getting in the way of the compiler development.
For instance, experimentation with more advanced kernels like https://github.com/openai/triton/issues/2243 could take place there

You probably want to have a discussion with @daemyung

@Jokeren Thanks for noticing me.
My opinion is that Triton is a language, akin to CUDA and SYCL, rather than a library. Consequently, supporting various operations (e.g., flash attention) falls outside Triton's scope. Consider CUDA for comparison: CUDA itself doesn't offer implementations for specific operations. Instead, libraries based on CUDA (like CUTLASS, cuBLAS, and cub) provide those implementations.
For these reasons, I have initiated Trident. Trident is a performance library designed for machine learning applications, with a focus on accelerating both training and inference. It comprises highly optimized kernels, functions, and modules tailored for machine learning and is built upon Triton.
Therefore, I believe the purpose of triton.ops.flash_attention is geared towards developers rather than users.


reg: init at 0.16.1

Motivation for this change
Add the reg tool for interacting with v2 container registries.
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[ ] NixOS
[x] macOS
[x] other Linux distributions: openSUSE Leap 15.3

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
21.11 Release Notes (or backporting 21.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

@SuperSandro2000 thank you, addressed. Honestly, I don't know if it's the right place in the toplevel file.


Grant example maintainers access to clusters in kubeflow-ci-deployment.

Examples will run on auto-deployed clusters in project kubeflow-ci-deployment
To facilitate debugging tests we want example maintainers to be able to
access those clusters
create a new group example-maintainers to keep track of who should have
access
Add @jinchihe since he's been making a lot of contributions
Grant the new group container.developer permissions in project kubeflow-ci-deployment
Create a helper script for creating new groups

Related to kubeflow/testing#588

This change is

/assign @jinchihe
/assign @texasmichelle

/assign @abhi-g

/lgtm
/approve


Fix static content

Fixes being able to use static content to initially set content into buffer

I'd already converted simpla-img to v2 and updated the setCallback stuff? Did you not pull down latest?

Yeah, see the final merge commit. Just cleaned up a few bits that weren't needed given the latest element-behavior, and static url stuff

Oh - no this branch was around from pre your commits

Yep saw that as soon as I made that comment hahaha


Add support for microservices + some changes

@stevehouel I need your help to test my code. This was quite tricky to do and I don't have much time to work on it.
We need to test microservices deployment with Eureka and Consul. I'm not sure everything is working properly, so please do some tests before merging this.
The trick with the sidekick is similar to what I did with the k8s subgen. Although we recommend using a git config for prod I still prefer to setup something that doesn't need a git repo and will work out of the box for the user (this is better for demos 😄 )=.

thx @PierreBesson I will check it asap and test it on my rancher server before merging it. Thx for your work


RSpec describe nested inside a module triggers error 5067

Input
→ View on sorbet.run
# typed: true

# Works
describe SomeModule::SomeClass do
end

# Doesn't work
module SomeOtherModule
  describe SomeClass do
  end
end

Observed output
editor.rb:9: The super class SomeOtherModule of SomeOtherModule::<describe 'SomeClass'> does not derive from Class https://srb.help/5067
     9 |  describe SomeClass do
    10 |  end
Errors: 1

Expected behavior
Error 5067 is not triggered.

I've identified the issue comes up in release 0.5.6500.
https://github.com/sorbet/sorbet/compare/0.5.6497.20210713212056-f7d542338...0.5.6500.20210714142733-b4e0f4e79
Best I can tell it comes from this PR https://github.com/sorbet/sorbet/pull/4360 authored by @elliottt . @elliottt would love your eyes on this! Right now this is blocking us from upgrading to the newest version of Sorbet 🙏 Happy to chat through the use case here.

Basically, I think this:
https://github.com/sorbet/sorbet/blob/4f146522e25047f6527a98797672f9b1c462eced/rewriter/Minitest.cc#L283
should only happen on the condition that the self reference refers to a class. Minitest similarly checks if Class === self.


ML 1.16 : Bootstrap Sampling (D)

Hey, I've added the documentation.
You can see it.

Follow the PR template before creating any PR. @AdityaStark7

Follow the PR template before creating any PR. @AdityaStark7

Where Can I find PR template?

[MACHINE LEARNING] This will!

Mention your issue number please atleast. And PR template is in the template section of the main repository.
Here it is, https://github.com/girlscript/winter-of-contributing/blob/main/.github/PULL_REQUEST_TEMPLATE.md

issue Number: #2273

PR Approved @AdityaStark7


Composed data/metadata Melon.http.app() requests generating wrong meta code

Target
2.7.0 (not released)

Summary
Composed data/metadata Melon.http.app() requests generating wrong meta code, causing an error.

Warning
This turns inviable the use of http requests with data like query, body, headers...

Problem Solution
Use multiline string literals in meta code to avoid automatic syntax errors.

Solved in #230


looks great, here are a couple requests to get it to work on our environment

Hello Steve,
I just reviewed the script.   It looks great , wow, lots of comments and validations test, debugging and have a lot of error conditions. Very well written!   However
a)	Our servers do not have access to internet and from the beginning it requires a few downloads, is that really the only way? Can we not download these ahead of time and then move onto next steps? So just check if these files are there already installed?
a.	yum install -y wget
b.	yum install -y pigz
c.	wget https://github.com/VictoriaMetrics/VictoriaMetrics/releases/download/"${vm_version}"/vmutils-linux-amd64-"${vm_version}".tar.gz
d.	and others…
b)	# Perform Backup of PMM
a.	Can we backup the smaller dBs ClickHouse, PostgreSQL before we do the larger VM ?
b.	If we don’t want all the data but the configuration of the PMM and the servers it is monitoring, can we have an option to do so?
c)	We have a NAS mount created on OVA as well as on Container. However the notes say it needs 2x /srv, that is quite a lot, are there any parameters that can be added to the backup command to do a compression or a compressed backup?
a.	### nice to haves ###     #will the backup fit on the filesystem (need >2x the size of the /srv directory)

Since CURL is already installed in all versions of PMM I removed the wget requirement (one less download)
Until this can be included in a future release of PMM (backup script, pigz and vmutils) you will need to download and stage it separately.
I also added a -s or --storage flag so you can specify where backups/restores will go to/be read from
I went back and forth on backup-sub-sets and ultimately decided that because PMM is more of an appliance, doing a selective backup or restore isn't good for the world so I won't add that here.
I'm still looking at a way to pre-determine storage needs that isn't overly expensive but all the methods i've found can be system resource intensive so far.


Make the fs fully threadsafe

If fs_unmount is invoked while fs i/o is ongoing then it will cause a NULL pointer exception due to the unchecked and unprotected dereference of the fs pointer.
https://github.com/zephyrproject-rtos/zephyr/issues/73501

This should be configurable by user as it is up to user setup, mostly, where mounted fs is used by more than one thread.
Users that do not have the issue should be able to turn off the feature as it adds code and impacts execution paths.

Thanks for your comments, and indeed I believe there is a much simpler solution which I have tested on my platform and pushed.

Thanks for your comments, and indeed I believe there is a much simpler solution which I have tested on my platform and pushed.

The issue you have logged is still correc.

@de-nordic please revisit


Sign out fix

Issue #, if available:
#510
Description of changes:
Users will get error when signing out if their identity pool doesn't allow unauthenticated access.
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Codecov Report

Merging #511 into master will decrease coverage by 0.08%.
The diff coverage is 20%.

@@            Coverage Diff             @@
##           master     #511      +/-   ##
==========================================
- Coverage   88.98%   88.89%   -0.09%
==========================================
  Files          62       62
  Lines        3059     3062       +3
  Branches      591      591
==========================================
  Hits         2722     2722
- Misses        322      325       +3
  Partials       15       15

Impacted Files
Coverage Δ

packages/aws-amplify/src/Auth/Auth.ts
85.81% <20%> (-0.47%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4ab6abc...5fc0a02. Read the comment docs.


Regular Expressions: Positive and Negative Lookahead

Describe your problem and how to reproduce it:
This solution requires GROUPING which we learn AFTER this lesson. This needs to be adjusted to require an answer that does NOT REQUIRE GROUPING.
Add a Link to the page with the problem:
https://www.freecodecamp.org/learn/javascript-algorithms-and-data-structures/regular-expressions/positive-and-negative-lookahead
Tell us about your browser and operating system:

Browser Name: Doesn't matter
Browser Version: Doesn't matter
Operating System: Doesn't matter

If possible, add a screenshot here (you can drag and drop, png, jpg, gif, etc. in this box):

Hello~!
My apologies, but I do not see grouping in the solution you have shared. As stated in the instructions, a positive lookahead uses the syntax (?=...), where the ... is replaced with the characters you want to match. In the following lesson, grouping is taught - grouping takes the syntax (set1|set2), where you replace set1 and set2 with the two alternative character sets you want to match.
The solution uses lookaheads as explained in this lesson, but does not appear to use grouping. 🙂

Is () not a capture group? I may be missing something here. There was another issue with a much earlier lesson that apparently required parenthesis to group commands together that I also did not understand the solution of, because I did not know what the parenthesis even did, or that I was supposed to use them.

Going to copy the relevant instruction from this challenge so I can reference it more quickly:

A positive lookahead will look to make sure the element in the search pattern is there, but won't actually match it. A positive lookahead is used as (?=...) where the ... is the required part that is not matched.

There are a few different use-cases for parentheses in a regex, and lookaheads are one of them. The text I copied from the lesson instructions reads clearly to me - but my perspective is certainly not the only one. Is there a way you think these instructions could be worded more clearly? 🙂

Hmmm, no I suppose not in this specific case. But I was only confused because of the solution to this problem: https://forum.freecodecamp.org/t/freecodecamp-challenge-guide-restrict-possible-usernames/301363 and this forum thread: https://forum.freecodecamp.org/t/restrict-possible-usernames-solution-requires-knowledge-not-introduced/395660, which, now that I've gotten a bit farther in the lessons, quantity specifiers are not parenthesis, but that was the first solution I had seen with them, so I associated it to "grouping". Either way, I suppose the issue I linked here is solvable without quantity specifiers judging by Solution 1.
Anyway, now I know parenthesis can be actual syntax of regex and not just grouping regex together for various purposes, apologies!


Consider redesign or new Azure driver to support Resource Manager infrastructure

Author Name: Warren Frame (Warren Frame)
Original Redmine Issue: 5084, https://dev.opennebula.org/issues/5084
Original Date: 2017-03-29

Hi!
The Azure driver was completed a while back: https://dev.opennebula.org/issues/2989
Unfortunately, Microsoft completely redesigned their Azure offerings, and have been pushing folks to use Resource Manager rather than "classic" VM deployments for some time (details: https://docs.microsoft.com/en-us/azure/azure-resource-manager/resource-manager-deployment-model).
New Ruby SDK: https://github.com/Azure/azure-sdk-for-ruby (note the old SDK is now in the asm branch of that repo)
New gems: azure_mgmt_compute, azure_mgmt_storage, azure_mgmt_network, etc.
Note that while the new sdk has been around for 8 months, it's still in preview.  This new architecture will presumably stick around for some time.  It may be worth re-designing, or adding a new Azure driver to support Resource Manager.
I personally don't have the bandwidth or background in Ruby to implement this - sorry!
Cheers!

Driver Status
General info
To start and use this driver you should download source code of the proper branch Feature-1203, compile and install it.
Azure preparation

Active directory

Create an application (ex: AzureDriver_one)
-> manage access for the application (for the moment SECRET key is mandatory)

Create OpenNebula host:
onehost create <name> -i az -v az

Update the template adding the next attributes (requirement to get the driver to work):
ONE ATTRIBUTES:
handling authentication:

AZ_CLIENT=  application ID, its mandatory to have any app working with active directory
AZ_SECRET= the secret key for the user
AZ_TENANT= the directory ID
AZ_SUB= normal subscription id

LOCATION_NAME= the name of the location
CAPACITY = [KEY="VALUE"] based on /etc/one/az_driver.conf

Once you have completed all the steps, the host should be green.
Template example
Using public cloud attributes we can define vm properties:
CPU="0.5"
MEMORY="128"
NAME="test"
PUBLIC_CLOUD=[
    IMAGE="UbuntuServer",
    INSTANCE_TYPE="ExtraSmall",
    PRUEBA="vacio",
    PUBLISHER="canonical",
    SKU="16.04.0-LTS",
    SSHPORT="2222",
    TCP_ENDPOINTS="80",
    TYPE="AZURE",
    VERSION="latest",
    VM_PASSWORD="Mypassword1234",
    VM_USER="azuser",
    WIN_RM="https" ]

Behaviour
Opennebula Host will create new reource group (new paradigm based) with his own name to control all resources.
PROBLEMS:

monitor all vms at same time (impossible until microsoft provides instance view for list calls)
driver actions take too long due Azure API:

terminate action -> opennebula keeps waiting for the vm to deletion and reach a timeout(?) then the vm keeps running but is deleted in azure.
deploy action -> azure takes too long (very very long) to deploy a machine, meanwhile you cannot perform any action in opennebula or the monitoring will fail.

TODO

[x] cipher secret key,
[ ] Improve cli creation
[ ] check cert option
[ ] Optional attribute for RESOURCE_GROUP name
[ ] Network/NIC management through public cloud
[ ] Replacing cli template for new one with new atts/options
[ ] Update opennebula instance_types

NIC_0="vnet_name"
NIC_1 = ....

[ ] Deploy_id azure tags based ->  -one-
-> AZ_PREFIX attribute to choose the name of the machine,
-> example: vm-$i-$name

Missing features

remove nics/disks when terminate
set up public addresses
basic context package
improve monitoring

TODO possible ideas

[ ] cipher secret key, check cert option
[ ] Optional attribute for RESOURCE_GROUP name
[ ] Network/NIC management through public cloud

NIC_0="vnet_name"
NIC_1 = ....

[ ] Deploy_id azure tags based ->  -one-
-> AZ_PREFIX attribute to choose the name of the machine,
-> example: vm-$i-$name

[ ] Update instance types
-

ONE ATTRIBUTES:

AZ_CLIENT=  application ID, its mandatory to have any app working with active directory
AZ_SECRET= the secret key for the user
AZ_TENANT= the directory ID
AZ_SUB= normal subscription id

Hello, check out our alpha-release.
We'll be very pleased to work together.

your driver looks nice!
we will try that soon ;)


Upgrade log4j2 to 2.16.0

2.16.0 upgrade,
a) message lookups feature has been completely removed,
b)  disables access to JNDI by default, so any attack vector related
to jndi is solved.
This solves CVE-2021-45046:
Apache Log4j2 Thread Context Message Pattern
and Context Lookup Pattern vulnerable to a denial of service attack.
Eventhough we don't use these in pattern layout in log4j2.xml, its
good to upgrade, as there maybe still undiscovered jndi attack vectors

I have tested log4j2 2.16.0 upgrade in aaa server, everything works. quoting from here  https://logging.apache.org/log4j/2.x/security.html
From version 2.16.0, the message lookups feature has been completely removed. Lookups in configuration still work.
We use lookups only in configuration (log4j2.xml) which works, so its good .
Please do the needful in other api-servers @kailash @swaminathanvasanth @rraks.

Note that only the log4j-core JAR file is impacted by these vulnerabilities i.e CVE-2021-45046 and CVE-2021-44228. Applications using only the log4j-api JAR file without the log4j-core JAR file are not impacted by these vulnerabilities.

What is up with this library? 🤦♂


Stencil 1.15.0

New stencil version is up. Is there any plan to update soon?

Yes, we are working on getting this integrated into the framework.


Added defaults to tasks

Added a new field to the Task class named defaults which sets default values of an instance for chosen fields in both inputs and outputs.
For #893 issue and discussions in #908

@pawelknes - can you also make some changes to actual tasks so they work with only needed data (such as "text_type" should default to "text", "text_a_type" should default to "first text" , "text_a_type" should default to "second text")
Then you can also remove the default from the actual cards.
unitxt/prepare/tasks/classification.py unitxt/prepare/tasks/generation.py unitxt/prepare/tasks/rewriting.py

I've added default values you mentioned as well as some others which I found quite common across different cards


Does not try to wrap getters & setters

There was an issue with property accessors. There was an error when doing:
class A {
  get valueGetter() { return this.value }
}

That was because valueGetter property was called on the class prototype, which did not have any value defined. (at this line)
So I've filtered out getters and setters from the checked keys.

Awesome, thanks for the PR! :)

Thanks again! Just tagged a patch release

Welcome! Glad I could help.


LND Properties tab not appearing

This is normally a result of LND having not started up yet, but one user has it as a recurring issue.  Re-installs do not help.  Logs report "Error: missing field 'cipher_seed_mnemonic' at line 1 column 135" and "waiting for wallet encryption password," and asks for lncli commands to create or unlock a wallet.

I can also spin up a 0.2.x box no problem to try and reproduce this.

Sounds good, thanks for looking into this

@kn0wmad Does this issue reflect a problem in the EOS v0.2.x version of LND?

@kn0wmad Does this issue reflect a problem in the EOS v0.2.x version of LND?

Yes.  I filed a report for a similar issue on 0.3 however, which was my own, not of a user

If we can't reproduce we should probably close this as a ghost.


How to use wireles universal terminal

Title

you obtain it by combining two wireless terminals, or one wireless terminal and an wireless universal terminal in a crafting terminal.
once you have your terminal, you can either open specific terminals with their keybindings, open the last terminal by using the terminal, or cycle to the next terminal with the button on the left sidebar


After buy suggest user next targets to acquire

Same as on Twitter wants enhance graphs and feed ppl more stuff to consume and brighten their peak interest by particular subset of ppl, we could leverage #(passion-feed) to reccommend you to snipe another set of NFTs
I need expand bit more, but definitely someone should write reccomendation query

@exezbcz can we have something like this? suggested to follow (latest gen artists or teammembers?)


[BUG]: Model page shows incorrect/missing metadata when models has parameters named *_*

Describe the bug
I have a model (see below) for which the model page is showing incorrect parameter information.

the parameter NPI_mult is shown as NPI only and is missing all its metadata
ditto for the parameter vacc_mult
all parameters r_* are forced into a single matrix, even though this model is not a product of stratification

This is probably due to the (incorrect) assumptions about IDs with *_*.
The model:
SEIRHD vacc model for LA County t0 = 10_28_2021 (1).json
To Reproduce
Steps to reproduce the behavior:

Upload this model
Inspect its model page
Create a Configure Model operator and plug the model to it
Inspect the parameter table to see the lack of values of NPI_mult, vacc_mult and the incorrect matrix for r_*

Screenshots

I think we can add additional heuristics to detect cases like this - but at some point these become educated guesses.


Branch 0.6.0

Reworked request-response flow
Updated documentation

Coverage remained the same at 100.0% when pulling 49cec223b045423463f81a09bf69d062ce8ea001 on branch-0.6.0 into 121f9c23cd86f109ae9d9bcacf535f097ff461d2 on master.

Coverage remained the same at 100.0% when pulling 49cec223b045423463f81a09bf69d062ce8ea001 on branch-0.6.0 into 121f9c23cd86f109ae9d9bcacf535f097ff461d2 on master.

Coverage remained the same at 100.0% when pulling 49cec223b045423463f81a09bf69d062ce8ea001 on branch-0.6.0 into 121f9c23cd86f109ae9d9bcacf535f097ff461d2 on master.


Missing c6ab.npy

I am trying to run the tutorial but keep getting this error:
from nff.train import Trainer, get_trainer, get_model, load_model, loss, hooks, metrics, evaluate

FileNotFoundError: [Errno 2] No such file or directory: '~/miniconda3/envs/nff/lib/python3.8/site-packages/nff/utils/table_data/c6ab.npy'

Can you let me know how to fix this?

Hey @sli259 - can you try cloning the repo and putting it in your Python path, instead of pip installing it? That should fix the issue (I still haven't figured out how to make this work with pip)

I have a fix for this that I'm going to make a PR for now!

Thank you! I struggled with it for a while and couldn't figure out how to fix it


Document systemd-devel package requirement

Fixes #1865 from github issues.

Looks good.

@bgeltz
https://github.com/geopm/geopm/blob/geopm-service/service/configure.ac#L216-L223


Method not found (latest nuget)

System.MissingMethodException: Method not found: 'Void eZet.EveLib.Core.Util.HttpRequestHelper.AddPostData(System.Net.HttpWebRequest, System.String)'.
at eZet.EveLib.EveAuthModule.EveAuth.d__14.MoveNext()
at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1.Start[TStateMachine](TStateMachine& stateMachine)

Please provide me with the code/method you are using to produce this.

AuthResponse response = await eveAuth.AuthenticateAsync("my key", "response code from ccp");

Which version of EveLib.Core are you using?

why didnt it show up in the update tab... i did an update again and now it works..

I have no idea. Maybe your project or nuget settings? Checking the dependencies for newest EveAuth:
Dependencies
Newtonsoft.Json (>= 8.0.2)
eZet.EveLib.Core (>= <IP_ADDRESS>)


generation or download in Firefox 55.0a1

I don't get any messages in the javascript console when I click 'generate' nor 'download'.  But, the downloaded document is truncated, less than 700 bytes.
If you give me instructions, I'll perform them to test this issue.

Thanks for the report, I could reproduce it on my version of firefox (53.0.3) - the generated data is loaded in the href attribute of the download link, it seems chrome and firefox were escaping it differently.
It should be fixed now, do let me know if that does the trick for you.

You fixed it!


Check changeset

I propose that in DoctrineEncryptSubscriber::preUpdate() we check the entityChangeSet[] for a field before trying to update the field.
    foreach ($properties as $refProperty) {
        $propName = $refProperty->getName();

        if (isset($args->getEntityChangeSet()[$propName])) {
            if ($this->annReader->getPropertyAnnotation($refProperty, self::ENCRYPTED_ANN_NAME)) {

                $args->setNewValue($propName, $this->encryptor->encrypt($args->getNewValue($propName)));
            }
        }
    }

+1
Hi matthewvalimaki, what's wrong with your solution. I think it could solve the problem here.

We've encountered the same problem with multiple updates of an entity within the same request. It can render this bundle unusable on applications with complex requests. This is the same issue as #40.
The resolution proposed here for DoctrineEncryptSubscriber::preUpdate() here: https://github.com/reprovinci/doctrine-encrypt/issues/2 ...
if ($args->hasChangedField($propName)) {     $args->setNewValue($propName, $this->encryptor->encrypt($args->getNewValue($propName))); }
... appears to resolve the issue.

Maybe we can fix it and create PR ?


helm-update-image doesn't do anything if value isn't in the values file, reports success

Checklist

[x] I've searched the issue queue to verify this is not a duplicate bug report.
[x] I've included steps to reproduce the bug.
[x] I've pasted the output of kargo version.
[x] I've pasted logs, if applicable.

Description
I have a kargo promotion workflow that includes the helm-update-image.  This works if the value to be updated exists in the values file.  If it doesn't, kargo reports that it has updated the value but it doesn't actually commit anything so nothing is updated.
Screenshots

Steps to Reproduce
Set the promotionTemplate something like this:
promotionTemplate:
    spec:
      steps:
        - uses: git-clone
          as: clone
          config:
            repoURL: https://github.com/docnetwork/k8s-configs.git
            checkout:
            - branch: main
              path: ./k8s-config
        - uses: helm-update-image
          as: update-values
          config:
            path: ./k8s-config/helm-values/dev/mclaneinator.yaml
            images:
              - image: repos.doc.network/m3test/m3test
                key: job.image.tag
                value: Tag
              - image: repos.doc.network/microfrontends/imms-reg
                key: mfe.image.tag
                value: Tag
        - uses: git-commit
          as: commit
          config:
            path: ./k8s-config
            messageFromSteps:
            - update-values
        - uses: git-push
          as: push
          config:
            path: ./k8s-config

        - uses: argocd-update
          as: sync
          config:
            apps:
            - name:  dev-mclaneinator
              sources:
              - chart: m3test
                updateTargetRevision: True
                repoURL:  repos.doc.network/helm-charts

but do not include mfe.image.tag in the values file that is being updated.  Kargo will not add the value nor will it indicate that it hasn't updated that value.
Version

Logs
time="2024-11-05T16:40:22Z" level=info msg="began promotion" freight=8bb36ec2bd37396d7cba741fe4438febe4f56ac3 namespace=imms-reg promotion=dev.01jbyk5qk9j1a1h1r2xx8mb48x.8bb36ec stage=dev
time="2024-11-05T16:40:35Z" level=info msg=promotion freight=8bb36ec2bd37396d7cba741fe4438febe4f56ac3 namespace=imms-reg phase="\"Succeeded\"" promotion=dev.01jbyk5qk9j1a1h1r2xx8mb48x.8bb36ec stage=dev
time="2024-11-05T16:47:59Z" level=info msg="began promotion" freight=8bb36ec2bd37396d7cba741fe4438febe4f56ac3 namespace=imms-reg promotion=dev.01jbykknrx0x21tyhr811qn329.8bb36ec stage=dev
time="2024-11-05T16:48:01Z" level=info msg=promotion freight=8bb36ec2bd37396d7cba741fe4438febe4f56ac3 namespace=imms-reg phase="\"Succeeded\"" promotion=dev.01jbykknrx0x21tyhr811qn329.8bb36ec stage=dev
time="2024-11-05T16:50:06Z" level=info msg="began promotion" freight=47377799a33d59d2c0f850ce1ece1206c0e01418 namespace=mclaneinator promotion=qa.01jbykqhmq712axmsrh7ak8484.4737779 stage=qa
time="2024-11-05T16:50:12Z" level=info msg=promotion freight=47377799a33d59d2c0f850ce1ece1206c0e01418 namespace=mclaneinator phase="\"Succeeded\"" promotion=qa.01jbykqhmq712axmsrh7ak8484.4737779 stage=qa

This was already fixed in v1.0.0.


Trying out caching

Pls ignore. Trying out the new caching feature of azdo. https://docs.microsoft.com/en-us/azure/devops/pipelines/caching/?view=azure-devops

Closing, this was mostly seeing if the task was invoked. I'll eventually write up an issue where we can implement caching.


Support non-homogenous nested types in SchemaProvider implementations

Currently we can infer schemas for nested types, but only when they are homogenous (e.g. an AutoValue with an AutoValue field, or a Java Bean with a Java Bean field).
We should also support schema inference for non-homogenous types, so that schemas can be inferred for an AutoValue field with a Java Bean field.
Not doing so can lead to confusing errors like the one reported in https://lists.apache.org/thread.html/rc7c45ff8efd425fe545b6020c5b4250c99f6c788bf32a114708187a1%40<user.beam.apache.org>
Imported from Jira BEAM-10765. Original Jira may contain additional context.
Reported by: bhulette.

Part of #18898


Batch crypto functions in isolates

For performance reasons we need to make the following changes to crypto functions

create singular encryption, sign, derive, etc. methods that can be inline or as isolates
create bulk encryption & sign methods using isolates


Completion of command features

This patch accomplishes the following:

Fixes an issue in ConfigDumper, whereby an argument referencing an interface led to an exception. These should be used as-is, but the code should not generate ConfigAbstractFactory configuration for the interface.
Fixes an exception message around non-class/interface argument types; the message now refers to the argument name, not the class that has the argument in its constructor.
Refactors the FactoryCreator:

to use a nowdoc template, instead of string concatenation, simplifying the code.
to remove temporary variables wherever possible
to extract argument concatenation to its own method

Removes the ConsoleHelper
Adds zend-stdlib as a requirement, in order to pick up its ConsoleHelper implementation
Updates ConfigDumperCommand to use the zend-stdlib ConsoleHelper; this allowed removing a ton of code.
Adds FactoryCreatorCommand
Adds the vendor binary generate-factory-for-class

I decided against extracting the code for detecting constructor arguments, as the approaches are actually a fair bit different due to what they need to aggregate.
Finally, I documented the new scripts.

@GeeH I think this may be ready. The new functionality you introduced means we'll have very little to do to integrate with either zend-mvc or zend-expressive.
I have some thoughts about generate-deps-for-config-factory, however:

Do we need a config file to start with? Could that be an optional argument? Since we're not overwriting configuration, this would allow generating the contents for a file from scratch.
If a file is specified, but does not exist, couldn't we then operate as if no config file was provided, per the above?

Finally, I found that a lot of my website classes depend on individual config values and/or array subsets; I'd really like to figure out if there's a solution around such patterns that we can document, as otherwise, these tools cannot be used with such classes.

@weierophinney agreed - we should make the config file an optional 2nd parameter
Can you provide an example of the class that depends on config values or array subsets please? I'm finding it difficult to picture what you mean.


batch inference cloudtrail analyzer

Description of changes:
Adding a sample notebook to demonstrate the use of Amazon Bedrock Batch Inference, supporting article on community.aws:
https://community.aws/content/2lq0rQsuD60tmIpJbUOOaauXzIc/analyze-cloudtrail-logs-with-amazon-bedrock-batch-inference
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Please re do this PR following the new layout and the process for creating the required file . We request all files to have a presence on the Cookbook / Recipes Website which is fronting this github repo now. Some of the mandatory sections of the notebook need to include

Overview.
What are we demonstrating .
What use case .
What will you learn.
What is the architectural pattern and why we select this. With a diagram
What are the libraries to install
What model did we choose and why this model
Every cell needs to have a markup