Add replacement_id for credential replacement to credential issuance

Signed-off-by: Sam Curren<EMAIL_ADDRESS>

Questions: Does this ID need to be used in more messages?


Problems with VNC

There is a problem with connecting to jetson nano 4gb via vnc. I used the official guide. It worked with yours ubuntu 18.04, but with this image, using RealVNC, I cant connect to my jetson. It just says "time out wating for responce from remote computer". Can someone help?

We will address the issue asap.

Thanks! I'll be looking forward to it.

Thanks, but I don't have a monitor to follow the steps you indicated. Could you translate these instructions into terminal commands? I think they differ from nvidia docs only in vnc client settings. But even with this step, I can't connect to jetson.

Any chance to enable VNC on headless Jetson Nano?

I'm working on a headless solution. I need to overwrite the default screen resolution. The well known Xorg.conf doesn't work.

I managed to connect following the steps from the README, but after the first connection it looks like the live feed is not working any more. The date&time in the Jetson's Desktop shows the time when I first connected to it, although it's the following day now.
To be clear, I can see the mouse moving on my VNC Client, but clicking and text input does not work. Anyone has experienced the same behaviour? Definitely weird.


1340 update scope.yml

This PR clears out obsolete terminology from scope.yml, and makes capitalization and wording patterns consistent. It also adds explanations where there were bare headings (e.g., for the crash analysis section).
Working with @jrcheli , the old pattern of speaking of "backends" that use transports has been replaced by the idea of "features" that use transports. So we speak of a metrics feature, an events feature, etc.
Let's see how this all works for the team.

Looks great to me!  Thanks @abetones!


clusterresource/builder: add type metadata for adopted kubeconfig & password secret

This makes sure when we use -oyaml the output creates a valid secret object that can be pushed to cluster using oc
/assign @abutcher
xref: https://issues.redhat.com/browse/HIVE-1586

/lgtm

/test e2e-pool


Missed semicolon CssSyntaxError in shadow-offset property

What minimal example or steps are needed to reproduce the bug?
my component in styles.ts:
export const ButtonContainer = styled.View.attrs({ elevation: 15 })`
  background-color: ${({ theme: { COLORS } }) => COLORS.BACKGROUND};
  padding-horizontal: 24px;
  padding-vertical: 30px;
  shadow-offset: {width: 0, height: 2};
  shadow-opacity: 0.3;
  shadow-radius: 2px;
  shadow-color: #0000004D;
`;

The problem is at shadow-offset: {width: 0, height: 2};
What minimal configuration is needed to reproduce the bug?
my .stylelintrc:
{
    "processors": ["stylelint-processor-styled-components"],
    "extends": ["stylelint-config-react-native-styled-components"],
    "plugins": ["stylelint-react-native"],
    "customSyntax": "postcss-styled-syntax"
}

How did you run Stylelint?
stylelint './src/**/*.ts
Which Stylelint-related dependencies are you using?
    "stylelint": "^16.2.1",
    "stylelint-config-react-native-styled-components": "^0.7.0",
    "stylelint-processor-styled-components": "^1.10.0",
    "stylelint-react-native": "^2.7.0",
    "postcss-styled-syntax": "^0.6.4",

What did you expect to happen?
stylelint works without error.
What actually happened?
I'm getting this error: Missed semicolon  CssSyntaxError

It's a tough one, as it's React Native specific. This parser targets standard CSS syntax with some Styled Components features. {width: 0, height: 2} does not fall in any of these categories.
I will see what I can do, but I'm not optimistic.
For time being one workaround I could came up with is wrap this object syntax in interpolation:
export const ButtonContainer = styled.View`
  shadow-offset: ${`{width: 0, height: 2}`};
`;

This workaround solve my problem.


Set AnalysisMode to Recommended, fix resulting warnings

Description
We did Minimum level last time, now trying to get to recommended

Suppressed warnings that would lead to breaking change, or was nitpicky
A couple of parameter names that got warnings
Lots of StringComparison and int parsing stuff

OrdinalIgnoreCase when operating on URLs
Ordinal where StringComparison was missing
Some CurrentCulture variants I switched to InvariantCulture

We were/are a bit inconsistent on when to ignore case or not, so please review those bits in particular
Related Issue(s)

N/A

Verification

[ ] Your code builds clean without any errors or warnings
[ ] Manual testing done (required)
[ ] Relevant automated test added (if you find this hard, leave it and we'll help out)
[ ] All tests run green

Documentation

[ ] User documentation is updated with a separate linked PR in altinn-studio-docs. (if applicable)

Haha, this was already merged. Dang, and I thought I was helping.

you doubled my confidence 😄


improve readability of the error output

I have following suggestions to improve the readability of the error output

The base statement. Right now if webpack spits out the warnings it reads like this
WARNING in Circular dependency detected:
i'd suggest to use the name of the plugin, like this
WARNING in [circular-dependency-plugin]:
This however does not improve readability. Its just a personal preference.

The line length. Right now, all paths are written into a single line joined with " -> ".

frontend/modules/foo/foo.js -> frontend/modules/bar/bar.js -> frontend/modules/baz/baz.js

This is hard to read when there are many paths inside the circle.
My suggestion is to write each path in its own line. Maybe indent with a TAB and add an utf8 arrow symbol, like this
new Error(["[circular dependency]", ...circularPath].join("\r\n\t↳ "))

which renders like this
WARNING in [circular-dependency-plugin]
	↳ frontend/modules/foo/foo.js
	↳ frontend/modules/bar/bar.js
	↳ frontend/modules/baz/baz.js

Report detected circles once. Right now, each circle is reported at least twice (for each file involved in the circle). The plugin could track already detected circles and then check each detected new circle against that list.

function isAlreadyTracked(trackedList, detected) {
  for (const circle of trackedList) {
    if (circle.length !== detected.length) {
      continue
    }
    const index = circle.indexOf(detected[0])
    if (index === -1) {
      continue
    }
    const len = detected.length - 1 // first and last entries are the same, skip the last
    return detected.every((it, i) => circle[(i + index) % len] === it)
  }
  return false
}

I might open a pull request, but that might take me some time. I thought i'd share my ideas up front.
Great plugin, helped me a lot.

I'll take this into consideration, but I'm not changing the base output right now. In v4.x I've provided the onDetected method as an escape hatch for customization.
Please take a look at that and let me know if it doesn't resolve your concerns.

i actually use my own implementation, based on your source. My intention was to share my improvements which i think some devs would be happy to see. Actually points 2. and 3. are the main reasons why i had to roll up my own implementation.
Points 1. and 2. are solvable with onDetected. That callback is nice to have for little adjustments like the log format. But point 3. is a bit more complicated. One would have to track all previously detected circular dependencies and also reset that information before a rebuild (watch mode). From that callback only one does not know when to reset the tracked information. Further, that kind of logic would clutter the configuration file. That should happen inside the plugin.

@giniedp do you have a specific example where a circular dependency is reported more than one time?

if foo.ts and bar.ts both require each other, then the plugin reports 2 detections
foo.ts -> bar.ts -> foo.ts
and
bar.ts -> foo.ts -> bar.ts

I'm seeing the same behavior, if I have N files in a circular reference, I'll see N lines of output for the chain.
Here's a gist with a full example: https://gist.github.com/Retsam/9c35799c3b1867d9a1170f8c04301308, and here's the output I get when I webpack it:
WARNING in Circular dependency detected:
a.js -> b.js -> c.js -> a.js

WARNING in Circular dependency detected:
b.js -> c.js -> a.js -> b.js

WARNING in Circular dependency detected:
c.js -> a.js -> b.js -> c.js


Hide related videos, youtube button and title

I need to know how to hide the related videos, youtube button and title in android.

Unfortunately is not possible. The IFrame player doesn't allow it.


Fix CODEOWNERS file

There is a stray colon at the beginning of the file
preventing matching
Signed-off-by: Brett Logan<EMAIL_ADDRESS>

This is why CODEOWNERS arent being automatically added


Rapid "compiling..." loop in yarn dev when navigating to the profile page from a scratch

I could be wrong but IIRC I started noticing this behaviour after the shopify worker plugin was introduced in #605

@zbanks would you be willing to look into this maybe?

I had a brain moment, I meant to tag @ConorBobbleHat (sorry zach)


Must use import to load ES Module

Hello,
I'm using date-holidays in a Vtex.IO project.
Here I can only use import and not require.
However, I am getting this error when trying to use the lib.

Any way to solve?

Hi @diegobmss,
Did you found a solution to your problem? In case there is one please post you findings.


Try functionalities "diff" and "patch"

If we produce new tiles from a new planet dump, probably only a small percentage of tiles have changed. Maybe adding a command "diff" to extract only changed tiles and "patch" to update tiles might help keeping a planet.versatiles file up to date more easily.

Something like this could be used to merge multiple sources:
versatiles patch in1.versatiles in2.versatiles in3.versatiles out.versatiles

Alternative names for this sub command could be: add, merge, stack, paste, overlay, overwrite, flatten, composite, ...
This would also solve: https://github.com/versatiles-org/versatiles-generator/issues/6


luarocks: append RT_DIR arg in wrapper

Description of changes
Fixes #229291.
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
23.05 Release Notes (or backporting 22.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

This looks ok. Another approach might be to add it to the generated config in result/etc/luarocks/config-5.2.lua . I am not sure but that way I think someone might be able to override it.

I've opened https://github.com/luarocks/luarocks/issues/1505 and will wait for feedback.

Closing this, because I don't think it's needed and there are other packages that can fail to install due to various libraries not being found.
This is not a sustainable solution.


Full resolution modes don't work on some hardware

We've had a couple of reports of hardware where the pixel doubled modes work, but the signal for the full resolution mode does not.
PicoVision is based on PicoDVI, and the DVI output for full colour full-resolution modes doesn't match the DVI specification exactly, which might be the cause.
In order to help understand this problem better, it would be helpful to know what modes from the vanilla build of the PicoDVI examples work on devices that don't like the full-res signal from PicoVision.  If you have such a display, please could you try running the different uf2 files in the attached zip and reply to this issue with which ones work and do not work for you.
picovision-dvi-test.zip
Load the tests by holding bootsel and hitting reset, then copying the uf2 on to the RPI-RP2 drive in the normal way.  Thank you!

Here are test results for my HD capture dongle.
All worked except mandel-640x480-8bpp.uf2
Test results.zip

Thank you!
Unfortunately this confirms our suspicion that the 2 interleaved DC balanced streams trick that is used by the PicoDVI full resolution encoder isn't allowed by that device - it's not something we've broken with the PicoVision modifications so it's unlikely to be possible to fix it.
It's good to know that the 2 bits per channel mode works though - that could be used for an RGB222 mode with 1 bit of depth, or maybe extended to allow an RGB332 mode (without depth).  I'll have a think.

I have a similar capture dongle device, and got the same fail as 'anislec'
After checking All of my monitors and TV are fine with it, I remembered I have the capture dongle so I could confirm with mike that is fails.

I ran these on the 10,1 inch monitor that had problems with the MicroPython demos and on the 5 inch monitor that runs all of them.
❯ cat README.txt
This folder contains some simple tests for the PicoVision "GPU", running an unmodified version of Luke Wren's PicoDVI.  Builds are from commit a248d72b8cc95a08b43ef4307cd954eb801272b2 (Fri Jun 30 15:48:35 2023 +0100)

10.1 inch monitor that gave me grief on the MicroPython demos:
mandel-320x240-16bpp          Pixel doubled mandlebrot set.  RGB565 - should be similar signal to normal PicoVision pixel doubled output.
    - looks OK
moon-640x480-1bpp             Black and white image of the moon.  This should exactly match the HDMI spec for 640x480 image.
    - looks OK
terminal-640x480-1bpp         Black and white text display.  This should exactly match the HDMI spec for 640x480 image.
    - displays on monitor but characters are very tiny
colour_terminal-640x480-6bpp  6bpp (2bits per colour) text display.  I believe this matches the HDMI spec too.
    - displays on monitor but looks like gibberish
mandel-640x480-8bpp           Full resolution mandelbrot, 256 colour palette mode.  This is similar to the normal PicoVision full-res output.  It matches the spirit but not the letter of the HDMI spec
    - no signal

5 inch monitor that works on all the MicroPython demos:
mandel-320x240-16bpp          Pixel doubled mandlebrot set.  RGB565 - should be similar signal to normal PicoVision pixel doubled output.
    - looks OK
moon-640x480-1bpp             Black and white image of the moon.  This should exactly match the HDMI spec for 640x480 image.
    - looks OK
terminal-640x480-1bpp         Black and white text display.  This should exactly match the HDMI spec for 640x480 image.
    - displays on monitor but characters are very tiny
colour_terminal-640x480-6bpp  6bpp (2bits per colour) text display.  I believe this matches the HDMI spec too.
    - displays on monitor but looks like gibberish
mandel-640x480-8bpp           Full resolution mandelbrot, 256 colour palette mode.  This is similar to the normal PicoVision full-res output.  It matches the spirit but not the letter of the HDMI spec
    - looks OK

The only one that doesn't work on the 10.1 inch monitor is the full resolution Mandelbrot - it gets no signal. All of the others worked. The "terminal" ones look awful but they look the same kind of awful on both monitors.

I should buy an HDMI - USB dongle - can I get some recommendations?

This one is known to work with PicoVision: https://www.amazon.co.uk/Loop-Out-Streaming-Recorder-Broadcasts-Conference/dp/B08PLXT6PW/

Wait ... it turns out I have a "video capture card" https://www.amazon.com/gp/product/B08J5MQ6D3/
Let me see if I can find a manual online and test it with the PicoVision.

I had a brain wave early this morning!  I now have a hack that should make these devices work, at the cost of the colours being slightly off (generally not noticeable).
#93 adds a maximum_compatibility option on the PicoVision constructor (MicroPython) or DVDisplay::init (C++), set that to True and it should work.

So with the new C++ code, mandel-640x480-8bpp should work? All the others were fine on my dodgy monitor.
The ones I had problems with were mostly in MicroPython - can this adjustment be added to Pimoroni's fork of MicroPython if it works on mandel-640-480-8bpp?

The PR linked above integrates the change with the PicoVision version of Micropython. You can grab the firmware from the GitHub action: https://github.com/pimoroni/picovision/actions/runs/6804658786
You’ll need to adjust the PicoGraphics constructor as described https://github.com/MichaelBell/picovision/blob/patch-extra-compatability/docs/python-documentation.md#compatibility-mode to use the compatibility mode.

Thanks!!

I now added an option to screenmodes.py
COMPATIBILITY = True
Leave as = False unless the full resolution modes are not working.
For now it is available on my github account, but this should be merged it soon.


Add .gitignore for bot

Ralph, please remove the bot/messenger/node_modules from the master branch. It is added by accident after the smbmkt refactor where .gitignore in the root become empty. So I have add an individual .gitignore from bot.

Hi Yatsea, I can't delete a folder without going trough each file.
Next time use git rm to delete the files
For now you can do agit rm --cached  which will remove the file from the index (staging it for deletion on the next commit).


Add the ability to enable or disable all jobs in UI with one click

Now enabling or disabling all recurring jobs in UI does not hurt in development.

#397

Pull request #398


Added eventqueue package

Add the generic "eventqueue" package, which is used in dapr/dapr#6716 and will be used in other PRs in dapr/dapr. This code is generic and not specific to Dapr, so dapr/kit seems a good place for it.
Eventqueue maintains an in-memory queue of messages that have to be "executed" at a given time in the future. The queue is a priority queue where messages are in the order they are executed. More details are in dapr/dapr#6716
Users interact with the Processor object which processes messages from the queue at the given time, efficiently using at most one goroutine that is blocked on the next mesage.

Codecov Report

Merging #54 (90b1d0d) into main (804821b) will increase coverage by 0.60%.
The diff coverage is 89.11%.

@@            Coverage Diff             @@
##             main      #54      +/-   ##
==========================================
+ Coverage   80.23%   80.84%   +0.60%
==========================================
  Files          33       35       +2
  Lines        2004     2151     +147
==========================================
+ Hits         1608     1739     +131
- Misses        285      296      +11
- Partials      111      116       +5

Files Changed
Coverage Δ

eventqueue/processor.go
86.02% <86.02%> (ø)

eventqueue/queue.go
94.44% <94.44%> (ø)


[fix] incorrect path to generated tsconfig.json

When attempting to update my existing sveltekit project I  added "extends": ".svelte-kit/tsconfig.json" like the docs say and was met with the error '.svelte-kit/tsconfig.json' not found. I checked the template and the correct path was ./.svelte-kit/tsconfig.json. Without the ./, the project fails to build and every svelte file has an error.
Please don't delete this checklist! Before submitting the PR, please make sure you do the following:

[ ] It's really useful if your PR references an issue where it is discussed ahead of time. In many cases, features are absent for a reason. For large changes, please create an RFC: https://github.com/sveltejs/rfcs
[ ] This message body should clearly illustrate what problems it solves.
[ ] Ideally, include a test that fails without this PR but passes with it.

Tests

[ ] Run the tests with pnpm test and lint the project with pnpm lint and pnpm check

Changesets

[ ] If your PR makes a change that should be noted in one or more packages' changelogs, generate a changeset by running pnpx changeset and following the prompts. All changesets should be patch until SvelteKit 1.0

whoops! thanks


Extension for Video Playback Controller UI

UI for Video Player

Single video

[ ] Portrait/Minimised view
[ ] Fullscreen

Playlist in one view

[ ] Portrait/Minimised view
[ ] Fullscreen

Ref:

https://dribbble.com/tags/player

https://dribbble.com/tags/video_player


refactored to remove JQuery

Issue #1254

Thanks @wbholland for the PR.
And @Andykmcc for the feedback on it.
🎉
Merging now.

@wbholland  Feel free to open a PR to add yourself to the list of authors in the README (which is far from exhaustive).
https://github.com/crimethinc/website/blob/master/README.md#authors


Transformations with flipped y-axis

Sth I encountered while working on #337: when using datashader, transformations of points and shapes need to be applied before rendering. I think the flipping of the y-axis leads to an inconsistency when applying Affine transformations (might also be for other transformations, that's just where I noticed it).
Say we are applying an affine transformation to our blobs polygons, namely a rotation 90° to the right (around 0/0), and then render:
from spatialdata.transformations import Affine
from spatialdata.datasets import blobs
from spatialdata.transformations._utils import _set_transformations

rotation = Affine(
    [
        [0, -1, 0],
        [1, 0, 0],
        [0, 0, 1],
    ],
    input_axes=("x", "y"),
    output_axes=("x", "y"),
)

blob = blobs()
_set_transformations(blob["blobs_polygons"], {"global": rotation})
blob.pl.render_shapes("blobs_polygons", method="matplotlib", outline_alpha=1.0).pl.show()

If I get this correctly, a point can be transformed by performing matrix multiplication with the affine matrix of the transformation, such as np.array([1, 1]) @ np.array([[0, -1], [1, 0]]) which gives [1, -1], therefore rotation by 90° to the right around the point 0/0.
The original image of the blobs polygons without any transformation looks like this:

And the code above (using matplotlib) gives us

Which looks like a rotation to the right around 0/0. However, my question here is that when you flip the y-axis, wouldn't any rotation to the right look like a rotation to the left instead?
My current solution for datashader simply performs the matrix multiplication of all points of the polygons with the transformation matrix. This is all in a "normal", not flipped coordinate system, so when you flip the axes, you would get something like this:

(Looks like a rotation to the left, because the y-axis is flipped).
@LucaMarconato since you're the master of transformations, could you have a look and tell me what you think about it? Is this intended behavior since it is more intuitive for the user?
If yes: do you know an easy way how to get the affine matrix to do the transformation in the y-axis-not-flipped scenario (especially thinking about sequences of transformations...)
If no: the matplotlib version would be "incorrect" and I think get_extent() as well, since it gives us exactly the values that we see in the matplotlib plot (and that's a problem, because in the very end of basic.show(), the axis limits are adapted according to the extent -  I only got the datashader plot above by manually overwriting the extent).
(cc: @timtreis)

@LucaMarconato any thoughts on this? Our current best guess is "do what matplotlib is doing" so we don't change all plots created to date with the library 😅

Sorry I started working on this but then things got into my way. I'll get back to this soon.

@LucaMarconato I have an approach right now in #378 that works for Identity, Scale and Affine and all sorts of sequences of the three. The idea is to first reflect all points along the x-axis by multiplying with [[1, 0], [0, -1]], then apply the transformation(s) (multiply with the affine matrix - for a Sequence we need to reverse the order of the transformations first) and flip back by once again multiplying with our flip matrix.
This gives the same results as matplotlib. The only problem is that the same approach doesn't work for MapAxis and Translation, so I will probably just try to write a method that checks for the type of each transformation and treats it accordingly (e.g. don't flip before MapAxis).
If you find the time it would just be interesting to know what you think about the idea that a rotation to the right should be done to the left on a flipped y-axis, aka the matplotlib result is "incorrect"?


IO#write accepts multiple objects

As per the docs in comment above, IO#write accepts a splat of objects.

We have a policy of testing changes to Sorbet against Stripe's codebase before
merging them. I've kicked off a test run for the current PR.  When the build
finishes, I'll share with you whether or how it failed. Thanks!
Stripe employees can see the build results here:
→ https://go/builds/bui_PWJd0BqIcU2ZUh
→ https://go/builds/bui_PWJdvDAJ9fLtXU
→ https://go/builds/bui_PWJdTbdR8z9WtQ


WARNING log variables not binded

The following WARNING is logged, but no variable significant value is shown:
WARNING -  plugins.mkdocs_include_markdown_plugin: Delimiter {delimiter_name} '{delimiter_value}' of '{directive}' directive at {relative_path}:{line_number} not detected in the file{plural_suffix} {readable_files_to_include}
So I understand that this warns about a mistake in using include delimiters between importing and imported files, but it is not helpful to locate the issue.

Thanks for the report. Fixed by v6.0.4.


Phase 7: Hiring guidelines and resources

Describe the task
we need to add functionality in add resource modal in which we will store data on the database.
Expected behavior
When we click on the Add Resource button that appears on a modal and we will be shown the Resource URL and Category drop-down fields so that we can fill in this field and click on the Save button which in turn will store this data in the database.

This issue is completed. Closing it.


Changed initial AAF AI skill

Changed initial AAF AI skill to make the regular army feel a bit more experienced.

Merged as 351d3b65f11d91e11d4767d02776531f44e8d5e9.
Thanks a lot!


fix: misc quota bugs

snapshot pending usage not cleaned after created
server-attach-network error
loadbalancer fail to set cloudregion_id

这个 PR 实现什么功能/修复什么问题:
修正：

快照配额的pending-usage在快照创建后没有正确清理
server-attach-network报quotakey转换错误
loadbalancer没有设置cloudregion_id

是否需要 backport 到之前的 release 分支:

release/2.13
release/2.14
release/3.0

/cc @yousong @zexi
/area region

Codecov Report

Merging #4735 into master will increase coverage by <.01%.
The diff coverage is 0%.

@@            Coverage Diff            @@
##           master   #4735      +/-   ##
=========================================
+ Coverage    6.79%   6.79%   +<.01%
=========================================
  Files         524     524
  Lines       89684   89691       +7
=========================================
+ Hits         6093    6095       +2
- Misses      83083   83089       +6
+ Partials      508     507       -1

Flag
Coverage Δ

#aFlag
6.79% <0%> (ø)
:arrow_up:

Impacted Files
Coverage Δ

pkg/compute/models/guest_actions.go
0% <0%> (ø)
:arrow_up:

pkg/compute/models/loadbalancers.go
1.63% <0%> (-0.01%)
:arrow_down:

pkg/compute/models/snapshots.go
1.55% <0%> (-0.02%)
:arrow_down:

pkg/cloudcommon/db/quotas/quotas.go
0% <0%> (ø)
:arrow_up:

pkg/compute/models/quotas.go
7.37% <0%> (-0.05%)
:arrow_down:

pkg/cloudcommon/db/namevalidator.go
0% <0%> (ø)
:arrow_up:

pkg/appsrv/response.go
69.23% <0%> (+3.07%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6c7b477...3f148f7. Read the comment docs.


Random starting point in the env to avoid overfitting?

Hello,
I am testing out PPO with BSH action scheme and position-based returns. I am quite happy with the learned models but it seems to be too overfitted to the train data. In fact, the model is worse for unseen test data.
What is your recommendation to avoid overfitting? I am thinking about random starting in the ENV but do not know the right way to implement it?
Is there anyone working on it?
Thanks

I am new to tensortrade, but random starts is usually a very important training strategy in RL - especially in complex DRL models, as ANNs tend to overfit. So, if there are functions to do so, make a +1 on this issue :)

There is no function yet implemented, but you could play with the minibatch size.
How would you implement a random start feature?

Before the end of a new trial, draw a random r number in [0,training set size-1] and start the new trial from observation r in the series (In fact, you can also have a random stop in the same manner, because the learner will most likely overfit the end of the series otherwise). In this framework, it seems most fitting to place these functions as input in the training function (based on my limited knowledge of it, so I might be wrong).

I am wondering if you can achieve a similar effect with the rollout fragment length in Ray...
This seems something that needs to be implemented in the training framework of your choice. If it was me I would implement it in the creator function that Ray uses to initialize the environment.
I might give it a go in the future. Please let us know if you manage to do so before.
I am trying to extend the examples/documentation with up to date content, focused on having Ray as a backend.

Thank you - I will get to know the framework better and test the suggested solutions + leave an update here!

I tried to work my mind on that a little bit (to be honest in some spare time hehe, so some more work could be put into this), but couldn't figure out where to inject that "random start" code when training with Ray.
The environment gets built at the start of the training, and each trial just runs over and over the same environment, not building that anymore.
The brute force solution would be to randomize the start in the environment creation, and force an environment recreation mid training (like saving a checkpoint, stopping the training and resuming it from the saved checkpoint, which would force the environment to be recreated), but i am sure there is a cleaner and much streamlined way to do that, without fiddling a lot with it.
In case there's no way to do that, a PR on the Ray side is also possible, but would keep that as a last resort.
I'll have to look a little bit more into this. @robanos4 do you have any update?
Thanks

What I would do is to randomize the start in the .reset() of the environment; when the environment is initialized it has the full streams, but then when we reset the environment we can select a random start and go from there.

Done. Please close the issue.

@trungtv @robanos4 @alexvaca0 you can test the feature by installing tensortrade from master with
pip install git+https://github.com/tensortrade-org/tensortrade.git
There is a new "random_start" parameter that does just that, not expressed as a boolean flag, but as a percentage of the dataset in which to randomly start (ie: randomly start in the first 10% of data).
Default is to randomly start in the first 0% of data (which effectively disables this feature)
Closing as per #392
Will be released in v1.0.4


Add Persian (fa) Translation

What does this PR do?
Changes:

Translated index.md into Persian.
Organized translated files into the fa directory.

@alifirozjaei can you find another Farsi-speaker to review your PRs?


select2:select event doesn't trigger for the first time when selecting a tag

I have select2 widget with tags allowed and ajax data loading.
$('#order_address_select').select2({
            placeholder: "Start typing...",
            ajax: {
                url: '<?=Yii::app()->getBaseUrl(true)?>/order/getplacemarklist',
                dataType: 'json',
            },
            tags: true,
        });

When i'm selecting a tag after reloading page, event select2:select does not trigger, but when i'm typing text again, and selecting it, it works. Also it works fine with elements loaded by ajax. Here's my event handler:
$('#order_address_select').on('select2:select',function(e){
            console.log(e.params.data);
         });

Found same issue.


Remove method duplication

Issue
configure_user exists in shared library and has no difference.
(It used to have when we were using root@% to connect to database)
Solution
Remove it

This should be completed in the scope of task dpe-2178


Fix optional strings

Fix code generation for optional strings

Hi @28Smiles, thanks for your contributions! What problem does this exactly solve? I am curious what this will do with the generated code. You can add an extra columns in the build.rs located here:
https://github.com/Jasperav/Catalytic/tree/master/catalytic_table_to_struct/example
than run a test, it triggers the build.rs file and places the newly generated code in the src/generated dir.


Feature Request

Is there any plans to make adding custom fields to registration/sign in part of the gem by default. This would be a great addition, although there are ways to do it fairly easily it would be great if it was part of the gem (to avoid gem update related issues )

Thank you for the request. This gem permit you to extend any behavior overriding the views and extending the controllers.
You can use those features to customize which fields you want in the registration and sign in process similar with what is done in this guide in the wiki page https://github.com/plataformatec/devise/wiki/How-To:-Allow-users-to-sign-in-using-their-username-or-email-address.
Apart from those supported ways, we don't plan to add any other.

thank you


memcpy

Expose something like memcpy so users don't have to do silliness like:
let sp = ref (p +@ (offsetof name_)) in
String.iter (fun c -> !sp <-@ c; sp := !sp +@ 1) name

For the moment, there's some memcpy support in a separate package.


Fix/house keeping and bug fixes

Description
This PR is not associated with any particular Jira issue, the content of this PR is to hand off my current progress before I shift my focus to making our mono repo.
Summary of Changes:

implement the registration steps validation logic skeleton
modularize ModalStateManager previously in frontend/src/views/Seedlot/SeedlotRegistrationForm/index.tsx
modularize the submit popup previously in frontend/src/views/Seedlot/SeedlotRegistrationForm/index.tsx
remove eslint ignore comment in test files
force mockServerHost to be REACT_APP_NRSPARWEBAPP_VERSION in prod @RMCampos I think this will fix the prod crashing for sure now 👀

I think it's due to recent-activities endpoint returning an HTML file without mock server running

Ownership validation state is now a prop from the parent API, so it will not crash, this should fix FSADT2-618
fix Ownership portion calculation, tested with 3 owners each having: 33.33, 33.34, 33.33. This should fix FSADT2-615

Fixes # (issue)
Type of change
Please delete options that are not relevant.

[x] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)

How Has This Been Tested?
Test locally and manually
Checklist

[x] I have read the CONTRIBUTING doc
[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[x] My changes generate no new warnings
[x] I have added tests that prove my fix is effective or that my feature works
[x] New and existing unit tests pass locally with my changes
[x] Any dependent changes have already been accepted and merged

Further comments

Thanks for the PR!
Any successful deployments (not always required) will be available below.
Frontend available
Once merged, code will be promoted and handed off to following workflow run.
Main Merge Workflow

Thanks for the PR!
Any successful deployments (not always required) will be available below.
Frontend available
Once merged, code will be promoted and handed off to following workflow run.
Main Merge Workflow

WOAH 27 Code Smells 🤧🤧🤧, @DerekRoberts probably turned on some sonarcloud features. We should discuss if we can turn some off, for example with the current eslint and sonarcloud setting we cannot use for loops at all, and I'm not a fan of using forEach everywhere.

Eslint doesn't allow me to use for ... of

Sonarcloud doesn't let me use simple for loops

@RMCampos @lucasbuenoencora @mgaseta @ArthurEncr
It's ready for review :)


PR comment on c162209

place [HtmlAttributeNotBound] on its own line
don't use (wonderful) shortcut syntax
@Eilon's comment https://github.com/aspnet/Mvc/pull/2452/files#r29162068

/cc @Eilon

:shipit:

05ac641


How to obtain access to the test gateway

I want to register for the test gateway, but I do not find the information how to contact the "Test Opterator" as stated in https://github.com/eu-digital-green-certificates/dgc-participating-countries/blob/main/gateway/OnboardingChecklist.md?plain=1#L24

See https://github.com/eu-digital-green-certificates/dgc-overview/issues/56#issuecomment-986694777 and https://github.com/eu-digital-green-certificates/dgc-participating-countries/issues/10


Request to add plexkodiconnect and hbogoeu players

Hi
thank you for your great addon... is it possible to also add player for:
HBOGOeu video addon https://forum.kodi.tv/showthread.php?tid=339798
PLEXkodiconnect https://forum.kodi.tv/showthread.php?tid=262621
Thanks and
Best Regards

There are players for both of these now :+1:

Hi
Thank you very much but i cant find HBOGO player...
I always add movies or series in library with OpenMeta and this is work OK. Plexkodiconnect player is my default...When i start movies they always found 2 or 3 movies (same name) and then i choose which one to play....  First is usally 1080p (from folder Movies) Second is usally 4k (from folder Movies - 4k) Third is usally 4k remux (from folder Movies - 4k Remux)
Is possible to see also name of the folders or maybe name of the movie file?
When I start serie they always found only one with 1080 quality even if i have also 4k quality...
I have two folders with name: SeriesSeries - 4k
Is possible to see also name of the folders or maybe name of the serie file?
And also is it possible that if some movies or series dont found in Plex (default player) then automatically start Scrubs v2 player?
Thanks again for this great addon
and Best Regards                               janKO
On Friday, January 3, 2020, 04:45:21 AM GMT+1, drinfernoo<EMAIL_ADDRESS>wrote:

There are players for both of these now 👍
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or unsubscribe.

Oh man, I forgot to push it! Give me five minutes and I will!

OK it works but i must change this at begining:
  "plugin"       : "plugin.video.hbogoeu",  "priority"     : 300,  "id"           : "search.hbogoeu",
What about my questions for plexkodiconnect.... is possible or not?
Thanks :-)
On Friday, January 3, 2020, 05:39:51 PM GMT+1, drinfernoo<EMAIL_ADDRESS>wrote:

Oh man, I forgot to push it! Give me five minutes and I will!
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or unsubscribe.

There is already a PKC player, but what did you have to change in the hGO EU player?

"plugin" : "plugin.video.hgoeu",
change to
  "plugin"       : "plugin.video.hbogoeu",
and
"id" : "search.hgoeu",
change to
 "id"           : "search.hbogoeu",
I know PKC work but for series find only HD title and not also 4k title ... so please read again what already wrote to you ... sorry for my english :-(
Thanks
On Friday, January 3, 2020, 10:48:19 PM GMT+1, drinfernoo<EMAIL_ADDRESS>wrote:

There is already a PKC player, but what did you have to change in the hGO EU player?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or unsubscribe.

Ah, I missed a typo, is what you're saying. I just fixed the plugin and id fields, and pushed the new player file.
Would you please open a separate issue regarding any troubles you're having with the PKC player? They are a bit scattered here, and I can't quite figure out what you're asking for.

OK, here we go
Plexkodiconnect player issue · Issue #27 · a4k-openproject/json.openplayers
|
|
|
|  |  |
|
|
|
|  |
Plexkodiconnect player issue · Issue #27 · a4k-openproject/json.openplayers
Plexkodiconnect player is my default and work ... I have 3 movies folder: Movies Movies - 4k Movies - 4k Remux I...
|
|
|
Thanks for your help :-)
On Saturday, January 4, 2020, 12:42:31 AM GMT+1, drinfernoo<EMAIL_ADDRESS>wrote:

Ah, I missed a typo, is what you're saying. I just fixed the plugin and id fields, and pushed the new player file.
Would you please open a separate issue regarding any troubles you're having with the PKC player? They are a bit scattered here, and I can't quite figure out what you're asking for.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or unsubscribe.


Unhandled exception if MZ Loader tried to load file smaller than header says it is.

Ghidra appears to look at the MZ header's reported exe size and proceeds to load that many blocks from the file we're looking at. If the file isn't at least as big as the header says it is, the loader throws an exception. It works fine if the file is larger than the header says.
Fixing the header to report the actual size of the file (or exec data) allows the loader to do its thing. Padding the file with bytes until it reaches the header's reported size also works.
To Reproduce

Find an exe (MZ header+exec data) with a header that reports a larger total size than the file, assuming the rest of the exe is correct and complete.
Load it with the MZ 16-bit loader
Watch it crash.

Note: Step one applies to standalone files. Ghidra will analyze the MZ stub of a PE file because there's data after the MZ such that Ghidra can load as much data as the header reports. If you extract the stub and put it in a standalone file and load it, it will cause Ghidra to throw the exception.
Expected behavior
A check that the file size is not smaller than the header-reported size, offers a recommendation if it is, and asks the user how to proceed (fail, ignore the header size in favor of the file size, enter a custom size, etc.).
Environment (please complete the following information):

Linux Mint 21.2
Java Version: 17.0.9
Ghidra Version: 10.4
Ghidra Origin: Official GitHub Distro

Additional context
I noticed this bug when I separated the MSDOS stub exe from the PE exec (setup.exe from windows xp disk, probably anything else build by visual studio in that era). The actual stub is only 0x79 (0d121) bytes long, but the header itself gives the size as 0x490 bytes, well past the end of the MZ exe stub, and several sectors into the PE portion. The header size is correct at 0x40, so DOS knows where to find the exec data. My guess is that it just loads the whole file and only checks the MZ sig and the header size, does any relocations required, and jumps straight to the code.
If I correct the size reported in the header to match the actual size of the stub, ghidra digests it with no issues. If I feed it the whole MZ+PE and analyze it as an MZ, it also works just fine.

If I correct the size reported in the header to match the actual size of the stub, ghidra digests it with no issues. If I feed it the whole MZ+PE and analyze it as an MZ, it also works just fine.

I'm not sure I see the bug here.  My understanding (please correct me if I'm wrong) is that you did surgery on a PE file, but didn't leave it in a consistent state.  Generally speaking we only try to load things like this if the actual Windows loader can load it...otherwise, we just consider it corrupt and the failure is the desired outcome.
I am going to close this ticket, but I will reopen it if you make a strong case why we should support this specific type of header inconsistency.

My understanding (please correct me if I'm wrong) is that you did surgery on a PE file, but didn't leave it in a consistent state.
Incorrect. This is a stub whose filesize field is supposed to indicate the size of the stub itself, but does not. It executes perfectly in DOS, regardless of the size of that field. DOS literally does not care what bytes 02-03 and 04-05 say the executable's size is. It just loads the file using int 21h to wherever it wants, does the relocations, and jumps to the entry point.

Ghidra however DOES care about what the filesize field says, even when the filesystem says something different. It probably allocates space based on that field, and when it gets to the end of that allocated space but the file itself hits an eof (which it will be if you cut off the PE stuff), the tool crashes.
This is absolutely a bug. Behavior in a live system (DOS) effectively tells me that the filesize in the MZ header is potentially not to be trusted. Ghidra should at least prompt the user for how to handle that situation and handle it gracefully instead of crashing without giving a clear reason. If someone is trying to analyze a fat executable, and they isolate just the one they want from it for any reason, they should still be able to analyze it without any further surgery, assuming that the rest of the file is valid.

A correction to the above when running the bare stub.

FreeDOS, DOSemu, and DOSBox don't care and go by the filesystem size.
MSDOS 6.22 checks it and actually throws an error about the exe being invalid.
I didn't check on a windows system, but I assume it probably just looks for the PE signature or something and goes from there, ignoring the DOS stub entirely.
A custom exe loader from an old booter game I've been working on reversing (it uses an exe format, but isn't using DOS), also doesn't check the size in the header, which reports a smaller executable than the filesystem does (and thus would not run into this issue anyway).

So what we have here is more modern software seems to potentially treat the exe size as untrusted. MSDOS probably just throws the error when it hits EOF earlier than it was expecting from the filesize field.
I still think it should be considered a bug due to the fact that it throws an exception without really saying why, different systems handle this differently, and could easily just be handled by a simple check of "if ( header.filesize < os.filesize ) { showmessage(); failgracefully(); }"

Ok, I can ensure that it loads, and put out a warning if there is a mismatch.

That seems like a pretty solution to me.


WSARecv tcp <IP_ADDRESS>:10454: i/o timeout,when update To go1.4.2

Use of the latest code.And update To go1.4.2.
modbus.NewTCPClientHandler
error:WSARecv tcp <IP_ADDRESS>:10454: i/o timeout

I already know.
FuncCodeReadDiscreteInputs = 2
modify
FuncCodeReadDiscreteInputs = 3
because FuncCodeReadDiscreteInputs is const.
I must  edit lib code.

@chengziqing  Would you please clarify what the issue is? Did you got i/o timeout when using ReadDiscreteInputs or ReadHoldingRegisters?
From what you've suggested, I think your server does not support function code ReadDiscreteInputs (0x02)?


skip deploy job when package version has not been increased

All the packages workflows currently have a similar issue for the deploy job: if the version hasn't been bumped, it will fail as conflicting during the deployment phase.
The list of workflows includes all workflows starting with abstractions-, authentication-, serialization- and http-.
Here is what we need:

[ ] 3 new powershell scripts in the "scripts" folder.
[ ] each script will take a path, a package name, and a feed url as mandatory parameters.
[ ] each script will be dedicated to one package ecosystem (npm, nuget, maven).
[ ] each script will get the latest version of the package on the feed for the given package name
[ ] each script will get the version of the package in the package path that's been provided
[ ] each script will compare the two versions and set a workflow variable indicating whether the package versions on the feed and in the package file are identical or not
[ ] workflows deploy job will be updated to call that the corresponding version check script with corresponding parameters
[ ] subsequent steps need a condition to execute only if the value has changed
AB#9755

@wcontayon do you feel like you could take on this one? are the instructions I put together clear enough?

@baywet, I can try a PR on it. It'll improve my scripting knowledge 🙂 🙂

Thanks! Assigning to you. Don't hesitate if you have questions.

Closing this as we're moving the kiota packages for each language to their own repo and it will be the responsibility of the dedicated repo to handle that depending on the deployment workflow.


Support for alternative parts other than text/plain and text/html

We have an application that sends out emails with the following structure:

multipart/alternative

text/html
text/calendar

This mimics the style of emails sent out by Outlook, allowing invitation emails to be sent (and canceled) from a Rails application with native Outlook "Approve/Tentative/Decline" buttons.
I wanted to use premailer-rails to allow us to easily style these emails, but unfortunately it munges this email and drops the text/calendar part when it adds the text/plain part. I think I could probably get it to work by disabling the generation of the text/plain part, but I ended up falling back to inline styles and removing premailer-rails for the moment.
It would also be good to deal with messages that are structured similar to how Google Calendar structures its invitation emails:

multipart/mixed

multipart/alternative

text/plain
text/html
text/calendar

application/ics

Thanks for your input. Indeed, premailer-rails is a bit naive about this, judging by a quick look at the code. I think it simply grabs the text/html part and replaces it by a multipart/alternative that contains a text/html and a text/plain part.

This would be great for another reason as well: if you don't want to rely on premailer to generate the text/plain portion, there is no way to do this. Premailer clobbers whatever plaintext you may have created in ActionMailer.

PRs welcome ❤


Error while advancing transaction in new block / sql error in trending

Getting this on master now. Additional debugging shows:
Traceback (most recent call last):
  File "/home/tom/lbry/lbry/lbry/wallet/server/db/trending.py", line 47, in finalize
    return (self.last - self.mean) / (self.standard_deviation or 1)
  File "/home/tom/lbry/lbry/lbry/wallet/server/db/trending.py", line 42, in standard_deviation
    return sqrt((self.power / self.count) - self.mean ** 2)
ValueError: math domain error
ERROR:torba.server.block_processor.LBRYBlockProcessor:Error while advancing transaction in new block.
Traceback (most recent call last):

      0.04mins calculate_trending
====================================================================================================
INFO:torba.server.block_processor.LBRYBlockProcessor:our height: 663,132 daemon: 670,775 UTXOs 849MB hist 148MB
INFO:torba.server.block_processor.LBRYBlockProcessor:our height: 665,341 daemon: 670,775 UTXOs 854MB hist 155MB
INFO:torba.server.block_processor.LBRYBlockProcessor:our height: 666,640 daemon: 670,775 UTXOs 834MB hist 164MB
INFO:torba.server.block_processor.LBRYBlockProcessor:our height: 667,245 daemon: 670,775 UTXOs 835MB hist 167MB
Traceback (most recent call last):
  File "/home/tom/lbry/lbry/lbry/wallet/server/db/trending.py", line 47, in finalize
    return (self.last - self.mean) / (self.standard_deviation or 1)
  File "/home/tom/lbry/lbry/lbry/wallet/server/db/trending.py", line 42, in standard_deviation
    return sqrt((self.power / self.count) - self.mean ** 2)
ValueError: math domain error
ERROR:torba.server.block_processor.LBRYBlockProcessor:Error while advancing transaction in new block.
Traceback (most recent call last):
  File "/home/tom/lbry/lbry/lbry/wallet/server/block_processor.py", line 76, in advance_blocks
    self.timer.run(super().advance_blocks, blocks)
  File "/home/tom/lbry/lbry/lbry/wallet/server/block_processor.py", line 30, in run
    return func(*args, **kwargs)
  File "/home/tom/lbry/torba/torba/server/block_processor.py", line 378, in advance_blocks
    height, block.transactions, self.coin.electrum_header(block.header, height)
  File "/home/tom/lbry/lbry/lbry/wallet/server/block_processor.py", line 92, in advance_txs
    timer.run(self.sql.advance_txs, height, txs, header, self.daemon.cached_height(), forward_timer=True)
  File "/home/tom/lbry/lbry/lbry/wallet/server/block_processor.py", line 28, in run
    return func(*args, **kwargs, timer=t)
  File "/home/tom/lbry/lbry/lbry/wallet/server/db/writer.py", line 752, in advance_txs
    r(calculate_trending, self.db, height, daemon_height)
  File "/home/tom/lbry/lbry/lbry/wallet/server/block_processor.py", line 30, in run
    return func(*args, **kwargs)
  File "/home/tom/lbry/lbry/lbry/wallet/server/db/trending.py", line 96, in calculate_trending
    """)
sqlite3.OperationalError: user-defined aggregate's 'finalize' method raised error

This is no longer happening, closing.


Windows install

This version is now able to be pip installed on both windows and linux, but then requires the user to also install oemof.tabular  manually with pip install -e<EMAIL_ADDRESS>Ideally oemof.tabular next release can be installed without dependencies problem and it can be added to the requirements/build_requirements.txt file

:)!!!!


Add Algorithm execution thread

Expected Behavior

Algorithm code is executed always by the same thread. This is required to allow functional debugging in python, specifically adding breapoints during a debugging session, why? Because existing debugging python tools set new breakpoints in a per thread fashion, this being a limitation of the underlying python debugger.

Actual Behavior

Currently Lean uses Tasks to execute algorithm code, in consequence the thread executing the code changes during the life of the process.

Potential Solution

Add a worker thread that will execute Algorithm code

Reproducing the Problem

N/A
System Information

N/A
Checklist

[x] I have completely filled out this template
[x] I have confirmed that this issue exists on the current master branch
[x] I have confirmed that this is not a duplicate issue by searching issues

[x] I have provided detailed steps to reproduce the issue

Is there any potential performance impact from keeping all the Algorithm code in one thread? Do we lose some multi-threading performance boost?

No, there shouldn't be any performance impact. Before we sequentially used 1 Task (any thread from the pool), now we will use the same thread instance.


Using within electron

Currently if window is undefined it does an ealry return. When using it in electron in the main process, window will be undefined, but it can be specified later:
import {BrowserWindow} from 'electron'
const win = BrowserWindow.getFocusedWindow()
const mousetrap = new Mousetrap(win)

Lets make it less opinionated about the environment.

Sorry, we can't access the DOM process from the main process anyways.


Revert "Components/md chips"

Reverts marcosmoura/vue-material#261

Why?

It was a temporary commit.


Enforce the default cwOption and update README

Prior to this patch, the application raised an error when cwOption is not specified. This pull request also updates README.md for reflecting the recent changes in the code.

thanks for the update!


AMBARI-24712. Backport Execution Command Library from branch 'branch-feature-AMBARI-14714' to Ambari 2.8.0

What changes were proposed in this pull request?
Background: Execution Command library was introduced in Ambari's branch 'branch-feature-AMBARI-14714'.
Now, we are back-porting Execution Command library for Ambari 2.8 release.
As of now, we have been parsing the Execution Command command*.json directly, which isn't ideal as there is no interface to :

shield the changes that we would like to make in command*.json structure, if need be, and
Not a good programming approach.

Thus, Execution Command library creates an interface for accessing the command*.json structured data. Reference for a sample execution*.json can be checked at : ambari-server/src/test/python/TestExecutionCommand_command.json
How was this patch tested?
Ran the added UT.
$ pwd
… ambari/ambari-server/src/test/python
$ python unitTests.py
....
....
Running tests for ambari-server
....
....
test_access_to_cluster_settings (TestExecutionCommand.TestExecutionCommand) ... ok
test_access_to_execution_command (TestExecutionCommand.TestExecutionCommand) ... ok
test_access_to_module_configs (TestExecutionCommand.TestExecutionCommand) ... ok
test_access_to_stack_settings (TestExecutionCommand.TestExecutionCommand) ... ok
test_get_java_version (TestExecutionCommand.TestExecutionCommand) ... ok
test_get_module_configs (TestExecutionCommand.TestExecutionCommand) ... ok
test_get_module_name (TestExecutionCommand.TestExecutionCommand) ... ok
test_null_value (TestExecutionCommand.TestExecutionCommand) ... ok

----------------------------------------------------------------------
Ran 8 tests in 0.017s

OK
----------------------------------------------------------------------
Total run:8
Total errors:0
Total failures:0
OK

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/Ambari-Github-PullRequest-Builder/4177/
Test FAILed.
Test FAILured.

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/Ambari-Github-PullRequest-Builder/4178/
Test FAILed.
Test FAILured.

[AMBARI-24712. Backport Execution Command Library from branch 'branch-…](/apache/ambari/pull/2428/commits/49e5109d6eb5e18c6bd1c89f65265710f675febd)  …

Updated code as per @adoroszlai review comments.

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/Ambari-Github-PullRequest-Builder/4184/
Test FAILed.
Test FAILured.

@swapanshridhar Can you push incremental commits instead of amending to ease re-review? Thanks.

Updated as suggested @adoroszlai

[AMBARI-24712. Backport Execution Command Library from branch 'branch-…](/apache/ambari/pull/2428/commits/e02749c00ab9928f7e272c234101d3c96fb77b68)   …

As I had already merged and pushed before your suggestion of not merging, hhis change has empty  init.py removed.

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/Ambari-Github-PullRequest-Builder/4185/
Test FAILed.
Test FAILured.

retest this please

Thanks @swapanshridhar for the changes.

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/Ambari-Github-PullRequest-Builder/4187/
Test FAILed.
Test FAILured.

retest this please

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/Ambari-Github-PullRequest-Builder/4189/
Test PASSed.

Empty __init__.py files fail the RAT check.

Removed empty inits.py.


add baidu-brpc-java-3.x plugin

Add an agent plugin to support baidu-brpc-3.x

[x] Add a test case for the new plugin, refer to the doc
[ ] Add a component id in the component-libraries.yml
[ ] Add a logo in the UI repo

[ ] If this pull request closes/resolves/fixes an existing issue, replace the issue number. Closes #.
[ ] Update the CHANGES log.

The test scenario has not been added into GitHub action control file. We can't verify this plugin in the CI until you do.

Plugin-list.md  and supported-list.md should be updated accordingly. CI fails due to the first file not changes.
Also, you should update changes.md in the root.


[VS Code] Joining collaboration session: connect ENOENT \.\pipe\vscode.31229a691c1408c28cea36adf0d51725

<!--
For Visual Studio problems/feedback, please use the Report

Closing this as a duplicate of #1819.


Draft: Testing of "Implement Apollo Federation v2"

@Aeliot-Tm thanks for all your great work so far. Maybe point this PR to the branch of https://github.com/Skillshare/apollo-federation-subgraph-compatibility/pull/1 ?


How to implement the new check-in function for booking tickets

In the latest blog article, a new check-in function for booking tickets is described.
The blog article shows this new process from the end-users perspective.
I would like to use this function for my event online shop, so I searched the documentation on how to implement this functionality, but I did not find any information about this.
Where can I find information about this?

Internal Tracking ID: EXPOSUREAPP-11110

Hi @derweili
Does https://www.t-systems.com/de/en/newsroom/news/corona-validation-service-475486 help you?

@derweili
https://github.com/corona-warn-app/cwa-documentation/issues/780#issuecomment-998553495 quoted the document Guidelines on the use of Digital Covid Certificates in traveller and online booking scenarios saying that Chapter 3 is implemented in CWA. That may be useful as background reading only.
I also raised this question in

https://github.com/corona-warn-app/cwa-website/issues/2218

@derweili Thanks for raising this issue.
Internal Tracking ID: EXPOSUREAPP-11110

Corona-Warn-App Open Source Team

Thank you all for this information. So I suspect there is currently no public validation service, unlike the one for event OR codes (https://www.coronawarn.app/de/eventregistration/), right?
As I understand the App only implements the Wallet/Client Functionality described in chapter 3 (see @MikeMcC399 comment) while the the validation service is a payed feature build by t-systems (@Ein-Tim )?
Is this correct?

@derweili
The German FAQ section Zertifikatprüfung bei Buchungen was updated today and the article Fragen und Antworten zur Zertifikatsprüfung bei Ticketbuchungen includes the text:
"Welche Unternehmen bieten bereits einen DCC-Validierungsservice an?
Erster Anbieter ist T-Systems. Das Modell ist bewusst marktoffen gestaltet und lässt mehrere verschiedene Anbieter zu.  Mit Wettbewerb wollen wir eine möglichst schnelle Verbreitung von Validierungs-Diensten unterstützen."
This doesn't however provide any contact information or instructions about how to integrate with it.

I'm going to clarify the contact details for participation and integration of the validation service. The results will then be added to the existing communication in FAQ and/or blog.

@GisoSchroederSAP
I see that there was an update to the blog https://www.coronawarn.app/en/blog/2021-12-20-cwa-2-15/ today:
Important update from January 10, 2022: The Europe-wide requirements for online verification services have already been in place since October 2021. In Germany, no provider of an online verification service has been approved yet.

FYI: https://github.com/corona-warn-app/cwa-website/issues/2218#issuecomment-1094809124
There is no validation service provider available anymore, which makes this question de-facto obsolete.
The community managers (@dsarkar) should decide how to proceed with this issue, I suggest to close it.

Closing as suggested, internal ticket is set to obsolete.


Cannot extract factor column as Integers

I'm matching an Robj based on its rtype. Factors are of type integer, but it is not possible to extract them.
library(rextendr)

rust_function(r"-{
fn from_factor(x: Robj) {
  rprintln!("x has an Rtype of {:?}", x.rtype());
  rprintln!("{:?}", Integers::try_from(&x));
}
}-")
#> ℹ build directory: '/private/var/folders/wd/xq999jjj3bx2w8cpg7lkfxlm0000gn/T/RtmpfPtaVc/filefc134fbc88c3'
#> ✔ Writing '/private/var/folders/wd/xq999jjj3bx2w8cpg7lkfxlm0000gn/T/RtmpfPtaVc/filefc134fbc88c3/target/extendr_wrappers.R'

from_factor(iris$Species)
#> x has an Rtype of Integers
#> Err(ExpectedInteger([1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3].set_class(["factor"]))

Created on 2024-04-20 with reprex v2.1.0

I've looked into this. The issue is, that is_integer doesn't accept factors, as it should. I believe it is time to bite the bullet and make a Factors-type. We can start with a rust definition for it, and clarify some conversions. Then I can add my enum to R factor conversion, and we can have a full fledged feature.
I hope we can do this is a collaborative manner, as we have done before.

It is worth it to mention that we do have some factor support in extendr.
Factors may be interpreted as a sequence of strings, because in reality, they are sort of that.
We have AsStrIter-trait, which provides as_str_iter(&self) -> Option<StrIter> on Robj.
This means, if you've got a factor (in an Robj), you may retrieve a StrIter from it.


Multipart upload

Hello,
at first great library. Question if anyone knows how to declare multipart upload?

Hello @szuttenbach looking at the following example: from swagger.io the correct way to replicate it with @asteasolutions/zod-to-openapi would be:
const registry = new OpenAPIRegistry();

// Please note that the formats from the example are omitted for brevity
const Schema = z.object({
  id: z.string(),
  address: z.object({
    street: z.string(),
    city: z.string(),
  }),
  profileImage: z.string(),
});

registry.registerPath({
  method: 'post',
  path: 'upload',
  request: {
    body: {
      content: {
        'multipart/form-data': {
          schema: Schema,
        },
      },
    },
  },
  responses: {},
});

the resulting YAML is:
paths:
  upload:
    post:
      requestBody:
        content:
          multipart/form-data:
            schema:
              type: object
              properties:
                id:
                  type: string
                address:
                  type: object
                  properties:
                    street:
                      type: string
                    city:
                      type: string
                  required:
                    - street
                    - city
                profileImage:
                  type: string
              required:
                - id
                - address
                - profileImage
      responses: {}

Does that work for you? If yes please go ahead and close the issue. And if not, please let me know.

Hi, thank you for the response, but string is not correct type of a binary file, so when I want to pass the file to another function as a Buffer it has incorrect type.

I was trying to use z.instanceOf(Buffer), but then it's not generating swagger at all, so it seems that it's not supported.

Sure, yes that is a separate problem. z.instanceof is not supported at this point. And I am not sure if we can even implement, I'll give it a go soon. For the time being I would suggest just using z.instanceOf(Buffer).openapi({ /*You must pass type and then everything you want*/  }) to provide your own documentation for this particular instance. That way you would still have the Buffer type in your code but the documentation would be generated properly.


Column with table prefix in where() clause not recognized as attribute in joins

I'm encountering an issue that seems to be related to changes introduced in version 2.9.8. When performing joins, the where() clause does not recognize columns with table prefixes as attributes of the model.
For example, this query:
MyTable::query()->join('other_table', ...)->where('my_table.status', 1)

Expected Behavior: The where() clause should recognize my_table.status as a valid column.
Actual Behavior:
Parameter #1 $column of method Illuminate\Database\Eloquent\Builder<App\Models\MyTable>::where() expects
 array<int|model property of App\Models\MyTable,mixed>|(Closure(Illuminate\Database\Eloquent\Builder<App\Models\MyTable>): Illuminate\Database\Eloquent\Builder<App\Models\MyTable>)|(Closure(Illuminate\Database\Eloquent\Builder<App\Models\MyTable>): void)|Illuminate\Contracts\Database\Query\Expression|model property of App\Models\MyTable,
 'my_table.status' given.

Related to: https://github.com/larastan/larastan/pull/1959

Same thing here ! Specially with Filament fields.

This works just fine on my fork (calebdw/larastan):
User::query()->join('roles', 'users.role_id', '=', 'roles.id')->where('roles.id',  1)->where('users.id', 1);

So has been fixed by one of my PRs (likely closed by #1879)

Thank you so much @calebdw , it's working great!

Hi,
Cannot reproduce this. We already have this test case, and it correctly find the error. And even more if I add User::query()->join('roles', 'users.role_id', '=', 'roles.id')->where('users.email', 'admin'); it doesn't complain.

@canvural I've created a branch with reproducible code of the bug. You can see the test cases here:
https://github.com/larastan/larastan/compare/2.x...KennedyTedesco:larastan:issue-2002
Maybe @calebdw has some ideas?

Thanks I'll check it 👌

The following works just fine on my fork which indicates that one of my PRs has fixed this issue:
User::query()->join('roles', 'users.role_id', '=', 'roles.id')->where('name', 'John');
User::query()->join('roles', 'users.role_id', '=', 'roles.id')->where('users.name', 'John');

@KennedyTedesco, there is no reason to add the @property $type in your commit. Larastan gets the actual database columns from the schema/migrations and not model annotations

@calebdw Thanks! I work on an application (big one) where we have columns annotations for all our models. And guess what? We don’t use migrations!😄

I see where the problem is now. When we have table_name.column we check the column only in database structure, we do not take the @property tags into account.

we do not take the @property tags into account.

This should not be done because @property tags can be any number of virtual tags which are not guaranteed to exist in the database

I have checkModelProperties: true enabled in my application, which is why this was never a problem for me before. However, Larastan now validates the actual column usage in queries. Perhaps we could introduce a new parameter to disable this specific validation of column usage in queries?
I understand what @calebdw pointed out: a model can have getters (virtual properties), and the Larastan validation could lead to false positives in some cases.
That's a tough one.

Do you not have schema dumps that Larastan can scan? How do you have a database with no migrations or dumps?

The database I work with is almost 20 years old. We have never used migrations, as it never made sense to us.
We also don't have schema dumps in the app because it never made sense to have them before. But this isn't a problem for us. We could create a schema dump if needed. Not a problem at all.
I'll try that. This could be the best approach to continue using Larastan. But I still think it would be nice to have this validation as opt-in.

We have never used migrations, as it never made sense to us.

How do you continue to manage the data and update the schema (just curious)? I also work on a older codebase and we use the dumps in conjunction with migrations, but we squash migrations fairly often so there's not a ton of files to parse through.
Also, what database are you using? If you're using Postgres (like we are) then you might need some additional workarounds

We've become experts in that, and we've never had any troubles managing it. Only two people touch the database. =D
We use MySQL.

I'll certainly try that. Thanks for your kind help with this issue.

We have more than 500 tables, and this is causing many issues, even with all the schemas in place. We have numerous dynamic connections because we deal with multi-tenant logic and so on.
In my opinion, for our project, checkModelProperties: true is more crucial (and works like a charm) than evaluating table columns (which doesn't add much value for us, as we've lived without it for about 12 years now using Laravel).
I believe this should be opt-in, with a new option like checkDatabaseColumns: false|true, something like that.
I hope someone can implement this in the future. =D

If it interests someone, I have created this ignore rule to bypass those errors, as it is not crucial for my project for now. :blush:
    ignoreErrors:
        - '#Parameter \#1 \$(column|value|attribute|callback)s? of method Illuminate\\Database\\Eloquent\\Builder.*expects.*given\.#'

same problem when using "as" for table alias
$contacts = Transaction::query()
    ->select(['transactions.*'])
    ->join('make_call_logs as m', 'm.transaction_id', '=', 'transactions.id')
    ->where('m.created_at', '>', Carbon::parse('-3 days'))


Modify and Improve the "Delete all" button functionality

Is your feature request related to a problem? Please describe.
There is a button "Delete all" in the bookmark section which deletes all the bookmarks.
The export bookmark feature has also been moved from the options page to the bookmarks section. So, now we have two more buttons (refer to the screenshot below). Users can manually select the bookmarks they want and then export them by clicking the "Export bookmarks" button. If they want to export all of them, they can click the "Select all" button to select all the images and then press the "Export Bookmarks" button.

It would be good if we could mix these two features: Users might not want to delete all the bookmarks all at once, therefore let them select the images they want to delete.
Describe the solution you'd like
Change the "Delete all" button to "Delete", i.e make it delete only those images that are checked by the user. If they click on the button without selecting any of the bookmarks, then show a snackbar warning "No bookmarks selected".

Hey, can I work on this issue?

@harsh551 go ahead.


Allow GrantItem REs to assign a badge value to granted items

https://user-images.githubusercontent.com/43446478/198371192-b2a6fc47-c853-4220-9acb-64334920bda2.mp4
This PR changes the behaviour of GrantItem REs so that they can now set the granted item's badge value if applicable (right now, only Effects and Conditions).
If "Reevaluate on Update" is ticked on, the granted item's badge value will update if something changes on the actor / item.

This is planned, but I'd like to approach it in a broader way to anticipate other alterations to an item.

If I recall, there's a standing uncertainty over whether item alterations should be part of the GrantItem itself or defined in subclasses. Which at this point honestly, I'm fine with either if defining the item type in GrantItem is untenable or unwieldy. This is actually one of those "hard problems" you've stumbled into, one that is actually the reason we've been building out this functionality.

So should this PR be just closed then?

There was a bit of a discussion. Shark, what's your opinion on an "overrides" object with a "type" field that restricts the type of item being overriden, that explicitly handles specific overrides for the item?

Taking a less stapled-on approach to this


universal_io, Question about?

Please, can you explain why you need this package, "universal_io," inside this translation package?

It was used instead of dart:io (which is not supported on Web) to access Platform.localeName.

It was replaced & removed in version 5.0 (pre-release currently).


Willow MSBuild fails the build without any indication of what went wrong

Build log:
https://gist.github.com/davkean/61d053a2d70081fb4b5555c97286d5f0
I cannot for the life of me, figure out what is causing the build to fail.

Does this still repro?

Close to resolve this as a dupe of 1526.


Student voice: Update differences between what shows in profile notes / profile insights (WIP)

Moving over from https://github.com/studentinsights/studentinsights/pull/2398.

This branch is broken now; this will need some refactoring to split out: profile notes from profile insights.

selfie


Create links for liblto_plugin.so

For AR to work with LTO objects, it is necessary for lib/bfd-plugins/liblto_plugin.so to be present.
Make a link to the location where the build process leaves it for LD.

Fixed in 8.2.1-1.5.


[BUG] Fishstrap automatically closing

Fishstrap Version
v<IP_ADDRESS>
What problem did you encounter?
For some reason when i try launching fishstrap it automatically closes. i tries using test mode and when i launch it just puts me in settings. please help
Bloxstrap Log
N/A

Can you check if you're using vulkan rendering?

Yes I am using vulkan settings.

Sounds like a client issue. Can you try removing all of your feature flags?

I did that and switched to direct3D 10 and it now works, ty!


upgrade zend optimizer to 3.3.9

The Dockerfile installs zend optimizer 3.3.3, but 3.3.9 is the latest version in that series (3.3.3 is segfaulting for me, whereas 3.3.9 is fine)
http://downloads.zend.com/optimizer/3.3.9/ZendOptimizer-3.3.9-linux-glibc23-x86_64.tar.gz

Thanks for the clue!


Refactor Dashbord views to remove redundancy and make easier to understand

Make use of ViewDispatcher like other views does.

See discussion in https://github.com/OpenTechFund/hypha/pull/1928.

The dashboard view is already using ViewDispatcher. It is about abstracting duplicate code from views in a base class. And inherit in main views. Some code in get methods can also be in get_context_data method.


WIP: update current state of web console

This is the current state of affairs for the web-based version of the Jupyter Qt console: https://github.com/jupyter/jupyter-js-notebook/issues/170
It is a work in progress, this PR is just to keep the development more transparent.

Can you post a gif of the current state?

Thanks for posting a screenshot!

Merge and iterate!


Go To Symbol (Ctrl+Shift+O) doesn't pick up on prototype methods

It seems that the code editor only scans for symbols with named functions, not functions assigned to variables, which makes the following code not have any symbols to go to, except for the constructor:
function A() {}
A.prototype.myMethod = function() {};

Expected behavior
The Go To Symbol command should find the myMethod function symbol instead of just A in the dropdown list.
Current behavior (0.10.3)
The Go To Symbol dropdown only lists A as the only symbol in the file (the only named function).

@jrieken fyi

Will move to TypeScript since they to the math for us.

This issue was moved to Microsoft/TypeScript#6145


Feature: NextJS Landing

Summary
I consider NextJS as a good option to develop the foundation of the landing page. This PR includes all the basic setup + github pages deploy.
@mario-ezquerro @dcristobalhMad we can discuss here the pros and cons to avoid falling into the rabbit hole.
Deployed GH Pages link: https://cloudnativerioja.github.io/official-website/
Related issues

#1
#2

For the first version I think it can be enough, what do you think?
BTW nice job! :partying_face:


'Configure Soft Delete Policy…'  is not localized on Blob Containers context menu

Storage Explorer Version: 1.10.1
Build: 20190926.4
Branch: master
Platform/OS: Windows 10/ Linux Ubuntu 18.04/macOS High Sierra
Architecture: ia32/x64
Language:  Chinese (zh-CN) / Chinese (zh-TW)
Regression From: Not a regression
Steps to reproduce:

Launch Storage Explorer -> Open Settings panel-> Preference Locale.
Select language as 'Chinese (simplified)' -> Restart Storage Explorer.
Expand one non-ADLS Gen2 storage account.
Right click 'Blob Containers' -> Check its context menu.

Expect Experience:
'Configure Soft Delete Policy…' is localized.
Actual Experience:
'Configure Soft Delete Policy…' is not localized.

Good catch. Missed localizing a string. Will also need to be translated.

On translation now.
File: loc\en\src\Standalone\resources\Azure.json
ID: 0; "ActionConfigureSoftDeletePolicy"
SRC: Configure Soft Delete Policy...
TGT: 配置软删除策略

Verified fixed on master.


[1.6.x][Compaction] Random compaction failures

Expected Behavior

Compaction completes without any error.

Current Behavior

Temporary file is not deleted.
couch.log has following stack trace
`[Thu, 17 Aug 2017 11:14:30 GMT] [error] [emulator] Error in process <0.12887.1> with exit value: {function_clause,[{couch_db_updater,'-copy_docs/4-fun-3-',[not_found],[{file,"couch_db_updater.erl"},{line,857}]},{lists,map,2,[{file,"lists.erl"},{line,1224}]},{lists,map,2,[{file,"lists.erl"},{line,1224}]},{couch_db_updater,copy_docs...

[Thu, 17 Aug 2017 11:14:30 GMT] [error] [<0.5045.1>] ** Generic server <0.5045.1> terminating
** Last message in was {'EXIT',<0.12887.1>,
{function_clause,
[{couch_db_updater,'-copy_docs/4-fun-3-',
[not_found],
[{file,"couch_db_updater.erl"},
{line,857}]},
{lists,map,2,[{file,"lists.erl"},{line,1224}]},
{lists,map,2,[{file,"lists.erl"},{line,1224}]},
{couch_db_updater,copy_docs,4,
[{file,"couch_db_updater.erl"},
{line,856}]},
{couch_db_updater,'-copy_compact/3-fun-0-',7,
[{file,"couch_db_updater.erl"},
{line,917}]},
{couch_btree,stream_kv_node2,8,
[{file,"couch_btree.erl"},{line,708}]},
{couch_btree,stream_kp_node,7,
[{file,"couch_btree.erl"},{line,637}]},
{couch_btree,fold,4,
[{file,"couch_btree.erl"},{line,159}]}]}}
** When Server state == {db,<0.5044.1>,<0.5045.1>,<0.12887.1>,
<<"1502965878196162">>,<0.5046.1>,<0.5042.1>,
<0.5048.1>,
{db_header,6,885493,0,
{6119000697,{39549,257,136740145},7541350},
{6119002975,42754,3498231},
{6119018635,[],8490},
286,6117892339,5154762888,1000},
885493,
{btree,<0.5042.1>,
{6119000697,{39549,257,136740145},7541350},
#Fun<couch_db_updater.10.75275056>,
#Fun<couch_db_updater.11.75275056>,
#Fun<couch_btree.5.71351651>,
#Fun<couch_db_updater.12.75275056>,snappy},
{btree,<0.5042.1>,
{6119002975,42754,3498231},
#Fun<couch_db_updater.13.75275056>,
#Fun<couch_db_updater.14.75275056>,
#Fun<couch_btree.5.71351651>,
#Fun<couch_db_updater.15.75275056>,snappy},
{btree,<0.5042.1>,
{6119018635,[],8490},
#Fun<couch_btree.3.71351651>,
#Fun<couch_btree.4.71351651>,
#Fun<couch_btree.5.71351651>,nil,snappy},
885493,<<"c0050-10236326">>,
"/var/lib/couchdb/c0050-10236326.couch",
[#Fun<couch_doc.8.24157724>],
[{<<"admins">>,
{[{<<"names">>,
[<<"C0050-10236326SYNCUSER57DF65FA">>]},
{<<"roles">>,[<<"admin">>]}]}},
{<<"readers">>,
{[{<<"names">>,
[<<"C0050-10236326SYNCUSER57DF65FA">>]},
{<<"roles">>,[<<"reader">>]}]}}],
5154762888,
{user_ctx,null,[],undefined},
nil,1000,
[before_header,after_header,on_file_open],
[{user_ctx,
{user_ctx,
<<"C0050-10236326SYNCUSER57DF65FA">>,
[<<"admin">>],
<<"{couch_httpd_auth, default_authentication_handler}">>}}],
snappy,nil,nil}
** Reason for termination ==
** {function_clause,
[{couch_db_updater,'-copy_docs/4-fun-3-',
[not_found],
[{file,"couch_db_updater.erl"},{line,857}]},
{lists,map,2,[{file,"lists.erl"},{line,1224}]},
{lists,map,2,[{file,"lists.erl"},{line,1224}]},
{couch_db_updater,copy_docs,4,
[{file,"couch_db_updater.erl"},{line,856}]},
{couch_db_updater,'-copy_compact/3-fun-0-',7,
[{file,"couch_db_updater.erl"},{line,917}]},
{couch_btree,stream_kv_node2,8,[{file,"couch_btree.erl"},{line,708}]},
{couch_btree,stream_kp_node,7,[{file,"couch_btree.erl"},{line,637}]},
{couch_btree,fold,4,[{file,"couch_btree.erl"},{line,159}]}]}
[Thu, 17 Aug 2017 11:14:30 GMT] [error] [<0.5045.1>] {error_report,<0.31.0>,
{<0.5045.1>,crash_report,
[[{initial_call,
{couch_db_updater,init,['Argument__1']}},
{pid,<0.5045.1>},
{registered_name,[]},
{error_info,
{exit,
{function_clause,
[{couch_db_updater,'-copy_docs/4-fun-3-',
[not_found],
[{file,"couch_db_updater.erl"},{line,857}]},
{lists,map,2,[{file,"lists.erl"},{line,1224}]},
{lists,map,2,[{file,"lists.erl"},{line,1224}]},
{couch_db_updater,copy_docs,4,
[{file,"couch_db_updater.erl"},{line,856}]},
{couch_db_updater,'-copy_compact/3-fun-0-',7,
[{file,"couch_db_updater.erl"},{line,917}]},
{couch_btree,stream_kv_node2,8,
[{file,"couch_btree.erl"},{line,708}]},
{couch_btree,stream_kp_node,7,
[{file,"couch_btree.erl"},{line,637}]},
{couch_btree,fold,4,
[{file,"couch_btree.erl"},{line,159}]}]},
[{gen_server,terminate,6,
[{file,"gen_server.erl"},{line,744}]},
{proc_lib,init_p_do_apply,3,
[{file,"proc_lib.erl"},{line,239}]}]}},
{ancestors,[<0.5044.1>,<0.5041.1>]},
{messages,[]},
{links,[<0.5044.1>]},
{dictionary,[]},
{trap_exit,true},
{status,running},
{heap_size,75113},
{stack_size,27},
{reductions,156752}],
[]]}}`
Possible Solution

Document purge delete the document from the db, but not from index.
Discard any document that is not in the db but only in the main index file.
Create a new database replicating from the current db.

Steps to Reproduce (for bugs)

Exact steps are unknown.

Context
DB is growing due to compaction failures.
Your Environment

Version used: 1.5 and 1.6
Browser Name and version:
Operating System and version (desktop or mobile): Ubuntu 16.04
Link to your project:  -

Following code is to avoid compaction failure when document not found in the db but only in index.
`
diff --git a/src/couchdb/couch_db_updater.erl b/src/couchdb/couch_db_updater.erl
index c92097f62..4a783aad0 100644
--- a/src/couchdb/couch_db_updater.erl
+++ b/src/couchdb/couch_db_updater.erl
@@ -884,7 +884,10 @@ copy_docs(Db, #db{updater_fd = DestFd} = NewDb, InfoBySeq0, Retry) ->
fun({_, _, _, AttLen, _, _, _, _}, S) -> S + AttLen end,
SummarySize, AttsInfo),
{IsDel, Pos, Seq, TotalLeafSize}

           end, RevTree)}

           end, RevTree)};

   (U) ->

        ?LOG_INFO("Drop a document from compaction: not found in db : ~p", [U]),

       []
   end, LookupResults),

NewFullDocInfos = stem_full_doc_infos(Db, NewFullDocInfos1),
`

Reopening to commit the code to the fork and send pull request.


Expected period of time hanging(or pre-processing) in the beginning of the training

❓ Questions & Help
When I start training the code, it is hanging in the beginning as below. How long do you expect to wait for the training to start? For my case, it is more than at least ~5 hrs. My very first run went through and it failed in the middle of the training because of CUDA issues.
[2021-09-16 01:46:18,272][openspeech.utils][INFO] - Operating System : Linux 5.11.0-27-generic
[2021-09-16 01:46:18,272][openspeech.utils][INFO] - Processor : x86_64
[2021-09-16 01:46:18,273][openspeech.utils][INFO] - device : NVIDIA GeForce RTX 2080 Ti
[2021-09-16 01:46:18,273][openspeech.utils][INFO] - CUDA is available : True
[2021-09-16 01:46:18,273][openspeech.utils][INFO] - CUDA version : 11.0
[2021-09-16 01:46:18,273][openspeech.utils][INFO] - PyTorch version : 1.7.0
GPU available: True, used: True
TPU available: False, using: 0 TPU cores
IPU available: False, using: 0 IPUs
/opt/conda/lib/python3.8/site-packages/pytorch_lightning/core/datamodule.py:423: LightningDeprecationWarning: DataModule.setup has already been called, so it will not be called again. In v1.6 this behavior will change to always call DataModule.setup.
  rank_zero_deprecation(
LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0]
wandb: (1) Create a W&B account
wandb: (2) Use an existing W&B account
wandb: (3) Don't visualize my results
wandb: Enter your choice: 3
wandb: You chose 'Don't visualize my results'
wandb: WARNING `resume` will be ignored since W&B syncing is set to `offline`. Starting a new run with run id tpyh7nfj.

CondaEnvException: Unable to determine environment

Please re-run this command with one of the following options:

* Provide an environment name via --name or -n
* Re-run this command inside an activated conda environment.

wandb: W&B syncing is set to `offline` in this directory.  Run `wandb online` or set WANDB_MODE=online to enable cloud syncing.

  | Name      | Type                     | Params
-------------------------------------------------------
0 | criterion | JointCTCCrossEntropyLoss | 0
1 | encoder   | LSTMEncoder              | 36.6 M
2 | decoder   | LSTMAttentionDecoder     | 53.4 M
-------------------------------------------------------
90.0 M    Trainable params
0         Non-trainable params
90.0 M    Total params
359.991   Total estimated model params size (MB)
Global seed set to 1

Details
Env: Ubuntu 18.04
GPU: 2080TI 12GB

Five hours is a little strange. If there's no progress bar, it seems to be blocked somewhere.

@jun-danieloh
CondaEnvException: Unable to determine environment
I think you should first check you cuda version and cudatoolkit version.

@yinruiqing @sooftware
I am using Docker Env. Should I use Conda always? I moved to AZURE server where I have plenty of memory and larger GPU but my model is still hanging at the same page...

I think there's a deadlock. There seems to be an environmental problem.
I've never seen an error like this before, so I'm embarrassed.

@yinruiqing @sooftware
[2021-09-29 06:48:48,012][openspeech.utils][INFO] - Processor : x86_64
[2021-09-29 06:48:48,013][openspeech.utils][INFO] - device : Tesla V100-PCIE-16GB
[2021-09-29 06:48:48,013][openspeech.utils][INFO] - CUDA is available : True
[2021-09-29 06:48:48,013][openspeech.utils][INFO] - CUDA version : 11.0
[2021-09-29 06:48:48,013][openspeech.utils][INFO] - PyTorch version : 1.7.0
GPU available: True, used: True
TPU available: False, using: 0 TPU cores
IPU available: False, using: 0 IPUs
/opt/conda/lib/python3.8/site-packages/pytorch_lightning/core/datamodule.py:423: LightningDeprecationWarning: DataModule.setup has already been called, so it will not be called again. In v1.6 this behavior will change to always call DataModule.setup.
  rank_zero_deprecation(
LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0]
wandb: (1) Create a W&B account
wandb: (2) Use an existing W&B account
wandb: (3) Don't visualize my results
wandb: Enter your choice: 3
wandb: You chose 'Don't visualize my results'
wandb: WARNING `resume` will be ignored since W&B syncing is set to `offline`. Starting a new run with run id 2513tpfc.

CondaEnvException: Unable to determine environment

Please re-run this command with one of the following options:

* Provide an environment name via --name or -n
* Re-run this command inside an activated conda environment.

wandb: W&B syncing is set to `offline` in this directory.  Run `wandb online` or set WANDB_MODE=online to enable cloud syncing.

I never activated Conda and don't understand why logs are complaining about it. Is it related to wandb? I made choice 3 while training. Do I miss anything here?

I think not wandb problem. @hasangchun What do you think about this?

@jun-danieloh @sooftware
It doesn't seem like a wandb problem, but how about changing the logger to  tensorboard and trying it?  [link]

I don't think this problem is caused by logging. It's hard because it's like an environmental problem.

openspeech/openspeech/data/sampler.py, line 88, sample_rate=16000. Always does resample when audio file is not 16k, it takes quite some time.

I am experiencing the same issue, not witnessing any error message.

#127 I solved it by switching sampler from 'smart' to 'random'.

This is a bottleneck. [link].
When I used RandomSampler, it was immediately executed. [link]
sampler: str = field(
        default="else", metadata={"help": "smart: batching with similar sequence length."
                                           "else: random batch"}
    )

Also getting this issue, for reference I'm using Ubuntu and a 2080Ti also. Is there a fix?

@tand22  Would you like to try changing the sampler from smart to else?   In the current code, the default is smart, so you will have to modify it.

Seems to have done something, however now getting this. How can I lower the memory usage?

@tand22   You can reduce the batch size, but the 2080ti will run out of memory a bit.  [LINK]

I also had the issue with smart sampler when training on LibriSpeech 960h. I am using random sampler but I want to know if this issue is still ongoing.


CCed Address not getting bulk emails

Hi team,
I am using sendgrid to send emails in Bulk.
For ex. I am sending an email to 100 users with 10 substitutions in a personalization object. So i am addind 100 personalization to sendgrid mail object. So with each personalization object i'm adding CC email id.
Now users who are in To, getting the email properly, but the user who is CCed, gets only one email. Here my requirement is like if i am sending 100 emails to different users, i should get 100 emails too if my email id is in CC.
Kindly let me know the solution for the same.

Hello @avdhoota,
Thanks for submitting a GitHub issue! We are very sorry that you are running into this problem. In order to better serve you, as this does not present itself as a library specific issue, we would like to ask that you reach out to our support team at https://support.sendgrid.com.
Thank you!
SendGrid DX Team


This page should link to instructions on how to cause Windows to dump in response to a machine check

This cmdlet injects a machine check into the VM.  Windows, by default, ignores this.  The following link says how to fix that.  https://docs.microsoft.com/en-us/windows/win32/debug/configuring-automatic-debugging

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 15879589-bf38-cdfc-b358-03c72e9b9411
Version Independent ID: 08df00f8-48eb-fe48-1e4b-20dd9ed6a521
Content: Debug-VM (hyper-v)
Content Source: docset/windows/hyper-v/Debug-VM.md
Product: w10
Technology: powershell-windows
GitHub Login: @andreabarr
Microsoft Alias: v-anbarr

@jakeoshins Thank you for pointing out this important nuance. The article is under investigation.

@jakeoshins Thank you for your feedback. We have added the link to the related links section of the document via PRhttps://github.com/MicrosoftDocs/windows-powershell-docs/pull/1868
Thanks
Sri

Closing via #1868


can not create helper define when there is a custom get mutator to id

I'm using the optimized uuid as primary key, which need to convert from text to binary and vice versa, so I created a trait including the setIdAttribute and  getIdAttribute, when the getIdAttribute function exists, this package tell me this:
Exception: Undefined index: id
Could not analyze class App\ClassXXX.

but if i remove the getIdAttribute, it works fine.

same issue here

Same here

Is this still an issue?

I think you can close this now, because use uuid as primary key with mysql always a huge pain.
I've already abandoned this idea.