Dockerfile build failed due to missing required pkgs on conda

failed to build ci/dockerfile due to missed specific openssl version.
related to https://github.com/mamba-org/mamba/issues/2788
[2023-08-27T01:58:35.148Z]

[2023-08-27T01:58:35.148Z] ───────────────────────────────────────────────────────────────────────────────────────────────────

[2023-08-27T01:58:35.148Z]

[2023-08-27T01:58:35.148Z]

[2023-08-27T01:58:35.148Z] error    libmamba Failed to download package from https://conda.anaconda.org/conda-forge/openssl-3.1.2-hd590300_0.conda (status 404)

[2023-08-27T01:58:35.148Z]

[2023-08-27T01:58:35.148Z] Looking for: ['cuml=23.08', 'python=3.9', 'cuda-version=11.5']

[2023-08-27T01:58:35.148Z]

[2023-08-27T01:58:35.148Z] Multi-download failed. Reason: Transfer finalized, status: 404 [https://conda.anaconda.org/conda-forge/openssl-3.1.2-hd590300_0.conda] 956 bytes

[2023-08-27T01:58:35.148Z]

[2023-08-27T01:58:35.148Z] # >>>>>>>>>>>>>>>>>>>>>> ERROR REPORT <<<<<<<<<<<<<<<<<<<<<<

[2023-08-27T01:58:35.148Z]

[2023-08-27T01:58:35.148Z]     Traceback (most recent call last):

[2023-08-27T01:58:35.148Z]       File "/root/miniconda3/lib/python3.8/site-packages/conda/exception_handler.py", line 16, in __call__

[2023-08-27T01:58:35.148Z]         return func(*args, **kwargs)

[2023-08-27T01:58:35.148Z]       File "/root/miniconda3/lib/python3.8/site-packages/mamba/mamba.py", line 926, in exception_converter

[2023-08-27T01:58:35.148Z]         raise e

[2023-08-27T01:58:35.148Z]       File "/root/miniconda3/lib/python3.8/site-packages/mamba/mamba.py", line 919, in exception_converter

[2023-08-27T01:58:35.148Z]         exit_code = _wrapped_main(*args, **kwargs)

[2023-08-27T01:58:35.148Z]       File "/root/miniconda3/lib/python3.8/site-packages/mamba/mamba.py", line 877, in _wrapped_main

[2023-08-27T01:58:35.148Z]         result = do_call(parsed_args, p)

[2023-08-27T01:58:35.148Z]       File "/root/miniconda3/lib/python3.8/site-packages/mamba/mamba.py", line 748, in do_call

[2023-08-27T01:58:35.148Z]         exit_code = install(args, parser, "install")

[2023-08-27T01:58:35.148Z]       File "/root/miniconda3/lib/python3.8/site-packages/mamba/mamba.py", line 557, in install

[2023-08-27T01:58:35.148Z]         transaction.fetch_extract_packages()

[2023-08-27T01:58:35.148Z]     RuntimeError: Multi-download failed. Reason: Transfer finalized, status: 404 [https://conda.anaconda.org/conda-forge/openssl-3.1.2-hd590300_0.conda] 956 bytes

[2023-08-27T01:58:35.148Z]

[2023-08-27T01:58:35.148Z] `$ /root/miniconda3/bin/mamba install -y -c rapidsai -c conda-forge -c nvidia cuml=23.08 python=3.9 cuda-version=11.5`

seems it changed every run

[2023-08-26T01:58:28.165Z]

[2023-08-26T01:58:28.165Z] error    libmamba Failed to download package from https://conda.anaconda.org/conda-forge/dlpack-0.5-h9c3ff4c_0.tar.bz2 (status 404)

[2023-08-26T01:58:28.165Z] Multi-download failed. Reason: Transfer finalized, status: 404 [https://conda.anaconda.org/conda-forge/dlpack-0.5-h9c3ff4c_0.tar.bz2] 955 bytes

[2023-08-26T01:58:28.165Z]

[2023-08-26T01:58:28.165Z] # >>>>>>>>>>>>>>>>>>>>>> ERROR REPORT <<<<<<<<<<<<<<<<<<<<<<

[2023-08-26T01:58:28.165Z]

[2023-08-26T01:58:28.165Z]     Traceback (most recent call last):

[2023-08-26T01:58:28.165Z]       File "/root/miniconda3/lib/python3.8/site-packages/conda/exception_handler.py", line 16, in __call__

[2023-08-26T01:58:28.165Z]         return func(*args, **kwargs)

[2023-08-26T01:58:28.165Z]       File "/root/miniconda3/lib/python3.8/site-packages/mamba/mamba.py", line 926, in exception_converter

[2023-08-26T01:58:28.165Z]         raise e

[2023-08-26T01:58:28.165Z]       File "/root/miniconda3/lib/python3.8/site-packages/mamba/mamba.py", line 919, in exception_converter

[2023-08-26T01:58:28.165Z]         exit_code = _wrapped_main(*args, **kwargs)

[2023-08-26T01:58:28.165Z]       File "/root/miniconda3/lib/python3.8/site-packages/mamba/mamba.py", line 877, in _wrapped_main

[2023-08-26T01:58:28.165Z]         result = do_call(parsed_args, p)

[2023-08-26T01:58:28.165Z]       File "/root/miniconda3/lib/python3.8/site-packages/mamba/mamba.py", line 748, in do_call

[2023-08-26T01:58:28.165Z]         exit_code = install(args, parser, "install")

[2023-08-26T01:58:28.165Z]       File "/root/miniconda3/lib/python3.8/site-packages/mamba/mamba.py", line 557, in install

[2023-08-26T01:58:28.165Z]         transaction.fetch_extract_packages()

[2023-08-26T01:58:28.165Z]     RuntimeError: Multi-download failed. Reason: Transfer finalized, status: 404 [https://conda.anaconda.org/conda-forge/dlpack-0.5-h9c3ff4c_0.tar.bz2] 955 bytes

[2023-08-26T01:58:28.165Z]

[2023-08-26T01:58:28.165Z] `$ /root/miniconda3/bin/mamba install -y -c rapidsai -c conda-forge -c nvidia cuml=23.08 python=3.9 cuda-version=11.5`

@eordentlich as some scripts in repo already relying on the mamba to speed up the conda installation,
we may need to to decide if we would like to wait for the fix of https://github.com/mamba-org/mamba/issues/2788
or just switch all usages to conda directly

Thank you @pxLi for resolving this.

reopened as https://github.com/NVIDIA/spark-rapids-ml/pull/416 which caused intermittent error https://github.com/mamba-org/mamba/issues/1728
we may consider the new conda solver to use libmamba directly
conda update -n base conda
conda install -n base conda-libmamba-solver
conda config --set solver libmamba

I will verify the solution in coming days


Unable to send email template within Cloudflare Worker

I have a Nuxt 3 project and am calling a server API route to send an email template. Everything is working locally, but when I push to my Cloudflare Worker, I get the following error:
{
    message: "(h2.adapter || qi.adapter) is not a function",
    stack: "",
    statusCode: 500,
    statusMessage: "",
    url: "/api/postmark"
}

Hi @kpetrillo
unfortunately we don't have experience with Cloudfare Worker, so we can't identify what the issue could be there. Since it works locally and those functions (h2 and qi adapter) are not something we can see within our library, it seems the issue is with cloudfare worker setup, maybe some of the libraries needed there are not installed properly.

Thank you for the response. If you do not see the error on your end, that will help me narrow things down. Thanks!

Yea, I think you're right. I've run into similar limitations. That's okay, though, I could just send fetch requests via your API. The wrappers are nice, but I can live without them. Thanks for your help!


rtl8723bs: remove

Description of changes
This kernel module match no kernel version in NixPkgs.
rtl8723bs has been upstreamed in 4.12.
Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

This breaks unstable small, because it's still part of nixos/modules/hardware/all-firmware.nix.

Good catch! I wonder what is missing to catch that at eval time.


KubevirtVmHighMemoryUsage firing even though compute has memory limit higher then requested amount

We're observing frequent alerts of this kind for one of VM's (running Windows Server), despite setting memory limit higher then memory request - as described in runbook:
apiVersion: v1
kind: Pod
metadata:
  name: virt-launcher-vm-....
spec:
  containers:
  - name: compute
    resources:
      limits:
        memory: 71146Mi
      requests:
        memory: 66026Mi

https://github.com/kubevirt/kubevirt/blob/15090de920b2345df8f56eb70a3d6ecc64d60992/pkg/monitoring/rules/alerts/vms.go#L32-L44

@dosu Ok, but define what's container free memory... IMHO it should be counted towards memory limit of pod, not the requested memory. And in my case memory limit is far greater then current container usage.
Quoting Kubernetes documentation:

A Container can exceed its memory request if the Node has memory available. But a Container is not allowed to use more than its memory limit. If a Container allocates more memory than its limit, the Container becomes a candidate for termination. If the Container continues to consume memory beyond its limit, the Container is terminated. If a terminated Container can be restarted, the kubelet restarts it, as with any other type of runtime failure.

So using that, when defined memory limit is 71146Mi and current usage is 65979Mi this gives us 5167Mi of container "free" memory...

@dosu I still don't think that this alert should be fired in my case. Container is not at risk of eviction, memory usage is reaching requested amount, but still far away from resource limit set, so it shouldn't be at risk of eviction as described in runbook - which also refers to memory limit in 'Impact' section:

The virtual machine running inside the container is terminated by the runtime if the container’s memory limit is exceeded.

@machadovilaca does this fall under your domain?

/assign


Implement pygrep-hook's Mock-mistake diagnostic

Adds a new rule, PGH005, to close out pygrep-hooks.
This rule checks for common mistakes when interacting with mocks, e.g., using assert my_mock.called_once_with() instead of my_mock.assert_called_once_with().

Random PR but I just want to close out the issue and remove the TODOs from the README etc.


Edited GIF causing error.

I implemented the API and it is working fine so far. I edited a gif file online to reverse it/ make it slower the edited gif is somehow not playing.
Original GIF
Edited GIF
When changing the source to the edited gif my window is crashing while loading:
System.Runtime.InteropServices.COMException: "MILERR_WIN32ERROR (Ausnahme von HRESULT: 0x88980003)"
(I could reproduce this problem when editing other gifs)
PS: I also tried the newer XamlAnimatedGif API but the performance was just to bad to use it on WPF+Windows10

Hi @Tonne-TM,
That's a low-level rendering error in WPF itself, so unfortunately I can't do much about it... Maybe try to edit your GIF with a different editor?

I have tried a few different things and discovered that it has nothing to do with with the edit of the gif but rather with the same origin of the gif. I can use as many different edited gif parallel as i want but the moment i take for example a gif which plays forward and the same gif which plays backward this error occurs for me.

This seems quite weird to me.

To me as well... I can't think of any logical reason for that. The fact that the GIFs have the same "origin" should be completely irrelevant.

My original workaround for this problems was: instead of using many images and make them Visibility="Hidden" when not needing them I used one single image and binded the source. But with the attached gif i run in big memory problems after switching the source a few times (1gb + RAM usage).

Closing due to inactivity


More accuracy wrapper type for exception

Currently, if eval or call_funcion throws an exception, we just produce a simple string, without the context.
QuickJS support  some non-standard properties, such as stack, lineNumber, we should consider to provide more accuracy wrapper type to model the exception.

@kamyuentse
i know "message", "stack" and "name" work but lineNumber does not seem to be present as a property of an Exception..
see https://github.com/HiRoFa/quickjs_es_runtime/blob/master/src/quickjs_utils/errors.rs#L35
As far as i can tell from https://raw.githubusercontent.com/bellard/quickjs/master/quickjs.c lineNumber is only used in the build_backtrace function


Loading/disconnected

I have both Aria2 Download Manager Integration 0.4.5 and aria2 1.35.0.  I know aria2 is not for beginners, so I appreciate your patience.  I have several questions.
Does Aria2 Download Manager Integration depend on aria2 1.35.0 to operate? I have it set up, and tried to test it on a YouTube video, but it got stuck here

Perhaps I didn't get the options settings correct?  Please advise.
Thanks

You should have a running aria 2 instance, not installed program.

In firefox addon settings, make this addon link to that aria 2 instance, using IP address/hostname, port, and the token if you have set one. Remember click "Save"

Then open AriaNg it should be working.

This is what i have so far
aria2-1.35.0-win-64bit-build1

You said "Then open AriaNg it should be working."  I'm assuming you mean like this?

But I still get this

no, you need an RPC server instead of a one-time downloader. See aria2c --help=#rpc

I don't know how to implement this.  I can't get the syntax right, or the steps.

I ran across this, at https://github.com/ziahamza/webui-aria2

but it says insecure.
So I have to create a token?  I'm not sure how to go about it.

You need also --rpc-allow-origin-all option, if you want to see details from "Details" button. Everything else seems okay and you are ready for adding tasks.
You can enable token authentication with --rpc-secret=<TOKEN>.

Detailed: Since the server can be easily accessed with HTTP GET, any web page you visit thus its provider (might be evil) is allowed to add/remove a task to/from the aria2 server, even to flood-attack another server by adding many many tasks to your aria2 server. However, with token enabled, the evils must know the token before doing evil things.

Since I already ran it without a tokwn, albeit with a "watch" download result, have I opened/risked a security breach?
I'm still getting the "watch" download

and this

You need aria2c --enable-rpc --rpc-listen-all --rpc-allow-origin-all --rpc-secret=<TOKEN> in one row.

Then this terminal cannot run any command as intended. Don't close this window or press Ctrl-C to stop it. You will be able to connect with Web-UI, AriaNg or others.

Please clarify.  You say YouTube videos cannot be simply downloaded "this way".  Are you saying that aria can only be used for downloading web pages, or that it is just not possible using the webgui?  If possible, please let me know how to go about video download.
Tho this seemed to succeed,

Everything else still failing

What about settings adjustments

Generally you only need to change the host name and the token.
For host name, if you are running aria 2 instance and browser on same machine, you can use <IP_ADDRESS>. Otherwise use the IP address of that computer.
For token, you know what you chose.
YouTube is an online player not a video host. Yes it hosts videos, but what you opens in the browser is a video player written in JavaScript. This video player downloads video from googlevideo.com and plays it.
"Copy video url at current time" only adds a tag to video player URL telling the player where to start playing.
However, YouTube don't want videos to be easily downloaded, since this will cut their ad fees. You can hardly find anything from google :( There are two project on GitHub to download YouTube videos, you-get and youtube-dl.


xfce.xfce4-whiskermenu-plugin: 2.8.1 -> 2.8.2

https://gitlab.xfce.org/panel-plugins/xfce4-whiskermenu-plugin/-/compare/v2.8.1...v2.8.2
Description of changes

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

@ofborg test xfce


Luckperms setting 2 prefixes

So when i do /lp group owner meta setprefix 999 "&4Owner " it puts two of them

like that does anyone know how to fix this?

Please provide a screenshot running /lp user <yourself inheriting owner group> info.

if i did it wrong let me know i think i did

i was confused sorry if i did it multiple times

?? That's literally not what I asked for. Run /lp user <yourself> info and share a screenshot.

well im sorry ima run that command "/lp user  info" that what you said sounded like what i just did sorry

command is /lp user <yourself> info you need to include the playername. Also the latest screenshot isn’t loading for me

yea it wasn't for me either i resent it

Okay... now run and share a screenshot of /lp user <yourself> meta info.

looks like, you haven’t even ate prefix, or delete it midway. screenshot /lp group owner meta info

oh i removed the group off of me for now

Well, it appears properly in there, so it's probably an issue with your chat formatting plugin. You might want to give this section a read: https://github.com/lucko/LuckPerms/wiki/FAQ#why-are-prefixessuffixes-not-working specifically the item that reads "If you are using Essentials..."

yes i am using essentials

i have it set as false as well so it would not be a problem right?

Remove the # at the beginning.

ah ok that worked ty very much for the fast response as well

you can re open it if you would like


Start XVFB prior to testing

This was removed when we were running with Chrome Headless. Unfortunately Headless has some issues with the latest SDK https://github.com/dart-lang/test/issues/772 so we must run with full Chrome for the time being. This will allow us to run with the latest test package and latest SDK without issues.

Is there any reason why a dart4web repository wouldn't want this config? Does it make sense to add it to the standard dart travis environment instead?

Does it make sense to add it to the standard dart travis environment instead?

The standard dart travis tasks already handles this. We aren't using the standard tasks because we aren't a single-package repo.


Is it possible to extract markdown in user specific folder.

I am using your script. But I want to extract markdown to my _notes folder of Jekyll based project. Is it possible ?
No formatting needed. Just extract or move extracted markdown files to specific location.
Thanks a lot in advance.

You could try forking https://github.com/everruler12/roam2github/blob/main/roam2github.js
then replace line 409 const markdown_dir = path.join(backup_dir, 'markdown', graph_name) with const markdown_dir = path.join(backup_dir, '_notes')
Then in your Actions repo, in main.yml line 30, replace:
git clone -q https://github.com/everruler12/roam2github.git roam2github with git clone -q https://github.com/tharansakthi/roam2github.git roam2github
and add th following after line 37:
          BACKUP_EDN: false
          BACKUP_JSON: false
          BACKUP_MARKDOWN: true

But I see you're using roam-to-git to generate notes, in which case this wouldn't work. There's probably a way after the "Generate notes" task in main.yml to add a run a task that does the renaming and moving. That would probably be easiest.

Unfortunately, I am using this fork of roam-to-git -> https://github.com/DoomHammer/roam-to-git/tree/roam-to-garden
The formatter code inside this transforms the .md files and its file names when moving to "_notes" folder in Jekyll. But the template (https://github.com/maximevaillancourt/digital-garden-jekyll-template) I'm using doesn't need any formatting. Also the code doesn't publish entire roam graph, instead it only converts the notes referred under Public.md file.
So, I am thinking about moving to roam-to-git, but I don't how to move the extracted .md files in /markdown/ to _notes folder.

The above didn't work as expected. It again stores content inside markdown/ directory. Did I do anything wrong?

https://github.com/tharansakthi/roam2github/blob/main/backup.js
code line number 413.
replacing to -> const markdown_dir = path.join(backup_dir, '_notes')
Worked successfully

It would be nice to get an option to mention the location folder through git secrets or something like that in your original repo, so that many people like me benefit.

I have since moved on from Roam to Obsidian. Roam2Github was only intended for backups, not digital gardens. Roam has since released their own automatic backup solution. So I no longer use Roam2Github, and unfortunately don't plan on adding more features.

code line number 413. replacing to -> const markdown_dir = path.join(backup_dir, '_notes')

Ah, I missed line 413 which still included the graph name. Good catch! So are things working the way you want now? If not, there should still be a way using main.yml to move files.

It worked like a charm.
Thanks a lot for the help.


support: Allow user look up through full name search

This would allow to lookup users through their full name in /support page. The search is case insensitive but partial names won't return any results.
Was requested https://app.frontapp.com/inboxes/teammates/472523/shared-with-me/open/2631377635/search/global/full name/13546310147?around=74863219395

Is this actually ready to merge? If so, can we remove the "[WIP]"?
The code looks straightforward.  I suppose the styling is a bit minimal now, but it seems fine for a support page.

@showell Yes. It can be merged. Removed the WIP.

LGTM

@alexmv Can you merge this? The changes are pretty straightforward.

Merged, thanks @hackerkid!


should we spin off a technical issues only repo?

like the NMDC issues repo, for those who are aware of it: https://github.com/microbiomedata/issues/issues

I'm assuming that over time most new issues will be for content and many of the technical issues will stabilize, which would argue for keeping it simple and having one tracker for now. But I appreciate it's hard to find content issues. Some standard labels would help

We have quite a lot of labels already -- perhaps too many to help improve sorting issues. I think a better solution than starting a new tracker is to clean up our labels and create documentation on how to use them consistenly.

I'm going to close this. Issues should always be technical. Non-technical or non-actionable items should be discussions.


fxi(scheduledtask): skip task when scheduledtask.labels is empty

What this PR does / why we need it:

[ ] Smoke testing completed
[ ] Unit test written

Does this PR need to be backport to the previous release branch?:
If no, just write "NONE".
If don't know, write "UNKNOWN", and let the reviewer decide.
If yes, write the release branches name in the below format and submit the related cherry-pick PR:

release/3.10

/cc @ioito @zexi
/area scheduledtask

/lgtm


Make Name first column after rank in benchmark tables

cc @lazappi

@scottgigante-immunai @lazappi see https://github.com/openproblems-bio/website/pull/82
note, a lot of these things should be fixed by whoever is exporting the dataFile.


Review system doesn't work well

<=3 stars the "Please include comments" doesn't disappear.

Maybe you need to write more words.

OK, thank you! That is the workaround! They should inform the user to write more words.


CSS: standardize identity icon display

closes https://github.com/inveniosoftware/invenio-app-rdm/issues/1581

@kpsherva @jennur I've applied the changes you suggested in https://github.com/inveniosoftware/invenio-app-rdm/pull/1519 and rebased on master.

@zzacharo after talking to @jennur IRL, we decided to go ahead with the 1rem. Then, she will discuss with @lhenze and decide if its useful to export it to a variable :)


A few questions about sdk & Viewer:

Before opening a new issue, we wanted to provide you with some useful suggestions (Click "Preview" above for a better view):

Consider checking out SDK examples.
Have you looked in our documentations?
Is you question a frequently asked one?
Try searching our GitHub Issues (open and closed) for a similar issue.

All users are welcomed to report bugs, ask questions, suggest or request enhancements and generally feel free to open new issue, even if they haven't followed any of the suggestions above :)

Required Info

Camera Model
{D400 }

Firmware Version
<IP_ADDRESS>

Operating System & Version
Win (10)

Kernel Version (Linux Only)
(e.g. 4.14.13)

Platform
PC

Language
{C++ }

Viewer Version
2.13

Issue Description
<Describe your issue / question / feature request / etc..>
Hi, i have 3 questions about the sdk & viewer:
1).When i use rs2::software_device instance, may use register_extrinsics_to function register A devices depth stream to B devices color stream？If it is ok,when i add the software device source in Viewer, does it mean that the textrue source and depth source in 3D view will show correctly?
2)Is Viewer support record the Platform Camera as normal video format files, like mp4 etc..
3).May i open a avi or mp4 file , and put it into software_device`s color stream?
Thanks !

Hi @joelihn

1).When i use rs2::software_device instance, may use register_extrinsics_to function register A devices depth stream to B devices color stream？

Yes, it is possible to add extrinsics / intrinsics for every two stream and all SDK processing should work with it.

If it is ok,when i add the software device source in Viewer, does it mean that the textrue source and depth source in 3D view will show correctly?

Currently, there is no built-in way to add custom software device to the Viewer. This can be done, by adding add_software_device function to the context.

2)Is Viewer support record the Platform Camera as normal video format files, like mp4 etc..

We are using uncompressed ROS-bag format for all recording. Standard formats rely on codec libraries like FFMPEG, but these come with licensing limitations that we prefer to avoid.

3).May i open a avi or mp4 file , and put it into software_device`s color stream?

You can read frames using something like OpenCV and send them to software device.

Below is my code, i have a xml config record devices stream extrinsics like this:
<Config>     <Device SN="A">     		 <Color SN="A">         	<MT>1.0000 0.0038 -0.0009 -0.0038 1.0000 0.0058 0.0008 -0.0058 1.0000 -0.025.6999989 0.000733261108 -0.00396292090</MT>     		</Color>         <Color SN="B">         	<MT>1 0 0 0 1 0 0 0 1 0 0 0</MT>>        		</Color>     </Device>     <Device  SN="B">     	 <Color SN="A">         	<MT>1 0 0 0 1 0 0 0 1 0 0 0</MT>>     		</Color>        	<Color SN="A">     			<MT>1 -0.0038 0.0008 0.0038 1 -0.0058 -0.0009 0.0058 1 -0.0300679 -0.000661246 0.00393617</MT>>     		</Color>     </Device> </Config>
in ds5-color.cpp`s constructor function i regisiter the extrinsics for every device depth stream to every device color stream .
when i use the use the depth1&color1 or depth2&color2 , i change the extrinsics has affect, but when i use depth1&color2 or depth2&color1, thers is no affect, so i dont know sth i doing wrong,thanks.
`// License: Apache 2.0. See LICENSE file in root directory.
// Copyright(c) 2017 Intel Corporation. All Rights Reserved.
#include <librealsense2/rs.hpp> // Include RealSense Cross Platform API
#include <librealsense2/hpp/rs_internal.hpp>
#include "example.hpp"
#include "example.hpp"          // Include short list of convenience functions for rendering
#include <windows.h>
#define STB_IMAGE_WRITE_IMPLEMENTATION
#include <stb_image_write.h>
#include <int-rs-splash.hpp>
#ifndef STB_IMAGE_IMPLEMENTATION
#define STB_IMAGE_IMPLEMENTATION
#include <stb_image.h>
#endif // !1
#include
int main(int argc, char * argv[]) try
{
window app(1920, 1080, "RealSense Capture Example");
glfw_state app_state;
register_glfw_callbacks(app, app_state);
rs2::pointcloud pc;
rs2::points points;
int frame_number = 0;

//////////////////////////////////////////////////////////////////////////////////////
// Using the context we can get all connected devices in a device list
rs2::context ctx;
rs2::device_list devices = ctx.query_devices();
std::cout << "devices cout is: " << devices.size() << std::endl;
int index = 0;

rs2::pipeline p0;
rs2::config c0;
std::cout << "devices[0] SERIAL_NUMBER is: " << devices[0].get_info(RS2_CAMERA_INFO_SERIAL_NUMBER) << std::endl;
c0.enable_device(devices[0].get_info(RS2_CAMERA_INFO_SERIAL_NUMBER));
// Start the pipeline with the configuration
rs2::pipeline_profile profile0 = p0.start(c0);

rs2::pipeline p1;
rs2::config c1;
std::cout << "devices[1] SERIAL_NUMBER is: " << devices[1].get_info(RS2_CAMERA_INFO_SERIAL_NUMBER) << std::endl;
c1.enable_device(devices[1].get_info(RS2_CAMERA_INFO_SERIAL_NUMBER));
// Start the pipeline with the configuration
rs2::pipeline_profile profile1 = p1.start(c1);

auto depth_stream1 = profile0.get_stream(RS2_STREAM_DEPTH);
auto color_stream1 = profile0.get_stream(RS2_STREAM_COLOR);

auto depth_stream2 = profile1.get_stream(RS2_STREAM_DEPTH);
auto color_stream2 = profile1.get_stream(RS2_STREAM_COLOR);

//==================================================//
//           Declare Software-Only Device           //
//==================================================//

rs2::software_device dev; // Create software-only device
auto depth_sensor = dev.add_sensor("Depth"); // Define single sensor
auto color_sensor = dev.add_sensor("Color"); // Define single sensor

dev.create_matcher(RS2_MATCHER_DLR_C);
rs2::syncer sync;

depth_sensor.open(depth_stream2);
color_sensor.open(color_stream1);

depth_sensor.start(sync);
color_sensor.start(sync);

//depth_stream2.register_extrinsics_to(color_stream1, { { 1,0,0,0,1,0,0,0,1 },{ 0,0,0 } });

while (app) // Application still alive?
{
	rs2::frameset frameset1 = p0.wait_for_frames();
	rs2::frameset frameset2 = p1.wait_for_frames();

	++frame_number;

	rs2::frame depth1 = frameset1.first_or_default(RS2_STREAM_DEPTH);
	rs2::frame color1 = frameset1.first_or_default(RS2_STREAM_COLOR);
	rs2::frame depth2 = frameset2.first_or_default(RS2_STREAM_DEPTH);
	rs2::frame color2 = frameset2.first_or_default(RS2_STREAM_COLOR);

	if (**depth1** && **color2**)
	{
		if (auto as_depth = **depth1**.as<rs2::depth_frame>())
			points = pc.calculate(as_depth);
		pc.map_to(**color2**);

		// Upload the color frame to OpenGL
		app_state.tex.upload(**color2**);
	}
	draw_pointcloud(app.width(), app.height(), app_state, points);
	Sleep(1000);
}

return EXIT_SUCCESS;

}catch (const rs2::error & e)
{
std::cerr << "RealSense error calling " << e.get_failed_function() << "(" << e.get_failed_args() << "):\n    " << e.what() << std::endl;
return EXIT_FAILURE;
}
catch (const std::exception& e)
{
std::cerr << e.what() << std::endl;
return EXIT_FAILURE;
}
`

Someone can help me check this question？Thanks in advance.

Hello @joelihn,
That's an interesting use-case indeed, and cross-device registration is possible.
There was a single line in the code that had to be fixed to make it work :

depth_stream2.register_extrinsics_to(color_stream1, { { 1,0,0,0,1,0,0,0,1 },{ 0,0,0 } });

to

depth_stream1.register_extrinsics_to(color_stream2, { { 1,0,0,0,1,0,0,0,1 },{ 0,0,0 } });

:)
Additionally, the point cloud calculation API should be reordered:

pc.map_to(color2);    // This is the appropriate place for the call
if (auto as_depth = depth1.asrs2::depth_frame())
points = pc.calculate(as_depth);
pc.map_to(color2); // At this point has no effect as the pointcloud and [u,v] map are already generated

This error would manifest itself clearly if the pointcloud was generated once and not in a loop

@ev-mp ok,thank you very much!
I have another question , may i add a software device into devicelist in Intel RealSense Viewer? Is there some sample code?

hi @joelihn
Sorry for late response, we are a bit swamped temporarily. Right now there is no add_device API for the context class. I did some work in this direction some time ago. You can take a look at dorodnic/adv_software_device branch, specifically this commit. The branch requires some polish, but it shows how you can run python opencv inside the Viewer, and was used to generate the visualisations for stereo depth blog post. At the time, none showed particular interest in software device APIs, but perhaps its time to refine and add to the main SDK.

Thanks for ur response. I think it is very useful add software device into viewer.
wait in hope.


redisson has a memory leak when redis cluster switched

Expected behavior
when redis cluster switched, The client connection to the old node should not exist in memory,   and the nodeConnections should remove the old node.
Actual behavior
When the redis cluster whose ip address is <IP_ADDRESS> is suspended, the dns switches to the redis cluster whose ip address is <IP_ADDRESS>.
redisson keeps the redisclient that connects to the old node(<IP_ADDRESS> ), and the connectionWatchDog keeps creating connections in the background to try to reconnect the old node.

Steps to reproduce or test case
step one: Prepare one dns service, two redis clusters, and one application service.
step two: The application service continuously accesses redis through dns.
step three: The dns switches to another redis cluster, the simulated redis cluster is suspended, and the new redis cluster is restarted.
Redis version
7.0.5
Redisson version
3.17.7
Redisson configuration
Config config = new Config();
List nodeAddresses = List.of("redis-test.com:7000").stream()
.map(node -> MessageFormat.format("redis://{0}", node))
.collect(Collectors.toList());
config.useClusterServers()
.setMasterConnectionMinimumIdleSize(3)
.setMasterConnectionPoolSize(30)
.setSlaveConnectionMinimumIdleSize(3)
.setSlaveConnectionPoolSize(30)
.setSubscriptionConnectionMinimumIdleSize(1)
.setSlaveConnectionPoolSize(1)
.setScanInterval(60000)
//                    .setPassword(getClusterPassword())
.setNodeAddresses(nodeAddresses);
return Redisson.create(config);

Redisson continue to reconnect if it didn't get information form cluster topology that this node has down. Make sure that the cluster topology was properly updated.

It performs a clusterConnectionManager shutdownEntry, but the nodeConnection MasterSlaveConnectionManager did not remove the node. I tried to remove the relevant node in the nodeConnections in the shutdownEntry method without this problem.

The ip address obtained through domain name resolution is the IP address of the new node, and no old ip address exists.

Thank you for your reply, redisson cluster topology information is obtained through ClusterConnectionManager.scheduleClusterChangeCheck? If this is the case, the old node information can not be obtained by the resolver in this method, then redisson should not try to reconnect the old node.

I have the same issue. It seems that the connection, which used to query cluster topology information, is leaked. The log about reconnecting will disappear if close the connection by using MasterSlaveConnectionManager#disconnectNode() right after querying cluster topology information(cluster nodes). On my observation, the leak probably happen on redis cluster switched when the connection is connected to the slave.

@guihuoliuying
Can you try build attached to this comment https://github.com/redisson/redisson/issues/4649#issuecomment-1311516290 ?

I ran the test with the jar presented in #4649, but the issue is still here. I capture some log grepped by "connected" or "reconnect".

@guihuoliuying
This may happen due to network issues and/or multiple ips bounded to the same hostname

It's multiple ips bounded to the same hostname. The redis cluster is deployed in k8s and there is an operator supervise the status of redis cluster. In the logs mentioned above, I deleted a pod running a slave, then operator found and start another pod to replaced the deleted one.

@mrniko
Does redisson support this scenario?

@guihuoliuying
Can you try build attached to this comment #4649 (comment) ?

This seems to have solved my problem, I have no memory leaks after testing, thank you very much.

Fixed! thanks for help

@guihuoliuying
Please provide more details. Which hosts you specified in Redisson configuration. And how many ips used by each hostname in a cluster.

Just one hostname for all ips in a cluster.
I test with latest revision, it seems to be fixed in the first few times, but in the last time I try, the issue appear again. When I want to investigate further, the test environment was broken by my mistake. I need some time to set it up and see what happen.

I test with the commit '0cfc250e74132633d1415fa90506a9aae0b6e29d', the issue still appear in some cases.
Test Environment: As mentioned above, the redis cluster is deployed is k8s, 2 nodes, one is master, the other is slave. Application use hostname to connect cluster, the hostname is resolved to ips of nodes. An operator is used to supervise the redis cluster, if the number of nodes is dropped below 2, it will start the new pod to replace the node which is down, also it will make dns to resolve to new ip of new pod.
Case 1: Read mode is MASTER_SLAVE, and I delete 2 nodes. After the cluster resumed by operator, the leak didn't happen.
Case 2: Read mode is MASTER_SLAVE, and I delete the node which is slave. After the cluster resumed by operator, the leak still happen.
Case 3: Read mode is MASTER, and I delete 2 nodes. After the cluster resumed by operator, the leak still happen.
For Case 2, what about invoking disconnectNode() to delete slave while calling MasterSlaveEntry.slaveDownAsync() in ClusterConnectionManager.addRemoveSlaves()
For Case 3, what about deleting the nodes which in last partition but not in new partition right after parsePartiton

@guihuoliuying
This feature is available only in PRO version for replicated mode. https://github.com/redisson/redisson/wiki/2.-Configuration/#25-replicated-mode

It's compatible with Redis setup with single master and multiple slaves. Is this your case?

The number of master chosen 1 is for describing the issue. I redo the test in a cluster of 3 masters and 3 slaves, in Case 2, the leak still happen.

@guihuoliuying
Can you run https://github.com/redisson/redisson/issues/4649#issuecomment-1311516290 and share logs?

Ok. Here is the log which filter out some sensitive data. Are these logs enough?
server_log.txt
redisson_config.txt

@mrniko Does it help? Need more logs?

@guihuoliuying
Try to set slaveConnectionPoolSize = 20 and masterConnectionPoolSize = 20 and subscriptionConnectionPoolSize = 20


connman_%.bbappend: fix capabilities for our Smack setup

Upstream ConnMan starts connmand under systemd so that it runs with
minimal priviliges. However, on a system with Smack setup as defined
in this layer, /proc/net is not writable unless connmand has the
CAP_MAC_OVERRIDE capability. It used to have that before when running
as full root process.
Changing the setup of /proc is possible, but not easily. So instead
the service file gets changed (if needed) such that connmand still
runs with CAP_MAC_OVERRIDE.
Signed-off-by: Patrick Ohly<EMAIL_ADDRESS>

@wzhen12 can you confirm that this PR makes sense, based on the discussions we had about /proc access?

@ipuustin can you perhaps review?

I think that the problem are the files in /proc/sys/net, which are related to different kernel networking options. Would an alternative approach be to create udev files which would wait for the files in /proc/sys/net to be created and then set them up with right Smack labels? Connmand process label could then be configured to have correct access to the files in Smack configuration. I don't know if that's feasible or even possible, but such a scheme would maybe be more in line with the way Smack is supposed to work (with system integrator setting the rules on how the labels interact). It would also not let connmand to be able to bypass Smack rules completely.

@ipuustin we had a discussion with Casey about this (search your inbox for "Smack labels on /proc"); he recommended using CAP_MAC_OVERRIDE for now. Please have a look at that discussion because it should address your concerns.
In a nutshell, it is how /proc was meant to be used. An alternative might enhance security, but it would be complex to setup. I'm not sure whether udev can be used for entries in /proc/sys/net; I doubt it.

Alright. My only worries were with the approach. The patch itself looks good to me.
(I think that with udev you would need to wait for the network devices etc. to appear, and then know which files to set the labels for. Quick grepping shows five paths that connman needs to acceess.)


migrate XML::XPathContext to the TypedData API

What problem is this PR intended to solve?
Part of the TypedData epic described at #2808.

cc @byroot for :eyes:


Create User Guide

Create a basic user guide so newcomers will know how to use Sandiego. (This will evolved as the tool/Explorer does).

This will have a tentative creation date of July 1, 2022, conflicts notwithstanding.


Refactoring autoassess

This branch is getting way out of date compared to backend, I should have merged before, but am panicking now it will be too obsolete. The changes are 99.9% restricted to adding files. So let's do this now even if we won't use the autoassess diags until later on

PS - dont be too concerned with the autoassess bits, I'll rebranch out of it and keep working improving stuff

For me it's fine to merge, but if you are just concerned with this branch getting outdated, you can simply keep it regularly synchronized by merging REFACTORING_backend into it.

OK -- you guys cool with this, will do it now if there's no nays, want to test this asap on Jasmin, hopefully whatever bug has started creeping up on the installation will be gone

I'm testing this branch, please wait another hour or so...

cool, thanks lots, Mattia!

@bouweandela cheers, dude! The autoassess is indeed a package but what we are looking at is not to be installed separately but rather just get the diagnostic bits (assessment_areas) and auxiliary wrappers (like run_area.py) to be part of ESMValTool -- there is quite a bit to be removed from the /autoassess_source but was planning on doing it after the PR. I can work on it before and only PR after? The codacy stuff needs to be lookined into clearly, but again, was planning on doing it after the PR gets approved -- your call, I can easily work on these and then PR it

Hi @valeriupredoi, yes, if you could fix these issues before the pull request is merged would be great. That way we keep esmvaltool in a clean state, also setting a good example to other diagnostic developers.

sounds about right, man! am getting into this as we speak

ok guys, bear with me for a sec on this one (apologies if you may have received about a million emails with my commit/pushes today - I was trying to figure out if the issue on Jasmin is due to some weird import behavior; it's not and I still have no bloody clue why the issue) - all I have to fix now is the pesky pep8 issues, tomorrow will be ready for the PR :)

@valeriupredoi Regarding the matplotlib backend: put # noqa behind the line where you set the backend if you're sure you really cannot solve it any other way.

eughhh that's ugly but OK, cheers, will do it this way for now :)
On Wed, May 30, 2018 at 5:00 PM, Bouwe Andela<EMAIL_ADDRESS>wrote:

@valeriupredoi https://github.com/valeriupredoi Regarding the
matplotlib backend: put # noqa behind the line where you set the backend
if you're sure you really cannot solve it any other way.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/ESMValGroup/ESMValTool/pull/365#issuecomment-393217468,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AbpCo-AVL6Zg7oYz7XRyZ1Yn-Vhoah_qks5t3sIZgaJpZM4UKlRw
.

--
Dr. Valeriu Predoi
Computational Scientist for UKESM Core Team
Department of Meteorology, University of Reading
Earley Gate, Office 1U08
READING, RG6 6BB
United Kingdom
Mobile number:<PHONE_NUMBER>2
"If one day you be questioning your ability to come up with professional
results, think of this: Noah's ark was built by farmers whereas the Titanic
was crafted by skilled engineers"

By the way, I noticed this is based on an older version of the Python example diagnostic. Can you do a git merge REFACTORING_backend and check that your code still works?  I'll fix the stuff tomorrow

ok gents @bouweandela @mattiarighi - I reckon we're about ready for this PR, how you guys think?

@bouweandela you destroyed the environment, my friend :grinning: Seriously, what's up with the environment not being able to be solved? I am ready to PR this in, but environment.yml is standing between me and the PR :)

@valeriupredoi The iris 1.13 conda package is broken because it depends on another package that was renamed and is therefore no longer available, I've filed a bug report: https://github.com/conda-forge/iris-feedstock/issues/30.

the nc_time_axis crap? That is not needed by the autoassess module no more...

But it is needed by iris 1.13

blood and guts :grin: can we just get this PR in for now? I am starting to get anxious this will never see the daylight :D

iris 1.13 is showing signs of age, we'll have to retire that thing as soon as we figure out the optimization in 2.0...

@bouweandela @mattiarighi the autoassess bit now works fine and this branch has no other changes wrt backend apart from the independent autoassess bit (that works with both iris 1.13 and 2.0) -- can I merge plssss :grinning:

@bouweandela yes, as of today before the iris 1.13 issue, both Py2 and 3 tests were successful

@bouweandela changes made, tested and it works soothly -- be advised that when creating work-dir and plot-dir in shared/_base.py you need to put a check if the directory already exists, as it is now one can not re-run a diagnostic

I can put a nicer error message if it exists? Re-running a script on a directory containing stuff probably also leads to unexpected results and I do not like the idea of deleting the contents: someone might loose their data that way.

@bouweandela wait -- where did the variable_name go from cfg['input_data'].items()? Have you just changed backend?

@bouweandela  I don't think there should be a problem with overwriting work_dir and plot_dir, it's their responsibility after all - but it's your call, I can't be bothered unless there is a process in a certain diag that will call run_diag again in the same place, which, by all means, should never happen :grin:
The only gripe I have with this is it actually renders the screen statement 'To rerun this diagnostic do...' since it's impossible to rerun the diagnostic.
Anyways, I have tested again and all works fine now with the latest _backend, if there iare no objective objections I will want to get this PR in so I can go get beer :grinning:


Add support for paragraphs

Paragraphs (as one might expect) include text and none of the other supported elements that are wrapped in a <p> tag.

+1

+1


Move from JIRA to Github Projects

Github issues notifications in slack

Can this be done automatically? https://zapier.com/app/editor/template/10407
I guess all our notes on (old) issues might have some value still

Closing since we use Github on a daily basis now. Old issues are still in Jira for future reference.


Newest eslint breaks this plugin

Expected Behavior
Running npm install -g eslint eslint-config-fullstack eslint-plugin-react babel-eslint and creating the file ~/.eslintrc.json with the following contents:
{
  "extends": "fullstack",
  "parser": "babel-eslint",
  "rules": {
    "semi": [1, "always"]
  }
}

Will make eslint work, as per the instructions in the workshop.
Actual Behavior
Running eslint generates the following error message:
Oops! Something went wrong! :(

ESLint: 6.0.1.

ESLint couldn't find the config "fullstack" to extend from. Please check that the name of the config is correct.

The config "fullstack" was referenced from the config file in "/Users/joshua/.eslintrc.json".

If you still have problems, please stop by https://gitter.im/eslint/eslint to chat with the team.

Temporary Workaround
Downgrading eslint to version 5.0.1 works. I modified the instructions to:
npm install -g<EMAIL_ADDRESS>eslint-config-fullstack eslint-plugin-react babel-eslint
And everything worked perfectly.

Thanks for the note, I need to do a lot of housekeeping on the versions here. I should also amend the installation instructions to be pinned to compatible versions so that this doesn't happen every time the peer deps fall out of sync. Will get on this soon, maybe later this week.

I don't have write access to this anymore, so someone at Fullstack will have to attend to it.


Rework the mounting system to mount the parts as one instance

Currently the mounting system, mounts each part as its own Vue Instance, this can cause performance issues if say a module has 3-5 parts and a user has 5 of those windows open. That means there will be 15-25 vue instances running within foundry at once.
Rewriting it so that it uses one instance with multiple components should make the performance much better.

Done as of v0.0.4


[ENH] Add BIDSification code

This adds the BIDSification code originally in cis-processing.

Initial debugging works. Merging now.


Asterisk versions

We are currently using this library, along with the ari-proxy, on asterisk 16.9.0 without any issues. We are now considering an upgrade to asterisk 17 or 18.
It is not clear from the documentation which asterisk versions are supported, or tested with.
For instance the release notes for Asterisk 17.5.0 mentioned ARI changes that might be useful, but seems to be missing in the current code.
res_ari_channels
------------------
 * When creating a channel in ARI using the create call
   you can now specify dialplan variables to be set as part
   of the same operation.

It would be nice if the README could contain any Asterisk version compatibility information.

There definitely may be missing features, but I'm happy to add them (or accept PRs which add them).  If they don't exist, it just means I haven't had cause to use them yet.  As for existing features, we use this package up to the latest version of Asterisk (19 as of this writing).


[BUG]: std::vector containing non-trivially copyable types are unexpectedly moved

Problem description
We found some unexpected behavior when creating a binding for some types, which are not trivially copyable, and passing them between Python and C++ in lists/vectors using the type casters.
We would expect that objects in the lists/vectors remain unchanged after passing them to functions bound in C++. The Python example below illustrates this.
Inspecting the issue in a debugging session, we see a move constructor being called, but we would expect to see the copy constructor being called.
We have reproduced this issue in version v.1.5.2.
Reproducible example code
//
// C++
//

#include <nanobind/nanobind.h>
#include <nanobind/stl/string.h>
#include <nanobind/stl/vector.h>
namespace nb = nanobind;

struct example
{
    std::string text;
};

NB_MODULE(example, m) {
    nb::class_<example>(m, "Example")
        .def(nb::init<const std::string&>())
        .def_rw("text", &example::text)
        .def(
            "__repr__",
            [](const example& e) {
                return std::string("Example(\"") + e.text + "\")";
            }
        );

    m.def(
        "process",
        [](const std::vector<example>& v) {
            return v.size();
        },
        nb::arg("v")
    );
}

#
# Python
#

# To reproduce the issue in Python:
from example import Example, process
a = [Example("A"), Example("B")]
b = process(a)
print(a)

# We expect `a` to be unchanged, but if we inspect it we get:
#   [Example(""), Example("")]

This is very bad 😱. I am surprised that this has apparently always been an issue, and that you are the first to stumble into it.  Will have a fix coming up soon (unfortunately a quite intrusive one that changes many things and will need to stay on master for 1-2 weeks to stabilize a bit and gather feedback)

Fixed in the master branch -- could I ask you to double-check that it addresses your problem?

Yes, the issue appears to be fixed. Thank you very much for your quick resolution!

Great to hear -- I think I will actually push this out fairly soon to get feedback. I think that the current bug is more serious than concerns about keeping compatibility.

I just ran into this myself. After updating to the latest, it appears to be fixed.


Move top-level Go code under the 'pkg' directory

This directory structure follows what kubernetes/kubernetes does. We may have other directories in the future that have Go code in them, but this issue starts with moving code just to pkg
cc/ @pmorie

Agree that we should do this.

Will all import paths then need to include "pkg" or is "pkg" directory somehow special in that it gets auto-resolved during golang package resolution?

Yep, all import paths need to include the full path.

do we want to do that? pollute all paths with pkg?

@martinmaly Many go projects do this -- Kubernetes is one.

for context, one of the reasons I created this issue is to move our codebase closer in structure to that of kubernetes/kubernetes

One thing to keep in mind is (I'm not saying this is the case here) could be 'legacy' reasons. There might be a good reason to do something that way, but sometimes it could be that 'we really should be doing it different way but we're stuck for now'. So, if we could for some of these (bit painful imho) moves/renames validate that this is the current and future direction, then I'm more inclined to do it. Just doing it because k8s has been doing it that way might just mean we have to clean things up later.
According to go code doc:
https://golang.org/doc/code.html
src contains Go source files,
pkg contains package objects, and
bin contains executable commands.
So if we can figure out why k8s (seemingly?) deviates from this I'd be more inclined to proceed or mayhaps I'm missing something.

looks like this is already done, closing


coverage report returning false positives?

Hi, I am working my way through a simple todo app with redux, react and jest to learn Jest.
I've got some code here:
https://gist.github.com/lifeiscontent/1c11e03a6d73a1de121a1539ee4359ec
and I've generated a coverage report, and it says visible-todo-list.js lines 15,17 are untested when they've clearly been tested implicitly within the test.
is there something I'm missing? I shouldn't need to test the reducer if all of the logic is being tested from the component, right? If not, that seem's a little excessive to call it 100%.

Hi!
Unfortunately this is not a help forum. Please ask such questions on StackOverflow or Reactiflux, you'll find details on our Help page.
But just a quick look – while using reducers to and pure components (without state) you're good to only test your reducers, no need to render component each time imo (but Flow should take care of props validation).

@thymikee no one responds in reactiflux.

learning testing in JavaScript is still painful, delightful might be true for jest, but... there currently isn't enough documentation on how to test so it's still really painful for beginners. Jest's slogan is a false positive.

You see, the problems you're facing aren't coming from the testing framework but libraries you use, and probably lack of sufficient beginner-centric documentation on certain issues to overcome (if you have ideas on how to improve it for newcomers, please do so by creating an issue or, better, sending a PR to this library!).
Programming, testing and learning new concepts in general will be hard, especially when you start. We all just try to build tools that won't get you in the way too often.
Also, I see quite comprehensive responses to your questions on Reactiflux. Please note this is Open Source community and we try to help each other out as often as possible, but everybody is doing this in their free time – no one is getting paid for 24/7 support, and only few fortunate ones do it as a day job.
So please complain less, read more, and be grateful for all the time OSS community spends on building better software and fixing your issues for free.

@thymikee you're right, here's my contribution: https://github.com/lifeiscontent/todo-flow
if you have ideas on what we should do with this, let me know, I was thinking of maybe trying to get it into the redux repo as there is already a todo-flow example, just this one is typed and 100% tested. What do you think?

If this is something that would have helped you save some time, feel free to send them a PR with these adjustments, I'm sure they'll appreciate :)


Multiple frameworks bridge

Integrate this library multiple frameworks if possible.
Like cocur/slugify does: https://github.com/cocur/slugify/tree/1.3/src/Bridge
You can comment on this issue if you have some specific framework integration requests.

Forget it. This library is linked to Symfony validators and will produce conflicts.


Improve Value Set Downloading

Currently, you need to run node src/services/valuesets/updateValueSetDb.mjs [your_api_key] from the root of ccsm-cds-dashboard to download the valuesets from VSAC into src/services/valusets/valueset-db.js.
We should probably make that command into an npm script that could either read in the api key from an environment variable or prompt the user to enter one, and then add documentation for this step to the ReadMe.

the command is already in the package.json
"download-value-sets": "node src/services/valuesets/updateValueSetDb.mjs $UMLS_API_KEY",
You can  run `npm run download-valuesets [UMLS_API_KEY]"

Whoops, I completely missed that, thanks! It may be helpful to add a note about this to the README, since this step would be required for any CDS that uses value sets from VSAC.

Whoops, I completely missed that, thanks! It may be helpful to add a note about this to the README, since this step would be required for any CDS that uses value sets from VSAC.

Instructions for downloading value sets from VSAC added to README.md in https://github.com/ccsm-cds-tools/ccsm-cds-dashboard/pull/19.


pull request to fix hue-894

[HBase Brower] api error throw when search hbase with rowkey startwith '0'

Thanks!


[LCM] Updated eventgrid schema to support policy run summary

Choose a PR Template
Switch to "Preview" on this description then select one of the choices below.
Click here to open a PR for a Data Plane API.
Click here to open a PR for a Control Plane (ARM) API.

API change check
APIView has identified API level changes in this PR and created following API reviews.
Microsoft.ApiCenter


patch: remove internal user properties from being selected

Fixes #580
/claim #580
Description: Added an extra WHERE clause in the SQL for getUsers to not select any user property that has resourceType Internal
AND up."resourceType" != 'Internal'

@rajdip-b thanks for the PR! I will be sure to evaluate before EOD tomorrow.

@rajdip-b thanks for the PR! I will be sure to evaluate before EOD tomorrow.

Thanks!!

Done and Done!


fix: remove mutations of the redux state in reducers

Summary of changes
This fixes some of our reducers, so that they don't mutate the state.
Context and reason for change
Before this change, there were a few places in our code, where reducers were mutating the state. This is strongly discouraged according to the Redux guide.
How can the changes be tested

yarn test:unit
check that the app performance is still acceptable, by opening a large file in OpossumUI

Fixes https://github.com/opossum-tool/OpossumUI/issues/2412

I did a performance test with a large OpossumUI file and the performance does not seem to be significantly impacted by these changes. Also, I loosely checked that no other state mutations, not covered by tests, are present.


Needs to be public for Visual Composer, but hide URL and throw 404

May be possible in future to enable VC without public option. Awaiting reply from their support and will reopen when possible.


improve readability with new keyword loop

insead of for dracula for(;;) or while($true)
loop {

}

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: p0W3RH311 sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.

You should fork and create working branch with your commits.


Adapted handling of voice tags to work with altered adaption in API

Adapted for alterations in API:
Added get information about voice functionality: https://github.com/neuphonic/streaming-api/pull/112

Added functionality to get information about a specific voice.


TD-3229 Create IconWithLabel component

Contributes TD-3196
Closes TD-3229
Changes

A brief description of what this pull request solves / introduces.

Created new component to render an Icon with an icon to ther right that can optionally be a link
Wrote tests to ensure the component renders and works as expected
Created story for storybook

Dependencies

UI/UX

Testing notes

In the CI/CD workflow of this PR open the rendered storybook
Navigate to IconWithLabel
Make sure that the component renders and inspect it if it matches FIGMA At the time of writing this the component with RoadName has wrong styling. The variant of Typography must be caption
Add something to the href prop make sure now the text is blue and on hover it is underlined, clicking it takes you to the url defined in the href prop
Type in a long text in label make sure that the text truncates and there is no tooltip displayed.

Author checklist
Before I request a review:

[x] I have reviewed my own code-diff.
[x] I have tested the changes in Docker / a deploy-preview.
[x] I have assigned the PR to myself or an appropriate delegate.
[x] I have added the relevant labels to the PR.
[x] I have included appropriate tests.
[x] I have checked that the Lint and Test workflows pass on Github.
~- [ ] I have populated the deploy-preview with relevant test data.~
[x] I have tagged a UI/UX designer for review if this PR includes UI/UX changes.

@Sowbhagya-ipg Can you please confirm that this component is to the specification you are expecting. Thanks

Check the storybook for the update. Looks good. @AronPetrauskas


Fix loading floating dock layout

Switching between editor layouts with floating docks now works correctly.
fix #81162
fix #80748

Thanks! And congrats for your first merged Godot contribution :tada:

Thank you!

Thanks! And congrats for your first merged Godot contribution 🎉

@akien-mga  Not my first contribution, It's just been a few years and I changed my github username from @ianb96 to @kitbdev.

Welcome back then :)


ReadCssProperty Error propertyName=null

I am trying to verify that an element on the page is a certain color. I followed what was done on the documents from the opentest website, however, the example shown didn't include propertyName in its steps. Below is what I wrote and following is the error that I keep getting back. I am stuck at what is wrong and why I keep getting this error based on what I wrote. I have tried putting the propertyName in quotes as well and still hit the error.
      - description: Read the "color" property of the description text
        action: org.getopentest.selenium.ReadCssProperty
        args:
          locator: { id: searchbutton }
          propertyName: color

      - description: Log the color value
        script: |
          $log("The color is: " + $output.value);

ERROR: java.lang.Exception: Failed executing test Appraisals Tests/Appraisal Info w SQL test, segment 1
at org.getopentest.base.TestActor.executeTestSegment(TestActor.java:2111)
at org.getopentest.base.TestActor.runOneSession(TestActor.java:2899)
at org.getopentest.base.TestActor.runOneSession(TestActor.java:2935)
at org.getopentest.Main.main(Main.java:20)
Caused by: java.lang.RuntimeException: There was an error while executing action no. 7 (org.getopentest.selenium.ReadCssProperty) in segment 1 of test Appraisals Tests/Appraisal Info w SQL test.
The action definition was:
{
"action": "org.getopentest.selenium.ReadCssProperty",
"args": {
"locator": {
"id": "searchbutton"
},
"propertyName": "color"
},
"description": "Read the "color" property of the description text"
}
at org.getopentest.base.TestActor.executeTestSegment(TestActor.java:2069)
... 3 more
Caused by: java.lang.RuntimeException: Failed executing action org.getopentest.selenium.ReadCssProperty with arguments {"locator":{"id":"searchbutton"},"propertyName":"color"}
at org.getopentest.base.TestActor.executeActionByDef(TestActor.java:1766)
at org.getopentest.base.TestActor.executeTestSegment(TestActor.java:2019)
... 3 more
Caused by: java.lang.RuntimeException: Failed to instantiate action class "org.getopentest.selenium.ReadCssProperty"
at org.getopentest.base.TestActor.executeActionByClassName(TestActor.java:1569)
at org.getopentest.base.TestActor.executeActionByDef(TestActor.java:1650)
... 4 more
Caused by: java.lang.NullPointerException: null value in entry: propertyName=null
at com.google.common.collect.CollectPreconditions.checkEntryNotNull(CollectPreconditions.java:34)
at com.google.common.collect.ImmutableMap.entryOf(ImmutableMap.java:175)
at com.google.common.collect.ImmutableMap.of(ImmutableMap.java:132)
at org.openqa.selenium.remote.RemoteWebElement.getCssValue(RemoteWebElement.java:172)
at org.getopentest.selenium.ReadCssProperty.run(ReadCssProperty.java:20)
at org.getopentest.base.TestActor.executeAction(TestActor.java:1474)
at org.getopentest.base.TestActor.executeActionByClassName(TestActor.java:1550)

The property name must be passed as an argument named property, like this:
- description: Read the "color" property of the description text
  action: org.getopentest.selenium.ReadCssProperty
  args:
      locator: { id: searchbutton }
      property: color

Although the example on the website is missing the property name, the property argument is documented in the section above the example. Thanks for reporting the error in the documentation, I will make sure to fix that.


Hazelcast state store implementation

Description
State store implementation for Hazelcast using its Map data structure
Issue reference
Issue #119
Checklist
Please make sure you've completed the relevant tasks for this PR, out of the following list:

[x] Code compiles correctly
[x] Created/updated tests
[ ] Extended the documentation

WOOT!
Will review tomorrow

@yaron2 can you please help resolve the check-diff issues?

yep

Thanks. I did try pulling in the changes - didn't work as expected.

@abhirockzz can you try to run go mod tidy locally and push any changes?

That's what I did. Opened a new PR #145 . Forked latest from dapr master, based these changes on top of it, go mod tidy and pushed changes

Closing for #145


Support linux on local-cluster.sh

It seems that the script assumes that you have a docker-machine configured [1]. This is not always true in barebone linux hosts.
It would be great if linux users could take advantage of this script.
[1]
[[ -n "${DOCKER_MACHINE_NAME:-}" ]] || return

It seems that Kubernetes just released https://github.com/kubernetes/minikube which works on mac and linux.
It might be a good idea to point to it from our documentation instead of local-cluster.sh
What do you think?

Yeah, I think that should be the preferred route. Changing the issue title accordingly.


[Feature] Segregating JobInterface into executable and read/writable

Hey there,
I am actually implementing a Queue/Worker project, which should be able to deploy multiple workers on multiple machines. I would love to create a Project, which handles the queuing itself (e.g. over an API) and a worker project, which just fetches a job and executes it.
Actually, I have to configure both projects (API and Worker) to interact with the Queue and with another Project, just because I have to provide the execute method to the JobInterface even if I just want to enqueue the Job without executing it directly.
So it would be nice if we could segregate the JobInterface into ExecutableJobInterface (which provides the execute method) and an IOJobInterface (which is extended by the ExecutableJobInterface) which provides the other methods, the JobInterface actually is implementing.
That would mean, that we could change the QueueInterface::push and QueueInterface::delete method definition from JobInterface to IOJobInterface and the return value of QueueInterface::pop to ExecutableJobInterface.
What do you guys think about this? I know, this change will BC break but I think this could be pretty useful.

IMO this is not a feature I would invest my time in. But if you provide a good PR I’m willing to have a look and consider it. No issues with BC.


Wifi scanning when connected to network

Scanning of networks doesn't work when connected to Wifi hotspot

Do you have the appropriate location permission listed in the documentation https://github.com/isuPatches/WiseFy/blob/2.x/documentation/permissions_example.md
I'm wondering if it never works on your device because you are missing that.
What type and version of Android are you using and what type of Hotspot?  Are you using one of the regex search functions and may I also see how you are trying to scan?

Sorry for long response. All permissions are in manifest and granted. Android 6,5 (Samsung, Meizu, Lenovo).
Here is code which I use:
 List<ScanResult> scans = mWiseFy.getNearbyAccessPoints(true);
Scanning is working, but when I connected to any Wifi point it just return empty List

I will see if I can't replicate when I have a spare moment

maybe you have sample app. i will test it in my conditions, and detect is this a bug(or something like that) or troubles in my code?

That was the route I was going to go more than likely :)  Sorry if it takes a few days...I'm pretty busy.

OK, it's normal way)

I plan on looking at this hopefully this weekend.  Thank you for your patience.

I had a spare cycle and made this sample: https://github.com/isuPatches/WiseFySample which works for me locally.
 List: [SSID: CantTouchThis5g, ...]
Question...if you open your network settings on your Android phone, is it able to see the other networks?  I did some playing around and when the Android device had WiFi off the list would rightfully return [].  I'm wondering if there are cases on Hot Spots that are similar where once connected, other networks are no longer reported.  If that is the issue, I would have to think a lot about a solution.

Ookay, you know
It's working
I simulated my situation, adn it works just fine
Sorry for worrying you
Troubles in my side
Perhaps, now lib has a sample)
//By the way
Is that output built in lib?
D/WiseFySearch: Found new wifi network
D/WiseFySearch: SSID 1: UNTC_7, SSID 2: dir-615

Glad to hear!  Yes, that is part of the libraries logging which is disabled by default and enabled by the logging parameter on the builder:
WiseFy mWiseFy = new WiseFy.brains(getActivity()).logging(true).getSmarts();
It's also nice to have a sample :)  Thank you for your feedback and usage.


PS4 save game dump: tag parsing errors

Hi, I have just dumped our save files from our PS4 to continue playing on a steam gaming pc. I dumped them 2 times to have a not corrupted dump. Installed the dev build via pip inside Arch Linux, BTW.
So the header is PS4, found your tools to hopefully convert them to windows. I have read I can convert them to JSON, then patch the JSON and convert it back to a save game.
00000000: 47 56 41 53 02 00 00 00 04 02 00 00 04 00 14 00  GVAS............
00000010: 03 00 89 a5 2b 80 16 00 00 00 44 41 46 46 4f 44  ....+.....DAFFOD
00000020: 49 4c 2d 50 41 54 43 48 50 53 34 31 2d 37 31 00  IL-PATCHPS41-71.

https://filepickup.phcn.de/sophie_ps4_export.sav
$ ttwl-save-info -i sophie_ps4_export.sav
Traceback (most recent call last):
  File "/home/sophie/.local/bin/ttwl-save-info", line 8, in <module>
    sys.exit(main())
             ^^^^^^
  File "/home/sophie/.local/lib/python3.11/site-packages/ttwlsave/cli_info.py", line 85, in main
    save = TTWLSave(args.filename)
           ^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/sophie/.local/lib/python3.11/site-packages/ttwlsave/ttwlsave.py", line 190, in __init__
    self.import_protobuf(data)
  File "/home/sophie/.local/lib/python3.11/site-packages/ttwlsave/ttwlsave.py", line 205, in import_protobuf
    raise Exception('Unable to parse savegame (did you pass a profile, instead?): {}'.format(e)) from None
Exception: Unable to parse savegame (did you pass a profile, instead?): Wrong wire type in tag.

http://filedrop.phcn.de/uploads/profile
$ ttwl-profile-info profile
Traceback (most recent call last):
  File "/home/sophie/.local/bin/ttwl-profile-info", line 8, in <module>
    sys.exit(main())
             ^^^^^^
  File "/home/sophie/.local/lib/python3.11/site-packages/ttwlsave/cli_prof_info.py", line 63, in main
    prof = TTWLProfile(args.filename)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/sophie/.local/lib/python3.11/site-packages/ttwlsave/ttwlprofile.py", line 176, in __init__
    self.import_protobuf(data)
  File "/home/sophie/.local/lib/python3.11/site-packages/ttwlsave/ttwlprofile.py", line 191, in import_protobuf
    raise Exception('Unable to parse profile (did you pass a savegame, instead?): {}'.format(e)) from None
Exception: Unable to parse profile (did you pass a savegame, instead?): Wrong wire type in tag.

Hope someone can check these save if they usable or not complete.
edited: uploaded profile

@abramhindle any ideas?


Open/Close trigger is not implemented

Just got a new Eufy smart lock (the finger print version with WiFi) and verified it’s on the compatible list per documentation.
When re-configuring my Eufy setup, it finds the lock and adds it into HomeKit. When I unlock the door, it just gets stuck on “unlocking…” and nothing happens. I viewed the logs for HomeBridge and see the following error:
[10/04/2022, 17:40:31] [EufySecurity] Open/Close trigger is not implemented
Any help would be appreciated.

Did you use beta version ?

Did you use beta version ?

Negative, I am on the latest stable (1.0.8).

Lock feature is available on beta only.

Lock feature is available on beta only.

Ah got it, thank you for the answer (and all your work on this plugin). I believe I saw somewhere the latest beta is set to go stable within the next 2 weeks?

yes, you can track it into our new repo :
https://github.com/homebridge-eufy-security/plugin/issues/1


EncodingsDiff.removeNonBreaking directional

Codecov Report

Merging #112 (911452d) into main (62b9811) will increase coverage by 0.01%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main     #112      +/-   ##
==========================================
+ Coverage   89.50%   89.51%   +0.01%
==========================================
  Files          70       70
  Lines        3925     3931       +6
==========================================
+ Hits         3513     3519       +6
  Misses        296      296
  Partials      116      116

Flag
Coverage Δ

unittests
89.51% <100.00%> (+0.01%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

diff/content_diff.go
94.73% <100.00%> (+0.61%)
:arrow_up:

:mega: Codecov can now indicate which changes are the most critical in Pull Requests. Learn more


Plan ZIP 215 handling.

ZIP 215 will change the validation rules for Ed25519 signatures on Zcash.  As this library aims to provide Zcash-flavored Ed25519, it necessarily must also be updated in sync with the ZIP 215 activation.
I would very much prefer not to maintain multiple code paths, so the current plan is:

release a version 1.x series with the current validation rules;
release a version 2.x series with the ZIP 215 validation rules.

Since downstream crates can import multiple versions of the same dependency simultaneously (by renaming the dependency so that the two versions have different names), it's still possible to use different validation rules in different contexts if someone needed to do that (e.g., pre/post activation), but the API remains simple for everyone who doesn't particularly care about the details of the validation rules.

cc @str4d, any thoughts on this strategy as a potential user?

To make this happen there needs to be a 1.x release first, so that a 2.x release can be ready in advance of ZIP 215.  I would like the API to be essentially the same between the two, so, mapping out any potential changes:

changing terminology (#8, #20)
implementing Signature (#9, #10) -- can be done later without breaking compatibility, probably more useful as a general-purpose library post ZIP-215;
stabilizing the batch verification API -- done in #19.

Once #20 is merged I think the next step is to release a new minor version, sit on it for a bit, and then rerelease it as 1.0.


Fixing "Unused Java BUILD Deps" issues.

Implementing Actionable cleanup from G3 import.
CC: @jasonwyatt @csilvestrini

Warnings are from cl/326066603

Yes, will do.

Here's the presubmit CL -- there are no build or "unused deps" errors, as of writing. cl/326112367

5 checks passing, and so does a manual presubmit check (I'm superstitious). So, I feel it's safe to merge.


TiCDC cannot reasonably dispatch a table's region to different nodes.

What did you do?

There is a bigcluster.bigtable in the upstream cluster, containing 560,000 regions.
Use the following to create a changefeed to sync the table.

[filter]
rules=["bigcluster.*"]

[scheduler]
enable-table-across-nodes = true
region-threshold = 100000
write-key-threshold = 20000

One TiCDC node is assigned to sync more than 500,000 regions, while the other is only assigned to sync more than 20,000 regions. Additionally, the changefeed stopped advancing.

What did you expect to see?
I hope that the region and write flow of this table can be evenly distributed to two CDC nodes.
What did you see instead?
described aboved.
Versions of the cluster
Upstream TiDB cluster version (execute SELECT tidb_version(); in a MySQL client):
(paste TiDB cluster version here)

Upstream TiKV version (execute tikv-server --version):
(paste TiKV version here)

TiCDC version (execute cdc version):
(paste TiCDC version here)

/assign @overvenus

The issue was caused by uneven distribution of inserts in the upstream, where a large number of writes were falling into a small number of tikv instances. After adjusting the primary key generation method for writing data, the issue was resolved.