Permission Denied For Msgbox

When we try to run the vbscript code with msgbox, Permission denied message is displayed.
Msgbox "Hello"
Below error shows up :

Permission denied: 'Msgbox'
OK

Hi @jaskaran0001,
For the MsgBox and InputBox functions to work, you must provide an implementation of IHostWindow. Here's a minimal example:
internal class HostWindow : IHostWindow {
    public IntPtr OwnerHandle {
        get { return IntPtr.Zero; }
    }
    public void EnableModeless(bool enable) {
        throw new NotImplementedException();
    }
}

And then:
engine.HostWindow = new HostWindow();
engine.Execute("result = MsgBox(\"Ready?\", vbQuestion + vbYesNo, \"Let's Go!\")");

Good luck!

Thanks for the reply, but i could not figure out where do this implementation.
It would be very kind of you , if you could elaborate more.
Thanks !

Hi @jaskaran0001,
You need to set the engine's HostWindow property to a non-null value. Once you've done that, VBScript's MsgBox and InputBox functions should work.
Here's a full sample program:
using System;
using Microsoft.ClearScript.Windows;

namespace TestApp {
    internal class Window : IHostWindow {
        public IntPtr OwnerHandle {
            get { return IntPtr.Zero; }
        }
        public void EnableModeless(bool enable) {
            throw new NotImplementedException();
        }
    }
    public static class Program {
        public static void Main() {
            using (var engine = new VBScriptEngine()) {
                engine.HostWindow = new Window();
                engine.Evaluate("MsgBox(\"Ready?\", vbQuestion + vbYesNo, \"Let's Go!\")");
            }
        }
    }
}

Cheers!

Thanks ! It Worked!


rogue and rogue-likes

What contents are gonna be mentioned in this episode? Procedural map gen? Or character build up based on number incremental? Or simply reviewing some video games?
Btw, i'm recently reviewing ue4. The c++/cli seems very mysterious to many people. Also, I think it's time to teach people how to do the cpp style GC, which works perfectly with ECS pattern and imo not possible to make cyclic referencing which causes memory leaking. I also think the cpp style GC helps people understand the black magic of c++/cli. Am I supposed to create another issue entry to mention this?

I'd love to hear what the current easiest method is to do the kind of text rendering used for these kinds of games. ncurses is getting a bit long in the tooth.

Since this is planned for [fill in the blank] I was really just thinking about a quick overview of the original game and some history of the genre.
I guess I could instead look at doing a "quickly making a rogue clone with FTXUI" or something instead, or in addition to?

I'm not sure you could do both topics justice in the same video, but they both sound good to me.


x/tools/cmd/goimports: strict ordering of local packages

Support for multiple packages was added here.
It would be good to be able to specify strict order of local packages.
For example if I specify local packages as mycompany.com/foo,mycompany.com/bar mycompany.com/foo imports will always be placed above mycompany.com/bar packages.

I dunno; I'd rather not. The less configuration, the better. As it stands, you won't get code churn if two people set up their flags differently.

We don't want to add more configuration to goimports, and this hasn't attracted much attention, so closing. Please comment if you disagree.


Range parsers with tests b

Q
A

Is bugfix?
❌

New feature?
✔

Breaks BC?
❌

@Gerych1984 do you have time to rebase this PR and adjust it based on comments?

@Gerych1984 do you have time to rebase this PR and adjust it based on comments?

Yes. I haven't forgotten about this and this PR. I'll try to find time to get them in the right shape


feat: Observability for RayServe and vLLM GPU

What does this PR do?
This PR provides observability with Prom and Grafana for rayserve-vllm-gpu pattern
🛑 Please open an issue first to discuss any significant work and flesh out details/direction - we would hate for your time to be wasted.
Consult the CONTRIBUTING guide for submitting pull-requests.

Motivation
#586
#645

More

[x] Yes, I have tested the PR using my local account setup (Provide any test evidence report under Additional Notes)
[x] Mandatory for new blueprints. Yes, I have added a example to support my blueprint PR
[x] Mandatory for new blueprints. Yes, I have updated the website/docs or website/blog section for this feature
[x] Yes, I ran pre-commit run -a with this PR. Link for installing pre-commit locally

For Moderators

[ ] E2E Test successfully complete before merge?

Additional Notes

Verify pre-commit Min TF check please


Crash app when read epub file

It is working in debug apk but same not working in release apk
     VocsyEpub.open(path,
          lastLocation: EpubLocator.fromJson({
            "bookId": bookid,
            "href": href,
            "created": created,
            "locations": {"cfi": location},
          }));

I'm encountering an issue with my release APK. While it works fine in debug mode, it crashes on any Android version when running the release build.

I found the issue the problem is its not able to parse the material color to hex code and send to the method channel.

The fix is simple we just have to replace the color with a static hex code for other devs to work.
Meaninwhile , @kaushikgodhani I can rise a PR if you are ok to fix this issue permanantly. Let me know on the same.

i have the same issue. @jalakamkiran. if you could, it would be nice if you could send the fix for this error in the issue.

i have the same issue. @jalakamkiran. if you could, it would be nice if you could send the fix for this error in the issue.

Check and let me know if this works: https://github.com/kaushikgodhani/vocsy_epub_viewer/pull/60
CC: @kaushikgodhani

SORRY FOR DELAY
PLEASE CHECK THIS NEW VERSION "vocsy_epub_viewer: ^3.0.0" AND GIVE YOUR REVIEW. THANK YOU @djoks


Conda install: Supported python version

Currently, conda install supports python 3.6/3.7/3.8. Do we want to support python 3.9/3.10?
Specifications:

  - cytnx -> python[version='>=3.6,<3.7.0a0|>=3.7,<3.8.0a0|>=3.8,<3.9.0a0']

I think the plan is to support 3.7-3.9 for the next iteration 0.7.5 or 0.7.6

v076 is now online, with support version 3.7/3.8/3.9


Can not Login

Hi, I have the problem that i could not login. I get the Error "received unexpected status code 401"

My Azure App:

JSON:

Browser:

Can you give me a hint what I configured wrong?

Hi @tlehletmt, I've tried to reproduce your issue. I'm encountering a 401 error like yours when I'm using an incorrect Secret Value in "client_secret". Please make sure you're using the Secret's Value, not the ID (see screenshot below).

Yes that was the problem. I have now changed this and the login works now. Thank you very much for the quick help!


Created new integration test suit

New integration test case needed for demo/developer environment

This issue was moved to datafibers-community/df_data_service#12


Add Keycloak 24

What this PR does / why we need it:
Which issue this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close that issue when PR gets merged):
fixes #996
Special notes for your reviewer:
PR Readiness Checklist:
Complete these before marking the PR as ready to review:

[X] the CHANGELOG.md release notes have been updated to reflect any significant (and particularly user-facing) changes introduced by this PR

Hi @lme-atolcd,
as there were breaking changes in 23.0.4 we do need to add my pull request as well: https://github.com/adorsys/keycloak-config-cli/pull/977
Could you please try to merge my branch into yours and see whether everything keeps working?
I am currently stuffed with other things on the project but I will also try to add the 24 within the next week, I think ;)
Best Regards
Jonas
P.S.: @st3v0rr Could you please give a sign of life? ^^

Hi @jonasvoelcker
I rebased my branch on top of yours.
Still wondering why my pull-request fails on Github CI (local tests are ok) :smile:
[ERROR] de.adorsys.keycloak.config.service.GroupImportServiceTest$CreatingGroupIT.createOrUpdateGroups_shouldCreateGroup  Time elapsed: 0.007 s  <<< ERROR!
java.lang.NoSuchMethodError: 'java.time.Instant ch.qos.logback.classic.spi.ILoggingEvent.getInstant()'
	at de.adorsys.keycloak.config.service.GroupImportServiceTest$CreatingGroupIT.createOrUpdateGroups_shouldCreateGroup(GroupImportServiceTest.java:85)

If you have an idea...

Hi @lme-atolcd, it was exactly what @tbroyer mentioned and I downgraded it to 7.3.
Furthermore there was a change in the return values of groups so I needed to change some if-statements.
My branch seems to work now, thanks for your Feature-Flag-Analysis :)
https://github.com/adorsys/keycloak-config-cli/pull/998

@jonasvoelcker okay, that's good news :)
Let's continue with your pull request then.


pythonPackages.nibabel: unbreak tests/package

Motivation for this change
Build is broken due to an unimportant test failing and a few tests erroring due to missing pytest.
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[ ] NixOS
[ ] macOS
[x] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[x] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
nilearn is still broken for unrelated reasons
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

@GrahamcOfBorg build pythonPackages.nibabel
@GrahamcOfBorg build pythonPackages.nibabel

@GrahamcOfBorg build python3Packages.nibabel
@GrahamcOfBorg build python38Packages.nibabel

A couple tests fail on aarch64.  I've PR'ed one of them but can't reproduce the other on x64, so I've disabled them in the expression.
@ashgillman @jonringer

@GrahamcOfBorg build pythonPackages.nibabel
@GrahamcOfBorg build python3Packages.nibabel
@GrahamcOfBorg build python38Packages.nibabel

my main concern is: Under normal usage of this library, is it still actually broken for arm?
just because we disable a test, doesn't mean that everyone is okay; those tests might be revealing that the package makes some assumptions which are broken on arm.
at the very least, please comment why those tests are disabled :)

Sure, updated to disable non-x64 builds for now.

Added another commit to remove some spurious Python 2-related stuff from an earlier version.


Allow glob patterns on on

Possible to do glob pattern on on? For example, fzf.vim can have commands like FzfFiles, FzfCommits and so on.
The configuration would look like this:
Plug 'junegunn/fzf.vim', { 'on': 'Fzf*' }

:version
NVIM 0.1.7
Build type: RelWithDebInfo
Compilation: /usr/local/Homebrew/Library/Homebrew/shims/super/clang -Wconversion -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=1 -DDISABLE_LOG -Wall -Wextra -pedantic -Wno-unused-parameter -Wstrict-prototypes -std=gnu99 -Wvla -fstack-protector-strong -fdiagnostics-color=auto -DINCL
UDE_GENERATED_DECLARATIONS -DHAVE_CONFIG_H -I/tmp/neovim-20161129-56964-dc0z4u/neovim-0.1.7/build/config -I/tmp/neovim-20161129-56964-dc0z4u/neovim-0.1.7/src -I/usr/local/include -I/usr/local/include -I/usr/local/include -I/usr/local/include -I/usr/local/include -I/usr/lo
cal/opt/gettext/include -I/usr/include -I/usr/include -I/tmp/neovim-20161129-56964-dc0z4u/neovim-0.1.7/build/src/nvim/auto -I/tmp/neovim-20161129-56964-dc0z4u/neovim-0.1.7/build/include
Compiled by<EMAIL_ADDRESS>
Optional features included (+) or not (-): +acl   +iconv    -jemalloc +tui
For differences from Vim, see :help vim-differences

   system vimrc file: "$VIM/sysinit.vim"
  fall-back for $VIM: "/usr/local/Cellar/neovim/0.1.7/share/nvim"

Type:

[ ] Bug
[ ] Enhancement
[x] Feature Request
[ ] Question

OS:

[x] All/Other
[ ] Linux
[ ] OS X
[ ] Windows

Vim:

[ ] Terminal Vim
[ ] GVim
[x] Neovim

It's not possible. When you specify the name of a command, vim-plug sets up a proxy command of the same name that loads the plugin which is supposed to implement the command, and rerun the command hoping that it's now properly loaded. Without an exact name, vim-plug can't define the proxy command.
More importantly, you most likely don't need it. A well-structured vim plugin should already load lazily without any help from the plugin manager. Make sure that you're tackling the right problem by breaking down the start up time of vim using --staruptime option. fzf.vim is especially a bad example here because it loads in less than a millisecond. There are very few cases where on or for options make much sense.


[CVE/main] main patches

CVE-2023-35941
CVE-2023-35942
CVE-2021-35944
CVE-2021-35943

Commit Message:
Additional Description:
Risk Level:
Testing:
Docs Changes:
Release Notes:
Platform Specific Features:
[Optional Runtime guard:]
[Optional Fixes #Issue]
[Optional Fixes commit #PR or SHA]
[Optional Deprecated:]
[Optional API Considerations:]

pushing through to resolve CVEs


Add openchannel reserve option

Description
This PR adds an optional argument to the open channel request for the remote reserve amount.

Not sure why we're hitting
https://github.com/lightninglabs/lndclient/actions/runs/9405322822/job/25906215580?pr=186#step:5:14
go.mod:187: invalid go version '1.21.4': must match format 1.23

The branch you're merging into doesn't have a PR yet, so I haven't looked into the linter. Probably just need to update it.


Replace any strings after the first ? in a url for GA

Purpose
In some browsers location.pathname also send the querystring and isn't split into the search property. This means we are still being sent email addresses and other data.
Fixes UML-969
Approach
Added test case and fix to make it pass
Checklist

[x] I have performed a self-review of my own code
[x] I have added relevant logging with appropriate levels to my code
[ ] I have updated documentation (Confluence/GitHub wiki/tech debt doc) where relevant
[x] I have added tests to prove my work
[ ] The product team have tested these changes

Coverage remained the same at 81.735% when pulling a059d870ff56e89451396833c8dcf7b983993cc2 on uml-969-ga-query into a6b13b3c72af9764236e5252a1c31b44a079d037 on master.


Removed references to s2i builds and included cordova install

@wei-lee @aliok - Please review, as mentioned I have managed to get the centos images to build Also included cordova). The rhel7 version is giving me errors wrt rh-nodejs4 (not found). I will leave this out for now I have asked Sushma and Jozef for help, so this (the rhel7 version is still a WIP)

👍

Code looks good to me, but I haven't tried connecting it with Jenkins master yet.

@wei-lee @aliok - Thanks for the review. If you could verify it on your local vm and let me know so I can make the necessary changes if needed

@luigizuccarelli although I am not sure if we need to test as following for sure but I had a problem.
When I tried using this new image in Jenkins for Android agents, I got this error in the pods:
/usr/local/bin/run-jnlp.sh: line 9: exec: c2685844688cd5f56d789668fb3eeb6ef96bc49cb356fff8eee475ea6c034ccd: not found

Then the pod dies.

@aliok - OK I'll look into that now

@luigizuccarelli I was able to build an Android Cordova project using this slave in Jenkins, tested it and it worked fine.
I did have to set the Kubernetes Plugin option Disable https certificate check locally, otherwise slaves would fail to run due to handshake issues though. So maybe that could go into the README?

closing it due to #37


Downloading video from VK.COM returns HTTP error 404

Checklist

[x] I'm reporting a broken site support
[x] I've verified that I'm running youtube-dl version 2021.12.17
[x] I've checked that all provided URLs are alive and playable in a browser
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x] I've searched the bugtracker for similar issues including closed ones

Verbose log
/usr/bin/python3.10 /home/docryte/PycharmProjects/utilabot/bug.py
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2021.12.17
[debug] Python version 3.10.7 (CPython) - Linux-5.19.0-29-generic-x86_64-with-glibc2.36
[debug] exe versions: none
[debug] Proxy map: {}
[vk] -60099869_456246720: Downloading JSON metadata
ERROR: Unable to download JSON metadata: HTTP Error 404: Not Found (caused by <HTTPError 404: 'Not Found'>); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "/usr/local/lib/python3.10/dist-packages/youtube_dl/extractor/common.py", line 634, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/usr/local/lib/python3.10/dist-packages/youtube_dl/YoutubeDL.py", line 2288, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/usr/lib/python3.10/urllib/request.py", line 525, in open
    response = meth(req, response)
  File "/usr/lib/python3.10/urllib/request.py", line 634, in http_response
    response = self.parent.error(
  File "/usr/lib/python3.10/urllib/request.py", line 563, in error
    return self._call_chain(*args)
  File "/usr/lib/python3.10/urllib/request.py", line 496, in _call_chain
    result = func(*args)
  File "/usr/lib/python3.10/urllib/request.py", line 643, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/youtube_dl/extractor/common.py", line 634, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/usr/local/lib/python3.10/dist-packages/youtube_dl/YoutubeDL.py", line 2288, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/usr/lib/python3.10/urllib/request.py", line 525, in open
    response = meth(req, response)
  File "/usr/lib/python3.10/urllib/request.py", line 634, in http_response
    response = self.parent.error(
  File "/usr/lib/python3.10/urllib/request.py", line 563, in error
    return self._call_chain(*args)
  File "/usr/lib/python3.10/urllib/request.py", line 496, in _call_chain
    result = func(*args)
  File "/usr/lib/python3.10/urllib/request.py", line 643, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/youtube_dl/YoutubeDL.py", line 815, in wrapper
    return func(self, *args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/youtube_dl/YoutubeDL.py", line 836, in __extract_info
    ie_result = ie.extract(url)
  File "/usr/local/lib/python3.10/dist-packages/youtube_dl/extractor/common.py", line 534, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/lib/python3.10/dist-packages/youtube_dl/extractor/vk.py", line 325, in _real_extract
    payload = self._download_payload('al_video', video_id, data)
  File "/usr/local/lib/python3.10/dist-packages/youtube_dl/extractor/vk.py", line 67, in _download_payload
    code, payload = self._download_json(
  File "/usr/local/lib/python3.10/dist-packages/youtube_dl/extractor/common.py", line 895, in _download_json
    res = self._download_json_handle(
  File "/usr/local/lib/python3.10/dist-packages/youtube_dl/extractor/common.py", line 874, in _download_json_handle
    res = self._download_webpage_handle(
  File "/usr/local/lib/python3.10/dist-packages/youtube_dl/extractor/common.py", line 667, in _download_webpage_handle
    urlh = self._request_webpage(url_or_request, video_id, note, errnote, fatal, data=data, headers=headers, query=query, expected_status=expected_status)
  File "/usr/local/lib/python3.10/dist-packages/youtube_dl/extractor/common.py", line 652, in _request_webpage
    raise ExtractorError(errmsg, sys.exc_info()[2], cause=err)
youtube_dl.utils.ExtractorError: Unable to download JSON metadata: HTTP Error 404: Not Found (caused by <HTTPError 404: 'Not Found'>); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/docryte/PycharmProjects/utilabot/bug.py", line 11, in <module>
    get_video()
  File "/home/docryte/PycharmProjects/utilabot/bug.py", line 9, in get_video
    youtube_dl.YoutubeDL({'outtmpl': name, 'cookiefile': './cookies.txt', 'verbose': True}).download([video])
  File "/usr/local/lib/python3.10/dist-packages/youtube_dl/YoutubeDL.py", line 2068, in download
    res = self.extract_info(
  File "/usr/local/lib/python3.10/dist-packages/youtube_dl/YoutubeDL.py", line 808, in extract_info
    return self.__extract_info(url, ie, download, extra_info, process)
  File "/usr/local/lib/python3.10/dist-packages/youtube_dl/YoutubeDL.py", line 824, in wrapper
    self.report_error(compat_str(e), e.format_traceback())
  File "/usr/local/lib/python3.10/dist-packages/youtube_dl/YoutubeDL.py", line 628, in report_error
    self.trouble(error_message, tb)
  File "/usr/local/lib/python3.10/dist-packages/youtube_dl/YoutubeDL.py", line 598, in trouble
    raise DownloadError(message, exc_info)
youtube_dl.utils.DownloadError: ERROR: Unable to download JSON metadata: HTTP Error 404: Not Found (caused by <HTTPError 404: 'Not Found'>); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

Process finished with exit code 1

Description
I try to download any video from vk.com and It returns HTTP error 404 as you can see. I use cookies to log in. In cookies.txt I have only vk.com cookies I downloaded with Get cookies.txt addon for Chrome. The video and URL surely exist. The python code you can see here:
import youtube_dl

def get_video():
    message_chat_id = 'any int'
    message_id = message_chat_id
    name = './tmp/' + message_chat_id + "_" + message_id
    video = 'https://vk.com/video/@pitbullmonster?z=video-60099869_456246720%2Fclub60099869%2Fpl_-60099869_-2'
    youtube_dl.YoutubeDL({'outtmpl': name, 'cookiefile': './cookies.txt', 'verbose': True}).download([video])

get_video()

Hi, I've almost the same issue as you
Here my log on verbose :
[youtube] Bl_xxxxxxx: Downloading webpage
WARNING: Unable to download webpage: <urlopen error [Errno -2] Name or service not known>
[youtube] Bl_xxxxxxx: Downloading API JSON
ERROR: Unable to download API page: <urlopen error [Errno -2] Name or service not known> (caused by URLError(gaierror(-2, 'Name or service not known')))
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 634, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 2288, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/usr/lib/python3.9/urllib/request.py", line 517, in open
    response = self._open(req, data)
  File "/usr/lib/python3.9/urllib/request.py", line 534, in _open
    result = self._call_chain(self.handle_open, protocol, protocol +
  File "/usr/lib/python3.9/urllib/request.py", line 494, in _call_chain
    result = func(*args)
  File "/usr/local/bin/youtube-dl/youtube_dl/utils.py", line 2735, in https_open
    return self.do_open(functools.partial(
  File "/usr/lib/python3.9/urllib/request.py", line 1349, in do_open

My issue seems to be unrelated, sorry

Although I can't get the video without account details, I can't reproduce the problem with the yt-dl program (as opposed to your wrapper). Both the git master and release versions identify that I would need to be a registered user. Perhaps VK checks the user details before trying to find the referenced resource, and the 404 only arises then.
Please run youtube-dl --cookies ./cookies.txt -v --ignore-config 'https://vk.com/video/@pitbullmonster?z=video-60099869_456246720%2Fclub60099869%2Fpl_-60099869_-2'

Command returns the same. Also you can open this video by link in incognito mode and It will still work. I think, If there was a login problem, It would return an "This video is only available for registered users" error.
docryte@docryte:~/PycharmProjects/utilabot$ youtube-dl --cookies './cookies.txt' -v --ignore-config 'https://vk.com/video/@pitbullmonster?z=video-60099869_456246720%2Fclub60099869%2Fpl_-60099869_-2'
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--cookies', './cookies.txt', '-v', '--ignore-config', 'https://vk.com/video/@pitbullmonster?z=video-60099869_456246720%2Fclub60099869%2Fpl_-60099869_-2']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2021.12.17
[debug] Python version 3.10.9 (CPython) - Linux-5.19.0-29-generic-x86_64-with-glibc2.36
[debug] exe versions: none
[debug] Proxy map: {}
[vk] -60099869_456246720: Downloading JSON metadata
ERROR: Unable to download JSON metadata: HTTP Error 404: Not Found (caused by <HTTPError 404: 'Not Found'>); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "/usr/local/lib/python3.10/dist-packages/youtube_dl/extractor/common.py", line 634, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/usr/local/lib/python3.10/dist-packages/youtube_dl/YoutubeDL.py", line 2288, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/usr/lib/python3.10/urllib/request.py", line 525, in open
    response = meth(req, response)
  File "/usr/lib/python3.10/urllib/request.py", line 634, in http_response
    response = self.parent.error(
  File "/usr/lib/python3.10/urllib/request.py", line 563, in error
    return self._call_chain(*args)
  File "/usr/lib/python3.10/urllib/request.py", line 496, in _call_chain
    result = func(*args)
  File "/usr/lib/python3.10/urllib/request.py", line 643, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)

Indeed, "This video is only available for registered users" is what I get. What happens if you leave out the --cookies ...?

this works  youtube-dl -o '%(title).20s' --no-part --restrict-filenames --user-agent "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/<IP_ADDRESS> Safari/537.36" --add-header "Cookie:tstc=p; Expires=Tue, 01 Feb 2033 08:39:34 GMT; Path=/; HttpOnly;" --referer "https://vk.com" "https://vkvd183.mycdn.me/?expires=1675759170076&srcIp=<IP_ADDRESS>&pr=40&srcAg=CHROME&ms=<IP_ADDRESS>&type=1&sig=0yVLdX9Gj88&ct=6&urls=<IP_ADDRESS>&clientType=13&appId=512000384397&id=1058544814656"

Yes, but in order to get to that point yt-dl has to fetch the JSON that lists that URL. What about https://github.com/ytdl-org/youtube-dl/issues/31512#issuecomment-1416514038?
I wonder what the tstc cookie means.

It seems I fixed this issue by replacing one of the arguments for al_video.php request. I replaced 'act': 'show_inline' with 'act': 'show' at 317 line of vk.py. After that, I was able to download the needed video, and I checked that it was working on a couple more. But it still doesn't work without cookies, and I couldn't understand why.
But I don't exactly understand what am I doing, so I wouldn't rather create a pull request.

OK, that rings a bell: try the patch at https://github.com/ytdl-org/youtube-dl/issues/31035#issuecomment-1161719063 !

Well, fixes in both last two comments work, but now mostly the same code returns a different error. I think reason for this error isn't related to vk.py but I also didn't found someone with the same error. I can close the issue if you think i need open new issue to fix this.
Code:
import youtube_dl

def get_video():
    video = 'https://vk.com/video/@pitbullmonster?z=video-60099869_456246720%2Fclub60099869%2Fpl_-60099869_-2'
    youtube_dl.YoutubeDL({'cookiefile': './cookies.txt', 'verbose': True}).download([video])

get_video()

Log with verbose:
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2021.12.17
[debug] Python version 3.10.6 (CPython) - Linux-6.0.12-76060006-generic-x86_64-with-glibc2.35
[debug] exe versions: ffmpeg 5.0.2, ffprobe 5.0.2
[debug] Proxy map: {}
[vk] -60099869_456246720: Downloading JSON metadata
[vk] -60099869_456246720: Downloading m3u8 information
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on 'https://vkvd183.mycdn.me/expires/1676501646457/srcIp/<IP_ADDRESS>/pr/40/srcAg/CHROME/ms/<IP_ADDRESS>/type/5/sig/AZMdHYOi0MU/ct/8/urls/<IP_ADDRESS>/clientType/13/id/1058544814656/video/'
[hlsnative] Downloading m3u8 manifest
[hlsnative] Total fragments: 1
[download] Destination: Уронил банку кваса--60099869_456246720.mp4
[download] 100% of 5.27MiB in 00:01
[debug] ffmpeg command line: ffprobe -show_streams 'file:Уронил банку кваса--60099869_456246720.mp4'
[ffmpeg] Fixing malformed AAC bitstream in "Уронил банку кваса--60099869_456246720.mp4"
[debug] ffmpeg command line: ffmpeg -y -loglevel repeat+info -i 'file:Уронил банку кваса--60099869_456246720.mp4' -c copy -f mp4 -bsf:a aac_adtstoasc 'file:Уронил банку кваса--60099869_456246720.temp.mp4'
[debug] ffmpeg version 5.0.2 Copyright (c) 2000-2022 the FFmpeg developers
  built with gcc 12.2.0 (GCC)
  configuration: --prefix=/usr --libdir=/usr/lib/x86_64-linux-gnu --disable-debug --disable-doc --disable-static --enable-optimizations --enable-shared --disable-everything --enable-ffplay --enable-ffprobe --enable-gnutls --enable-libaom --enable-libdav1d --enable-libfdk-aac --enable-libmp3lame --enable-libfontconfig --enable-libfreetype --enable-libopus --enable-libpulse --enable-libspeex --enable-libtheora --enable-libvorbis --enable-libvpx --enable-libwebp --enable-openal --enable-opengl --enable-sdl2 --enable-vulkan --enable-zlib --enable-libv4l2 --enable-libxcb --enable-vdpau --enable-vaapi --enable-encoder='ac3,alac,flac,libfdk_aac,g723_1,mp2,libmp3lame,libopus,libspeex,pcm_alaw,pcm_mulaw,pcm_f32le,pcm_s16be,pcm_s24be,pcm_s16le,pcm_s24le,pcm_s32le,pcm_u8,tta,libvorbis,wavpack,' --enable-encoder='ass,ffv1,libaom_av1,libvpx_vp8,libvpx_vp9,mjpeg_vaapi,rawvideo,theora,vp8_vaapi,libopenh264' --enable-decoder='adpcm_g722,alac,flac,g723_1,g729,libfdk_aac,libopus,libspeex,mp2,mp3,m4a,pcm_alaw,pcm_mulaw,pcm_f16le,pcm_f24le,pcm_f32be,pcm_f32le,pcm_f64be,pcm_f64le,pcm_s16be,pcm_s16be_planar,pcm_s24be,pcm_s16le,pcm_s16le_planar,pcm_s24le,pcm_s24le_planar,pcm_s32le,pcm_s32le_planar,pcm_s64be,pcm_s64le,pcm_s8,pcm_s8_planar,pcm_u8,pcm_u24be,pcm_u24le,pcm_u32be,pcm_u32le,tta,vorbis,wavpack,' --enable-decoder='ass,ffv1,mjpeg,mjpegb,libaom_av1,libdav1d,libvpx_vp8,libvpx_vp9,rawvideo,theora,vp8,vp9,libopenh264' --enable-encoder='bmp,gif,jpegls,png,tiff,webp,' --enable-decoder='bmp,gif,jpegls,png,tiff,webp,' --enable-hwaccel='vp8_vaapi,mjpeg_vaapi,' --enable-parser='aac,ac3,flac,mjpeg,mpegaudio,mpeg4video,opus,vp3,vp8,vp9,vorbis,' --enable-muxer='ac3,ass,flac,g722,gif,matroska,mp3,mpegvideo,rtp,ogg,opus,pcm_s16be,pcm_s16le,wav,webm,' --enable-demuxer='aac,ac3,ass,flac,g722,gif,image_jpeg_pipe,image_png_pipe,image_webp_pipe,matroska,mjpeg,mov,mp3,mpegvideo,ogg,pcm_mulaw,pcm_alaw,pcm_s16be,pcm_s16le,rtp,wav,' --enable-filter='crop,scale,overlay,amix,amerge,aresample,format,aformat,fps,transpose,pad,' --enable-indev='v4l2,xcbgrab,' --enable-protocol='crypto,file,pipe,rtp,srtp,rtsp,tcp,udp,unix,' --arch=x86_64 --enable-libopenh264
  libavutil      57. 17.100 / 57. 17.100
  libavcodec     59. 18.100 / 59. 18.100
  libavformat    59. 16.100 / 59. 16.100
  libavdevice    59.  4.100 / 59.  4.100
  libavfilter     8. 24.100 /  8. 24.100
  libswscale      6.  4.100 /  6.  4.100
  libswresample   4.  3.100 /  4.  3.100
Input #0, mpegts, from 'file:Уронил банку кваса--60099869_456246720.mp4':
  Duration: 00:00:08.33, start: 0.000000, bitrate: 5306 kb/s
  Program 1
    Metadata:
      service_name    : Service01
      service_provider: FFmpeg
  Stream #0:0[0x100]: Video: h264 (High) ([27][0][0][0] / 0x001B), yuv420p, 1080x1080, 30 fps, 30 tbr, 90k tbn
  Stream #0:1[0x101](und): Audio: aac ([15][0][0][0] / 0x000F), 44100 Hz, stereo, s16, 212 kb/s
[NULL @ 0x55ca692cbf00] Requested output format 'mp4' is not a suitable output format
ERROR: file:Уронил банку кваса--60099869_456246720.temp.mp4: Invalid argument
Traceback (most recent call last):
  File "/home/docryte/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/youtube_dl/YoutubeDL.py", line 2115, in post_process
    files_to_delete, info = pp.run(info)
  File "/home/docryte/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/youtube_dl/postprocessor/ffmpeg.py", line 593, in run
    self.run_ffmpeg(filename, temp_filename, options)
  File "/home/docryte/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/youtube_dl/postprocessor/ffmpeg.py", line 242, in run_ffmpeg
    self.run_ffmpeg_multiple_files([path], out_path, opts)
  File "/home/docryte/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/youtube_dl/postprocessor/ffmpeg.py", line 238, in run_ffmpeg_multiple_files
    raise FFmpegPostProcessorError(msg)
youtube_dl.postprocessor.ffmpeg.FFmpegPostProcessorError: file:Уронил банку кваса--60099869_456246720.temp.mp4: Invalid argument

Traceback (most recent call last):
  File "/home/docryte/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/youtube_dl/YoutubeDL.py", line 2115, in post_process
    files_to_delete, info = pp.run(info)
  File "/home/docryte/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/youtube_dl/postprocessor/ffmpeg.py", line 593, in run
    self.run_ffmpeg(filename, temp_filename, options)
  File "/home/docryte/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/youtube_dl/postprocessor/ffmpeg.py", line 242, in run_ffmpeg
    self.run_ffmpeg_multiple_files([path], out_path, opts)
  File "/home/docryte/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/youtube_dl/postprocessor/ffmpeg.py", line 238, in run_ffmpeg_multiple_files
    raise FFmpegPostProcessorError(msg)
youtube_dl.postprocessor.ffmpeg.FFmpegPostProcessorError: file:Уронил банку кваса--60099869_456246720.temp.mp4: Invalid argument

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/docryte/PycharmProjects/pythonProject/hueta.py", line 9, in <module>
    get_video()
  File "/home/docryte/PycharmProjects/pythonProject/hueta.py", line 6, in get_video
    youtube_dl.YoutubeDL({'cookiefile': './cookies.txt', 'verbose': True}).download([video])
  File "/home/docryte/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/youtube_dl/YoutubeDL.py", line 2068, in download
    res = self.extract_info(
  File "/home/docryte/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/youtube_dl/YoutubeDL.py", line 808, in extract_info
    return self.__extract_info(url, ie, download, extra_info, process)
  File "/home/docryte/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/youtube_dl/YoutubeDL.py", line 815, in wrapper
    return func(self, *args, **kwargs)
  File "/home/docryte/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/youtube_dl/YoutubeDL.py", line 847, in __extract_info
    return self.process_ie_result(ie_result, download, extra_info)
  File "/home/docryte/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/youtube_dl/YoutubeDL.py", line 881, in process_ie_result
    return self.process_video_result(ie_result, download=download)
  File "/home/docryte/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/youtube_dl/YoutubeDL.py", line 1692, in process_video_result
    self.process_info(new_info)
  File "/home/docryte/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/youtube_dl/YoutubeDL.py", line 2050, in process_info
    self.post_process(filename, info_dict)
  File "/home/docryte/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/youtube_dl/YoutubeDL.py", line 2117, in post_process
    self.report_error(e.msg)
  File "/home/docryte/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/youtube_dl/YoutubeDL.py", line 628, in report_error
    self.trouble(error_message, tb)
  File "/home/docryte/PycharmProjects/pythonProject/venv/lib/python3.10/site-packages/youtube_dl/YoutubeDL.py", line 598, in trouble
    raise DownloadError(message, exc_info)
youtube_dl.utils.DownloadError: ERROR: file:Уронил банку кваса--60099869_456246720.temp.mp4: Invalid argument

Process finished with exit code 1

Will be fixed by back-port of newly updated yt-dlp extractor:
$ python -m youtube_dl -v -F 'https://vk.com/video/@pitbullmonster?z=video-60099869_456246720%2Fclub60099869%2Fpl_-60099869_-2'
[debug] System config: [u'--prefer-ffmpeg']
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'-F', u'https://vk.com/video/@pitbullmonster?z=video-60099869_456246720%2Fclub60099869%2Fpl_-60099869_-2']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2021.12.17
[debug] Git HEAD: dd9aa74be
[debug] Python version 2.7.18 (CPython) - Linux-4.4.0-210-generic-i686-with-Ubuntu-16.04-xenial
[debug] exe versions: avconv 4.3, avprobe 4.3, ffmpeg 4.3, ffprobe 4.3
[debug] Proxy map: {}
[vk] -60099869_456246720: Downloading JSON metadata
[vk] -60099869_456246720: Downloading m3u8 information
[info] Available formats for -60099869_456246720:
format code  extension      resolution note
url240       unknown_video  240p
url360       unknown_video  360p
url480       unknown_video  480p
url720       unknown_video  720p
url1080      unknown_video  1080p
hls-222      mp4            144x144     222k , 30.0fps
hls-450      mp4            240x240     450k , 30.0fps
hls-899      mp4            360x360     899k , 30.0fps
hls-1495     mp4            480x480    1495k , 30.0fps
hls-3090     mp4            720x720    3090k , 30.0fps
hls-5306     mp4            1080x1080  5306k , 30.0fps (best)
$


about GPU memory when training

hello @yysijie @yjxiong  , I am sorry to bother you again. as a beginner, I am not familiar with Pytorch, when i was training ,the GPU memory used 2697MiB, and if the epoch=1,2,3....is the same. But in this moring ,when the epoch=9, the GPU memory used 2845MiB.I want know the reason about it. I guess that in the file, we saved weighs every 10 epoch caused increaseing memory, an i right??? and if when the epoch=11,12,.....,  ,the GPU memory using is 2697MiB or still increaseing until finish training???
thanks again, i am looking for your reply

Hi, @yanqian123,
Thank you for your interest in our works.
The reason is that an extra batch for evaluation will be sampled every 10 epochs.


Grunt task to generate a zip file containing the built app files for easy download

A substantial portion of make8bitart's audience is non-technical (which is probably a good thing) and as @jennschiffer once said "Your Grandparents Probably Didn't Have Node". To accommodate these users better, I propose that a grunt task be added that will automate the creation of a zip file, which contains the necessary application files, that can be committed to the repo and made available for download via a link directly from the readme.

I just watched that talk and stumbled over here as well.
Rather than a zip file (as she mentions some don't know how to unzip), why not just generate a single HTML file with inlined files?
If one uses webpack, the JS file can require the CSS and images and inline them. And combined with html-webpack-plugin, you can even inject that resulting JS directly into a template HTML file to generate a final production standalone HTML file.
Or at what point does it become overengineered, when https://make8bitart.com/ already exists? :)


Why take two batches as input

Hello, I have some problems in reading and understanding the code.

First, why two batches need to be taken from a data set？
Second , the two batch form the same data set are different or same ?
Hope to your answer, thanks.

the same problem @caozhangjie

because the input is pair-wise

because the input is pair-wise

But, why do you choose read the pair-wise image from two different batch, in one batch, for example, batch_size = 64,  image[i] can be organized to pair-wise with other 63 image[j], j != i.

I just did an experiment to change the code of train.py and loss.py as follows:
train.py:

loss.py:

The result is a litter better than the original version, which means the codes can be simplified by only one input branch.

Thank you very much !


Add Not Applicable as valid value for Days to Recurrence and Processing Days from Index

Changes requested by SRRS center
Attribute to Validate
Specify the attribute that you would like validation rules to apply to
Data Type: SRRS Clinical Data Tier 2
Attribute: Days to Recurrence
Data Type: SRRS Biospecimen
Attribute: Processing Days from Index
Validation Rule
Related to https://github.com/ncihtan/data-models/issues/85
Update validation rule to regex with either INT or “not applicable” (Leaning toward this approach). Adam notes that "/^\d+|Not Applicable/" should work.
How important is this validation? Select from the options below:
• Important - it's a blocker and can't do work without it
When will use cases depending on this become relevant? Select from the options below:
• Short-term - 2-4 weeks
Additional context
Add any other context or screenshots about the validation rule here.

FYI @aclayton555. We may need to move this into our current sprint to deliver to SRRS.
@clarisse-lau is this blocking SRRS at the moment?

Thanks @adamjtaylor
It does appear to be blocking their submission. There are workarounds we can suggest if need be, but implementing these rules would be preferable.

I think it's okay to prioritize this in our current sprint. @elv-sb is this one you could tackle?

This should now be in staging @clarisse-lau


[stable/fluent-bit] Fix ElasticSearch Output config templatate

The most important part of this PR is the fix for the ES config which was broken because it was cut off by the Splunk config.
It also adds the tls options to the http and fluentd output plugin as well as a shared_secret option to the fluentd forwarder output plugin. Also http_user/password options are added to the http backend. All options have backwards compatible defauts.
Signed-off-by: Thorsten Kunz<EMAIL_ADDRESS>

I originally was using #7632 for support of Elasticsearch, but since I now have to support both ES and Splunk, this current PR #8166 has passed tests in on both my EKS clusters sending to both platforms.  Giving the thumbs up on this and removing support for #7632 since it doesn't work for Splunk and is currently stale.

cc: @kfox1111

@edsiper we now how 3 separate pr's trying to fix this issue due to lack of reviews :/ I'm not an approver so I can't do much to fix it. I'll try and ping the cores again.

@kfox1111 @edsiper Any luck finding anyone who can approve the PR?

crickets. :(
Someone suggested trying to get a hold of someone at the next call.
Either way, doesn't seem like a good sign as to the health of the charts community. :(

@davidkarlsen Any chance you could take a look at this PR to get it moving forward?

@ThorstenKunz Do you have a chance to resolve the conflicts or give me access to do it? Other PRs went in a lot faster than this one it seems.

@mwl I fixed the conflict. Hope the PR will get in before the Chart version gets updated by somebody else and cause the next conflict ;)

@ThorstenKunz Appreciated! I'm working on getting this merged.

/ok-to-test

/lgtm


Publish to NPM

This repo was uploaded today(12/18/18). We need to publish all these packages except for fhir-sanitize-param by 12/20/18.

DONE !!!


Add experimental exportTrailingSlash config

Add exportTrailingSlash to experimental config with a default of true. When enabled it adds a trailing slash to links when exported

Added a test with the option disabled


Write e-Translation documentation

NIF compatible
ITS 2.0 category support
Optional domain specificity
Usage of different publicly available or private translation systems

Appending new section to tutorial:
http://api-dev.freme-project.eu/doc/tutorials/translate_EN-NL_including_terminology.html


Avoid word "observation bin"?

@nicolasvanermen can you clarify "observation bin"? Do we need to include this term and if so, how do I include it in the position description?

The observation bin is the trajectory sailed between time A & B, between point X & Y. It is (generally) defined by the coordinate of the middle point between point X & Y. All observations done on this trajectory are linked to this position, and was therefore named 'an observation bin'. No inspiration for suitable alternatives though.

I have rephrased the position table definition to:

Positions during sampling. Since the platform moves during sampling, these positions often represent the calculated middle point of a trajectory. These trajectories (called "observation bins") typically have predefined durations (e.g. 2 minutes).

Additional question: is the time then the starttime of the trajectory?

Perfect! Yes time is expected to be the start time of the trajectory...
Nicolas Vanermen
Wetenschappelijk medewerker
Instituut voor Natuur- en Bosonderzoek
Havenlaan 88, bus 73, 1000 Brussel
0486/361.582
On Thu, Apr 29, 2021 at 4:53 PM Peter Desmet @.***>
wrote:

I have rephrased the position table definition to:
Positions during sampling. Since the platform moves during sampling, these
positions often represent the calculated middle point of a trajectory.
These trajectories (called "observation bins") typically have predefined
durations (e.g. 2 minutes).
Additional question: is the time then the starttime of the trajectory?
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
https://github.com/ices-tools-dev/esas/issues/58#issuecomment-829305360,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABYKGXIKLTEMUAKFFCOHEKDTLFXG5ANCNFSM43S732NQ
.

Ok, I have updated the definition for time from:

UTC time of the observation bin. Format: hh:mm:ss.

To:

Sampling (start) time at the position, in UTC. Format: hh:mm:ss.

Suggestion:
UTC time of the observation bin, defined as the start time of the
trajectory.  Format: hh:mm:ss
Nicolas Vanermen
Wetenschappelijk medewerker
Instituut voor Natuur- en Bosonderzoek
Havenlaan 88, bus 73, 1000 Brussel
0486/361.582
On Tue, May 4, 2021 at 12:15 PM Peter Desmet @.***>
wrote:

Ok, I have updated the definition for time from:
UTC time of the observation bin. Format: hh:mm:ss.
To:
Sampling (start) time at the position, in UTC. Format: hh:mm:ss.
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
https://github.com/ices-tools-dev/esas/issues/58#issuecomment-831832901,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABYKGXMFOPF7UYSGNPYQ4FDTL7CL3ANCNFSM43S732NQ
.

Ok, can do. Just wanted to avoid the word observation bin.

This is nonetheless used several times in the positions table?
Nicolas Vanermen
Wetenschappelijk medewerker
Instituut voor Natuur- en Bosonderzoek
Havenlaan 88, bus 73, 1000 Brussel
0486/361.582
On Tue, May 4, 2021 at 12:22 PM Peter Desmet @.***>
wrote:

Ok, can do. Just wanted to avoid the word observation bin.
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
https://github.com/ices-tools-dev/esas/issues/58#issuecomment-831836865,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABYKGXLL3IFBOKQUK53ZG5DTL7DFZANCNFSM43S732NQ
.

You're right. Updated: https://github.com/ices-tools-dev/esas/commit/65f9c9474ae4784261e5cb36a65f4392154074a4


Add support for Metric or Imperial

Allow for configuring Metric or Imperial and automatically respond to sensors if they inquire.

@bpair Thank you for the feature request.
Right now MyController responds to sensors as 'Metric' https://github.com/mycontroller-org/mycontroller/blob/master/src/main/java/org/mycontroller/standalone/AppProperties.java#L140
I will add it in system settings, so user can select "Metric" or "Imperial". But the selection should be common for all the sensors.


Define colors

To be able to add colors to the game to make it more lively, we need to define the colors

OK. The original pong wasn't very colorful, to tell the truth. But, defining colors is a good idea. We can always make pong in 2017 more colorful. :)

Okay, I'll work on it

Good.

I have merged. Can we close?

+1


Create canvases for calm and reliable culture setting

This is part of the onboarding volunteers ticket right?

This is part of the onboarding volunteers ticket right?

I think probably we all need to explore them and figure out what works. So, yes, but also let's all build some.
To this end, I've encouraged the Proms to build some and built some example ones for them to look at. I've also made them in Tech Ed and Portfolios channels.
For Tech Ed, probably getting the Code Review channel together is the next priority.


[TOML Configus] TenantDomainDropDownEnabled in application-authentication.xml

Please provide the corresponding TOML configs for the TenantDomainDropDownEnabled in <IS_HOME>/repository/conf/identity/application-authentication.xml.
Sample config:
<TenantDomainDropDownEnabled>true</TenantDomainDropDownEnabled>
        <TenantDataListenerURLs>
            <TenantDataListenerURL>
                /authenticationendpoint/tenantlistrefresher.do
            </TenantDataListenerURL>
        </TenantDataListenerURLs>

ref: https://docs.wso2.com/display/IS580/Customizing+the+Authentication+Endpoint

This issue is being closed due to extended inactivity. Please feel free to reopen it if further attention is needed. Thank you for helping us keep the issue list relevant and focused!


Ensure that committed Jupyter notebooks contain no outputs

This is not an issuse but perhaps an idea for a feature if it is not out of scope for nbQA
If one wants to commit a Jupyter notebook to a repository they want to ensure correct styling using pre-commit hooks. However, they might also want to commit without the outputs of the notebook.
Currently one would need to include an additional repo in the pre-commit.yaml alongside nbQA. For simplicity would it make sense to include such cleaning in nbQA, ensuring a high quality of the jupyter notebooks? Perhaps something as in gitlab.com/iamlikeme/nbhooks

thanks for the suggestion, but isn't this exactly what nbstripout does?

isn't this exactly what nbstripout does?

Yes, you are right.
Perhaps there is a way for integrating nbstripout without duplicating the work. I am not sure if they'd support something like that.

closing then as out-of-scope


Error while trying the first "Multiples Exchange/ One Currency" example

   exchanges = [getattr(ccxt, exchange_id)() for exchange_id in exchanges]
AttributeError: module 'ccxt.async_support' has no attribute '/'

same for me, like below

opportunity = asyncio.get_event_loop().run_until_complete(get_opportunity_for_market("BTC/USD", collections_dir))
Traceback (most recent call last):
File "", line 1, in
File "/home/justin/anaconda3/envs/peregrine/lib/python3.7/asyncio/base_events.py", line 587, in run_until_complete
return future.result()
File "/mnt/f/projects/peregrine/peregrinearb/async_find_opportunities.py", line 324, in get_opportunity_for_market
finder = OpportunityFinder(ticker, exchanges=exchanges, name=name)
File "/mnt/f/projects/peregrine/peregrinearb/async_find_opportunities.py", line 52, in init
exchanges = [getattr(ccxt, exchange_id)() for exchange_id in exchanges]
File "/mnt/f/projects/peregrine/peregrinearb/async_find_opportunities.py", line 52, in
exchanges = [getattr(ccxt, exchange_id)() for exchange_id in exchanges]
AttributeError: module 'ccxt.async_support' has no attribute '/'

my pip list is below
Package           Version

aiodns            2.0.0
aiohttp           3.7.4
async-timeout     3.0.1
attrs             20.3.0
ccxt              1.42.38
certifi           2020.12.5
cffi              1.14.5
chardet           3.0.4
cryptography      3.4.6
decorator         4.4.2
idna              2.10
multidict         5.1.0
networkx          2.5
peregrinearb      1.8.0
pip               21.0.1
pycares           3.1.1
pycparser         2.20
requests          2.25.1
setuptools        52.0.0.post20210125
six               1.15.0
typing-extensions <IP_ADDRESS>
urllib3           1.26.3
wheel             0.36.2
yarl              1.1.0

Any updates on the above issue? I am facing the same error too

Is this entire project dead?  17 months since the latest update, the very first example in the ReadMe is failing and no response to requests for help, and this, and no response either.  Would love to use this, but nervous about starting a large project with something already broken and abandoned, if anyone is still driving this, please respond.

For anyone interested, here is the actual problem... in the example code provided are these two lines...
collections_dir = '/Users/wardbradt/cs/peregrine/'
opportunity = asyncio.get_event_loop().run_until_complete(get_opportunity_for_market("BTC/USD", collections_dir))
as you can see, collections_dir is set to a literal string representation of some directory that of course will not exist on your machine.  Then, that literal string is passed into the call for setting opportunity.
I am guessing the intent was to look into that directory, and find all of the exchanges you want to look through... but that literal string is never actually treated as a directory (which, again, even if it were, would not exist on anyones machine except the authors) and it is never searched for exchanges.  Instead, it is parsed character by character as a string by downstream code, and since the first character is "/", that is where the error is originating.
I am done troubleshooting this... it is obviously broken and abandoned.  If anyone pulls the string further and actually fixes it, please post the fix here, as I would still like to get it up and running, but I have to be realistic.

... so, I couldn't help myself...
  So I simply changed the demo code to not supply a value at all.  But this still crashes, just differently.  That call crawls inside a tangled web of asynchrounous non-sense (I despise asynchronous code, especially when the very next step depends on it's completion, thereby rendering the entire point moot...).  Where it then crashes is in trying to iterate a coroutine, rather than iterating that coroutine's results.  Obviously, something in the async/await chain is busted, and NOW I am totally done with this because it is too needlessly complicated, AND broken, AND abandoned.
Such a pity... we had such high hopes for you...
@wardbradt ???

Why was my last post with the deeper analysis removed?  and who removed it?

Is this entire project dead? 17 months since the latest update, the very first example in the ReadMe is failing and no response to requests for help, and this, and no response either. Would love to use this, but nervous about starting a large project with something already broken and abandoned, if anyone is still driving this, please respond.

At the moment, I am not actively maintaining this project. I will respond to some issues and review pull requests, but I am not currently working on code to contribute to its upkeep. There are some issues with the original implementation that have yet to be fixed, namely with regards to data directories and the use of async. @SzQaNinja

@SzQaNinja Outside of my full-time job, I devote my personal coding time to a proprietary arbitrage/ MEV bot. Although I would like for the Peregrine project to be kept up-to-date, I have little time to contribute to it.


Can we save some functions calls by not calling guess function for stations they already correctly guessed?

If they've already guessed a station we should maybe optimize our use of functions by checking if they already got it before calling the /api/guess function.  This is a nice to have.

Could do this by having the backend return all possible matches when they get the station name correct then using those as guards to not call the backend again if needed.  This is a low priority nominal improvement enhancement.


Bundle Onyx with Webpack

Details

Bundle Onyx with Webpack to allow using Onyx outside of react-native
Using a test project with the follow package.json config

package.json
{
  "name": "test-onyx",
  "version": "0.1.0",
  "private": true,
  "dependencies": {
    "@testing-library/jest-dom": "^5.16.4",
    "@testing-library/react": "^13.2.0",
    "@testing-library/user-event": "^13.5.0",
    "expensify-common": "git+https://github.com/Expensify/expensify-common.git#2e5cff552cf132da90a3fb9756e6b4fb6ae7b40c",
    "localforage": "^1.10.0",
    "react": "^18.1.0",
    "react-dom": "^18.1.0",
    "react-native-onyx": "git+https://github.com/kidroca/react-native-onyx.git#11dc5443e4d6e7cac3a967344996466bb26966c8",
    "react-scripts": "5.0.1",
    "web-vitals": "^2.1.4"
  },
  "scripts": {
    "start": "react-scripts start"
  },
  "eslintConfig": {
    "extends": [
      "react-app",
      "react-app/jest"
    ]
  }
}

We can import and use Onyx like so:
import Onyx from 'react-native-onyx/web';

// ...

Onyx.init({
    keys: { session: 'session' },
    safeEvictionKeys: ['actions'],
    keysToDisableSyncEvents: [],
    captureMetrics: false,
});

Onyx.merge('session', { loggedIn: true });

And continue using the old import for react-native
import Onyx from 'react-native-onyx';

These shorthand import paths (vs react-native-onyx/dist/index.web.js) are possible by using package.json's exports field
Specifying more packages in extrenals is necessary to reduce duplicate versions of common packages like lodash and underscore otherwise they are bundled inside Onyx
Specifying expensify-common under peer dependencies ensures both Expnesify/App and Expnsify/react-native-onyx use the same expensify-common version (the one from App)
Additional information on the changes: https://github.com/Expensify/react-native-onyx/pull/132#issuecomment-1128880760
Related Issues

Slack thread: https://expensify.slack.com/archives/C01GTK53T8Q/p1652389473489429
Automated Tests

No new functionality added
Existing tests are still pass
Linked PRs

cc @tgolen

✅ Fixed unit tests
This was a bit tricky to tackle. It turned out that since we're using react-native preset for jest, jest was configured to resolve .native.js extensions like index.native.js and it would prefer them over plain index.js, so the mock for Storage wasn't getting picked up
✅ Fixed eslint errors
Similar problems with letting eslint know that there's no storage/index.js but storage/index.native.js and storage/index.web.js
Also ignored the dist directory since it's minified code
✅ Configured exports correctly
Looks like it's preferable to specify paths as ./dist/index... instead of just dist/index... so that IDEs don't complain

An IDE complaining the path react-native-onyx/web is not installed
✅ Added production grade source maps
These help with stack traces and debugging Onyx sources through parent projects
Now that the code is minified we need these to trace calls like Onyx.merge from App
✅ Added script that generates typescript typings
Again since code is now bundled a the information about method signature cannot be resolved like it used to
In order to let IDEs continue to provide code completion we need to provide static typing of the library

Code completion is suggested for both react-native-onyx and react-native-onyx/web
✅ Verified all envs and entry points work in App and for new projects using Onyx
The package.json structure and exports/main are correctly resolved in

webpack (web/desktop)
metro (ios/android)

@kidroca When testing this with the web-only import... I'm getting the following webpack error:

This is what my import looks like:
import {withOnyx} from 'react-native-onyx/web';

It appears that the code is working, so I'm not sure what this error message means or is referring to. Google seemed equally confused.

Actually, I was wrong about the code not working (must have been the old version of code). This is the JS console error I get:

@kidroca When testing this with the web-only import... I'm getting the following webpack error:

Hmm could it be because I added back . to exports? or because of the order of the imports
I'll give it another test in a web only project

Regarding the "Error: Default condition should be last one"
looks like the default condition for exports should be the last one, like so
"exports": {
    ".": {
      "require": "./dist/revue-draggable.cjs.js",
      "default": "./dist/revue-draggable.es.js"
    },

I've recreated the error, looks like it wasn't a problem in App, but it was for the /web import
Moving the default declarations to the bottom resolved the Error and the module is found

Removed .d.ts.map files
Will experiment with the .development.js idea and post back

Removing myself as a reviewer as I don't have much experience with webpack thing and we have got a good amount of helping hands. Thanks.

Hey @tgolen, while writing the documentation I was testing stuff and found out how to get rid of the .d.ts files, and also use the unmodified source for Onyx for react-native projects
Now the native source doesn't have to be bundled, which allows us to tweak it (experiment) from parent projects
Another change is we no longer have to import react-native-onyx/web for web projects, package.json has the following fields

react-native - react native cli would load package source from whatever path is added here
main - IDEs and other tools would load source from here (in our case it provides code completion for IDEs)
browser - bundlers like Webpack would prefer to load code from here

Using the browser field, bundlers would load the source from dist/web
Sorry for the new changes, but I think this makes the setup simpler and closer to what we previously had for react-native
(I've triple tested these changes, but would be happy if someone else confirms the changes are good)

I agree with you that the only real reason it's helpful is for messing with
Onyx code directly (strictly a time-saver). I don't think we need to spend
too much time trying to provide that functionality, but I'm curious about
the development.js idea and see how that works.
On Wed, May 18, 2022 at 10:01 AM Peter Velkov @.***>
wrote:

Removed .d.ts.map files
Will experiment with the .development.js idea and post back
—
Reply to this email directly, view it on GitHub
https://github.com/Expensify/react-native-onyx/pull/132#issuecomment-1130204404,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAJMABZX7WF2IQWFJRJ5Z7DVKUH4PANCNFSM5WCHB3FA
.
You are receiving this because you were mentioned.Message ID:
@.***>

I'm curious about the development.js idea and see how that works.

Right now for web we directly return the minified code from dist/
What we can do is add a new index script - web.js and load that instead
Inside web.js would be a NODE_ENV check and depending on the value we load the minified code or the non minified code
Dev servers are running with NODE_ENV=development, while builds are configured for production
One thing to note is that we still load bundled code, so live changes to source code would still not be reflected - to make changes to Onyx live you'd have to modify the non-minified code from dist/ (which is still a lot easier compared to dealing with minified code)

If we want to save time on testing new thing in Onyx, perhaps we can make a script in App that

cd to node_modules/react-native-onyx
runs webpack in watch mode so any changes to lib are rebuild and sent to dist
now make changes to node_modules/react-native-onyx/lib source and see them live in web/desktop

So strange. I wrote that reply months ago and it only now posted to GH.
I do still think it's a problem worth fixing to make development on Onyx source code easier. We've been making a lot of performance changes, so it's been in active development lately.
I like your second idea since that would allow us to edit the source code directly. Could we try that?

I think maybe we should open a new GH issue for that

@tgolen

I like your second idea since that would allow us to edit the source code directly. Could we try that?
I think maybe we should open a new GH issue for that

Yep, we have almost everything in place, we just need to:

Add a watch script in Onyx, that runs webpack in watch mode
Add a test-onyx script in App. It goes to Onyx folder and install devDependencies so we can build and re-build the app with the build command (no-op if they are already installed), then trigger the watch script

@kidroca @tgolen @parasharrajat just FYI, it looks like this PR likely caused this bug: https://github.com/Expensify/App/issues/10622

Do you mean this PR specifically, or is there another? There are multiple attached to that issue.

@puneetlath
This PR caused the web part of the bug, because we forgot to test capturing metrics after the change

capturing metrics on web was not supposed to work after the change, so we didn't test setting the flag ONYX_METRICS: true
capturing metrics on native continued to work until the introduction of Onyx.update method

The Android issue was because of the introduction of the Onyx.update method which (at the time) didn't return Promise but was added to the list of decorated methods (activated by env flag)
https://github.com/Expensify/react-native-onyx/pull/133/files#diff-146c57cda221f8f5ee5c808eee0c6692b02c4ac2b8818d0104896a04be78e78aR917
Initially decorateWithMetrics was implemented to be able to decorate any func - promise returning or not, but the code was slightly more complicated and I was asked to make it work only for promise returning (async) functions in order to simplify
I guess we should have added documentation about only working with async function to

the place where we decorate all the Onyx (async) functions
and on decorateWithMetrics function description

Ok good learnings! Anything we should do now?

We can update method documentation and comments to mention that only Promise returning methods can be decorated
We can update Onyx metrics to work on Web - we only disabled them so that Onyx can be used in other non react-native projects, because it caused issues with bundling - instead of applying a working around - disabling metrics for web (via a no-op web file), we can fix bundling


Change Ripple Background Runtime

Hi @aritraroy
it is possible to change the color of ripple effect on click at run time, if yes then how? please help to solve this issue.
**XML UI Like : **
  <com.andrognito.pinlockview.PinLockView             android:id="@+id/pin_lock_view"             android:layout_width="fill_parent"             android:layout_height="wrap_content"             android:layout_below="@+id/indicator_dots"             android:layout_centerHorizontal="true"             android:layout_margin="16dp"             app:keypadButtonSize="72dp"             app:keypadDeleteButtonDrawable="@drawable/ic_backspace"             app:keypadDeleteButtonSize="30dp"             app:keypadShowDeleteButton="true"             app:keypadTextColor="@color/white"             app:keypadTextSize="26dp" />
Thanks.

Currently the library used default system ripple, so it is not possible to change the color of the ripple dynamically. But this feature can be added if really necessary.


[live] ancestry mismatch

observation:

SCV1 was running alone for a while and produced sidechain blocks.
Then we started SCV2, provisioning worked as expected and SCV2 started producing blocks
SCV1 stopped producing blocks and logs:

[2023-12-18T10:32:24Z ERROR enclave_runtime::error] Returning error Consensus(BlockAncestryMismatch(40285, 0x13439b4b4ffea6ead7e76d7178e935c5aa495d5fd381c14aaceab19fb589756e, "Parent hash does not match")) as sgx unexpected.
[2023-12-18T10:32:24Z ERROR integritee_service::sidechain_setup] Sgx(SGX_ERROR_UNEXPECTED)

onchain, the last attemt of SCV to confirmSidechainBlockImport was:

strange: only the primary SCV (first entry in ShardStatus)  should be able to confirm sidechain blocks:
enclaveBridge.shardStatus: Option<Vec>
[
  {
    signer: 2MuXrbdAgimHFEPwU43a2xAYX34oWpB42ZUJwbA2gA68Bknr
    fingerprint: 0x136fc869ddff3333b28dfc1374150890c548799c87c928cd5841508b287f972d
    lastActivity: 3,702,336
  }
  {
    signer: 2Meaw9Gw2HSJRGJVdNjL13rDTQ5r8sgN5mx7fX2fJWynD1jL
    fingerprint: 0x136fc869ddff3333b28dfc1374150890c548799c87c928cd5841508b287f972d
    lastActivity: 3,702,416
  }
]

Aha: SCV2 is actually ignored but Success, while SCV1 is rejected not because of SCCV2's attempt, but because the the onchain expected candiate got outdated:

deployed release: v0.12.7-dev2

this is a fork:
[SCV1]:Claiming slot<PHONE_NUMBER>)
[SCV1]:Enclave produced sidechain blocks: [40275]
[SCV1]:Claiming slot<PHONE_NUMBER>)
[SCV1]:Enclave produced sidechain blocks: [40276]
[SCV2]: Enclave produced sidechain blocks: [40277]
[SCV1]:Claiming slot<PHONE_NUMBER>)
[SCV1]:Enclave produced sidechain blocks: [40278]
[SCV2]: Enclave produced sidechain blocks: [40279]
[SCV1]:Claiming slot<PHONE_NUMBER>)
[SCV1]:Enclave produced sidechain blocks: [40280]
[SCV2]: Enclave produced sidechain blocks: [40281] (confirmed on L1 by SCV2)
[SCV1]:Claiming slot<PHONE_NUMBER>)
[SCV1]:Enclave produced sidechain blocks: [40282]
[SCV2]: Enclave produced sidechain blocks: [40283]
[SCV1]:Claiming slot<PHONE_NUMBER>)
[SCV1]:Enclave produced sidechain blocks: [40284]
[SCV2]: Claiming slot<PHONE_NUMBER>)
[SCV2]: Enclave produced sidechain blocks: [40285] at [2023-12-18T10:32:21Z
[SCV2]:  Successfully imported broadcast sidechain block (number: 40285, author: (SCV2) 0x97048505b0502de1340da1615d52ca063c57948cc30631b4e2af60f5ede9949c), based on parentchain block 3702333
[SCV1] Claiming slot<PHONE_NUMBER>) (last claim of SCV1)
[SCV1]: Enclave produced sidechain blocks: [40285]
[SCV1]: Successfully imported broadcast sidechain block (number: 40285, author: (SCV1) 0xa26ad684039c978b68957f3f42ac0d9dadd6ba5b132d30c9b14b87eea0677fa8), based on parentchain block 3702333
[SCV1]: [2023-12-18T10:32:23Z TRACE enclave_runtime] [Integritee] Dispatching Import of 1 blocks and 1 events
[SCV1]: [2023-12-18T10:32:23Z INFO  integritee_service::parentchain_handler] [Integritee] Synced 3702334 out of 3702334 finalized parentchain blocks
[SCV2]: Claiming slot<PHONE_NUMBER>)
[SCV2]: Enclave produced sidechain blocks: [40286]
[SCV1]: Add block 40286 to import queue
[SCV1]: Got ancestry mismatch error upon block import. Attempting to fetch missing blocks from peer
[SCV1]: Initiating fetch blocks from peer, last imported block hash: 0x13439b4b4ffea6ead7e76d7178e935c5aa495d5fd381c14aaceab19fb589756e, until block hash: 0x3ca96e8d6e426b243e38dd96b896dc1abd061bc193360b93fd7ba4e4bcc331a4
[SCV1]: [2023-12-18T10:32:24Z ERROR enclave_runtime::error] Returning error Consensus(BlockAncestryMismatch(40285, 0x13439b4b4ffea6ead7e76d7178e935c5aa495d5fd381c14aaceab19fb589756e, "Parent hash does not match")) as sgx unexpected.
[SCV1]: [2023-12-18T10:32:24Z ERROR integritee_service::sidechain_setup] Sgx(SGX_ERROR_UNEXPECTED)
[SCV2]: Claiming slot<PHONE_NUMBER>)
[SCV2]: Enclave produced sidechain blocks: [40287]
[SCV2]: Claiming slot<PHONE_NUMBER>)
[SCV2]: Enclave produced sidechain blocks: [40288]
full logs of both SCV:
sidechain-rococo-1-0-0-ancestry.log
sidechain-rococo-2-0-0-ancestry.log

strange:
shutting down SCV2 lets SCV1 recover:
sidechain-rococo-1-0-0-ancestry-recover.log

funny: SCV1 recovers if I shut down SCV2
clean reset of SCV2 synced nicely this time and they produced blocks together since...

forked again after ~1h

get_untrusted_peer_url_of_shard always returns primary worker. Therefore, if the primary encounters a mismatch and tries to fetch from peers, it will try to fetch from self - with no succes - leading to Ancestry mismatch, even if a good block would be left in the queue

moreover, the current logic in block_import_queue_worker assumes that blocks are in order in the queue and that all blocks are valid - or if not fetching from peers - which may not be necessary because correct blocks are left in the queue


Github actions for Mobile repo

GitHub actions & CI/CD for folder /JoyboyCommunity.

Start implementing Github actions
CI/CD check for React-native with Expo

If you can, please update the mobile README for what you do on the Mobile folder.
#45  Build error on Android, I don't get logs for this error crash on Expo GO for Android, and I can't debug easily.

Hey, I can take this up. Can set up the ci cd pipeline and will check the error issue

Hey can I work on this

Hey, I can take this up. Can set up the ci cd pipeline and will check the error issue

Hey,  thank you for the reply! I can assign you to this issue.
Are you available on the Telegram too ?
Here is the link: https://t.me/JoyboyStarknet

Hey can I work on this

Hey; this issue is assigned sorry, but we have others issues on mobile too, check the mobile labels!
Few others are gonna be created soon.
Contributors definitely welcome.
Btw, are you available on the Telegram?
Here is the link: https://t.me/JoyboyStarknet

@MSghais i would be interested in front-end issues if there are or would be in the future


Update vendoring + fix issue with timestamps being added to log

As per the vendoring here:
https://github.com/kubernetes-incubator/kompose/commit/e9544ca89477ed76bd75f1160f9a89686f75e95d
for some odd issue, text_formatter.go in the logrus package was updated
to an older file.
This commit updates the vendoring as well as specifies a specific
version for logrus to be used.

Closes #529

Thanks Charlie! This commit looks good to me in terms of /vendor/golang.org/x/sys update and should fix issue#532

@cdrage, do you have any comprehensive tests you can run?

@cdrage can you add that this fixes #532 to the commit comment?
also I have a question, if we are updating a lot of different things then I think we might need a new release of kompose in order to put it out. would rather not pull back a patch if its going to be a large change.

@dustymabe No comprehensive tests are being run right now, we're working on adding more integration tests. But unit tests + cmd tests are the only ones being ran at the moment.
Yup. We can do another release on Monday!

sounds good. once you commit PR we can have @surajssd build an rpm from this commit (don't need a release yet) and I can run it through the fedora build system to verify everything works on ppc before you do a release.

I've confirmed that this commit works and we've gotten a LGTM.
Let's merge this!


Support subtitles, and longer titles

OpenSSH 7.3 supports longer titles (ED25519 256) and subtitles (SHA256).

Thanks, looks good. I'd prefer keeping the Generate signature as is, to avoid breaking everyone's builds, and adding a GenerateSubtitled function for example. The Generate function can just be a convenience wrapper.

Fixed!

Thanks!


Remove volumes after containers in pod remove

When trying to reproduce #4704 I noticed that the named volumes from the Postgres containers in the reproducer weren't being removed by podman pod rm -f saying that the container they were attached to was still in use. This was rather odd, considering they were only in use by one container, and that container was in the process of being removed with the pod.
After a bit of tracing, I realized that the cause is the ordering of container removal when we remove a pod. Normally, it's done in removeContainer() before volume removal (which is the last thing in that function). However, when we are removing a pod, we remove containers all at once, after removeContainer has already finished - meaning the container still exists when we try to remove its volumes, and thus the volume can't be removed.
Solution: collect a list of all named volumes in use by the pod, and remove them all at once after every container in the pod is gone. This ensures that there are no dependency issues.

CI is green. Github, however, is complaining that commits are not signed, even though they are? Little confusing.

I fixed the github issue.
LGTM
@giuseppe @haircommander @saschagrunert @nalind @TomSweeneyRedHat PTAL

LGTM

/lgtm

/retest


fix helm charts yaml style

(If this PR fixes a github issue, please add Fixes #<xyz>.)
Fixes #
(or if this PR is one task of a github issue, please add Master Issue: #<xyz> to link to the master issue.)
Master Issue: #
Motivation
Explain here the context, and why you're making that change. What is the problem you're trying to solve.
Modifications
Describe the modifications you've done.
Verifying this change

[ ] Make sure that the change passes the CI checks.

(Please pick either of the following options)
This change is a trivial rework / code cleanup without any test coverage.
(or)
This change is already covered by existing tests, such as (please describe tests).
(or)
This change added tests and can be verified as follows:
(example:)

Added integration tests for end-to-end deployment with large payloads (10MB)
Extended integration test for recovery after broker failure

Documentation
Check the box below.
Need to update docs?

[ ] doc-required
(If you need help on updating docs, create a doc issue)

[ ] no-need-doc
(Please explain why)

[ ] doc
(If this PR contains doc changes)

@freeznet could you please help verify whether we need to add/update docs for this PR? Thanks.

@Huanli-Meng no meed doc update, just fix installation failure


Reconcile the Suite settings menu with what's being applied.  Make sure image format is honored

jpg, png

Relies on #46


Error "relation "public.pg_toast_5987783_index" does not exist" when running the utility

Hi!
I successfully run pgcompacttable on different tables separately:
postgres@database:/home/dimon/pgcompacttable/bin$ ./pgcompacttable -d moyklass -t user_subscriptions
[Mon May 16 23:13:52 2022] (moyklass) Connecting to database
[Mon May 16 23:13:52 2022] (moyklass) Postgres backend pid: 100889
[Mon May 16 23:13:52 2022] (moyklass) Handling tables. Attempt 1
[Mon May 16 23:13:58 2022] (moyklass:public.user_subscriptions) Statistics: 88846 pages (114069 pages including toasts and indexes), it is expected that ~13.670% (12149 pages) can be compacted with the estimated space saving being 94.919MB.
[Mon May 16 23:14:02 2022] (moyklass:public.user_subscriptions) Reindex: public.user_subscriptions_subscription_id_idx, initial size 4099 pages(32.023MB), has been reduced by 33% (10.633MB), duration 3 seconds.
[Mon May 16 23:14:02 2022] (moyklass:public.user_subscriptions) Processing results: 88846 pages left (112708 pages including toasts and indexes), size reduced by 0.000B (10.633MB including toasts and indexes) in total.
[Mon May 16 23:14:02 2022] (moyklass) Processing complete.
[Mon May 16 23:14:02 2022] (moyklass) Processing results: size reduced by 0.000B (10.633MB including toasts and indexes) in total.
[Mon May 16 23:14:02 2022] (moyklass) Disconnecting from database
[Mon May 16 23:14:02 2022] Processing complete: 1 retries to process has been done
[Mon May 16 23:14:02 2022] Processing results: size reduced by 0.000B (10.633MB including toasts and indexes) in total.

After that I run the utility on full database:
./pgcompacttable -d moyklass

Some tables where optimized successfully, but after some time an error "relation "public.pg_toast_5987783_index" does not exist" started appearing for all tables. Relation pg_toast_5987783_index is the same for all tables.
This is the first table the error occurs (table name is classes, maybe it is important):
[Mon May 16 23:34:59 2022] (moyklass:public.classes) Statistics: 36086 pages (38337 pages including toasts and indexes), it is expected that ~21.820% (7873 pages) can be compacted with the estimated space saving being 61.513MB.
[Mon May 16 23:35:27 2022] (moyklass:public.classes) SQL Error: ERROR:  relation "public.pg_toast_5987783_index" does not exist
[Mon May 16 23:35:27 2022] (moyklass:public.classes) Table handling interrupt.
[Mon May 16 23:35:27 2022] (moyklass:public.classes) Processing results: 36086 pages (38437 pages including toasts and indexes), size has been reduced by 0.000B (-816.000KB including toasts and indexes) in total. This attempt has been initially expected to compact ~21% more space (7871 pages, 61.498MB)

Now this error appears in any utility run, ex:
postgres@database:/home/dimon/pgcompacttable/bin$ ./pgcompacttable -d moyklass -t user_subscriptions
[Mon May 16 23:51:57 2022] (moyklass) Connecting to database
[Mon May 16 23:51:57 2022] (moyklass) Postgres backend pid: 13168
[Mon May 16 23:51:57 2022] (moyklass) Handling tables. Attempt 1
[Mon May 16 23:51:58 2022] (moyklass:public.user_subscriptions) Statistics: 88846 pages (112709 pages including toasts and indexes), it is expected that ~13.670% (12147 pages) can be compacted with the estimated space saving being 94.902MB.
[Mon May 16 23:51:58 2022] (moyklass:public.user_subscriptions) SQL Error: ERROR:  relation "public.pg_toast_5987783_index" does not exist
[Mon May 16 23:51:58 2022] (moyklass:public.user_subscriptions) Table handling interrupt.
[Mon May 16 23:51:58 2022] (moyklass:public.user_subscriptions) Processing results: 88846 pages left (112709 pages including toasts and indexes), size reduced by 0.000B (0.000B including toasts and indexes) in total.
[Mon May 16 23:51:58 2022] (moyklass) Processing complete.
[Mon May 16 23:51:58 2022] (moyklass) Processing results: size reduced by 0.000B (0.000B including toasts and indexes) in total.
[Mon May 16 23:51:58 2022] (moyklass) Disconnecting from database
[Mon May 16 23:51:58 2022] Processing complete: 1 retries to process has been done
[Mon May 16 23:51:58 2022] Processing results: size reduced by 0.000B (0.000B including toasts and indexes) in total.

The error occurs in this query:
   SELECT
    indexname, tablespace, indexdef,
    regexp_replace(indexdef, E'.* USING (\\w+) .*', E'\\1') AS indmethod,
    conname,
    CASE
        WHEN contype = 'p' THEN 'PRIMARY KEY'
        WHEN contype = 'u' THEN 'UNIQUE'
        ELSE NULL END AS contypedef,
    (
        SELECT
            bool_and(
                deptype IN ('n', 'a', 'i') AND
                NOT (refobjid = indexoid AND deptype = 'n') AND
                NOT (
                    objid = indexoid AND deptype = 'i'
                ))
        FROM pg_catalog.pg_depend
        LEFT JOIN pg_catalog.pg_constraint ON
            pg_catalog.pg_constraint.oid = refobjid
        WHERE
            (objid = indexoid AND classid = pgclassid) OR
            (refobjid = indexoid AND refclassid = pgclassid)
    )::integer AS replace_index_possible,
    (
        SELECT string_to_array(indkey::text, ' ')::int2[] operator(pg_catalog.@>) array[0::int2]
        FROM pg_catalog.pg_index
        WHERE indexrelid = indexoid
    )::integer as is_functional,
    condeferrable as is_deferrable,
    condeferred as is_deferred,
    (contype = 'x') as is_exclude_constraint,
    pg_catalog.pg_relation_size(indexoid) as idxsize
FROM (
    SELECT
        indexname, COALESCE(tablespace, (SELECT spcname AS tablespace FROM pg_catalog.pg_tablespace WHERE oid = (SELECT dattablespace
            FROM pg_catalog.pg_database
            WHERE
                datname = current_database() AND
                spcname != current_setting('default_tablespace')))) AS tablespace, indexdef,
        (
            quote_ident(schemaname) || '.' ||
            quote_ident(indexname))::regclass AS indexoid,
        'pg_catalog.pg_class'::regclass AS pgclassid
    FROM pg_catalog.pg_indexes
    WHERE
        schemaname = 'public' AND
        tablename = 'user_subscriptions'
) AS sq
LEFT JOIN pg_catalog.pg_constraint ON
    conindid = indexoid AND contype IN ('p', 'u', 'x')
ORDER BY idxsize

It is interesting that if I change LEFT JOIN to JOIN, query executes without any error. Also if I remove condition schemaname = 'public', query executes without error too. Also if I change contype IN ('p', 'u', 'x') to contype IN ('p', 'u'), query works too!
I don't understand why this error happens, I didn't find any relation or index with the name pg_toast_5987783_index. But in fact that this has been started during pgcompacttable run and probably the utility made something wrong in database.
I've restored the dump made after this error happened on other server, and this query runs without errors on restored database. I dont know how to fix this in production database.

Yeah, I observed such error yesterday. Will fix.
The query itself looks correct, but the postgresql query planner moved the cast to regclass to the join condition. Therefore, it may receive an attempt to search for a knowingly non-existent object. pg_toast_5987783_index is part of postgresql TOAST system, but should be in special schema pg_toast, not in public.
But to be sure it's the same problem, please say:

what version of postgresql are you using
this query gives an error? please post explain (just explain, without explain analize)
does this query give an error if you uncomment OFFSET 0?

SELECT
            indexname, indexdef,
            pg_catalog.pg_relation_size(indexoid) as idxsize
        FROM (
            SELECT
                indexname, indexdef,
                (quote_ident(schemaname) || '.' || quote_ident(indexname))::regclass AS indexoid
            FROM pg_catalog.pg_indexes
            WHERE
                schemaname = 'public' AND
                tablename = 'user_subscriptions'/* OFFSET 0*/
        ) AS sq
        LEFT JOIN pg_catalog.pg_constraint ON
            conindid = indexoid AND contype IN ('p', 'u', 'x')
        ORDER BY idxsize

@Melkij
Server version PostgreSQL 13.2
This query gives an error. This is the explain:
                                                                        QUERY PLAN
------------------------------------------------------------------------------------------------------------------------------------------------------------
 Sort  (cost=39.23..39.24 rows=1 width=104)
   Sort Key: (pg_relation_size((((quote_ident((n.nspname)::text) || '.'::text) || quote_ident((i.relname)::text)))::regclass, 'main'::text))
   ->  Merge Join  (cost=4.84..39.22 rows=1 width=104)
         Merge Cond: (n.oid = c.relnamespace)
         Join Filter: (x.indexrelid = i.oid)
         ->  Nested Loop Left Join  (cost=0.27..1868.52 rows=453 width=136)
               Join Filter: (pg_constraint.conindid = ((((quote_ident((n.nspname)::text) || '.'::text) || quote_ident((i.relname)::text)))::regclass)::oid)
               ->  Nested Loop  (cost=0.27..83.70 rows=453 width=136)
                     ->  Index Scan using pg_namespace_oid_index on pg_namespace n  (cost=0.27..31.03 rows=1 width=68)
                           Filter: (nspname = 'public'::name)
                     ->  Seq Scan on pg_class i  (cost=0.00..48.14 rows=453 width=72)
                           Filter: (relkind = ANY ('{i,I}'::"char"[]))
               ->  Materialize  (cost=0.00..18.43 rows=120 width=4)
                     ->  Seq Scan on pg_constraint  (cost=0.00..17.83 rows=120 width=4)
                           Filter: (contype = ANY ('{p,u,x}'::"char"[]))
         ->  Materialize  (cost=4.56..18.28 rows=1 width=8)
               ->  Nested Loop  (cost=4.56..18.28 rows=1 width=8)
                     ->  Index Scan using pg_class_relname_nsp_index on pg_class c  (cost=0.28..8.30 rows=1 width=8)
                           Index Cond: (relname = 'user_subscriptions'::name)
                           Filter: (relkind = ANY ('{r,m,p}'::"char"[]))
                     ->  Bitmap Heap Scan on pg_index x  (cost=4.29..9.96 rows=2 width=8)
                           Recheck Cond: (indrelid = c.oid)
                           ->  Bitmap Index Scan on pg_index_indrelid_index  (cost=0.00..4.29 rows=2 width=0)
                                 Index Cond: (indrelid = c.oid)

With the uncommented OFFSET 0 there is no errors.

Should be fixed now


Update kanela-agent to 1.0.11

Updates io.kamon:kanela-agent from 1.0.7 to 1.0.11.
GitHub Release Notes - Version Diff
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "io.kamon", artifactId = "kanela-agent" } ]

labels: library-update, semver-patch

Superseded by #183.