How to release via Manifest config w/ additional files?

Hi,
I have a Java (w/ Gradle) project acting as a mono-repo. I wish to increment the version of each submodule/package individually, which thus far appears to be "partially" working via the manifest-pr and manifest-release commands.
Please find the affected .github/workflows/release.yml, release-please-config.json, and resulting pull request axieum/fabric-release-please#6.

The commit to be released does not appear in its package's section, I would expect it to be in both
It does not appear to know how to handle extra-files: gradle.properties argument, and hence any additional files are not included in the pull request, see example-submod/gradle.properties#L5
It fails to read the release-type from the manifest config when running manifest-release, but manifest-pr picks it up okay

If these are indeed three unique issues/bugs, I can split this issue up.
I understand this project is under active development for a major milestone, but some guidance would be greatly appreciated.
Thanks,

Just seen that the manifest-* commands will be deprecated.
I will come back to this after google-github-actions/release-please-action has been updated to reflect the config-file and manifest-file arguments.

In v3, manifest should still work, except the CLI command is rolled into the same release-pr and github-release commands. Also, in v13, the manifest config should support extra-files for each component in the manifest.
I think @bcoe has a candidate version of the GitHub action that is using the v13 release candidate version of this library if you're interested in trying it out.

Digging into your config, you are using the java-yoshi strategy which was built to support our custom repository structure and not necessarily meant for public consumption. It is documented here
The java-yoshi strategy already handles multiple artifact versions (at the same or different versions). You will need to create a versions.txt file at the root of the component (example).
Then, I would configure your manifest config release-please.json to only have a single component like:
{
  "bump-minor-pre-major": true,
  "bump-patch-for-minor-pre-major": true,
  "packages": {
    ".": {
      "release-type": "java-yoshi",
      "extra-files": ["gradle.properties", "example-submod/gradle.properties"],
    }
  }
}

Additionally, the default location for the manifest file is release-please-config.json at the root of the component (vs. .github/release-please.json).

Hi @chingor13, 👋
Thank you for your detailed response, it is very insightful. I'm starting to believe that using the simple release strategy would be better suited for my use case. Do you think it's possible to avoid a version.txt file with said strategy and instead read the current version from the already existing manifest file? I could then use the changes you've made in #1157 to update any of my extra files. 🤔
Thanks,

If we merge accept #1157, then we should probably create a separate strategy like Custom that only updates the CHANGELOG.md and leaves the rest up to configuration with the extra-files option.
Also, v13 is the version of release-please -- the action will have a different version tag (maybe v3? or maybe still v2 if we don't have to break the action's interface).

A strategy that only updates the README.md and the rest is up to the extra-files sounds great!
v13 is the latest branch on the action - it is yet to be merged into main and doesn't appear to be tagged yet.

I've updated my use case and can confirm points 1 & 3 appear to be fixed. Point 2 is still an issue however. Please see resulting PR axieum/fabric-release-please#19 that fails to update any of the gradle.properties. 😊


Not able to insert a local WSDL file in SoapModule.register({ uri:

Hello!
I facing a problem when i try to insert a relative local path as uri.
the code is something like
SoapModule.register({       clientName: 'SOAP_GESTIONE_PRIVACY',       uri: 'http://webservices.oorsprong.org/websamples.countryinfo/CountryInfoService.wso?wsdl',       clientOptions: {         disableCache: true,       },     }),
and i want to change the uri with a local file located in a relative path such ./src/CountryInfoService.wsdl.. is it possible?
anyway Cool Lib! Man
Thanks

Hello @rspace3,
The soap npm package accepts a path as an 'uri', as they say. Maybe this is what you need?
I can't test it since I'm on a trip at the moment.


nicbres/signal generation

(Partly) implements: #46
This is a first simplified approach to generating the idealized, received signals.
Assumptions:

no absorption from medium nor from geometrical spreading -> nice to have
sound speed constant -> changing this would be to much effort
no noise -> nice to have / low-hanging fruit
no window function around pulse  -> must have

Sample output for 4 hydrophones in array:

Rebased fixup commits, tested setup and running pytest in docker image.


Odyssey Kayn animations not working

Odyssey Kayn animations aren't working proper, the animations of E in the wall isn't working nor showing on both forms and also the hologram above the champions when ulting someoning isn't showing either on all three forms, i'm hoping for a fix because it's one of my favorite skins from kayn

is skin changer working for u except for the kayn skin? Since the update recently, i cant even use it lol

#1
Closes #899 @hotline1337

#1


Wrong actions detected if ActionsProfile names change

XRTK - Mixed Reality Toolkit Bug Report
Wrong actions detected if names changed - names will be new but IDs will be from the old action.
To Reproduce
I have removed several actions, added a few and renamed some.
Expected behavior
There should be a way to auto regenerate IDs so the correct actions are called without the need to delete ActionsProfile and create a new one
Actual behavior
Actions are modified in ActionsProfile, and OnInputDown will get wrong actions. The InputEventData will get new names but same IDs so comparison of received event data and the action expected will return wrong result. If I realize that one of the action in the middle is unnecessary, it seems that deleting it will mess IDs of other actions on the list.
In addition, if new profile has less number of actions, the triggering the last action on the list will result in ~index out of bounds logged into console
Your Setup (please complete the following information)

Unity Version 2019.1.14f1
XRTK Version 0.1.27

Target Platform (please complete the following information)

WMR immersive

Swapping the input actions from another configuration is not supported yet.
See #379


cookie issue

Just upgrade to the new version. NICE LOOK!
But it seems it does not save and use cookies for the same domain. Any ideas how to overcome this issue?

Hi,
Thanks for issue report.
The solution is in the hotfix branch. However there will be no session information exchange between the app and Chrome since there's no API available for apps to do this. The app will be able to read cookies from the response and set them back in next request to the same server (as browsers does).
As per this I'll close this issue.


vscode: 1.49.3 -> 1.50.0

Motivation for this change
Upgrades vscode from 1.49.3 to 1.50.0
This PR was automatically generated by nixpkgs-upkeep.

CI workflow that created this PR.
Internal tag: 339fca1ef62302f8363f4b819f1e45e3.

Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[ ] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

@GrahamcOfBorg build vscode


Remove version: Jackett.Jackett version 0.21.1189

404 - release deleted
Microsoft Reviewers: Open in CodeFlow

URL: https://github.com/Jackett/Jackett/releases/download/v0.21.1189/Jackett.Installer.Windows.exe
Response Error: The remote server returned an error: (404) Not Found.
(Automated message - build 918)


Using a % for width

Using a % for width throws this warning, but works fine, might want to allow the string with % in the prop validation.
[Vue warn]: Invalid prop: type check failed for prop "width". Expected Number with value NaN, got String with value "100%".

Just made a pull request for it
https://github.com/LucasLeandro1204/vue-content-loading/pull/22

Bump. Allowing % for width would be really useful.

I did a pull request with this.

I also use %, can we merge the PR of @alanssoares ?


[Help] 🤔 docker 部署无法正常使用

Describe the help wanted
具体解决
Steps to behave
docker部署+nginx反代
Expected behavior
如何解决
Screenshots
2024/01/24 01:11:22 http: panic serving <IP_ADDRESS>:57940: runtime error: index out of range [1] with length 1
goroutine 239 [running]:
net/http.(*conn).serve.func1()
net/http/server.go:1868 +0xb9
panic({0x885180?, 0xc000028678?})
runtime/panic.go:920 +0x270
adams549659584/go-proxy-bingai/common.NewSingleHostReverseProxy.func2(0xc00031bdd0)
adams549659584/go-proxy-bingai/common/proxy.go:175 +0xc26
net/http/httputil.(*ReverseProxy).modifyResponse(0xc0003b9ea0, {0xab8e70, 0xc000110e00}, 0xc00031bdd0, 0x1a0?)
net/http/httputil/reverseproxy.go:324 +0x4a
net/http/httputil.(*ReverseProxy).ServeHTTP(0xc0003b9ea0, {0xab8e70, 0xc000110e00}, 0xc0000efb00)
net/http/httputil/reverseproxy.go:481 +0x1016
adams549659584/go-proxy-bingai/api.Sydney({0xab8e70, 0xc000110e00}, 0xc0003afb18?)
adams549659584/go-proxy-bingai/api/sydney.go:14 +0x49
net/http.HandlerFunc.ServeHTTP(0x440b60?, {0xab8e70?, 0xc000110e00?}, 0x6571ba?)
net/http/server.go:2136 +0x29
net/http.(*ServeMux).ServeHTTP(0xde55c0?, {0xab8e70, 0xc000110e00}, 0xc0000efb00)
net/http/server.go:2514 +0x142
net/http.serverHandler.ServeHTTP({0xc0002d1950?}, {0xab8e70?, 0xc000110e00?}, 0x6?)
net/http/server.go:2938 +0x8e
net/http.(*conn).serve(0xc0000e4240, {0xab9e08, 0xc00007f620})
net/http/server.go:2009 +0x5f4
created by net/http.(*Server).Serve in goroutine 1
net/http/server.go:3086 +0x5cb
Versions

OS:
Browser & Version:
GoProxiBing Version:

Additional context
No response

和LZ同样情况docker部署+nginx反代
2024/01/24 15:39:40 http: panic serving <IP_ADDRESS>:39012: runtime error: index out of range [1] with length 1
goroutine 6046 [running]:
net/http.(*conn).serve.func1()
net/http/server.go:1868 +0xb9
panic({0x885180?, 0xc002fbe1c8?})
runtime/panic.go:920 +0x270
adams549659584/go-proxy-bingai/common.NewSingleHostReverseProxy.func2(0xc0007a47e0)
adams549659584/go-proxy-bingai/common/proxy.go:175 +0xc26
net/http/httputil.(*ReverseProxy).modifyResponse(0xc000992190, {0xab8e70, 0xc000714000}, 0xc0007a47e0, 0x1a0?)
net/http/httputil/reverseproxy.go:324 +0x4a
net/http/httputil.(*ReverseProxy).ServeHTTP(0xc000992190, {0xab8e70, 0xc000714000}, 0xc00041c000)
net/http/httputil/reverseproxy.go:490 +0xef5
adams549659584/go-proxy-bingai/api.Index({0xab8e70, 0xc000714000}, 0xc00041c000)
adams549659584/go-proxy-bingai/api/index.go:21 +0xc5
net/http.HandlerFunc.ServeHTTP(0x440b60?, {0xab8e70?, 0xc000714000?}, 0x6571ba?)
net/http/server.go:2136 +0x29
net/http.(*ServeMux).ServeHTTP(0xde55c0?, {0xab8e70, 0xc000714000}, 0xc00041c000)
net/http/server.go:2514 +0x142
net/http.serverHandler.ServeHTTP({0xc000a96090?}, {0xab8e70?, 0xc000714000?}, 0x6?)
net/http/server.go:2938 +0x8e
net/http.(*conn).serve(0xc0007a4000, {0xab9e08, 0xc000081620})
net/http/server.go:2009 +0x5f4
created by net/http.(*Server).Serve in goroutine 1
net/http/server.go:3086 +0x5cb

能不能定位到哪一个请求出现了这个报错？能的话查一下 Nginx 的日志

nginx的error日志
2024/01/25 02:36:43 [error] 31112#31112: *50634 upstream prematurely closed connection while reading response header from upstream, client: <IP_ADDRESS>, server: _, request: "GET /turing/userconsent?bundleVersion=1.1482.6&isStartOfConversation=true HTTP/1.1", upstream: "http://<IP_ADDRESS>:12080/turing/userconsent?bundleVersion=1.1482.6&isStartOfConversation=true", host: "<IP_ADDRESS>:11443", referrer: "https://<IP_ADDRESS>:11443/web/?showconv=1"
2024/01/25 02:36:43 [error] 31112#31112: *50605 upstream prematurely closed connection while reading response header from upstream, client: <IP_ADDRESS>, server: _, request: "GET /turing/conversation/create?bundleVersion=1.1482.6 HTTP/1.1", upstream: "http://<IP_ADDRESS>:12080/turing/conversation/create?bundleVersion=1.1482.6", host: "<IP_ADDRESS>:11443", referrer: "https://<IP_ADDRESS>:11443/web/?showconv=1"

应该是修了, 5320f864f1a9fa76cb2dd5002e89131973d27254
我这边处理一下带token的人机验证后再发版本

尝试一下新版本，如果还有问题再重新打开这个 issue

依旧存在无限循环人机验证问题

循环人机验证请等我写wiki，对账号有要求

忘记更新了，升级到了1.19.2最新了！

然后就出现 这个400错误，之前全部是错误，现在升级后，好像大部分200，然后出现一个400，无限循环等待。。。
Bad Request
Your browser sent a request that this server could not understand.
。。

本体在哪个平台搭建的？
人机验证服务器在哪个平台搭建的？
如何搭建？（贴出搭建教程或者视频地址，或者详细说明）
遇到了什么问题？（截图加说明）
请提供以上信息，不然我定位不了问题

本体在哪个平台搭建的？
人机验证服务器在哪个平台搭建的？
如何搭建？（贴出搭建教程或者视频地址，或者详细说明）
遇到了什么问题？（截图加说明）

请提供以上信息，不然我定位不了问题

1，自己的国外VPS
2，人机验证是啥玩意，没有搞
3，你的docker直接拖得
4，就是上述问题得描述

你就给我这一点东西，我能看出啥问题哇😅能导致这个问题的原因太多了

你就给我这一点东西，我能看出啥问题哇😅能导致这个问题的原因太多了

我也就搞了一点东西啊，从你的docker拉了一下，什么也没改动，然后就是nginx反代
#PROXY-START/
location ^~ /
{
proxy_pass http://<IP_ADDRESS>:8080;
proxy_http_version        1.1;
proxy_cache_bypass     $http_upgrade;
	# Proxy headers
	proxy_set_header Upgrade                   $http_upgrade;
	proxy_set_header Connection               $connection_upgrade;
	proxy_set_header Host                          $host;
	proxy_set_header X-Real-IP                  $remote_addr;
	proxy_set_header X-Forwarded-For      $proxy_add_x_forwarded_for;
	proxy_set_header X-Forwarded-Proto   $scheme;
	proxy_set_header X-Forwarded-Host    $host;
	proxy_set_header X-Forwarded-Port     $server_port;

}
#PROXY-END/

chmod +x go-proxy-bingai
./go-proxy-bingai
2024/01/27 16:48:22 Starting BingAI Proxy At :8080
直接拖二进制文件运行，也是一样，这个就更简单了，加上上面的反代（主要为了SSL）

刚刚小日子的服务器，换了一台美国的服务器，问题一样，奇了怪了。。。

别急，教程我在写了

这难怪过不去人机验证，你都没配置

不过神奇了，刚刚不是换了后端么，现在又换回来了，居然现在正常了。。。。

别急，教程我在写了
最新的部署，人机启动失败。。。。

2024-01-29 00:50:07,248 INFO Included extra file "/etc/supervisor/conf.d/selenium.conf" during parsing
2024-01-29 00:50:07,261 INFO RPC interface 'supervisor' initialized
2024-01-29 00:50:07,262 CRIT Server 'unix_http_server' running without any HTTP authentication checking
2024-01-29 00:50:07,263 INFO supervisord started with pid 8
2024-01-29 00:50:08,270 INFO spawned: 'xvfb' with pid 9
2024-01-29 00:50:08,283 INFO spawned: 'go-bingai-pass' with pid 10
2024/01/29 00:50:08 [Info] Http Server Start 🚀
2024/01/29 00:50:08 [Info] Http Server Listen on: http://<IP_ADDRESS>:7860
2024-01-29 00:50:08,350 CRIT uncaptured python exception, closing channel  (stderr)> (:[Errno 29] Illegal seek [/usr/lib/python3/dist-packages/supervisor/supervisord.py|runforever|220] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|handle_read_event|270] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|record_output|204] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|_log|173] [/usr/lib/python3/dist-packages/supervisor/loggers.py|info|327] [/usr/lib/python3/dist-packages/supervisor/loggers.py|log|345] [/usr/lib/python3/dist-packages/supervisor/loggers.py|emit|227] [/usr/lib/python3/dist-packages/supervisor/loggers.py|doRollover|264])
2024-01-29 00:50:09,351 INFO success: xvfb entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-01-29 00:50:13,509 INFO success: go-bingai-pass entered RUNNING state, process has stayed up for > than 5 seconds (startsecs)
2024/01/29 00:52:11 [Info] IP: <IP_ADDRESS>:52798 Request: GET /
2024/01/29 00:52:11 [Error] IP: <IP_ADDRESS>:52798 Request: GET / Status: 405
2024-01-29 00:52:11,936 CRIT uncaptured python exception, closing channel  (stderr)> (:[Errno 29] Illegal seek [/usr/lib/python3/dist-packages/supervisor/supervisord.py|runforever|220] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|handle_read_event|270] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|record_output|204] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|_log|173] [/usr/lib/python3/dist-packages/supervisor/loggers.py|info|327] [/usr/lib/python3/dist-packages/supervisor/loggers.py|log|345] [/usr/lib/python3/dist-packages/supervisor/loggers.py|emit|227] [/usr/lib/python3/dist-packages/supervisor/loggers.py|doRollover|264])
2024/01/29 00:52:12 [Info] IP: <IP_ADDRESS>:52798 Request: GET /favicon.ico
2024/01/29 00:52:12 [Error] IP: <IP_ADDRESS>:52798 Request: GET /favicon.ico Status: 405
2024-01-29 00:52:12,092 CRIT uncaptured python exception, closing channel  (stderr)> (:[Errno 29] Illegal seek [/usr/lib/python3/dist-packages/supervisor/supervisord.py|runforever|220] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|handle_read_event|270] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|record_output|204] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|_log|173] [/usr/lib/python3/dist-packages/supervisor/loggers.py|info|327] [/usr/lib/python3/dist-packages/supervisor/loggers.py|log|345] [/usr/lib/python3/dist-packages/supervisor/loggers.py|emit|227] [/usr/lib/python3/dist-packages/supervisor/loggers.py|doRollover|264])
2024/01/29 00:52:17 [Info] IP: <IP_ADDRESS>:36702 Request: POST /
2024-01-29 00:52:17,832 CRIT uncaptured python exception, closing channel  (stderr)> (:[Errno 29] Illegal seek [/usr/lib/python3/dist-packages/supervisor/supervisord.py|runforever|220] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|handle_read_event|270] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|record_output|204] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|_log|173] [/usr/lib/python3/dist-packages/supervisor/loggers.py|info|327] [/usr/lib/python3/dist-packages/supervisor/loggers.py|log|345] [/usr/lib/python3/dist-packages/supervisor/loggers.py|emit|227] [/usr/lib/python3/dist-packages/supervisor/loggers.py|doRollover|264])
2024/01/29 00:52:21 [Info] Browser PID: 39
2024-01-29 00:52:21,267 CRIT uncaptured python exception, closing channel  (stderr)> (:[Errno 29] Illegal seek [/usr/lib/python3/dist-packages/supervisor/supervisord.py|runforever|220] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|handle_read_event|270] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|record_output|204] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|_log|173] [/usr/lib/python3/dist-packages/supervisor/loggers.py|info|327] [/usr/lib/python3/dist-packages/supervisor/loggers.py|log|345] [/usr/lib/python3/dist-packages/supervisor/loggers.py|emit|227] [/usr/lib/python3/dist-packages/supervisor/loggers.py|doRollover|264])
Get "https://www.bing.com/fd/ls/l?IG=8GV6L51WT51GDKPTW5MK1FHO92OMMV3S&TYPE=Event.ClientInst&DATA=%!B(MISSING)%!B(MISSING)%!N(MISSING)amespace%3A%!C(MISSING)onversation%2C%!C(MISSING)ustomData%3A{%!C(MISSING)%!h(MISSING)ref%!C(MISSING)%3A%!C(MISSING)%!h(MISSING)ttps%!A(MISSING)%!F(MISSING)%!F(MISSING)www.bing.com%!F(MISSING)turing%!F(MISSING)captcha%!F(MISSING)challenge%!F(MISSING)q%!D(MISSING)%!i(MISSING)frameid%!D(MISSING)local-gen-1fa41216-d75c-465e-902f-ae6e09637408%!C(MISSING)%2C%!C(MISSING)%!i(MISSING)frameid%!C(MISSING)%3A%!C(MISSING)%!l(MISSING)ocal-gen-1fa41216-d75c-465e-902f-ae6e09637408%!C(MISSING)}%2C%!T(MISSING)%3A%!C(MISSING)I.SystemEvent%2C%!T(MISSING)S%3A1706489541%!C(MISSING)%!N(MISSING)ame%3A%!I(MISSING)FrameCreation%2C%!F(MISSING)ID%3A%!C(MISSING)odex}%!D(MISSING)": Not Found
2024-01-29 00:52:21,470 CRIT uncaptured python exception, closing channel  (stdout)> (:[Errno 29] Illegal seek [/usr/lib/python3/dist-packages/supervisor/supervisord.py|runforever|220] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|handle_read_event|270] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|record_output|204] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|_log|173] [/usr/lib/python3/dist-packages/supervisor/loggers.py|info|327] [/usr/lib/python3/dist-packages/supervisor/loggers.py|log|345] [/usr/lib/python3/dist-packages/supervisor/loggers.py|emit|227] [/usr/lib/python3/dist-packages/supervisor/loggers.py|doRollover|264])
2024/01/29 00:53:12 [Info] IP: <IP_ADDRESS>:56592 Request: POST /
2024-01-29 00:53:12,145 CRIT uncaptured python exception, closing channel  (stderr)> (:[Errno 29] Illegal seek [/usr/lib/python3/dist-packages/supervisor/supervisord.py|runforever|220] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|handle_read_event|270] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|record_output|204] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|_log|173] [/usr/lib/python3/dist-packages/supervisor/loggers.py|info|327] [/usr/lib/python3/dist-packages/supervisor/loggers.py|log|345] [/usr/lib/python3/dist-packages/supervisor/loggers.py|emit|227] [/usr/lib/python3/dist-packages/supervisor/loggers.py|doRollover|264])
2024/01/29 00:53:12 [Info] Browser PID: 0
2024-01-29 00:53:12,540 CRIT uncaptured python exception, closing channel  (stderr)> (:[Errno 29] Illegal seek [/usr/lib/python3/dist-packages/supervisor/supervisord.py|runforever|220] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|handle_read_event|270] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|record_output|204] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|_log|173] [/usr/lib/python3/dist-packages/supervisor/loggers.py|info|327] [/usr/lib/python3/dist-packages/supervisor/loggers.py|log|345] [/usr/lib/python3/dist-packages/supervisor/loggers.py|emit|227] [/usr/lib/python3/dist-packages/supervisor/loggers.py|doRollover|264])
Get "https://www.bing.com/fd/ls/l?IG=CXRZNI7ZCGRISL1KKGA0QOT7Q66G6D5A&TYPE=Event.ClientInst&DATA=%!B(MISSING)%!B(MISSING)%!N(MISSING)amespace%3A%!C(MISSING)onversation%2C%!C(MISSING)ustomData%3A{%!C(MISSING)%!h(MISSING)ref%!C(MISSING)%3A%!C(MISSING)%!h(MISSING)ttps%!A(MISSING)%!F(MISSING)%!F(MISSING)www.bing.com%!F(MISSING)turing%!F(MISSING)captcha%!F(MISSING)challenge%!F(MISSING)q%!D(MISSING)%!i(MISSING)frameid%!D(MISSING)local-gen-426f23b8-44ae-4a2a-bc93-b0ef6af88b3c%!C(MISSING)%2C%!C(MISSING)%!i(MISSING)frameid%!C(MISSING)%3A%!C(MISSING)%!l(MISSING)ocal-gen-426f23b8-44ae-4a2a-bc93-b0ef6af88b3c%!C(MISSING)}%2C%!T(MISSING)%3A%!C(MISSING)I.SystemEvent%2C%!T(MISSING)S%3A1706489592%!C(MISSING)%!N(MISSING)ame%3A%!I(MISSING)FrameCreation%2C%!F(MISSING)ID%3A%!C(MISSING)odex}%!D(MISSING)": Not Found
2024-01-29 00:53:12,617 CRIT uncaptured python exception, closing channel  (stdout)> (:[Errno 29] Illegal seek [/usr/lib/python3/dist-packages/supervisor/supervisord.py|runforever|220] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|handle_read_event|270] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|record_output|204] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|_log|173] [/usr/lib/python3/dist-packages/supervisor/loggers.py|info|327] [/usr/lib/python3/dist-packages/supervisor/loggers.py|log|345] [/usr/lib/python3/dist-packages/supervisor/loggers.py|emit|227] [/usr/lib/python3/dist-packages/supervisor/loggers.py|doRollover|264])
2024/01/29 00:53:17 error value: mzcb5xqaU.ezWg91j2iGKu{}
2024-01-29 00:53:17,832 CRIT uncaptured python exception, closing channel  (stderr)> (:[Errno 29] Illegal seek [/usr/lib/python3/dist-packages/supervisor/supervisord.py|runforever|220] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|handle_read_event|270] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|record_output|204] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|_log|173] [/usr/lib/python3/dist-packages/supervisor/loggers.py|info|327] [/usr/lib/python3/dist-packages/supervisor/loggers.py|log|345] [/usr/lib/python3/dist-packages/supervisor/loggers.py|emit|227] [/usr/lib/python3/dist-packages/supervisor/loggers.py|doRollover|264])
2024/01/29 00:53:17 error value: &eJt0dpHGJUL4.gmyJEsHKkRv{cgtJhL:"context canceled"}
2024-01-29 00:53:17,862 CRIT uncaptured python exception, closing channel  (stderr)> (:[Errno 29] Illegal seek [/usr/lib/python3/dist-packages/supervisor/supervisord.py|runforever|220] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|handle_read_event|270] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|record_output|204] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|_log|173] [/usr/lib/python3/dist-packages/supervisor/loggers.py|info|327] [/usr/lib/python3/dist-packages/supervisor/loggers.py|log|345] [/usr/lib/python3/dist-packages/supervisor/loggers.py|emit|227] [/usr/lib/python3/dist-packages/supervisor/loggers.py|doRollover|264])
2024/01/29 00:53:18 http: panic serving <IP_ADDRESS>:36702: context deadline exceeded
2024-01-29 00:53:18,324 CRIT uncaptured python exception, closing channel  (stderr)> (:[Errno 29] Illegal seek [/usr/lib/python3/dist-packages/supervisor/supervisord.py|runforever|220] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|handle_read_event|270] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|record_output|204] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|_log|173] [/usr/lib/python3/dist-packages/supervisor/loggers.py|info|327] [/usr/lib/python3/dist-packages/supervisor/loggers.py|log|345] [/usr/lib/python3/dist-packages/supervisor/loggers.py|emit|227] [/usr/lib/python3/dist-packages/supervisor/loggers.py|doRollover|264])
2024/01/29 00:54:19 [Info] IP: <IP_ADDRESS>:42246 Request: POST /
2024-01-29 00:54:19,589 CRIT uncaptured python exception, closing channel  (stderr)> (:[Errno 29] Illegal seek [/usr/lib/python3/dist-packages/supervisor/supervisord.py|runforever|220] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|handle_read_event|270] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|record_output|204] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|_log|173] [/usr/lib/python3/dist-packages/supervisor/loggers.py|info|327] [/usr/lib/python3/dist-packages/supervisor/loggers.py|log|345] [/usr/lib/python3/dist-packages/supervisor/loggers.py|emit|227] [/usr/lib/python3/dist-packages/supervisor/loggers.py|doRollover|264])
2024/01/29 00:54:22 [Info] Browser PID: 409
2024-01-29 00:54:22,039 CRIT uncaptured python exception, closing channel  (stderr)> (:[Errno 29] Illegal seek [/usr/lib/python3/dist-packages/supervisor/supervisord.py|runforever|220] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|handle_read_event|270] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|record_output|204] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|_log|173] [/usr/lib/python3/dist-packages/supervisor/loggers.py|info|327] [/usr/lib/python3/dist-packages/supervisor/loggers.py|log|345] [/usr/lib/python3/dist-packages/supervisor/loggers.py|emit|227] [/usr/lib/python3/dist-packages/supervisor/loggers.py|doRollover|264])
Get "https://www.bing.com/fd/ls/l?IG=UHW3UM92Z6JTEXSIL2TPSGLO8L8DYE5N&TYPE=Event.ClientInst&DATA=%!B(MISSING)%!B(MISSING)%!N(MISSING)amespace%3A%!C(MISSING)onversation%2C%!C(MISSING)ustomData%3A{%!C(MISSING)%!h(MISSING)ref%!C(MISSING)%3A%!C(MISSING)%!h(MISSING)ttps%!A(MISSING)%!F(MISSING)%!F(MISSING)www.bing.com%!F(MISSING)turing%!F(MISSING)captcha%!F(MISSING)challenge%!F(MISSING)q%!D(MISSING)%!i(MISSING)frameid%!D(MISSING)local-gen-de113467-1540-462a-b93c-224d4767004d%!C(MISSING)%2C%!C(MISSING)%!i(MISSING)frameid%!C(MISSING)%3A%!C(MISSING)%!l(MISSING)ocal-gen-de113467-1540-462a-b93c-224d4767004d%!C(MISSING)}%2C%!T(MISSING)%3A%!C(MISSING)I.SystemEvent%2C%!T(MISSING)S%3A1706489662%!C(MISSING)%!N(MISSING)ame%3A%!I(MISSING)FrameCreation%2C%!F(MISSING)ID%3A%!C(MISSING)odex}%!D(MISSING)": Not Found
2024-01-29 00:54:22,210 CRIT uncaptured python exception, closing channel  (stdout)> (:[Errno 29] Illegal seek [/usr/lib/python3/dist-packages/supervisor/supervisord.py|runforever|220] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|handle_read_event|270] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|record_output|204] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|_log|173] [/usr/lib/python3/dist-packages/supervisor/loggers.py|info|327] [/usr/lib/python3/dist-packages/supervisor/loggers.py|log|345] [/usr/lib/python3/dist-packages/supervisor/loggers.py|emit|227] [/usr/lib/python3/dist-packages/supervisor/loggers.py|doRollover|264])
2024/01/29 00:55:03 [Info] IP: <IP_ADDRESS>:41806 Request: POST /
2024-01-29 00:55:03,309 CRIT uncaptured python exception, closing channel  (stderr)> (:[Errno 29] Illegal seek [/usr/lib/python3/dist-packages/supervisor/supervisord.py|runforever|220] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|handle_read_event|270] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|record_output|204] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|_log|173] [/usr/lib/python3/dist-packages/supervisor/loggers.py|info|327] [/usr/lib/python3/dist-packages/supervisor/loggers.py|log|345] [/usr/lib/python3/dist-packages/supervisor/loggers.py|emit|227] [/usr/lib/python3/dist-packages/supervisor/loggers.py|doRollover|264])
2024/01/29 00:55:03 [Info] Browser PID: 0
2024-01-29 00:55:03,578 CRIT uncaptured python exception, closing channel  (stderr)> (:[Errno 29] Illegal seek [/usr/lib/python3/dist-packages/supervisor/supervisord.py|runforever|220] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|handle_read_event|270] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|record_output|204] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|_log|173] [/usr/lib/python3/dist-packages/supervisor/loggers.py|info|327] [/usr/lib/python3/dist-packages/supervisor/loggers.py|log|345] [/usr/lib/python3/dist-packages/supervisor/loggers.py|emit|227] [/usr/lib/python3/dist-packages/supervisor/loggers.py|doRollover|264])
Get "https://www.bing.com/fd/ls/l?IG=H9S2ELIQW7SJIGS5DOH2EEX3QE903WVS&TYPE=Event.ClientInst&DATA=%!B(MISSING)%!B(MISSING)%!N(MISSING)amespace%3A%!C(MISSING)onversation%2C%!C(MISSING)ustomData%3A{%!C(MISSING)%!h(MISSING)ref%!C(MISSING)%3A%!C(MISSING)%!h(MISSING)ttps%!A(MISSING)%!F(MISSING)%!F(MISSING)www.bing.com%!F(MISSING)turing%!F(MISSING)captcha%!F(MISSING)challenge%!F(MISSING)q%!D(MISSING)%!i(MISSING)frameid%!D(MISSING)local-gen-e23bd1dd-8bea-43ab-9a64-a91d17b6b0e9%!C(MISSING)%2C%!C(MISSING)%!i(MISSING)frameid%!C(MISSING)%3A%!C(MISSING)%!l(MISSING)ocal-gen-e23bd1dd-8bea-43ab-9a64-a91d17b6b0e9%!C(MISSING)}%2C%!T(MISSING)%3A%!C(MISSING)I.SystemEvent%2C%!T(MISSING)S%3A1706489703%!C(MISSING)%!N(MISSING)ame%3A%!I(MISSING)FrameCreation%2C%!F(MISSING)ID%3A%!C(MISSING)odex}%!D(MISSING)": Not Found
2024-01-29 00:55:03,619 CRIT uncaptured python exception, closing channel  (stdout)> (:[Errno 29] Illegal seek [/usr/lib/python3/dist-packages/supervisor/supervisord.py|runforever|220] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|handle_read_event|270] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|record_output|204] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|_log|173] [/usr/lib/python3/dist-packages/supervisor/loggers.py|info|327] [/usr/lib/python3/dist-packages/supervisor/loggers.py|log|345] [/usr/lib/python3/dist-packages/supervisor/loggers.py|emit|227] [/usr/lib/python3/dist-packages/supervisor/loggers.py|doRollover|264])
2024/01/29 00:55:19 error value: mzcb5xqaU.ezWg91j2iGKu{}
2024-01-29 00:55:19,589 CRIT uncaptured python exception, closing channel  (stderr)> (:[Errno 29] Illegal seek [/usr/lib/python3/dist-packages/supervisor/supervisord.py|runforever|220] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|handle_read_event|270] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|record_output|204] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|_log|173] [/usr/lib/python3/dist-packages/supervisor/loggers.py|info|327] [/usr/lib/python3/dist-packages/supervisor/loggers.py|log|345] [/usr/lib/python3/dist-packages/supervisor/loggers.py|emit|227] [/usr/lib/python3/dist-packages/supervisor/loggers.py|doRollover|264])
2024/01/29 00:55:19 error value: &eJt0dpHGJUL4.gmyJEsHKkRv{cgtJhL:"context canceled"}
2024-01-29 00:55:19,629 CRIT uncaptured python exception, closing channel  (stderr)> (:[Errno 29] Illegal seek [/usr/lib/python3/dist-packages/supervisor/supervisord.py|runforever|220] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|handle_read_event|270] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|record_output|204] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|_log|173] [/usr/lib/python3/dist-packages/supervisor/loggers.py|info|327] [/usr/lib/python3/dist-packages/supervisor/loggers.py|log|345] [/usr/lib/python3/dist-packages/supervisor/loggers.py|emit|227] [/usr/lib/python3/dist-packages/supervisor/loggers.py|doRollover|264])
2024/01/29 00:55:19 http: panic serving <IP_ADDRESS>:42246: context deadline exceeded
2024-01-29 00:55:19,925 CRIT uncaptured python exception, closing channel  (stderr)> (:[Errno 29] Illegal seek [/usr/lib/python3/dist-packages/supervisor/supervisord.py|runforever|220] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|handle_read_event|270] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|record_output|204] [/usr/lib/python3/dist-packages/supervisor/dispatchers.py|_log|173] [/usr/lib/python3/dist-packages/supervisor/loggers.py|info|327] [/usr/lib/python3/dist-packages/supervisor/loggers.py|log|345] [/usr/lib/python3/dist-packages/supervisor/loggers.py|emit|227] [/usr/lib/python3/dist-packages/supervisor/loggers.py|doRollover|264])


Update the README file to include types

I've created this PR as I was having trouble figuring out where to find the types. I eventually found them in this GH thread: https://github.com/jaredpalmer/cypress-image-snapshot/issues/252#issuecomment-1376893399 so thought it easier to just update the README with them there :)

Thanks @willwearing, the next version will have TS support built in :)


Increase re-connection attempts

Task/Issue URL: https://app.asana.com/0/488551667048375/1205568854995139/f
Description
Increase the reconnection attempts for NetP
Steps to test this PR
Run test cases

Current dependencies on/for this PR:

develop

PR #3627   👈

This comment was auto-generated by Graphite.


build stability problem

[~/Workspaces/kivakit-1.6/feature/telenav-superpom] ./release.sh
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for com.telenav:telenav-root-superpom:pom:1.0.1
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-source-plugin is missing. @ line 382, column 29
[WARNING]
[WARNING] Some problems were encountered while building the effective model for com.telenav:telenav-superpom:pom:2.0.3
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-source-plugin is missing. @ com.telenav:telenav-root-superpom:1.0.0, /Users/jonathan/.m2/repository/com/telenav/telenav-root-superpom/1.0.0/telenav-root-superpom-1.0.0.pom, line 377, column 29
[WARNING]
[WARNING] Some problems were encountered while building the effective model for com.telenav:telenav-superpom-project-family:pom:2.0.2
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-source-plugin is missing. @ com.telenav:telenav-root-superpom:1.0.0, /Users/jonathan/.m2/repository/com/telenav/telenav-root-superpom/1.0.0/telenav-root-superpom-1.0.0.pom, line 377, column 29
[WARNING]
[WARNING] Some problems were encountered while building the effective model for com.telenav:telenav-superpom-project:pom:2.0.3
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-source-plugin is missing. @ com.telenav:telenav-root-superpom:1.0.0, /Users/jonathan/.m2/repository/com/telenav/telenav-root-superpom/1.0.0/telenav-root-superpom-1.0.0.pom, line 377, column 29
[WARNING] 'build.plugins.plugin.version' for com.telenav.cactus:cactus-maven-plugin is missing. @ line 132, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for com.telenav.kivakit:telenav-superpom-kivakit:pom:2.0.6
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-source-plugin is missing. @ com.telenav:telenav-root-superpom:1.0.0, /Users/jonathan/.m2/repository/com/telenav/telenav-root-superpom/1.0.0/telenav-root-superpom-1.0.0.pom, line 377, column 29
[WARNING] 'build.plugins.plugin.version' for com.telenav.cactus:cactus-maven-plugin is missing. @ com.telenav:telenav-superpom-project:2.0.2, /Users/jonathan/.m2/repository/com/telenav/telenav-superpom-project/2.0.2/telenav-superpom-project-2.0.2.pom, line 132, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for com.telenav.mesakit:telenav-superpom-mesakit:pom:2.0.6
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-source-plugin is missing. @ com.telenav:telenav-root-superpom:1.0.0, /Users/jonathan/.m2/repository/com/telenav/telenav-root-superpom/1.0.0/telenav-root-superpom-1.0.0.pom, line 377, column 29
[WARNING] 'build.plugins.plugin.version' for com.telenav.cactus:cactus-maven-plugin is missing. @ com.telenav:telenav-superpom-project:2.0.2, /Users/jonathan/.m2/repository/com/telenav/telenav-superpom-project/2.0.2/telenav-superpom-project-2.0.2.pom, line 132, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for com.telenav.lexakai:telenav-superpom-lexakai:pom:2.0.6
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-source-plugin is missing. @ com.telenav:telenav-root-superpom:1.0.0, /Users/jonathan/.m2/repository/com/telenav/telenav-root-superpom/1.0.0/telenav-root-superpom-1.0.0.pom, line 377, column 29
[WARNING] 'build.plugins.plugin.version' for com.telenav.cactus:cactus-maven-plugin is missing. @ com.telenav:telenav-superpom-project:2.0.2, /Users/jonathan/.m2/repository/com/telenav/telenav-superpom-project/2.0.2/telenav-superpom-project-2.0.2.pom, line 132, column 21
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]

I have explained the reason for this many times already:
We use a small hack to get our local builds to use the latest cactus if present, and if not, fall back to the previous version:

You can't specify a range dependency in a <plugin> entry
But you can in a <dependencyManagement> entry, and Maven will use it if you don't give it any other version to use

I intend to find a better solution for this, but for now, this works, and there are higher priority things than a harmless warning to solve.

yeah, just recording this so we don't forget it.


Validators for relationships

Primarily to resolve #3903

@lpalashevski @danielaotelea can someone test that this at least now logs an issue and raises a RepositoryErrorException in such scenarios as documented in #3903 ?

@lpalashevski @danielaotelea can someone test that this at least now logs an issue and raises a RepositoryErrorException in such scenarios as documented in #3903 ?

@cmgrote we will pick it up with the regular regression testing we do but most probably will not be reproduced due to the test data we use. Hope that somewhere next week we will check with the product team to test it on the environment where this was originally discovered.

We cannot merge this change do to subject-area FVT failing build checks with following exeption:
Error:    RelationshipsIT.testRelationships:17 Unexpected exception thrown: org.odpi.openmetadata.frameworks.connectors.ffdc.PropertyServerException: OMAG-COMMON-400-016 An unexpected org.odpi.openmetadata.accessservices.subjectarea.handlers.SubjectAreaRelationshipHandler exception was caught by restore for Synonym; error message was OMAG-REPOSITORY-HANDLER-500-001 An unexpected error org.odpi.openmetadata.repositoryservices.ffdc.exception.RelationshipNotKnownException was returned to restoreRelationship(deprecated) by the metadata server during restoreSynonym request for open metadata access service Subject Area OMAS on server serverinmem; message was OMRS-REPOSITORY-404-012 The Synonym relationship identified with guid 14e101ed-bf54-4c99-912e-c94b862a3f4f passed on the getRelationship call is soft-deleted in the open metadata repository serverinmem
This is the case for both graph and in-mem repo tests.
Not completely sure but looks like the test should be aligned with the new validation logic for relationships.
@davidradl can you please check?

Subject-area FVT failing build checks with following exception:
Error: RelationshipsIT.testRelationships:17 Unexpected exception thrown: org.odpi.openmetadata.frameworks.connectors.ffdc.PropertyServerException: OMAG-COMMON-400-016 An unexpected org.odpi.openmetadata.accessservices.subjectarea.handlers.SubjectAreaRelationshipHandler exception was caught by restore for Synonym; error message was OMAG-REPOSITORY-HANDLER-500-001 An unexpected error org.odpi.openmetadata.repositoryservices.ffdc.exception.RelationshipNotKnownException was returned to restoreRelationship(deprecated) by the metadata server during restoreSynonym request for open metadata access service Subject Area OMAS on server serverinmem; message was OMRS-REPOSITORY-404-012 The Synonym relationship identified with guid 14e101ed-bf54-4c99-912e-c94b862a3f4f passed on the getRelationship call is soft-deleted in the open metadata repository serverinmem
This is the case for both graph and in-mem repo tests.
Not completely sure but looks like the test should be aligned with the new validation logic for relationships.
@davidradl can you please check?

Sure @lpalashevski I will check it out.

From the error message, it is complaining that a restore is being attempted on a soft deleted relationship. But the only relationships that can be restored are those that are soft deleted. I can see that line 5374 in LocalOMRSMetadataCollection  is called while processing restoreRelationship.
    Relationship relationship = realMetadataCollection.getRelationship(userId, deletedRelationshipGUID);
The getRelationship validation checks that the guid is associated with a non-deleted relationship.
In the case of restore it needs to check that the relationship is deleted.

@cmgrote drawing your attention to my comment above. It seems that this getRelationship validation breaks restoreRelationship, which is incorrectly using getRelationship (where your new validation is). An easy fix would be to remove the getRelationships call from restoreRelationship, a better fix would be for LocalOMRSMetadataCollection restoreRelationship to validate that the passed guid is known and soft deleted (restoreRelationship processing may already do this later) prior to calling the restoreRelationship implementation.

I'll go for the simple fix (for now) as this most closely matches the current behaviour...  Since getRelationship only operates on active relationships, I think to do a validation against any deleted relationship would require running a search (eg. findRelationshipsByProperty) which would be a (potentially much) more expensive operation than what we're doing elsewhere...

@lpalashevski can you re-test in the scenario that was failing previously?  At least the PR should build and pass all FVTs again now.

@lpalashevski can you re-test in the scenario that was failing previously? At least the PR should build and pass all FVTs again now.

Yes we will. Can we merge it to master already once the checks finish?


Align keyword ordering and operation ordering netfx/netcore

This one deals with keyword ordering and operation ordering, as well as adding some missing keywords.
No code logic has changed, so should be straight forward to review I hope
Part of #2953

/azp run


Fix hruby by adding ruby_2_1 dependency

This works locally with the current default ghc (still 7.8.4)
I had to disable testing as it cannot find the test ruby file
PS: I haven't figured out how to enable the package back into the hydra system as it is currently disabled.

сс @peti

Just check it with 7.10.1 (that is now the default in the master branch) and it works fine.

That's a wrong way to fix haskell pkgs. Let's wait for @peti's answer.

@PierreR, thank you for the fixes. I've added appropriate overrides in https://github.com/peti/nixpkgs/commit/e83e110d55b884c1490762057be383c6d96eda26. I'll merge to master as soon as the test builds are done.
The Hydra builds are controlled by cabal2nix. https://github.com/NixOS/cabal2nix/commit/a6a28c6dd88afbff1f01f73e0de87ee9e21c69d0 enables them for hruby again.

@peti Thanks. I have learned a lot from your fix ;-)
The tests are actually failing because it does not find test ruby file ?
Do you know how to fix this ? Add it as an extra files in cabal would do the job ?

@PierreR, yes, the file was missing from the release tarball. This problem was fixed upstream in https://github.com/bartavelle/hruby/commit/22785b8bca9c6bd518c2d9dcc42898c9a8feeea4 (by adding an extra-files: stanza).


[Refactor] refactor hive auto sync

What type of PR is this：

[ ] BugFix
[ ] Feature
[ ] Enhancement
[ ] Refactor
[ ] UT
[ ] Doc
[ ] Tool

Which issues of this PR fixes ：

Fixes #
adjust https://github.com/StarRocks/starrocks/pull/12569
Problem Summary(Required) ：

Checklist:

[ ] I have added test cases for my bug fix or my new feature
[ ] I have added user document for my new feature or new function

run starrocks_admit_test

BE Build Success

run starrocks_admit_test

[FE PR Coverage Check]
:disappointed: fail : 19 / 207 (09.18%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/catalog/Database.java
0
1
00.00%
[852]

:large_blue_circle:
com/starrocks/connector/hive/HiveMetastore.java
0
2
00.00%
[177, 178]

:large_blue_circle:
com/starrocks/scheduler/PartitionBasedMaterializedViewRefreshProcessor.java
0
1
00.00%
[163]

:large_blue_circle:
com/starrocks/connector/hudi/HudiMetadata.java
0
1
00.00%
[154]

:large_blue_circle:
com/starrocks/connector/hive/HiveMetadata.java
0
1
00.00%
[155]

:large_blue_circle:
com/starrocks/server/MetadataMgr.java
0
1
00.00%
[149]

:large_blue_circle:
com/starrocks/connector/hive/HiveMetaClient.java
0
4
00.00%
[290, 301, 302, 303]

:large_blue_circle:
com/starrocks/connector/hive/events/DropPartitionEvent.java
0
5
00.00%
[44, 83, 94, 95, 96]

:large_blue_circle:
com/starrocks/connector/hive/events/AlterPartitionEvent.java
0
7
00.00%
[79, 108, 109, 110, 112, 113, 115]

:large_blue_circle:
com/starrocks/connector/hive/events/AlterTableEvent.java
0
11
00.00%
[99, 100, 102, 136, 137, 138, 139, 141, 142, 143, 144]

:large_blue_circle:
com/starrocks/connector/hive/events/InsertEvent.java
0
17
00.00%
[48, 49, 50, 51, 87, 90, 110, 113, 114, 115, 116, 118, 120, 121, 122, 123, 124]

:large_blue_circle:
com/starrocks/server/LocalMetastore.java
0
1
00.00%
[322]

:large_blue_circle:
com/starrocks/server/GlobalStateMgr.java
0
1
00.00%
[3094]

:large_blue_circle:
com/starrocks/connector/hive/events/DropTableEvent.java
0
3
00.00%
[52, 71, 72]

:large_blue_circle:
com/starrocks/connector/PartitionUtil.java
0
12
00.00%
[117, 118, 119, 120, 121, 123, 124, 125, 126, 127, 128, 129]

:large_blue_circle:
com/starrocks/connector/hive/IHiveMetastore.java
0
2
00.00%
[41, 44]

:large_blue_circle:
com/starrocks/connector/hive/CachingHiveMetastore.java
0
33
00.00%
[293, 303, 342, 343, 344, 359, 360, 361, 362, 363, 364, 365, 369, 370, 371, 374, 378, 382, 383, 384, 387, 388, 389, 390, 392, 393, 394, 395, 402, 403, 404, 405, 406]

:large_blue_circle:
com/starrocks/connector/hive/CacheUpdateProcessor.java
3
67
04.48%
[32, 33, 34, 65, 66, 67, 68, 69, 74, 75, 76, 77, 78, 79, 80, 82, 83, 84, 85, 86, 87, 88, 93, 94, 95, 96, 97, 98, 99, 100, 102, 103, 104, 106, 108, 109, 115, 117, 118, 121, 123, 129, 137, 141, 145, 146, 147, 150, 152, 153, 155, 163, 164, 165, 166, 169, 170, 171, 172, 173, 174, 179, 180, 186]

:large_blue_circle:
com/starrocks/connector/hive/events/MetastoreEventsProcessor.java
3
12
25.00%
[80, 81, 85, 86, 199, 200, 201, 202, 203]

:large_blue_circle:
com/starrocks/connector/hive/events/MetastoreEventFactory.java
3
11
27.27%
[34, 74, 75, 77, 78, 79, 80, 83]

:large_blue_circle:
com/starrocks/connector/CachingRemoteFileIO.java
1
2
50.00%
[103]

:large_blue_circle:
com/starrocks/catalog/HiveTable.java
2
4
50.00%
[378, 386]

:large_blue_circle:
com/starrocks/connector/hive/HiveConnector.java
4
5
80.00%
[74]

:large_blue_circle:
com/starrocks/connector/hive/HiveMetadataFactory.java
3
3
100.00%
[]

run starrocks_admit_test

[FE PR Coverage Check]
:disappointed: fail : 34 / 211 (16.11%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/catalog/Database.java
0
1
00.00%
[852]

:large_blue_circle:
com/starrocks/connector/hive/HiveMetastore.java
0
2
00.00%
[177, 178]

:large_blue_circle:
com/starrocks/scheduler/PartitionBasedMaterializedViewRefreshProcessor.java
0
1
00.00%
[163]

:large_blue_circle:
com/starrocks/connector/hudi/HudiMetadata.java
0
1
00.00%
[154]

:large_blue_circle:
com/starrocks/connector/hive/HiveMetadata.java
0
1
00.00%
[155]

:large_blue_circle:
com/starrocks/server/MetadataMgr.java
0
1
00.00%
[149]

:large_blue_circle:
com/starrocks/connector/hive/HiveMetaClient.java
0
4
00.00%
[290, 301, 302, 303]

:large_blue_circle:
com/starrocks/connector/hive/events/DropPartitionEvent.java
0
5
00.00%
[44, 83, 94, 95, 96]

:large_blue_circle:
com/starrocks/connector/hive/events/AlterPartitionEvent.java
0
7
00.00%
[79, 108, 109, 110, 112, 113, 115]

:large_blue_circle:
com/starrocks/connector/hive/events/AlterTableEvent.java
0
11
00.00%
[99, 100, 102, 136, 137, 138, 139, 141, 142, 143, 144]

:large_blue_circle:
com/starrocks/connector/hive/events/InsertEvent.java
0
17
00.00%
[48, 49, 50, 51, 87, 90, 110, 113, 114, 115, 116, 118, 120, 121, 122, 123, 124]

:large_blue_circle:
com/starrocks/server/LocalMetastore.java
0
1
00.00%
[322]

:large_blue_circle:
com/starrocks/server/GlobalStateMgr.java
0
1
00.00%
[3094]

:large_blue_circle:
com/starrocks/connector/hive/events/DropTableEvent.java
0
3
00.00%
[52, 71, 72]

:large_blue_circle:
com/starrocks/connector/hive/IHiveMetastore.java
0
2
00.00%
[41, 44]

:large_blue_circle:
com/starrocks/connector/hive/CachingHiveMetastore.java
0
33
00.00%
[293, 303, 342, 343, 344, 359, 360, 361, 362, 363, 364, 365, 369, 370, 371, 374, 378, 382, 383, 384, 387, 388, 389, 390, 392, 393, 394, 395, 402, 403, 404, 405, 406]

:large_blue_circle:
com/starrocks/connector/hive/CacheUpdateProcessor.java
3
67
04.48%
[32, 33, 34, 64, 65, 66, 67, 68, 73, 74, 75, 76, 77, 78, 79, 81, 82, 83, 84, 85, 86, 87, 92, 93, 94, 95, 96, 97, 98, 99, 101, 102, 103, 105, 107, 108, 114, 116, 117, 120, 122, 128, 136, 140, 144, 145, 146, 149, 151, 152, 154, 162, 163, 164, 165, 168, 169, 170, 171, 172, 173, 178, 179, 185]

:large_blue_circle:
com/starrocks/connector/hive/events/MetastoreEventsProcessor.java
3
12
25.00%
[80, 81, 85, 86, 199, 200, 201, 202, 203]

:large_blue_circle:
com/starrocks/connector/hive/events/MetastoreEventFactory.java
3
11
27.27%
[34, 74, 75, 77, 78, 79, 80, 83]

:large_blue_circle:
com/starrocks/connector/CachingRemoteFileIO.java
2
4
50.00%
[88, 89]

:large_blue_circle:
com/starrocks/catalog/HiveTable.java
2
4
50.00%
[378, 386]

:large_blue_circle:
com/starrocks/connector/hive/HiveConnector.java
4
5
80.00%
[74]

:large_blue_circle:
com/starrocks/connector/hive/HiveConnectorInternalMgr.java
2
2
100.00%
[]

:large_blue_circle:
com/starrocks/connector/hive/HiveMetadataFactory.java
3
3
100.00%
[]

:large_blue_circle:
com/starrocks/connector/PartitionUtil.java
12
12
100.00%
[]

[FE PR Coverage Check]
:disappointed: fail : 35 / 213 (16.43%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/catalog/Database.java
0
1
00.00%
[852]

:large_blue_circle:
com/starrocks/connector/hive/HiveMetastore.java
0
2
00.00%
[177, 178]

:large_blue_circle:
com/starrocks/scheduler/PartitionBasedMaterializedViewRefreshProcessor.java
0
1
00.00%
[163]

:large_blue_circle:
com/starrocks/connector/hudi/HudiMetadata.java
0
1
00.00%
[154]

:large_blue_circle:
com/starrocks/connector/hive/HiveMetadata.java
0
1
00.00%
[155]

:large_blue_circle:
com/starrocks/server/MetadataMgr.java
0
1
00.00%
[149]

:large_blue_circle:
com/starrocks/connector/hive/HiveMetaClient.java
0
4
00.00%
[290, 301, 302, 303]

:large_blue_circle:
com/starrocks/connector/hive/events/DropPartitionEvent.java
0
5
00.00%
[44, 83, 94, 95, 96]

:large_blue_circle:
com/starrocks/connector/hive/events/AlterPartitionEvent.java
0
7
00.00%
[79, 108, 109, 110, 112, 113, 115]

:large_blue_circle:
com/starrocks/connector/hive/events/AlterTableEvent.java
0
11
00.00%
[99, 100, 102, 136, 137, 138, 139, 141, 142, 143, 144]

:large_blue_circle:
com/starrocks/connector/hive/events/InsertEvent.java
0
17
00.00%
[48, 49, 50, 51, 87, 90, 110, 113, 114, 115, 116, 118, 120, 121, 122, 123, 124]

:large_blue_circle:
com/starrocks/server/LocalMetastore.java
0
1
00.00%
[322]

:large_blue_circle:
com/starrocks/server/GlobalStateMgr.java
0
1
00.00%
[3094]

:large_blue_circle:
com/starrocks/connector/hive/events/DropTableEvent.java
0
3
00.00%
[52, 71, 72]

:large_blue_circle:
com/starrocks/connector/hive/IHiveMetastore.java
0
2
00.00%
[41, 44]

:large_blue_circle:
com/starrocks/connector/hive/CachingHiveMetastore.java
0
33
00.00%
[293, 303, 342, 343, 344, 359, 360, 361, 362, 363, 364, 365, 369, 370, 371, 374, 378, 382, 383, 384, 387, 388, 389, 390, 392, 393, 394, 395, 402, 403, 404, 405, 406]

:large_blue_circle:
com/starrocks/connector/hive/CacheUpdateProcessor.java
3
67
04.48%
[32, 33, 34, 64, 65, 66, 67, 68, 73, 74, 75, 76, 77, 78, 79, 81, 82, 83, 84, 85, 86, 87, 92, 93, 94, 95, 96, 97, 98, 99, 101, 102, 103, 105, 107, 108, 114, 116, 117, 120, 122, 128, 136, 140, 144, 145, 146, 149, 151, 152, 154, 162, 163, 164, 165, 168, 169, 170, 171, 172, 173, 178, 179, 185]

:large_blue_circle:
com/starrocks/connector/hive/events/MetastoreEventFactory.java
3
11
27.27%
[34, 74, 75, 77, 78, 79, 80, 83]

:large_blue_circle:
com/starrocks/connector/hive/events/MetastoreEventsProcessor.java
4
14
28.57%
[72, 82, 83, 87, 88, 201, 202, 203, 204, 205]

:large_blue_circle:
com/starrocks/connector/CachingRemoteFileIO.java
2
4
50.00%
[88, 89]

:large_blue_circle:
com/starrocks/catalog/HiveTable.java
2
4
50.00%
[378, 386]

:large_blue_circle:
com/starrocks/connector/hive/HiveConnector.java
4
5
80.00%
[74]

:large_blue_circle:
com/starrocks/connector/hive/HiveConnectorInternalMgr.java
2
2
100.00%
[]

:large_blue_circle:
com/starrocks/connector/hive/HiveMetadataFactory.java
3
3
100.00%
[]

:large_blue_circle:
com/starrocks/connector/PartitionUtil.java
12
12
100.00%
[]

run starrocks_admit_test

run starrocks_admit_test


Shared doc doesn't appear on initial page load for restricted member

To reproduce this bug, please follow the steps below:

Clear the history
Log in as ctrance2 or ctrance4
Doc list didn't show shared file Jellyfish.jpg
Refresh the page, only then the shared file will appear.

I attempted to reproduce this as follows and was unable to:

added mobilize-teacher

I attempted to reproduce with the following (sorry for the rogue comment):

added mobilize-teacher to cathy:test class
logged in as mobilize teacher from incognito window and private browsing window in FF  (which gives me a history and cache-free browsing experience).
I was able to view Jellyfish and another shared doc that mobilize-teacher only has a restricted member permission for on first load.

I'm not really sure what could be going on in this case, but I don't use any permanent storage in this app and do a /app/document/read call on every page refresh, getting all data from the server each time. The server would have to return two different sets of data each time in order for this to happen (which could happen if the state changed between refreshes).
@ctrance if this is still happening, could I have you re-try and provide me some info from the console? I added a logger to print out a big json blob of the result from the server, so we can compare the output from the server on each page load:

load page on first try, and if doc is not available, provideconsole console content
load page on second try, if doc has appeared, provide console again.
(feel free to email these two blobs to me, since they may content semi-private data).

I can no longer reproduce this error, which might have been caused by unstable server during my testing time. I'm closing this now.

cool! good to know...I was getting concerned about the potential of a server bug for a minute there :) thanks @ctrance


fix: Extended gitignore, added missing req and fixed f-string issue

Added missing requirement
Extended gitignore
Fixed f-string error in main

merged.


how to run it ?Many files does not exist！hope u help me！

Please specify which file does not exist?

Please specify which file does not exist?

there is no "vgg.h5" file.I downloaded file from "https://github.com/fchollet/deep-learning-models/releases/download/v0.1/vgg16_weights_th_dim_ordering_th_kernels.h5",but cannt run @beratkurar

Github limits the size of files that can be uploaded. Therefore I am not able to upload it to the repository.

Github limits the size of files that can be uploaded. Therefore I am not able to upload it to the repository.
Would u mind provided some advice for me  about the problem?
whats the dataset? What are the parameters of the network？（vgg.h5）

Here is the paper:
https://www.cs.bgu.ac.il/~berat/papers/Icfhr2018Text.pdf


Fixes 1848 : Option for adding location for those pictures which have no location

Description (required)
Fixes #1848
Some images don't have the location. It's very important to have a location for an upload.

Suggesting user to add location.
Map icon in the upload wizard is available for no location images too to add the location.
Skip option is also available.

Tests performed (required)
Tested latest master ProdDebug on Pixel 3 with API level 30.

@nicolas-raoul In my local environment, this PR is building without any problem. But here I can see a grade build failure. This PR is up to date with the latest master.

@Ayan-10 Sometimes CI does not work. Please do not worry too much about it, except if that happens for several commits in succession.

Understood! Would you mind creating a new issue, if possible with reproduction steps? Thanks a lot!

@nicolas-raoul The issue has been created.

Would you mind rebasing? Thanks :-)

Sure, I will add tests.
As, this is very related enhancement I will save the last location in this PR.
Thanks


Remove sponsor level

@razzeee can you remove the item "What level of sponsorship are you interested in?" from the list? then it's good for merge :) thanks!

Done

good to merge then :+1:


takeEnd is wrong for surrogate pairs

for example:
> I.showText "fo𐐷"
"Text [102,111,55297,56375] 0 4"
> I.showText $ T.takeEnd 1 "fo𐐷"
"Text [56375] 3 1"               -- instead of "Text [55297,56375] 2 2"
> I.showText $ T.takeEnd 2 "fo𐐷"
"Text [111,55297,56375] 1 3"     -- correct
[] λ> I.showText $ T.takeEnd 2 "f𐐷o"
"Text [56375,111] 2 2"           -- instead of "Text [55297,56375,111] 1 3"

the base case  | m <= 1    = i is wrong in iterNEnd since the invariant is: i points to the last Word16 of the code point, not the first one

this is bad because then e.g.:
> T.encodeUtf8 $ T.takeEnd 2 "f𐐷o"
"\237\176\183o"

> T.decodeUtf8 . T.encodeUtf8 $ T.takeEnd 2 "f𐐷o"
*** Exception: Cannot decode byte '\xb0': Data.Text.Internal.Encoding.decodeUtf8: Invalid UTF-8 stream

dropEnd has a similar problem:
> I.showText $ T.dropEnd 2 "f𐐷o"
"Text [102,55297] 0 2"

cf that with drop, which works fine:
> I.showText  $ T.drop 1 "f𐐷o"
"Text [55297,56375,111] 1 3"
> I.showText  $ T.drop 2 "f𐐷o"
"Text [111] 3 1"

i looked at Test.QuickCheck.Arbitrary and found part of the problem:
instance Arbitrary Char where
  arbitrary = chr `fmap` oneof [choose (0,127), choose (0,255)]

i.e. it seems that most of the tests for Data.Text (if not all) just check the behaviour for ASCII...


Using CoGe for genomics pipeline

CoGe is a genomics pipeline developed by @mbomhoff and @elyons.
Following the Dec 11 2015 standards committee meeting, CoGe can provide the pipeline defined in terraref/reference-data#19 as well as a web interface and REST API.
There is an instance at U Arizona (https://genomevolution.org/coge/) hosted by Eric Lyons that is available for researchers to use. If prudent we can create VM / docker files for use locally.
CoGe Documentation

Homepage https://genomevolution.org/coge/
The workflow is described here: https://genomevolution.org/wiki/index.php?title=LoadExperiment
Documentation for installing CoGe on a Ubuntu server: https://genomevolution.org/wiki/index.php/Install_coge
The REST API is documented here: https://docs.google.com/document/d/1GXOPIVvyTwoGR2IRjDNmdd2nj_6d8db7jx9hG8RxTDc/edit
Yerba is a job management framework developed for CoGe by @mbomhoff

Next steps:

[x] @max-zilla assess feasibility of creating a CoGe VM or Docker file hosted on OpenStack?

[ ] Where is computing done? How will VM submit jobs to HPC queue?
we will run the analyses remotely at UA

[x] Get example data and meta-data from Danforth to develop / demonstrate the pipeline

[x] How should data be transferred (@jdmaloney)?
[ ] what is unique identifier for an accession (@nfahlgren)? (addressed by terraref/reference-data#65)
[x] Which reference genome should we use?

[ ] Define API calls for

[x] uploading data to Cyverse data store using i-commands Documentation
[ ] calling the desired CoGe pipeline (see examples for creating an experiment

[ ] user may also want to use tools for downstream analysis - how should these be coupled to the CoGe pipeline?

GOBII being used by the UI / Gore / Buckler teams
For addtional analyses (e.g. de novo sequencing?) we can start with the scripted pipelines used by HPCBio (Documentation).

I am currently moving some example data for pipeline development to the Roger server (provided by @nfahlgren et al):

paired-end DNA sequencing files in FASTQ format (for each sample there are two files, one for each end of the DNA fragments).
files are individually gzipped, with a total compressed size of 600GB. They will be unzipped following transfer
will be stored on Roger in /home/dlebauer/terraref/genomics until further notice

Are the data to analyze in CoGe (e.g. 600GB sample) totally distinct from the imagery data we're getting from LemnaTec? I was planning to represent the genomics pipeline somehow in revising that architecture diagram - is there a vision for launching a CoGe VM from Clowder with selected data like we are doing with PlantCV, for example? Is it largely separate from the phenomics workflow?

Are the data ... distinct from the imagery data ...?

Yes. the betydb.cultivars table will link to accessions in the genomics database. A genomics analysis would then query vectors / arrays of data associated with a unique record in the cultivars table.

is there a vision for launching a CoGe VM from Clowder with selected data like we are doing with PlantCV, for example?

Yes. In both cases, the VM/docker will need to access to HPC computing resources

Is it largely separate from the phenomics workflow?

Yes. The big picture is that the phenomics workflow will fill rows in the betydb.traits table for each plant, plot, or unit of replication; it will also send files to the betydb.dbfiles table.

@nfahlgren This is the coge pipeline I ran https://genomevolution.org/r/j8c7
I'd appreciate feedback on the settings, the pipeline configuration, and if we will be able to run the fastq files through CoGe in this way.

@dlebauer I can only see the steps that were run but it looks good in general. The FPKM/cufflinks section would not be needed in this case since the uploaded fastq files are DNA sequences rather than RNA. I'm not familiar with all the programs they use, but based on the file exchange formats it looks like the right steps that we need to get polymorphism calls. An hour and a half to completely process one fastq file also seems very reasonable.

@dlebauer I can only see the steps that were run but it looks good generally. This input file has genomic DNA sequences, so the steps involving FPKM/cufflinks would not be necessary since those are for RNA expression.
I'm not familiar with all the particular programs they implement but it looks like it outputs what we need (polymorphism calls) and takes care of all the steps in between.
One thing to think about is that in this example you uploaded a single fastq file, which is valid for experiments done with single-end sequencing, but I think we will be doing paired-end sequencing, so there will be two input files per sample (sequences from the left and right ends of the same DNA fragment). I assume they have both single- and paired-end modes?

Yes, CoGe supports both single and paired end reads.

On Jan 21, 2016, at 9:42 AM, Noah Fahlgren<EMAIL_ADDRESS>wrote:
@dlebauer https://github.com/dlebauer I can only see the steps that were run but it looks good generally. This input file has genomic DNA sequences, so the steps involving FPKM/cufflinks would not be necessary since those are for RNA expression.
I'm not familiar with all the particular programs they implement but it looks like it outputs what we need (polymorphism calls) and takes care of all the steps in between.
One thing to think about is that in this example you uploaded a single fastq file, which is valid for experiments done with single-end sequencing, but I think we will be doing paired-end sequencing, so there will be two input files per sample (sequences from the left and right ends of the same DNA fragment). I assume they have both single- and paired-end modes?
—
Reply to this email directly or view it on GitHub https://github.com/terraref/computing-pipeline/issues/41#issuecomment-173629023.

@elyons and @mbomhoff

We currently have some sample files for testing on our server 'Roger' (roger-login.ncsa.illinois.edu) in /projects/arpae/terraref/raw_data/hudson-alpha/test_data.
The CoGe API documentation indicates that it can take data from the CyVerse Data Store, HTTP, or FTP. I gather the Cyverse data store is easiest / most commonly used and our project has a 2TB allocation.

Are these the next steps:

install icommands on Roger
icommands to transfer from Roger to Cyverse data store,
Then create script to generate API calls based on the template in #69 (from example in CoGe API documentation)

OR
would it be easier to just FTP / HTTPS directly from either Roger or the Clowder front-end (@max-zilla)?
@nfahlgren what is the relevant meta-data that we should send in the API call?

@dlebauer Setting up icommands and transferring the data to the CyVerse
Data Store is ideal method due performance -- the icommands perform
parallel transfers.  For testing small datasets the FTP/HTTP method is
adequate.
On Wed, Mar 9, 2016 at 11:34 AM, David LeBauer<EMAIL_ADDRESS>wrote:

@elyons https://github.com/elyons and @mbomhoff
https://github.com/mbomhoff

We currently have some sample files for testing on our server
'Roger' (roger-login.ncsa.illinois.edu) in
/projects/arpae/terraref/raw_data/hudson-alpha/test_data.
The CoGe API documentation indicates that it can take data from the
CyVerse Data Store, HTTP, or FTP. I gather the Cyverse data store is
easiest / most commonly used and our project has a 2TB allocation.

Are these the next steps:

install icommands
https://pods.iplantcollaborative.org/wiki/display/DS/Using+iCommands
on Roger
icommands to transfer from Roger to Cyverse data store,
Then create script to generate API calls based on the template in #69
https://github.com/terraref/computing-pipeline/pull/69 (from example
in CoGe API documentation
https://docs.google.com/document/d/1GXOPIVvyTwoGR2IRjDNmdd2nj_6d8db7jx9hG8RxTDc/edit#
)

OR
would it be easier to just FTP / HTTPS directly from either Roger or the
Clowder front-end (@max-zilla https://github.com/max-zilla)?
@nfahlgren https://github.com/nfahlgren what is the relevant meta-data
that we should send in the API call?
—
Reply to this email directly or view it on GitHub
https://github.com/terraref/computing-pipeline/issues/41#issuecomment-194440338
.

I just updated the CoGe API spec ("Experiment Add with Downstream Analyses") to reflect minor changes to the JSON request format when we recently added Methylation and ChIP-seq pipelines.

I've started to transfer the files to the iplant datastore. We have a project allocation at /iplant/home/shared/terraref/
(transfer details in the TERRA REF documentation)
The test files are in raw_data/hudson-alpha/test_data/. I've created a folder output/ for CoGe output (perhaps in output/coge/? Is there a convention / preferred method here?
In the raw_data folder Noah has write and Matt has read permissions. Both have write permissions to output/

@nfahlgren  - where are you on this?

I hit two roadblocks:
The Agave API documentation for obtaining a token no longer exists (http://agaveapi.co/authentication-token-management/). I think Ramona told me you have to be on campus to have access to the Agave API currently, but maybe I'm mistaken.
I have access to the /iplant/home/shared/terraref data store through the Discovery Environment, but I don't seem to be able to access any files in it through the CoGe web interface. I can see other data sets in /iplant/home/shared, so maybe our sharing settings are blocking access?

@mbomhoff and @elyons, could you help me out with the comment above? Thanks!

Hi Noah, items in the shared folder aren't automatically made public so you will have to share the terraref folder with the "coge" user.
I think Agave reorganized their docs, check here:  http://developer.agaveapi.co/#authorization

@mbomhoff thanks! The group who generated these data want to keep it private until the publish, does sharing with the coge user make the data public or just makes it available through CoGe?

@nfahlgren I see, yes it will effectively make them public for any user logged into the CoGe web site, however they will remain private within the DE.

@dlebauer it looks like you have to modify the sharing, I don't have permission. Can you share the terraref volume with the users coge and pozersky (Phil from Todd's lab)?

@nfahlgren I gave you owner permissions, and Phil and the CoGe team write permissions on the following directories:

raw_data/
output/
sites/

I put the sites folder on there to be consistent with the directory structure on Roger and Globus. But it is redundant with the original raw_data and output folders. It looks like the original test data is in the raw_data folder. Could you please clean up the directory structure - i.e. merge terraref/raw_data and terraref/sites/hudson-alpha/raw_data, delete what you don't need (is the test data useful?) and etc.
:file_cabinet: 👍

@dlebauer I met with @phloz today to discuss this issue. One thing I realized is that I don't know what our goal is here. What specific things do we want to accomplish? We are (mostly) able to process individual samples, but it's less clear to me how we would aggregate the data into a full data set.

@nfahlgren can you please update this issue and create a new one if we are going to do something else with the documented pipeline?

Phil from Todd’s group is working on this
@nfahlgren and @nshakoor  - where did we leave this? Should we discuss using / contributing to CoGe? Or should we discuss deploying pipeline at NCSA? Both? Other?
CoGe only partially meets our needs.  Should we work with CoGe developers to implement changes?  This may take longer than we have
Can use pipeline that Phil’s group is using.  Should we implement this at NCSA?  Phil will process data at Danforth.  Need to follow up with @dlebauer

David,

I was able to get the CoGe API to work so submissions to CoGe can be done on the command line.    However, after our conference call on Nov. 7th, I steered away from pursing
 the CoGe pipeline based on that conversation.   While I’ll proceed as instructed, I’m still of the opinion that CoGe is not geared to this large of a genomic analysis undertaking because of its limited compute footprint, the difference in pipeline tools compared
 to what I have set up here at the Danforth Center, and to a lesser extent, the addition tools that would have to be added to their pipeline to reach a final product. Matt Bomhoff was very helpful in my communications with him and the CoGe pipeline definitely
 has merit but as I said, not on the scale of 384 genomes and especially with the data size of this second set of 192 lines.  My workflow is currently running and it handled the first set 192 samples but I have had to make some modifications to accommodate
 scaling up to the second set of data.   The data has to progress further into the workflow to have a good handle on when I’ll have a final data product available but will update as best I can its progress and projected completion.

Best,

Phil

Phil,
David and I have both received commitments from Eric Lyons and others at CyVerse that they will continue to improve CoGe and their infrastructure to enable TERRA-REF’s needs. My recommendation is that David do what he can to implement CoGe in the TERRA-REF framework. But if CoGe/CyVerse is insufficient at this time for our internal DDPSC needs then you should use whatever other tools and pipelines you need.
Todd

@mbomhoff is CoGe ready to support the TERRA pipeline?
@phloz what is the timeline for getting this started ?

@dlebauer I am finishing it up now, should be deployed by end of next week.  For reference, this is the guide I am using:  https://terraref.gitbooks.io/terraref-documentation/content/genomic-data-product.html

Thanks Matt, is it ready now? Can we start sending our jobs?

The functionality described in the guide I referenced above is available for use.  I have been working on some additions (incl. Variant Recalibration) based on a conversation with @phloz that are still under development.

I am going to close this issue and open a new one related to running the genomics pipeline


[ci-skip] [meta] Update Contributing.md to reflect new naming

Also fixes somewhere where "Paper" should say "Purpur," so please fix that if you close this PR without merging :)

I'd avoid naming patches with brackets if it makes the file names weird, iirc NTFS doesn't like them.

it wont affect the file names, git patching omits special characters for the file name

This should be merged once all the patches follow the naming system.


[bug] [2.0] New project crash on -->  pnpm tauri android Init

Describe the bug
I create a new project with --> pnpm create tauri-app --rc
..and it crashes on --> pnpm tauri android init
Reproduction
pnpm create tauri-app --rc
✔ Project name · odd-test-rc
✔ Identifier · com.odd-test-rc.app
✔ Choose which language to use for your frontend · TypeScript / JavaScript - (pnpm, yarn, npm, bun)
✔ Choose your package manager · pnpm
✔ Choose your UI template · Solid - (https://solidjs.com/)
✔ Choose your UI flavor · TypeScript

cd odd-test-rc
pnpm install
pnpm tauri android init
thread '<unnamed>' panicked at src/mobile/mod.rs:283:6:
called `Result::unwrap()` on an `Err` value: IdentifierInvalid { identifier: "app.odd-test-rc.com", cause: NotAsciiAlphanumeric { bad_chars: ['-'] } }
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
    Error Tauri CLI unexpected panic
 ELIFECYCLE  Command failed with exit code 1.

Expected behavior
Tauri Android Init
Full tauri info output
> tauri "info"

[✔] Environment
    - OS: Mac OS 14.5.0 X64
    ✔ Xcode Command Line Tools: installed
    ✔ rustc: 1.80.1 (3f5fd8dd4 2024-08-06)
    ✔ cargo: 1.80.1 (376290515 2024-07-16)
    ✔ rustup: 1.27.1 (54dd3d00f 2024-04-24)
    ✔ Rust toolchain: stable-aarch64-apple-darwin (default)
    - node: 22.4.1
    - pnpm: 8.15.5
    - npm: 10.8.1

[-] Packages
    - tauri [RUST]: 2.0.0-rc.5
    - tauri-build [RUST]: 2.0.0-rc.5
    - wry [RUST]: 0.42.0
    - tao [RUST]: 0.29.1
    - tauri-cli [RUST]: 1.5.11
    - @tauri-apps/api : not installed!
    - @tauri-apps/cli [NPM]: 2.0.0-rc.6

[-] App
    - build-type: bundle
    - CSP: unset
    - frontendDist: ../dist
    - devUrl: http://localhost:1420/
    - framework: SolidJS
    - bundler: Vite

Stack trace
No response
Additional context
Perhaps related to https://github.com/tauri-apps/tauri/issues/10720

Turns out I can't have " - " in my app name. Live and learn.
However I still get the same error as https://github.com/tauri-apps/tauri/issues/10727


DI caching

I am using windsor castle DI along the Generic Repository pattern for my WebAPI project.

User forgets the password, so he calls ForgotPassword API. This API triggers an email with some random password.
User login with username & random password via Login API.
Post to login User wishes to reset the password via calling Reset Password API.
User tries to login again with this new password.

But when he do so he gets the User Credentials invalid exception.While if he uses the old password he is able to login.
When I check in the database, password is updated correctly. But when I check DAL method that is making use of EF. The password is stil the OLD password.
But if I restart the website is IIS, then User can login with new password.
My DAL Method.
    public bool IsUserValid(string username, string password)
	{
        //#inspection line for me
		var user = GetUser(username);
		return user != null && password.EncryptStringAES() == user.Password;
	}

   private User GetUser(string username)
   {
      userName = !string.IsNullOrEmpty(userName) ? userName.Trim().ToLower() : string.Empty;
		return _userRepository.GetQuery()
			.FirstOrDefault(x => x.Email == userName);

   }

If I debug at #inspection line for me, I see that the user object has still old password.
DI Configuration.
public void Install(IWindsorContainer container, IConfigurationStore store)
	{
		container.Register(
			Classes
			.FromAssemblyNamed("CustomerApp.EF")
			.WithService.Self()
			.LifestylePerWebRequest());
	}

I tried with LifestylePerThread& others but still same issue. While if I update my DAL as below.
public bool IsUservalid(string username, string password)
	{
		using(AppContext entities = new AppContext()
        {
            var user = (from c in entities.tblUsers
                        where c.Email == username
                        select c);
            //if I debug now, no issue
        }
	}

Above patch is not Valid for me.
So what is causing this & how do I address this issue?
Any help/suggestion highly appreciated.
Thanks.

Hi @chetankhargone, could you give us a little more information? e.g are your repositories in "CustomerApp.EF" as well, meaning are they registered PerWebRequest also? How is the  DbContext been injected assigned in the repository class?

Hi @devworker55 , thanks for the follow-up. Please find the below answers to your questions.

Yes, all my repositories are in CustomerApp.EF & they are registered as .LifestylePerWebRequest()); mode.
I didn't get your question.
No.
Yes. The issue is reproducible irrespective of the number of  users.

Hope above inputs suffice you. In case any further details required,please let me know.
Thanking You.

@chetankhargone you're probably better off asking this on stackoverflow.

@chetankhargone I found your question on SO so I will continue with my responses there...

you're probably better off asking this on stackoverflow.

Thanks @jonii, yep StackOverflow is the place for help with your project, here is my usual saved reply:
Hi, this is the Castle Windsor issue tracker, for help with your project please use StackOverflow (tagged with castle-windsor) or our users mailing list as per http://www.castleproject.org/get-involved/mailing-lists/.


Old GPU (Quadro K6000) is not used

How are you running AnythingLLM?
Docker (local)
What happened?
Running lastest AnythingLLM on Docker in Linux Ubuntu 20.4 Server
Needed to use Lance_revert image though to prevent crashes
NVIDIA Driver Version: 470.256.02
CUDA Version: 11.4
nvidia-smi gives no errors but no processes are found = AnythingLLM is not using the GPU :-(
I know it´s an outdated GPU but maybe there is a workaround?
Are there known steps to reproduce?
docker pull mintplexlabs/anythingllm:lancedb_revert
export STORAGE_LOCATION=/mnt &&
mkdir -p $STORAGE_LOCATION &&
touch "$STORAGE_LOCATION/.env" &&
docker run -d -p 3001:3001
--cap-add SYS_ADMIN
--gpus all
--name anythingllm
-v ${STORAGE_LOCATION}:/app/server/storage
-v ${STORAGE_LOCATION}/.env:/app/server/.env
-e STORAGE_DIR="/app/server/storage"
mintplexlabs/anythingllm:lancedb_revert

This would be entirely dependent on the LLM provider you are using - are you loading a model manually into /models or using something external like Ollama/LMstudio/LocalAI?
There is really nothing in AnythingLLM that would use the GPU unless you are using the "native" llama-cpp LLM, which is going to be deprecated soon because of these kinds of issues with CUDA detection and needing to rebuild the binary for it

Thank you @timothycarambat. I tried both, native and external LLMs. But good to know that if I have an external LLM running, AnythingLLM does not need GPU support...


Additional requirements added.

This patch fixes #2, the guac 400 error.

@shahzaib1007 please review and submit my changes.


Breakpoint not working reliably when having a min-width configured on any parent element e.g. body

Check that this is really a bug

[X] I confirm

Reproduction link
Bug description
Breakpoints work fine but as soon as I add a min-width to any parent Element of the swiper and its greater or equal to the breakpoint, it doesn't work reliably anymore when the window gets resized (slowly).
I added a min-width of 1024px on a div above the swiper (common thing to do on desktop is to have such min-width on the body) and on the swiper I have a breakpoint at 1024px to show 5 slides. The effect/bug is even more noticeable/occurs more often when the min-width of the div is greater than the breakpoint. You have to resize the window pretty fast for swiper to react to it correctly. With breakpointBase="container" it seems to work perfectly fine.
Similar Demo in react with different values which makes it more noticeable. min-with is much higher than the breakpoint: codesandbox
Demo VIdeo
https://github.com/nolimits4web/swiper/assets/92583338/41c8a874-0f6c-4276-8d58-4074de183279
Expected Behavior
No matter the "resize speed", breakpoint should be handled correctly and reliably when a parent element has a 'min-width' set
Actual Behavior
When a parent Element has a min-width that is equal or larger than the breakpoint, the breakpoint does't trigger reliable anymore
Swiper version
11.1.0
Platform/Target and Browser Versions
macOS Chrome, Firefox, Safari
Validations

[X] Follow our Code of Conduct
[X] Read the docs.
[X] Check that there isn't already an issue that request the same feature to avoid creating a duplicate.
[X] Make sure this is a Swiper issue and not a framework-specific issue

Would you like to open a PR for this bug?

[ ] I'm willing to open a PR

t0ggles-create swiper

Swiper uses ResizeObserver to trigger the resize logic (for better performance), so if its size not changed it will do nothing. You can disable resizeObserver parameter or use container as a breakpoints base

thanks for looking into it and I get the rational behind it. I think it would be helpful to document this behaviour in the description for breakpoints and breakpointsBase


Shouldn't EncoderClassifier.classify_batch() operates on embeddings?

Shouldn't classify_batch(self, wavs, wav_lens=None) instead be classify_batch(self, embeddings)  in EncoderClassifier?
That would allow to use it together with EncoderClassifier.encode_batch(). It seems to makes more sense to me, also there is nothing to do with precomputed embeddings at the moment (because only waves are expected for classification).

That could work as well, but changing this doesn't really provide anything new and would break backwards compatibility. I think these methods are meant as full self-contained pipelines. In some cases the embeddings themselves are the desired end product, in some cases the classification result is.


Question about using Ranger21 with Hugging Face Trainer

First of all, sorry if this issue is not very related to this repo, but I thought you being a professional at PyTorch optimizers, would know more on this than the rest.
I am not sure if you are familiar with Hugging Face Trainer https://huggingface.co/docs/transformers/v4.29.1/en/main_classes/trainer#transformers.Trainer , but they allow custom optimizer but also require a learning rate scheduler to be passed in, like
from transformers.optimization import Adafactor, AdafactorSchedule

optimizer = Adafactor(model.parameters(), scale_parameter=True, relative_step=True, warmup_init=True, lr=None)
lr_scheduler = AdafactorSchedule(optimizer)
trainer = Trainer(..., optimizers=(optimizer, lr_scheduler))

In this case, I can replace optimizer with Ranger21, but since Ranger21 has built-in scheduling, how does this interact with the extra lr_scheduler? And what should I be passing in for that?

 Ranger21 optimizer has a built-in scheduler that only adjusts the learning rate at the start & end of the training (k < warm-up steps, k > warm-down steps). (You can check the details in README.md, Linear learning rate warmup, Explore-exploit learning rate schedule)
If you apply another lr scheduler like a cosine annealing scheduler w/ warm-up, the learning rate at the warmup stage works slightly differently (or same) (applied lr scheduler warm-up logic + built-in lr scheduler), and After the stage, only applied lr scheduler affects to the learning rate.
In short, I recommend using lr scheduler with Ranger21, and the built-in scheduler won't affect much I assume! (If you are worried about lr at the warm-up stage, use lr scheduler without a warmup or set num_warm_up/down_iterations parameter to 0)
I hope this could help and feel free to leave a comment if you have any questions or suggestions :)
thank you!

Thanks for the answer. So to confirm my understanding, Ranger21's scheduler only modifies the start and end, and this library does it internally within the optimizer. Does this mean that for Hugging Face's side, if I pass in a constant LR schedule (meaning the LR stays at 1e-3 for example), Ranger21 internally will adjust the LR from this 1e-3 for the warm up and warm down, while the middle part will stay 1e-3?
Asking this because Hugging Face requires me to pass in a scheduler, and I do not want it to do anything to the Ranger21's built in one, to keep Ranger21 as factory-default as possible.

Thanks for the answer. So to confirm my understanding, Ranger21's scheduler only modifies the start and end, and this library does it internally within the optimizer. Does this mean that for Hugging Face's side, if I pass in a constant LR schedule (meaning the LR stays at 1e-3 for example), Ranger21 internally will adjust the LR from this 1e-3 for the warm up and warm down, while the middle part will stay 1e-3?
Asking this because Hugging Face requires me to pass in a scheduler, and I do not want it to do anything to the Ranger21's built in one, to keep Ranger21 as factory-default as possible.

Ranger21 internally will adjust the LR from this 1e-3 for the warm up and warm down, while the middle part will stay 1e-3? -> correct!
Maybe you can build a dummy learning rate scheduler and pass it to HF Trainer I guess!
lr_scheduler = LambdaLR(optimizer, lambda=lambda epoch: epoch)

Yep thats what I have in mind. Thank you!


feat: support writing and reading array segments

Allows for passing ArraySegment in remote methods.  For example:
[Command]
public void DoSomething(ArraySegment<int>  data)
{
   ...
}

Note we already support ArraySegment which is optimized to avoid copies and allocations by reusing the buffer.
This PR adds support for ArraySegment  where T is any type supported by Mirror.

why do we need ArraySegment, can you give an example?

:tada: This PR is included in version 3.13.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Facility form has shared aria labels for different components

Area or Component
Facility form
Quick Summary
There are elements with the same accessible name that serve different purposes. Generally these are the address fields for the facility and ordering provider.
The elements are:

street1
street2
city
phone
zip code
state

Accessibility Violation
Name: The element's name is missing or incorrect: https://cdc-devtools.dequecloud.com/rule-help/en/aria-name-missing-incorrect
More broadly, elements on the page must have unique aria labels unless they do exactly the same thing. Multiple save buttons on the facility form with the same aria label is fine, because those buttons have an identical function. These inputs don't have identical function though, so they need different aria text.
Action Requested
Differentiate the aria labels for all the above input fields. (Ordering-provider-street1 and faclity-street1, for instance)
Original Deque Issue
https://docs.google.com/spreadsheets/d/1b6xjubAN5Uw11DV4_B5zvSu7HeDI6Z-DpV4DMcToqAY/edit#gid=1346058064&range=2:2

@emmastephenson I think we can close this ticket because I am no longer seeing this as an issue on the facility form. I'm not seeing any usage of aria-labels for those text inputs. The only error close to the one described is because of the device dropdowns on that page. Let me know if I am mistaken and I can investigate again!

@emyl3 unfortunately I don't think that's the case :/ I miswrote the accessibility violation a bit - the issue isn't about an aria-label, but rather about the name of the element. There are multiple elements on the page with exactly the same name, but different input fields - phone_number for both ordering provider and facility phone, for instance. Those names need to be unique.
Let me know if you want to chat about this offline! You're right about the device thing btw, but @georgehager is looking to fix that with #4269.

@emmastephenson Thank yo u for the clarification emma! I updated th eticket a bit! :)


03_data.core: create docments

Add docments to 03_data.core.
See the style guide and contribution guide for more details (links will be added when created).
This requires advanced familiarity with fastai, as this notebook implements fastai's custom functionality on top of fastai's version of a PyTorch dataloader.
Docments progress:

[ ] TfmdDL
[ ] DataLoaders
[ ] TfmdLists
[ ] Datasets

Hello,
I would like to docment the data.core.ipynb. May be I will create 4 PRs (one PR each) for the four items listed in issue to make the review process easier

Created PR #93 to add docment for TfmdDL.

Created the following PRs to implement tasks in this issue

TfmdDL -> PR #93
DataLoaders -> PR #94
TfmdLists -> PR #96
Datasets -> PR #97


NewScObj refactor

NewScObj refactor - Splits NewScObj into multiple bytecodes with 4 distinct parts: GenCtorObj (makes ctor object), NewScObj (calls ctor with ctor object), determine ret val (done using multiple bytecode instrs), UpdateNewScObjCache.

Have you done perf testing?


Add Mac OSX application icon

Reference: https://www.electron.build/icons

Use: https://iconverticons.com/online/


[1.18.2] Durasteel ingot cannot be smelted back into molten metal

The durasteel ingot cant be smelted back into molten metal.

Nope this is still broken


Add User Story template to project

Is your feature request related to a problem? Please describe.
User story template is missing and this can be great for well-defined issues and guiding contributors.
Link to raw template on backend repo: https://raw.githubusercontent.com/anitab-org/mentorship-backend/develop/.github/ISSUE_TEMPLATE/user-story.md
Describe the solution you'd like
Add User Story template to .github/ISSUE_TEMPLATE folder
Describe alternatives you've considered
N/A
Additional context
N/A

Hi can I work on this @isabelcosta

Sure @Sanika1999 , good luck :)
@isabelcosta Is it okay when I assign people to work on issues? Or do we need your approval? I just want to help and take some work of triaging issues off you :)

Is it okay when I assign people to work on issues? Or do we need your approval? I just want to help and take some work of triaging issues off you :)

@bartekpacia yes of course, especially when you are a maintainer of the repository :P You are one of the code owners / maintainers of this project, so you are more than welcome and also this is part of your work as maintainer of this flutter project :)

@bartekpacia My only thing, is when an issue is labeled as "First Timers Only", this means that the contributor assigned, is new to the repository. This is important for newcomers to feel motivated and get an opportunity to get acquainted with the repositories.

@Sanika1999 please use the Fixes #ISSUE_NO. as mentioned in the PR template. this closes the linked issue when PR is merged

@Sanika1999 please use the Fixes #ISSUE_NO. as mentioned in the PR template. this closes the linked issue when PR is merged

OK got it!


Add a way to add CSS themes that doesn't require GUI

Is your feature request related to a problem? Please describe.
I use NixOS, and I used to manage a very nice systemwide color palette which could be swapped out on a whim. This is now broken after the addition of --add-css-theme, which requires manual user interaction with a dialog window for theme change.
Describe the solution you'd like
Add a --no-start or --no-gui cli flag, such that the typical dialog window could instead be a simple print statement. This would enable declarative installation of themes on my end by installing them and then running webcord --no-gui --add-css-theme=path/to/theme
EDIT: it should probably just be called --confirm-all or something, so the dialogue box is bypassed.
Describe alternatives you've considered
Remove the --add-css-theme flag entirely. I'm not sure what security hole you're really patching here: if another application can be exploited to write malicious themes to ~/.config/Webcord/Themes, then that's a hole in another application and should be addressed there. Additionally, you could remove the flag and instead add a dialogue to any startup where a new theme is detected in the themes folder.
I am willing to implement this feature provided it is welcome.

The dialog is actually there for a reason – I assume it is hard for thirdparties to inject the CSS themes (and in the future - also modify CSP) when a GUI popup is present. The way it works is meant to prevent other software that can have access to the entire filesystem (limited by user permissions) from any kind of the manipulation outside of WebCord.

I'm not sure what security hole you're really patching here: if another application can be exploited to write malicious themes to ~/.config/Webcord/Themes, then that's a hole in another application and should be addressed there.

Files loaded there are encrypted with the key stored in the secret service, so there should be no way for that software to actually inject their own scripts unless they guess the key. That being said, the code is still at initial state and I haven't really tested how it works with the plaintext (and if it can be abused), but definitely will do before WebCord will modify CSP based on themes. This update was more like a preparation, the --add-css-theme might be deprecated in the future in favor of the GUI configuration.
As of the details, it uses the same mechanism as in Chromium for encrypting the passwords. WebCord will also not encrypt anything when the secret service is unavailable (on Freedesktop-compilant operating systems, like FreeBSD or Linux).

(…) then that's a hole in another application and should be addressed there.

This mechanism is not just to prevent the issues with another software's security, but also mitigate the consequences of installed software that is being malicious by the design. But it's more kind of sollution made for the future, when WebCord will allow tweaking the CSP. I also plan to partially encrypt the configuration files: one ofbmy ideas it to split it to earlyConfig (unencrypted, pre-Electron configuration, mostly for Node tweaks and Chromium flags modifications) and lateConfig (encrypted, loaded after Chromium engine is being initialized).

So, what's my idea about these dialogs? I could allow to disable them using the configuration... which itself is unencrypted, so that is something I would have to work first. I don't like the idea of CLI or TUI, stdin can be easily manipulated.

Alright, I'll leave this issue open if you plan on providing a solution at some point, but I won't make a PR.


Capital queries - fix null database connection retuning null instead of an exception/error message

fixed, test not receiving the correct exception, added code into the utilities to unwrap so exception can be properly seen


[FEATURE] Events tab improvements

Description

hide finished events (similar to Community Events page)
hide profile picture as not required on profile page (use flag to hide)
Better virtual icon
Key for icons (in person / virtual)

Screenshots
No response
Additional information
No response

hey Eddie! I would like to work on this feature

hey @prajapati55 thank you but I already assigned it to me the day before and started working on it. Please have a look at the issue list for unassigned items


Velocity encoder in the torch example

Hello! I have a quick question regarding the minimal PyTorch implementation.
Is the velocity encoder for v0 implemented the same way in this version?
I see the general encoder, but it appears to only take in one image slice and be shared for the velocity and position with its shape of [N, 2q].
Thanks!

Hi Ryan! In the simple torch implementation, the encoder only takes the initial frames while in general multiple (stacked) frames should be given as input. This is because initial velocity is constant, so no need for multiple frames to extract it.
Cagatay.

Ah that makes sense with respect to the training set there. Thank you for the reply!


Full processing

Deployment of version 1.7.6 will kick off full processing

This is underway now, as of 12:09 CET, Aug 6


Set forwarding_required in app.json to always

Set forwarding_required in app.json to always. This fixes service not available in mCCF.

Testing: https://github.com/microsoft/privacy-sandbox-dev/actions/runs/10922731311