[nixio] Use Neo object names in NIX file

Last year I changed the NixIO to use UUIDs as names for objects as a way to get around a couple of issues. Issue #311 is where the discussion happened and #331 is the relevant PR where this was implemented.
Some time later, there was a discussion on the mailing list regarding the write performance but, as a side topic, the issue of the naming also came up. In short, with the current naming scheme, the NIX/HDF5 file that is generated has names that make it difficult to work with and can be a hindrance (and an annoyance) for people who purposefully name their objects in order to be able to navigate a file.
This PR adds a new feature which somewhat backtracks from the design decision of automatically naming objects. The write_all_blocks() and write_block() methods now accept an optional, boolean argument, use_obj_names (false, by default). If enabled, the objects in the NIX file will use the names of the corresponding Neo objects. Before writing, however, the whole Neo object tree is checked for conflicts, based on the requirements of NIX and HDF5. If a conflict is found, a ValueError is raised and no objects are written.
I felt it was important to not check the names while writing and instead check names beforehand. This avoids potential issues with partially writing data with names that later turn out to have conflicts. It's also good for avoiding situations where a write will fail half way through the saving of a large file that could take minutes (or hours). I've clocked the name checking function and even with thousands of objects (the saving of which took over 20 mins), it only needs a few seconds to run.
Tests for the new functionality are also included.

Coverage decreased (-6.3%) to 49.623% when pulling 6e7f557868f81b8b11f629ef57863789c0c7779a on G-Node:nixio-use-neo-names into 7753fb24ca7d103b97a9209217260b33edb55bbf on NeuralEnsemble:master.

Thanks for the improvements. I tested it and it works.
I will merge this now.


CI Pipeline with Docker, Checks, etc.

Introduction
We are now executing checks inside Docker containers.
The build process also happens inside containers, so we are only executing minimal tasks on the PermaplanT server (unstash and deploy); everything else is happening on the docker infrastructure.
This fixes #63.
For #98 we still need some kind of entry point for the tests.
:rocket: :rocket: :rocket:

Basics

[x] Details of what you changed are in commit messages
(first line should have module: short statement syntax)
[x] References to issues, e.g. close #X, are in the commit messages.
[x] The buildserver is happy.
[x] The PR is rebased with current master.

Checklist

[ ] I added unit tests for my code
[x] I fully described what my PR does in the documentation
(not in the PR description)
[x] I fixed all affected documentation
[ ] I fixed all affected decisions
[ ] I added code comments, logging, and assertions as appropriate
[ ] I mentioned every code not directly written by me in reuse syntax

Review

[ ] Documentation is conforming to our Documentation Guidelines
[ ] Examples are well chosen and understandable
[ ] Code is conforming to our Coding Guidelines
[ ] Code is consistent to our Design Decisions

This new pipeline is currently failing, because the diesel-generated schema.rs doesn't pass cargo fmt --check.
Unfortunately neither the option ignore nor the option format_generated_files is available in stable...
@kitzbergerg @aidnurs do you have any ideas? 🐱

Fascinating job! We are now state of the art for backend CI. :heart:


Rewrite the toolchain a bit

Related to #10, this mainly change the Dockerfile and the Makefile and its target. 🐧
The way the Makefile works, doing the same as docker/docker. There is a central target build which build the docker image ; then each other target run command(s) inside a container from this image. The image build is libcompose-dev with the tag corresponding to the current branch (so for this PR it is building libcompose-dev:refactor-makefile).
It uses a share folder called bundles (just as in docker/docker) to put the binaries in — makes it possible to use them on the host if needed.

binary (replace the build target) target to make the binaries and put them into ./bundles/ —clean target to clean it.

λ make binary
docker build -t "libcompose-dev:refactor-makefile" .
Sending build context to Docker daemon 61.85 MB
Sending build context to Docker daemon
Step 0 : FROM golang:1.4.2-cross
 ---> bbc500088baa
# […]
Step 14 : COPY . /go/src/github.com/docker/libcompose
 ---> a4633a23f665
Removing intermediate container 4f617eab2867
Successfully built a4633a23f665
docker run --rm -it --privileged -e OS_PLATFORM_ARG -e OS_ARCH_ARG -e DOCKER_TEST_HOST -e TESTFLAGS -v "/home/vincent/src/docker/libcompose/bundles:/go/src/github.com/docker/libcompose/bundles" "libcompose-dev:refactor-makefile" ./script/make.sh binary
---> Making bundle: binary (in .)
Number of parallel builds: 4

-->      darwin/386: github.com/docker/libcompose/cli/main
-->    darwin/amd64: github.com/docker/libcompose/cli/main
-->       linux/386: github.com/docker/libcompose/cli/main
-->     linux/amd64: github.com/docker/libcompose/cli/main
-->       linux/arm: github.com/docker/libcompose/cli/main
-->     windows/386: github.com/docker/libcompose/cli/main
-->   windows/amd64: github.com/docker/libcompose/cli/main

λ ls bundles
docker-compose_darwin-386*    docker-compose_linux-amd64*      docker-compose_windows-amd64.exe*
docker-compose_darwin-amd64*  docker-compose_linux-arm*
docker-compose_linux-386*     docker-compose_windows-386.exe*

test-unit target (replace the test target) to run the unit tests. It will only run unit tests — The detection is done the same way as on docker/docker, looking for folders that contains *_test.go files except from special ones (like integration, Godeps, .git, …). Put a little bit of colours :stuck_out_tongue_closed_eyes:, and display coverage too.

λ make test-unit
docker build -t "libcompose-dev:refactor-makefile" .
Sending build context to Docker daemon 61.85 MB
# […]
Successfully built 7d907bfdde91
docker run --rm -it --privileged -e OS_PLATFORM_ARG -e OS_ARCH_ARG -e DOCKER_TEST_HOST -e TESTFLAGS -v "/home/vincent/src/docker/libcompose/bundles:/go/src/github.com/docker/libcompose/bundles" "libcompose-dev:refactor-makefile" ./script/make.sh binary test-unit
---> Making bundle: binary (in .)
Number of parallel builds: 4

-->      darwin/386: github.com/docker/libcompose/cli/main
-->    darwin/amd64: github.com/docker/libcompose/cli/main
-->       linux/386: github.com/docker/libcompose/cli/main
-->     linux/amd64: github.com/docker/libcompose/cli/main
-->       linux/arm: github.com/docker/libcompose/cli/main
-->     windows/386: github.com/docker/libcompose/cli/main
-->   windows/amd64: github.com/docker/libcompose/cli/main

---> Making bundle: test-unit (in .)
+ go test -cover -coverprofile=cover.out ./docker
ok      github.com/docker/libcompose/docker     0.019s  coverage: 4.6% of statements
+ go test -cover -coverprofile=cover.out ./project
ok      github.com/docker/libcompose/project    0.010s  coverage: 8.4% of statements
+ go test -cover -coverprofile=cover.out ./version
ok      github.com/docker/libcompose/version    0.002s  coverage: 0.0% of statements

Test success

test-integration target (replace the run-integration-tests target) now runs the integration tests. It starts a docker engine inside the container first, then run the integration test against it and stop the engine (daemon script comes straight from docker/docker : ./script/.integration-daemon-start, ./script/.integration-daemon-stop). Wasn't really sure how the integration tests were working before, I could not make the run-integration-tests script to work so I might have change a bunch how it was working but it does works.
tests target runs unit tests and integration in one run.
shell target drops a shell inside the container to be able to run any commands.

This is a start but does the job (except there is an integration tests that fail :sweat_smile: ). I see few things that could be better/nice to have :

makes the shell target bind-mount the sources inside the container (volumes) — I think docker/compose does that.
less output for integration-test by default :sweat_smile:.
How to handle multiple version of docker daemon  ? — docker/compose kinda does that. And also how many multiple version should we test against ?

🐸
Signed-off-by: Vincent Demeester<EMAIL_ADDRESS>

Wow, this is awesome. Thanks!  I'll try to look through this in detail by Monday.

Cool!
The drawback to the docker-in-docker approach is that it's a bit complex; I've got a PR open on Compose where I'm using the dockerswarm/dind image instead to run a daemon in its own container and linking to it from a separate container that runs the tests, which is much cleaner. However, I've not yet determined why the connection to the daemon sometimes closes unexpectedly.

https://jenkins.dockerproject.org/job/Libcompose-PRs/1/console

ah humm I didn't thought of running the validation step.. I'll fix that as soon as I get back home :wink: (in an hour)

It is green :smile_cat: o/

\o/ whoop

LGTM
I'm cool with merging this PRs as is.  We can always iterate and make it better, but since we have green builds thats a step in the right direction.  Now I feel comfortable merging other PRs.
WDTY @vdemeester?

@ibuildcloud completely agree with u, we can iterate later on this.
so LGTM for me too :wink:

Thanks @vdemeester!


Rewrite Walker.Walk to write entries in lexical order

Two runs of develop:
real	5m45.561s
user	2m7.993s
sys	13m45.553s

real	5m46.711s
user	2m11.191s
sys	13m50.183s

Two runs of this branch:
real	5m52.249s
user	3m0.063s
sys	13m41.197s

real	6m4.065s
user	3m3.324s
sys	13m53.571s

So, it does spend more time in userspace, but it still seems to be IO bound, so it hopefully won't be that relevant.


AnyTextPipeline: ResourceExhaustedError.init() missing 2 required positional arguments: 'op' and 'message

2024-01-09 20:22:31,137 - modelscope - INFO - PyTorch version 2.0.1 Found.
2024-01-09 20:22:31,152 - modelscope - INFO - TensorFlow version 2.13.0 Found.
2024-01-09 20:22:31,152 - modelscope - INFO - Loading ast index from /home/flyang/.cache/modelscope/ast_indexer
2024-01-09 20:22:34,583 - modelscope - INFO - Loading done! Current index file version is 1.10.0, with md5 c3f4ad4f45046b1c409c0f21a503852b and a total number of 946 components indexed
raceback (most recent call last):
File "/mnt/p/home/flyang/AnyText/demo.py", line 50, in
inference = pipeline('my-anytext-task', model='damo/cv_anytext_text_generation_editing', model_revision='v1.1.1', use_fp16=not args.use_fp32, use_translator=not args.no_translator, font_path=args.font_path)
File "/home/flyang/.local/lib/python3.10/site-packages/modelscope/pipelines/builder.py", line 170, in pipeline
return build_pipeline(cfg, task_name=task)
File "/home/flyang/.local/lib/python3.10/site-packages/modelscope/pipelines/builder.py", line 65, in build_pipeline
return build_from_cfg(
File "/home/flyang/.local/lib/python3.10/site-packages/modelscope/utils/registry.py", line 215, in build_from_cfg
raise type(e)(f'{obj_cls.name}: {e}')
TypeError: AnyTextPipeline: ResourceExhaustedError.init() missing 2 required positional arguments: 'op' and 'message

pip install tensorflow-datasets==2.1.0
Can't resolve this error

i have the same error, can someone has solved it?


关于调用biliup模块上传偶尔出错

我通过python调用biliup模块上传
这里是出错信息：
2023-08-13 01:41:55_os: upos
Traceback (most recent call last):
File "requests\models.py", line 971, in json
File "json_init_.py", line 346, in loads
File "json\decoder.py", line 337, in decode
File "json\decoder.py", line 355, in raw_decode
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "upload.py", line 212, in main
File "biliup\plugins\bili_webup.py", line 413, in upload_file
File "asyncio\runners.py", line 190, in run
File "asyncio\runners.py", line 118, in run
File "asyncio\base_events.py", line 653, in run_until_complete
File "biliup\plugins\bili_webup.py", line 540, in upos
File "requests\models.py", line 975, in json
requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
出现在部分文件上传结束（分P结束但整个投稿还在上传），概率出现，大多是时候是可以正常上传的。
线路选择的是ws，网络所在地是德国（AUTO选择的qn速度非常慢所以手动选择了ws，gcs线路经常报错偶尔能用）
还请作者看一下是什么问题，我是萌新小白不太懂，是bug还是网络原因？

补充一下新的报错：
使用持久化内容上传
使用cookies上传
2023-08-17 03:00:36_线路选择 => upos: upcdn=ws&probe_version=20221109. time: None
2023-08-17 03:00:36_os: upos
2023-08-17 03:00:37_Assigned UpOS endpoint //upos-cs-upcdnqnhk.bilivideo.com was never seen before, something else might have changed, so will not modify it
Traceback (most recent call last):
File "urllib3\connectionpool.py", line 467, in _make_request
File "urllib3\connectionpool.py", line 1092, in validate_conn
File "urllib3\connection.py", line 642, in connect
File "urllib3\connection.py", line 783, in ssl_wrap_socket_and_match_hostname
File "urllib3\util\ssl.py", line 469, in ssl_wrap_socket
File "urllib3\util\ssl.py", line 513, in _ssl_wrap_socket_impl
File "ssl.py", line 517, in wrap_socket
File "ssl.py", line 1075, in _create
File "ssl.py", line 1346, in do_handshake
TimeoutError: _ssl.c:985: The handshake operation timed out
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "requests\adapters.py", line 486, in send
File "urllib3\connectionpool.py", line 844, in urlopen
File "urllib3\util\retry.py", line 470, in increment
File "urllib3\util\util.py", line 39, in reraise
File "urllib3\connectionpool.py", line 790, in urlopen
File "urllib3\connectionpool.py", line 491, in _make_request
File "urllib3\connectionpool.py", line 469, in _make_request
File "urllib3\connectionpool.py", line 370, in _raise_timeout
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='upos-cs-upcdnqnhk.bilivideo.com', port=443): Read timed out. (read timeout=15)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "upload.py", line 218, in main
File "biliup\plugins\bili_webup.py", line 413, in upload_file
File "asyncio\runners.py", line 190, in run
File "asyncio\runners.py", line 118, in run
File "asyncio\base_events.py", line 653, in run_until_complete
File "biliup\plugins\bili_webup.py", line 539, in upos
File "requests\sessions.py", line 637, in post
File "requests\sessions.py", line 589, in request
File "requests\sessions.py", line 703, in send
File "requests\adapters.py", line 532, in send
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='upos-cs-upcdnqnhk.bilivideo.com', port=443): Read timed out. (read timeout=15)

qnhk 已经废了


Improve how we count downloads

Feature Request
The downloads metrics for ScholarSphere 4.0 are much higher than they were for ScholarSphere 3.0. This may be because we're not doing a good job of filtering "robot" downloads. We might consider taking session information into account like we do for view counts.

Add rel=nofollow to the download links to cut down on crawler downloads.

It is definitely true that we count work views and downloads differently. Views for Works/Collections/WorkVersions are "deduped" by a cache that we store in Redis that contains the resource and the users session. This same cache is not present on the downloads.
However, having looked at this code just now, there is actually a bug in that cache that could be undercounting the Works/Collections/Versions! That cache uses only the resource's primary key, without also using the resource's type. That means if someone views Collection#1 and WorkVersion#1, the cache that was set by the collection will hit on the work version, thus undercounting the workversion.
My proposed solution to both of these issues is to add the resource type the SessionViewStatsCache, fixing the undercounting bug, and then add that stats cache to the downloads controller. I'm not sure if that will fix all the strangeness but it will help fix two obvious issues


Global epg

Description

Not every playlist has links that are from a single country/source.
Some apps do not accept more than 1 xmltv source.

Due to the reasons above, having a "merged" global xml file would be great. File size may be large, but it is a downside some are willing to take.

Duplicate of #708


TypeError: Invalid host defined options when using dynamic imports

What version of pkg are you using?
5.11.1
What version of Node.js are you using?
Node 20
What operating system are you using?
macOs
What CPU architecture are you using?
x86_64
What Node versions, OSs and CPU architectures are you building for?
Node 20, linux
Describe the Bug
If the code to be packaged includes a dynamic import, like this one:
const foobar = await import("foobar.js");

When running the resulting exe we get an exception with the following error:
TypeError: Invalid host defined options

Seems like for some reason the resulting exe is not compatible with dynamic imports, despite using node20 as target which has full support for dynamic imports.
Expected Behavior
It should work as it does when just running the given code with node.
To Reproduce
const foobar = await import("foobar.js");

Ok, it seems like the issue comes from this Node bug: https://github.com/nodejs/node/issues/43663

👍🏼 keep me updated

In practice, the only way to get "pkg" to work in modern codebases is to prebundle everything with esbuild and then compile the resulting bundle. It can get complicated if you have a lot of dynamic imports or you load static assets, etc, but it is doable with some non trivial effort.

That's exactly what i do on my packages and I have some that are really big. Take a look at this tool: https://github.com/bpkg/bpkg
It's like esbuild but it handles better node native addons by loading them as base64


Keybindings not working -- V0.3.0

Lapce Version
0.3.0
System information
Ubuntu 22.04
Describe the bug
I have just updated to version 0.3.0. There are far too many issues to enumerate here, including but not limited to:

Can't change font
Can't change the language of any file in my project
Can't use the keybindings that I set
C++ syntax highlighting is not working

The main fix I am seeking is to be able to use the keybindings that I set. Editor is essentially unusable after update.
Additional information
I suspect that there is a configuration file missing or broken, but I am unsure how to go about debugging this.

Try deleting your keymaps.toml and settings.toml (Ctrl+Shift+P to open palette, then 'Open Settings Directory'), does that fix it?
I think the settings changed the format some, but I'm surprised it breaks things.
(Though these wouldn't affect C++ syntax highlighting)

Thanks for the suggestion, I will give it a shot this weekend


fix bug #111 (ar currencies)

What does this PR do ?
fix bug #111
Before your PR is "Ready for review"
Pre checks:

[x] Have you signed your commits? Use git commit -s to sign.
[x] Do all unittests finish successfully before sending PR?

pytest or (if your machine does not have GPU) pytest --cpu from the root folder (given you marked your test cases accordingly @pytest.mark.run_only_on('CPU')).
Sparrowhawk tests bash tools/text_processing_deployment/export_grammars.sh --MODE=test ...

[ ] If you are adding a new feature: Have you added test cases for both pytest and Sparrowhawk here.
[ ] Have you added __init__.py for every folder and subfolder, including data folder which has .TSV files?
[ ] Have you followed codeQL results and removed unused variables and imports (report is at the bottom of the PR in github review box) ?
[ ] Have you added the correct license header Copyright (c) 2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved. to all newly added Python files?
[ ] If you copied nemo_text_processing/text_normalization/en/graph_utils.py your header's second line should be Copyright 2015 and onwards Google, Inc.. See an example here.
[ ] Remove import guards (try import: ... except: ...) if not already done.
[ ] If you added a new language or a new feature please update the NeMo documentation (lives in different repo).
[ ] Have you added your language support to tools/text_processing_deployment/pynini_export.py.

PR Type:

[ ] New Feature
[x] Bugfix
[ ] Documentation
[ ] Test

If you haven't finished some of the above items you can still open "Draft" PR.

@mgrafu please update the CI folder name


Add frame filtering functionality

In scenarios when zapsentry is used with zap and go-logr the existing frame filtering mechanism does not skip frames of the go-logr adapter.
This PR adds an interface FrameFilter allowing any user to filter frames just like they want to.
I refactored the existing two filters to some default filter types that might come in handy for most users.
While reading the docs regarding the Sentry SDK I also stumbled upon a deprecation notice of sentry.Event.Extra and that sentry.Scope should be used instead.
I adopted this change in the API, too, but I could also split both changes into two PRs if preferred?

@grongor I finally had some time to apply your suggestions :see_no_evil:
I hope I didn't miss anything - if you spot anything else to refine, do not hesitate to let me know :blush:

hey guys, sorry for big delay. im trying to look it in a couple of days

Hey guys! @TheZeroSlave, this PR looks good and useful. Could you check it and merge, if it's ok?

Haven't heard anything and left the company I originally implemented this PR (don't know if they're still using my fork 😅 @farodin ) but could rebase and resolve conflicts probably in 2 week's or so if there's still interest

From my point of view, yes, it is. The PR is useful to exclude frames from wrappers. So, it would be nice

@baez90 hi, if you rebase it, i will merge it )

@TheZeroSlave I cloud recreate the PR and rebase it.

@TheZeroSlave I cloud recreate the PR and rebase it.
yeah, that's good idea, thanks!

@farodin91 no worries I'll rebase it on Sunday :)

Finished rebasing, let me know if there are any further change requests :smile:

Finished rebasing, let me know if there are any further change requests 😄

thnx, im watching it.


drivers: video: Add VIDEO_BUF_STARTED to poll signals

Adding VIDEO_BUF_STARTED result to enum video_signal_result.
VIDEO_BUF_STARTED: Gets triggered at the start of buffer processing (e.g. start of capturing data)
Full disclosure:
I'm developing a sensor driver for a TOF image sensor and I need to change some settings on the driver after every frame.
The Idea would be to produce the VIDEO_BUF_STARTED in the video driver using the vsync or SOF interrupt and pulling for it in the sensor driver using a meta-IRQ thread.

IMO the naming this VIDEO_BUF_STARTED is a bit misleading, wouldn't' make it sense to name it VIDEO_VSYNC or more generically VIDEO_START_OF_FRAME?

IMO the naming this VIDEO_BUF_STARTED is a bit misleading, wouldn't' make it sense to name it VIDEO_VSYNC or more generically VIDEO_START_OF_FRAME?

I had VIDEO_BUF_SOF and VIDEO_BUF_EOF first but then realized that VIDEO_BUF_EOF is the same as VIDEO_BUF_DONE.
I felt like VIDEO_BUF_STARTED fits more to the existing entries. But I can rename it to VIDEO_BUF_START_OF_FRAME if you really prefer.
I wouldn't call it VIDEO_VSYNC since other drivers might not have a vsync signal at the start of capturing image data. (e.g. mipi interfaces).

Sorry, I messed up and pushed to the wrong branch while I intended to make a new PR...
If you're interested, #78566 shows my intention for the new signal result on the esp32s3 video driver.

@epc-ake it still not entirely clear from your diagram where is the allowed window for changing the 'settings', and why it can not be done before/after enqueuing/dequeuing the buffer?
If I try to understand a bit better, you need a specific setting/control for each frame you're going to queue?

If I try to understand a bit better, you need a specific setting/control for each frame you're going to queue?

Yes, I need to change a setting on my image sensor for every frame.
So during the time the image sensor is transmitting the captured image, I setup the needed settings for the next image.

I close this PR again since adding a new video_signal_result seems not to be the right way to achieve what I need.

I close this PR again since adding a new video_signal_result seems not to be the right way to achieve what I need.

With a signal/poll API, the MIPI driver continue to run after the signal.
If you wish to reconfigure the device before the next frame is enqueued, a different API is needed indeed!
Is that what you observed for your use-case?


NameError: name 'api' is not defined

So I'm trying to navigate around the functionality of this library and find the things I need but nothing seems to work at first try unfortunately.
I got the first example from README.rst to work in Python 3 with a few modifications but the third piece of code (with brackets for the print for python 3) is throwing the error in the title
from disqusapi import Paginator
paginator = Paginator(api.get, 'trends.listThreads', forum='disqus')
for result in paginator:
    print (result)

So I tried to change api.get to disqus as defined above
disqus = DisqusAPI(secret_key, public_key)
but now it is throwing a different error
InterfaceNotDefined: Interface is not defined, you must pass ``method`` (HTTP Method).
I tried the solution that worked for the other code snippet:
paginator = Paginator(disqus, 'trends.listThreads', forum='disqus', method='GET')
..now it's running without error but not returning anything.
Does anyone know how this code is meant to work?

It might work.
NameError: name 'api' is not defined
ou forgot to import api
Try with following:
from openerp import api,models,fields
https://stackoverflow.com/questions/41363869/nameerror-name-api-is-not-defined/41364578#41364578


Formatting emotes and user mentions.

The code needs to format user mentions properly, as well as emoji mentions. The latter will require restructuring of the code since I forgot I would need to inevitably print HTML from the code itself (and the code is currently using a package that does HTML escaping automatically).
But the former is not only possible, there's already code for it written. It's just that in practice, the .Member( function complains about the state being missing, despite every other function being able to see it. And we can't get member names without the state.

Merged into #10


Add github actions to build and Deploy Doxygen Pages

Add a github action to build and deploy doxygen plages to the gh-pages branch.
See online help for details of the build-and_deploy_doxygen.yml file contents. The README.md has been changed to provide a link to the online help.
This solution means only the tip of main is documented online, which is a standard approach.

LGTM, ship it!


TryValidateModel is slow with large arrays

The code
TryValidateModel(model);

is very slow when i pass a model with huge arrays. My model looks roughly like this:
public class MyModel
{
    [Required]
    public string Id { get; set; }
    [Required]
    public byte[] Data { get; set; }
    [Required]
    public Dictionary<string, string> Metadata { get; set; }
}

If Data is only a few KB, everything is fine. However, if Data is filled with ~5MB, the validation takes nearly 2 seconds on my machine. I'm using .NET Core 1.1.
Of course, I could disable validation for MyModel and validate the properties myself... But I still think this is a bug, since I could not find any information on this topic (e.g. not to use validation on large arrays).
Note: Removing the [Required] from Data doesn't make any difference.

This bug was actually fixed recently and is available in nightly builds. https://github.com/aspnet/Mvc/commit/ce53675b87e9d435bb3f9c686024ccf3700e7b25
With this commit you can decorate the property with a ValidateNever attribute.
Meanwhile you could update the MVC options to exclude byte array from validation (this effects the entire app but I can't see why we do not do this by default. @dougbu ?)
options.ModelMetadataDetailsProviders.Add(new SuppressChildValidationMetadataProvider(typeof(byte[])));

Correcting my previous comment :-)...We don't know if this a bug yet but there is a new way (through ValidateNever) through which you can selectively disable validation.

Yes, I've read about ValidateNever and it looks cool. But I think of it as a workaround in this situation. I think it is dangerous to globally exclude byte arrays from validation...
By the way, validation is also very slow for lists with a few thousand entries. If I change my model to
public class MyModel
{
    [Required]
    public string Id { get; set; }
    [Required]
    public List<byte> Data { get; set; }
    [Required]
    public Dictionary<string, string> Metadata { get; set; }
}

the problem still exists.

@kichalla - using [ValidateNever] is a workaround - we need to be smart enough to do this by default when there's nothing to validate.

Isn't it something like:
...
else if (IsEnumerableType && ElementType.GetTypeInfo().IsPrimitive)
{
     _validateChildren = false;
}
...

in DefaultModelMetadata.ValidateChildren?

@Yves57 it would be similar to what you've got.
Should also confirm no validators are configured for ElementType and it might be better to do it in an IValidationMetadataProvider implementation. While unusual, primitive types can certainly have associated validators e.g., an IValidationMetadataProvider implementation could add [Range(0, 20] to the byte metadata.
Put another way, your suggestion is a good way to avoid recursion through the metadata to find validators. Still need to look for those validators.

Looking at this issue again, this is definitely something we should profile and try to improve.
Secondly, we need to hold on to this piece of design feedback: it should be possible for model binding to determine that a graph is a 'no-op'. Today we can't/don't due to that due to the flexibility to the validator providers have in MVC, and we're contributing a lot to global warming. We should make sure that any new validation system can determine when not to explore an object graph with greater vigour.

Back to 2.2.0-preview3


File format support.

Having a hard time locating information on file formats that are supported by the service.
It should be an easy search and find, I can't locate that data easily.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: c8162cca-9883-c168-a631-bb6a06d979d2
Version Independent ID: 8f9d41d1-79c7-ff5f-25d2-318c506877e2
Content: What is the Speech Service? - Azure Cognitive Services
Content Source: articles/cognitive-services/Speech-Service/overview.md
Service: cognitive-services
GitHub Login: @erhopf
Microsoft Alias: erhopf

@Joll59
Thanks for your feedback. We are investigating this issue actively and will get back to you soon.

@Joll59 Hi Yomi, thanks for your feedback. Can you share any insight about how it will help better to show the information, put all information in a separate page, add a part of file format under every product... etc?
@erhopf Hi Erik, this is a doc-enhancement issue about file format information. Could you please check this issue and update the document as necessary? Thanks a lot.

@Joll59 - The supported formats using the Speech SDK are available in the API reference for each language. Currently, it's only WAV/PCM. Here's an example for C#. If you're looking for a different language, the full table is available on the SDK page.
The REST API (and Batch Transcription) support a handful of formats, which are available:

REST APIs
Batch Transcription

@YutongTie-MSFT - #please-close

@erhopf Thanks for these links, they are proving to provide the information I needed, but, my point still stands. There should be a central place that documents exactly what these links you provided are demonstrating.
@YutongTie-MSFT I think this can document can live under, the Reference label.
Considering each service has different offerings, the table format utilized for language support would be ideal, it is easy to navigate and consume.

@Joll59 - I hear you. We are working on some content updates that should address your concerns.

@Joll59 We will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion and we will reopen the issue.


Add rust build step prior to building debian packages

The rust debian packages were missing the built executables.
Signed-off-by: Boyd Johnson<EMAIL_ADDRESS>

@boydjohnson Tested building locally - any recommendation on how to verify?

@peterschwarz From a ubuntu container do 2 steps: dpkg -c <name of deb>.deb and it will show the contents of the debian package including the built executable. Then dpkg -i <name of deb>.deb and verify you can run the command installed with the package, so sawadm or smallbank-workload. Also ./bin/build_all installed will put the debs in sawtooth-core/debs/rust.


Chore change partition value for cold heat separation case

Proposed changes
Issue Number: close #xxx
The partition is not suitable for the data used in regression-test, this pr changes the value so that both partition would have data.

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall


Prevent okio 'InvalidPackage' error breaking build

https://github.com/square/okio/issues/58

Thanks for your PR!

@cbrevik are you able to stamp a new version soon?

Hi @wilsonpage! Been a bit busy lately, but I put off some time for this today. New version is out @ 3.1.0.


Blocks in Github actions?

Hi,
thank you for this awesome library. I was testing it locally and it was working fine. But I have found two issues:

If the test does not exist, the process would not close and I had to terminate the process manually. You could check if Mongo is still running on start and reuse it or close the previous process.
The build was not running in Github CI anymore. It is a docker build, based on bullseye-slim and .NET 7 and it was just hanging. After an hour the build was still running, so the question is, is there some kind of wait or timeout, that could be configured?

My test: https://github.com/notifo-io/notifo/blob/main/backend/tests/Notifo.Domain.Tests/UserNotifications/MongoDb/MongoDbUserNotificationRepositoryTests.cs
My Fixture: https://github.com/notifo-io/notifo/blob/main/backend/tests/Notifo.Domain.Tests/Fixtures/MongoFixtureBase.cs

Hi @SebastianStehle , thanks for using the library. I'm not sure to understand you when you say "the test does not exist".
Furthermore, one way to verify why the mongod process is still alive at the end of the tests execution is to add logging:

When the IMongoRunner is instanciated
When the IMongoRunner is dispose (because that's when the mongod process is killed)
Specify MongoRunnerOptions.StandardOuputLogger and MongoRunnerOptions.StandardErrorLogger

In the end you want to make sure that your fixture gets disposed and also that there's no race condition that could allow one instance of IMongoRunner from not being disposed.
If you still can't find the "leak", then you can try to use testcontainers which is another approach of spawning a mongo process but in a Docker container.
However, you might still have the same "leak" problem leading in a docker container staying alive. This might not "block" your tests or your CI, though.

Closing due to inactivity


A query about your paper

I have two question struggle me for a long time, can you give me an answer? Thank you a lot.
Q1：You say "a k-layers GCN aggregates information of words that are k hop away. Such a way of embedding structure may hinder
cross-lingual transfer when the source and target languages have different path length distributions among words". Is the path distance refer to the distance in the syntactic structure? But the Gate and GCN both use the syntactic structure, what's the different?
Q2：You say "GCNs struggle to model words with long-range dependencies", is it beacuse it only aggregates information of words that are k hop away? But the Gate also attend the distance within delta, what's the different?

Yes, path distance refers to the distance in the syntactic structure. Please read the paper carefully to understand the difference between GCN and GATE.
We can set an arbitrary value to delta.  A 1-layer GATE model can model dependencies between words that are k-hop away by setting delta=k. But for GCN, we need a k-layer GCN encoder.


Include docker image in metadata

Hi,
Would it be possible to add the docker image name:tag to the metadata? It is available from kube pod information and the container_id is already known from the log. This would allow to trace logs back to specific versions of pods/applications/containers in fast-moving environments, quite a valuable addition in my opinion.
I've looked through the code (I'm not a very experienced ruby developer) and it looks to me like this could be added without too much issues, but I'm not familiar enough to take a stab without getting some feedback where and how this would be best implemented..

Wrong repo, sorry..


Make alarm rules work for events

Some events can directly and immediately trigger service failure, such as health-check failure, Pod OOM, etc., I think we can have alarm rules work for events as well, WDYT @wu-sheng , for example.
  unhealthy_event_rule:
    metrics-name: Unhealthy
    threshold: 2
    op: ">"
    period: 10
    count: 1

Make sense to me. Is the model compatible with this? How to measure an event as a number?


lorri is missing functionality for ghcide in emacs:

Describe the bug

with this shell.nix: https://dpaste.org/NcYb , when i run nix-shell in terminal, emacs opens up into the directory and ghcide is able to recognize modules when i try to import, but when i try to use   (lorri+direnv+emacs-direnv) in emacs, ghcide works but it's not able to recognize modules, like when i try to import Yesod for example.
Any tips to help me fix this will be greatly appreciated, thanks in advance !!!
To Reproduce
Steps to reproduce the behavior:

...
...
...

Expected behavior

Metadata

$ lorri info
<please paste output here>

$ uname -a
<please paste output here>

Additional context

Could you please fill out the issue template and use an inline code-block for your shell.nix? The dpaste link is already deleted.

I figured it out in the other issue: https://github.com/target/lorri/issues/377  , go ahead and close this issue


Pass terraform plan output to apply

Current issue I know we've talked about is when running terraform plan output. The output file has relative paths to where it was ran. So if you ran apply on another node in jenkins and the paths where different. Things would break.
I'm wondering what happens when you set the environment variable TF_IN_AUTOMATION? Does it remove all those relative path issues?

Was reading this today https://learn.hashicorp.com/terraform/development/running-terraform-in-automation

NVM. looking more through this. found this statement Before running apply, obtain the archive created in the previous step and extract it at the same absolute path.
I wonder if there's a better way to solve this?

I thought there was an open feature request on terraform to fix this, but apparently there isn't.
Extracting at the same absolute path is problematic in Jenkins, because (1) if you have multiple build nodes, you'd need to ensure that JENKINS_HOME is the same on all of them, and (2) if you're using GitHub Branch Source / Multibranch, I'm pretty sure the workspace paths are different for every build.
The only sure-fire way that I can think of to fix this is to run terraform inside a Docker container (i.e. with docker.image('image/name:tag').inside() { ... }, and mount the workspace in to some reproducible path like /app. But that's pretty ugly for multiple reasons, if you're not already doing it.


[Perf issue] group name resolving is ultra slow on domains with a lot of groups

Hi again. This has been a long-standing issue I've noticed with Process Hacker, that isn't exhibited by Process Explorer (since it seem to resolve them on a background thread(s)), but the way PH resolves group names ends up locking up the UI when there are over 150+ in a large domain. I think some of this needs to be handled by a background thread.
The result is:

If Token was the tab last selected for any given Process properties, then PH will hang for approx 20 seconds once double clicking on any other process, since its resolving groups on its UI thread.

It's annoying to say the least. I haven't specifically tried debugging on the domain connected machine, but viewing the code I would bet the code path is:
tokprp.c ! PhpUpdateSidsFromTokenGroups -->
fullName = PhGetSidFullName(Groups->Groups[i].Sid, TRUE, NULL))) -->
LsaLookupSids
I don't think its LsaLookupSids fault as from tests with some C# code calling the documented way LookupAccountSidA, appears slow on this domain. I would suspect Process Explorer uses this standard win32 API, and just dispatches the processing on a worker background thread, as it appears from its dialog where it automatically lists the SIDs, and you can see it resolving each one in "realtime" with its UI still being responsive.
Implementing a fix for this by myself is above my knowledge of how PH UI works, so maybe dmex you could take a stab at this, and I would surely test any nightly commit on the machine in question. It seems like this is do-able given the excellent responsiveness with other PH methods, callbacks, updates, etc... so maybe this one is just handled somewhat poorly, not accounting for networking resolving delay (almost like 1/2 second per group name.

For my local copy of the code, im considering trying to move the Groups out of the combined Privileges list (like it was previously) and have some sub-tab splitting apart Privs and Groups, as this issue really bugs me daily when peering into a process's token (mainly for Privilege work). Maybe this would be an easier fix for now? I definitely dont like how it is anyway with no longer being able to Select All in the privileges list, without it also highlighting all groups (since I may just want to qucikly enable all privileges). But now with the combined list, I have Shift Click on the Privilege range that I want. :/
Anyway, if I can provide more info that's needed, just let me know.

Maybe for now it’s best to implement 2 suntabs under token and just show Privilges by default. That would be a nice “workaround” to such problem of opening process properties... most of the time o couldn’t care about all the groups

Edit, looks like maybe this has been fixed above? I’ll test this out and try


[Release] Milestone M181

Changes:

#1712: git-vfs: update to Git 2.30.0

Closing, as the M181 release was canceled.

Closing, as the M181 release was canceled.


Add documentation regarding possible output variables

Requested Feature
Currently, there's little documentation about valid variables that can be used in config.output. In fact, end users have to check this (formatter.py) to get a sense of what's allowed.
Possible implementation
I would add a table in the documentation, perhaps something like the following table:

Variable
Explanation
Example

{title}

Dark Horse

{artists}

Katy Perry, Juicy J

{artist}
The first of {artists}
Katy Perry

{album}

PRISM

{album-artist}

Katy Perry

{genre}

dance pop

{disc-number}
Useful for multi-disc releases
1

{disc-count}

1

{duration}
In seconds
215.672

{year}

2013

{original-date}

2013-01-01

{track-number}

06

{tracks-count}

13

{isrc}
Song/Label ID (?)
USUM71311296

{track-id}
Spotify song ID
4jbmgIyjGoXjY01XxatOx6

{publisher}
Publishing label
Capitol Records (CAP)

{list-length}
Probably something related to playlists?

{list-position}
Probably something related to playlists?

{list-name}
Probably something related to playlists?

{output-ext}
File extension
.mp3

Do you want to open a PR with this change?

Sure, but I'm not entirely sure of the real purpose of isrc and the list- values.
Also, would it be fine to put the table in Usage.md under the config example?


[excel] (Settings) Add PrintComments sample

A simple sample showing how to use the PrintComments enum.

Learn Build status updates of commit f919e1b:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/docs-ref-autogen/excel/excelscript/excelscript.pagelayout.yml
:white_check_mark:Succeeded
View (office-scripts)

docs/docs-ref-autogen/excel/excelscript/excelscript.printcomments.yml
:white_check_mark:Succeeded
View (office-scripts)

docs/sample-scripts/excel-scripts.yaml
:white_check_mark:Succeeded

generate-docs/tools/API Coverage Report.csv
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the learn.microsoft.com contributor guidesPost your question in the Learn support channel

Learn Build status updates of commit fb56879:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/docs-ref-autogen/excel/excelscript/excelscript.pagelayout.yml
:white_check_mark:Succeeded
View (office-scripts)

docs/docs-ref-autogen/excel/excelscript/excelscript.printcomments.yml
:white_check_mark:Succeeded
View (office-scripts)

docs/sample-scripts/excel-scripts.yaml
:white_check_mark:Succeeded

generate-docs/tools/API Coverage Report.csv
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the learn.microsoft.com contributor guidesPost your question in the Learn support channel


Error "IRI not supported"

When i try to POST a new resource of a Product, with a related Category, API says me "
  "@type": "Error",
  "hydra:title": "An error occurred",
  "hydra:description": "IRI  not supported (found \"19\" in \"category\" of \"AppBundle\\Entity\\Product\")",

Category 19 exists and its mapped correctly with products.

Hello @markitosgv.
Could you give us:

The version which your running on
The content of your POST request
Your entities

Thanks :)

Hi @theofidry,
Let's go, first DunglasApiBundle I'm using is v1.0.0-beta.3.
My entities:
Product.php
<?php

namespace AppBundle\Entity;

use Doctrine\ORM\Mapping as ORM;

use Symfony\Component\Validator\Constraints as Assert;
use Symfony\Component\Serializer\Annotation\Groups;
/**
 * Product
 *
 * @ORM\Table()
 * @ORM\Entity(repositoryClass="AppBundle\Entity\ProductRepository")
 */
class Product
{
    /**
     * @var integer
     *
     * @ORM\Column(name="id", type="integer")
     * @ORM\Id
     * @ORM\GeneratedValue(strategy="AUTO")
     */
    private $id;

    /**
     * @var string
     *
     * @ORM\Column(name="name", type="string", length=255)
     * @Groups({"inventory"})
     */
    private $name;

    /**
     * @var string
     *
     * @ORM\Column(name="reference", type="string", length=255)
     * @Groups({"inventory"})
     *
     * @Assert\Length(
     *      min = 13,
     *      max = 13
     * )
     */
    private $reference;

    /**
     * @ORM\ManyToOne(targetEntity="Category")
     * @Groups({"inventory"})
     */
    protected $category;

Category.php
<?php

namespace AppBundle\Entity;

use Doctrine\ORM\Mapping as ORM;

use Symfony\Component\Serializer\Annotation\Groups;
/**
 * Category
 *
 * @ORM\Table()
 * @ORM\Entity(repositoryClass="AppBundle\Entity\CategoryRepository")
 */
class Category
{
    /**
     * @var integer
     *
     * @ORM\Column(name="id", type="integer")
     * @ORM\Id
     * @ORM\GeneratedValue(strategy="AUTO")
     */
    private $id;

    /**
     * @var string
     *
     * @ORM\Column(name="name", type="string", length=255)
     * @Groups({"inventory"})
     */
    private $name;

My POST content:
POST /xxxx/api/products HTTP/1.1
Host: localhost
Cache-Control: no-cache

{"name":"test","reference":"8888888888888","category":"17"}

Response is:
{
  "@context": "xxxxx/api/contexts/Error",
  "@type": "Error",
  "hydra:title": "An error occurred",
  "hydra:description": "IRI  not supported (found \"17\" in \"category\" of \"AppBundle\Entity\Product\")"
}

PS. Category with id 17 exists.

@markitosgv keep in mind the the identifier of each "object" is its URI, not it's ID (mostly related to the storage layer). So the value you have to send in the category field is the URI of the given category.
So if you try with the following body, that should be better:
{"name":"test","reference":"8888888888888","category":"\/categories\/17"}

Ok works perfect, thanks!

Hello,
If I have a relation one to many to post, how can I post an array?
The api interface Nelmio support this type of syntax?
Thanks


My Contribution for Github Programme

String functions

Hi @Naina047. Welcome to the league. Thank you for your contribution to Cyberbuddy.
Tip:- Add an issue or just comment in a pre existing issue matching your contribution so that you can reference your commits to the issue and it is easier for the maintainer to keep track of it.


Closable tabs

Feature request to implement closable tabs.

This is more of a plugin request.
There are multiple solutions that you can implement:
Stack Overflow
Jay Keu
For now, I am not able to create new features for the template. I hope the provided links helps you.
Thanks for the suggestion.


verify the clamps in unconstained_dists.py aren’t too extreme

try relaxing clamps; also, maybe don't hardcode these clamped values

I finally got around this and the clamps seem to be fine (though admittedly, hardcoding standard deviation ranges isn't ideal). To test whether the clamps could be problematic, I trained bliss for 10 epochs and then put break points in unconstrained_dists.py to see how often the clamps had any effect, that is, how often the clamp inputs differed from the output. It's exceedingly rare for the clamp upper bounds to matter. The lower bounds were active sometime, but these serve to keep the standard deviations from becoming so small that we could have numerical stability issues.


[#4313] ByteBufUtil.writeUtf8 should use fast-path for WrappedByteBuf

Motivation:
ByteBufUtil.writeUtf8(...) / writeUsAscii(...) can use a fast-path when writing into AbstractByteBuf. We should try to unwrap WrappedByteBuf implementations so
we are able to do the same on wrapped AbstractByteBuf instances.
Modifications:

Try to unwrap WrappedByteBuf to use the fast-path

Result:
Faster writing of utf8 and usascii for WrappedByteBuf instances.

Cherry-picked into 4.0 (d6a00d06427a5215c113f8d3eee8e75fa2e7f99b), 4.1 (30dc1c1fa4249609551608c20fb0f42475502eab) and master (404b004775903d3950d67d5f8cd4cddc26fe1a05)


Add University of Málaga to JetBrains SWOT Repository

This pull request aims to add the University of Málaga to the JetBrains SWOT repository, which is used to identify academic institutions. By adding our university, students and faculty members will be able to apply for JetBrains' educational product licenses, facilitating enhanced access to development tools.
Details:

University Name: University of Málaga
Location: Málaga, Spain
Domain: uma.es
Reason for Addition: Enabling JetBrains product access for students and faculty.

The added JSON file follows the required structure and has been tested locally to ensure correctness. Please see the attached file for verification.
Additional Notes:

The domain uma.es is the official email domain for the University of Málaga, used by both students and faculty.
This submission complies with all guidelines specified in the repository's README for contributing.

Thank you for considering this addition. I look forward to any feedback or required changes. Should there be any issues with this submission, please feel free to let me know, and I will address them promptly.

@rulp91 I am sorry, the domain uma.es is removed from our trusted domains list because it was abused in the past. If you are the student of this school, please enroll to GitHub Student Developer Program. Then apply for JetBrains educational subscription with your GitHub account (GitHub tab at https://www.jetbrains.com/shop/eform/students).

Thank you for your prompt response and for clarifying the situation regarding the domain uma.es. I appreciate your guidance on how to proceed.
I will follow your advice and enroll in the GitHub Student Developer Program. Subsequently, I will apply for the JetBrains educational subscription using my GitHub account as you suggested.
Thank you once again for your assistance.
Best regards,


Fix 'structuring-software-projects' sample

Importing the sample to IDEA is currently fails with a following error message:
Unresolved module dependency (...) Neither the source set nor the artifact property was populated by the Android Gradle plugin.

This issue seems to be the root cause: https://issuetracker.google.com/issues/247066500
Updating AGP to 7.3.1 locally fixes the issue.

@bot-gradle test RFM

OK, I've already triggered the following builds for you:

PullRequestFeedback build

@bot-gradle test and merge

Your PR is queued. See the queue page for details.

OK, I've already triggered a build for you.


WIP: Review dependencies and examples, make Vuex more explicit with TypeScript

Objective
The Vuex Mutations, Actions and Getters looks a bit done in a hurry.
I feel this project is about showing how to use Nuxt with TypeScript.
Let's rework the Vuex modules.
There aren't much properly shown examples of Nuxt with TypeScript checked Vuex modules.
Maybe we need something similar to what's shown in this StackOverflow question (using championswimmer/vuex-module-decorators, codesandbox) or maybe we don't need. It looks like docs example about using TypeScript for vuex nuxtjs.org/examples/typescript-vuex
Main

Make Vuex work with strictly typed Mutations, Actions, etc.
Setup/Review serverMiddleware (Express) to cache HackerNews backend response (?)
Setup/Review Axios to leverage @nuxtjs/axios

Maybe?

Use configuration management (e.g. convict)
Review Prettier and VSCode setup
TypeScript VSCode bindings with current TypeScript version (e.g. in .vscode/settings.json, add   {"typescript.tsdk": "node_modules/typescript/lib"}
Setup VSCode Debuging tools

Review
Make sure we can run the following properly, without errors:

Unit tests
As mode: "spa", after nuxt build, and nuxt start
As mode: "universal", after nuxt build, and nuxt start
Properly see we can see filesystem cache of origin responses (isn’t what Express API Cache is for?)

Done

Make @nuxtjs/axios to use NUXT_ENV_... environment variable to flip which API endpoint to call
There was an issue with Prettier configuration

https://github.com/coding-blocks-archives/realworld-vue-typescript/blob/master/src/store/modules/articles.ts


Boba-community docker image "l2" uses chain ID 10, op-node thinks it should be 288

From the "l2" docker image logs:
[INFO] [04-22|22:30:04.978] Initialised chain configuration          config="{ChainID: 10, Homestead: 0, DAO: <nil>, Tangerine Whistle: 0, Spurious Dragon: 0, B                                                  Byzantium: 0, Constantinople: 0, Petersburg: 0, Istanbul: 0, Muir Glacier: 0, Ber                                                  rlin: 3950000, London: 105235063, Arrow Glacier: 105235063, Gray Glacier: 1052350                                                  063, Terminal Total Difficulty: 0, Merge Netsplit: 105235063, Shanghai: 170499240                                                  01, Cancun:<PHONE_NUMBER>, Prague: <nil>, BedrockBlock: 105235063, RegolithTime: 0,                                                    CanyonTime:<PHONE_NUMBER>, EcotoneTime:<PHONE_NUMBER>, Engine: optimism}" genesis=0x7c                                                  ca38a1916c42007829c55e69d3e9a73265554b586a499015373241b8a3fa48b
You can see the ChainID is clearly set to 10.  However, op-node thinks it should be 288:
t=2024-04-22T22:39:09+0000 lvl=info msg="Initializing rollup node" version=v0.0.0-5c83ca4f-1713316462
t=2024-04-22T22:39:09+0000 lvl=info msg="Connected to L1 Beacon API, ready for EIP-4844 blobs retrieval." version="Prysm/v5.0.2 (linux amd64)"
t=2024-04-22T22:39:09+0000 lvl=eror msg="Error initializing the rollup node" err="failed to init L2: incorrect L2 RPC chain id 10, expected 288"
t=2024-04-22T22:39:09+0000 lvl=crit msg="Application failed" message="failed to setup: unable to create the rollup node: failed to init L2: incorrect L2 RPC chain id 10, expected 288"

After this, the op-node dies.  I'm running op-erigon:v1.1.5 and op-node:v1.6.3 which were auto-pulled as 'latest' by leaving the version numbers blank in my .env file.  OS is Ubuntu 20,04 LTS.

This appears to be related to the snapshot used in op-node.  The README.md in /boba/boba-community clearly states:
### Get the data dir

1. The first step is to download the initial data for `op-erigon`.

- OP Mainnet

  The **erigon** db can be downloaded from [Test in Prod OP Mainnet]
(https://op-erigon-backup.mainnet.testinprod.io).

When this snapshot is used, the node runs chainID 10.  Note that the above is the only one that says "Mainnet" in the README.md.  It is necessary to use the snapshot mentioned in the top of the docker-compose-boba-mainnet.yml file, in the same directory:
# The erigon db can be downloaded from
# https://boba-db.s3.us-east-2.amazonaws.com/mainnet/boba-mainnet-erigon-db-1149019.tgz
# and extracted to the DATA_DIR


⚠ Jenkins Plugins Artifactory has degraded performance

In d64a54b, Jenkins Plugins Artifactory (https://get.jenkins.io/plugins/artifactory/) experienced degraded performance:

HTTP code: 200
Response time: 1314 ms

Resolved: Jenkins Plugins Artifactory performance has improved in 8798356 after 22 minutes.


fix: prevent failed live-reloads on dev machine

:tada: This PR is included in version 4.17.0-alpha.15 :tada:
The release is available on:

npm package (@alpha dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 1.17.0-alpha.18 :tada:
The release is available on:

npm package (@alpha dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 3.0.2 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 1.20.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 4.20.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 3.0.0-alpha.4 :tada:
The release is available on:

npm package (@alpha dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Fixed a bug and typo.

Removed a hard-coded constant from run_midas.py and fixed a typo (threhold instead of threshold).

You forgot to change this line.
https://github.com/zhengqili/Neural-Scene-Flow-Fields/blob/94032fa44b7035d482c593d71f954262380c481c/nsff_scripts/run_flows_video.py#L428
There is error now.


refactor: use map for environment instead of pipes

Agents currently use pipe separated strings for environment variables. Refactored to maps.

Codecov Report
Patch coverage: 42.85% and project coverage change: -0.14 :warning:

Comparison is base (422cdb2) 18.01% compared to head (23ea35f) 17.87%.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
Additional details and impacted files
@@             Coverage Diff             @@
##           develop     #617      +/-   ##
===========================================
- Coverage    18.01%   17.87%   -0.14%
===========================================
  Files           54       53       -1
  Lines         5091     5080      -11
===========================================
- Hits           917      908       -9
+ Misses        4147     4145       -2
  Partials        27       27

Impacted Files
Coverage Δ

golang/api/v1/deploy.go
80.61% <ø> (ø)

golang/pkg/crane/k8s/deploy_facade.go
0.00% <0.00%> (ø)

golang/pkg/dagent/utils/docker.go
8.88% <0.00%> (+0.03%)
:arrow_up:

golang/internal/mapper/grpc.go
69.68% <100.00%> (+0.07%)
:arrow_up:

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Certificate Text and Icon

[ ] Select icon for project

[ ] write text for project

https://docs.google.com/document/d/1NVpetRyqGpCje0oSiutHSr7PJL5XkItC6WMSd0aZBwc/edit?usp=sharing


Bulk Decode - Folder browser not launching on Windows 10

    Thanks! 1.4 via the Microsoft Store is not opening the Folder browser when I click the button. It just sits there and greys the button out.

Originally posted by @jpooley-hearst in https://github.com/MarkHopper24/barcodrod.io/discussions/10#discussioncomment-5469981

Cause is outlined here: https://github.com/microsoft/WindowsAppSDK/issues/776
I'm testing a fix that and can confirm it resolves the issue on W10. Need to make sure it doesn't regress any W11 behavior and if not, will get this out as a hotfix within the next few days.

Should now be fixed in v1.4.1, now available on the Microsoft Store and GitHub. @jpooley-hearst, please let me know if you run into any issues. Thanks for your help on this one!


Howto Template

Rules in Template:
Example:
Get {{set number1 = number / 1024}} or
{{set number1 = number * 1024}}

Templates should not be used for calculations. That's what controllers are for. But if you really want to, create a template helper function in one of your controllers or in app/init.go:
func init() {
	revel.TemplateFuncs["multiply"] = func(a, b int) int {
		return a * b
	}
}

Use it in your template as:
{{set . "number1" (multiply .number 1024)}}
{{.number1}}

And as I have already said, Stackoverflow is where questions should be asked. This is a bugtracker.

Sometimes templates are the right place to do certain calculations if the result is only relevant to the view. For example, calculating a percentage from a ratio. However, the cleanest way would be to create a filter ("TemplateFunc") that does the specific calculation, rather than doing arbitrary math in the template.

:+1:
Thanks
I'll post my questions on Stackoverflow
I migrated my Beego project to Revel, I am very loving the Revel, congratulations to all of the community are doing a wonderful job.
The revel.github.io was pretty much after the upgrade.
I hope I can help in translating some contents to Portuguese Brazil and create some screencast

@jniltinho Help with documentation and translation would be great. Screencasts would be very appreciated as well. :100:

We need to include a quick "template starter" to the docs, its on my TODO list...

@jniltinho thank your very much for your gratitude! It means a lot to me (and us) to have positive feedback from fellow developers :)


Enabling BT can fail

If the machine is booted with BT off and CP attempts to enable it, it can fail

I've noticed BT issues in general.  Sometimes when BT is off, CP will fail to enable it as well as vice versa.

I've noticed BT toggling erroring quite a lot for me when waking from sleep (usually disable on sleep and enable on wake in a specific location).

Put a delay on it?

I'll try that when I get back home (in a few days). Although I wonder if it'd matters any, as actions only start executing once I've finished entering my password, not before, at least that's the impression I've got so far. And at that point, the computer should be completely "awake", right? (notice the should :-P )

This is probably related to the BT hardware not being ready yet, similar to how I need to delay doing anything with it in the evidence source.


Trying to copy table data from one db to another seems to fail if some columns have attribute server_default=True

First Check

[X] I added a very descriptive title to this issue.
[X] I used the GitHub search to find a similar issue and didn't find it.
[X] I searched the SQLModel documentation, with the integrated search.
[X] I already searched in Google "How to X in SQLModel" and didn't find any information.
[X] I already read and followed all the tutorial in the docs and didn't find an answer.
[X] I already checked if it is not related to SQLModel but to Pydantic.
[X] I already checked if it is not related to SQLModel but to SQLAlchemy.

Commit to Help

[X] I commit to help with one of those options 👆

Example Code
"""server_default issue"""

from datetime import datetime
from typing import Optional

from sqlalchemy import func
from sqlmodel import (
    Field,
    SQLModel,
    Session,
    create_engine,
    select,
)

try:
    from rich import print
except ImportError:
    pass

class Product(SQLModel, table=True):

    product_id: int = Field(primary_key=True)
    created_time: Optional[datetime] = Field(
        default=None,
        sa_column_kwargs={
            "server_default": func.now(),
        },
    )
    updated_time: Optional[datetime] = Field(
        default=None,
        sa_column_kwargs={
            "server_default": func.now(),
        },
    )

# Setup sqlite file db
engine0 = create_engine(
    "sqlite:///sqlalchemy_issue.db",
    future=True,
    connect_args={"check_same_thread": False},
    echo=True,
)
SQLModel.metadata.create_all(engine0)

# Setup in-memory db
engine1 = create_engine(
    "sqlite://",
    future=True,
    connect_args={"check_same_thread": False},
    echo=True,
)
SQLModel.metadata.create_all(engine1)

# Rebuild sqlite file db if it does not exist
with Session(engine0) as session:
    data = session.exec(select(Product)).all()
    if not data:
        print("")
        print("--> Build engine0 db sqlite file: START")
        for pid in range(6):
            session.add(Product(product_id=pid))
        session.commit()
        print("Added data to engine0")
        print("<-- Build engine0 db sqlite file: END")

# Get items from engine0 db
print("")
print("--> Get data from engine0: START")
with Session(engine0) as session:
    data0 = session.exec(select(Product)).all()
    print("Got data from engine0")
    print(data0)
print("<-- Get data from engine0: END")

# Add items to engine1 db
print("")
print("--> Add data to engine1: START")
with Session(engine1) as session:
    for item in data0:
        session.add(item)
    session.commit()
    print("Added data to engine1")
print("<-- Add data to engine1: END")

# Get items from engine1 db
print("")
print("--> Get data from engine1: START")
with Session(engine1) as session:
    data1 = session.exec(select(Product)).all()
    print("Got data from engine1")
    print(data1)
print("<-- Get data from engine1: END")

# Add item without server_default columns
print("")
print("--> Add new_item to engine1: START")
with Session(engine1) as session:
    new_item = Product(product_id=99)
    session.add(new_item)
    session.commit()
    print("Added new_item to engine1")
print("<-- Add data to engine1: END")

# Get items from engine1 db (again)
print("")
print("--> Get data from engine1 (again): START")
with Session(engine1) as session:
    data1 = session.exec(select(Product)).all()
    print("Got data from engine1")
    print(data1)
print("<-- Get data from engine1 (again): END")

Description

Create model with sqlalchemy column attribute server_default=func.now() set to have the db side set timestamps on creation.
Create engine that loads sqlite db file (engine0).
Create engine that is a blank, in-memory sqlite db (engine1).
Load data from engine0.
Attempt to add data from engine0 to engine1.

This appears to fail silently (getting data from engine1 still produces nothing).

Add new data that does not have server_default columns set to engine1.

Successfully adds data.

Operating System
macOS
Operating System Details
No response
SQLModel Version
0.0.4
Python Version
3.10.0
Additional Context
I initially created this issue on sqlalchemy's repo: https://github.com/sqlalchemy/sqlalchemy/discussions/7435, but I am unsure where the root of the problem is (or if this is expected behavior).

Was able to resolve the issue by using session.merge() instead of session.add(). See for details: https://github.com/sqlalchemy/sqlalchemy/discussions/7435#discussioncomment-1788215


CB-16131: Added proper error handling to SdxEventsService

Jira: https://jira.cloudera.com/browse/CB-16131
This specifically serves to introduce actual error throwing for the SdxEventsService. Before we were just returning an empty list and not logging or throwing anything.
This issue is of particular importance due to a difficult experience had during the release of 2.52.0, more info here: https://jira.cloudera.com/browse/CB-15944.
I have simply opted to throw exceptions in the various places where the errors can occur, allowing for them to be received and interpreted.

Marking this as blocked to wait for #12351.

retest this please

@aszegedi what do you mean? Like re-run the checks or is there something you see wrong with my tests themselves?

retest this please is a magic sentence for github to rerun PR check jobs

Ah haha, I wasn't aware of that, that's kinda cool. Thank you.

Yep! This mean: I'd just like to rerun the PR checks (that's all and no worries ;) ). I made some changes at our Jenkins PR jobs. Unfortunately the jenkins: cb-integration-test check was created then removed too soon by me. So this has been stuck at pending state. The PR can be approved and merge even if the jenkins: cb-integration-test check is pending, because of this check is not a required one.
In case of new PRs in the future this check won't appear in the list.

please rebase this onto top of master

root cause of ums test failure: this should be called with internal actor too: https://github.com/hortonworks/cloudbreak/blob/b72e5977a9c6d0c47ebb9b098a06256d465ae348/datalake/src/main/java/com/sequenceiq/datalake/service/SdxEventsService.java#L142
like here:
https://github.com/hortonworks/cloudbreak/blob/b72e5977a9c6d0c47ebb9b098a06256d465ae348/datalake/src/main/java/com/sequenceiq/datalake/service/SdxEventsService.java#L131
since errors are not hidden anymore, it appeared


N25 final

Part of #751
Preview (f628ccb): https://agitated-saha-af60ca.netlify.app/news/025/
Todo:

[x] Add sections at the bottom
[x] Line length rewrap
[x] Full spelling and grammar pass

Aiming to release this in around 12 hours.
Expected release time is 18:00 GMT

Hi! There's a slight mistake with the developers of TO BE DIRE. This was addressed in the Rusty Jam's Discord and the game's itch.io page. So, the change would be in the index.md in line 73  :
- Third place: [To be Dire][rusty-jam-third-place] by septum

To be changed with:
- Third place: [TO BE DIRE][rusty-jam-third-place] by mdaffin,
  TimeLark and septum

@ozkriff All of your notes should be resolved :100:

I'll aim to merge in about 2 hours, which will hopefully give any final reviewers time to check out stuff.


general changelog process

We should create an unified process how to get the changelogs of server, client (and maybe mobile apps too) on the website. RN everyone does it differently which makes it hard for me to scrape and display it on the website.
Opening this for awareness, we should talk and find a way which makes everyones life easier.
@guruz @michaelstingl @PVince81 @Kawohl @jnweiger
website perspective
From the website visitors perspective I think we should view a complete changelog per product (server, client, mobile). To do so there are two possibilities:

you'll get a login to owncloud.org and edit the changelog manually in wordpress (this option might give you cancer, i know :) )
You put a file on github somewhere in the project which contains all changelog information to all versions. It's up to you how you do this but I will only scrape one file. For best results use markdown to structure content.

Please let me know what you think about it.
I know adjustments to used processes are inconvenient but I'm sure we can ease this up by unifying the processes.
more ideas

[ ] Add /feed for changelogs

We now have changelogs for all platforms in the GH repos:
https://github.com/owncloud/client/blob/master/ChangeLog
https://github.com/owncloud/core/blob/stable10/CHANGELOG.md
https://github.com/owncloud/android/blob/master/CHANGELOG.md
https://github.com/owncloud/ios/blob/master/Changelog.md
@guruz @SamuAlfageme use Markdown format for client changelog too and make issue ID's clickable? (same as server)

uh that was fast. Thank you!

Beautiful: https://owncloud.org/changelog/

Beautiful: https://owncloud.org/changelog/

for the server it shows me only this (as text, it does not load anything):
[load-github id=”changelog-server” url=”https://raw.githubusercontent.com/owncloud/core/stable10/CHANGELOG.md”]

Broken for desktop too.
[load-github id=”changelog-desktop” url=”https://raw.githubusercontent.com/owncloud/client/master/ChangeLog”]

Please for desktop just add those two links:
New releases: https://github.com/owncloud/client/releases
All releases: https://raw.githubusercontent.com/owncloud/client/master/ChangeLog

(We can think of a better text later, e.g. the latter one does not contain binary/installer links)


How to integrate istio tracing with Skywalking

Please answer these questions before submitting your issue.

Why do you submit this issue?
[ ☑] Question or discussion
[ ] Bug
[ ] Requirement
[ ] Feature or performance improvement

Question

What do you want to know?

Bug

Which version of SkyWalking, OS and JRE?
6.4

Which company or project?

What happen?
If possible, provide a way for reproducing the error. e.g. demo application, component version.

Requirement or improvement

Please describe about your requirements or improvement suggestions.

I followed below step to create the skywalking adapter for istio and related metrics transform to skywalking successful.
https://github.com/apache/skywalking/blob/master/docs/en/setup/istio/README.md
But Skywalking tracing is not available.
I found endpoint relation table don't have any data after check the skywalking data source.
So my question is  whether this adapter can collected tracing data ?

If you want trace, you could use zipkin or jaeger receiver, plus zipkin-es or jaeger-es storage.


SCB-938 Should check self presevation max ttl

Follow this checklist to help us incorporate your contribution quickly and easily:

[ ] Make sure there is a JIRA issue filed for the change (usually before you start working on it).  Trivial changes like typos do not require a JIRA issue.  Your pull request should address just this issue, without pulling in other changes.
[ ] Each commit in the pull request should have a meaningful subject line and body.
[ ] Format the pull request title like [SCB-XXX] Fixes bug in ApproximateQuantiles, where you replace SCB-XXX with the appropriate JIRA issue.
[ ] Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
[ ] Run go build go test go fmt go vet to make sure basic checks pass. A more thorough check will be performed on your pull request automatically.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

Codecov Report

Merging #450 into master will decrease coverage by <.01%.
The diff coverage is 88.88%.

@@            Coverage Diff             @@
##           master     #450      +/-   ##
==========================================
- Coverage   59.77%   59.76%   -0.01%
==========================================
  Files         149      149
  Lines       13174    13176       +2
==========================================
  Hits         7875     7875
  Misses       4727     4727
- Partials      572      574       +2

Impacted Files
Coverage Δ

server/core/backend/common.go
100% <ø> (ø)
:arrow_up:

server/core/backend/defer_instance.go
86.02% <88.88%> (+0.3%)
:arrow_up:

server/plugin/infra/registry/etcd/tracing.go
72.72% <0%> (-9.1%)
:arrow_down:

server/broker/util.go
53.2% <0%> (-0.27%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 95013d4...65d86e3. Read the comment docs.

Coverage decreased (-0.1%) to 62.219% when pulling 65d86e315d988c296cdbfe79de675a61fb682518 on little-cui:bug into 95013d48d6c3db50c10f575a29d0b773fb9c4128 on apache:master.


Break Codemine in useful code samples

Since the beginning of this framework, the number of helper functions grew quite a bit. Since most of the times we don't use the whole framework functionality in projects and we need only specific functions from it, we could maybe benefit more from it, if we can make Codemine in such a way, we can find and take only the functions we need.
Confirm with @chriscombs before starting on this

This was done in #61


move dependencies bundled by webpack to devDependencies

every js dependency (excluding the 2 listed here, which include native code and should not be a subject to this: https://github.com/mattermost/desktop/blob/master/webpack.config.main.js#L28-L29) is bundled by webpack into the files in dist/ directory.
moving them to devDependencies breaks nothing and reduces package builds from ~80 MiB to ~20 MiB (excluding electron builds in both).
I was about to submit a PR myself, but the data requested in contributor agreement is insane.

the webpack output is the same, but the dependencies (excluding devDependencies) from node_modules/ are packaged by electron-builder into app.asar

@selfisekai @tboulis Did some playing around and turns out this would help reduce the package size a bit. On Windows, looks like about 10-15 MB. I am noticing that the app.asar file is also smaller.
I think what's happening by doing this is making it so that we don't drop a bunch of source code for node_modules in the package, which is what was happening before.
I'll make a PR with the changes and tag this issue. Thanks for the suggestion :)


Missing Profile Statistics via OpenDota API

Hello OpenDota Team,
I’m experiencing an issue while using the OpenDota API. Despite my Steam profile being public, I cannot access my Dota 2 statistics through the API.
Could you please clarify:
1/ Do I need to register or link my Steam ID specifically with OpenDota for my stats to become visible?
2/ Are there any common reasons (e.g., delays in updates) why my stats might not appear?
Here’s my STEAM ID for reference:<PHONE_NUMBER>4136869
DOTA ID: 83871141
Looking forward to your guidance!
Best regards,

You need to enable Expose Public Match Data in the Dota client.


arrays forEach iteration not working well on iOS

Hi All,
I'm very new to angular and typescript.
When I trying to modify the hello world --ng template to show some JSON read from https, I hit this problem.
here's the json which server replies:
{"results":[
      {"objectId":"U6O1G1Jpn5","pid":1,"name":"Airtub","role":"boiler","createdAt":"2017-08-30T13:47:49.538Z","updatedAt":"2017-08-30T13:47:49.538Z"},
      {"objectId":"MXB2XmwYQR","role":"boiler","createdAt":"2017-08-30T23:23:10.457Z","updatedAt":"2017-08-30T23:23:21.149Z","pid":2,"name":"Airfel"},
      {"objectId":"ABhswtAR2n","role":"emitter","createdAt":"2017-08-30T23:53:54.478Z","updatedAt":"2017-08-30T23:54:02.200Z","pid":3,"name":"Airfel"},
      {"objectId":"hPRjeZ9VFH","role":"emitter","createdAt":"2017-08-30T23:54:31.781Z","updatedAt":"2017-08-30T23:54:39.905Z","pid":4,"name":"Airfit"},
      {"objectId":"gCWAx1K9x2","role":"manifold","createdAt":"2017-08-31T00:23:13.388Z","updatedAt":"2017-08-31T00:23:21.083Z","pid":5,"name":"Airfit"},
      {"objectId":"2zVA3hK2wH","role":"manifold","createdAt":"2017-08-31T14:13:28.292Z","updatedAt":"2017-08-31T14:13:38.799Z","pid":6,"name":"Giacomini"}
]}

And here's the code:
@Injectable()
export class ItemService {
    private items = new Array<Item>();

    constructor() {
      var items = this.items;
      http.request({
        url: "https://myserver:3000/hb/classes/Product",
        headers: { "X-Parse-Application-Id": "mapped" },
        method: "GET"
      }).then(function (response) {
          var jsonData = response.content.toJSON().results;
          //console.log(JSON.stringify(jsonData));
          jsonData.forEach(element => {
            items.push(element);
            console.log('E: ' + JSON.stringify(element));  // <-- check with this is correct
          });
      }, function (e) {
        console.log(e);
      });
    }

While it's running on Android, I got all elements in JSON responded and shows well on item view.
But in iOS, the last element lost. but as console.log show the elements read is correct.
So, where's the problem? is this a bug?

Related to https://github.com/NativeScript/NativeScript/issues/3818

Thank you @Nicklliev, at least there's a temp solution.

@zenz thanks for bringing the issue into our attention. Closing this one as a duplicate to https://github.com/NativeScript/NativeScript/issues/3818 - keep track  on the original issue which is planned for fixing with N v3.3


Implement taint analysis using BIR

This issue has been marked as "Deferred" and will be revisited in the future when resources are available.


Changing options on the fly. Is it possible?

Hi!
I'm wondering is there any way to change options and give them in to datepicker after it is constructed? Or is there any commands to reconstruct datepicker object?

+1


[web] Use Flutter Gold instead of flutter/goldens

[x] Update recipes:

Install required deps in web_engine recipe (CL).
Web drones can receive inherited_dependencies (CL).
Pass web_engine dependencies to subshard drones (CL).
Remove temporary 'dependencies' property (CL).
https://github.com/flutter/engine/pull/29168

[x] Pre/post-submit image uploads:

https://github.com/flutter/engine/pull/29139
Disable Gold comments on flutter/engine PRs (PR).

[x] Use a fuzzy matching algorithm:

Update goldctl (CL) (issue)
Add service account to authorized_users (CL)
https://github.com/flutter/engine/pull/29847

[x] Block PRs on Skia Gold:

https://github.com/flutter/cocoon/pull/1505

https://github.com/flutter/cocoon/pull/1541
https://github.com/flutter/cocoon/pull/1546

Fail in CI if Skia Gold is expected to run but didn't run.

https://github.com/flutter/engine/pull/29792
Pass the --require-skia-gold flag in linux and macos (CL).

[x] Cleanup all usages of flutter/goldens:

In recipes (CL).
https://github.com/flutter/engine/pull/30116
Remove smoke tests (Done).
Re-enable Gold comments on flutter/engine PRs (CL).
Archive the flutter/goldens repo (TBD).

[ ] Ability to run screenshot tests locally.

This is complete except for the last item. I created a separate issue for it since I don't plan to work on it in the near future: https://github.com/flutter/flutter/issues/103988


Update azure-stack-redhat-create-upload-vhd.md

@kivenkat : Thanks for your contribution! The author, @mattbriggs, has been notified to review your proposed change.

#sign-off


import errors

File "", line 1, in
File "/home/clemson/miniconda3/envs/pytorch/lib/python3.6/site-packages/ctcdecode/init.py", line 1, in
from ._ext import ctc_decode
ImportError: /home/clemson/miniconda3/envs/pytorch/lib/python3.6/site-packages/ctcdecode/_ext/ctc_decode.cpython-36m-x86_64-linux-gnu.so: undefined symbol: _ZN2at19UndefinedTensorImpl10_singletonE
I have see the problem #73, it still doesn't work.

I find the problem !
You should import torch first. Then import ctcdecode.
Anaconda3-dir/ctcdecode-master/installedfile$ python
Python 3.5.2 |Anaconda 4.2.0 (64-bit)| (default, Jul  2 2016, 17:53:06)
[GCC 4.4.7 20120313 (Red Hat 4.4.7-1)] on linux
Type "help", "copyright", "credits" or "license" for more information.

import torch
import ctcdecode

yeah, you are right. thanks a lot.

I find the problem !
You should import torch first. Then import ctcdecode.
Anaconda3-dir/ctcdecode-master/installedfile$ python
Python 3.5.2 |Anaconda 4.2.0 (64-bit)| (default, Jul 2 2016, 17:53:06)
[GCC 4.4.7 20120313 (Red Hat 4.4.7-1)] on linux
Type "help", "copyright", "credits" or "license" for more information.

import torch
import ctcdecode

Yes! this works. Thank you!

hi @huangnengCSU
I followed the instruction specified above and i am still unable to use it and im getting the error.
I am on an ubuntu16.04 machine with cuda10 and cudnn7.2 . I have Installed pytorch using the pip and for the python 2.7 .
Any help is appreciated.
Thanks

hi @huangnengCSU
I followed the instruction specified above and i am still unable to use it and im getting the error.
Traceback (most recent call last):
File "", line 1, in
File "ctcdecode/init.py", line 1, in
from ._ext import ctc_decode
ImportError: No module named _ext
I am on an ubuntu16.04 machine with cuda10 and cudnn7.2 . I have Installed pytorch using the pip and for the python 2.7 .
Any help is appreciated.
Thanks

https://blog.csdn.net/u011550545/article/details/87926995#

@vaibhav0195 I meet the same problem ,have you fixed it ?

Hi @liudatutu
yes I solved it, I dont remember the actual steps i took to solve it, but the error was resolved by changing my python to python3 or by changing the cuda version to cuda 9.2 I guess.

@vaibhav0195 my python version is python3,but cuda is 9.1,thanks,i will try it.

have you solved it @liudatutu

when I import ctcdecode by the following command:
import torch
import ctcdecode
I found I get the error "No module named _ext" when I run these command in the ctcdecode directory, and I found it can be bypassed in the other directory.


DerivedReactiveList fires CountChanged when it hasn't

See failing test here: https://gist.github.com/mteper/2b6ee72278ab703cf912
(this is against RxUI 6)

We have deprecated ReactiveList in the next release/latest. Closing issue.


Prevent crash if API sends invalid data

From time to time Campfire's API seems to send invalid JSON as payload. Seems that usually this is caused by some Rails error and the resulting data is actually a Rails's error page.
bundler/gems/Scamp-8caa3e34aa19/lib/scamp/rooms.rb:102:in `<<': lexical error: invalid char in json text.   (Yajl::ParseError)
                                   <!DOCTYPE html PUBLIC "-//W3C//

With this patch the json parse error exception is rescued and the crash can be avoided.

Thanks for this great pull request Matias, I've release a new version
of the gem with your changes applied.
Will.
On Tue, Jan 24, 2012 at 9:39 AM, Matias Käkelä
<EMAIL_ADDRESS>wrote:

From time to time Campfire's API seems to send invalid JSON as payload. Seems that usually this is caused by some Rails error and the resulting data is actually a Rails's error page.


Https for web

I am trying to find some clever way to have the web service work with https. Both nginx and apache2

Now works on apache. But I cannot get chrome to accept the cert in any way :(
@iammikek Any experience with self-signed certs?

Works! Just import the certificate in chrome and you have a working https site :)

openssl req -x509 -newkey rsa:4096 -sha256 -days 3650 -nodes \
  -keyout localhost.key -out localhost.crt -subj "/CN=localhost" \
  -addext "subjectAltName=DNS:localhost,IP:<IP_ADDRESS>"


make logo for website

To create a logo for your website, design a simple, memorable graphic that includes your brand name or initials with a distinct icon or symbol. Ensure it is visually appealing, scalable, and reflects the essence of your brand.
assign this issue to me!

@heli0707 I will only accept this issue if the logo you propose looks promising


Adding coverage exemption for AppVeyor.

This was the 2nd commit in #63, but I realize now that this change should go in now and the release should wait until we can confirm some things about 32-bit Python.

FWIW, this change is passing right now on AppVeyor: https://ci.appveyor.com/project/jonparrott/nox/build/1.0.251.master

@jonparrott I am going to merge this based on

The AppVeyor breakage looks like their bug

A build with this change has already gone green


Added the code for Responsive Box Hover Effect

@arpit456jain please check this PR. This will fix issue-141.

@shallanidevi great work
kindly add your project in json file also style_links.json from next time

Fixes  : #141


Interstellar update

Continues from #1428. We need to use the new Observable class instead of Signal, since it allows us to unsubscribe from updates (this is very important for performance reasons).
One important note about the change: Observable removes the concept of errors that Signal had. For signals that require errors, we need to use Result as the Observable's value. There are extensions for Observable's of Results, which is pretty cool. I like this personally; while if it requires us to be slightly more verbose, it also encodes the errorability of an Observable into the type system.
We need to use my fork until https://github.com/JensRavens/Interstellar/pull/39 is merged. Also, this led to discovery of a Swift compiler bug ( https://bugs.swift.org/browse/SR-1313 ), even though it's a duplicate.
Still to be done:

[x] Unsubscribe from Observables where required.

I'm not loving the clunkiness around unsubscribing from observables, I've opened https://github.com/JensRavens/Interstellar/issues/40 for discussion, but this PR can be reviewed independently.

1 Warning

:warning:
Needs testing on a Phone if change is non-trivial

  Generated by :no_entry_sign: danger

Looking all dandy! 🎉


Fix admin queue page title

Fix #26408
# locale_en-US.ini
[admin]
monitor.queues = Queues

Test failure likely unrelated - Data race in TestGit/SSH.

Test failure likely unrelated - Data race in TestGit/SSH.

Already a PR:  Fix data race by using atomic value https://github.com/gliderlabs/ssh/pull/211

Ah, nice, I opened https://github.com/go-gitea/gitea/issues/26411 to track it.

Use a trick to bypass the upstream data race bug. d682e1032de83fec81f520d3f224ba9c6fff3a0c
Let's see whether it works.

The patch works, CI passes

Giving this a bit more time for other reviewers, but ultimately we should land it soon to eliminate the intermittent CI failures related to the race.

I guess it's better to land now to unblock other PRs.

I suspect the race has something to do with go1.21 which already runs on the ci because we specify go-version: ">=1.20". Might wanna lock that down.

A new failure, I think it's related to speed up TestEventSourceManagerRun #26262 : EventSourceUpdateTime = time.Second
--- FAIL: TestEventSourceManagerRun (31.56s)
    eventsource_test.go:83:
        	Error Trace:	/home/runner/work/gitea/gitea/tests/integration/eventsource_test.go:83
        	Error:      	Condition never satisfied
        	Test:       	TestEventSourceManagerRun

I was unable to create a backport for 1.20. @wxiaoguang, please send one manually. :tea:
go run ./contrib/backport 26409
...  // fix git conflicts if any
go run ./contrib/backport --continue


Can we use PPOtrainer to deal with text classification problem

I found the library is mainly used to finetune models for text generation tasks, and wonder if I can use the T5/Roberta/Bert/etc to classify text with our dataset, and then use our reward model, and also optimize with PPO? Or this is only for text-generation tasks?

There is the RewardTrainer to train reward model but currently only supports decoder models. If there is a lot of demand we could consider extending it to encoder models. In general you can always use the transformers.Trainer to do just that and everything in we add in trl would anyway just be a wrapper around it.

I also meet the error if I want to use Roberta/Bert to train with PPO instead of RewardTrain, since when I loaded these two:
model = AutoModelForSeq2SeqLMWithValueHead.from_pretrained('bert-base-uncased').to(device)

# or this one
model = AutoModelForSeq2SeqLMWithValueHead.from_pretrained('roberta-base', num_labels=6).to(device)

there is error:
raise ValueError( ValueError: Unrecognized configuration class <class 'transformers.models.roberta.configuration_roberta.RobertaConfig'> for this kind of AutoModel: AutoModelForSeq2SeqLM. Model type should be one of BartConfig, BigBirdPegasusConfig, BlenderbotConfig, BlenderbotSmallConfig, EncoderDecoderConfig, FSMTConfig, GPTSanJapaneseConfig, LEDConfig, LongT5Config, M2M100Config, MarianConfig, MBartConfig, MT5Config, MvpConfig, NllbMoeConfig, PegasusConfig, PegasusXConfig, PLBartConfig, ProphetNetConfig, SwitchTransformersConfig, T5Config, UMT5Config, XLMProphetNetConfig.
or
ValueError: Unrecognized configuration class <class 'transformers.models.bert.configuration_bert.BertConfig'> for this kind of AutoModel: AutoModelForSeq2SeqLM. Model type should be one of BartConfig, BigBirdPegasusConfig, BlenderbotConfig, BlenderbotSmallConfig, EncoderDecoderConfig, FSMTConfig, GPTSanJapaneseConfig, LEDConfig, LongT5Config, M2M100Config, MarianConfig, MBartConfig, MT5Config, MvpConfig, NllbMoeConfig, PegasusConfig, PegasusXConfig, PLBartConfig, ProphetNetConfig, SwitchTransformersConfig, T5Config, UMT5Config, XLMProphetNetConfig.
But it's okay when I load T5/flanT5:
model = AutoModelForSeq2SeqLMWithValueHead.from_pretrained('t5-small').to(device)

# or this one
model = AutoModelForSeq2SeqLMWithValueHead.from_pretrained('google/flan-t5-small').to(device)

Really hope encoder models can also be loaded!

hi @yixiaoer indeed currently encoder models are not supported, mainly because they are not designed to be generative (even though in some cases we can generate text with encoder based models). @lvwerra would it make sense to support encoder models for PPO?

Sure, if there is no big overhead I think there's no reason why not to also allow for encoder models. What do you think is necessary to get this integrated @younesbelkada?

The issue still needs to be addressed.

Note that this can already be done in the transformers library: https://huggingface.co/docs/transformers/tasks/sequence_classification

Note that this can already be done in the transformers library: https://huggingface.co/docs/transformers/tasks/sequence_classification

hi @ivwerra, so can we use PPO for text classification tasks?

@lvwerra can you please give me a brief about how can we train model like Bert suing with ppotrianer or  using rlhf in general

@yixiaoer did you find any solution to this

when I used it at that time,  I switched to an encoder-decoder model instead of an encoder-only model like BERT.

can you please share the code if possible
or mail to me at<EMAIL_ADDRESS>that will be really helpful
thank you

Can you share the code if possible
On Sat, 23 Mar 2024 at 11:13 PM, yixiaoer @.***> wrote:

when I used it at that time, I switched to an encoder-decoder model
instead of an encoder-only model like BERT.
—
Reply to this email directly, view it on GitHub
https://github.com/huggingface/trl/issues/747#issuecomment-2016558072,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/A6VBGX35HNBQ4UDV2EZTQ53YZW5LPAVCNFSM6AAAAAA4QAZA42VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMJWGU2TQMBXGI
.
You are receiving this because you commented.Message ID:
@.***>

when I used it at that time, I switched to an encoder-decoder model instead of an encoder-only model like BERT.

hi @yixiaoer @lvwerra , I am also stuck at the same problem, can you let me know the steps to resolve or share me the code please. it would be of a great help. Thank you

sorry, I don't have the code anymore

@lvwerra can you please give me a brief about how can we train model like Bert using  ppo trainer or using rlhf in general as you mentioned by you in this message

There is the RewardTrainer to train reward model but currently only supports decoder models. If there is a lot of demand we could consider extending it to encoder models. In general you can always use the transformers.Trainer to do just that and everything in we add in trl would anyway just be a wrapper around it.

@lvwerra can you please guide me a bit it is really necessary for my current experimentations

I am also interested to know how we can implement RLHF for classification tasks.

Any updates here? I am also interested in RLHF for classification.


HTTP endpoint for file upload / download and changs

this is really cool. Been meaning to make something like this.
Would like to add a HTTP endpoint to this thats not S3. It can then cal the S3 Api if we want.
For file up and down.
then a very simple golang template html for Files up and down via the HTTP gateway.

Supporting S3 protocol means having a HTTP endpoint.
Basically, the followings are identical:
aws s3 cp file1.txt s3://bucketA --endpoint-url http://localhost:5222

curl --location --request PUT 'http://localhost:5222/bucketA/file1.txt' \
--header 'Authorization: [auth header adhere to s3 protocol]'
--header 'Content-Type: application/json' \
--data 'fie content'

In the second case, Autherization header should be according the S3 protocol.
Or do you mean having another HTTP endpoint to upload/download files? Then we need to come up with our own Authentication mechanism?

I mean having a HTTP file upload and download mechanism.
Yes I believe an authentication mechanism would be needed for this. I wonder if a nats based authentication would do, because then it can be managed by nats nsc, and so is globally synchronised in a NATS cluster.
I was also wondering about how we can notify a http client that the file has changed inside NATS , since NATS supports that. The gateway server  could do a web hook , or a SSE event . In both cases , I think that the S3 API does not support that though.

Seems S3 supports file / bucket change events …
https://docs.aws.amazon.com/AmazonS3/latest/userguide/EventBridge.html

The client could use htmx.
so the gateway gets the event and then pushes it to a browser using htmx SSE.
the event would originate from NATS object store.
this file upload and download could also use the htmx.
https://github.com/chasefleming/elem-go Would do all this for use quite well. I already use this as it’s just golang with complete control over the look and feel using strongly typed golang to define the css etc

I mean having a HTTP file upload and download mechanism.
Yes I believe an authentication mechanism would be needed for this. I wonder if a nats based authentication would do, because then it can be managed by nats nsc, and so is globally synchronised in a NATS cluster.
I was also wondering about how we can notify a http client that the file has changed inside NATS , since NATS supports that. The gateway server could do a web hook , or a SSE event . In both cases , I think that the S3 API does not support that though.

Yeah, it would be nice to support a simple file upload/download REST API endpoints.
Maybe it is something quick implement, so we don't need to adhere to protocol like S3.

Yeah that’s exactly what I was thinking .
that’s why I added the reference to event bridge . Because we have nats we ki d of have our own event bridge.