checkpoint path logic issue

Hi,
What's the purpose of line 275 in solvers/vince_solver.py? The args.checkpoint_dir variable is already assigned in arg_parser.py. This is preventing the code from properly loading previous checkpoints specified at the command line.
Similar issues exist for end_task_base_solver.py (line 116).
Also, how to apply a VINCE trained model to ImageNet task? The instructions are missing. With these issues regarding the checkpoint_dir, it seems impossible?
Thank you.

Just a note: I noticed the end task will look for a pre-trained model in the checkpoint directory. By fixing the earlier checkpoint path problem, I was able to get the code to successfully load a VINCE pre-trained ResNet18 model and finish an evaluation on ImageNet. But I got a Top-1 number for ImageNet around 43%, which seems higher than the number reported in the paper (40%).

The purpose of https://github.com/danielgordon10/vince/blob/master/solvers/vince_solver.py#L275


Dropdown controls and its list items are not accessible by label name while we are using voice access.

Dropdown controls and its list items are not accessible by label name while we are using voice access.
How to reproduce the bug

Open URL: https://titanweb-testenv/superset/dashboard/268/ in Edge browser.
Navigate to the Market filter section appearing.
Turn ON Voice Access.
Say 'click Type or Select Market'.
Observe that dropdown controls and its list items are not accessible by label name while we are using voice access.

Expected results
Dropdown controls should be accessible by label name while we are using voice access.
Actual results
Dropdown controls and its list items are not accessible by label name while we are using voice access.
Environment
OS: Windows_11
Version: 22H2
OS Build: 22610.1
Browser: New edge (Version 105.0.1343.53)
URL: https://titanweb-testenv/superset/dashboard/268/
Tool: Voice Access Wiki
Additional context
Same issue repro on all dropdown controls.
Attachments:

https://github.com/apache/superset/assets/93735775/b8e73a58-8ae5-436d-85ac-792299ed8622

Hi there,
I've noticed you filed a wave of these accessibility shortcomings. We could probably open a hundred more of these, but that just goes to underscore the point that Superset is not really up to snuff in this department. Would you have any interest in contributing to Superset in this realm and/or coordinating a community effort in this area?

It's been a long while since this was opened. I've assigned it to a couple folks who might be able to get it onto an acessibility project board, but unless someone wants to contribute toward this in the near future, I think we'll likely close it since it's gone silent for so long, and it's more feature request than bug (though I suppose it depends who you ask!). We'd really love to see more contributions in the accessibility realm if anyone here wants to take a crack at it.

Anyone object to closing this?


Burned in subtitles with certain files results in a video that can't be rendered by media players

Problem:
I get a segfault during the conversion process whenever I try to burn in subtitles for certain video files. The end result is a video file that can't be rendered by my media players.
The conversion goes just fine if I use soft subtitles, rather than burning it in. However, if I choose to burn in subtitles, then I get a segfault error according to unRAID's system log. I believe this is what causes handbrake to 'crash'. (see "Misc" below)
I can use "custom_preset002" just fine on the 3 other video files I've tried, but this one video in particular causes a segfault. I consistently get a segfault with that video file whenever I burn in subtitles.
Reproduction:
I created a custom preset called "custom_preset002"
It uses the "Very Fast 480p30" preset as a base to work on.
Changes made:
Subtitles

selection behavior - all tracks matching selected language
selected languages - english, any
add foreign audio scan pass - uncheck
add english subtitle track if default audio is not english - check
burn in behavior - first selected track

Next, convert that particular video file using the custom preset. The segfault tends to happens towards the end of the video, around 96%.
The unraid GUI system log shows a segfault:

Jul 23 12:05:15 Tower kernel: ghb[5376]: segfault at 2b3a0a6bd008 ip 00002b3a020dbbf2 sp 00002b3a0a6bb548 error 6 in ld-musl-x86_64.so.1[2b3a020a2000+45000]

The default presets I've tried were "Very Fast 480p30", "Fast 480p30", and "Fast 1080p30". And they all converted just fine. Again, it's only when I try to burn in subtitles that I get a segfault.
I've attached debug files to my post. These are logs from when I used the GUI.
pass in.zip
Misc:
I don't know if this is useful information, but one thing I've noticed is that during a manual conversion if there's a segfault, the GUI crashes and the docker container completely shuts down. I have to restart the container manually.
Instead, if I use an automated conversion and there's a segfault, the GUI does not crash. I can continue to perform more automated conversions, or use the GUI.

Any update on this?

We can try to get more details about the crash:

Use the debug image.  Edit the container settings and set the repository to jlesage/handbrake:v1.17.1-debug.
Enable core dump.  See https://github.com/jlesage/docker-handbrake/#debug-builds

Once you reproduce the issue, provide the core dump along with log files in /mnt/user/appdata/HandBrake/ghb/.

Here is the core dump and the log files for jlesage/handbrake:v1.17.1-debug:
https://mega.nz/#F!ddNXzaaB!_s8VF9Jz5N4pT6LlUT2eEA

Do you reproduce the crash with the latest image version?

Thanks, that did the trick! Handbrake doesn't crash anymore when encoding.
Do you mind telling me how you fixed the issue? It would be a good reference to know in the future if I make my own Docker container.

I won't take any credit or this, I just updated HandBrake to the new version 1.3.0.

Okay, that's good to know. I don't see anything immediately obvious in the 1.3.0 changelog about fixing crashes.

HandBrake uses many third party libraries, so it's possible that the crash was fixed in one of those...


Questions about downstream COCO detection

Hi, I’m wondering if you can provide a recipe to reproduce the results of CoCo detection?
I’ve tried to use your pre-trained checkpoint to train the downstream task with Mask R-CNN, but cannot get the results reported in the paper. Not sure if there was something wrong during the training. Could you please provide more details? Thank you!

Thank you! I will try it again with your configuration. Btw, which part of the parameters did you use as the feature extractor in downstream tasks? teacher or student？

Hi, I’m wondering if you can provide a recipe to reproduce the results of CoCo detection? I’ve tried to use your pre-trained checkpoint to train the downstream task with Mask R-CNN, but cannot get the results reported in the paper. Not sure if there was something wrong during the training. Could you please provide more details? Thank you!

hi, Could you share how to load the pre-trained model? When I load the model, there are the following errors :unexpected key in source state_dict: student, teacher, optimizer, epoch, args, dino_loss, fp16_scaler


Complete code coverage

Codecov Report

Merging #347 into master will increase coverage by 0.19%.
The diff coverage is n/a.

@@           Coverage Diff            @@
##           master   #347      +/-   ##
========================================
+ Coverage    99.8%   100%   +0.19%
========================================
  Files          25     25
  Lines        1544   1538       -6
  Branches      260    256       -4
========================================
- Hits         1541   1538       -3
+ Misses          3      0       -3

Impacted Files
Coverage Δ

lib/workers/branch.js
100% <ø> (+0.74%)
:arrow_up:

lib/workers/package-file.js
100% <ø> (+1%)
:arrow_up:

lib/api/gitlab.js
100% <0%> (+0.45%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 02a4029...b387031. Read the comment docs.


Make build scripts compatible with node 12

fs/promises is not in node 12, use a more compatible way to import it. Also, lock major down versions of the image build dependencies to prevent future surprises.

One more tweak added: node_modules dependency added on the make target to make it update node_modules when switching between git branches.

make lgtm work


Add a benchmark script for in-batch prefix caching

Changes

Add a benchmark script bench_in_batch_prefix.py from @Ying1123
Clean up the code of delay scheduling for in-batch prefix caching introduced in #2442.

Some results
Please note that there are huge variances across runs.

Results with the old default policy

Latency of test_batch_by_batch          : 1.9585 s
Latency of test_batch_by_batch_with_hint: 1.9020 s
Latency of test_send_all                : 3.7643 s

Results with the reverted delay scheduling from #2442.

Latency of test_batch_by_batch          : 1.9868 s
Latency of test_batch_by_batch_with_hint: 1.9520 s
Latency of test_send_all                : 3.0549 s

The goal: the Latency of test_send_all should be very close to the Latency of test_batch_by_batch_with_hint (the oracle).

I was intrigued by your benchmark results, particularly noting that test_send_all showed slower performance compared to other methods. To verify this, I conducted tests on my own server, but interestingly, I observed opposite results:
Latency of test_batch_by_batch          : 2.3765 s
Latency of test_batch_by_batch_with_hint: 2.4907 s
Latency of test_send_all                : 2.2191 s

The tests were run using the following commands:
python3 -m sglang.launch_server --model Qwen/Qwen2.5-3B-Instruct
# Changed the tokenizer to Qwen
python bench_in_batch_prefix.py

Environment details:

SGLang version: 0.4.1
Hardware: A100 GPU

I repeated these experiments multiple times and also tested with a smaller model, but the results consistently showed the same pattern: test_send_all performed faster than the other methods.

attention_backend='flashinfer', sampling_backend='flashinfer',


build android example with a timeout error during downloading

**i follow the toturial to install mediapipe ,this "hello world " works well. i have set andorid ndk and sdk。but when i build the android example，it gives the errors，it looks like  network connnections problem?(ubuntu 18.04) **
errors info:
root@8e200f3a939b:/data/data/mediapipe# /usr/bin/bazel-1.2.1 build -c opt --config=android_arm64 mediapipe/examples/android/src/java/com/google/mediapipe/apps/facedetectiongpu
WARNING: Download from https://mirror.bazel.build/github.com/tensorflow/tensorflow/archive/77e9ffb9b2bfb1a4f7056e62d84039626923e328.tar.gz failed: class java.io.IOException connect timed out
WARNING: Download from http://mirror.tensorflow.org/github.com/bazelbuild/rules_closure/archive/cf1e44edb908e9616030cc83d085989b8e6cd6df.tar.gz failed: class com.google.devtools.build.lib.bazel.repository.downloader.UnrecoverableHttpException GET returned 404 Not Found
INFO: Call stack for the definition of repository 'remote_java_tools_linux' which is a http_archive (rule definition at /root/.cache/bazel/_bazel_root/132637124ea9cb01ed777b0c1a9b1948/external/bazel_tools/tools/build_defs/repo/http.bzl:292:16):
 - /root/.cache/bazel/_bazel_root/132637124ea9cb01ed777b0c1a9b1948/external/bazel_tools/tools/build_defs/repo/utils.bzl:205:9
 - /DEFAULT.WORKSPACE.SUFFIX:260:1
ERROR: An error occurred during the fetch of repository 'remote_java_tools_linux':
   java.io.IOException: thread interrupted
INFO: Call stack for the definition of repository 'remotejdk11_linux' which is a http_archive (rule definition at /root/.cache/bazel/_bazel_root/132637124ea9cb01ed777b0c1a9b1948/external/bazel_tools/tools/build_defs/repo/http.bzl:292:16):
 - /root/.cache/bazel/_bazel_root/132637124ea9cb01ed777b0c1a9b1948/external/bazel_tools/tools/build_defs/repo/utils.bzl:205:9
 - /DEFAULT.WORKSPACE.SUFFIX:216:1
INFO: Call stack for the definition of repository 'android_opencv' which is a http_archive (rule definition at /root/.cache/bazel/_bazel_root/132637124ea9cb01ed777b0c1a9b1948/external/bazel_tools/tools/build_defs/repo/http.bzl:292:16):
 - /data/data/mediapipe/WORKSPACE:186:1
INFO: Call stack for the definition of repository 'com_github_gflags_gflags' which is a http_archive (rule definition at /root/.cache/bazel/_bazel_root/132637124ea9cb01ed777b0c1a9b1948/external/bazel_tools/tools/build_defs/repo/http.bzl:292:16):
 - /data/data/mediapipe/WORKSPACE:56:1
INFO: Call stack for the definition of repository 'android_tools' which is a http_archive (rule definition at /root/.cache/bazel/_bazel_root/132637124ea9cb01ed777b0c1a9b1948/external/bazel_tools/tools/build_defs/repo/http.bzl:292:16):
 - /DEFAULT.WORKSPACE.SUFFIX:343:1
WARNING: Download from https://mirror.bazel.build/github.com/bazelbuild/rules_java/archive/7cf3cefd652008d0a64a419c34c13bdca6c8f178.zip failed: class java.io.IOException connect timed out
DEBUG: Rule 'rules_cc' indicated that a canonical reproducible form can be obtained by modifying arguments sha256 = "20e134e1348022090fd38bcf354dd88f4d95808ad905c62cb1a359b03c4ad058"
DEBUG: Call stack for the definition of repository 'rules_cc' which is a http_archive (rule definition at /root/.cache/bazel/_bazel_root/132637124ea9cb01ed777b0c1a9b1948/external/bazel_tools/tools/build_defs/repo/http.bzl:292:16):
 - /data/data/mediapipe/WORKSPACE:34:1
ERROR: /root/.cache/bazel/_bazel_root/132637124ea9cb01ed777b0c1a9b1948/external/bazel_tools/tools/jdk/BUILD:225:1: @bazel_tools//tools/jdk:JacocoCoverageRunner depends on @remote_java_tools_linux//:java_tools/JacocoCoverage_jarjar_deploy.jar in repository @remote_java_tools_linux which failed to fetch. no such package '@remote_java_tools_linux//': java.io.IOException: thread interrupted
ERROR: Analysis of target '//mediapipe/examples/android/src/java/com/google/mediapipe/apps/facedetectiongpu:facedetectiongpu' failed; build aborted: no such package '@remote_java_tools_linux//': java.io.IOException: thread interrupted
INFO: Elapsed time: 21.628s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (0 packages loaded, 0 targets configured)

i try the second time:
(base) root@8e200f3a939b:/data/data/mediapipe# /usr/bin/bazel-1.2.1 build -c opt --config=android_arm64 mediapipe/examples/android/src/java/com/google/mediapipe/apps/facedetectiongpu
WARNING: Download from https://mirror.bazel.build/github.com/tensorflow/tensorflow/archive/77e9ffb9b2bfb1a4f7056e62d84039626923e328.tar.gz failed: class java.io.IOException connect timed out
WARNING: Download from http://mirror.tensorflow.org/github.com/bazelbuild/rules_closure/archive/cf1e44edb908e9616030cc83d085989b8e6cd6df.tar.gz failed: class com.google.devtools.build.lib.bazel.repository.downloader.UnrecoverableHttpException GET returned 404 Not Found
WARNING: Download from https://mirror.bazel.build/github.com/bazelbuild/rules_java/archive/7cf3cefd652008d0a64a419c34c13bdca6c8f178.zip failed: class java.io.IOException connect timed out
DEBUG: Rule 'rules_cc' indicated that a canonical reproducible form can be obtained by modifying arguments sha256 = "20e134e1348022090fd38bcf354dd88f4d95808ad905c62cb1a359b03c4ad058"
DEBUG: Call stack for the definition of repository 'rules_cc' which is a http_archive (rule definition at /root/.cache/bazel/_bazel_root/132637124ea9cb01ed777b0c1a9b1948/external/bazel_tools/tools/build_defs/repo/http.bzl:292:16):
 - /data/data/mediapipe/WORKSPACE:34:1
WARNING: Download from https://mirror.bazel.build/github.com/gflags/gflags/archive/77592648e3f3be87d6c7123eb81cbad75f9aef5a.tar.gz failed: class java.io.IOException connect timed out
INFO: Call stack for the definition of repository 'android_tools' which is a http_archive (rule definition at /root/.cache/bazel/_bazel_root/132637124ea9cb01ed777b0c1a9b1948/external/bazel_tools/tools/build_defs/repo/http.bzl:292:16):
 - /DEFAULT.WORKSPACE.SUFFIX:343:1
WARNING: Download from https://mirror.bazel.build/bazel_android_tools/android_tools_pkg-0.12.tar.gz failed: class java.io.IOException connect timed out
ERROR: An error occurred during the fetch of repository 'android_tools':
   java.io.IOException: Error downloading [https://mirror.bazel.build/bazel_android_tools/android_tools_pkg-0.12.tar.gz] to /root/.cache/bazel/_bazel_root/132637124ea9cb01ed777b0c1a9b1948/external/android_tools/android_tools_pkg-0.12.tar.gz: connect timed out
INFO: Call stack for the definition of repository 'android_opencv' which is a http_archive (rule definition at /root/.cache/bazel/_bazel_root/132637124ea9cb01ed777b0c1a9b1948/external/bazel_tools/tools/build_defs/repo/http.bzl:292:16):
 - /data/data/mediapipe/WORKSPACE:186:1
INFO: Call stack for the definition of repository 'remote_java_tools_linux' which is a http_archive (rule definition at /root/.cache/bazel/_bazel_root/132637124ea9cb01ed777b0c1a9b1948/external/bazel_tools/tools/build_defs/repo/http.bzl:292:16):
 - /root/.cache/bazel/_bazel_root/132637124ea9cb01ed777b0c1a9b1948/external/bazel_tools/tools/build_defs/repo/utils.bzl:205:9
 - /DEFAULT.WORKSPACE.SUFFIX:260:1
ERROR: /root/.cache/bazel/_bazel_root/132637124ea9cb01ed777b0c1a9b1948/external/bazel_tools/src/tools/android/java/com/google/devtools/build/android/BUILD:3:1: @bazel_tools//src/tools/android/java/com/google/devtools/build/android:all_android_tools depends on @android_tools//:all_android_tools_deploy.jar in repository @android_tools which failed to fetch. no such package '@android_tools//': java.io.IOException: Error downloading [https://mirror.bazel.build/bazel_android_tools/android_tools_pkg-0.12.tar.gz] to /root/.cache/bazel/_bazel_root/132637124ea9cb01ed777b0c1a9b1948/external/android_tools/android_tools_pkg-0.12.tar.gz: connect timed out
ERROR: Analysis of target '//mediapipe/examples/android/src/java/com/google/mediapipe/apps/facedetectiongpu:facedetectiongpu' failed; build aborted: no such package '@android_tools//': java.io.IOException: Error downloading [https://mirror.bazel.build/bazel_android_tools/android_tools_pkg-0.12.tar.gz] to /root/.cache/bazel/_bazel_root/132637124ea9cb01ed777b0c1a9b1948/external/android_tools/android_tools_pkg-0.12.tar.gz: connect timed out
INFO: Elapsed time: 66.609s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (2 packages loaded, 265 targets configured)

Error downloading [https://mirror.bazel.build/bazel_android_tools/android_tools_pkg-0.12.tar.gz] to /root/.cache/bazel/_bazel_root/132637124ea9cb01ed777b0c1a9b1948/external/android_tools/android_tools_pkg-0.12.tar.gz: connect timed out

The error is a timeout issue during downloading the external dependencies. Please check your network conntection and retry. VPN is preferred if you are in mainland China. See https://github.com/google/mediapipe/issues/3 for more detail.

i have used VPN to download,but the connection always not stable,  it is ok after i try sevaral times. hope that offers a solution for users in mainland China

The solution is obvious. We need to host all the dependencies of MediaPipe on a server that is physically located in mainland china. We will evaluate this option when we have more bandwidth. Thanks.


[rules] Specify fusesoc cache dir to be in the bazel tree

Make the fusesoc cache dir be in the bazel tree, so fusesoc doesn't attempt to create directories outside, such as ~/.cache/fusesoc. That action can cause build failures, since fusesoc is sandboxed.
Fixes #23696

I think this would fix #22833 and a bug that @AlexJones0 was having. It LGTM, was there something you wanted to change before marking as ready?

It was merely marked draft because of the quiet period (since it changes something with tool flows, though it should represent a fix, hehe).

I've marked it ready, since the development is ostensibly done, but do check that the merge window for such changes is open before merging.


NavBar and Pay Button Text Customisation

I love the way this package is heading, I was about to create an issue for removing the 'Save Card' feature but that has been handled. Thank You
This is a customization issue, I need to customize the navbar text to read 'Add Card' not 'Card payment', also for the 'Pay' button if it could read something else like 'Add card' too. I will explain to the user beforehand that I will need to make a tiny charge in order for their card to be saved. Also, the Pay text and the currency on the right seem a bit off, maybe reduce the spacing between the two texts, this is in the pay button.
In summary,

Ability to customize the text on NavBar
Ability to customize the text on the button
Ability to remove the amount to be charged from that button when say, I have 'Add Card' text on the button. I don't want it to read 'Add Card Ksh 100'

Yeah, I agree the package is too rigid now. My plan in the next couple of days is to make it more customizable. Will update this thread when it's done.

@kevinrobert3  Check if v1.0.6 solves this issue.

@kevinrobert3  ??


 See: https://github.com/IBM/keyprotect-go-client/commit/6c932342060549afc474d4307ccf6f34cb77171b from the cli-integration branch
Waiting on confirmation about what needs to be done with this PR from @gvdibm / others in the meantime.

The changes in the PR is already been addressed by another PR which has already been merged in cli-integration branch. So, this PR can be closed.


Created the visualization dev tool

@Elijas.
I'm glad to create a PR.
Here is my approach.

At first, determine if the current semantic element contains the table.
If so, add a new element (block: div) which has same width, height, position and semi-transparent background color. And encapsulate the both element with div tag.

If not, simply assign the background color style.

Why because currently other elements are based on text elements and mainly contain text information. However, on the table side it has boxing properties in terms of visualization.

You can lauch this by using the command: task launch-visualizer
Here is a screenshot.

@kameleon-ad Thanks for the PR! 🙌
Solves https://github.com/alphanome-ai/sec-parser/issues/45

Looks good to me! Thank you 🎉 🎉


Recompilation via require fails silently

Hi. First of all, thank you for your work on the plugin, it has worked great so far for me. However, I recently noticed that errors during recompilation of previously compiled modules are no longer shown.
Steps to reproduce:

Create a file ~/.config/nvim/fnl/test.fnl with valid content, e.g. (print :hello)
Require it via :=require'test'<CR>
Create a syntax error in test.fnl, e.g. by removing the closing parenthesis.
Unload the modul via :lua package.loaded['test'] = nil
Rerequire it via :=require'test'<CR>

Until recently, the last require would've produced an error displaying the error description produced by fennel. But now it just fails silently, loading the last succesfully compiled Lua file. When changing test.fnl without any syntax erros, the last require correctly picks up the changes.
I'll have to admit that I haven't read all the API documentation yet, so I can't say for sure if this is the intended way to do this, I only noted the regression; if there is another more "correct" way to recompile a module, I'd appreciate a pointer in the right direction.

Thanks for the report. I'm pretty sure I have already fixed this in an upcoming release which I just need some time to tidy up.
For now you could use this global function to unrequire a module, which also clears the cache.
(fn _G.__unrequire [...]
  (let [hotpot (require :hotpot)]
    (hotpot.api.cache.clear-cache))
  (each [module _ (pairs package.loaded)]
    (for [i 1 (select :# ...)]
      (let [unreq (select i ...)]
        (if (string.match module unreq)
          (do
            (print :unreq module)
            (tset package.loaded module nil)))))))

:=__unrequire("my.mod") -- unrequires my.mod my.mod.x my.mod.y etc etc

It will ask for confirmation to clear the cache and it clears the whole cache so its a pretty blunt instrument, but I will add an option in the upcoming to skip the prompt too.

Should be fixed in 87d2c346b940438388ec48e376f92d944fcb7efc with according regression test in ebc9bfc3484fa2e040f2cbb2ac9ca1b45cc8b2c6.

Hi. Sorry for not coming back to you earlier. It now works again as expected. Thanks!


Optional!

https://github.com/gitazeinstra/the-client-website/blob/b2ec2e16f0540960921bd6fb1dd5ccf6a9f826f7/js/main.js#L6
This block of code is executed for every pixel that the user scrolls. In this code, you do a lookup in the DOM (querySelector). This isn't needed for every pixel that you scroll, but just once :)

Const navbar & const scrollBtn are now outside the function. Thank you!


The requested resource /2010-04-01/ ... was not found

After setting the ENV variables for my Twilio Auth / App / Number ids, I ran python configure.py but got the error:
The requested resource /2010-04-01/Accounts/<MY ID>/Applications/<MY ID>.json was not found

<MY ID> was not literally part of the error but I'm replacing my credentials.
I don't write much Python.

Hi, I noticed there was an update on this project so I gave it another try.
This time I got a different error when running configure.py with the API KEYS.:
Configuring your Twilio hackpack...
Could not find Heroku remote in your .git config.  Have you created the Heroku app?
Traceback (most recent call last):
  File "configure.py", line 372, in <module>
    main()
  File "configure.py", line 369, in main
    configure.start()
  File "configure.py", line 68, in start
    self.host = self.getHerokuHostname()
  File "configure.py", line 283, in getHerokuHostname
    raise ConfigurationError("Could not find Heroku remote in " \
__main__.ConfigurationError
txt


Can't find a MonoTouch port of the GLImageProcessing sample project

I can't find the GLImageProcessing example project from the Apple documentation:
http://developer.apple.com/library/ios/#samplecode/GLImageProcessing/Introduction/Intro.html
A MonoTouch version of that would be very useful to learn, allowing fast image processing of UIImages using the iPhone and iPad GPU, making filters like blur or  to 24 times faster.

Hi @Emasoft, we have another sample with pretty much the same functionality - GLKBaseEffectDrawingTexture.


Not working on ionic 2 nightly

I'm not sure if it's a problem with ionic or this module, but after upgrading from ionic 2 RC4 to the latest nightly build, I get the following error when trying to open a page that contains an ion-textarea with the fz-elastic attribute:
The 'elastic' attribute directive must be used on a 'textarea' or an element that contains a 'textarea'.

Thanks for the report.
I've just pushed v0.13.0 to npm which should hopefully fix the issue. Please could you update and try again?
Please note there is a breaking change in this release, the Elastic import should be changed to ElasticModule. See the changelog for more details.

Thanks Tom,
It seems to be working again. At least when testing in the browser.


Remove pin to early (pre 1.8) versions of shapely

fix #181
fix #180

Codecov Report

Merging #182 (eb1ceb9) into master (b171436) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #182   +/-   ##
=======================================
  Coverage   95.28%   95.28%
=======================================
  Files          30       30
  Lines        2799     2799
=======================================
  Hits         2667     2667
  Misses        132      132

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b171436...eb1ceb9. Read the comment docs.


Question about data processing code

Hi @Jyonn
I wonder why you have 5th and 6th steps in the processing codes. They seem to randomly remove users and items. Could you explain it?
https://github.com/Jyonn/Legommenders/tree/325c59cee6e3a658e0e707c3dbb12dbeb20544eb/process/goodreads
Best,
Chiyu

Hi Chiyu. We filtered out items and users whose interactions are less than ten. The core code is the trim function.

Sorry. The random remove is to get a smaller dataset, so that the Openai API cost can be reduced and the model training can be accelerated.

Hi @Jyonn,
Thanks for the clarification.
I am trying to understand what you did in https://github.com/Jyonn/Legommenders/blob/master/process/goodreads/4_analyse_session.py
I wonder what vocabulary size you want to check. I did see that you loaded the book information file. What do you drop in this step?

The book information is not parsed or tokenized in this file. All the first 6 scripts are processing the interaction file. All the book id in the interactions will be added into the book_vocab, which will count the interaction numbers of each book.

I also find the third script (3_truncate_session) is of no use.

Here we have two filterings.
First, filtered out items with little interactions (<5) and too much interactions (>10000). Next, we cut off the user sequence to make it shorter. The final goal is to make all the sequence less than 100. Too long sequence will also affect training efficiency.
These two steps are iteratively running until the dataset is stable.
Here we set max_seq_len = max_seq_len * 0.2 is because, if we hard code it to max_seq_len = 100, there might be some items in the sequence filtered out in the next iteration, making the length of lots of sequences shorter than 100. So we did the dynamic length decrease.

Thanks.
So, in this step, you filter out both books and users, right?
I also wonder what you mean by "stable".

I also noticed that the third script (3_truncate_session) is of no use. I am not aware of it before, since the codes are written several months ago.

Do you mean you did not use this script in your experiments? It seems to truncate the history and negative length to 50.

More question,
I found that the 5th and 6th steps use input function (for example)to take some numbers during the iteration. I don't know what this is for and what number should give.

Here we have two filterings.
First, filtered out items with little interactions (<5) and too much interactions (>10000). Next, we cut off the user sequence to make it shorter. The final goal is to make all the sequence less than 100. Too long sequence will also affect training efficiency.
These two steps are iteratively running until the dataset is stable.
Here we set max_seq_len = max_seq_len * 0.2 is because, if we hard code it to max_seq_len = 100, there might be some items in the sequence filtered out in the next iteration, making the length of lots of sequences shorter than 100. So we did the dynamic length decrease.

Thanks. So, in this step, you filter out both books and users, right? I also wonder what you mean by "stable".

Yes. By stable, it means, after the first step's filtering, the second step's processing has no change, vice versa.

The random remove is to get a smaller dataset, so that the Openai API cost can be reduced and the model training can be accelerated.

I can answer this question partically with my yesterday's reply:

The random remove is to get a smaller dataset, so that the Openai API cost can be reduced and the model training can be accelerated.

Right now I am not sure about the given number. Since these two scripts contains random procedures, you may not obtain the fully same dataset used in the paper. But you can get simiar scale Goodreads dataset by these scripts. For example, we have 16K items and 23K users in our generated dataset. You can try to randomly remove users to 25K or 30K with 5th scripts and then randomly remove items to 16K. Those 25K or 30K users will be decreased in the item remove scripts.
Another option, is to download our generated dataset by this link.

Got it.
I would like to ask if you can share the datasets that were generated at the 7th step, such as **_inter.csv, user.csv, neg.csv, book.csv.

Got it. I would like to ask if you can share the datasets that were generated at the 7th step, such as **_inter.csv, user.csv, neg.csv, book.csv.

I'd love to. While I copied the tokenized data to different GPU machines to run, the original text-based files, however, are only processed and stored in one machine, which is broken down from early November, making them currently unaccessible. I can release these data when the machine get repaired.

Ok. I see. Hope it will be fixed soon.
For the processed data, I don't know how to load the dat and npy files. Can you explain how to read them?

You should firstly install unitok package by
pip install unitok

Next, you can read the data by:
from UniTok import UniDep

depot = UniDep('/path/to/folder')
print(depot[0])

You can convert those IDs to tokens by:
title_vocab = depot.cols['title'].voc.vocab
title = depot[0]['title']
print(' '.join(list(map(title_vocab.i2o, title))))

We will release the documentation of the UniTok package soon...
Here are some useful functions:

You can use len(depot) to get the sample size.
All columns (attributes) are listed in depot.cols.
All vocabs are listed in depots.vocs.
Union method. Here training data is constructed in (userID, bookID, click) format, and book data is constructed in (bookID, title, ...) format. You can use union method: train_depot.union(book_depot), so that train_depot[0] will be in (userID, bookID, click, title, ...) format.

You should firstly install unitok package by
pip install unitok

Next, you can read the data by:
from UniTok import UniDep

depot = UniDep('/path/to/folder')
print(depot[0])

You can convert those IDs to tokens by:
title_vocab = depot.cols['title'].voc.vocab
title = depot[0]['title']
print(' '.join(list(map(title_vocab.i2o, title))))

Can I convert the book and user indices back to the original IDs in Goodreads dataset?

I tried to load your processed dataset. I cannot find the title field.
depot.cols gave me this:
{'index': <UniTok.meta.Col at 0x111779590>,
 'uid': <UniTok.meta.Col at 0x111a28490>,
 'bid': <UniTok.meta.Col at 0x1117861d0>,
 'click': <UniTok.meta.Col at 0x111786610>}

I also wonder which field the user history sequence is and the prediction impression set. Could you give more guidance? Thanks.

Convert back:
depot = UniDep('/path/to/train-set')
sample = depot[0]

uid, bid = sample['uid'], sample['bid']

uid_vocab = depot.cols['uid'].voc.vocab
bid_vocab = depot.cols['bid'].voc.vocab

# original user id
print(uid_vocab[uid])
# original book id
print(bid_vocab[bid])
``

I tried to load your processed dataset. I cannot find the title field.
depot.cols gave me this:
{'index': <UniTok.meta.Col at 0x111779590>,
 'uid': <UniTok.meta.Col at 0x111a28490>,
 'bid': <UniTok.meta.Col at 0x1117861d0>,
 'click': <UniTok.meta.Col at 0x111786610>}

I also wonder which field the user history sequence is and the prediction impression set. Could you give more guidance? Thanks.

User history is not stored in the training set, but the user folder.
depot = UniDep('/path/to/user')

user = depot[0]

history = user['history']

# history_vocab is actually bid_vocab

vocab = depot.cols['history'].voc.vocab

# get original history (book IDs) of the current user
print(list(map(vocab, history)))

In the Goodreads dataset, we use the uid column as the impression column

Thanks. I can reconstruct the dataset to the original text now.

I have a question about the user data.
{'uid': 4, 'history': [2968, 6566, 1539, 3332, 6053, 13605], 'neg': [5520, 12919, 5420, 13363, 2647, 5925, 13918, 11065, 3438, 11687, 16762, 2938, 7007, 1068, 2431, 6881, 901, 1994, 16373]}

My understanding is that history is all positive history of users' behavior and neg is all negative history. Did you use the negatives in your ONCE paper? I think the user-side only uses positives to encode users. Do I understand correctly?

Partially correct. history is used for user modeling, and neg is used for matching tasks.
Models are trained by given such tuples: (user_id, pos_item_id,, neg_item_id_1, ..., neg_item_id_K). After the item and user encoding, we can get K+1 scores by dot product. Cross-entropy loss is used to optimize the model (positive score should be larger than negative ones).

Partially correct. history is used for user modeling, and neg is used for matching tasks.
Models are trained by given such tuples: (user_id, pos_item_id,, neg_item_id_1, ..., neg_item_id_K). After the item and user encoding, we can get K+1 scores by dot product. Cross-entropy loss is used to optimize the model (positive score should be larger than negative ones).

I see. Are these negatives in the user file as same as negatives in train/dev/test files?

Yes. It is used for train and dev set.

I see. Are these negatives in the user file as same as negatives (with click=0) in train/dev/test files?

Yes. You should filter out all the negative interactions when using matching-based models.

Matching Models
Ranking Models

Examples
NAML, NRMS
DCN, DeepFM

Training Data
Select positive samples
Full dataset

Neg Data
Use
Not use

Hi @Jyonn,
I still have questions about the negatives. I found that the negatives in the user file are not as same as the negatives (with click=0) in train/dev/test files.
For example, for the following user, the user neg set has 4 more negatives than the training set, they are '346952', '22522293', '25564446', '18089930'. So, do you sample the K negatives from the training file or the user neg set in the user file?
User ID: 9d95d0956601ed05785c48fdada5f8af
Negative interactions in Train set: ['823411', '12079', '20701984', '312881', '10560331', '831367', '66658', '16062210', '19469', '25467698', '85413', '93981', '336249', '28815', '286957', '716696', '104191', '13932']
Negative interactions in User Neg set: ['823411', '12079', '20701984', '312881', '10560331', '831367', '66658', '16062210', '19469', '25467698', '85413', '93981', '336249', '28815', '286957', '716696', '104191', '13932', '346952', '22522293', '25564446', '18089930']

I also wonder how you split the positives to user history and prediction impressions. Any details?
Thanks.

Please refer to process/goodreads/7_build_dataset.py. We also perform negative sampling on Line 80, to ensure each user has at least 10 negative samples. For all the baselines, i.e., matching-based methods, in the main paper, we did not use the negative samples provided by the interaction file, but used the neg set, as illustrated in the above table

Please refer to process/goodreads/7_build_dataset.py. We also perform negative sampling on Line 80, to ensure each user has at least 10 negative samples. For all the baselines, i.e., matching-based methods, in the main paper, we did not use the negative samples provided by the interaction file, but used the neg set, as illustrated in the above table

Ok. I see. You also split negatives to train, dev, or test.
Could you explain how you split the positives to user history and prediction impressions?

Core code please refer to the split_inter method in process/goodreads/7_build_dataset.py. We randomize the history length, and the number of the interaction samples for each set.

I will close this issue, as it already contains many questions. Feel free to open issues if you meet other problems.


[BUG] "nonModHub" badge applied to FS25 ModHub mods

Is there an existing issue for this?

[X] I have searched the existing issues

Current Behavior
FS25 mods downloaded via in-game ModHub are displaying the label "nonModHub". All 3 mods in the screenshot below were downloaded via the in-game ModHub.

Expected Behavior
Should correctly identify ModHub mods and hid the "nonModHub" label appropriately
Steps To Reproduce
In Windows 11, using Mod Assistant v5.1.4 and Farming Simulator 25 (latest version purchased directly from Giants as of creation of this ticket), download one of more mods from the in-game ModHub, refresh the monitored folder in Mod Assistant and see the "nonModHub" label applied to the mod.
Environment
- Mod Assistant Version: 5.1.4
- OS: Windows 11
- Virtualized: No

Anything else?
No response

correct.  give me a couple more days on this one, I'm not set up to parse modhub for 25 just yet.

Appreciate the quick response. I figured it was something like that but thought I'd create the issue just in case. Thanks for all that you do!

aye. I appreciate the issue actually, it will keep this on my radar and make sure I actually remember to do it.

fixed in 5.1.5 (out soon), closing as complete


Is Sacred compatible with Horovod for distributed computing?

I don't know Horovod, so could you give a short explanation of what it does and what sacred would need to be compatible?


SickScanApi-Functions error handling

Hi everyone,
according to the comments in the header file, there shoul be a possibility to check if the api functions return successfully or not. There is an enum called SickApiErrorCodes which should be used to cover that behavior.
In our application we use the SickScanApiInitByCli-Method and the SickScanApiRegisterCartesianPointCloudMsg-Method to get the scanner up. But even if I disconnect the scanner (LMS1000) in a physical way the first named Method allways returned 0 which means SICK_SCAN_API_SUCCESS. The fact that the callback method could be registered successfully is fine, because the callback is there.
My question is how to do this right, so that we receive error codes in case that the scanner is not physicaly connected?
Best regards,
Christian

Thanks for your feedback. SickScanApiInitByCli starts the lidar initialization, including background threads to handle TCP communication, lidar setup and reconnection after connection failures. In case of SICK_SCAN_API_SUCCESS, this process has started successfully.
Currently the API does not provide functions to query the current lidar state resp. to get error messages and error codes in case of failures. We will provide these functions in a future release.
To detect errors of any kind, you can monitor the receipt of pointcloud messages within your application.

@cblesing Please find an update in branch https://github.com/SICKAG/sick_scan_xd/tree/feature/api_diagnostics, which exports diagnostic status and messages via the API. You can now register callbacks using SickScanApiRegisterDiagnosticMsg and SickScanApiRegisterLogMsg, or query the current status with function SickScanApiGetStatus. A callback function registered with SickScanApiRegisterDiagnosticMsg will be called, whenever the status changed (INIT, EXIT or OK) or an error occured (WARN or ERROR). See the diagnostic API description and example sick_scan_xd_api_test.cpp for details.
Note that this update is a cumulative update with multiple changes.


Add support for background execution limits on Android 8+

See https://developer.android.com/about/versions/oreo/background
For minimal support we could make MailService and PushService foreground services. We also need to make sure at least one of them is started whenever we perform a background operation.
For a nicer solution we could look into making periodic syncs use JobIntentService. For Push we still need to use a foreground service. We probably want to create a separate notification channel. That way users will be able hide the ongoing notification required for a foreground service.

Are you planning to implement any of these solutions? If yes when will an updated version be ready? Thanks to the entire team that keeps developing K9.

there is some news about this milestone? from 1 november is impossible to submit to store new versions without this target.

Thoughts on using WorkManager for this?

Is this ticket closed with #3763?

Is this ticket closed with #3763?

No. We still need to fix or disable Push.

As proposed by android, the problem can be fixed by extending the services to use JobIntentService instead of CoreService (Service).

With respect, I would hardly call this an Enhancement. Irrespective of the Play store criteria, even standalone apps cannot be targeted above API 25 and we are a long way past that.


Bug with Bun

Affected Packages
I don't know which package replaces workspace packages versions
Problem
Hi there. I recently updated my codebase to bun and published my private packages. However, I recently noticed that if I have a workspace dependency defined for a package ("package-a": "workspace:*") the version doesn't get updated and it stays at "workspace:*" on publish, so if I try to install it I get this error:
In : "package-a@workspace:*" is in the dependencies but no package named "package-a" is present in the workspace

Hopefully you know what I mean, if not don't hesitate to ask 😊
Proposed solution
I don't know if this is changeset related or a problem with bun

For the time being, you should use bun to publish your packages. Please configure changesets/action with your custom publish script that will call bun publish-command-i-dont-know-how-to-use-bun && changeset tag.

@migueldamota I'm curious, how did you end up publishing? Bun doesn't have a publish command yet, and npm doesn't support the workspace:* protocol AFAIK. I'm using PNPM to publish right now 😂

Hi @Nickersoft. I am using a library called bunpublish. Be sure to also add a bunfig.toml to your project like this:
[install]
registry = { url = "https://registry.npmjs.org", token = "$NPM_TOKEN" }

Then I just added bunpublish to my ci:publish script and then it got published just fine.
"scripts": {
  "ci:publish": "bunpublish && changeset tag"
}


split datafusion-logical-plan sub-module

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
(This section helps Arrow developers understand the context and why for this feature, in addition to  the what)
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.

I believe this is done https://github.com/apache/arrow-datafusion/tree/master/datafusion/expr/src/logical_plan -- though maybe the intent was to move all of logical_plan into its own crate?
I am thinking extracting the physical plan from core will be the biggest bang for the buck


[🐛 BUG]: POST too large

No duplicates 🥲.

[X] I have searched for a similar issue in our bug tracker and didn't find any solutions.

What happened?
Hi everyone!
When I'm trying to send more than 8M POST data, I'm getting 500 error with message:

POST too large

Use https://github.com/StreetYo/rr-post-error to reproduce the error.

rr.exe serve
php test.php

Version
php: 8.1
rr.exe version 2.9.4
Relevant log output
# rr.exe serve
[INFO] RoadRunner server started; version: 2.9.4, buildtime: 2022-05-06T16:59:44+0000
2022-06-14T01:52:51.347+0500    DEBUG   server          worker is allocated     {"pid": 18088, "internal_event_name": "EventWorkerConstruct"}
2022-06-14T01:52:51.349+0500    DEBUG   http            http server was started {"address": "<IP_ADDRESS>:8080"}
2022-06-14T01:52:58.090+0500    ERROR   http            request forming error   {"start": "2022-06-14T01:52:58.018+0500", "elapsed": "71.2208ms", "error": "http: POST too large"}

Hey 👋🏻 Thanks for the report, I'll try to reproduce the bug, and in case of success, I will fix it in the 2.10.5 (next bugfix release 23.06).

Ok guys, this issue is confirmed. The current limit for the x-www-form-urlencoded is 10MB, and I will sync it with the max_request_size limit.

Notes (@rustatian): Use the MaxBytesReader here: https://github.com/roadrunner-server/http/blob/master/handler/request.go#L94
r.Body = http.MaxBytesReader(w, r.Body, MaxFileSize)
r.ParseForm()


Fix broken headings in Markdown files

GitHub changed the way Markdown headings are parsed, so this change fixes it.
See bryant1410/readmesfix for more information.
Tackles bryant1410/readmesfix#1

Cool, thank you @bryant1410 !


Possible Typo: In the most secure deployments, the Enterprise Root CA is taken offline and physically secured.

Other sources suggest this should read "In the most secure deployments, the Standalone Root CA is taken offline and physically secured." (standalone NOT enterprise).  Taking a domain joined machine offline introduces issues.  Reference:
https://social.technet.microsoft.com/Forums/en-US/0880e4a4-cf4f-4831-be8d-7e25c11d8b9c/how-to-offline-an-enterprise-root-ca
This is an easy one. You cannot deploy an enterprise root CA as an offline CA. By definition, an offline CA is never connected to the network. Which makes it impossible to:

Join the domain
Have an IP address
Read certificate templates from AD
Issue certificates based on permissions on the AD-based certificate templates.
An offline root CA is deployed as a standalone root CA, end of story

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 9af1ad51-f0e9-b207-5788-2c7564358666
Version Independent ID: e18caf13-3585-c525-4314-e8c820caffe9
Content: Server Certificate Deployment Overview
Content Source: WindowsServerDocs/networking/core-network-guide/cncg/server-certs/Server-Certificate-Deployment-Overview.md
Product: windows-server-threshold
Technology: networking
GitHub Login: @shortpatti
Microsoft Alias: pashort

Only Microsoft employees can close issues or pull requests via commenting in this repo.


prometheus hight memory usage

Hello
Prometheus consumes a lot of memory, with more and more every day.
pprof metrics:
inuse space:
(pprof) top10
Showing nodes accounting for 4074.76MB, 73.49% of 5544.98MB total
Dropped 278 nodes (cum <= 27.72MB)
Showing top 10 nodes out of 108
      flat  flat%   sum%        cum   cum%
 1372.59MB 24.75% 24.75%  1938.25MB 34.96%  github.com/prometheus/prometheus/promql.(*evaluator).eval
  533.52MB  9.62% 34.38%   533.52MB  9.62%  github.com/prometheus/prometheus/tsdb/encoding.(*Decbuf).UvarintStr (inline)
  399.62MB  7.21% 41.58%   864.64MB 15.59%  github.com/prometheus/prometheus/tsdb/record.(*Decoder).Series
  397.12MB  7.16% 48.74%   397.12MB  7.16%  github.com/prometheus/prometheus/pkg/labels.(*Builder).Labels
  312.57MB  5.64% 54.38%   412.57MB  7.44%  github.com/prometheus/prometheus/tsdb.newMemSeries
  266.98MB  4.81% 59.20%   266.98MB  4.81%  github.com/prometheus/prometheus/scrape.newScrapePool.func1
  201.52MB  3.63% 62.83%   201.52MB  3.63%  github.com/prometheus/prometheus/tsdb/chunkenc.NewXORChunk
  201.31MB  3.63% 66.46%   201.31MB  3.63%  github.com/beorn7/perks/quantile.newStream
  198.58MB  3.58% 70.04%   265.08MB  4.78%  github.com/prometheus/prometheus/tsdb.(*baseChunkSeries).Next
  190.94MB  3.44% 73.49%   190.94MB  3.44%  github.com/prometheus/prometheus/scrape.(*scrapeCache).trackStaleness

alloc space:
(pprof) top10
Showing nodes accounting for 1431.44GB, 78.53% of 1822.82GB total
Dropped 1048 nodes (cum <= 9.11GB)
Showing top 10 nodes out of 98
      flat  flat%   sum%        cum   cum%
  610.80GB 33.51% 33.51%   613.51GB 33.66%  github.com/prometheus/prometheus/promql.(*evaluator).aggregation
  260.81GB 14.31% 47.82%   291.38GB 15.99%  github.com/prometheus/prometheus/tsdb.(*baseChunkSeries).Next
  109.02GB  5.98% 53.80%   109.02GB  5.98%  github.com/prometheus/prometheus/scrape.newScrapePool.func1
  101.24GB  5.55% 59.35%  1413.37GB 77.54%  github.com/prometheus/prometheus/promql.(*evaluator).rangeEval
   85.10GB  4.67% 64.02%   103.46GB  5.68%  compress/flate.NewWriter
   70.13GB  3.85% 67.87%  1415.11GB 77.63%  github.com/prometheus/prometheus/promql.(*evaluator).eval
   56.73GB  3.11% 70.98%    56.73GB  3.11%  github.com/prometheus/prometheus/tsdb/chunkenc.(*XORChunk).iterator
   48.11GB  2.64% 73.62%   140.01GB  7.68%  github.com/prometheus/prometheus/tsdb.newChunkSeriesIterator (inline)
   45.40GB  2.49% 76.11%    81.98GB  4.50%  github.com/prometheus/prometheus/web.(*Handler).federation
   44.11GB  2.42% 78.53%   370.92GB 20.35%  github.com/prometheus/prometheus/tsdb.(*blockSeriesSet).Next

Prometheus version:
version 2.20.1

Prometheus configuration file:

global:
  evaluation_interval: 1m
  external_labels: {monitor: example}
  scrape_interval: 1m

It makes more sense to ask questions like this on the prometheus-users mailing list rather than in a GitHub issue. On the mailing list, more people are available to potentially respond to your question, and the whole community can benefit from the answers provided.


Support for type classes

Enso doesn't have special syntax for writing type classes as of Oct 2024. The original design...

Implementation and tests for type classes, as described in the design doc. WARNING: the design doc needs to be confirmed before implementing this task!

...hasn't yet been implemented. Anyway this is the current blueprint to follow when writing type classes as of Oct 2024.

The blueprint to write type classes in Enso as for Oct 2024:
Define API and "Dictionary"
Here is a way to define Set type class:
from Standard.Base import Error
from Standard.Base.Errors.Common import Type_Error
from  Standard.Base.Errors import Illegal_State

type Set a
    Value o s:a

    is_empty self = self.o.is_empty self.s
    contains self e = self.o.contains self.s e
    length self = self.o.length self.s
    insert self e = Set.Value self.o <| self.o.insert self.s e
    union self (other:Set) = if self.o != other.o then Error.throw (Type_Error "Incompatible sets") else
        Set.Value self.o <| self.o.union self.s other.s

type Operator a
    is_empty (_ : Set) = Error.Throw (Illegal_State.Error "is_empty not implemented")
    contains (_ : Set) _ = Error.Throw (Illegal_State.Error "contains not implemented")
    length (_ : Set) _ = Error.Throw (Illegal_State.Error "length not implemented")
    insert (_ : Set) _ = Error.Throw (Illegal_State.Error "insert not implemented")
    union (_ : Set) _ = Error.Throw (Illegal_State.Error "union not implemented")

The type Set defines is_empty, contains, length, insert and union operations. Once one has such a set up, one can define an implementation.
Implementation with Vector Backing Store
Let's use Vector Any to store the elements as shown here:
from Standard.Base import Vector

import project.Set.Set

type Vector_Impl a
    empty = Set.Value Vector_Impl []

    is_empty (elements : Vector) = elements.length == 0
    contains (elements : Vector) e = elements.contains e
    length (elements : Vector) = elements.length
    insert (elements : Vector) e = if elements.contains e then elements else elements + [ e ]
    union (us : Vector) (them : Vector) = (us + them).distinct

the preferred way of creating type Set is to define a conversion to turn any Vector into a Set:
Set.from (that:Vector) = Vector_Impl.empty . insert that

Using Set
To use the set one can start with a conversion and they operate on the set as desired:
v = [1, 2, 3]
s = v:Set
four = s . insert 4
four . length . should_equal 4

see also #11366


[Bug][Connector-v2][ElasticsearchSource][When this field instanceof N…

Purpose of this pull request
[feature] [Connector-v2][ElasticsearchSource]when source empty,We might want to pull all the fields of Elasticsearch
[Bug][Connector-v2][ElasticsearchSource][When this field instanceof NullNode,The Long field will cast an exception]
Check list

[x] Code changed are covered with tests, or it does not need tests for reason:
[x] If any new Jar binary package adding in your PR, please add License Notice according
New License Guide
[x] If necessary, please update the documentation to describe the new feature. https://github.com/apache/incubator-seatunnel/tree/dev/docs
[x] If you are contributing the connector code, please check that the following files are updated:

Update change log that in connector document. For more details you can refer to connector-v2
Update plugin-mapping.properties and add new connector information in it
Update the pom file of seatunnel-dist

[x] Update the release-note.

@iture123 @TyrantLucifer @Hisoka-X PTAL,thanks.

@hailin0 @Hisoka-X @EricJoy2048 PTAL

@Hisoka-X i have already added test case，PTAL

@CosmosNi  hi, is there any new progress on it

Due to submission email error，close merge


ghc bootstrap binary: 8.2.1 -> 8.2.2

If the nix store lives on NFS, ghc 8.2.1 is unable to build a package
database. This bug was fixed by @bgamari in ghc 8.2.2 here:
https://ghc.haskell.org/trac/ghc/ticket/13945
This commit upgrades the unpacked bootstrap GHC version, so that we can build
newer versions of GHC even if the store is on NFS.
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[ ] NixOS
[ ] macOS
[x] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Fits CONTRIBUTING.md.

Note that this impacts users of GHC 8.2, 8.4, and 8.6 equally: all of them need the GHC 8.2-binary bootstrap compiler when building from src.
Without this, any build of any GHC fails (almost) immediately with this error, since the bootstrap compiler is unable to create package databases on NFS:
'/nix/store/7j7kci9f1h73pjcmy1vf2f7b60251npk-ghc-8.2.1-binary/lib/ghc-8.2.1/bin/ghc-pkg'
exited with an error:
ghc-pkg: Couldn't open database
/nix/store/7j7kci9f1h73pjcmy1vf2f7b60251npk-ghc-8.2.1-binary/lib/ghc-8.2.1/package.conf.d
for modification: {handle:
/nix/store/7j7kci9f1h73pjcmy1vf2f7b60251npk-ghc-8.2.1-binary/lib/ghc-8.2.1/package.conf.d/package.cache.lock}:
hLock: invalid argument (Bad file descriptor)
make[1]: *** [ghc.mk:993: install_packages] Error 1
make: *** [Makefile:51: install] Error 2

@GrahamcOfBorg build haskell.compiler.ghc822Binary

Success on x86_64-linux (full log)
Attempted: haskell.compiler.ghc822Binary
Partial log (click to expand)
gzipping man pages under /nix/store/dpw7c7pwfsvdhjsscr7dfgnd340b5fbc-ghc-8.2.2-binary/share/man/
patching script interpreter paths in /nix/store/dpw7c7pwfsvdhjsscr7dfgnd340b5fbc-ghc-8.2.2-binary
/nix/store/dpw7c7pwfsvdhjsscr7dfgnd340b5fbc-ghc-8.2.2-binary/lib/ghc-8.2.2/bin/ghc-split: interpreter directive changed from "/usr/bin/perl" to "/nix/store/3slr7z6s497z36x3dlkh6g8l7d8jkn6x-perl-5.28.0/bin/perl"
/nix/store/dpw7c7pwfsvdhjsscr7dfgnd340b5fbc-ghc-8.2.2-binary/share/doc/ghc-8.2.2/html/libraries/gen_contents_index: interpreter directive changed from "/bin/sh" to "/nix/store/qnp0bgn3icxrwcnnhz4pcjynxbcnxfv9-bash-4.4-p23/bin/sh"
checking for references to /build/ in /nix/store/dpw7c7pwfsvdhjsscr7dfgnd340b5fbc-ghc-8.2.2-binary...
running install tests
[1 of 1] Compiling Main             ( main.hs, main.o )
Linking main ...
compilation ok
/nix/store/dpw7c7pwfsvdhjsscr7dfgnd340b5fbc-ghc-8.2.2-binary

Success on aarch64-linux (full log)
Attempted: haskell.compiler.ghc822Binary
Partial log (click to expand)
/nix/store/vi4352yli8q9rri24xfx07z0ppghbrhv-ghc-8.2.2-binary/lib/ghc-8.2.2/bin/ghc-split: interpreter directive changed from "/usr/bin/perl" to "/nix/store/6qcipin39m3j9gbxqfz2fkpmp3w7mqmi-perl-5.28.0/bin/perl"
checking for references to /build/ in /nix/store/vi4352yli8q9rri24xfx07z0ppghbrhv-ghc-8.2.2-binary...
running install tests
/nix/store/vi4352yli8q9rri24xfx07z0ppghbrhv-ghc-8.2.2-binary/lib/ghc-8.2.2/bin/ghc: /nix/store/9slnwsf9lmd1n68fzqi64i48pi0kfcj3-ncurses-6.1-20181027-abi5-compat/lib/libtinfo.so.5: no version information available (required by /nix/store/vi4352yli8q9rri24xfx07z0ppghbrhv-ghc-8.2.2-binary/lib/ghc-8.2.2/bin/../haskeline-<IP_ADDRESS>/libHShaskeline-<IP_ADDRESS>-ghc8.2.2.so)
/nix/store/vi4352yli8q9rri24xfx07z0ppghbrhv-ghc-8.2.2-binary/lib/ghc-8.2.2/bin/ghc: /nix/store/9slnwsf9lmd1n68fzqi64i48pi0kfcj3-ncurses-6.1-20181027-abi5-compat/lib/libtinfo.so.5: no version information available (required by /nix/store/vi4352yli8q9rri24xfx07z0ppghbrhv-ghc-8.2.2-binary/lib/ghc-8.2.2/bin/../ghc-8.2.2/libHSghc-8.2.2-ghc8.2.2.so)
/nix/store/vi4352yli8q9rri24xfx07z0ppghbrhv-ghc-8.2.2-binary/lib/ghc-8.2.2/bin/ghc: /nix/store/9slnwsf9lmd1n68fzqi64i48pi0kfcj3-ncurses-6.1-20181027-abi5-compat/lib/libtinfo.so.5: no version information available (required by /nix/store/vi4352yli8q9rri24xfx07z0ppghbrhv-ghc-8.2.2-binary/lib/ghc-8.2.2/bin/../terminfo-<IP_ADDRESS>/libHSterminfo-<IP_ADDRESS>-ghc8.2.2.so)
[1 of 1] Compiling Main             ( main.hs, main.o )
Linking main ...
compilation ok
/nix/store/vi4352yli8q9rri24xfx07z0ppghbrhv-ghc-8.2.2-binary

Rebased onto haskell-updates, thanks for the tip.

Test builds are running at https://hydra.nixos.org/jobset/nixpkgs/haskell-updates.

Thanks @peti!


install-photobooth.sh: Add composer and modules depending on php version

Prerequisites checklist

[x] I have read the contributing guidelines.

What is the purpose of this pull request? (put an "x" next to an item)

[x] Bug fix
[ ] Documentation update
[ ] Bug fix
[ ] New feature
[ ] Other, please explain:

What changes did you make? (Give an overview)

install-photobooth.sh: Add composer and modules depending on php version

Is there anything you'd like reviewers to focus on?
I installed photobooth on Rapberry Pi OS bookworm with the following command from the installation guide:
sudo bash install-photobooth.sh -username='<YourUsername>' -webserver='nginx'
It seems php modules gd, xml, zip and mbstring are not installed/activated correctly.
Also composer was missing, so the installation failed, so I like to fix it in this PR.

I think PHP 8.3 is the current stable now and installed by default with it's 8.3 packages.

Hope I'm not bothering you with this PR. :)
This is a great project and you are doing good work.
Think you are right with the default version of PHP in bookworm. :+1:


Add new OX contract & logo

Discussed on Discord as well as Telegram. We switched contracts; old OX was earlier removed, and new OX is now added.
Thanks!


revert: Dead Letter queue contract changes.

Codecov Report
Base: 61.05% // Head: 61.05% // No change to project coverage :thumbsup:

Coverage data is based on head (b46b3b6) compared to base (ce13f3f).
Patch has no changes to coverable lines.

Additional details and impacted files
@@           Coverage Diff            @@
##           develop     #322   +/-   ##
========================================
  Coverage    61.05%   61.05%
========================================
  Files           43       43
  Lines         4321     4321
========================================
  Hits          2638     2638
  Misses        1507     1507
  Partials       176      176

Flag
Coverage Δ

unittests
61.05% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Modal structure a11y

Fixes (Internally reported issue)
The current modal in the main branch has a stuctural issue where the element that provides role="dialog" and the various aria enhancments is provided twice. Once by react-modal, once by the component itself.  So that we get this, for instance (note the dual dialog components):

This PR Moves all aria attributes to the role="dialog" element created by react-modal so that we now get:

Additionally since all aria attributes are now passed as an object to the react-modal aria prop, this PR adds a getAriaAttributes method to handle all the logic involved n computing these attributes (e.g. label or labelledby)

CONTRIBUTOR checklist (do not remove)
Please complete for every pull request

[ ] First-time contributors should sign the Contributor License Agreement.  If you haven't before, wait a few minutes and a bot will comment on this pull request with instructions.
[X] npm run lint:fix has been run and linting passes.
[X] Mocha, Jest (Storyshots), and components/component-docs.json CI tests pass (npm test).
[X ] Tests have been added for new props to prevent regressions in the future. See readme.
[X] Review the appropriate Storybook stories. Open http://localhost:9001/.
[X] Review tests are passing in the browser. Open http://localhost:8001/.
[X] Review markup conforms to SLDS by looking at DOM snapshot strings.

REVIEWER checklist (do not remove)

[ ] TravisCI tests pass. This includes linting, Mocha, Jest, Storyshots, and components/component-docs.json tests.
[ ] Tests have been added for new props to prevent regressions in the future. See readme.
[ ] Review the appropriate Storybook stories. Open http://localhost:9001/.
[ ] The Accessibility panel of each Storybook story has 0 violations (aXe). Open http://localhost:9001/.
[ ] Review tests are passing in the browser. Open http://localhost:8001/.
[ ] Review markup conforms to SLDS by looking at DOM snapshot strings.

Required only if there are markup / UX changes

[ ] Add year-first date and commit SHA to last-slds-markup-review in package.json and push.
[ ] Request a review of the deployed Heroku app by the Salesforce UX Accessibility Team.
[ ] Add year-first review date, and commit SHA, last-accessibility-review, to package.json and push.
[ ] While the contributor's branch is checked out, run npm run local-update within locally cloned site repo to confirm the site will function correctly at the next release.

Thank you @jorycunningham


do not copy target folder (which is huge and thus slow)

Hi thanks for the lib! My usage (on my local dev computer) is as follows:

run cargo test etc
also use rustimport and thus use in python code

However, it seems that the rustimport tries to copy all folders, including the huge target folder of my workspace, into the temporary dir. Since the target folder is more than a few GB, it is slow to copy and wastes disk and time.
PS. A stack trace when I realize rustimport is stuck and hit keyboard interrupt is as follows. As can be seen, it seems to be copying.
^CTraceback (most recent call last):
  File "/Users/tom/opt/anaconda3/lib/python3.9/runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/Users/tom/opt/anaconda3/lib/python3.9/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/Users/tom/Main/research/code/research_mono/research_mono/benchmarks/benchmark_ineq_generator.py", line 17, in <module>
    main()
  File "/Users/tom/Main/research/code/research_mono/research_mono/benchmarks/benchmark_ineq_generator.py", line 9, in main
    g = wrapped_generator.GeneratorVec(hypotheses=hypotheses, num_generators=num_generators)
  File "/Users/tom/Main/research/code/research_mono/research_mono/neural_theorem_prover/interactive_theorem_prover/ineq/generator/wrapped_generator.py", line 8, in __init__
    import rust.ineq
  File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
  File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 664, in _load_unlocked
  File "<frozen importlib._bootstrap>", line 627, in _load_backward_compatible
  File "/Users/tom/opt/anaconda3/lib/python3.9/site-packages/rustimport/import_hook.py", line 48, in load_module
    self.__importable.build(release=settings.compile_release_binaries)
  File "/Users/tom/opt/anaconda3/lib/python3.9/site-packages/rustimport/importable.py", line 206, in build
    shutil.copytree(self.__workspace_path or self.__crate_path, root_output_path, dirs_exist_ok=True)
  File "/Users/tom/opt/anaconda3/lib/python3.9/shutil.py", line 566, in copytree
    return _copytree(entries=entries, src=src, dst=dst, symlinks=symlinks,
  File "/Users/tom/opt/anaconda3/lib/python3.9/shutil.py", line 504, in _copytree
    copytree(srcobj, dstname, symlinks, ignore, copy_function,
  File "/Users/tom/opt/anaconda3/lib/python3.9/shutil.py", line 566, in copytree
    return _copytree(entries=entries, src=src, dst=dst, symlinks=symlinks,
  File "/Users/tom/opt/anaconda3/lib/python3.9/shutil.py", line 504, in _copytree
    copytree(srcobj, dstname, symlinks, ignore, copy_function,
  File "/Users/tom/opt/anaconda3/lib/python3.9/shutil.py", line 566, in copytree
    return _copytree(entries=entries, src=src, dst=dst, symlinks=symlinks,
  File "/Users/tom/opt/anaconda3/lib/python3.9/shutil.py", line 504, in _copytree
    copytree(srcobj, dstname, symlinks, ignore, copy_function,
  File "/Users/tom/opt/anaconda3/lib/python3.9/shutil.py", line 566, in copytree
    return _copytree(entries=entries, src=src, dst=dst, symlinks=symlinks,
  File "/Users/tom/opt/anaconda3/lib/python3.9/shutil.py", line 508, in _copytree
    copy_function(srcobj, dstname)
  File "/Users/tom/opt/anaconda3/lib/python3.9/shutil.py", line 444, in copy2
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/Users/tom/opt/anaconda3/lib/python3.9/shutil.py", line 270, in copyfile
    _fastcopy_fcopyfile(fsrc, fdst, posix._COPYFILE_DATA)
  File "/Users/tom/opt/anaconda3/lib/python3.9/shutil.py", line 105, in _fastcopy_fcopyfile
    posix._fcopyfile(infd, outfd, flags)
KeyboardInterrupt

Fixed by #10

Thanks for your improvement suggestions and PR to rustimport so far! I'm very happy everytime it gets a little more mature.

You are welcome! rustimport is quite good already ;)

Fixed now in 70f172b


⚠ Cioos Pacific CKAN has degraded performance

In cf9f6f3, Cioos Pacific CKAN (https://catalogue.cioospacific.ca) experienced degraded performance:

HTTP code: 200
Response time: 8109 ms

Resolved: Cioos Pacific CKAN performance has improved in addc217 after 5 minutes.


[backport v6.2.x] imp(core): allow huckleberry events with a prefix (#5541)

Description
This PR is a cherry-pick of #2375109.
The only notable diff is converting attribute.Key and attribute.Value using built-in string() in convertToErrorEvents due to the fields being []byte on this version of cosmos-sdk.

Before we can merge this PR, please make sure that all the following items have been
checked off. If any of the checklist items are not applicable, please leave them but
write a little note why.

[ ] Targeted PR against the correct branch (see CONTRIBUTING.md).
[ ] Linked to GitHub issue with discussion and accepted design, OR link to spec that describes this work.
[ ] Code follows the module structure standards and Go style guide.
[ ] Wrote unit and integration tests.
[ ] Updated relevant documentation (docs/).
[ ] Added relevant godoc comments.
[ ] Provide a conventional commit message to follow the repository standards.
[ ] Include a descriptive changelog entry when appropriate. This may be left to the discretion of the PR reviewers. (e.g. chores should be omitted from changelog)
[ ] Re-reviewed Files changed in the GitHub PR explorer.
[ ] Review SonarCloud Report in the comment section below once CI passes.

Maybe we can remove the markdown link checkers on this branch. I don't think we need them anymore


[WIP] KAFKA-10694: Implement zero copy for FetchSnapshot

More detailed description of your change

Add a BaseRegion type similar to BaseRecords, but differs from BaseRecords in that Position in FetchSnapshotRequest is not required a start of RecordBatch, add FileRegionSend to convert FileRegion into a Send.
RawSnapshotWriter and RawSnapshotReader interact with BaseRegion instead of ByteBuffer
Add SendBuilder.writeRegion method using zero-copy

Summary of testing strategy (including rationale)

Change code in unit test of RawSnapshotWriter and RawSnapshotReader
Add unit test in SendBuilderTest and FileRawSnapshotTest
Add unit test for FileRegion and MemoryRegion

Committer Checklist (excluded from commit message)

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation (including upgrade notes)

@dengziming Thanks for the patch. I have one high level comment. The approach we've taken here is to implement a new zero-copy "region" type. One alternative is to use the existing "records" type since it already supports "zero-copy" and the snapshot data is expected to be records data anyway. I'd like to understand the drawbacks of this approach a bit better. I think having two zero-copy types is a bit undesirable. An alternative is that we can let the "region" type subsume "records," but I suspect that will be tricky because of the down-conversion logic.
@jsancio also suggested that we might be able to represent the "region" type using type=bytes zeroCopy=true. I think that would require us to introduce an interface of some kind so that we can represent both a ByteBuffer and FileChannel. I'm not sure what that would look like, but it's also worth considering.
Anyway, just want to make sure we have covered all of the options before getting too far with this.

@dengziming Thanks for the patch. I have one high level comment. The approach we've taken here is to implement a new zero-copy "region" type. One alternative is to use the existing "records" type since it already supports "zero-copy" and the snapshot data is expected to be records data anyway. I'd like to understand the drawbacks of this approach a bit better. I think having two zero-copy types is a bit undesirable. An alternative is that we can let the "region" type subsume "records," but I suspect that will be tricky because of the down-conversion logic.
@jsancio also suggested that we might be able to represent the "region" type using type=bytes zeroCopy=true. I think that would require us to introduce an interface of some kind so that we can represent both a ByteBuffer and FileChannel. I'm not sure what that would look like, but it's also worth considering.
Anyway, just want to make sure we have covered all of the options before getting too far with this.

@dengziming @jsancio I'll give my take what I think we should do here, but let's try to agree before we go any further. Basically I am not really convinced that we need a new type, at least not in the near term. The snapshot data will be record data, so I cannot see a strong argument not to use the existing "records" type which already handles zero-copy.
The one difference between FetchSnapshot and Fetch is that the latter is aligned on offsets while the former can indicate an arbitrary position in a file. I assume that is the main reason we have diverged here. However, I do not think this presents a major hurdle. On the server side, I think we have everything we need. FileRawSnapshotReader already has a FileRecords object and we can return a slice at an arbitrary position using slice(int position, int size). On the client side, when we parse a snapshot response, Readable will give us back a reference to a MemoryRecords which will not necessarily be aligned. However, MemoryRecords gives us direct access to the underlying buffer, so the misalignment does not cause any problems.
Longer term, I think we can make an effort to replace the "records" type and just rely on type=bytes, zeroCopy=true. For this to work, we need a type which generalizes both a ByteBuffer and a FileChannel slice. For example, we could have something like this:
interface ZeroCopyBuffer {
  ByteBuffer read(int length);
  Send toSend();
}

When parsing a request or response received over the network, it will be in memory anyway, so we need some hook to get access to the ByteBuffer. On the other hand, when transmitting a request or response, we let the implementation build the Send itself. This gives us a way to work with RecordsSend. There's probably more to it than that, but that's probably enough to get started. Then we would change the generated code to rely on the new type and let SendBuilder invoke ZeroCopyBuffer.toSend as appropriate.
Thoughts?

@dengziming @jsancio I'll give my take what I think we should do here, but let's try to agree before we go any further. Basically I am not really convinced that we need a new type, at least not in the near term. The snapshot data will be record data, so I cannot see a strong argument not to use the existing "records" type which already handles zero-copy.
The one difference between FetchSnapshot and Fetch is that the latter is aligned on offsets while the former can indicate an arbitrary position in a file. I assume that is the main reason we have diverged here. However, I do not think this presents a major hurdle. On the server side, I think we have everything we need. FileRawSnapshotReader already has a FileRecords object and we can return a slice at an arbitrary position using slice(int position, int size). On the client side, when we parse a snapshot response, Readable will give us back a reference to a MemoryRecords which will not necessarily be aligned. However, MemoryRecords gives us direct access to the underlying buffer, so the misalignment does not cause any problems.
Longer term, I think we can make an effort to replace the "records" type and just rely on type=bytes, zeroCopy=true. For this to work, we need a type which generalizes both a ByteBuffer and a FileChannel slice. For example, we could have something like this:
interface ZeroCopyBuffer {
  ByteBuffer read(int length);
  Send toSend();
}

When parsing a request or response received over the network, it will be in memory anyway, so we need some hook to get access to the ByteBuffer. On the other hand, when transmitting a request or response, we let the implementation build the Send itself. This gives us a way to work with RecordsSend. There's probably more to it than that, but that's probably enough to get started. Then we would change the generated code to rely on the new type and let SendBuilder invoke ZeroCopyBuffer.toSend as appropriate.
Thoughts?

Replying to https://github.com/apache/kafka/pull/9819#issuecomment-761119104
Thanks @hachikuji for thinking about this and for giving a detail reply. For the long term solution, I am trying to understand how we transition from type: "records" to type: "bytes", zeroCopy="true".
Outside of what you have enumerate, how would changing the type of a field work after the version bump? Would the generated message class need to support access to this field as both BaseRecords and ZeroCopyBuffer? Or would the generated class would just have ZeroCopyBuffer? In other words, what is the expectation of 3rd party clients with regards to the generated classes?

Replying to https://github.com/apache/kafka/pull/9819#issuecomment-761119104
Thanks @hachikuji for thinking about this and for giving a detail reply. For the long term solution, I am trying to understand how we transition from type: "records" to type: "bytes", zeroCopy="true".
Outside of what you have enumerate, how would changing the type of a field work after the version bump? Would the generated message class need to support access to this field as both BaseRecords and ZeroCopyBuffer? Or would the generated class would just have ZeroCopyBuffer? In other words, what is the expectation of 3rd party clients with regards to the generated classes?

@jsancio It's a good question. Up to now, we have not enforced strict compatibility for the JSON schema representation. As long as the on-the-wire bytes are the same, we have allowed some flexibility for the generator. It was only in the past couple months that we finally got all of the APIs converted, so the flexibility was necessary. Personally I'd like to retain this loose compatibility going forward, but I guess it will depend on what users want. If there is a strong demand to keep the schema definitions compatible, then we will need to come up with some way to evolve them. However, for now, I don't think we should consider JSON type compatibility to be a blocker.

@jsancio It's a good question. Up to now, we have not enforced strict compatibility for the JSON schema representation. As long as the on-the-wire bytes are the same, we have allowed some flexibility for the generator. It was only in the past couple months that we finally got all of the APIs converted, so the flexibility was necessary. Personally I'd like to retain this loose compatibility going forward, but I guess it will depend on what users want. If there is a strong demand to keep the schema definitions compatible, then we will need to come up with some way to evolve them. However, for now, I don't think we should consider JSON type compatibility to be a blocker.

The json schema is indeed not api today. A KIP will be required before we make it so.

The json schema is indeed not api today. A KIP will be required before we make it so.

The proposal in https://github.com/apache/kafka/pull/9819#issuecomment-761119104 sounds good to me. I'll update the associated Jira soon.

The proposal in https://github.com/apache/kafka/pull/9819#issuecomment-761119104 sounds good to me. I'll update the associated Jira soon.

comment
I have tried locally to replace the FileRegion with FileRecords, and it worked fine, which means that "aligned on offsets" is just a soft requirement of FetchRequest,  the MemoryRecords  from FetchResponse is not necessarily be aligned, so it's viable to use FileRecords and MemoryRecords to implement zero-copy, the only new work is to support BaseRecords.writeTo(FileChannel)

comment
I have tried locally to replace the FileRegion with FileRecords, and it worked fine, which means that "aligned on offsets" is just a soft requirement of FetchRequest,  the MemoryRecords  from FetchResponse is not necessarily be aligned, so it's viable to use FileRecords and MemoryRecords to implement zero-copy, the only new work is to support BaseRecords.writeTo(FileChannel)

@hachikuji @jsancio @ijuma ,Hello, This pr is ready for a second review, Thank you.

@hachikuji @jsancio @ijuma ,Hello, This pr is ready for a second review, Thank you.

@dengziming Thanks for the updates. I think we're on the right track. I thought of a few potential potential simplifications. Take a look here: https://github.com/hachikuji/kafka/commit/01cc3aaa147064e60624f8b759ede54b95242a57.

@dengziming Thanks for the updates. I think we're on the right track. I thought of a few potential potential simplifications. Take a look here: https://github.com/hachikuji/kafka/commit/01cc3aaa147064e60624f8b759ede54b95242a57.

@hachikuji ,Thank you for your suggestions, I found DefaultRecordsSend similar to UnalignedRecordsSend  so I added a generic type toDefaultRecordsSend, and also added a parent interface TransferableRecords to Records and UnalignedRecords, please take a look.

@hachikuji ,Thank you for your suggestions, I found DefaultRecordsSend similar to UnalignedRecordsSend  so I added a generic type toDefaultRecordsSend, and also added a parent interface TransferableRecords to Records and UnalignedRecords, please take a look.

@hachikuji @jsancio Thank you for your great patience!
@jsancio your concerns seems similar to https://github.com/apache/kafka/pull/9970#discussion_r564747239 , we can discuss it there.

@hachikuji @jsancio Thank you for your great patience!
@jsancio your concerns seems similar to https://github.com/apache/kafka/pull/9970#discussion_r564747239 , we can discuss it there.


Monomorphization

Codegen expects a monomorphized type system, so at the moment there's a monomoprhize :: Expr Poly.Type -> Expr Flat.Type function that's doing that. But all it's really doing is trivially mapping types that already happen to be nullary polytypes, and throwing out anything that involves any kind of type application.
A proper monomorphization pass will also need to type-specialize polymorphic variables/functions, on an as-needed basis.
We also need to come up with a sane type name mangling scheme, to convert type applications like Option Int into Option_Int or something of the sort. We need to convince ourselves that such a scheme will never introduce name conflicts where there were none previously.

Note that this is no longer relevant due to our runtime supporting polymorphic values. This is closed by https://github.com/ssm-lang/sslang/commit/cfefdbe71cdd6055b0ebe2dd261e4cf332afb28a, @EmilySillars will eventaully land into main via #74


⚠ Spryr has degraded performance

In ef84b75, Spryr (https://spryr.com) experienced degraded performance:

HTTP code: 200
Response time: 5087 ms

Resolved: Spryr performance has improved in 5923f44 after 7 minutes.


Manually add user

In the Permissions and Registration one can Disable registration, which "can be useful for public wikis with a closed group of editors".
But how do I get my closed group of editors in?
It would be great if the User Management had a button to manually add a user.

Released in v2.7.0.


[WIP] bots: Add timed event support and a work timer bot

The first commit adds a new EventTimer class to bots_api.
I don't know what the best way to integrate such a class would be, so the current setup is perhaps temporary.
EventTimer gives sort of the JS setTimeout and setInterval functionality to bots. To run a function in 30 seconds, use event_timer.schedule(func, 30).
To run it every 30 seconds, use event_timer.schedule(func, 30, repeat=True)
I'd like some feedback on my implementation, and if there are more optimal ways to approach it.
And then, the bot I made to test this will let you set timers for work, in a similar vein as the Pomodoro technique. See this usage example:

Automated message from Dropbox CLA bot
@cory2067, it looks like you've already signed the Dropbox CLA. Thanks!

Note!  This PR will need to be moved to our new bots repo.  ping @cory2067

Personally I'm in favor of doing something like this first, before building out bot stuff:
https://github.com/zulip/python-zulip-api/issues/11

Ok, I think I'm basically abandoning this endeavor for now.

OK, I'm going to close the PR since it won't be mergable given that it's against the wrong repository now :)


Missing docker image for ARM

Since v13.0, docker image for ARM seems to be missing
$ docker pull ghcr.io/ellie/atuin:12.0
12.0: Pulling from ellie/atuin
Digest: sha256:9e20849cb256337ef7c8df8986f106bf0691675189e98a3c805d1554f5e7ca19
Status: Image is up to date for ghcr.io/ellie/atuin:12.0
ghcr.io/ellie/atuin:12.0

$ docker pull ghcr.io/ellie/atuin:13.0
13.0: Pulling from ellie/atuin
no matching manifest for linux/arm64/v8 in the manifest list entries

$ docker pull ghcr.io/ellie/atuin:main
main: Pulling from ellie/atuin
no matching manifest for linux/arm64/v8 in the manifest list entries

Yup, unfortunately we've had to disable them for now. They've only been in since November, and it looks like they struggle to link properly
I'm hoping once we are entirely Rust code this will no longer happen, but it's probably coming from a C dependency

Sorry for the ops hassle! :/

Hopefully, compatibility won't break between my server and client before the fix 😅

It won't do - we still have a lot of people using old releases, even back to 0.7! So the old sync methods will be supported for a long time yet.

Just a heads up that we now build on arm, thanks to https://actuated.dev!


Add Links to Official Songs of Conquest website and Steam.

Should add links to the official game websites and store to promote the game

GoG store page and maybe the official game discord as well.

👍
maybe on the landing page (#20) or on footer?

Is this up for grabs? If so I'd like to take this one on
If we want to drive traffic to SoC's main site, and whichever store fronts we want to highlight I think having the links in the footer would be best? Below is what I'm thinking in a rough mock up - sub out the text for the stores respective icons so it matches the header with Discord and Github icons, but open to whatever ya'll think is best
mobile view:

desktop:

The footer will include more links like the privacy policies. I think, it might be difficult if the footer is always visible, because the size will increase.
What do you think about adding the footer at the bottom of the main area? The footer would be visible if you scroll down in the main area.
This allows us to have a multi line footer if required.
I like how the footer is added on https://mantine.dev/.

That's a much better implementation since we're going to have more than just the links to the stores in the footer. I'll get started implementing that

Maybe we can call it "Official Discord"?
You can create a draft request (Work in progress) if you like and want to get early feedback.

What all links do we want in the footer? So far I have these:

Steam store link
GoG store link
official website link

I'm unsure how to add their game discord in a way that differentiates itself from the Leon's Dev Discord in the header. Any ideas there?
Once we're solid on this I should have a PR opened up for this in the coming days

Hi, any update about the PR?

Sorry, been out sick and had an app launch that has eaten more time than expected. I should have a PR opened up for this this weekend. This is where I'm currently at with things, with links/layout open to redesign/adjustments for what ya'll think is best

I'm not sure if we want to have icons in the bottom right there, but I included them for demo purposes.
Let me know if there are any links I'm missing or if there are any I should remove, same with verbiage.

Looks good!
I think we don't need the logo and "Songs of Conquest Database".
Same with icons, because we have them in header. Or we move them, but I like to have them prominent somewhere.

You thinking something more like this?
desktop:

mobile:

Looks good. Logo is not required I think, but it's up to you

Fixed in #45


MAPL3 GCM Run Failure as of 2022-Oct-19

Something changed last night to cause the MAPL3 GCM to no longer run. When you run MAPL3 you get:
[3] SURFACEDOCDS                                  4549
[3] SURFACERun1                                   4220
[3] PHYSICS::Run                                  2576
[3] pe=00003 FAIL at line=00068    GetPointer.H                             <status=41>
[3] pe=00003 FAIL at line=01650    MAPL_Generic.F90                         <status=41>
[3] pe=00003 FAIL at line=01650    MAPL_Generic.F90                         <status=41>
[3] AGCMRun                                       2394
[3] GCMRun                                        1892
[3] pe=00003 FAIL at line=01650    MAPL_Generic.F90                         <status=41>
[3] pe=00003 FAIL at line=01650    MAPL_Generic.F90                         <status=41>
[3] pe=00003 FAIL at line=01292    MAPL_CapGridComp.F90                     <status=41>
[3] pe=00003 FAIL at line=01244    MAPL_CapGridComp.F90                     <status=41>
[3] pe=00003 FAIL at line=00935    MAPL_CapGridComp.F90                     <status=41>
[3] pe=00003 FAIL at line=01053    MAPL_CapGridComp.F90                     <status=41>
[3] pe=00003 FAIL at line=00294    MAPL_Cap.F90                             <status=41>
[3] pe=00003 FAIL at line=00258    MAPL_Cap.F90                             <status=41>
[3] pe=00003 FAIL at line=00194    MAPL_Cap.F90                             <status=41>
[3] pe=00003 FAIL at line=00171    MAPL_Cap.F90                             <status=41>
[3] pe=00003 FAIL at line=00032    GEOSgcm.F90                              <status=41>

I added some prints into DOCDS and found it was failing in child 4 aka LAND. Because of that, my guess is this is related to https://github.com/GEOS-ESM/GEOSgcm_GridComp/pull/645 by @weiyuan-jiang . @sdrabenh pulled that into GEOSgcm_GridComp develop yesterday and so I dutifully pulled it into release/MAPL-v3.
Looking at that PR, LAND had the big change:
https://github.com/GEOS-ESM/GEOSgcm_GridComp/pull/645/files#diff-5e760bd21e17fdf9982fbb56586586a302efcd3da3eeeaba1f1e5870f40b87be
which I'm guessing is related to the addition of MAPL_StateAddExportSpecFrmChld_all from #1683:
https://github.com/GEOS-ESM/MAPL/pull/1683/files#diff-2b2006ccb73b2d8c88ac8739a027952b42448a7eff5f98ed7a6c9e4e44b8ad93
Thing is, while MAPL_Generic.F90 is different from develop to release/MAPL-v3 it is not that different around that call!
For now I'll assign to @weiyuan-jiang (and myself) and I'll also cc @tclune and @atrayano as they are our MAPL3 gurus.

One possibility is the conflicted names because LAND add all the export form catchment. What is the name when getpointer crashes ?

Note: line numbers are a bit off because of other prints I added to that file.

I feel we can try to move up these two lines https://github.com/GEOS-ESM/GEOSgcm_GridComp/blob/49c5ca34f21c08b293ad261161451a78d2c1ae9e/GEOSagcm_GridComp/GEOSphysics_GridComp/GEOSsurface_GridComp/GEOSland_GridComp/GEOS_LandGridComp.F90#L332-L333
to line 193 right after addChild

Note that on MAPL3 GenericSetServices() is mostly a no-op.      The goal is to avoid the requirement that user gridcomps need to call phases of the generic layer.   This is mostly motivated by NUOPC compatibility, but it is good for other reasons.

But I am still confused why GEOSldas works

Well, maybe GEOSldas + MAPL3 wouldn't work? I mean, the MAPL2 GCM is happy, so it's something different in MAPL3 that this code is reacting to.

This has been "fixed" by Weiyuan by reverting to the old style of explicit addexport.


Move ad image props into image previews

This prevents the UI from having to handle edge cases for ad
images.
:eyeglasses: @ajacksified

:fish:

ff0eaf306b5f288f37b737bc278eb1c8b6ad8787


git-init: Setting submodules to false has no effect

Expected Behavior
When using a git resource, setting the submodules param to false passes -submodules false to cmd/git-init.
Actual Behavior
GitResource.GetInputTaskModifier does not inspect Submodules at all and does not generate the flag. Submodules are always initialized and fetched.
Steps to Reproduce the Problem

Use a git resource with params including {name: submodules, value: 'false'} in a TaskRun
Feast your eyes upon the generated Pod

Additional Info
#1531 changed git-init to fetch submodules. Making this configurable with a resource param was suggested in code review, but not completely implemented. Test_GitResource_GetDownloadTaskModifier was not updated to test the new param.
I discovered this while working on implementing #1450; I'll have a fix shortly.

Ohh :sweat:
/kind bug


after installing the zip file i extracted it and i open the new version the pop up says the system cannot perform this action

🧐 Have you read the FAQ and viewed similar issues?

[X] I have read the FAQ
[X] I have checked older issues, open and closed
[X] I did a clean install of SpotX as described in the FAQ

Сountry of your account
india
What is your Spotify Plan?
Free
Do you have Spicetify installed?
No
ℹ Computer information
- Spotify: Spotify for Windows (64 bit)
<IP_ADDRESS>2.g794acc0a
- Windows:Edition	Windows 10 Pro
Version	22H2
Installed on	27-09-2020
OS build	19045.3448
Experience	Windows Feature Experience Pack 1000.19044.1000.0

- PowerShell: 5.1.19041.3031

📝 Description

...
📸 Screenshots

Your PowerShell environment variable is broken, which is beyond Spotx support. You'll need to resolve this on your own or consult Google for assistance.
Additionally, you can run the script directly from the PowerShell terminal:

Press Win + R, then type "powershell"
Execute the following command:

[Net.ServicePointManager]::SecurityProtocol = 3072; iex "& { $(iwr -useb 'https://spotx-official.github.io/run.ps1') } -new_theme"


Provide WLS models using auxiliary image

The WLS offer provides WLS models by:

Building the basic model files into Application Image.
Specify model file for DB configuration with ConfigMap.

This issue is to refactor the offer, and provides WLS models using auxiliary image.
For more information, see https://oracle.github.io/weblogic-kubernetes-operator/managing-domains/model-in-image/auxiliary-images/

Auxiliary images are the recommended best approach for including Model in Image model files, application archive files, and the WebLogic Deploy Tooling installation, in your pods. This feature eliminates the need to provide these files in the image specified in domain.spec.image.

Hi @galiacheng, Reza and I discussed this. We do believe this is appropriate for investment in Dilithium. See https://dev.azure.com/weblogic-azure/Open Standard Enterprise Java (Java EE) on Azure/_workitems/edit/343 .


[1.11.2] Crash on game load

Well when loading the new update on my pack the game crashed. I tested the mod by itself and I didn't get the issue. I don't get if it's due to some mod incompatibility in the update or what, but here's the log: https://pastebin.com/qeJWrSGu

You need to reset your configs :)

Ik that's why i closed it. Didn't see that the first time I read the log, but a minute after I opened the issue I did. You should have mentioned it in the update log though.

You're right - I have now. I think I've found a fix though, so I'll get that up as soon as possible. The issue is that when I added new coolers, the size of the array of cooler stats changed, and so there was a mismatch between the size of the array in the config file and that of the defaults. What I'll do is check if the array sizes are the same, and if not, set the new members of the array in the file to the defaults automatically.