Possible bug in BukkitVersionHelperGeneric?

Hey there!
I was trying to get Dynmap to render a biome overview and noticed some of the new (mutated) ones were just being grey as if they weren't properly recognized. I've traced the possible error back to BukkitVersionHelperGeneric - biomebasearray does not seem to have been initialized at all - which prevented getPrivateField(...) from accessing the "biome" property of CraftChunkSnapshot.
I was able to fix this by going to line 111
/* CraftChunkSnapshot */
craftchunksnapshot = getOBCClass("org.bukkit.craftbukkit.CraftChunkSnapshot");
ccss_biome = getPrivateField(craftchunksnapshot, new String[] { "biome" }, biomebasearray);

and adding a few lines of code as follows
/* CraftChunkSnapshot */
craftchunksnapshot = getOBCClass("org.bukkit.craftbukkit.CraftChunkSnapshot");

Class<?> bbaseClass = getNMSClass("net.minecraft.server.BiomeBase");
biomebasearray = (java.lang.reflect.Array.newInstance(bbaseClass, 1)).getClass();

ccss_biome = getPrivateFieldNoFail(craftchunksnapshot, new String[] { "biome" }, biomebasearray);

Dunno, maybe you can use this information somehow which is why I thought I'd open a ticket here. (:
Regards,
Matthias

This issue was fixed here;
https://github.com/webbukkit/dynmap/commit/27dc1d4a0b2a3e0d1048af208f4716a431795c5b#diff-5dd7c8fbc414280997a95fa16a456bcd


Weather tiles are not correct

Checklist:

[X ] I updated to the latest version available
[X ] I cleared the cache of my browser
[X ] I installed using HACS (leave unchecked for manual installs)

Release with the issue:
2.1.1
Last working release (if known):
unknown
Browser and Operating System:
Seems to happen everywhere, all OS, all browsers
Card Config (click Show Code Editor and copy paste your config, remove a few of the least significant digits of your lat/lon to avoid posting you exact home address):
type: custom:weather-radar-card
card_title: Radar
data_source: RainViewer-TITAN
map_style: Dark
zoom_level: 10
center_latitude: 30.4
center_longitude: -97.7
extra_labels: true
square_map: false
show_range: false
show_playback: false
show_zoom: false
show_marker: true
show_scale: false
static_map: false
marker_latitude: 30.4
marker_longitude: -97.7
frame_count: 24
frame_delay: 100
Description of problem:
The radar does not seem to have anything to do with where I am. The map is correct, but weather radar is not aligned with the current or historic weather condition that I can correlate.
Javascript errors shown in the web inspector (if applicable):

Additional information:

This is a radar card for Australia, your coordinates are in the US so it is never going to work.


⚠ GreatPosterWall has degraded performance

In c688a06, GreatPosterWall ($GPW) experienced degraded performance:

HTTP code: 200
Response time: 1476 ms

Resolved: GreatPosterWall performance has improved in 5d05d0d.


.md jenga

Write everything .md

This shall never be over, therefore this is getting closed as this is not an issue, rather a part of the process of documentation while coding.


VMA - files not found for interface

Interface has been successfully retrieving files until beginning of April. Interface configuration has not changed, DAG says 0 files found. Regex is correct.
Interface - https://sul-libsys-airflow-prod.stanford.edu/vendor_management/interfaces/43
Should be retrieving the following -
-rw-r--r--    1 incabook   incabook        16334 Apr 10 09:41 ST26673.mrc
-rw-r--r--    1 incabook   incabook        16016 Apr 10 09:41 ST26674.mrc
-rw-r--r--    1 incabook   incabook        17279 Apr 10 09:41 ST26677.mrc
-rw-r--r--    1 incabook   incabook        16446 Apr 10 09:41 ST26678.mrc
-rw-r--r--    1 incabook   incabook        18469 Apr 24 15:36 ST26708.mrc
-rw-r--r--    1 incabook   incabook        18349 Apr 24 15:36 ST26709.mrc
-rw-r--r--    1 incabook   incabook        17779 Apr 24 15:36 ST26710.mrc

Looking at the Interface, I think the regular expression should be adjusted to ^Stanford/ST\d+.*\.mrc$, the "Stanford" directory is being prepended to the list of files so the regular expression is failing.

Is this a change on our end and therefore across all interfaces? If so, most of our regexes will now be wrong and I wonder if we can revert back to how it behaved previously?

I don't think it is across all of the interfaces but it may help to check those interfaces that have a Remote Path value to see they are working as expected with the regex.

I tried updating the interface with the suggested regex and got a download error.

@shelleydoljack found the following Stackoverflow answer that seems related to this ticket.


dest.on is not a function

TypeError: dest.on is not a function
    at DestroyableTransform.Readable.pipe (/Users/AJ/dev/bz/lifesgreatestquestion.com/node_modules/through2/node_modules/readable-stream/lib/_stream_readable.js:516:8)
    at Gulp.<anonymous> (/Users/AJ/dev/bz/lifesgreatestquestion.com/gulpfile.js:256:6)
    at module.exports (/Users/AJ/dev/bz/lifesgreatestquestion.com/node_modules/gulp/node_modules/orchestrator/lib/runTask.js:34:7)
    at Gulp.Orchestrator._runTask (/Users/AJ/dev/bz/lifesgreatestquestion.com/node_modules/gulp/node_modules/orchestrator/index.js:273:3)
    at Gulp.Orchestrator._runStep (/Users/AJ/dev/bz/lifesgreatestquestion.com/node_modules/gulp/node_modules/orchestrator/index.js:214:10)
    at Gulp.Orchestrator.start (/Users/AJ/dev/bz/lifesgreatestquestion.com/node_modules/gulp/node_modules/orchestrator/index.js:134:8)
    at /Users/AJ/npm/lib/node_modules/gulp/bin/gulp.js:129:20
    at doNTCallback0 (node.js:415:9)
    at process._tickCallback (node.js:344:13)
    at Function.Module.runMain (module.js:474:11)
    at startup (node.js:124:18)
    at node.js:959:3

using io.js 2.0.1

just missed the second set of parentheses in the function call, closing


Python extension loads very slowly: unresponsive

Environment data

VS Code version: 1.55.2
Extension version (available under the Extensions sidebar): v2021.3.680753044
OS and version: Mac 11.2.3
Python version (& distribution if applicable, e.g. Anaconda): 3.9.4
Type of virtual environment used (N/A | venv | virtualenv | conda | ...): N/A
Relevant/affected Python packages and their versions: N/A
Relevant/affected Python-related VS Code extensions and their versions: maybe Jupyter, v2021.5.745244803
Value of the python.languageServer setting:     "python.languageServer": "Pylance"

Expected behaviour
Very quick environment loading, no significant delays reported in the logs of the CPU profile (see below).
Actual behaviour
Such a long delay that I often see the pop up window saying that it is taking a long time to evaluate my environment.
Also, a log file is auto-generated showing that the python extension is often unresponsive.  The log file is attached.
ms-python.python-unresponsive.cpuprofile.txt
Steps to reproduce:

Launch VS Code with the extension installed.

Note:  I also have the following Python-adjacent extensions installed:

Jupyter
Pylance
Python Preview
Python Test Explorer

Logs
They are too large to paste, provided in file:
ms-python.python-unresponsive.cpuprofile.txt

I believe my issue is the same as issue 10704, but that got closed with no resolution, so I am recreating a new issue.

@lazarillo Please try insiders version of the extension, and see if it helps with this issue. You can always download and install latest insiders build form here https://pvsc.blob.core.windows.net/extension-builds/ms-python-insiders.vsix .
If you continue to have this issue with insiders version as well, then please share the contents of the Output > Python panel.

@karthiknadig thanks for the advice!
Is there a way to safely install a version that I do not trust.  (Ie, can I fully roll back to the non-insider version?)
I generally prefer not to be on the bleeding edge because I like to give the developers time to deal with any unforeseen bugs or security issues before I adopt.  :)    In other words, I would prefer VS Code launch to be slow than to install something that might crash due to unforeseen complications with my current set of extensions.

@lazarillo You can roll back to previous released version from the extension tab. It will give you a list of versions you can roll back to.

To safely install insiders (automatically), you could set this:

You can choose weekly or daily.
This step essentially does the same thing as installing from https://pvsc.blob.core.windows.net/extension-builds/ms-python-insiders.vsix . You can manually install it by using the VSIX file and "Install from VSIX" option that can be found here:

At any point to get off on the insiders, you can turn the above setting off. Or uninstall extension and install from the market place.

The "Install Another Version" is disabled for me

Because we have not heard back with the information we requested, we are closing this issue for now. If you are able to provide the info later on then we will be happy to re-open this issue to pick up where we left off.


CNI repair broken for non-restartable pods

When a job has restartPolicy=Never or low backoffLimit, CNI race repair may not work. This is because the pod will not just crashloop until its fixed, it will stop immediately.
This applies even to the new repairPods mode, not just label/delete pods mode, because even repairPods is triggered by the pod crashlooping.

Thinking about it, I guess this is not practically fixable except by adopting
https://github.com/istio/istio/pull/48818 / https://github.com/istio/istio/pull/49092
to entirely obviate the need for crash-based repair.

Now that the untaint controller is in I would actually advocate we drop this form of race repair entirely, and point people to the untaint controller instead.
Need to do a bit of work there still tho.


NIFI-4614: ManagedRangerAuthorizer: Wildcard policies

NIFI-4614:

Updating the types of resources that are filtered out for viewing purposes. Updates include resources with no values and resources that contain wildcards.

+1 verified wildcard policies are protected against and won't break the UI, will merge


Regression - date/time issue

Regression: after clean install and to try set time/date format: hh:mm:ss and date for Saturday, 08 april 2017 no long words effect in string.
Workaround: delete last "s" in ss (hh:mm:ss) and type s again then press OK and all to be OK.

I assume this is related to lumina-config -> General Options?
I need to know where to look to see what's going on.

Time/Date format for hh:mm:ss and ddd, dd MMMM yyyy Time first then Date will be set onle after delete last s in hh:mm:ss and type s again and press Save (OK) only from second time.

ok, thanks for reporting back. I'll see what I can come up with in testing.

I can confirm this behavior, but right now I'm not sure why the panel isn't updating.  I'll have to add in some debug functions and see if I can figure out what's going on.

It looks like the issue is that when save is clicked, the setting is being set, the clock widget is getting the signal, but something is failing at that point.  You can change anything else, click save again, and then the clock will update.  (enabling numlockx for example)  So it's the result of being able to click save again which finally kicks the plugin to repaint.
I dont see anything in the following that would account for this issue.
lumina/src-qt5/core-utils/lumina-config/pages/page_session_options.cpp
lumina/src-qt5/core/lumina-desktop/panel-plugins/clock/LClock.cpp

q5sys, this problem is a regression: in one of the previous version of Lumina date/time settings can be set correctly from the first time.

I understand its a regression. It's in your issue title. I wanted to check the code responsible for the actual implementation of the widget first and then work backwards over what's changed since it worked last.  My last post was a note in case someone else looked at it they could pick up from there.

Fixed!!
https://github.com/trueos/lumina/commit/58779ad78cf80423c8cf207fc72295b302fb2035


Handle ACCOUNT_ID_REQUIRED error and update some text

MaxMind is renaming "user ID" to "account ID" for basic auth as we roll out multi-user accounts. In doing this, we will be updating the error code returned by the service from USER_ID_REQUIRED to ACCOUNT_ID_REQUIRED. This PR supports both the new and old error code. It also updates some references to "user ID". It does not change change the accessor on Minfraud as I was not sure how you wanted to handle that.

Coverage remained the same at 98.347% when pulling f318da199a98547394138b123051c237d0747931 on oschwald:greg/account-id into 6b97c5d00dde8de3cebe0dbef9adbd8bc3933b87 on kushniryb:master.

Hello @oschwald
Thank you, this is great 👍
I suppose we'll go with user_id for now so that it's compatible with both versions.


fix: string comparisons instead of relying on booleans

Actually, I'm realizing this is just a different, more buggy version of solution-1. Not all boolean checks in this branch are using string comparisons


Feature/tag user component

A few things here, probably looks a bit bigger than it actually is due to moving things about. If you want me to split it up or walk through it give me a shout.
Mainly we've got a new TagUserForm component, similar to the MentionForm, but users are added in a more 'tagging' style, rather than @ing. Because of similarities between the two I've moved MentionsFormSearch out to a new UserSearch component, so both can use it, and made some cleanup in MentionsForm too!
There's a new button style, a new icon, and some global styling changes that were requested for placeholders, and the slight font-size.
One thing to note is there's a couple of timeouts in TagUserForm. I've had to add those in due to a timing issue that occurs if its placed inside a Dropdown.

 [Loop someone in] UI Components


fix issue with initial rendering of the TilesList

Q
A

Bug fix?
[X]

New feature?
[ ]

New sample?
[ ]

Related issues?
fixes #X, partially #Y, mentioned in #Z

What's in this Pull Request?
Resolves #1558 issue

@DMichev many thanks for this. Tested and everything seemed to work as expected


Provide mechanism to make socket IO operations be initiated on IO Thread

Is your feature request related to a problem? Please describe.
On Windows, when an async IO operation is initiated, the initiating thread owns the operation. If the thread is exited, any pending IO operations initiated on that thread are cancelled. When the .NET Threadpool is pruning idle threads from the thread pool, it checks to see if there's any pending IO outstanding that belongs to the thread and will wait for that IO to complete before pruning the thread. By calling receive on a random worker thread, you can potentially cause that thread to live a long time.
By calling the IO socket operation on an IO threadpool thread, you limit the threads being kept alive to IO threads which don't have the work queue issues that a large worker thread pool suffers from.
CoreWCF with it's NetTcp transport maintains an outstanding receive for each client which only completes when the client sends another request or our Receive timeout is hit. The default Receive timeout for WCF is 10 minutes although this can be set a lot higher. Under the right (or wrong depending on your viewpoint) conditions, this can cause the worker threadpool to be artificially larger than necessary.
A pure AspNetCore scenario which could be affected by this is an EventSource endpoint. The socket could be open for an extended period of time and the pending receive to detect the FIN/RST on the socket when the client is completed could cause extra threads to be kept alive.
Describe the solution you'd like
Because thread hopping is more expensive, this should be opt-in so only those affected would need to enable this. I don't have a preference for what the solution should look like.

@davidfowl - area?

@mconnew Do you have a scenario the demonstrates the impact of this scenario? We'll want a sample handy when we go investigate

I don't have a scenario at the moment as I haven't started to perf test CoreWCF yet. Because this depends on which thread the pending receive was issued from, and that's going to be random, getting a repro using asp.net core is going to be hard. Any sample showing the behavior would be artificial and done with raw sockets and full control of what executes where completely outside of aspnetcore.


[Bug] docker build streampark cannot find flinkhome path

What problem does this PR solve?
Issue Number: close #xxx
Problem Summary:
What is changed and how it works?
Proposal: xxx
Feel free to ping committers for the review!
Contribution Checklist

Make sure that the pull request corresponds to a GITHUB issue.

Name the pull request in the form "[Feature] [component] Title of the pull request", where Feature can be replaced by Hotfix, Bug, etc.

Minor fixes should be named following this pattern: [hotfix] [docs] Fix typo in README.md doc.

Purpose of this pull request

Docker-related pr needs to be fully test

Thank you for your contribution. I will review it later

@MonsterChenzhuo   At present, there are some problems when docker-compose deploys the streampark service.
For example, the path of mysql's final.sql has changed. Can you optimize it together ?

@MonsterChenzhuo sql ddl has  changed, see: https://github.com/apache/incubator-streampark/pull/1696


Write flag for prefixed length

It's a basic implementation for #21424 . However I haven't figured out how to add a test case for it. Could you share some guide if you think the feature is ok?
@vjpai

Do you have any profiling data to suggest that this would be valuable?

@vjpai sorry for late, I was busy on some other things last week.
I have some profiling results.
I'm working with grpc-rs, which is a rust front end of gRPC, based on grpc core (APIs like grpc_call_start_batch). And grpc-rs API is based on futures, which is a rust asynchronous framework. My benchmark case is client sends 10k messages to server in a duplex streaming call, and retrieves 10k responses. My client code looks like
let (tx, rx) = futures::sync::mpsc::channel(1024); // create a channel with capacity 1024.
thread::spawn(move || generate_messages_and_send_to(tx)); // create a thread to generate messages.
let client = GrpcCreateClient(); // connect to grpc server.
let (sender, receiver) = client.call_duplex_streaming(); // create a duplex streaming call.
thread::spawn(move || sender.send_all(rx)); // forward messages from `rx` to `sender`.
thread::spawn(move || handle_responses(receiver)); // handle responses.

The key is sender.send_all(rx). Currently for every message comes from rx, sender will call grpc_call_start_batch to send it, which means it sends out a HTTP/2 frame with only 1 chunk.
This behavior involves many system calls, and hurts performance.  Here is a result comparing grpc-rs and tower-grpc:

QPS 35K(grpc-rs) V.S. 180K(tower-grpc)
Network Traffic 2.7M(grpc-rs) V.S. 518K(tower-grpc)

We can see the obvious difference. It's because tower-grpc can merge upstream messages and then send them in one HTTP/2 frame, which reduces syscall times and network traffic.
So I want the feature so that I can merge messages and then call grpc_call_start_batch to send them in one batch.

Could you take a look again? @vjpai


Chinese text not grabbed by text extractor

Microsoft PowerToys version
0.62.1
Running as admin

[X] Yes

Area(s) with issue?
TextExtractor
Steps to reproduce
I tried this with Chinese text, but it was not recognized
✔ Expected Behavior
That any unicode character would be recognized
❌ Actual Behavior
blur text:
VIJtä±GlA
IL-. Ilkä, ä—e. fäfätissue1102
Chinese translation.txt
Other Software
No response

@BruMaz0 thank you for report. Could you please run next commands in admin powershell and send us the output:
PS C:\Windows\system32> $null = [Windows.Media.Ocr.OcrEngine,                Windows.Foundation,      ContentType = WindowsRuntime]
PS C:\Windows\system32> [Windows.Media.Ocr.OcrEngine]::AvailableRecognizerLanguages

When selecting the area, please make sure that input language matches to the language needs to be recognized.
/needinfo

@taras-janea
Oops, I have exactly the same issue. He didn't reply, so I did the experiment in powershell instead of him. Here are the results:
Name  : Language.OCR~~~ar-SA~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~bg-BG~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~bs-LATN-BA~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~cs-CZ~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~da-DK~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~de-DE~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~el-GR~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~en-GB~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~en-US~<IP_ADDRESS>
State : Installed

Name  : Language.OCR~~~es-ES~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~es-MX~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~fi-FI~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~fr-CA~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~fr-FR~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~hr-HR~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~hu-HU~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~it-IT~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~ja-JP~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~ko-KR~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~nb-NO~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~nl-NL~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~pl-PL~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~pt-BR~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~pt-PT~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~ro-RO~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~ru-RU~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~sk-SK~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~sl-SI~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~sr-CYRL-RS~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~sr-LATN-RS~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~sv-SE~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~tr-TR~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~zh-CN~<IP_ADDRESS>
State : Installed

Name  : Language.OCR~~~zh-HK~<IP_ADDRESS>
State : NotPresent

Name  : Language.OCR~~~zh-TW~<IP_ADDRESS>
State : NotPresent

All except zh-cn display is "NotPresent". Um, I don't know what these means, do they explain anything?

Hi BruMaz0, this problem has been bothering me for a long time. Now I finally know why. Let me share it with you.
This is because when you press "win+shift+T" to activate TextExtractor, the current input method is not Chinese.
For example, my default input mode is the US keyboard, so I can't use this function before, and I can't find the reason. If you want to recognize Chinese, just switch the current input method to Chinese.
Good luck.

Hi i'm having the same problem. I have all OCR packs for chinese (cn, tw, hk) installed but text extractor can't seem to grab even clear black text on white backgrounds, it only works if the keyboard is set to chinese.
I don't think it makes sense that it only works when the chinese keyboard is on, this is not really good user experience and the requirement isn't even mentioned anywhere. Please mention this on text extractor's page in powertoys at least, and please make it work regardless of the selected keyboard.


⚠ BeyondHD has degraded performance

In 19828a4, BeyondHD ($BHD) experienced degraded performance:

HTTP code: 200
Response time: 2733 ms

Resolved: BeyondHD performance has improved in cb19ad9 after 6 minutes.


rustfmt adds a trailing comma to struct-like macro

For example, in 0.3.8-nightly (346238f 2018-02-04)
Input
test!(RunPassPretty {
    path: "src/test/run-pass/pretty",
    mode: "pretty",
    suite: "run-pass",
    default: false,
    host: true
});

Output
test!(RunPassPretty {
    path: "src/test/run-pass/pretty",
    mode: "pretty",
    suite: "run-pass",
    default: false,
    host: true,
});

Diff
test!(RunPassPretty {
    path: "src/test/run-pass/pretty",
    mode: "pretty",
    suite: "run-pass",
    default: false,
-    host: true
+    host: true,
});

(https://github.com/rust-lang/rust/blob/c83fa5d91c3b16459ab7b87c48ed18bd059a23af/src/bootstrap/test.rs#L719-L725)
This will break the code.

We use struct_lit_formatting to control how to format struct literals:
https://github.com/rust-lang-nursery/rustfmt/blob/eea5dcac4661877dc5e1921eb201102c903f21e6/rustfmt-core/src/lists.rs#L747-L771
We need to pass true to force_no_trailing_comma if we are inside macro and there is no trailing comma in the original source code. I think we can check the presence of the trailing comma by using methods of SnippetProvider.


add type annotation to onLocationChange

This is from my project's code snippet. You can use it as a starting point. Public domain license.
type NiiVueLocationValue = {
  id: string;
  mm: Float32Array;
  name: string;
  value: number;
  vox: [number, number, number];
};

@thangngoc89 this is a good start. Here is a screenshot of the structure:

Therefore, I think the full description is:
type NiiVueLocationValue = {
  id: string;
  mm: Float32Array;
  name: string;
  value: number;
  vox: [number, number, number];
};
type NiiVueLocation = {
  axcorsag: number;
  frac: Float32Array;
  mm: Float32Array;
  string: string;
  values: NiiVueLocationValue[];
  vox: Float32Array;
  xy: [number, number];
};

At first inspection, the fact that vox and mm are reported for both the main structure and separately for each layer. However, it is worth noting that all overlays are resliced to match the resolution and field-of-view of the background image. Therefore, due to interpolation, rotation and zoom, the overlays are often different from the background image.


pdf-converter-table-role.rb error

Firstly, thank you for this truly amazing software! It's so flexible, customizable, and has quickly become an integral part of my workflow!  I've begun messing about with custom themes and want to try using the pdf-converter-table-role.rb script to be able to pass some custom table settings. This is the command I ended up needing to use to get the script to register with the asciidoctor-pdf backend.
asciidoctor --trace -a pdf-theme=./resources/themes/first-theme.yml -a compress -r asciidoctor-pdf -r ./resources/themes/pdf-converter-table-role.rb -b pdf "$(SOURCE_ADOC)" -o "$@"
This is my entire theme so far:
extends: default-with-font-fallbacks
base:
  font-color: #000000
  font_size_min: 7
role:
  <table>:
    normaltable:
      font-size: 12
heading:
  h2-text-align: center
table:
  header-cell:
    background-color: #f0f0f0
  font-size: 8

The command throws me this error:
undefined method `start_with?' for :font_catalog:Symbol
I haven't set "Symbol" in fonts, or messed with setting any custom fonts yet, so I believe this to be some kind of bug.
Thanks in advance for the help!

Thanks for the compliment and support! That means a lot.
The problem is with how you are invoking Asciidoctor PDF. Typically, we recommend using the provided asciidoctor-pdf command. If you prefer to use the asciidoctor command, then you need to require asciidoctor/pdf in the require script (since it won't already be loaded).
require 'asciidoctor/pdf'

class PDFConverterTableRole < (Asciidoctor::Converter.for 'pdf')
  register_for 'pdf'

  # ...
end

Also, ensure you are using Asciidoctor PDF 2.

The command throws me this error: undefined method `start_with?' for :font_catalog:Symbol

Please turn on --trace and share the full error so that we can see where in the source this is happening.

I think I may understand what's happening. In Ruby < 2.7, Symbol did not support the start_with? method. Each key in the theme is a Symbol. The first key is typically font_catalog. This is where the extended converter assumes it can call start_with? on the key:
unless (role_entries = theme.each_pair.select {|name, val| name.start_with? key_prefix }).empty?

I can update the example to coerce the name to a String for portability.

In the future, can you ask questions about usage in the project chat? See https://docs.asciidoctor.org/about/support/#chat for details.
I'm still interested to know which combination of software you were using to produce this error. I can't find a combination that would produce the same error, even though I understand why it is happening.

Thank you for such a quick reply! I was able to get it working after amending the script then changing the relative parts of my theme to this:
role:
  <table>:
    normaltable:
      font-size: 12
    smalltable:
      font-size: 8

I removed the standard table entry and the custom roles started working like a gem. I should note I'm using in nested tables (which the docs already mention should be used sparingly 😵)  and I think there's some funny business going on in nested tables regarding font sizes, but this clears it up nicely!
In the future I'll direct my questions to the chat first!

That's great!
Could you still let me know which version of Ruby you are using?

Forgot to mention I'm on macOS, it's probably an exorbitantly outdated version!
ruby 2.6.8p205 (2021-07-07 revision 67951) [universal.x86_64-darwin21]

Exactly what I needed to know. Thanks! That confirms why you were getting
this error. But no need to worry anymore as the code is now portable.


accept=".txt" in dropbox markup does not work

I want to let the user only upload *.txt files. Whatever tpye of file I am dragging, there will always be the accept-class (= "dragover") with a green border but NEVER the reject-class (= "dragover-err"). Does anybody see the error?
Drop pdfs or images here or click to upload
I adapted the sample fiddle with my dropbox markup:
http://jsfiddle.net/nmdcwf3w/166/

You have defined drag-over-class twice and only the first one will be considered.


Bulk Updates - Fix test case "Removal of field"

Fix failing test case:
https://docs.google.com/spreadsheets/d/1hf6k7EUw5_l3mZEHVMi-iRZTRtCFyTDS1rOcIXNHBpo/edit#gid=0
@gabsie this is the known bug of bulk updates about the removal of fields

closing as this is duplicate of #437


INSTINCT for white box LLM

Hello, thanks for your nice work and I really learned a lot from your paper.
I have a question, INSTINCT is designed for black box LLM like chatGPT.
If I have an open-source LLM of size 6~7B, and I have some data to tune it myself, I wonder if the performance of INSTINCT would be the same as (or surpass) those methods based on gradients, such as p-tuning as mentioned in your paper (page 2 line 2).

Thank you for your interest in our paper. Our INSTINCT algorithm is designed for the black-box model setting, where access to the model's weights is not possible. Our goal is to identify the best instruction with as few queries to the black-box model as possible, aiming for query efficiency. In scenarios where the LLM is a white-box model, thus not constrained by a query budget, our INSTINCT algorithm (a global optimization algorithm) theoretically could outperform gradient-based approaches (local optimization algorithms) given an unlimited query budget. However, empirically, the query budget is never unlimited, as we typically run a fixed number of iterations. Therefore, we cannot conclusively determine whether our approach performs better than gradient-based methods empirically, as we have not conducted experiments in those settings. Please let me know if you have any further questions.

Thanks for your kind reply.
Can I say INSTINCT is theoretically better than gradient-based methods because INSTINCT can be tuned directly on validation set, and if given sufficient steps for exploration it can always achieve a best prompt. However those gradient-based methods are trained on training set, yet there is always a domain gap between training and test set, so the prompt would not be a perfect one for validation.

INSTINCT uses the neural bandits algorithm, which is a global optimization algorithm. In other words, the neural bandits algorithm provides a theoretical guarantee that as the number of iterations approaches infinity, the best function value found will converge to the global optimum. In contrast, gradient descent approaches only guarantee convergence to a local optimum. In this sense, the neural bandits algorithm is superior to gradient-based approaches theoretically.

I see. Thank you for your clear and helpful explanation.


[Service Fabric] Application Upload does not honor certificat settings

Description
I am using the Azure CLI 2.0 on MacOS to connect to a secured Azure Service Fabric Cluster (self signed certificate). The connection and some commands work just fine but the application upload command seems to not honor the certificate settings from the cluster selection.
Is there a way to add the —no-verify flag to other commands or to add the certificate to the python certificate store?

————————
Cluster select
————————
$ az sf cluster select --endpoint https://XXX.cloudapp.azure.com:19080 --no-verify --key key --cert crt

————————
Successful commands
————————
$ az sf cluster manifest
/Users/norbert/lib/azure-cli/lib/python2.7/site-packages/urllib3/connectionpool.py:852: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
  InsecureRequestWarning)
{
  "manifest": „<ClusterManifest …..
}

$ az sf cluster health
/Users/norbert/lib/azure-cli/lib/python2.7/site-packages/urllib3/connectionpool.py:852: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
  InsecureRequestWarning)
{
  "aggregatedHealthState": "Ok",
  "applicationHealthStates": [
    {
      "aggregatedHealthState": "Ok",
      "name": "fabric:/System"
    }
  ],….
}

$ az sf application list
/Users/norbert/lib/azure-cli/lib/python2.7/site-packages/urllib3/connectionpool.py:852: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
  InsecureRequestWarning)
{
  "continuationToken": "",
  "items": []
}

————————
Unsuccessful command
————————
$ az sf application upload --path . --show-progress --debug
Command arguments ['sf', 'application', 'upload', '--path', '.', '--show-progress']
Current cloud config:
{'endpoints': {'active_directory': 'https://login.microsoftonline.com',
               'active_directory_data_lake_resource_id': 'https://datalake.azure.net/',
               'active_directory_graph_resource_id': 'https://graph.windows.net/',
               'active_directory_resource_id': 'https://management.core.windows.net/',
               'batch_resource_id': 'https://batch.core.windows.net/',
               'gallery': 'https://gallery.azure.com/',
               'management': 'https://management.core.windows.net/',
               'resource_manager': 'https://management.azure.com/',
               'sql_management': 'https://management.core.windows.net:8443/',
               'vm_image_alias_doc': 'https://raw.githubusercontent.com/Azure/azure-rest-api-specs/master/arm-compute/quickstart-templates/aliases.json'},
 'is_active': True,
 'name': 'AzureCloud',
 'profile': 'latest',
 'suffixes': {'azure_datalake_analytics_catalog_and_job_endpoint': 'azuredatalakeanalytics.net',
              'azure_datalake_store_file_system_endpoint': 'azuredatalakestore.net',
              'keyvault_dns': '.vault.azure.net',
              'sql_server_hostname': '.database.windows.net',
              'storage_endpoint': 'core.windows.net'}}
Registered application event handler 'CommandTableParams.Loaded' at <function add_id_parameters at 0x10bb708c0>
Registered application event handler 'CommandTable.Loaded' at <function add_id_parameters at 0x10bb708c0>
Successfully loaded command table from module 'sf'.
Application event 'CommandTable.Loaded' with event data {'command_table': {'sf application upload': <azure.cli.core.commands.CliCommand object at 0x10bb48e50>}}
Application event 'CommandParser.Loaded' with event data {'parser': AzCliCommandParser(prog='az', usage=None, description=None, version=None, formatter_class=<class 'argparse.HelpFormatter'>, conflict_handler='error', add_help=True)}
Application event 'CommandTableParams.Loaded' with event data {'command_table': {'sf application upload': <azure.cli.core.commands.CliCommand object at 0x10bb48e50>}}
Application event 'CommandParser.Parsing' with event data {'argv': ['sf', 'application', 'upload', '--path', '.', '--show-progress']}
Application event 'CommandParser.Parsed' with event data {'args': Namespace(_command_package='sf', _jmespath_query=None, _log_verbosity_debug=False, _log_verbosity_verbose=False, _output_format='json', _parser=AzCliCommandParser(prog='az sf application upload', usage=None, description='Copies a Service Fabric application package to the image store.  The cmdlet copies a Service Fabric application package to the image store. After copying the application package, use the sf application provision cmdlet to register the application type.  Can option [...]
urllib3.connectionpool : Starting new HTTPS connection (1): XXX.cloudapp.azure.com
("bad handshake: Error([('SSL routines', 'tls_process_server_certificate', 'certificate verify failed')],)",)
Traceback (most recent call last):
  File "/Users/norbert/lib/azure-cli/lib/python2.7/site-packages/azure/cli/main.py", line 36, in main
    cmd_result = APPLICATION.execute(args)
  File "/Users/norbert/lib/azure-cli/lib/python2.7/site-packages/azure/cli/core/application.py", line 211, in execute
    result = expanded_arg.func(params)
  File "/Users/norbert/lib/azure-cli/lib/python2.7/site-packages/azure/cli/core/commands/__init__.py", line 351, in __call__
    return self.handler(*args, **kwargs)
  File "/Users/norbert/lib/azure-cli/lib/python2.7/site-packages/azure/cli/core/commands/__init__.py", line 550, in _execute_command
    reraise(*sys.exc_info())
  File "/Users/norbert/lib/azure-cli/lib/python2.7/site-packages/azure/cli/core/commands/__init__.py", line 527, in _execute_command
    result = op(client, **kwargs) if client else op(**kwargs)
  File "/Users/norbert/lib/azure-cli/lib/python2.7/site-packages/azure/cli/command_modules/sf/custom.py", line 238, in sf_upload_app
    verify=ca_cert)
  File "/Users/norbert/lib/azure-cli/lib/python2.7/site-packages/requests/api.py", line 126, in put
    return request('put', url, data=data, **kwargs)
  File "/Users/norbert/lib/azure-cli/lib/python2.7/site-packages/requests/api.py", line 58, in request
    return session.request(method=method, url=url, **kwargs)
  File "/Users/norbert/lib/azure-cli/lib/python2.7/site-packages/requests/sessions.py", line 502, in request
    resp = self.send(prep, **send_kwargs)
  File "/Users/norbert/lib/azure-cli/lib/python2.7/site-packages/requests/sessions.py", line 612, in send
    r = adapter.send(request, **kwargs)
  File "/Users/norbert/lib/azure-cli/lib/python2.7/site-packages/requests/adapters.py", line 490, in send
    raise ConnectionError(err, request=request)
ConnectionError: ("bad handshake: Error([('SSL routines', 'tls_process_server_certificate', 'certificate verify failed')],)",)

Environment summary
Install Method: How did you install the CLI? (e.g. pip, interactive script, apt-get, Docker, MSI, nightly)
Via curl with the default settings/paths
CLI Version: What version of the CLI and modules are installed? (Use az --version)
$ az --version

azure-cli (2.0.10)
acr (2.0.8)
acs (2.0.10)
appservice (0.1.10)
batch (3.0.3)
billing (0.1.3)
cdn (0.0.6)
cloud (2.0.6)
cognitiveservices (0.1.6)
command-modules-nspkg (2.0.1)
component (2.0.6)
configure (2.0.10)
consumption (0.1.3)
core (2.0.11)
cosmosdb (0.1.10)
dla (0.0.10)
dls (0.0.10)
feedback (2.0.6)
find (0.2.6)
interactive (0.3.6)
iot (0.1.9)
keyvault (2.0.8)
lab (0.0.8)
monitor (0.0.8)
network (2.0.10)
nspkg (3.0.1)
profile (2.0.8)
rdbms (0.0.5)
redis (0.2.7)
resource (2.0.10)
role (2.0.8)
sf (1.0.5)
sql (2.0.7)
storage (2.0.10)
vm (2.0.10)

Python (Darwin) 2.7.13 (default, Apr  4 2017, 08:47:57)
[GCC 4.2.1 Compatible Apple LLVM 8.1.0 (clang-802.0.38)]

OS Version: What OS and version are you using?
macOS Sierra 10.12.5
Shell Type: What shell are you using? (e.g. bash, cmd.exe, Bash on Windows)
zsh

I had a look at the code and created a small fix. It works for my case but surely needs a review if it fits the overall architecture.

Thanks for reporting and fixing this @bertschneider, do you want to create a PR for this so you get contribute credit, or would you rather we take your fix?

I already created PR #4077 with the fix. Feel free to merge it or take the code in some other way.
Beware that I didn't (had no time to) check all the other commands if they honor the flag.


Skip windows CI while investigating

Summary

The component installation script stopped working which lead to some "component not found" build error, skipping Windows build and test steps for now to unblock other check-ins while investigating.
Test Plan

Compatibility

OS
Implemented

iOS
✅❌

Android
✅❌

Checklist

[ ] I have tested this on a device and a simulator
[ ] I added the documentation in README.md
[ ] I mentioned this change in CHANGELOG.md
[ ] I updated the typed files (TS and Flow)
[ ] I added a sample use of the API in the example project (example/App.js)

@jamonholmgren the component installation script exited without any error, but seems like the install failed for some reason, I haven't figured out exactly why yet.
But RNW upgraded to v142 build tools (which comes with the build server by default) since 0.62, so once we merge in #1364, the CI loop should work again. And I'll just remove the extra installation step after merging.

@kaiguo I'm thinking I'll just merge #1364 tonight, so this PR won't be necessary. Thanks for doing it, though!


when a power cut issue happens when transaction running , in steve still its showing in charging and active transaction

how to resolve power cut happens , device should show un-available , it should disappear from active transaction .
can you explain how to resolve it?

@matth-x PLEASE RESPOND for this issue

Sorry that your issue remained unanswered. I'm closing this assuming it's no longer relevant.


When titleComponent returns falsy, it shouldn't be rendered in the sidebar.

In theme.config.tsx:
    sidebar: {
        titleComponent({ title, type, route }) {
            if (type === 'separator') {
                return {title};
            }
            if (route.startsWith('/nonposts')) {
                return null;
            }
            return <>{title}</>;
        },
        defaultMenuCollapseLevel: 1,
        toggleButton: true,
    },

This results in an empty expander to be rendered, when nothing should be rendered for routes that start with /nonposts.
I'm trying to use this as a way to control which .md and .mdx files get included in the sidebar. Is there a better way?

I wanted to do it in a dynamic way, to enable custom filtering, for example.

Hey guys I have a question, why in this case my router of menu bar does not work when the separator is up
{
"--": {
"title": "separator",
"type": "separator"
},
"knowledge": "Knowledge Base",
"aem_technology": "AEM Technology",
"technical_integration": "Technical Integration",
"software_control_safety_certification": "Software, Control, Safety, and Certification"
}


Update wiki.py

I have no Idea if the bot has a wiki page for Hiya so i made one Just in case

Do we have any particular reason to add the landing page? We already have a command that links to every page under hiyaCFW. The landing page doesn't really say much to begin with.

Closing as PR maintainer has committed existn't.


Jupyter data viewer - export to excel.

With jupyter data viewer, i want to be able to easily export to excel.

We closed this issue because we don't plan to address it in the foreseeable future. If you disagree and feel that this issue is crucial: we are happy to listen and to reconsider.
If you wonder what we are up to, please see our roadmap and issue reporting guidelines.
Thanks for your understanding, and happy coding!

It should at least be possible to copy the content at least.. Now its only possible to screenshot...


✨ [Feature request]: New UI For the Play Cards

Is your feature request related to a problem? Please describe.
The current UI for the play cards section exhibits significant visual deficiencies and alignment inconsistencies. The design lacks aesthetic appeal, with colors, fonts, and spacing choices failing to engage users effectively. Alignment issues further detract from the user experience, leading to confusion and difficulty in navigating the content. Improving the UI and alignment of the play cards section is essential to enhance user engagement and streamline interaction. By refining the layout, optimizing spacing, and selecting more suitable visual elements, we can ensure a more intuitive and visually pleasing experience for our users.

Describe the solution you'd like.
I Created New UI For this I hope you will like the UI

Describe alternatives you've considered.
Please Give the Feedback So i can Make more useful contribution
Screenshot / Screenshare
No response
Additional context
No response
Record

[X] I have checked the existing issues
[X] I have read the Contributing Guidelines
[X] I want to work on this issue

Code of Conduct

[X] I agree to follow this project's Code of Conduct

I already created an issue for the wrong image size https://github.com/reactplay/react-play/issues/1447
we need to change the UI a little bit if you want to work on it you can

But i am not able to push the code I don't know why
remote: Permission to reactplay/react-play.git denied to Akshaygore1.
fatal: unable to access 'https://github.com/reactplay/react-play.git/': The requested URL returned error: 403
this error is coming

I already created an issue for the wrong image size #1447
we need to change the UI a little bit if you want to work on it you can

what should i change can you suggest

But i am not able to push the code I don't know why remote: Permission to reactplay/react-play.git denied to Akshaygore1. fatal: unable to access 'https://github.com/reactplay/react-play.git/': The requested URL returned error: 403
this error is coming

you've to fork the repo & clone the fork repo

I already created an issue for the wrong image size #1447
we need to change the UI a little bit if you want to work on it you can

what should i change can you suggest

add some padding to the inside of the card but avoid changing the hover color of the tech stack.

https://github.com/reactplay/react-play/pull/1461


Port to singularity

Gregory Kurtzer of Singularity is interested in hearing about the progress on this.

It could also make an interesting paper perhaps: pros/cons of singularity dev env vs docker.


Being able to use lg custom functions on condition expressions

Is your feature request related to a problem? Please describe.
BotFramework Composer
v2.0
SDK 4.8.0
Many times we need to validate data with a complex and very long lg expressions. We can create this lg expressions as an lg templates that can be break down in an other templates/functions for an easy mantain of that expressions.
But, when we need to use that lg custom templates on a condition, we can’t.
Composer Editor tell as that the expressions on conditions can be only memory vars or pre-built functions.
Describe the solution you'd like
I would like to use my custom lg template/function in a condition like that:
common.lg      # validateID(text)    - length(text)==9 && isMatch(text, ‘[0-9]{9}’)
Condition: ${validateID(turn.activity.text)}
Describe alternatives you've considered
Additional context

Tracked via Microsoft/BotBuilder-Dotnet#3652


Provide borrow_FIELD_mut as an unsafe method

Is it possible to provide borrow_FIELD_mut, provided sufficient documentation on its memory safety constraints? The current documentation does not explain under what circumstances would it be unsound to return the mutable reference directly.

@joshua-maros Maybe you can provide a bit deeper explaination on this unsoundness? I imagine one of the problems is swapping the contents of mutable reference with something else, however maybe this can be done by returning Pin<&mut T>?

Let's say I have a field data: &'this str. The point of a function returning &mut &'this str would be to replace the inner reference with some other reference. But, it is impossible to express the'this lifetime to Rust's borrow checker. The solution employed internally by Ouroboros is to replace 'this with 'static and provide safe wrappers that abstract away this detail. If this were to be exposed, it would be easy to create a reference to dropped data:
#[self_referencing]
struct SelfRef {
    base: String,
    data: &'this str,
}
fn invalid_static_ref() -> &'static str {
    let self_ref = SelfRef::new("Drop Me".to_owned(), |base_ref| base_ref);
    *self_ref.borrow_data_mut()
}

So, maybe we should employ the trick that makes borrow_FIELD work, replacing the 'this lifetime with the lifetime of the self reference used in the method call. But since mutable references are invariant, this would also be unsound:
fn print_invalid_ref() {
    let self_ref = SelfRef::new("Unused".to_owned(), |base_ref| base_ref);
    let new_str = "This will be dropped too early".to_owned();
    'temp: {
        let data: &mut &'temp str = self_ref.borrow_data_mut();
        // Valid, new_str outlives 'temp.
        *data = &new_str;
    }
    drop(new_str);
    println!("{:?}", self_ref.get_data());
}

In general, the property of "invariance" that mutable references have dictates that any lifetimes that appear inside them must be exactly unchanged from their original values. Since Ouroboros is designed to fake a lifetime that Rust cannot express, it is impossible to return a mutable reference referring to types with the appropriate lifetimes. Given this limitation, it is my understanding that the with_mut and with_FIELD_mut methods cover all safe use cases.

Consider code like this:
struct BorrowedStringTable<'b> {
    /// The arena to store the characters in.
    arena: &'b bumpalo::Bump,

    /// Used to have efficient lookup by index, and to provide an
    /// [Iterator] over the strings.
    vec: Vec<&'b str>,

    /// Used to have efficient lookup by [&str].
    map: HashMap<&'b str, size_t>,
}

#[self_referencing]
struct StringTableCell {
    owner: bumpalo::Bump,

    #[borrows(owner)]
    #[covariant]
    dependent: BorrowedStringTable<'this>,
}

I want to write a clear() method, which basically calls dependent.map.clear(), dependent.vec.clear(), and owner.reset(). I know it's unsafe, but it's sound. I think the issue is basically asking... can we make something available for these cases, with some documentation about what can or cannot be done?

There's a much better way to do what you're asking:
impl StringTableCell {
    pub fn clear(&mut self) {
        *self = Self::new();
    }
}

It also safeguards against adding future things and forgetting to clear them in the clear method.

This is not viable for me. I need to do more work than was posted here after the resets have occurred, so I can't use an empty arena. This means new allocations which definitely goes against the purpose of why I'm adding a clear method in the first place.

If you need to keep the arena, you could do it with something like this (which is effectively what would be required in vanilla Rust to do something similar):
impl StringTableCell {
    pub fn cleared(self) -> Self {
        let mut arena = self.into_heads().owner;
        arena.clear();
        Self::new(arena, BorrowedStringTable::new)
    }
}

If this is still not acceptable, you would need to use unsafe code, even in the equivalent vanilla Rust scenario. If you really need what you're saying, I'm worried how the surrounding code is structured that that one allocation is a significant performance hit. It feels like being concerned about bounds checking - the vast majority of the time, it's not actually a serious problem, and trying to solve it by diving into unsafe code can end up putting your application in a worse spot than just accepting the tiny performance hit. And if the performance hit isn't tiny, there's probably something you can do to fix that.
My main concern with making a borrow_FIELD_mut method is that it lets you mess up the internals of the struct in any way that regular unsafe code can. It's effectively a switch that says "even though I'm using this library, I'd like to erase all guarantees the library provides me." You would have to keep track of as many guarantees as if you wrote your own unsafe wrapper from scratch. Providing a method connotates that there's something the library is taking care of for you, when in reality it's providing you total control over the internals of the struct. If you need total control, there's not really a point to using an existing library.

My original motivation for borrow_FIELD_mut was to implement something similar to lock_api::ArcMutexGuard:
#[self_referencing]
struct MappedArcMutexGuard<T> {
    owned: Arc<Mutex<T>>,
    #[borrows(mut owned)]
    guard: MappedMutexGuard<'this, RawLock, T>,
}

In this case, guard is only meaningful to use when it is borrowed mutably.
It seems the only soundness issue mentioned above is when I swap the &mut MappedMutexGuard<'this, RawLock, T> to something else that does not reference owned?

Is with_FIELD_mut not acceptable for your use case?

The issue was created one year ago and I have since refactored my code to avoid using lock_arc, so I can't remember the details of my original use case, but I suppose there were indeed difficulties with using the with style.

ArcMutexGuard implements DerefMut, which is, if I understand correctly, currently impossible to replicate with the current API (safe or unsafe). Having an unsafe (but provably sound depending on the types involved) way to reach API-parity could be beneficial.


ports 2 and 3 on mega

How can I use serial ports 2  or 3 on mega 2560?  I only see documentation and notes for switching to port1.

The ports 2 and 3 for mega2560 has not been implemented - but it should be easy to do.
The port specific defines are in the file DMXSerial_avr.h and more ports can be added here by adding definitions.
Maybe you create a pull request for this ?

Port 0 and Port 1 work currently with your software?
Sent from Yahoo Mail on Android
On Mon, Jan 10, 2022 at 4:29 AM, Matthias @.***> wrote:
The ports 2 and 3 for mega2560 has not been implemented - but it should be easy to do.
The port specific defines are in the file DMXSerial_avr.h and more ports can be added here by adding definitions.
Maybe you create a pull request for this ?
—
Reply to this email directly, view it on GitHub, or unsubscribe.
Triage notifications on the go with GitHub Mobile for iOS or Android.
You are receiving this because you authored the thread.Message ID: @.***>

So I am having enabling the "DMX_USE_PORT1" feature.  I would like to use the default or port 0 for serial monitoring the arduino mega 2560, and use port1 uart for the DMX receiver.    I have uncommented out the section in the DMXSerial_avr.h and to use_port1, and have added the line in my little program  #define DMX_USE_PORT1, but I still get the following errors
HardwareSerial0.cpp.o (symbol from plugin): In function Serial': (.text+0x0): multiple definition of __vector_25'
C:\Users\Jason\AppData\Local\Temp\arduino_build_806647\libraries\DMXSerial\DMXSerial.cpp.o (symbol from plugin):(.text+0x0): first defined here
HardwareSerial0.cpp.o (symbol from plugin): In function Serial': (.text+0x0): multiple definition of __vector_26'
C:\Users\Jason\AppData\Local\Temp\arduino_build_806647\libraries\DMXSerial\DMXSerial.cpp.o (symbol from plugin):(.text+0x0): first defined here
collect2.exe: error: ld returned 1 exit status
Using library DMXSerial at version 1.5.2 in folder: C:\src\libraries\DMXSerial
exit status 1
Error compiling for board Arduino Mega or Mega 2560.

I just checked by the following steps:
(read documentation in https://github.com/mathertel/DmxSerial)

Open the example DmxSerialRecv.ino with Arduino IDE.
Change processor to “Arduino Mega or Mega 2560”
add  Serial.begin(57600); in setup()
add Serial.println("DMXBOX_TestLED");in setup()
.
Open the file  DMXSerial_avr.h in the libraries / DMXSerial / src folder.
uncomment line # 33 to activate the definition #define DMX_USE_PORT1
.
Verify the Sketch – it must compile without the errors above.

Please verify that this works for you as well.

Ok I did exactly that.. followed your instructions and I got the same error.
HardwareSerial0.cpp.o (symbol from plugin): In function Serial':(.text+0x0): multiple definition of __vector_25'C:\Users\Jason\AppData\Local\Temp\arduino_build_658739\libraries\DMXSerial\DMXSerial.cpp.o (symbol from plugin):(.text+0x0): first defined hereHardwareSerial0.cpp.o (symbol from plugin): In function Serial':(.text+0x0): multiple definition of __vector_26'C:\Users\Jason\AppData\Local\Temp\arduino_build_658739\libraries\DMXSerial\DMXSerial.cpp.o (symbol from plugin):(.text+0x0): first defined herecollect2.exe: error: ld returned 1 exit statusUsing library DMXSerial at version 1.5.2 in folder: C:\homeassistant\esphome projects\homeenerymonitor-heatpump\EmonESP-master\EmonESP-master\src\libraries\DMXSerial exit status 1Error compiling for board Arduino Mega or Mega 2560.
 DmxSerialRecv.ino: Sample DMX application for retrieving 3 DMX values:// address 1 (red) -> PWM Port 9// address 2 (green) -> PWM Port 6// address 3 (blue) -> PWM Port 5// // Copyright (c) 2011-2015 by Matthias Hertel, http://www.mathertel.de// This work is licensed under a BSD style license. See http://www.mathertel.de/License.aspx// // Documentation and samples are available at http://www.mathertel.de/Arduino// 25.07.2011 creation of the DmxSerial library.// 10.09.2011 fully control the serial hardware register//            without using the Arduino Serial (HardwareSerial) class to avoid ISR implementation conflicts.// 01.12.2011 include file and extension changed to work with the Arduino 1.0 environment// 28.12.2011 changed to channels 1..3 (RGB) for compatibility with the DmxSerialSend sample.// 10.05.2012 added some lines to loop to show how to fall back to a default color when no data was received since some time.// - - - - -
#include <DMXSerial.h>
// Constants for demo program
const int RedPin =    9;  // PWM output pin for Red Light.const int GreenPin =  6;  // PWM output pin for Green Light.const int BluePin =   5;  // PWM output pin for Blue Light.
#define RedDefaultLevel   100#define GreenDefaultLevel 200#define BlueDefaultLevel  255
void setup () {  DMXSerial.init(DMXReceiver);  Serial.begin(57600);  Serial.println("dmx text rx");    // set some default values  DMXSerial.write(1, 80);  DMXSerial.write(2, 0);  DMXSerial.write(3, 0);    // enable pwm outputs  pinMode(RedPin,   OUTPUT); // sets the digital pin as output  pinMode(GreenPin, OUTPUT);  pinMode(BluePin,  OUTPUT);}
void loop() {  // Calculate how long no data backet was received  unsigned long lastPacket = DMXSerial.noDataSince();    if (lastPacket < 5000) {    // read recent DMX values and set pwm levels     analogWrite(RedPin,   DMXSerial.read(1));    analogWrite(GreenPin, DMXSerial.read(2));    analogWrite(BluePin,  DMXSerial.read(3));
  } else {    // Show pure red color, when no data was received since 5 seconds or more.    analogWrite(RedPin,   RedDefaultLevel);    analogWrite(GreenPin, GreenDefaultLevel);    analogWrite(BluePin,  BlueDefaultLevel);  } // if}
// End.
and I edited the avr file as so
// For using the serial port 1 on a Arduino MEGA 2560 board, enable the following DMX_USE_PORT1 definition.#define DMX_USE_PORT1
On Thursday, January 13, 2022, 12:29:45 AM PST, Matthias Hertel<EMAIL_ADDRESS>wrote:

I just checked by the following steps:
(read documentation in https://github.com/mathertel/DmxSerial)

Open the example DmxSerialRecv.ino with Arduino IDE.
Change processor to “Arduino Mega or Mega 2560”
add Serial.begin(57600); in setup()
add Serial.println("DMXBOX_TestLED");in setup()
.
Open the file DMXSerial_avr.h in the libraries / DMXSerial / src folder.
uncomment line # 33 to activate the definition #define DMX_USE_PORT1
.
Verify the Sketch – it must compile without the errors above.

Please verify that this works for you as well.
—
Reply to this email directly, view it on GitHub, or unsubscribe.
Triage notifications on the go with GitHub Mobile for iOS or Android.
You are receiving this because you authored the thread.Message ID: @.***>

The #define USART0_RX_vect	_VECTOR(25) is still used by the DMXSerial library so the uncomment of #define PORT1 in the file C:\homeassistant\esphome projects\homeenerymonitor-heatpump\EmonESP-master\EmonESP-master\src\libraries\DMXSerial\src\DMXSerial_avr.h is not in effect. Please check this file.
The #define USART1_RX_vect	_VECTOR(36) must be used to assign USARTn_RX_vect
#define USARTn_RX_vect USART1_RX_vect

im confused, the define port1 is COMMENTED out.. so its not in effect.  I can delete it.  But I dont understand what you want me to do.
On Thursday, January 13, 2022, 09:40:25 AM PST, Matthias Hertel @.***> wrote:
The #define USART0_RX_vect _VECTOR(25) is still used by the DMXSerial library so the uncomment of #define PORT1 in the file C:\homeassistant\esphome projects\homeenerymonitor-heatpump\EmonESP-master\EmonESP-master\src\libraries\DMXSerial\src\DMXSerial_avr.h is not in effect. Please check this file.
The #define USART1_RX_vect _VECTOR(36) must be used to assign USARTn_RX_vect
#define USARTn_RX_vect USART1_RX_vect
—
Reply to this email directly, view it on GitHub, or unsubscribe.
Triage notifications on the go with GitHub Mobile for iOS or Android.
You are receiving this because you authored the thread.Message ID: @.***>

I did that, and I get the same error as before.
jason
On Thursday, January 13, 2022, 11:43:26 AM PST, Matthias Hertel @.***> wrote:
Line #33 must look like this:
// For using the serial port 1 on a Arduino MEGA 2560 board, enable the following DMX_USE_PORT1 definition.
#define DMX_USE_PORT1
—
Reply to this email directly, view it on GitHub, or unsubscribe.
Triage notifications on the go with GitHub Mobile for iOS or Android.
You are receiving this because you authored the thread.Message ID: @.***>

Maybe we should share screens for some minutes.
Send me an invite to ma email address directly.
You can find on https://www.mathertel.de/impressum.aspx

found the right file to uncomment the PORT1 directive....


More models?

It seems the caffe version has more models that provide more quality savings (such as upresnet10), but theyre not present on ncnn version, would be hard to implement it?

I don't know about on implementing them in the binary itself, but see #37 for how to load them yourself.

I don't know about on implementing them in the binary itself, but see #37 for how to load them yourself.

its not really clear about "how to port/convert" them in the link you just shared, could you be more specific?


Fix issue #4819: [Bug]: Logs are not printed out in headless command line mode

This pull request fixes #4819.
The issue has been successfully resolved. The AI agent implemented the requested functionality by:
Automatic fix generated by OpenHands 🙌

To run this PR locally, use the following command:
docker run -it --rm   -p 3000:3000   -v /var/run/docker.sock:/var/run/docker.sock   --add-host host.docker.internal:host-gateway   -e SANDBOX_RUNTIME_CONTAINER_IMAGE=docker.all-hands.dev/all-hands-ai/runtime:a17d066-nikolaik   --name openhands-app-a17d066   docker.all-hands.dev/all-hands-ai/openhands:a17d066

Seems like something is broken here. Would be good to get some eyes if this is going to provide value to the user.

Sorry, I'm slow on this but I'll finish it.


reattach-to-user-namespace still necessary?

@joshuaclayton @christoomey I saw some clipboard changes with a recent version of Tmux:
https://github.com/joshuaclayton/dotfiles/commit/3c852eab9540b5e56cdcedd0aff1a07db085c48a
Do y'all know if we can remove reattach-to-user-namespace from Laptop at this point?

Ah, looks like reattach-to-user-namespace is still used there.
What do those lines do, though? We don't have them in https://github.com/thoughtbot/dotfiles/blob/master/tmux.conf @geoffharcourt

The changes to the -T variants are related to changes made to the key binding system in tmux 2.4 I believe. My understanding is the reattach-to-user-namespace is related to OS level stuff, so it would be independent from this change.
We'll likely need to update the dotfiles, although we'll need to support both 2.4+ syntax and older bind -t syntax. This code block from tmux yank has an example of how this could work.

I think I see: these lines are just for yanking from Vim into the clipboard?
unbind -T copy-mode-vi Enter
bind-key -T copy-mode-vi Enter send -X copy-pipe-and-cancel "reattach-to-user-namespace pbcopy"

So only necessary for folks using Vim inside Tmux who want to copy without using their mouse.
Installing reattach-to-user-namespace in Laptop as we have it allows for mouse copying inside Tmux.

Almost, @croaky. The two conf lines you listed above are to enable Tmux to copy to the system clipboard from within Tmux copy-mode (prefix-[): When in Tmux copy-mode, make pressing Enter pipe the selection (if any) to the command reattach-to-user-namespace pbcopy and cancel out of copy-mode.
As far as I know, reattach-to-user-namespace is (again) necessary as of macOS 10.12, but reattach-to-user-namespace won‘t do anything without being explicitly configured (and thoughtbot/dotfiles currently make no reference to it.)
In addition to the above conf for Tmux copy-mode, my dotfiles use the following to copy/paste from/to the macOS system clipboard from Tmux+Vim:
set -g default-command "reattach-to-user-namespace -l ${SHELL}"

I’m probably stating the obvious (especially to MacVim users!), but system clipboard integration is super useful. Using Vim motions and text objects instead of mousing selections is a win, and it‘s essential to me for multi-line copy (to avoid copying line numbers or adjacent splits/panes).
But, wow: thanks @christoomey for pointing out tmux-yank! I recently spent way too much time getting Tmux+Vim and macOS system clipboard integration working, and the whole experience left me wanting for some canonical source that tracks this moving target—maybe the tmux-yank plugin is the answer.

Okay, thanks for the explanations everyone! Going to close this and leave reattach-to-user-namespace in Laptop. @geoffharcourt wonder if https://github.com/tmux-plugins/tmux-yank should be added to Dotfiles?

@croaky I like this idea!

I've had tmux-yank in my Dotfiles for about a month and am happy with it.

There is this issue with sourcing via if-shell which at least for me is not solved: https://github.com/tmux-plugins/tpm/issues/59


Convert to TypeScript

[ ] Convert source files to TypeScript
[ ] Publish TypeScript types
[ ] Keep Flow types

@necolas here is my understanding of requirements

Convert src files into .ts
Have .d.ts mapped in package.json for types

for 3rd can you elaborate ? is it that you want styleq.flow.js file to be as it is?


Is it possible to add border to image?

Summary
Is it possible to add some predefined border to image that gets uploaded?

I don't know exactly what you want. Can you elaborate more? Do you want to make it like a frame decoration?

I don't know exactly what you want. Can you elaborate more? Do you want to make it like a frame decoration?

yes, I mean frame decoration.


[FLINK-5990][table]Add event time OVER ROWS BETWEEN x PRECEDING aggre…

…gation to SQL.
Thanks for contributing to Apache Flink. Before you open your pull request, please take the following check list into consideration.
If your changes take all of the items into account, feel free to open your pull request. For more information and/or questions please refer to the How To Contribute guide.
In addition to going through the list, please provide a meaningful description of your changes.

[×] General

The pull request references the related JIRA issue ("[FLINK-5990] Add event time OVER ROWS BETWEEN x PRECEDING aggregation to SQL")
The pull request addresses only one issue
Each commit in the PR has a meaningful commit message (including the JIRA id)

[ ] Documentation

Documentation has been added for new functionality
Old documentation affected by the pull request has been updated
JavaDoc for public methods has been added

[×] Tests & Build

Functionality added by the pull request is covered by tests
mvn clean verify has been executed successfully locally or a Travis build has passed

Hi @sunjincheng121, thanks for this PR.
To be honest, I don't completely understand the implementation of the RowsClauseBoundedOverProcessFunction.
I thought about another design, that I would like to discuss (not considering process time which should be addressed in a separate ProcessFunction, IMO.):

we have three state objects: 1) the accumulator row, 2) a MapState[Long, List[Row]] for not processed data (toProcess), 3) a MapState[Long, List[Row]] for processed data which needs to be retracted (toRetract).
processElement() puts the element in the toProcess MapState with the original timestamp and registers a timer for currentWatermark() + 1. Hence, we only have a single timer which triggers when the next watermark is reached.
onTimer() is called for the next watermark. We get an iterator over the toProcess MapState. For RocksDB the iterator is sorted on the key. We sort-insert the records from the iterator into a LinkedList (since the iterator is sorted for RocksDB this will be simple append. For other state backends it will be more expensive but we can tolerate that, IMO).  We do the same for toRetract MapState. So we have two sorted lists for data to accumulate and to retract. We go over both sorted lists and accumulate and retract for each step using the accumulator state. Then we emit the new row and move the emitted row from the toProcess MapState to the toRetract MapState.

This design has the benefit of using RocksDB to sort. Moreover, we could also put only those fields into the toRetract state that need to be retracted instead of the full row.
What do you think about this approach?
Thanks, Fabian

Hi, @fhueske Thanks for your attention to the PR. Today I'll proposal the design doc and link here.
Best,
SunJIncheng

Hi, @fhueske  When I want to write a design document, I compare the different between your proposed design and the current program I propose. I finally decided to explain this directly in Jira instead of another design doc. If I understand you correctly, the differences of our design are as follows:
-  Regard to the state:

[ ] 1) the accumulator row -> accumulatorState (we are the same)
[ ] 2) a MapState[Long, List[Row]] -> （I did not use this, as I mentioned below, we do not a sorted map for accumulate, so it can share the same state (In my case, I just use one dataState) )
[ ] 3) a MapState[Long, List[Row]] -> (we are the same)

-  About core processing logic：

[ ] processElement:

Check if the data is late.

Register timer

[ ] onTimer:

toRectract -> retract (we are the same)

toProcess -> accumlate (we are the same)

-  About sorting with mapState:

toProcess -> accumlate (Do not need to sort)
toRectract -> retract (Need to sort) The purpose of sorting in retract is to find expired data, such as for a  2 proceding over window case, the dataState is (0-> row, 1-> row, 2-> row, 3-> row), When handling element 3  we need find the element 0 and retract it.

If the backend state is RocksDB and the key is Long type, then luckily the data is sorted by key ensured by RocksDB. But if we use other backend, it may not be sorted, such as (heapBackend). So the existing MapState key sorting has some limitations, unless we implement a sortedMapState. This semantics can ensure that any backend are ordered. So my current design uses traversal dataState.keys to find the smallest one for retraction.
- About register timer:
I would like to use the timestamp to register timer. For example for (7L, 7, "Hello") I use 7 to register timer. IMO, we should not use currentWatermark + 1 to register timer, as the currentWatermark can not be representing the "event time" of each data. If we explicitly use currentWatermark + 1, there will be problems. For instance, two data with different event time could be arrival at same time. Then we will get the same register timer (because we have not updated currentWatermark). So eventually, these two data will different event time will be emitted at the same time, which is unexpected.
FYI, examples (using my design) are as follows:
（Refer to: testBoundPartitionedEventTimeWindowWithRowWithLateEvent）

Sql:
   SELECT +c, a, sum(a) OVER (PARTITION BY c ORDER BY RowTime() ROWS BETWEEN 2 preceding AND CURRENT ROW) from T1

TestData:

    val data = List(
      (1L, 1, "Hello"),
      (2L, 2, "Hello"),
      (4L, 4, "Hello"),
      (3L, 3, "Hello"),
      (7L, 7, "Hello"),
      (8L, 8, "Hello World"),
      (7L, 8, "Hello"),
      (5L, 5, "Hello"),
      (20L, 20, "Hello World"),
      (9L, 9, "Hello World"))

WaterMark:

      (1L, 1, "Hello") -> -1
      (2L, 2, "Hello") -> 0
      (4L, 4, "Hello") -> 2
      (3L, 3, "Hello") -> 1
      (7L, 7, "Hello") -> 5
      (8L, 8, "Hello World") -> 6
      (7L, 8, "Hello") -> 5
      (5L, 5, "Hello") -> 3
      (20L, 20, "Hello World") -> 18
      (9L, 9, "Hello World")) -> 7

Print info in processElement  and onTimer:

process_ts_lastTs_wm:[1][0][-9223372036854775808]
process_ts_lastTs_wm:[2][0][-1]
process_ts_lastTs_wm:[4][0][0]
====>ontime_ts_wm_triggerTs_lastRow:[1][2][null][null]
====>ontime_ts_wm_triggerTs_lastRow:[2][2][1][null]
process_ts_lastTs_wm:[3][2][2]
process_ts_lastTs_wm:[7][2][2]
====>ontime_ts_wm_triggerTs_lastRow:[3][5][2][null]
====>ontime_ts_wm_triggerTs_lastRow:[4][5][3][(1,Hello)]
process_ts_lastTs_wm:[8][0][5]
process_ts_lastTs_wm:[7][4][6]
<<late_ts_lastTs_wm:[5][4][6]
process_ts_lastTs_wm:[20][0][6]
====>ontime_ts_wm_triggerTs_lastRow:[7][18][4][(2,Hello)]
====>ontime_ts_wm_triggerTs_lastRow:[7][18][4][(3,Hello)]
====>ontime_ts_wm_triggerTs_lastRow:[8][18][null][null]
<<late_ts_lastTs_wm:[9][8][18]
====>ontime_ts_wm_triggerTs_lastRow:[20][9223372036854775807][8][null]

BTW, I updated the code, had separated the proc-time and event-time in to two classes.
I am trying to make a detailed description, but I do not know if it is clear enough, feel free to feedback me if there is anything not clear.
Thanks,
SunJincheng

Hi @fhueske, in our point of view, register timer should be correlated to the event time of the CURRENT data, but not currentWaterMark (which is correlated to the event time of the PREVIOUS datas) . Using the PREVIOUS event time (currentWatermark + 1) to register the timer for CURRENT data may cause some problems IMO. I do not have whole lots of counterexamples for now, just intuitively think this is not the correct way. One example I have is:
Data line -> ...               5   7 4   3   2
Watermark line -> ...  5    4      3   2 1
In this case, assuming when watermark is 3，we get 4 and 7, then we use  currentWatermark + 1 to register timer timer(3+1) for both 4 and 7. When watermark goes to 4，timer timer(3+1) be triggered (then 4 and 7 will be emitted). After this, data 5 comes (while the watermark is still 4), then we register timer timer(4+1) for 5. This is incorrect, as we should always ensure data 5 is triggered before data 7. I run a test case, and printed the results of [event time][currentWatermark] as below. I hope it can help to explain my point.
Datas:
(1L, 1, "Hello"),
(2L, 2, "Hello"),
(4L, 4, "Hello"),
(3L, 3, "Hello"),
(5L, 3, "Hello"),
(7L, 7, "Hello"),
(6L, 7, "Hello"),
(8L, 8, "Hello World"),
(7L, 8, "Hello"),
(5L, 5, "Hello"),
(20L, 20, "Hello World"),
(9L, 9, "Hello World"))

Event time of each data & Watermark: (newTS_currentWM[event time][currentWatermark])
newTS_currentWM[1][-9223372036854775808]
newTS_currentWM[2][-1]
newTS_currentWM[4][0]
newTS_currentWM[3][2]
newTS_currentWM[5][2]
newTS_currentWM[7][3] // a data with event time 7, it will be registered timer to (3+1)
newTS_currentWM[6][5] // a data with event time 6, it will be registered timer to (5+1)
newTS_currentWM[8][5]
newTS_currentWM[7][6]
newTS_currentWM[5][6]
newTS_currentWM[20][6]
newTS_currentWM[9][18]

Another important reason of using allowedLateness to configure the watermark in my design is that, in our point of view, watermark is a semantics which is correlated to the stream lateness SLA. User exactly knows the tuple of (SLA, allowedLateness). For instance:

A system which always ensure the order:
SLA(100%) = Watermark(eventTime)

For flink system process out of order data, and user have different watermarks indicating different SLA levels:
(SLA, allowedLateness) = Watermark(eventTime - allowedLateness)
(SLA(80%), 0) = Watermark(eventTime)
(SLA(90%), 2)  = Watermark(eventTime - 2)
(SLA(95%), 5)  = Watermark(eventTime - 5)
We want to keep the interface to let user configure the allowedLateness(AssignerWithPeriodicWatermarks|AssignerWithPunctuatedWatermarks), thereby the correlated SLA.
What do you think ?
Thanks,
SunJincheng

I think you can do exactly the same with both approaches, but a single timer has the benefit of reduced overhead. If you have records (id, ts)
(1, 1), (2, 2), (3, 5), WM 4, (4, 7), (5, 10), (6, 6), WM 8

Using timestamp timers would result in
processElement((1,1))
processElement((2,2))
processElement((3,5))
onTimer(1)
onTimer(2)
processElement((4,7))
processElement((5,10))
processElement((6,6))
onTimer(5)
onTimer(6)
onTimer(7)

Where onTimer(1) and onTimer(2) (or onTimer(5), onTimer(6), and onTimer(7)) could share the access to the MapState
Using a single watermark timer we would have
processElement((1,1))
processElement((2,2))
processElement((3,5))
onTimer(_) // emit all records with ts < current watermark (= 4): (1,1) and (2,2)
processElement((4,7))
processElement((5,10))
processElement((6,6))
onTimer(_) // emit all records with ts < current watermark (= 8): (3,5), (6,6), (4,7)

Since we can check against the current watermark also in this case, we can avoid to emit records too early. It should also be possible integrate an allowed lateness parameter into this approach in the future.
The benefit of processing multiple rows (for different timestamps) by a single onTimer() call is that we can iterate the list of Long keys just once.

Hi @fhueske I had updated the PR. and move the processing time OVER ROWS BETWEEN x PRECEDING part(RowsClauseProcessingBoundedOverProcessFunction) to Here
Thanks,
SunJincheng

Hi, @fhueske  thanks a lot for your suggestions. And most of the comments make sense for me. I had updated the PR. There is one thing I'am not sure. About implementation of the SourceFunction. So please pay attention on it. Feel free to feedback me If it's incorrect.
Thanks,
SunJincheng


[WIP DO NOT MERGE] Fix VR bootstrapping/connection state in KVM

Description

After PR #3278 there was some changes on the channels. this does not seem like the problem. if we look to the VR XML file we see the following. the qemu guest agent must be the problem because the state of the VR is "disconnected".

   <channel type='unix'>
     <source mode='bind' path='/var/lib/libvirt/qemu/r-1750-VM.org.qemu.guest_agent.0'/>
     <target type='virtio' name='org.qemu.guest_agent.0' state='disconnected'/>
     <alias name='channel0'/>
     <address type='virtio-serial' controller='0' bus='0' port='1'/>
   </channel>

after investigation of the bootstrap process i think i found this problem. there is no startup from the qemu-guest-agent. we need them in connected state for the patch.sh script.

the problems seems to be the startup of the "qemu-guest-agent". since this is not an really systemd service more than an sysvinit. the service will be started with "systemctl enable --now qemu-guest agent". this will be redirected to systemd-sysv-install. normally "--now" should enable and start the service. i think with this redirection to systemd-sysv-install there is no option for the startup.

last one is to capture the error from the module load kvm pci hotplug

Use actually master, build a SystemVM and try to deploy them

Types of changes

[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] New feature (non-breaking change which adds functionality)
[x] Bug fix (non-breaking change which fixes an issue)
[ ] Enhancement (improves an existing feature and functionality)
[ ] Cleanup (Code refactoring and cleanup, that may add test cases)

Screenshots (if appropriate):
How Has This Been Tested?

@blueorangutan package

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@svenvogel is this work in progress or ready for review?

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-188

@blueorangutan test

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@rhtyd yes its ready. there is nothing from me. :)

Trillian test result (tid-228)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 41063 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3524-t228-kvm-centos7.zip
Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Intermittent failure detected: /marvin/tests/smoke/test_hostha_kvm.py
Smoke tests completed. 75 look OK, 2 have error(s)
Only failed tests results shown below:

Test
Result
Time (s)
Test File

test_04_rvpc_privategw_static_routes
Failure
971.62
test_privategw_acl.py

test_hostha_enable_ha_when_host_in_maintenance
Error
304.77
test_hostha_kvm.py

@blueorangutan test

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

Tests lgtm. Can you review @shwstppr @anuragaw @borisstoyanov

Trillian test result (tid-232)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 30143 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3524-t232-kvm-centos7.zip
Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
Smoke tests completed. 76 look OK, 1 have error(s)
Only failed tests results shown below:

Test
Result
Time (s)
Test File

test_04_rvpc_internallb_haproxy_stats_on_all_interfaces
Error
201.78
test_internal_lb.py

Tests LGTM


Update comeinon dependency from 0.2.2 to 0.4.

Changes since 0.2.2:

Updated pbkdf2_sha512 to prevent users from calling hashpass without a salt.
Updated bcrypt to version 1.5.2.
Added configuration options for number of log_rounds, or rounds.

:+1:


python312Packages.triton build failure on x86_64-linux as of 13bb3040

Issue description
Build of python312Packages.triton failed on x86_64-linux as of 13bb3040aebb54bb116f2450eba78afa6ecaaffb. This is currently breaking python3Packages.torch-bin.
error: builder for '/nix/store/p49mxpdb58j2vzjr9f4kk1jhjv8h7yxm-python3.12-triton-3.1.0.drv' failed with exit code 1;
       last 10 log lines:
       > checking for references to /build/ in /nix/store/3pgvjqnl5c5wxzxppy8p3xpcp2kb3j79-python3.12-triton-3.1.0...
       > patching script interpreter paths in /nix/store/3pgvjqnl5c5wxzxppy8p3xpcp2kb3j79-python3.12-triton-3.1.0
       > shrinking RPATHs of ELF executables and libraries in /nix/store/5pi24hh71yafcxdvfzggviw018j2yshl-python3.12-triton-3.1.0-dist
       > checking for references to /build/ in /nix/store/5pi24hh71yafcxdvfzggviw018j2yshl-python3.12-triton-3.1.0-dist...
       > patching script interpreter paths in /nix/store/5pi24hh71yafcxdvfzggviw018j2yshl-python3.12-triton-3.1.0-dist
       > Rewriting #!/nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 to #!/nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6
       > wrapping `/nix/store/3pgvjqnl5c5wxzxppy8p3xpcp2kb3j79-python3.12-triton-3.1.0/bin/proton'...
       > Rewriting #!/nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 to #!/nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6
       > wrapping `/nix/store/3pgvjqnl5c5wxzxppy8p3xpcp2kb3j79-python3.12-triton-3.1.0/bin/proton-viewer'...
       > chmod: cannot access '/nix/store/3pgvjqnl5c5wxzxppy8p3xpcp2kb3j79-python3.12-triton-3.1.0/lib/python3.12/site-packages/triton/third_party/cuda/bin/ptxas': No such file or directory
       For full logs, run 'nix log /nix/store/p49mxpdb58j2vzjr9f4kk1jhjv8h7yxm-python3.12-triton-3.1.0.drv'.
error: 1 dependencies of derivation '/nix/store/d61p8x24ddvj42bac0sqcxxqylpvrcsc-python3.12-torch-2.4.1.drv' failed to build

full build log
python3Packages.torch-bin maintainers cc: @junjihashimoto
python312Packages.triton maintainers cc: @SomeoneSerge @Madouura @derdennisop
Other cc: n/a
Steps to reproduce

Checkout nixpkgs at commit 13bb3040aebb54bb116f2450eba78afa6ecaaffb
Run nix-build -A python312Packages.triton

Technical details
 - system: `"x86_64-linux"`
 - host os: `Linux 6.5.0-1025-azure, Ubuntu, 22.04.5 LTS (Jammy Jellyfish), nobuild`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.16.1`
 - nixpkgs: `/nix/store/h5x7dvrz3gg20m1bh4dx333g1vvqsagp-source`

Contents of ~/.config/nixpkgs/config.nix:
{ allowUnfree = true; cudaSupport = true; cudaCapabilities = ["8.0"]; }

Misc.
This issue was automatically generated by nixpkgs-upkeep.

CI workflow that created this issue.
Internal tags:<PHONE_NUMBER>962779645 -3613853086660875134

❯ nom build -f "<nixpkgs>" -I "nixpkgs=https://github.com/NixOS/nixpkgs/archive/master.tar.gz" --arg config "{ config.cudaSupport = true; config.allowUnfree = true; }" --print-out-paths python3Packages.triton
/nix/store/m68xm8gyf282m79hf1phl6z4n6bz4xgd-python3.12-triton-3.1.0

Huh, this doesn't look like a timeout or OOM error -- I wonder what's wrong. I can close if it's not a concern for others.

stderr: chmod: cannot access '/nix/store/3pgvjqnl5c5wxzxppy8p3xpcp2kb3j79-python3.12-triton-3.1.0/lib/python3.12/site-packages/triton/third_party/cuda/bin/ptxas': No such file or directory
yeah this error is the cause of it. @SomeoneSerge do you know how we can fix it?

I have the same issue with nixpkgs at revision 2768c7d042a37de65bb1b5b3268fc987e534c49d.
I tried inspecting the torch-bin derivation works, but I do not understand how triton is resolved in it:
Building python triton succeeds (version 3.1.0):
nix build nixpkgs#python312Packages.triton
# Produces /nix/store/m68xm8gyf282m79hf1phl6z4n6bz4xgd-python3.12-triton-3.1.0

However building torch-bin fails with the same error as above:
NIXPKGS_ALLOW_UNFREE=1 nix build nixpkgs#python312Packages.torch-bin --impure
# The error comes from derivation /nix/store/p49mxpdb58j2vzjr9f4kk1jhjv8h7yxm-python3.12-triton-3.1.0.drv

I am a nixpkgs beginner, I don't really know how torch-bin alters the triton build config, here are pastebins of nix derivation show for these 2 derivations which seem to show some differences when diffing the 2:
Working /nix/store/m68xm8gyf282m79hf1phl6z4n6bz4xgd-python3.12-triton-3.1.0
Broken /nix/store/p49mxpdb58j2vzjr9f4kk1jhjv8h7yxm-python3.12-triton-3.1.0

I took a quick look at this. torch-bin by default is using python312Packages.triton-bin for its triton dependency, rather than the from-source python312Packages.triton (see here: https://github.com/NixOS/nixpkgs/blob/master/pkgs/top-level/python-packages.nix#L15803). If you build python312Packages.triton-bin you'll see the same error.
I pushed a potential fix here: https://github.com/NixOS/nixpkgs/pull/351627 but I expect it's not correct as-is (see PR comments).

Thanks for picking up the triton-bin issue.
The original issue (about the source build of triton) doesn't seem to be reproducible or maybe was specific to that concrete revision, I don't think it's worth the time to find out which
❯ git pull
...
Updating 6422c786dd51..23664a7358c5
Fast-forward
...
❯ nom build .#python3Packages.triton --print-out-paths
Finished at 11:30:20 after 0s
/nix/store/m68xm8gyf282m79hf1phl6z4n6bz4xgd-python3.12-triton-3.1.0
❯ nom build -f "<nixpkgs>" --arg config "{ cudaSupport = true; allowUnfree = true; }" python3Packages.triton --print-out-paths
Finished at 11:31:22 after 0s
/nix/store/0acx76pmmk9zlrp9dfcsrir7q0gv6i6b-python3.12-triton-2.1.0
❯ git show HEAD
commit 23664a7358c599dd4f975f16cea0865bf423e83d (HEAD -> master, nixos/master, nixos/HEAD)
Merge: 3de6ab6d99de 2f5d739cfeb6
Author: Stig<EMAIL_ADDRESS>Date:   Sun Oct 27 10:41:34 2024 +0000

    perlPackages.AppSqitch: 1.4.0 -> 1.4.1 (#351171)


fix(module:popconfirm): fix icon disappear when nzTitle is a TemplateRef instance

PR Checklist
Please check if your PR fulfills the following requirements:

[x] The commit message follows our guidelines: https://github.com/NG-ZORRO/ng-zorro-antd/blob/master/CONTRIBUTING.md#commit
[ ] Tests for the changes have been added (for bug fixes / features)
[ ] Docs have been added / updated (for bug fixes / features)

PR Type
What kind of change does this PR introduce?

[x] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Build related changes
[ ] CI related changes
[ ] Documentation content changes
[ ] Application (the showcase website) / infrastructure changes
[ ] Other... Please describe:

What is the current behavior?
Icon disappears when nzTitle is a TemplateRef instance.
Issue Number: N/A
What is the new behavior?
Icon won't disappear when nzTitle is a TemplateRef instance.
Does this PR introduce a breaking change?
[ ] Yes
[x] No

Other information

Hi @WOOOFEI ,
thanks for your pr
but this is not a bug, it provides the chance to rewrite the icon.

I'm handling with #2196, shall I add this change to that branch or just stay the same?

@WOOOFEI This would introduce breaking changes. Maybe we should fix it later.


目标检测模型PicoDet在使用add_negative_samples添加负样本后报错

目标检测模型PicoDet在使用add_negative_samples添加负样本后，训练报错
输出报错：
Process Process-1:
Traceback (most recent call last):
  File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap
    self.run()
  File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/multiprocessing/process.py", line 99, in run
    self._target(*self._args, **self._kwargs)
  File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/dataloader/worker.py", line 355, in _worker_loop
    six.reraise(*sys.exc_info())
  File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/six.py", line 719, in reraise
    raise value
  File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/dataloader/worker.py", line 345, in _worker_loop
    for b in batch
  File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/dataloader/worker.py", line 345, in <listcomp>
    for b in batch
RuntimeError: (Unavailable) Memory map failed when create shared memory.
  [Hint: Expected ptr != ((void *) -1), but received ptr:0xffffffffffffffff == ((void *) -1):0xffffffffffffffff.] (at /paddle/paddle/fluid/memory/allocation/mmap_allocator.cc:81)

Process Process-2:
Traceback (most recent call last):
  File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap
    self.run()
  File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/multiprocessing/process.py", line 99, in run
    self._target(*self._args, **self._kwargs)
  File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/dataloader/worker.py", line 355, in _worker_loop
    six.reraise(*sys.exc_info())
  File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/six.py", line 719, in reraise
    raise value
  File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/dataloader/worker.py", line 345, in _worker_loop
    for b in batch
  File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/dataloader/worker.py", line 345, in <listcomp>
    for b in batch
RuntimeError: (Unavailable) Memory map failed when create shared memory.
  [Hint: Expected ptr != ((void *) -1), but received ptr:0xffffffffffffffff == ((void *) -1):0xffffffffffffffff.] (at /paddle/paddle/fluid/memory/allocation/mmap_allocator.cc:81)

Exception in thread Thread-9:
Traceback (most recent call last):
  File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/dataloader/dataloader_iter.py", line 583, in _get_data
    data = self._data_queue.get(timeout=self._timeout)
  File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/multiprocessing/queues.py", line 105, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/dataloader/dataloader_iter.py", line 505, in _thread_loop
    batch = self._get_data()
  File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/dataloader/dataloader_iter.py", line 599, in _get_data
    "pids: {}".format(len(failed_workers), pids))
RuntimeError: DataLoader 2 workers exit unexpectedly, pids: 13247, 13248

---------------------------------------------------------------------------
SystemError                               Traceback (most recent call last)
/tmp/ipykernel_12706/2956733280.py in <module>
     19     save_dir='output/picodet_esnet_s',
     20     log_interval_steps=25,
---> 21     use_vdl=True)

/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddlex/cv/models/detector.py in train(self, num_epochs, train_dataset, train_batch_size, eval_dataset, optimizer, save_interval_epochs, log_interval_steps, save_dir, pretrain_weights, learning_rate, warmup_steps, warmup_start_lr, lr_decay_epochs, lr_decay_gamma, metric, use_ema, early_stop, early_stop_patience, use_vdl, resume_checkpoint)
    908             early_stop_patience=early_stop_patience,
    909             use_vdl=use_vdl,
--> 910             resume_checkpoint=resume_checkpoint)
    911
    912

/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddlex/cv/models/detector.py in train(self, num_epochs, train_dataset, train_batch_size, eval_dataset, optimizer, save_interval_epochs, log_interval_steps, save_dir, pretrain_weights, learning_rate, warmup_steps, warmup_start_lr, lr_decay_epochs, lr_decay_gamma, metric, use_ema, early_stop, early_stop_patience, use_vdl, resume_checkpoint)
    332             early_stop=early_stop,
    333             early_stop_patience=early_stop_patience,
--> 334             use_vdl=use_vdl)
    335
    336     def quant_aware_train(self,

/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddlex/cv/models/base.py in train_loop(self, num_epochs, train_dataset, train_batch_size, eval_dataset, save_interval_epochs, log_interval_steps, save_dir, ema, early_stop, early_stop_patience, use_vdl)
    331             step_time_tic = time.time()
    332
--> 333             for step, data in enumerate(self.train_data_loader()):
    334                 if nranks > 1:
    335                     outputs = self.run(ddp_net, data, mode='train')

/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/dataloader/dataloader_iter.py in __next__(self)
    695
    696             if in_dygraph_mode():
--> 697                 data = self._reader.read_next_var_list()
    698                 data = _restore_batch(data, self._structure_infos.pop(0))
    699             else:

SystemError: (Fatal) Blocking queue is killed because the data reader raises an exception.
  [Hint: Expected killed_ != true, but received killed_:1 == true:1.] (at /paddle/paddle/fluid/operators/reader/blocking_queue.h:166)

环境

请提供您使用的PaddlePaddle和PaddleX的版本号：最新版2.2.2

请提供您使用的操作系统信息：AI Studio至尊版

把num_workers设成0试试。https://github.com/PaddlePaddle/PaddleX/blob/develop/paddlex/cv/datasets/voc.py#L38


azure-core-amqp-cpp is broken in vcpkg

This breaks the daily vcpkg validation run: https://github.com/microsoft/vcpkg/pull/17119
Ideally is to fix it, alternatively we can remove the vcpkg manifest files so that no azure-core-amqp-cpp package is produced and therefore it does not get to the validation PR. But it is better to fix - after all, one day we will want to release azure-core-amqp-cpp, and then we will have to fix it, so let's fix it sooner.

I do not know yet, what is broken. You need to try to build, and then read the logs.
To get the details:
git clone https://github.com/azure-sdk/vcpkg.git
cd vcpkg
git checkout release/azure-sdk-for-cpp-daily-verification
.\bootstrap-vcpkg.bat
.\vcpkg install azure-core-amqp-cpp

The last line is also good to run as
.\vcpkg install azure-core-amqp-cpp:x64-windows
.\vcpkg install azure-core-amqp-cpp:x64-windows-static
.\vcpkg install azure-core-amqp-cpp:x86-windows
.\vcpkg install azure-core-amqp-cpp:x64-uwp
.\vcpkg install azure-core-amqp-cpp:arm-uwp
.\vcpkg install azure-core-amqp-cpp:arm64-windows