[BugFix] Forbid modify bucket when alter colocate dynamic partition table.

Signed-off-by: Astralidea<EMAIL_ADDRESS>What type of PR is this：

[x] BugFix
[ ] Feature
[ ] Enhancement
[ ] Refactor
[ ] UT
[ ] Doc
[ ] Tool

Which issues of this PR fixes ：

Fixes #17409
Problem Summary(Required) ：

Checklist:

[ ] I have added test cases for my bug fix or my new feature
[ ] This pr will affect users' behaviors
[x] This pr needs user documentation (for new or modified features or behaviors)

[ ] I have added documentation for my new feature or new function

Bugfix cherry-pick branch check:

[x] I have checked the version labels which the pr will be auto backported to target branch

[x] 2.5
[x] 2.4
[x] 2.3
[x] 2.2

[FE PR Coverage Check]
:disappointed: fail : 3 / 4 (75.00%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/alter/SchemaChangeHandler.java
3
4
75.00%
[1184]

run starrocks_admit_test

@Mergifyio backport branch-2.5

@Mergifyio backport branch-2.4

@Mergifyio backport branch-2.3

@Mergifyio backport branch-2.2


Can I use the peer image of the docker hub?

I want to use hyperledger/fabric-peer 2.2 or custom peer image.
Is it possible?
Please reply.

You can use whatever docker image you wish.
The only thing you need to keep in mind is to make sure that building and launching the chaincode is supported by the image, either as an external service or directly in Kubernetes(https://github.com/kfsoftware/externalbuilder or https://github.com/postfinance/hlfabric-k8scc)

참고하여 테스트 해보겠습니다.
답변해주셔서 감사합니다.

I'll refer to it and test it.
Thank you for your answer.


ImportError: cannot import name 'SYNC_AUDIO' from 'nes'

Error:
pygame 2.4.0 (SDL 2.26.4, Python 3.11.3)
Hello from the pygame community. https://www.pygame.org/contribute.html
Traceback (most recent call last):
  File "E:\Pyntendo\main.pyw", line 1, in <module>
    from nes import NES, SYNC_AUDIO, SYNC_NONE, SYNC_PYGAME, SYNC_VSYNC
ImportError: cannot import name 'SYNC_AUDIO' from 'nes' (E:\Python311-venv\Lib\site-packages\nes\__init__.py)

Code:
from nes import NES, SYNC_AUDIO, SYNC_NONE, SYNC_PYGAME, SYNC_VSYNC

SYNC_NONE = 0  # no sync: runs very fast, unplayable, music is choppy
SYNC_AUDIO = 1  # sync to audio: rate is perfect, can glitch sometimes, screen tearing can be bad
SYNC_PYGAME = 2  # sync to pygame's clock, adaptive audio: generally reliable, some screen tearing
SYNC_VSYNC = 3  # sync to external vsync, adaptive audio: requires ~60Hz vsync, no tearing

nes = NES(rom_file,                  # the rom file to load
          screen_scale=3,            # factor by which to scale the screen (NES screen is 256x240 pixels with overscan)
          log_file=None,             # file to log to (logging is largely turned off by default and is exceptionally slow for high-volume parts of the system)
          log_level=None,            # level of logging (logging is largely turned off by default)
          opengl=False,              # use opengl for screen rendering
          sync_mode=SYNC_AUDIO,      # audio / video sync mode  (one of SYNC_AUDIO, SYNC_NONE, SYNC_PYGAME, SYNC_VSYNC; see below)
          verbose=True,              # whether to print out cartridge info at startup
          show_nametables=False,     # shows the nametables alongside the main screen (for debug, not compatible with opengl=True)
          vertical_overscan=False,   # show the top and bottom 8 pixels (not usually visible on CRT TVs)
          horizontal_overscan=False, # show the left and right 8 pixels (often not visible on CRT TVs)
          palette_file=None,         # supply a palette file to use; None gives default
          headless=False,            # runs the nes in headless mode without the pygame screen being started
          )

nes = NES("2.nes")
nes.run()

@jameskmurphy is this support a sound? In whole internet version can't find anything what working with sound.

Sound working but imports are wrong in relation to docs.

How did you get audio working? I am struggling to figure it out

; )
You overused params and imports probably as in docs.


Returning empty array with Promise stuck as Pending

Hi everyone,
I am currently trying to use torrent-search-api to query and download torrents from IPTorrents. The code I had was working for months without any issue but I had to step away and let it sit for about 3 months. I come back and start it up only to find out none of the queries are working. I haven't touched anything since then. I pulled out only the code relating to the torrent search and set it in a file and I am still running into the same issue.
When I do the query VIA my original code, I am being returned an empty array of torrents. When I stripped out the code and only ran the part that was querying torrent, I was getting an undefined object and it seemed that the promise was stuck in a pending state even using the await function.
I have tried:

Chaning the URL for IpTorrents to other countries and with/without SSL (I am now running a fresh install of torrent-search-api)
I am 100% sure my credentials are proper VIA my username and password.
Adding loops and trying to force the promise to resolve

I have no idea how to catch the errors for the TorrentSearchAPI and am hoping I can find a way to obtain that so I can see what is wrong.

const torrentSearch = require('torrent-search-api');
torrentSearch.enableProvider('IpTorrents', 'USER', 'PASSWORD');
const results = startTorrentQuery();
//torrentSearch.enablePublicProviders();
console.log(results);

async function startTorrentQuery() {
    return await torrentSearch.search('1080', 'Movies', 20);
}

Try this:

const torrentSearch = require('torrent-search-api');
torrentSearch.enableProvider('IpTorrents', 'USER', 'PASSWORD');

async function startTorrentQuery() {
    return await torrentSearch.search('1080', 'Movies', 20);
}

(async () => {
 const results = await startTorrentQuery();
 console.log(results);
})();

Ran that, but now I am getting an empty array when printing out the value of the search. Copy pasted your code and all I have are the empty square brackets. I know for sure my credentials and I know there should be results for 1080 in the search option.

Try this:
const torrentSearch = require('torrent-search-api');
torrentSearch.enableProvider('IpTorrents', 'USER', 'PASSWORD');

async function startTorrentQuery() {
    return await torrentSearch.search('1080', 'Movies', 20);
}

(async () => {
 const results = await startTorrentQuery();
 console.log(results);
})();

Ran that, but now I am getting an empty array when printing out the value of the search. Copy pasted your code and all I have are the empty square brackets. I know for sure my credentials and I know there should be results for 1080 in the search option.
I have tried a few other public providers and it seems to be throwing some random errors occasionally when searching for even basic torrents. Specifically whenever I deal with IPtorrents, I receive an empty array when executing my torrent search, did something change on their end?

It seems so, unfortunately I don't have an IpTorrents account anymore.
From what I see, your queries may be blocked by cloudfare.
You can try to enable the "enableCloudFareBypass" flag on the IpTorrents provider.
{
    "name": "IpTorrents",
    "baseUrl": "https://iptorrents.eu",
    "enableCloudFareBypass": true, // <==== Here
    "requireAuthentification": true,
    "supportCookiesAuthentification": true,
    "supportCredentialsAuthentification": true,
    "loginUrl": "/take_login.php",
    "loginQueryString": "username={username}&password={password}",
    "searchUrl": "/t?{cat}q={query};o=seeders",
    "categories": {
       "All": "",
       "Movies": "7;68;54;77;20;89;90;96;6;48;62;38;",
       "TV": "73;",
       "Games": "74;",
       "Music": "75;"
    },
    "defaultCategory": "All",
    "resultsPerPageCount": 50,
    "itemsSelector": "table[id=\"torrents\"] tr:not(:first-child)",
    "itemSelectors": {
       "title": "td:nth-child(2) a",
       "time": "tr:nth-child(2) div.t_ctime | split:%SPECIAL_CHAR%,1 | trim",
       "downloaded": "td:nth-child(7) | int",
       "seeds": "td:nth-child(8) | int",
       "peers": "td:nth-child(9) | int",
       "size": "td:nth-child(6)",
       "link": "td:nth-child(4) a@href",
       "desc": "td:nth-child(2) a@href"
    },
    "paginateSelector": "a:contains(Next)@href",
    "torrentDetailsSelector": ".desWrap@html"
 }

It seems so, unfortunately I don't have an IpTorrents account anymore.
From what I see, your queries may be blocked by cloudfare.
You can try to enable the "enableCloudFareBypass" flag on the IpTorrents provider.
{
    "name": "IpTorrents",
    "baseUrl": "https://iptorrents.eu",
    "enableCloudFareBypass": true, // <==== Here
    "requireAuthentification": true,
    "supportCookiesAuthentification": true,
    "supportCredentialsAuthentification": true,
    "loginUrl": "/take_login.php",
    "loginQueryString": "username={username}&password={password}",
    "searchUrl": "/t?{cat}q={query};o=seeders",
    "categories": {
       "All": "",
       "Movies": "7;68;54;77;20;89;90;96;6;48;62;38;",
       "TV": "73;",
       "Games": "74;",
       "Music": "75;"
    },
    "defaultCategory": "All",
    "resultsPerPageCount": 50,
    "itemsSelector": "table[id=\"torrents\"] tr:not(:first-child)",
    "itemSelectors": {
       "title": "td:nth-child(2) a",
       "time": "tr:nth-child(2) div.t_ctime | split:%SPECIAL_CHAR%,1 | trim",
       "downloaded": "td:nth-child(7) | int",
       "seeds": "td:nth-child(8) | int",
       "peers": "td:nth-child(9) | int",
       "size": "td:nth-child(6)",
       "link": "td:nth-child(4) a@href",
       "desc": "td:nth-child(2) a@href"
    },
    "paginateSelector": "a:contains(Next)@href",
    "torrentDetailsSelector": ".desWrap@html"
 }

I just attempted again with cloud flare bypass, but still thoriwng error, this time with the CloudFlare technique changing.

The library we use to bypass cloudfare (cloudscraper) may be outdated.
We use the 3.2.0 and the latest is 4.3.0.
You should try to upgrade, but you may have some breaking changes to fix.

Duplicate of #68

As of today I started getting this issue again. I have had 	"enableCloudFareBypass": true, in my iptorrents.json and now I am once again recieving the error in regards to Cloudflare changing their technique. I updated to the latest version of cloudscraper(4.5.0) and am still having this issue. If I set the variable to false I am given an empty array of torrent each time the search is executed.
Any idea on how I should resolve this? Only happens with IpTorrents, error and configuration below.
{     "name": "IpTorrents",     "baseUrl": "https://iptorrents.com", 	"enableCloudFareBypass": true,     "requireAuthentification": true,     "supportCookiesAuthentification": true,     "supportCredentialsAuthentification": true,     "loginUrl": "/take_login.php",     "loginQueryString": "username={username}&password={password}",     "searchUrl": "/t?{cat}q={query};o=seeders",     "categories": {        "All": "",        "Movies": "7;68;54;77;20;89;90;96;6;48;62;38;",        "TV": "73;",        "Games": "74;",        "Music": "75;"     },     "defaultCategory": "All",     "resultsPerPageCount": 50,     "itemsSelector": "table[id=\"torrents\"] tr:not(:first-child)",     "itemSelectors": {        "title": "td:nth-child(2) a",        "time": "tr:nth-child(2) div.t_ctime | split:%SPECIAL_CHAR%,1 | trim",        "downloaded": "td:nth-child(7) | int",        "seeds": "td:nth-child(8) | int",        "peers": "td:nth-child(9) | int",        "size": "td:nth-child(6)",        "link": "td:nth-child(4) a@href",        "desc": "td:nth-child(2) a@href"     },     "paginateSelector": "a:contains(Next)@href",     "torrentDetailsSelector": ".desWrap@html"  }
`(node:8372) UnhandledPromiseRejectionWarning: ParserError:
Cloudflare may have changed their technique, or there may be a bug.
Bug Reports: https://github.com/codemanki/cloudscraper/issues
Check the detailed exception message that follows for the cause.
SyntaxError: Challenge evaluation failed: Unexpected token |
at solveChallenge (C:\Users\Plex\Desktop\TorrentTalker\node_modules\torrent-
search-api\node_modules\cloudscraper\index.js:254:21)
at Timeout._onTimeout (C:\Users\Plex\Desktop\TorrentTalker\node_modules\torr
ent-search-api\node_modules\cloudscraper\index.js:179:7)
at ontimeout (timers.js:436:11)
at tryOnTimeout (timers.js:300:5)
at listOnTimeout (timers.js:263:5)
at Timer.processTimers (timers.js:223:10)
(node:8372) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This
error originated either by throwing inside of an async function without a catch
block, or by rejecting a promise which was not handled with .catch(). (rejection
id: 2)
`

Cloudfare may have done some changes since someone also opened an issue on cloudscraper with the same problem few hours ago (issue).
Hopefully, there will be a fix and we'll just have to upgrade.

A new update was pushed for cloudscraper(version 4.6.0), but still having the same issue with the request being rejected. Any other ideas?


Small mistake in documentation for "Handling image uploads"

"Resizing images" section, missing the parentheses to call the editor.regions() function :
function getImages() {
    ...
    for (name in editor.regions**()**) {
        // Search each region for images
        descendants = editor.regions**()**[name].descendants();
        ....
    }
    return images;
}

Fantastic library btw !!

@maparole thanks for letting me know I'll fix that now :+


Update images on homepage

Changes proposed in this pull request
Update homepage images
Guidance to review
After

Is there a reason the images are these dimensions? As they seem to always be being scaled down in the browser.

Supplied by @conordelahunty...

I think these should be scaled down to 465x310

Done @gidsg. I really think we need SVG's at some stage


Auto naming for Extension Objects

I could do some kind of “auto renaming”, based on a “CRS.ExtensionObjectPattern”-setting, which includes the name of the object it extends and some ... (like “ Ext”).  And only do that when you rename the file (or OnSaveAction) – with no ability for you to change the name.

Waldo, thanks for the lightning (and thoughtful!) response! I thought you said you were busy, LOL!!!
I tried mightily for about 6 hours the other day, trying to do this with Regular Expressions in VSC; but all I got out of it was a renewed hatred for Regex...
The template my particular “Project Mgr” (the “Project” being ‘Converting our C/AL Add-Ons into 2.0 Extensions’) was desiring was the following:
[Prefix][BaseName] [ObjectTypeShort]Ext
Eg. CCSItem List PagExt
It would be wonderful if it could also work with (or also in the fashion of) your “Rename All” Command.
And as far as I am concerned, It would be fine that you couldn't change the name. I just wouldn't enable the "OnSave" option.
Would this become a new CRS Command, with its own "Settings" for the Template? That would likely be best, in my opinion.

I think this would make sense:
A new setting: "CRS.ExtensionObjectNamePattern".
Default: ""
When "" -> manual naming
When filled in -> automatic naming
Available tags: ->
Would work?

Looks reasonable to me!

lol, my tages weren't visible :-)

Now it looks even MORE reasonable, LOL!
So why don't I have it yet?  ;-)

BTW, how'd you get the comment-editor to let you show "angle brackets"? It ATE mine!

insert it in code...

Duh, I wondered about that. Thanks!

Done!
Hope you like it ;-)

Waldo,
That is SWEET!!!!!!
You have officially earned your Weekend!!!
Thanks a million!!!
BTW, is there REALLY any difference between a Prefix and a Suffix (IOW, can I just put my “Prefix” at the End of something and call it good?)
Thanks again,
-Doug
this is a placeholder
Doug McIntosh
[DougSkype]
this is also a placeholder
Doug McIntosh
Cost Control Softwarehttp://www.costcontrolsoftware.com/
Phone:<PHONE_NUMBER> (office);<PHONE_NUMBER> (cell)
Email: doug<EMAIL_ADDRESS>Click here for current Price Cataloghttps://costcontrolsoftware.leadpages.co/leadbox/141df29f3f72a2%3A113e88a1eb46dc/5697982787747840/
Click here for current DVD Training Cataloghttps://costcontrolsoftware.leadpages.co/leadbox/142882473f72a2%3A113e88a1eb46dc/5698497110081536/
From: waldo<EMAIL_ADDRESS>Sent: Friday, July 06, 2018 4:50 AM
To: CloudReadySoftware/crs-al-language-extension
Cc: Doug McIntosh; Comment
Subject: Re: [CloudReadySoftware/crs-al-language-extension] Auto naming for Extension Objects (#64)
Done!
Hope you like it ;-)
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHubhttps://github.com/CloudReadySoftware/crs-al-language-extension/issues/64#issuecomment-402971051, or mute the threadhttps://github.com/notifications/unsubscribe-auth/Am-O_0mDk6slngIp7Mm8eEhr1xPRzR9lks5uDySzgaJpZM4VEFlS.


Feature/readded argv

@johngluckmdsol , I needed ARGV again, cause found, that it is not working in our scripts anymore.
Should have the same behaviour as before, except, that -f is not needed anymore.
I merge it now, but please check it, John. Thanks.

Okay, but IMO, that behavior was a defect because it's not globbing as a regular user would expect it to, so I'm inclined to say your scripts are incorrect.  I will take a look and give you a more detailed analysis if pertinent before I make any judgements :)

Now I remember.  Here are my notes:
We no longer use command-line expansion through ARGV to get the file list because this doesn't work in all cases (/**/* vs dir/*). This would be a bug fix That said, since we bugfixed the cli but all other changes should be backward compatible, we bumped to 0.7.0., which I believe is in accordance with semantic versioning, even though the usage has changed (in that command line arg now requires -f '<path to file/s>'
That means all you have to do to fix your scripts is surround pass -f with single-quotes.  As you have it now, you've switched back to unix globbing instead of Ruby globbing, which is superior.  Since I have to manage a lot of users, this is going to be confusing for them.  They will expect ruby globbing and will be upset with the linter misses files

ok, but gherkin_lint '**/*.feature' and gherkin_lint -f '**/*.feature' would be the same.....so it is enough to put the ruby globbing around?
if have so many users, we also could support additionally the -f-behaviour.

The problem with **/*.feature is that it expands before getting into ruby and doesn't catch the files in the parent directory. I just think that's a bug.  It's not obvious that's going to happen.  In fact, I didn't even know that was how Unix operated with ** until I wrestled with this for 2 hours.  But even if I had, I assume that when I pass an arg like this into Ruby, it is treated as a string.  It feels to me like it should be a string so as to avoid Unix interpreting it before it gets to the main execution.
So no, it's not the same
gherkin_lint '**/*.feature' and gherkin_lint -f '**/*.feature' produce different output, the difference being that the former won't list files in the parent directory.  That's why I think it's a bug

gherkin_lint **/*.feature and gherkin_lint -f '**/*.feature' is not the same, but
gherkin_lint '**/*.feature' and gherkin_lint -f '**/*.feature' is.
So I would add the ruby globbing around any file passed. And also additionally readd the --file syntax even it could be done without it to support your users?

Okay.  I'm good with that


Move insert to data

Codecov Report

:exclamation: No coverage uploaded for pull request base (pydantic_experiment@8edced0). Click here to learn what that means.
Patch has no changes to coverable lines.

Additional details and impacted files
@@                  Coverage Diff                   @@
##             pydantic_experiment     #388   +/-   ##
======================================================
  Coverage                       ?   94.17%
======================================================
  Files                          ?       73
  Lines                          ?     9314
  Branches                       ?        0
======================================================
  Hits                           ?     8771
  Misses                         ?      543
  Partials                       ?        0

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Fixing copy/pasta error between scripts

Fixing copy/pasta error between scripts
Write-Log --> Write-Host

/lgtm


update copyright for all k files

lgtm, but I worked with @cos, so someone else needs to review it too.


Perform government documents overlap analysis

Now that the underlying code has been committed, the actual script needs to be written.
Primary stakeholder: David Hollander
Acceptance criteria:

[ ] A script is written in tasks that performs an overlap analysis of bibs with Marcive portfolios against all other unsuppressed electronic titles in Alma
[ ] A report is presented to David Hollander

Lead: Mark
Reviewer: Tom, Peter

I sent the provisional report with my findings to David Hollander to see if any more information is needed.


Camera is accessible via ssh but web app is failing

Hi,
A few days ago my camera wasn't available anymore using webrtc, but it is available using the YI app.
When I try to access it it looks like this, with the following error on the browser console:
Error: <path> attribute d: Expected number, "…2.097898,1.5862amundomario, role…".

I still have ssh access, so I tried looking at dmesg logs and this is what I got:
[    0.558622] sunxi-mmc sdc1: smc 1 p1 err, cmd 55, RTO !!
[    0.559456] sunxi-mmc sdc1: smc 1 p1 err, cmd 55, RTO !!
[    0.560292] sunxi-mmc sdc1: smc 1 p1 err, cmd 55, RTO !!
[    0.560334] sunxi-mmc sdc1: sdc set ios:clk 400000Hz bm OD pm ON vdd 21 width 1 timing LEGACY(SDR12) dt B
[    0.561258] sunxi-mmc sdc1: smc 1 p1 err, cmd 1, RTO !!
[    0.561288] sunxi-mmc sdc1: sdc set ios:clk 0Hz bm PP pm OFF vdd 0 width 1 timing LEGACY(SDR12) dt B
[    0.640374] sunxi-codec-machine sndcodec: [sunxi_card_dev_probe] register card finished.
[    0.640993] NET: Registered protocol family 17
[    0.641042] NET: Registered protocol family 15
[    0.641072] Key type dns_resolver registered
[    0.641667] Registering SWP/SWPB emulation handler
[    0.646981] sunxi-rtc rtc: setting system clock to 2024-07-15 22:46:00 UTC<PHONE_NUMBER>)
[    0.647816] snddaudio snddaudio0: codec: snd-soc-dummy, codec_dai: snd-soc-dummy-dai.
[    0.648350] snddaudio snddaudio0: snd-soc-dummy-dai <-> daudio0 mapping ok
[    0.649647] ALSA device list:
[    0.649656]   #0: sun8iw19-codec
[    0.649659]   #1: snddaudio0
[    0.649716] Warning: unable to open an initial console.
[    0.654072] VFS: Mounted root (squashfs filesystem) readonly on device 31:2.
[    0.655696] devtmpfs: mounted
[    0.655934] Freeing unused kernel memory: 108K
[    0.655938] This architecture does not have kernel memory protection.
[    0.672107] random: fast init done
[    0.693970] sunxi-mmc sdc0: sdc set ios:clk 0Hz bm PP pm ON vdd 21 width 1 timing LEGACY(SDR12) dt B
[    0.694023] sunxi-mmc sdc0: Switching to 1.8V signalling voltage ok
[    0.712051] sunxi-mmc sdc0: sdc set ios:clk 400000Hz bm PP pm ON vdd 21 width 1 timing LEGACY(SDR12) dt B
[    0.719726] mmc0: host does not support reading read-only switch, assuming write-enable
[    0.720435] sunxi-mmc sdc0: sdc set ios:clk 400000Hz bm PP pm ON vdd 21 width 4 timing LEGACY(SDR12) dt B
[    0.721263] sunxi-mmc sdc0: sdc set ios:clk 400000Hz bm PP pm ON vdd 21 width 4 timing UHS-SDR104 dt B
[    0.721348] sunxi-mmc sdc0: sdc set ios:clk 150000000Hz bm PP pm ON vdd 21 width 4 timing UHS-SDR104 dt B
[    0.721492] mmc0: new ultra high speed SDR104 SDHC card at address 1388
[    0.722897] mmcblk0: mmc0:1388 USD00 14.7 GiB
[    0.724792]  mmcblk0: p1
[    1.179488] udevd[535]: could not create /run/udev: No such file or directory
[    3.106481] sunxi-wlan wlan: bus_index: 1
[    3.226115] sunxi-mmc sdc1: sdc set ios:clk 0Hz bm PP pm UP vdd 21 width 1 timing LEGACY(SDR12) dt B
[    3.244017] sunxi-mmc sdc1: sdc set ios:clk 400000Hz bm PP pm ON vdd 21 width 1 timing LEGACY(SDR12) dt B
[    3.264710] sunxi-mmc sdc1: sdc set ios:clk 400000Hz bm PP pm ON vdd 21 width 1 timing LEGACY(SDR12) dt B
[    3.267205] sunxi-mmc sdc1: sdc set ios:clk 400000Hz bm PP pm ON vdd 21 width 1 timing LEGACY(SDR12) dt B
[    3.269088] sunxi-mmc sdc1: smc 1 p1 err, cmd 8, RTO !!
[    3.272346] sunxi-mmc sdc1: card claims to support voltages below defined range
[    3.283552] sunxi-mmc sdc1: sdc set ios:clk 400000Hz bm PP pm ON vdd 21 width 1 timing SD-HS(SDR25) dt B
[    3.283674] sunxi-mmc sdc1: sdc set ios:clk 50000000Hz bm PP pm ON vdd 21 width 1 timing SD-HS(SDR25) dt B
[    3.283834] sunxi-mmc sdc1: sdc set ios:clk 50000000Hz bm PP pm ON vdd 21 width 4 timing SD-HS(SDR25) dt B
[    3.284607] mmc1: new high speed SDIO card at address 0001
[    3.298770] random: crng init done
[    3.444617] [sc3335_mipi]V4L2_IDENT_SENSOR = 0xcc1a
[    3.457021] sunxi_gpadc_init,1779, success
[    3.457829] input: sunxi-gpadc0 as /devices/virtual/input/input0
[    3.457891] sunxi_gpadc_probe success
[    5.313401] libphy: 5020000.eth: probed
[    5.313810] sunxi-gmac 5020000.eth eth0: eth0: Type(6) PHY ID 0000ffff at 31 IRQ poll (5020000.eth-0:1f)
[    5.315821] sunxi-gmac 5020000.eth eth0: Initialize hardware error
[    5.703674] cpld_periph: loading out-of-tree module taints kernel.
[    5.709632]
[    5.709632] [CPLD_PERIPH] ir_led_ctl: 0, ircut_direction: 0 audio_ctl:0
[    5.709833]
[    5.709833] [CPLD_PERIPH] cpld_init ok, [ ver=Aug 16 2021, 10:46:41 ]
[    5.709901] can't request wifi_en gpio[198]
[    5.710265] [CPLD_PERIPH] pwm init ok.
[    5.710273] [CPLD_PERIPH] timer init ok.
[    5.710277] timer resolution:4 MHZ
[    5.710280] [CPLD_PERIPH] HZ = 250
[    7.146822] hw8_xy:[0],hw12_ab_cd_ratio[0],hw23_26_x_step:[0],hw27_30_y_step:[0]
[    7.477738] Adding 65532k swap on /tmp/sd/swapfile.  Priority:-1 extents:20 across:66684k SS
[    9.255462] [CPLD_PERIPH] Timer closed.
[    9.255474] [CPLD_PERIPH] Timer opened.
[   11.322889] cedar_ve: VE real_fre=300000000
[   11.597112] snddaudio snddaudio0: codec_dai set sysclk failed
[   11.597123] snddaudio snddaudio0: codec_dai set set_pll failed.
[   11.597129] snddaudio snddaudio0: codec dai set fmt failed
[   11.597148] snddaudio snddaudio0: codec_dai set clkdiv failed
[   12.071981] -----> wait adc hw ready
[   12.120795] snddaudio snddaudio0: codec_dai set sysclk failed
[   12.120805] snddaudio snddaudio0: codec_dai set set_pll failed.
[   12.120810] snddaudio snddaudio0: codec dai set fmt failed
[   12.120829] snddaudio snddaudio0: codec_dai set clkdiv failed
[   12.191300] [sc3335_mipi]V4L2_IDENT_SENSOR = 0xcc1a
[   12.288111] into set sensor hfilp the value:1
[   12.288657] [VIN]sensor_flip_option:isp0 reset!!!
[   12.288710] into set sensor hfilp the value:1
[   12.289244] [VIN]sensor_flip_option:isp0 reset!!!
[   12.290152] cedar_ve: VE real_fre=300000000
[   12.290225] cedar_ve: VE real_fre=300000000
[   12.292928] cedar_ve: VE real_fre=300000000
[   18.432185] [CPLD_PERIPH] Timer closed.
[   19.540012] -----> wait adc hw ready
[   19.588912] snddaudio snddaudio0: codec_dai set sysclk failed
[   19.588940] snddaudio snddaudio0: codec_dai set set_pll failed.
[   19.588946] snddaudio snddaudio0: codec dai set fmt failed
[   19.588966] snddaudio snddaudio0: codec_dai set clkdiv failed
[   19.593162] [sc3335_mipi]V4L2_IDENT_SENSOR = 0xcc1a
[   19.633215] [sc3335_mipi]V4L2_IDENT_SENSOR = 0xcc1a
[   19.665329] cedar_ve: VE real_fre=300000000
[   19.756452] cedar_ve: VE real_fre=300000000
[   20.005739] cedar_ve: VE real_fre=300000000
[   45.912825]
[   45.912825] [PID_LIST] pid_list_init ok, [ ver=Aug 16 2021, 10:46:40 ]

I thought about running unbrick but in my backup file I can only see .conf files, not the .bin files mentioned in the wiki.
Is there a way to solve it without unbrick?
If not, is there a way to perform a backup that includes the bin files using ssh?
Thanks a lot!

I have formatted the sd card and reinstalled the hack and everything is back to normal.
I'm still wondering how to get the bin files described in the unbrick guide.

Solved by formatting the sd card and reinstall the hack

Good to know.


GH2595: Installs prerelease package versions when explicitly specified

Got hit by this one today and based on the conversation in #2595, seems like the consensus is that we should honour explicitly specified prerelease versions, even without a prerelease flag. From what I can test, behaviour is otherwise unchanged.

fixes #2595

@agc93 your changes have been merged, thanks for your contribution 👍


added continuous integration

You'll likely have to activate CI on these URLs:

https://travis-ci.org/profile/tambien
https://codecov.io/gh/tambien/+

but landing this PR will set up everything you need aside from that.

I just used the GitHub GUI to resolve the merge conflicts between this branch and my other PRs.

Thanks for all your contributions! very much appreciated


Perform max 5 retries on URL fetches to cope with timeouts

Because I have a lot of addons, the Curse server was blocking some of the requests, making it impossible for me to update all of them at the same time as failure of one results in a complete stop of the process.
I added a try-catch loop which retries a request maximum 5 times which solves the problems for me.
This should also solve #15 for the same reasons. I also experienced that issue and that too is gone now.
Another solution might be not to throw all the requests to the server at the same time, if you don't like this patch :-)

Nice wrapper! Merged! Thanks


No map objects for locations other than US and Canada

I am checking on Swift3.0 version and getting following issue
ViewController.swift - didReceiveApiResponse(_:response:) - 177 - Got map objects!
however there are no forts,  spawnPoints, catchablePokemons, wildPokemons, nearbyPokemons getting in the response other than US and Canada locations.
PokemonMap.swift - viewDidLoad() - 33 - forts - 0
PokemonMap.swift - viewDidLoad() - 34 - spawnPoints - 0
PokemonMap.swift - viewDidLoad() - 35 - catchablePokemons - 0
PokemonMap.swift - viewDidLoad() - 36 - wildPokemons - 0
PokemonMap.swift - viewDidLoad() - 37 - nearbyPokemons - 0
is there any setting to check for other countries ?
am early response will be appreciated.

To addin this was working fine in the master version I.e. Swift 2 version.

Try setting all bools to false in setApiSettings and let me know if it works. I'll try it later tonight.

@PokemonGoSucks, thanks for quick revert. I have changed the above mentioned settings at both places 1. at default and at the setPlatformRequestSettings (as this method is not been called).
Really appreciate your early advice to move forward, thanks
at default
internal struct platformRequestSettings {
    //    internal var useSensorInfo: Bool = true
    //    internal var useActivityStatus: Bool = true
    //    internal var useDeviceInfo: Bool = true
    //    internal var useLocationFix: Bool = true
    //    internal var randomizedTimeSnapshot = UInt64.random(100, max: 500)

    internal var useSensorInfo: Bool = false
    internal var useActivityStatus: Bool = false
    internal var useDeviceInfo: Bool = false
    internal var useLocationFix: Bool = false
    internal var randomizedTimeSnapshot = UInt64.random(100, max: 500)
}

at the setPlatformRequestSettings
open func setPlatformRequestSettings(useActivityStatus: Bool? = false, useDeviceInfo: Bool? = false, useSensorInfo: Bool? = false, useLocationFix: Bool? = false) {
    print("\(URL(fileURLWithPath: #file).lastPathComponent) - \(#function) - \(#line) - useActivityStatus: \(useActivityStatus)")
    print("\(URL(fileURLWithPath: #file).lastPathComponent) - \(#function) - \(#line) - useDeviceInfo: \(useDeviceInfo)")
    print("\(URL(fileURLWithPath: #file).lastPathComponent) - \(#function) - \(#line) - useSensorInfo: \(useSensorInfo)")
    print("\(URL(fileURLWithPath: #file).lastPathComponent) - \(#function) - \(#line) - useLocationFix: \(useLocationFix)")

    //        unknown6Settings.useActivityStatus = useActivityStatus!
    //        unknown6Settings.useDeviceInfo = useDeviceInfo!
    //        unknown6Settings.useSensorInfo = useSensorInfo!
    //        unknown6Settings.useLocationFix = useLocationFix!

    unknown6Settings.useActivityStatus = false
    unknown6Settings.useDeviceInfo = false
    unknown6Settings.useSensorInfo = false
    unknown6Settings.useLocationFix = false

}

However, there is no improvement. The test results are as follows:
Failed - Not getting any map objects for below: (Not OK)
    // London
    latField.text! = String(51.507351)
    longField.text! = String(-0.127758)

    // Eiffle Tower, Paris
    latField.text! = String(48.858370)
    longField.text! = String(2.294481)

    // Sydney Opera House
    latField.text! = String(-33.856767)
    longField.text! = String(151.215284)

Passed - getting map objects for below: (OK)
    // Apple HQ
    latField.text! = String(37.33161821509)
    longField.text! = String(-122.0298043927)

     // Time Square, Newyork
    latField.text! = String(40.759011)
    longField.text! = String(-73.984472)

    // toronto, Canada
    latField.text! = String(43.653226)
    longField.text! = String(-79.383184)

It should be solved now.

thanks @PokemonGoSucks, it helped a lot !!! 👍


Update fork

Whenever it turns out to be a good time, can we update this fork from the active dev github repo at biothings?

Whenever it turns out to be a good time, can we update this fork from the active dev github repo at biothings?

Sure! I'm going to set up a Github Action workflow to automatically sync between these two repos.


Add Goryo and Myling from recent update

Updated the ghost evidences and added the new ghosts.
Picked this icon for the Dots projecter since I couldn't find any other suitable icon.

cool! thanks for the update! 🥳
will try to build and publish this one

changes are now live 👍


Spell check GitHub action

This shouldn't get in the way of development too much. It's designed to work with code and have a low false-positive count. Feel free to drop the Add github spell check workflow commit if you recon it'll be more hassle than  worth.

This is awesome.  My only question: what's the procedure for silencing a false positive?

My only question: what's the procedure for silencing a false positive?

Add it to the [default.extend-words] in the .typos.toml file. There's already two defined:
inout = "inout" # Mutable projection keyword
olt = "olt" # Abbreviation for "ordered less than"

The list is defined as a map of valid corrections. TBH not too sure why it's a correction in this case. Likely related to the tool working off of correction lists and not valid lists. See the docs on false positives for more info.

If you could add something to this text describing how contributors can spell-check their code locally, I think we can accept this PR with gratitude!

Think that should suffice :+1:


Add error catchers for uninitialized gradients

For GradTensors, initializing and then trying to access gradients gives a obscure seg fault. Add new attribute that keeps track of whether it's initialized (or I think we can use backward attribute for this).
import ember

# generate dataset with 100 samples, 8 features
X = ember.Tensor.arange(0, 3, 1).reshape([3, 1])
W = ember.Tensor.arange(3, 6, 1).reshape([1, 3])
b = ember.Tensor([[0]])
z1 = W @ X

print(X.grad)
print(W.grad)
print(b.grad)
print(z1.grad)

Done.


How to improve the mOTUpan core-genome estimation for viruses species?

When I tried to generate the viruses pangenome, I found that the effect mOTUpan estimated the core-genome was not ideal.
How does SuperPang improve the core-genome estimation effect of small genome-sized species?

I have not tested it in viruses yet.
Can you elaborate a bit more on what happened? Why do you think it is not "optimal", exactly? What were your expectations and what is the result you got?

Maybe the genome size of viruses is small,  the core.fasta file is empty for some viruses.

I can reproduce with the HIV genomes that you mentioned in #6.
One problem is that by default SuperPang expects genomes to come from the same ANI>95% cluster. The ANI between the HIV genomes is lower. This can be controlled by using the -i parameter, maybe setting up down to 0.8 or 0.7 for HIV. This greatly improves the collapsing of homologous regions, and results in a better looking assembly (when you look at the graph.fastg file in Bandage.
Still, mOTUpan is not working correctly even when lowering the -i parameter, and I'm not sure why. I have also played around with some other settings in SuperPang that might have helped, but got nothing so far.
I will discuss this its developer.
For now, you can just manually filter the NBPs according to their coverage.
E.g. I ran SuperPang 0.9.4beta1 (available in conda) on 39 HIV genomes with SuperPang.py --fasta rawHIV/*fna -i 0.7.
mOTUpan failed to predict a core genomes, but e.g. the header for one of the NBPs I got was:
>NODE_Sc0-0-noinfo_length_8924_cov_38.94_tag_noinfo;
So then I can see that the coverage of that NBP in my original genomes is 38.94, very close to the 39 original genomes (a couple kmers might be missing for one of the input genomes so it's not exactly 39). So I would definitely say that it is core.
Anyways I'll keep looking at this


snack bar z-index 변경

🤔 해결하려는 문제가 무엇인가요?

#351
fixed 이미지 아래에 스낵바가 뜨는 문제 해결

Codecov Report
Patch and project coverage have no change.

Comparison is base (5e85abc) 90.81% compared to head (491dc0d) 90.81%.

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #352   +/-   ##
=======================================
  Coverage   90.81%   90.81%
=======================================
  Files          42       42
  Lines         294      294
  Branches       52       52
=======================================
  Hits          267      267
  Misses         27       27

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Sample for nginx-php-mysql

Thanks for submitting the sample.
I can't give good feedback about the nginx-php setup as I am not familiar with it. If somebody more knowledgeable can help, it would be great.

@aiordache this part I am confident about. I run dozens of high volume nginx/php configurations in a production environment.

Hello @spamr
Did you plan to rework this PR to address the feedbacks or should we close this pull request?

Hello @spamr
Did you plan to rework this PR to address the feedbacks or should we close this pull request?

Hey @glours,
Sorry I haven't been around to respond. The feedback of connecting the database makes perfect sense. I'll work on that part.
This is the only feedback currently halting the contribution right? I want to be sure I didn't miss anything.


Aperture not being selected properly

We should be setting the aperture based on the bounding box crystal size from zocalo but it looks like we're not.
i.e.

Should have the aperture size set as medium for the rotation

The actual aperture is changing properly, we're not updating the beamsize correctly though. It seems like the BeamSize scannable on GDA is not getting updated correctly when we change the aperture from Hyperion. Needs further investigation.

Won't fix in GDA, we should make sure that it's done properly in Hyperion


Egress feature should sync, not upload

We should make sure we're syncing the output data to an object store ... not just uploading the latest files.
Right now I believe we do the latter ... which is pretty unhelpful if the names of files are changing.

This would be pretty nice to have, also would be useful to see if we can use etags to make sure we don't upload the same data twice.

Totally - we want to avoid that as much as possible.
I think s3 has an rsync like feature (which only uploads new things). I'm hoping each client has something similar.

I think s3cmd has an rsync like feature but I don't see it anywhere in the client library. I think we're likely going to need to roll our own for clients which makes this a bit trickier.

Yea you're right.
We agreed the easy tactical thing to do here is either:
A) upload under a prefix (e.g. the commit ID)
Advantage: super simple to implement, and gets us 'correctness' for what a user wants
Disadvantage: a user needs to lookup the latest commit (which doesn't really suit the use case ... this is intended for users who are not techincal and 'just want to see a lsit of files' and may not even have access to the p7m cluster)
B) delete the contents, then upload
Advantage: gets us correctness + ease of use for all users
Disadvantage: deleting obj from a bucket can be really time consuming (as I'm finding out when trying to do this cleanup for our AWS buckets)

I think we'll go w B for now. It might be slower ... but it gets us closer to the finish line we want ... and is probably step1 in rolling our own rsync like feature.

stale


Linking error with Cats & Monix

See this fiddle for reference: https://scalafiddle.io/sf/c2qvSzI/0
The error:
ScalaFiddle.scala:-5: ERROR: There were linking errors
Referring to non-existent method cats.functor.Invariant.$$init$()scala.Unit
  called from monix.reactive.Observable$CatsInstances.()
  called from monix.reactive.Observable$.()
  called from ScalaFiddle$.()
  exported to JavaScript with @JSExport
Referring to non-existent method cats.functor.Invariant.$$init$()scala.Unit
  called from monix.eval.instances.CatsAsyncInstances$ForTask.()
  called from monix.eval.instances.CatsAsyncInstances$ForParallelTask.()
  called from monix.eval.instances.CatsEffectInstances$ForParallelTask.(monix.execution.Scheduler)
  called from monix.eval.TaskInstances2.catsEffectInstances(monix.eval.instances.ApplicativeStrategy,monix.execution.Scheduler)monix.eval.instances.CatsEffectInstances
  called from monix.eval.Task$.catsEffectInstances(monix.eval.instances.ApplicativeStrategy,monix.execution.Scheduler)monix.eval.instances.CatsEffectInstances
  called from ScalaFiddle$.()
  exported to JavaScript with @JSExport
involving instantiated classes:
  monix.eval.Task$
Referring to non-existent method cats.functor.Invariant.$$init$()scala.Unit
  called from cats.effect.IOInstances$$anon$1.(cats.effect.IOInstances)
  called from cats.effect.IOInstances.$$init$()scala.Unit
  called from cats.effect.IO$.()
  called from monix.eval.internal.TaskConversions$.fromEffect(java.lang.Object,cats.effect.Effect)monix.eval.Task
  called from monix.eval.Task$.fromEffect(java.lang.Object,cats.effect.Effect)monix.eval.Task
  called from monix.reactive.Observable.$$anonfun$mapEval$1(scala.Function1,cats.effect.Effect,java.lang.Object)monix.eval.Task
  called from monix.reactive.Observable.mapEval(scala.Function1,cats.effect.Effect)monix.reactive.Observable
  called from ScalaFiddle$.()
  exported to JavaScript with @JSExport
involving instantiated classes:
  monix.eval.internal.TaskConversions$
  monix.eval.Task$
  monix.reactive.internal.builders.IterableAsObservable
  monix.reactive.internal.operators.MapTaskObservable
  monix.reactive.internal.builders.NowObservable

I am unsure if that's ScalaFiddle's fault or not, but I currently have no way to confirm it in an IDE.

I think it's a problem with library versions. If you use Cats 1.0-MF then it'll work (tick the box "show all versions" in the library selector):
https://scalafiddle.io/sf/VHtuiE6/0


include latest grant updates in the Permissions tabs

Closes #2656
Requires externally tracked items to be addressed first: MR-165, MR-166, MR-167

Adds the missing subsections for Longview, StackScripts, Images, Volumes with grants matching the legacy Manager (which are those documented in the API - https://developers.testing.linode.com/v4/reference/endpoints/account/users/$username/grants )

Adds the missing Global privileges, updates text to match the legacy Manager.

Coverage decreased (-0.06%) to 68.141% when pulling a53b46e5395b743449f82edaeffedffb1a268df4 on displague:feature-2656 into 2ddedf583d5fe309a2dade0b95e3e22a8aec6423 on linode:develop.


[Feature] Deploy tagged commits with Travis

Deploy via Travis (will need manylinux deployment with docker for cython extensions).

Automatic windows deployment now a priority, because installing from the source dist apparantly doesn't work for some (https://github.com/SainsburyWellcomeCentre/cellfinder/issues/88#issuecomment-621301173)

MacOS & Windows deployment added in 473d5ee29bdb15abe2732e13c8b19b8da0547484


Show warning in chat with unverified email

If I chat with users who haven't yet verified their email, I want to know they may not respond because they do not receive notifications.

@guerinoni

I'll try to fix it tomorrow

Fixing this issues is simple, but needs changes in multiple crates. We can do it together in a pair-programming session.


Remove Link does not always work.

In Windows version 1.3.1 when you delete a number of links you can get "stuck" with a link that wont delete until you press save, exit diagram and go back in. Unfortunately this does not always happen so I have not ben able to come up with foolproof steps
To Reproduce
Steps to reproduce the behavior:

Create a model where you have > 4 processes along with 2 or more data flows per process
Delete more than one data flow link
At some point the remove link button stops working
Save
Close Diagram
Open Diagram
Delete link

Expected behavior
Delete should always work
Environment:

Platform: Desktop
OS: Windows
Version 1.3.1

I was able to reproduce this in Mac 11.5.2 with version 1.5.3.
I made a diagram, duplicated that diagram, opened the diagram and tried to delete a link.
After saving, closing and opening it again, it worked.

Thanks @juankb1024 , I will see if I can repeat it. We are updating our version of JointJS in #236 and this may get solved during that update.

Closing this as a Won't Do
We have replaced the drawing library for version 2.0 onwards, so we no longer have this problem (just different problems)


gf gen dao -l "mysql:roots:cf42b1748796f358@tcp(<IP_ADDRESS>:3306)/shop"

gen dao use username is root? why not roots?

无法复现，请提供一下版本号


✨ try using map to save dicts

import pyarrow as pa
import pyarrow.parquet as pq

# Assuming your dataset is a list of dictionaries
dataset = [
    {"date": "2023-06-01", "severity": "INFO", "message": "Event 1"},
    {"date": "2023-06-02", "severity": "WARNING", "message": "Event 2", "count": 10},
    {"date": "2023-06-03", "severity": "ERROR", "message": "Event 3", "duration": 5.25}
]

# Create an empty list to hold the PyArrow Array objects
arrays = []

# Iterate over the dataset
for event_data in dataset:
    # Convert dictionary to a PyArrow Map array
    map_array = pa.array(
        [pa.Map.from_arrays(list(event_data.keys()), list(event_data.values()))]
    )

    arrays.append(map_array)

# Concatenate the Arrays
merged_array = pa.concat_arrays(arrays)

# Create a schema for the Map column
map_field = pa.field("event_data", pa.map_(pa.string(), pa.string()))

# Create a PyArrow Table from the array and schema
table = pa.Table.from_arrays([merged_array], schema=pa.schema([map_field]))

# Write the Table to Parquet
pq.write_table(table, 'output.parquet')

this code appears to work but Map requires all of the values to be the same type, which is of limited value as that will be difficult to determine ahead of time.
import pyarrow as pa
import pyarrow.parquet as pq

# Assuming your dataset is a list of dictionaries
dataset = [
    {"date": "2023-06-01", "severity": "INFO", "message": "Event 1"},
    {"date": "2023-06-02", "severity": "WARNING", "message": "Event 2", "count": 10},
    {"date": "2023-06-03", "severity": "ERROR", "message": "Event 3", "duration": 5.25}
]

# Create empty lists to hold the PyArrow Array objects
offsets = []
keys = []
items = []

# Iterate over the dataset
for event_data in dataset:
    # Separate the keys and values of the dictionary
    event_keys = list(event_data.keys())
    event_values = [str(value) for value in event_data.values()]

    # Record the offsets for each event
    offsets.append(len(keys))

    # Add the keys and values to the corresponding lists
    keys.extend(event_keys)
    items.extend(event_values)

# Create arrays from the lists
offsets_array = pa.array(offsets)
keys_array = pa.array(keys, type=pa.string())
items_array = pa.array(items, type=pa.string())

# Construct the MapArray from the arrays
map_array = pa.MapArray.from_arrays(offsets_array, keys_array, items_array)

# Create a schema for the Map column
map_field = pa.field("event_data", pa.map_(pa.string(), pa.string()))

# Create a PyArrow Table from the array and schema
table = pa.Table.from_arrays([map_array], schema=pa.schema([map_field]))

print(table)


Getting MaxNumberOfGlobalEnvironmentsInSubExceeded for making second ACA in free tier

Please provide us with the following information:

This issue is a: (mark with an x)

[X] bug report -> please search issues before submitting
[ ] documentation issue or request
[ ] regression (a behavior that used to work and stopped in a new release)

Issue description
From my personal Azure account, I am trying to create a deployment using the "Deploy to Azure" flow.
Here's the link I'm using:
https://portal.azure.com/#create/Microsoft.Template/uri/https%3A%2F%2Fraw.githubusercontent.com%2Fpamelafox%2Fbabybuddy-azure%2Fmain%2Finfra%2Fmain.json
When I specify a region where I do not have any container app environments (e.g. "Canada Central"), I get this error:
{"code":"InvalidTemplateDeployment","details":[{"code":"ValidationForResourceFailed","message":"Validation failed for a resource. Check 'Error.Details[0]' for more information.","details":[{"code":"MaxNumberOfGlobalEnvironmentsInSubExceeded","message":"The subscription '74feb6f3-f646-478d-a99b-37fafee75e29' cannot have more than 1 environments among all regions."}]}],"message":"The template deployment 'Microsoft.Template-20221017144926' is not valid according to the validation procedure. The tracking id is '5a281424-3495-456e-ad39-508b6d51428f'. See inner errors for details."}

I am able to successfully deploy the resources when I follow the same link from my corporate account, which has a higher tier.
Expected behavior [What you expected to happen.]
According to the documentation at https://learn.microsoft.com/en-us/azure/container-apps/quotas, "Pay-as-you-go and trial subscriptions are limited to 1 environment per region per subscription."
I expected that if I specified a region where I had no existing container app environment, it would successfully create it.
Actual behavior [What actually happened.]
I got the MaxNumberOfGlobalEnvironmentsInSubExceeded error instead.
Screenshots

Based on the above this documentation has been updated

@kendallroden To be clear;
* Pay-as-you-go and trial subscriptions are limited to 1 environment per region per subscription.

This text was removed; does that mean the limit of 1 for pay-as-you-go is lifted to 5?


Actions v2

Actions v2
This feature allows further customization of ZITADEL. The admin will be able to provide an endpoint to manipulate the request before zitadel handles a request, manipulate the response before it's sent to the client, react on events which were stored or hook into predefined trigger points to complement a token for example.
The custom code is a REST API server managed by the customer, ZITADEL will call the provided endpoint and either use the HTTP status code of the response or even the response body depending on your configuration.
Examples of configurations and diagrams can be found in the examples section below
This epic summarises the action items for the new actions features. Based on the "Future of Actions"-Discussion
Basic implementation
The following tasks build the foundation of actions when these tasks are finished admins are able to use the new version of actions.

[ ] Command side for execution targets
[ ] Command side for executions
[ ] Query side for executions and targets
[ ] Console implementation for managing executions and targets
[ ] Run Executions on API (response and request)
[ ] Run executions on events
[ ] Run executions on functions

Future Tasks

[ ] Create proto which ZITADEL is using as client and action implementation as server

[ ] Proto compiler to create proto from services

[ ] On request
[ ] On response

[ ] Proto compiler to create proto from events
[ ] Proto compiler to create stubs

[ ] ZITADEL action client
[ ] Language action server

[ ] move events to proto definitions
[ ] Sign calls to actions for call verification

analog to https://stripe.com/docs/webhooks#verify-manually

SDKs
SDKs allow easy implementation of actions. A developer should only implement the handler and the SDK starts the server to listen to events.

[ ] define languages to provide an SDK

Per language
If possible extend the already existing SDK

[ ] Implement REST server

[ ] overwrite default path path

[ ] Provides endpoint per trigger

[ ] Generate endpoints from proto
[ ] Allow custom implementation of handler
[ ] If possible: automatic protoc after change in ZITADEL

[ ] Verify signature from ZITADEL

analog to https://stripe.com/docs/webhooks#verify-manually

Targets
The object describes how ZITADEL interacts with the action.

id: uid
name: unique name of the target (e.g. ip_allow_list)
type: one of the below options

REST webhook: Only response status is used by ZITADEL, response payload is ignored
REST request/response: response status and payload are used. The payload is used to manipulate the object

url: URL to the REST POST endpoint
timeout: duration until ZITADEL cancels the query
async: if true the call is executed asynchronously
allowToFail: if true errors are ignored and flow is continued, if async is true this field is ignored

Response codes of the action are handled as follows:

successful: >= 200, < 300
follow redirect: >= 300, < 400
failure >= 400

Targets can be managed with the following calls:

CreateTarget: adds a new target
UpdateTarget: allows manipulation of the target
DeleteTarget: removes the target, the target will also be removed from requests/responses/functions/events

Request execution
It's possible to set the following conditions:

each proto method (e.g. UserService.AddHuman)
each proto service (e.g. UserService)
all requests

ZITADEL decides which condition is triggered like a proxy, the most exact match is executed. A condition is allowed once per instance.

condition: enum value analog conditions above
targets: ordered list of one of the following types

target: id of a predefined target
include: id of another condition

Requests can be managed with the following calls:

SetRequest: Creates or updates a request execution for the specified condition, there can only be one request object per condition

Response execution
It's possible to set the following conditions:

each proto method (e.g. UserService.AddHuman)
each proto service (e.g. UserService)
all requests

ZITADEL decides which condition is triggered like a proxy, the most exact match is executed. A condition is allowed once per instance.

condition: enum value analog conditions above
targets: ordered list of one of the following types

target: id of a predefined target
include: id of another condition

Responses can be managed with the following calls:

SetResponse: Creates or updates a response execution for the specified condition, there can only be one response object per condition

Function execution
It's possible to set the following conditions:

analog actions v1

The condition only allows exact match. A condition is allowed once per instance.

condition: enum value analog conditions above
targets: ordered list of one of the following types

target: id of a predefined target
include: id of another condition

Functions can be managed with the following calls:

SetFunction: Creates or updates a function execution for the specified condition, there can only be one function object per condition

Event execution
ZITADEL decides which condition is triggered like a proxy, the most exact match is executed. A condition is allowed once per instance.
ZITADEL sends events in the order they occurred and uses the same logic as for internal projections to execute the calls to the targets, including timeouts, failure handling, retries.

name: name of the item
condition: event type or event type group (e.g. user.added, user.*, *)
targets: ordered list of one of the following types

target: id of a predefined target of type webhook
include: id of another condition

Events can be managed with the following calls:

SetEvent: Creates or updates a event execution for the specified condition, there can only be one function object per condition

Examples
Show case
sequenceDiagram
    actor Client
    Client->>+ZITADEL: Create User
    ZITADEL->>ZITADEL: Get request execution for create user
    ZITADEL->>+AddMetadataToUser: request info
    AddMetadataToUser->>AddMetadataToUser: Add metadata
    AddMetadataToUser-->>-ZITADEL: updated user, ok
    ZITADEL->>ZITADEL: Store events
    ZITADEL->>ZITADEL: Get execution for "user.added" event
    ZITADEL->>+UserAddedHook: event (background processing)
    UserAddedHook->>LDAP: Store new user
    UserAddedHook-->>-ZITADEL: ok
    ZITADEL->>ZITADEL: Get response execution for create user
    ZITADEL->>+ResponseStateAsyncHook: response info
    ZITADEL->>-Client: ok
    ResponseStateAsyncHook->>-ResponseStateAsyncHook: Log user id

configuration
requests:
  all_requests:
    targets:
      - target: logger
      - target: allow_list
  user_service:
    targets:
      - include: all_requests
      - target: call_counter
  change_user:
    targets:
      - target: all_requests
  add_user:
    targets:
      - target: set_display_name
      - include: all_requests
      - include: user_service

responses:
  all_responses:
    targets:
      - target: hook
  user_service:
    # hook is called twice in this example
    targets:
      - include: all_responses
      - target: hook
  change_user:
    targets:
      - include: all_responses
      - target: hook
  add_user:
    targets:
      - include: user_service
      - target: hook

events:
  - name: milestones
    targets:
      - target: handler
      - target: queue
    condition:
      - project.*
  - name: users
    # only webhooks allowed
    targets:
      - target: webhook1
      - target: webhook2
    events:
      - user.added

function:
  create_id_token:
    targets:
      - target: hook

targets:
  allow_list:
    # response is not mapped to object
    # only status code is relevant
    type: webhook
    url: https://my.super.duper/endpoint/ip/allow/list
    timeout: 10s
    # returns an error if status code is >= 400
    allow_to_fail: false
    async: false
  allow_list_ignore_err:
    type: webhook
    url: https://my.super.duper/endpoint/ip/allow/list
    timeout: 10s
    allow_to_fail: true
    # awaiting http status
    async: false
  call_counter:
    type: webhook
    url: https://my.super.duper/endpoint/count/calls
    async: true
    timeout: 1s
    allow_to_fail: false
  logger:
    # response is NOT mapped to object
    type: webhook
    url: https://my.super.duper/endpoint/logger
    # NOT waiting for response
    async: true
    # allow_to_fail is irrelevant if async is true
    allow_to_fail: true
  set_display_name:
    # waiting for response
    # response is mapped to object
    type: request response
    url: https://my.super.duper/endpoint/users/displayname
    allow_to_fail: false
    timeout: 1s

https://github.com/zitadel/zitadel/issues/7025

@hifabienne, question about this epic: would it enable the management of Actions at the instance level?
We plan to use organizations to represent and isolate customers, but because Actions live at the organization, we would have to manage and duplicate actions thousands of times.

Hi @vs-gtadeu
Actions v2 will come available on org level before we deprecate actions v1. Actions v2 will start on instance level before it comes to org level


Weird hardcoded 010 event

@khaledJabr found a weird hardcoded 010 event coding in UniversalPetrarch that is also in Petrarch2. If we're reading it right, it assigns events a 010 code if some event info is missing.
Here's the code in UniversalPetrarch and here it is in Petrarch2. Could this explain the explosion in 010 events once we switched to Petrarch2? Anyone know what's going on here? cc @philip-schrodt

FWIW, it's my bad and got added into PETR-1 when I was frantically trying to do
a comparison of PETR-1 and PETR-2 using the Gigaword corpus for a paper I
presented at PRIO three years ago, and note that it is tactfully commented as
"a very crude hack"  In the original context, it only applied it some rare
situations involving some cases that invoked multi-word verbs (in English) but
seems to be getting called more frequently now, probably through some sort of
more general failure in the pattern matching.
That said, I should have embedded the problem in a try/except and done nothing
when the exception was hit rather than doing this.
Good to know the code controlling your nearby nuclear reactor probably contains
similar little tweaks. In MOSTech 6502 assembly language. As does Facebook's
code for protecting your private information, except it's written in Java by
the shop in Russia that submitted the lowest bid.

Resolved in commit  db1baef


[NT-463] Improve error handling for graph requests

📲 What
This PR makes some changes to how we make Graph requests, and how we parse responses from Graph requests.
🤔 Why
To improve error parsing/handling for graph requests and make our requests more robust to changes in the JSON structure coming back from the API. Also, to make graph requests more consistent with how our v1 requests are made.
🛠 How
Previously, we made all graph requests through a single performRequest function that started a data task within a producer and parsed errors and data in the completion block of that task. This approach was a little inconsistent with our approach for v1 requests, which splits up error handling and model decoding by running all error handling through rac_* helper functions defined in an extension of URLSession. These helpers also make use of Reactive Swift's data(with request:) function which is specially designed to return a SignalProducer which "performs work associated with an NSURLSession". It seemed like a good idea for Graph requests to follow a similar pattern of doing error handling in a similar rac_graphDataResponse function, and then running the resulting Data through a decoding function (decodeGraphModel).
Now, v1 requests are made like this (no change here):
 return Service.session.rac_JSONResponse(preparedRequest(forURL: paginationUrl))
      .flatMap(self.decodeModel)

... and Graph requests are made like this:
return Service.session.rac_graphDataResponse(request)
        .flatMap(self.decodeGraphModel)

♿ Accessibility
N/A
🏎 Performance
N/A
✅ Acceptance criteria
Setup: Using Charles Proxy, set up a breakpoint such that all requests hitting the Graph endpoint are intercepted.

[x] Test that aborted requests correctly show a request error.
[x] Test that removing the "data" field from a request with a validation error (ex. entering the wrong password when trying to change your email) does not affect parsing of the returned error. The message banner should still show the validation error returned from the API.
[x] Test that errors returned from the API (ex. entering the wrong password when changing your email) are correctly parsed and displayed.
[x] Test that modifying the response body to an invalid object correctly produces a decoding error

This all checks out! Only thing to mention is that during testing, it correctly produced a decoding error by way of entering that part of the code, but the message is still just "Something went wrong". Was that your intention?
If so - :shipit:

By "decoding error" are you referring to the error that results if the structure of the data doesn't match our expectation? If so, then yes this is the expected behavior.

By "decoding error" are you referring to the error that results if the structure of the data doesn't match our expectation? If so, then yes this is the expected behavior.

Yes. The console of course still said that it was a decoding error.


sylpheed: 3.6.0 -> 3.7.0

Semi-automatic update generated by https://github.com/ryantm/nix-update tools.
This update was made based on information from https://repology.org/metapackage/sylpheed/versions.
These checks were done:

built on NixOS
ran /nix/store/h2523jz7ladr0j6m3v6a0x45ak0z9iq8-sylpheed-3.7.0/bin/sylpheed --version and found version 3.7.0
found 3.7.0 with grep in /nix/store/h2523jz7ladr0j6m3v6a0x45ak0z9iq8-sylpheed-3.7.0
directory tree listing: https://gist.github.com/8f404aeeccf14771245b2a25b3a1231e

cc @edolstra for review

Success on x86_64-darwin (full log)
Attempted: sylpheed
Partial log (click to expand)
/nix/store/lg3mmqz4vy81yf0grg3mg8r8aqmvjlyl-sylpheed-3.7.0/lib/libsylph-0.1.dylib: fixing dylib
/nix/store/lg3mmqz4vy81yf0grg3mg8r8aqmvjlyl-sylpheed-3.7.0/lib/libsylpheed-plugin-0.1.dylib: fixing dylib
/nix/store/lg3mmqz4vy81yf0grg3mg8r8aqmvjlyl-sylpheed-3.7.0/lib/libsylph-0.1.dylib: fixing dylib
/nix/store/lg3mmqz4vy81yf0grg3mg8r8aqmvjlyl-sylpheed-3.7.0/lib/libsylpheed-plugin-0.1.dylib: fixing dylib
/nix/store/lg3mmqz4vy81yf0grg3mg8r8aqmvjlyl-sylpheed-3.7.0/lib/libsylph-0.1.dylib: fixing dylib
/nix/store/lg3mmqz4vy81yf0grg3mg8r8aqmvjlyl-sylpheed-3.7.0/lib/libsylpheed-plugin-0.1.dylib: fixing dylib
/nix/store/lg3mmqz4vy81yf0grg3mg8r8aqmvjlyl-sylpheed-3.7.0/lib/libsylph-0.1.dylib: fixing dylib
/nix/store/lg3mmqz4vy81yf0grg3mg8r8aqmvjlyl-sylpheed-3.7.0/lib/libsylpheed-plugin-0.1.dylib: fixing dylib
/nix/store/lg3mmqz4vy81yf0grg3mg8r8aqmvjlyl-sylpheed-3.7.0/lib/libsylph-0.1.dylib: fixing dylib
/nix/store/lg3mmqz4vy81yf0grg3mg8r8aqmvjlyl-sylpheed-3.7.0

Success on aarch64-linux (full log)
Attempted: sylpheed
Partial log (click to expand)
post-installation fixup
shrinking RPATHs of ELF executables and libraries in /nix/store/0x60ihf944hl56j9m2wf5mhsvlm3zks9-sylpheed-3.7.0
shrinking /nix/store/0x60ihf944hl56j9m2wf5mhsvlm3zks9-sylpheed-3.7.0/bin/sylpheed
shrinking /nix/store/0x60ihf944hl56j9m2wf5mhsvlm3zks9-sylpheed-3.7.0/lib/libsylpheed-plugin-0.so.1.3.0
shrinking /nix/store/0x60ihf944hl56j9m2wf5mhsvlm3zks9-sylpheed-3.7.0/lib/libsylph-0.so.1.3.0
strip is /nix/store/3zq400fri5dv7d30lpxlqm2v9y1iis6j-binutils-2.28.1/bin/strip
stripping (with command strip and flags -S) in /nix/store/0x60ihf944hl56j9m2wf5mhsvlm3zks9-sylpheed-3.7.0/lib  /nix/store/0x60ihf944hl56j9m2wf5mhsvlm3zks9-sylpheed-3.7.0/bin
patching script interpreter paths in /nix/store/0x60ihf944hl56j9m2wf5mhsvlm3zks9-sylpheed-3.7.0
checking for references to /build in /nix/store/0x60ihf944hl56j9m2wf5mhsvlm3zks9-sylpheed-3.7.0...
/nix/store/0x60ihf944hl56j9m2wf5mhsvlm3zks9-sylpheed-3.7.0


jcenter() End of life

Can you migrate com.microsoft.appcenter:espresso-test-extension:1.4 to maven?  Android Studio 4.2 is deprecating jcenter

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 02d8bdce-a2ad-80cb-efdb-74c0bb3ebb8c
Version Independent ID: b8d0b4a7-a6b0-42d6-aab3-58a9d8681502
Content: Preparing Espresso Tests for Upload - Visual Studio App Center
Content Source: docs/test-cloud/frameworks/espresso/index.md
Service: vs-appcenter
Sub-service: app-center-test
GitHub Login: @lucen-ms
Microsoft Alias: lucen

Hi! The espresso-test-extension was moved to the maven repository. Please see this guide about integration espresso tests via maven.


[meta] 7.6 release

Preliminary release notes for 7.6.0
(Generated from asciidoc release notes on 2020-02-03)
Breaking changes
Mapping

[x] Add a cluster setting to disallow loading fielddata on _id field #49166 (issues: #26472 #43599)

Breaking Java changes
Security

[x] Support Client and RoleMapping in custom Realms
#50534
(issue:
#48369)

Deprecations
Analysis

[x] Deprecate and remove camel-case nGram and edgeNGram tokenizers
#50862
(issue:
#50561): PR #4355

Authorization

[x] Deprecating kibana_user and kibana_dashboard_only_user roles
#46456

Distributed

[x] Deprecate synced flush
#50835
(issue:
#50776)

[x] Deprecate indices without soft-deletes
#50502

Features/Indices APIs

[x] Emit warnings when index templates have multiple mappings
#50982

Infra/Core

[x] Deprecate the local parameter of /_cat/nodes
#50499
(issue:
#50088) will be picked up by the generator

MULTIPLE AREA LABELS

[x] Ensure we emit a warning when using the deprecated template field.
#50831
(issue:
#49460)

[x] Add a deprecation warning regarding allocation awareness in search
request
#48351
(issue:
#43453)

Reindex

[x] Deprecate sorting in reindex
#49458
(issue:
#47567) PR #4357

Search

[x] Update the signature of vector script functions.
#48604

[x] Deprecate the sparse_vector field type.
#48315

New features
Aggregations

[x] New Histogram field mapper that supports percentiles aggregations.
#48580
(issue:
#48578) PR #4367

[x] Implement stats aggregation for string terms
#47468 PR #4370

Analysis

[x] Implement Lucene EstonianAnalyzer, Stemmer
#49149
(issue:
#48895) PR #4371

Features/ILM+SLM

[x] ILM action to wait for SLM policy execution
#50454
(issue:
#45067) PR #4375

[x] Add ILM histore store index
#50287
(issue:
#49180)

Features/Ingest

[x] CSV processor
#49509
(issue:
#49113) PR #4374

MULTIPLE AREA LABELS

[x] Password Protected Keystore (Feature Branch)
#49210

Machine Learning

[x] Implement precision and recall metrics for classification
evaluation
#49671
(issue:
#48759)

[x] [ML] Explain data frame analytics API
#49455

[x] [ML] ML Model Inference Ingest Processor
#49052 draft PR https://github.com/elastic/elasticsearch-net/pull/4412

[x] Implement accuracy metric for multiclass classification
#47772
(issue:
#48759)

Mapping

[x] Add per-field metadata.
#49419
(issue:
#33267) PR #4376

Search

[x] Add fuzzy intervals source
#49762
(issue:
#49595) PR #4379

[x] Add a listener to track the progress of a search request locally
#49471
(issue:
#49091)

Enhancements
Aggregations

[x] Add reusable HistogramValue object
#49799
(issue:
#49683)

[x] Optimize composite aggregation based on index sorting
#48399
(issue:
#48130)

Allocation

[x] Auto-expand indices according to allocation filtering rules
#48974

[x] Do not cancel ongoing recovery for noop copy on broken node
#48265
(issue:
#47974)

[x] Quieter logging from the DiskThresholdMonitor
#48115
(issue:
#48038)

[x] Faster access to INITIALIZING/RELOCATING shards
#47817
(issues:
#46941,
#48579)

Analysis

[x] Check for deprecations when analyzers are built
#50908
(issue:
#42349)

[x] Make Multiplexer inherit filter chains analysis mode
#50662
(issue:
#50554)

[x] Allow custom characters in token_chars of ngram tokenizers
#49250
(issue:
#25894) PR #4384

Authentication

[x] Add Debug/Trace logging for authentication
#49575
(issue:
#49473)

Authorization

[x] Increase Size and lower TTL on DLS BitSet Cache
#50535
(issues:
#43669,
#49260)

[x] Add monitor_snapshot cluster privilege
#50489
(issue:
#50210)

[x] Remove reserved roles for code search
#50068
(issue:
#49842)

[x] [Code] Remove code_admin/code_user roles
#48164

[x] Resolve the role query and the number of docs lazily
#48036

CCR

[x] Improve error message when pausing index
#48915

[x] Use MultiFileTransfer in CCR remote recovery
#44514
(issue:
#44468)

CRUD

[x] print id detail when id is too long.
#49433

[x] Add preflight check to dynamic mapping updates
#48817
(issue:
#35564)

Cluster Coordination

[x] Move metadata storage to Lucene
#50907
(issue:
#48701)

[x] Remove custom metadata tool
#50813
(issue:
#48701)

Distributed

[x] Use retention lease in peer recovery of closed indices
#48430
(issue:
#45136)

Engine

[x] Do not force refresh when write indexing buffer
#50769

[x] Deleted docs disregarded for if_seq_no check
#50526

[x] Allow realtime get to read from translog
#48843

[x] Do not warm up searcher in engine constructor
#48605
(issue:
#47186)

[x] Add a new merge policy that interleaves old and new segments on
force merge
#48533
(issue:
#37043)

[x] Refresh should not acquire readLock
#48414
(issue:
#47186)

Features/ILM+SLM

[x] Refresh cached phase policy definition if possible on new poli…
#50820
(issue:
#48431)

[x] Make the UpdateRolloverLifecycleDateStep retryable
#50702
(issue:
#48183)

[x] Make InitializePolicyContextStep retryable
#50685
(issue:
#48183)

[x] ILM retryable async action steps
#50522
(issues:
#44135,
#48183)

[x] Make the TransportRolloverAction execute in one cluster state update
#50388

[x] ILM open/close steps are noop if idx is open/close
#48614

[x] ILM Make the check-rollover-ready step retryable
#48256
(issue:
#44135) PR #4391

Features/Ingest

[x] Foreach processor - fork recursive call
#50514

[x] Sync grok patterns with logstash patterns
#50381

[x] Replace required pipeline with final pipeline
#49470
(issue:
#49247) PR https://github.com/elastic/elasticsearch-net/pull/4401

[x] Add templating support to enrich processor
#49093

[x] Introduce on_failure_pipeline ingest metadata inside on_failure
block #49076
(issue:
#44920)

[x] Add templating support to pipeline processor.
#49030
(issue:
#39955)

[x] Add option to split processor for preserving trailing empty fields
#48664
(issue:
#48498) PR https://github.com/elastic/elasticsearch-net/pull/4402

[x] Change grok watch dog to be Matcher based instead of thread based.
#48346
(issues:
#43673,
#47374)

[x] update ingest-user-agent regexes.yml
#47807

Features/Java High Level REST Client

[x] Add remote info to the HLRC
#49657
(issue:
#47678)

[x] Add delete alias to the HLRC
#48819
(issue:
#47678)

Features/Monitoring

[x] Significantly Lower Monitoring HttpExport Memory Footprint
#48854

[x] Validate proxy base path at parse time
#47912
(issue:
#47711)

[x] Validate index name time format setting at parse time
#47911
(issue:
#47711)

[x] Validate monitoring header overrides at parse time
#47848
(issue:
#47711)

[x] Validate monitoring username at parse time
#47821
(issue:
#47711)

[x] Validate monitoring password at parse time
#47740
(issue:
#47711)

Features/Watcher

[x] Log attachment generation failures
#50080

[x] Don’t dump a stacktrace for invalid patterns when executing
elasticse…
#49744
(issue:
#49642)

Geo

[x] "CONTAINS" support for BKD-backed geo_shape and shape fields
#50141
(issue:
#41204)

[x] Adds support for geo-bounds filtering in geogrid aggregations
#50002 PR https://github.com/elastic/elasticsearch-net/pull/4403

[x] Introduce faster approximate sinh/atan math functions
#49009
(issue:
#41166)

[x] Add IndexOrDocValuesQuery to GeoPolygonQueryBuilder
#48449

Infra/Core

[x] Add "did you mean" to ObjectParser
#50938

[x] Consistent case in CLI option descriptions
#49635

[x] Improve resiliency to formatting JSON in server
#48553
(issue:
#48450)

[x] Don’t close stderr under --quiet
#47208
(issue:
#46900)

Infra/Packaging

[x] Respect ES_PATH_CONF on package install
#50158

[x] Restrict support for CMS to pre-JDK 14
#49123
(issue:
#46973)

[x] Remove parsed JVM settings from general settings in Windows service
daemon manager
#49061
(issue:
#48796)

[x] Package the JDK into jdk.app on macOS
#48765

[x] Add UBI-based Docker images
#48710
(issue:
#48429)

Infra/Plugins

[x] Report progress of multiple plugin installs
#51001
(issue:
#50924)

[x] Allow installing multiple plugins as a transaction
#50924
(issue:
#50443)

Infra/Scripting

[x] Scripting: ScriptFactory not required by compile
#50344
(issue:
#49466)

[x] Scripting: Cache script results if deterministic
#50106
(issue:
#49466)

[x] Scripting: Groundwork for caching script results
#49895
(issue:
#49466)

[x] Scripting: add available languages & contexts API
#49652
(issue:
#49463) EXPERIMENTAL API

[x] Scripting: fill in get contexts REST API
#48319
(issue:
#47411) EXPERIMENTAL API

[x] Scripting: get context names REST API
#48026
(issue:
#47411) EXPERIMENTAL API

Infra/Settings

[x] Add parameter to make sure that log of updating IndexSetting be more
detailed
#49969
(issue:
#49818)

[x] Enable dependent settings values to be validated
#49942

[x] Do not reference values for filtered settings
#48066

License

[x] Add max_resource_units to enterprise license
#50735

[x] Add setting to restrict license types
#49418
(issue:
#48508)

[x] Support "enterprise" license types
#49223
(issue:
#48510) PR https://github.com/elastic/elasticsearch-net/pull/4406

MULTIPLE AREA LABELS

[x] Add ingest info to Cluster Stats
#48485
(issue:
#46146) PR https://github.com/elastic/elasticsearch-net/pull/4407

Machine Learning

[x] [ML] Add audit warning for 1000 categories found early in job
#51146
(issue:
#50749)

[x] [ML] Add num_top_feature_importance_values param to regression
and classi…
#50914

[x] [ML] Implement force deleting a data frame analytics job
#50553
(issue:
#48124) will be picked up by generator

[x] [ML] Delete unused data frame analytics state
#50243

[x] Make each analysis report desired field mappings to be copied
#50219
(issue:
#50119)

[x] [ML] retry bulk indexing of state docs
#50149
(issue:
#50143)

[x] [ML] Persist/restore state for DFA classification
#50040

[x] [ML] Introduce randomize_seed setting for regression and
classification
#49990

[x] Pass prediction_field_type to C++ analytics process
#49861
(issue:
#49796)

[x] [ML] Add optional source filtering during data frame reindexing
#49690
(issue:
#49531)

[x] [ML] Add default categorization analyzer definition to ML info
#49545 PR https://github.com/elastic/elasticsearch-net/pull/4408

[x] [ML] Add graceful retry for anomaly detector result indexing
failures
#49508
(issue:
#45711)

[x] Lower minimum model memory limit value from 1MB to 1kB.
#49227
(issue:
#49168)

[x] Throw an exception when memory usage estimation endpoint encounters
empty data frame.
#49143
(issue:
#49140)

[x] Change format of MulticlassConfusionMatrix result to be more
self-explanatory
#48174
(issue:
#46735)

[x] Make num_top_classes parameter’s default value equal to 2
#48119
(issue:
#46735)

[x] [ML] Improve model_memory_limit UX for data frame analytics jobs
[ISSUE]
#44699

Mapping

[x] Add telemetry for flattened fields.
#48972 PR https://github.com/elastic/elasticsearch-net/pull/4409

Network

[x] Add certutil http command
#49827

[x] Do not load SSLService in plugin contructor
#49667
(issue:
#44536)

[x] Netty4: switch to composite cumulator
#49478

[x] Add the simple strategy to cluster settings
#49414
(issue:
#49067)

[x] Deprecate misconfigured SSL server config
#49280
(issue:
#45892)

[x] Improved diagnostics for TLS trust failures
#48911

Percolator

[x] Refactor percolator’s QueryAnalyzer to use QueryVisitors
#49238
(issue:
#45639)

Ranking

[x] Support search_type in Rank Evaluation API
#48542
(issue:
#48503)

Recovery

[x] Use peer recovery retention leases for indices without soft-deletes
#50351
(issues:
#45136,
#46959)

[x] Recovery buffer size 16B smaller
#50100

Reindex

[x] Reindex sort deprecation warning take 2
#49855
(issue:
#49458)

SQL

[x] SQL: Add TRUNC alias for TRUNCATE
#49571
(issue:
#41195)

[x] SQL: binary communication implementation for drivers and the CLI
#48261
(issue:
#47785)

Search

[x] Add Validation for maxQueryTerms to be greater than 0 for
MoreLikeThisQuery
#49966
(issue:
#49927)

[x] Optimize numeric sort on match_all queries
#49717
(issue:
#48804)

[x] Pre-sort shards based on the max/min value of the primary sort field
#49092
(issue:
#49091)

[x] Optimize sort on long field
#48804

[x] Search optimisation - add canMatch early aborts for queries on
"_index" field
#48681
(issue:
#48473)

[x] #48475 Pure disjunctions should rewrite to a MatchNoneQueryBuilder
#48557

[x] Disable caching when queries are profiled
#48195
(issue:
#33298)

[x] BlendedTermQuery’s equals method should consider boosts
#48193
(issue:
#48184)

[x] Increase the number of vector dims to 2048
#46895

Security

[x] Make .async-search-* a restricted namespace
#50294

[x] Security should not reload files that haven’t changed
#50207
(issue:
#50063)

Snapshot/Restore

[x] Use Cluster State to Track Repository Generation
#49729
(issue:
#49060)

[x] Track Repository Gen. in BlobStoreRepository
#48944
(issues:
#38941,
#47520,
#47834,
#49048)

[x] Restore from Individual Shard Snapshot Files in Parallel
#48110
(issue:
#42791)

[x] Track Shard-Snapshot Index Generation at Repository Root
#46250
(issues:
#38941,
#45736)

Store

[x] mmap dim files in HybridDirectory
#49272
(issue:
#48509)

Transform

[x] [Transform] Improve force stop robustness in case of an error
#51072

[x] [Transform] add actual timeout in message
#50140

[x] [Transform] automatic deletion of old checkpoints
#49496

[x] [Transform] improve error handling of script errors
#48887
(issue:
#48467)

[x] [ML][Transforms] add wait_for_checkpoint flag to stop
#47935
(issue:
#45293)

Bug fixes
Aggregations

[x] Fix format problem in composite of unmapped
#50869
(issue:
#50600)

[x] SingleBucket aggs need to reduce their bucket’s pipelines first
#50103
(issue:
#50054)

[x] Avoid precision loss in DocValueFormat.RAW#parseLong
#49063
(issue:
#38692)

[x] Fix ignoring missing values in min/max aggregations
#48970
(issue:
#48905)

Allocation

[x] Collect shard sizes for closed indices
#50645
(issue:
#33888)

[x] Auto-expand replicated closed indices
#48973

[x] Ignore dangling indices created in newer versions
#48652
(issue:
#34264)

[x] Handle negative free disk space in deciders
#48392
(issue:
#48380)

Analysis

[x] Throw Error on deprecated nGram and edgeNGram custom filters
#50376
(issue:
#50360)

[x] _analyze api does not correctly use normalizers when specified
#48866
(issue:
#48650)

Audit

[x] Audit log filter and marker
#45456
(issue:
#47251)

Authentication

[x] Don’t fallback to anonymous for tokens/apikeys
#51042
(issue:
#50171)

[x] Populate User metadata with OpenIDConnect collections
#50521
(issue:
#50250)

[x] Always return 401 for not valid tokens
#49736
(issue:
#38866)

[x] Fix iterate-from-1 bug in smart realm order
#49473

[x] Remove unnecessary details logged for OIDC
#48746

[x] Add owner flag parameter to the rest spec
#48500
(issue:
#48499) will be picked up by generator.

Authorization

[x] Fix memory leak in DLS bitset cache
#50635
(issue:
#49261)

[x] Validate field permissions when creating a role
#50212
(issues:
#46275,
#48108)

[x] Validate field permissions when creating a role
#48108
(issue:
#46275)

CCR

[x] CCR should auto-retry rejected execution exceptions
#49213

CRUD

[x] Block too many concurrent mapping updates
#51038
(issue:
#50670)

[x] Ensure meta and document field maps are never null in GetResult
#50112
(issue:
#48215)

[x] Replicate write actions before fsyncing them
#49746

[x] Do not mutate request on scripted upsert
#49578
(issue:
#48670)

[x] Fix Transport Stopped Exception
#48930
(issue:
#42612)

[x] Return consistent source in updates
#48707

[x] Close query cache on index service creation failure
#48230
(issue:
#48186)

Cluster Coordination

[x] Import replicated closed dangling indices
#50649

[x] Ignore metadata of deleted indices at start
#48918

[x] Make elasticsearch-node tools custom metadata-aware
#48390

Discovery-Plugins

[x] Make EC2 Discovery Cache Empty Seed Hosts List
#50607
(issue:
#50550)

[x] Make EC2 Discovery Plugin Retry Requests
#50550
(issue:
#50462)

Distributed

[x] Closed shard should never open new engine
#47186
(issues:
#45263,
#47060)

Engine

[x] Account trimAboveSeqNo in committed translog generation
#50205
(issue:
#49970)

[x] Greedily advance safe commit on new global checkpoint
#48559
(issue:
#48532)

[x] Do not ignore exception when trim unreferenced readers
#48470

Features/Features

[x] Fix X-Pack SchedulerEngine Shutdown
#48951

Features/ILM+SLM

[x] Fix SLM check for restore in progress
#50868

[x] Handle failure to retrieve ILM policy step better
#49193
(issue:
#49128)

[x] Don’t halt policy execution on policy trigger exception
#49128

[x] Re-read policy phase JSON when using ILM’s move-to-step API
#48827

[x] Don’t schedule SLM jobs when services have been stopped
#48658
(issue:
#47749)

[x] Ensure SLM stats does not block an in-place upgrade from 7.4
#48367

[x] Ensure SLM stats does not block an in-place upgrade from 7.4
#48361

[x] Add SLM support to xpack usage and info APIs
#48096
(issue:
#43663)

[x] Change policy_id to list type in slm.get_lifecycle
#47766
(issue:
#47765) will be picked up by generator

Features/Ingest

[x] Fix ignore_missing in CsvProcessor
#51600

[x] Don’t overwrite target field with SetSecurityUserProcessor
#51454
(issue:
#51428)

[x] Fix ingest simulate response document order if processor executes
async #50244

[x] Allow list of IPs in geoip ingest processor
#49573
(issue:
#46193) PR https://github.com/elastic/elasticsearch-net/pull/4410

[x] Do not wrap ingest processor exception with IAE
#48816
(issue:
#48810)

[x] Introduce dedicated ingest processor exception
#48810
(issue:
#48803)

Features/Java High Level REST Client

[x] Support es7 node http publish_address format
#49279
(issue:
#48950)

[x] Add slices to delete and update by query in HLRC
#48420

[x] fix incorrect comparison
#48208

[x] Fix HLRC parsing of CancelTasks response
#47017

Features/Java Low Level REST Client

[x] Improve warning value extraction performance in Response
#50208
(issue:
#24114)

Features/Monitoring

[x] Validate exporter type is HTTP for HTTP exporter
#49992
(issues:
#47246,
#47711,
#49942)

Geo

[x] Guard against null geoBoundingBox
#50506
(issue:
#50505)

[x] Geo: Switch generated GeoJson type names to camel case (#50285)
#50400
(issue:
#49568)

[x] Geo: Switch generated WKT to upper case
#50285
(issue:
#49568)

[x] Fix typo when assigning null_value in GeoPointFieldMapper
#49645

[x] Fix handling of circles in legacy geo_shape queries
#49410
(issue:
#49296)

[x] GEO: intersects search for geo_shape return wrong result [ISSUE]
#49017

[x] Geo: improve handling of out of bounds points in linestrings
#47939
(issue:
#43916)

Highlighting

[x] Fix invalid break iterator highlighting on keyword field
#49566

Infra/Core

[x] Ignore virtual ethernet devices that disappear
#51581
(issue:
#49914)

[x] Guess root cause support unwrap
#50525
(issue:
#50417)

[x] Allow parsing timezone without fully provided time
#50178
(issue:
#49351)

[x] [Java.time] Retain prefixed date pattern in formatter
#48703
(issue:
#48698)

[x] Don’t drop user’s MaxDirectMemorySize flag on jdk8/windows
#48657
(issues:
#44174,
#48365)

[x] Warn when MaxDirectMemorySize may be incorrect (Windows/JDK8 only
issue)
#48365
(issue:
#47384)

[x] [Java.time] Calculate week of a year with ISO rules
#48209
(issues:
#41670,
#42588,
#43275,
#43652)

Infra/Logging

[x] Slow log must use separate underlying logger for each index
#47234
(issue:
#42432)

Infra/Packaging

[x] Extend systemd timeout during startup
#49784
(issue:
#49593)

Infra/REST API

[x] Return 400 when handling invalid JSON
#49552
(issue:
#49428)

[x] Slash missed in indices.put_mapping url
#49468

MULTIPLE AREA LABELS

[x] Fix meta version of task index mapping
#50363
(issue:
#48393)

[x] Prevent deadlock by using separate schedulers
#48697
(issues:
#41451,
#47599)

[x] APM system_user
#47668
(issues:
#2708,
#40876)

Machine Learning

[x] [ML] Validate classification dependent_variable cardinality is at
lea… #51232

[x] Do not copy mapping from dependent variable to prediction field in
regression analysis
#51227

[x] Handle nested and aliased fields correctly when copying mapping.
#50918
(issue:
#50787)

[x] [ML] Fix off-by-one error in ml_classic tokenizer end offset
#50655

[x] [ML] Improve uniqueness of result document IDs
#50644
(issue:
#50613)

[x] [7.x] Synchronize processInStream.close() call
#50581
(issue:
#49680)

[x] Fix accuracy metric
#50310
(issue:
#48759)

[x] Fix race condition when stopping a data frame analytics jobs
immediately after starting it
#50276
(issues:
#49680,
#50177)

[x] Use query in cardinality check
#49939

[x] Make only a part of stop() method a critical section.
#49756
(issue:
#49680)

[x] Fix expired job results deletion audit message
#49560
(issue:
#49549)

[x] [ML] Apply source query on data frame analytics memory estimation
#49517
(issue:
#49454)

[x] Stop timing stats failure propagation
#49495

[x] [ML] Fix r_squared eval when variance is 0
#49439

[x] Blacklist a number of prediction field names.
#49371
(issue:
#48808)

[x] Make AnalyticsProcessManager class more robust
#49282
(issue:
#49095)

[x] [ML] Fixes for stop datafeed edge cases
#49191
(issues:
#43670,
#48931)

[x] [ML] Avoid NPE when node load is calculated on job assignment
#49186
(issue:
#49150)

[x] Do not throw exceptions resulting from persisting datafeed timing
stats.
#49044
(issue:
#49032)

[x] [ML] Deduplicate multi-fields for data frame analytics
#48799
(issues:
#48756,
#48770)

[x] [ML] Prevent fetching multi-field from source
#48770
(issue:
#48756)

Mapping

[x] Ensure that field collapsing works with field aliases.
#50722
(issues:
#32648,
#50121)

[x] Improve DateFieldMapper ignore_malformed handling
#50090
(issues:
#46675,
#50081)

[x] Annotated text type should extend TextFieldType
#49555
(issue:
#49289)

[x] Ensure parameters are updated when merging flattened mappings.
#48971
(issue:
#48907)

Network

[x] Fix TransportMasterNodeAction not Retrying NodeClosedException
#51325

Percolator

[x] Correctly handle MSM for nested disjunctions
#50669
(issue:
#50305)

[x] Fix query analyzer logic for mixed conjunctions of terms and ranges
#49803
(issue:
#49684)

Recovery

[x] Check allocation id when failing shard on recovery
#50656
(issue:
#50508)

[x] Migrate peer recovery from translog to retention lease
#49448
(issue:
#45136)

[x] Ignore Lucene index in peer recovery if translog corrupted
#49114

Reindex

[x] Reindex and friends fail on RED shards
#45830
(issues:
#42612,
#45739)

SQL

[x] SQL: Optimisation fixes for conjunction merges
#50703
(issue:
#49637)

[x] SQL: Fix issue with CAST and NULL checking.
#50371
(issue:
#50191)

[x] SQL: fix NPE for JdbcResultSet.getDate(param, Calendar) calls
#50184
(issue:
#50174)

[x] SQL: COUNT DISTINCT returns 0 instead of NULL for no matching docs
#50037
(issue:
#50013)

[x] Fix LOCATE function optional parameter handling
#49666
(issue:
#49557)

[x] Fix NULL handling for FLOOR and CEIL functions
#49644
(issue:
#49556)

[x] Handle NULL arithmetic operations with INTERVALs
#49633
(issue:
#49297)

[x] Fix issue with GROUP BY YEAR()
#49559
(issue:
#49386)

[x] Fix issue with CASE/IIF pre-calculating results
#49553
(issue:
#49388)

[x] Fix issue with folding of CASE/IIF
#49449
(issue:
#49387)

[x] Fix issues with WEEK/ISO_WEEK/DATEDIFF
#49405
(issues:
#48209,
#49376)

[x] SQL: Fix issue with mins & hours for DATEDIFF
#49252

[x] SQL: Failing Group By queries due to different ExpressionIds
#43072
(issues:
#33361,
#34543,
#36074,
#37044,
#40001,
#40240,
#41159,
#42041,
#46316)

Search

[x] Fix upgrade of custom similarity
#50851
(issue:
#50763)

[x] Fix NPE bug inner_hits
#50709
(issue:
#50539)

[x] Collect results in a local list when notifying partial results
#49828
(issue:
#49778)

[x] Fixes a bug in interval filter serialization
#49793
(issue:
#49519)

[x] Correctly handle duplicates in unordered interval matching
#49775

[x] Correct rewritting of script_score query
#48425
(issue:
#48081)

[x] Do not throw errors on unknown types in SearchAfterBuilder
#48147
(issue:
#48074)

Security

[x] Always consume the body in has privileges
#50298
(issue:
#50288)

Snapshot/Restore

[x] Fix Overly Aggressive Request DeDuplication
#51270
(issue:
#51253)

[x] Guard Repository#getRepositoryData for exception throw
#50970

[x] Fix Index Deletion During Partial Snapshot Create
#50234
(issues:
#50200,
#50202)

[x] Fix Index Deletion during Snapshot Finalization
#50202
(issues:
#45689,
#50200)

[x] Fix RepoCleanup not Removed on Master-Failover
#49217

[x] Make FsBlobContainer Listing Resilient to Concurrent Modifications
#49142
(issue:
#37581)

[x] Fix SnapshotShardStatus Reporting for Failed Shard
#48556
(issue:
#48526)

[x] Cleanup Concurrent RepositoryData Loading
#48329
(issue:
#48122)

Transform

[x] [Transform] fail to start/put on missing pipeline
#50701
(issue:
#50135)

[x] Fix possible audit logging disappearance after rolling upgrade
#49731
(issue:
#49730)

[x] [Transform] do not fail checkpoint creation due to global
checkpoint mismatch
#48423
(issue:
#48379)

Upgrades
Engine

[x] Upgrade to Lucene 8.4.0.
#50518

Infra/Packaging

[x] Upgrade the bundled JDK to JDK 13.0.2
#51511

NOT CLASSIFIED
Aggregations

[x] Revert "Begin moving date_histogram to offset rounding (backport of
#50873) (#50978)"
#51240

Authentication

[x] Change password API authenticating with a bearer token [ISSUE]
#48752

Closing this issue as all checklist items have been checked, and will be going into a 7.6.0 release shortly.


Key timing graph - use dark shade rather than solid block for 'mark' …

…bars (Windows block is smaller for some reason).

Closes #286


Fix Grafana Drilldown Graphs

The path for the public dashboards has changed in the new base
image grafana/grafana:7.4.2

How to review and check:

Deploy dev, metric and log pipelines without the change (master branch).
Login into Horizon with mini-mon/password.
Open in other browser tag this link.

http://<IP-ADDRESS>/grafana/dashboard/script/drilldown.js?metric=mem.used_bytes&hostname=docker-host&unit=bytes

⚠ Grafana shows an alert about the missing dashboard.
4. Deploy dev, metric and log pipelines with the change (fix/grafana-drilldown)
5. Login into Horizon with mini-mon/password.
6. Open in other browser tag this link.
http://<IP-ADDRESS>/grafana/dashboard/script/drilldown.js?metric=mem.used_bytes&hostname=docker-host&unit=bytes

📈 Grafana will show the Graph about memory used in bytes.


[SOP Document] Structured EHR Data

Items to be considered to include:

Standardization
De-identification
Tools that either should or recommended to be used

Implementing OMOP Mapping Principles
Integrating Mappings in OMOP ETL Processes
Managing Unmappable OMOP Concepts
Contributing New OMOP Concepts or Vocabulary


Bug with trips shortcut

When using the l shortcut to get to the logs/trips window. The Cave column disappears from the refreshed table if you were already in the logs/trips window.
It does not happen if you cycle between the windows normally.
And does not happed with other windows.

Not produceable on second machine. Leaving open in case I see it again.

Figured it. When the terminal window is too small (not wide enough) the column gets dropped.
Solution resize your terminal window


k8s offload access denied

hello
I have a issue with the s3 tiered offload two exact configurations, using different buckets, one works and the other one doesn't i got this when i try to check the offload status after trying to trigger it manually with topics offload (the one that doesnt work isnt a fresh start so it has some previous data)
Error in offload

null

Reason: Error offloading: org.apache.bookkeeper.mledger.ManagedLedgerException: java.util.concurrent.CompletionException: org.jclouds.rest.AuthorizationException: Access Denied

I am using pulsar 2.6.1 i have set the following configuration in the brokers
managedLedgerOffloadDriver: "aws-s3"
s3ManagedLedgerOffloadRegion: "us-east-1"
s3ManagedLedgerOffloadBucket: bucketname
s3ManagedLedgerOffloadRole: rolename
s3ManagedLedgerOffloadRoleSessionName: sessioname

the role name has the following perms both have the same the only difference its the bucket name, i even tried with s3 full access and no luck
{
    "Statement": [
        {
            "Action": [
                "s3:PutObject",
                "s3:GetObject",
                "s3:DeleteObject",
                "s3:ListBucket",
                "s3:GetBucketLocation"
            ],
            "Resource": [
                "arn:aws:s3:::bucketname",
                "arn:aws:s3:::bucktname/*"
            ],
            "Effect": "Allow"
        }
    ]
}

is there something else i can check between the two?
appreciate any feedback
thanks

From @joncashe :
so after testing a little bit more im not sure why its happening but it seems i was using in my first config a s3 bucket and then i changed to a new one replacing the value in the s3ManagedLedgerOffloadBucket, but it seems the ledger its still trying to offload to the previous bucket the way i found this was when i give it full access to the s3 so this time i didnt get the access denied error and the offload was done to the first bucket i set
im trying to look which places are still pointing to the old s3 bucket because the broker.conf its using the new one i set in the s3ManagedLedgerOffloadBucket
any ideas?
thanks

From @joncashe :
so after testing a little bit more im not sure why its happening but it seems i was using in my first config a s3 bucket and then i changed to a new one replacing the value in the s3ManagedLedgerOffloadBucket, but it seems the ledger its still trying to offload to the previous bucket the way i found this was when i give it full access to the s3 so this time i didnt get the access denied error and the offload was done to the first bucket i set
im trying to look which places are still pointing to the old s3 bucket because the broker.conf its using the new one i set in the s3ManagedLedgerOffloadBucket
any ideas?
thanks

@joncashe - Did you set the offload policies in the namespace policy? One of the possibilities is that you set the namespace policy. Otherwise, I don't expect the bucket is persisted somewhere else.

@joncashe - Did you set the offload policies in the namespace policy? One of the possibilities is that you set the namespace policy. Otherwise, I don't expect the bucket is persisted somewhere else.

@sijie thanks you were right although i replace the parameter it was still using the old bucket in the offload namespace policy
i was able to replace it through the pulsar-admin cli tool
do you know exactly in which file this change its applied?
i guess we can say its solved
thanks

@sijie thanks you were right although i replace the parameter it was still using the old bucket in the offload namespace policy
i was able to replace it through the pulsar-admin cli tool
do you know exactly in which file this change its applied?
i guess we can say its solved
thanks

The namespace policy is stored in zookeeper.

The namespace policy is stored in zookeeper.

@joncashe I am closing this issue for now. If you have any other questions, feel free to reopen it or create a new one.

@joncashe I am closing this issue for now. If you have any other questions, feel free to reopen it or create a new one.


feat(mysql): fix_bug_for_account_rule_check

关联研发信息
dev_branch: feat/fix_bug_for_account_rule_check/#4583
target_branch: v1.3.0