Persistent IP collection is always using hash on user-agent when storing keys at database

Hi there...
Using libmodsecurity v3 latest 3.0.8.
I can start a new collection by:
initcol:ip=%{remote_addr}
but have noticed there is a hash just after the IP in the lmdb keys being stored...

key: 0x7f52e789122c <IP_ADDRESS>_8fa902c8b3f6ce55c295f79d74a9caf267c02599::::hits_count, data: 0x7f52e7891270 2
key: 0x7f52e78912d0 <IP_ADDRESS>_c0bf39a203266f322cafe8b44bb1a036eec5a58d::::hits_count, data: 0x7f52e7891314 598

I have noticed, this hash from "<IP_ADDRESS>_c0bf39a203266f322cafe8b44bb1a036eec5a58d", is just the user-agent being used, so it is just "IP_(hash of user-agent)" for the keys.
I think it is a bit strange, since I only have initialized the collection with the variable '%{remote_addr}'.
Whats the main problem here? Common xploiters do usually modify their user-agents on several multiple requests, so this IP collection is almost useless: cannot track correctly the IP of the "attacker".
Last night, had almost 60-70 keys for the same IP in the lmdb database... couldn't apply my rules for the offending IP, as the counters did not trigger limits.
I guess this is not the ideal situation. If I were interested in attaching user-agent to the IP in the collection keys, I would have done it via 'initcol:ip='. For me, user-agent is not important here since I only want to have a look at IPs... that's my collection for.
So, could this suppose a bug or is it something fixable?
Thanks so much for your work and efforts.

Even noticed I could init collection by using:
initcol:ip="fixed"
and it doesn't really matters... it is going to perform exactly the same:
keys = IP_

Hi @feanorknd ,
It shouldn't be the ModSecurity engine itself that is doing that.
My assumption is that the rule you are using to do the initcol is explicitly doing that. For example, if you happen to be using coreruleset (CRS), then I believe they have a rule that does exactly that sort of concatenation during initcol.
Doing that concatenation has advantages for some use cases, but potential disadvantages for others. If you're curious to inquire further, you may wish to raise this with coreruleset (the CRS rules are managed by a separate group).

Hi @martinhsv,
you were certain.... I have been using my own rules, but have checked and CRS initalization is creating the collection on its own, although not being used later because I do not include their DOS controller.....

root@ispconfig /etc/modsecurity/owasp/rules # grep initcol *
REQUEST-901-INITIALIZATION.conf:    initcol:global=global,
REQUEST-901-INITIALIZATION.conf:    initcol:ip=%{remote_addr}_%{tx.ua_hash},\

Once again, it's my fault to open an issue for this... didn't check everything I guess.
Thanks so much for your words.


Upgrade sqlx to 0.6

I don't think there is anything needed to do here. But sea-query has to modify the driver support

Version bumped on https://github.com/SeaQL/sea-schema/commit/2e42cf7d801701372af72982e90c95e39238afac


[Android] Images are not showing using local assets or remote image.

React Native version:
React Native Environment Info:
System:
OS: Windows 10
CPU: (8) x64 Intel(R) Core(TM) i5-8300H CPU @ 2.30GHz
Memory: 7.54 GB / 15.85 GB
Binaries:
Yarn: 1.15.2 - C:\Program Files (x86)\Yarn\bin\yarn.CMD
npm: 6.9.0 - C:\Program Files\nodejs\npm.CMD
IDEs:
Android Studio: Version  <IP_ADDRESS> AI-181.55<IP_ADDRESS>56338
Steps To Reproduce
Here's the code
Poster.js
const Poster = ({ imageURL }) => {
  const { width } = Dimensions.get("window");
  console.log(imageURL);
  return (
    <View style={{ padding: 5 }}>
      <Image
        source={imageURL}
        style={{
          width: Math.floor(width / 2 - 30),
          height: 300,
          flex: 1,
          borderRadius: 10,
        }}
      />
    </View>
  );
};

It's being called from here.
MovieGrid.js
....
     <View style={movieGrid}>
          <Poster imageURL={require("../images/image.jpg")} />
          <Poster imageURL={require("../images/1.jpg")} />
          <Poster imageURL={require("../images/2.jpg")} />
        </View>
      </View>
....

When I run the same app in the browser using Expo it works fine but when I run it on an emulator or a physical device it doesn't show the images.
In the Web Browser

On Emulator

Also require('../images/image.jpg') returns a number

Working with images is such a pain 😥
Thank you for your time.

I currently have this issue too. My images appear fine on a fresh react-native init app when running on android in debug and release mode.
However in my current application, images and assets appear fine in debug but do not appear in release.
  React Native Environment Info:
    System:
      OS: macOS 10.14.5
      CPU: (8) x64 Intel(R) Core(TM) i7-3615QM CPU @ 2.30GHz
      Memory: 1.28 GB / 16.00 GB
      Shell: 5.3 - /bin/zsh
    Binaries:
      Node: 10.2.1 - /usr/local/bin/node
      Yarn: 1.7.0 - /usr/local/bin/yarn
      npm: 5.6.0 - /usr/local/bin/npm
    SDKs:
      iOS SDK:
        Platforms: iOS 12.2, macOS 10.14, tvOS 12.2, watchOS 5.2
    IDEs:
      Android Studio: 3.4 AI-183.6<IP_ADDRESS>22156
      Xcode: 10.2.1/10E1001 - /usr/bin/xcodebuild
    npmPackages:
      react: ^16.8.3 => 16.8.6
      react-native: ^0.59.8 => 0.59.9
    npmGlobalPackages:
      react-native-cli: 2.0.1

I'm having quite the same here. On emulator works but on real device there's no image (android only).
return (<Image style={styles.image} resizeMode={'contain'} source={require('../../assets/images/logo.png')} />);

"react": "16.8.3",
"react-native": "0.59.5",

Might not be related, but in my release build configs, I had minify and Shrink Resources, which made all files turn black:
buildTypes {
  release {
    singingConfig signingConfigs.release

    // commenting out below because they break assets on android release

    // minifyEnabled true
    // shrinkResources true
  }
}

Crazy!
I'm in another project right now, with a different RN version, but the images are called in the same way.
Turns out when I had to build a new version I got the error about duplicate drawable images, so I though "I'll delete them and my build will not show my images". But no, it is all working.
"react": "16.8.3",
"react-native": "0.59.9",

Looks like shrinkResources true is messing up with assets. However, minifyEnabled can still be true. Keeping that true and building a release apk didn't affect my assets. Any step to skip the assets when shrinkResources is enabled ??
buildTypes {
  release {
    singingConfig signingConfigs.release

    // commenting out below because they break assets on android release

    minifyEnabled true
    // shrinkResources true
  }
}

It still need attention.

Same thing, none of my emulators are showing images, regardless if they are local or remote. All of my images in both dev and prod are sent via HTTPS. They are not showing in my debug APKs or my release APKs. I have tried various Android emulators: 7, 8 and 9. iOS is working just fine, as usual.
"react": "16.6.3",
"react-native": "0.59.10"

I had something similar, until I found out, that I had "url" instead of
"uri" as the source object passed to the image. It was working fine on ios,
so I didn't even think about it. Hope that helps somebody else!
On Tue 19. Nov 2019 at 20:11, wincod75<EMAIL_ADDRESS>wrote:

Same thing, none of my emulators are showing images, regardless if they
are local or remote. All of my images in both dev and prod are sent via
HTTPS. They are not showing in my debug APKs or my release APKs. I have
tried various Android emulators: 7, 8 and 9. iOS is working just fine, as
usual.
"react": "16.6.3",
"react-native": "0.59.10"
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/facebook/react-native/issues/25290?email_source=notifications&email_token=AICHIKU4LFN73R5WFYUKPRTQUQ26XA5CNFSM4HY4IEK2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEEPLWMY#issuecomment-555662131,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AICHIKTB5NIEUMQWEWEQG5DQUQ26XANCNFSM4HY4IEKQ
.

@wincod75 works for me, thanks 👍

I am having something similar, ReactNative/Expo - both images and some line graphs rendering perfectly in iOS but not showing in Android. There are no error messages.
[I have tried adding resizeMode={'contain'}  as suggested elsewhere]
iOS:

Android:

FYI: I down-graded my react-native-svg  package from '10.0.0' to  "react-native-svg": "9.5.3" & that seemed to clear it. Images coming through now.  I know this is slightly diff from other situations on here, but this may help someone 🤟🏻

Facing Same problem.. Images showing in emulator but not after assemblerelease. Any Help :(

I had the same problem, found out that internet was not working on my Android device.. I restarted the device and the image showed up normally.. I hope that helps someone along the way.

Same problem here, although I find that if I put the app in the background and then re-open it, the images show. Anyone else find that?

Same thing, none of my emulators are showing images, regardless if they are local or remote. All of my images in both dev and prod are sent via HTTPS. They are not showing in my debug APKs or my release APKs. I have tried various Android emulators: 7, 8 and 9. iOS is working just fine, as usual.
"react": "16.6.3",
"react-native": "0.59.10"
Update
After running Android Studio and reviewing the logcat output I discovered a warning:
"Dependency ':native-imagetranscoder'"
This lead me to: https://github.com/facebook/fresco
And in my android/app/build.gradle file I added...
This: "implementation 'com.facebook.fresco:fresco:2.0.0'"
If you are using GIF's you will also need need...
This: "implementation 'com.facebook.fresco:animated-gif:2.0.0'"
And just like that my images are back...

Thanks a lot. It works for me. Maybe project template should be updated to include that dependency by default, at least in typescript one there is no such dependency.

In my case - the images were showing in IOS but not on Android.

I later realised, i had applied the elevator which hid the image on android

Same issues here, but realised that it was the Android Emulator not getting any internet connection. Tried wiping data and restarting, both doesn't work until I came across this post.
What I do is,

Close the running Android Emulator.
Run emulator @<your_emulator_name> -dns-server <IP_ADDRESS> in a terminal.
Woola! Now the internet works and all remote images loaded correctly.

PS: You can use emulator -list-avds to check the emulator's name.

Same issues here, but realised that it was the Android Emulator not getting any internet connection. Tried wiping data and restarting, both doesn't work until I came across this post.
What I do is,

Close the running Android Emulator.
Run emulator @<your_emulator_name> -dns-server <IP_ADDRESS> in a terminal.
Woola! Now the internet works and all remote images loaded correctly.

PS: You can use emulator -list-avds to check the emulator's name.

i had the same issue. turns out i had import image component from react-native-elements instead of rect-native

I had the same issue and in my case, the solution was giving the image a default styling and resize mode.
 <Image resizeMode="cover" style={styles.image} />

const styles = Stylesheet.create({
  image: {
     width: '100%',
     height: '100%'
  }
})

This is still an issue, none of my local image assets are visible, but every image is visible on iOS, this is really weird.

Android:
http://<IP_ADDRESS>:8081/assets/src/assets/my_orders.png?platform=android&hash=1741d26e319a1f4e934f651d1955c818
IOS:
http://localhost:8081/assets/../../libs/forex/src/ForexListing/assets/my_orders.png?platform=ios&hash=1741d26e319a1f4e934f651d1955c818
For both of the Platforms the url generated for local images is different. I am unable to find the actual url which will work for android.
Also :
Iimages kept apps/ folder are loading but image outside apps (libs folder) are not being loaded.
http://<IP_ADDRESS>:8081/assets/src/app/assets/ic_bmf_logo.png?platform=android&hash=3dd2be38e2726be6a24584f4c5464d90

Any update on this? I have a similar issue.
I am passing a remote uri to the Image and it is visible in iOS regardless of debug or release mode. But not loading in andorid in release mode.
BoardLogo is fetched from some other function whose value is - https://*************/Clients/3e474bef-6392-4ff8-aa44-b4304b1d8537/Images/logo1.png.
If I hardcode this uri in the source prop it works perfectly fine but when passing like below, it doesn't render. I have tired adding key prop as well.
Code -
 <Image
          style={styles.imageStyle}
          source={boardLogo ? { uri: boardLogo } : Bitmap}
        />


Send latency metrics node_name as tag instead of hostname

What does this PR do?

For consideration…
For latency metrics, send the node_name as a node_name tag, instead of using it to set the metric hostname.
Motivation

Prevent duplicate hosts, for example in case the Agent-detected hostname is different from the node_name.
Prevent ghost hosts, i.e. hosts where an Agent is not installed (but that would previously show up in the host map because of these metrics).

Additional Notes

Alternative to https://github.com/DataDog/integrations-core/pull/7235, prompted by https://github.com/DataDog/integrations-core/pull/7235#pullrequestreview-459115227:

I believe we could improve the consul check by simply stop trying to match the hostname of remote hosts in order to prevent duplicates. We could attach the remote node name as a new tag like node_name instead of using it as the host name. WDYT?

Testing
Right now the consul tests setup cannot pick up latency metrics. I've debugged locally and it looks like the nodes take a while (~2min) to show up in the /v1/coordinate/nodes we use to collect these metrics. Once all 3 nodes are showing up, the ACL test is failing (no 403 response error), and I don't understand why/ There are strange logs in the leader and follower nodes, such as below, which might indicate there's something up with how ACLs are configured in our setup.
$ docker logs -f consul-follower-1
    ...
    2020/08/04 13:27:16 [INFO] consul: New leader elected: consul-leader
    2020/08/04 13:27:16 [DEBUG] serf: messageUserEventType: consul:new-leader
    2020/08/04 13:27:16 [DEBUG] serf: messageUserEventType: consul:new-leader
    2020/08/04 13:27:17 [WARN] agent: Coordinate update blocked by ACLs
    2020/08/04 13:27:19 [WARN] agent: Node info update blocked by ACLs

Review checklist (to be filled by reviewers)

[ ] Feature or bugfix MUST have appropriate tests (unit, integration, e2e)
[ ] PR title must be written as a CHANGELOG entry (see why)
[ ] Files changes must correspond to the primary purpose of the PR as described in the title (small unrelated changes should have their own PR)
[ ] PR must have changelog/ and integration/ labels attached

Closing as stale. This is not necessarily wrong or a bad idea, but we've lost customer context (no more active support tickets about this) and it's hard to move this forward w/o a customer to answer questions or beta-test. Let's see if this comes up again in the future.


requests.exceptions.InvalidSchema: No connection adapters were found for 'Error: Must register to be able to perform the download'

It seems that that BM added a "Street" field to the request, so the repo needs to be updated.
See recent comments here for the details.

merged the attached PR. sorry it took so long.


Add an event filter with the resource.DesiredStateChanged predicate to filter status updates out

Generate the spec.initProvider API for the MRs.

Description of your changes

This PR adds an event filter using the resource.DesiredStateChanged to the generated resource controllers so that updates to only labels, annotations (Crossplane's create pending/failed annotations will be ignored) and to the spec will result in reconcile requests.
The PR also generates the spec.initProvider API because it bumps the upjet version.
I have:

[x] Run make reviewable test to ensure this PR is ready for review.

How has this code been tested

Please see https://github.com/upbound/provider-aws/pull/789. We will also need to perform some further tests with https://github.com/upbound/provider-azure/pull/495.

/test-examples="examples/azure/resourcegroup.yaml"

/test-examples="examples/azure/resourcegroup.yaml"


Request textDocument/hover failed.   Message: unknown document

@Ark-kun commented on Mon Dec 10 2018

Environment data

VS Code version: 1.28.2
Extension version (available under the Extensions sidebar): 2018.11.0
OS and version: Debian 9
Python version (& distribution if applicable, e.g. Anaconda): Python 3.5.3
Type of virtual environment used (N/A | venv | virtualenv | conda | ...): N/A

Version: 1.28.2
Commit: 7f3ce96ff4729c91352ae6def877e59c561f4850
Date: 2018-10-17T00:20:56.183Z
Electron: 2.0.9
Chrome: 61.0.3163.100
Node.js: 8.9.3
V8: 6.1.534.41
Architecture: x64
Expected behaviour
I expect mouse hovers not to cause errors.
Actual behaviour
I get errors on mouse hovers.
Steps to reproduce:

Open any Python file
Point your mouse to any part of the code.

Logs
Repeated many times:
[Error - 5:13:34 PM] Request textDocument/hover failed.
  Message: unknown document
  Code: -32000
   at Microsoft.Python.LanguageServer.Implementation.ProjectFiles.GetEntry(Uri documentUri, Boolean throwIfMissing)
   at Microsoft.Python.LanguageServer.Implementation.ProjectFiles.GetEntry(TextDocumentIdentifier document, Nullable`1 expectedVersion, ProjectEntry& entry, PythonAst& tree)
   at Microsoft.Python.LanguageServer.Implementation.Server.Hover(TextDocumentPositionParams params, CancellationToken cancellationToken)
   at Microsoft.Python.LanguageServer.Implementation.LanguageServer.Hover(JToken token, CancellationToken cancellationToken)

I have these issues too.
Another way to repro this error is by copy paste selected file in the working tree. Then this error pop ups once in few seconds and it only disappears when I restart vscode.

I don't see textDocument/didOpen sent down to the LS.

#452

I still have this error, and updated newest vscode
版本: 1.31.1
提交: 1b8e8302e405050205e69b59abb3559592bb9e60
日期: 2019-02-12T02:19:29.629Z
Electron: 3.1.2
Chrome: 66.0.3359.181
Node.js: 10.2.0
V8: 6.6.346.32
OS: Linux x64 4.15.0-45-generic

The fix is not in public builds yet. When we resolve issue it means it was fixed and tested internally. There is a major rework of the language server in progress but it is not yet ready for public release.

Any workaround for this? (particularly in VS Code)

Typical case is when new file was created and not saved as *.py and instead, just language was selected. The underlying case is that file does not have disk path/URI.

Ah, indeed. Thanks!

Hello, I got this bug too. I solved from the 'settings.json' . I was using terminal.external.osxExec : gnome-terminal.app  and telemetry.enableTelemetry: false . I removed both of them and issue is disappeared for now.

Folding into #597

I solved the issue by reverting back to jedi.  This Analysis Engine is the exact reason I don't use Visual Studio 15.0 or 17.0.
Under preferences, you should be able to search for jedi, then click the checkbox under the following section:
Python: Jedi Enabled
    Enables Jedi as IntelliSense engine instead of Microsoft Python Analysis Engine.

@MarkMoretto - did you use LS 0.1 or 0.2? 0.2 is vastly different from VS. You can try it by setting download to beta channel.
"python.analysis.downloadChannel": "beta"


feat: OAuth2 endpoint audience

What this PR changes/adds
Introduces a new "endpoing audience" setting value that will be used for validation, while the "provider audience" will be used on token request
Why it does that
To permit more finer token claims validation
Further notes

moved CredentialsRequestAdditionalParametersProvider to oauth2-spi
introduced Oauth2DefaultServicesExtension
split Oauth2ValidationRule in 3 smaller rules to improve readability and tests

Linked Issue(s)
Closes # <-- insert Issue number if one exists
Checklist

[x] added appropriate tests?
[x] performed checkstyle check locally?
[x] added/updated copyright headers?
[x] documented public classes/methods?
[x] added/updated relevant documentation?
[x] assigned appropriate label? (exclude from changelog with label no-changelog)
[x] formatted title correctly? (take a look at the CONTRIBUTING and styleguide for details)

Codecov Report
Base: 63.64% // Head: 63.62% // Decreases project coverage by -0.01% :warning:

Coverage data is based on head (8d6287d) compared to base (740c100).
Patch coverage: 87.50% of modified lines in pull request are covered.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2000      +/-   ##
==========================================
- Coverage   63.64%   63.62%   -0.02%
==========================================
  Files         772      775       +3
  Lines       16370    16377       +7
  Branches     1055     1053       -2
==========================================
+ Hits        10418    10420       +2
- Misses       5508     5514       +6
+ Partials      444      443       -1

Impacted Files
Coverage Δ

...am/oauth2/core/Oauth2DefaultServicesExtension.java
0.00% <0.00%> (ø)

...paceconnector/iam/oauth2/core/Oauth2Extension.java
0.00% <0.00%> (ø)

...or/iam/oauth2/core/identity/Oauth2ServiceImpl.java
75.00% <ø> (ø)

...connector/iam/oauth2/core/Oauth2Configuration.java
74.28% <85.71%> (-10.72%)
:arrow_down:

...e/rule/Oauth2ExpirationIssuedAtValidationRule.java
94.44% <94.44%> (ø)

...oauth2/core/rule/Oauth2AudienceValidationRule.java
100.00% <100.00%> (ø)

...auth2/core/rule/Oauth2NotBeforeValidationRule.java
100.00% <100.00%> (ø)

...2/core/rule/Oauth2ValidationRulesRegistryImpl.java
100.00% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


New functions

Maybe?
Entity.getSneaking();
?

Entity.isSneaking(ent)==true)
is one type for get sneaking

just Entity.isSneaking would work (it already returns either true or false)


frontend: Fix transfer history lazy loading

Closes #851
Every transfer group label and every transfer element is now wrapped in a LazyWrapper itself. This fixes the problem that a user needed to scroll to the label to see the whole group. Also, this removes the overhead of every transfer being added to the DOM when the respective group is displayed. As all transfers go eventually into the "older" group, this could have been an performance issue in my opinion.
I would like to have the opinion of @weilbith next week when he is back on this PR. This bug is nothing critical, so this should be fine. I am just wondering how he intended the LazyWrapper to be uses, because my version will create an extra div for every element.

This is exactly what I had in mind too. When I implemented this first, I wasn't careful enough and the history was just not a couple of days old. But after I saw this bug myself I also thought that this is the issue and the approach how to solve it. So great job from my perspective. 👍🏾


Fix linting errors

Description
Please include a summary of the changes and the related issue. Please also include relevant motivation and context. List any dependencies that are required for this change.
Fixes # (issue)
Type of change
Please delete options that are not relevant.

[x ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

Checklist:

[ x] My code follows the style guidelines of this project
[x ] I have performed a self-review of my code
[ x] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes
[ ] Any dependent changes have been merged and published in downstream modules

fix some linting errors like:

trailing white space
blank line contains whitespace
f-string is missing placeholders
no newline at end of file
blank line contains whitespace


Constant deduplication in renderer

I was playing around to get a better understanding of the generated renderer and noticed that this template
<head>
    {{#cssFiles}}
    <link rel="stylesheet" href="{{source}}" />
    {{/cssFiles}}
    {{#jsFiles}}
    <script type="application/javascript" src="{{source}}" />
    {{/jsFiles}}
</head>

produces these constants in the renderer
    private static final byte[] TEXT_0 = (
    "<head>\r\n").getBytes(TEMPLATE_CHARSET);
    private static final byte[] TEXT_1 = (
    "    <link rel=\"stylesheet\" href=\"").getBytes(TEMPLATE_CHARSET);
    private static final byte[] TEXT_2 = (
    "\" />\r\n").getBytes(TEMPLATE_CHARSET);
    private static final byte[] TEXT_3 = (
    "    <script type=\"application/javascript\" src=\"").getBytes(TEMPLATE_CHARSET);
    private static final byte[] TEXT_4 = (
    "\" />\r\n").getBytes(TEMPLATE_CHARSET);
    private static final byte[] TEXT_5 = (
    "</head>").getBytes(TEMPLATE_CHARSET);

TEXT_2 and TEXT_4 are identical, resuing TEXT_2 could save a couple of bytes and instructions.
Changing io.jstach.apt.internal.context.VariableContext#addTextCode to
	public String addTextCode(String textCode) {
		var codes = textCodes();
		int index = codes.indexOf(textCode);

		if (index < 0) {
			index = codes.size();
			codes.add(textCode);
		}

		return TEXT + "_" + index;
	}

seems to do the trick.
I am currently on a Windows 10 machine and unfortunately cannot run the tests (issues with line endings), but using the modified template compiler locally produces the expected renderer (TEXT_2 is used twice).

Oh yeah I guess bytes are probably not interned or elided like string.

Thank you for the contribution @bitfist !
Besides adding your enhancement I made it so when you checkout on windows the line endings of the mustache files should be preserved.

@agentgt Just some random thoughts on another avenue for optimization, I thought I'd write it down:
Did you consider / is it possible to store all static pieces of all templates that are compiled together in a single byte[] and then access them by offsets? Imagined benefits:

less pointer chasing of individual arrays
less object headers for the individual arrays
reduce total <clinit> time by only loading the generated blob from a file, skipping the string decoding
easy feedback on the amount of heap reserved for template caching (could also mmap the blob to reduce this)

The deduplication of individual pieces from this ticket could also be performed globally on the blob (updating offsets).

@zimmi @bitfist
Yes I thought about doing this. Even the byte deduplication that @bitfist found I was planning on doing but did not for do for different reasons but some overlapping. The byte deduplication avoidance was more about keeping to keep the code easier to read and diff of the generated file down which in hindsight was dumb because most people will not be checking in the generated files.
For the byte deduplication I was planning more of.
static final byte[] TEXT_4 = TEXT_2;

But I like @bitfist solution better because it is simpler and they already did it for me. Thanks BTW @bitfist.
Now for the single byte array I tried doing something like that several years ago on an internal forked version of JMustache. It is a little different because it was runtime generated so perhaps this should be revisited.
Regardless the results were surprisingly slower based on JMH benchmarks.
I thought Rocker also did similar and then reverted IIRC but I cannot easily figure that out since it is generated code. That is might be confusing it with another templating engine. Perhaps https://htmlflow.org/ .
Anyway we should try it again. Luckily unlike Rocker or JTE I left an API hole for us to do it:
https://jstach.io/jstachio/io.jstach.jstachio/io/jstach/jstachio/Output.EncodedOutput.html#write(byte[],int,int)
Javadoc comment:

Analogous to OutputStream.write(byte[], int, int). Generated templates do not call this method as great care as to be taken to preserve the encoding. It is only provided in the case of future found optimizations and is not currently required.

Obviously a giant array with another int array for offsets will probably use less static memory (I'm blanking on what that memory is called... not permgen...) as well as to your other points.
The question is if it slows down actual template rendering.
Luckily we can test that here: https://github.com/agentgt/template-benchmark
We just take the generated code from this guy: https://github.com/agentgt/template-benchmark/blob/utf8/src/main/java/com/mitchellbosecke/benchmark/utf8/JStachioUtf8.java
And alter the generated code manually so that it has your array idea and add it as another template engine in the utf8 package.
At the moment I don't have time to do this but I can help you if you plan on testing this.
Once we know it doesn't impact perf and readability that much I think we could probably do this and thanks for bringing it up!

I suspected that you tried this already, mad props for the foresight of leaving enough API space for further optimizations!

Never assume 😄 because most of the time have not tried and I'm not always that bright. I rather people participate and tell me things I have tried or thought about than be too afraid too (I'm not saying you were but it is a fear of mine).
Thats why I kind of didn't want to lead with oh yeah I was going to do constant deduplication when @bitfist reported this because then people will feel like "he probably already knows" or "he knows the better way".
I guess what I'm saying is never want any hesitation on filing bugs or asking question or suggestions. I have seen that in lots of other projects were it is terrifying to even ask a question and I think that is wrong.
I am curious to see the results and if you don't have time I will eventually retry it especially given the differences I have noticed with ARM64.


Extended tag line

I've tweaked font style and colour a bit because it looked weird as just a small - might need an expert touch still.
I also contemplated pulling numbers and round from the db but tbh I didn't want to bother at this time.

I'll pick this up and give it a little tickle. Thanks!


DeviceController API is not protected by platform lock

Problem
When an application create multiple threads which calls DeviceController will cause racing with each other or main platform loop.
Proposed Solution
Use platform lock to protect all CHIP SDK APIs which is intended to be called by applications.

@kghost is this issue still relevant?


host_exerciser: fix erroneous buffer commpare

The host was receiving the interrupt before the final data
writes were complete.  Therefore the resulting buffer compare
failed.  Fix involves reading the DSM, which acts as a fence,
before performing the compare.
Signed-off-by: Matthew Gerlach<EMAIL_ADDRESS>

Coverage decreased (-0.05%) to 64.141% when pulling cdfcc51285d9f296c8bff26188b2950e704d5835 on mgerlach/master-read-dsm into 6ccfc96db9354f7482bf7bcf9b26c18b4d63e1b7 on master.


Using get with a cluster

So, I have just looked over the cluster documentation. I am trying to implement something simple. For instance, say I have a dask.array (a) that I would like to take the max over one dimension (e.g. the 0-th), which can be done simply to give me a new dask.array (am). Normally, if I want to get this value, I could allocate an array and store it. In the case of a dask client, I am not sure how to proceed.
>>> am = a.max(axis=0)

If you call .compute(get=myclient.get) on an array then the result will be sent back from the workers to the client.
myclient = Client('tcp://scheduler-hostname:1234')
result = am.compute(get=myclient.get)

If you want to store the result to something like an HDF5 file then all of the workers must have access to that thing, presumably through some network file system.  This is a bit tricky because each worker will have to open the HDF5 file on their own (h5py.datasets aren't serializable).  At the moment there isn't a nice convenience function accomplish this.  There should be though.

Ah, ok. Thanks for clarifying.

If you want to store the result to something like an HDF5 file then all of the workers must have access to that thing, presumably through some network file system.

Is this assuming that one has Parallel HDF5 then?

This is a bit tricky because each worker will have to open the HDF5 file on their own (h5py.datasets aren't serializable)

Indeed. So, if the dask.array was using h5py.Dataset to read from, would this also cause issues?

This is a bit tricky because each worker will have to open the HDF5 file on their own (h5py.datasets aren't serializable)

Another thought on this. Maybe you could have something like, but admittedly not the same as, iPython's %px/%%px where it runs the same command on all engines. As you can't really use cell magics, maybe a with block would be an option.

I would expect from_array(h5py.File(...)['/data']) to fail in a parallel setting where the dataset needed to be communicated across a wire.  I'm surprised that this doesn't fail for you.
I'm not sure exactly how safe HDF5 is in parallel.  My guess is that it's decently safe for reads even if not compiled specially.

I would expect from_array(h5py.File(...)['/data']) to fail in a parallel setting where the dataset needed to be communicated across a wire. I'm surprised that this doesn't fail for you.

Never mind, I was doing something wrong. It doesn't seem to work. However, it doesn't explicitly fail, but just hangs.

I'm not sure exactly how safe HDF5 is in parallel. My guess is that it's decently safe for reads even if not compiled specially.

Yes, reads are perfectly fine in parallel, but writes are not. I was musing more over the problem of how to store to HDF5 when running in the distributed mode.

Hrm, so how would you normally solve this problem in practice without dask?  Parallel HDF5?  Some other solution?

Which part?
If you are referring to reading, I bet serializing the filename and dataset name would be sufficient and then a file can be opened in read mode on the engines. However, I am sure you already thought about this. :)
Regarding the second, there are a few ways.
One is Parallel HDF5. However, this requires MPI and a special build of HDF5 and h5py. This could be a way to go. So, it could be reasonable, but these dependency constraints might not be nice.
If you skip this route there are two ways to go, one would be to have some main process control writing to the HDF5 file. Then the engines serializes their data over the wire and the main process handles putting this to disk. The main process in this case would likely be the client or some other entity not yet included in your model.
Another solution, is have each engine write an HDF5 file of their own. Then the client can stitch them together. This is a pretty simple solution to implement and avoids heavy traffic.

IMHO, the last case (having each process write to a file is easy, safe, reasonably scalable, and will work without adding more dependencies) is probably best.

How does serialization of arrays to the engines currently work? Does the scheduler serialize the whole array or does it simply hook up some sort of connection between the client and relevant engines?

The graph moves from the client to the scheduler, the scheduler moves tasks of the graph to the workers as necessary.  When workers require intermediate results from each other then they communicate peer-to-peer.
Ideally the graph itself is relatively small and does not hold large data like arrays, but instead holds functions that say how to get an array (e.g. by loading from a network file system).

@jakirkham do you have any further questions on this topic or can this issue be closed?

Sorry to drop off the face of the map. I needed a solution quickly and had to cobble one together. This is what I have learned.
Doing HDF5 I/O becomes a major bottleneck if it is happening on the client side. That being said, it is much more tolerable if reading is happening on engines. This way, no matter how bad your I/O situation is whether you are using SSD, HD, or NFS, the engines will remain active and won't be idling until data comes through the pipe. This is very obvious on simple operations like element-wise multiplication. However, it remained quite noticeable for fairly complex operations.
As we already know, HDF5 only allows one write handle. So, it is natural to place this on the client-side. Also, as reading and writing is not yet available it will have to be a different file from the input data. This actually works ok as now there is 1 HDF5 file per array. If they really need to be on the same file at the end, a temporary file can be used and a copy step to the original file can be added.
As mentioned, I/O still can be an issue when there is one process doing it. However, if jobs have already been queued up in advance, this becomes less of an issue. Given a comparable amount of work is allocated to each engine and a significantly large amount of work, engines will over time have some small lag between them. This results in parallelism that is somewhat less than the number of engines, but is not 1.
In my experiences, I have found this to be acceptable.

You may find http://distributed.readthedocs.org/en/latest/ to be of interest.  It supercedes development in dask.distributed.


add commit info for notifications

Note on DCO:
If the DCO action in the integration test fails, one or more of your commits are not signed off. Please click on the Details link next to the DCO action for instructions on how to resolve this.
Checklist:

[ ] Either (a) I've created an enhancement proposal and discussed it with the community, (b) this is a bug fix, or (c) this does not need to be in the release notes.
[ ] The title of the PR states what changed and the related issues number (used for the release note).
[ ] I've included "Closes [ISSUE #]" or "Fixes [ISSUE #]" in the description to automatically close the associated issue.
[ ] I've updated both the CLI and UI to expose my feature, or I plan to submit a second PR with them.
[ ] Does this PR require documentation updates?
[ ] I've updated documentation as required by this PR.
[ ] Optional. My organization is added to USERS.md.
[ ] I have signed off all my commits as required by DCO
[ ] I have written unit and/or e2e tests for my change. PRs without these are unlikely to be merged.
[ ] My build is green (troubleshooting builds).

I think this PR should be closed. The relevant fix is in the release branch already, with the message/revision/etc saved on the labels, instead of the source.

you are right the fix was made on https://github.com/codefresh-io/argo-cd/pull/36/commits/0a212f7ae2b247a03cd5fdfac63fdfcbd8512dc6


Crash when using extension sidebar item

Probably the same as #147?
hltb_log.zip

Can you try with the v2.10.1?

Confirmed it's fixed.


Enable dependabot to patch base images

Closes #27
This pull request enables Dependabot to track available patch for our 3 Docker base images.
Once merged, version updates should be enabled and automatically creates 2 pull request to bump pypy:3.9-7.3.9-slim-bullseye to pypy:3.9-7.3.11-slim-bullseye.

I'm not sure the review team @LeastAuthority/it-ops is right in my pull request!
Switching to @LeastAuthority/magic-wormhole.

@hacklschorsch, this pull request may answer your questions (here and there) about why not using a minor tag (e.g.: python 3.9.16 vs 3.9): I believe pinning an exact version is required for dependabot to automatically create pull request upon new patch being available upstream.

I believe pinning an exact version is required for dependabot to automatically create pull request upon new patch being available upstream.

That's I find a bit lame of dependabot, but sure, whatever works!

That I find a bit lame of dependabot, but sure, whatever works!

I don't see how it could work otherwise; if you say "I want 3.9." and dependabot sees that "3.9.11" should be upgraded to "3.9.12" then there's nothing to do (because you'll already get "3.9.12" if you declare you want "3.9.")


I wish there was a login feature

Is your feature request related to a problem? Please describe.
login
I'm always frustrated when there's no log-in sync there
Describe the solution you'd like
Would like to add email login or Google login
Login to synchronize data, passwords, tabs, etc.

for password you can install bitwarden extension
for bookmarks you can use floccus extension.


fix some typos in source comments

Signed-off-by: bin liu<EMAIL_ADDRESS>

Thanks @liubin :)

LGTM!


Interaction with norton av

Please add instructions on how to handle getting mdm policies enabled if running Norton av.  My Mdm policies still aren’t working after I joined pc while norton was installed - blocking bitlocker, full defender and windows 10 business upgrade

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: a6b63155-715a-14bf-c3bb-31b52ffcf8ec
Version Independent ID: d274ba6f-50f2-a4ff-5981-f53561b7e438
Content: Get started with Microsoft 365 Business
Content Source: microsoft-365/business/microsoft-365-business-overview.md
Service: o365-administration
GitHub Login: @Sirkkuw
Microsoft Alias: sirkkuw

@officedocsbot assign @mypil

@officedocsbot assign @mypil

@gkens "after I joined pc while norton was installed" - you mean Azure-AD join? Do you have Auto-Enroll enabled in Intune? The antivirus installed on the PC does not have any impact what so ever on this process.
Are you having issues with the mandatory compliance policy (which marks the device as compliant or not) or an optional MDM policy which you created? I assume the latter.
I would recommend opening a support ticket from the Azure Portal (or any Intune blade), so that a support engineer can look at the affected policy and check why it's not working.

@gkens - We appreciate any feedback that improves the content in the Microsoft docs but we haven't had any response from you so we are going to close this issue.
Please feel free to re-open this issue if there is a specific area of the docs that we can improve or make better. Thank you.

@officedocsbot close


SignalR v3.0.0-preview3-19153-02 not working in Android Xamarin.Forms project. "System.TypeLoadException: Could not load type of field 'System.Text.Json.Utf8JsonWriter:s_dateTimeStandardFormat'"

Attempting to connect to a v3.0.0-preview3-19153-02 SignalR service (using Azure's SignalR Service) using an Android Xamarin.Forms application gives the following exception:
System.AggregateException: Unable to connect to the server with any of the available transports. (WebSockets failed: Could not load type of field 'System.IO.Pipelines.Pipe:_reader' (16) due to: Could not resolve type with token 0100002e from typeref (expected class 'System.Threading.Tasks.Sources.IValueTaskSource`1' in assembly 'System.Threading.Tasks.Extensions, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51') assembly:System.Threading.Tasks.Extensions, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51 type:System.Threading.Tasks.Sources.IValueTaskSource`1 member:(null)) (ServerSentEvents failed: The transport does not support the 'Binary' transfer format.) (LongPolling failed: Could not load type of field 'System.IO.Pipelines.Pipe:_reader' (16) due to: Could not resolve type with token 0100002e from typeref (expected class 'System.Threading.Tasks.Sources.IValueTaskSource`1' in assembly 'System.Threading.Tasks.Extensions, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51') assembly:System.Threading.Tasks.Extensions, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51 type:System.Threading.Tasks.Sources.IValueTaskSource`1 member:(null)) ---> Microsoft.AspNetCore.Http.Connections.Client.TransportFailedException: WebSockets failed: Could not load type of field 'System.IO.Pipelines.Pipe:_reader' (16) due to: Could not resolve type with token 0100002e from typeref (expected class 'System.Threading.Tasks.Sources.IValueTaskSource`1' in assembly 'System.Threading.Tasks.Extensions, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51') assembly:System.Threading.Tasks.Extensions, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51 type:System.Threading.Tasks.Sources.IValueTaskSource`1 member:(null) ---> System.TypeLoadException: Could not load type of field 'System.IO.Pipelines.Pipe:_reader' (16) due to: Could not resolve type with token 0100002e from typeref (expected class 'System.Threading.Tasks.Sources.IValueTaskSource`1' in assembly 'System.Threading.Tasks.Extensions, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51') assembly:System.Threading.Tasks.Extensions, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51 type:System.Threading.Tasks.Sources.IValueTaskSource`1 member:(null)
  at Microsoft.AspNetCore.Http.Connections.Client.Internal.WebSocketsTransport.StartAsync (System.Uri url, Microsoft.AspNetCore.Connections.TransferFormat transferFormat) [0x001c6] in <4ac1bf8ae2d540ccafed16f06514c1e1>:0
  at Microsoft.AspNetCore.Http.Connections.Client.HttpConnection.StartTransport (System.Uri connectUrl, Microsoft.AspNetCore.Http.Connections.HttpTransportType transportType, Microsoft.AspNetCore.Connections.TransferFormat transferFormat) [0x000b4] in <4ac1bf8ae2d540ccafed16f06514c1e1>:0
  at Microsoft.AspNetCore.Http.Connections.Client.HttpConnection.SelectAndStartTransport (Microsoft.AspNetCore.Connections.TransferFormat transferFormat) [0x004b4] in <4ac1bf8ae2d540ccafed16f06514c1e1>:0
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
  at Microsoft.AspNetCore.Http.Connections.Client.HttpConnection.SelectAndStartTransport (Microsoft.AspNetCore.Connections.TransferFormat transferFormat) [0x00567] in <4ac1bf8ae2d540ccafed16f06514c1e1>:0
  at Microsoft.AspNetCore.Http.Connections.Client.HttpConnection.StartAsyncCore (Microsoft.AspNetCore.Connections.TransferFormat transferFormat) [0x00118] in <4ac1bf8ae2d540ccafed16f06514c1e1>:0
  at System.Threading.Tasks.ForceAsyncAwaiter.GetResult () [0x0000c] in <4ac1bf8ae2d540ccafed16f06514c1e1>:0
  at Microsoft.AspNetCore.Http.Connections.Client.HttpConnection.StartAsync (Microsoft.AspNetCore.Connections.TransferFormat transferFormat, System.Threading.CancellationToken cancellationToken) [0x0008b] in <4ac1bf8ae2d540ccafed16f06514c1e1>:0
  at Microsoft.AspNetCore.SignalR.Client.HttpConnectionFactory.ConnectAsync (Microsoft.AspNetCore.Connections.TransferFormat transferFormat, System.Threading.CancellationToken cancellationToken) [0x0009d] in <8947a218ec4c4a4f81338cd8b5b1247b>:0
  at Microsoft.AspNetCore.SignalR.Client.HttpConnectionFactory.ConnectAsync (Microsoft.AspNetCore.Connections.TransferFormat transferFormat, System.Threading.CancellationToken cancellationToken) [0x00142] in <8947a218ec4c4a4f81338cd8b5b1247b>:0
  at Microsoft.AspNetCore.SignalR.Client.HubConnection.StartAsyncCore (System.Threading.CancellationToken cancellationToken) [0x00130] in <e49ca2e500654d99b6021ba11176a922>:0
  at System.Threading.Tasks.ForceAsyncAwaiter.GetResult () [0x0000c] in <e49ca2e500654d99b6021ba11176a922>:0
  at Microsoft.AspNetCore.SignalR.Client.HubConnection.StartAsync (System.Threading.CancellationToken cancellationToken) [0x00091] in <e49ca2e500654d99b6021ba11176a922>:0

After installing System.IO.Pipelines 4.6.0-preview3.19128.7 on my app projects, I get the same exception.
After installing System.Threading.Tasks.Extensions 4.6.0-preview.18571.3 on my app projects, I get this exception:
System.TypeLoadException: Could not load type of field 'System.Text.Json.Utf8JsonWriter:s_dateTimeStandardFormat' (0) due to: Could not resolve type with token 01000052 from typeref (expected class 'System.Buffers.StandardFormat' in assembly 'System.Memory, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51') assembly:System.Memory, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51 type:System.Buffers.StandardFormat member:(null)
  at Microsoft.AspNetCore.SignalR.Client.HubConnection.HandshakeAsync (Microsoft.AspNetCore.SignalR.Client.HubConnection+ConnectionState startingConnectionState, System.Threading.CancellationToken cancellationToken) [0x00056] in <e49ca2e500654d99b6021ba11176a922>:0
  at Microsoft.AspNetCore.SignalR.Client.HubConnection.StartAsyncCore (System.Threading.CancellationToken cancellationToken) [0x001ef] in <e49ca2e500654d99b6021ba11176a922>:0
  at Microsoft.AspNetCore.SignalR.Client.HubConnection.StartAsyncCore (System.Threading.CancellationToken cancellationToken) [0x002b5] in <e49ca2e500654d99b6021ba11176a922>:0
  at System.Threading.Tasks.ForceAsyncAwaiter.GetResult () [0x0000c] in <e49ca2e500654d99b6021ba11176a922>:0
  at Microsoft.AspNetCore.SignalR.Client.HubConnection.StartAsync (System.Threading.CancellationToken cancellationToken) [0x00091] in <e49ca2e500654d99b6021ba11176a922>:0

After installing System.Memory 4.5.2 on my app projects, I get the same exception.
After installing System.Buffers 4.5.0 on my app projects, I get the same exception.
Is there something special I need to do to use System.Buffers.StandardFormat?
Additional context
This works with UWP, but not Android.
Output of dotnet --info:
.NET Core SDK (reflecting any global.json):
 Version:   3.0.100-preview3-010431
 Commit:    d72abce213

Runtime Environment:
 OS Name:     Windows
 OS Version:  10.0.17134
 OS Platform: Windows
 RID:         win10-x64
 Base Path:   C:\Program Files\dotnet\sdk\3.0.100-preview3-010431\

Host (useful for support):
  Version: 3.0.0-preview3-27503-5
  Commit:  3844df9537

.NET Core SDKs installed:
  2.1.500 [C:\Program Files\dotnet\sdk]
  2.1.502 [C:\Program Files\dotnet\sdk]
  2.1.503 [C:\Program Files\dotnet\sdk]
  2.1.504 [C:\Program Files\dotnet\sdk]
  2.1.600 [C:\Program Files\dotnet\sdk]
  2.1.601 [C:\Program Files\dotnet\sdk]
  2.1.602 [C:\Program Files\dotnet\sdk]
  2.2.100 [C:\Program Files\dotnet\sdk]
  2.2.105 [C:\Program Files\dotnet\sdk]
  3.0.100-preview3-010431 [C:\Program Files\dotnet\sdk]

.NET Core runtimes installed:
  Microsoft.AspNetCore.All 2.1.2 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.All]
  Microsoft.AspNetCore.All 2.1.4 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.All]
  Microsoft.AspNetCore.All 2.1.5 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.All]
  Microsoft.AspNetCore.All 2.1.6 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.All]
  Microsoft.AspNetCore.All 2.1.7 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.All]
  Microsoft.AspNetCore.All 2.1.8 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.All]
  Microsoft.AspNetCore.All 2.1.9 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.All]
  Microsoft.AspNetCore.All 2.2.0 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.All]
  Microsoft.AspNetCore.All 2.2.3 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.All]
  Microsoft.AspNetCore.App 2.1.2 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
  Microsoft.AspNetCore.App 2.1.4 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
  Microsoft.AspNetCore.App 2.1.5 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
  Microsoft.AspNetCore.App 2.1.6 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
  Microsoft.AspNetCore.App 2.1.7 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
  Microsoft.AspNetCore.App 2.1.8 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
  Microsoft.AspNetCore.App 2.1.9 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
  Microsoft.AspNetCore.App 2.2.0 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
  Microsoft.AspNetCore.App 2.2.3 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
  Microsoft.AspNetCore.App 3.0.0-preview3-19153-02 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
  Microsoft.NETCore.App 2.0.6 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 2.0.7 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 2.0.9 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 2.1.2 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 2.1.3-servicing-26724-03 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 2.1.4 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 2.1.5 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 2.1.6 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 2.1.7 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 2.1.8 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 2.1.9 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 2.2.0 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 2.2.3 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 3.0.0-preview3-27503-5 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.WindowsDesktop.App 3.0.0-preview3-27504-2 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]

We've had issues with System.Memory on Xamarin in the past :(. I'll follow up on this with those guys and see where we are right now.
If you have a repro project you could post that would be a big help :).

Sorry, I don't have a repro project at the moment. I rolled my entire solution back to .NET Core 2.2 and am done trying the preview packages for now, so it is not a pressing issue for me at the moment at least. I figured that this was just a problem of the libraries being out of sync and would be fixed when Core 3.0 was released.

Triage decision: Sounds like Xamarin has a weird System.Memory quirk going on. Need to follow up with Xamarin folks (cc @jamesmontemagno @bradygaster) to see what we can work out here.

Actually it seems most likely that this is because we're using preview builds of corefx packages (like System.Memory) and I know that System.Memory (in particular) is embedded in the Xamarin platform (so upgrading packages doesn't help here). It's likely this is blocked on Xamarin importing the latest versions of these packages.

Ack... finally figured out this is stopping me, too.

@BrennanConroy looks like this API (StandardFormat) was added in .NET Core 3.0, so it might be an issue that is resolved now that we have a netstandard2.0 JSON package. Can you take a quick check to see if that's the case?

@BrennanConroy you found a Xamarin issue tracking a similar problem. It looks like they are actively working on it. Can you link it here for our tracking purposes?

Issue is still there with the binary package.

looks like this API (StandardFormat) was added in .NET Core 3.0

StandardFormat is in netstandard1.1 I believe, so that shouldn't be an issue.

@BrennanConroy can you make sure there's a Xamarin issue tracking this (file one if not) and link it here? I'll ping our contacts again :).

There wasn't an issue, but there is a PR that's been merged https://github.com/mono/mono/pull/14344

Awesome, so the issue has been identified and fixed in Mono. Closing this bug.

Acceptance checklist (check one item)

[ ] We decided not to take this fix.
[ ] The fix is tests-only.
[x] The fix contains product changes (check all items below).

[x] Relevant XML documentation comments for new public APIs are present.
[x] Narrative docs (docs.microsoft.com) are updated. (check one item below)

[ ] The change requires a new article. An issue with an outline has been filed here: [ISSUE LINK]
[ ] The change requires a change to an existing article. A docs PR with these changes is linked here: [PR LINK]
[x] The change requires no docs changes.

[x] Verification has been completed. (check one item below)

[ ] The change is in the shared framework and was verified against the following versions

SDK installer: [VERSION]
ASP.NET Core Runtime: [VERSION]
.NET Core Runtime: [VERSION]

[ ] The change is in an OOB NuGet/NPM/JAR package and was verified against the following version of that package: [PACKAGE ID] [VERSION]
[x] The change is in Xamarin/Mono: [<IP_ADDRESS> (d16-2@559c0f212)]


update info/variation/population REST endpoint to retrieve individuals

Description
The variation/population REST endpoint retrieves population names, descriptions and sample counts. Individuals/Population are also of interest. This update allows the retrieval of individual names and any genders for a given population name.
Use case
We have had requests for the ability to retrieve lists of individuals by population to help in analysis of genotype data. This functionality was only available in the perl API.
GET info/variation/populations/:species/:population_name
Benefits
The update allows retrieval of all individuals for a population from a species.
Possible Drawbacks
None.
Testing
Yes. The corresponding tests have been updated.
If so, do the tests pass/fail?
Tests pass.
Have you run the entire test suite and no regression was detected?
Yes.
Changelog
[/info/variation/population] Added the ability to retrieve all individuals for a population from a species.

This PR goes together with PR  https://github.com/Ensembl/ensembl-rest_private/pull/30.

Thanks @avullo for checking! Indeed the filter is not needed if data on a specific population is requested. I've cleaned the code in the next commit to reflect that and cleaned the parameter logic.

@ima23 thanks, this is good for me.

OK, CI complains with the usual rate limit stuff.


STORM-933:NullPointerException during KafkaSpout deactivation

We can add null check from KafkaSpout.commit() to save tiny memory (by lazy allocation), but it is really tiny so I think current approach is acceptable.
+1.

I merged this into master, 0.10.x-branch, 0.9.x-branch respectively.
Seems like Github mirror has issue again. When it becomes stable, your PR could be automatically marked as merged.


Add 'grade points' grading scheme

This addresses #3432 and adds a new grading scheme called Grade Points. See the issue for the full details.

I have been unable to verify the MySQL conversion as my db is borked and I only have an Oracle instance. Can someone please run it?

Ah MySQL and being case sensitive... Also fixed that.

Is this meant to be merged into 11.x?


Home Page Examples Error

Wire up a Backend
1.Click Edit Me.
2.Go to jsfiddle.
3.Uncaught Error: Firebase.set failed: First argument contains undefined

Yep, looks broken. Need to investigate.

Same as https://github.com/angular/angular.js/issues/13457


Permanently altered perspective from rotating salvage

I was dragging a canister off of a salvage when it was bumped by the cargo shuttle.
I ended up with my perspective permanently rotated by 90 degrees for the rest of the round.
Screenshots taken on Bagel station

Did you press the camera reset button

Ah, didn't know about that. I assume that would help. I'll close this.

arguably this is an issue in the sense of 'the camera behavior and controls isnt explained super well and can feel incorrect even when its not'


Add lua-date to format dates

I tried to only copy the date stuff that's needed, but the code is not really modular.
Everything depends on everything..
It's not that big, I think it's acceptable to just include the whole thing. What do you think?
Also there should probably be a way to configure the formatting
resolve #38

thanks!


Infer a Unify schema from Datomic schema and manually supplied Unify annotations

If a user is working with a schema that has skewed from original Unify schema definitions, or one which was created without the Unify DSL, e.g. one to which Unify schema annotations were manually supplied, then Unify should allow the user to generate a working minimally specified Unify schema.
For the first cut of this, Unify will output :unify.error/ placeholders when its constraints and expectations are violated, allowing the user to manually correct these in the schema and/or resulting file.

Resolved by #43


Add [VNode]

Hi leffff, I'm wondering if you have implemented the VNode readout?
It's my understanding that the VNode is what enables graph classification tasks. Without the VNode is whole-graph classification still possible with your model?
Thanks

Hi!
Well, unfortunately I haven't :(
However you can still use any invariant aggregation function, like mean/max/min to pool your node embeddings into a graph embedding!
I plan on adding it!

Thanks for the quick response leffff, I'll try mean pooling for my project :).
Good luck with adding the VNode, I know in the paper they say it can produce a significant performance uplift.
Thanks

Looking forward to the updating of  VNode.


Compensate for ingest-api change of /datasets/ to /entities/

I'm not sure of the full extent of this yet.  The new shim that maps the new entities-api endpoint into the location of the old ingest-api endpoint makes this necessary.  Searching for 'datasets/' in dags/*.py is a good place to start.  I'm not sure if /datasets/status is also affected.  Much of the impact could be absorbed by wrapping more of the changes into utils.pythonop_get_dataset_status .

PUT on ingest-api /datasets/status seems to work as expected.

Bill has added: https://hubmapconsortium.slack.com/archives/DNJ4LCT0V/p1614795494136900

which can be used to avoid constructing the full path from the relative path.


Can you pass data to child routes and index components?

I think my question is similar to this guys' question:
http://stackoverflow.com/questions/37796352/how-to-pass-data-from-parent-route-to-child-route-in-ngrx-angular2
Basically I have this route configuration:
   ...
   },  {
            path: '/event',
            component: IndexComponent, // generic index component
            index: {
                redirectTo: '/' // we must have an ID
            },
            children: [{
                path: ':id',
                component: EventComponent, // data is loaded here
                index: {
                    component: EventFormComponent // and I want to access here
                },
                children: [{
                    path: '/menu',
                    component: EventMenuEditComponent // and here
                }, {
                    // and so on
                }]
            }]

    }, {
    ...

Resulting in URLs like this:
/event/1234567890 = EventComponent + EventFormComponent
/event/1234567890/menu = EventComponent + EventMenuEditComponent
/event/1234567890/users = EventComponent + EventUsersComponent
etc
My EventComponent loads the event details from an API endpoint and I want to be able to share the data with all child routes AND the index component (EventFormComponent).
The EventFormComponent displays a form where the user can edit the event details.
Normally I would just add the data to the component's attribute, and then access it using @Input(), e.g.
<event-form [data]="myData"></event-form>

But, of course, I never actually write <event-form></event-form> because the router handles this for me.
Is there some way of doing this within ngrx router or should I use a service to store / access the data?

I've worked around this now by creating a shared data service, but I'd be interested to know if there is a different way to do this with the router...?

A shared service is the most common way. If you were using ngrx/store you would push that data into the store so it could be accessed by whichever components needed it.

Thanks Brandon, I'll take another look at ngrx/store


thread 'main' panicked at 'Unexpected state TimedOut(TimedOutDepositState)', during fedimint-cli await-deposit

Commands run on 0f6096b3bb5961a1697e4591b4d2526629b13c2d using just mprocs
mbp:fedimint ethantuttle$ bc sendtoaddress bcrt1qj2c54alr09eafkpmwp8ul4emvyldfct3x9sshsqxl9gy58nn3eeseh8za7 2.5342978
d559e23666e3101e0d07a3854360d2a0f44511057c847a533b285dfd1884ce9c
mbp:fedimint ethantuttle$ bc gettransaction d559e23666e3101e0d07a3854360d2a0f44511057c847a533b285dfd1884ce9c
{
  "amount": -2.53429780,
  "fee": -0.00006160,
  "confirmations": 0,
  "trusted": true,
  "txid": "d559e23666e3101e0d07a3854360d2a0f44511057c847a533b285dfd1884ce9c",
  "wtxid": "b7ecd5998df75de646ff1cbdadca91fa32ce0197af6ddf34c33996ba1b5a3e26",
  "walletconflicts": [
  ],
  "time":<PHONE_NUMBER>,
  "timereceived":<PHONE_NUMBER>,
  "bip125-replaceable": "yes",
  "details": [
    {
      "address": "bcrt1qj2c54alr09eafkpmwp8ul4emvyldfct3x9sshsqxl9gy58nn3eeseh8za7",
      "category": "send",
      "amount": -2.53429780,
      "vout": 0,
      "fee": -0.00006160,
      "abandoned": false
    }
  ],
  "hex": "0200000000010189d8f41c3190b800e96e0730a41d40ad9a48135160343203846eaef21ba5ebdc0100000000fdffffff0214081b0f0000000022002092b14af7e37973d4d83b704fcfd73b613ed4e17131610bc006f9504a1e738e739ccdf314010000002251205d9240cb2e3727f82626156157274390fa745d850b03d2c8a44cd2ba6d05fddd01403b6402170fa800e713a1e029d10ce477b9443a632bb1996cc30d343c2cce0902a69a4e5195358f3285a5810aed5ef0abfe784a77a6452b2887d0d876a918ccbf07010000"
}

mbp:fedimint ethantuttle$ fedimint-cli await-deposit dd0c61ff8d99f75c57cfb8226beb62f4feb35ecbc966c8d639749bacb54bc8e4
2023-08-08T01:38:02.397919Z  INFO fedimint_client::sm::executor: Starting state machine executor task
2023-08-08T01:38:02.401396Z  INFO fedimint_cli::client: Update: WaitingForTransaction
thread 'main' panicked at 'Unexpected state TimedOut(TimedOutDepositState)', modules/fedimint-wallet-client/src/lib.rs:216:29
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
2023-08-08T01:38:02.403693Z  INFO fedimint_client: Last client reference dropped, shutting down client task group
2023-08-08T01:38:02.403732Z  INFO fedimint_client::sm::executor: Shutting down state machine executor runner due to shutdown signal
mbp:fedimint ethantuttle$ fedimint-cli await-deposit dd0c61ff8d99f75c57cfb8226beb62f4feb35ecbc966c8d639749bacb54bc8e4
2023-08-08T01:38:26.323243Z  INFO fedimint_client::sm::executor: Starting state machine executor task
2023-08-08T01:38:26.323650Z  INFO fedimint_cli::client: Update: WaitingForTransaction
thread 'main' panicked at 'Unexpected state TimedOut(TimedOutDepositState)', modules/fedimint-wallet-client/src/lib.rs:216:29
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
2023-08-08T01:38:26.323809Z  INFO fedimint_client: Last client reference dropped, shutting down client task group
2023-08-08T01:38:26.323868Z  INFO fedimint_client::sm::executor: Shutting down state machine executor runner due to shutdown signal

I thought it was perhaps because I needed to mine a block, but that did not resolve the issue:
mbp:fedimint ethantuttle$ bc -regtest -generate 1
{
  "address": "bcrt1qaxctmetpk4f0rzuwsjq20uhvw4marxj3kttmms",
  "blocks": [
    "3c8ec38780342384013949a0fb36107166fb0d4aa8fed6db10cdc859381a3715"
  ]
}
mbp:fedimint ethantuttle$ fedimint-cli await-deposit dd0c61ff8d99f75c57cfb8226beb62f4feb35ecbc966c8d639749bacb54bc8e4
2023-08-08T01:45:08.756375Z  INFO fedimint_client::sm::executor: Starting state machine executor task
2023-08-08T01:45:08.757102Z  INFO fedimint_cli::client: Update: WaitingForTransaction
thread 'main' panicked at 'Unexpected state TimedOut(TimedOutDepositState)', modules/fedimint-wallet-client/src/lib.rs:216:29
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
2023-08-08T01:45:08.759182Z  INFO fedimint_client: Last client reference dropped, shutting down client task group
2023-08-08T01:45:08.759217Z  INFO fedimint_client::sm::executor: Shutting down state machine executor runner due to shutdown signal
mbp:fedimint ethantuttle$ bc gettransaction d559e23666e3101e0d07a3854360d2a0f44511057c847a533b285dfd1884ce9c
{
  "amount": -2.53429780,
  "fee": -0.00006160,
  "confirmations": 1,
  "blockhash": "3c8ec38780342384013949a0fb36107166fb0d4aa8fed6db10cdc859381a3715",
  "blockheight": 264,
  "blockindex": 1,
  "blocktime":<PHONE_NUMBER>,
  "txid": "d559e23666e3101e0d07a3854360d2a0f44511057c847a533b285dfd1884ce9c",
  "wtxid": "b7ecd5998df75de646ff1cbdadca91fa32ce0197af6ddf34c33996ba1b5a3e26",
  "walletconflicts": [
  ],
  "time":<PHONE_NUMBER>,
  "timereceived":<PHONE_NUMBER>,
  "bip125-replaceable": "no",
  "details": [
    {
      "address": "bcrt1qj2c54alr09eafkpmwp8ul4emvyldfct3x9sshsqxl9gy58nn3eeseh8za7",
      "category": "send",
      "amount": -2.53429780,
      "vout": 0,
      "fee": -0.00006160,
      "abandoned": false
    }
  ],
  "hex": "0200000000010189d8f41c3190b800e96e0730a41d40ad9a48135160343203846eaef21ba5ebdc0100000000fdffffff0214081b0f0000000022002092b14af7e37973d4d83b704fcfd73b613ed4e17131610bc006f9504a1e738e739ccdf314010000002251205d9240cb2e3727f82626156157274390fa745d850b03d2c8a44cd2ba6d05fddd01403b6402170fa800e713a1e029d10ce477b9443a632bb1996cc30d343c2cce0902a69a4e5195358f3285a5810aed5ef0abfe784a77a6452b2887d0d876a918ccbf07010000"
}

Restarted mprocs and working fine now.

You don't happen to still have the old client DB (the one that failed) somewhere? That would help a lot with debugging since the new client keeps a log of its state transitions.

I copied out the directory from /tmp that I believe would have the error. Which file within should I extract the logs from?
Scanning through it looks like probably something within the cfg/client.db directory?

I copied out the directory from /tmp that I believe would have the error. Which file within should I extract the logs from? Scanning through it looks like probably something within the cfg/client.db directory?

I think Eric probably wants that whole cfg/client.db folder.

Is this still actionable?

Fixed by https://github.com/fedimint/fedimint/pull/3117 when fixing the duplicated #2993 of this issue.


Enhance: handle non-deterministic heap operations

Since this project invokes gdb later, it's this project's job to decide when the wanted program state is achieved and then launches gdb for debugging. The current approach, counting heap operation numbers, is not a reliable way to determine program state because real-world programs may invoke different numbers of heap operations each time to reach a specific program state (for example, initialization code behaves differently each time).
I suggest supporting another interface that allows users to set a breakpoint at a specific address and using the times this breakpoint is invoked as an indicator whether the execution should be passed to gdb.

maybe it can be merged into the --break interface.

Super close on this! But I'm braindead from looking at code for too long so I'm gonna finish it another day. My progress is @ https://github.com/Arinerron/heaptrace/pull/65
It works for all oid examples. It also works for most of the address examples, but libc variable doesn't work yet, and the count feature is broken


ResourceUtils adds invalid resources scanning classpath resources

I have included the following in my report:

CAS server version:
5.0.0

Container/environment type/version (Tomcat, Jetty, Java, Linux/Windows, etc):
Vagrant/Ubuntu. CAS is started as a service using embed tomcat.

Steps to duplicate the problem:
1.) there are 4 OAuth json-formatted services defined in project's /resources/services directory);
2.) CAS starts an initialization of JsonServiceRegistryDao using the default JsonServiceRegistryConfiguration;

return new JsonServiceRegistryDao(registry.getConfig().getLocation(), registry.isWatcherEnabled(), eventPublisher);

3.) ResourceUtils.prepareClasspathResourceIfNeeded() scans classpath resources using "json" file extension provided by JsonServiceRegistryDao#getExtension();
final Resource servicesDirectory = ResourceUtils.prepareClasspathResourceIfNeeded(configDirectory, true, getExtension());
initializeRegistry(Paths.get(servicesDirectory.getFile().getCanonicalPath()), serializer, enableWatcher, eventPublisher);

Stacktraces and CAS logs where appropriate.
As a result the are unexpected jars and services in /tmp/cas directory:

Apereo-10000002.json (unexpected service)
cas-server-support-json-service-registry-5.0.0.jar (unexpected jar)
oauth-3.json (my service)
hjson-2.1.0.jar (unexpected jar)
HTTPSandIMAPS-10000001.json (not sure about this one)
oauth-2.json (my service)
json-smart-1.3.1.jar (unexpected jar)
oauth-1.json (my service)
metrics-json-3.1.2.jar (unexpected jar)
OAuthCallbackurl-13402657892840.json (not sure about this one)
postman.json (my service)

I suppose that the root cause of this issues is that "json" extension is used as a "containsName" parameter in
public static Resource prepareClasspathResourceIfNeeded(final Resource resource,
                                                        final boolean isDirectory,
                                                        final String containsName)
...
  final ZipEntry entry = (ZipEntry) e.nextElement();
  if (entry.getName().contains(resource.getFilename()) && entry.getName().contains(containsName)) {
...

You'll need to attach a POM please.

I use Gradle to build a project. I can provide build.gradle.

Sure.

Build script added.
cas.version=5.0.0

build.gradle

apply plugin: 'spring-boot'
apply from: 'http://dl.bintray.com/scalding/generic/waroverlay.gradle'
apply from: 'https://raw.githubusercontent.com/apereo/cas/master/gradle/overrides.gradle'

sourceCompatibility = JavaVersion.VERSION_1_8
targetCompatibility = JavaVersion.VERSION_1_8

bootRepackage {
    enabled = false
}

springBoot {
    mainClass = "org.springframework.boot.loader.WarLauncher"
}

repositories {
    mavenLocal()
    jcenter()
    maven { url 'https://oss.sonatype.org/content/repositories/snapshots' }
    maven { url 'https://build.shibboleth.net/nexus/content/repositories/releases/' }
}

dependencies {
    compile("org.apereo.cas:cas-server-webapp:${project.'cas.version'}@war")
    compile("org.apereo.cas:cas-server-webapp-config:${project.'cas.version'}")
    compile("org.apereo.cas:cas-server-core:${project.'cas.version'}")
    compile("org.apereo.cas:cas-server-support-jdbc:${project.'cas.version'}")
    compile("org.apereo.cas:cas-server-support-themes:${project.'cas.version'}")
    compile("org.apereo.cas:cas-server-support-oauth-webflow:${project.'cas.version'}")
    compile("org.apereo.cas:cas-server-support-json-service-registry:${project.'cas.version'}")
    compile("org.apache.commons:commons-dbcp2:${project.'dbcp.version'}")
    compile("org.postgresql:postgresql:${project.'postgresql.version'}")
    // FIXME required for bootRun task, used by a CAS configuration server
    runtime("com.fasterxml:classmate:${project.'classmate.version'}")
    runtime("org.apereo.cas:cas-server-support-generic:${project.'cas.version'}@jar")
}

task copyConfig(type: Copy) {
    println "Copying configuration to /etc/cas/config"
    from "${project.rootDir}/etc/cas/config"
    into '/etc/cas/config'
}

bootRun {
    addResources = true
    dependsOn += copyConfig
    environment SPRING_PROFILES_ACTIVE: environment.SPRING_PROFILES_ACTIVE ?: "staging,dev"
}

war {
    archiveName "${project.name}.war"
    includeWarJars = true
    entryCompression = ZipEntryCompression.STORED
    manifest {
        from manifestFile()
    }
}

task explodeWar(type: Copy) {
    group = "build"
    description = "Explode the cas.war"
    from zipTree(project.war.outputs.files.singleFile)
    into "${buildDir}/cas"
}

File manifestFile() {
    def warfile = configurations.runtime.asFileTree.matching {
        include '**/*.war'
    }
    def manifest = zipTree(warfile.singleFile).matching {
        include '**/*.MF'
    }
    def dst = new File("$projectDir/../etc/cas/MANIFEST.MF")
    dst.delete()
    dst << manifest.singleFile.text
    return dst
}

Thanks.
First things first: your build shows you have added cas-server-support-json-service-registry-5.0.0.jar as module. Is there a reason you think that is an unexpected jar in the final output, given you have explicitly declared that JAR in your build?

Also given that you have added that JAR, other dependencies show up to accommodate that such as JSON-smart. The metrics dependency has nothing to do with this, and is about CAS providing metrics. You're safe there.
Second, can you also attach CAS startup logs on DEBUG, as well as your collection settings?

These dependencies:
    compile("org.apache.commons:commons-dbcp2:${project.'dbcp.version'}")
    compile("org.postgresql:postgresql:${project.'postgresql.version'}")

are also probably not needed.

These are also not needed:
    compile("org.apereo.cas:cas-server-webapp-config:${project.'cas.version'}")
    compile("org.apereo.cas:cas-server-core:${project.'cas.version'}")
    compile("org.apereo.cas:cas-server-support-themes:${project.'cas.version'}")

Unless you're writing code against those modules. Which doesn't sound like you are.

 Not sure there; seems to be a custom change.

I also suspect you're bundling up your own services inside the services directory on the classpath. That basically merges your config with what's provided by default. Externalize your service defns and you'll be fine.


Serviceworker restarts / times out causing unexpected loss of state

It seems most browsers desire to restart or terminate service workers after a period of inactivity.
This means cve.js looses stored state sooner than expected and without an explicit timeout.
Investgate the cause and overcome this issue so the explicit timeout could be as long or small as desired.
Storing some state outside the service worker may be an issue depending on the exact nature of the issue.

I could not reproduce this behaviour. The most likely explanation is due to the unconfigurable session timeout. This will remove a user's session in 60 min after the login call. This feature will be made configurable soon. Closing for now.


Tree defaultExpandedKeys can't apply to nested node, and defaultSelectedKeys is never effect.

TuSimple/naive-ui version (版本)
2.16.5
Vue version (Vue 版本)
3.2.4
Browser and its version (浏览器及其版本)
Chrome(91)
System and its version (系统及其版本)
Windows10
Node version (Node 版本)
Reappearance link (重现链接)
https://codesandbox.io/s/naughty-lumiere-tjkog?file=/src/Demo.vue
Reappearance steps (重现步骤)
  defaultExpandedKeys: ['4030' ],
  defaultSelectedKeys:ref(['41'])

Expected results (期望的结果)
set default expand nodes and selected node
Actual results (实际的结果)
not effect
Remarks (补充说明)

If you need to set defaultSelectedKeys, then you need to set checkable and cascade properties, and when your defaultExpandedKeys is set to ['4030'], the inner layer is already expanded, if you set it to ['40'] then you can obviously See the effect.


build jsdom capybara driver

JSDom is a DOM implementation that works in any JS runtime (mini_racer perhaps) and can be used for doing functional testing without a browser. I'm thinking this would be faster and more reliable than headless-chrome et al.
Really this wouldn't be a Hyperloop specific tool, more just another Capybara driver somewhere between Rack and Selenium in capabilities.
Looking at the Capybara driver base class it looks like it would be surprisingly easy to implement. I'm thinking of giving it a go when I find the time but opening an issue here anyway for reference and thoughts.
Testing framework options - all would just be different Capybara drivers:

chrome-headless standard Capybara setup: full functionality, slow, buggy
Hyperloop remote browser:  full functionality, simple, better debugging, slow
JSDom browserless (this issue): speed, full DOM & JS, fast, no rendering
React Test Renderer: fastest unit tests, not acceptance tests

Good analysis.
Given you are using hyperloop, then the Hyperloop Remote browser (#5) would always be used rather than standard capybara.
I think if #5 were done properly, it would fast enough to make the other options (JSDom and TestRenderer) not very interesting.  Sure they might be a bit faster,  but would it be worth maintaining 2 more tools, and adding to the confusion of which tool to use when?
So my feeling is that we get #5 done and see if that doesn't fix the problems we are having with speed and reliability.

I just noticed that elsewhere you said your priority would be to get JSDom working first.  I may be missing something here, but Hyperloop remote browser seems the much easier problem to solve.  I.e. its just a matter of building a Hyperloop specific capybara driver.  The actual communications is well understood (see hyper-console for example) and is built ontop of hyperloop operations.
On the otherhand with JSDom you are going to have to do the same amount of work in terms of writting the capybara interface, plus there is going to be some finagling to get it work with hyperloop and react, etc.
Plus you are now testing in an environment that is radically different from production.  With the hyperloop capybara driver, you are using all your production code (hyperloop stack) without change, and you are running on the same base browser code that many of your users will execute on.

I agree with your points. I think it comes down to tradeoffs and constraints with none of the solutions being perfect; so choosing will come down to personal preference and what works best for the application being developed.
Motivations
The easier and faster writing tests can be the better. That's why I like hyper-spec and a big reason I chose Hyperloop. You just swap visit for mount and that's it, nothing new to learn, no separate test framework, just the same Capybara you know and tolerate. It's a beautifully streamlined setup.
CI builds are slow, a few minutes are setup and deploy, then you add all the test time. So you can't QA a feature right away, you have to come back to it later, and by then you have multiple pull requests, builds queued, out of date branches, merge conflicts. Anything I can do to get CI out of my way faster the better. Especially if a flakey browser spec makes you restart CI.
Development cycle. If tests are instant you can run the spec while developing for a nice tight feedback loop. It works for unit tests, but as soon as a browser is involved that goes out the window. Browser specs seem to take ~4s just to boot, then ~1s per spec. Not pleasant.
Basically, I'll never be happy with the speed of tests and always looking for ways to speed them up and increase programmer happiness. In our app I tend to prefer faster unit style tests wherever possible—even databaseless in the few places we can make that work—then a few higher level feature tests from a user perspective too. And even those are mostly Rack driver whenever possible. Those few JS tests running in chrome-headless take the majority of test suite run time despite being fewest in number.
Choice
RSpec Rails has tons of very similar test types: controller, request, feature, routing, system. "routing" is basically useless even. Which is crazy, but we actually have found different uses for and use each of: controller, request and feature specs. I wouldn't like to see us go as far as RSpec but some options would allow making the right tradeoffs given particular situation.
E.g. I've enforced controller specs to be databaseless, mainly for quickly testing auth, redirection, status codes; all the possible paths through a controller. Then feature specs for happy path testing the key things a user can do. And finally integration specs we use on occasions we want to run a full request while still having visibility inside the controller to stub / check instance variables; rarely needed or the best way, but when it is it's great to have.
The point of this driver should be a simple driver swap that increases speed and reliability across all JS tests in the app (not just hyper-spec ones) at the expense of being less close to a production browser. I would see myself using it to test individual components quicker, not quite true unit tests but less than full acceptance test.
Outcomes
We basically get the Selenium driver for free, so that's fine for certain tests like acceptance style perhaps. Then maybe we could have 1 or 2 additional drivers that meet different constraints - faster or more reliable.
Having looked at Capybara drivers, JSDom and mini_racer I have this hunch that it might all be quite easy to cobble together. But that does sound like famous last words. JSDom is commonly used for React testing, but there may still be snags. If it turns out to be a big mess, or unreliable, or slow, then I definitely wouldn't pursue it.
I don't see a JSDom browser needing anything Hyperloop specific so it needn't be a part of the Hyperloop project, could be developed separately and just dropped in.
To me, making a driver that uses operations with a regular browser sounds like more work cobbling, but I don't know the Hyperloop code at all. If any of these end up getting built, then we can compare and see how well they work. They may all be terrible and we begrudgingly stick with Selenium :P

huh... so I went back and took a little closer look at JSDOM, and perhaps I understand a little better.
So the idea here is that all the JS DOM APIs are presented, and because its just written in JS you can run it inside of mini-racer for example. (right?)
Thus the communication transport between the JSDOM and Capybara is just simple ruby method <->js function calls (Hyperloop does this today during prerendering, so there is example code to look at.)
Okay let's compare to using a browser, and hyperloop operations for the transport.  In both cases you have to write a capybara driver to communicate with the JS/browser side of things.  In both cases, you get immediate benefit of not having selenium.   And both cases are going to enable (with some work) running each spec without a full tear down and setup.
JSDOM

no hyperloop dependency
uses execjs (miniracer / rubyracer / etc) which is just a gem so dependency can be bundled.

your test environment is quite different from the actual production environment
you will still want some ability to do full acceptance style testing, which means you have the whole selenium integration headache.
no fun for debug (but might be fixable by adding some console like features, but still no visual of what is going on.)

Browser (any brand or headless) + Hyperloop Operations for Communication with Capybara

test as you fly, fly as you test
switch from headless to normal browser for easy debug
gets rid of selenium even for full acceptance testing

depends on external software (i.e. browser / headless browser for test)
requires you include hyperloop in test - not sure if this would be a big deal  or not

In terms of ease of implementation, I think Hyperloop Operations is going to be easier, but I could be wrong.  My belief is because there is simple working code (HyperConsole) that does very close to what a capybara driver would do.  I.e. uses ServerOps to receive and broadcast async data.
My conclusion is that I can live easily with the two negatives for using Browser + Operations, but the three negatives for JSDom are show stoppers.
My question is am I missing any +/-'s

For me I don't care about drivers visually rendering as you don't test anything based on how it looks, just that elements exist, can be clicked, etc.
The big point for me is speed. Using Operations is still using a full browser so I doubt it will be any faster. Maybe Selenium adds a little overhead, but most time is spent by the browser rendering the page.
Biggest downside for me of Operation driver is that it would only work for testing Hyperloop parts of the app. Most of our app is not Hyperloop so we'd need a regular Selenium driver to test those. As I assume the Operation driver would be sending clicks and whatnot to React. Unless you're suggesting it would work for non Hyperloop pages with vanilla Javascript as well, I don't know how you're thinking of implementing.

I spent a couple nights scrappily writing my proposed JSDOM driver and I have a basic implementation working. It has enough methods implemented to do simple Capybara stuff like visit "/foo" and expect(page).to have_css("p").
Thus I was able to do a very artificial benchmark of JSDOM vs Selenium vs RackTest and (ignoring startup time) the JSDOM version is about 5x slower than Rack and 17x faster than Selenium, so between the two and about what I hoped.
I'll keep going and see if it works in a real app not just a tiny dummy Sinatra one, and what the performance and capabilities look like then. No idea if it will handle everything Hyperloop needs like WebSockets. I'll put it on GitHub too once I've done a bit more.

FYI re: operation based solution.  Yes I was assuming that it would simulate events at the lowest possible level.  Wouldn't a JSDOM driver have to do the same?
So operations would just be the communication transport.

Oh I see, fair enough then. Yes with the JSDOM driver you basically just send JS commands to the "browser", it's been easy so far - click() and the like.
Welp, with a lot of fiddling I got my JSDOM driver working on the work app. Well, on 1 feature spec involving clicking and AJAX anyway. Selenium takes 1.5s, JSDOM takes 0.17s, so about 9x faster. I think this is promising enough for me to continue with.

Alpha version pushed to Github. Needs more Capybara API fleshing out (not hard, just time). Also needs testing on more, well, tests. I see all of the Hyperloop log messages coming through so it looks like it's working at least a little, but I haven't tried testing Hyperloop through it yet.


(ask): Can we render circle packing?

I want to use G6 because it has so many good features and good performance.
All I want to know is:
Is it possible to get this sort of graph (circle packing):

ref: https://vasturiano.github.io/circlepack-chart/example/flare/
I know there is something called type: 'comboForce' but that fails to generate layout when data size is large.

G6 does not support it yet


Add person support for Waze Travel Time

Adds person to the list of TRACKABLE_DOMAINS domains.  _get_location_from_entity will handle the person domain without any changes.
Description:
Related issue (if applicable): fixes #
Pull request in home-assistant.io with documentation (if applicable): home-assistant/home-assistant.io#<home-assistant.io PR number goes here>
Example entry for configuration.yaml (if applicable):

Checklist:

[x] The code change is tested and works locally.
[ ] Local tests pass with tox. Your PR cannot be merged unless tests pass
[x] There is no commented out code in this PR.

If user exposed functionality or configuration variables are added/changed:

[x] Documentation added/updated in home-assistant.io

If the code communicates with devices, web services, or third-party tools:

[x] New dependencies have been added to the REQUIREMENTS variable (example).
[x] New dependencies are only imported inside functions that use them (example).
[x] New or updated dependencies have been added to requirements_all.txt by running script/gen_requirements_all.py.
[x] New files were added to .coveragerc.

If the code does not interact with devices:

[x] Tests have been added to verify that the new code works.

@balloob Yes, I agree.  I'll look into making those changes.  I wanted to refactor this to fit the new component model too.


[Feature Request] Deduplication

I think deduplication would be a great feature to add.
However, I'd like to add that it would probably be hard and processor-intensive to have Vienna check for duplicate posts every time new data is fetched and deleting them.
Instead, I'd propose that reading a feed item would prompt Vienna to check for other items that share the same link and title.

+1 nice fr


Flesh out hive backend when using odo on the machine that hive is located on

This may already work, but it'd be nice to be sure that it does.

I don't think that this currently works.  Odo doesn't currently grok
odo(CSV, 'hive://...')
On Mon, Mar 30, 2015 at 7:02 AM, Phillip Cloud<EMAIL_ADDRESS>wrote:

This may already work, but it'd be nice to be sure that it does.
—
Reply to this email directly or view it on GitHub
https://github.com/ContinuumIO/odo/issues/158.


upgrade backbone to 1.2.1

fixed in https://github.com/mohnish/money/commit/122510f7b9f88babc104afdbef794e389dd09687


Stop a python source once the subscriber is no longer subscribed

Description

When a Python generator source yields a value, and the subscriber is no longer subscribed, stop the source.
Fix out of date docstring comment.

This is a partial fix for nv-morpheus/Morpheus#1838
Checklist

[x] I am familiar with the Contributing Guidelines.
[x] New or existing tests cover these changes.
[x] The documentation is up to date with these changes.

/merge

/merge


How to get CAS_RESPONSE_CALLBACKS tree value

Hi
I'm working on installation of this git project : https://github.com/EsupPortail/Esup-Pod
This project use django-cas-client 1.5.2.
I encounter some problems with CAS Auth configuration.
In order to debug I'm looking for a way to get the CAS_RESPONSE_CALLBACKS tree value.
What the best way to do get the tree value return by my CAS server?
If i understand well, in this project in settings.py, I have :
CAS_RESPONSE_CALLBACKS = (
        'pod.authentication.populatedCASbackend.populateUser',
        # function call to add some information to user login by CAS
    )

This call the function populateUser in pod/authentication/populatedCASbackend.py :
def populateUser(tree):
    username_element = tree.find(
        './/{http://www.yale.edu/tp/cas}%s' % AUTH_CAS_USER_SEARCH)
    username = username_element.text
    user, user_created = User.objects.get_or_create(username=username)
    owner, owner_created = Owner.objects.get_or_create(user=user)
    owner.auth_type = 'CAS'
    owner.save()

    if POPULATE_USER == 'CAS':
        #raise Exception(tree)
        populate_user_from_tree(user, owner, tree)
    if POPULATE_USER == 'LDAP' and LDAP_SERVER['url'] != '':
        list_value = []
        for val in USER_LDAP_MAPPING_ATTRIBUTES.values():
            list_value.append(str(val))
        conn = get_ldap_conn()
        if conn is not None:
            entry = get_entry(conn, username, list_value)
            if entry is not None:
                populate_user_from_entry(user, owner, entry)

I try to put raise Exception(tree) in order to force django to show me the tree value in browser, but seems doesn't work.
What the best way to get value of tree CAS_RESPONSE_CALLBACKS ?
cordialy,

Hi,
I find the way to get the answer of my CAS server 👍

In /cas/backends.py
in def _internal_verify_cas(ticket, service, suffix): function :

try:
        response = page.read()
        tree = ElementTree.fromstring(response)
        document = minidom.parseString(response)

        import pickle
        xml_str = ElementTree.tostring(tree).decode()
        fichier=open('path to debug file','a')
        fichier.write(xml_str )
        fichier.close

The CAS response are in path to debug file
thx


How to navigate the application

Hi...
Sir  a great work that I was searching for...I am very new to asp.net core. I want to ask that how to navigate the application as the application can only render Login page even if I change the startup file content. How to access the rest of the pages.
plz help.

open the project and restore client libraries
login using default password in https://github.com/moemura/AdminLTE.Core/blob/master/src/AdminLTE/Data/DataSeed.cs


Git post-receive hook fails on hugo build step: not a git repository

What version of Hugo are you using (hugo version)?

$ hugo version
hugo v0.101.0+extended linux/amd64 BuildDate=unknown

Does this issue reproduce with the latest release?
yes
The problem
Hugo fails to build website with error “not a git repository” when run from git post-receive hook. This is the output from git push to the remote host:

Enumerating objects: 13, done.
Counting objects: 100% (13/13), done.
Delta compression using up to 8 threads
Compressing objects: 100% (7/7), done.
Writing objects: 100% (8/8), 1.12 KiB | 1.12 MiB/s, done.
Total 8 (delta 5), reused 0 (delta 0), pack-reused 0
remote: Cloning into ‘/home/dpirate/hugo/myhugoproject.com’…
remote: done.
remote: Start building sites …
remote: hugo v0.101.0+extended linux/amd64 BuildDate=unknown
remote: ERROR 2022/07/29 12:12:45 Failed to read Git log: fatal: not a git repository: ‘.’
remote: INFO 2022/07/29 12:12:45 syncing static files to /
remote: Error: Error building site: logged 1 error(s)
remote: Total in 52 ms
To ssh://host.myhugoproject.com/git/myhugoproject.com
1a30ca1…b86ecd6 master → master
branch ‘master’ set up to track ‘host:myhugoproject.com/master’.

The content of the post-receive script are:

#!/bin/bash

set -e

PROJECT=“myhugoproject.com”
GIT_REPO=“/srv/git/${PROJECT}.git”
WORKING_DIR=“${HOME}/hugo”
PUBLIC_WWW=“/srv/http/${PROJECT}”

mkdir -p “${WORKING_DIR}”
git clone “${GIT_REPO}” “${WORKING_DIR}/${PROJECT}”
hugo -v -s “${WORKING_DIR}/${PROJECT}” -d “${PUBLIC_WWW}”
rm -rf “${WORKING_DIR}”

If I go to ${WORKINGDIR}/${PROJECT} (which has not been deleted because bash bails early on errors here) from an interactive shell and run "hugo -d /srv/http/myhugoproject.com" manually everything works fine, Hugo can now find what it needs in .git. I've tried adding a "sleep 3s" after the "git clone" step. It didn't matter.
Also, running the post-receive script manually works fine (cd ~/srv/git/myhugoproject.com.git/hooks ; ./post-receive ). So no permission problems, wrong paths, or obvious bash script problems. Furthermore, there is no firejail, SELinux and friends on the host.
One thing that may be a problem (but shouldn't) is the account on the remote host is running fish as the default shell. But I’m guessing it shouldn’t matter since there is the #!/bin/bash bang in the script.

Please continue the discussion here:
https://discourse.gohugo.io/t/git-post-receive-hook-fails-on-hugo-build-step-not-a-git-repository/39755
We prefer to use GitHub for verified bugs and vetted enhancements. Thanks.