When is a DataProc not a DataProc?

PRs
#829 (closed)
#870
#878 (stacked on #870)
Problem
Dataproc. It's expensive, hard to maintain, difficult to debug. However, we need it for some functionality which exists in Hail, but has not been migrated to Hail Batch.
Solution
We can overcome this by running Hail in a local-mode, inside cloud infrastructure. That's effectively what Dataproc allows us to do. If Dataproc can run it, Hail itself can run it, just not in Query-on-Batch. There are limitations, but also benefits.
Purpose
This 'issue' is trying to leave a little documentation about why we might want to leave Dataproc, the ways our current scripts need to be altered to escape from dataproc, and a couple of pointers to where we've successfully extricated ourselves in the MT -> ElasticSearch process, which can be used as templates for removing more future jobs from Dataproc.
This was partially motivated by the chaos yesterday - it seems (I might be wrong?) like Dataproc jobs are failing to run, and the reason for failure is that DP jobs pip-install a wide range of libraries at runtime. Ick.
Please feel free to ignore, untag yourself, close this issue. I just wanted to outline the things I could think of that were useful in getting out of Dataproc, so they can potentially be repeated elsewhere in the codebase.
Benefits

We don't need to maintain separate images and configurations to run Dataproc jobs
Debugging should be SO much easier. We're no longer using separate images to run dataproc, then running at-runtime installation of packages into the container.
Costs down - Dataproc over-provisions resources relative to most use-cases, and the costs of procuring large storage volumes/high CPU/memory manually are still less than what Dataproc reserves anyway.

Limitations

If we stop running Dataproc tasks we will likely lose the lessons we've learnt, and should we really need Dataproc again in future that might be tough
There's no guarantee that all tasks which run now in Dataproc will run in local-mode. So far so good, but we've got hard resource constraints (RAM, CPU) which could end up being impractical to overcome
Import and Export feels a bit silly. To run Hail in local-mode you have to localise the MT (or HT, or both). This ends up being cheaper (in testing so far) than running QOB/Dataproc on an equivalent process.

Export is equally unsatisfying - if you want to export single files, that's fine, Hail can take care of that. If you want to generate new HT/MTs, then you would have to either compress that directory and export as a single file, or run a gcloud copy from the running container back into GCP. It's all doable, but it's far less slick than using Dataproc, where you can read/write all data as if it was locally mounted

How To
Basic requirements for taking a job out of Dataproc

Your whole task can be a script, with a command line interface. Ancestry PCA example - this file is all the steps of the PCA process, but can't be run as a script. It only runs by using the Dataproc/Query-command wrapper which does some witchcraft and runs the run method directly. An example of this is this script which can now be run directly as a script, with an ArgParse CLI interface. Functionally, it's equivalent to this Dataproc script.

This isn't a need so much as it's a want - there's benefits to having one single file that runs a process end to end, that can be run independently.

Your script needs to start a local Hail runtime. An example of this is here. You might need fine-grained control over the number of cores in the pyspark instance, you might be happy with the defaults, but you should have some way of connecting the number of cores your VM has been provisioned with to the number of cores the Hail runtime expects to have available.
You need to be able to find that script inside the container. In the Driver image we git-clone the repository into the container, in the child jobs we don't. Your Stage should be able to locate the script in both situations. I've handled this by registering the script as an entrypoint in the cpg_workflows library here. In an environment where cpg_workflows is installed, the command mt_to_es is equivalent to running python cpg_workflows/scripts/mt_to_es_without_dataproc.py, no matter where that script is installed.

A quick gotcha here is that the image you use to run the job in Hail batch needs to have the exact version of the code you expect to run. There's a way of overcoming this with query_command, but I think that process is a nightmare and would advocate avoiding at all costs.

You need to localise the input data. An example in seqr_loader is here - get the MT, localise the whole thing using gcloud, then tell the script to use the localised version. Very easy, very cool.
De-localise the outputs. Because Hail runs in local-mode, you can't write directly to GCP. You can use Hail's write_output and temp files to manage this, or you can use gcloud to copy files directly as a command in the container. I've used this a few times in Talos (e.g. here) to copy in a whole MatrixTable using a gcloud command, generate a VCF file inside the Stage Job, then delocalise the resulting output using Hail. The script itself never needs to do anything cloud related.

I think this is a little out of date - the problem on the RD side is being solved, PA is well underway.
This is probably best chased up on the relevant PRs


Pattern matching fails to give a non-nullable type in the presence of anonymous functions

The following code seems like it should work:
void main() {
  int? value;

  () {
    value = 1;
  }();

  if (value case var nonNullable?) {
    print(nonNullable.abs());
  }
}

I understand that anonymous functions make it difficult to accurately type-promote value in cases like this. However, value case var nonNullable? should always give the nonNullable variable a non-nullable type, regardless of how difficult it is to promote value. However, this fails on both the analyzer:
$ dart analyze test.dart
Analyzing test.dart...

  error - test.dart:9:23 - The property 'abs' can't be unconditionally accessed because the receiver can be 'null'. Try making the
          access conditional (using '?.') or adding a null check to the target ('!'). - unchecked_use_of_nullable_value

1 issue found.

and the Dart VM:
$ dart test.dart
test.dart:9:23: Error: Property 'abs' cannot be accessed on 'int?' because it is potentially null.
Try accessing using ?. instead.
    print(nonNullable.abs);
                      ^^^

Note that the notionally-equivalent desugaring works:
void main() {
  int? value;

  () {
    value = 1;
  }();

  var nonNullable = value;
  if (nonNullable != null) {
    print(nonNullable.abs());
  }
}

Tested on Dart 3.0.5.

Agree. The static type of value is int?. That's the matched value type of var nonNullable?, which should make the matched value type of var nonNullable be NON_NULL(int?), aka. int.


Add support for bitwise NOT operator

Python has ~0x3, which upon research and testing shows that this is basically the same result as Golang's "^0x3".
This adds support for that.

Well I tried to do that.
bitwisenot.py
def main():
	yeah = 9
	yeah &= ~0x3
	print(yeah)

if __name__ == '__main__':
    main()

bitwise.go
package main

import "fmt"

func main() {
	yeah := 9
	yeah &= ^3
	fmt.Println(yeah)
}

generate_scripts.py gives this error:
Traceback (most recent call last):
  File "/home/gavin/Projects/pytago/scripts/generate_readme.py", line 76, in <module>
    main()
  File "/home/gavin/Projects/pytago/scripts/generate_readme.py", line 55, in main
    assert example.endswith(".go")
AssertionError

Weirdly enough, I modified the script to print file names and it seems that it actually stops at listappend...?
gavin@shitpad ~/P/pytago (yeah) [1]> python scripts/generate_readme.py
bitwisenot
listappend
Traceback (most recent call last):

The filenames should be the same other than the extensions, maybe that's what's wrong here? I see you have bitwisenot.py and bitwise.go. It's probably zipping through the filenames in alphabetical order which is why you're seeing it get paired with something random.

That was the issue yes.

Looks good to me! Thanks so much for the contribution!


python310Packages.python-rapidjson: 1.9 -> 1.10

Description of changes
Changelog: https://github.com/python-rapidjson/python-rapidjson/blob/v1.10/CHANGES.rst

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.05 Release Notes (or backporting 22.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 228169 run on x86_64-linux 1

4 packages marked as broken and skipped:

python311Packages.cirq
python311Packages.cirq-rigetti
python311Packages.cirq-rigetti.dist
python311Packages.cirq.dist

16 packages built:

python310Packages.cirq
python310Packages.cirq-rigetti
python310Packages.cirq-rigetti.dist
python310Packages.cirq.dist
python310Packages.pyquil
python310Packages.pyquil.dist
python310Packages.python-rapidjson
python310Packages.python-rapidjson.dist
python310Packages.rpcq
python310Packages.rpcq.dist
python311Packages.pyquil
python311Packages.pyquil.dist
python311Packages.python-rapidjson
python311Packages.python-rapidjson.dist
python311Packages.rpcq
python311Packages.rpcq.dist


Fix a latent bug in Constraint::clone().

Noticed by inspection.

@swift-ci Please smoke test and merge.


ong/client: check if vulnerable to ssrf in http redirection & dns rebinding

https://dropbox.tech/security/bug-bounty-program-ssrf-attack

Come up with tests for this and then update the comment in https://github.com/komuw/ong/commit/be3844f076b3df4a284903ae93836f11d0129406

Also see: https://github.com/komuw/ong/issues/260


Ubuntu Visual Studio dnx Run Command

VSCode Version: 1.0.0
OS Version: Ubuntu 14.04

I have created a simple WEB API application using Visual Studio Code on Ubuntu(on my VMWare). I completed all prior steps to install & configure .NET core, VS Code & mono libraries and packages. my package.json file contains following parameter as:
"commands": {     "web": "Microsoft.AspNet.Server.Kestrel" }
when I use 'ctrl+shift+p' to get command pallet, I can get dnx:Run Command, however after selecting this, I am not getting dnx web - (MyApplication). When I tried to run same application from terminal using dnx web. I am getting proper results of saying :
Hosting environment: Production Now listening on: http://localhost:5000 Application started. Press Ctrl+C to shut down.
Same application, I moved to my windows 7 environment, I am getting everything expected from VS Code. I don't have to run explicitly from command prompt.
Is it the behavior of VS Code on Ubuntu Vs Windows environment or something is wrong.

This issue was moved to OmniSharp/omnisharp-server#214


We need testing and improve test coverage!

We don't have testing!
Solution:
Add test cases for all models.
e.g. for Mllib.Tree.Decision
x = [[1], [2], [3], [4]]
y = [0, 0, 1, 1]
tree = fitDecisionTree treeSetup (map vector x) y
tree
predict tree (map vector [[0], [1.6], [3.3], [10]])

expected output:
[0, 0, 1, 1]

UPD: Testing was added.
See HOW-TO-TEST.md

This is related to #10. Performance testing should also be considered


Add support for customizing control center widget buttons

It would be nice to choose different or additional buttons from the four (brightness and volume) currently available in the control strip widget. Specifically the lock button as I find myself using it the most frequent of any TouchBar controls since there isn’t a good shortcut anymore.

Pock 0.5 has a built-in control center that is useful if you have the Hide Control Strip checkbox enabled. I'll keep this issue open until I add the Lock Item in Control Center widget.
If you preferer you can still use the system Control Strip and configure it from System Preferences -> Keyboard -> Customise Touch Bar... settings.

+1 on making this about the Lock button (came here looking for an existing issue just for that).
Don't think any customisation would be as needed if that button alone were added

Mute button and lock button are the two ones I use the most personally.
It would be great to see them in the Control Center widget as togglable options, especially since activating the system Control Strip has the big downside of causing the close button to appear on the left where the ESC usually is (which reduces available horizontal space and pushes the custom ESC button to the right)
Right now we have to chose between the lesser of two evils (displaced esc button vs. missing command center controls)

Have a similar request. I use the keyboard backlight buttons a lot and that's the only thing that is keeping me away from using pock.
I guess you need to give a thought about making the control center widget customizable?

187d4e024322077c9cfbed61a538424a52fc00a9


How to get thumbnail of RichTextEditor

I am creating a file manager and I need to get the thumbnail of the RTF file, if I use RichTextEditor I don't know how to disable user interactions with that view
PDFDocument has .thumbnail() method, but I couldn't find that method on RichTextEditor

Sounds like you might want to use something like SwiftUI's ImageRenderer that draws a view to a bitmap. https://developer.apple.com/documentation/swiftui/imagerenderer

thanks! I'll try it

Yeah, the ImageRenderer is great for these situations.
I'm closing this since I haven't heard anything else about it in a while. Feel free to let me know if you want to reopen it.


Update to IBC-go v3.1.0

Background
We should update to IBC-go v3.1
It requires a state migration to fix IBC'ing of assets with a slash in them (LP shares)
Suggested Design
I'd suggest this be blocked until a decision is reached for https://github.com/cosmos/ibc-go/issues/1542 , would prefer the full function's complexity not have to be in our repo.
Acceptance Criteria

[ ] Upgrade to IBC v3.1.x
[ ] State migration exists for allowing transferral of denoms with a / in them.

would prefer the full function's complexity not have to be in our repo.

Totally agree here.


[1.12.0-rc4] Impossible to remove a down Master node.

Output of docker version:
Client:
 Version:      1.12.0-rc4
 API version:  1.24
 Go version:   go1.6.2
 Git commit:   e4a0dbc
 Built:        Wed Jul 13 04:05:31 2016
 OS/Arch:      linux/amd64

Server:
 Version:      1.12.0-rc4
 API version:  1.24
 Go version:   go1.6.2
 Git commit:   e4a0dbc
 Built:        Wed Jul 13 04:05:31 2016
 OS/Arch:      linux/amd64

Output of docker info:
Containers: 2
 Running: 1
 Paused: 0
 Stopped: 1
Images: 3
Server Version: 1.12.0-rc4
Storage Driver: aufs
 Root Dir: /var/lib/docker/aufs
 Backing Filesystem: extfs
 Dirs: 30
 Dirperm1 Supported: true
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
 Volume: local
 Network: bridge null host overlay
Swarm: active
 NodeID: d2k2i4wri7hm36jgdqki577m8
 IsManager: Yes
 Managers: 1
 Nodes: 4
 CACertHash: sha256:7310eb967df3e291b57144726175879e92a9815566071663760c6ec68ecc3d64
Runtimes: runc
Default Runtime: runc
Security Options: apparmor seccomp
Kernel Version: 4.4.0-28-generic
Operating System: Ubuntu 16.04 LTS
OSType: linux
Architecture: x86_64
CPUs: 2
Total Memory: 236.4 MiB
Name: master1
ID: 52L6:KUMM:BFGX:NEA3:Q4BQ:WFHH:YQF2:CCHX:RXM3:QCVB:M2ME:AK3T
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): false
Registry: https://index.docker.io/v1/
WARNING: No swap limit support
Insecure Registries:
 <IP_ADDRESS>/8

Additional environment details (AWS, VirtualBox, physical, etc.):
Running on VirtualBox
Steps to reproduce the issue:

Join a node
Promote that node
Shutdown the node
Try to remove the node docker node rm
Docker demote the node

Describe the results you received:
It`s impossible to remove
ubuntu@master1:~$ docker node rm 9cmcpdlmzqjltzv61b4y7ufpn
Error response from daemon: rpc error: code = 9 desc = node 9cmcpdlmzqjltzv61b4y7ufpn role is set to manager. It should be demoted to worker for safe removal

And It`s impossible to demote
docker node demote 9cmcpdlmzqjltzv61b4y7ufpn
Error response from daemon: rpc error: code = 5 desc = can't find manager in raft memberlist

Describe the results you expected:
Whould be great a forceoption to do that.
Additional information you deem important (e.g. issue happens only occasionally):

/cc @abronan I think this is the same issue with just 2 managers
@diegofernandes we're working on documentation for this, but basically in a raft, there should always be an odd number of managers (1,3,5 or 7). Having two managers, with one manager down results in a situation that there can never be reached consensus, because >50% of the managers need to "agree"

+1 I ran into this as well when playing around

Scaling down from 2 to 1 Manager (using demote) only works when the 2 nodes are up. This is specific to Raft: whatever you do you need a majority agreeing. In this case with 2 nodes, you end up stuck requiring the 2 nodes to agree on the removal but because the second node is down, you can't.
If the Manager you want to remove is down on a 2 Managers cluster, you have two solutions:

Bring the node back up and remove it gracefully.
Restart the first node using --force-new-cluster as there is no majority left to process the removal.

If you had 3 Managers running and you shut down one of the Managers, it would let the removal be processed because a majority would agree (2/3).
That's also why we recommend using a minimum of 3 Managers with a recommended number of 5 (and the number should be odd: 3/5/7/9, etc. to cope with network partition scenarios).
Hope this is helpful, but I think this is more of a documentation problem.

@diegofernandes Looking into the errors:
Error response from daemon: rpc error: code = 5 desc = can't find manager in raft memberlist

Seems strange to me. Was this a typo on the node ID?
It should give:
Error response from daemon: rpc error: code = 4 desc = context deadline exceeded

Also see https://github.com/docker/docker/issues/24407, and https://github.com/docker/docker/issues/24109

@abronan this node was very strange to me too, I have tried to promote but in the node list It was marked as a worker.
Could be something with the hostname?

@abronan I tried to bring back the node but no success. I dont if I did correct in my env.  I Just start the machine and wait to the node come back but it didnt happen, so I try a swarm join and it appears as a new node

I have a similar problem. One of my managers is down and I can't remove it.
$ docker node ls
ID                           HOSTNAME  MEMBERSHIP  STATUS  AVAILABILITY  MANAGER STATUS
52oklvepdg52anqeh80ittgh2    aws3      Accepted    Ready   Active        Reachable
aqt1wn4aarb34rqyherksb6p7    aws4      Accepted    Ready   Active        Reachable
d05oirzqq9lteefzbsdepjzuu *  aws1      Accepted    Ready   Active        Leader
db1vlkevh5jf27al16pr7ff8w    aws5      Accepted    Ready   Active
dvu6kyngrzblajw9unl1jnnw3    aws2      Accepted    Down    Active        Unreachable
$ docker node rm aws2
Error response from daemon: rpc error: code = 9 desc = node dvu6kyngrzblajw9unl1jnnw3 is a cluster manager and is part of the quorum. It must be demoted to worker before removal
$ docker node demote aws2
Manager aws2 demoted in the swarm.
$ docker node rm aws2
Error response from daemon: rpc error: code = 9 desc = node dvu6kyngrzblajw9unl1jnnw3 is a cluster manager and is part of the quorum. It must be demoted to worker before removal

This should be fixed by docker/swarmkit#1182 and docker/swarmkit#1184
One is still under review. But we'll confirm and close after vendoring the changes in a new version of swarmkit.

Should be fixed as part of the swarmkit vendoring in #24620. Please let us know if you still encounter any issue with the node promotion/demotion process by opening a new issue. Thanks.


Update Discord to 0.0.236

Thank you for the contribution. It was merged directly as 8c81df58b6d757ca2e3e706c9580563fba527413 to keep commit history cleaner. Your contribution is still credited to you.


[Terminal Canary] The language setting doesn't match with the OS

Windows Terminal version
1.22.1781.0
Windows build number
10.0.26241.5000
Other Software
No response
Steps to reproduce

I changed the language setting from English to French.
The entire OS changed to French after I signed out.
I opened Terminal Canary and it's still in English.

Expected Behavior
I'm expecting the language in Terminal to match with the OS since it should follow the system default
Actual Behavior
Even tho Terminal's setting language uses the "system default", it remains the same previous language.

Is this still happening/? We haven't had any other reports on Canary of this happening, and that build is a couple months out of date.

I'll try to retry again, and i'll let you know if the problem presists.

I apologize for the late response. I tried that again with Terminal Canary version: 1.23.2961.0. The issue still persists.

Do you think it has to do with administrative settings?

I don't believe so. The first item in each of these ("Display Language" in English) should be the one what the app platform should use for determining the language for WinUI. I think the language settings in the registry for Windows Terminal may have gone out of sync with the rest of the OS for you.
@DHowett for instance encountered a bug just yesterday where he changed the "accent color" (the window border frame color) and Windows Terminal did not adopt it. He checked the package registry and it still contained the old value. I think these may just be various bugs with the packaged app / app platform implementation on Windows. 🤔
As you probably already know or noticed, you can change the "Language" setting in the left half of your screenshot (roughly in the center) to French and it should work around the issue. I'm not sure if we can fix this on our side since we rely on WinUI which in turn relies on the ApplicationLanguages.Languages API.


Minor style fixes

List of style fixes from this document that haven't been completed yet.
Most of these are small & should be quick fixes. Details and screenshots are in doc

[ ] Help menu dropdown items are 14px and should be 16px. Also, there is CSS causing little white corners to show.
[ ] Use a different icon for “View Datasets” button on home page
[ ] Discover features items on home: Either add autoplay or left/right buttons with (e.g.) 1/4
[ ] Open-source datasets: related publication link should open in new tab
[ ] "Active" style for query naming input should be bright aqua (match search box outline styling)
[ ] Check line spacing in new data source modal
[ ] Swap caret direction for collapsed query states
[ ] Check fill/size for icons in queries
[ ] Left panel is not using the intended icon for “collapse”
[ ] Check spacing on left and right panels (see doc/figma for details)
[ ] All buttons (e.g., download/open) should have left/right padding of 19px at all times
[ ] Check if text in last file in list is still cut off
[ ] Agave menu item styling
[ ] Remove icon from file types (csv, json, parquet)
[ ] Change "New query" in collapsed left panel to "Open query panel" or similar, fix icon, change background & font weight
[ ] File names on image grid are not white. Size is 14px and 12px for large and small grids, respectively; should be bumped up to 16px, and 14px.

/assign

can i work on this


Avoid loading entire disk images into memory for use with v86

v86 allows booting disk images asynchronously from a URL. If you use https://github.com/humphd/nohost , you could make it possible to use Ubuntu 16 easier.

Thanks for this idea.
I was aware of that feature but for some reason had considered not doing it. I can't recall why so I will give it another look. As it is though the 2 files I host are small and anything dragged on will be hosted locally client side in the browser.
As for using nohost, I hadn't heard of this and am not sure of the connection to this v86 suggestion or it's help with Ubtuntu, could you clarify how I could use it for those use cases?
Thanks!

Thanks for this idea.
I was aware of that feature but for some reason had considered not doing it. I can't recall why so I will give it another look. As it is though the 2 files I host are small and anything dragged on will be hosted locally client side in the browser.
As for using nohost, I hadn't heard of this and am not sure of the connection to this v86 suggestion or it's help with Ubtuntu, could you clarify how I could use it for those use cases?
Thanks!

Nohost would simply allow loading disk images without loading the entire image, as well as opening local files in the iframe browser. Also, I am aware that those disk images are small. However, I mounted a directory and was unable to boot a disk image from that local directory.

Ah ok I see what you mean with nohost. Thanks for the feedback about not being able to load a mounted disk image, I will look into that and recently had the same issue. But if I drag and dropped the image onto the desktop it usually loaded ok.


Calling nested gradient in reverse mode sweep can cause segfaults

Description
Calling nested gradients in the reverse mode sweep can cause segfaults.
This happens when ChainableStack::instance_->var_stack_ needs to reallocate itself.
You can make the bug happen with this code (put it in test somewhere):
#include <gtest/gtest.h>
#include <test/unit/math/rev/fun/util.hpp>
#include <stan/math/rev/core.hpp>
#include <stan/math/rev/fun/sin.hpp>

namespace stan {
namespace math {

class test_vari : public vari {
 public:
  explicit test_vari() : vari(0.0) {
  }

  virtual void chain() {
    stan::math::nested_rev_autodiff nested;

    // Add enough vars to make the the var_stack_ vector reallocate
    int N_new_vars = ChainableStack::instance_->var_stack_.capacity() + 1;

    var total = 0.0;
    for (int i = 0; i < N_new_vars; ++i) {
      total += i;
    }

    total.grad();
  }
};

}
}

TEST(AgradRev, grad_in_reverse_mode) {
  using stan::math::var;

  var total = 0.0;
  for (int i = 0; i < 2; ++i) {
    total += i;
  }

  var test_var(new stan::math::test_vari());

  test_var.grad();
}

Current Version:
v3.2.0

What's the use case for nested autodiff within chain()?

It's the reason we didn't have adjoint ODEs two/three years ago :P. To do that you solve an ODE in the reverse pass and you need to be able to get Jacobians and stuff.

@bbbales2 Thanks for clarifying.  And I'm OK with the change now that I understand why it's there.
Is there an efficiency reason we couldn't compute that ODE in the forward pass and save the results?

yes, we want to get adjoint ODE solving going. Apparently then we need the AD system during the reverse pass. The adjoint ODE methods is far more efficient when you have more states and/or more parameters when compared to the forward thing we do now which scales badly.

Is there an efficiency reason we couldn't compute that ODE in the forward pass and save the results?

See Section 1 of https://arxiv.org/abs/2002.00326 https://arxiv.org/abs/2002.00326, in particular the last equation.
The efficiency of the adjoint method requires that we need only integrate the one-dimensional
system in the second term which requires knowing the adjoint delta.  If one wanted to precompute
anything without knowing delta then one would have to compute \int dt df/dpsi which are exactly
the costly sensitivities.


Workflow Implemented

TRAPI input has a workflow section with operations that must be completed in order specified by workflow.
Due: July 29, 2021
Details in architecture repo Git issue here.

Handled at aragorn level


How to extract the filtered data

Sometimes, when analyzing data with the pivot table, you stumble on weird/unexpected results. Especially when narrowing down, we really want to know what exactly those remaining data points are.
Is there a way to get an array of only the filtered data shown in the pivot table? How could I myself apply the filters? Are there any helper functions that I can import and use on my initial data array?

You can get the data for a cell with the clickCallback. You pass something like this to PivotTableUI:
tableOptions = {{clickCallback: function(e, value, filters, pivotData)
{
var dbg = [];
pivotData.forEachMatchingRecord(filters,
function(record){dbg.push(record.import_id); });
alert(dbg.join('\n'));
}.bind(this)} }

Hi, I new with pivottable. I was able to render it but I would like to start with a fix pivot using a particular data.key1 as row and data.key2 as column. Basically as you have @ https://react-pivottable.js.org/
Do you think you can share the code of your demo? at least the interesting part?
Thanks


Give containerSize, trackSize and thumbSize default values

Without default values, and when not debugging in Chrome, the app will crash with the following error:
*** Terminating app due to uncaught exception 'NSInvalidArgumentException', reason: 'Invalid number value (NaN) in JSON write'
This happens on react-native 0.14-rc

Pinging on this

Thanks @skevy! Sorry for the delay, it will be in the next release!

@jeanregisser it's no problem, just wanted to make sure you were aware of the issue :)


Pose blend shape vector (207)

Hey, thanks for letting this open source!
I was trying to merge your project with another one and for that other project I needed a 207-dim Pose Blend Shape as input. Checking your code the close I can get, it's a 72-dim pose parameter... Is there any way to convert those parameters to the 207 vector that I need?
Thanks

What is the 207-dim Pose Blend Shape?

https://files.is.tue.mpg.de/black/papers/SMPL2015.pdf [SMPL Paper // Page 5]
Pose blend shapes. We denote as R : R|✓
~| 7! R9K a function
that maps a pose vector ~✓ to a vector of concatenated part relative
rotation matrices, exp(~!). Given that our rig has 23 joints, R(~✓) is
a vector of length (23 ⇥ 9 = 207). Elements of R(~✓) are functions
of sines and cosines (Eq. (1)) of joint angles and therefore R(~✓) is
non-linear with ~✓.

The project that I'm trying to merge with yours is Tex2Shape

The estimated pose vector is 3D rotation vector of 24 joints(1 root joint+23 body joints), 72=24*3.
The 23 ⇥ 9 = 207 you want might be the 3D rotation matrix of 23 body joints?
Please use this to convert the estimated 3-dim 3D rotation vectors to 9-dim 3D rotation matrix.
For example,
transform_rot_representation(pose.reshape(-1,3), input_type='vec',out_type='mat')


Game Will Not Launch if PublishSingleFile is Enabled

Release Type: Official Release
Version: <IP_ADDRESS>2
Platform(s): Windows
Describe the bug
If true or "Produce single file" is enabled when creating a build, the resulting executable will fail to launch.
To Reproduce
Steps to reproduce the behavior:

Start Stride <IP_ADDRESS>2 and create a New Game project for Windows
Once loaded, open Visual Studio and Publish the project to a local folder
Ensure File publish options -> Produce single file is selected in Profile settings

Expected behavior
Game should launch when the executable is opened.

Can confirm this seems to have been an issue since 4.1, I have tried before.

Event Viewer log,
Application: MyGame.Windows.exe
CoreCLR Version: 8.0.324.11423
.NET Version: 8.0.3
Description: The process was terminated due to an unhandled exception.
Exception Info: System.TypeInitializationException: The type initializer for 'Stride.Core.IO.VirtualFileSystem' threw an exception.
 ---> System.TypeInitializationException: The type initializer for 'Stride.Core.PlatformFolders' threw an exception.
 ---> System.ArgumentNullException: Value cannot be null. (Parameter 'path1')
   at System.ArgumentNullException.Throw(String paramName)
   at System.IO.Path.Combine(String path1, String path2)
   at Stride.Core.PlatformFolders.GetApplicationLocalDirectory() in C:\BuildAgent\work\b5f46e3c4829a09e\sources\core\Stride.Core\PlatformFolders.cs:line 109
   at Stride.Core.PlatformFolders..cctor() in C:\BuildAgent\work\b5f46e3c4829a09e\sources\core\Stride.Core\PlatformFolders.cs:line 31
   --- End of inner exception stack trace ---
   at Stride.Core.PlatformFolders.set_IsVirtualFileSystemInitialized(Boolean value) in C:\BuildAgent\work\b5f46e3c4829a09e\sources\core\Stride.Core\PlatformFolders.cs:line 90
   at Stride.Core.IO.VirtualFileSystem..cctor() in C:\BuildAgent\work\b5f46e3c4829a09e\sources\core\Stride.Core.IO\VirtualFileSystem.cs:line 85
   --- End of inner exception stack trace ---
   at Stride.Core.Storage.ObjectDatabase.CreateDefaultDatabase() in C:\BuildAgent\work\b5f46e3c4829a09e\sources\core\Stride.Core.Serialization\Storage\ObjectDatabase.cs:line 85
   at Stride.Engine.Game.InitializeAssetDatabase() in C:\BuildAgent\work\b5f46e3c4829a09e\sources\engine\Stride.Engine\Engine\Game.cs:line 401
   at Stride.Engine.Game.PrepareContext() in C:\BuildAgent\work\b5f46e3c4829a09e\sources\engine\Stride.Engine\Engine\Game.cs:line 258
   at Stride.Games.GameBase.Run(GameContext gameContext)

Just tested in Master and seems like this works mostly as expected.

Above is compared to the 82 files that get generated without singlefile.
I dont know what the expectation was but this is definitely a lot better.

Can this be closed? Did #2225 fix the issue?

Can this be closed? Did #2225 fix the issue?

It's not included in a stable release yet but I think we have enough tests on source to consider it solved, I'll go ahead and close.


Claims added to token via custom UserClaimsPrincipalFactory don't make it to the final token

Hi folks,
I'm using IdentityServer4 v3.1.4 with the ASPNET Core Identity integration.
I've got a custom field added to my ApplicationUser profile. I'd like the data from that field to always exist in user tokens, regardless of scopes, etc. After some reading around, it seems like I could either make a custom IProfileService implementation or a custom UserClaimsPrincipalFactory implementation. Both seem to somewhat be a tool for what I'm trying to do, but the docs make UserClaimsPrincipalFactory sound more specific to adding claims to tokens.
So, I've created my own UserClaimsPrincipalFactory class and registered it with ASPNET Identity. I am following the instructions on the IdentityServer4 docs that say to register it prior to calling AddAspNetIdentity.
My custom UserClaimsPrincipalFactory code gets executed, and I can see it adding the claims to the ClaimsIdentity, but my problem is as follows: the claims added don't seem to make it to the final token. I don't see these claims in my tokens.
I'm thinking the work done by my UserClaimsPrincipalFactory code is being undone by some code occurring afterwards somewhere down the line. I've tried re-ordering the registration of my UserClaimsPrincipalFactory class many different ways. I've tried registering it through dependency injection instead of through the IdentityBuilder.AddClaimsPrincipalFactory method. Nothing seems to make these claims appear in the token.
I figure I'm doing something wrong, so I am coming here to ask for some assistance. Below I will paste my ConfigureServices method so that you can see the order in which I am registering things. I will then paste my custom UserClaimsPrincipalFactory code.
I appreciate any advice! Thank you.
        public void ConfigureServices(IServiceCollection services)
        {
            services.AddTransient<IEmailSender, EmailSender>();
            services.Configure<EmailSenderOptions>(m_configuration);

            services.AddControllersWithViews();
            services.AddRazorPages();

            services.AddDbContext<IdentityDbContext>(ConfigureIdentityContext);

            // configure aspnet core identity
            var identityBuilder = services
                .AddDefaultIdentity<ApplicationUser>(ConfigureDefaultIdentity)
                .AddRoles<IdentityRole>()
                .AddEntityFrameworkStores<IdentityDbContext>()
                .AddDefaultTokenProviders();

            // configure identity server
            var identityServerBuilder = services
                .AddIdentityServer(ConfigureIdentityServer)
                .AddOperationalStore(ConfigureOperationalStore)
                .AddConfigurationStore(ConfigureConfigurationStore)
                .AddDeveloperSigningCredential();

            // use our own claims factory
            identityBuilder
                .AddClaimsPrincipalFactory<RadixUserClaimsPrincipalFactory>();

            // tell identity server to integrate with aspnet core identity
            identityServerBuilder
                .AddAspNetIdentity<ApplicationUser>();
        }

    public class RadixUserClaimsPrincipalFactory : UserClaimsPrincipalFactory<ApplicationUser>
    {
        public RadixUserClaimsPrincipalFactory(UserManager<ApplicationUser> userManager, IOptions<IdentityOptions> optionsAccessor) : base(userManager, optionsAccessor)
        {

        }

        #region Methods

        protected override async Task<ClaimsIdentity> GenerateClaimsAsync(ApplicationUser user)
        {
            var identity = await base.GenerateClaimsAsync(user);

            identity.AddClaim(new Claim("AuthorizedClients", user.AuthorizedClients));
            identity.AddClaim(new Claim(ClaimTypes.Role, "SysAdmin"));

            return identity;
        }

        #endregion
    }

I switched to a custom UserProfile and call AddProfileService after calling AddAspNetIdentity. That seems to give me the opportunity to put some permanent claims into the token.
I will close this, just so it's not hanging out there on github, although I never did get the UserClaimsPrincipalFactory to work.


Feed cache

Cache main feeds so we don't re-request every time we change timelines.

This is also vital to restoring scroll position, i think there is an easy way to do this, we can simply cache a list of notes based on the sub id, since these are specific to each page we will be able to simply store the ids of all the events then have a general indexdDb for events which we can lookup

Huge win for perfomance and UX, let's do it asap


Example code is not working when used with latest Cocoapod file

I have added the cocoapod (http://cocoapods.org/pods/WebViewJavascriptBridge) to my project:
pod "WebViewJavascriptBridge", "~> 4.1.4"

I have used the example code found in https://github.com/marcuswestin/WebViewJavascriptBridge/tree/master/Example Apps/ExampleApp-iOS and have spent two hours now trying to figure out when the bridge doesn't work. The exampleApp.html comes up fine and the log shows the obj-c sending data off, but the calls are never received in the webview.
As the example code was working I tried removing the pod and manually drag the WebViewJavascriptBridge into my project - and voila, it works!
There must be something wrong with the files in your pod. Just FYI. :smile:

I suppose that this project's spec file is not matching the lastest code.When I installed 4.1.4 version,I checked my Pods > WebViewJavascriptBridge and just 'WebViewJavascriptBridge.h' existed.But 'WKWebViewJavascriptBridge.h' doesn't exist in the folder. :-(

I had same issue with pod.

Has someone resolved this?

You can try
pod "WebViewJavascriptBridge", :head

And get all source from this project.

Cocoapod doesn't seem to work , i downloaded github code and copied and
pasted bridge code, then it worked nice.
On Thu, Dec 10, 2015 at 4:03 PM, CashLee<EMAIL_ADDRESS>wrote:

You can try
pod "WebViewJavascriptBridge", :head
And get all source from this project.
—
Reply to this email directly or view it on GitHub
https://github.com/marcuswestin/WebViewJavascriptBridge/issues/155#issuecomment-163628121
.

--
Head of iOS and Android Development

ZhongShan DaLian
Email<EMAIL_ADDRESS><EMAIL_ADDRESS>

Hi guys,
I've been out of action for quite a while. I'm finally about to be able to take this back up again, and intend to resolve all the outstanding issues.
Sorry for all the inconveniences in the meantime!!
-- while mobile
On Thu, Dec 10, 2015 at 12:38 PM, ancheng<EMAIL_ADDRESS>wrote:

Cocoapod doesn't seem to work , i downloaded github code and copied and
pasted bridge code, then it worked nice.
On Thu, Dec 10, 2015 at 4:03 PM, CashLee<EMAIL_ADDRESS>wrote:

You can try
pod "WebViewJavascriptBridge", :head
And get all source from this project.
—
Reply to this email directly or view it on GitHub
https://github.com/marcuswestin/WebViewJavascriptBridge/issues/155#issuecomment-163628121
.

--
Head of iOS and Android Development

ZhongShan DaLian
Email<EMAIL_ADDRESS><EMAIL_ADDRESS>Reply to this email directly or view it on GitHub:
https://github.com/marcuswestin/WebViewJavascriptBridge/issues/155#issuecomment-163698051

I spent numerous hours trying to make the bridge works too. I installed the framework with Cocoapod and followed every single code demonstrated in your Example, it just didn't work.
At last I discovered that the bridge in my javascript was never initialized, the WebViewJavascriptBridgeReady event was never called. It turned out that the bundle path of WebViewJavascriptBridge.js is different when it's managed by Pods. You'll have to update the path to have the js file loads correctly in your Webview.

Hi guys,
This should have been fixed in 4.1.5.
Note that the newest version is 5.0.1. If you switch to the new version, please note that the API has changed. In particular, make sure that you use the javascript setup code, as it has changed: https://github.com/marcuswestin/WebViewJavascriptBridge#usage
Cheers!


Missing modules

Getting "ImportError: No module named 'pymongo'" after recent update. Is the extension suddenly defaulting to using venv? Why? And how do I get rid of that?

Getting "ImportError: No module named 'pymongo'

This is generally an indication of the fact that the linter and the module are not installed in the same env. (assuming the module pymongo is installed).

defaulting to using ven

Yes, if you have a virtual env in your project directory, this will be used.
You can easily change the interpreter the extension uses by following the instructions on this page https://code.visualstudio.com/docs/python/environments
Please let me know how this goes.

Thank you, I got it working again.
Pymongo - is installed under Anaconda's working environment.
Virtual environments don't work on my dev machine, under windows numpy wouldn't compile
Is there something like a forum for this, I feel issue reports are not the appropriate method to use for these kind of questions?

Thanks for getting back with a confirmation of the fix.

Is there something like a forum for this

The best place would be Stackoverflow.


Documenting Listener Isolation in Gateway Spec

What type of PR is this?
/kind cleanup
/kind documentation
What this PR does / why we need it:
This PR is a follow up to #2416. It introduces a new concept called "Listener Isolation" to describe the recommendation that at most one Listener matches a request, and only Routes attached to that Listener are used for routing.
Originally I'd planned to consider this an "Extended" feature (see https://github.com/kubernetes-sigs/gateway-api/issues/2416#issuecomment-1731747678) but generally the idea of "Extended" and "Core" is per-field, not really a description of behavior. So instead I'm using "SHOULD" which per RFC-2119 is a recommendation and not a requirement. This does add the requirement that implementations that do not support Listener Isolation must document that.
Which issue(s) this PR fixes:
Related to #2416 but leaving open until conformance tests are present.
Does this PR introduce a user-facing change?:
Gateway: A new concept called "Listener Isolation" has been introduced to describe the recommendation that at most one Listener matches a request, and only Routes attached to that Listener are used for routing.

LGTM, but will leave it for @shaneutt to bring this one in.

/lgtm


ISPN-16675 RemotePublisher can hang if retrying segments and it fails…

… again
https://issues.redhat.com/browse/ISPN-16675

merged! thanks @wburns !


Add unit tests for repo2docker/utils.py

The following functions have unit tests added:

execute_cmd
chdir
ByteSpecification.validate

maybe_cleanup has been replaced with a try...finally in
its only place of use, which IMO is clearer.

I picked this out by looking through https://codecov.io/gh/jupyter/repo2docker/tree/master/repo2docker and finding files that need more coverage. Help, I've fallen into a trap set by @betatim!

I added two commits to move the shutil import around. Interestingly that missing import only got noticed by one of our many tests, those that build external repos.

Apparently something needs updating in the codecov settings as it thinks the target for the diff is 0%.


Modified zookeeper.sh to install Zookeeper from repo.

Related to https://github.com/GoogleCloudPlatform/dataproc-initialization-actions/issues/35

LGTM


Guides not reaching client with in server/client environment

Tested tonight, guides get pushed to the server but the client isn't getting the saved text of the guide itself.
Also has an issue where I logged into the server and it didn't send any of the guides to the client.
No errors on server or client.

The list of guides usually loads but never the data from it.

Is it all guides that show up? Anything in one of the guides triggering an exception? Try catching a throwable where we load the guides and see if anything shows up.


Support for EdDSA

There is an issue (#639) asking about support for EdDSA that was closed back in August 2021.  Has anyone picked up this work?  If so, I'd like to help finish it!
I'll be starting this week if I don't get any positive replies here.

Hello,
I have it on the backlog but have not yet had time to add it. Any help adding it as a new algorithm would be greatly appreciated!
Thanks,
Andrew

Understood.  I'm picking it up, and I hope to make it a quick turn-around.  I'll post progress here.

For anyone interested in an update...
I've completed coding for libacvp, but I can't validate it.  I've discovered that OpenSSL is missing some critical functionality in EdDSA, making it a partial implementation at best.  I'm planning to hold the work until I can validate all of the changes.  If anyone here is waiting on this work, please post here and let me know.  If there's strong support for an early release, I'll reconsider.
KeyGen:
Works fine, passes 100%
KeyVer:
https://mta.openssl.org/pipermail/openssl-users/2023-June/016441.html
(Briefly explains the issue, no replies @ 17 days and counting)
Sign/Verify:
https://mta.openssl.org/pipermail/openssl-users/2023-June/016455.html
(Long, detailed explanation of the issue, 1 reply with limited info)

Is there an update further for this support here, as openssl seems to have implemented support for all EdDSA curve instances.
https://github.com/openssl/openssl/pull/19705/commits/4f8b7c2319523f8e83b8b2fa31127832fa092552#top

I have two clients that completed the EdDSA implementation for PureEdDSA for 3.0 and 3.1, and I've passed testing for both.  This testing only validates my libacvp changes for PureEdDSA (complete, with full context support).  The code I have should pass HashEdDSA as well, but I'll need to test against 3.2 to confirm.  I'll confirm with passing on the Demo server, which should be sufficient.
I'll submit a PR in a week or so with full coverage for EdDSA.

Thanks for the update. Is response file getting validated by Demo server in your testing - just for the confirmation. For my response file (that is exactly as in https://pages.nist.gov/ACVP/draft-celi-acvp-eddsa.html#name-eddsa-siggen-test-group-res ), I see below validation log. (BTW I am using dpdk-ci tools/acvp for the testing).
            {
                "tcId": 1,
                "result": "failed",
                "reason": "Validation failed: Failed to verify",
                "expected": {},
                "provided": {}
            },

In case if it is not an issue through libacvp, please ignore (and I ll find out why).

Thanks for the update @RandallSteck! If/when you do a PR, could you base it in the libacvp_2_1_0-throttle branch?
Thanks,
Andrew

Hello, is there an update for this support here?
After tracking EVP_PKEY_public_check() in OpenSSL 3.2.0, it seems to only check whether there is a public key in the key.
(Ref: https://github.com/openssl/openssl/blob/openssl-3.2.0/providers/implementations/keymgmt/ecx_kmgmt.c#L792)
The ecx->haspubkey are set in ossl_ecx_key_fromdata() finally if we use EVP_PKEY_new_raw_public_key_ex()
Therefore, I wonder that is it enough to use EVP_PKEY_public_check() for EdDSA KeyVer test.
Thank you.

Hi all,
@0140454 apologies for the delay getting back here.I have run into the exact issue and opened a discussion on the OpenSSL page. I am trying to get more info (they seem to suggest keyVer may not be required). Will update here if I find out more.
EDDSA support (with keyVer disabled in the app for now) has been merged into 2_1_0-throttle, set to come out soon. Closing this issue!
Andrew

Hi Andrew,
Thanks for your work again.
Since we thought it might be useful for the caller who may want to know whether a public key is valid, we introduced a naive implementation of EDDSA KeyVer in our fork of OpenSSL FIPS provider without cosulting the OpenSSL team after my last comment.
However, I appreciate you informing me there is a discussion about this. I will follow up the discussion. Thank you.


Do not filter report config if report is not peristed: Fixes #877

Backport of https://github.com/Hyperfoil/Horreum/pull/918

:+1:


Another one to check out

Extend context 6-8k on any model. *Have not tested
https://kaiokendev.github.io/til#extending-context-to-8k

Maybe this works now. I can't test though cause only 8GB VRAM. LoRAs seem to work at least
Download the LoRA: https://huggingface.co/kaiokendev/superhot-13b-8k-no-rlhf-test - and set the path in the app (File>Parameters>Exllama)
Set 'Context' to 8192
Set 'Compress pos embeddings' to 4

Seen the stuff going on with these long conext + exllama?
https://huggingface.co/Panchovix
https://huggingface.co/TheBloke
"Please make sure you're using the latest version of text-generation-webui
Click the Model tab.
Under Download custom model or LoRA, enter TheBloke/Robin-13B-v2-SuperHOT-8K-GPTQ.
Click Download.
The model will start downloading. Once it's finished it will say "Done"
Untick Autoload the model
In the top left, click the refresh icon next to Model.
In the Model dropdown, choose the model you just downloaded: Robin-13B-v2-SuperHOT-8K-GPTQ
To use the increased context, set the Loader to ExLlama, set max_seq_len to 8192 or 4096, and set compress_pos_emb to 4 for 8192 context, or to 2 for 4096 context.
Now click Save Settings followed by Reload
The model will automatically load, and is now ready for use!
Once you're ready, click the Text Generation tab and enter a prompt to get started!"

They should work here now with Exllama backend, if set context to 8192 and 'Compress pos embeddings' to 4


Why doesn't Espalexa need certificates?

Why doesn't the Hue Protocol is espalexa need certificates? Seems fauxmo (wemo protocol) does.
If this protocol can be used for a project, it seems much easier, and lower cost.

Luckily they are not enforcing an encrypted connection on the local Hue api.
Once they start doing it that would be problematic resource-wise. Of course you can use it, but i would not advise doing so in a commercial product since it may break with an Alexa update at any point.

Thanks. That makes a lot of sense!
On Wed, Feb 5, 2020 at 9:32 AM Aircoookie<EMAIL_ADDRESS>wrote:

Luckily they are not enforcing an encrypted connection on the local Hue
api.
Once they start doing it that would be problematic resource-wise. Of
course you can use it, but i would not advise doing so in a commercial
product since it may break with an Alexa update at any point.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/Aircoookie/Espalexa/issues/103?email_source=notifications&email_token=ALSSLQNV2EMQCHI635M2SB3RBLZ4PA5CNFSM4KPNK232YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEK4JMHA#issuecomment-582522396,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ALSSLQJPPEIVN5MPL5ANOETRBLZ4PANCNFSM4KPNK23Q
.


Create rust.yml

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.1 out of 2 committers have signed the CLA.:white_check_mark: OKEAMAH:x: ImgBotAppYou have signed the CLA already but the status is still pending? Let us recheck it.


Define Base.one as identityoperator

Coverage increased (+0.004%) to 96.023% when pulling 9f285d6e74ebe5c4dbe6b44e4d90b95d1f3cc35f on david-pl:one into 736510e1af275aecf4fc2822f1606a4ddaee9c4e on bastikr:master.


WIP monitor: Use strings instead of interfaces for Fields

When monitoring certain fields of a table, the model is
needed since their values are obtained as an offset.
Since the model is not kept in TableMonitor, this change
will convert the fields to strings sooner.
NOTE: There is an issue with the unit test that still needs to be address before we merge this PR.
Fixes #303
Signed-off-by: Flavio Fernandes<EMAIL_ADDRESS>

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

13 of 33 (39.39%)  changed or added relevant lines in 2 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.2%) to 73.712%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

client/monitor.go
11
31
35.48%

Totals

Change from base Build<PHONE_NUMBER>:
-0.2%

Covered Lines:
4551

Relevant Lines:
6174

💛  - Coveralls

This PR needs this change:
https://github.com/ovn-org/ovn-kubernetes/pull/2940
See: https://github.com/ovn-org/ovn-kubernetes/pull/2940#issuecomment-1105732767

LGTM


Reflect release 4.8.1

can reproduce failure of the testFailsToStartIfDowngraded locally, will take a look

see https://crate.slack.com/archives/CBPLN6WJK/p1653478964886189
retest this please


Add label sanity check to entry formatting

Fixes #5.
Before returning a formatted entry check if the current entry options
carry a label. If they don't they are probably not an entry that should
be displayed since we don't know how to in the completion menu.
Instead they are in all probability for example a metadata entry
provided through JabRef.

Thanks!


Validator in props break props typing

Version
2.6.11
Reproduction link
https://codesandbox.io/s/mystifying-wozniak-ny5vg?file=/src/components/Test.vue
Steps to reproduce

Use the examples in the official documentation.
https://github.com/vuejs/docs-next/blob/master/src/guide/typescript-support.md
Add setup to handle some things.
Can't get correct props attribute inference on function parameter props.

What is expected?
Able to infer the properties of props
What is actually happening?
Can't get correct props attribute inference on function parameter props.

Duplicate of https://github.com/vuejs/vue-next/issues/2474

@silkwromzf transfered to the correct repository


How to build/how to get mssql-openssl.dll and libmssql-openssl.so?

We're trying to use this MsQuic wrapper in a Unity project (installed using NuGetForUnity). At runtime, MsQuic.Net tries to load mssquic-openssl.dll on Windows or libmssquic-openssl.so. This doesn't seem to be included in the package, which causes the library not to work as expected - and Exception is thrown since the library can't be loaded. (The README.md sounds to me like no steps besides installing the NuGet package would be required, however it could very well be an issue with NuGetForUnity.)
How would we need to build MsQuic in order to retrieve the correct libraries (i.e. msquic-openssl.dll instead of msquic.dll)?

It seems like I could have spent a few more minutes searching for it. According to the BUILD.md file in the MsQuic repository we would need to use scripts contained in the repository to build the project, and to use certain flags in order to select whether schannel, openssl or openssl3 should be used.
However, I didn't yet verify if this is working, so I won't yet close this issue.

The problem doesn't occur anymore if I place the msquic.dll as msquic-openssl.dll into the same directory as the StirlingLabs.MsQuic.Bindings.dll.
I can't yet say if this problem resulted from me using the NuGet package within Unity (where the installation of the package might have been incomplete to begin with) or if it would also occur if the NuGet package is used in a regular C# project. In any case, adjusting the installation instructions would probably be helpful, either by instructing that the MsQuic dll needs to be inserted manually, or that this needs to be done within Unity projects.
Since I don't know how you manage your tasks, I'll leave this issue open for now. Feel free to close it if you don't see a need for this issue (e.g. if you keep track of progress within another tool).

Similarly there should be a hint for the sa.dll as well, see https://github.com/StirlingLabs/MsQuic.Net/issues/27


Environment variable to choose chromium platform

Hello,
Could you add an environment variable to choose the chromium platform to download at installation time?
In my case, our CI/CD machine runs under linux, but the artifacts that it generates are supposed to be deployed on windows machines. These artifacts contain puppeteer: Because puppeteer is installed under the linux machine, the chromium binary is linux, while the machine that is supposed to run it is windows. Then, when executing this artifact on the windows machine, it complains it cannot find the 'local' binary. We want to have a full running installation in a single zip file.
Could you simply add something like that in install.js file?
const downloadHost = process.env.PUPPETEER_DOWNLOAD_HOST || process.env.npm_config_puppeteer_download_host;

const puppeteer = require('./index');
- const browserFetcher = puppeteer.createBrowserFetcher({ host: downloadHost });
+ const browserFetcher = puppeteer.createBrowserFetcher({ host: downloadHost, platform: process.env.PUPPETEER_CHROMIUM_PLATFORM });

const revision = process.env.PUPPETEER_CHROMIUM_REVISION || process.env.npm_config_puppeteer_chromium_revision
  || require('./package.json').puppeteer.chromium_revision;

const revisionInfo = browserFetcher.revisionInfo(revision);

If the variable is not set, BrowserFetcher will take the local platform, as done until now.
FYI, currently I'm doing the following workaround
$ set PUPPETEER_SKIP_CHROMIUM_DOWNLOAD=true
$ npm install --production  # It will not install Chromium because PUPPETEER_SKIP_CHROMIUM_DOWNLOAD is set
$ unset PUPPETEER_SKIP_CHROMIUM_DOWNLOAD
$ sed -i -- "s/host: downloadHost/host: downloadHost, platform: 'win64'/" node_modules/puppeteer/install.js
$ node node_modules/puppeteer/install.js # Chromium will be installed with platform 'win64'

@farumi This was one of the main usecases for the BrowserFetcher API.
The suggested way is:

use PUPPETEER_SKIP_CHROMIUM_DOWNLOAD=true to avoid puppeteer's download
come up with a custom node script that would use BrowserFetcher to download the version you're interested in

Will this work for you?

@aslushnikov Thank you very much for your answer
Now that you say it, I remember saw this answer in another issue, but at the time I've found it a bit obscure. Now, after playing a bit with the code seems clearer for me.
But anyway, won't be easier to just define the environment variable I'm proposing? It is completely transparent for people not using it. It goes in the same direction of PUPPETEER_CHROMIUM_REVISION, where you can choose your revision. Why don't choose the platform, if you wish?
Thank you again for your comment, if you think doesn't worth to add it, I'll change my ugly workaround by some proper use of BrowserFetcher.
Regards,
Ferran

But anyway, won't be easier to just define the environment variable I'm proposing? It is completely transparent for people not using it. It goes in the same direction of PUPPETEER_CHROMIUM_REVISION, where you can choose your revision. Why don't choose the platform, if you wish?

@farumi we can't add every single thing to the library since it'll eventually become unmanageable. Instead, we add only highly demanded features.
This issue looks quite specific to the deployment process and there's a decent workaround, so I don't think it's worth adding another env variable to address this usecase.
Hope this helps!


JetBrains: Chat: Make Cody's typing look and feel faster

This ticket could be called "Make Cody's typing look and feel faster by making it objectively slower" because that's what we intend to do.
Currently, Cody's response arrives in large chunks because that's how the data arrives from the API.
As a result, the user must stare at the partially filled chat window for many milliseconds / several seconds, waiting for the craved information, and it doesn't feel nice.
What we could do instead is to hold back a bit and display the response broken up into smaller blocks and fill the chat message gradually, thus creating an illusion of displaying the response as it arrives.
Think like how a progress bar makes waiting nicer.
We need to implement this so that we don't actually hold back a lot of information, so if the next chunk arrives, we want to speed up Cody's fake typing and quickly reach the next chunk. Similarly, if the next chunk hasn't arrived yet then we can slow down the fake typing to wait for it.

See also: https://github.com/sourcegraph/sourcegraph/pull/54665


CreateCSharpManifestResourceName failed to create a manifest resource name

Steps to reproduce
Attached a rather simple project.
WindowsFormsCore.zip
Expected  behavior
Compile the project should be successful.
Actual behavior
Compilation failed with,
C:\Program Files (x86)\Microsoft Visual Studio\2019\Preview\MSBuild\Current\Bin\Microsoft.CSharp.CurrentVersion.targets(100,9): error MSB3041: Unable to create a manifest resource name for "Test\Form1.resx". Could not find a part of the path 'C:\Users\lextm\source\repos\WindowsFormsCore\WindowsFormsCore\Test\Test\Form1.cs'.
Environment data
It started to happen in .NET Core 3.0 SDK Preview 9 (RC1 still has this issue).
.NET Core 3.0 SDK Preview 8 and earlier seem to be OK.
Workaround
Move all files of Form1 to the root directory of that project, and the compilation error disappears. However, many existing projects should already have such folders to organize their forms/user controls, so applying this workaround will be painful.

Thanks for the report. This should be fixed in the latest rc2 builds and in the final release.

Duplicate of #4695

@rainersigwald Great.


fix: extra properties in templateFiles

Types of changes

[x] Bug fix (a non-breaking change which fixes an issue)
[ ] New feature (a non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Description

If t is string like 'app/template.js', the returned object will be:
{
	0: "a"
	1: "p"
	2: "p"
	3: "/"
	4: "t"
	5: "e"
	6: "m"
	7: "p"
	8: "l"
	9: "a"
	10: "t"
	11: "e"
	12: "."
	13: "j"
	14: "s",
	src: '...',
	dst: '...',
	custom: '...'
}

Checklist:

[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly. (PR: #)
[ ] I have added tests to cover my changes (if not applicable, please state why)
[ ] All new and existing tests are passing.

Codecov Report

Merging #4925 into dev will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##              dev    #4925   +/-   ##
=======================================
  Coverage   91.71%   91.71%
=======================================
  Files          73       73
  Lines        2414     2414
  Branches      594      594
=======================================
  Hits         2214     2214
  Misses        182      182
  Partials       18       18

Impacted Files
Coverage Δ

packages/builder/src/builder.js
88.98% <ø> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 569b6aa...9a5c9ee. Read the comment docs.


Unbreak hg-git

Motivation for this change
hg-git did not work with the current Mercurial because of well-known issues,
one of which is fixed in the latest release, the second one of which has a simple
patch.
Things done

[X] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[ ] NixOS
[X] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[X] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[X] Fits CONTRIBUTING.md.

Sure, but could you briefly explain why? It seems it inserts a dependency on a bitbucket page making the build process more fragile.

Then we don't need to carry the patch in our channel, it is clear where the patch comes from and our cache will also make sure that the patch is available when bitbucket is down.

Thanks for the explanation! (And thanks for the quick review.)
Done.


Provide tools for allowing packaged templates to be unpacked in the projects template dir.

This makes template work for FEDs much easier.
The generate idea is the following:
$ molo unpack-templates molo.profiles

Which would copy all of the stuff in molo.profiless templates directory into the scaffolded applications' templates directory.

happy!

@smn well..I don't think module templates should require modification very often. Post these 2 apps that we're rushing now, any new projects should really be build using Sass (fufu) and follow a very lean markup. So rarely would you ever need to edit the /templates/profiles/register.html

And if you do, like any other app, you'd only override the particular template that you want to modify

Not ready for review yet.

@miltontony ready for review.

:+1:


Console Warning: 'Attr.nodeValue' is deprecated. Please use 'value' instead.

blanket.js:5074
This line in collectPageScripts:
return sn.nodeName === "src" && _blanket.utils.matchPatternAttribute(sn.nodeValue,filter) &&

Can be re-created by installing and enable coverage reporting against https://github.com/softlayer/sl-ember-components/commit/a360de031d90754ac335921dfa9d90b5a131d36e (presently HEAD on the develop branch)

That's an issue with blanket https://github.com/alex-seville/blanket/issues/461, but I'll leave it open until the version is updated with a fix

Looks like a new version of blanket was published in late May (1.1.7) that should include the fix for this.  I'll try to find some time this weekend to do an upgrade and test to see if this is resolved.


Adapter turns yellow after first polling

Peletto 434 Grande is used. Does poll data correctly first time but then the adapter turns yellow in ioBroker and data is not updated anylonger. Restarting adapter works for first polling and then turns yellow again. Is the 30 second polling intervall too much for the Haas Sohn Cloud?

Hey,
since this is an oven, I configured the adapter to terminate itself if an unknown (=untested) hardware/software version is present. However, each new combination can be unlocked.
If you take a look at the log, you should see something like
Hardware / Software combination (???) is not supported by this adapter! Please open an issue on GitHub.
Can you send me this line please?
Best regards

Yep it's true. That's what the log shows
Hardware / Software combination (KS01_V7.11) is not supported by this adapter! Please open an issue on GitHub.

Thanks, I unlocked your device in Version 1.0.5.
Please install this version directly from GitHub, using the "Expert Mode" in ioBroker:

If you can confirm that it works as expected, I'll add it to the stable list.

Thanks for the Update. Sorry for the late reply-was on vacation! Adapter works great now. Thanks!


Update Milvus Aspire docs to reflect auth config and minimum versions support

Describe the issue or suggestion
See dotnet/aspire#4966 for details. Milvus enabled authentication configuration similar to other Aspire resources. The docs at https://github.com/dotnet/docs-aspire/blob/main/docs/database/milvus-component.md would need to be updated to reflect the configuration requirement and password usage.

@timheuer is this a release 8.2 request, or just general?

This would be for the next release


Fix golint issue caused by typo

Signed-off-by: Guangwen Feng<EMAIL_ADDRESS>

Thanks!


It shows a spinning circle while copy pasting

Does this issue occur when all extensions are disabled?: Yes/No

VS Code Version: 1.90.0
OS Version: Windows_NT x64 10.0.19045

Steps to Reproduce:

I don't know

Version: 1.90.0 (user setup)
Commit: 89de5a8d4d6205e5b11647eb6a74844ca23d2573
Date: 2024-06-04T19:33:54.889Z
Electron: 29.4.0
ElectronBuildId: 9593362
Chromium: 122.0.6261.156
Node.js: 20.9.0
V8: 12.2.281.27-electron.0
OS: Windows_NT x64 10.0.19045
provided video link of the issue

Should already be fixed


ReShade breaks shadow control when used with Neptastic Mod

I'm trying to use ReShade with the Neptastic Mod to inject some FXAA since it's infinitely better than the game's default FXAA, however ReShade completely kills all the shadows in the game. Here's a screenshot of Neptastic Mod and ReShade working together:

Disabling shadow control in nep.ini restores the game's low res vanilla shadows.
Verbose log:
nep.log
ReShade log (if it helps at all):
ReShade.log

Sorry, but I've no idea what this ReShade mod/shader is doing and in what order, so I can't comment on it.
You can find sources for shader replacements - including the one used for shadows - in this file and try to integrate them with whatever you're injecting:
https://github.com/tlaik/neptastic/blob/main/src/nep_shaders.h

After further messing around with the shadow options and ReShade, it seems that ReShade doesn't kill the shadows, they're still working, but the higher the shadow resolution goes, the more offset they become, so at 4.0 and 8.0 the shadows are still rendering, but they're all most likely completely off the map. Setting the shadow resolution to 1.0 works, but at that point it's pretty much the same as using the game's vanilla shadows. Anything over 1.0 offsets them.
Here's an example with the shadows set to 1.1:

Would it be possible at all to add a shadow offset option to the mod to deal with this?


pip compile does not carry forward environment markers like sys_platform

If I have a item in my requirement file where I have explicitly provided env markers like sys_platform, it does not get carried forward in the pip compile output.
So, when I have a dependency like pysqlite3-binary; sys_platform=="linux" the pip compile removed the sys_platform part. WHen I use pip-tools, it was not removing that.
Try:
$ echo "pysqlite3-binary; sys_platform==\"linux\"" | uv pip compile --verbose -
DEBUG Starting toolchain discovery for any Python
DEBUG Looking for exact match for request any Python
DEBUG Searching for Python interpreter in all sources
DEBUG Found CPython 3.8.19 at `/home/ali/.conda/envs/py38/bin/python3` (conda prefix)
DEBUG Using Python 3.8.19 interpreter at /home/ali/.conda/envs/py38/bin/python3 for builds
DEBUG Using request timeout of 30s
DEBUG Solving with installed Python version: 3.8.19
DEBUG Adding direct dependency: pysqlite3-binary{sys_platform == 'linux'}*
DEBUG Found stale response for: https://pypi.org/simple/pysqlite3-binary/
DEBUG Sending revalidation request for: https://pypi.org/simple/pysqlite3-binary/
DEBUG Found not-modified response for: https://pypi.org/simple/pysqlite3-binary/
DEBUG Searching for a compatible version of pysqlite3-binary{sys_platform == 'linux'} (*)
DEBUG Selecting: pysqlite3-binary{sys_platform == 'linux'}==0.5.3 (pysqlite3_binary-0.5.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl)
DEBUG Searching for a compatible version of pysqlite3-binary{sys_platform == 'linux'} (==0.5.3)
DEBUG Selecting: pysqlite3-binary{sys_platform == 'linux'}==0.5.3 (pysqlite3_binary-0.5.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl)
DEBUG Found fresh response for: https://files.pythonhosted.org/packages/2a/ec/3007532ea336d705f3abc7961f1a1c89f2fa34733b625ac317eea5a935ea/pysqlite3_binary-0.5.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
DEBUG Searching for a compatible version of pysqlite3-binary (==0.5.3)
DEBUG Selecting: pysqlite3-binary==0.5.3 (pysqlite3_binary-0.5.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl)
DEBUG Tried 1 versions: pysqlite3-binary 1
Resolved 1 package in 104ms
# This file was autogenerated by uv via the following command:
#    uv pip compile -
pysqlite3-binary==0.5.3

And my version:
$ uv version
uv 0.2.10

This is a duplicate of #1429.

As an aside: what pip-compile is doing there is not really safe (as in, you should not rely on those markers). Consider flask ; python_version > '3.8' as your input. pip-compile will resolve to:
blinker==1.8.2
    # via flask
click==8.1.7
    # via flask
flask==3.0.3 ; python_version > "3.8"
    # via -r req.in
itsdangerous==2.2.0
    # via flask
jinja2==3.1.4
    # via flask
markupsafe==2.1.5
    # via
    #   jinja2
    #   werkzeug
werkzeug==3.0.3
    # via flask

So the marker is only applied to the direct dependency, not any of its downstream dependencies. Retaining the markers leads to a resolution that is still incorrect on all other platforms.

Thanks for the note on duplicate. For some reason I did not find it ! Probably searched for the wrong keywords
Hmm, you're right on pip-compile. Luckily I happen to use it only for this 1 dep which does not provide osx wheels and it doesn't have any other deps !


Updated benchmarks to support DistributionsAD and CSV dependency removal

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 81.029%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
252

Relevant Lines:
311

💛  - Coveralls


Interested in Partnering?

Roku recently axed PlayOnRoku for third parties in OS 11.5.
Are you interested in working with me and taking this solution you created to Roku Store as a public channel? Assuming we can get it past requirement.
I would then make it the preferred channel in rokuecp and HA integration.

Hi Chris, let's talk on private, e-mail me at marcelo dot cabral at google e-mail domain

any updates ?


PR: Fix SPYDER_DEBUG=3

Fixes #4829

In Windows running something like 3 or True will return 3 however running something like True or 3 will return True. Also running something like False or 3 will return 3. As a reference:

Hello @dalthviz! Thanks for submitting the PR.

In the file spyder/app/mainwindow.py, following are the PEP8 issues :

Line 3040:59: E502 the backslash is redundant between brackets


The code trace location is wrong!

When I read the koa source code, I tracked the code and then jumped to a directory where it was the Users/yuantu/library/store/typescript/node_modules!
Hope for restoration!
Ps: then you want to know that the index.d.s file is the js code? I don't understand [tears] Want to learn
email<EMAIL_ADDRESS>

It's not clear what you problem is. You can learn about .d.ts files here https://www.typescriptlang.org/docs/handbook/declaration-files/introduction.html

My question is, let me say the procedure, I don't speak English very well
NPM install koa2 - save
The new file index, js

/ / index. Js
Let Koa = require (' koa2 ') / / I click on the command + mouse click on koa2 to the cache
  `
On 05/22/2017 05:25, Daniel Imms wrote: It's not clear what you problem is. You can learn about .d.ts files here https://www.typescriptlang.org/docs/handbook/declaration-files/introduction.html
—You are receiving this because you authored the thread.Reply to this email directly, view it on GitHub, or mute the thread.
{"api_version":"1.0","publisher":{"api_key":"05dde50f1d1a384dd78767c55493e4bb","name":"GitHub"},"entity":{"external_key":"github/Microsoft/vscode","title":"Microsoft/vscode","subtitle":"GitHub repository","main_image_url":"https://cloud.githubusercontent.com/assets/143418/17495839/a5054eac-5d88-11e6-95fc-7290892c7bb5.png","avatar_image_url":"https://cloud.githubusercontent.com/assets/143418/15842166/7c72db34-2c0b-11e6-9aed-b52498112777.png","action":{"name":"Open in GitHub","url":"https://github.com/Microsoft/vscode"}},"updates":{"snippets":[{"icon":"PERSON","message":"@Tyriar in #27011: It's not clear what you problem is. You can learn about .d.ts files here https://www.typescriptlang.org/docs/handbook/declaration-files/introduction.html"}],"action":{"name":"View Issue","url":"https://github.com/Microsoft/vscode/issues/27011#issuecomment-302964342"}}}

@mattbierner I'm guessing this is about go to definition going to the TS declaration file?

This is a duplicate of https://github.com/Microsoft/TypeScript/issues/6209 as far as I can tell
We use .d.ts files to power our javascript and TypeScript language features without having to analyze the original JavaScript sources

yes,this is about go to definition going to the TS declaration file
------------------ 原始邮件 ------------------
发件人: "Daniel<EMAIL_ADDRESS>发送时间: 2017年5月22日(星期一) 上午10:46
收件人<EMAIL_ADDRESS>抄送<EMAIL_ADDRESS><EMAIL_ADDRESS>主题: Re: [Microsoft/vscode] The code trace location is wrong! (#27011)
@mattbierner I'm guessing this is about go to definition going to the TS declaration file?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or mute the thread.


Onboarding for 2021-05-18

Docs Build status updates of commit 4252e95:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

ci-configs/packages-preview.json
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel


Moving the pool setup on controller

The pool setup should be executed on controller and not on the storage nodes.

Oooooooooh ! That's why so much people were havin issues !!!!!!!!!!

Should we push this commit to branch I.1.3 as well?

@fridim if it hasn't been done already, yes !


Remove related link from service instance sharing endpoint

As an app dev (sharer) I no longer get a related shared_spaces link in the shared spaces endpoint #153566266
NOTE: This PR builds on top of #1033, which should be merged first. The actual changes on top of #1033 can be viewed in this diff.
What
When we first implemented the POST /v3/service_instances/:guid/relationships/shared_spaces endpoint, we returned a response that looked like this:
{
  "data": [
    {
      "guid": "885de116-1313-46a3-a578-f152eea17af6"
    },
    {
      "guid": "05e472b8-ff7d-4f2f-bd00-dd874aa822eb"
    }
  ],
  "links": {
    "self": {
      "href": "https://api.example.com/v3/service_instances/ddaa57af-eeaf-4098-9f7e-31aad16c36f5/relationships/shared_spaces"
    },
    "related": {
      "href": "https://api.example.com/v3/service_instances/ddaa57af-eeaf-4098-9f7e-31aad16c36f5/shared_spaces"
    }
  }
}

As we're rounding out the API and filling in the gaps, we looked into implementing the GET endpoints to the two links listed in the links section. We found that the related link above is somewhat strange to implement and consume, since it would need to be heavily redacted if the querying user doesn't have full read permission to all the target spaces. This PR removes the related link. The work to implement the GET method on the self link, on the other hand, will be coming shortly in a following PR.
Changes:

Removed related link from being return by the response of POST /v3/service_instances/:guid/relationships/shared_spaces
Removed related link from documentation of this endpoint.

PR

[X] I have viewed signed and have submitted the Contributor License Agreement
[X] I have made this pull request to the master branch
[X] I have run all the unit tests using bundle exec rake
[X] I have run CF Acceptance Tests on bosh lite

Thanks,
SAPI team (@jenspinney and @ablease)

Changes looks good. Docs looks good. Merging now.


Incoming payment Controller Tests

Incoming payment controller tests should be created.
Incoming payment Service tests can be also added if needed.

Hi, I am interest to resolve this issue.


Not possible to set defaults from within an app?

Is the only way to set defaults for awesome_print through ~/.aprc?
It would be good if it could be done through an initializer, but this doesn't seem to work (this is a Rails app):
config/initializers/awesome_print.rb
AwesomePrint.defaults = {
  plain: true
}

Using an external defaults file doesn't play well when using a PaaS platform like Heroku...

Hi the problem will be that awesome print will be loading after your initialiser and overriding your defaults with it's own. This may be something we address in the future, but for now, if you put
require 'awesome_print' just before your defaults, that should address your issue.
Although now that you mention Heroku... I wouldn't recommend using AwesomePrint in your production environment, if that is what you are doing as it's only really intended for development purposes.

@gerrywastaken should placing the require call in front of the defaults still get around this?


Add userId reference field import if schema belongs to user

I added a simple fix for issue #2 by concatenating the userId reference field type when the schema belongs to a user.
Note: I used "string" reference field type because the generated users table always uses text or varchar.

Sorted with: https://github.com/nicoalbanese/kirimase/commit/777dd233502a546eb2d57606e61d3f09bd4248c6


(PDB-1105) Remove experimental status of v4 api

This commit removes the warning message when using the v4 endpoint of
the query api as well as the corresponding documentation changes needed
to express that v4 is the new 'stable' endpoint.
Merge with https://github.com/puppetlabs/puppet-docs/pull/426.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/410/

@pljenkinsro retest this please

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/416/

I can see a few more occurrences by grepping the repo for "stability"

@wkalt the only reference I was able to see was related to metrics, which is handled by https://github.com/puppetlabs/puppetdb/pull/1209
+1 from me

@senior oh yeah good point


Tweak the formatting of the team page

The layout is identical, except the tables of people will resize to fit the screen for small screens (mobile etc.) and any hanging people (e.g. a team with 5 people when the row fits 4) will be centred instead of left aligned.

r? @brson
(rust_highfive has picked a reviewer for you, use r? to override)


UNAVAILABLE: HTTP/2 error code: NO_ERROR Received Goawaysession_timed_out

Operating System version: Ubuntu
Firebase SDK version: 6.8.1
Firebase Product: Firestore

This is the callstack:
java.util.concurrent.ExecutionException: com.google.api.gax.rpc.UnavailableException: io.grpc.StatusRuntimeException: UNAVAILABLE: HTTP/2 error code: NO_ERRORReceived Goawaysession_timed_out at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:500) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:479) at com.google.common.util.concurrent.AbstractFuture$TrustedFuture.get(AbstractFuture.java:76) at com.google.common.util.concurrent.ForwardingFuture.get(ForwardingFuture.java:62)
This is my lines of code that triggered this
ApiFuture future = db.collection(collection).document(doc).set(fsData, SetOptions.merge());
future.get();
This is working most of the time, it happened only twice so far so maybe it's something temporary but I have no idea what it is and how to overcome this.
Please advice
Thanks

@Amosss can you please add log level to FINEST and send it over?

Not sure what do you mean by log level. I added the trace to my post. The line that threw the exception is com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:500)
The trace go back up to my part of the code which is a simple:
ApiFuture future = db.collection(collection).document(doc).set(fsData, SetOptions.merge());
future.get();
It works most of the time and the once or twice it didn't work, it was due to that error.
Looks like a temporary issue that was in a perfect timing with my request. Not something that can be reproducible to the exact details. I wonder maybe if you can add some more checks or retries in such cases.

@Amosss this rpc is not safely retriable, thats why automatic retry is not enable. Please see conversation in #4235. However you can add retries in application code if its safe to retry.

Thanks but what do you consider "if its safe to retry"?

means from applications perspective, its ok for the operation to happen more than once without any side effects.

Assuming the first one failed, there was never a "once" to have "more than" :-) Thanks for the tip. I guess I will need to add such fail safe to all my futures. I wish Marty Mcfly was here :)

@Amosss there can be case where operation is applied on server, but proxy might have sent UNAVAILABLE due to various reason, retrying in this case would cause more than once situation.


Date & time UI & UX

hey @avinash201199
I made all the changes to make the clock Ui & UX better ...
I hope you like it ..If you like it please merge it into your

project ...

good work


/usr/bin/env: 'python2' error for Manta

Version info

bcbio version (bcbio_nextgen.py --version): 1.2.9
OS name and version (lsb_release -ds): Red Hat Enterprise Linux release 8.5 (Ootpa)

To Reproduce
Exact bcbio command you have used:
bcbio_nextgen.py ../config/NA12878-sv.yaml -n 16

Your yaml configuration file:
# Evaluate structural variant calling on NA12878 whole genome data,
# using validated deletions and insertions from the Genome in a Bottle svclassify project
# https://groups.google.com/d/msg/genome-in-a-bottle/v3EDUgZT0Xo/eGYsQlJk2JMJ
#
# See the bcbio-nextgen documentation for full instructions to
# run this analysis:
# https://bcbio-nextgen.readthedocs.org/en/latest/contents/testing.html#example-pipelines
---
details:
- algorithm:
    aligner: bwa
    align_split_size: false
    exclude_regions: [lcr]
    recalibrate: false
    realign: false
    tools_off: [collectsequencingartifacts]
    variantcaller: false
    svcaller: [lumpy, manta, cnvkit, metasv, wham]
    svvalidate:
      DEL: ../input/giab-svclassify-deletions-2015-05-22.bed
      INS: ../input/giab-svclassify-insertions-2015-05-22.bed
  analysis: variant2
  description: NA12878
  files:
  - ../input/NA12878_1.fastq.gz
  - ../input/NA12878_2.fastq.gz
  genome_build: hg38
  metadata:
    batch: ceu
    sex: female
upload:
  dir: ../final

Log files (could be found in work/log)
Please attach (10MB max):  bcbio-nextgen-commands.log, and bcbio-nextgen-debug.log.
bcbio-nextgen-debug.log
bcbio-nextgen-commands.log
It seems that the runWorkflow.py script for Manta (that gets generated when manta runs) has #!/usr/bin/env: python2 as the shebang line which access the system's python rather than bcbio env python. How can this be rectified in the pipeline?
Regards,
Prasun

Hi @prasundutta87 !
Thanks for reporting!
I've just ran SV analysis in 1.2.9 including manta - it worked.
Let us see.
Your command from commands.log
/mnt/e1000/home/u027/u027/pdutta/bcbio-nextgen/bcbio_data/anaconda/envs/python2/bin/python \
/mnt/e1000/home/u027/u027/pdutta/bcbio-nextgen/NA12878-sv-eval/work/bcbiotx/tmpwsnx_nt3/manta/runWorkflow.py \
-m local -j 16

looks correct.
debug.log has:
[2022-03-22T03:39Z] [2022-03-22T03:39:18.984766Z] [sdf-cs1] [2542664_1] [TaskRunner:getChromDepth_sample000_catChromDepth] [WARNING] Task: 'getChromDepth_sample000_catChromDepth' failed but qualifies for retry. Total task failures (including this one): 1.

Manta is a great tool, but still written some time ago and not supported since that. Manta does not work for some samples - they just fail.
What data are you using as input? is it NA12878 WES or WGS?
Sergey

Hi @naumenko-sa,
I tried running the example data present in https://bcbio-nextgen.readthedocs.io/en/latest/contents/structural_variants.html. It is WGS.
-Prasun

Thanks for reporting. As far as I recall, it worked in GRCh37 SV validation.
Too bad that manta is not working for hg38 + NA12878. however, we don't have much chance to fix it:
https://github.com/Illumina/manta/issues
Yes, please ask. I will try to answer or maybe anybody else from the community will chime in.
Sergey


"kafka: response did not contain all the expected topic/partition blocks" out of nowhere? when changing compression

Hi, I think if I interpret the kafka docs, i should be allowed to switch back and forth between none/gzip/snappy compression to the same topic/partition, right?
anyway when I try this, first i use no compression, than kill my producer, restart it with snappy or gzip compression, send data to the same topic/partition, i get this in the logs:
[Sarama] 2016/07/08 21:51:24 consumer/broker/0 added subscription to mdm/0
[Sarama] 2016/07/08 21:51:24 kafka: error while consuming mdm/0: kafka: response did not contain all the expected topic/partition blocks
[Sarama] 2016/07/08 21:51:24 consumer/broker/0 abandoned subscription to mdm/0 because kafka: response did not contain all the expected topic/partition blocks
[Sarama] 2016/07/08 21:51:26 consumer/mdm/0 finding new broker
[Sarama] 2016/07/08 21:51:26 client/metadata fetching metadata for [mdm] from broker kafka:9092
[Sarama] 2016/07/08 21:51:26 consumer/broker/0 added subscription to mdm/0
[Sarama] 2016/07/08 21:51:26 kafka: error while consuming mdm/0: kafka: response did not contain all the expected topic/partition blocks
[Sarama] 2016/07/08 21:51:26 consumer/broker/0 abandoned subscription to mdm/0 because kafka: response did not contain all the expected topic/partition blocks
[Sarama] 2016/07/08 21:51:28 consumer/mdm/0 finding new broker
[Sarama] 2016/07/08 21:51:28 client/metadata fetching metadata for [mdm] from broker kafka:9092
[Sarama] 2016/07/08 21:51:28 consumer/broker/0 added subscription to mdm/0
[Sarama] 2016/07/08 21:51:28 kafka: error while consuming mdm/0: kafka: response did not contain all the expected topic/partition blocks
[Sarama] 2016/07/08 21:51:28 consumer/broker/0 abandoned subscription to mdm/0 because kafka: response did not contain all the expected topic/partition blocks
[Sarama] 2016/07/08 21:51:30 consumer/mdm/0 finding new broker
[Sarama] 2016/07/08 21:51:30 client/metadata fetching metadata for [mdm] from broker kafka:9092
[Sarama] 2016/07/08 21:51:30 consumer/broker/0 added subscription to mdm/0
[Sarama] 2016/07/08 21:51:30 kafka: error while consuming mdm/0: kafka: response did not contain all the expected topic/partition blocks
[Sarama] 2016/07/08 21:51:30 consumer/broker/0 abandoned subscription to mdm/0 because kafka: response did not contain all the expected topic/partition blocks

Sarama Version: latest git master
Kafka Version: 0.10
Go Version: 1.7rc1
any idea? thanks!

Hi, I think if I interpret the kafka docs, i should be allowed to switch back and forth between none/gzip/snappy compression to the same topic/partition, right?

Off the top of my head, https://issues.apache.org/jira/browse/KAFKA-1499 suggests that you should, and that it will all end up uniform on the broker.

kafka: response did not contain all the expected topic/partition blocks

That is... surprising. It sounds like you've hit some very peculiar bug in either Sarama or upstream Kafka. I just did a quick skim of our produce-response-parsing code and didn't spot anything, so I would suggest you take a look at the actual broker logs when you try this. Is the broker logging any exceptions? If the Sarama log is accurate then the broker is sending a malformed response and you'll need to take it up with upstream.

Thanks @eapache
i took a copy of all ZK and kafka logs when stopping the nonecompression producer, then restarted producer with sappy enabled, confirmed the errors appearing in my consumer, but some diff -r'ing confirms nothing new appeared in either the ZK or kafka logs :( no exceptions either.
FWIW here's all the kafka, zk and supervisor logs https://gist.github.com/Dieterbe/7142236d6828b7bb078c6f0172b543c4 and this is how I'm running it: https://github.com/raintank/raintank-docker/tree/master/kafka

Ya, I'm not sure what the problem is still. You might try inspecting the actual traffic on the wire using a tool like Wireshark to see if the Sarama error message is correct and the broker responses are actually missing the relevant blocks? I definitely suspect an upstream issue, though I have no proof.

https://issues.apache.org/jira/browse/KAFKA-3961

so i found out i can trigger this behavior without going from none->gzip or none->snappy. just using gzip/snappy directly works too. i tried sniffing with wireshark but it's hard to inspect the tcp stream, it looks pretty garbled. probably due to the compression.

Is #720 the explanation?

Hey @eapache don't have time to run the test right now but it seems very likely! glad we're on to something!

Yes, this is the same as #720.

using the latest sarama i'm still seeing this when trying to use snappy:
[Sarama] 2016/09/20 08:57:37 kafka: error while consuming mdm/1: kafka: response did not contain all the expected topic/partition blocks
[Sarama] 2016/09/20 08:57:37 consumer/broker/0 abandoned subscription to mdm/1 because kafka: response did not contain all the expected topic/partition blocks

i use 	config.Version = sarama.V0_10_0_0 btw. we manually manage offsets and use sarama.NewClient and sarama.NewConsumerFromClient

It's possible my fix in #735 missed a case or something, but it worked in my simple tests so I'm not sure what might be going on. It would be helpful if you could put some additional logging in that flow and see where the issue is.


Arabic Support

Hello Guys 😁.
I'm wondering if can I add the arabic support to the package ?
If yes, Please confirm so I can open my PR.
Thanks!

Hi @moneebalalfi, please feel free to raise the PR for arabic support.


Handle Follow Redirect on Fragments

As the title, how's about we make an option on fragment tag to whether follow redirection (3xx) or not.
Now, fragment request handler only handles on http-error case but not http-redirect. There might be a case that sometime fragment servers sit under the redirection rules of its infrastructure and network. For an example, redirects from http to https, etc.
I got the idea when I saw some options on request. There are options followRedirect, followAllRedirects, etc. So, it's nice to have these here.
Let me know what do you guys think.

Why I cannot set a label to feature? lol

Hi Trick, I am not sure it makes sense to follow redirects as it would make it slower if you had to follow a redirect on every request. It would make it twice as slow everytime. If you had to make a redirect, better would be to update the tailor template :) or use Quilt
@vigneshshanmugam Has Quilt been released? It doesn't look like it on https://www.mosaic9.org/

@trickpeeraze The reason why we don't it for every fragments is that, It will make the whole page composition slower as @kevinsimper pointed out.
The redirects are only handled by primary fragment since the fragment is the only one responsible for setting the status code of the page. so primary fragment can reply with 301 and the browser would take it from there.
@kevinsimper No, Its just a simple key value data store, So we thought of not doing it since its easier to do it. We do have a template cache internally, I will open source it with 4.0.0

@vigneshshanmugam My case is fragments is developed by other teams and they redirect their fragment from http://www.sample.com to https://www.sample.com.
So when we(Tailor) call them by http://www.sample.com, I need to support redirect to https by myself.
Work around is changing url to https://www.sample.com, but I think I still need to support redirect because I can't handle the fragment that developed by other team. In the future they might redirect the another url.
But the problem is as @kevinsimper mention, it will take longer time. Template cache is a good way to help. (Now I'm using ejs for template caching)

@WarisR Got it, You can pass in your own requestFragment function in tailor options and handle it it without touching tailor functionality and it still would work.
https://github.com/zalando/tailor#options

Yes yes, I got that point too so, what I am offering is an option that you can turn on and off on each fragment (via its attributes). If users want their fragments to follow redirection just turn it on and take your own risk (performance of cause). On @WarisR commented, that's such a case. I think there are other situations as well.
Btw, I just drop the idea. I'm glad that you guys come and discuss together. :)
@vigneshshanmugam I just notice that the primary fragment's already been handled redirection. However, you're saying that 301 will be forwarded to browser and it will take care the rest. In that case, there's an entire page redirection, isn't it? And this what primary is as the Tailor's concept, right?
@kevinsimper thank you for an advice but honestly, I'm quite not understand much about the concept of Quilt. Is it some kind of a registry like npm?

@trickpeeraze Yes you are right, it will result in a page redirection.

Is it some kind of a registry like npm?

No, its just like a key/value store for templates
Request -> https://www.zalando.de/home
Tailor -> Tries to fetch the template for /home from Quilt
Quilt
Key - /home
Value - <html> <head/><body/></html>
Hope this helps, Let me know if it helps.