(PUP-7277) Add Init[T] type to the Puppet Type System.

This PR contains the necessary changes to add a new Init[T] type to the Puppet Type System. Several minor issues were detected during the implementation work and when adding the unit tests, hence the 9 (maint) commits. Some refactoring was also made on how loaders are handled by types to avoid loader confusion when initializing types using the Init type.

The types Optional[T] (which essentially is a Variant[Undef,T]) and Variant[T1, T2] are not allowed in an Init. A Variant[Init[T1], Init[T2]] is OK although it cannot be used as an argument to #new.

CLA signed by all contributors.

AppVeyor fails with "Debug: Failed to load library 'syslog" seems unrelated.

That's not a failure. It's a debug trace which has been there for a long time.
The curious thing is that although the tests end with "21491 examples, 0 failures, 59 pending", the exit status is still 1. I'll restart and see what happens.


Fixes #27 Integrate GearPump Scheduler into YARN

YarnAM is now running successfully. Master and workers are not yet launching correctly.

Hi Kam, seems now the AppMasterSpec often fails, may be you could increase the timeout duration of line 122.

Thanks Huafeng - I'll get to it later tonight or tomorrow morning

+1

Thanks Sean :)


Passing props to nested components?

I'm trying to set up a simple Hello World app and am confused as to how props get passed to nested components with react-templates. I tried following the example given with InfiniteScroll.js but it doesn't seem to be working for me.
The initialization code:
import ListTemplate from './ListTemplate.rt.js';
import React from '../vendor/react';

var ListPosts = React.createClass({
  render: function() {
    return ListTemplate.apply(this);
  }

})

function init() {
    React.render(
      React.createElement(ListPosts),
      document.querySelector("#content"));
}

module.exports = {
    init: init
}

ListTemplate.rt:
<rt-require dependency="./Hello" as="Hello"/>

My First React Templates App:

    <Hello msg="Hello World">

Message from props: {this.props.msg}

    </Hello>

Hello.js
import React from '../vendor/react';

export default class Hello extends React.Component {
  constructor(props) {
    super(props)
  }

  render() {
    return React.DOM.div(this.props, this.props.children)
  }
}

ListTemplate.rt.js:
import React from '../vendor/react';
import _ from '../vendor/lodash';
import Hello from './Hello';
export default function () {
    return React.createElement('div', {}, React.createElement('p', {}, 'My First React Templates App:'), React.createElement(Hello, { 'msg': 'Hello World' }, React.createElement('p', {}, 'Message from props: ', this.props.msg)));
};

The output is just: "My first React Templates App:" . The problem I see is that this.props.msg is not defined in ListTemplate.rt.js. The documentation doesn't seem to provide examples of this type of process. Any ideas?

Figured it out after digging into some other issues.
Solution was to break the Hello component into its own .rt file, and change Hello.js to
import React from '../vendor/react';
import HelloTemplate from './Hello.rt.js'

export default class Hello extends React.Component {
  render() {
    return HelloTemplate.apply(this);
  }
}


Enable HTTPS

Hello,
I want to be able to use https with my site for performance and security purposes, I've seen some examples changing the settings in the config files but so far nothing that could apply to my project, Is this possible? Has anyone tried this in a project using vuesion?

Hey, I usually use https with vuesion. But this is handled by the infrastructure set up. Can you tell me what you use? (aws, azure, vercel, heroku, etc.)

You're right, we've implemented this with IIS just by setting the bindings there. We are trying different things to improve the performance of the app and I was able to deploy the app as an SPA  but I wanted to try SSR, I was reading the documentation to see how I could make that work.
Checking this out: https://vuesion.github.io/docs/en/v3/guide/deployment.html#isomorphic-universal-web-application
It indicates which files to include in the deployment but I'm not so sure on how to set them up on the website folder and specially on how the web.config should look like in this case. Do you know how this should be setup or have any examples or any other documentation I could use as a guide for this?

closing this due to inactivity


[CH] Core dump when io.glutenproject.RunTPCHTest stop

Describe the bug
When executing io.glutenproject.RunTPCHTest with bhj disable, it will be core dump after stopping.
To Reproduce
Steps to reproduce the behavior:
Expected behavior
A clear and concise description of what you expected to happen.
Additional context
Add any other context about the problem here.

fixed


Support arm64 build for latest macos runners

I opened this PR, to pin to macos-12, but then found that adding support for arm64 runners isn't a big change.
Note: The build for this PR might fail if this repository hasn't completed the macos-latest migration from macos-12 to macos-14 yet.
Migration has completed because the macos-build is successful.

The Native: macos-latest/release job completed in 6 minutes! debug in 10! 😮

I don't think we want to be using macos-latest in the end, because it's not actually the latest.  I switched Swifty-LLVM testing to the macos-13 runner when I discovered that, most likely because it was missing something I needed like zstd.

I've just seen your PR where you ran into the same error: https://github.com/hylo-lang/hylo/actions/runs/8836074265/job/24261792049
And the switch to macos-13 to fix it. https://github.com/hylo-lang/hylo/pull/1439/commits/3db2a61ac46d0c92f0d691dc8729fe74236369a4
I'll close this then, because it looks like you've got it handled. The main branch is failing though, so if your PR is going to take some time to merge, perhaps we should make a small change macos-latest -> macos-13 to fix it. wdyt?

As suspected, the merge of this commit to main yesterday ran into the same error for macos-latest, which now has migrated to macos-14.
https://github.com/hylo-lang/hylo/actions/runs/8837773206/job/24267384784

@peter-evans my PR is currently blocked against https://github.com/SwiftyLab/setup-swift/issues/279 so if this fixes main and it can pass CI, we should land it.

@dabrahams Sure. We can either merge this one, which uses macos-latest -> macos-14, or this PR, which pins to macos-13.  Either route should fix the macos builds temporarily until your cmake PR lands.

I created that second PR because it sounded like you preferred that option in https://github.com/hylo-lang/hylo/pull/1441#issuecomment-2077703469

I didn't even know there was a macOS-14 runner (or a macOS-14 for that matter)!  I just figured if macOS-latest was 12, the real latest must be 13.

I didn't even know there was a macOS-14 runner (or a macOS-14 for that matter)! I just figured if macOS-latest was 12, the real latest must be 13.

Ah I see. 😄
Yeah for some reason they seem to have skipped macos-13, even though it's available as a runner, and transitioned macos-latest from 12 -> 14. 🤷♂

@peter-evans Is this PR still relevant?  If so, let's discuss what's necessary to get it merged.  Otherwise, please close it.  We shouldn't have languishing open issues and PRs hanging around if possible.  Thanks

I'll close it for now. Not sure if it's still relevant, so we can revisit at a later date.


vert-x with api gateway

Hi Team,
I have started using vert-x, does the vert-x can acting as reverse proxy (zuuls or Spring Cloud Gateway)?
Regards

you can use Vert.x has a very scalable api gateway but you need to do it yourself.

@ryrun168 if you don't want to implement it by yourself, there is already an API Gateway based on Vert.x: https://github.com/gravitee-io/gravitee-gateway

@brasseld thanks for share.


$cordovaContacts needs major update since last iOS bug fixes in cordova-plugin-contacts pickContact()

A major bug in the pickContact function leads to complete app crash under iOS when dealing with linked contacts (meaning almost all contacts for most users). This bug and a few others have been fixed in the latest cordova-plugin-contacts master version (https://github.com/apache/cordova-plugin-contacts/tree/master).
The plugin version in ng-cordova is now several months old and leads to these crashes.
Could you please consider an update asap?
Greatly appreciated.

Hi, are you aware that ngCordova does not bundle the plugins it references? It's just a set of wrapper functions that converts the JS api into Angular style methods, whatever the version of the plugins used.
From what I read here http://ngcordova.com/docs/plugins/contacts/, the methods called (create, find, pickContact) are up to date.
So, to sum up, no need to update ngCordova for every bugfix in the wrapped plugins, happily :)
:-1:

Is it possible to pick multiple contacts using pickContatc(), if not please suggest me other ways to pick multiple contacts.


Making source selection translatable.

Note: This patch needs the parallel update of all modules using get_source.
I will try to provide those patches and report here when ready.

Relevant references to get_source appear in:
nereid-cart-b2c/channel.py:23:    def get_source(cls):
trytond-amazon-mws/channel.py:60:    def get_source(cls):
trytond-pos/sale.py:59:    def get_source(cls):
trytond-prestashop/channel.py:86:    def get_source(cls):
trytond-magento/channel.py:148:    def get_source(cls):
trytond-ebay/channel.py:64:    def get_source(cls):

Before doing further work could you please indicate, if you will merge this request(s)? Still to do then:
trytond-amazon-mws/channel.py:60: def get_source(cls):
trytond-pos/sale.py:59: def get_source(cls):
trytond-prestashop/channel.py:86: def get_source(cls):
trytond-magento/channel.py:148: def get_source(cls):
trytond-ebay/channel.py:64: def get_source(cls):

LGTM
This can be merged, when other channels also adapt this logic.

Tarun Bhardwaj: " Re: [trytond-sale-channel] Making source selection
translatable. (#63)" (Wed, 02 Dec 2015 15:08:39 -0800):

LGTM
This can be merged, when other channels also adapt this logic.

Reply to this email directly or view it on GitHub:
https://github.com/fulfilio/trytond-sale-channel/pull/63#issuecomment-161462575

Will proceed to fix the other channels when I find a little spare time.
--
Mathias Behrle
PGP/GnuPG key availabable from any keyserver, ID: 0x8405BBF6


RE: #18 Compton

This is the same PR as #18 which I accidentally deleted.
Still has to be rebased onto the newest dev, but the merge conflicts aren't quite trivial.

@AntonReinhard Can it still be merged?

We will close this in favor to the latest introduction of PhaseSpacePoint and the implementation of Compton scattering in that. (cf. #52, #59, #63, #68)


Revendor etcd/raft

Change Campaign logic to trigger after Advance, because now Campaign
won't do anything if there are uncommitted entries. Also, remove the
check on Progress, because now Progress is only filled in if the node is
already the leader.
Set a smaller WAL segment size to work around high I/O load on Mac when
running unit tests.
Fixes #1229

Current coverage is 55.29% (diff: 100%)

Merging #1353 into master will decrease coverage by 0.01%

@@             master      #1353   diff @@
==========================================
  Files            80         80
  Lines         12558      12557     -1
  Methods           0          0
  Messages          0          0
  Branches          0          0
==========================================
- Hits           6946       6943     -3
+ Misses         4658       4655     -3
- Partials        954        959     +5

Powered by Codecov. Last update abb15df...8c1075e

while running this branch, got this:
--- FAIL: TestRaftSnapshot (10.76s)
        Error Trace:    testutils.go:104
                        testutils.go:365
                        storage_test.go:67
        Error:          Received unexpected error polling failed: did not find leader in member list

FAIL
exit status 1

while running this branch, got this:

Was this on Mac? I also saw some issues with the tests due to I/O load, but I have an upstream PR pending that should solve the problem.

Negative. Ubuntu 12.04 LTS.

@dperny: I made a change to the test that may help. Can you check if the problem is still occurring?

My PR to coreos/etcd that allows tests to work around the preallocation issue was merged. Updated this PR and removed WIP.

@aaronlehmann, sorry, I should have specified that the failure was intermittent. I got it in one run out of maybe 10.

-22k LOC? I'm in.
LGTM

-22k LOC? I'm in.

Yeah, some of it is from removing dependencies like candiedyaml that we don't use any more. But also etcd switched to a better vendoring system where they aren't rewriting import paths. So we no longer vendor two copies of gogoprotobuf, for example.

Rebased after #1327 to adapt to new locking API in this upstream version, and adjust TestGCWAL for the smaller segment size. The test is now enabled in CI.
PTAL

Thanks @aaronlehmann, I'm going to test this with docker integration.

Haven't seen any issue running a cluster with docker integration, removing the progress check seems safe too since we now vendor v3.
On 3 Manager cluster, I tested:

promotion/demotion (with self-demotion)
stop whole cluster and restart
stop whole cluster and restart a subset
stop leader
some service operations and stress-test while doing all of the above

We should think about using the leadership transfer on self-demotion now that we vendor v3.
LGTM

Cool. Did you have a chance to run the Docker integration tests? I haven't done this yet.

Docker integration tests passed. Here goes nothing.

@LK4D4: Actually it's -36k LOC - GitHub is not showing correct totals.


Extension prevents Code actions with keyboard shortchut Ctrl + .

The default behaviour with the keyboard shortcut Ctrl + . brings up code actions on any widget. But with the extension enabled, code actions does not show. I'm unsure if this is only in a case when it returns the No widget found dialogue at the bottom right of the screen,
To Replicate:

Create a flutter project, or open existing Flutter project
With the default project template, try to invoke code actions on any widget with Ctrl + .

Hello @davidnwaneri ,
Ctrl + . is a hotKey for windows, basically when you highlight on any widget, and then use that hotKey, it is suppose to search automatically.
You can customise that to your choice, this will allow code actions to work once again

I guess that works.


[Feature][ray-operator] Make pod creation errors accessible

Search before asking

[X] I had searched in the issues and found no similar feature requirement.

Description
Right now, if the operator fails to create a head or worker pod for any reason, the fact of the failure and the reason for it is not surfaced anywhere except in the operator logs. The only thing you can see is status.state = Failed in the RayCluster CR.
Typically, we don't want end-users to have to dig through operator logs. We should surface pod creation issues in a user-accessible way.
Use case
Observability into failure of pod creation, which can happen for a variety of reasons.
Related issues
No response
Are you willing to submit a PR?

[ ] Yes I am willing to submit a PR!

cc @davidxia, re: surfacing quota issues

@DmitriGekhtman thanks for creating this issue.

We should surface pod creation issues in a user-accessible way.

One specific example of this is when a K8s ResourceQuota is exhausted. The kuberay-operator logs show an error like
2022-10-17T18:10:34.669Z	ERROR	controller.raycluster-controller	Reconciler error	{"reconciler group": "ray.io", "reconciler kind": "RayCluster", "name": "andreasd-cluster1", "namespace": "podampray", "error": "pods \"andreasd-cluster1-head-rs8wr\" is forbidden: exceeded quota: quota, requested: limits.cpu=12,requests.cpu=12, used: limits.cpu=996,requests.cpu=996, limited: limits.cpu=1k,requests.cpu=1k"}

The RayCluster resource only says the following. It should provide more info.
kubectl -n podampray get rayclusters andreasd-cluster1
NAME                AGE
andreasd-cluster1   39m

kubectl --context gke_kubeflow-platform_europe-west4-b_ml-compute-1 -n podampray get rayclusters andreasd-cluster1 -o json | jq .status
{
  "availableWorkerReplicas": 6,
  "desiredWorkerReplicas": 5,
  "lastUpdateTime": "2022-10-17T18:46:21Z",
  "maxWorkerReplicas": 11,
  "minWorkerReplicas": 5,
  "state": "failed"
}

kubectl --context gke_kubeflow-platform_europe-west4-b_ml-compute-1 -n podampray describe rayclusters andreasd-cluster1

...

Status:
  State:  failed
Events:
  Type    Reason   Age   From                   Message
  ----    ------   ----  ----                   -------
  Normal  Created  35m   raycluster-controller  Created service andreasd-cluster1-head-svc

Seems like a natural and important addition to status-reporting logic.
cc @Jeffwan @akanso

@DmitriGekhtman, how about setting a status.reason on the RayCluster with the error message? I'm taking a look now at stubbing out a PR since I have time.
kubectl --context gke_kubeflow-platform_europe-west4-b_ml-compute-1 -n podampray get rayclusters andreasd-cluster1 -o yaml

...
status:
  state: failed
  reason: pods "andreasd-cluster1-head-rs8wr" is forbidden: exceeded quota: quota, requested: limits.cpu=12,requests.cpu=12, used: limits.cpu=996,requests.cpu=996, limited: limits.cpu=1k,requests.cpu=1k

Thanks for the PR draft! Will take a look.


FTP Subjects: Order of replayable queue affects total measured coverage

Hi,
I am experimenting with reusing the replayable queues of fuzzing runs against other targets and ProFuzzBench has been a very helpful tool so far! To do so, I am using the "cov_script.sh" for the different FTP subjects, but without any preceding fuzzing.
However, I have ran into an issue, where the order in which I replay test cases changes the outcome of these replays.
Specifically, LightFTP's seed "ftp_requests_full_anonymous.raw" seems to be the problem, as it is the only test cases authenticating with USER anonymous instead of USER ubuntu (BFTPD, ProFTPD) or USER fuzzing (PureFPTD).
When this test case is replayed on other subjects first, the total coverage is considerably smaller than what the exact same queue achieves, if it is replayed last.
For example, replaying only the seed corpus of a given subject in addition to the two LightFTP seeds with no fuzzing at all:

BFTPD

anonymous first: 27.0% line coverage, 16.8% branch coverage
anonymous last:  41.9% line coverage, 27.8% branch coverage

ProFTPD

anonymous first: 16.4% line coverage, 10.9% branch coverage
anonymous last:  24.9% line coverage, 17.8% branch coverage

These are the same 15 test cases, just replayed in a different order!
LightFTP and PureFTPD appear not to be affected from what I have seen so far.
It seems to me the reset between replays is not working properly and the run gets "stuck" with the less privileged user.
The affected test case even executes a QUIT at the end, although I think the fuzzer shouldn't depend on its test cases to properly clean up after them.
As I am only reusing ProFuzzBench functionality, I am fairly certain that this is a issue with these FTP subjects in general, not just my use case.
Do you have any ideas what exactly the problem is or how to fix it?
Thanks in advance and thank you for providing this great tool!

Thanks @SpormannDavid for reporting this issue. It looks buggy. I don't know the exact reason yet but your detailed explanation is very helpful for debugging. Will try to get back ASAP.

Hi all,
It seems a problem with permissions of *.gcda files produced by the instrumented server (which runs as the logged-in user).
I just committed a bug-fix, it seems to work now. @SpormannDavid  can you kindly test it?
I also removed files from the "ftpshare" folder before each run, since residual files can slightly affect coverage (e.g., outcome of directory listing and other operations). Since BFTPD also saves *.gcda within "ftpshare", I moved the working directory of the server to "ftpshare/data" subfolder.


NullPointerException in CudaDirectProvider.malloc when trying to create a diagonal matrix

I'm trying to convert a vector into a diagonal matrix using the static method Nd4j.diag, and getting a NPE in the malloc method of CudaDirectProvider (stack trace below).
The input vector is an NDArray created from a Java primitive double[].
I'm using cudnn 5.1, cuda 7.5, and a GTX-960.
I've set the data type as "double" via DataTypeUtil.setDTypeForContext(DataBuffer.Type.DOUBLE). (Half or float lead to a different error - cannot cast ShortPointer to FloatPointer in JcublasLevel2.java at line 52).
The code is running in a loop that traverses multiple member records. The first few dozen work fine, then one throws this exception. The underlying data for this record doesn't look any different from the other records. If I remove this record, the code will progress over a few more and then throw this exception again.
I've successfully reproduced this on an EC2 instance running the recently-announced DL4J AMI as well as my local environment.
Note this is not a neural network - just linear algebra. I'm only using ND4J - not DL4J or DataVec etc.

2016-10-09 18:02:10,987 INFO  c.p.r.OptimizeLatentFactors - Member 213830 (49)
2016-10-09 18:02:13,219 ERROR j.l.Throwable - Exception in thread "main" java.lang.NullPointerException
2016-10-09 18:02:13,220 ERROR j.l.Throwable - 	at org.nd4j.jita.memory.impl.CudaDirectProvider.malloc(CudaDirectProvider.java:89)
2016-10-09 18:02:13,220 ERROR j.l.Throwable - 	at org.nd4j.jita.memory.impl.CudaCachingZeroProvider.malloc(CudaCachingZeroProvider.java:116)
2016-10-09 18:02:13,220 ERROR j.l.Throwable - 	at org.nd4j.jita.memory.impl.CudaFullCachingProvider.malloc(CudaFullCachingProvider.java:76)
2016-10-09 18:02:13,220 ERROR j.l.Throwable - 	at org.nd4j.jita.handler.impl.CudaZeroHandler.alloc(CudaZeroHandler.java:253)
2016-10-09 18:02:13,220 ERROR j.l.Throwable - 	at org.nd4j.jita.allocator.impl.AtomicAllocator.allocateMemory(AtomicAllocator.java:381)
2016-10-09 18:02:13,220 ERROR j.l.Throwable - 	at org.nd4j.jita.allocator.impl.AtomicAllocator.allocateMemory(AtomicAllocator.java:338)
2016-10-09 18:02:13,220 ERROR j.l.Throwable - 	at org.nd4j.linalg.jcublas.buffer.BaseCudaDataBuffer.(BaseCudaDataBuffer.java:144)
2016-10-09 18:02:13,220 ERROR j.l.Throwable - 	at org.nd4j.linalg.jcublas.buffer.CudaDoubleDataBuffer.(CudaDoubleDataBuffer.java:59)
2016-10-09 18:02:13,220 ERROR j.l.Throwable - 	at org.nd4j.linalg.jcublas.buffer.factory.CudaDataBufferFactory.createDouble(CudaDataBufferFactory.java:241)
2016-10-09 18:02:13,220 ERROR j.l.Throwable - 	at org.nd4j.linalg.factory.Nd4j.createBuffer(Nd4j.java:1282)
2016-10-09 18:02:13,220 ERROR j.l.Throwable - 	at org.nd4j.linalg.factory.Nd4j.createBuffer(Nd4j.java:1252)
2016-10-09 18:02:13,220 ERROR j.l.Throwable - 	at org.nd4j.linalg.api.ndarray.BaseNDArray.(BaseNDArray.java:249)
2016-10-09 18:02:13,221 ERROR j.l.Throwable - 	at org.nd4j.linalg.api.ndarray.BaseNDArray.(BaseNDArray.java:286)
2016-10-09 18:02:13,221 ERROR j.l.Throwable - 	at org.nd4j.linalg.api.ndarray.BaseNDArray.(BaseNDArray.java:563)
2016-10-09 18:02:13,221 ERROR j.l.Throwable - 	at org.nd4j.linalg.jcublas.JCublasNDArray.(JCublasNDArray.java:258)
2016-10-09 18:02:13,221 ERROR j.l.Throwable - 	at org.nd4j.linalg.jcublas.JCublasNDArrayFactory.create(JCublasNDArrayFactory.java:224)
2016-10-09 18:02:13,221 ERROR j.l.Throwable - 	at org.nd4j.linalg.factory.Nd4j.create(Nd4j.java:4369)
2016-10-09 18:02:13,221 ERROR j.l.Throwable - 	at org.nd4j.linalg.factory.Nd4j.create(Nd4j.java:4331)
2016-10-09 18:02:13,221 ERROR j.l.Throwable - 	at org.nd4j.linalg.factory.Nd4j.create(Nd4j.java:3584)
2016-10-09 18:02:13,221 ERROR j.l.Throwable - 	at org.nd4j.linalg.factory.Nd4j.diag(Nd4j.java:2506)
2016-10-09 18:02:13,221 ERROR j.l.Throwable - 	at org.nd4j.linalg.factory.Nd4j.diag(Nd4j.java:2550)
2016-10-09 18:02:13,221 ERROR j.l.Throwable - 	at org.nd4j.linalg.factory.Nd4j$diag$2.callStatic(Unknown Source)
2016-10-09 18:02:13,221 ERROR j.l.Throwable - 	at c.p.r.OptimizeLatentFactors.computeMemberConfidenceMatrix(OptimizeLatentFactors.groovy:146)

This particular exception comes from OOM and is already fixed on current
master.
But could you please provide that cast exception, you've mentioned there?
10 окт. 2016 г. 4:02 пользователь "jgainesau"<EMAIL_ADDRESS>написал:

I'm trying to convert a vector into a diagonal matrix using the static
method Nd4j.diag, and getting a NPE in the malloc method of
CudaDirectProvider (stack trace below).
The input vector is an NDArray created from a Java primitive double[].
I'm using cudnn 5.1, cuda 7.5, and a GTX-960.
I've set the data type as "double" via DataTypeUtil.
setDTypeForContext(DataBuffer.Type.DOUBLE). (Half or float lead to a
different error - cannot cast ShortPointer to FloatPointer in
JcublasLevel2.java at line 52).
The code is running in a loop that traverses multiple member records. The
first few dozen work fine, then one throws this exception. The underlying
data for this record doesn't look any different from the other records. If
I remove this record, the code will progress over a few more and then throw
this exception again.
I've successfully reproduced this on an EC2 instance running the
recently-announced DL4J AMI as well as my local environment.
Note this is not a neural network - just linear algebra. I'm only using
ND4J - not DL4J or DataVec etc.
2016-10-09 18:02:10,987 INFO c.p.r.OptimizeLatentFactors - Member 213830
(49)
2016-10-09 18:02:13,219 ERROR j.l.Throwable - Exception in thread "main"
java.lang.NullPointerException
2016-10-09 18:02:13,220 ERROR j.l.Throwable - at org.nd4j.jita.memory.impl.
CudaDirectProvider.malloc(CudaDirectProvider.java:89)
2016-10-09 18:02:13,220 ERROR j.l.Throwable - at org.nd4j.jita.memory.impl.
CudaCachingZeroProvider.malloc(CudaCachingZeroProvider.java:116)
2016-10-09 18:02:13,220 ERROR j.l.Throwable - at org.nd4j.jita.memory.impl.
CudaFullCachingProvider.malloc(CudaFullCachingProvider.java:76)
2016-10-09 18:02:13,220 ERROR j.l.Throwable - at
org.nd4j.jita.handler.impl.CudaZeroHandler.alloc(CudaZeroHandler.java:253)
2016-10-09 18:02:13,220 ERROR j.l.Throwable - at
org.nd4j.jita.allocator.impl.AtomicAllocator.allocateMemory(
AtomicAllocator.java:381)
2016-10-09 18:02:13,220 ERROR j.l.Throwable - at
org.nd4j.jita.allocator.impl.AtomicAllocator.allocateMemory(
AtomicAllocator.java:338)
2016-10-09 18:02:13,220 ERROR j.l.Throwable - at org.nd4j.linalg.jcublas.
buffer.BaseCudaDataBuffer.(BaseCudaDataBuffer.java:144)
2016-10-09 18:02:13,220 ERROR j.l.Throwable - at org.nd4j.linalg.jcublas.
buffer.CudaDoubleDataBuffer.(CudaDoubleDataBuffer.java:59)
2016-10-09 18:02:13,220 ERROR j.l.Throwable - at org.nd4j.linalg.jcublas.
buffer.factory.CudaDataBufferFactory.createDouble(
CudaDataBufferFactory.java:241)
2016-10-09 18:02:13,220 ERROR j.l.Throwable - at
org.nd4j.linalg.factory.Nd4j.createBuffer(Nd4j.java:1282)
2016-10-09 18:02:13,220 ERROR j.l.Throwable - at
org.nd4j.linalg.factory.Nd4j.createBuffer(Nd4j.java:1252)
2016-10-09 18:02:13,220 ERROR j.l.Throwable - at
org.nd4j.linalg.api.ndarray.BaseNDArray.(BaseNDArray.java:249)
2016-10-09 18:02:13,221 ERROR j.l.Throwable - at
org.nd4j.linalg.api.ndarray.BaseNDArray.(BaseNDArray.java:286)
2016-10-09 18:02:13,221 ERROR j.l.Throwable - at
org.nd4j.linalg.api.ndarray.BaseNDArray.(BaseNDArray.java:563)
2016-10-09 18:02:13,221 ERROR j.l.Throwable - at org.nd4j.linalg.jcublas.
JCublasNDArray.(JCublasNDArray.java:258)
2016-10-09 18:02:13,221 ERROR j.l.Throwable - at org.nd4j.linalg.jcublas.
JCublasNDArrayFactory.create(JCublasNDArrayFactory.java:224)
2016-10-09 18:02:13,221 ERROR j.l.Throwable - at
org.nd4j.linalg.factory.Nd4j.create(Nd4j.java:4369)
2016-10-09 18:02:13,221 ERROR j.l.Throwable - at
org.nd4j.linalg.factory.Nd4j.create(Nd4j.java:4331)
2016-10-09 18:02:13,221 ERROR j.l.Throwable - at
org.nd4j.linalg.factory.Nd4j.create(Nd4j.java:3584)
2016-10-09 18:02:13,221 ERROR j.l.Throwable - at
org.nd4j.linalg.factory.Nd4j.diag(Nd4j.java:2506)
2016-10-09 18:02:13,221 ERROR j.l.Throwable - at
org.nd4j.linalg.factory.Nd4j.diag(Nd4j.java:2550)
2016-10-09 18:02:13,221 ERROR j.l.Throwable - at
org.nd4j.linalg.factory.Nd4j$diag$2.callStatic(Unknown Source)
2016-10-09 18:02:13,221 ERROR j.l.Throwable - at
c.p.r.OptimizeLatentFactors.computeMemberConfidenceMatrix(
OptimizeLatentFactors.groovy:146)
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/deeplearning4j/nd4j/issues/1335, or mute the thread
https://github.com/notifications/unsubscribe-auth/ALru_zgzP7GYNMU_zHiabUdF71vDBc5Rks5qyY7AgaJpZM4KSKuF
.

Oh I see, so what I'm seeing is actually an OutOfMemoryError manifesting itself in a funny way? Ok, seems plausible, OOMs can do weird things sometimes.  I'll try to reduce the memory consumption.
But ... it is odd that the first 40-odd passes through the loop worked fine. The data structures on each pass are all the same size. I suppose if I've got a massive memory leak somewhere that could be causing it.
Ok, regarding the class cast exception. To trigger this, I run exactly the same code, but with one change:
Early on, instead of this:
DataTypeUtil.setDTypeForContext(DataBuffer.Type.DOUBLE)
I have this:
DataTypeUtil.setDTypeForContext(DataBuffer.Type.HALF)
Here is the resulting stack trace:

2016-10-10 17:10:41,788 ERROR j.l.Throwable - Exception in thread "main" java.lang.ClassCastException: org.bytedeco.javacpp.ShortPointer cannot be cast to org.bytedeco.javacpp.FloatPointer
2016-10-10 17:10:41,788 ERROR j.l.Throwable - 	at org.nd4j.linalg.jcublas.blas.JcublasLevel2.sgemv(JcublasLevel2.java:52)
2016-10-10 17:10:41,788 ERROR j.l.Throwable - 	at org.nd4j.linalg.api.blas.impl.BaseLevel2.gemv(BaseLevel2.java:51)
2016-10-10 17:10:41,788 ERROR j.l.Throwable - 	at org.nd4j.linalg.api.ndarray.BaseNDArray.mmuli(BaseNDArray.java:2697)
2016-10-10 17:10:41,788 ERROR j.l.Throwable - 	at org.nd4j.linalg.api.ndarray.BaseNDArray.mmul(BaseNDArray.java:2501)
...
2016-10-10 17:10:41,790 ERROR j.l.Throwable - 	at c.p.r.OptimizeLatentFactors.optimizeLatentFactors(OptimizeLatentFactors.groovy:94)

In this case the error arises not in the diag call but in a later call to mmul, which is doing the dot product of two matrixes filled with double values.
I thought there might be some relationship between "ShortPointer" and the "HALF" DataBuffer type, and since the matrices are filled with doubles, I thought changing "HALF" to "DOUBLE" might fix the problem.  It did - but it seems that perhaps all I accomplished was to get the code to run out of memory :-).
Thanks for taking a look.

Ah, right. cuBLAS do not provides Hgemv for halfs.
What about DataTypeUtil.setDTypeForContext(DataBuffer.Type.FLOAT)?

Well, it's an NPE like the first version, but it happens right away like the second one:

2016-10-10 18:18:18,651 INFO  c.p.r.OptimizeLatentFactors - Member 213278 (0)
2016-10-10 18:18:23,125 ERROR j.l.Throwable - Exception in thread "main" java.lang.NullPointerException
2016-10-10 18:18:23,125 ERROR j.l.Throwable - 	at org.nd4j.jita.memory.impl.CudaDirectProvider.malloc(CudaDirectProvider.java:89)
2016-10-10 18:18:23,125 ERROR j.l.Throwable - 	at org.nd4j.jita.memory.impl.CudaCachingZeroProvider.malloc(CudaCachingZeroProvider.java:116)
2016-10-10 18:18:23,126 ERROR j.l.Throwable - 	at org.nd4j.jita.memory.impl.CudaFullCachingProvider.malloc(CudaFullCachingProvider.java:74)
2016-10-10 18:18:23,126 ERROR j.l.Throwable - 	at org.nd4j.jita.handler.impl.CudaZeroHandler.alloc(CudaZeroHandler.java:253)
2016-10-10 18:18:23,126 ERROR j.l.Throwable - 	at org.nd4j.jita.allocator.impl.AtomicAllocator.allocateMemory(AtomicAllocator.java:381)
2016-10-10 18:18:23,126 ERROR j.l.Throwable - 	at org.nd4j.jita.allocator.impl.AtomicAllocator.allocateMemory(AtomicAllocator.java:338)
2016-10-10 18:18:23,126 ERROR j.l.Throwable - 	at org.nd4j.linalg.jcublas.buffer.BaseCudaDataBuffer.(BaseCudaDataBuffer.java:144)
2016-10-10 18:18:23,126 ERROR j.l.Throwable - 	at org.nd4j.linalg.jcublas.buffer.CudaFloatDataBuffer.(CudaFloatDataBuffer.java:59)
2016-10-10 18:18:23,126 ERROR j.l.Throwable - 	at org.nd4j.linalg.jcublas.buffer.factory.CudaDataBufferFactory.createFloat(CudaDataBufferFactory.java:251)
2016-10-10 18:18:23,126 ERROR j.l.Throwable - 	at org.nd4j.linalg.factory.Nd4j.createBuffer(Nd4j.java:1277)
2016-10-10 18:18:23,126 ERROR j.l.Throwable - 	at org.nd4j.linalg.api.ndarray.BaseNDArray.(BaseNDArray.java:262)
2016-10-10 18:18:23,126 ERROR j.l.Throwable - 	at org.nd4j.linalg.jcublas.JCublasNDArray.(JCublasNDArray.java:114)
2016-10-10 18:18:23,127 ERROR j.l.Throwable - 	at org.nd4j.linalg.jcublas.JCublasNDArrayFactory.createUninitialized(JCublasNDArrayFactory.java:229)
2016-10-10 18:18:23,127 ERROR j.l.Throwable - 	at org.nd4j.linalg.factory.Nd4j.createUninitialized(Nd4j.java:4391)
2016-10-10 18:18:23,127 ERROR j.l.Throwable - 	at org.nd4j.linalg.api.shape.Shape.toOffsetZeroCopyHelper(Shape.java:152)
2016-10-10 18:18:23,127 ERROR j.l.Throwable - 	at org.nd4j.linalg.api.shape.Shape.toOffsetZeroCopy(Shape.java:108)
2016-10-10 18:18:23,127 ERROR j.l.Throwable - 	at org.nd4j.linalg.api.ndarray.BaseNDArray.dup(BaseNDArray.java:1498)
2016-10-10 18:18:23,127 ERROR j.l.Throwable - 	at org.nd4j.linalg.jcublas.JCublasNDArray.dup(JCublasNDArray.java:407)
2016-10-10 18:18:23,127 ERROR j.l.Throwable - 	at org.nd4j.linalg.api.ndarray.BaseNDArray.sub(BaseNDArray.java:2577)
2016-10-10 18:18:23,127 ERROR j.l.Throwable - 	at
2016-10-10 18:18:23,128 ERROR j.l.Throwable - 	at
...
c.p.r.OptimizeLatentFactors$_optimizeLatentFactors_closure4.doCall(OptimizeLatentFactors.groovy:98)

... and the Nd4j operation is a subtraction.

It looks like the same oom issue. Can I see source code, that reproduces
this issue?
PS. This issue is fixed on current master, so you can build from sources if
you want. But if that's real shortage of memory, things will be slow,
because host memory will be used in such cases
10 окт. 2016 г. 12:24 пользователь "jgainesau"<EMAIL_ADDRESS>написал:

... and the Nd4j operation is a subtraction.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/deeplearning4j/nd4j/issues/1335#issuecomment-252570442,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ALru_3QbYd38ko22itpCPRvnqc4b5JOCks5qygQ8gaJpZM4KSKuF
.

Sure thing. It's Groovy.
Here's the loop that calculates latent factors for each member. The expression CX.sub(productsI) is what throws the exception. members and products are lists of int. alpha is just a double that provides some weighting. Oh and productsI is the result of doing Nd4j.eye(numProducts):
members.eachWithIndex { member, i ->
        log.info "Member $member ($i)"
        final CX = computeMemberConfidenceMatrix(member, products, rentalRecords, alpha)
        final PX = computeMemberPreferences(member, products, rentalRecords)
        final q1 = CX.sub(productsI)
       ...
  }

This method computes the CX variable for each member. rentalRecords is a List<List<Integer>> showing who's rented what. The last step translates the Java primitives into an NDArray (vector) and then takes the diag of that vector:
final Map scoredRentals = rentalRecords.findAll { it[0] == member }.groupBy { it[1] }.collectEntries { productId, recs ->
    [(productId): recs*.getAt(3).sum()]
}
final float[] confidence = products.collect { product ->
    (float) (1 + (alpha * (scoredRentals.containsKey(product) ? scoredRentals.get(product) : 0)))
}
return Nd4j.diag(Nd4j.create(confidence))

And this creates the PX variable for each member:
final allRentals = rentalRecords.findAll { it[0] == member }.collect { it[1] }.unique()

final float[] prefs = products.collect { product ->
    (float) (allRentals.contains(product) ? 1 : 0)
}
return Nd4j.create(prefs).transpose()

The confidence and prefs variables each have about 20k elements, so that diag (and productsI for that matter) is pretty big.
It wouldn't surprise me in the slightest if this code had memory issues. It's a first pass, trying to get a feel for using Nd4j in a non-neural-network setting, as a linear algebra tool.
Having said that, it's still interesting to me that setting the context data type to DataBuffer.Type.DOUBLE - which surely is the most memory-hungry way to go? - does actually seem to work for a few dozen complete passes through that main loop.

Ok so I reviewed my comment and decided to check to see if the underlying issue is OOM by the very simple expedient of taking a small slice of the full dataset. And guess what - it works fine!
So I'd say the underlying issue really truly is OOM.
And I'd better get to work optimizing that code ;-).

Yea, that's oom without any doubts.
10 окт. 2016 г. 13:48 пользователь "jgainesau"<EMAIL_ADDRESS>написал:

Ok so I reviewed my comment and decided to check to see if the underlying
issue is OOM by the very simple expedient of taking a small slice of the
full dataset. And guess what - it works fine!
So I'd say the underlying issue really truly is OOM.
And I'd better get to work optimizing that code ;-).
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/deeplearning4j/nd4j/issues/1335#issuecomment-252585101,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ALru_6y0q0pT9YxBaHwExcb0W84Ws-ntks5qyhfigaJpZM4KSKuF
.

Closing this now, since original issue is already fixed on current master.


[Suggestion] Dark mode

It's blatantly obvious that there needs to be a dark mode since looking at the pages are blinding to the eyes.

this should be 100% pure html and css task


Upgrading dependencies

Upgrading dependencies
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

AWS CodeBuild CI Report

CodeBuild project: GitHubCodeBuild8756EF16-pDO66x4b9gEu
Commit ID: f7176289d9129ab0da8fd2aec260d241b894f8c3
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository


Child process crashes when stdout === undefined on MacOS X

Same issues:
https://github.com/nodejs/node/issues/1321
https://github.com/nodejs/node/pull/3799
Stack trace:
Uncaught TypeError: Cannot read property 'addListener' of undefined
exports.execFile @ child_process.js:252
module.(anonymous function) @ ATOM_SHELL_ASAR.js:163
module.(anonymous function) @ ATOM_SHELL_ASAR.js:163
module.(anonymous function) @ ATOM_SHELL_ASAR.js:163
exports.exec @ child_process.js:113

Uncaught Error: spawn /bin/sh EMFILE
exports._errnoException @ util.js:837
ChildProcess._handle.onexit @ internal/child_process.js:178
onErrorNT @ internal/child_process.js:344
doNTCallback2 @ node.js:441
_tickCallback @ node.js:355

Fixed by #3724.


[BUG] Flyte console display error in workflows page when an execution is in unknown state

Describe the bug
When one or more workflow execution is in "Unknown" state, Flyte console display error as shown in below screenshot for the workflow details page. It's observed in flyte console version v0.27.1.
Expected behavior
Should show list of workflow execution including the "Unknown" execution.
To Reproduce
Steps to reproduce the behavior:

Launch a workflow
Quickly go back to the workflow details page

Screenshots
If applicable, add screenshots to help explain your proble

.

We need to check if it's already fixed

Tested a few workflows and could not repo so will assume this was fixed; closing this as resolved 👍


GM_Lag

Hey! I was looking for the GM_Lag model but it seems it has been deprecated as it was available on previous version 1.1.0 (https://spreg.readthedocs.io/en/latest/api.html#) . This version seems not to be available in pip, so is there any other way to recover this? This would be really helpful for my research. Thanks

All versions of spreg contain GM_Lag and it is not deprecated. The current version in pip (1.1.1) contains GM_Lag. Could you please provide any traceback to show why you are not being able to find it?

Hello @pedrovma  thanks for your reply. I already found it, it just changed its place in the library. Really nice work you have here in this library! :D Many thanks


Automator: update<EMAIL_ADDRESS>in<EMAIL_ADDRESS>

Generated by Automator - 2024-08-24T00:28:37+00:00

@istio-testing: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name
Commit
Details
Required
Rerun command

unit-tests-arm64_istio_release-1.22
25b19ba5759c73a69c540f1b9ae149be3862bcba
link
true
/test unit-tests-arm64

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.


Attempt to defibrillate Travis-CI testing

See #145, we need to install scipy within the 10-minute timeout, or try other
workarounds.
Also documents how to test from the command line.

Not quite there, yet...
https://travis-ci.org/wiki-ai/revscoring/builds/73338921

Tests pass in Travis... now, why aren't the silly traffic lights appearing in github?

Build time is down to 73 seconds... merge me!

@yuvipanda how difficult would it be to change all of the things to reference scikit-learn 0.16.1 instead of 0.15.2
@adamwight how critical is it to use this more recent version and will we need to update to a recent version again soon or can we stick with 0.16.1 for a while?

I'm going to try to change my approach, and find a way to run CI without changing the Python module requirements.
Currently, scipy is the dealbreaker and not scikit-learn, so it's not worth the trouble to upgrade, rebuild the models, etc.
The issue with scipy is that installing via pip takes longer than a 30-second timeout built into Travis, so I'm using a binary package installer to get that down to a few seconds, but the versions don't match what we want.  There are a few potential workarounds, * emit download progress information from pip so we don't hit the "quiet for 30 seconds" timeout, * build and upload a scipy package for the same version we're using, * find another binary installer which makes the right version available.

Our scipy requirements can be looser.  If we know the tests pass with a higher version, let's just update the requirements.txt to include that range.

Can't we just use apt-get to install scipy?

Can't we just use apt-get to install scipy?

Hey yeah, we can do that since 3f2f77652ab!  Previously, the issue had been that there were many different versions of the package depending on your platform.

D'oh!  Travis CI uses Ubuntu Precise, which is still at scipy 0.9.0: http://packages.ubuntu.com/precise/python3-scipy

@adamwight This pr has been languishing for a while.  What does it need in order to get merged?

Closing in favor of the PR that I just self-merged that got Travis working again.


Bugs in GUI (code-insiders)

Issue Type: Bug

There are bugs in GUI of menu items (all). See examples' screenshots below.

VSCode Version: 1.28.0 - insider (system setup) (https://github.com/Microsoft/vscode/commit/a3f9f2e7240106aeec2f1d4bc03d7876bd42e2e4 2018-09-09T15:20:39)
OS Version: Windows 7 Ultimate 6.1.7601 Service Pack 1 rev 7601

Does this issue occur when all extensions are disabled?:  Yes
Screenshots:

Duplicate of #58156


update readme

In case of TransactionState.Restored on android - as far as I see -  the Transaction object has just 2 filled properties originalTransaction and transactionState.

Done.
Yes this is caused by my VSC user setting "files.trimTrailingWhitespace": true,
Maybe it would be good to set it to false in  .vscode/setting.json, if not desired?

Actually this setting is nowhere to be found in the report. So it must be in your user settings 😃
This is now merged. Thanks for your contribution!


Paloma LigntNode Automation with Authz

As a Paloma LightNode Client, I want the light client to automatically claim and delegate my staking rewards with Authz so that I don't have to enter my password each time.
Acceptance Criteria

Automatic delegation to active validators to maximize low-stake validators
Automatic redelegate from inactive validators to active validators.
GRAINs will be claimed and redelegated every 24-hours

@taariq I'm not sure authz allows us to do what we want, here.
Authz allows us to setup one account to be authorized to perform actions for another account. However, we're only dealing with a single account here, the vesting account. Who should we be granting staking permission to?
The LightNode client will be doing the delegations, so it has to be able to operate an account. Am I missing something on this?

@maharifu we want to grant permission to an account that will execute the claim, delegate and redelegate commands. Are we able to limit just those commands to a new Paloma account that we control on the back end?

@taariq We can set a StakeAuthorization for the delegate and redelegate, and we should be able to set the GenericAuthorization for the claims. But will we have a backend to do these operations?
We can look into other solutions for the passwords. For instance, we should be able to setup the pass backend to require the password only once on every restart.


timeouts?

hiya -
Did you look at a way to put timeouts into this? I'm getting a lot of them from LUIS.
wrapping around the external caller is a bit messy.
I think would be best to hack into the MS so called "SDK" to change the options on their request library?
if doing that, maybe better to switch to request-promise, and just return a Promise.
What do you think?
quite hard to change upstream though.

tried to add a timeout here, but doesn't seem to work
https://github.com/Microsoft/Cognitive-LUIS-Node.js/blob/master/luis_sdk/index.js#L95


Columnar Join and Sync Nodes Consequence

The columnar join function requires Thicket._sync_nodes_frame in order to match up the nodes in the dataframe after union operations have been performed in the graph. The function makes an assumption if a df node's frame matches a graph node's frame to set the df node to be the graph node, making their nid's equal. This results in some nodes being mapped to the same nid, if it's frame has already existed in the df.

I ran into this issue when traversing a graphs children and then trying to match those nodes in the dataframe. The problem appears for nodes like the one above because the same node frame appears for every kernel node that exists (obviously the kernel nodes have different frames, "apps_vol" vs "apps_hydro", etc).

This issue has come up again, prompting #99. It is apparent that a better solution is necessary. An approach using the old_to_new dictionary from the Hatchet graph.union function should be a more solid solution, since that is a direct reference to what nodes were replaced.

Resolved by #129


Create uni-muenster

@Xentox lib/domains/de/uni-muenster: this request has an incorrect file path format, please ensure that you are familiar with     this repository rules located at the bottom of this page and change     your request accordingly. If you don't know how to change request, close it and open a new one.     If you are not able to make the pull request according the instructions, please send us an email to<EMAIL_ADDRESS>Please mention this request URL in the message.

@Xentox I am sorry, the domain uni-muenster.de was removed from our trusted domains list because the school allows to register an email address there even if you are not a student of the school, or someone shared access to their inbox in this domain with third parties.
If you are the student of this school, please apply with official document (OFFICIAL DOCUMENT tab at https://www.jetbrains.com/shop/eform/students).


Push new version to pub.dev

Is the newest version being uploaded to pub.dev soon?

Hi soz ive just been super busy lately will get it out today


Placing a Pipe in the same block as another Pipe turns it into a Head

Using TransportPipes Version 4.3.2-SNAPSHOT-b72 on Paper version git-Paper-1414 (MC: 1.12.2)
If you place a pipe under an existing pipe, but in the same block space, it places a head which, when broken, does not drop a pipe.
GIF: https://i.gyazo.com/c7534840964b6d7ccc49d761f5c3eb60.gif

Thank you for this detailed bug report (thats not natural :smile:)
I've planned to recode the hole plugin this summer which will definitely fix this issue. So please be Patient :)

I forked the repo and made a quick change which blocks placing skulls in the same block space as ducts. It's quick and dirty but gets the job done, though I had to fight a bit with GitHub to get the commit up without it thinking I changed every line. XD
So I'm satisfied for now. Can't wait for the recode! =)


Enhancement Request: Trakt.TV support?

Any possibility of adding functionality for Trakt to this extension?

Hi @marc-cwm, thank you for your suggestion ! I've added support for Trakt.tv in version v1.5.0 , let me know if it suits your needs.

Wow, that's perfect, good placement too, thank you!


Controls should be less prescriptive and less focused on specifics of Github, etc.

My view is the baseline is too focused on assumptions that the projects are using Github, etc. and are less flexible than they could be about other ways to meet the same security properties.   This has the potential for us to bake in a lot of things that don't make sense into the future and also be seen as pushing projects to specific vendors.
For example:

OSPS-02	1	Access Control	The project's version control system MUST restrict collaborator permissions to the lowest available privileges by default.

Looking at this, I think what is meant is that one must set Github's collaborator permissions in a specific manner for a repo.   However, other version control systems may not have this exact way of setting permissions.   In gittuf, there isn't a central place to set collaborator permissions, but this is intertwined with functionality that this is found in places like the CODEOWNERS file for Github.   I've heard from the group discussions that the intent with this rule isn't to require CODEOWNERS / file access permissions on the repo itself / blocking read access to different repos, or similar functionality, but this isn't clear enough from this statement, since these permissions are all available and could be set this way by default.
A focused question is what are "collaborator permissions" outside of the context of Github?   What does this mean for a vanilla git repository?
My suggestion to fix this is to give an example for each control about what you're trying to achieve and to explain the purpose rather than being so prescriptive.

+1 - the Collaborator definition may be the appropriate place to expand on this.
perhaps:

projects MUST define permissions to the lowest available privileges by default for their version control system

+1. I've started trying to help do this, but it will require multiple eyes.
Sometimes it's just terminology, e.g., GitHub says "pull request" while practically everyone else uses the term "merge request" for the same idea. But the bigger problem is when things fundamentally work differently to achieve the same result. I often try to use the Linux kernel as a counter-example; it's very widely used, but it does things differently (due to scale), and considering it can help us focus on the objectives instead of being overly prescriptive.


feat: auto-expand routes

Description

Auto-expand routes in the trade widget
Move the "Confirm" button, and associated rendered info to be above the routes

Pull Request Type

[ ] :bug: Bug fix (Non-breaking Change: Fixes an issue)
[x] :hammer_and_wrench: Chore (Non-breaking Change: Doc updates, pkg upgrades, typos, etc..)
[ ] :nail_care: New Feature (Breaking/Non-breaking Change)

Issue (if applicable)
As per conversation here: https://discord.com/channels/554694662431178782/554694662896615436/1144042614522380368
Risk
Small risk UI doesn't work as expected.
Testing
When fetching trade quotes, the "routes" toggle should be expanded by default.
The Confirm button, and associated info should now sit above the list of routes.
Engineering
☝
Operations
☝
Screenshots (if applicable)

Current dependencies on/for this PR:

develop

PR #5160   👈

This comment was auto-generated by Graphite.


GL_error @post_render invalid value 1281

When trying to launch two clients:
./launchclient.sh -port 10000
./launchclient.sh -port 10001
The clients go into error

[16:32:19] [Client thread/ERROR]: ########## GL ERROR ##########
[16:32:19] [Client thread/ERROR]: @ Pre render
[16:32:19] [Client thread/ERROR]: 1281: Invalid value

Can you tell us something about your system? What OS are you using, are you running headless, etc.etc?

@DaveyBiggers
Ubuntu 16.04.1 I am directly running with display. If only one client is started, everything is fine.


chore: set app version to 7.2.2

The type of this PR is: chore

This PR set the app version to 7.2.2
#nochagenlog

Warnings

:warning:

❌ An error occurred while validating your changelog, please make sure you provided a valid changelog.

  Generated by :no_entry_sign: dangerJS against dbd81cfdb655bc610e7fd4a3b43f6bf781e68889


Automatically set project for connection

A small feature that I think would greatly increase user friendliness of the Projects View.  Currently, one is able to create a connection by right clicking on a project and selecting Create > Connection However, unless the user re-specifies the project for the connection again, the connection is relegated to the "General" project with no obvious way of changing it.
I don't know the codebase well enough to make the change myself but one would think that the project reflect whichever project was right-clicked to create the connection.

This makes great sense, thanks for noticing this.

Verified.


Dynamically add Slider to website (after ajax call)

I try to build a website with multiple swiper sliders which are loaded dynamically with ajax. The pagination and the controls seem to be shown correctly for each loaded slider but none of the sliders is working properly.
Is there any way to dynamically add new sliders to website (not slides to an existing slider!)?

Hi!
I could be wrong but I think you should create a new instance of the Swipe object for each slider that you want to create, each of the latter with a unique class name or # ID.
var mySwiper1 = new Swiper('.swiper-container-unique-class-name', {
loop: true,
pagination: '.swiper-pagination',
});
var mySwiper2 = new Swiper('.swiper-container-another-unique-class-name', {
loop: false,
pagination: '.another-swiper-pagination'
});

So basically you should create a new mySwiper# variable and initialize Swiper for every new slider you wish to add. You could set this upon success of the ajax call or whatever you feel is best.
Haven't tested it, but seems reasonable.

Closing as looks like resolved or due to inactivity


fix(helpers): support thrown strings in getExceptionMessage

Of course, strings aren't proper errors, but scripts sometimes do that, and Puppeteer loses such error messages.

@aslushnikov Done. Please have a look. Travis failed for some reason, but it seems unrelated.


[CI] Lift timeout on cpu unittest

Description
Here is a brief statistics of the CI time out occurrences:
Among the 25 most recent CI builds the following CI items has such rate of time out(excluding failures):
cpu-unittest: 45%
master-cpu-unittest: 33%
gpu-integration: 0%
gpu-unittest: 0%
master-gpu-doc: 0%
master-gpu-integration: 0%
master-gpu-unittest: 0%
Therefore, I am lifting the time out settings for cpu-unittest and master-cpu-unittest so that they can provide steady performance even on peak hours.
Checklist
Essentials

[x] PR's title starts with a category (e.g. [BUGFIX], [MODEL], [TUTORIAL], [FEATURE], [DOC], etc)
[x] Changes are complete (i.e. I finished coding on this PR)
[x] All changes have test coverage
[x] Code is well-documented

Changes

[ ] Feature1, tests, (and when applicable, API doc)
[ ] Feature2, tests, (and when applicable, API doc)

Comments

If this change is a backward incompatible change, why must this change be made.
Interesting edge cases to note here

cc @dmlc/gluon-nlp-team

Job PR-1216/1 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-1216/1/index.html


LM-134: Add File Storage metrics

This documents the upcoming File Storage metrics. It depends on https://github.com/mendix/cf-mendix-buildpack/pull/488 which is pending review, and would be released together with a future Cloud Portal release. As such, this is a Draft Pull Request.
It also removed the bit about /srv which is only applicable to Cloud v3.

Hi @MarkvanMents , thanks for the reviews! We have decided not to go ahead with displaying these metrics publicly for the time being, but it'd be a waste to throw away everything we've worked on here. Shall I just close the PR and save the branch for the future?

Hi @jeohist
If this is going to be resurrected in the next couple of months, then you can just keep the PR open with a Future label. But if it is going to be longer than that, probably best to close the PR and keep the branch for later.
I'll leave the decision up to you.
Since the branch is on the mendix/docs repo, if you don't want the branch to be accidentally deleted, I suggest renaming it and adding DONOTDELETE to the name.
Alternatively, make your own fork where we can't accidentally delete your work 😀

@MarkvanMents works for me, thanks!

Closing in favour of #4323 to resolve merge conflicts on new Docs Stack


feat(board): Add Waveshare ESP32-S3-Matrix board support

Description:
Adds support for the  Waveshare ESP32-S3-Matrix board.

Please redo against the changed new branch develop


add RD sakari

Docs Build status updates of commit 4418b32:
:warning: Validation status: warnings

File
Status
Preview URL
Details

rd/index.yml
:warning:Warning

Details

rd/map.yml
:warning:Warning

Details

rd/media/profiles/sakari-nahi.jpg
:white_check_mark:Succeeded

rd/sakari-nahi.yml
:white_check_mark:Succeeded

rd/toc.yml
:white_check_mark:Succeeded

rd/index.yml

Line 14, Column 8: [Warning-file-not-found] Invalid file link: './map'.
Line 16, Column 8: [Warning-file-not-found] Invalid file link: './about'.
Line 18, Column 8: [Warning-file-not-found] Invalid file link: './CodeOfConduct'.

rd/map.yml

Line 15, Column 8: [Warning-file-not-found] Invalid file link: './map'.
Line 17, Column 8: [Warning-file-not-found] Invalid file link: './about'.
Line 19, Column 8: [Warning-file-not-found] Invalid file link: './CodeOfConduct'.

For more details, please refer to the build report.
If you see build warnings/errors with permission issues, it might be due to single sign-on (SSO) enabled on Microsoft's GitHub organizations. Please follow instructions here to re-authorize your GitHub account to Docs Build.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel


[BUG] CommonJS file with ESM syntax is exported as "module"

Before you begin...

[X] I have searched the existing issues
[X] I am not using version 13.x of node  (if so, please upgrade)

Description of the problem
The exports in package.json currently contains this:
  "main": "./dist/index.js",
  "exports": {
    ".": {
      "node": {
        "module": "./dist/esm-node/index.js",
        "require": "./dist/index.js",
        "import": "./wrapper.mjs"
      },
      "browser": {
        "import": "./dist/esm-browser/index.js",
        "require": "./dist/commonjs-browser/index.js"
      },
      "default": "./dist/esm-browser/index.js"
    },
    "./package.json": "./package.json"
  },
  "module": "./dist/esm-node/index.js",

In a Node.js environment, the .js files are interpreted as CommonJS and the .mjs file as ESM, since no "type": "module" is defined. This means that the files in ./dist/esm-*/*.js are interpreted as CJS, even though they contain ESM code.
In a normal Node.js ESM environment, this is not a problem, since it will resolve to the .mjs file defined in the node.import export. However, there are other environments which resolve dependencies in a different way but still interpret the file extensions in the same way as Node.js.
Problem with esbuild
In particular, I'm having trouble with a project that is compiled using esbuild. According to its docs, in node mode, the modules condition is included by default, so the node.module export is used, leading to the following error:
import { v4 } from "../../node_modules/uuid/dist/esm-node/index.js";
         ^^
SyntaxError: Named export 'v4' not found. The requested module '../../node_modules/uuid/dist/esm-node/index.js' is a CommonJS module, which may not support all module.exports as named exports

As a workaround, I specified conditions: [] in my esbuild config.
Problem with jest
I'm also experiencing the same problem with Jest that is reported in #678. Testing has revealed that Jest (at least in a jsdom environment) uses the browser.import export.
Suggested solution
In other issues reported here I have seen comments about needing to add "type": "module", which would have a lot of side effects and break things. I think this is not needed, it is only needed to rename the ESM bundles to .mjs. I believe this would also make the wrapper.mjs file unnecessary.
There might be some outdated build tools that don't support the .mjs extension yet. In immerjs/immer#939, we had this problem with Metro, however the underlying issue facebook/metro#535 seems to have been fixed by now. If support for such outdated build tools should be preserved, a .js ESM file should be referenced in the module field in package.json (while a .mjs file should be in the exports.module field).
Recipe for reproducing
To reproduce the issue with esbuild, create a file test.mjs that imports uuid:
import { v4 } from 'uuid';

Then build the file by executing a Node.js script with the following content:
import { build } from 'esbuild';
import { fileURLToPath } from 'url';

await build({
    entryPoints: [fileURLToPath(new URL('./test.mjs', import.meta.url))],
    platform: 'node',
    bundle: true,
    format: 'esm',
    outfile: './out.mjs',
    external: ['./node_modules/*']
});

It is important to use a recent version of esbuild, as older versions were not using the module condition.
Additional information
No response
Environment
No response

We're running into this issue with Jest tests in a jsdom test environment. Is there any interest from the maintainers in accepting a patch?
The fix suggested by @cdauth sounds like it should be relatively low impact (compared to adding "type": "module")

We're running into this issue with Jest tests in a jsdom test environment. Is there any interest from the maintainers in accepting a patch?
The fix suggested by @cdauth sounds like it should be relatively low impact (compared to adding "type": "module")

This would be helpful for me too 👍🏻


Since 4.0.0 grunt-ts ignoring templated parameters in 'out' string

Now getting this error:
Running "ts:build" (ts) task
Compiling...
Cleared fast compile cache for target: build
Fast compile will not work when --out is specified. Ignoring fast compilation
Using tsc v1.4.1
error TS6053: File '%>/<%=.ts' not found.
error TS6054: File '%>.js' must have extension '.ts' or '.d.ts'.
error TS6054: File 'pkg.company' must have extension '.ts' or '.d.ts'.
error TS6054: File 'pkg.name' must have extension '.ts' or '.d.ts'.
With the following call:
    ts: {
        build: {
            src: ['src/ts/**/*.ts'],
            reference: 'src/ref/Reference.ts',
            out: 'build/<%= pkg.company %>/<%= pkg.name %>.js',
            options: {
                target: 'es5',
                module: 'amd',
                declaration: true,
                sourceMap: true,
                removeComments: true
            }
        }
    },

Whereas previously pkg.company and pkg.name variables are replaced. Rolling back to 3.0.0 fixes the issue.

Thanks for the report.  Will investigate this evening.

I can confirm the same behavior, FWIW.  :)

This should be fixed - please re-open if not.  Thank you for the report.  I added you both to the Change Log.

Thanks, will try it out as soon as github recovers fully from their attack, still getting timeouts on bower runs here

I just tried it this morning, works fine again.  Thanks for a quick fix Steve!

w00t.


Header value misinterpreted as query param

When specifying a header option whose value ends with an =, bat incorrectly interprets that as a query param, even when escaped.
➜ bat GET :8001/v1/me/entity 'X-APIKey:asdfasdfa\='
GET /v1/me/entity?X-APIKey%3Aasdfasdfa%5C= HTTP/1.1
Host: localhost:8001
Accept: application/json
Accept-Encoding: gzip, deflate
User-Agent: bat/0.1.0

unfortunately this pr breaks queries with ":" into headers. I cannot think of away to fixes this without completely changing the parsing :weary:


helm3 upgrade --install creates a release named after the chart and does not permit --generate-name

Hi,
I was doing some testing with Helm3 (3rd beta) investigating using one command in a pipeline to deploy or upgrade rather than needing to parse the response of Helm list to decide which command is needed (upgrade or install) to proceed with a deployment.
Helm upgrade --install does work however does not enforce or allow the use of auto-generated release names.
Thanks

clarified the title, this may be expected behavior? Thanks

Hi, @teng1 - yes, https://helm.sh/docs/helm/helm_install/ lists --generate-name and https://helm.sh/docs/helm/helm_upgrade/ does not. So, this is the behavior currently expected; these docs are generated from a recent build of Helm v3.
We have not seen much demand for this to change, but if you'd like, you could investigate the codebase and determine what would need to be adjusted. Thanks.

Hi will close as was quite some time ago and there are several managers now that can work out if an install or upgrade is needed
Thanks!


Provide documentation on setting up authentication with GCP workload identity

A clear documentation on how to set up workload identity
Use-Case
Would be good if a reference or step by step guide on how to set up workload identity is added.
It is also unclear on which service account of keda setup should be used for setting up workload identity though we have only one service account. It can easily be understandable to a new comer if these things are explicitly mentioned in the documentation.

/assign

@tomkerkhove
Would love to work on this part of the documentation.

Wonderful, thank you!

Made changes in PR #1120 and are merged to main.
Closing this issue.

Thank you!


Object Detection using Darknet19

I used DL4J Yolo and TinyYolo examples for object detection using opencv it works fine
But When I first used Darknet19 I saw that there is no way to get the detected object boundaries
Yolo has Yolo2OutputLayer but Darknet19 has loss output layer and there is no way to get boundaries.
I checked documentation/examples/tests but couldn't find a way.
Is there any guide or documentation for such an issue?

Darknet doesn't do object detection on its own. That's what the Yolo layers
do.


Handle unchecked_ownership_conversion in SILInstruction::mayRelease

@swift-ci test

@swift-ci test

Thanks @gottesmm
I think the other API's are fine because when unhandled, they return the default MemoryBehavior on the SILNode which is 'MayRelease' in this case.

k. Just wanted to make sure someone checked. Thanks!


Add Object Model Overview

This adds a README to specifically help describe the object model for the new namespace.

CI will likely show as failed, because the PR was merged before it completed. This was done because it is only a README change, and will not have any semantic impact.


Add integration with GitHub Actions CI/CD

Integration  .github/workflows/ci.yml enables set up to run pre-commit tool

Adding CI/CD badge to README.md provides current status of the workflow

Resolves #14

to fetch the source code of the repository into workflow environment
to set up Python 3.11 and provide version compatibility for the workflow
to run pre-commit tool

There's no need to describe how the CI works. Virtually any CI setup works the same. Just mention that the CI is set up to run pre-commit on certain events and that's it.

Thank you, I edited as per your comments. But, I'm really not sure that I can add commit "Add README.md" in this PR. Also, I expect conflict with #13, because of the same document will be edited.

Don't add that commit. Only add README with the badge but not the rest of the content.

Add GitHub Actions CI/CD badge in README.md

Same as in another PR — use less specific file names.

Add GitHub Actions workflow files

One file, not many. But also just a workflow, it's obvious that you work with files in Git. You cannot commit changes that are not in files so this information is redundant. You could explain that it's running pre-commit tool in the commit long description. Also, point out why no-commit-to-branch is to be skipped in CI.

Oh, and it's usually nicer to keep natural order of the commits. There's no CI runs to link to until it's integrated so I'd expect the badge pointing there to be added in the second commit, not before the CI setup exists.

Updated the commits. But, I have some difficulties understanding the expediency of this:
env:
        SKIP: no-commit-to-branch

From asottile found an answer:

Looks like this hook false-positives when not on a branch (as is likely in CI)

Could you please clarify this issue?

Could you please clarify this issue?

The CI runs on PR events and push events. When you update a PR, a pull_request event happens and the CI job runs in the context of the incoming branch so the check would be green. OTOH, a push event happens when you push to branches which is fine for the PR branches too but merging PRs into the main branch also triggers a push event inside the GitHub's platform, which causes another CI job run but in the context of the main branch. This check would report failure in such case since it's a push to the main branch and we don't want that since it doesn't makes sense to validate that the commit is into the main branch on remote — it's already there.
This specific check is a helper for local Git repositories preventing humans from accidentally committing to the main on their laptops. With branch protection on, they won't be able to push that to remote anyway.  This would also cause confusion for inexperienced contributors.
The assumption is that one would run pre-commit install in their local repository and this small check would abort their commit attempts early, reminding them to switch branches. You can install it to run as a local pre-commit hook, once #15 is merged.

Don't make merge commits into this branch and rebase instead. This creates ugly "foxtrot merges" in the main branch then. Google this concept.

Thank you, I executed rebasing, please verify

Could you add the missing motivation bit to this explanation?
It's not a display. Just an indicator/badge/information. Try rephrasing this.

Maybe this variant will be better

@OlenaYefymenko well, it still doesn't explain the check exclusion.

@webknjaz ok, I considered you meant motivation for configuration integration. Maybe this variant for commit will be correct:
Integrate CI/CD configuration into project
This patch provides automation of the workflow — the running pre-commit tool. It enables prevention and fixing errors, following the best practices in the project. However, the no-commit-to-branch check should be excluded  —  merging PRs into the main branch would trigger incorrect failure.
Resolves ...

@OlenaYefymenko yep, that'll do. Maybe change "incorrect" to "false-positive", though.


Structured 3D dataset - corruptions in zip files

Many thanks for making this dataset available!
I have downloaded the Structured3D_panorama_00.zip ... Structured3D_panorama_17.zip from the Azure cloud and found that all except 14,15,16,17 have some files corrupted inside the zip archives. I have downloaded the archives on multiple university and my private internet connections and used different applications to unzip the files (unzip, 7z in Ubuntu 22.04 and with Windows 10 archive manager). In all cases, the same errors were encountered. For example, unzipping the Structured3D_panorama_13.zip  results in the following errors:
unzip -q Structured3D_panorama_13.zip -d /media/jiri/Pluto/datasets/Structured3D/Structured3D_panorama/13/
error:  invalid compressed data to inflate /media/jiri/Pluto/datasets/Structured3D/Structured3D_panorama/13/Structured3D/scene_02601/2D_rendering/843/panorama/simple/normal.png
/media/jiri/Pluto/datasets/Structured3D/Structured3D_panorama/13/Structured3D/scene_02608/2D_rendering/345/panorama/full/rgb_coldlight.png  bad CRC 406b2c0b  (should be 53007390)
file #1444:  bad zipfile offset (local header sig):  536390646
/media/jiri/Pluto/datasets/Structured3D/Structured3D_panorama/13/Structured3D/scene_02609/2D_rendering/1235/panorama/simple/rgb_warmlight.png  bad CRC fbc88119  (should be 35d6a845)
file #1486:  bad zipfile offset (local header sig):  553273189
file #1487:  bad zipfile offset (local header sig):  553279282
file #1488:  bad zipfile offset (local header sig):  553279355
file #1489:  bad zipfile offset (local header sig):  553279437
file #1490:  bad zipfile offset (local header sig):  553279568
file #1491:  bad zipfile offset (local header sig):  553279656
file #1492:  bad zipfile offset (local header sig):  553519416
/media/jiri/Pluto/datasets/Structured3D/Structured3D_panorama/13/Structured3D/scene_02609/2D_rendering/4681/panorama/empty/rgb_coldlight.png  bad CRC c4090c4d  (should be 02b78ee6)
file #1579:  bad zipfile offset (local header sig):  586400993
and with 7z
7z x  -o/media/jiri/Pluto/datasets/Structured3D/Structured3D_panorama/13/    Structured3D_panorama_13.zip
7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
p7zip Version 16.02 (locale=en_GB.UTF-8,Utf16=on,HugeFiles=on,64 bits,8 CPUs Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz (306F2),ASM,AES-NI)
Scanning the drive for archives:
1 file,<PHONE_NUMBER>7 bytes (12 GiB)
Extracting archive: Structured3D_panorama_13.zip
--
Path = Structured3D_panorama_13.zip
Type = zip
Physical Size =<PHONE_NUMBER>7
64-bit = +
ERROR: Data Error : Structured3D/scene_02601/2D_rendering/843/panorama/simple/normal.png
ERROR: CRC Failed : Structured3D/scene_02608/2D_rendering/345/panorama/full/rgb_coldlight.png
ERROR: Headers Error : Structured3D/scene_02608/2D_rendering/345/panorama/full/rgb_rawlight.png
ERROR: CRC Failed : Structured3D/scene_02609/2D_rendering/1235/panorama/simple/rgb_warmlight.png
ERROR: Headers Error : Structured3D/scene_02609/2D_rendering/1235/panorama/simple/semantic.png
ERROR: Headers Error : Structured3D/scene_02609/2D_rendering/1419
ERROR: Headers Error : Structured3D/scene_02609/2D_rendering/1419/panorama
ERROR: Headers Error : Structured3D/scene_02609/2D_rendering/1419/panorama/camera_xyz.txt
ERROR: Headers Error : Structured3D/scene_02609/2D_rendering/1419/panorama/empty
ERROR: Headers Error : Structured3D/scene_02609/2D_rendering/1419/panorama/empty/albedo.png
ERROR: Headers Error : Structured3D/scene_02609/2D_rendering/1419/panorama/empty/depth.png
ERROR: CRC Failed : Structured3D/scene_02609/2D_rendering/4681/panorama/empty/rgb_coldlight.png
ERROR: Headers Error : Structured3D/scene_02609/2D_rendering/4681/panorama/empty/rgb_rawlight.png
Sub items Errors: 13
Archives with Errors: 1
Sub items Errors: 13
Could you please verify that these files are fine in the Azure cloud? If yes, then perhaps the files are corrupted only on the Azure mirror in the UK, which would be a very serious fault in Azure data management.
Kind Regards
Jiri

I had a quick check and found the files on Azure Cloud had already been corrupted. But it seems that only a few images have been affected. For now, you may ignore the corrupted data.

Thank you for confirming the issue. For what it is worth, here is a list of the corrupted scenes in the Structured3D_panorama.  In each scene, one or multiple files are corrupted.
00
scene_00010
scene_00013
scene_00014
01
scene_00206
scene_00211
scene_00212
scene_00213
02
scene_00403
scene_00408
scene_00409
scene_00410
scene_00411
scene_00412
03
scene_00609
scene_00612
scene_00613
04
scene_00806
scene_00809
scene_00810
05
scene_01009
scene_01010
06
scene_01209
scene_01210
07
scene_01410
scene_01411
scene_01412
08
scene_01605
scene_01607
scene_01608
09
scene_01813
scene_01814
scene_01815
11
scene_02211
scene_02212
scene_02213
12
scene_02409
scene_02411
13
scene_02601
scene_02608
scene_02609

Yes, I also encountered this problem.


Algorithm checklist 1

As discusses, let's start off with some popular algorithms in each domain not necessarily in this order. Feel free to add and update this when necessary.

Deep RL

[x] PPO1
[ ] HER
[ ] SAC
[ ] TD3
[ ] DQN (all variants as options for a single model)
[ ] DDPG

Classical RL

[ ] UCB-1
[ ] Thompson Sampling
[ ] Vanilla Policy Gradient
[ ] SARSA (with eligibility traces)

Evolutionary Algorithms
TODO

Meta-Learning
TODO

I'll work on HER

It would be great if we can log results from algorithm implementations. That way, we dont have to run them again later on

Yeah. Can you create a spreadsheet where we add results (mean and variance of rewards) on different environments?

We can probably have a markdown file with a table, etc inside dir deeprl/ no?

Yeah makes sense. Should we also create a json/yml file for hyperparameters?

Yeah. We can add these details to the Contributing Guidelines I think

On 31-Mar-2020, at 8:19 PM, Ajay Subramanian<EMAIL_ADDRESS>wrote:
Yeah makes sense. Should we also create a json/yml file for hyperparameters?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub https://github.com/SforAiDl/JigglypuffRL/issues/6#issuecomment-606675273, or unsubscribe https://github.com/notifications/unsubscribe-auth/AH72FJ4TUXUAKC6K3TNIX5DRKH7IVANCNFSM4LWRS65A.

Ok, will add that once these files have been made

@mehulrastogi Can you work on adding any evolutionary algorithms?

For sure sharad!
On Tue, Mar 31, 2020 at 1:17 PM Sharad Chitlangia<EMAIL_ADDRESS>wrote:

@mehulrastogi https://github.com/mehulrastogi Can you work on adding
any evolutionary algorithms?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/SforAiDl/JigglypuffRL/issues/6#issuecomment-606760708,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AFINXC32FSYD4MNMXBFEXJ3RKIQSHANCNFSM4LWRS65A
.

@mehulrastogi Could you please create an issue on the same so that we can discuss basic structure, etc beforehand?

Okay so there are many Evolutionary Algorithms. I gues you want to cover the basic and the popular ones right?
so those can be listed as follows:-

Basic ES  (https://openai.com/blog/evolution-strategies/)
NEAT
HyperNEAT
Many more are there. You can look at link

We can start off with NEAT, ES algos here and HyperNEAT (in any order). These look like the main ones for now, we can keep adding stuff later on. What do you think?

Of course, we should focus on the ones which are reproducible+benchmarkable first, otherwise we might just be stuck with code no ones gonna look at

Of course, we should focus on the ones which are reproducible+benchmarkable first, otherwise we might just be stuck with code no ones gonna look at

I think to focus on NEAT and HyperNEAT first. Of course you can find the implementation for NEAT for python here. If you want NEAT implementation in PyTorch you can find them here. After replicating the benchmark for NEAT for your tasks you will want to focus on HyperNEAT and then the Deep Neuroevolution algorithms by UBER.  In my opinion
Random Search -> Basic ES -> NEAT -> HyperNEAT -> DeepNeuroevolution.

Ok, thanks for the info!
I was hoping you could take some of these on? If not, thats ok, we will come back to it later after getting some core details of deeprl sorted.

On 08-Apr-2020, at 12:48 AM, Mehul Rastogi<EMAIL_ADDRESS>wrote:
Of course, we should focus on the ones which are reproducible+benchmarkable first, otherwise we might just be stuck with code no ones gonna look at
I think to focus on NEAT and HyperNEAT first. Of course you can find the implementation for NEAT for python here https://neat-python.readthedocs.io/en/latest/. If you want NEAT implementation in PyTorch you can find them here https://github.com/uber-research/PyTorch-NEAT. After replicating the benchmark for NEAT for your tasks you will want to focus on HyperNEAT and then the Deep Neuroevolution algorithms by UBER. In my opinion
Random Search -> Basic ES -> NEAT -> HyperNEAT -> DeepNeuroevolution.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub https://github.com/SforAiDl/JigglypuffRL/issues/6#issuecomment-610572301, or unsubscribe https://github.com/notifications/unsubscribe-auth/AH72FJYU327C7GT6LT75UQDRLN4AJANCNFSM4LWRS65A.

Closing this in favour of #101 as thats the only one left


No TF import library to link custom operators on Windows

I cannot reopen the issue here: https://github.com/tensorflow/tensorflow/issues/23740
But the issue persists, the file is still missing in the pip package as of today in TensorFlow 1.12.
Could you please reintroduce the library _pywrap_tensorflow_internal.lib in the pip pickage ? It is required to build custom ops on Windows platform.
Thanks,

@meteorcloudy Can you PTAL? Thanks!

@evgal This issue is fixed by https://github.com/tensorflow/tensorflow/commit/4beea30ec8a231a12b9183f631608a6af64b8172, but it will only be released in 1.13
You can also cherry-pick this commit to build your own TF pip package that contains the import library.

Are you satisfied with the resolution of your issue? Yes No


function bootstrap_html() in paginator.class throws error

I wanted to make a pagination in a classic style, not a typical blog one, but I found it's already there (great!).
Right after using it, and trying to move through pages, the bootstrap_html() function throws an error
  Uncaught Error: Call to undefined method Paginator::prevPageUrl() in /bl-kernel/helpers/paginator.class.php:168
as for now I got rid of: self::prevPageUrl() as I don't currently need prev/next buttons (only first/last ones).
btw. would be good if getting back to first page using first/previous/1  buttons got rid of  "/?page=1" in url for seo purposes

That's a bug: prevPageUrl should be previousPageUrl.

I changed the function name, but I was thinking to deprecated the function bootstrap_html(), almost the themes are using they own paginator code.
thanks!


Problems with connexion, gunicorn.

Hello I am currently using flask, gunicorn and nginx, all that works well for me. This is an example of my current template on the server.
from flask import (Flask, render_template)
app = Flask (__ name__, template_folder = "templates")
@ app.route ('/')
def home ():
     return render_template ('home.html')
if name == 'main':
     app.run (debug = True)
But when I want to use connexion and swagger, with a file like this, it works on my local PC. But when I upload it to the server with gunicorn and nginx, right there it doesn't work on the server
from flask import render_template
import connection
app = connexion.App (__ name__, specification_dir = '. /')
app.add_api ('swagger.yml')
@ app.route ('/')
def home ():
     return render_template ('home.html')
if name == 'main':
     app.run (host = '<IP_ADDRESS>', port = 5000, debug = True)
Is something missing in the second configuration?
sorry for the language

python 3.`
connexion 2.6

Have you configured gunicorn to use app.app? app is the connexion application, whereas
app.app is the flask application.

Hello @dtkav I could solve my problem, thanks.


Move icons stuff from material to widget

Diffbases #10179
Fixes #10177

We should have a test that verifies that Icons.foo has the right font specified.

Missed a few tests during the move. Added

LGTM


Cleanup/docstrings

Adding more docstrings

Pull Request Test Coverage Report for Build 52

0 of 0 (NaN%) changed or added relevant lines in 0 files are covered.
372 unchanged lines in 2 files lost coverage.
Overall coverage remained the same at 0.0%

Files with Coverage Reduction
New Missed Lines
%

/home/travis/miniconda/lib/python2.7/site-packages/pyiron_vasp/volumetric_data.py
26
0.0%

/home/travis/miniconda/lib/python2.7/site-packages/pyiron_vasp/vasp.py
346
0.0%

Totals

Change from base Build 50:
0.0%

Covered Lines:
0

Relevant Lines:
4638

💛  - Coveralls


jlittle576

its works!

Coverage increased (+5.7%) to 42.529% when pulling b798cb990601074a83382256de5b17054ad93c8c on jlittle576:pycon2016 into a5390a50b6e8ab83c47c6c64c379c4daf10aa4dc on keeppythonweird:master.

Coverage increased (+10.3%) to 47.126% when pulling 67977dcd1023b6c7aafc0d221f857eb92da3ae83 on jlittle576:pycon2016 into a5390a50b6e8ab83c47c6c64c379c4daf10aa4dc on keeppythonweird:master.


Add support for indonesian bible (terjemahan baru)

Dear Caleb531,
Do you mind adding support for indonesian bible (terjemahan baru)?
Thanks.

@situmorang-com Absolutely! To confirm, are you referring to "Bahasa Indonesia - Indonesian"? (from the official list of supported YouVersion languages, the second in the list with the code ind?)
If that's not the correct language, let me know. But if so, could you please also specify which version I should set as the default version? Choices are TSI, TB, BIMK, and AMD (the list is here).

Hi caleb thanks so much...yes...the indonesian version i was referring to is TB (Terjemahan Baru)

From: Caleb Evans<EMAIL_ADDRESS>Sent: Monday, September 24, 2018 2:09 AM
To: caleb531/youversion-suggest-alfred
Cc: Edmund Situmorang; Mention
Subject: Re: [caleb531/youversion-suggest-alfred] Add support for indonesian bible (terjemahan baru) (#8)
@situmorang-comhttps://github.com/situmorang-com Absolutely! To confirm, are you referring to "Bahasa Indonesia - Indonesian"? (from the official list of supported YouVersion languageshttps://my.bible.com/languages, the second in the list with the code ind?)
If that's not the correct language, let me know. But if so, could you please also specify which version I should set as the default version? Choices are TSI, TB, BIMK, and AMD (the list is herehttps://my.bible.com/languages/ind).
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/caleb531/youversion-suggest-alfred/issues/8#issuecomment-423840035, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AhxzFLZhpvSW3dSo5ha2KtK5eiwDFaqFks5ud9x7gaJpZM4W1q5G.

@situmorang-com I am please to announce that I have officially released YouVersion Suggest v9.1.0 with support for Bahasa Indonesia. The default version is BIMK; I hope this is to your liking, but do know that you can change it using the yvset language command.
I am closing this issue unless you have anything further to comment or request.

@situmorang-com Hi, I just wanted to check in: were you able to download the new version with Indonesian support? The link is below if you haven't yet:
https://github.com/caleb531/youversion-suggest-alfred/blob/master/YouVersion Suggest (Alfred 3).alfredworkflow?raw=true

@situmorang-com My apologies; I completely missed that you requested TB as the default version, not BIMK. I will push out an update today with that fix.
But as I said, if you've already installed the current version, you can use yvset version tb to set your preferred version.

@situmorang-com Done! Below is the link to YouVersion Suggest v9.1.1, where TB is now the default version for Indonesian:
https://github.com/caleb531/youversion-suggest-alfred/raw/master/YouVersion Suggest (Alfred 3).alfredworkflow


Add teardown auto analysis extension

This auto analysis will run in the final phases of auto analysis.
There will be a configuration for this analysis with questions the user can enter.
A thread will begin for each question and ReVa will be started with the RevaChat protocol.
Some default questions can be provided or loaded from a configuration. Maybe some profiles?
ReVa should have a bookmark category for each question, she will add bookmarks for the actions she takes and have the tool to add custom bookmarks herself.

This is a malware. Find the command and control and document it.
This is a malware. Find the persistence mechanism and document it.
This is a malware. Find any obfuscation and document it.

For this we will want to add support for the cyberchef python, chepy or python scripting #1

Examine the program and document any memory corruption bugs.
This is a CTF challenge. Explain how to get the flag.
This is a CTF challenge. Write a pwntools script to get the flag.

These are just some examples of questions you could task ReVa threads with.

We added a new bookmark feature in #62. We can make the auto analysis create bookmarks.
For example:

Examine the program and bookmark any malicious behaviour

Examine the progam and bookmark any network code.

https://github.com/NationalSecurityAgency/ghidra/discussions/6582


TFLite Interpreter fails to load fp32/ fp16 model on iPhone with CoreML or Metal Delegate in Swift

1. System information

OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Ubuntu 18.04
TensorFlow installation (pip package or built from source): pip
TensorFlow library (version, if pip package or github SHA, if built from source): 2.13
Mobile Device: iPhone 13 Pro

2. Code
Provide code to help us reproduce your issues using one of the following options:
I have finetuned RetinaNet detection model from the model garden.
The saved model takes input (1, None, None, 3), even though I saved it as follows:
from official.vision.serving import export_saved_model_lib

export_saved_model_lib.export_inference_graph(
        input_type='image_tensor',
        batch_size=1,
        input_image_size=list(args.inp_size),
        params=exp_config,
        checkpoint_path=tf.train.latest_checkpoint(args.model_dir),
        export_dir=args.export_dir)

where arg.inp_size is [256, 256, 3].
However I convert using concrete functions to tflite model that takes input (1, 256, 256, 3)
with open(os.path.join(saved_model_dir, "params.yaml"), "r") as stream:
    params = yaml.safe_load(stream)
h, w, c  = tuple(params['task']['model']['input_size'])[:3]
b = 1 # batch size is 1.
print(f"Saved model size will be set to [{b, h, w, c}]")

model = tf.saved_model.load(saved_model_dir)
concrete_func = model.signatures[ tf.saved_model.DEFAULT_SERVING_SIGNATURE_DEF_KEY]
concrete_func.inputs[0].set_shape([b, h, w, c])

converter = tf.lite.TFLiteConverter.from_concrete_functions([concrete_func])
tflite_model = converter.convert()

The result of tf.lite.experimental.Analyzer.analyze(model_content=tflite_model, gpu_compatibility=True) can be found here.
3. Failure after conversion

Attempting to use a delegate that only supports static-sized tensors with a graph that has dynamic-sized tensors
Note that the model works fine on iPhone CPU.

This issue originally reported by @hemangchawla has been moved to this dedicated repository for LiteRT to enhance issue tracking and prioritization. To ensure continuity, we have created this new issue on your behalf.
We appreciate your understanding and look forward to your continued involvement.

@gaikwadrahul8 could you please share if fixing this issue is on the roadmap for this quarter?


Fails to find Intel Integrated GPU

When running on my desktop (nvidia GPU), Bevy examples compile and run fine. However when running on my laptop (Intel integrated GPU), I see a message that it cannot find the GPU:
$ cargo run --example ui
    Finished dev [unoptimized + debuginfo] target(s) in 0.26s
     Running `target/debug/examples/ui`
thread 'main' panicked at 'Unable to find a GPU! Make sure you have installed required drivers!', crates/bevy_wgpu/src/wgpu_renderer.rs:28:14
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

It's worth noting that other applications run fine including ones that use the GPU such as games, CAD software etc.
I am not sure if this is an issue with Bevy or with wgpu. This issue is to see if anyone else has encountered this problem or if it is just me.

Relevant info
$ git log
commit 70ad6671dba9e7dc93e8a085ad8bb73904ca1fa5 (HEAD -> master, origin/master, origin/HEAD)

$ sudo lshw -C display
  *-display
       description: VGA compatible controller
       product: UHD Graphics 620 (Whiskey Lake)
       vendor: Intel Corporation
       physical id: 2
       bus info: pci@0000:00:02.0
       version: 00
       width: 64 bits
       clock: 33MHz
       capabilities: pciexpress msi pm vga_controller bus_master cap_list rom
       configuration: driver=i915 latency=0
       resources: irq:148 memory:a0000000-a0ffffff memory:80000000-9fffffff ioport:2000(size=64) memory:c0000-dffff

$ lscpu
Architecture:                    x86_64

<< snip >>

Vendor ID:                       GenuineIntel
CPU family:                      6
Model:                           142
Model name:                      Intel(R) Core(TM) i7-8565U CPU @ 1.80GHz

<< snip >>

Do you have vulkan compatible driver? Can you check the output of vulkaninfo?

@chemicstry You are completely correct, I did not have intel-vulkan package installed. Installing it solved the problem.
I've created a PR on the website to add a "troubleshooting section" with the solution.


not able to export intents from the framework...export intent option gives only a blank json file

facing the same :(


Is loading of control vectors supported?

The documentation (https://llama-cpp-python.readthedocs.io/en/latest/api-reference/#llama_cpp.llama_cpp.llama_control_vector_apply) mentions

Apply a loaded control vector to a llama_context, or if data is NULL, clear the currently loaded vector. n_embd should be the size of a single layer's control, and data should point to an n_embd x n_layers buffer starting from layer 1. il_start and il_end are the layer range the vector should apply to (both inclusive) See llama_control_vector_load in common to load a control vector.

I can't find llama_control_vector_load in the python api, is there another way to load control vectors?

I'm also interested in this feature


teletype new errors if path contains space

Describe the problem
It seems teletype isn't escaping / quoting the relative path (i.e. app name) for bundler, which then errors due to invalid arguments.
Steps to reproduce the problem
cd ~/
mkdir 'weird dir' && cd 'weird dir'
teletype new app

Actual behaviour
teletype new app returns 1, prints traceback:
ERROR: "bundle gem" was called with arguments ["/Users/tim/weird", "dir/app"]
Usage: "bundle gem NAME [OPTIONS]"
Traceback (most recent call last):
        9: from /Users/tim/.rbenv/versions/2.6.5/bin/teletype:23:in `<main>'
        8: from /Users/tim/.rbenv/versions/2.6.5/bin/teletype:23:in `load'
        7: from /Users/tim/.rbenv/versions/2.6.5/lib/ruby/gems/2.6.0/gems/tty-0.10.0/exe/teletype:14:in `<top (required)>'
        6: from /Users/tim/.rbenv/versions/2.6.5/lib/ruby/gems/2.6.0/gems/thor-0.20.3/lib/thor/base.rb:466:in `start'
        5: from /Users/tim/.rbenv/versions/2.6.5/lib/ruby/gems/2.6.0/gems/thor-0.20.3/lib/thor.rb:387:in `dispatch'
        4: from /Users/tim/.rbenv/versions/2.6.5/lib/ruby/gems/2.6.0/gems/thor-0.20.3/lib/thor/invocation.rb:126:in `invoke_command'
        3: from /Users/tim/.rbenv/versions/2.6.5/lib/ruby/gems/2.6.0/gems/thor-0.20.3/lib/thor/command.rb:27:in `run'
        2: from /Users/tim/.rbenv/versions/2.6.5/lib/ruby/gems/2.6.0/gems/tty-0.10.0/lib/tty/cli.rb:128:in `new'
        1: from /Users/tim/.rbenv/versions/2.6.5/lib/ruby/gems/2.6.0/gems/tty-0.10.0/lib/tty/commands/new.rb:126:in `execute'
/Users/tim/.rbenv/versions/2.6.5/lib/ruby/gems/2.6.0/gems/tty-command-0.9.0/lib/tty/command.rb:106:in `run': Running `bundle gem /Users/tim/weird dir/app --no-mit --no-exe --coc --no-ext -t rspec` failed with (TTY::Command::ExitError)
  exit status: 15
  stdout: ERROR: "bundle gem" was called with arguments ["/Users/tim/weird", "dir/app"]
Usage: "bundle gem NAME [OPTIONS]"
  stderr: Nothing written

Expected behaviour
For the presence or absence of spaces in the project path to make no noticeable difference to an end-user's experience invoking teletype new.
Describe your environment
I only noticed this because I store some stuff in iCloud Drive, which has this unfortunate location on disk: /Users/tim/Library/Mobile Documents/com~apple~CloudDocs.

ruby 2.6.5p114 (2019-10-01 revision 67812) [x86_64-darwin19]
macOS 10.15.1
tty (0.10.0)

Hi Timothy,
Thanks for using tty and reporting this.
Would you have time to investigate or even better submit PR fixing the issue?
On another note, this toolkit needs to undergo a few significant changes. Hopefully next year I will get some concentrated chunks of time to get things improved.


Consider changing the project name

I suggest to the team to consider changing the name of this project. Companies often relies on aggressive legal terms prohibiting third-party and/or external personal to use their brand names on unrelated products. Moby (a.k.a. Docker) did a very similar thing some time ago demanding that people stop creating new software / products by adding the word Docker to them, this was one of the reasons we had to re brand the BioDocker project to BioContainers. By adding the word "Thermo" as a prefix, it also may pass the idea that this is some kind of oficial project made by Thermo Fischer. It is better to address this issue before the publication is out than having to change it later because a cease and desist.

@prvst so far with Thermo @lnnrt team never had an issue. See here another previous parser https://www.ncbi.nlm.nih.gov/pubmed/21714566

Yes, and the same thing can be said about the ThermoFinigan converter, but
that doesn't mean that the company will not start enforcing their trademark
tomorrow. The word Thermo is trademarked, you will always be at risk to
have it changed.
On Wed, May 1, 2019, 12:23 PM Yasset Perez-Riverol<EMAIL_ADDRESS>wrote:

@prvst https://github.com/prvst so far with Thermo @lnnrt
https://github.com/lnnrt team never had an issue. See here another
previous parser https://www.ncbi.nlm.nih.gov/pubmed/21714566
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/compomics/ThermoRawFileParser/issues/36#issuecomment-488331441,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AADCR6PUQS3MJR5PFEROZNTPTG7XBANCNFSM4HJUOANA
.