Fixed issues with EditorLayer::NewScene()

Describe the issue(s)

When you try to open a new scene while playing/simulating, Hazelnut crashes.
When you open a new (empty) scene (without having loaded a scene file before), then modify and play the scene, an empty m_EditorScene is copied to m_ActiveScene, causing loss off all progress.

PR impact
List of related issues/PRs this will solve:

Impact
Issue/PR

Issues this solves
None

Other PRs this solves
None

Proposed fix

Stop the scene if it is currently playing/simulating.
Create a new m_EditorScene instead of m_ActiveScene in NewScene().

You just couldn't wait for @TheCherno to see my PR, huh? 😞

You just couldn't wait for @TheCherno to see my PR, huh? 😞 I find it disrespectful, but each to their own.

It's not meant to be disrespectful by any means and I'm sorry for that.
But it's still your PR that gets merged probably.

We'll see, but if you're so sure that my PR gets merged, then why even make this PR? It makes no sense to me.

We'll see, but if you're so sure that my PR gets merged, then why even make this PR? It makes no sense to me.

It resolves completely different issues. It just allows your code from #562 to look cleaner.

which issues are they? 🤔 My PR resolves the fact that when launching Hazel 2D, you cannot right-click in the Scene Hierarchy, it won't register it...

which issues are they? 🤔 My PR resolves the fact that when launching Hazel 2D, you cannot right-click in the Scene Hierarchy, it won't register it...

The two issues are described in the issue description above.

Aah! The first bug, i cannot replicate with my PR changes, like at all! But, the second one is true, i experience that bug myself!

Also i deleted the old messages. because i am a numbskull for not looking at your code first, before reacting to it!

Aah! The first bug, i cannot replicate with my PR changes, like at all! But, the second one is true, i experience that bug myself!

Oh alright, I see.
And also, my description is inaccurate. By "open a new scene" I mean creating a new scene. This issue isn't solved by your PR.
I will go ahead and change it.

OnSceneStop should not be called when NewScene is ran. This will result in lost work of an existing scene because the end user never has the chance to save their existing scene.
It can be assumed that if an end user created a new scene (either through the dropdown menu or Ctrl+N) that they most likely accidentally did so. I can't imagine a situation where you're playing/simulating a scene and all of a sudden want to load a blank scene and lose existing progress before saving. The proper solution is doing nothing when creating a new scene if the user isn't in "edit" mode or giving them a chance to save their work before unloading the scene.
Cherno most likely prefers this too considering he intends to merge my PR (#506) that implements this fix.
Personally it does not matter to me which PR is merged, as they both implement the same fix, although if for some reason Cherno merges your PR instead of mine I think this should be changed.


EPU can indicate image shift group in file names

Hi,
This is very helpful, thank you! I especially like the visualization of image shift groups.
But it seems a bit crazy that one has to do all this to figure out which movies belong to which image shift group. Surely, EPU must be able to indicate the image shift group in filenames? It would then be easy to match files belonging to only one group during import in RELION, to import each group independently. So, I tried to find whether the image shift group information is already present in the file name, and according to CryoSPARC's documentation this is indeed the case: the first number after Data in the file name supposedly encodes image shift group. I checked in a bunch of movies I have that were recorded with EPU, and this first number after Data indeed only ever takes 4 different values across all my movies, so this is consistent with an image shift group (although not obvious at all, since these numbers look completely arbitrary and are big).
I am not sure this is done by default, maybe it was set this way in the EPU session that produced this particular set of movies I have? But I would suggest you check what your EPU does, because it seems you can maybe make your life a lot easier to assign image shift groups.

Hi,
Thanks for pointing this out to me, I didn't know this beforehand. However unfortunately this only works for splitting up 'exposure groups' into the shots per hole (which is too small of a beam shift for us to really even care about really). It does not make unique values for different holes collected with beam-image shift.
I checked with the most recent AFIS data I collected and printed the two numbers after Data (both seem to be tied to the template) with sort -n -k3,3 test.txt | uniq :
18135022 18135024 1
18135107 18135109 1
18135022 18135024 2
18135107 18135109 2
18135022 18135024 3
18135107 18135109 3
18135022 18135024 4
18135107 18135109 4
18135022 18135024 5
18135107 18135109 5
18135022 18135024 6
18135107 18135109 6
18135022 18135024 7
18135107 18135109 7
18135022 18135024 8
18135107 18135109 8
18135022 18135024 9
18135107 18135109 9
18135022 18135024 10
18135107 18135109 10
18135022 18135024 11
18135107 18135109 11
18135022 18135024 12
18135107 18135109 12
18135022 18135024 13
18135107 18135109 13
18135022 18135024 14
18135107 18135109 14
18135022 18135024 15
18135107 18135109 15
18135022 18135024 16
18135107 18135109 16
18135022 18135024 17
18135107 18135109 17
18135022 18135024 18
18135107 18135109 18
18135022 18135024 19
18135107 18135109 19
18135022 18135024 20
18135107 18135109 20
18135022 18135024 21
18135107 18135109 21

You can see that the values do not correspond with the optics groups and that they just repeat with the two shots per hole I had setup in my template.
We are in conversation with some people at TFS who work on EPU to make sure in the future that it is less tedious to group the data, and included in either the name or the metadata, but currently I am not aware of a better alternative than the one I have posted.
Would you mind if I add this conversation to our forum for those who may be interested in the discussion?

Would you mind if I add this conversation to our forum for those who may be interested in the discussion?

Please feel free to do it. 👍
And I am glad I posted this, because I didn't realize until I read your answer that beam shift is used not only to record several fields of view per hole, but also several holes per stage position (with much larger beam shifts, obviously). I guess I first read the notebook file too fast, because this is actually explained in it already.
You can close this issue, it was only meant as a discussion not as a bug report (maybe I should sign up on the SciLifeLab forum). Maybe see you around the microscope when the pandemic slows down (I am part of the Uppsala BAG).

Great, yes thank you very much for your comments.
You can find the forum here
Yes hope to see you around the facility when things return to a semblance of normal.


build: replace lerna task orchestration with nx

Description of changes

Lerna is no longer actively maintained.
nx is much faster for incremental builds
nx graph provides a nice overview of the project dependency graph which can help identify circular dependencies between packages

See more at the nx docs

Issue #, if available

Description of how you validated changes
Checklist

[x] PR description included
[x] yarn test passes

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Codecov Report

Merging #10369 (cb4f0d5) into master (da391b1) will increase coverage by 0.00%.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master   #10369   +/-   ##
=======================================
  Coverage   46.57%   46.58%
=======================================
  Files         703      703
  Lines       35246    35246
  Branches     7134     7134
=======================================
+ Hits        16417    16418    +1
+ Misses      17042    17041    -1
  Partials     1787     1787

Impacted Files
Coverage Δ

...li/src/domain/amplify-usageData/getUsageDataUrl.ts
100.00% <0.00%> (+12.50%)
:arrow_up:

:mega: Codecov can now indicate which changes are the most critical in Pull Requests. Learn more


Supported longer stack names

By passing in the name of the stack the functions are associated with, we no longer depend on the 25 character limit.
This allows for stacks with longer names, or cases where the length of the name is not optional, such as nested stacks.
Changed reputation-list-parser to take in the uuid, and send anonymous usage value, so we didn't need to check the stack at all
Changed custom-resource to take in the stack name, rather than interpret it based on an assumed pattern that limits it to 25 characters, thus not supporting security automations as a sub cloudformaton stack

this seems to be included in https://github.com/awslabs/aws-waf-security-automations/commit/3f9afeff52def452f2f6693be75a5fea725f4d10 can we close this PR?

Yeah looks like they cherry picked parts of it, but in either case, it's so far gone from where the PR came in, that if it didn't work, I'd have to start over anyway, so might as well close it.


ability to use custom root of trust (instead of “vsecm.com”)

We already have this feature in helm charts.
Closing.
ref
    # -- The trust domain is the root of the SPIFFE ID hierarchy. It is used to
    # identify the trust domain of a workload. If you use anything other than
    # the default `vsecm.com`, you must also update the relevant environment
    # variables that does SPIFFE ID validation.
    #
    # To prevent accidental collisions (two trust domains select identical names),
    # operators are advised to select trust domain names which are highly likely
    # to be globally unique. Even though a trust domain name is not a DNS name,
    # using a registered domain name as a suffix of a trust domain name, when
    # available, will reduce chances of an accidental collision; for example,
    # if a trust domain operator owns the domain name `example.com`,
    # then using a trust domain name such as `apps.example.com` would likely
    # not produce a collision. When trust domain names are automatically generated
    # without operator input, randomly generating a unique name (such as a UUID)
    # is strongly advised.
    #
    # All SPIFFE IDs shall be prefixed with `spiffe://<trustDomain>` unless
    # you have an advanced custom setup.
    trustDomain: "vsecm.com"


Value not parsed

Hi,
I get this error in the FanControl log when trying to fetch temperatures from HWinfo: "Value not parsed: 33,5". Values from HWinfo show as "NaN" in FanControl. If I change from comma decimal separator to dot in HWinfo setting the error disappears. But I wish to use comma decimal. Anything that can be solved in future update?
I'm on version 154 and HWinfo64 v7.42-5030 with "shared memory" disabled and gadget active.
Thanks for a fantastic software!
Kind regards

See
https://github.com/Rem0o/FanControl.HWInfo/blob/077db8f0c09c9ed92ab5c976c5623e2a753157d4/HWInfoRegistry.cs#L11

Thank you for the speedy reply. Could you please offer some guidance on how I can use this info?


Tabs: "Cannot read property 'getBoundingClientRect' of undefined"

Seems to happen when the component starts unmounting (or when it's not fully mounted yet?)
Repro: have 2 pages with tabs, cross-linked. Switch between them.

Having a similar issue but with IconMenus, where I'm getting Cannot read 'getBoundingClientRect' of undefined .
I have IconMenus that are in a grid component that removes rows from the DOM when they're no longer visible. I found this issue: https://github.com/react-toolbox/react-toolbox/issues/251 and I suspect the fix there introduced race conditions when components unmount.
In this particular case it looks like a guard on this.refs here: https://github.com/react-toolbox/react-toolbox/blob/5184e872daf1f5820455a16b5bef17d2c9a8abe3/components/menu/Menu.jsx#L47 would fix the problem I'm seeing. Feels like a band aid though.

@mattkauffman23 may be related: https://github.com/react-toolbox/react-toolbox/issues/303

👍 @emirotin thanks will look into whether that's related.

The same bugfix should also be applied here: https://github.com/react-toolbox/react-toolbox/blob/dev/components/menu/Menu.js#L47


Can't export image

Photoshop version
CC2021
Describe the bug
There is no way to export the image. Quick export as png opens no dialog and export as is empty (see screenshot bellow)
To Reproduce
Steps to reproduce the behavior:

Open and edit your image
Click "Quick export as png", nothing happens
Click "Export as...", nothing happens too

Expected behavior
Be able to export the image
Screenshots
The empty "Export As" dialog

System informations

Distro : ArchLinux
GPU : Nvidia

Additional context
Just installed it
Is some information are missing it might take longer to find the issue so please complete carefully
Save As works fine. In fact I'm able to open the .psd on GIMP and export it. But what's the point in that?

Exporting doesn't work at all, you can save as png or jpeg with the save as tab.
Or you can export with gimp. The point is even if you can't export using photoshop,  some people need all photoshop functionality or workflow.
I personally export using save as and choose png or jpeg.
I currently don't know how to fix it.

Oh save as can save png.. Didn't notice
Funnily enough I remember myself trying to daily drive Ubuntu back in like 2016 and had the exact same problem on Photoshop. It seems there is no progress on that 😄

Oh save as can save png.. Didn't notice
Funnily enough I remember myself trying to daily drive Ubuntu back in like 2016 and had the exact same problem on Photoshop. It seems there is no progress on that smile

Well I guess x) at least it still have a workaround to export.

Hey @MiMillieuh
You mentioned that you were inspired by @Gictorbit
I'm trying to install Photoshop on linux for more than 5 days. So far, Only this repo has worked for me with anhttps://github.com/Gictorbit/photoshopCClinux/issues/177. And due to low data pack, I'm not currently able to install you repo's Photoshop. Can you please look into this issue . ? In your free time? Thanks!

Hey @MiMillieuh
You mentioned that you were inspired by @Gictorbit
I'm trying to install Photoshop on linux for more than 5 days. So far, Only this repo has worked for me with anhttps://github.com/Gictorbit/photoshopCClinux/issues/177. And due to low data pack, I'm not currently able to install you repo's Photoshop. Can you please look into this issue . ? In your free time? Thanks!

Is there anything to do with the issue of exporting ?

No. Its @Gictorbit's repo.  But maybe due to some work, he isn't active for a long time now.  Do you have an idea how it can be fixed? Please.

No. Its @Gictorbit's repo.  But maybe due to some work, he isn't active for a long time now.  Do you have an idea how it can be fixed? Please.

I don't know... maybe if you use wine staging use the wine devel.
Maybe it's outdated. You should try on an older distro.
To be clear I didn't take anything from his repo... just the concept of installing Photoshop. So I don't really know how his version works

For me, the Export function is working with wine-staging-7.5-1 and wine-staging-7.6-1.


Coping something to /usr break the image

After coping some content to /usr dir, the built image is broken with error while loading shared libraries: libtinfo.so.5: cannot open shared object file: Permission denied.
This the simplest Dockerfile that reproduces the issue:
FROM rhel7:7.2
RUN groupadd group && \
    useradd --create-home --shell /bin/bash --gid group user

COPY usr /usr
USER user

The content of usr folder copied is (can be anything):
$ tree usr/
usr/
└── lib64
    └── file.txt

1 directory, 1 file

Output of docker version:
Client:
 Version:      1.12.0
 API version:  1.24
 Go version:   go1.6.3
 Git commit:   8eab29e
 Built:        Thu Jul 28 22:00:36 2016
 OS/Arch:      linux/amd64

Server:
 Version:      1.12.0
 API version:  1.24
 Go version:   go1.6.3
 Git commit:   8eab29e
 Built:        Thu Jul 28 22:00:36 2016
 OS/Arch:      linux/amd64

Output of docker info:
Containers: 8
 Running: 0
 Paused: 0
 Stopped: 8
Images: 738
Server Version: 1.12.0
Storage Driver: aufs
 Root Dir: /var/lib/docker/aufs
 Backing Filesystem: extfs
 Dirs: 804
 Dirperm1 Supported: true
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
 Volume: local
 Network: overlay host bridge null
Swarm: inactive
Runtimes: runc
Default Runtime: runc
Security Options: apparmor
Kernel Version: 3.19.0-65-generic
Operating System: Ubuntu 14.04.5 LTS (containerized)
OSType: linux
Architecture: x86_64
CPUs: 4
Total Memory: 7.762 GiB
Name: ES96001206800102236
ID: 6G6X:CTGE:5ISG:4TFN:7FUE:HCOB:RZTW:L4FV:O6EC:EHGK:XFWG:JB4Z
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): false
Registry: https://index.docker.io/v1/
WARNING: No swap limit support
Insecure Registries:
 <IP_ADDRESS>/8

Steps to reproduce the issue:

Build the image: docker build --rm --tag=name:version -f Dockerfile .
Run the container: docker run --rm -ti name:version

Describe the results you received:
The container does not start. This is the error message in the output:
/bin/bash: error while loading shared libraries: libtinfo.so.5: cannot open shared object file: Permission denied

Inside the container I can see that /usr/lib64 permission was changed to 770, instead of 755 (because of the copy?).
Describe the results you expected:
The shell prompt is the expected result. It is possible to access the container if -u root parameter is used in the run command.
Additional information you deem important (e.g. issue happens only occasionally):
This issue is always reproducible with the given Dockerfile.

I think this is an overlay kernel bug.
On 8 Aug 2016 7:19 p.m., "ttres"<EMAIL_ADDRESS>wrote:

After coping some content to /usr dir, the built image is broken with error
while loading shared libraries: libtinfo.so.5: cannot open shared object
file: Permission denied.
This the simplest Dockerfile that reproduces the issue:
FROM rhel7:7.2
RUN groupadd group &&
useradd --create-home --shell /bin/bash --gid group user
COPY usr /usr
USER user
The content of usr folder copied is (can be anything):
$ tree usr/
usr/
└── lib64
└── file.txt
1 directory, 1 file
Output of docker version:
Client:
Version:      1.12.0
API version:  1.24
Go version:   go1.6.3
Git commit:   8eab29e
Built:        Thu Jul 28 22:00:36 2016
OS/Arch:      linux/amd64
Server:
Version:      1.12.0
API version:  1.24
Go version:   go1.6.3
Git commit:   8eab29e
Built:        Thu Jul 28 22:00:36 2016
OS/Arch:      linux/amd64
Output of docker info:
Containers: 8
Running: 0
Paused: 0
Stopped: 8
Images: 738
Server Version: 1.12.0
Storage Driver: aufs
Root Dir: /var/lib/docker/aufs
Backing Filesystem: extfs
Dirs: 804
Dirperm1 Supported: true
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
Volume: local
Network: overlay host bridge null
Swarm: inactive
Runtimes: runc
Default Runtime: runc
Security Options: apparmor
Kernel Version: 3.19.0-65-generic
Operating System: Ubuntu 14.04.5 LTS (containerized)
OSType: linux
Architecture: x86_64
CPUs: 4
Total Memory: 7.762 GiB
Name: ES96001206800102236
ID: 6G6X:CTGE:5ISG:4TFN:7FUE:HCOB:RZTW:L4FV:O6EC:EHGK:XFWG:JB4Z
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): false
Registry: https://index.docker.io/v1/
WARNING: No swap limit support
Insecure Registries:
<IP_ADDRESS>/8
Steps to reproduce the issue:

Build the image: docker build --rm --tag=name:version -f Dockerfile .
Run the container: docker run --rm -ti name:version

Describe the results you received:
The container does not start. This is the error message in the output:
/bin/bash: error while loading shared libraries: libtinfo.so.5: cannot open shared object file: Permission denied
Inside the container I can see that /usr/lib64 permission was changed to
770, instead of 755 (because of the copy?).
Describe the results you expected:
The shell prompt is the expected result. It is possible to access the
container if -u root parameter is used in the run command.
Additional information you deem important (e.g. issue happens only
occasionally):
This issue is always reproducible with the given Dockerfile.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/docker/docker/issues/25501, or mute the thread
https://github.com/notifications/unsubscribe-auth/AAdcPDc1xTvGyCxGOf4h2qzvLj19ftlfks5qd3MSgaJpZM4JfUoZ
.

@justincormack you meant, aufs :smiley: ?

Oh, looking again, it looks like the files under the directory being copied, including the lib64 directory, are created with the permissions that they have on the filesystem, even if they already exist. So if you change the permissions in your directory that is copied in to 755 it should work as expected. I can see that could be confusing, although arguably wither way would be correct, I think it is reasonable for the later copy to override what was there. You could also use COPY /usr/lib64 /usr/lib64/.

Yes, @justincormack, you're right, the permissions inside the image were set over the permissions from the base image.
My mistake was not paying attention to the local permissions of the origin files.
Conclusion #protip: always check the local files permissions before COPY.


 I think that’s the
closest English word.

But this person is asking about omcherabech which is different.  The last
four letters are 'bech' instead of 'cheb'.  So are you saying that you
think they are the same word or maybe the person asking is confused?

<EMAIL_ADDRESS>replied, It is the same with new generation spelling words from 70’s, 80’s, and now
is different but it is the same word.

<EMAIL_ADDRESS>replied, Omecheracheb. Omecherabech.
The person asking must have just spelled it wrong or is one of the many who
change the last few letters of many words. It does happen a lot. Not
purposely but they just don't know....
Other examples:
Bechecheiaches - bechecheiasech
Menguchet - mengutech
Melechet - meletech
And more but that's all I can quickly think of.
J

Close. Closing this without changing anything. Assuming the OP just got confused and transposed some letters.


Metadata persistence should allow User lookup by server

Right now Users are stored with the primary key being the user identity. This should change so that multiple users with the same ID but different servers can be stored. A particular user should be uniqued based on both its identity and its server, if the server is defined. @astigsen

Yes please. I started with just an IP address to the server and I switched to a domain name, now it won't let me log in with the same user credentials. I guess I'll switch back for now.

Same here. We added an SSL certificate for a domain and we switched from ip to domain with https and realms protocols. Now we cant login:
terminating with uncaught exception of type std::invalid_argument: Cannot retrieve an existing user specifying a different auth server.

Any updates on this issue? We're having the same problem after adding HTTPS support.

Thanks for commenting. We understand that this is important for our customers and are (internally) exploring ways to improve this feature. I'll post in this thread once we have anything to show you all.

Duplicate of #397.

If I'm not mistaken, @austinzheng, this looks to be fixed now, correct? We're able to switch our servers to use https or a domain name without issue?
Thanks!

Yes, this was fixed at the object store level in #497. The fix was released in the Cocoa SDK in v2.9.0. I think it's also been released in several other SDKs by now, but I don't know in which versions off the top of my head.

As @bdash said, you'll be able to create different users with different URLs but the same identity without problem. This covers cases including (but not limited to) http vs https, different ports, and IP versus hostname.
Note that we don't do anything special to distinguish URLs (e.g. a user created using https://realm.example.org is considered a different user than one created using http://realm.example.org). This won't cause your app to malfunction in any way even if you use both users simultaneously, but you shouldn't (e.g.) expect them to share the same local Realm file or automatically log the other out when one is logged out.
Hope that helps, and as always thanks for using Realm!

@austinzheng Thanks for the explanation! Any idea what would happen if we switch from an IP address to a domain address? Would Realm consider that a different user?

The Realm Object Server (which is what matters for the purposes of your question) would consider them the same user, as you'd probably expect.
The client device wouldn't know about the IP to domain address switch, so you'd have to create/log in the user using the new URL, and if you opened a Realm using the domain address user it would download a new copy.
We are considering APIs to make this process less awkward (for example, APIs to indicate to the sync subsystem that a user at URL x has moved to URL y), and welcome any feedback!

@austinzheng Right, that makes sense. So maybe after that change they need to do a full refresh from the Realm Object Server but that's a minor inconvenience (in my case at least).
Sounds great, guys. Can't wait to try it out. Thanks! 👍


Add continuous benchmarking

What is the expected enhancement?
Leveraging a framework like asv (https://github.com/airspeed-velocity/asv ) we can build a benchmarking suite for parts of qiskit-terra and measure the performance over time.
We would have to do this outside of our existing appveyor and travis ci systems because there is too much inherent variability in those systems to provide a consistent baseline for benchmarking. (What those systems could provide though is just a job to ensure we don't break the benchmarks) But if we can setup a dedicated environment to run benchmarks from we can leverage github webhooks to run new benchmarks on every commit (using something like https://github.com/mtreinish/asv-github )

i think this should not be in terra but a global repo

This is the same issue as #325. Let's track there and follow up on that conversation.


CI: Fix nightly build

What

Update post-release version bump to bump versions for everything, not just crates
Manually bump versions to 0.18.0-alpha.1+dev

Checklist

[x] I have read and agree to Contributor Guide and the Code of Conduct
[x] I've included a screenshot or gif (if applicable)
[x] I have tested the web demo (if applicable):

Using examples from latest main build: rerun.io/viewer
Using full set of examples from nightly build: rerun.io/viewer

[x] The PR title and labels are set such as to maximize their usefulness for the next release's CHANGELOG
[x] If applicable, add a new check to the release checklist!

PR Build Summary
Recent benchmark results
Wasm size tracking

To run all checks from main, comment on the PR with @rerun-bot full-check.

Running nightly here: https://github.com/rerun-io/rerun/actions/runs/9860353960/job/27227115292

Nice: https://github.com/rerun-io/rerun/actions/runs/9860353960/job/27227115292#step:10:1


Configurable bot command prefix

Several users have requested the ability to configure the bot's command prefix (default .au).
We can adapt an implementation from resources like this

This has been added and merged :)


[Security] ZooKeeper unauthorized access

There is a warning about ZooKeeper unauthorized access allowed in vulnerability scanning. What should we do to config the access permission for ZooKeeper without affecting OpenPAI and HA service？
OpenPAI Environment:
OpenPAI version: v0.11.0
Cloud provider or hardware configuration:
OS (e.g. from /etc/os-release): ubuntu16.04
Kernel (e.g. uname -a):
Hardware (e.g. core number, memory size, storage size, GPU type etc.):
Others:

Do you mean this?
We have upgraded to the fixed version the first time, however, OpenPAI doesn't take much effort on security feature, such as zk ACL. You could use firewall instead, and we provide pylon as proxy.

@mzmssg thanks. Is it possible that performing setAcl in zk temporarily, and How?

@mzmssg Thanks. what's the path if I want to setAcl in zk?


Fixes code example for client.index

Correct key is bodyinstead of doc
See https://github.com/elastic/elasticsearch-js

@markusz thank you!


remove extra mocks

Signed-off-by: Joe Grund<EMAIL_ADDRESS>

Codecov Report

Merging #51 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master      #51   +/-   ##
=======================================
  Coverage   95.03%   95.03%
=======================================
  Files         295      295
  Lines        3947     3947
  Branches      481      481
=======================================
  Hits         3751     3751
  Misses        175      175
  Partials       21       21

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7161c8e...c3fc5ca. Read the comment docs.


Add example playground

Closes #6.

Closing and re-opening to run PR checks again.

We need to update guide how to use the playground.

This PR is stale almost two months, we can reopen when we more time to invest into documentation.


Adding type predicates

https://github.com/sdingcn/exprscript/blob/9509156fb73f38ff4836ee5d19cd4aa1bbb69f7e/src/interpreter.py#L1009
May want to add void? integer? string? closure? continuation?, and remove type.

Currently the lexer only recognizes pure letters for variable names; may want to support variables with other characters.

Final plan: use the special prefix : for intrinsic functions and add (intrinsic) type predicates :isvoid, :isinteger, :isstring, :isclosure, :iscontinuation.
After this, may open a new issue for the support of '_' and / or non-initial digits in variable names.

Use the special prefix ., like .isvoid.

Leave special prefix as future work.
98bb33e


Rename com.google.gct.idea to com.google.cloud.tools.intellij

@loosebazooka might want to take a look.

lgtm


feat: gene essentiality workflow

Main improvements in this PR:

This PR aims to automatise the gene essentiality checks as introduced in https://github.com/SysBioChalmers/Human-GEM/pull/563 with a GitHub workflow, also discussed in that PR thread.
I hereby confirm that I have:

[ ] Tested my code on my own computer for running the model
[x] Selected develop as a target branch
[ ] Any removed reactions and metabolites have been moved to the corresponding deprecated identifier lists

Also noting here this relevant research article Synthetic lethality in large-scale integrated metabolic and regulatory network models of human cells.

Also noting here this relevant research article Synthetic lethality in large-scale integrated metabolic and regulatory network models of human cells.

yes, it mentioned another method gMCStool that can predict essential genes in context-specific models

@mihai-sysbio Could you explain the reason for the failing task?

@mihai-sysbio Could you explain the reason for the failing task?

The task isn't actually failing, really. As mentioned in the comment above, it's simply that the output of the gene essentiality is so long that it cannot be posted as a PR comment. I couldn't figure out how @haowang-bioinfo ran the calculations to obtain a much more compressed output. As visible in the workflow changes, the code here is just calling functions defined elsewhere.

I couldn't figure out how @haowang-bioinfo ran the calculations to obtain a much more compressed output. As visible in the workflow changes, the code here is just calling functions defined elsewhere.

the concise output was an outcome of a series of manual operations of running functions, copy/paste results, and modifications with text editor

If these last manual steps could be ran as a function, then we would be ready to run the gene essentiality analysis on every PR 💪🏻

As is suggested for MACAW results in #840, a summary output could be posted on in the PR, while a more detailed text file could be written and committed as part of each PR. This could be organized in the same folder as the MACAW results, and a README.md file could indicate for both output files from which PR they derived from.

Finally 😄 it seems to work! Ready for review.


Adding parallel::destroy and destroy_n

This is related to #1141

It is... Do you have a better idea how to check whether an object
actually was destroyed? We could perhaps simply use a counter to count
invocations. Not sure.

Guess the counter is the only way here ... this test fails on a gcc
release build ...

@sithhell: see #2709 for a fix


Compatibility issue with newer Windows Holographic Versions(21H1)?

My MR-WebRTC Application which worked on an old OS-Version of my HoloLens2 is now crashing straight after startup if I build it with ARM-compatiblility. On the other hand, if I build it with ARM64 compatibility, it does not crash but MR-WebRTC does not support ARM64.
Is there a way how to use MR-WebRTC on Windows Holographic Version 21H1 and higher(with ARM-compatibility) and what could be the reason behind the crash?

Now I was able to fix it. With one of my Provisioning-Packages I disabled the usage of microphone for mixedReality and it seems like access to those audio-informations is mandatory for MR-WebRTC even if you are not transmitting any audio (no audio media-line) via WebRTC. It had nothing to do with the OS-Version. Maybe this should be mentioned somewhere in the documentation Microsoft!

I have seen this before, it's definitely documented somewhere but it's not completely obvious.
But yes, as you say, microphone is required to init the library, even if you don't plan to use it.


Kubernetes support

Adds Kubernetes controller and service definitions, a build of Cassandra that is Kubernetes-aware, and some environment variables to link services together.

Hi, Dana. This looks really neat.
This seems almost "new repo" worthy, especially as the README could highlight how to setup kubernetes specifically and flatten the directories.
What are your thoughts on zipkin-kubernetes? I could help set it up, if you are interested.

Sounds good to me!

https://github.com/openzipkin/zipkin-kubernetes and you can be pull request 1!


Crash on Results subscript access

Here's the stacktrace we see in our crash logger:
EXC_BAD_ACCESS KERN_INVALID_ADDRESS 0x00000001542c4000

Crashed:
0  Superhuman                     0x102d2d0e8 realm::BpTreeNode::get_bptree_leaf(unsigned long) const + 396168
1  Superhuman                     0x102e0d5ac realm::Column<double>::is_null(unsigned long) const + 24720
2  Superhuman                     0x102e0fd58 int realm::ColumnBase::compare_values<realm::Column<double> >(realm::Column<double> const*, unsigned long, unsigned long) + 34876
3  Superhuman                     0x102e2e990 realm::ColumnsDescriptor::Sorter::operator()(realm::ColumnsDescriptor::IndexPair, realm::ColumnsDescriptor::IndexPair, bool) const + 30816
4  Superhuman                     0x102e37c9c void std::__1::__sort<std::__1::reference_wrapper<realm::ColumnsDescriptor::Sorter>&, realm::ColumnsDescriptor::IndexPair*>(realm::ColumnsDescriptor::IndexPair*, realm::ColumnsDescriptor::IndexPair*, std::__1::reference_wrapper<realm::ColumnsDescriptor::Sorter>&) + 68460
5  Superhuman                     0x102e37b38 void std::__1::__sort<std::__1::reference_wrapper<realm::ColumnsDescriptor::Sorter>&, realm::ColumnsDescriptor::IndexPair*>(realm::ColumnsDescriptor::IndexPair*, realm::ColumnsDescriptor::IndexPair*, std::__1::reference_wrapper<realm::ColumnsDescriptor::Sorter>&) + 68104
6  Superhuman                     0x102e336cc realm::RowIndexes::do_sort(realm::DescriptorOrdering const&) + 50588
7  Superhuman                     0x102e18958 realm::TableViewBase::do_sync() + 900
8  Superhuman                     0x102d7fa40 realm::Query::find_all(realm::DescriptorOrdering const&) + 734432
9  Superhuman                     0x102a78d94 realm::Results::evaluate_query_if_needed(bool) + 458 (table_view.hpp:458)
10 Superhuman                     0x102a78a64 realm::util::Optional<realm::BasicRowExpr<realm::Table> > realm::Results::try_get<realm::BasicRowExpr<realm::Table> >(unsigned long) + 1251 (column.hpp:1251)
11 Superhuman                     0x102a78990 realm::BasicRowExpr<realm::Table> realm::Results::get<realm::BasicRowExpr<realm::Table> >(unsigned long) + 402 (optional.hpp:402)
12 Superhuman                     0x102a98394 RLMAccessorContext realm::Results::dispatch<auto realm::Results::get<RLMAccessorContext>(RLMAccessorContext&, unsigned long)::'lambda'(RLMAccessorContext&)>(RLMAccessorContext&&&) const + 306 (results.hpp:306)
13 Superhuman                     0x102b1d620 -[RLMResults objectAtIndex:] + 60 (RLMResults_Private.hpp:60)
14 Superhuman                     0x102b93ef8 Results.subscript.getter + 152 (Results.swift:152)
...
61 Superhuman                     0x1027dcb60 partial apply for specialized  +<PHONE_NUMBER>
62 Superhuman                     0x10233045c thunk for @escaping @callee_guaranteed () -> () (<compiler-generated>)
63 libdispatch.dylib              0x1ba985610 _dispatch_call_block_and_release + 24
64 libdispatch.dylib              0x1ba986184 _dispatch_client_callout + 16
65 libdispatch.dylib              0x1ba96373c _dispatch_lane_serial_drain$VARIANT$armv81 + 564
66 libdispatch.dylib              0x1ba964188 _dispatch_lane_invoke$VARIANT$armv81 + 452
67 libdispatch.dylib              0x1ba96360c _dispatch_lane_serial_drain$VARIANT$armv81 + 260
68 libdispatch.dylib              0x1ba964188 _dispatch_lane_invoke$VARIANT$armv81 + 452
69 libdispatch.dylib              0x1ba96d43c _dispatch_workloop_worker_thread + 576
70 libsystem_pthread.dylib        0x1ba9d5fa4 _pthread_wqthread + 276
71 libsystem_pthread.dylib        0x1ba9d8ae0 start_wqthread + 8

We've only seen this on v4.1.1, we're trying to downgrade back to v3.19.0 to see if stops
(Xcode 11.1, iOS 13.1.3)

We also see this from the same function:
0  Superhuman                     0x10596bc88 void std::__1::__sort<std::__1::reference_wrapper<realm::ColumnsDescriptor::Sorter>&, realm::ColumnsDescriptor::IndexPair*>(realm::ColumnsDescriptor::IndexPair*, realm::ColumnsDescriptor::IndexPair*, std::__1::reference_wrapper<realm::ColumnsDescriptor::Sorter>&) + 68440
1  Superhuman                     0x10596bb38 void std::__1::__sort<std::__1::reference_wrapper<realm::ColumnsDescriptor::Sorter>&, realm::ColumnsDescriptor::IndexPair*>(realm::ColumnsDescriptor::IndexPair*, realm::ColumnsDescriptor::IndexPair*, std::__1::reference_wrapper<realm::ColumnsDescriptor::Sorter>&) + 68104
2  Superhuman                     0x1059676cc realm::RowIndexes::do_sort(realm::DescriptorOrdering const&) + 50588
3  Superhuman                     0x10594c958 realm::TableViewBase::do_sync() + 900
4  Superhuman                     0x1058b3a40 realm::Query::find_all(realm::DescriptorOrdering const&) + 734432
5  Superhuman                     0x1055acd94 realm::Results::evaluate_query_if_needed(bool) + 458 (table_view.hpp:458)
6  Superhuman                     0x1055aca64 realm::util::Optional<realm::BasicRowExpr<realm::Table> > realm::Results::try_get<realm::BasicRowExpr<realm::Table> >(unsigned long) + 1251 (column.hpp:1251)
7  Superhuman                     0x1055ac990 realm::BasicRowExpr<realm::Table> realm::Results::get<realm::BasicRowExpr<realm::Table> >(unsigned long) + 402 (optional.hpp:402)
8  Superhuman                     0x1055cc394 RLMAccessorContext realm::Results::dispatch<auto realm::Results::get<RLMAccessorContext>(RLMAccessorContext&, unsigned long)::'lambda'(RLMAccessorContext&)>(RLMAccessorContext&&&) const + 306 (results.hpp:306)
9  Superhuman                     0x105651620 -[RLMResults objectAtIndex:] + 60 (RLMResults_Private.hpp:60)
10 Superhuman                     0x1056c7ef8 Results.subscript.getter + 152 (Results.swift:152)
...

Please use the issue-template when creating issues.
That said, could you please explain circumstances around this.

Is it in production or in testing?
Can you reproduce this?
How often have you seen it?

@bmunkholm This is happening in production and testing, I can reproduce now that I have the users device in hand. It doesn't reproduce every time, but often.

@bmunkholm I think I've tracked it down to the double that we're sorting the results containing nan in some rows. Does that sound like it could cause this?

That's a plausible thing to look into at least; I wouldn't be surprised if we don't have good tests for sorting nans.

The sorting code doesn't attempt to handle nans so there's no guarantee that trying to sort on a property where some values are nan will actually sort correctly, but I don't see anything that could cause crashes.

@tgoyne Here is a minimum example of a the sort crashing:
class PersonModel: Object {
    @objc dynamic var name: String = ""
    @objc dynamic var sort: Double = 0

    override static func primaryKey() -> String? {
        return "name"
    }
}

class ViewController: UIViewController {

    override func viewDidLoad() {
        super.viewDidLoad()

        let realm = try! Realm()
        try! realm.write {
            realm.deleteAll()
            for _ in 0..<80000 {
                let p = PersonModel()
                p.name = UUID().uuidString
                p.sort = Double.random(in: 0..<1)

                if Bool.random() {
                    p.sort = .nan
                }

                realm.add(p)
            }
        }
    }

    @IBAction func buttonTapped(_ sender: Any) {
        let realm = try! Realm()
        let sorted = realm.objects(PersonModel.self).sorted(byKeyPath: "sort", ascending: false)
        for index in 0..<sorted.count {
            let person = sorted[index]
            print("PERSON", person)
        }
    }
}

Tested on an iPhone X, iOS 12.4.1, Xcode 11.2.1, Realm 3.17.3
(Though in our app I saw it on various devices, iOS versions and Realm versions)

It looks like this is directly related to the sort comparator not handling nans. libc++'s sort implementation skips some bounds checks that would be redundant with a well-behaved comparator, so it ends up performing an out-of-bounds read.


Missing SelectorDepth rules?

I noticed some SelectorDepth warnings, but I couldn't find the rules: https://github.com/sasstools/sass-lint/tree/develop/docs/rules
Wondering if they need to be added?

Do you mean our nesting-depth rule? https://github.com/sasstools/sass-lint/blob/develop/docs/rules/nesting-depth.md

Hey @DanPurdy thanks for the reply, I'm finding it tricky to drill down the warning to the corresponding rule in some cases. Would it be helpful to have a list of the warnings on the rule.md for easier searchability? e.g. can't find anything for ElsePlacement either: https://github.com/sasstools/sass-lint/search?utf8=✓&q=ElsePlacement

No problem, Are you sure you're in the right repo? They look like scss-lint rules to me..
scss-lint is a linter for only scss files running in ruby
sass-lint is a linter for scss/Sass files runing on node
You're probably trying to find this and this

@DanPurdy Ahhhhhhhhhhhhhhhhhhhh, sorry! I am indeed, thanks very much.


Amends from Ruby 2.2.0 environment

Seems ok to me :+1:

The data attribute was duplicated, so I merged the options together.
If someone has any advice on an alternative implementation, please let me know.

Not aside from wanting to have this kind of messy code in a presenter or something rather, but that's not within Rizzo's current capabilities and a discussion for another day I reckon.

Looks like there's a cage match in store between this PR and https://github.com/lonelyplanet/rizzo/pull/1246. Any more thoughts on this?

closing in favor of #1246


C# extension members: add F# to the list of client languages examples

This seems like a small (but important) contribution, so no Contribution License Agreement is required at this point. We will now review your pull request.
Thanks,
.NET Foundation Pull Request Bot


Random seed doesn't seem to work well

Im new with petastorm and Im facing some issues.
I need to iterate over a dataset getting three equals batches to transform 2 of them to extract some info.
The dataset consist on users ratings movies (like the Movie-Lens dataset). I need to get three batches with the same ratings(rows) to extract each user(in ratings the user could appear repeated) and extract each movie rated. I write this code.
Creating fake dataset and spark converter:
ratings_l = [
    {'uid_dec': 0, 'mid_dec': 6, 'eval': 2.18},
    {'uid_dec': 0, 'mid_dec': 7, 'eval': 3.83},
    {'uid_dec': 0, 'mid_dec': 8, 'eval': 3.94},
    {'uid_dec': 0, 'mid_dec': 9, 'eval': 4.31},
    {'uid_dec': 0, 'mid_dec': 10, 'eval': 4.48},
    {'uid_dec': 0, 'mid_dec': 11, 'eval': 3.74},
    {'uid_dec': 1, 'mid_dec': 6, 'eval': 3.21},
    {'uid_dec': 1, 'mid_dec': 7, 'eval': 2.05},
    {'uid_dec': 1, 'mid_dec': 8, 'eval': 2.24},
    {'uid_dec': 1, 'mid_dec': 9, 'eval': 2.08},
    {'uid_dec': 1, 'mid_dec': 10, 'eval': 4.94},
    {'uid_dec': 1, 'mid_dec': 11, 'eval': 4.22},
    {'uid_dec': 2, 'mid_dec': 6, 'eval': 3.52},
    {'uid_dec': 2, 'mid_dec': 7, 'eval': 2.67},
    {'uid_dec': 2, 'mid_dec': 8, 'eval': 2.69},
    {'uid_dec': 2, 'mid_dec': 9, 'eval': 2.75},
    {'uid_dec': 2, 'mid_dec': 10, 'eval': 4.93},
    {'uid_dec': 2, 'mid_dec': 11, 'eval': 2.9},
    {'uid_dec': 3, 'mid_dec': 6, 'eval': 2.0},
    {'uid_dec': 3, 'mid_dec': 7, 'eval': 2.9},
    {'uid_dec': 3, 'mid_dec': 8, 'eval': 4.74},
    {'uid_dec': 3, 'mid_dec': 9, 'eval': 2.5},
    {'uid_dec': 3, 'mid_dec': 10, 'eval': 2.18},
    {'uid_dec': 3, 'mid_dec': 11, 'eval': 4.93},
    {'uid_dec': 4, 'mid_dec': 6, 'eval': 4.46},
    {'uid_dec': 4, 'mid_dec': 7, 'eval': 2.23},
    {'uid_dec': 4, 'mid_dec': 8, 'eval': 4.42},
    {'uid_dec': 4, 'mid_dec': 9, 'eval': 4.67},
    {'uid_dec': 4, 'mid_dec': 10, 'eval': 2.65},
    {'uid_dec': 4, 'mid_dec': 11, 'eval': 2.11},
    {'uid_dec': 5, 'mid_dec': 6, 'eval': 2.31},
    {'uid_dec': 5, 'mid_dec': 7, 'eval': 2.69},
    {'uid_dec': 5, 'mid_dec': 8, 'eval': 2.41},
    {'uid_dec': 5, 'mid_dec': 9, 'eval': 4.62},
    {'uid_dec': 5, 'mid_dec': 10, 'eval': 3.96},
    {'uid_dec': 5, 'mid_dec': 11, 'eval': 2.23}
]

train_ds = spark.createDataFrame(ratings_l)

conv_train = make_spark_converter(train_ds)

Get three batches from the same converter(hoping they are the same):
epochs = 4
batch_size = 6
with conv_train.make_tf_dataset(batch_size=batch_size, num_epochs=epochs, seed=1) as train, \
     conv_train.make_tf_dataset(batch_size=batch_size, num_epochs=epochs, seed=1) as train1, \
     conv_train.make_tf_dataset(batch_size=batch_size, num_epochs=epochs, seed=1) as train2:
     epoch_eval = True
     for i, (b, b1, b2) in enumerate(zip(train, train1, train2)):
        if i%(36//batch_size) == 0:
            print('==========Epoch==========: {0}'.format(i//(36//batch_size)))
        print('==========Group of Batches  {}:'.format(i%(36//batch_size)))
        print(b[0].numpy())
        print(b1[0].numpy())
        print(b2[0].numpy())

This is the output:
==========Epoch==========: 0
==========Group of Batches 0:
[2.   2.9  4.74 2.5  2.18 4.93]
[2.18 3.83 3.94 4.31 4.48 3.74]
[2.   2.9  4.74 2.5  2.18 4.93]
==========Group of Batches  1:
[4.46 2.23 4.42 4.67 2.65 2.11]
[3.21 2.05 2.24 2.08 4.94 4.22]
[4.46 2.23 4.42 4.67 2.65 2.11]
==========Group of Batches 2:
[2.31 2.69 2.41 4.62 3.96 2.23]
[3.52 2.67 2.69 2.75 4.93 2.9 ]
[2.31 2.69 2.41 4.62 3.96 2.23]
==========Group of Batches 3:
[2.18 3.83 3.94 4.31 4.48 3.74]
[2.18 3.83 3.94 4.31 4.48 3.74]
[2.18 3.83 3.94 4.31 4.48 3.74]
==========Group of Batches 4:
[3.21 2.05 2.24 2.08 4.94 4.22]
[3.21 2.05 2.24 2.08 4.94 4.22]
[3.21 2.05 2.24 2.08 4.94 4.22]
==========Group of Batches 5:
[3.52 2.67 2.69 2.75 4.93 2.9 ]
[3.52 2.67 2.69 2.75 4.93 2.9 ]
[3.52 2.67 2.69 2.75 4.93 2.9 ]
==========Epoch==========: 1
==========Group of Batches 0:
[2.18 3.83 3.94 4.31 4.48 3.74]
[2.   2.9  4.74 2.5  2.18 4.93]
[2.18 3.83 3.94 4.31 4.48 3.74]
==========Group of Batches 1:
[3.21 2.05 2.24 2.08 4.94 4.22]
[4.46 2.23 4.42 4.67 2.65 2.11]
[3.21 2.05 2.24 2.08 4.94 4.22]
==========Group of Batches 2:
[3.52 2.67 2.69 2.75 4.93 2.9 ]
[2.31 2.69 2.41 4.62 3.96 2.23]
[3.52 2.67 2.69 2.75 4.93 2.9 ]
==========Group of Batches 3:
[2.   2.9  4.74 2.5  2.18 4.93]
[2.   2.9  4.74 2.5  2.18 4.93]
[2.   2.9  4.74 2.5  2.18 4.93]
==========Group of Batches 4:
[4.46 2.23 4.42 4.67 2.65 2.11]
[4.46 2.23 4.42 4.67 2.65 2.11]
[4.46 2.23 4.42 4.67 2.65 2.11]
==========Group of Batches 5:
[2.31 2.69 2.41 4.62 3.96 2.23]
[2.31 2.69 2.41 4.62 3.96 2.23]
[2.31 2.69 2.41 4.62 3.96 2.23]

The question is: Why in some groups the batched are differen, for example in the Epoch1, Group of Batches2 ?.
The expected behavior is that all batches be always the same like in Epoch 1, Group of Batches3,4 and 5.

It's likely due to a race before workers. We currently don't have a reordering buffer after the reader (that launches multiple threads or processes to parallelize the work). To test this hypothesis, please pass workers_count=1 to the make_tf_dataset call.
Obviously make_tf_dataset=1 will cause a degradation in the reading speed.
I am not sure I understand though, why do you use three different dataset instances to read different columns? i.e. what prevents you from doing something like this?
with conv_train.make_tf_dataset(batch_size=batch_size, num_epochs=epochs, seed=1) as train:
     epoch_eval = True
     for i, b, in enumerate(train):
        # b should have all three fields: uid_dec, mid_dec and eval...

I´m not trying to read different columns. What I want is to make different transformations over each batch, but I need to make these transformations over the same data, thats why im trying to get three identical batches, in fact, that´s why Im calling make_tf_dataset three times over the same dataset, in each make_tf_dataset call I need to pass a different TransformSpec object.
Could I achieve the desired result in another way?
Thanks for your attention


Should have a test suite

Ideally, there should be a test suite for this gem.
It should at minimum test:

Swift generation
Objective-C generation
All generated code types (view controllers, segues, etc.)

Fixed by commit 8e9481. Still needs improvement!
Currently tests:

Swift support
Objective-C support
Single storyboard, multiple view controllers (and types)
Generic UIViewControllers, special (UINavigationController), and custom-casted (DetailViewController)


Redshift: Set Rendersettings actually apply multilayer_exr and force_combine

Changelog Description
Fix applying of Force combine beauty and AOVs into a single file and Multipart EXR in Redshift Rendersettings from settings defined in AYON settings.
Additional info
The settings already existed but seemed to have been used nowhere - even back in OpenPype.
Note: There has been some discussion that Multilayer is not the same as Multipart so either the settings name and label is wrong, or we're setting the wrong attribute here? Any clue @m-u-r-p-h-y @antirotor ?
Testing notes:

Change settings

ayon+settings://maya/render_settings/redshift_renderer/multilayer_exr
ayon+settings://maya/render_settings/redshift_renderer/force_combine

Launch Maya, set redshift as renderer.
Click "AYON > Set Render Settings" in menu in Maya
The Redshift render settings should now have been updated.

regarding the multilayer and multipart this is the way I understand the RS settings

Force combine beauty and AOVs into single file = multilayer
Multipart EXR = multipart

it only works partially for me. The attributes from Common section of Render Globals are set correctly but other attributes are untouched

Should be fixed - it seems updated in recent Redshift versions, so I've justed matched it. Tested with Maya 2024.2 and Redshift 3.6.03.

@m-u-r-p-h-y you'd need to build and redeploy the addon for updated settings, yes.

@m-u-r-p-h-y you'd need to build and redeploy the addon for updated settings, yes.
will do

If still not working - what Maya version and Redshift version are you using?

M2025.1
RS3.6.04

M2025.1
RS3.6.04

Just to be sure - you did try with a re-uploaded addon package @m-u-r-p-h-y ?


journal number, from string to number

Found by community member: https://github.com/XeroAPI/xero-node/issues/412
A deserialization is being effected for node sdk.. I can fix in the SDK itself, but this seems like an API wide type fix that should propagate through all sdks?

WIP

I've verified the fix in node. Will check Ruby on Monday - want to double check and see if this is deserializing correctly in java/net the way it is now ( string, not number )

Ah - thats what I was looking for. Theres no decimal places. I'll re work this / test through and can go through during Hero mtg.

@SerKnight - i've change the JournalNumber to an integer and will merge this PR.


[DOCFIX] Wrap the paragraph of

A follow-up PR to https://github.com/Alluxio/alluxio/pull/4566#issuecomment-270758071 to update the style.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-Pull-Request-Builder/12936/
Test PASSed.


Probably a typo

On the page 130 (Chapter 17.5), instead of
"The subproof started on line 3 is still open at line 3."
there should be the sentence
"The subproof started on line 3 is still open at line 5."
(The sub-subproof is still open at line 5, which is the problem being refered to in that paragraph.)

fixed in https://github.com/rzach/forallx-yyc/commit/034ff3de5f79708339a389beb32bd8cd1604052b; thanks!


Marjan/m5ops

Done! Let me know if it needs more work

Marking this as closed as I manually rebased and pushed it :).
Thanks for getting this together!


Capybara spec is stuck with Ruby 2.7.0

What Ruby, Rails and RSpec versions are you using?
Ruby version: 2.7.0
Rails version: <IP_ADDRESS>
RSpec version: 4.0.0.beta3 (doesn't work for 4.0.0.beta4 as well)
Observed behaviour
I have a problem that rspec process is stuck when runs capybara spec with some specific case.
f.e.
RSpec.describe 'Test', type: :feature, js: true do
  subject { page }
  let(:teacher) { create :user }
  let(:article) { create :article }

  before { login_as(teacher, scope: :user, run_callbacks: false) }

  # pass
  context 'when visit root' do
   before do
      article.destroy
      visit root_path
   end

   it { expect(subject).to have_text('Hello user') }
  end

  # freeze
  context 'when visit root' do
   before do
      visit root_path
      article.destroy
   end

   it { expect(subject).to have_text('Hello user') }
  end
end

as I've found, that very important that object destroyed/created before visit.
It does work with Ruby 2.6.5.

Just a random thought - can you try against master rspec-rails, there are 115 commits since 4.0.0.beta4.

You might want to take a look in your test log, this is more likely a rails issue than an rspec-rails one

@JonRowe could be a rails problem, in logs nothing helpful, just lats command with object destroy

@pirj thanks for advice, but result the same

Wondering at which stage it hangs.
Can you put breakpoints here and there to figure this out?
# freeze
context 'when visit root' do
  it do
    visit root_path
    article.destroy
    expect(subject).to have_text('Hello user')
  end
end

If it hangs on subject, mind setting up breakpoints in your controller?

Ping

@pirj sorry for delay
I've investigated a little bit and what I found:

my case a little bit complex than I explain from the beginning
I have SPA and load some data on demand
it doesn't freeze on initial controller action
it does freeze on processing XHR request afterwards
if I add any sleep (wait precessing of all requests from the page) before destroy, like

context 'when visit root' do
  it do
    visit root_path
    sleep 1
    article.destroy
    expect(subject).to have_text('Hello user')
  end
end

it does work as well

Freezing is still a strange problem.
What is the default waiting time in your configuration?
Just to confirm that it's Capybara stuck in endless wait: if you Ctrl-C that process, does it show its backtrace?
Is "Hello user" text delivered with root_path load, or with an XHR request?

Capybara.default_max_wait_time = 10
yes, it stuck forever, if press Ctrl-C it doesn't have any backtrace
doesn't really matter where the Hello user is

I'm afraid we've left with two options here, one is to use sleep 1 which doesn't seem too reliable in the long run, and to debug it deeper.
Can you drop a binding.pry (install pry-byebug) breakpoint somewhere before have_text (without sleep 1), wait for a second and then Ctrl-D? Wondering if it will still hang.
If it will, change it to:
- expect(subject).to have_text('Hello user')
+ page.has_text?('Hello user) # this is the usual suspect, removing `subject` to avoid doing extra steps

run step in pry to dive into page's has_text? method.
Use step/next (and help if you need to) to get to the point where it hangs.
Please share your results.

I mean if a sleep fixes it I'm wondering if its a deadlocking issue in a thread somewhere, if you add a timeout to the spec:
context 'when visit root' do
  around do |example|
    Timeout.timeout(15) do
      example.call
    end
  end

  it do
   # your spec
  end
end

It should stop it freezing, and the backtrace from the error should reveal where its stuck...

Please feel free to reopen if you are still experiencing the problem.
If you happened to solve it, please share your solution.


Error when running the tool on Kali Linux 2019.01

./osmedeus.py -m subdomain -t <target.com>                                                                         1 ↵
                   `@@`
                  @@@@@@
                .@@`  `@@.
                :@      @:
                :@  :@  @:
                :@  :@  @:
                :@      @:
                `@@.  .@@`
                  @@@@@@
                    @@
                 @  @@  @
                +@@ @@ @@+
             @@:@#@,@@,@#@:@@
            ;@+@@`#@@@@#`@@+@;
            @+ #@@@@@@@@@@# +@
           @@  @+`@@@@@@`+@  @@
           @.  @   ;@@;   @  .@
          #@  '@          @;  @#

         Osmedeus v1.0 by @j3ssiejjj

                ¯\_(ツ)_/¯

[*] Config file detected: core/config.conf
--~~~=:>[ Staarting Flask API ]>
[-] Something wrong to connect to {0}
Traceback (most recent call last):
File "/root/PenTest/OSINT/Osmedeus/core/config.py", line 136, in parsing_config
ip = socket.gethostbyname(strip_target)
socket.gaierror: [Errno -2] Name or service not known
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "./osmedeus.py", line 151, in
main()
File "./osmedeus.py", line 147, in main
parsing_argument(args)
File "./osmedeus.py", line 50, in parsing_argument
options = config.parsing_config(config_path, args)
File "/root/PenTest/OSINT/Osmedeus/core/config.py", line 139, in parsing_config
utils.print_bad("Something wrong to connect to {0}").format(target)
AttributeError: 'NoneType' object has no attribute 'format'

Serving Flask app "app" (lazy loading)
Environment: production
WARNING: Do not use the development server in a production environment.
Use a production WSGI server instead.
Debug mode: on
Running on http://<IP_ADDRESS>:5000/ (Press CTRL+C to quit)
Traceback (most recent call last):
File "core/app.py", line 238, in
app.run(debug=True)  # important to mention debug=True
File "/usr/local/lib/python3.7/dist-packages/flask/app.py", line 943, in run
run_simple(host, port, self, **options)
File "/usr/local/lib/python3.7/dist-packages/werkzeug/serving.py", line 812, in run_simple
reloader_type)
File "/usr/local/lib/python3.7/dist-packages/werkzeug/_reloader.py", line 266, in run_with_reloader
reloader = reloader_loops[reloader_type](extra_files, interval)
File "/usr/local/lib/python3.7/dist-packages/werkzeug/_reloader.py", line 171, in init
from watchdog.observers import Observer
ImportError: cannot import name 'Observer' from 'watchdog.observers' (unknown location)

My bad typo when connection error to the target.
It's should be fixed now.

Hi,
Still getting the error when attempting to use the tool.

[*] Config file detected: core/config.conf
--~~~=:>[ Staarting Flask API ]>

Serving Flask app "app" (lazy loading)
Environment: production
WARNING: Do not use the development server in a production environment.
Use a production WSGI server instead.
Debug mode: on
Running on http://<IP_ADDRESS>:5000/ (Press CTRL+C to quit)
Traceback (most recent call last):
File "core/app.py", line 238, in
app.run(debug=True)  # important to mention debug=True
File "/usr/local/lib/python3.7/dist-packages/flask/app.py", line 943, in run
run_simple(host, port, self, **options)
File "/usr/local/lib/python3.7/dist-packages/werkzeug/serving.py", line 812, in run_simple
reloader_type)
File "/usr/local/lib/python3.7/dist-packages/werkzeug/_reloader.py", line 266, in run_with_reloader
reloader = reloader_loops[reloader_type](extra_files, interval)
File "/usr/local/lib/python3.7/dist-packages/werkzeug/_reloader.py", line 171, in init
from watchdog.observers import Observer
ImportError: cannot import name 'Observer' from 'watchdog.observers' (unknown location)
[+] Make new workspace: /root/PenTest/OSINT/Osmedeus/workspaces/target.com
Traceback (most recent call last):
File "/usr/local/lib/python3.7/dist-packages/urllib3/connection.py", line 171, in _new_conn
(self._dns_host, self.port), self.timeout, **extra_kw)
File "/usr/local/lib/python3.7/dist-packages/urllib3/util/connection.py", line 79, in create_connection
raise err
File "/usr/local/lib/python3.7/dist-packages/urllib3/util/connection.py", line 69, in create_connection
sock.connect(sa)
ConnectionRefusedError: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
chunked=chunked)
File "/usr/local/lib/python3.7/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
conn.request(method, url, **httplib_request_kw)
File "/usr/lib/python3.7/http/client.py", line 1229, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/usr/lib/python3.7/http/client.py", line 1275, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "/usr/lib/python3.7/http/client.py", line 1224, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/usr/lib/python3.7/http/client.py", line 1016, in _send_output
self.send(msg)
File "/usr/lib/python3.7/http/client.py", line 956, in send
self.connect()
File "/usr/local/lib/python3.7/dist-packages/urllib3/connection.py", line 196, in connect
conn = self._new_conn()
File "/usr/local/lib/python3.7/dist-packages/urllib3/connection.py", line 180, in _new_conn
self, "Failed to establish a new connection: %s" % e)
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f2d9ff10978>: Failed to establish a new connection: [Errno 111] Connection refused
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/dist-packages/requests/adapters.py", line 445, in send
timeout=timeout
File "/usr/local/lib/python3.7/dist-packages/urllib3/connectionpool.py", line 638, in urlopen
_stacktrace=sys.exc_info()[2])
File "/usr/local/lib/python3.7/dist-packages/urllib3/util/retry.py", line 398, in increment
raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='<IP_ADDRESS>', port=5000): Max retries exceeded with url: /config (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2d9ff10978>: Failed to establish a new connection: [Errno 111] Connection refused'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "./osmedeus.py", line 151, in
main()
File "./osmedeus.py", line 147, in main
parsing_argument(args)
File "./osmedeus.py", line 54, in parsing_argument
utils.set_config(options)
File "/root/PenTest/OSINT/Osmedeus/core/utils.py", line 135, in set_config
r = requests.post(url, headers=headers, json=data)
File "/usr/local/lib/python3.7/dist-packages/requests/api.py", line 112, in post
return request('post', url, data=data, json=json, **kwargs)
File "/usr/local/lib/python3.7/dist-packages/requests/api.py", line 58, in request
return session.request(method=method, url=url, **kwargs)
File "/usr/local/lib/python3.7/dist-packages/requests/sessions.py", line 512, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.7/dist-packages/requests/sessions.py", line 622, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.7/dist-packages/requests/adapters.py", line 513, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPConnectionPool(host='<IP_ADDRESS>', port=5000): Max retries exceeded with url: /config (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2d9ff10978>: Failed to establish a new connection: [Errno 111] Connection refused'))

Look like requests library is missing from your OS.
So you may wanna check this out Install Guide

I've verified both pip and python requests library is installed. Still reinstalled it, but still getting the same error.
This was working fine till sometime in Feb'19. Not sure of what had broken this... I've tried a fresh clone and install process, but in vain.

Apparently, did a fresh VM and installed the tool. The tool worked without any issues...any suggestion on how to resolve this on the current setup shall be really great.
Thanks

yeah just DM @j3ssiejjj


Performance issues on a large (120724) location dataset

Hello cell2location devs,
I am working with a large visium dataset (12240 features, 120724 locations), and am running into issues when it comes to training the cell2location.models.Cell2location model. The specific issue is very simple, it's just too slow. I was getting a speed of about 10 seconds per iteration, and across 30000 iterations I was hitting estamated completion times of about 80 hours. I am running in GPU mode, and throwing additional a40 cores at the issue didn't seem to improve speed, I was using 8 with my latest run. I also tried batching the data so each batch was about 30,000 cells, which also didn't improve speed.
Do you have any advice for me? I would be greatly appreciative, as I have used this package before on a smaller dataset to great success, and it was done training in only a few hours.
sincerely,
Dillon Brownell

Hi @Dillon214
Exciting data you have. Please have a look at this issue for practical suggestions about working with large data https://github.com/BayraktarLab/cell2location/issues/356
We find the best performance when training cell2location with batch size equal to full data. This limits batch size by GPU memory. Roughly 18k genes * 60k locations for 80GB A100.
Are you using batch_size=None?

getting a speed of about 10 seconds per iteration

This is very slow. Could you confirm that the GPU is used?

throwing additional a40 cores at the issue didn't seem to improve speed, I was using 8 with my latest run

Cell2location doesn't support using multiple GPUs - only one GPU was used.

it was done training in only a few hours

This sounds expected.

Hi Viktl,
Thanks for the speedy reply. And no, I was adjusting the batch_size argument to avoid out of memory errors. I'm no expert, but I'm guessing the size of the dataset exceeds the memory capacity of a single GPU. And yes, I can confirm that a GPU is being used. See attached image.
Based on the suggestions in the issue you posted, it seems like splitting the dataset into chunks, stratified by batch and other relevant variables perhaps, is a good idea for evading slowdown issues. Do you still reccomend this? I tested this a bit, and it seemed to speed up processing dramatically. I suppose afterwards the results can be re-merged.
-Dillon

Using batch_size other than batch_size=None is indeed expected to take between many days and more than a week (10 seconds per epoch is pretty fast). More importantly, training with batch_size equal to full data gives higher accuracy - so we don't recommend using minibatch training.

it seems like splitting the dataset into chunks, stratified by batch and other relevant variables perhaps, is a good idea for evading slowdown issues. Do you still reccomend this?

Yes but you also need to set batch_size=None.

Hi Vitkl,
I followed the code you posted in that other thread for subsetting and individually processing multiple objects, and experienced much better training times.
One final question: say I want to now compute expected expression per cell type, as was done in the tutorial pictured below and at the following link: https://cell2location.readthedocs.io/en/latest/notebooks/cell2location_tutorial.html#Estimate-cell-type-specific-expression-of-every-gene-in-the-spatial-data-(needed-for-NCEM).
Would it be fine to perform this process for each individually processed object, then merge the results, or do you think a different approach should be taken?
-Dillon


not working with nodejs Buffer

const obj = { name: "abc" }
const res = lzwcompress.pack(obj)
const buffer = Buffer.from(res)

The value of res is [
123, 34, 95, 95, 107, 34, 58, 91, 34, 110, 97, 109, 101, 34, 93, 44, 257, 95, 118, 261, 256,
48, 261, 34, 97, 98, 99, 34, 125, 125
] while the value of buffer is {
"type": "Buffer",
"data":  [
123, 34, 95, 95, 107, 34, 58, 91, 34, 110, 97, 109, 101, 34, 93, 44,     1, 95, 118,     5,     0,
48,    5, 34, 97, 98, 99, 34, 125, 125
]
}.

This way of using the library is not supported - please check out the documentation to see how this library can be used.


translating admonitions

Thanks a lot for working on this project!
I have a documentation with multiple languages and I was looking for a way to translate admonitions.
I wasn't sure how should I add a test for it, whether to add an admonition into tests/docs_*_two_languages or should I create a separate testing doc?

Thanks for this amazing work @michalfapso
I'd rather you add tests to a separate tree so that it's strictly related to the feature and easier to cope with
Please rebase

Sure, now I've pushed a rebased commit with tests included.

@michalfapso I forgot to ask sorry but could you share a rationale of the problem you're trying to solve with an example as to why it's not possible currently?

Sure, @ultrabug, I have a documentation in English with quite a lot of admonitions. Then I have auto-translated it to several other languages which would be later manually corrected by a community. I'm using the material theme and your static-i18n plugin for it.
When I have !!! tip in my English documentation it gets rendered as "Tip" (as seen here: https://squidfunk.github.io/mkdocs-material/reference/admonitions/#supported-types). To translate it to another language I can write !!! tip "Conseil" which replaces the admonition title with "Conseil", but I would prefer to have a translation map for each admonition type so that its translated across the whole documentation consistently.
I could have written a separate script just to post process all markdown files and to add the translation of admonition titles directly to them, but I prefer not having those translations hard coded in all markdowns.
I already have some strings translated via nav_translations, so I find it convenient to have the proposed admonition_tranlstations right beside it in the mkdocs.yml.
Here are some related requests:
https://github.com/squidfunk/mkdocs-material/discussions/4599
https://github.com/squidfunk/mkdocs-material/issues/749

Makes sense and I'm honored that the plugin could help people find a solution to a 2018 problem :+1: thanks
Please check my comments

Thanks for your comments, @ultrabug. I've tried to apply them in a new commit.
Do you prefer having separate commits of these subsequent changes or should I rebase and keep it in a single commit?

Do you prefer having separate commits of these subsequent changes or should I rebase and keep it in a single commit?

Rebase please, or I'll squash & merge np

Almost there!

All green, one final review and we should be good to go

Thanks and congratulations again @michalfapso

Thanks a lot, @ultrabug! It was my pleasure :)


EventSubscriber

Hey,
IntelliSense does not suggest anything usefull when completing the EventSubscriber Syntax.
I'd like some more information on how to form the [EventSubscriber] syntax.
We get [EventSubscriber(ObjectType::ObjectType, ObjectId, OnSomeEvent, ElementName, SkipOnMissingLicense, SkipOnMissingPermission)].
However, I've tried everything for the OnSomeEvent parameter but none seem to work. Also not sure what ElementName should refer to.
My code:
[EventSubscriber(ObjectType::Table, 18,OnAfterInsertEvent,'',TRUE,TRUE)]
OR
[EventSubscriber(ObjectType::Table, 18,OnAfterInsertEvent(VAR Rec : Record Customer; RunTrigger : Boolean),'',TRUE,TRUE)]

We are actively working on implementing InelliSense for this scenario.
In the meanwhile the syntax to use in this case is:
[EventSubscriber(ObjectType::Table, 18, 'OnAfterInsertEvent', '', true, true)]
Element name is either blank in case of events defined on the objects itself or a field/action name in case of events defined on these elements


Use standart importlib instead of django.utils.importlib

https://docs.djangoproject.com/en/1.9/releases/1.9/#features-removed-in-1-9

Features removed in 1.9

django.utils.importlib is removed.

@kulikov I think the original author has abandoned this repo. I have an actively maintained fork at: https://github.com/alsoicode/django-medusa. If you'd like to submit a PR there, I'll be happy to merge it with a few minor changes as to not break backward compatibility with Django < 1.9


Please push semantic version tag

This package turns out to be a dependency of https://github.com/ipfs/go-ipfs. I am in the process of packaging IPFS for Gentoo where we prefer to build our software from source when we install it. Thus I am also packaging this project and would kindly like to ask you to push a semantic version tag, which makes things a lot easier for me.

ping

https://help.github.com/articles/creating-releases/

Having similar problem with homebrew for Mac

@baccenfutter Now that Go 1.6 supports vendoring out of the box, what about using that for ipfs instead of Godep and a semantic version number?

The dep tool, which is intended to be folded into the official Go tooling in the future, also uses semver. I think adopting semver is worthwhile.

@mitchellh as above could you please tag this repo.

Oh, 16 days ago the tag v1.0.0 has been published, so we can probably close this issue.

Yes, sorry for this, but I was waiting for official reasons to use tagging and seeing what the official Go policy would be. This was done as soon as gomod was announced.


support Private DNS View and Zone

reference implementation

Hi @chanstev, the module does support private DNS views and zones. See
https://github.com/oci-landing-zones/terraform-oci-modules-networking/blob/main/variables.tf#L225
and
https://github.com/oci-landing-zones/terraform-oci-modules-networking/blob/main/dns.tf


put semantics: hstore

a put should replace any existing k,v pairs that match. If the new put is a different size, then the object should be reallocated.  If the new put is the same size, then it should be updated in place.

commit 8580271 should add this behavior.


PORTALS-3025: cheap solution for card-based top 10 projects

See the associated ticket for discussion and screenshots (during implementation):  https://sagebionetworks.jira.com/browse/PORTALS-3025


[sqllogictest] port tests in avro.rs to sqllogictest

Which issue does this PR close?

Closes #6299
Rationale for this change

#6195
What changes are included in this PR?

Port the Rust unit tests from avro.rs, excluding avro_query_multiple_files, to sqllogictest.
Are these changes tested?

yes.
Are there any user-facing changes?

This PR was failing on CI: https://github.com/apache/arrow-datafusion/actions/runs/5010297388/jobs/8991828477 -- I pushed some fixes for cargo fmt and the hash collisions failures. Hopefully the tests pass this time

Thanks again @e1ijah1


undefined reference to google::LogSink::ToString

ubuntu version. 18.04.5 LTS
ros version: melodic
The error in building cartographer_ros:
/home/rztech/carto_ws/devel_isolated/cartographer_ros/lib/libcartographer_ros.a(ros_log_sink.cc.o): In function cartographer_ros::ScopedRosLogSink::send(int, char const*, char const*, int, tm const*, char const*, unsigned long)': ros_log_sink.cc:(.text+0x167): undefined reference to google::LogSink::ToString[abi:cxx11](int, char const*, int, tm const*, char const*, unsigned long, int)'
collect2: error: ld returned 1 exit status
ninja: build stopped: subcommand failed.
<== Failed to process package 'cartographer_ros':
The instruction is : https://google-cartographer-ros.readthedocs.io/en/latest/compilation.html#building-installation
In the ubuntu 20.04 LTS, All works well.
Any advices? THX a lot.

solved. I install it in a new computer and all work well.


Update project_precommit_check's 4.2 swiftlang version

Pull Request Description
This updates project_precommit_check to check 4.2 against the swift version that ships with Xcode 10 Beta 3. It also relaxes the version check so it won't fail if the Target information is slightly different.

@swift-ci test


[SPARK-19876][SS][WIP] OneTime Trigger Executor

What changes were proposed in this pull request?
An additional trigger and trigger executor that will execute a single trigger only. One can use this OneTime trigger to have more control over the scheduling of triggers.
In addition, this patch requires an optimization to StreamExecution that logs a commit record at the end of successfully processing a batch. This new commit log will be used to determine the next batch (offsets) to process after a restart, instead of using the offset log itself to determine what batch to process next after restart; using the offset log to determine this would process the previously logged batch, always, thus not permitting a OneTime trigger feature.
How was this patch tested?
A number of existing tests have been revised. These tests all assumed that when restarting a stream, the last batch in the offset log is to be re-processed. Given that we now have a commit log that will tell us if that last batch was processed successfully, the results/assumptions of those tests needed to be revised accordingly.
In addition, a OneTime trigger test was added to StreamingQuerySuite, which tests:

The semantics of OneTime trigger (i.e., on start, execute a single batch, then stop).
The case when the commit log was not able to successfully log the completion of a batch before restart, which would mean that we should fall back to what's in the offset log.
A OneTime trigger execution that results in an exception being thrown.

@marmbrus @tdas @zsxwing
Please review http://spark.apache.org/contributing.html before opening a pull request.

Test build #74231 has started for PR 17219 at commit 682eb1a.

Test build #74231 has finished for PR 17219 at commit 682eb1a.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
case class OneTimeExecutor() extends TriggerExecutor

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74231/
Test FAILed.

Merged build finished. Test FAILed.

Test build #74282 has started for PR 17219 at commit a129dd5.

Test build #74282 has finished for PR 17219 at commit a129dd5.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
case class OneTime() extends Trigger

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74282/
Test FAILed.

Test build #74328 has started for PR 17219 at commit b4ef029.

Test build #74328 has finished for PR 17219 at commit b4ef029.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74328/
Test FAILed.

Test build #74333 has started for PR 17219 at commit 7cb43b7.

Test build #74333 has finished for PR 17219 at commit 7cb43b7.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74333/
Test FAILed.

Test build #74347 has started for PR 17219 at commit 98812cb.

Test build #74347 has finished for PR 17219 at commit 98812cb.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74347/
Test PASSed.

Test build #74365 has started for PR 17219 at commit 8c5b84f.

Test build #74365 has finished for PR 17219 at commit 8c5b84f.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74365/
Test FAILed.

Test build #74465 has started for PR 17219 at commit 573ec98.

Test build #74465 has finished for PR 17219 at commit 573ec98.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74465/
Test PASSed.

also remove the WIP from the title.

Test build #74766 has started for PR 17219 at commit 5d2ba62.

Test build #74767 has started for PR 17219 at commit 2989fad.

Test build #74766 has finished for PR 17219 at commit 5d2ba62.

This patch fails Spark unit tests.
This patch does not merge cleanly.
This patch adds no public classes.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74766/
Test FAILed.

Build finished. Test FAILed.

Test build #74767 has finished for PR 17219 at commit 2989fad.

This patch fails Spark unit tests.
This patch does not merge cleanly.
This patch adds no public classes.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74767/
Test FAILed.

Build finished. Test FAILed.

Test build #74786 has started for PR 17219 at commit fd28ed7.

Test build #74786 has finished for PR 17219 at commit fd28ed7.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74786/
Test PASSed.

Merged build finished. Test PASSed.

Test build #74914 has started for PR 17219 at commit 83db3b8.

Test build #74914 has finished for PR 17219 at commit 83db3b8.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74914/
Test FAILed.

Test build #75037 has started for PR 17219 at commit d7c5edf.

Test build #75037 has finished for PR 17219 at commit d7c5edf.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75037/
Test PASSed.

Merged build finished. Test PASSed.

Test build #75045 has started for PR 17219 at commit ae92ec6.

Test build #75045 has finished for PR 17219 at commit ae92ec6.

This patch fails PySpark unit tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
class OneTime(Trigger):

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75045/
Test FAILed.

Merged build finished. Test FAILed.

Test build #75074 has started for PR 17219 at commit 64cd233.

Test build #75074 has finished for PR 17219 at commit 64cd233.

This patch fails RAT tests.
This patch merges cleanly.
This patch adds no public classes.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75074/
Test FAILed.

Merged build finished. Test FAILed.

Test build #75077 has started for PR 17219 at commit f928ade.

Test build #75077 has finished for PR 17219 at commit f928ade.

This patch fails Python style tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75077/
Test FAILed.

Test build #75080 has started for PR 17219 at commit 0925965.

Test build #75080 has finished for PR 17219 at commit 0925965.

This patch fails MiMa tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75080/
Test FAILed.

Test build #75086 has started for PR 17219 at commit db5ae3f.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75086/
Test FAILed.

Merged build finished. Test FAILed.

Jenkins test this please

Test build #3607 has started for PR 17219 at commit db5ae3f.

Test build #75091 has started for PR 17219 at commit db5ae3f.

Test build #3607 has finished for PR 17219 at commit db5ae3f.

This patch fails PySpark unit tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
public class Trigger

Test build #75091 has finished for PR 17219 at commit db5ae3f.

This patch fails PySpark unit tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
public class Trigger

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75091/
Test FAILed.

Merged build finished. Test FAILed.

Test build #75108 has started for PR 17219 at commit 0c3e20c.

Test build #75108 has finished for PR 17219 at commit 0c3e20c.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75108/
Test PASSed.

Seems like this broke the 2.10 builds:
spark-master-compile-maven-scala-2.10 #3992
spark-master-compile-sbt-scala-2.10 #4077


Write to a networkfile

Question
Dir Sir or Madam,
I want to write on a file into a Network Directory. With the given XML-file, NLog will not produce a log-file, but i have read/write access to this folder. How should i create the XML-file to solve the Network writing problem?
Friendly regards
Frank
NLog version: 4.03
Platform:   .Net 4.5
Current NLog config (xml or C#, if relevant)
<nlog>
<targets>
   	<target name="NetworkFile" xsi:type="File"
            layout="${level} ${longdate} ${logger} ${message}"
            fileName="//<IP_ADDRESS>/Logging/log.txt"
			archiveFileName="//<IP_ADDRESS>/Logging/log_{#}.txt"
            archiveEvery="Day"
            archiveNumbering="Date"
            maxArchiveFiles="7"
            concurrentWrites="true"
            keepFileOpen="false"
            encoding="iso-8859-2" />
</Targets>
     <rules>
    <logger name="*" minlevel="Trace" writeTo="NetworkFile"/>
  </rules>
</nlog>

Please check https://github.com/NLog/NLog/wiki/Logging-troubleshooting


Arrow function syntax highlight error

I'm writing unit tests with avajs, and the highlight is not quite working for arrow functions.
It just happens if I have this other arrow function call inside the test.

I'm using OceanicNext color scheme
henriquehirako:~/ $ vim -version                                                                                [10:33:26]
VIM - Vi IMproved 8.0 (2016 Sep 12, compiled Feb  6 2018 20:43:24)

My dotfiles: http://github.com/henriquehirako/dotfiles
Thanks!

This is a conflict by Plugin 'crusoexia/vim-javascript-lib' and yajs.

I have add tape support to https://github.com/othree/javascript-libraries-syntax.vim .
You can switch to it for temp solution.
I will add avajs support later

Awesome, thanks!!


Broken link for SummEval

Check the first column: https://tabilab.cmpe.boun.edu.tr/BIOSSES/DataSet.html

Hmm for SummEval the link should probably be https://github.com/Yale-LILY/SummEval - Do you want to submit a PR?


Merge version 0.2.0 to main

Haven't heard any major problems with the version 0.2.0 from beta users. It seems to solve most of the problems from previous versions so merging to main branch.

Fixed #11 .


Load without errors in IE 9

This ports our fixes back into the Shaka source.
@ustudio/dev Can somebody review this, before I open a PR back to the upstream source?

Also, please read CONTRIBUTING and follow the instructions there.  You'll need to sign a license agreement and add yourself to AUTHORS & CONTRIBUTORS.  Thanks!

@joeyparrish Thanks for the feedback. WRT CONTRIBUTORS/AUTHORS, since I'm doing this for uStudio I need to wait for somebody else to agree to the Corporate CLA, so I left it out of the PR for now.
I actually intended to open this against our fork, so one of our other devs could review it, so you didn't have to deal with the fiddly stuff, but I guess GitHub doesn't allow that.

Sounds good on the CLA.  Just ping me when you're ready for me to take another look, and thanks for your contribution!

@joeyparrish Your comments should be addressed, other than the contributor stuff. I'll update those files and ping you again when we get that sorted out on our end.
Thanks again!

@joeyparrish We finally got the CLA taken care of, so I've pushed the new AUTHORS and CONTRIBUTORS file, so it should be GTG.

If you can fix the quoted console['assert'] and change support.js's double quotes to single quotes, everything else looks good to me.  Thanks!

I spoke too soon.  You'll also need to fix the errors reported by the compiler & linter.  Just run ./build/all.sh to see them:
./build/all.sh
0 error(s), 0 warning(s), 98.1% typed
----- FILE  :  /var/lib/jenkins/jobs/Shaka Player GitHub PR Build/workspace/lib/debug/asserts.js -----
Line 46, E:0220: No docs found for member 'shaka.asserts.patchAssert_'
Line 55, E:0011: Missing semicolon after function assigned to a variable
----- FILE  :  /var/lib/jenkins/jobs/Shaka Player GitHub PR Build/workspace/lib/debug/log.js -----
Line 72, E:0220: No docs found for member 'shaka.log.patchConsole_'
Line 82, E:0011: Missing semicolon after function assigned to a variable
Found 4 errors, including 0 new errors, in 2 files (107 files OK).

@joeyparrish Sorry about all the back and forth, but hopefully I have it all fixed now.

Looks great, just one small tweak.

Ok, @joeyparrish I think I have it.

I'm so sorry.  I know closure is new for lots of people.  I meant that only @private is needed for a private function with no arguments and no return value.  We don't generally use @type for functions unless it's a callback.

@joeyparrish No problem; back to you.
http://i.imgur.com/8PJevlr.gif

Looks good to me.  I'm going to see if the CI system I'm experimenting with will pick this up and test it:  ok to test
If not, I'll give it a manual test run and merge later today.  Thanks for your hard work on this!

No problem; thanks for sticking with all the back and forth!

CI isn't working yet, but I ran the tests manually and everything's passing.  Thanks for the contribution!


Multiple font size

Hi !
How can i handle multiple font size ? I tried to load 2 fonts from the same TTF and with a different pixels size but it crash immediatly without any stacktrace but with exit code -1073740940 (0xC0000374).
I used this code to load fonts
var fontBytes = Constants.imguiFontPath.readBytes()
imguiDefaultFont = imgui.IO.fonts.addFontFromMemoryTTF(CharArray(fontBytes.size, { fontBytes[it].c }), 19f, FontConfig(), glyphRanges = imgui.IO.fonts.glyphRangesDefault)
imguiBigFont = imgui.IO.fonts.addFontFromMemoryTTF(CharArray(fontBytes.size, { fontBytes[it].c }),  30f, FontConfig(), glyphRanges = imgui.IO.fonts.glyphRangesDefault)

Is there any solution to have multiple font size with just one font ?
Thanks, Catvert.

Do you get a hs_err_pidxxxx file?

Oh yes : https://gist.github.com/Catvert/73054b2f6de3f1d6552d4ebfef6e6865 :)

This happens simply loading two fonts, same or different, for me. I'll look into fixes

It should be fixed now, there was an error in calculating some offsets

It's working ! Thanks :)


ClearScrollService.Do() method getting stuck

Please use the following questions as a guideline to help me answer
your issue/question without further inquiry. Thank you.
Which version of Elastic are you using?
[ ] elastic.v7 (for Elasticsearch 7.x)
[ ] elastic.v6 (for Elasticsearch 6.x)
[x] elastic.v5 (for Elasticsearch 5.x)
[ ] elastic.v3 (for Elasticsearch 2.x)
[ ] elastic.v2 (for Elasticsearch 1.x)
Please describe the expected behavior
Ideally the scroll should get cleared successfully.
Please describe the actual behavior
Based on log messages added in the program it was discovered that the ClearScrollService.Do() was getting stuck and control did not return from this function call.
Any steps to reproduce the behavior?
This problem does not occur during every run, but it occurs frequently. The following code is being used:

       esClient = elastic.NewClient(elastic.SetURL(url), elastic.SetMaxRetries(3), elastic.SetSniff(false), elastic.SetHealthcheck(requireHealthCheck), elastic.SetBasicAuth(username, password))
	scrollId := ""
	scroller := esClient.Scroll(Index).Size(100)

	if Type != "" {
		scroller = scroller.Type(Type)
	}

	if SortField != "" {
		scroller = scroller.Sort(SortField, !DescSort)
	}

	if Query != nil {
		kind := reflect.ValueOf(Query).Kind()
		var queryString string
		switch kind {
		case reflect.String:
			queryString = Query.(string)
		case reflect.Map:
			b, _ := json.Marshal(Query)
			queryString = string(b)
		}

		query := elastic.RawStringQuery(queryString)
		scroller = scroller.Scroll("15m").Query(query)
	}

	for {
		var results *elastic.SearchResult
		var esErr error

		if scrollId != "" {
			scroller = scroller.ScrollId(scrollId)
		}
		results, esErr = scroller.Do(context.Background())

		if esErr != nil {
			if esErr == io.EOF {
				break
			} else {
				return esErr
			}
		}

		scrollId = results.ScrollId

		for _, hit := range results.Hits.Hits {
			//process the hits
		}
	}
	esClient.ClearScroll(scrollId).Do(context.Background())
	return nil

Terminating and restarting the program usually solves the problem, but need to find the root cause of why it happens.

I'm sorry, I can't reproduce. I used this program and it worked fine:
$ ./scroll2 -index=warehouse -size=100
resp = &{Succeeded:true NumFreed:1}

It looks like you sometimes try to clear the scroll with an empty scrollId in the end. That is not necessary if the scrolling is complete. You also don't capture possible errors there, so maybe ES will give you a hint.
We don't clear scroll operations at all, even in production. It's never been a problem, and we have a big cluster with many scroll operations. But your mileage may vary.
Notice there is a recipe for using Scroll API that maybe of help.
HTH


adding support for string only parameter

This enables configuration based middleware to use your great library easier.  An example would be a kraken.js application where meddleware.js is used.  An example config using meddleware would be...
"apiProxy": {
    "enabled": true,
    "route": "/api",
    "module": {
        "name": "proxy-middleware",
        "arguments": [ "http://jsontest.com" ]
    }
}

+1

cool, released in 0.13.0


Fix: Handle missing home environment

Fixes #17.

@timothyej Thanks! Really good feedback.
Really needed to fix this issue so didn't focus on those things you mentioned. But they are good for the future so I incorporated them in a new PR :)
https://github.com/stormpath/stormpath-node-config/pull/19
Cheers! :beers:


Default domain for organization

Hello,
I have found a proposal for default domain endpoint for v3:
https://docs.google.com/document/d/1HbJU3zYwiMVveIh_I4rJFDf-1zd9DxUiwRm9FsaWe_s/edit#heading=h.z0mpx7u4lmtz
Than I tried to call the endpoint and I received the expected result:
cf curl /v3/organizations//domains/default
That is great!
However, this is not documented here:
https://v3-apidocs.cloudfoundry.org/version/3.76.0/index.html#list-domains-for-an-organization
Could you tell why this is not documented?
Option A: It is not official API
Option B: It is a gap in the documentation
Best Regards,
Boyan

https://v3-apidocs.cloudfoundry.org/version/3.76.0/index.html#get-default-domain

Thanks for pointing out the proper place