issue with def in nf-core nextflow.config

It got caught up in a loop, I was first a warning on the n of nextflow warning me about the def that should not be there.
If I apply the fix, then the warning is on the f of nextflow, saying that I need the def
and so on...
// Disable process selector warnings by default. Use debug profile to enable warnings.
nextflow.enable.configProcessNamesValidation = false

def trace_timestamp = new java.util.Date().format( 'yyyy-MM-dd_HH-mm-ss')

I think this is being addressed in the pipeline template: https://github.com/nf-core/tools/issues/3294

Thanks


Add CreateCSISnapshotAll, RestoreCSISnapshotAll and DeleteCSISnapshotAll functions

For datastores with multiple replicas, having the "All" alternatives for CreateCSISnapshot, RestoreCSISnapshot and DeleteCSISnapshot is useful in order to:

avoid phase duplication for each of the replicas
address use cases where the number of replicas for the datastore can change in Day 2. Without the "All" alternative, a blueprint update is required with each scale
have a single blueprint regardless of the setup of the datastore in various environments

We discussed in today's community meeting; the request is valid. However, the solution to multiply functions may not be the best way forward, a loop or an all argument could be considered.

@laurentiusoica Can we close this issue?
@viveksinghggits will also look for a loop example

CreateCSISnapshot just takes a PVC name right now. https://github.com/kanisterio/kanister/blob/master/pkg/function/create_csi_snapshot.go#L77
So, even if we passe multiple PVCs from the arg to CreateCSISnapshot the function would not be able to handle that properly. We will have to change the function in such a way that it can handle space separated PVC names.

Hi @laurentiusoica ,
Is this still relevant to you? Do you have use case to use this feature as soon as we add it, or you had a use case where  you thought it would be useful in future.

Without this APIs, is there a path forward for replicated services that could also dynamically scale at runtime ?

The only option right now would be to take application aware backup using database specific utilities for example mysqldump etc.


Update Haskell package set to LTS 15.3 (plus other fixes)

This PR is test-built by Hydra at https://hydra.nixos.org/jobset/nixpkgs/haskell-updates. I'll fix up the remaining errors and merge it on Friday, 2020-03-13 20:00 CET. You can watch this live on Twitch at https://www.twitch.tv/peti343.
TODO

[ ] Try running krank on our override files.
[ ] https://github.com/NixOS/docker/pull/13

@GrahamcOfBorg build cachix

Next week, we'll merge https://github.com/NixOS/nixpkgs/pull/82849.


Sorting variables

I don't think it is useful to sort variables alphabetically because it can bring up some serious problems.
Sass is read from top to bottom, so if variables are ordered in a new way it can cause errors like Undefined variable.
Example:
$gutter: 1.618;

$gu02: $gutter*0.2em;
$gu05: $gutter*0.5em;
$gu1:  $gutter*1em;
$gu2:  $gutter*2em;
$gu3:  $gutter*3em;
$gu4:  $gutter*4em;

should not be:
$gu1            : $gutter*1em;
$gu02           : $gutter*0.2em;
$gu2            : $gutter*2em;
$gu3            : $gutter*3em;
$gu4            : $gutter*4em;
$gu05           : $gutter*0.5em;
$gutter         : 1.618;
```

I'll leave this open, and if someone else agrees I'll remove it.

Variable sorting is gone.


sapcpsdk-proxygenerator Code compilation failed

I am starting learning the new SDK for iOS but where should we log bugs ??
Right now I can't generate proxy classes using the sapcpsdk-proxygenerator CLI
it says Code compilation failed Missing semicolon before 'return'.
my service document metadata comes from Gateway SAP_GWFND 740	0014
please help
thanks

Thank you for your feedback. The issue seems to be resolved (or taken offline), so I am closing the issue.
If you still have questions, feel free to reopen the issue.


How to deal with autoload and oh-my-zsh plugins?

Is it possible to have a program installed with this role that is only installed via autoload?
For example, I wish to have zmv installed, along with all the other extras (powerlevel10k, zsh-autosuggestions, etc.). However, I don't think I can simply add it to the zsh_antigen_bundles_extras variable because it's not considered a bundle. According to my research, it can only be installed by running autoload zmv on the shell. The same goes for another program called zcalc.
The same goes for enabling built-in oh-my-zsh plugins. I'd like to enable npm and sudo, but I don't know how to do it with this role, short of manually editing the .zshrc.local file after running it.
Is there a way to install these things with this role instead?

@SturmB, now you can add any code in variable zsh_custom_before, zsh_custom_after.

zsh_custom_before - before include antigen.zsh
zsh_custom_after - before include ~/.zshrc.local


Can @GlobalTransaction be nested ?

Can we invoke a @GlobalTransaction annotated method from current @GlobalTransaction ?

@sharajava I think it is not the nest transaction. We can consider the following scenario:
GlobalTransaction tx1 = tm.begin();
tx1.branchRegister(branch1);

GlobalTransaction tx2 = tm.begin(); // tx2 will be the nest transaction
tx2.branchRegister(branch2);

tx2.rollback(); // we just rollback the nest transaction.
tx1.commit(); // we can commit the parent transaction as well and it should be OK

So if the PROPAGATION_REQUIRED is added, I think tx1 and tx2 will be in the same global transaction.

这样不行，我在所有的方法都加上GlobalTransaction是不行


fix: don't modify config

Description
worker resolved config should use origin user config
refs https://github.com/vitejs/vite/pull/9212
refs #9261

Additional context

What is the purpose of this pull request?

[x] Bug fix
[ ] New Feature
[ ] Documentation update
[ ] Other

Before submitting the PR, please make sure you do the following

[x] Read the Contributing Guidelines.
[x] Read the Pull Request Guidelines and follow the Commit Convention.
[x] Check that there isn't already a PR that solves the problem the same way to avoid creating a duplicate.
[x] Provide a description in this PR that addresses what the PR is solving, or reference the issue that it solves (e.g. fixes #123).
[ ] Ideally, include relevant tests that fail without this PR but pass with it.

Same as #9261, this PR fixes https://github.com/vitejs/vite/issues/9252.
https://github.com/vitejs/vite-ecosystem-ci/runs/7441543695?check_suite_focus=true

move the validate after handle config.
move create worker config after the config stable.

Can confirm this resolves our issue in CI! 🥳


Jobs page: advanced filtration and implemented sorting

Motivation and context
Sorting:

Quick filters:

Filter builder

Recent filters:

@nmanovic  The implementation is buggy for now and not fully implemented yet, but it can send json logic requests to the server.
Example request (see query params):
filters: {"and":[{"in":[{"var":"state"},["in progress","new"]]},{"==":[{"var":"dimension"},"2d"]},{"<=":[5,{"var":"id"},500]},{"in":["Test task name",{"var":"task_name"}]},{"in":["Test project name",{"var":"project_name"}]}]}

[x] keep state while fetching
[x] colorify applied filters
[x] implement server filtering
[x] timedate before/after, setup timedate format
[x] reduce code duplication
[x] add sorting
[x] test and debug

How has this been tested?

Checklist

[x] I submit my changes into the develop branch
[x] I have added a description of my changes into CHANGELOG file
[ ] I have updated the documentation accordingly
[ ] I have added tests to cover my changes
[ ] I have linked related issues (read github docs)
[x] I have increased versions of npm packages if it is necessary (cvat-canvas,
cvat-core, cvat-data and cvat-ui)

License

[x] I submit my code changes under the same MIT License that covers the project.
Feel free to contact the maintainers if that's a concern.
[x] I have updated the license header for each file (see an example below)

# Copyright (C) 2022 Intel Corporation
#
# SPDX-License-Identifier: MIT

@nmanovic
Looks like everything works (I didn't test datetime yet, need to implement it on UI first).
But don't you think when filtering by assignee, better to use username rather then user id? It is not very important from UI point of view, just my personal suggestion.

@nmanovic
Looks like everything works (I didn't test datetime yet, need to implement it on UI first). But don't you think when filtering by assignee, better to use username rather then user id? It is not very important from UI point of view, just my personal suggestion.

I agree, just need to map assignee to assignee__username lookup field. When you are ready with UI, I will improve the server part as well. Several comments:

Better to rename the query parameter to filter
Need to add a quick button to reset filters
Is it possible to make all button on the filtering dialog visible from the beginning? An empty yellow box without any buttons looks confusing and agly.
It will be better to choose a predefined filter and be able to edit it in the dialog. On your mockups the button was inside the popup dialog as far as I remember.
Also the filter encoding isn't readable. But I don't think that we can fix that. Probably a good solution could be "deepObject", but it doesn't support nested objects: https://swagger.io/docs/specification/serialization/. Another solution is https://github.com/ljharb/qs but I don't see an implementation on python.

Better to rename the query parameter to filter

Ok.

Need to add a quick button to reset filters

Ok.

Is it possible to make all button on the filtering dialog visible from the beginning? An empty yellow box without any buttons looks confusing and agly.

Possible I think with our css setup, but the library does not provide strong API to modify default styles, so, it might be broken in case of significant changes. Anyway, I'll try.

It will be better to choose a predefined filter and be able to edit it in the dialog. On your mockups the button was inside the popup dialog as far as I remember.

I do not think a user should change predefined filters, because they are predefined..  And about the button, inside dialog on annotation view we have "Recent filters" list. From the meeting we discussed, that for predefined list, better to have them outside for quick access.

@bsekachev , some nice ideas for UI: https://devdocs.magento.com/guides/v2.4/pattern-library/filters/data-table-filters/filtering.html

@nmanovic Look at new appearance (I've updated screenshots).

When the cross (clear filter) appear and disappear, UI elements are moving and it looks strange. I believe we need to following UI ideas in the link above. The interface looks professional, known, intuitive. Of course our interface in any case will be slightly different, but need to following the concept in general.

When the cross (clear filter) appear and disappear

Let's do the button visible always, but disable it when no filters applied.
In the link you provided filters are simple set of conditions united with AND, in our case filters are more difficult, so many design solutions from there (like for example a line with active filters) is not applicable for us because in our case these lines are multilevel and unreadable.

@bsekachev ,

Indentation of the menu should not be by center. It looks strange. Now the indentation is (center, center, left). I propose to change it (right, right, left). Also I will vote to remove the close button and make the menu button with a state (open/close). Thus if you click on the button it will show the drop down menu and if you click one more time, it will close it.

@bsekachev , for visualization of filters I will not recommend to use JsonLogic. It is good for communication between the server and client, but it is not human readable format. Better to use humanStringFormat or spelFormat (https://ukrbublik.github.io/react-awesome-query-builder/)

@bsekachev , there is no fast way to recent the filter below. Indeed it exists but it isn't intuitive (need to click clear filters). I will vote to put apply button on the same row as the recent drop down menu and replace close by reset button.

@nmanovic

I believe if recent filters are just a list without checkbox, it will be better. Also in the case close button will be unnecessary as well.

Do you mean a user is able to choose only one option?

Yes. In 99% of cases we need just one of recent filters. Not a combination of them. Otherwise how to join them using or, and, not?

Indentation of the menu should not be by center.

to remove the close button

Done.

there is no fast way to reset the filter below

Done, but not exactly as u described. Apply and reset are located in one place:

This way it is implemented on annotation view.

I believe if recent filters are just a list without checkbox, it will be better. Also in the case close button will be unnecessary as well.

Done.

Better to use humanStringFormat or spelFormat

Done. Used queryString format which is more readable. For now we can't use spelFormat because it was introduced starting from<EMAIL_ADDRESS>and it looks like this release is underperformed, there are significant issues event with installing it.  We could find more 3rdparty converters, but looks like query string is also Ok (and again, it is used on annotation view).

@bsekachev , need to remember the ordering. Now it is reset after I leave the job page.

@bsekachev ,
I will propose to remove "Jobs" word, highlight "Jobs" in the header, align search bar to the left.

@kirill-sizov, Could you please take a look at small changes in REST API tests? In this PR job order was changed and I've updated assets and have added a step with filtering jobs with annotation with shapes (because without it tests failed).

@kirill-sizov, Could you please take a look at small changes in REST API tests? In this PR job order was changed and I've updated assets and have added a step with filtering jobs with annotation with shapes (because without it tests failed).

I looked, tests changes looks good to me.

@bsekachev, I guess, filters for users also should be updated..

@Marishka17
We do not have filters for users as far as I know, only search.

@ActiveChooN
Could you please conduct a review?

@TOsmanov
Could you please add/update documentation about current implementation of Jobs page?

@TOsmanov
Could you please add/update documentation about current implementation of Jobs page?

@bsekachev , yes, sure


Fixing alignment issues

Avoids the wrapping if input is stretched to 100% or container is smaller.
#PATCH#

:+1:


Performance regression for large batch sizes

Hello,
Thank you for the great work. I'm integrating the FP6 linear kernel to torchao (https://github.com/pytorch/ao/pull/223). One thing I have observed is that the kernel is slower than PyTorch's default at large batch sizes. On my 4070Ti Super, the breaking point is at batch size = 256. You can see the detailed benchmark reports in my PR to torchao above. @msaroufim also had similar results with H100. I use the splitK values as specified in tests/python/run.sh
Have you observed similar results? I believe the kernel was tuned for A100. I don't have access to an A100 so I can't check.
I have also run tests/python/run.sh with the kernel compiled in this repo.  I am delighted that our kernel can also work well on 4070Ti GPUs, as I never tested it myself.
The phenomenon you have observed is exactly what we would expect. Please refer to Figure 1 in our paper.
As the BS increases to a certain point (e.g., 256 for A100),  the GEMM becomes compute-bound, where the computational throughput of Tensor Cores becomes the bottleneck of the kernel execution.
Our FP6-LLM kernel and cuBLAS are both using FP16 tensor cores. Thus, the theoretical peak speed of both kernels for large batch sizes should be the same. We have tried to make our FP6-LLM not significantly slower than cuBLAS for large batch sizes, but we can never be faster than cuBLAS if we also use the FP16 tensor core for the core computations.
Note that the breaking point could be different for different GPUs. The breaking point for H100 would be larger than 256 since the ratio between Tensor Core throughput and DRAM bandwidth is larger than ever. Our kernel is not optimized for H100 now, but I will do it if I get more spare time.

Thank you for your reply. It's good to know that it is indeed a known limitation.
In the case of LLM, the batch size in matmul is batch size x sequence length. Thus, how would this kernel be faster than fp16 for LLM inference? Specifically, I'm referring to End2End Inference results (Section 7.3), Figure 12, 13, and 14. Is the "batch size" in Figure 12 and 13 refers to batch size of matmul (BxD), or batch size of transformer activations (BxLxD)? Due to the sentence "We set the prefill/prompt length of each request to 0.5K, and generate 1.5K tokens", I have the impression that it is the latter (BxLxD).

The shape of activations is (BL, Hidden) for the prompt/prefill processing phase, but the shape of activation becomes (B1, Hidden) for the decoding (token generation) phase if KV-Cache is used. Our kernel mainly accelerates the token generation phase of LLM inference.
For LLM inference, we only need to execute a prompt processing phase once (all input tokens are processed in parallel), but we must execute a decoding step to generate each output token. Thus, the decoding phase can easily dominate the overall LLM inference execution time. That is the reason why we can get end-to-end speedups.

I see, that makes perfect sense! Thank you again. I will close this issue.
Another small question. Do you plan to add support for bias (A @ W.T + b) in the future? It's a bit inconvenient to launch a separate kernel just to add bias.

Thanks for your valuable suggestion. I will add this feature.


[Physical addressing] UNREACHABLE in LowerAddrSpaceCastPass when compiling a memory copy kernel

Compiling the attached source, with the following options:
clspv source.cl   -cl-std=CL2.0 -inline-entry-points -cl-single-precision-constant  -cl-kernel-arg-info   -fp16=0  -rewrite-packed-structs  -std430-ubo-layout  -decorate-nonuniform    -arch=spir64  -physical-storage-buffers  --use-native-builtins=acos,acosh,acospi,asin,asinh,asinpi,atan,atan2,atan2pi,atanh,atanpi,ceil,copysign,fabs,fdim,floor,fma,fmax,fmin,frexp,half_rsqrt,half_sqrt,isequal,isfinite,isgreater,isgreaterequal,isinf,isless,islessequal,islessgreater,isnan,isnormal,isnotequal,isordered,isunordered,ldexp,mad,rint,round,rsqrt,signbit,sqrt,tanh,trunc,  -spv-version=1.6  -max-pushconstant-size=256  -max-ubo-size=65536  -global-offset  -long-vector  -module-constants-in-storage-buffer  -cl-arm-non-uniform-work-group-size     -o compiled.spv

results in the following unreachable being hit:
Instruction not handled:   %27 = inttoptr i64 %26 to ptr addrspace(4)
Missing support for instruction
UNREACHABLE executed at /path/to/clvk/external/clspv/lib/LowerAddrSpaceCastPass.cpp:262!

source.txt

@kpet , where does this kernel come from?
I don't see a way to fix it. The kernel is very simple:
kernel void indirect_copy_kernel(global uintptr_t *destination,
                                 const global uintptr_t *source) {
  const int tid = get_global_id(0);
  const uchar *s = (uchar *)(source[tid]);
  uchar *d = (uchar *)(destination[tid]);
  *d = *s;
}

But the last line is just loading from a generic address space, to then store to a generic address space. As destination and source are pointers on uintptr_t, I don't see any way of knowing what the actual address space is for this last load/store.

My only guess would be that if we cannot find the address space, it might have to be global.
It is the only one where we will be able to perform a OpConvertUToPtr.


CNN part error with too many indices for array

Hello,
error
CNN part is giving an error
File "", line 8, in
batch_y = train_y[offset:(offset + batch_size), :]
IndexError: too many indices for array
follow up test, that has been done by me
print(X)
Tensor("Placeholder_2:0", shape=(?, 1, 90, 3), dtype=float32)
print(Y)
Tensor("Placeholder_3:0", shape=(?, 6), dtype=float32)
print(c_flat)
Tensor("Reshape_1:0", shape=(?, 1080), dtype=float32)
print(shape)
[None, 1, 1, 1080]

I have not changed your code at any point, as I'm in the learning and understanding the CNN.
It would be great if you could help me in this regard
thanks in advance for your valuable time

train_y should be one hot encoded. See here how to convert labels (train_y) to one hot encoded representation.

thanks for the tips. I will work on it. however the link "see here" does not have any content

Fixed. (https://aqibsaeed.github.io/2016-11-04-human-activity-recognition-cnn/)

Hello Aqi,
I started to work with your code form the above link. Later only I found the git-hub link. Now, I understood the concept of one hot encoding; however, I have a doubt where should I used this part. to be very specific, should I use this after
reshaped_segments = segments.reshape(len(segments), 1,90, 3)
or
at the CNN part.

"""
one hot encoding part
"""
def enco(label):
from numpy import array
from numpy import argmax
from sklearn.preprocessing import LabelEncoder
from sklearn.preprocessing import OneHotEncoder
# define example
#data = ['cold', 'cold', 'warm', 'cold', 'hot', 'hot', 'warm', 'cold', 'warm', 'hot']
data=label
values = array(data)
print(values)
import getpass
getpass.getpass("Press Enter to Continue")
# integer encode
label_encoder = LabelEncoder()
integer_encoded = label_encoder.fit_transform(values)
print(integer_encoded)
# binary encode
onehot_encoder = OneHotEncoder(sparse=False)
integer_encoded = integer_encoded.reshape(len(integer_encoded), 1)
onehot_encoded = onehot_encoder.fit_transform(integer_encoded)
print(onehot_encoded)
import getpass
getpass.getpass("Press Enter to Continue")
# invert first example
inverted = label_encoder.inverse_transform([argmax(onehot_encoded[0, :])])
print(inverted)
import getpass
getpass.getpass("Press Enter to Continue")
return onehot_encoded, inverted

Fixed. (https://aqibsaeed.github.io/2016-11-04-human-activity-recognition-cnn/)

Hello Aqi,
I started to work with your code form the above link. Later only I found the git-hub link. Now, I understood the concept of one hot encoding; however, I have a doubt where should I used this part. to be very specific, should I use this after
reshaped_segments = segments.reshape(len(segments), 1,90, 3)
or
at the CNN part.
"""
one hot encoding part
"""
def enco(label):
from numpy import array
from numpy import argmax
from sklearn.preprocessing import LabelEncoder
from sklearn.preprocessing import OneHotEncoder
define example
#data = ['cold', 'cold', 'warm', 'cold', 'hot', 'hot', 'warm', 'cold', 'warm', 'hot']
data=label
values = array(data)
print(values)
import getpass
getpass.getpass("Press Enter to Continue")
integer encode
label_encoder = LabelEncoder()
integer_encoded = label_encoder.fit_transform(values)
print(integer_encoded)
binary encode
onehot_encoder = OneHotEncoder(sparse=False)
integer_encoded = integer_encoded.reshape(len(integer_encoded), 1)
onehot_encoded = onehot_encoder.fit_transform(integer_encoded)
print(onehot_encoded)
import getpass
getpass.getpass("Press Enter to Continue")
invert first example
inverted = label_encoder.inverse_transform([argmax(onehot_encoded[0, :])])
print(inverted)
import getpass
getpass.getpass("Press Enter to Continue")
return onehot_encoded, inverted
thanks in advance

Fixed. (https://aqibsaeed.github.io/2016-11-04-human-activity-recognition-cnn/)

I understood that you have used dummies for hot encoding. however, I am getting this error
CNN part is giving an error
File "", line 8, in
batch_y = train_y[offset:(offset + batch_size), :]


[auth-swift] More User link unit tests

Not all the deleted Objective C tests were ported, since some were exact duplicates or required trivial additions to other tests.
#no-changelog

Rebased auth-swift to origin/master after this PR merge


ImportError: libcublas.so.9.0: cannot open shared object file: No such file or directory

I met the same problem as ImportError: libcublas.so.9.0: cannot open shared object file: No such file or directory , https://github.com/tensorflow/tensorflow/issues/15604 , but non of their methods work.

@KeithAymar I have tried to use that command but I get the following error:

Reading package lists... Done
Building dependency tree
Reading state information... Done
E: Unable to locate package cuda-9-0

Could you please advise what to do? Thanks in advance!

I don’t know for sure.  I’m an a noob with this.  Took me a few days to get things working.  Anytime something doesn’t work quite right I make sure to do before running any install commands.
sudo apt-get update
Sounds like you don’t have the packages set up for install.
These are the instructions I followed when I installed 9.1.  Be sure all the prerequisites are complete.  I am using a minimal install of Lubuntu.   But there are instructions for other flavors.
http://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#ubuntu-installation

I use Ubuntu 1604, I installed cuda 9.1 following the instructions here: http://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#ubuntu-installation
When importing tensorflow happened the same problem as OP.
I used the command:
sudo apt-get install cuda-9-0

And it solved my issue, I now finally have tensorflow-gpu running
Thanks @KeithAymar


User documentation

We should document the various configuration options and how to build and run WasmFX programs.

Partially fixed, as @frank-emrich has updated the README with some basic instruction.


[FEATURE REQ] profile parameter in CLI

Is your feature request related to a problem? Please describe.
The CLI does not allow history to be exported from a specific profile (in case of browsers which support them) and the default is to get history from all profiles.
Describe the solution you'd like
A -p/--profile parameter that takes the name of the profile and calls the appropriate functions under generic.Browser.
This should show an error if the flag is used without a browser parameter (since profiles are specific to a browser) or if the browser does not support profiles.
Another flag --show-profiles (or --list-profiles) must be added that lists all available profiles for a given browser. This should also show errors on the same conditions as --profile.
Additional context
The profiles and history_profiles functions can be used for this (note: links might be outdated, find these functions on the master branch).

I will look at this in the course of this week

I will look at this in the course of this week


Cannot close stdin, stdout stderr to make a daemon

Hello:
I have written a program using tinyb that reads all the sensors. Everything works as expected.
I am now trying to daemonize the program so that it can run when the machine boots.
Accordingly to get a program daemonized you must among other things close the open file descriptors
in the child via calls to close( 0 ), close( 1), close( 2).
However the issue I am having is that if I close all three the program stops working. If I only close 2 of the 3 the program works as expected. What am I missing? Is it a D-Bus issue? Any suggestions would be appreciated?
thank you,
west suhanic

When closing all the file descriptors Linux OS will kill the process. Have you made sure to call setsid()?

Hello:
Yes I called setsid. I have to leave one of stdin, stdout or stderr open.
Is the D-Bus code dependent on any of these?
thank you,
west suhanic
On Tue, Sep 5, 2017 at 4:04 PM, Tzafrir<EMAIL_ADDRESS>wrote:

When closing all the file descriptors Linux OS will kill the process. Have
you made sure to call setsid()?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/intel-iot-devkit/tinyb/issues/115#issuecomment-327287710,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AbU48zTZAFmt6YItppuvFY8NVvZtFLOgks5sfalqgaJpZM4PAqrW
.

DBus communicates over UNIX sockets, so there shouldn't be any requirements to keep any of the std* filedescriptors open, and there's plenty of DBus daemons.
Did you try running your process with GDB or strace and see if it has an error?

Hello:
I will run it with strace/GDB and get back to you.
thanks,
west suhanic
On Thu, Sep 7, 2017 at 2:42 AM, petreeftime<EMAIL_ADDRESS>wrote:

DBus communicates over UNIX sockets, so there shouldn't be any
requirements to keep any of the std* filedescriptors open, and there's
plenty of DBus daemons.
Did you try running your process with GDB or strace and see if it has an
error?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/intel-iot-devkit/tinyb/issues/115#issuecomment-327702563,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AbU48700t7_ftlmkBatvtEFVhbjMp_HLks5sf5BegaJpZM4PAqrW
.

Hello All:
I discovered what was causing my daemon to exit without so much as a log entry anywhere. Me.
I was trying to close stderr while trying to write to stderr. This happened just before opening the
connection to syslogd.
My mistake. I apologize. All is well.
thank you,
west suhanic


Not hide Activity Bar

Type: Bug
1.set hotkey1 for View:Toggle Activity Bar Visibility
2.set hotkey2 for View:Focus Activity Bar
hide anyhow Activity Bar
Focus Activity Bar throw hotkey2
then hotkey1 not hide ActivityBar even we f6 from Activity Bar
VS Code version: Code 1.73.0 (8fa188b2b301d36553cbc9ce1b0a146ccb93351f, 2022-11-01T15:38:50.881Z)
OS version: Darwin x64 19.6.0
Modes:
Sandboxed: No

Thanks for creating this issue! It looks like you may be using an old version of VS Code, the latest stable release is 1.73.1. Please try upgrading to the latest version and checking whether this issue remains.
Happy Coding!


Influx SSL not working

From @mts57017 on January 17, 2018 13:41
i am running a .NET Core 2 API....
here is the config....
public static IWebHost BuildWebHost(string[] args) =>
WebHost.CreateDefaultBuilder(args).ConfigureMetricsWithDefaults(builder =>
{
builder.Configuration.Configure(options =>
{
options.DefaultContextLabel = "Data Load API";
options.GlobalTags.Add("test tag", "test value");
options.Enabled = true;
options.ReportingEnabled = true;
}).Report.ToInfluxDb(options =>
{
options.InfluxDb.BaseUri = new Uri("https://");
options.InfluxDb.Database = "";
options.InfluxDb.UserName = "";
options.InfluxDb.Password = "";
options.HttpPolicy.BackoffPeriod = TimeSpan.FromSeconds(30);
options.HttpPolicy.FailuresBeforeBackoff = 5;
options.HttpPolicy.Timeout = TimeSpan.FromSeconds(10);
options.MetricsOutputFormatter = new MetricsJsonOutputFormatter();
options.FlushInterval = TimeSpan.FromSeconds(20);
});
}).UseMetrics().UseHealthEndpoints()
.UseStartup()
.Build();
}
the above returns the following....
"context": "appmetrics.internal",
"apdexScores": [],
"counters": [
{
"name": "report_failed",
"unit": "items",
"count": 13,
"items": [
{
"count": 13,
"item": "App.Metrics.Reporting.InfluxDB.InfluxDbMetricsReporter",
"percent": 100.0
}
],
"tags": {
"server": "abb2533aac4e",
"app": "DataCacheAPI",
"env": "development",
"test tag": "test value"
}
}
],
any ideas as to what is causing this?
Copied from original issue: AppMetrics/AppMetrics#214

off the top of my head no, I'll have to dig in

SSL works fine me for on the latest version. What's the exception you are getting and are you using a self signed cert?

the provider changed it over from a self signed to a public one, so i wouldn't think that would be an issue...right?

not an exception, when you go to the metrics page, i can see the failed sends

do my setting look right above?

Hard to tell, obvious questions, confirmed the dbname, username and password are correct?
I'd say the best way is to pull this repo down and update the configuration in the sandbox project and give it a run.
You're referring to the "metrics page" of your provider?
Do you see error's logged from App Metrics in your app?, see here
What are the details of errors you are getting on the "metrics page"?

Cannot replicate


Mismatching deallocation

\src\cpp\qos\ParameterList.cpp line 343 + 348
use delete [] oc;

It was solved in commit b75fff305b45b4f94fd867cd32b7f3ef1043fbbd
Thanks


CI fails because JRuby doesn't support set_simultaneous_accept_count

JRuby doesn't support set_simultaneous_accept_count yet. CI fails after introducing this.
https://github.com/eventmachine/eventmachine/pull/420

I've forgotten that I'm supporting Jruby

Fixed by merged PR #18


Deprecated nightwatchjs instruction

Sorry for my late reply.
I had misunderstood nightwatch API.
I checked the official API reference, and I think your changes are right.
Now, I'm investigating the test failure.

The test problem was resolved :tada:
Thanks you, @atkach !


Add ability to specify required checks

Closes:

[x] Unit tests
[ ] Changelog
[ ] Documentation (Readme)

What has been done
Add a new required_checks array property to the config where a list of all required checks can be specified. By default, this list is empty making the checksPassed always true.
How to test
TBD

Closing in favor of https://github.com/maximbircu/pull-request-assistant/pull/22


added another javascript course

added another javascript persian taught course to free-course-fa_IR

For youtube, we prefer "playlist" links and the name of the producer/creator. https://github.com/EbookFoundation/free-programming-books/blob/master/CONTRIBUTING.md#platforms-and-access-notes


Relax parser dependency

I understand the reason why parser is fixed to 2.6.3 (due to #129) but that also enforces other tools relying on parser to stick to the older version.
Unparser itself shouldn't break if used with the latest parser, 'cause the latter one is backward-compatible with older Rubies.
What about changing ~> to >=?

@palkan This is a hard line to walk.
Given not 2.6 support is not really complete (well it was at a point before ruby started to add syntax). I think its fair to do so and note the current "expectations" in the readme.

@palkan I released 0.4.7 that depends on parser >= 2.6.5

@palkan Just curious what do you use unparser for?

Thanks a lot!
I'm using it in my transpiler project: https://github.com/ruby-next/ruby-next 🙂
And it currently requires a custom parser release. Hopefully, now I will be able to use the latest official versions.
And I'm also using it in Action Policy for pretty printing: https://github.com/palkan/action_policy/blob/master/lib/action_policy/utils/pretty_print.rb
So, thanks for your work!

@palkan Cool. BTW I see tildelift in your projects, what are your experiences?
I'd love to also acquire some sponsoring for unparser.

I see tildelift in your projects, what are your experiences?

Zero 🙂 We don't have enough subscriber uses
Honestly, I don't expect anything from it. OpenCollective seems to be a better alternative. Or GH Sponsors, which is quite similar but is still beta-like.

Haha. Yeah. I thought so.
I'd love to use GH sponsors, as its native to GH. But they did not reply yet to my application.


Make DataviewJS keyword configurable in settings

Making the keyword for DataviewJS blocks configurable in order to mitigate the risk of a DataviewJS block injection attack.
For context, see this comment on #615. Relevant portions:

It's pretty trivial to create HTML that displays some completely normal-looking text, but on copy, copies a malicious script that is wrapped in a dataviewjs block to the user's clipboard. If an unsuspecting user were to copy that seemingly innocuous text and then paste it into their Obsidian vault, if they have DataviewJS enabled, the malicious code would execute.

One simple mitigation for the specific issue mentioned above is to allow users to customize the keyword used to begin a dataviewjs block.

Note that this requires an app reload on change. I tried doing it without a reload but I couldn't figure out how to unregister a previously registered MarkdownPostProcessor.
Please let me know if there's anything I should change. Thanks!

An interesting and simple fix. Looks fine to me.


Add Copy Editor plugin

https://github.com/zakkain/sketch-copyeditor

Please edit the plugins.json in src/data and open a pull request. Thanks.

Searching the repo doesn't show a plugins.json file at all. I also can't
see this comment on GitHub, perhaps this comment was for a separate
issue/repo?
On Tue, Jul 28, 2015 at 2:54 AM Florian Bürger<EMAIL_ADDRESS>wrote:

Please edit the plugins.json in src/data and open a pull request. Thanks.
—
Reply to this email directly or view it on GitHub
https://github.com/buzzfeed/Sketch-Toolbox/issues/51#issuecomment-125530228
.

Yes, you're right, my mind was in a different repository. Sorry about that.

FTR, the plugin was added to the plugin-directory repo yesterday, so this issue can be closed


Separate static checks from pytest

I want to separate the static code checks (black, mypy, ruff) so that they don't run as part of pytest. Instead they should run either as part of pre-commit, or as their own standalone tox environments. We only need to run these checks once, not for every Python version as we do with pytest, and besides the dependencies needed to run these tests as part of pytest are breaking compatibility with Python 3.6.

From what I've figured out so far, I think this should be done together with, or after, #20. Anyway I'm working on both.


Add optional Solr/Tomcat installation

See: https://github.com/geerlingguy/acquia-cloud-vm/issues/3
Do something similar, but don't install by default.

This is postponed on https://github.com/geerlingguy/ansible-role-solr/issues/8

The above issue is now closed, and I've added a Wiki page with more instructions for using Apache Solr with Drupal sites on Drupal VM: Use Apache Solr for Search.


[SPARK-36028][SQL][3.2] Allow Project to host outer references in scalar subqueries

This PR cherry picks https://github.com/apache/spark/pull/33235 to branch-3.2 to fix test failures introduced by https://github.com/apache/spark/pull/33284.
What changes were proposed in this pull request?
This PR allows the Project node to host outer references in scalar subqueries when decorrelateInnerQuery is enabled. It is already supported by the new decorrelation framework and the RewriteCorrelatedScalarSubquery rule.
Note currently by default all correlated subqueries will be decorrelated, which is not necessarily the most optimal approach. Consider SELECT (SELECT c1) FROM t. This should be optimized as SELECT c1 FROM t instead of rewriting it as a left outer join. This will be done in a separate PR to optimize correlated scalar/lateral subqueries with OneRowRelation.
Why are the changes needed?
To allow more types of correlated scalar subqueries.
Does this PR introduce any user-facing change?
Yes. This PR allows outer query column references in the SELECT cluase of a correlated scalar subquery. For example:
SELECT (SELECT c1) FROM t;

Before this change:
org.apache.spark.sql.AnalysisException: Expressions referencing the outer query are not supported
outside of WHERE/HAVING clauses

After this change:
+------------------+
|scalarsubquery(c1)|
+------------------+
|0                 |
|1                 |
+------------------+

How was this patch tested?
Added unit tests and SQL tests.
(cherry picked from commit ca348e50a4edbd857ec86e4e9693fa4bcbab54b7)
Signed-off-by: allisonwang-db<EMAIL_ADDRESS>

Test build #141664 has started for PR 33527 at commit fb58c1c.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46180/

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46180/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46180/

Test build #141664 has finished for PR 33527 at commit fb58c1c.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

cc @cloud-fan (The test failures seem to be related to SPARK-35985?)

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141664/

Test build #141727 has started for PR 33527 at commit 29b068c.

Kubernetes integration test unable to build dist.
exiting with code: 1
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46240/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46240/

Test build #141727 has finished for PR 33527 at commit 29b068c.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141727/

thanks, merging to 3.2!


While renaming displayId, must refer to the correct sequence

Instead of renaming displayId to refer to old parts, maybe disallow (because it requires filling in fields again) and use flashlight to select from already created parts.


Update BlobServiceClient Initialization Based on useCredential Parameter

Description: This PR modifies the initialization logic of the BlobServiceClient in the AzureBlobProvider class to dynamically select the credential type based on the useCredential parameter:
If useCredential is true, BlobServiceClient is initialized using ConnectedServiceTokenCredential.
If useCredential is false, it uses StorageSharedKeyCredential.

/azp run


fix endlessh-logs parser to handle IPV4/IPV6 correctly

should fix #445

oh, I'm sorry that I didn't get it correctly... I've indeed set it to ipv4 only, so it's working for me now 🥳😉
many thanks for double checking 👍

I will look into seeing we can have best of both worlds. 👍🏻

Please give my changes a test but here grok debugger output


Interpolating between frames

Hi @Wasserwecken !
(No hurry, btw., don't feel pressured to answer)
I have an animation file and I want to cut a range of frames for it.
Let's say this animation file has 100 frames and I want to only leave the part from frame 25 to frame 75 (both-inclusive)
cuts = {
"<path-to-bvh>" : [24,74]
}

for k,v in cuts.items():
    for start, end in v:
        bvh = bvhio.readAsBvh(k)
        root = bvhio.convertBvhToHierarchy(bvh.Root)

        # write ground truth
        path = Path(output_path) / f"{Path(k).name}_{start}_{end}_GROUND_TRUTH.bvh"
        for joint, _, _ in root.layout():
            joint.Keyframes = zip(range(0, end-start+1), [joint.Keyframes[i][1] for i in range(start, end+1)])
        bvhio.writeHierarchy(path, root, bvh.FrameTime, end - start + 1)

        # write linear interpolation
        path = Path(output_path) / f"{Path(k).name}_{start}_{end}_LIN_INTERP.bvh"
        for joint, _, _ in root.layout():
            joint.Keyframes = [(0, root.Keyframes[0][1]), (end-start, root.Keyframes[-1][1]) ]
        bvhio.writeHierarchy(path, root,  bvh.FrameTime,  end - start + 1)

The so called "ground-truth" is written correctly, however the linear interpolation doesn't work - it produces a completely messed up animation. Am I doing the interpolation wrong?

Do you have a sample file for me to try it out?

Here you are:
https://drive.google.com/file/d/1lNXQ6KsBSrFvr62sqFN2yn5oFAbC3lsm/view?usp=sharing
Let's say the cuts is:
cuts = {
"<path-to-bvh>" : [0,38]
}

You should see that "ground-truth" is correctly cut, while linear interpolation is completely broken - it has position channels for every joint, but of the kind that you can't easily delete using the method from https://github.com/Wasserwecken/bvhio/issues/5

I have good and bad news here. The good one is, your code has a simple bug that will fix the broken animation:
This will copy the animation data of the root to all other joints.
joint.Keyframes = [(0, root.Keyframes[0][1]), (end-start, root.Keyframes[-1][1]) ]
But you should return the animation data of the joint itself like this:
joint.Keyframes = [(0, joint.Keyframes[0][1]), (end-start, joint.Keyframes[-1][1]) ]
But the bad new is that the interpolation looks horrible. the code uses the GLM lerp-method for interpolation and the local offset data is interpolated:
Transform(
    name=f'Key {frame} (interpolated)',
    position=glm.lerp(before[1].Position, after[1].Position, weight),
    rotation=glm.lerp(before[1].Rotation, after[1].Rotation, weight),
    scale=glm.lerp(before[1].Scale, after[1].Scale, weight)
), keep=None

To impove the interpolation feature, I gues the world data of restpose + animation has to be interpolated. Unfortunatly this is not implemented. But feel free to create a pull request :)

Oh, yeah, you're right!
Shouldn't rotations be interpolated using slerp?
Either way, thanks!


Allow friendly names to be added to heap snapshots

Currently today, all of Objects, Arrays, etc. are all combined within the same constructor within a heap snapshot view. This makes it difficult to get a summary of what types of objects are causing the most memory problem. If instead, we could provide a friendly name to objects, so the aggregation of those events could be based off of friendly name, this would help us in allowing us to target the correct objects that will get us the most bang for our buck.

This seems like an interesting idea that would, for sure, make it easier to use the snapshot view. I think @zoherghadyali would want to hear about this.


Remove unnecessary randomize() call

QUICConnectionId::randomize() is always called by QUICPacketHandlerIn::_recv_packet() from here.
https://github.com/apache/trafficserver/blob/08042e622c34c3d2658ace4f16a540a6465c3d08/iocore/net/QUICPacketHandler.cc#L289
This looks bit expensive.

It looks like QUICConnectionId::randomize() is called explicitly when it is needed. Is there any place assuming randomizing is done in constructor?

Those calls are probably from these two lines.
https://github.com/apache/trafficserver/blob/9fc03ee395ebe56b8b2c2d555ef52f693b8e3f86/iocore/net/QUICPacketHandler.cc#L98-L99
I think we should probably have appropriate constructor and make randomize() private. Then we can remove calls of randomize() from many places.

They are wrong lines but the same thing.
https://github.com/apache/trafficserver/blob/9fc03ee395ebe56b8b2c2d555ef52f693b8e3f86/iocore/net/QUICPacketHandler.cc#L216-L217

Also, _rerandomize_original_cid is not used at all.

Those calls are probably from these two lines.
I don't think QUICConnectionId::ZERO() calls  QUICConnectionId::randomize().
https://github.com/apache/trafficserver/blob/9fc03ee395ebe56b8b2c2d555ef52f693b8e3f86/iocore/net/quic/QUICTypes.cc#L559-L563

ZERO() will not call randomize() but I guess the default constructor is called before assigning one returned from ZERO().

That = is (copy?) initialization so default constructor is not called in this case. Also I checked on debugger. Line 289 is calling default constructor and it go to randomize().
(lldb) bt
* thread #2, name = '[ET_UDP 0]', stop reason = breakpoint 1.1
  * frame #0: 0x00000001003e5980 traffic_server`QUICConnectionId::randomize(this=0x0000000008ae09b0) at QUICTypes.cc:595:22
    frame #1: 0x00000001003e5969 traffic_server`QUICConnectionId::QUICConnectionId(this=0x0000000008ae09b0) at QUICTypes.cc:567:9
    frame #2: 0x00000001003e4db5 traffic_server`QUICConnectionId::QUICConnectionId(this=0x0000000008ae09b0) at QUICTypes.cc:566:1
    frame #3: 0x0000000100377696 traffic_server`QUICPacketHandlerIn::_recv_packet(this=0x0000000000b1c240, event=210, udp_packet=0x0000000002047f60) at QUICPacketHandler.cc:289:20
    frame #4: 0x0000000100376b4c traffic_server`QUICPacketHandlerIn::acceptEvent(this=0x0000000000b1c240, event=210, data=0x0000000008ae0c58) at QUICPacketHandler.cc:174:13
    frame #5: 0x0000000100010d51 traffic_server`Continuation::handleEvent(this=0x0000000000b1c240, event=210, data=0x0000000008ae0c58) at I_Continuation.h:190:12
    frame #6: 0x000000010036d580 traffic_server`UnixUDPConnection::callbackHandler(this=0x0000000000d4ba50, event=0, data=0x0000000000000000) at UnixUDPConnection.cc:89:21
    frame #7: 0x000000010036f034 traffic_server`UDPNetProcessorInternal::udp_callback(this=0x000000010062f8b0, nh=0x00000000084e5a40, xuc=0x0000000000d4ba50, thread=0x00000000084d4000) at UnixUDPNet.cc:276:9
    frame #8: 0x0000000100373623 traffic_server`UDPNetHandler::waitForActivity(this=0x00000000084e5a40, timeout=60000000) at UnixUDPNet.cc:1111:24
    frame #9: 0x00000001003b887b traffic_server`EThread::execute_regular(this=0x00000000084d4000) at UnixEThread.cc:277:14
    frame #10: 0x00000001003b8ce8 traffic_server`EThread::execute(this=0x00000000084d4000) at UnixEThread.cc:338:11
    frame #11: 0x00000001003b7042 traffic_server`spawn_thread_internal(a=0x0000000004015be0) at Thread.cc:92:12
    frame #12: 0x00007fff5acce2eb libsystem_pthread.dylib`_pthread_body + 126
    frame #13: 0x00007fff5acd1249 libsystem_pthread.dylib`_pthread_start + 66
    frame #14: 0x00007fff5accd40d libsystem_pthread.dylib`thread_start + 13
(lldb) frame select 3
frame #3: 0x0000000100377696 traffic_server`QUICPacketHandlerIn::_recv_packet(this=0x0000000000b1c240, event=210, udp_packet=0x0000000002047f60) at QUICPacketHandler.cc:289:20
   286
   287    // Server Stateless Retry
   288    QUICConfig::scoped_config params;
-> 289    QUICConnectionId cid_in_retry_token;
   290    if (!vc && params->stateless_retry() && QUICInvariants::is_long_header(buf)) {
   291      int ret = this->_stateless_retry(buf, buf_len, udp_packet->getConnection(), udp_packet->from, dcid, scid, &cid_in_retry_token);
   292      if (ret < 0) {

OK, then we should be able to make it cid_in_retry_token  = QUICConnectionId::ZERO();
Which case is more common?

My preference is not having public randomize(), and having constructors for each use cases.

It could be another option, but which means when somebody just declare ConnectionId like this case, it goes to expensive function. It looks trap from performance perspective.

Is it better than use of non-randomized value at where it has to be?

In this case the ConnectionId doesn't have to be randomized nor ZERO. It's just declared.

After discussion of default constructor design of QUICConnectionId (performance vs security) on slack, we decided to push workaround fix (initializing with ZERO) for now. 4aa5ba259e5d70fa0d1e420513435df5bbc83039
With this commit, the 6.5% usage of randomize() is gone.


Remove MemoryMappedFile & switch to fixed width types in VolFile

Start using fixed width types in VolFile code to improve Read/Write stream process
Remove MemoryMappedFile class to remove VolFile's dependency on Windows.h
Refactor VolFile::ReadVolHeader (Still needs more cleaning)

This branch started as changing variables in VolFile as fixed width and unsigned where appropriate. This messed with some of the bit operations in VolFile which I had difficulty restoring. To solve the problem, I ended up just removing MemoryMappedFile and eliminating several sections that were giving me trouble. This seemed to make more sense than struggling through the bit operation changes only to delete them a few commits later.
It would be helpful to continue cleaning the function VolFile::ReadVolHeader in the future.
We may want to revisit the function VolFile::ReadStringTable as there is probably a cleaner way to accomplish it. The function currently works though.
Getting close to eliminating windows.h entirely...

I've ran into some bugs when opening certain volumes. One bug that I think I've fixed is not seeking past the padding if present at the end of the StringTable. There seems to be another bug associated with locating the beginning of a file for unpacking. These did not manifest on my test cases, probably because I was just lucky and the padding didn't exist.
I've also locally improved the error messaging when reading from the volume header.


Migration testing runtime API/Bot

A quick and dirty, but functioning attempt at making an end to end runtime api that can be triggered by a bot to test all the OnRuntimeUpgrade implementations inside a runtime, including two newly added hooks for some pre-and-post checks. I have one example of how these can work here: https://github.com/paritytech/polkadot/commit/146f1e2fe936a975204d7d49a021bd9ed28ccc39#diff-db5840c3c03c740de25aed56b9257559c224a04619c079c94cddbb23f9a855a4R961
Given that it works now, I see this as a leaner and more minimalistic approach compared to #7665, but we can replace parts of this PR with test-runner once it is compatible.
My vision with this work is:

Each substrate PR can request the OnRuntimeUpgrade of a particular pallet to be executed against the live state of any chain: \migration_bot run target:pallet-staking source:remote('http://remote-host:9933').
Prior to each release, we run the same command once more on the polkadot node: \migration_bot run target:all cache('./path-to-cache-file.bin').

Current branch works fine, just needs a clean-up and configurability + making a few things generic (e.g. I assume Hash = H256 which is not good). In its current state, running cargo run -- dry-run --target all -lremote-ext=debug will yield something like:
2021-02-03 16:11:16.421   INFO main staking: 💸 new validator set of size 1 has been elected via ElectionCompute::OnChain for era 0
2021-02-03 16:11:16.443   INFO main remote-ext: scraping keypairs from remote node http://localhost:9933 @ 0x36b8402ce0037f61795cfa50a5615c3b0a30bd2dc2b5c2171faae3622886de12
2021-02-03 16:11:16.443   INFO main remote-ext: downloading data for all modules.
2021-02-03 16:12:18.371   INFO main remote-ext: injecting a total of 328567 keys
2021-02-03 16:15:27.709   INFO main node_runtime: !!! DRYRUN MIGRATION UP AHEAD !!!
2021-02-03 16:15:50.996   INFO main node_runtime: !!! DRYRUN MIGRATION DONE !!!

You can try the same, if you have a locally running node.
If this line of work is deemed okay, I will continue with cleaning the code, and making a companion PR that adds the same subcommand to polkadot as well.
CC @apopiak @seunlanlege @bkchr @shawntabrizi

This is more or less ready for review. A note about naming: I first called everything in this PR along the lines of DryRuntRuntimeUpgrade and such. But this is too specific. I foresee that in the future it will be useful (for me, at least) to add new cli commands and APIs that run the OnInitialize, or a particular Call of a new (not deployed) pallet over the state of a particular chain (or a range of blocks, updating as we go through). So I had to make it a bit more genralized and I thought the Try prefix, such as TryFrom, TryInto and such are cool enough to go with. It is also much easier to type than dry-run-runtime-upgrade :D so now everythign is called try-runtime and TryRuntime. Not perfect, but okay for now.

TryRuntimeCmd stuff looks good to me

I expect that some kind of log output of the storage keys that changed during the execution would be very relevant.
Is this already available via lstate=trace while executing this CLI?

Please add this to the node template

Why should this added to the node template? We don't need to add there everything :P

I expect that some kind of log output of the storage keys that changed during the execution would be very relevant.

Indeed, I made some changes here in that direction #8123. -lstate=tracing would probably hashed opaque keys at best. I reckon if we modify the TestExternalities that I use for backend, that one could probably even print unhashed keys, which are much more useful.

Please add this to the node template

Why should this added to the node template? We don't need to add there everything :P

My initial plan was to add it to this PR, but for now I am in favour of not doing so as the naming and the detail is kinda unstable. We can make an issue for someone to pickup a while after this is merged to add it to node-template.

My suggestion for adding it to the node template is that, like benchmarks, people eventually will want to use it on their custom chains, and if we don't include it, people will have to figure out how to do it
I'm fine to wait until this stabilizes

what is utils/frame/try-runtime/remote-externalities/proxy_test ?

https://github.com/paritytech/substrate/pull/8038#discussion_r574507517

bot merge

bot merge

Sorry, will fix the unwraps in #8123 😄 the async runtime is discussed here: https://github.com/paritytech/substrate/pull/8038#discussion_r578991856


bug: stamp_c3 board has incorrect CONFIG_SYS_CLOCK_HW_CYCLES_PER_SEC in defconfig

Describe the bug
k_msleep() in this code only waits a fraction of a second.
int main(void){
    int i = 0;
    while(1){
        printk("Hello World %u %d! %s\n",CONFIG_SYS_CLOCK_HW_CYCLES_PER_SEC, i, CONFIG_BOARD);
        k_msleep(1000);
        i++;
    }
}

When overriding CONFIG_SYS_CLOCK_HW_CYCLES_PER_SEC with 16000000 (default value if I comment away the config in the def_conf file of the board) in my prj.conf, it works as intended.
I'm not 100% sure I understand to what this config refers to (the MCU should be running at 160MHz, what clock is this exactly)
@soburi @carlescufi could I be missing something here?
Expected behavior
Should print every one second.
Zephyr revision: 4d76e26f173060d0fd0c9ccbed1e617fff615434
Platform: Windows
Blame: https://github.com/zephyrproject-rtos/zephyr/blame/ed040f187375cea20b5cceab2a3697a5e305980b/boards/riscv/stamp_c3/stamp_c3_defconfig#L8
Impact
Simple example does not work as intended.

Indeed stamp_c3 is redefining HW clock cycles, causing this.

@sylvioalves, you're right. One of my concerns when changing the clock frequency is the need to update both the clock-frequency in the DTS and CONFIG_SYS_CLOCK_HW_CYCLES_PER_SEC in prj.conf.
I'm not certain if it's possible to do a compile-time check within a source file (perhaps a dedicated dummy file for compile-time checks to avoid cluttering the include files).
Here's an idea:
#if (CONFIG_SYS_CLOCK_HW_CYCLES_PER_SEC != DT_PROP(DT_PATH(cpus, cpu_0), clock_frequency))
#error "SYS_CLOCK_HW_CYCLES_PER_SEC must match with CPU clock!"
#endif

Another approach, seen in other SoCs like atmel_sam, atmel_sam0, and gigadevice, is to define the default value in Kconfig.defconfig as the same as in the DTS:
config SYS_CLOCK_HW_CYCLES_PER_SEC
	default	$(dt_node_int_prop_int,/cpus/cpu@0,clock-frequency)

@ndrs-pst I don't feel very familiar with the whole zephyr architecture just yet, but why would we need to update the DTS file as well?
If I understand, SYS_CLOCK_HW_CYCLES_PER_SEC is defined by the SoC Kconfig and defaults to 16MHz.
By the way, since I will be working with this platform for a few weeks, let me know if a pull request would be welcomed.
In this time I will be trying to integrate ESP-NN accelerated kernels in TensorFlow Lite (it currently seems to be running locally), do you know if anyone should be involved on this topic?

@Yaxit The CPU clock frequency setting depends on the SoC initialization code. As you can see, the actual values for setting the CPU clock frequency are defined by CONFIG_ESP32C3_DEFAULT_CPU_FREQ_MHZ and ESP_SOC_DEFAULT_CPU_FREQ_MHZ.
These settings are not directly related to SYS_CLOCK_HW_CYCLES_PER_SEC.
However, higher-level functions, such as k_msleep(), depend on this value. If a different value is used, it could lead to issues, as you have now confirmed.
About TensorFlow Lite, I'm not sure maybe someone who involved in this folder?
https://github.com/zephyrproject-rtos/zephyr/commits/main/modules/tflite-micro

I haven't tested it yet, but
https://github.com/zephyrproject-rtos/zephyr/commit/cff71c8d2b5b31c1e8d7a62371817da9177e002d
It looks like the following line should have been deleted along with this correction.
https://github.com/zephyrproject-rtos/zephyr/blob/f688532412432987682716de60bdf17f2afd4b38/boards/riscv/stamp_c3/stamp_c3_defconfig#L8
I think it will work if you delete it, but I haven't tested it yet.
(I created stamp_c3 mostly based on esp32c3_devkitm.)

@soburi Looks like that's the way. So the PR from you can close this issue 😉.

@soburi yes I did test it, it works when the line is removed.

Is that a PR to fix this already?

Is that a PR to fix this already?

Yes, The #66922 fixed this issue.


qt6Packages.qtdeclarative: does not build reproducibly

Building this package twice does not produce the bit-by-bit identical result each time, making it harder to detect CI breaches. You can read more about this at https://reproducible-builds.org/ .
Fixing bit-by-bit reproducibility also has additional advantages, such as avoiding hard-to-reproduce bugs, making content-addressed storage more effective and reducing rebuilds in such systems.
Steps To Reproduce
nix-build '<nixpkgs>' -A qt6Packages.qtdeclarative --check --keep-failed

You can use diffoscope to analyze the differences in the output of the two builds.
To view the build log of the build that produced the artifact in the binary cache:
nix-store --read-log $(nix-instantiate '<nixpkgs>' -A qt6Packages.qtdeclarative)

Additional context
https://reproducible.nixos.org/nixos-iso-gnome-runtime/diff/a1c9c89fb3168282d64c64feff4b1114a7baf686bbaf93be3559d08c1cf2b238-ba6832ff08079ae4ec355297f0e39f4114b11a77eb22315c2e5eed514494ec34.html

(this is not showing up in the latest report, may have been fixed or not reproducibly unreproducible)

(closing until we see it again)


Generate or update only on failed test

Is there an option that allow us to update base folder only on failed tests?
I means that when I update the base folder, I need to update all the visual snapshots, but I only want to update and commit on failed tests.

You can use this plugin to filter out and run only your visual tests. just need a bit of work in tagging/keyword
https://github.com/cypress-io/cypress-grep

This is out of the scope of this plugin.


Adding Page Sub Navigation Hooks

Description
This adds hooks for Page Sub Navigation
Visual changes
None
Functional changes

[x] Code style has been fixed by running the composer cs command.
[x] Changes have been tested to not break existing functionality.
[x] Documentation is up-to-date.

Hi, apologies but we are no longer accepting new features for v3 as per #13744. Also, please check out our contributing guide which talks about proposing the feature before submitting the PR, to ensure you aren't spending time building something that we won't merge.
Please open a discussion and @danharrin so we can talk about the implementation, I'm unsure if using the same hooks for both sidebar and topbar nav is useful? What if the HTML between them differs? I'd need to see a use case.

Well they are both sub-navigation... you can't have both on the same page, right? and you can scope for the pages you want it differently...
I'm totally fine having different hooks too...
altho i don't see this as a new feature... i understand...

I created this discussion: https://github.com/filamentphp/filament/discussions/14134
Thanks


Fix creating fields for attached properties called name. closes #12283

What does the pull request do?
This fixes the issue that the Avalonia.Generators is creating fields for attached proerties that have the name "Name"
What is the current behavior?
A field is created for attached properties called "Name", leading to compile errors, if they contain characters not valid for field names like spaces. A common use case for this is the AutomationProperties.Name. (#12283)
What is the updated/expected behavior with this PR?
No field is generated for attached properties with name "Name"
How was the solution implemented (if it's not obvious)?
Filtering out attached properties in XamlNameResolver by checking if DeclaringType is different to TargetType.
Checklist

[x] Added unit tests? -> adjusted existing test
[ ] Added XML documentation to any related classes? ->not relevant
[ ] Consider submitting a PR to https://github.com/AvaloniaUI/Documentation with user documentation -> not needed

Breaking changes
Technical yes, if users would have relied on a wrongly generated field, but I would say that is rather unlikely and is easily fixable by the user.
Obsoletions / Deprecations
none
Fixed issues
Fixes #12283

You can test this PR using the following package version. 11.0.999-cibuild0038030-beta. (feed url: https://nuget-feed-all.avaloniaui.net/v3/index.json) [PRBUILDID]

You can test this PR using the following package version. 11.0.999-cibuild0038036-beta. (feed url: https://nuget-feed-all.avaloniaui.net/v3/index.json) [PRBUILDID]

@maxkatz6 Any idea why integration tests are failing? Seems winappdrive had some connection issues, can these be re-triggered?

You can test this PR using the following package version. 11.0.999-cibuild0038072-beta. (feed url: https://nuget-feed-all.avaloniaui.net/v3/index.json) [PRBUILDID]


ROS Noetic Compatibility Changes

These changes make the rrt_exploration package compatible with ROS Noetic

Python 3 is the default for ROS1 distributions starting from Noetic. Hence, the shebang has been updated to point at python3.
Integer division result is different between python2 and python3. For example, 3/2 is 1 in python2 but 1.5 in python3, however, 3//2 is 1 in python3.  Hence, the / operator has been replaced with // to get floored integers.

With these changes, I was able to run the rrt_exploration package on my custom robot + ROS Noetic successfully. Please find the associated launch file for a single robot exploration scenario here.

Hey @prabinrath , when I am trying to run your fork in ROS noetic, my robots are not moving. Nothing gets printed on terminal after "Waiting for the robot transform". Can you help?

@phoenixrider12 the message is "Waiting for the robot transform", I guess your TF graph is probably not connected. Your robot needs to be navigation ready before you can use RRT exploration. For getting started with this package I had to tune some parameters. This package is designed for multi-robot systems and running it on a single robot system without the "robot_1" namespace requires overriding default params in the launch file. You can refer to my launch file that sets these parameters for the package here.

see the tf_tree is correct I think and autonomous navigation works on my robot so I think its navigation ready. I also tried with your launch file but the issue is still same

@phoenixrider12 please share the link to your package. The information you have provided is not enough to debug the issue. There are a plethora of reasons that may lead to the issue you are facing. It is not related to this thread for ROS Noetic compatibility. I would suggest you create an issue in your repository and share the link with me at<EMAIL_ADDRESS>


Tooltips for sidebar tabs

When you hover over the tabs in the left sidebar there's no tooltip so you have to click on each tab to see what it is. Minor nit but tooltips would be nice.

This is addressed via the pull request here: https://github.com/microsoft/BotFramework-Composer/pull/2691
Closing as a dupe of an existing a11y ticket.


Dataset Configuration Issue for TreeSatAI-TS Results Reproduction

Hello,
We are working on reproducing the results from the paper on the TreeSatAI-TS dataset but have encountered some issues related to the dataset configuration.
In accordance with the instructions, running python src/train.py exp=TSAITS_OmniSAT calls the file ./src/data/TreeSAT.py, which expects the TreeSatAI-TS dataset to be organized in the following structure:

`./data/TreeSAT/
│
├── train_filenames.lst
├── val_filenames.lst
├── test_filenames.lst
│
├── labels/
│   └── TreeSatBA_v9_60m_multi_labels.json
│
├── aerial/
│   ├── image1.tif
│   ├── image2.tif
│   └── ... (additional aerial image files)
│
├── sentinel/
│   ├── image1.h5
│   ├── image2.h5
│   └── ... (additional Sentinel-1 and Sentinel-2 HDF5 files)
│
├── s1-asc/
│   ├── image1.pth
│   ├── image2.pth
│   └── ... (additional Sentinel-1 Ascending `.pth` files)
│
├── s1-des/
│   ├── image1.pth
│   ├── image2.pth
│   └── ... (additional Sentinel-1 Descending `.pth` files)
│
├── s1/
│   └── 60m/
│       ├── image1.tif
│       ├── image2.tif
│       └── ... (additional Sentinel-1 60m resolution images)
│
└── s2/
    └── 60m/
        ├── image1.tif
        ├── image2.tif
        └── ... (additional Sentinel-2 60m resolution images)
`

However, the sentinel.zip file available at the provided dataset link (https://huggingface.co/datasets/IGNF/TreeSatAI-Time-Series) only contains .tif images located in the s1/ and s2/ 60m/200m subfolders. It does not include the .h5 files expected in the sentinel/ folder.
Additionally, the s1-asc/ and s1-des/ folders are missing, along with their corresponding .pth files. This seems to be a separate issue, as the .pth files are not present in the shared dataset at all.
Could you please provide guidance on resolving these discrepancies or point us to the correct dataset files? Thank you very much!

Hi,
Thank you for your detailed issue.
Concerning the .h5 files, there are located in the sentinel-ts.zip archive that is available at the dataset link.
Concerning s1-asc and s1-des .pth files, I indeed do a prepocessing to replace NaNs present in some dates. I've added the code preprocess_tsaits.py in src/utils/.
Do not hesitate if you still can not reproduce the experiments!

Hi, Thank you for your detailed issue. Concerning the .h5 files, there are located in the sentinel-ts.zip archive that is available at the dataset link. Concerning s1-asc and s1-des .pth files, I indeed do a prepocessing to replace NaNs present in some dates. I've added the code preprocess_tsaits.py in src/utils/ to run once or to integrate the dataloader if you prefer. Do not hesitate if you still can not reproduce the experiments!

Hi @gastruc , thank you for your reply
Since sentinel.zip (downloaded from the dataset link you had shared) contained only .tif files (and not .h5), what we did was to extract sentinel-ts.zip into the sentinel folder. However, running the script preprocess_tsaits.py gives the below error-
FileNotFoundError: [Errno 2] Unable to synchronously open file (unable to open file: name = './TreeSat/sentinel/Abies_alba_1_1005_WEFL_NLF.h5', errno = 2, error message = 'No such file or directory', flags = 0, o_flags = 0)
The sentinel-ts.zip seems to contain the file Abies_alba_1_1005_WEFL_NLF_2020.h5 (which is the closest to Abies_alba_1_1005_WEFL_NLF.h5'). Please could you let us know how do we proceed from here? Thanks!

Hi,
Yes you did the proper extraction. Indeed, I renamed all .h5 files with suppressing the last date (''.join(name.split('')[:-1])) for the names to match the other files. Hope that this time, you'll be able to reproduce the experience!

Hi @gastruc we are encountering the same issue with preprocessing the sentinel-ts/ folders. The core issue is that the names of the files in the split lists (<split>_filenames.lst) are of format: <species>_<serialnumber>_<metadata>.tif , whereas the filenames in the timeseries folder (sentinel-ts/) is in the format: <species>_<serialnumber>_<metadata>_<year>.tif
For this preprocessing code to work, you'd have to either:

Match all years for a given filenames from the train/val/test lists within the preprocessing loop, or
Add each year into the names of the train/val/test lists

Hi,
My solution has been to rename all files with suppressing the date in the name. I've updated the preprocess code in the git to perform this while preprocessing.


No class arguments

See #1085

I think that'll do it!  Feel free to have a look.  I'll merge it in in a couple of days