Differences in SLURM command between what Snakemake says it runs and what is actually run

Dear developers
I have a rule that produces unexpected results when submitting to slurm (Snakemake version: 8.10.0). So, I turned on verbose in order to double-check that the command was formatted correctly. According to Snakemake, the following command was submitted to slurm:
gatk SplitIntervals -R some_file       -L some_file        --scatter-count 32       --subdivision-mode BALANCING_WITHOUT_INTERVAL_SUBDIVISION              -O some_folder

Job 11 has been submitted with SLURM jobid 633204 (log: /.../633204.log).

Then I opened the referenced 633204.log and here the command looked like:
gatk SplitIntervals -R some_file       -L some_file        --scatter-count 1       --subdivision-mode BALANCING_WITHOUT_INTERVAL_SUBDIVISION              -O some_folder

Notice how the --scatter-count option has changed from 32 to 1, which explains the unexpected results. This number is based on available cores and is calculated like this in my workflow:
large_job_cores = max(1, math.floor(workflow.cores / len(SAMPLES)))
Since this number has apparently changed between the main workflow and the slurm submission, I wonder if Snakemake is run a second time for each slurm submission? If so, workflow.cores (and maybe other parameters) should be transferred somehow from the main workflow to the slurm submission.
Thank you for all your hard work!
Cheers!

Hi,
Thanks for the feedback!
The SLURM executor plugin is oblivious to whatever you write in your Snakefile, except for threads and cpus_per_task (the latter usually defined as a resource in a workflow profile).
So, how is large_job_cores propagated further? Please show us that code to elaborate whether we are dealing with a bug, indeed. Thank you!

Thanks, certainly.
large_job_cores is used to control multithreading in rules that launch multi-threaded programs. In addition, parallel computing is also achieved for certain single-threaded jobs by splitting input files in chunks before running them. The latter is what SplitIntervals is for and it creates as many chunks as you instruct it to via the --scatter-count option.
I don't know if it will help to shed some light on this, but here is how large_job_cores is used in that rule:
large_job_cores = max(1, math.floor(workflow.cores / len(SAMPLES)))
INTERVAL_SUBDIVISION_NUMBERS = [str(i).zfill(4) for i in range(large_job_cores )]

rule subdivide_intervals_file:
    input:
        intervals_file = rules.create_intervals_file.output.intervals_file,
        ref = rules.prepare_genome_files.output.fasta_ref,
        ref_index = rules.prepare_genome_files.output.ref_index,
        ref_dict = rules.create_reference_dict.output.ref_dict
    output:
        scattered_interval_lists = expand(os.path.join(intervals_folder,'{subdivision}scattered.interval_list'),subdivision=INTERVAL_SUBDIVISION_NUMBERS)
    conda:
        conda_environment
    params:
        intervals_folder = intervals_folder
    log:
        os.path.join(logs,'subdivide_intervals_file.log')
    shell:
        """
        gatk SplitIntervals \
       -R {input.ref} \
       -L {input.intervals_file} \
       --scatter-count {large_job_cores } \
       --subdivision-mode BALANCING_WITHOUT_INTERVAL_SUBDIVISION \
       -O {params.intervals_folder} \
       > {log} 2>&1
        """

Since large_job_cores has a direct consequence for the expected output files of this rule, Snakemake throws a missing files error . That is, on a workflow run where large_job_cores evaluates to 32, Snakemake says it submits the correct job command, but as the slurm log shows, this number has been changed to 1. So Snakemake expects 32 files, but only one gets produced. For the rules that runs multithreaded programs, i expect that they will also run with just one core instead of the expected 32. However, no missing files error arise in those cases.
In any case, I expect that differences between what Snakemake says it sends to slurm and what is actually sent is not something one would want. Thank you for looking into this.
Cheers.

OK, thank you. This is no bug in the executor, but rather one in your Snakefile. Let me explain:
You instruct your executable to use a number of resources. Yet, upon submission, nothing will be reserved. I suggest changing to either
rule subdivide_intervals_file:
    <snip>
    resources:
        cpus_per_task: large_job_cores
    <snip>

or
rule subdivide_intervals_file:
    <snip>
    threads: large_job_cores
    <snip>

However, as large_job_cores presumably gets calculated on a login node, you might want to consider that your assumption does not hold, when the number of cores is different there compared to compute nodes.

I just hope, I did not make a mistake for obviously my advice is untested.
Cheers
Christian

Thank you, Christian.
I am not sure I agree, though. I believe the error originates (or is exemplified) in the property, workflow.cores, which appears to have two evaluations when running the workflow with the slurm executor:
In the context of my data, the first evaluation seems to be when Snakemake builds the DAG and figures out the names of input and output files. Here it is evaluated to the expected 32 as evident from the verbose output and the list of expected output files from subdivide_intervals_file. This rule, by the way, always runs single-threaded, but the filenames it is supposed to output depend on the evaluation of workflow.cores, which reflects on large_job_cores.
The second evaluation seems to be when the job is submitted to slurm where it appears to take on the value of 1. It is possible that it gets calculated on a login node, as you suggest, but if that is indeed the case, isn't that a problem?
If this is the expected behavior, then it means that workflow.cores cannot be used when slurm is used as the executor. I hope this is not the intended behavior, but if it is, it should be clearly indicated in the documentation.
Cheers,
Steffen

Hi,

I am not sure I agree, though.

Try the following:
#!/bin/bash

#SBATCH ... # all the settings for your job submissions
#SBATCH -c1
echo "I want to run with n-threads, but am confined to ${SLURM_CPUS_PER_TASK} threads."

Whatever is asked for at submit time, is available in the job context - if physically possible and not otherwise restricted by settings. When you calculate your max. number of threads on the login node and not use it for submission (by means of Snakemakes resources), you will not get the resource in the job context. If you recalculate in the job context, depending on the tools you use, you will get different numbers, e.g. the available threads in the c-group, the number of CPUs on the node, etc.. This is not reliable. The workflow.cores-Variable will yield different values, too: Snakemake essentially submits itself. Hence the re-evaluation.

Hmm, thanks but I fail to understand how this addresses my disagreement. So let me try to be more specific as to why I disagree and hopefully you will take a another fresh look at this. Thank you for taking the time.
I don't agree that there is a bug in my snakefile. Why? Because it works and runs as expected if I do not reference workflow.cores. Conclusion: workflow.cores is the culprit here and we can sweep everything else off the table and focus on that.
And just to be clear: workflow.cores is mentioned in several places in the main Snakemake documentation as a resource that is available to the user.
Another important remark is this: workflow.cores does NOT represent an evaluation of the available compute environment. Instead, it reflects the requested number of cores when snakemake is called. That is, if I call snakemake like this on a single core machine:
snakemake -s snakefile.smk -c1000

the value of workflow.cores is 1000
So, speculations on the influence of the login node can also be set aside.
The question now is this: Why does workflow.cores get redefined, when using slurm as the executor? It shouldn't get redefined.
I don't have any experience with the Snakemake codebase and I am not familiar with dataclasses, but a quick comparison between the code for snakemake-executor-plugin-slurm and the skeleton for executor plugins reveals that the workflow seems to get referenced in the skeleton's _post_init_ function in the Executor, but not in snakemake-executor-plugin-slurm.
Thus, I may be completely wrong but based on this, my best guess is that workflow.cores is undefined and therefore, a default value of 1 is used.
Cheers.

Sorry, I should have been more elaborate:
The idea is to trigger a workflow run on the login node. This is the first invocation of Snakemake. workflow.cores is evaluated to a number. Some jobs, those not defined as localrules, get submitted. This is where the jobstep-executor plugin kicks in. It is the second invocation of Snakemake per (group) job. workflow.cores is re-evaluated.
Now, cluster admins might treat this differently, but the default is, that SLURM sets it c-group according to values present at submit time (we will not consider a case where a job is rejected due to faulty parameters). Basically, there are two scenarios:

the c-group is most likely smaller than your "allowance" on the login node (for a shared memory application is cpus_per_task big, which is equivalent to threads - any setting is fine). Hence, the apparent(!) core count based on workflow.cores will be lowered.
if the calculation is not based on the c-group, the compute node might still be different in terms of core number (compared to the login node - let's disregard the little but important difference of cores and CPUs for this discussion).

In both cases, we suffer from a deviation for the apparent cores. As your count for workflow.cores is 1 in job context, I presumed you suffer from scenario one.
This is why upon workflow design we need to ensure that whatever we want to use in terms of resources needs to be reserved. And it is the reason, too, why we ought to store any resource calculation as a parameter of the rule.
But yes, this limits the use case of workflow.cores somewhat. I will put it in the documentation of this plugin!

I wonder if this has been fixed via this fix?


DBZ-8082: Pass Headers to Key/Value Converters

Part of: https://issues.redhat.com/browse/DBZ-8082
We want to be able to use headers in the key/value converter. When a configuration is set, the headers will be passed through to the converters.
My gut reaction to the increased complexity this configuration adds would be to keep the code clean and change the default behaviour. Converters by default call the current method if you pass the Headers so I think we don't need a configuration. I understand the extra cast will be slower - but I'm curious if that really warrants the extra complexity.
    /**
     * Convert a Kafka Connect data object to a native object for serialization,
     * potentially using the supplied topic and headers in the record as necessary.
     *
     *
Connect uses this method directly, and for backward compatibility reasons this method
     * by default will call the {@link #fromConnectData(String, Schema, Object)} method.
     * Override this method to make use of the supplied headers.

     * @param topic the topic associated with the data
     * @param headers the headers associated with the data; any changes done to the headers
     *        are applied to the message sent to the broker
     * @param schema the schema for the value
     * @param value the value to convert
     * @return the serialized value
     */
    default byte[] fromConnectData(String topic, Headers headers, Schema schema, Object value) {
        return fromConnectData(topic, schema, value);
    }

I still need to add some testing but I'd love a first pass at the general structure.

Perfect - thanks!
I'm still tempted to say that an implementation more akin to https://github.com/debezium/debezium/compare/main...ryanvanhuuksloot:debezium:rvh.example-record-headers may be generally simpler to maintain and basically as fast.
I'm actually using ^ in our test environment over this PR because I don't have to change configs so I can give a basic idea of profiling if there is interest.

@jpechane Change made
I don't love the test but the engine only supports SourceRecord so without a larger refactor I had to hack around using a new engine.
We don't have a great environment for building locally so I assume some spotless may be off but the functionality should be available for review now.

Reformatted, rebased and force-pushed. When CI finishes the PR is ready for merge.

@ryanvanhuuksloot Applied, thanks!

Reformatted, rebased and force-pushed.

Thank you! I missed that there were more style issues.


When using named import from styled-components both babel and swc plugins are ignored.

When using named import from styled-components both babel and swc plugins are not used.

Funnily enough in codesandbox the behavior is exact opposite
Environment
System:

OS: Linux 5.15 Debian GNU/Linux 11 (bullseye) 11 (bullseye)
CPU: (2) x64 AMD EPYC
Memory: 617.30 MB / 2.01 GB
Container: Yes
Shell: 5.8 - /bin/zsh

Binaries:

Node: 18.15.0 - /usr/local/bin/node
Yarn: 1.22.19 - /usr/local/bin/yarn
npm: 9.5.0 - /usr/local/bin/npm

npmPackages:

babel-plugin-styled-components: ^2.1.3 => 2.1.3
styled-components: ^6.0.0-rc.2 => 6.0.0-rc.2-4007

Reproduction

https://codesandbox.io/p/sandbox/jolly-haze-sf21k4
Steps to reproduce
Use babel-plugin-styled-components and named import from styled-components package
Expected Behavior
displayName is correctly added to class
Actual Behavior
displayName is not added to class

When using named import from styled-components both babel and swc plugins are not used.

Actually looking at your sandbox, it looks like only the button using the named import worked... I wonder if the plugin can handle one or the other but not both.


Declare package typed

Codecov Report

Merging #104 (51add7c) into main (09af28d) will increase coverage by 0.01%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main     #104      +/-   ##
==========================================
+ Coverage   96.47%   96.48%   +0.01%
==========================================
  Files          12       12
  Lines         936      939       +3
  Branches      101      101
==========================================
+ Hits          903      906       +3
  Misses         18       18
  Partials       15       15

Impacted Files
Coverage Δ

tests/test_20_sentinel1.py
100.00% <100.00%> (ø)

xarray_sentinel/sentinel1.py
94.89% <100.00%> (+0.01%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 09af28d...51add7c. Read the comment docs.


Fix Carto/Mapzen API urls

#hacktoberfest

Thanks for this @JoseBorges! I'm going to close this PR in favour of a more complete version that we've put together for all of the examples: https://github.com/UDST/vizicities/pull/193
For clarification, the old Mapzen endpoints still work (and have been tested to work) and I'm unaware of any issues with the CartoDB endpoints as of yet.


SPARE COIN launched finally! Works now... SEE HERE!

See topic here: https://github.com/Spare-Network/spare-blockchain/issues/32
Its now working. You need to update to the latest build! They have changed the SSL vertifications and the difficulty (7).
Feels like I really was one of the first farming in spare. WOHOOO.
Never had so many nodes in my Chia GUI. :))

who thow so many plots in? allready 23PiB

Excellent. All working for me too for the past 10 minutes. Now all I need is the total network space to stay low while I mine haha

yes, can confirm, works now, third time was the charm!

how do i update

Now at 28 PiB. We will very fast overtake chaingreen. Flax is at 300 PiB now.

mine still trying to sync to 27xxx
:(

YOur still on the old one
Install the wallet again delete blockgain and it should work

this is my first time installing this and its just keeps trying to connect. any help would be greatly apparated

this is my first time installing this and its just keeps trying to connect. any help would be greatly apparated

Opened the port 9444 at your firewall?

After starting spare.exe GUI starts and shows "Connecting to wallet", circle is spinning. Do I have to start Chia GUI too?

Why is the total network capacity 30PB, shouldn't TB?

EVERYTHING IS WORKING: YEAAAAAAAAA !!!!!!!!!

Tu todavía estás en el viejo
Instale la billetera nuevamente, elimine blockgain y debería funcionar

podrias ser mas especifico, soy muy nuevo en esto

Tu todavía estás en el viejo
Instale la billetera nuevamente, elimine blockgain y debería funcionar

You should delete everything (including the ".spare-blockchain" directory in your User-directory on C:\ in windows) and then start from scratch after downloading the current files from github.


add hungarian (HU) translation

Hi Olton! Could you please review this PL and merge it to develop? Thanks!

Thanks


Update README.md | Added Maintainability Badge

The badge is added, which points to your Github-repo. Please let me know if it works for you.

Codecov Report

Merging #100 (b221e4c) into master (e64a6f3) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #100   +/-   ##
=======================================
  Coverage   61.73%   61.73%
=======================================
  Files           3        3
  Lines         311      311
  Branches       48       48
=======================================
  Hits          192      192
  Misses        112      112
  Partials        7        7

Flag
Coverage Δ

unittests
61.73% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e64a6f3...b221e4c. Read the comment docs.

Hi. Another PR for this (#98) was sent for this issue before yours. I will have to close this PR since #98 was merged.
Thank you for contributing though! You can check out the open issues if you would like to work on one.


Added vendorExtensions to document root

It would be great if you submit this MR. I'm really stuck on this.


Proper way to include your code in my library?

Hi, I am building a similar library (inspired by yours but crafted to my own needs), and I am using one of your file locale.rs.
I am wondering:

If I can include the file in my library (using MIT License)
I did not make change to the file, which includes the Copyright comments. Is this enough? I have following lines at the beginning of the file:

//
// This file is taken from https://github.com/OSSystems/compress-tools-rs/blob/master/src/ffi/locale.rs
// All the credit goes to https://github.com/OSSystems
//
// Copyright (C) 2021 O.S. Systems Software LTDA
//
// SPDX-License-Identifier: MIT OR Apache-2.0
// ...

Please let me know. If this is inappropriate, I apologize and I will delete the file

It is totally fine to reuse the file. Why couldn't we work together and avoid duplicated work?  What is missing in this crate?

Hey thanks for allowing me to reuse the code first of all.
In compress-tools, the file content is read by blocks into a Write. It only finishes when all the blocks are read or an error happens. In my use case, I want to return each block when after reading it, and I want to be able adjust the block size.
It's a pretty edgy case, so I don't think it's worthwhile to refactor compress-tools to support it. I have tried to add the functionality to compress-tool directly, but it requires a lot of work to breakdown the current structure of run_with_archive. The function releases the resource when it's done, so we have to read all blocks before the function ends.
Overall, thanks for your great work on this library! My library will mostly serve my own edgy use cases, and I would definitely come to compress-tools for the most common scenarios.


Support shortened command & dir name in xterm title plugin

This allows the user to see only last level of the current path (if dirname is longer than 8 chars),
and only first word of the ongoing command line if it's longer than 8 chars.
For example:
find / - type f {/var/foo/long} (user@server)

will become:
find {long} (user@server)

Thanks!


Issue with "Set Up Your Dev Environment" in @site/docs/tutorials/tut-setup-dev.md

Describe the problem

Page: Set Up Your Dev Environment
Source: https://github.com/demisto/content-docs/tree/master/docs/tutorials/tut-setup-dev.md

Stale link

The link to the poetry installation is no longer available (Note: /master/ isn't in the correct URL) and it seems that the option to install with the official installer is deprecated.
From the poetry docs:

The install-poetry.py installer has been deprecated and removed from the Poetry repository. Please migrate from the in-tree version to the standalone version described above.

Screenshots

Environment

OS: N/A
Browser: N/A
Browser Version:

Suggested fix

I am not sure which installation method you should recommend instead, but this URL should be a good start: https://python-poetry.org/docs/#installation

Hi @bneises, thanks for opening an issue.
As far as I understand, the install-poetry.py installer is an older installer, separate from the one described underneath the warning box. Running curl -sSL https://install.python-poetry.org | python3 - should work just fine.


<class 'AttributeError'> - 'NoneType' object has no attribute 'date'

Dear Dev,
I have this error:
`2024-08-28 10:32:08 :: [product.py               ] - [release_date_extractor ] - [ERROR   ] - Release date does not have a Z for the asin B0CR5PRBVW.
2024-08-28 10:32:08 :: [main.py                  ] - [               ] - [CRITICAL] - Error during bot execution: <class 'AttributeError'> - 'NoneType' object has no attribute 'date'`
I'll start by saying that I've been using the bot for about 2 weeks without any problems. In the last few days it's giving me this error. How can I fix it?

Hi @the0x1d3 , First of all, thank you for choosing my bot for your Telegram channel. The more people use it, the more I can maintain and improve it in the future. Unfortunately, at the moment, my API key has expired because there haven’t been any recent purchases through my link. For this reason, I can’t fix any bugs on my own until a purchase is made through my link.
However, I think I’ve identified the issue. If you can run some tests, we can check what’s causing the error. Specifically, the product you mentioned with ASIN: B0CR5PRBVW does not have a release date. In the file: /src/utils/product.py, the method release_date_extractor wasn’t handling the error properly. It handles the error if the release is None, but something must have happened that prevented it from processing correctly.
Go to the file: /src/utils/product.py and modify the release_date_extractor method as follows:
else:
            logging.error(f"Release date does not have a Z for the "
                        f"asin {asin}.")
            logging.error(f"{release} -- {release is None} -- {type(release)}")

After doing this, you need to force the program to search for that ASIN (B0CR5PRBVW) again. This way, we can see what’s causing the error and proceed to resolve it.


breaking: seprating sections with \n\n & drop SSHConfig.find()

cc @roblourens
closes #23 (again)

v3.0.0 released


[bug] issue with the exports field in the react-image-crop package's package.json file

Hi,
There is issue in package.json of react-image-crop in the latest version of the package, which prevents the ReactCrop.css from being imported.
Solution:

adding "./dist/ReactCrop.css": "./dist/ReactCrop.css" to exports field located in the node_modules/react-image-crop directory.

Thanks I'll add that, I thought it would fallback to the real path and find it without having to specify

Published, could you try 10.1.1 please?


Optimize error handling

Motivations: greptimedb has done an excellent job in error handling, see: https://greptime.com/blogs/2024-05-07-error-rust
Shall we adopt some ideas from it?

yeah the stack trace looks nice. i'd be up for using it

demo code, i've written a simple demo, mostly based on greptimedb's impl, since they haven't published the error handling crate yet, it shall be much more convenient to take a glance at their ideas of virtual user stack , the blog is already pasted above

Nice! Planning to make a crate for this?

Nnope, the idea belongs to greptime db, i just wondered how easily can we adopt it in our project. Is this way of error handling better from your point of view? After which i shall start the refactor in this project.

Ok makes sense.
Yeah I like it, seems clean way to track error stack and easier to report the where the error originates.


[1.1.x] Do not use generator for jobs need to be run in pool | fix tests | remove unused import | move deserialize into remote finder | Multi-instance settings support | Fix default values in manage.py | Fix

Backports the following commits to 1.1.x:

Do not use generator for jobs need to be run in pool (#2350)
fix tests (#2350)
remove unused import (#2350)
move deserialize into remote finder (#2354)
Multi-instance settings support (#2358)
Fix default values in manage.py (#2358)
Fix - a fallback have been added (#2358)
Update config-local-settings.rst (#2358)
test with and without buffering (#2354)
Update FreeBSD/OpenBSD netcat switch (#2366)
Generalized nc example (#2366)
use path hash to locate tagged series (#2368)
reduce duplication, maintain get_series interface (#2368)
make _get_series a static method (#2368)
Fix carbonlink queries for tagged series. (#2370)
flake8 cleanup (#2371)
With PR #2295 the top nav dashboard fails to render the default tree (#2372)
Also have to override the input box value of '' with '*' because query='' is a "bug" (#2372)
fix rrd paths (#2383)
docs: add link to regex documentation (#2381)
remove unused import (#2383)
Add tests for RRDReader (#2383)
fix typo in comment (#2383)
Add coverage for composer's send_email function  (#2174)

.tarvis.yaml changes from #2383 are lost somehow...
will redo that


Add example screenshots of the TUI to the README

I think an nview TUI screenshot at the top of the README and maybe a few more examples at the end would really help give a quick visual, be pretty convincing and motivating for running nview. It's really an awesome TUI I think it would really be a big benefit.

I will definitely do this once I finish the UI rewrite. It'll give it a more unique look and also update the functionality a bit.


How to make the inner div horizontal scroll when container has swipeleft/swiperight gesture?

I bind the swipeleft/swiperight gesture to a container div, it works fine.
There is a div included in the container which has css style overflow-x:scroll to show wide contents.
The problem is the inner div cannot scroll horizontal now.
How to disable the container gesture while touch on the inner div?

I'm having the same problem, but in the vertical direction. I'd also like to know how to get this to work. @dengdengxia, how did you solve it?

@dengdengxia @cupofjoakim unfortunately you can't use touch to produce gestures and allow scrolling in the same direction as the gestures.  You may want to setup hammer in a way that it doesn't listen events originating in the scrollable div, or use a custom scroll solution.  In any case, it's bad UX to have a gesture and a scroll behavior that both trigger horizontally or vertically.


Command EXPIRE accepts 2 parameters but method declares 4 parameter(s)

Bug Report
Current Behavior
Assuming we have declared a an increment command. An exception is raised.
Caused by: io.lettuce.core.dynamic.CommandMethodSyntaxException: Command EXPIRE accepts 2 parameters but method declares 4 parameter(s). Offending method: public abstract java.lang.Boolean org.bigbluebutton.common2.redis.commands.RecordingCommands.expireKey(java.lang.String,long)
    at io.lettuce.core.dynamic.DefaultCommandMethodVerifier.validateParameters(DefaultCommandMethodVerifier.java:109)
    at io.lettuce.core.dynamic.DefaultCommandMethodVerifier.validate(DefaultCommandMethodVerifier.java:71)
    at io.lettuce.core.dynamic.ExecutableCommandLookupStrategySupport$DefaultCommandFactoryResolver.resolveRedisCommandFactory(ExecutableCommandLookupStrategySupport.java:74)
    at io.lettuce.core.dynamic.ExecutableCommandLookupStrategySupport.resolveCommandFactory(ExecutableCommandLookupStrategySupport.java:48)
    at io.lettuce.core.dynamic.AsyncExecutableCommandLookupStrategy.resolveCommandMethod(AsyncExecutableCommandLookupStrategy.java:47)
    at io.lettuce.core.dynamic.RedisCommandFactory$CompositeCommandLookupStrategy.resolveCommandMethod(RedisCommandFactory.java:273)
    at io.lettuce.core.dynamic.RedisCommandFactory$BatchAwareCommandLookupStrategy.resolveCommandMethod(RedisCommandFactory.java:321)
    at io.lettuce.core.dynamic.RedisCommandFactory$CommandFactoryExecutorMethodInterceptor.<init>(RedisCommandFactory.java:212)
    at io.lettuce.core.dynamic.RedisCommandFactory.getCommands(RedisCommandFactory.java:192)

Input Code
public interface RecordingCommands extends Commands {
     @Command("EXPIRE ?0 ?1")
    Boolean expireKey(String key, long seconds);
}

Expected behavior/code
The code above should work without raising any exception.
Environment

Lettuce version(s): 5.1.2-RELEASE
Redis version: Redis 3.0.6 (00000000/0) 64 bit

Duplicate of #925.


Motor Controller

controller ic
https://no.mouser.com/ProductDetail/ADI-Trinamic/TMC4671-LA?qs=TiOZkKH1s2Q5Kur6316zpQ%3D%3D

[ ] Gate driver
[ ] Current sensor (TMCS1100)
[ ] MOSFETs driver
[ ] Voltage regulator?

we probably need a bulk capacitor and føyback diodes, I am also a bit worried about the current rating on the mosfets

https://no.mouser.com/ProductDetail/Comchip-Technology/CDBU0530?qs=tw%252BuQ%2FB6PO1p1lVxjOIVLQ%3D%3D
diodes for gates and voltage regulator


Release Azure.Core Library Preview for Java

[x] Instrumentation

[x] Distributed tracing - #3382
[x] Centralised logging - #3326

[x] Centralised configuration - #3476
[x] Authentication / identity - #3605, #3505
[x] Rename Azure.Common to Azure.Core.
[x] Clean up

[x] Exceptions - #3591
[x] RestProxy - #3594
[x] HttpHeaders - #3607
[x] HttpPipeline - #3608
[x] ContextData - #3609
[x] Implementation leaks - #3610, #3637, #3638

[x] Quality

[x] Fully JavaDoc'd
[x] SpotBugs clean
[x] CheckStyle clean

Closing issue given the last remaining associated issue (JavaDoc cleanup) has been addressed


Make an essence pouch counter.

a counter to show how many times did a certain pouch got filled and how many times are left until degrade,would be cool and useful.

Duplicate of #4651


mockup design in html/d3 of predicted vs actual

plotly, d3, flask, html
bootstrap

potential to include model status/connectivity status view, related to #18


Deduplicate docs, prepare to get rid of website

The idea is that the docs should the source of truth, and be able to replace the website (#215).
Information from the read-me is also moved to the docs.
The CONTRIBUTING.rst symlink is intended to do a thing on GitHub (see https://docs.github.com/en/communities/setting-up-your-project-for-healthy-contributions/setting-guidelines-for-repository-contributors), but I am not sure how to confirm it will short of merging this PR.

Docs are rendered at https://haskell-alex.readthedocs.io/en/refactor-read-docs-website/

Look good now, @andreasabel?

Thanks for your good work, @Ericson2314 !


variance checks don't take into account whether a property is readonly

Bug Report

🔎 Search Terms
variance readonly

🕗 Version & Regression Information
4.7.0-dev.20220408
⏯ Playground Link

Playground link with relevant code
💻 Code

type Invariant<in out T> = {
    value: T
}

declare const foo: Invariant<{readonly value: number}>

foo.value.value = 1 //error

const bar: Invariant<{ value: number }> = foo

bar.value.value = 2 //no error

🙁 Actual behavior
the value of type Invariant<{readonly value: number}> is allowed to be assigned to the variable of type Invariant<{value: number}>

🙂 Expected behavior
the types should not be compatible because {value: number} is narrower than {readonly value: number} and the Invariant type has an in annotation

Duplicate of #13347. Types with mutable properties and types with readonly properties are treated the same. The optional variance annotations don't change anything about this, because the issue is not about variance.

{value: number} is narrower than {readonly value: number}

It's not. They're the same.


Add caching for Item sources for selection Properties

Caching must be added for:

[ ] Users
[ ] Projects
[ ] Issue States
[ ] Issue Priorities
[ ] Trackers

The main problem is with objects that could reach a number greater than 100 because of the page limitations of current Redmine Version (3.2.0). These are the users and the projects. We could cache them in the redmine client instance so it would be possible to clear the cache if a new project or user is added

@rufer7 I tested the limitation problem with 1000 projects and 478 Users. There are no limitations. All projects are returned at the same time, the same with users.
Do we need the caching anyway?

@oliverluethi I don't know anything about this problem. Probably @dfch knows something and can give some feedback!?

@rufer7 @dfch The current Redmine.Client release uses the GetObjectList<Project> method for getting a list of objects. In the new referenced version of the redmine .NET Api this method is obsolete. I changed this to a different GetObjects<Project> method instead. This method reads all pages until every record is fetched.
So there is no limit anymore. I've implemented a caching functionality already. If there is no need for this anymore we should consider to close this issue.

@oliverluethi ok nice. Did you implement caching as well for users as mentioned in the comment above from Niklaus Jordi?

@dfch can you please give some feedback here?

@rufer7 Probably we won't get any answer here. I did a contribution to the Redmine .NET API for some inheritance fixes for get the caching done on our side.
My commit was merged into the master branch of the zapadi/redmine-net-api project.
You did a nuget package for this library right? At some point we have to rebuild the nuget package with the current release. Without these changes, the code will not compile.

@oliverluethi no we did not yet create a NuGet package for biz.dfch.CS.Redmine.Client. I would suggest we wait with the creation of a NuGet package until zapadi/redmine-net-api gets released. As I saw they are quite active at the moment so I expect we don't have to wait a long time for the next release.


Updated icons and tooltip in test explorer indicating status of test files/suites

For #4583

[x] Pull request represents a single change (i.e. not fixing disparate/unrelated things in a single PR)
[x] Title summarizes what is changing
[x] Has a news entry file (remember to thank yourself!)
[x] Has sufficient logging.
[x] Has telemetry for enhancements.
[x] ~Unit tests & system/integration tests are added/updated~
[x] ~Test plan is updated as appropriate~
[x] ~package-lock.json has been regenerated by running npm install (if dependencies have changed)~
[ ] The wiki is updated with any design decisions/details.

Are those the ones from @luabud?

Actually No. But we are gonna the change the icons eventually anyways ( those don't match with one described in issues). Should i still revert it?

@DonJayamanne @ericsnowcurrently
Implemented based on the comment of Dan:

If any test fails, the parent should be failure, otherwise pass if all tests that ran passed, and not run if no tests ran.


Unable to switch between 'Introduction' and 'Simulation' in PyFR workflow

I see the following errors in the console:

A refresh of the browser renders the correct page.

I've tracked it down to something in the SchedulerConfig/SGE.js but I cannot see a syntax error.

Is there a reason the browser is not reported the syntax error?

It could be a JSX/React error not a js/browser one. Could be with how we're mounting and unmounting them.

I'm going through and checking the JSX key={ } attributes. There are a few places where they may not be specific enough and that could be causing this (and other) errors.

changes in #328 have no effect.

Trying out React 15.0.0, everything is smooth sailing but this behavior still occurs. However the debug output is more helpful and it doesn't lock up the app anymore!

Investigating more...

Cannot read property 'backend' or null... might be related to #303??

So this was tricky one to track down, thanks for your perseverance! It seems that upgrading to React 15 was how we got enough information to resolve it. @TristanWright do you think we should upgrade to 15 to make it easier to resolve these sort of issues in the future? What would be involved in upgrading, just updating package.json?

I would like to upgrade but I'm not sure how it will fully affect our other react dependencies (router, redux) it only came out yesterday afterall. 15 helped with #302, but it gives the same Cannot read property '_currentElement' of null error for the Input step.  I've updated the commit message locally and will be going back to #303 and #326 for now.


cannot install using command in README on OS X

On OS X 10.12.6 the composer create-project command fails.
➔ composer --version
Composer version 1.5.2 2017-09-11 16:59:25

➔ composer create-project nystudio107/craft . -s RC

  [InvalidArgumentException]
  Could not find package nystudio107/craft with stability RC.

Right, for you to use it right now, you'll need to do:
composer create-project nystudio107/craft PATH -s dev

btw, don't use . for the PATH, you'll want at least a relative folder name in there, like:
composer create-project nystudio107/craft testsite -s dev

I didn't expect anyone to be using this quite yet (thus no release tags), it's still a work in progress... but keep any issues coming! :)


Block edge 4.3.28

4.3.28 needs to be disabled:
2 clusters currently failing (11%),  6 gone (33%),and  9 successful (50%), out of 18 who attempted the update over 7d
Currently failing classification:
* Monitoring issues: 1
* Single master: 1

4.3.28 can be enabled again:
1 clusters currently failing ( 7%),  5 gone (33%),and  8 successful (53%), out of 15 who attempted the update over 7d
Currently failing classification:
* Monitoring issues: 1
* Single master: 1


[feature request] return probability from language_name()

language_name() returns the best guess for the language. I would like to know the associated probability such that I can decide if I use the information or not.

you should use then the .probabilities() method, and by your own threshold decide whether is good or not.

Makes sense, thanks!


Incorrect TS types for GET _snapshot/<repo>/<snapshot> response

🐛 Bug Report
The TS type for calling client.snapshot.get is associated with the following type:
https://github.com/elastic/elasticsearch-js/blob/7a3cfe7e23b7a81c563f4deaa2990fed4c321ee9/api/types.d.ts#L6069
When looking at the actual response from the cluster it is of the form:
{
  "responses": [
    {
      "repository": "my-repo",
      "snapshots": [ /* list of snapshots... */ ]
    }
}

The TS type is missing the responses array of objects in which snapshots is nested.
Actual request:
          const response = await client.snapshot.get({
            repository,
            snapshot: '_all',
            ignore_unavailable: true, // Allow request to succeed even if some snapshots are unavailable.
          });

Expected behavior
The TS types should match the shape of the response from the cluster.
Your Environment

@elastic/elasticsearch npm<EMAIL_ADDRESS>

Closed in https://github.com/elastic/elastic-client-generator/pull/274.


Add unnecessary apply rule

This PR adds a rule to check for unnecessary use of apply, as described in issue #1214.

Would also be nice to add a test case where the return value of apply is used:
fun a(i: Int) {
}

a(1.apply {
  println(this)
})

I've added some tests for this.


shopware-cli: 0.4.43 -> 0.4.44

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://github.com/FriendsOfShopware/shopware-cli/releases.
meta.description for shopware-cli is: Command line tool for Shopware 6
meta.homepage for shopware-cli is: https://github.com/FriendsOfShopware/shopware-cli
meta.changelog for shopware-cli is: https://github.com/FriendsOfShopware/shopware-cli/releases/tag/0.4.44
Updates performed

Golang update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 0.4.44 with grep in /nix/store/g9v07l9c198pphnhvc4g6gs3dfvwz207-shopware-cli-0.4.44
found 0.4.44 in filename of file in /nix/store/g9v07l9c198pphnhvc4g6gs3dfvwz207-shopware-cli-0.4.44

Rebuild report (if merged into master) (click to expand)

2 total rebuild path(s)

2 package rebuild(s)

First fifty rebuilds by attrpath

shopware-cli

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/g9v07l9c198pphnhvc4g6gs3dfvwz207-shopware-cli-0.4.44 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A shopware-cli https://github.com/r-ryantm/nixpkgs/archive/b6085a260b1f25847529c3024e6feb889795e426.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/b6085a260b1f25847529c3024e6feb889795e426#shopware-cli

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/g9v07l9c198pphnhvc4g6gs3dfvwz207-shopware-cli-0.4.44
ls -la /nix/store/g9v07l9c198pphnhvc4g6gs3dfvwz207-shopware-cli-0.4.44/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review --extra-nixpkgs-config '{ allowInsecurePredicate = x: true; }' run on x86_64-linux 1

1 package built:

shopware-cli

Maintainer pings
cc @shyim for testing.

@NixOS/nixpkgs-merge-bot merge

@NixOS/nixpkgs-merge-bot merge

@NixOS/nixpkgs-merge-bot merge


Investigate offline mutation store

First investigation for #5
Idea
Investigate how offline mutations can be stored inside the Android library.
Offline changes need to be persisted just in case the application will be restarted. Applications can be offline for a long time so we might need to have separate stores for offline data.
Proposal
Store mutations in SQL database - sql lite
Store mutations only when offline (based on the offline state provided by broadcast)
Remove mutations from the store once they are processed by the server.
How this may be done
We could hook into Apollo Client and log to console (logcat) all mutation operations that are happening. This will help us to understand how graphql operations work and how they look like and how we can hook into request chain for Apollo Android.
Once we will be able to read all incoming mutations we can investigate the preferred way to store them inside some local database. We can use existing SQLite database capabilities available on Android.
Once we have all mutations stored we can visualize them as separate view in the example app.
The next step may be to store mutations only when the device is offline by registering a specific broadcast inside the application.

@harshithdwivedi WDYT about this? Do you think it is useful to do it now? Feel free to propose alternative flow.

ping @Lavanyagaur22

@wtrocki Perfect, looks good to me :+1:
I believe that researching this can be a worthwhile investment and looking at the code written by @Lavanyagaur22 , it looks like that she has already played around with adding a database to the app for handling offline mutations.

What went wrong:
Some problems were found with the configuration of task ':sample:generateDebugApolloIR'.

Value 'main GraphQL source' specified for property '$1' cannot be converted to a file.
Value 'debug GraphQL source' specified for property '$2' cannot be converted to a file.

execution failed for configuration of task ':sample:generateDebugApolloIR'
When building the project I am facing this error, I tried to fix it out by changing the gradle version and adding "ext.apolloGraphQL_version = '0.4.3' " , ( https://github.com/apollographql/apollo-android/issues/601 )but no success. @harshithdwivedi @wtrocki @danielpassos Can you please help me out.

@Lavanyagaur22 can you push your changes onto a branch?
I'll look into it

Looks like typical problem with missconfigured code generator. Where did we put the app schema? Are we using showcase schema or somthing else?

@wtrocki We are using the showcase schema right? Schema is out under "sample/src/main/graphql/org/aerogear/graphqlandroid/schema.json"

@Lavanyagaur22 can you push your changes onto a branch?
I'll look into it

#18 pushed the code

Applications can be offline for a long time so we might need to have separate stores for offline data.

@wtrocki What exactly do you mean by having separate stores?

@wtrocki @harshithdwivedi It's working with the previous version of gradle ( that is Apollo generated code and stuff ) but not with the latest one

Hm, maybe it's worthwhile to check the apollo-graphql repo's issues to see
if their users are facing the same issue.
If not then I'd recommend that you go ahead and open an issue for this.
For now, we can go ahead with the version of gradle with which the app
works; what's that version Btw?
On Tue, Jun 4, 2019, 12:00 PM Lavanya gaur<EMAIL_ADDRESS>wrote:

@wtrocki https://github.com/wtrocki @harshithdwivedi
https://github.com/harshithdwivedi It's working with the previous
version of gradle ( that is Apollo generated code and stuff ) but not with
the latest one
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/aerogear/voyager-android/issues/10?email_source=notifications&email_token=ALLWCVGMJGCGB2BUW5MYWCDPYYDYXA5CNFSM4HR54ZAKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODW3RZSQ#issuecomment-498539722,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ALLWCVGJ3V5KYPJVQ3F45X3PYYDYXANCNFSM4HR54ZAA
.

@harshithdwivedi gradle 4.6

Cool, go ahead with it.
On Tue, Jun 4, 2019, 3:27 PM Lavanya gaur<EMAIL_ADDRESS>wrote:

@harshithdwivedi https://github.com/harshithdwivedi gradle 4.6
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/aerogear/voyager-android/issues/10?email_source=notifications&email_token=ALLWCVC6AMWOQ7GIQHCNLFDPYY4CDA5CNFSM4HR54ZAKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODW4B3EA#issuecomment-498605456,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ALLWCVGBLATA2HWK2FWX7RLPYY4CDANCNFSM4HR54ZAA
.

@wtrocki What exactly do you mean by having separate stores?

Cache represent server side data that user fetched.
If we start adding things to cache that actually do not represent the state of the server it will mean that:

cache is no longer actual cache but the actually client-side store
we need to build another layer on top of the current cache that will represent this offline changes
we will need to deal with complex cache invalidation and listeners that also should be reattached once the application is restarted.

I really support you guys with any technical decision that we make here.
What I have suggested is just simple and independent mechanism that we can implement without writing phd thesis on data replication mechanism.
Separate store simplifies that as it will mean that we do not need to write custom cache. It is a great way to start without exploring and hitting so many problems with cache mechanisms.
We really do not want to deal with caching. Why.. Going to use this tweet as answer :P
https://twitter.com/codinghorror/status/506010907021828096?lang=en

@wtrocki When mutation results are successfully stored in the server(when online), does the server returns any kind of success (like any kinda callback on successful operation)?

Yes.. Mutate method should return observable.

@harshithdwivedi @wtrocki Can you have a look at this
https://drive.google.com/file/d/1sj_IMfPGYvma51VWV6K6fbbtOxpy5zfE/view?usp=sharing
More modifications to be done :p

What is the adv of having "status" field in the schema?

Create { title: 'Task6', description: 'This is task6', status: 'OPEN' }
{"level":30,"time":1559743931609,"pid":6674,"hostname":"lavanyas-MacBook-Pro.local","tag":"AUDIT","audit":{"logType":"RESOLVER_COMPLETION","msg":"insert into "tasks" ("description", "status", "title", "version") values ($1, $2, $3, $4) returning * - column "status" of relation "tasks" does not exist","operationType":"mutation","fieldName":"createTask","parentTypeName":"Mutation","path":"createTask","success":false,"arguments":{"title":"Task6","description":"This is task6”,"status":"OPEN"},"authenticated":false},"v":1}
@wtrocki Why is this error coming when creating a new one?

Sounds like backend problem column "status" of relation "tasks" does not exist.
To fix it:
docker ps
docker kill containerid
``

Btw. Lets include link to server project in Readme so it will be clear where it comes from.

https://github.com/apollographql/apollo-android/tree/master/apollo-kotlin-sample
This is also very nice to understand how different things in apollo android works :)

@Lavanyagaur22 Kudos for finding this example and playing with it.
You do not need mentors :) mentors need you :D


Wrong props passed to custom cell

Link to reproduction
No response
Environment Info
Binaries:
  Node: 20.12.2
  npm: 10.5.0
  Yarn: N/A
  pnpm: 9.10.0
Relevant Packages:
  payload: 3.0.0-beta.104
Operating System:
  Platform: darwin
  Arch: arm64
  Version: Darwin Kernel Version 23.6.0: Mon Jul 29 21:13:04 PDT 2024; root:xnu-10063.141.2~1/RELEASE_ARM64_T6020
  Available memory (MB): 16384
  Available CPU cores: 12

Describe the Bug
I'm building a custom field with a custom cell, but I can't access cellData because it's undefined.
These are the props passed to the cell: collectionConfig, collectionSlug, data, hasCreatePermission, i18n, limit, listPreferences, listSearchableFields, locale, newDocumentURL, params, payload, permissions, searchParams, user, clientField, field.
Reproduction Steps
This is the link to my custom field:

field: https://github.com/Etherna/etherna-website/blob/payload/apps/cms/src/fields/color/index.ts
field component: https://github.com/Etherna/etherna-website/blob/payload/apps/cms/src/fields/color/field.tsx
cell component: https://github.com/Etherna/etherna-website/blob/payload/apps/cms/src/fields/color/cell.tsx

Adapters and Plugins
No response

The way cell data can be accessed has changed - can you try the useTableCell() hook? https://payloadcms.com/docs/beta/admin/fields#the-cell-component

@tyteen4a03 thank you, that worked!


r lower -> R upper

R code cannot take r lowercase. Needs changing to take lowercase and change it into uppercase and can also take uppercase directly

This issue and Issue 31 have both been resolved together


Where is version 2.81.1?

In the releases, the latest release is 2.81.1, yet in npm (and when doing npm install) the latest version is 2.81.0
Is there a problem somewhere?

Odd releases are only in our git master. When we push a new release we roll the version up to the next even, publish, and then increment the odd version in git.


Add reified extensions for ComponentMetadataHandler

Once we have this, the examples in #10735 will be adjusted and with that automatically add some integration test coverage.

@eskatos anything else I have to consider here? (oriented this at what was done for ObjectFactoryExtensions)

Thanks @eskatos!


Fix/tmlr desk rejection

Enable a button for the EIC to desk reject the submission
Add two dropdowns in the AE/Reviewer console to select the paper quota and set availability
Change the venue name for Desk Rejected submissions.

it needs this PR: https://github.com/openreview/openreview-web/pull/937

i think when the AE set custom max papers to 0 the assignment availability should be also set to unavailable


Make Speech Recognizer sensitive to user Locale

Change-Id: Ida58436836a3f2b1abf9f2156f409a3a94b57264

As reported by users on the forum, the speech recognition in iOS always defaults to English. It turns out it's slightly more subtler than that in that the current locale ends up being a combination of en with the user's country code, so you may have something like en-IT whereas the user's device locale is actually it-IT. This PR does two things:

Add support for the Language property (available on Android) and use that to determine the locale if set
Otherwise, look at the list of preferred locales and take the first one.
If the list of preferred locales is somehow empty, default to using Locale.current, which is what effectively happens today in production.

I'm waiting to hear back from the developer who reported this issue to confirm it solves the problem. I did put my phone into a few different languages and it seemed to help but my accent is terrible...


Smartthings integration missing some switch

Home Assistant release with the issue:
0.98.3
Last working Home Assistant release (if known):
Operating environment (Hass.io/Docker/Windows/etc.):
Debian 10.0
Component/platform:
/components/smartthings
Description of problem:
I have a Fibaro Double Switch 2 -  FGS-223. It has two childs, but I cannot see them in integration, neither as switch as power meter, etc.
Problem-relevant configuration.yaml entries and (fill out even if it seems unimportant):
Traceback (if applicable):
Additional information:
I can find device related lines in my logs:
Sep  4 20:35:12 jailhouse hass[15412]: 2019-09-04 20:35:12 DEBUG (MainThread) [homeassistant.components.smartthings] Push update received: {'location_id': 'eeb7e6fa-355a-4ef4-8915-e672c1cdf142', 'device_id': 'd83145ef-1882-4644-a97b-1dc56affb509', 'component_id': 'ep1', 'capability': 'switch', 'attribute': 'switch', 'value': 'off', 'data': None}
Sep  4 20:41:00 jailhouse hass[15412]: 2019-09-04 20:41:00 DEBUG (MainThread) [homeassistant.components.smartthings] Push update received: {'location_id': 'eeb7e6fa-355a-4ef4-8915-e672c1cdf142', 'device_id': 'd83145ef-1882-4644-a97b-1dc56affb509', 'component_id': 'ep1', 'capability': 'switch', 'attribute': 'switch', 'value': 'on', 'data': None}
Sep  4 21:35:57 jailhouse hass[15412]: 2019-09-04 21:35:57 DEBUG (MainThread) [homeassistant.components.smartthings] Push update received: {'location_id': 'eeb7e6fa-355a-4ef4-8915-e672c1cdf142', 'device_id': 'd83145ef-1882-4644-a97b-1dc56affb509', 'component_id': 'ep1', 'capability': 'switch', 'attribute': 'switch', 'value': 'off', 'data': None}
Sep  4 21:35:58 jailhouse hass[15412]: 2019-09-04 21:35:58 DEBUG (MainThread) [homeassistant.components.smartthings] Push update received: {'location_id': 'eeb7e6fa-355a-4ef4-8915-e672c1cdf142', 'device_id': 'd83145ef-1882-4644-a97b-1dc56affb509', 'component_id': 'ep1', 'capability': 'switch', 'attribute': 'switch', 'value': 'on', 'data': None}
Sep  4 21:36:11 jailhouse hass[15412]: 2019-09-04 21:36:11 DEBUG (MainThread) [homeassistant.components.smartthings] Push update received: {'location_id': 'eeb7e6fa-355a-4ef4-8915-e672c1cdf142', 'device_id': 'd83145ef-1882-4644-a97b-1dc56affb509', 'component_id': 'ep1', 'capability': 'switch', 'attribute': 'switch', 'value': 'off', 'data': None}

Unfortunately, child devices aren’t supported in the integration at this time...  If the parent device doesn’t expose any supported capabilities, that would explain why it doesn’t show up either.  If you provide the DTH being used, I can confirm and possibly suggest a workaround.

I'm using Fibaro Double Switch 2 FGS-223 and Metering Switch Child Device.

The parent device should be showing up as a switch with the power attributes.  Are you sure it's not there?  Are there any other log messages during startup about not being able to query the device?

The parent is there, but I'd like to catch the children

Gotcha -- so as mentioned already, child devices aren't supported and there isn't a workaround for that.  I'm going to close this issue as it would be a new feature request -- something I'll start working on, but it will be a few weeks (it's a larger change).

Thank you!


now  prom2json can use function TextToMetricFamilies  ,but MetricsFamiles To Text didn't has method

Proposal
Use case. Why is this important?
“Nice to have” is not a good use case. :)
Bug Report
What did you do?
What did you expect to see?
What did you see instead? Under which circumstances?
Environment

System information:
insert output of uname -srm here

Prometheus version:
insert output of prometheus --version here

Alertmanager version:
insert output of alertmanager --version here (if relevant to the issue)

Prometheus configuration file:

insert configuration here

Alertmanager configuration file:

insert configuration here (if relevant to the issue)

Logs:

insert Prometheus and Alertmanager logs relevant to the issue here

Not sure what you want to report here but it isn't probably the correct repository...
I'm closing it for now. If you have further questions, please use our user mailing list, which you can also search.


service performance degradation and unexpected behavior after using SetMaxThreads

I am using grpc for bidirection streaming service. Beause this is an online real-time service, and we don't want our clients to wait too long, so we want to limit the rpcs to a certain number and reject the extra requests.
We are able to do it in Python with following code:
grpcServer = grpc.server(futures.ThreadPoolExecutor(max_workers=10), maximum_concurrent_rpcs=10)

In such case, only 10 requests will be processed, and other request will be rejected, the clients will throw a RESOURCE_EXHAUSTED error.
However, we find it hard to do it in C++. We use code following https://stackoverflow.com/questions/52311876/grpc-sync-server-limit-handle-thread
ServerBuilder builder;
builder.SetSyncServerOption(ServerBuilder::SyncServerOption::NUM_CQS, 10);
grpc::ResourceQuota quota;
quota.SetMaxThreads(10 * 2);
builder.SetResourceQuota(quota);

We are using grpc in many services. Some using kaldi, some using libtorch.
In some cases, the above code behaves normally, it processes 10 requests at a time, and rejects other requests. and the processing speed (our service requires a log of cpu calculation) is ok.
In some cases, it only accepts 9 request at a time.
In some cases, it accepts 10 request at a time, but the processing speed is significantly lower than before.
We also tried
builder.AddChannelArgument(GRPC_ARG_MAX_CONCURRENT_STREAMS, 10);

But it is useless becuase GRPC_ARG_MAX_CONCURRENT_STREAMS is the max_concurrent_rpcs on a single http connection.
Could someone please point out the equivalent C++ version of the Python code? We want to make our service to handle 10 requests at a time, and rejects other request, we do not want any service to wait in the queue.

We have 4 speech related service. service A/B/C using kaldi( a speech recognition tool), service D using libtorch. service D suffers from performance degradation after SetMaxThreads. I doubt this maybe related to the multi-threading technique used in libtorch/MKL. Service A/B is okay after SetMaxThreads. But service C can only support 9 requests, which is exactly minus 1 (If I set NUM_CQS 20, and SetMaxThreads 40, it support 19 requests). What does SetMaxThreads limits? Does it take into account all the threads in grpc server, or it only considers the queues and processing thread?

gRPC indeed does not have an out of the box option to limit the total number of concurrent requests. (Limiting the memory on ResourceQuota would give some control but not as fine grained a control as you want.)
Also note that at present, we do not recommend the sync API for performance. In your case, I would highly recommend using the async API and then the application code itself could be responsible for managing how to handle any extra requests.
SetMaxThreads on the ResourceQuota would limit the total number of threads allocated from the resource quota. If you really want to use the sync server to do this this, it sounds like you instead want to adjust the minimum and maximum number of pollers. https://github.com/grpc/grpc/blob/7b8fb43b33892b786f1cb8d8d5a086973169c9ac/include/grpcpp/server_builder.h#L229


VR Support

This is great, and results are pretty good.
I would like to get this working with Single Pass VR,
Not too familiar with SRP so not sure where to add any of this.
But I have found some documentation which should help:
VR Support Custom Render Pipeline
VR in HDRP
Commit from the github Setting up some Shader Variables
Any ideas?

The ScriptableRenderContext does support stereo rendering with StartMultiEye and StopMultiEye. However, I'm not familiar with stereo rendering either. I can guide you to add this feature on the code, though, be advised that the code is very messy right now (I'm planning to refactor to organize and make it easier to read).
About the render pipeline, I have devoted everything to defered rendering path, because forward rendering is not optimal for this lighting technique. The defered rendering path is implemented here. You probably know that there are 2 main steps:

Render to G-buffers.
Render from G-buffers to screen. This step includes 2 passes:
a) Render indirect diffuse lighting to a separate render texture, which can have the same or lower resolution than the screen resolution for performance reason. This render texture then can be scaled up to match screen resolution.
b) The indirect diffuse lighting result is merged with other light shading calculation to form the final composite image.

About the shader, you will have to edit Assets/Shaders/VXGI.shader to modify the transformation of vertex position to make it work with multi-eyes rendering.

Step 1 is implemented here.
Step 2a is implemented here.
Step 2b is implemented here.

I'm attempting this again.
I have managed to implement rendering to the headset.
Now I am trying to track down your shaders to add the Stereo shader variables but your recent changes have rearranged things quite  bit.
Adding VR support is generally simple if you know the shaders
see here:
https://docs.unity3d.com/Manual/SinglePassStereoRendering.html
Basically we need to tell uv that we are rendering in VR.
In some cases it is just modifying one line.
See the first line of the frag function here:
https://github.com/ddutchie/UnityPostFX_VR/blob/d336312553de207bed19873f178a6b458bf71785/VR PostFX/Graphic Novel/GraphicNovel.shader#L67
If these changes are made nothing will change for a non VR user. These macros only affect the shader with stereo rendering.

I will spend some time to research about this and will try to implement it in the next weekend.

I have actually gotten really close
if I make some changes to VXGIRenderer like so:

using UnityEngine;
using UnityEngine.Experimental.Rendering;
using UnityEngine.Rendering;
using UnityEngine.Rendering.PostProcessing;

public class VXGIRenderer : System.IDisposable {
  public enum MipmapSampler {
    Linear,
    Point
  }

  public DrawRendererFlags drawRendererFlags {
    get { return _renderPipeline.drawRendererFlags; }
  }
  public RendererConfiguration rendererConfiguration {
    get { return _renderPipeline.rendererConfiguration; }
  }

  int _cameraDepthTextureID;
  int _cameraDepthNormalsTextureID;
  int _cameraGBufferTexture0ID;
  int _cameraGBufferTexture1ID;
  int _cameraGBufferTexture2ID;
  int _cameraGBufferTexture3ID;
  int _dummyID;
  int _dummyID2;
  int _frameBufferID;
  float[] _renderScale;
  CommandBuffer _command;
  CullResults _cullResults;
  FilterRenderersSettings _filterSettings;
  LightingShader[] _lightingPasses;
  PostProcessRenderContext _postProcessRenderContext;
  RenderTargetBinding _gBufferBinding;
  VXGIRenderPipeline _renderPipeline;

  public VXGIRenderer(VXGIRenderPipeline renderPipeline) {
    _command = new CommandBuffer { name = "VXGIRenderer" };
    _filterSettings = new FilterRenderersSettings(true) { renderQueueRange = RenderQueueRange.all };
    _renderPipeline = renderPipeline;
    _cameraDepthTextureID = Shader.PropertyToID("_CameraDepthTexture");
    _cameraDepthNormalsTextureID = Shader.PropertyToID("_CameraDepthNormalsTexture");
    _cameraGBufferTexture0ID = Shader.PropertyToID("_CameraGBufferTexture0");
    _cameraGBufferTexture1ID = Shader.PropertyToID("_CameraGBufferTexture1");
    _cameraGBufferTexture2ID = Shader.PropertyToID("_CameraGBufferTexture2");
    _cameraGBufferTexture3ID = Shader.PropertyToID("_CameraGBufferTexture3");
    _dummyID = Shader.PropertyToID("Dummy");
    _frameBufferID = Shader.PropertyToID("FrameBuffer");

    _gBufferBinding = new RenderTargetBinding(
      new RenderTargetIdentifier[] { _cameraGBufferTexture0ID, _cameraGBufferTexture1ID, _cameraGBufferTexture2ID, _cameraGBufferTexture3ID },
      new[] { RenderBufferLoadAction.DontCare, RenderBufferLoadAction.DontCare, RenderBufferLoadAction.DontCare, RenderBufferLoadAction.DontCare },
      new[] { RenderBufferStoreAction.DontCare, RenderBufferStoreAction.DontCare, RenderBufferStoreAction.DontCare, RenderBufferStoreAction.DontCare },
      _cameraDepthTextureID, RenderBufferLoadAction.DontCare, RenderBufferStoreAction.DontCare
    );

    _renderScale = new float[] { 1f, 1f, 1f, 1f };

    _lightingPasses = new LightingShader[] {
      new LightingShader(LightingShader.Pass.Emission),
      new LightingShader(LightingShader.Pass.DirectDiffuseSpecular),
      new LightingShader(LightingShader.Pass.IndirectDiffuse),
      new LightingShader(LightingShader.Pass.IndirectSpecular)
    };

    _postProcessRenderContext = new PostProcessRenderContext();
  }

  public void Dispose() {
    _command.Dispose();

    foreach (var pass in _lightingPasses) pass.Dispose();
  }

  public void RenderDeferred(ScriptableRenderContext renderContext, Camera camera, VXGI vxgi) {
    ScriptableCullingParameters cullingParams;
    if (!CullResults.GetCullingParameters(camera, out cullingParams)) return;
    CullResults.Cull(ref cullingParams, renderContext, ref _cullResults);

    //Initialize Stereo

    renderContext.SetupCameraProperties(camera,  camera.stereoEnabled);
   if (camera.stereoEnabled)
            {
    renderContext.StartMultiEye(camera);
            }
    int width = camera.pixelWidth;
    int height = camera.pixelHeight;

    _command.GetTemporaryRT(_cameraDepthTextureID, width, height, 24, FilterMode.Point, RenderTextureFormat.Depth, RenderTextureReadWrite.Linear);
    _command.GetTemporaryRT(_cameraGBufferTexture0ID, width, height, 0, FilterMode.Point, RenderTextureFormat.ARGB32, RenderTextureReadWrite.Linear);
    _command.GetTemporaryRT(_cameraGBufferTexture1ID, width, height, 0, FilterMode.Point, RenderTextureFormat.ARGB32, RenderTextureReadWrite.Linear);
    _command.GetTemporaryRT(_cameraGBufferTexture2ID, width, height, 0, FilterMode.Point, RenderTextureFormat.ARGB2101010, RenderTextureReadWrite.Linear);
    _command.GetTemporaryRT(_cameraGBufferTexture3ID, width, height, 0, FilterMode.Point, RenderTextureFormat.ARGBHalf, RenderTextureReadWrite.Linear);
    _command.GetTemporaryRT(_frameBufferID, width, height, 0, FilterMode.Point, RenderTextureFormat.ARGBHalf, RenderTextureReadWrite.Linear);
    _command.SetRenderTarget(_gBufferBinding);
    _command.ClearRenderTarget(true, true, Color.clear);
    renderContext.ExecuteCommandBuffer(_command);
    _command.Clear();

    var drawSettings = new DrawRendererSettings(camera, new ShaderPassName("Deferred"));
    drawSettings.flags = _renderPipeline.drawRendererFlags;
    drawSettings.rendererConfiguration = _renderPipeline.rendererConfiguration;
    drawSettings.sorting.flags = SortFlags.CommonOpaque;

    renderContext.DrawRenderers(_cullResults.visibleRenderers, ref drawSettings, _filterSettings);

    if (camera.cameraType != CameraType.SceneView) {
      _command.EnableShaderKeyword("PROJECTION_PARAMS_X");
    } else {
      _command.DisableShaderKeyword("PROJECTION_PARAMS_X");
    }

   _command.GetTemporaryRT(_dummyID,width, height, 0, FilterMode.Point, RenderTextureFormat.ARGB32, RenderTextureReadWrite.Linear);
  _command.Blit(_cameraDepthTextureID, BuiltinRenderTextureType.CameraTarget, UtilityShader.material, (int)UtilityShader.Pass.DepthCopy);

//It seems there is an issue everywhere we sample this
// _command.Blit(BuiltinRenderTextureType.CameraTarget, _dummyID);
   _command.Blit(_dummyID, _frameBufferID, UtilityShader.material, (int)UtilityShader.Pass.GrabCopy);
   _command.ReleaseTemporaryRT(_dummyID);
   renderContext.ExecuteCommandBuffer(_command);
    _command.Clear();

    Matrix4x4 clipToWorld = camera.cameraToWorldMatrix * GL.GetGPUProjectionMatrix(camera.projectionMatrix,false).inverse;

    _command.SetGlobalMatrix("ClipToWorld", clipToWorld);
    _command.SetGlobalMatrix("ClipToVoxel", vxgi.worldToVoxel * clipToWorld);
    _command.SetGlobalMatrix("WorldToVoxel", vxgi.worldToVoxel);
    _command.SetGlobalMatrix("VoxelToWorld", vxgi.voxelToWorld);

    bool depthNormalsNeeded = (camera.depthTextureMode & DepthTextureMode.DepthNormals) != DepthTextureMode.None;

    if (depthNormalsNeeded) {
      _command.GetTemporaryRT(_cameraDepthNormalsTextureID, width, height, 0, FilterMode.Point, RenderTextureFormat.ARGB32, RenderTextureReadWrite.Linear);
      _command.Blit(_cameraDepthTextureID, _cameraDepthNormalsTextureID, UtilityShader.material, (int)UtilityShader.Pass.EncodeDepthNormal);
    }

    renderContext.ExecuteCommandBuffer(_command);
    _command.Clear();

    _renderScale[2] = vxgi.diffuseResolutionScale;

    for (int i = 0; i < _lightingPasses.Length; i++) {
      _lightingPasses[i].Execute(renderContext, camera, _frameBufferID, _renderScale[i]);
    }

    RenderPostProcessing(renderContext, camera);

    _command.Blit(_frameBufferID, BuiltinRenderTextureType.CameraTarget);

    RenderPostProcessingDebug(renderContext, camera);

    if (depthNormalsNeeded) {
      _command.ReleaseTemporaryRT(_cameraDepthNormalsTextureID);
    }

    _command.ReleaseTemporaryRT(_cameraDepthTextureID);
    _command.ReleaseTemporaryRT(_cameraGBufferTexture0ID);
    _command.ReleaseTemporaryRT(_cameraGBufferTexture1ID);
    _command.ReleaseTemporaryRT(_cameraGBufferTexture2ID);
    _command.ReleaseTemporaryRT(_cameraGBufferTexture3ID);
    _command.ReleaseTemporaryRT(_frameBufferID);
    renderContext.ExecuteCommandBuffer(_command);

    //Deactivate Stereo
    if (camera.stereoEnabled)
    {
    renderContext.StopMultiEye(camera);
    renderContext.StereoEndRender(camera);
    }

    _command.Clear();
  }

  public void RenderMipmap(ScriptableRenderContext renderContext, Camera camera, VXGI vxgi) {
    var transform = Matrix4x4.TRS(vxgi.origin, Quaternion.identity, Vector3.one * vxgi.bound);

    _command.BeginSample(_command.name);

    if (vxgi.mipmapSampler == MipmapSampler.Point) {
      _command.EnableShaderKeyword("RADIANCE_POINT_SAMPLER");
    } else {
      _command.DisableShaderKeyword("RADIANCE_POINT_SAMPLER");
    }

    _command.SetGlobalFloat("MipmapLevel", Mathf.Min(vxgi.level, vxgi.radiances.Length));
    _command.SetGlobalFloat("TracingStep", vxgi.step);
    _command.DrawProcedural(transform, VisualizationShader.material, (int)VisualizationShader.Pass.Mipmap, MeshTopology.Quads, 24, 1);

    _command.EndSample(_command.name);

    renderContext.ExecuteCommandBuffer(_command);

    _command.Clear();
  }

  public void RenderPostProcessing(ScriptableRenderContext renderContext, Camera camera) {
    var layer = camera.GetComponent<PostProcessLayer>();

    if (layer == null || !layer.isActiveAndEnabled) return;

    _command.GetTemporaryRT(_dummyID, camera.pixelWidth, camera.pixelHeight, 0, FilterMode.Point, RenderTextureFormat.ARGBHalf, RenderTextureReadWrite.Linear);

    _postProcessRenderContext.Reset();
    _postProcessRenderContext.camera = camera;
    _postProcessRenderContext.command = _command;
    _postProcessRenderContext.destination = _frameBufferID;
    _postProcessRenderContext.source = _dummyID;
    _postProcessRenderContext.sourceFormat = RenderTextureFormat.ARGBHalf;

    if (layer.HasOpaqueOnlyEffects(_postProcessRenderContext)) {
      _command.Blit(_frameBufferID, _dummyID);
      layer.RenderOpaqueOnly(_postProcessRenderContext);
    }

    _command.Blit(_frameBufferID, _dummyID);
    layer.Render(_postProcessRenderContext);

    _command.ReleaseTemporaryRT(_dummyID);
    renderContext.ExecuteCommandBuffer(_command);
    _command.Clear();
  }

  public void RenderPostProcessingDebug(ScriptableRenderContext renderContext, Camera camera) {
    var postProcessDebug = camera.GetComponent<PostProcessDebug>();

    if (postProcessDebug == null) return;

    postProcessDebug.SendMessage("OnPostRender");

    foreach (var command in camera.GetCommandBuffers(CameraEvent.AfterImageEffects)) {
      renderContext.ExecuteCommandBuffer(command);
    }
  }
}

Note _command.Blit(BuiltinRenderTextureType.CameraTarget, _dummyID); breaks things so there is an issue here??
So I rerouted the blit for debug purposes.
Then BlitSupport.hlsl :
#ifndef VXGI_BLIT_SUPPORT_HLSL
#define VXGI_BLIT_SUPPORT_HLSL

#if defined(UNITY_REVERSED_Z)
  #define DEPTH_TO_CLIP_Z(depth) depth
#else
  #define DEPTH_TO_CLIP_Z(depth) mad(2.0, depth, -1.0)
#endif

struct BlitInput
{
  float4 vertex : SV_POSITION;
  float2 uv : TEXCOORD;
  UNITY_VERTEX_OUTPUT_STEREO

};

BlitInput BlitVertex(appdata_base v)
{
  BlitInput o;
  o.vertex = UnityObjectToClipPos(v.vertex);
  o.uv = UnityStereoTransformScreenSpaceTex(v.texcoord);
  return o;
}

#endif

Everything (Geometry wise) is correct in the headset, but gi calcs uvs seem off...
Excuse the rotation, it was the only way to show the issue.

If you look at the image you will notice that the GI is offset. It looks like all lighting passes uvs are stretched accross both eyes based on the code changes in the BlitSupport Shader.
It looks like these calcs should not be split, even when VR.
Also the camera matrix or something is off as there is clipping below the horizon.

To give you an idea of what that "UnityStereoTransformScreenSpaceTex" shader change does see below
Without change:

With change:

As you may notice it ensures the correct uv adjustment accross eyes.

Looking at my post I see that GI is already wrong before the change
Matrix must be the issue here. Fixing that means we have it working. That and the issue stated above.

I suppose it is because I didn't use Unity built-in helper ComputeScreenPos to calculate screen space position. This helper will take stereo rendering into account if it is enabled.

Made some more progress
Visualizing Mipmap is correctly sampling the position in the world.

It seems the sampling of the voxels is not centered in VR

And the shadows, not sure where this happens in the rendering. Slowly working through the project.

My experiments here
https://github.com/ddutchie/Unity-SRP-VXGI

I calculate world space position from screen UV in here:
https://github.com/Looooong/Unity-SRP-VXGI/blob/07124317643f0ccdc244c367a9b49745d7745269/Resources/VXGI/Shader/Lighting.shader#L25-L26
If the UV format changed, the world space position is affected as well. I suggest that you should follow Post-processing effects section which uses UnityStereoScreenSpaceUVAdjust in fragment shader instead of vertex shader. For other part of the code, the UV value should not be changed to ensure that the correct pixel is sampled from screen space textures.
I haven't test yet and these are just my theories. This weekend, I'm gonna be busy and I probably won't have time to support you so much. If you ever need help, try using frame debugger or write a shader code to visualize VR results.

These theories prove correct.
Making some changes there has fixed the left eye completely.
Thanks for the direction. Now to fix the right eye and find out why blitting the default texture gives issues in VR.
So strange as I have screen-space effects using this everywhere in another project.

Scratch that. Fixed. Just trying to track down matrix issues with right eye  its only happening in lighting shader so its the UV being passed there that is incorrect.
Left eye looks delicious!
Will push changes to my branch. Thanks for the help. Hopefully I have some time this weekend to track it down.


add common value path

Remove duplicated declaration path for cleaner helmfile, for example, this configuration.
- chart: projectABC
  name: {{ .Environment.Name }}-projectABC
  namespace: abc
  version: {{ .Environment.Values.projectABC.chart.version }}
  valuesPathPrefix: ../values/{{ .Environment.Name }}/
  values:
  - common.yaml
  - project-abc.yaml
  - platform.yaml
  - ...
  secrets:
  - secrets.yaml

@roboll thanks for the good tool, for my PR, I updated the format and run well in my local(the bash's result is 0), do you know how to pass this issue in the CI? Thanks

@hungtd9 Hey! Seems like it is a code-styling issue. Could you run make fmt and push the result?

@hungtd9 Thank you so much for your contribution ☺

It seems like this no longer works in 0.54.0. Any advice? Or do you have a working example?

@yurrriq Will take a look asap. In the meantime, would you mind opening a dedicated issue so that I don't forget about it? Thanks!

Sure, will do. To be clear, my issue was specific to Go templates in valuesPathPrefix.


Add Synonym: Ichthyosis (disease)

Mondo term (ID and Label)
Ichthyosis (disease) (MONDO_0016444)
Synonym to be added

xeroderma
xerodermia

Synonym subtype: ie, broad/exact/narrow/related
Exact
Database cross reference for the synonym Such as PubMed ID (in the format PMID:XXXXXX) or a cross-reference to another ontology, like OMIM or Orphanet.

SCTID:52475004
OMOP:4198562

Your nano-attribution (ORCID)
If you don't have an ORCID, you can sign up for one here
https://orcid.org/0000-0002-8169-9049

@callahantiff please see the linked PR (#2110) - this does not seem like an appropriate synonym for Ichthyosis (disease).
Note - the Mondo ID you provided above is for 'primary anetoderma', I assume that was a mistake.
I will close this ticket, but please reopen if you'd like to discuss further.


1.20.1 Leacher has bug

Leacher is unable to input and output correctly, cannot execute the recipe correctly, and there are incorrect building instructions around it

You need to place pumps in highlighted blocks

Closing as reporter is not responding


KP-CNN on XYZ without normals

Hi,
I want to apply KP-CNN on some simple XYZ files to compare the results with other methods and on my own data.
I preprocessed my point clouds - for the moment there are 'training/cloud1.xyz', 'training/cloud2.xyz', 'testing/cloud1.xyz', and 'testing/cloud2.xyz'. Their format is now:

X Y Z CLASS
10.567 3.2987 3.73 1

Unfortunately there is only one example for classification. It's on ModelNet40, which also includes normals. I now have trouble getting it to work without normals on this very usual format... Especially random_balanced_gen() and get_tf_mapping() are my problem.
Can you provide code for simple XYZ files?
I am also not quite sure what the in_features_dim parameter does.
Thanks

Hi @neumicha,
For XYZ files, it is actually very simple, you just have to ignore everything that concerns normals. The code loads the training text files here:
https://github.com/HuguesTHOMAS/KPConv/blob/a54f594f613e3f8801f9946ec0f3e3d2ff5f994b/datasets/ModelNet40.py#L208
And the test text files here:
https://github.com/HuguesTHOMAS/KPConv/blob/a54f594f613e3f8801f9946ec0f3e3d2ff5f994b/datasets/ModelNet40.py#L265
If you do not want to change anything in the code, a simple solution would be to add fake normals to the data array, with something like
    data = np.hstack((data[:, :3], data[:, :3]*0))

Actually there is something strange, why do you have a column for class in your xyz file if it is a classification problem? Isn't the class the same for all points in cloud1.xyz?

Hi @HuguesTHOMAS
I think I misunderstood your definition of KP-CNN and KP-FCNN.
What I called a classification problem (big outdoor scenes with point-wise labels: house, car, pedestrian, ...) is the problem corresponding to your KP-FCNN, right?
I will have a look through your KP-FCNN examples to see what matches my data best.
Okay, using fake normals/colors is a solution. I'll have to see if this doesn't result in a too big memory footprint.


Use crevice std140_size_static everywhere

Objective

Use std140_size_static() everywhere instead of manual sizes as the crevice rewrite appears to have fixed all the problems as it claimed to do.

I've tested 3d_scene_pipelined, bevymark_pipelined, and load_gltf_pipelined and all three look fine.

bors r+


Background Jobs

We need to support the basic fg, bg, and jobs, wait commands, background syntax &, and the signal SIGTSTP typically invoked via ctrl-z.
The disown command is standard in Bash, but I'm not sure how I feel about it yet.
The main design work here is going to be around the needed event loop / threading to properly track and manage background jobs while the main shell is running. I suppose a single threaded solution exists, but I doubt it's a good idea.

Started in https://github.com/nixpulvis/oursh/tree/background

The syntax seems to all be correctly parsing now, and I'm pretty sure I'm happy about background jobs owning a Command and not a Program.

https://en.wikipedia.org/wiki/Job_control_(Unix)

Going to try and sort this out on job-exec-ohmy.

https://blog.nelhage.com/2010/01/a-brief-introduction-to-termios-signaling-and-job-control/

https://tokio.rs/blog/2018-08-async-await/

https://github.com/nixpulvis/lambash/commit/6fd53def4b7ec9d57cc2811468cf9eb5a0729169

The implementation at the moment seems to work quite well (at least in the basic cases I hand tested), however I'm aware of some shortcuts I've taken. For example, background compound statements, e.g. Background(Compound(vec![A, B])) should run A then B as a process group together in a single background job.
For example try:
{ echo 1; sleep 2; echo 2; }

I would guess that the solution to this will be related to the solution to #58.


Not working with NextJS 14.2.15

It seems that the error message does not display.
My repo: https://stackblitz.com/edit/stackblitz-starters-qftcjv

Can't get example running. Please check it out.

I'm trying on stackblitz and getting this

I have created another repo and used Vite instead of NextJS. Please check it. When I click on submit button, the error message does not display properly, but when I fill in the value in the field and then delete it, the error message appears.
https://stackblitz.com/edit/vitejs-vite-bnvr4i?file=src%2FApp.tsx

Hello. is there any update???

After looking at it more carefully I figured out it's because of Zod nature of validation. When validating with coerce flag on, validation will force any given value to wanted primitive as per documentation.
That means when an input is empty, the value that Zod gets in validation is undefined and since it's being coerced to primitive, it validates "undefined" which passes your schema.
In this case, you shouldn't be using coerce in schema. Schema should expect strict types. Form input should take care that the given value has the right type. Look at Zod schema here strictly as a validation tool, not (data) transformation.


Improve our usage of dyn Traits

According to someone,
We should reduce our usage of dyn Traits, using them can have some impact on performances. We should make sure that we don't use dyn Traits in hot loops like our indexing loops or anything that loops in the search part of the system.
You can find a basic explanation of how dyn Traits work internally and the reason why it can take more time than just using enums and simple traits on enums.

Just mentioning this crate, if we find anything interesting: https://docs.rs/enum_dispatch/latest/enum_dispatch


trados 2021

public SearchResults[] SearchTranslationUnitsMasked(SearchSettings settings, TranslationUnit[] translationUnits, bool[] mask)
这个接口实现，每一次已进入都执行多次是什么问题？
感谢
希望能够回复

联系方式：15928696398微信同号

@aiduhuihuang - Can you provide us with more context, please? This method is called by Studio, but it can be called in different scenarios, Batch Tasks (Analyze or Pre-Translate), and editor. For example, in the editor, it will be called multiple times when LookAhead is enabled.
Best Regards,
Andrei


Support completions inside JSDoc before EndOfFileToken

Noticed while looking into #25275. (However, that issue appears to be already fixed in master unless the comment is at the end of the file.)

I was hopeful that this might be related to or fix #26905.  But just confirmed that it does not.


Change regex to match new(?) figshare URL scheme

It looks like figshare.com URLs now have a new layout: https://figshare.com/articles/code/Binder-ready_openSenseMap_Analysis/9782777 is what I get when I follow https://doi.org/10.6084/m9.figshare.9782777.v1.
Based on the regex we use I think the old URLs looked like https://figshare.com/articles/Binder-ready_openSenseMap_Analysis/9782777 (or so).
With this new regex we can parse the new URLs. Maybe there is a way to make this more robust to future changes but my regex-fu isn't strong enough.
Is it a good idea to switch to using /(\d+)(/)?(\d+)?$ as regex (to get the numbers we need), a separate check that /articles/ appears in the URL and that the hostname contains figshare?

Thanks for solving this!
If you have time it would be nice to have a docstrings or inline comments that:

examplifies the URLs the regex will work against
warns about that this pattern has evolved over time

I have not learned what figshare is at this point so I didn't dare try to solve it when I saw this error first.

Thanks for solving this!
If you have time it would be nice to have a docstrings or inline comments that:

examplifies the URLs the regex will work against
warns about that this pattern has evolved over time

I have not learned what figshare is at this point so I didn't dare try to solve it when I saw this error first.


[New Tutorial] Workflow reports

Created a tutorial about workflow reports, using the workflow from "Galaxy 101 for everyone" as an example workflow. Covers viewing, customizing and sharing workflow reports.
Also reorganized the topic a bit to group all the workflow tutorials together
ping @jmchilton: let me know if there's anything more that would be good to include/show here?
Hoping to record a video and include it in the online training day ahead of GCC2022, along with some other workflow/collection/tags/viz tutorials (volunteers welcome! ;))

Thank you so much for this tutorial

oh cool, that's nice to hear! :)


Oops; flutter has exited unexpectedly.

win10  64bit
F:>flutter doctor
Downloading Gradle Wrapper...
Oops; flutter has exited unexpectedly.
Sending crash report to Google.

I met the same problem, Please fix................

win10 64bit
I met this problem too，help。。。


How many captchas does it take to login?

For me it ussually takes solving around 5-6 x 15 rotating images to login. Does anyone have the same experience?

When I initially developed the email system, the max images I'd get was 5.  I was also prompted to solve at least 3 sets, but it worked after solving one anyway. There must be a bug somewhere...
On the server I run it on, I don't get any captchas, which I guess means I'm trusted enough for that account. Hopefully after enough solves, you don't have to anymore?

Just pushed a change for the solving UI to add a success message. It looks like sometimes, the Arkose JS will just decide a Captcha isn't needed and send a success token, causing the Captcha game not to load. It looked like an error, but was actually success, so I added a message to indicate that.
The multiple Captcha requests for login may still be a thing, though. Sometimes Epic Games just seems to reject a token for no reason?

Since switching to the SPA captcha UI and reputation token approach, I believe this issue is resolved.

Can confirm that I have never meet that issue since I opened it.


HTTP Basic Auth with Huggins?

Since #1783 seems to have come to a halt, i'm trying to manually POST the reddit API. However, i am stuck in the authentication process - i can't figure out how to send a HTTP Basic Auth using Huggins. Is this already a thing, and if it is, can someone help me with it?

The PostAgent takes an optional basic_auth key in it's options. It can be either set to a string username:password or an array ["username", "password"].

that's what i was looking for, thanks a lot!


Bug: hri.known_persons does not update with a new face when a person leaves and returns

Expected Behavior: when a known person person returns to being visible, person.face becomes a valid Face instead of none.
Current Behavior: person.face remains None.
To Replicate:
Follow part 1.1 on the IROS 2022 tutorial.
Create and run the following script:
#!/usr/bin/env python3

import rospy
from hri import HRIListener

rospy.init_node('hello', anonymous=True)
rate = rospy.Rate(10)
hri = HRIListener()

while not rospy.is_shutdown():
    for id, person in hri.known_persons.items():
    # for id, person in hri.tracked_persons.items():
        if person.face or person.body:
            print("Person %s is seen with some id %s" % (id, person.face.id))
        else:
            print("Person %s is not seen" % id)
    rate.sleep()

Potential Solution: when running using hri.tracked_persons.items() instead of hri.known_persons.items(), there is a single tick where Person person_br is not seen is the output.  Unlike persons_tracked, known_persons may be relying on a one-time call to this callback instead of polling and thus may never get the face. Ensuring that the face (possibly similar for body and voice) list is updated first would solve this problem.

bug fixed in 0.3.1. Thanks for reporting!


Update index.md

Opening new issue to clean up .MD link formatting.
Updated index.md with previously discussed changes to homepage content per contribex Slack and google Docs iteration.

/assign @michellen

/unassign @michelleN
/assign
I'll update the root owners soon 😬

Oh yeah -- our automation blocks git commit messages with github handles starting with @ in git comments. (it causes unnecessary GH pings to folk).

Oh dear--I didn't know that. How do I fix this/remove it so it stops flagging the PR as not okay to merge?

/lgtm
/approve


[Feature] @mention autocompletion

Lack of autocompletion for mentions (@someone) makes it easy to get a name wrong and thus fail to notify someone.

this one looks nice https://github.com/spantaleev/suggestor.js/
looking at Example 8, would be easy to get issue-completion as well ^.^


Feature Suggestion: Outline Box for Scenarios

As a story editor I want to see all the scenarios in the outline box, so that I can quickly jump to any of the scenarios, as well as have a summary view of all scenarios written in the current file.
This Eclipse JBehave editor has this feature, and it's really nice. Actually it's it is the only thing I found over there that it is better than this editor does.
http://jira.codehaus.org/browse/JBEHAVE-376

I would like to see this outline show up in the built-in Eclipse Outline view in addition to the Ctrl-O menu. Was this considered?

Until asked, it wasn't considered. It shouldn't take too much time, one can plan it for next release.

Follow up to new Issue 22


Removal of update function introduced functional regression

In #21, the update function was changed to map to either updateOne or updateMany. In that PR it was mentioned that update was deprecated which was the motivating factor behind the patch. However, as part of this fix we need to add support for replaceOne on the normal collection interface as the change introduced a functional regression. Consider the case when you actually do want to fully replace every field in an object via an update call - that will now fail as updateOne and updateMany require atomic operators. Let me know your thoughts on this, I'll try to get together a quick patch for this later today.

Opened #25 for this.


DefaultSessionIdService.GetCookieName is now configurable

from IdentityServerOptions, the default is "idsvr.session" to not break existing configurations

Hi @khelben, I'm your friendly neighborhood .NET Foundation Pull Request Bot (You can call me DNFBOT). Thanks for your contribution!
You've already signed the contribution license agreement. Thanks!
The agreement was validated by .NET Foundation and real humans are currently evaluating your PR.
TTYL, DNFBOT;

i broke this in my recent update, but it's a good idea. i'll merge it in when i can.

looks like this got added in already. thanks!


feat(protocol-designer): deckThumbnail in Protocol overview

closes AUTH-678
Overview
Wires up the deck map thumbnail in the protocol overview page! when you hover over a slot, it has the overlay but the slot information part is not wired up yet (@koji  will likely do that afterwards!)
Test Plan and Hands on Testing
Make a flex and ot-2 protocol and add a thermocycler. Hover over the slots on the deck thumbnail and the overlay should work as expected.
Changelog

add deck map thumbnail, details, and slot hover components
make a test

Risk assessment
low

Looks good, just confirming that fixtures are not hoverable?

Only the staging area should be hoverable, i believe! @ncdiehl11

Looks good, just confirming that fixtures are not hoverable?

~Only the staging area should be hoverable, i believe!~, nevermind, i think you're referring to the trash and waste chute, those should be hoverable too lol. good catch! i'll fix it! @ncdiehl11

Looks better! Also confirming that entire fixtures are hovered together?

 Also confirming that entire fixtures are hovered together? @jerader

@ncdiehl11 , i think so! let me ask design

@ncdiehl11 , i think so! let me ask design

@ncdiehl11 ok actually it makes sense to hover individually to follow the design in deck setup. so i changed it to hover individually! still waiting to hear from design but it makes sense so i'm just gonna go with it 😄

confirmed with Mel that staging area slots should hover the 3rd column slot and 4th column slot individually! @ncdiehl11


Alternatives?

There have been no fresh commits to this repository over the last 2 years.
Are there any alternatives?

https://registry.terraform.io/modules/Nexode-Consulting/nextjs-serverless/aws/latest
I haven't tested both yet

It's a shame this doesn't appear to be supported any more. It was really useful.
I have switched to using Open Next - https://github.com/sst/open-next
I maintain a Terraform module for Open Next - https://github.com/RJPearson94/terraform-aws-open-next


Storybook does not recognise SCSS

Not sure how to configure storybook's Vite builder to recognise SCSS syntax.
This configuration doesn't seem to work:
// .storybook/main.js

module.exports = {
 [...]
  async viteFinal(config) {
   [...]
   config.css: {
     preprocessorOptions: {
       scss: {
         additionalData: '@use "src/style/mixins.scss" as *;',
       },
      },
    };
    return config;
  },
};

Solved


Install not working?

I tried installing this extension in an app I'm working on but it didn't show up.  So I quasar create a brand new app to test extension installation.  https://www.screencast.com/t/fq6S9j8Pv8o
After running quasar dev and trying to navigate to /auth/login there is nothing.  No pages in the components folder either.  https://www.screencast.com/t/McciFsJsjj  What am I doing wrong?

I think the route is /login. Also, have a look at the previous issue.

I m new to quasar and I was looking a quasar-extensions.json.  I see that the login page code is in node modules.  But I want to customize the layout and form to look like this:  https://www.screencast.com/t/v9bhK715BDW  How do I move all of this into my app?  Or is there another way to modify the style?
{
  "http-authentication": {
    "baseUrl": "http://localhost:420",
    "authenticationScheme": "Bearer",
    "identifierField": "email",
    "registerRoute": "/auth/register",
    "verificationRoute": "/auth/verify",
    "loginRoute": "/auth/login",
    "passwordForgotRoute": "/auth/password/forgot",
    "passwordResetRoute": "/auth/password/reset",
    "fetchUserRoute": "/auth/user"
  }
}

Check https://github.com/stefanvanherwijnen/quasar-app-extension-http-authentication/issues/9

Thank you.  FWIW, a FAQ might be helpful.    Thanks for making this available.

Should be fixed or no longer applicable in v2.


Feature/ch17238/multipe file sharing logic

CHANGELOG

Replace random encryption key with a pbkdf generation
Update sharing logic to zip multiple files before encryption.
Update open public shared filed logic to use password when decrypting.

LGTM. Wonder if we should move the pbkdf salt and IV to a config tho so that we inject it on build and not expose it in the repo. What do you think?

Yes, I can move it to a config, but I felt we should leave those values open because if we want people to build custom experience around publicly shared files without having to ask use for the decryption parameters. One update I want to do though is to have the IV be random and prepend it to the encrypted payload. So all that would be left is the salt and I think it is reasonably safe to leave that open. What do you think?


Geo update

This updates the geometry. Overlap checking is enabled and geometry mistakes are taken out whch prevented building and running the app. A first test macro with four events and massive text output (last was 25Mb) is added. Further geometry checking is required to see if the 4 detector towers really represent the geometry in storage as intended. The alternative geometry is untested so far. Another test macro, exercising the new command definitions would be needed for that.
The text output also strengthens the case to put in UserLimits to restrict e- and gamma transport.

Misunderstanding of subdetector placement. The Ge volume is placed inside the ULar logical volume which in turn is copied four times in PVplacement, taking each a Ge volume with them. No need for separate four Ge placements.
All corrected for baseline and alternative geometry.

Forgot to give unit for the vertex location G4double in detector construction. The default unit is is mm but I assumed cm - repaired explicitly now.
The test macro now initializes the run (line was missing) and as a test, sets the production cut by macro command - easiest method to set and observe the effect.

Thanks @yramachers, assuming the CI passes, I'll merge.