Autocomplete workspace/project names

Is your feature request related to a problem? Please describe.
We should improve UX by having the workspace/project name autocompleted when doing the start, stop, code, ssh, info, delete.
This is likely doable using cobra's built-in ValidArgsFunction command parameter
Describe the solution you'd like
For example:
"daytona start wor [TAB]" becomes "daytona start workspace1"
"daytona start workspace1 proj [TAB]" becomes "daytona start workspace1 project1"

I also agree with this idea. when I use Git to switch branches, I often use "[TAB]" to autocomplete the branch name. this is very convenient.

@Twacqwq I added a bounty if you or anyone else wants to try and contribute :)

I tried to implement it.

I tried to implement it.

ohh, If the method works, I will also do auto complete for other commands in the future.


CI: run under normal user inside Docker

The recently added vendor check rewrites "vendor" inside Docker, which
later broken working with the repo because those files then became
owned by root.
We could run "sudo chown" after each "docker run" invocation, but it
is safer and faster to not run as root inside Docker in the first
place.

https://cloudnative-k8sci.southcentralus.cloudapp.azure.com/job/pmem-csi/job/devel/109/console shows the problem:
15:22:25  + git checkout FETCH_HEAD
15:22:25  warning: unable to unlink 'vendor/gopkg.in/freddierice/go-losetup.v1/.gitignore': Permission denied
15:22:25  warning: unable to unlink 'vendor/gopkg.in/freddierice/go-losetup.v1/LICENSE': Permission denied
15:22:25  warning: unable to unlink 'vendor/gopkg.in/freddierice/go-losetup.v1/README.md': Permission denied
15:22:25  warning: unable to unlink 'vendor/gopkg.in/freddierice/go-losetup.v1/constants.go': Permission denied
15:22:25  warning: unable to unlink 'vendor/gopkg.in/freddierice/go-losetup.v1/device.go': Permission denied
15:22:25  warning: unable to unlink 'vendor/gopkg.in/freddierice/go-losetup.v1/format.go': Permission denied
15:22:25  warning: unable to unlink 'vendor/gopkg.in/freddierice/go-losetup.v1/info.go': Permission denied
15:22:25  warning: unable to unlink 'vendor/gopkg.in/freddierice/go-losetup.v1/losetup.go': Permission denied
15:22:25  error: unable to unlink old 'vendor/modules.txt': Permission denied
15:22:25  Note: checking out 'FETCH_HEAD'.

@avalluri: please have a look. This was rebased and should now work (https://cloudnative-k8sci.southcentralus.cloudapp.azure.com/job/pmem-csi/view/change-requests/job/PR-477/12 is passed the point that was previously failing mysteriously - the suppressed sshkey-gen stderr made it a bit harder to understand the root cause = missing user entry in /etc/passwd).

Spoke too soon. The cluster started, but didn't actually work and I still had a debug "sleep" in it.
Looks like "sudo" and root-privileges will be needed after all:
15:33:33  test/start-kubernetes.sh: line 177: sudo: command not found
15:33:33  ERROR: failed to mount tmpfs with size<PHONE_NUMBER> on /mnt/workspace/pmem-csi_PR-477/_work/clear/data/pmem-csi-clear-master/etcd-volume

This took a while to converge on a solution...
I was experimenting for a while with a combination of "docker create + docker start + docker exec" instead of "docker exec --rm" (i.e. start build container only once for the entire CI run, then run different commands in it), but that had drawbacks (like "docker exec" not supporting --group-add) and ultimately didn't work (despite --privileged, a command running under sudo was unable to execute privileged operations like filesystem mounting).
Now I am updating the build container image once at the beginning with changes that shouldn't be in our Dockerfile (like configuring sudo) and continued to use "docker exec --rm". To avoid repeated downloading, the required tools still get installed in the Dockerfile.
@avalluri: please have a look.


Angular 14

Hi. Thank you for this library. This is something that Angular should support natively.
Could you please update the Angular Version to 14.

Hi @SergejSintschilin I have upgraded to Angular 14!
Thanks for using my library and take a look to my other Angular libraries https://www.npmjs.com/~nigro.simone

Oh. Thanks. This was fast.

You forgot to change it here.
😄
https://github.com/nigrosimone/ng-for-track-by-property/blob/main/projects/ng-for-track-by-property/package.json

ops! fixed


Commits order is wrong

For example, commits with the same datetime from 85b38190d144a936d86b7ac1c4361d3efc9844ac to 7a604cdd98eff2883b9dbd7d1ca1ddd8c147b80e are not in order for sure. Link (it's not permanent).

Done in https://github.com/alexezeder/fmt_bnchmrk_gnrtr/commit/a670c49194d26459b82dcef2631f3e1d3a9e614b.


Have mesos span multiple availability zones

We should be able to achieve something like the above - having 2 masters in one AZ and another in a second AZ (providing higher availability)

To improve availability you'd need to spread ZK and Consul across 3 AZs in a single region.

This should work fine.

Closing as https://github.com/Capgemini/Apollo/pull/385 got in.


I should see that my balance is being determined when connecting to a provider

Ideally this would provide feedback to the user as to how much progress had made, i.e. a progress bar. We can only really do this though if we're using a blockfilter-based approach, but that results in a pretty big performance hit.
The other approach is to tell the user how many addresses have been scanned so far, which doesn't tell you how long it'll take precisely, but the user will have some idea of how many addresses they've utilized most likely.

Starting on this.

A relatively simple "indeterminate loader" take on this:

I'm unsure exactly what "Address-scanning" processes look like with wallets, but another version of this, with an actual endpoint could be rendered as such:

This has been merged.


Edit SOA

Is there a way to edit the SOA record for a domain? I see the SOA in the records DB table, however I can't find a way to edit it via PowerDNS-Admin.

Worked it out - Just had to enable SOA in Settings -> Basic.


Simple EC2 user-data VM test

This is a first pass at creating a VM test (which will soon become a handful of VM tests once I incorporate this with my other userdata work). It's not terrible but not quite in a mergeable state. I'm looking for feedback on the approach and hints for how to do it better.
cc @edolstra @rbvermaa @cstrahan
I'll add comments on individual files to explain why I'm doing things.
Once I get the basics ironed out in this test (shouldn't take long I hope!), I plan to make a separate PR for #7370 that not only adds the functionality but adds tests to here that ensure that the new user-data format works properly while not breaking the current user-data format.

(anyone else outside of the cc list is obviously welcome to give feedback too :smile:)

I've updated the PR with a cleaner approach to emulating the metadata service. The only thing preventing me from merging now is the commented-out line in Machine.pm. If anyone can comment on what the reasons are for that, I can move ahead with my evil plans to conquer all of AWS with NixOS.

I think this should be safe to merge now, except for the fact that it contains (and depends on) #8204, which might be undesired. Can someone take a quick look and make sure the non-#8204 parts look reasonable?

@rbvermaa @edolstra should I add this test to the tested jobset? It seems desirable to keep the EC2 image working correctly when it's listed prominently (with a ton of different variations) on the homepage. It's a slightly expensive test (it builds an image) but it doesn't take all that long.


adding support for {representation} anatomy key

Changelog Description
adding empty string to dictionary TEMLATE DATA [representation] because this key solves later in integration step so for submossion time its not here and need to presist as var but be empty
Testing notes:
to recreate a bug:

add {representation} key to anatomy tempate
try to publish and see it fails
try this PR and ses that it passes and all representations collected in separate folders

add {representation} key to anatomy tempate
try to publish and see it fails

I'm quite confident that if this fixes it that it's not the fix we want. If for whatever reason no valid value was put into the anatomy data down the line - we would basically be formatting it with incorrect data.
Also, there are some plug-ins, like collecting of instance.data["publishDir"] which as far as I know still assume that products of a publish end up as representations next to each other - and hence, there may be way more logic relying on that. E.g. published textures with Maya looks - we may need to 'test' whether it actually applies the resource transfer correctly and correctly remaps them.
Also, for resources that are sometimes collected during publishing like that, those are put into {publishDir}/resources. But what if there are multiple representations, in which of those representations' "publish directories" should those files end up? The logic is very likely undefined.

I have to agree with @BigRoy that this does not look as bugfix, but more like a source of future bug. Maybe rather create issue with more information about the issue you're facing?

The problem with that that we remove original for example "redshift_rop"  instance and creane new instances "render" per aov and generate representations after so redshift_rop will never get representations and json whitch we use for ayon publisher task dont have anything regardles publsigh folder. All steps of collecting and sorting thins performs in the integrator stage of ayon publish tack itself so at submission time there will not be any representation that we can put here

but i see what you mean, this fix will only work if {representation} key is the last in a chain in anatomy template

Guys I think maybe... is it an old piece of code? I'm asking because looks like my "fix" actually breaks an anatomy folder path but it still publishes I right directories because all path stuff hanled after in separate task at integration stage when we launch ayon task  in deadline, so do we realy need that ENV at publish time? What the function of it if it still ignored? Maybe can we just get rid of this part of cod where we set outpudirectory0?

Totally agree for dont merging!!! I just don't know that keys could be optional! Thanks and please close this pr!)


RHIROS-623 show iso format date in api endpoints

Why do we need this change? :thought_balloon:
Use iso format for report_date.

Documentation update? :memo:

[ ] Yes
[X] No

Security Checklist :lock:
Upon raising this PR please go through RedHatInsights/secure-coding-checklist
:guardsman: Checklist :dart:

[ ] Bugfix
[ ] New Feature
[X] Refactor
[ ] Unittests Added
[ ] DRY code
[ ] Dependency Added
[ ] DB Migration Added

Codecov Report
Base: 73.32% // Head: 73.32% // No change to project coverage :thumbsup:

Coverage data is based on head (95ebcb3) compared to base (6d96dd5).
Patch has no changes to coverable lines.

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #298   +/-   ##
=======================================
  Coverage   73.32%   73.32%
=======================================
  Files          27       27
  Lines        1282     1282
=======================================
  Hits          940      940
  Misses        342      342

Flag
Coverage Δ

unittests
73.32% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

ros/api/v1/hosts.py
86.46% <ø> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Feat: Added version info into sidebar

Description of your changes
Added version info from package.json to the sidebar
Fixes #343
I have:

[x] Read and followed KubeVela's contribution process.
[x] Related Docs updated properly. In a new feature or configuration option, an update to the documentation is necessary.
[x] Run yarn lint to ensure this PR is ready for review.
[ ] Added backport release-x.y labels to auto-backport this PR if necessary.

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: HendersonTyler sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.

@HendersonTyler  Thank your first PR.

CSS has never been my favourite. 🥲
Changing width to 50% didn't make the text align very well, so I changed a few more settings. Please let me know if it still isn't right.


Performance issues with paginate()

This may be helpful for people.
The paginate function runs into severe performance issues when the datasets are in the thousands.
We are using fastapi_pagination with SQLAlchemy and with a result of 8000 records. Since paginate requires a Sequence we must load the entire query result into memory and then paginate slices the result. Avg. response time above 1 second.
paginate function in the package.

def paginate(
    sequence: Sequence[T],
    params: Optional[AbstractParams] = None,
    length_function: Callable[[Sequence[T]], int] = len,
) -> AbstractPage[T]:
    params = resolve_params(params)
    raw_params = params.to_raw_params()

    return create_page(
        items=sequence[raw_params.offset : raw_params.offset + raw_params.limit],
        total=length_function(sequence),
        params=params,
    )

Our solution was to do the following, which uses the native offset() and limit() from SQLAlchemy. Obviously this does not apply to other databases ORMs so a better approach would be potentially allowing a slice_function like the length_function and then allowing a queryset-type object to be passed instead of only a sequence.
Our solution
def paginate(
    query: sqlalchemy.orm.query.Query,
    params: Optional[AbstractParams] = None,
) -> AbstractPage[T]:
    params = resolve_params(params)
    raw_params = params.to_raw_params()

    return create_page(
        items=query.offset(params.offset).limit(params.limit).all(),
        total=query.count(),
        params=params,
    )

The new function is 100x faster (.01 seconds)

Hi @fsnlarson,
Did you try to use fastapi_pagination.ext.sqlalchemy.paginate? It looks almost the same as your solution:
https://github.com/uriyyo/fastapi-pagination/blob/5a9ad788b2fbc5e34380e4b24a519921b4d52ab9/fastapi_pagination/ext/sqlalchemy.py#L14-L32

That extension is the right solution. The docs should maybe be updated to show an example of using an extension.


WIP: Use Prism v0.25

Implementation

Automated Tests

Manual Tests

Due to https://github.com/ruby/prism/pull/2685 we may need to wait for a new Prism release.

Succeeded by https://github.com/Shopify/ruby-lsp/pull/1953


Failed to execute 'postMessage' on 'DOMWindow': The target origin (https://....) provided does not match the recipient window's origin ('https://...')

React player showing following console error message When We provides url  of  youtube videos.
Can you suggest how can i fix this?

Im also seeing this, I tried to add the origin property to the youtube args but it didnt work.

Duplicate of #508


wallet configuration update (short process)

need before https://github.com/TalaoDAO/AltMe/issues/2156
If profile has been added , add a button "Update profile" in the Settings/About screens
When User clics, wallet asks user to enter email and password (same creen as at wallet creation) and the wallet gets the configuration file with same call as for creation


Upgrade autosize plugin to version 3

See https://github.com/jackmoore/autosize/releases
We're still using the version 1 (which is wrapped in a jQuery plugin). The new version 3 seems to close many bugfixes and doesn't come as a jQuery plugin anymore.
@vogdb When you have a moment could you check how we can best include the new version?
cc @christopheschwyzer

The easy-kick upgrade didn't work. Need to investigate.

Btw. The problem is that initial height is incorrect.

Depends on jackmoore/autosize#217

Looks ok, never sure why these options are prefered over normal params.
Let's not look into this now.


Profile picture

Subject: Profile picture
Description:
Cant fix the size of profile picture
Results:
Backend version: develop-9e529dc6
Frontend version: develop-9e529dc6
User Agent: Mozilla/5.0 (Linux; Android 11; POCO X2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/100.0.4896.127 Mobile Safari/537.36
Page: https://couchers.org/profile/about
User: ahmetcan (12825)

unclear


Add test for TTY state in test environment

A preliminary patch for https://github.com/teemtee/tmt/pull/1521 - there is no test for TTY setup that would keep me in line when working on TTY/duration changes.

Nice, however it would be nice to add a) execute -h tmt --interactive which enables TTY - we shouldn't break that either b) prepare/finish - we shouldn't change current no-tty state by accident either

I see. I should move the test elsewhere then, I didn't notice the finish is involved.

Nice, however it would be nice to add a) execute -h tmt --interactive which enables TTY - we shouldn't break that either b) prepare/finish - we shouldn't change current no-tty state by accident either

I see. I should move the test elsewhere then, I didn't notice the finish is involved.

It shouldn't be involved. However everything uses guest.execute so there is a risk we fix the issue there which would affect prepare and finish as well.

Nice, however it would be nice to add a) execute -h tmt --interactive which enables TTY - we shouldn't break that either b) prepare/finish - we shouldn't change current no-tty state by accident either

I see. I should move the test elsewhere then, I didn't notice the finish is involved.

It shouldn't be involved. However everything uses guest.execute so there is a risk we fix the issue there which would affect prepare and finish as well.

Sure, makes sense. I suppose prepare should get its own chapter, too.

Refactored & prepare and finish are now tested as well.

Blocked by https://github.com/teemtee/tmt/pull/1634

Adding to 1.19 since it's a prerequisite for https://github.com/teemtee/tmt/pull/1521.


Questions about Horizontal Flux Regridder for GCHP mass flux

Hi all,
I have several questions regarding the horizontal flux regridder and its fix #2056.
Currently variables using HFLUX regridder in GCHP are mass fluxes MFX/Y and courant number CX/Y.
MFXC;MFYC Pa_m+2_s-1 N H F0;003000 none  0.6666666 MFXC;MFYC
CXC;CYC   1          N H F0;003000 none  none      CX;CY

MFX/Y
As mentioned in https://github.com/GEOS-ESM/FVdycoreCubed_GridComp/issues/174, GEOS archived MFX/Y are in Pa m+2 = kg * g. Another evidence is in FV3 fv_tp_2d, it seems mfx/y does not need to multiply by edge length to be used.
Also in GEOS-5 file glossary, MFX/Y are already multiplied by edge length:

Thus, isn't it better to rollback to the "before-fix" HFLUX regridder that simply MFX_12 = MFX_1 + MFX_2 instead of the "fixed" version that MFX_12 = (MFX_1*dy_1 + MFX_2*dy_2) / d12? E.g. MFX is uniform 2 kg * g in C180. If regridded to C90, intuitively thinking, 4 kg of air enter the C90 grid. Thus, MFX should be 4 kg * g instead of still being 2 kg * g.
CX/Y
Courant number CX is u*dt/dx if I understand correctly.  If the velocity component U is the real  "flux" that needs the HFLUX regridder, then CX_12 = [ (CX_1*dx_1) * dy_1 + (CX_2*dx_2) * dy_2 ]/ (dy_12 * dx_12). I am not quite sure about this part, please correct me if I am wrong.
Timestep
Since MFX and CX are both dt dependent, I am curious what's the dynamic heartbeat of GEOS-DAS products like MERRA-2, GEOS-FP and GEOS-IT? Is it 450s like mentioned in https://github.com/GEOS-ESM/FVdycoreCubed_GridComp/issues/174#issuecomment-1218222853? If so, we might be using the wrong scale factor for MFX/Y in GCHP(600s). It should be 1.3333333 instead of 0.6666667. And it help explains why our imported mass flux are always two times smaller than wind derived mass flux.
Tagging @lizziel @sdeastham for GCHP related issues
Tagging @tclune for the Horizontal Flux Regridder implementation

You may well be correct.   my memory is that I introduced the   weighted sum for MFX/Y at the request of @sdeastham who had some data to indicate that this was needed.
I know that there was some evidence that the units claimed by GEOS were not correct for some associated quantities.
If you have a version that seems to give you good answers,  just update this PR and we'll roll it in.   GCHP is the only user of the feature - so they are free to define what they need to happen.  (Sorry to duck* - I've not given it thought in a long while.)

I'll check the systems tomorrow on Discover. @mathomp4 A reminder!

@mathomp4 Thanks, I will modify the scaling factor accordingly.

I'll long term this.


Manual_pick

Add code to plot manual picks on the result for comparison. The manual picks should be in a text file format.

Decide to save the probability and plot in another function.


debug option for webpack

Codecov Report
Patch and project coverage have no change.

Comparison is base (9d6c7fc) 82.03% compared to head (567ee45) 82.03%.

:exclamation: Current head 567ee45 differs from pull request most recent head 4697488. Consider uploading reports for the commit 4697488 to get more accurate results

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
Additional details and impacted files
@@           Coverage Diff           @@
##             main     #695   +/-   ##
=======================================
  Coverage   82.03%   82.03%
=======================================
  Files          27       27
  Lines         668      668
  Branches      120      120
=======================================
  Hits          548      548
  Partials      120      120

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


[MLIR][DISC] support fusion on buffer

This pass implements the logic to group kLoop/kInput fusion patterns on
buffer level. The reason for this is that we can avoid a lot of
headaches to handle shape-only consumers specially (e.g. memref.dim,
shape.shapeOf) since shapes are already resolved in buffer world. It may
be better to move this pass to tensor level after more shape
inference/constraint infras are ready on mhlo level.

@joker-eph Could you help to review this PR?

Sorry I was out for a few days when this PR was sent and I missed, will look now!

@joker-eph Sorry, I add a more commit to fix the sanity check failure. BTW, is there any tool like clang-format I can use outside the google to check the BUILD file format? Thanks!

@joker-eph Hi, could you help to have a look again?

Formatter for BUILD file: https://github.com/bazelbuild/buildtools

You need to rebase and fix the conflict I think before the import will go through

@joker-eph Thanks! I have fixed the conflict.


sed command in helper scripts breaks on some platforms

The sed command is used in many of our helper scripts. However sed preinstalled on macOS is not POSIX compliant (works differently than on most Linux distributions). But testing for the OS on which the script is being run on is not a good proxy to find out which version of sed is going to be available since macOS users can easily reinstall it (Homebrew, symlink, ...). On top of that, some Bash emulators used on Windows do not present as an operating system.
We need to replace this test for specific operating systems (or specific Bash emulator):
https://github.com/machine-learning-exchange/mlx/blob/c24c2ed4dca89ec6d5018c88e0f7308a62a6114a/tools/bash/add_license_headers.sh#L10-L22
With this more generic test:
if ! sed -i '1s/^/test/' $(mktemp) 2> /dev/null; then
    # macOS (BSD) version of sed
    alias gsed="sed -i ''"
else
    # POSIX compliant version of sed
    alias gsed="sed -i"
fi

sed is used in various script in the mlx and katalog repo where the platform check needs to be replaced:

in the mlx repo:

mlx/api/codegen.sh
mlx/tools/bash/add_license_headers.sh

in the katalog repo:

katalog/tools/bash/upgrade_notebook_requirements.sh
katalog/tools/bash/add_license_headers.sh

@ckadner  I can look into this..

Thanks @krishnakumar27 -- let me know if you need more information


Cannot run two kstream apps simultaneously with one Kafka instance

I Cannot run two  org.springframework.cloud:spring-cloud-stream-binder-kstream spring-boot apps simultaneously that is configured  with single Kafka server.
How to reproduce:
Env:
kafkaVersion=<IP_ADDRESS>
springBootVersion=1.5.9.RELEASE
springCloudStreamVersion=Ditmars.RELEASE

example project : https://github.com/xmlking/kstream-experiments
analyzer and product apps cannot be started  simultaneously. I can start both of them,  one-at-a-time without error.
Error:
java.lang.IllegalArgumentException: Assigned partition products-0 for non-subscribed topic.
        at org.apache.kafka.clients.consumer.internals.SubscriptionState.assignFromSubscribed(SubscriptionState.java:187) ~[kafka-clients-<IP_ADDRESS>.jar:na]
        at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:215) ~[kafka-clients-<IP_ADDRESS>.jar:na]
        at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:313) ~[kafka-clients-<IP_ADDRESS>.jar:na]
        at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:277) ~[kafka-clients-<IP_ADDRESS>.jar:na]
        at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:259) ~[kafka-clients-<IP_ADDRESS>.jar:na]
        at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1013) ~[kafka-clients-<IP_ADDRESS>.jar:na]
        at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:979) ~[kafka-clients-<IP_ADDRESS>.jar:na]
        at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:407) ~[kafka-streams-<IP_ADDRESS>.jar:na]
        at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:242) ~[kafka-streams-<IP_ADDRESS>.jar:na]

2017-12-25 13:43:07.275  INFO 11205 --- [ StreamThread-1] o.a.k.clients.producer.KafkaProducer     : Closing the Kafka producer with timeoutMillis =<PHONE_NUMBER>854775807 ms.
Exception in thread "StreamThread-1" java.lang.IllegalArgumentException: Assigned partition products-0 for non-subscribed topic.
        at org.apache.kafka.clients.consumer.internals.SubscriptionState.assignFromSubscribed(SubscriptionState.java:187)
        at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:215)
        at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:313)
        at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:277)
        at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:259)
        at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1013)
        at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:979)
        at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:407)
        at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:242)

@xmlking as you can see from the stack trace this is once again not related at all to spring-cloud-stream and as @garyrussell suggested earlier when you have a question it is better to be asked on the appropriate forum such as Kafka specific Gitter and/or StackOverflow channels.
But in trying to answer your question anyway, I believe you are using the same app id.

Thanks @olegz for the hint (app id)  . i am new to spring-cloud-stream.  I need to figure out how to set unique AppID. can't find any documentation on AppID.  I am using unique spring.application.name here https://github.com/xmlking/kstream-experiments/blob/master/product/src/main/resources/application.yml

looks like we are hardcoding application.id , is there a way to overwrite StreamsConfig in my code?
props.put(StreamsConfig.APPLICATION_ID_CONFIG, "default");

https://github.com/spring-cloud/spring-cloud-stream-binder-kafka/blob/master/spring-cloud-stream-binder-kstream/src/main/java/org/springframework/cloud/stream/binder/kstream/config/KStreamBinderSupportAutoConfiguration.java#L74

@sobychacko can we keep this issue open as APPLICATION_ID_CONFIG is not exposed yet?
which is preventing us to run more then one kstream apps on single kafka instance ?


"Fatal Python error: deallocating None" at run time

Using latest Numba, 0.43.1 with Python 3.7.1 on Xubuntu 18.04.
A minimal reproducer is pasted below.
Under some conditions, a jit'd function will reduce the reference count for "None".
See reproducer code for more information.
import os
import sys

print('-- py:', sys.version.replace('\n', ' '))
from numba import jit
import numba
print('-- numba:', numba.__version__)

# Monitor None's reference count

HI_NRC = LO_NRC = NRC = sys.getrefcount(None)
def checkNoneRefCnt():
    global HI_NRC, LO_NRC, NRC
    z = sys.getrefcount(None)
    if z > HI_NRC:
        HI_NRC = z
    if z < LO_NRC:
        print('!! {:6d} -> {:6d}  ({:d})'.format(LO_NRC, z, z - LO_NRC))
        LO_NRC = z
    NRC = z

# Function under test:
#   Returns first & last indices of positive xyz values, and a count of them.
#   If "if a is None" is not executed, None's reference count shrinks.
#   Shrinkage is usually, but not always, 2 when running in vscode.

@jit(nopython=True)
def foo(lo, hi, xyz):
    fx, lx, n = None, None, 0
    for x in range(lo, hi + 1):
        if xyz[x] > 0:
            if fx is None:
                fx = x
            lx = x
            n += 1
    return fx, lx, n

def main():
    xyz = [-1, 0, 1]    # The only positive value is in the last cell.
    #lox, hix = 0, 2     # OK when last cell is seen.
    lox, hix = 0, 1     # Fails when last cell is not seen.
    for _ in range(999999):
        _ = foo(lox, hix, xyz)
        checkNoneRefCnt()

if __name__ == '__main__':
    main()

Thank you

Thanks for the report, I can reproduce. The MWE can be reduced to:
import os
import sys

print('-- py:', sys.version.replace('\n', ' '))
from numba import jit
import numba
print('-- numba:', numba.__version__)

# Monitor None's reference count

HI_NRC = LO_NRC = NRC = sys.getrefcount(None)
def checkNoneRefCnt():
    global HI_NRC, LO_NRC, NRC
    z = sys.getrefcount(None)
    if z > HI_NRC:
        HI_NRC = z
    if z < LO_NRC:
        print('!! {:6d} -> {:6d}  ({:d})'.format(LO_NRC, z, z - LO_NRC))
        LO_NRC = z
    NRC = z

@jit(nopython=True)
def foo(maybe):
    lx = None
    if maybe:
        lx = 10
    return 1, lx

def main():
    tmp = []
    for _ in range(20000):
        maybe = False
        _ = foo(maybe)
        checkNoneRefCnt()

if __name__ == '__main__':
    main()

and run with (for a consistent deallocation behaviour):
PYTHONHASHSEED=0 python issue4058.py

I suspect there's a decref issue surrounding optional return types in a tuple. If the predicate maybe is adjusted such that it is True more often the problem is less prevalent. I think the root cause may be here:
https://github.com/numba/numba/blob/1de3cd5a687011d90b1a26070c6fe47abdf8a2a5/numba/targets/boxing.py#L260-L265
and that if an Optional it not valid as a value then None needs an incref.

Thank you very much for the speedy response.
On top of being super useful, the numba project appears to be in good hands!

@kdresser no problem, thanks for your kind words and for using Numba :)

@sklam any view on the above? If you agree to the cause I'm happy to patch, else we can discuss!

@stuartarchibald

if an Optional it not valid as a value then None needs an incref.

You are right.  It just need a incref for the None


Improve resource list command buy adding group and description columns

The command will now have data that appears as follows:
resource-type  group   name               version  description                       bom-ref
-------------  -----   ----               -------  -----------                       -------
component              ACME Application   2.0.0    ACME sample application<EMAIL_ADDRESS>component              Library A          1.0.0    Library A description<EMAIL_ADDRESS>

Here is what the result of this PR produces for the resource list command:
./sbom-utility resource list -i test/cyclonedx/cdx-1-3-resource-list.json  --quiet

resource-type  group   name               version  description                       bom-ref
-------------  -----   ----               -------  -----------                       -------
component              ACME Application   2.0.0    ACME sample application<EMAIL_ADDRESS>component              Library A          1.0.0    Library A description<EMAIL_ADDRESS>component              Library C          1.0.0    Library C description<EMAIL_ADDRESS>component              Library F          1.0.0    Library F description<EMAIL_ADDRESS>component              Library G          1.0.0    Library G description<EMAIL_ADDRESS>component              Library H          1.0.0    Library H description<EMAIL_ADDRESS>component              Library NoLicense  1.0.0    Library "NoLicense" description<EMAIL_ADDRESS>component      blue    Library B          1.0.0    Library B description<EMAIL_ADDRESS>component      blue    Library E          1.0.0    Library E description<EMAIL_ADDRESS>component      green   Library D          1.0.0    Library D description<EMAIL_ADDRESS>component      green   Library J          1.0.0    Library J description<EMAIL_ADDRESS>service                Bar                         Bar service                       service:example.com/myservices/bar
service                Foo                         Foo service                       service:example.com/myservices/foo


No License Specified

Hello. There doesn't seem to be a license specified for this code which means it defaults to "All Rights Reserved" and is in effect, not open source. If that is your intention that is fine, but a license should be added so we all know whether or not we can actually use this code.
And if I can suggest a license, MIT is the most flexible.

Done, thank you!


Memory leak when writing large packets using TCP socket write

I've embedded a fairly thorough comment at the location of the leak below.  I'm currently attempting to switch the TCP part to use SwiftSocket instead of BlueSocket, keeping the same structure.  With SwiftSocket the leak goes away, but it is having its own reliability problems and the API is inferior.  I'd rather get this done with BlueSocket.
The app here is using an electro-mechanical rig to capture thousands of images of objects at fine angular offsets and distances.  In operation it captures one image every one to two seconds.   It currently crashes before reaching a thousand images due to memory starvation.  The memory problem disappears if the call to tcpWrite is commented out, with no other changes.  There shouldn't be a buffering problem since the reader (written in Unity in C#) is keeping up with the images as they are sent (1 to 1), and doesn't send a new image capture request until the prior one has been fully received.  The received images have been observed as being correct and complete.
I would guess that any app sending 2MB data chunks would observe the same leak. I'm suspicious the leak may be occurring in the Darwin layer under BlueSocket since I see no references improperly retained in any of the BlueSocket Swift code.
Update: I've switched the TCP part of this code to use SwiftSocket instead, which required some source edits to handle large messages without problems with EAGAIN (they failed to handle this at all), but that does not leak.  It uses a C language interface to Darwin, while BlueSocket uses a Swift version of the Darwin interface. Maybe something about the different interfaces explains the problem.
Here's the relevant code snipper showing usage with an all-BlueSocket implementation: This runs in its own thread via this call during initialization:
networkQueue.async {
            self.manageNetworkConnection();
}

private func manageNetworkConnection() {
        do {
            let udpSocket = try Socket.create(family: Socket.ProtocolFamily.inet,
                                              type: Socket.SocketType.datagram,
                                              proto: Socket.SocketProtocol.udp)

            while(true) {
                var ipData = Data()
               // Listen for server to announce its IP address via UDP broadcasts
                _ = try udpSocket.listen(forMessage: &ipData, on: 9396);

                // Once a UDP broadcast is received, connect via TCP/IP and use that for messaging,
                if let ipString = String(data: ipData, encoding: .utf8) {
                    do {
                        let tcpSocket = try Socket.create();
                        try tcpSocket.connect(to: ipString, port: 9395, timeout: 0)

                        // Don't block on read
                        try tcpSocket.setReadTimeout(value: 10)

                        var pingStart = Date()
                        while(true) {
                            var incomingMessage = Data()
                            try _ = tcpSocket.read(into: &incomingMessage)
                            if(tcpSocket.remoteConnectionClosed) {
                                break;
                            }
                           // Simple ping every two seconds
                            let now = Date()
                            if(now.timeIntervalSince(pingStart) > 2) {
                                pingStart = now
                                let pingData = Data()
                                try tcpSocket.write(from: pingData)
                            }
                           // Check for outgoing messages coming from another thread
                            outgoingMessagesSemaphore.wait()

                            while(outgoingMessages.count > 0) {
                                for _ in 1...outgoingMessages.count {
                                    var message = outgoingMessages.removeFirst();
                                    print("Sending image data, length = " + String(message.count))

                                    let messageCountData = Data(bytes: &message.count,
                                                           count: MemoryLayout.size(ofValue: message.count))

                                     // *** Not sure if this line leaks, it is small
                                    try tcpSocket.write(from: messageCountData)

                                    // ********* LEAK HERE **********
                                    // This line is definitely leaking by the size of the message after every call.
                                    // The message an HEIC image from an iPhone typically ranging in size
                                    // between 1MB and 2MB.  If just this line is commented out the leak goes
                                    // away.  No errors are being thrown and every message is successfully
                                    // received and read by the program at the other end of the connection.
                                    try tcpSocket.write(from: message)
                                }
                            }
                            outgoingMessagesSemaphore.signal()

                            // If the nonblocking read returned 0, then there's nothing to read and
                            // this loop does nothing
                            if(incomingMessage.count > 0) {
                                if let message = String(data: incomingMessage, encoding: .utf8) {
                                    handleNetworkMessage(message: message)
                                }
                            }
                        }
                        tcpSocket.close()
                    }
                    catch let error {
                        print(error)
                    }
                }
            }
        }
        catch let error {
            print(error)
        }
    }

Trying to reproduce but so far have been unable. Still trying.

Some time later I found that with SwiftSocket the app leaked as well. It seems that when I used Data's Advanced(by:) function to advance the data buffer to retransmit the remainder of a large packet that didn't fully send (sometimes a message could take several partial sends when working wirelessly) a leak would develop.
Advanced(by:) makes a new buffer advanced by the amount already sent and it seems not all of the copies generated would be freed.  Why I don't know, maybe it is a Swift bug.  It seemed pretty clear I was releasing all the instances I had.  When I changed away from using Advanced(by:) and instead used Data's getBytes function with a range argument representing the part of the buffer that hadn't successfully been sent in the first TCP transmission, the leak completely disappeared.  I've been able to transfer over 30 thousand photos In my biggest test cases without a leak.
If BlueSocket is using Advanced(by:) to resubmit the remainder of partially transmitted TCP messages then it might be something to be wary of, unless I was somehow misusing it.  The leak I was observing only seemed to occur during partially successful sends so if someone decides to test this further you'll need to create a situation where the TCP send can't send the whole message in one piece.
I'm going to close this since it is no longer a problem I can say with certainty exists.  Thank you for taking a look at it and sorry for the inconvenience.


Proposed CONTRIBUTING.md file using a standardized template

Purpose

New CONTRIBUTING.md file format
Leveraging https://nasa-ammos.github.io/slim/documentation/starter-kits/#contributing-guide-template
⚠ NOTE: this is a DRAFT pull-request and it needs to be customized / adapted to your repo - please commit to this PR branch with your customizations before merging!
⚠ NOTE: make your modifications by searching for the string INSERT in the file and replacing with appropriate values for your repo
⚠ NOTE: read through the file thoroughly to ensure its well adapted for your repo and your scenario, feel free to modify as needed

Proposed Changes

[ADD] CONTRIBUTING.md file with sample content

Testing

For live example, see: https://github.com/riverma/terraformly/blob/main/CONTRIBUTING.md

Withdrawing in place of: https://github.com/unity-sds/unity-docs/pull/1


Add support for includes and remote includes

This is mainly intended for downstream consumers of apko such as melange.  But it unlocks some cool things here too.

Nice. I haven't looked at the code but I'm impressed how small it is.


CUDA out of memory

Since lately, the Interrogator keeps producing out of memory on my 8GB VRAM card.
Any ideas how to solve this? Also, does the size of the interrogated image matters for the VRAM and processing?

No suggestions/ideas ... ?

Ran out of VRAM
On my RTX3070 8GB :(

I don't know the exact steps, but sometimes when I have both the Kohya_ss terminal and SD_web_ui open and I use the tiled diffusion "free gpu" memory button my idle GPU_Memory_Allocated drops to 200mb and then I can run it just fine. I think the issue is that when SD is idle I normally sit at about 4000mb GPU_Memory_Allocated according to WinDirStat. Not sure if this helps anyone, but I thought I would post about it.

When will you fix this? I can't use the extension because of this error.


Update guidance for Dedicated cluster planning

Addresses DOC-8945
Added a note to the Plan your cluster doc saying downscaling to single-node Dedicated clusters is not supported, and documented a workaround. (Same note as the one on the Manage a cluster page)
Preview: https://deploy-preview-18022--cockroachdb-docs.netlify.app/docs/cockroachcloud/plan-your-cluster.html

Looks good, thanks for this.


PostLogoutRedirectUri  to SignedOutRedirectUri

Fixes #12499

@scottaddie

Thank you once again for your help, @spottedmahn! This change will go live within the next 24 hours.

Absolutely, happy to be a contributor!  #CommunityDrivenDevelopment 😊
And I love the speed at which you guys move! 🏎


Use pce 2.0.2

With this, breakdown will be of the format described in https://github.com/atlanticwave-sdx/pce/pull/120.

coverage: 45.352%. remained the same when pulling 07eecd4af041cee8c6dc5a695cb57dceb9c8699b on use-pce-2.0.2 into<PHONE_NUMBER>fef042d91572c7bb0387b4dcdd3557 on main.


undefined method `macro' for f.association with mongoid (7.0.2)

Environment

Ruby 2.5.1p57
Rails 5.2.1
Simple Form 4.0.1
Mongoid 7.0.2

Current behavior
When using a form with Mongoid > 6 and using f.association :location, it shows this exception:
2018-10-08 12:41:45 +0100: Rack app error handling request { GET /agents/5bbb4279b4e4cf1fce975cf5/edit }
#<ActionView::Template::Error: undefined method `macro' for #<Mongoid::Association::Referenced::BelongsTo:0x00007fb47ce647a8>>
/usr/local/lib/ruby/gems/2.5.0/gems/simple_form-4.0.1/lib/simple_form/form_builder.rb:508:in `build_association_attribute'
/usr/local/lib/ruby/gems/2.5.0/gems/simple_form-4.0.1/lib/simple_form/form_builder.rb:220:in `association'
/Users/hackeron/Dropbox/Development/Xanview/timeline/app/views/agents/_form_minimal.html.slim:24:in `_app_views_agents__form_minimal_html_slim__3949601813411023705_70206448617520'
/usr/local/lib/ruby/gems/2.5.0/gems/actionview-5.2.1/lib/action_view/template.rb:159:in `block in render'
/usr/local/lib/ruby/gems/2.5.0/gems/activesupport-5.2.1/lib/active_support/notifications.rb:170:in `instrument'
/usr/local/lib/ruby/gems/2.5.0/gems/actionview-5.2.1/lib/action_view/template.rb:354:in `instrument_render_template'
/usr/local/lib/ruby/gems/2.5.0/gems/actionview-5.2.1/lib/action_view/template.rb:157:in `render'
/usr/local/lib/ruby/gems/2.5.0/gems/actionview-5.2.1/lib/action_view/renderer/partial_renderer.rb:344:in `block in render_partial'
/usr/local/lib/ruby/gems/2.5.0/gems/actionview-5.2.1/lib/action_view/renderer/abstract_renderer.rb:44:in `block in instrument'
/usr/local/lib/ruby/gems/2.5.0/gems/activesupport-5.2.1/lib/active_support/notifications.rb:168:in `block in instrument'
/usr/local/lib/ruby/gems/2.5.0/gems/activesupport-5.2.1/lib/active_support/notifications/instrumenter.rb:23:in `instrument'
/usr/local/lib/ruby/gems/2.5.0/gems/activesupport-5.2.1/lib/active_support/notifications.rb:168:in `instrument'

The code in question is:
          = f.association :location, collection: @locations, \
              include_blank: "No Location", \
              prompt: t('simple_form.placeholders.location_selection')

Expected behavior
It should show the form correctly as it does with Mongoid 6.x
Maybe a similar change to this needs to be done? < https://github.com/sferik/rails_admin/commit/9ef623f6cba73adbf86833d9eb07f1be3924a133

+1
We receive the same error.

Thank you for the issue. We never supported mongoid officially. It was working mostly by coincidence and if it breaks we don't promise we will fix.
This information is on the readme:

Please note that the association helper is currently only tested with Active Record. It currently does not work well with Mongoid and depending on the ORM you're using your mileage may vary.

:( anyone has any workaround for this?

Since there is no workaround and I've had other issues and unexpected behaviour with simple_form, I am biting the bullet and rewriting 53 forms from simple_form_for to form_for.
Thank you simple_form for all these years of making things easier for so many of us, it's been great!

I just changed f.association model to f.input model_id and it worked

Can confirm the solution by @chrisokamoto also works with multiple selects:
f.input :category_ids, collection: Category.all, input_html: {multiple: true}

Also worth noting, when you do something like this your Strong Params will need to be updated, and they are particular about how you construct them with nested arrays.
See this article for more info: Permitting Nested Arrays using Strong Params in Rails

I just changed f.association :model to f.input :model_id and it worked

Can also confirm that it works but you must change your ActiveModel validation accordingly (from model to ``model_id`) in order to maintain the errors handling facilities provided simple_form.

I just changed f.association :model to f.input :model_id and it worked

Can also confirm that it works but you must change your ActiveModel validation accordingly (from model to ``model_id`) in order to maintain the errors handling facilities provided simple_form.


chore: update dependencies

Description
Updated dependencies to the latest compatible version.
Missing updates:

@vuepress/plugin-active-header-links
@vuepress/plugin-google-analytics
@vuepress/plugin-toc
del
stylelint-config-standard
vuepress

VuePress and dependencies are still in beta and having a lot of breaking changes, it's not worth to update it until we have a problem or they release a stable version.
del changed its implementation to ESM module and we need to migrate dialtone to ESM so we can require it, so we'll stay on this version until we do that.
stylelint-config-standard new version has a lot of problems with other stylelint configs.
Pull Request Checklist

[x] Ask the contributors if a similar effort is already in process or has been solved.
[x] Review the contribution guidelines.
[x] Use staging as your pull request's base branch. (All PRs using production as its base branch will be declined).
[x] Ensure all gulp scripts successfully compile.
[ ] Update, remove, or extend all affected documentation.
[ ] Ensure no private Dialpad links or info are in the code or pull request description (Dialtone is a public repo!).

Obligatory GIF (super important!)

VuePress and dependencies are still in beta and having a lot of breaking changes, it's not worth to update it until we have a problem or they release a stable version.

Doesn't this also make it harder to update when we need to?

VuePress and dependencies are still in beta and having a lot of breaking changes, it's not worth to update it until we have a problem or they release a stable version.

Doesn't this also make it harder to update when we need to?

No, It's harder to be updating it every time, when they release a stable version we'll do a single update.


fstrim: Add service

Motivation for this change
Provide fstrim service and timer, like other systemd distros do today https://www.digitalocean.com/community/tutorials/how-to-configure-periodic-trim-for-ssd-storage-on-linux-servers
Things done

[ ] Tested using sandboxing
(nix.useSandbox on NixOS,
or option build-use-sandbox in nix.conf
on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] Linux

[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[x] Fits CONTRIBUTING.md.

Can we use the upstream units included in util-linux? It looks like we're not currently installing them. If we did, we could just say
systemd.packages = [ pkgs.utillinux ];

to get the fstrim units.

I guess a note like "Note, that it won't TRIM whole SSD, but only mounted filesystems. Unused partitions and unused LVM space should be TRIMmed manually." should be added.
Personally, I use an adapted script which takes care of unallocated LVM space.
  periodic_fstrim = { pkgs, ... }: {
    environment.etc."lvm/lvm.conf".text = ''
      devices {
        issue_discards = 1
      }
    '';

    systemd.services.periodic_fstrim = {
      startAt = "Sun 00:00:00";
      path = with pkgs; [ utillinux lvm2 ];
      script = ''
        echo TRIMming mounted filesystems...
        time fstrim -v --all
        echo TRIMming unused LVM space...
        lvm vgs -o vg_name,vg_free_count --noheadings | while read vgname free ; do
		      vgdev="/dev/$vgname/discard"
		      if [ -e "$vgdev" ]; then
			       echo "Logical volume $vgdev does already exist." >&2
			       echo "If it is just a leftover from a previous run then remove it with:" >&2
			       echo "lvm lvremove -f \"$vgdev\"" >&2
		      elif [ "$free" -gt 0 ]; then
			       lvm lvcreate -l100%FREE -n discard "$vgname"
			       cnt=5
			       while [ $cnt -gt 0 ] && ! time lvm lvremove -f "$vgdev" ; do
				       sleep 1
				       cnt=$(($cnt-1))
			       done
			       if [ "$cnt" -eq 0 ]; then
				       echo "Could not remove logical volume $vgdev" >&2
			       fi
		      fi
        done
        echo TRIMming finished
      '';
    };
  };

@edolstra Thank you much! Let's try it.

At least for me, in utillinux package, $out in configureFlags is mistakenly not evaluated: https://github.com/NixOS/nixpkgs/blob/master/pkgs/os-specific/linux/util-linux/default.nix#L36configuring
fixing libtool script ./config/ltmain.sh
configure flags:
...
--with-systemdsystemunitdir=$out/lib/systemd/system/

so units are not shipped. Possible fix pushed, please correct if needed.
Besides systemd.packages = [ pkgs.utillinux ]; I heard that an explicit wantedBy exactly systemd.timers.fstrim.wantedBy = [ "timers.target" ]; is needed in NixOS, or am I wrong?

@danbst Interesting what to do with ESP (EFI) partition, since fstrim still doesn't supported by vfat. Distros what I've seen do nothing (don't even use discard for it).

I now get cycle error. Suggestions?

Regarding the cycle, where do the units get installed? If they're installed in the same output as the binaries, you shouldn't get a cycle. Then you also don't need to patch out the ExecStart paths and don't need to override ExecStart in the module. (The usefulness of the arguments option is debatable IMHO.)
Yes, a wantedBy is needed to pull in the timer.

@edolstra Thanks! Haven't meet split derivations before, moved units installation from out to bin and removed arguments option in module.

Seems to work here. BTW, do these systemd-related configure flags also need to be added to crossAttrs.preConfigure?

Given that this changes util-linux, I expect this will be a large rebuild. Perhaps should go via staging.

Merged to staging, thanks!

@edolstra Thank you!

@bjornfor Installed fstrim.timer from utillinux already do this.

@gnidorah: I don't understand what that means.

@bjornfor
In short: upstream does this.
This https://github.com/NixOS/nixpkgs/commit/a996fe849f669e5d1cafed18f299ed6ed4abec84#diff-fab06f256b6956e04e4806ab5b9dabfbR34 says to use units from utillinux package.
And fstrim.timer unit from utillinux package defines Persistent=true like you suggested https://github.com/karelzak/util-linux/blob/stable/v2.29/sys-utils/fstrim.timer#L8

@edolstra Noticed however that fstrim -a doesn't work for root fs. Here's the fix: https://github.com/NixOS/nixpkgs/pull/26540


Error running

This happens when I run in my desktop, apk and kivy launcher via deploy.sh
And this  code line: >>   28:    resolution: 640, 480 # 1920, 1080
is related to the last commit, maybe is just happening with me .
11-21 18:25:29.689  1882  1910 I python  :  Traceback (most recent call last): 11-21 18:25:29.690  1882  1910 I python  :    File "main.py", line 38, in <module> 11-21 18:25:29.691  1882  1910 I python  :      CameraApp().run() 11-21 18:25:29.692  1882  1910 I python  :    File "/home/tito/code/python-for-android-upstream/build/python-install/lib/python2.7/site-packages/kivy/app.py", line 802, in run 11-21 18:25:29.693  1882  1910 I python  :    File "main.py", line 32, in build 11-21 18:25:29.694  1882  1910 I python  :      return Builder.load_string(kv) 11-21 18:25:29.696  1882  1910 I python  :    File "/home/tito/code/python-for-android-upstream/build/python-install/lib/python2.7/site-packages/kivy/lang.py", line 1921, in load_string 11-21 18:25:29.699  1882  1910 I python  :    File "/home/tito/code/python-for-android-upstream/build/python-install/lib/python2.7/site-packages/kivy/lang.py", line 2084, in _apply_rule 11-21 18:25:29.702  1882  1910 I python  :    File "/home/tito/code/python-for-android-upstream/build/python-install/lib/python2.7/site-packages/kivy/lang.py", line 1970, in apply 11-21 18:25:29.706  1882  1910 I python  :    File "/home/tito/code/python-for-android-upstream/build/python-install/lib/python2.7/site-packages/kivy/lang.py", line 2130, in _apply_rule 11-21 18:25:29.711  1882  1910 I python  :  kivy.lang.BuilderException: Parser: File "<inline>", line 28: 11-21 18:25:29.712  1882  1910 I python  :  ... 11-21 18:25:29.714  1882  1910 I python  :       26: 11-21 18:25:29.716  1882  1910 I python  :       27:    id: camera 11-21 18:25:29.718  1882  1910 I python  :  >>   28:    resolution: 640, 480 # 1920, 1080 11-21 18:25:29.720  1882  1910 I python  :       29:    allow_stretch: True 11-21 18:25:29.722  1882  1910 I python  :       30: 11-21 18:25:29.724  1882  1910 I python  :  ... 11-21 18:25:29.726  1882  1910 I python  :  JavaException: JVM exception occurred: Fail to connect to camera service 11-21 18:25:29.728  1882  1910 I python  :    File "/home/tito/code/python-for-android-upstream/build/python-install/lib/python2.7/site-packages/kivy/lang.py", line 2123, in _apply_rule 11-21 18:25:29.730  1882  1910 I python  :    File "kivy/weakproxy.pyx", line 22, in kivy.weakproxy.WeakProxy.__setattr__ (kivy/weakproxy.c:1235) 11-21 18:25:29.732  1882  1910 I python  :    File "kivy/properties.pyx", line 408, in kivy.properties.Property.__set__ (kivy/properties.c:5114) 11-21 18:25:29.734  1882  1910 I python  :    File "kivy/properties.pyx", line 733, in kivy.properties.ListProperty.set (kivy/properties.c:11127) 11-21 18:25:29.736  1882  1910 I python  :    File "kivy/properties.pyx", line 446, in kivy.properties.Property.set (kivy/properties.c:5876) 11-21 18:25:29.738  1882  1910 I python  :    File "kivy/properties.pyx", line 501, in kivy.properties.Property.dispatch (kivy/properties.c:6557) 11-21 18:25:29.739  1882  1910 I python  :    File "kivy/_event.pyx", line 1224, in kivy._event.EventObservers.dispatch (kivy/_event.c:13497) 11-21 18:25:29.740  1882  1910 I python  :    File "kivy/_event.pyx", line 1130, in kivy._event.EventObservers._dispatch (kivy/_event.c:12696) 11-21 18:25:29.741  1882  1910 I python  :    File "/home/tito/code/python-for-android-upstream/build/python-install/lib/python2.7/site-packages/kivy/uix/camera.py", line 103, in _on_index 11-21 18:25:29.742  1882  1910 I python  :    File "/home/tito/code/python-for-android-upstream/build/python-install/lib/python2.7/site-packages/kivy/core/camera/camera_android.py", line 40, in __init__ 11-21 18:25:29.743  1882  1910 I python  :    File "/home/tito/code/python-for-android-upstream/build/python-install/lib/python2.7/site-packages/kivy/core/camera/__init__.py", line 70, in __init__ 11-21 18:25:29.743  1882  1910 I python  :    File "/home/tito/code/python-for-android-upstream/build/python-install/lib/python2.7/site-packages/kivy/core/camera/camera_android.py", line 47, in init_camera 11-21 18:25:29.744  1882  1910 I python  :    File "jnius/jnius_export_class.pxi", line 906, in jnius.jnius.JavaMultipleMethod.__call__ (jnius/jnius.c:27875) 11-21 18:25:29.745  1882  1910 I python  :    File "jnius/jnius_export_class.pxi", line 637, in jnius.jnius.JavaMethod.__call__ (jnius/jnius.c:24246) 11-21 18:25:29.746  1882  1910 I python  :    File "jnius/jnius_export_class.pxi", line 803, in jnius.jnius.JavaMethod.call_staticmethod (jnius/jnius.c:26271) 11-21 18:25:29.746  1882  1910 I python  :    File "jnius/jnius_utils.pxi", line 93, in jnius.jnius.check_exception (jnius/jnius.c:3870) 11-21 18:25:29.747  1882  1910 I python  :   11-21 18:25:29.811  1882  1910 I python  : Python for android ended.
Regards

I have the same issue. @rlimaeco did you manage to fix it? Thanks

can`t run in kivy launch also.
is it better by package?

@goffi-contrib I'm not using this garden module anymore, Just use plyer like:
`
if platform == "android":
from plyer import camera
            camera.take_picture(filename=filepath,
                                on_complete=self.camera_callback)`

To my experience, this usually is a permission issue. e.g. static CAMERA permission not here or dynamic camera permission not given

Hi, I have totally forgotten about this issue, I'm not using this garden module but plyer instead.

Thanks for the feedback @goffi-contrib anyway this module needs some love. And if it really is a permission issue, then xcamera should fail more gracefully anyway. So we do have a bug here still


Add error handling for cleaning up old comments

Also:

Used gofmt to fix import order.
Added an info log for showing which port the app is running on

Hey @seemethere
Thanks for the PR. This looks good to merge. I'll cherry pick this PR (and a few other PRs) into a mega PR (so that we can avoid annoying merge conflicts). You'll still be the author :)

Cherry-picked and merged here: https://github.com/adtac/commento/pull/35
Of course, he commit author information is unchanged.
Thanks!


Update README.md

adding links to Discord and our forum
adding link to Grist for Spreadsheet Users post
other minor edits to make things cleaner

Fixed note and added one more small edit.


Update azure configs

Type of change

[ ] Refactor
[ ] New feature
[x] Bug fix
[ ] Optimization
[ ] Documentation Update

Description
Several modifications to make azure work again:

Default storageclass is now managed-csi
Create missing ovn-dp-v2 configuration, aligned with the AWS sizing one

Related Tickets & Documents

Related Issue #
Closes #

Checklist before requesting a review

[x] I have performed a self-review of my code.
[ ] If it is a core feature, I have added thorough tests.

Codecov Report

Merging #353 (2e1dfdd) into master (745ea2c) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #353   +/-   ##
=======================================
  Coverage   79.06%   79.06%
=======================================
  Files          22       22
  Lines        1003     1003
=======================================
  Hits          793      793
  Misses        210      210

Flag
Coverage Δ

gha
79.06% <ø> (ø)

python-3.9
79.06% <ø> (ø)

unit
79.06% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.


LIBSPDM_MAX_MESSAGE_VCA_BUFFER_SIZE seems to need larger size.

LIBSPDM_MAX_MESSAGE_VCA_BUFFER_SIZE is defined based on a below statement.

Length of the entire request message, in bytes. Length shall be less than or equal to 128 bytes. - Paragraph 252, Table 15 - NEGOTIATE_ALGORITHMS request message format, DSP0274_1.2.1

https://github.com/DMTF/libspdm/blob/f5e8613f44648919ee22bb007add59e8c265f0a8/include/library/spdm_common_lib.h#L212-L224
This value assumes that there are no ExtAsymCount and no ExtHashCount. However, in point of responder's view, It doesn't know how long the NEGOTIATION_ALGORITHMS will be until receive it. So, It would be better to allocate additional 80 bytes to reserve Maximum length, 128 bytes.
And also, It can be required additional space for fields which include ExtAsymSel, ExtHashSel and each AlgExternal for ALGORITHMS. However, we can remain these for configurable value, in my opinion.

@IamSukwonKim, this is valid point. Thanks!
So far, we do not see any Ext use case, and libspdm does not support Ext algorithm at all.
Would you please share with us what use case you will have to support Ext Algorithm?

@jyao1, It’s my pleasure. Thank you :)

Would you please share with us what use case you will have to support Ext Algorithm?

We don' have any use cases for Ext. Algorithm, too. What I'm trying to say is that the responder can't be sure that there will be no Ext Algorithm in the future, because of the specification.

So far, we do not see any Ext use case, and libspdm does not support Ext algorithm at all.

If there are no use case, why don't we get rid of the fields. So, that we can save memory.

Even if an endpoint does not support the ext algorithms they'll still end up in the transcript. The memory allocation for VCA should reflect that, within reason.

Even if an endpoint does not support the ext algorithms they'll still end up in the transcript. The memory allocation for VCA should reflect that, within reason.

Of course, if we're sure by considering backward compatibility, code complexity or something else, we might remove it from the spec. first, and then from the code.

@IamSukwonKim, can we assign to you, then you can propose a patch?

@IamSukwonKim, can we assign to you, then you can propose a patch?

First, PR is not possible in my work environment.  Second, I'm not sure if I'm allowed to PR outside of my workspace, and third, even if I could, it would take a long time because I'm so busy these days.
I want to do the work. If I find out a way, I'll let you know again.


Update irmin’s requirements (uses Fmt.failwith)

Ports https://github.com/ocaml/opam-repository/pull/21839

Codecov Report

Merging #1990 (71f3e8e) into main (3ad4824) will decrease coverage by 0.02%.
The diff coverage is n/a.

:exclamation: Current head 71f3e8e differs from pull request most recent head cf7a27d. Consider uploading reports for the commit cf7a27d to get more accurate results

@@            Coverage Diff             @@
##             main    #1990      +/-   ##
==========================================
- Coverage   63.80%   63.77%   -0.03%
==========================================
  Files         129      129
  Lines       15517    15517
==========================================
- Hits         9900     9896       -4
- Misses       5617     5621       +4

Impacted Files
Coverage Δ

src/irmin-fs/unix/irmin_fs_unix.ml
67.09% <0.00%> (-1.30%)
:arrow_down:

src/irmin-fs/irmin_fs.ml
81.21% <0.00%> (-1.22%)
:arrow_down:

:mega: Codecov can now indicate which changes are the most critical in Pull Requests. Learn more

Thanks!


Update ValidateRequestAttribute to use web.config

Instead of hardcoding the configuration into the ValidateRequestAttribute, you can now configure the attribute from the Web.config file:
Web.config:
<?xml version="1.0" encoding="utf-8"?>
<configuration>
<configSections>
  <sectionGroup name="twilio" type="Twilio.AspNet.Mvc.TwilioSectionGroup,Twilio.AspNet.Mvc">
    <section name="requestValidation" type="Twilio.AspNet.Mvc.RequestValidationConfigurationSection,Twilio.AspNet.Mvc"/>
  </sectionGroup>
</configSections>
<twilio>
   <requestValidation
     authToken="your auth token here"
     urlOverride="https://??????.ngrok.io/sms"
     allowLocal="true"
   />
</twilio>
<appSettings>
  <add key="twilio:requestValidation:authToken" value="your auth token here!"/>
  <add key="twilio:requestValidation:urlOverride" value="https://??????.ngrok.io/sms"/>
  <add key="twilio:requestValidation:allowLocal" value="true"/>
</appSettings>
...

You can configure the attribute using the twilio.requestValidation section, but you can also override this configuration using the appSettings.
The reason for this is that appSettings has configuration builders which allow for storing the auth token as a secret.
Also on platforms like Azure Web Apps, you can override appSettings from the portal, but you cannot override the configuration sections.
Attribute usage is now like this:
public class SmsController : TwilioController
{
  [ValidateRequest]
  public TwiMLResult Index(){}
}

AuthToken, UrlOverride, and AllowLocal cannot be configured through the constructor or object initializer.
However, you can still inherit from the attribute and configure the properties as you wish.
Contributing to Twilio

All third-party contributors acknowledge that any contributions they provide will be made under the same open-source license that the open-source project is provided under.

[x] I acknowledge that all my contributions will be made under the project's license.

Fixes #49


Add Github Action run id to coverage file names

Before submitting
Please complete the following checklist when submitting a PR:

[ ] All new features must include a unit test.
If you've fixed a bug or added code that should be tested, add a test to the
tests directory!

[ ] All new functions and code must be clearly commented and documented.
If you do make documentation changes, make sure that the docs build and
render correctly by running make docs.

[ ] Ensure that the test suite passes, by running make test.

[ ] Add a new entry to the .github/CHANGELOG.md file, summarizing the
change, and including a link back to the PR.

[ ] Ensure that code is properly formatted by running make format.

When all the above are checked, delete everything above the dashed
line and fill in the pull request template.

Context: The upload of coverage reports to codecov is currently causing failures due to a failure mode similar to https://community.codecov.com/t/ci-failure-due-to-too-many-uploads-to-this-commit/2587. This PR aims to rename the existing uploaded coverage files to have names unique to each job run, to avoid contention on the server.
Description of the Change: Renames the coverage output files to also include the job run ID.
Benefits:
Possible Drawbacks:
Related GitHub Issues:

@mlxd can we squeeze in an update to here: https://github.com/PennyLaneAI/pennylane-lightning/blame/489cff75f64fb1ddb706a7e6fa27d1ae15f1c1b0/setup.py#L197
so that we instead point to https://github.com/PennyLaneAI/pennylane-lightning

@mlxd can we squeeze in an update to here: https://github.com/PennyLaneAI/pennylane-lightning/blame/489cff75f64fb1ddb706a7e6fa27d1ae15f1c1b0/setup.py#L197 so that we instead point to https://github.com/PennyLaneAI/pennylane-lightning
(you suggested this a few months back)

https://github.com/PennyLaneAI/pennylane-lightning/pull/581 @dime10 already opened a PR for this


⚠ Bofrost.be has degraded performance

In 4d524ad, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 2137 ms

Resolved: Bofrost.be performance has improved in 6d8ec2e.


GCS offload support(4): add documentations for GCS

This is the 4th part to support Google Cloud Storage offload.
It aims to add documentations for GCS. And it is based on PR #2151
Master Issue: #2067

retest this please

@ivankelly Thanks for the comments, updated this PR.

rerun integration tests

@ivankelly , updated again.

@ivankelly , updated again.

rerun C++ / Python Tests

retest this please

retest this please

retest this please

fyi please hold on merging this until I cut over 2.1 website.


Output Reason 3 syntax. Support optional object properites. Test with…

Print code in Reason 3 syntax.
Support optional object properties.
Add test with React component, including optional properties that map to optional arguments passed to the make function.
Updated refmt using the reason npm package, which included refmt for Reason 3 syntax.
Updated snapshot tests.

Omg this is amazing! Thank you so much! 😁

Released in v0.13


Added simple validation parsing

Check for "BEGIN:VCARD" / "END:VCARD" as simple validation parsing, see #2

This pull request is being discussed here:
https://github.com/mixerp/MixERP.Net.VCards/issues/2

Thanks for the pull request. Fixed #2.


KAFKA-5061 - Make default Worker Task client IDs distinct

Use the task ID to make the default client IDs used by Worker Tasks
distinct and stable. This is avoids name conflicts on JMX MBeans and
enables useful monitoring.
This implements KIP-411, and so it should be merged only after that KIP is approved.
See: https://issues.apache.org/jira/browse/KAFKA-5061
This PR is an alternative to https://github.com/apache/kafka/pull/5775, avoiding the need for a new  configuration option.
Committer Checklist (excluded from commit message)

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation (including upgrade notes)

@rhauch I also have a process question you might be able to help with. Since we're now planning to change configuration defaults, do you think I need to submit a new KIP or is an update to KIP-411 enough?

retest this please

@pdavidson100 thanks for the changes. To answer your question about process, it's better to update KIP-411 than to close KIP-411 and open a new one, and I see from the KIP-411 discussion thread this is what you did.

Voting is now underway on KIP-411. Please vote if you would like this PR merged!  Thanks.

retest this please

@pdavidson100 is this still a WIP, or is this ready to merge? Seems like it's ready to merge, but I wanted to double check.

Thanks @rhauch - yes, the PR was ready to merge!

Is there a way to share the Mbean sensor across multiple consumers using the same client-id ?
We have an auto-scaling Kafka connect cluster which uses client and user quotas. So we wont be able to use distinct client-ids for each task
I don't see this problem occurring in the case where two consumers have the same client-id + subscribed topic ?
These report metrics properly. So are these consumers sharing the Mbean sensor ?
Any help would be greatly appreciated !!


Libvirt identical SID

Operating System Version: Arch Linux (Kernel 5.8.8)
Deploying via (VirtualBox/VMWare/AWS/Azure/ESXi): Libvirt
Vagrant Version (if applicable): 2.2.10

Description of the issue:
I tried to setup DetectionLab using Libvirt. Building the boxes worked fine. However i repeatedly encounter the following error during provisioning.
powershell.exe : Add-Computer : Computer 'wef' failed to join domain 'windomain.local' from its current workgroup
    + CategoryInfo          : NotSpecified: (Add-Computer : ...rent workgroup :String) [], RemoteException
    + FullyQualifiedErrorId : NativeCommandError
'WORKGROUP' with following error message: The domain join cannot be completed because the SID of
the domain you attempted to join was identical to the SID of this machine. This is a symptom of
an improperly cloned operating system install.  You should run sysprep on this machine in order
to generate a new machine SID. Please see http://go.microsoft.com/fwlink/?LinkId=168895 for more
information.

So it seems that the dc and wef have the same SID. Isn't sysprep used during the build of the Windows 2016 box?

Hi @kithack , I don't officially support the Libvirt provider, but this definitely sounds like the Sysprep step in the Packer build didn't work correctly. My only advice is to try re-creating the Packer boxes to see if that solves the problem. @Selora is the only person I'm aware of who has successfully built DetectionLab using LibVirt

Hey @clong, thanks for the fast answer! I really appreciate it. I will have a more detailed look at the Sysprep step in the Packer build and create a pull request if i am able to identify a problem.

Hi @kithack - okay to close this with the merge of https://github.com/clong/DetectionLab/pull/521?

Yes that's fine. Thanks for merging!


DeepBGC failed with KeyError: pfam_id

Hi,
I sometimes get an error:
INFO    05/03 10:31:02   Loading model from: /home/art/.local/share/deepbgc/data/0.1.0/classifier/product_activity.pkl
INFO    05/03 10:31:02   Processing input file 1/1: NZ_PZDX01000459.gbk
INFO    05/03 10:31:02   ================================================================================
INFO    05/03 10:31:02   Processing record #1: NZ_PZDX01000459
INFO    05/03 10:31:02   Sequence already contains 2 CDS features, skipping CDS detection
INFO    05/03 10:31:02   Reusing already existing HMMER hmmscan result: NZ_PZDX01000459/tmp/NZ_PZDX01000459.pfam.domtbl.txt
INFO    05/03 10:31:02   Added 1 Pfam domains (1 unique PFAM_IDs)
INFO    05/03 10:31:02   Detecting BGCs using deepbgc model in NZ_PZDX01000459
INFO    05/03 10:31:02   Detected 1 BGCs using deepbgc model in NZ_PZDX01000459
INFO    05/03 10:31:02   Classifying 1 BGCs using product_class model in NZ_PZDX01000459
ERROR   05/03 10:31:02   pfam_id
Traceback (most recent call last):
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/pandas/core/indexes/base.py", line 3080, in get_loc
    return self._engine.get_loc(casted_key)
  File "pandas/_libs/index.pyx", line 70, in pandas._libs.index.IndexEngine.get_loc
  File "pandas/_libs/index.pyx", line 101, in pandas._libs.index.IndexEngine.get_loc
  File "pandas/_libs/hashtable_class_helper.pxi", line 4554, in pandas._libs.hashtable.PyObjectHashTable.get_item
  File "pandas/_libs/hashtable_class_helper.pxi", line 4562, in pandas._libs.hashtable.PyObjectHashTable.get_item
KeyError: 'pfam_id'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/deepbgc/main.py", line 113, in main
    run(argv)
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/deepbgc/main.py", line 102, in run
    args.func.run(**args_dict)
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/deepbgc/command/pipeline.py", line 177, in run
    step.run(record)
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/deepbgc/pipeline/classifier.py", line 41, in run
    class_scores = self.model.predict(cluster_pfam_sequences)
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/deepbgc/models/wrapper.py", line 119, in predict
    X_list = self.transformer.transform(samples)
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/deepbgc/features.py", line 29, in transform
    X_list = [self._transform_sequence(sequence) for sequence in samples]
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/deepbgc/features.py", line 29, in <listcomp>
    X_list = [self._transform_sequence(sequence) for sequence in samples]
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/deepbgc/features.py", line 38, in _transform_sequence
    return pd.concat([t.transform(sequence) for t in self.transformers], sort=False)
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/deepbgc/features.py", line 38, in <listcomp>
    return pd.concat([t.transform(sequence) for t in self.transformers], sort=False)
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/deepbgc/features.py", line 204, in transform
    values = pd.get_dummies(X[self.column]).reindex(columns=self.unique_values, fill_value=0)
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/pandas/core/frame.py", line 3024, in __getitem__
    indexer = self.columns.get_loc(key)
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/pandas/core/indexes/base.py", line 3082, in get_loc
    raise KeyError(key) from err
KeyError: 'pfam_id'
ERROR   05/03 10:31:02   ================================================================================
ERROR   05/03 10:31:02   DeepBGC failed with KeyError: pfam_id
ERROR   05/03 10:31:02   ================================================================================

What is the problem here?
Attached is the extracted contig that is throwing this error.
NZ_PZDX01000459.zip
Thanks!

Hi @artur-matysik, thanks for reporting this. It was caused by CDS features whose "translation" field extended their boundaries. I fixed the issue, you can pip install deepbgc==0.1.24. The bioconda release should be ready within a day or so.
Please confirm if this works, so that we can close this issue.

Hi @prihoda,
I updated deepbgc to 0.1.24 as instructed, but I still get same error (on the example file). Did I miss something?
Thanks!
Art.
 _____                  ____    ____   ____
 |  _ \  ___  ___ ____ | __ )  / ___) / ___)
 | | \ \/ _ \/ _ \  _ \|  _ \ | |  _ | |
 | |_/ /  __/  __/ |_) | |_) || |_| || |___
 |____/ \___|\___| ___/|____/  \____| \____)
=================|_|===== version 0.1.24 =====
INFO    05/03 16:08:52   Loading model from: /home/art/.local/share/deepbgc/data/0.1.0/detector/deepbgc.pkl
Using TensorFlow backend.
WARNING 05/03 16:08:54   From /home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/keras/backend/tensorflow_backend.py:66: The name tf.get_default_graph is deprecated. Please use tf.compat.v1.get_default_graph instead.

WARNING 05/03 16:08:54   From /home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/keras/backend/tensorflow_backend.py:541: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

WARNING 05/03 16:08:54   From /home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/keras/backend/tensorflow_backend.py:4432: The name tf.random_uniform is deprecated. Please use tf.random.uniform instead.

WARNING 05/03 16:08:54   From /home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/keras/backend/tensorflow_backend.py:148: The name tf.placeholder_with_default is deprecated. Please use tf.compat.v1.placeholder_with_default instead.

WARNING 05/03 16:08:54   From /home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/keras/backend/tensorflow_backend.py:3733: calling dropout (from tensorflow.python.ops.nn_ops) with keep_prob is deprecated and will be removed in a future version.
Instructions for updating:
Please use `rate` instead of `keep_prob`. Rate should be set to `rate = 1 - keep_prob`.
WARNING 05/03 16:08:54   From /home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/keras/backend/tensorflow_backend.py:190: The name tf.get_default_session is deprecated. Please use tf.compat.v1.get_default_session instead.

WARNING 05/03 16:08:54   From /home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/keras/backend/tensorflow_backend.py:197: The name tf.ConfigProto is deprecated. Please use tf.compat.v1.ConfigProto instead.

WARNING 05/03 16:08:54   From /home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/keras/backend/tensorflow_backend.py:203: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

WARNING 05/03 16:08:54   From /home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/keras/backend/tensorflow_backend.py:207: The name tf.global_variables is deprecated. Please use tf.compat.v1.global_variables instead.

WARNING 05/03 16:08:54   From /home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/keras/backend/tensorflow_backend.py:216: The name tf.is_variable_initialized is deprecated. Please use tf.compat.v1.is_variable_initialized instead.

WARNING 05/03 16:08:55   From /home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/keras/backend/tensorflow_backend.py:223: The name tf.variables_initializer is deprecated. Please use tf.compat.v1.variables_initializer instead.

INFO    05/03 16:08:55   Loading model from: /home/art/.local/share/deepbgc/data/0.1.0/classifier/product_class.pkl
/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/sklearn/base.py:306: UserWarning: Trying to unpickle estimator DecisionTreeClassifier from version 0.18.2 when using version 0.21.3. This might lead to breaking code or invalid results. Use at your own risk.
  UserWarning)
/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/sklearn/base.py:306: UserWarning: Trying to unpickle estimator RandomForestClassifier from version 0.18.2 when using version 0.21.3. This might lead to breaking code or invalid results. Use at your own risk.
  UserWarning)
INFO    05/03 16:08:55   Loading model from: /home/art/.local/share/deepbgc/data/0.1.0/classifier/product_activity.pkl
INFO    05/03 16:08:55   Processing input file 1/1: NZ_PZDX01000459.gbk
INFO    05/03 16:08:55   ================================================================================
INFO    05/03 16:08:55   Processing record #1: NZ_PZDX01000459
INFO    05/03 16:08:55   Sequence already contains 2 CDS features, skipping CDS detection
INFO    05/03 16:08:55   Reusing already existing HMMER hmmscan result: NZ_PZDX01000459/tmp/NZ_PZDX01000459.pfam.domtbl.txt
INFO    05/03 16:08:55   Added 1 Pfam domains (1 unique PFAM_IDs)
INFO    05/03 16:08:55   Detecting BGCs using deepbgc model in NZ_PZDX01000459
INFO    05/03 16:08:55   Detected 1 BGCs using deepbgc model in NZ_PZDX01000459
INFO    05/03 16:08:55   Classifying 1 BGCs using product_class model in NZ_PZDX01000459
ERROR   05/03 16:08:55   pfam_id
Traceback (most recent call last):
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/pandas/core/indexes/base.py", line 3080, in get_loc
    return self._engine.get_loc(casted_key)
  File "pandas/_libs/index.pyx", line 70, in pandas._libs.index.IndexEngine.get_loc
  File "pandas/_libs/index.pyx", line 101, in pandas._libs.index.IndexEngine.get_loc
  File "pandas/_libs/hashtable_class_helper.pxi", line 4554, in pandas._libs.hashtable.PyObjectHashTable.get_item
  File "pandas/_libs/hashtable_class_helper.pxi", line 4562, in pandas._libs.hashtable.PyObjectHashTable.get_item
KeyError: 'pfam_id'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/deepbgc/main.py", line 113, in main
    run(argv)
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/deepbgc/main.py", line 102, in run
    args.func.run(**args_dict)
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/deepbgc/command/pipeline.py", line 177, in run
    step.run(record)
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/deepbgc/pipeline/classifier.py", line 41, in run
    class_scores = self.model.predict(cluster_pfam_sequences)
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/deepbgc/models/wrapper.py", line 119, in predict
    X_list = self.transformer.transform(samples)
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/deepbgc/features.py", line 29, in transform
    X_list = [self._transform_sequence(sequence) for sequence in samples]
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/deepbgc/features.py", line 29, in <listcomp>
    X_list = [self._transform_sequence(sequence) for sequence in samples]
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/deepbgc/features.py", line 38, in _transform_sequence
    return pd.concat([t.transform(sequence) for t in self.transformers], sort=False)
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/deepbgc/features.py", line 38, in <listcomp>
    return pd.concat([t.transform(sequence) for t in self.transformers], sort=False)
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/deepbgc/features.py", line 204, in transform
    values = pd.get_dummies(X[self.column]).reindex(columns=self.unique_values, fill_value=0)
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/pandas/core/frame.py", line 3024, in __getitem__
    indexer = self.columns.get_loc(key)
  File "/home/art/miniconda3/envs/deepbgc/lib/python3.7/site-packages/pandas/core/indexes/base.py", line 3082, in get_loc
    raise KeyError(key) from err
KeyError: 'pfam_id'
ERROR   05/03 16:08:55   ================================================================================
ERROR   05/03 16:08:55   DeepBGC failed with KeyError: pfam_id
ERROR   05/03 16:08:55   ================================================================================

My bad, forgot to merge the changes before releasing 😄 Please try pip install deepbgc==0.1.25.

HAHAHA!
Ok, now working fine!
Thanks for the quick fix :)

Hi,
I'm running version 0.1.26 and still getting this error. Any ideas how to fix it?
Thank you!

This issue is fixed in version 0.1.30


comparing two analysis produce the following error in django:

Environment:
Request Method: GET
Request URL: http://<IP_ADDRESS>:8000/compare/2/1/
Django Version: 1.8.4
Python Version: 2.7.6
Installed Applications:
('django.contrib.auth',
'django.contrib.contenttypes',
'django.contrib.sessions',
'django.contrib.staticfiles',
'django.contrib.admin',
'analysis',
'compare')
Installed Middleware:
('django.middleware.common.CommonMiddleware',
'django.contrib.sessions.middleware.SessionMiddleware',
'django.middleware.csrf.CsrfViewMiddleware',
'django.contrib.auth.middleware.AuthenticationMiddleware',
'django.contrib.messages.middleware.MessageMiddleware',
'web.headers.CuckooHeaders')
Traceback:
File "/usr/local/lib/python2.7/dist-packages/django/core/handlers/base.py" in get_response
132.                     response = wrapped_callback(request, *callback_args, **callback_kwargs)
File "/usr/local/lib/python2.7/dist-packages/django/views/decorators/http.py" in inner
45.             return func(request, *args, **kwargs)
File "/cuckoo/web/compare/views.py" in both
96.     counts = compare.helper_percentages_mongo(results_db, left_id, right_id)
File "/cuckoo/web/../lib/cuckoo/common/compare.py" in helper_percentages_mongo
85.         for pdoc in pids_calls["behavior"]["processes"]:
Exception Type: KeyError at /compare/2/1/
Exception Value: 'behavior'\
using cuckoo commit: 7fac495ca8f9ce37c7194d1d923eb741ed440378"

That's right. The interface hasn't been yet updated with latest report structure changes.

This seems to have been resolved.


feat: idle Battery level status notifications using Battery CC Reports

As a followup to https://github.com/zwave-js/node-zwave-js/pull/5632 and as mentioned in https://github.com/zwave-js/node-zwave-js/issues/1543#issuecomment-1497218026, this PR adds a heuristic to the Battery CC that will reset the corresponding Notification CC values for "low battery" to idle if the battery is near full charge.

@zwave-js-bot automerge


[Feature request] Shift + Enter to go to previous search result

Is your feature request related to a problem? Please describe.
I like to quick jump among search results using keyboard
Describe the solution you'd like
The shortcut I have suggested
Describe alternatives you've considered
None
Additional context
Not needed

You can use Shift+F3 for going to previous search result, any specific reason you want Shift+Enter??

I think Shift + Enter is more intuitive, Unigram for example has this shortcut

I think Shift + Enter is more intuitive,

I second this idea. Shift + Enter is also supported in many modern browsers (at least in Chrome/Chromium/Brave/Edge etc.) and also most state-of-the-art editors.

I'd add also some IDE like Visual Studio have that

Also Visual Studio Code, Sublime Text, Atom, and the whole Jetbrains family.

Imemented in #634


Expose User Management Resources to public Dynatrace cloud User management API

Is your feature request related to a problem? Please describe.
Presently, some services on the User Management API are only provided for self managed dynatrace instances, rather than the web hosted Dynatrace.
For example, creating usergroups here explicitly specifies an onpremise slug when called; this is the same on the user resource (and perhaps many other places).
https://github.com/dynatrace-oss/terraform-provider-dynatrace/blob/fee6c9ddf9318005851a39a6f1885021f42fbb5f/resources/usergroups/resource.go#L48
Describe the solution you'd like
Update these resources to either:

generate the route for the given resource based on a variable on the resource or provider stating the target is the public Dynatrace instance
consume a slug variable to allow user to specify the route (less favorable)

eg, the target ends up being something like: https://api.dynatrace.com/iam/v1/accounts/${myCoolTenantId}/users/Kyle.Ian@${companyDomain}'
Describe alternatives you've considered
The only other workable solution right now is to hit the public dynatrace user management  api directly, leveraging an oauth client created within the account space (I believe this is considered "cluster" on the self managed instance). I am using the pulumi provider that derives from this terraform provider, and am running calls against the api to get my object outputs, rather than using provider resources.
Additional context
It is likely that the provider will need to generate the access bearer token by way of setting the oauth client's variables (user provided in lieu of the cluster_api_token) as provider variables, and fetching/storing the temporary bearer token before execution.

Hi @kyleian,
I believe the existing IAM resources should address your use cases (eg. dynatrace_iam_user). The resources prefixed with dynatrace_iam should all point to SaaS account management which I believe is what you are looking for.
Please let us know if the above resources addresses your concern. Thanks!


OOM when loading large JSON files in v2

Overview
I am trying to parse a ~2.5GB JSON data file containing a list of lists of data (think Array of Array of Structs). Using the recommended approach of model_validate_json(f.read()) results in the OS SIGKILL-ing the process due to it running out of memory. In comparison, Python's json module parses it effortlessly.
For a bit of detail, I profiled the code using the below snippets using memray and am attaching the HTML flame graph files as TXT for ease of use (and because Github doesn't allow HTML files as attachments but allows PPTX..).
I wasn't able to dig deeper into the issue (due to lack of time) but it is possible that the issue is related to #843, but I could be very wrong (hence the new issue).
Vanilla json
import json

with open("dataset.json") as f:
    data = json.load(f)

memray-flamegraph-test-json.py.107113.html.txt
This approach just uses about 8.8G of memory: ~6 for parsing and the rest for the string data buffer.
Pydantic recommended API
from titanium_data import Data

with open("dataset.json") as f:
    data = Data.model_validate_json(f)

memray-flamegraph-test-pydantic.py.131233.html.txt
This gets SIGKILLed by the OS after consuming ~23G to parse the 2.5GB file.
Pydantic second approach
This uses the "non-recommended" approach from https://github.com/pydantic/pydantic/issues/7323
import json

from titanium_data import Data

with open("./data/trajectories/scenario1/dataset.json") as f:
    data = json.load(f)
data = Data.model_validate(data)

memray-flamegraph-test-pydantic2.py.130581.html.txt
Interestingly enough, this method successfully parses the dataset, and much faster than the direct approach of using model_validate_json.
System Information
uname -srvmo

Linux 5.15.0-84-generic #93~20.04.1-Ubuntu SMP Wed Sep 6 16:15:40 UTC 2023 x86_64 GNU/Linux

Pydantic versions:

pydantic==2.3.0
-e git+https://github.com/pydantic/pydantic-core@c086caec1a200417f19850244282c06b5d4d1650#egg=pydantic_core

Equivalent to ==2.6.3

Can you share the dataset, or a similar dataset, and the model in question?

I am not sure if I can, but I can check and let you know.

Ye, I've seen this too, a partial answer will be the new jiter JSON parser, but even that right now requires you to read the entire JSON into memory, but maybe just one or two copies in memory is fine.

This is very likely also related to https://github.com/PyO3/pyo3/issues/3382 / https://github.com/PyO3/pyo3/issues/1056

@sydney-runkle err, the memray flamegraphs make it pretty apparent this is an issue?

We have long updated to PyO3 0.21; we don't expect there to be a significant issue here any more. I'll close this one; @lattwood if you have a new example / repro, can you please open a new issue?


Colors in output panel support

In many cases (for instance, https://github.com/microsoft/vscode-python/issues/12615) it would be useful to have support colors in the 'Output' panel.
They are already available in the 'Terminal' panel, so is that something easy to also implement in the 'Output' panel?

/duplicate
https://github.com/microsoft/vscode/issues/19561

Thanks for creating this issue! We figured it's covering the same as another one we already have. Thus, we closed this one as a duplicate. You can search for similar existing issues. See also our issue reporting guidelines.
Happy Coding!

I apologise
I had not found that


How to make checkbox position fix?

material-react-table version
^2.12.1
react & react-dom versions
^18.2.0 & ^18.2.0
Describe the bug and the steps to reproduce it
Here I tried with your example(https://www.material-react-table.com/docs/examples/column-pinning) and its not working as aspected here facing issue with checkbox position when scrolling horizontal towards right then checkbox position fixed but when we move towards right to left then not fixed this is happening when enableColumnVirtualization is true  if we put enableColumnVirtualization as false then checkbox performance is slow i mean when we select any row it take some time so we can say its performance issue. Can you provide the checkbox position fix solution with enableColumnVirtualization is true or without decreasing checkbox performance issue.
Minimal, Reproducible Example - (Optional, but Recommended)
https://www.material-react-table.com/docs/examples/column-pinning
Screenshots or Videos (Optional)
https://github.com/KevinVandy/material-react-table/assets/52299248/23e4fd8f-aa03-4984-b345-96e41aafec35
Do you intend to try to help solve this bug with your own PR?
None
Terms

[X] I understand that if my bug cannot be reliably reproduced in a debuggable environment, it will probably not be fixed and this issue may even be closed.

@KevinVandy can you look into it.

If you are changing the cell/row background colors without all the complicated :before and :after styles required for pinned columns, you're going to run into this.

You'll have to get familiar with how all the complex :before and :after styles work to solve this problem: https://github.com/KevinVandy/material-react-table/blob/v2/packages/material-react-table/src/utils/style.utils.ts


Lock options for custom fields

Would love to have support for the custom fields in the signup process in react-native-lock, like Lock 10: https://auth0.com/docs/libraries/lock/v10/customization#additionalsignupfields-array-

This would be very helpful. Are there any workarounds available to achieve this?

That would be very helpful.
Not the first feature I see that auth0 doesn't implement


[region-isolation] Change semantics of function_extract_isolation from AssertingIfNonSendable -> Require.

The reason why I am doing this is that:

function_extract_isolation can take as a parameter a non-Sendable function today in SIL so in such a case, we crash.
It returns an Optional which always must be Sendable.

So it makes sense for it to just require that its non-Sendable parameter not be transferred at that point.

@swift-ci smoke test