MINOR: prune the metadata upgrade test matrix

Most of the values in the metadata upgrade test matrix are just testing
the upgrade/downgrade path between two previous releases. This is
unnecessary. We run the tests for all supported branches, so what we
should test is the up-/down-gradability of released versions with respect
to the current branch.
Committer Checklist (excluded from commit message)

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation (including upgrade notes)

This is now a pretty lean matrix, so I just ran it locally:
================================================================================
SESSION REPORT (ALL TESTS)
ducktape version: 0.7.8
session_id:       2020-07-01--011
run time:         10 minutes 8.126 seconds
tests run:        6
passed:           6
failed:           0
ignored:          0
================================================================================
test_id:    kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_metadata_upgrade.to_version=2.7.0-SNAPSHOT.from_version=<IP_ADDRESS>
status:     PASS
run time:   1 minute 27.933 seconds
--------------------------------------------------------------------------------
test_id:    kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_metadata_upgrade.to_version=2.7.0-SNAPSHOT.from_version=<IP_ADDRESS>
status:     PASS
run time:   1 minute 29.781 seconds
--------------------------------------------------------------------------------
test_id:    kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_metadata_upgrade.to_version=2.7.0-SNAPSHOT.from_version=<IP_ADDRESS>
status:     PASS
run time:   1 minute 47.036 seconds
--------------------------------------------------------------------------------
test_id:    kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_metadata_upgrade.to_version=2.7.0-SNAPSHOT.from_version=<IP_ADDRESS>
status:     PASS
run time:   1 minute 47.567 seconds
--------------------------------------------------------------------------------
test_id:    kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_metadata_upgrade.to_version=2.7.0-SNAPSHOT.from_version=1.0.2
status:     PASS
run time:   1 minute 50.108 seconds
--------------------------------------------------------------------------------
test_id:    kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_metadata_upgrade.to_version=2.7.0-SNAPSHOT.from_version=1.1.1
status:     PASS
run time:   1 minute 45.424 seconds
--------------------------------------------------------------------------------

Oh, I realized this could plausibly impact the broker test also, so I kicked off a test of the whole file: https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4008/console

great success! http://confluent-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/2020-07-01--001.1593639364--vvcephei--minor-prune-meta-upgrade-test-matrix--9d1f638fa/report.html

Hey @guozhangwang , now that https://github.com/apache/kafka/pull/8938 is finished, do you have any time to take a look at this one?

Since I resolved a conflict, I'm re-running: https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4011/console

LGTM!

Thanks, @guozhangwang ! I'll go ahead and merge it, despite the failures, since it couldn't possibly have caused any integration test failures.

This also needs to be backported. I'll do it once I'm done backporting https://github.com/apache/kafka/pull/8938

Backported to 2.5


fix: upgrade to version 3.1.330

from: https://github.com/jenkins-x/jx-cli

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by:
To complete the pull request process, please assign daveconde
You can assign the PR to them by writing /assign @daveconde in a comment when ready.
The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@jenkins-x-bot-test: The following test failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

gsm
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test gsm

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the jenkins-x/lighthouse repository. I understand the commands that are listed here.

@jenkins-x-bot-test: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

gsm
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test gsm

kube
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test kube

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the jenkins-x/lighthouse repository. I understand the commands that are listed here.

@jenkins-x-bot-test: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

gsm
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test gsm

kube
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test kube

vault
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test vault

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the jenkins-x/lighthouse repository. I understand the commands that are listed here.

@jenkins-x-bot-test: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

gsm
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test gsm

kube
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test kube

vault
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test vault

gsm-kapp
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test gsm-kapp

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the jenkins-x/lighthouse repository. I understand the commands that are listed here.

/retest

@jenkins-x-bot-test: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

kube
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test kube

vault
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test vault

gsm-kapp
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test gsm-kapp

gsm
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test gsm

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the jenkins-x/lighthouse repository. I understand the commands that are listed here.

@jenkins-x-bot-test: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

vault
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test vault

gsm-kapp
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test gsm-kapp

gsm
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test gsm

kube
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test kube

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the jenkins-x/lighthouse repository. I understand the commands that are listed here.

@jenkins-x-bot-test: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

gsm-kapp
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test gsm-kapp

gsm
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test gsm

kube
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test kube

vault
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test vault

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the jenkins-x/lighthouse repository. I understand the commands that are listed here.

@jenkins-x-bot-test: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

gsm-kapp
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test gsm-kapp

gsm
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test gsm

kube
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test kube

vault
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test vault

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the jenkins-x/lighthouse repository. I understand the commands that are listed here.

@jenkins-x-bot-test: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

gsm-kapp
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test gsm-kapp

gsm
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test gsm

kube
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test kube

vault
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test vault

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the jenkins-x/lighthouse repository. I understand the commands that are listed here.

@jenkins-x-bot-test: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

gsm
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test gsm

kube
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test kube

vault
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test vault

gsm-kapp
65ecd98acb638112e3f99cd5a16787d9bb4fc57e
link
/test gsm-kapp

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the jenkins-x/lighthouse repository. I understand the commands that are listed here.


Tools spinning while swimming

As title says. Using the 1.20 version of the mod with cloth config and api installed and everything works normally otherwise, but when you swim underwater the tool on the back just spins. I tested the game with just those three mods (api, config, and backtools) so its not mod conflicts.

It's not an issue, but rather an easter egg that the original mod had. Should probably add an option to disable it since I've seen other people complaining about it?

As title says. Using the 1.20 version of the mod with cloth config and api installed and everything works normally otherwise, but when you swim underwater the tool on the back just spins. I tested the game with just those three mods (api, config, and backtools) so its not mod conflicts.

It's not an issue, but rather an easter egg that the original mod had. Should probably add an option to disable it since I've seen other people complaining about it?


Improve flops profiler functionality

This PR makes the following improvements to the flops profiler:

supports pytroch > 1.8
use timing information from wall clock timers to compute FLOPS for bwd pass, and overall iteration
prints data parallelism, model parallelism, samples/second, etc.
change the aggregated profile to print from top to the specified module depth.
adds bert-large example
adds the option to print to file rather than stdout

@cli99 this is great, thank you for this feature @cli99!
I was just wondering last week why my DeepSpeed jobs suddenly stopped printing the flops profile!


Convert P8 to P7 MEL

Hi! Is there any way to convert from Dolby Vision Profile 8 to Profile 7 MEL currently? I didn't find a way to do this.

There isn't a way.
I'm not sure what purpose someone would have for this, profile 8 should be the same except the enhancement layer is not required.

Thanks very much for your reply! I was just experimenting to make a dual-track P7 MEL mp4 file to see if it can play on my device using Dolby's mp4muxer. However, it seems like it was still recognized as P8. I don't know if this makes any sense to you.

Well if you used a profile 8 RPU then the flags for the presence of an enhancement layer are not enabled.
Did you encode an enhancement layer yourself?  It would have to be encoded the same as the base layer, which gets complicated since you have to make sure the frame types and order match.

If you use dovi_tool info it will show the profile.
The RPU data doesn't indicate it, it's a combination of the flags to recognize the profile.

Thank you so much. I'll keep experimenting your wonderful tool by myself.

I managed to modify "disable_residual_flag" and "el_spatial_resampling_filter_flag" in the header, but when I use dovi_tool info, I got this error: "thread 'main' panicked at 'assertion failed: !reader.get()', src/dovi/rpu/vdr_dm_data.rs:172:17". So I guess some other parameters also needs to be altered as well. Apparently, it is much more complicated than I thought.

Yes, there is also the NLQ data to recreate..
When converting to P8: https://github.com/quietvoid/dovi_tool/blob/main/src/dovi/rpu/rpu_data.rs#L105https://github.com/quietvoid/dovi_tool/blob/main/src/dovi/rpu/rpu_data.rs#L105
NLQ struct: https://github.com/quietvoid/dovi_tool/blob/main/src/dovi/rpu/vdr_rpu_data.rs#L24
There are profile 7 RPUs in the assets folder, maybe recreating from the MEL would work.

Thank you! I'll keep experimenting.

Oh yea, some of the files in assets are old and not parsed properly by info.
Need to prepend two bytes to the file and edit so that it starts by 00 00 00 01 19 08

Following your advice, I've successfully recreate NLQ data from existing MEL to create a P7 rpu. However, the final file is not playable on my device. It shows no video, only audio, so I guess it is the incorrect encoding of the EL. (It may be too difficult for me to do so with x265)
Again, thank you so much for your great tool!
One small question: I'm a little confused with the "active_area" parameter, because on my device(Oppo UDP-203), it doesn't seem it was properly used to crop the video. If "active_area" is not set on an uncropped video with black bars, would there be any artifacts on the black bar or the content area? Please tell me what is expected, as I actually didn't see anything wrong without the parameter on my device. Thank you!

For Blu-ray players, Dolby mentions that the active area metadata is ignored because the letterbox bars are used to display subtitles.
Other players might show artifacts but only if there is metadata but the video itself was cropped, as far as I know.

That makes sense! Thank you for your patience.

Someone else asked for this so I implemented it in 5ca27765d8f6a5011bc9bd5ff9ab25251c10b9cc

Great work as always!

@shroomM2 Are you trying to encode EL by yourself or just inject the rpu into the BL? I found encoding EL very tricky without the use of commercial solutions, because you need to make sure the frame types of each frame in BL and EL are the same. I did somehow make it work on Oppo 203, but the compatibility is in question. I think it makes more sense to just use P8 without EL.

@ZimuQin I want to encode the EL by myself, yeah.
I don't have a device than can play profile8.1 with TrueHD ATMOS.
Since I want to play this file on an Oppo 203 clone, P8 is (as far as i know) not supported.
My current source is a P8.1 in an MKV. With the help of quietvoid, I managed to track down the corruption - it happened because I used ffmpeg to extract the HEVC stream from this MKV. Now I used mkvextract and the decoding problems went away.
My current approach is:

extract the hevc from mkv using mkvextract
demux this hevc using dovi_tool to bl and el
extract rpu from hevc using dovi_tool and convert it to profile7
encode an all-black MEL
inject the profile7 rpu into that using dovi_tool
mux using tsMuxer in Bluray folder / Bluray ISO

When I encode the EL, I parse the BL, get the frame types, then generate a qpfile and feed it to x265 to encode a 1920x1080 all-black EL.
I actually produced a working PoC file, but need to do more testing using a full length content.

@shroomM2 As far as I know, profile 8.1 in TS container is supported on Oppo 203. Just use tsmuxer to re-mux it to TS file would be fine. That's what I've been doing.
BTW, my approach to encode EL is similar to yours, but the problem is that I can't get certain frames the same type as you stated in the qpfile. Maybe the way I got frame types was wrong. I used ffprobe. How do you get all the frame types?

Oh, I did not know that about the Profile 8.1 support, will check it out, thanks!
My current approach for getting the frame types is using ffmpeg and the showinfo filter. The problem is that it's slow, I'm looking into optimizing this.
The CLI is something like...
 ffmpeg -i input.mkv -filter:v "showinfo" -f null - 2>&1 | grep iskey > showinfo.txt

Which gets me this in the file...

I parse this with a python script, but making sure I use b for B-frames as B represents a reference b-frame. So something like this...
0 I
1 b
2 b
3 b
4 b
5 P
6 b
7 b
8 b
9 b
10 P

It's possible my way is not OK either, since I only tested on ~5 minute files, will do more testing.

@shroomM2 My way is similar. It did work on Oppo 203 but I doubt it would work on other machines. You can use Dolby Vision Verification Toolkit (https://developer.dolby.com/dolby-professional/professional-products/dolby-vision-verification-toolkit/) to check if your streams are valid. I got a lot of frame type mismatch with my file.

@shroomM2 As far as I know, profile 8.1 in TS container is supported on Oppo 203. Just use tsmuxer to re-mux it to TS file would be fine. That's what I've been doing. BTW, my approach to encode EL is similar to yours, but the problem is that I can't get certain frames the same type as you stated in the qpfile. Maybe the way I got frame types was wrong. I used ffprobe. How do you get all the frame types?

I saw on another thread that ffprobe identifies multiple frame types as IDR frames, leading to many "false positives." Using the HEVC decoder through ffmpeg produces a more accurate frame identification, thus the method demonstrated by shroomM2 should work better than ffprobe.

@Travillion ffmpeg also marks both IDR and CRA as type I keyframes, so it won't work as you expected. There is some very complicated way to get the correct frame types of all frames. However, the problem is that the BL stream was very likely encoded by some commercial encoder, and you are not able to create a compliant EL stream using X265 because of the encoder limitation. Thus, I finally gave up on this and now I am happy with profile 8.1 playback.

If you're brave enough you can also reencode with the benefits of the FEL.
Using this: https://github.com/quietvoid/vs-nlq

@Travillion ffmpeg also marks both IDR and CRA as type I keyframes, so it won't work as you expected. There is some very complicated way to get the correct frame types of all frames. However, the problem is that the BL stream was very likely encoded by some commercial encoder, and you are not able to create a compliant EL stream using X265 because of the encoder limitation. Thus, I finally gave up on this and now I am happy with profile 8.1 playback.

Thank you for the clarification on ffmpeg and I frames. Can you point me in the direction of the method to correctly identify frame types? I haven't been able to find any methods besides ffprobe or ffmpeg, which are unreliable.

Is there any documentation for this tool? I'm not sure if I'm brave enough, but I would like to look into it.
No, it's meant to be used as a VapourSynth plugin.
I don't provide support for it.

I'll start with VapourSynth then. Thanks!
On Thu, Dec 9, 2021 at 9:15 AM quietvoid @.***> wrote:

Is there any documentation for this tool? I'm not sure if I'm brave
enough, but I would like to look into it.
No, it's meant to be used as a VapourSynth plugin.
I don't provide support for it.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/quietvoid/dovi_tool/issues/44#issuecomment-990000619,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AIHG7UNINZNKVPWJJLSKMOLUQDI3BANCNFSM5DBEZJ3A
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

Oh nice, I was wanting to do this (implement ETSI GS CCM 001) but was unfamiliar with VapourSynth.   I was looking into implementing it in OpenCL for FFMPEG instead, but it quickly became too complicated for their limited custom filter API the way I was reading things (see below, namely needing to know which plane is being operated on), and I quickly learned that nothing can play 12bpc HEVC properly.  I couldn't get it playing for more than 10 seconds in VLC before the decoder fell too far behind and dropped to 1fps, and the TV didn't recognize the file at all.  Maybe the decoders I tried were just terrible.     The best OLED TVs still can't display all of the P3 color space.  Oddly the lowest end LG has the best coverage, it goes down the brighter they get to just over 80% on the C1 and G1.  Generally that's an indicator that the panel itself doesn't have 10 bits of gradation, which makes higher bit depths seem pointless other than giving the panel a bit more room to manipulate data in...   luma channel maybe?   Certainly not color if they haven't hit 100% P3.
So my reasoning was that I thought the BL had to be mapped into the HDR domain via 5.4.2 using all of the additional RPU pivot data before the EL could be applied to it with 5.4.3?   Your code appears to only be doing the NLQ part (5.4.3) and applying it to the BL.   It seemed as though all the polynomial and MMR data needed to be applied to get the BL into a state that was ready for EL application.  It's possible I missed a key point somewhere in there, or maybe Dolby set things up differently, but your NLQ algorithm being identical to the paper makes me think not...
Anyway, I was thinking I'd have to do both steps then reduce the bit depth to 10bpc 4:2:0 to get it playing anywhere which might pull some barebones extra data after re-encoding but I couldn't see it being better than just keeping the studio-encoded BL.  Most of the FELs I've looked at tend to be mostly high-frequency detail that would get destroyed at low-bitrate encode settings even with the size amplification from the upscale.   I've yet to run across one of the discs I've read about where the EL contains most of the data due to something being done badly during the mastering process.

It seemed as though all the polynomial and MMR data needed to be applied to get the BL into a state that was ready for EL application.

That is correct. The polynomial and MMR steps are done prior to NLQ, through libplacebo, in my case using vs-placebo
That isn't included in the vs-nlq example.
NLQ processing is also preferrably done in full range (0-255)
As for reencoding, it does indeed lose most of the extra detail but the brightness/chroma benefits from the FEL are still there.
Currently the vs-nlq code seems to result in a slightly different color temperature, which I will investigate later.
A couple of people are implementing the ETSI document, discussions are mostly in libplacebo's IRC channel.

Ah good, I wasn't reading that wrong.   I'll look into those projects and maybe try it on a FEL disk where the extra detail on the far ends is needed;  Jurassic World 2 (+ Rifftrax of course) is a good candidate (possibly the only positive thing ever said about it)  since tons of the movie is extremely dark.   The FEL for it had enough contrast / detail by itself to see most of what was going on in any given scene.
I might revisit the OpenCL mess once ffmpeg fixes using the source of a hardware decode as OpenCL / Vulkan input on AMD cards on windows, but right now there's some broken color format problem.   The slow part of the whole mess is going to be the HEVC encode anyway so it might not be worth it.
The color temperature thing is odd since all the weird color math is in the previous section...   unless there's something to do with the fun mess of chroma siting that wasn't mentioned in the document (or isn't being handled right in the decoder?).  From what I understand most of the time it barely matters, but BL + FEL is one of the cases where it does.

Not sure, I haven't looked into it yet.
There are many steps I'm skipping currently: the documented EL resampling, chroma siting.
Here's my last attempt comparison: https://slow.pics/c/Phs22yhT
The noticeably different part is the white dress, where the NLQ filtered image is different.

have to set num_x_partitions_minus1 in the header to 2046

That value is actually two values. num_x_partitions_minus1 is 0

I'm intrigued by what might be possible with the hardware HEVC Main12 4:2:2 and 4:4:4 that are supposed to be on Intel gen 12 processors.  4:2:2 is obviously great because the proper bitdepth combined BL+FEL stream of a 4k could be encoded and played back, something that everything I've tried just chokes to death on in software.  Why the companies making $2000-6000 MSRP workstation GPUs (or even the $1000 MSRP desktop ones) haven't tacked this on to their feature set (and why Intel added a feature geared towards people who need a workstation processor that won't have an integrated GPU to its consumer line)    4:4:4 would be attractive for collapsing a 2K upscale UHD BL+FEL disk back down to the 2K resolution that it really is   (while removing chroma subsampling altogether aside from the extra 2 bits from the FEL being 4:2:0).
My reasoning behind this is that both of my 4k TVs do a better job of upscaling 1080p HEVC than the studio did on a huge percentage of the 2k upscaled UHD releases I've seen, and that's from 4:2:0 subsampled sources.    Some companies (cough Disney/Marvel cough) have some releases that look like somebody saw how long a high quality upscaling algo was going to take to transcode and switched to bicubic or bilinear then stacked 4 unsharp masks on it because their temporal-aware filter was also slow when they'd have been better off using the mythical 1:1 BL:FEL variant allowed on a UHD (but that I've never actually spotted) and letting user hardware  handle the upscale...
Meanwhile $1000 MSRIP gpus still won't do anything except possibly MAIN10 4:4:4  in some models.  I used to just hate chroma subsampling on general principle, since it should have been abandoned outside of broadcast situations that need it years ago  (main 12 4:4:4 isn't really a massive size increase over regular HDR10 4:2:0, but seeing the HEVC mono profile called 4:0:0 subsampling really solidified that hate for me.  Specifying that chroma channels don't exist should be as simple as calling it Mono, since there's an HEVC profile made for it, but the ridiculous notation had to go and make it   even dumber sounding...  :P

seeing the HEVC mono profile called 4:0:0 subsampling really solidified that hate for me.

No, there are two profiles. One that is Y only and one that has Cb Cr as achromatic, 128 for 8 bit, 512 for 10 bit.

using the mythical 1:1 BL:FEL variant allowed on a UHD

Did you mean FHD? Since 1:1 BL:EL is only allowed in FHD. For HEVC, only Main10 profile is used in current DV profiles, have you tried making a BL+FEL with 4:2:2 or 4:4:4 to playback on TV? It may cause problem.

Hello,
I also have a BL+RPU file and want to convert it into a BluRay disc.
How can I generate an EL / MEL ?
Up to now I extracted the RPU and the BL. With the BL I can create a BD but without the HDR information.
Unfortunately, I dont know the MPEG- and DV-Specification by heart.
Thanks in advance!


Add support for indicator icons (normally used for showing sort)

Add support for header indicator icons
Fix test

hi @jassmith is this what i need to achieve someting like this? At the moment I can't use it
version:     @glideapps/glide-data-grid": "^6.0.3


Stop queueing back data chunks after transport failures

Resolves #187 by implementing the suggested behavior.

:green_heart: Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Start Time: 2022-04-21T14:17:12.262+0000

Duration: 7 min 29 sec

Test stats :test_tube:

Test
Results

Failed
0

Passed
184

Skipped
4

Total
188

:robot: GitHub comments
To re-run your PR in the CI, just comment with:

/test : Re-trigger the build.

run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)


dockerignore: permission denied

Dear Alphafold support team,
I am trying to install alphafold on my local Ubuntu machine. I am stopped in the very first steps "Build the Docker image" when I apply following command:
docker build -f docker/Dockerfile -t alphafold .
I get this error:
user/alphafold/.dockerignore: permission denied
I appreciate to help me how to fix this error.

sudo docker build -f docker/Dockerfile -t alphafold .

It should not be necessary to have superuser permissions to run this. Did you already try the link for running Docker as a non-root user from the README?

It should not be necessary to have superuser permissions to run this. Did you already try the link for running Docker as a non-root user from the README?

Thanks! Already added user to the docker group.

@Maiya19724" Thank you for your note. I applied the command and it says
"""
"docker build" requires exactly 1 argument.
See 'docker build --help'.
Usage:  docker build [OPTIONS] PATH | URL | -
Build an image from a Dockerfile
"""

@Maryamtarazkar
What is your command?
Make sure you're in the alphafold folder and run the complete command.
If you don't have superuser permissions on your machine, you can read this document in the comments above:

It should not be necessary to have superuser permissions to run this. Did you already try the link for running Docker as a non-root user from the README?

@Maryamtarazkar
I think you're probably missing the final . that indicates that you want to build the docker image from the folder you currently are in.

@Maiya19724
Thank you for our note my command is:
sudo docker build -f docker/Dockerfile -t alphafold .
And now I get this error;
open /media/labuser/HDD/MT/alphafold/.dockerignore: permission denied

@aputron
Thank you for your note. My command is:
sudo docker build -f docker/Dockerfile -t alphafold .
And now I get this error;
open /media/labuser/HDD/MT/alphafold/.dockerignore: permission denied

Hi @Maryamtarazkar, this looks like /media/labuser/HDD/MT/alphafold isn't accessible by the docker daemon, likely not having read permissions when running through sudo. Make sure you've followed the advice here to manage docker as a non-root user.
Also note that network drives may also not be accessible from the Docker daemon (tho this looks to be running from local disk, going on the path). Hope this helps!


Added important details to readme

Readme now specifies the necessary route/view format and provides examples.
See diff for details.

Thanks for reminder.  I meant to merge this before the winter holidays.
Another idiomatic way to go about it would be to constrain the route to format: 'docx'.


added distanceCounter

Added DistanceCounter - class that calculates distance between current location and given Location
Distance is displayed in LocationDetails
Changed CoordX, CoordY to Longitude and Lattitude in Models.Location
Added radiobutton that allows to display distance in meters or yards (fullfilled delegate requirement)

Looks good. Just curious why write a distance calculating function when there is Xamarin.Essentials.Location.CalculateDistance()? For the sake of requirement completion? Also the word "Latitude" is misspelled everywhere D:

Before CalculateDistance seemed to not work (now changed to it) and lattitude now is with correct spelling.
The idea for using delegates is that doing so moves complexity away from place where it is used. Here it means that LocationDetailPage does not care how user wants to view data, it will be presented with same call. First I tried to do different functions for distance (crow flight vs walking), but it did not worked, so I settled with yards vs meters and might try it again later on


Add Attribute to Specify a Verb's Action

The current method of using verbs seems more verbose than it needs to be.
I would like to suggest an attribute that can be applied to a method within option classes marked as verbs that contain the code to execute when the verb is invoked.
[Verb("dosomething")]
class DoSomethingOptions
{
    [Option("foo")]
    public string Foo { get; set; }

    [VerbAction]
    public int Run()
    {
        Console.WriteLine(this.Foo)
    }
}

This could simplify the call to ParseArguments down to something along the lines of Parser.Default.ParseArguments<DoSomethingOptions, DoSomethingElseOptions>(args).Run()

hi @austinwagner, thanks for being there!
If you've a second verb you need a second class with another Run method obviously (and one for each other verb).
I think that this way or using Return<T1, T2, ...>() helpers is quite equivalent as verbosity, you simply moved the code into verb specific class.
Am I wrong?

@gsscoder, the current Return method has quite a lot of repetition that this attribute would remove. When you have more than a couple of verbs, it can get pretty messy.
[Verb("dosomething")]
class DoSomethingOptions
{
    [Option("foo")]
    public string Foo { get; set; }
}

static void DoSomething(DoSomethingOptions opts)
{
    Console.WriteLine(opts.Foo);
}

static void Main(string[] args)
{
    return Parser.Default
        .ParseArguments<
            DoSomethingOptions,
            DoSomethingElseOptions,
            DoAnotherThingOptions,
            AndAnotherOptions>(args)
        .Return(
            (DoSomethingOptions opts) => DoSomething(opts),
            (DoSomethingElseOptions opts) => DoSomethingElse(opts),
            (DoAnotherThingOptions opts) => DoAnotherThing(opts),
            (AndAnotherOptions opts) => AndAnother(opts)
        );
}

vs.
[Verb("dosomething")]
class DoSomethingVerb
{
    [Option("foo")]
    public string Foo { get; set; }

    [VerbAction]
    public int Run()
    {
        Console.WriteLine(this.Foo)
    }
}

static void Main(string[] args)
{
    return Parser.Default
        .ParseArguments<
            DoSomethingVerb,
            DoSomethingElseVerb,
            DoAnotherThingVerb,
            AndAnotherVerb>(args)
       .Run();
}

@austinwagner, matter of taste... The fact is that ParserResult is designed like a monadic Maybe type: it owns data in derivate Parsed and errors in NotParsed (similar to an F# discriminated union).
As you can read here, Return(...) is a standard operation for this kind of types.
I see a sort of completeness in ParseArguments<T1 ... -> T16> and Return<T1 ... -> T16>.
More, as said, in 2.0 I want developers to use only attributes in types defined for use in the library, no more methods with conventional signature (or worse interface to implement)...
Anyway, thank you for the proposal.

Anyway a Run extension must be defined for ParserResult<T>, you can't call directly the one of in option class. Because with verb the result is Parsed<object> and in every case the instance is available in Value property...


Query method POST, double sending all params

While testing SolrS to replace SolrJ, I've found a bug.
When the query method is selected as POST, all parameters passed to Solr (q, fq, ... or any manually set parameters) are duplicated. This is one such log output from Solr server.
2017-05-30 07:19:25.544 INFO  (qtp472654579-12) [   x:question] o.a.s.c.S.Request [question]  webapp=/solr path=/select params={q=frage&q=frage&fq=answers.isEmpty:false&fq=answers.expirationDate:[NOW+TO+*]&fq=answers.startDate:[*+TO+NOW]&fq=answers.visibility:(PUBLIC)&fq=language:DE&fq=tenant.id:1&fq=answers.isEmpty:false&fq=answers.expirationDate:[NOW+TO+*]&fq=answers.startDate:[*+TO+NOW]&fq=answers.visibility:(PUBLIC)&fq=language:DE&fq=tenant.id:1&wt=javabin&wt=javabin&version=2&version=2} hits=2 status=0 QTime=8
Naturally on SolrJ, using POST does not make this type of parameter duplication.
I have not traced the code to check why this occurs, but first thing that hits my mind is that the arguments are maybe passed twice -- once on URL header (just like GET case), and once more on the POST body ....
Note that, duplications are normally not very visible, unless ...

Query repeated twice, and can make different score.
-- On a server with http header size limited, this can make different ranks (e.g. part of query duplicated and gets more score, part lost are only on POST part)
Special params such as MoreLikeThis query's body.stream --- server exception occurs if they detect duplicated param.

Thanks for reporting! Unfortunately currently I'm quite loaded and cannot look into it. If you want to further analyze this this would be great!

Got it. Will trace the issue and try to produce a patch / pull request.

Awesome!


FW-373. Prefix cc2420.c functions with 'cc2420_'.

This PR prefixes the functions in chips/cc2420/cc2420.c file with cc2420_ instead of radio_ in order to match the new structure.

Wow, 4mins to fix an issue :-)
Go @malishav!

Just a rename, no grey cells involved :-)


Tests for AsyncStreamWrapper

I'm not too familiar with the Stream / AsyncStream packages, but the code looks clean.


Getting AttributError and ImportError while running code

Hey Steve,
I have imported securitycenter and did pip install too, but while calling securitycenter.SecurityCenter('ADDRESS','username','password') I am getting the error:
sc = securitycenter.SecurityCenter(server,username,password)
AttributeError: 'module' object has no attribute 'SecurityCenter'
further from securitycenter import SecurityCenter4 gives error :
ImportError: cannot import name SecurityCenter4
Can you please help me figure out what is going wrong.

make sure that you specify at the top of your script
from securitycenter import SecurityCenter4
I had a similar error and only had
import securitycenter
at the top of my script. Instead switching it to the specific one I needed, fixed the problem.

Hey I made some progress but still stuck. instead of SecurityCenter4 I am using sc4 in import and therefore the call now looks like
sc = sc4.SecurityCenter4(server,username,password) where server = 'https://ip_address'
But still I am getting error:
sc = sc4.SecurityCenter4(server,username,password)

File "/Library/Python/2.7/site-packages/securitycenter/sc4.py", line 38, in init
self.system = self._system()
File "/Library/Python/2.7/site-packages/securitycenter/sc4.py", line 697, in _system
return self.raw_query('system', 'init')
File "/Library/Python/2.7/site-packages/securitycenter/sc4.py", line 119, in raw_query
data = self.post('', kwargs)
File "/Library/Python/2.7/site-packages/securitycenter/base.py", line 87, in post
resp = self._session.post(self._url(path), self._builder(kwargs))
File "/Library/Python/2.7/site-packages/requests/sessions.py", line 518, in post
return self.request('POST', url, data=data, json=json, kwargs)
File "/Library/Python/2.7/site-packages/requests/sessions.py", line 475, in request
resp = self.send(prep, send_kwargs)
File "/Library/Python/2.7/site-packages/requests/sessions.py", line 585, in send
r = adapter.send(request, kwargs)
File "/Library/Python/2.7/site-packages/requests/adapters.py", line 467, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='https', port=443): Max retries exceeded with url: //...:username/request.php (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x10829e4d0>: Failed to establish a new connection: [Errno 8] nodename nor servname provided, or not known',))
Can you please help me figure out what is going wrong.

Hey I made some progress but still stuck. instead of SecurityCenter4 I am
using sc4 in import and therefore the call now looks like
sc = sc4.SecurityCenter4(server,username,password) where server = '
https://ip_address'
But still I am getting error:
sc = sc4.SecurityCenter4(server,username,password)
File "/Library/Python/2.7/site-packages/securitycenter/sc4.py", line 38, in
init
self.system = self._system()
File "/Library/Python/2.7/site-packages/securitycenter/sc4.py", line 697,
in _system
return self.raw_query('system', 'init')
File "/Library/Python/2.7/site-packages/securitycenter/sc4.py", line 119,
in raw_query
data = self.post('', kwargs)
File "/Library/Python/2.7/site-packages/securitycenter/base.py", line 87,
in post
resp = self._session.post(self._url(path), **self._builder(kwargs))
File "/Library/Python/2.7/site-packages/requests/sessions.py", line 518, in
post
return self.request('POST', url, data=data, json=json, kwargs)
File "/Library/Python/2.7/site-packages/requests/sessions.py", line 475, in
request
resp = self.send(prep, *
send_kwargs)File "/Library/Python/2.7/site-packages/requests/sessions.py",
line 585, in sendr = adapter.send(request, **kwargs)
File "/Library/Python/2.7/site-packages/requests/adapters.py", line 467, in
send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='https',
port=443): Max retries exceeded with url: //...***:username/request.php
(Caused by NewConnectionError(': Failed to establish a new connection:
[Errno 8] nodename nor servname provided, or not known',))
Can you please help me figure out what is going wrong.
Thanks,
Siddharth
On Tue, Aug 2, 2016 at 3:18 PM, Nick Wilfahrt<EMAIL_ADDRESS>wrote:

make sure that you specify at the top of your script
from securitycenter import SecurityCenter4
I had a similar error and only had
import securitycenter
at the top of my script. Instead switching it to the specific one I
needed, fixed the problem.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/SteveMcGrath/pySecurityCenter/issues/37#issuecomment-237013649,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AFFtGYyUwbf_U8ZK-PdFmWsJFGhpVSl8ks5qb5gjgaJpZM4Ja5V7
.

This is from the examples folder. I noticed your code looks a little different so I think you might just have a formatting issue.
Try:
from securitycenter import SecurityCenter4

username = 'uname'
password = 'passwd'
host = 'fullyqualified.domain.name'

sc = SecurityCenter4(host)
sc.login(username,password)

Taking that a bit farther, I am reading in my credentials from a file with the permissions set to read only from that user.
from securitycenter import SecurityCenterX

sc = SecurityCenterX('fullyqualified.domain.name')
with open('/Users/<user>/security_center_automation/scManager.txt') as f:
    credentials=f.readlines()
    user = (credentials[0]).rstrip()
    passwd = (credentials[1]).rstrip()
    sc.login(user, passwd)

I hope that helps

Thanks Nick. That helped, I was using full webpage name instead of host, just using ip solved the issue.

Glad to hear that


datalad-gooey:  init at unstable-2024-02-20

Description of changes
This adds the GUI component datalad-gooey for datalad.
Due to dependencies, this PR also includes:

python312Packages.outdated: init at 0.2.2 homepage
python312Packages.datasalad: init at 0.2.1  collection of utilities for datalad homepage
datalad: 1.0.2 -> 1.1.1 (fix build, see also #329398)
python312Packages.datalad-next: init at 1.5.0 Datalad extension homepage

Note: For datalad-gooey to work under darwin, #329238 needs to be merged first (introduction of QtUiTools in Pyside6).
Ping @gebner @renesat
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[x] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[x] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

@ofborg eval

This is a semi-automatic executed nixpkgs-review with nixpkgs-review-checks extension. It is checked by a human on a best effort basis and does not build all packages (e.g. lumo, tensorflow or pytorch).
Result of nixpkgs-review pr 329403 run on x86_64-linux 1

18 packages built:

datalad
datalad-gooey
datalad-gooey.dist
datalad.dist
python311Packages.datasalad
python311Packages.datasalad.dist
python311Packages.heudiconv
python311Packages.heudiconv.dist
python311Packages.outdated
python311Packages.outdated.dist
python312Packages.datalad-next
python312Packages.datalad-next.dist
python312Packages.datasalad
python312Packages.datasalad.dist
python312Packages.heudiconv
python312Packages.heudiconv.dist
python312Packages.outdated
python312Packages.outdated.dist

Also, I think you forgot to add datalad-gooey to pkgs/top-level/all-packages.nix?

It resides in pkgs/by-name and therefore does not need an entry in all-packages

This is a semi-automatic executed nixpkgs-review with nixpkgs-review-checks extension. It is checked by a human on a best effort basis and does not build all packages (e.g. lumo, tensorflow or pytorch).
Result of nixpkgs-review pr 329403 run on x86_64-linux 1

22 packages built:

datalad-gooey
datalad-gooey.dist
python311Packages.datalad
python311Packages.datalad-next
python311Packages.datalad-next.dist
python311Packages.datalad.dist
python311Packages.datasalad
python311Packages.datasalad.dist
python311Packages.heudiconv
python311Packages.heudiconv.dist
python311Packages.outdated
python311Packages.outdated.dist
python312Packages.datalad
python312Packages.datalad-next
python312Packages.datalad-next.dist
python312Packages.datalad.dist
python312Packages.datasalad
python312Packages.datasalad.dist
python312Packages.heudiconv
python312Packages.heudiconv.dist
python312Packages.outdated
python312Packages.outdated.dist

@renesat could you have another look? Thanks

This is a semi-automatic executed nixpkgs-review with nixpkgs-review-checks extension. It is checked by a human on a best effort basis and does not build all packages (e.g. lumo, tensorflow or pytorch).
Result of nixpkgs-review pr 329403 run on x86_64-linux 1

22 packages built:

datalad (python312Packages.datalad)
datalad-gooey
datalad-gooey.dist
datalad.dist (python312Packages.datalad.dist)
python311Packages.datalad
python311Packages.datalad-next
python311Packages.datalad-next.dist
python311Packages.datalad.dist
python311Packages.datasalad
python311Packages.datasalad.dist
python311Packages.heudiconv
python311Packages.heudiconv.dist
python311Packages.outdated
python311Packages.outdated.dist
python312Packages.datalad-next
python312Packages.datalad-next.dist
python312Packages.datasalad
python312Packages.datasalad.dist
python312Packages.heudiconv
python312Packages.heudiconv.dist
python312Packages.outdated
python312Packages.outdated.dist

Result of nixpkgs-review pr 329403 run on x86_64-linux 1

24 packages built:

datalad (python312Packages.datalad)
datalad-gooey (python312Packages.datalad-gooey)
datalad-gooey.dist (python312Packages.datalad-gooey.dist)
datalad.dist (python312Packages.datalad.dist)
python311Packages.datalad
python311Packages.datalad-gooey
python311Packages.datalad-gooey.dist
python311Packages.datalad-next
python311Packages.datalad-next.dist
python311Packages.datalad.dist
python311Packages.datasalad
python311Packages.datasalad.dist
python311Packages.heudiconv
python311Packages.heudiconv.dist
python311Packages.outdated
python311Packages.outdated.dist
python312Packages.datalad-next
python312Packages.datalad-next.dist
python312Packages.datasalad
python312Packages.datasalad.dist
python312Packages.heudiconv
python312Packages.heudiconv.dist
python312Packages.outdated
python312Packages.outdated.dist


Add precompute_RR feature into tpcf

This PR introduces an additional feature to the tpcf function: you can now optionally pass in a set of pre-computed random pairs. This feature is useful for MCMC applications populating multiple simulation volumes, as is currently being done by @mjvakili and @changhoonhahn.

@mjvakili, @changhoonhahn, I'm merging this in to master now.


OpenBLAS error JetPack 2.3

Tried building from source with the latest JetPack and got a compiling error when the script was building OpenBLAS.
gemv.c: In function ‘sgemv_’:
gemv.c:223:29: error: ‘GEMM_MULTITHREAD_THRESHOLD’ undeclared (first use in this function)
   if ( 1L * m * n < 2304L * GEMM_MULTITHREAD_THRESHOLD )
                             ^
gemv.c:223:29: note: each undeclared identifier is reported only once for each function it appears in
Makefile:841: recipe for target 'sgemv.o' failed

Any idea how to get this working? Thanks!

Nevermind, I got it to work. I was trying to build on an external drive which I guess wasn't configured properly. When I built from the main drive it worked.


upgrade angular from 12 to 13

What kind of change does this PR introduce? (check one with "x")

[ ] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Build related changes
[ ] CI related changes
[x] Other... Please describe: Angular upgrade

What is the current behavior? (You can also link to an open issue here)
What is the new behavior?
Does this PR introduce a breaking change? (check one with "x")

[ ] Yes
[x] No

If this PR contains a breaking change, please describe the impact and migration path for existing applications: ...
Other information:

Thank you! Could we get a release soon?

Looks like the package npm-script is failing on the master.


Bootstrap instructions not working

Hi !
Tried to start this project, but it seems that the bootstrap instructions are missing something:
$ sudo apt install vagrant virtualbox
... //install goes ok

$ vagrant up
Bringing machine 'tasksched' up with 'virtualbox' provider...
There are errors in the configuration of this machine. Please fix
the following errors and try again:

SSH:
* The following settings shouldn't exist: insert_key, password

vm:
* The box 'https://files.devuan.org/devuan_jessie/virtual/devuan_jessie_1.0.0_amd64_vagrant.box' could not be found.

Hi,
I personally don't use the Vagrantfile, I think it's easier to install it on your host instead of running in a VM (assuming you are running linux). However, @evilham should be able to help.
Glad to see somebody is using this :-)

:-D Apparently it's not vm.box but vm.box_url. For some reason it just worked for me.
Can you try the 19-evilham-vagrantfix branch?
https://github.com/AnotherKamila/tasksched/tree/19-evilham-vagrantfix

Thanks for the swift answer ! One of the error is gone, the other is still there:
~/tmp/tasksched$ git checkout 19-evilham-vagrantfix
// OK

~/tmp/tasksched$ vagrant up
Bringing machine 'tasksched' up with 'virtualbox' provider...
[tasksched] Box 'devuan' was not found. Fetching box from specified URL for
the provider 'virtualbox'. Note that if the URL does not have
a box for this provider, you should interrupt Vagrant now and add
the box yourself. Otherwise Vagrant will attempt to download the
full box prior to discovering this error.
Downloading box from URL: https://files.devuan.org/devuan_jessie/virtual/devuan_jessie_1.0.0_amd64_vagrant.box
Extracting box...te: 7931k/s, Estimated time remaining: 0:00:01)
Successfully added box 'devuan' with provider 'virtualbox'!
There are errors in the configuration of this machine. Please fix
the following errors and try again:

SSH:
* The following settings shouldn't exist: password

That's a bit weird, it should be a valid setting according to the documentation:
https://www.vagrantup.com/docs/vagrantfile/ssh_settings.html
In any case, try the patched file and if asked for a password use toor.

@evilham thanks for your help!
@MartyLake Just a note: using Vagrant for this is a bit of a special case, and not the recommended way to use (or develop!) this project. I have reworked the "how to use" section of the README, in case it was confusing -- see the new shiny https://github.com/AnotherKamila/tasksched/blob/master/README.md#how-to-use . Of course, if you do have a reason to use Vagrant, ignore me -- hopefully @evilham will be able to figure out the problem.
BTW, could your problem maybe be caused by having an old version of Vagrant? (I don't use it, just guessing.)

Fair point :-D I thought that was clear, but it is much more so now ^^.

Closing and merging, if there are still issues do re-open it :).


run: ' ng build --prod' error

ng build --prod
err:
An unhandled exception occurred: EEXIST: file already exists, copyfile '/Users/r/repository/ng-app/node_modules/.cache/angular-build-dl/content-v2/sha512/36/86/afb82f76da09848c154ccb79a5213dc67698763412e526216fbce17a94bd0b1762da3627677b3ee97a05cdc837739fdc4dbdc08b13fbd50cbb0fb9a0b512' -> '/Users/r/repository/ng-app/dist/ng-app/runtime-es2015.85f895af57b038f1e5b4.js'
See "/private/var/folders/33/pdb8zsnj3vgf_b11ylqm28jm0000gn/T/ng-NfpxH9/angular-errors.log" for further details.
Angular CLI: 8.3.5
Node: 11.10.0
OS: darwin x64
Angular: 8.2.7
... animations, common, compiler, compiler-cli, core, forms
... language-service, platform-browser, platform-browser-dynamic
... router

Package                           Version
-----------------------------------------------------------
@angular-devkit/architect         0.803.5
@angular-devkit/build-angular     0.803.5
@angular-devkit/build-optimizer   0.803.5
@angular-devkit/build-webpack     0.803.5
@angular-devkit/core              8.3.5
@angular-devkit/schematics        8.3.5
@angular/cli                      8.3.5
@ngtools/webpack                  8.3.5
@schematics/angular               8.3.5
@schematics/update                0.803.5
rxjs                              6.4.0
typescript                        3.5.3
webpack                           4.39.2

Duplicate of https://github.com/angular/angular-cli/issues/15544
Should be fixed in the next release.

using v12.10.0 is no problem.


Adding USER/INFO lookup via ID in the web_api

Please follow the guide below

Issues submitted without this template format will be ignored.
Read the questions carefully and answer completely.
Do not post screenshots of error messages or code.
Put an x into all the boxes [ ] relevant to your issue (==> [x] no spaces).
Use the Preview tab to see how your issue will actually look like.
Issues about reverse engineering is out of scope and will be closed without response.
Any mention of spam-like actions or spam-related tools/libs/etc is strictly not allowed.

Before submitting an issue, make sure you have:

[x] Updated to the lastest version v1.6.0
[x] Read the README and docs
[x] Searched the bugtracker for similar issues including closed ones
[x] Reviewed the sample code in tests and examples

Which client are you using?

[ ] app (instagram_private_api/)
[x] web (instagram_web_api/)

Describe your Feature Request:
Is it possible to add "https://i.instagram.com/api/v1/users/USER_ID/info/ to the lookup information on the web api? For the time being the web_api part only support username as an input.

The web api does not have such a function.


entire repo: clang-format.

Just noticed that there was several files that was not formatted. Makes it easier to track changes made to the code in the future IMO. Processed with the command
find . -type f \( -name "*.cpp" -o -name "*.hpp" \) -execdir clang-format-6.0 -i {} \;

Thanks!


Add negative_log_likelihood loss and cross_entropy loss

This PR adds negative_log_likelihood and cross_entropy to Tensor
Eg:
For negative_log_likelihood,
import tinygrad
data = tinygrad.Tensor([[1, 2, 4]])
target = [2]
print(data.negative_log_likelihood(target).numpy())

==ToDo==

Still need to implement this cross_entropy.

==Something which confused me==

As mentioned in #1018 negative_log_likelihood(referring to it as nll) and cross_entropy operate very similarly, nll works with log probabilities while cross_entropy works with logits. What if I keep them in the same function with an if else and 2 more functions which act as abstractions? I'll implement cross_entropy first and keep this as a task for future me.

The force push to get some of that rebase errors corrected (had those on local)
On a second thought, I could have fixed the lint unit test too...

to use cross_entropy,
You just have to call cross_entropy from Tensor and should be all good.
print(data.cross_entropy(target).numpy())

I think I'll need some help with the checks failing...

I think I'll need some help with the checks failing...

You are generating random float weights and Tensor is inferring that type. While you are doing type casts to long/int64 for the tests of torch side and the test tells you it fails for mismatching dtypes (float for tg and int for torch)

I think I'll need some help with the checks failing...

You are generating random float weights and Tensor is inferring that type. While you are doing type casts to long/int64 for the tests of torch side and the test tells you it fails for mismatching dtypes (float for tg and int for torch)

Worked on this, removing the type casting did the trick but seems like metal, hip and ptx are still failing.

Metal errors out because double isn't supported on it which I believe can be fixed by managing the types.
hip on the other hand is doing some interesting stuff...

tinygrad_output = array(-2.1397502)
torch_output = array(2.1397502), atol = 1e-06, rtol = 0.001

Tests on my intel cpu and cuda work fine and give the same result but on hip, the results are different? makes no sense? does hip have some different instruction causing the additive inverse??

Unit Tests / GPU OPT and IMAGE Tests (pull_request)  fails cause of a type mismatch but it looks like torch has a torch.tensor of float64 no problem but dtypes.default_float.np from prepare_test_op generates a tinygrad.Tensor with float32 which causes the assertion error
Idk I could be a dumbass but I can't seem to find a way around this.

3 days and I still can't figure out the broken test. torch has no problem creating float64 tensors but the architectures don't support it which makes the tests fail and I can't figure out a way to make it not do it
Any insights on this would be helpful!

close as stale

@chenyuxyz you would think so... gonna fix those test cases cause I have no clue why it was failing on the AMD side of things.
Had to save up a bit, and now 7700XT has been acquired. Any leads would be great but I shall get to this again


Add --test-message flag

Fixes #260
The --test-message flag allows customizing the message shown by the --test flag, which defaults to "Running test...".

Thanks - that's even simpler than I thought it would be! Will merge once the CI finishes.

Thanks!

@ndmitchell Thank you! The code was really easy to get into.


Zola installer 0.16.1

[x] Have you signed the Contributor License Agreement?
[x] Have you checked that there aren't other open pull requests for the same manifest update/change?

[ ] Have you tested your manifest locally with winget install --manifest <path>?
[x] Does your manifest conform to the 1.2 schema?

Note: <path> is the name of the directory containing the manifest you're submitting.

Blocked on 1.4 release
Microsoft Reviewers: Open in CodeFlow

@leotsarev singleton ManifestVersion was "deprecated" a while ago; the latest is 1.2.0. To my knowledge, there isn't a single singleton manifest left in the repository

@msftbot .zip

@wingetbot run

Hi @leotsarev,
The package installs normally, but requires Microsoft.VCRedist.2015+.x64 to run:

Pending:

https://github.com/microsoft/winget-cli/issues/163

Hi @leotsarev,
Please understand that dependencies are not currently supported. Specifying the dependency in the manifest won't have it install in the pipeline nor on user computers at this time. We are hoping to have this resolved soon. It's being tracked in this issue:

https://github.com/microsoft/winget-cli/issues/163

Thanks @stephengillie !
I guess I have to wait yet another winget release:-)

[Policy] Blocking-Issue

/AzurePipelines run

[Policy] Blocking-Issue

Since packaging dependencies (https://github.com/microsoft/winget-cli/issues/163) has been supported in WinGet 1.6, can we continue to work on this issue?


ionic serve not working - Error: Cannot find module '@angular/tsc-wrapped/src/tsc'

Ionic version:  (check one with "x")
[ ] 1.x (For Ionic 1.x issues, please use https://github.com/ionic-team/ionic-v1)
[ ] 2.x
[X] 3.x
I'm submitting a ...  (check one with "x")
[X] bug report
[ ] feature request
[ ] support request => Please do not submit support requests here, use one of these channels: https://forum.ionicframework.com/ or http://ionicworldwide.herokuapp.com/
Current behavior:

When I try to execute: ionic serve
I'm getting the error below:
Error: Cannot find module 'angular/tsc-wrapped/src/tsc'
Expected behavior:

Expect to run my ionic project
Steps to reproduce:

Related code:

Other information:

I need some help on this please.
My project was running yesterday and today started to give me this error.
As far as I understood, the new Ionic's version (3.8) merges some "cli" frameworks on it.
My guess is that the @angular/tsc-wrapped package is not merged or something related to it is broken.
Anyway, before open the issue I've tried some things, like:

Downgrade npm to these versions: 5.2.0, 5.1.0, 4.6.1
Remove the node_modules folder and package-lock.json and re-installing it
Update all cli frameworks

But I'm still facing the error.
I'd really appreciate some help on this.
Thanks!
Ionic info: (run ionic info from a terminal/cmd prompt and paste output below):
cli packages:

    @ionic/cli-utils  : 1.8.0
    ionic (Ionic CLI) : 3.8.0

global packages:

    Cordova CLI : 7.0.1

local packages:

    @ionic/app-scripts : 2.1.3
    Cordova Platforms  : android 6.2.3
    Ionic Framework    : ionic-angular 3.6.0

System:

    Android SDK Tools : 26.0.2
    Node              : v7.9.0
    npm               : 5.3.0
    OS                : Linux 4.4

I tried to downgrade node to version 7.10.0 and it worked fine now.
Anyway, I think when I update the node I'll face the problem again.

Hello! Thank you for opening an issue with us!
I just tried this with a couple of different projects using ionic 3.8.1 and did not have the issue. Can you try using 3.8.1 and see if you still have the issue? If so, can you also provide an application via Git that demonstrates the issue?
Thank you for using Ionic

Hi, my project seems pretty broken since ionic left v3.6
ionic serve --verbose [DEBUG] CLI flags: { interactive: true, confirm: false } [DEBUG] { cwd:          '/Applications/XAMPP/xamppfiles/htdocs/proyectos/my-project',          local: true, binPath: '/usr/local/lib/node_modules/ionic/bin/ionic',          libPath:          '/Applications/XAMPP/xamppfiles/htdocs/proyectos/my-project/node_modules/ionic/dist/index.js'          } [DEBUG] Daemon found (pid: 628) [INFO] Starting app-scripts server: --address <IP_ADDRESS> --port 8100         --livereload-port 35729 - Ctrl+C to cancel [16:41:59]  watch started ...  [16:41:59]  build dev started ...  [16:41:59]  clean started ...  [16:41:59]  clean finished in 1 ms  [16:41:59]  copy started ...  [16:41:59]  transpile started ...  [16:42:05]  transpile finished in 5.30 s  [16:42:05]  preprocess started ...  [16:42:05]  deeplinks started ...  [16:42:05]  deeplinks finished in 71 ms  [16:42:05]  preprocess finished in 72 ms  [16:42:05]  webpack started ...  [16:42:05]  copy finished in 5.65 s
And then the prompt is returned with exit code 130.
ionic: 3.9.1
typescript: 2.3.4 (upper versions doesn't support rxjs at any versión (even 5.4.3 which is supposed to fix it))
OS: Mac OS 10.12.6
Node: 6.11.2 / 3.10.10
Extra: moving to typescript 2.4.* it starts watching, opens the browser and seems to work fine (but as I said, this version of typescript doesn't work with rxjs).
thanks in advance.

There have been known NPM related issues that have caused this. Since this is not an Ionic Framework related issue, I am going to close this. If you are still having this issue, I will urge that you ask this question on our forum or on our slack channel. Thanks for using Ionic!


Unable to run Jest tests with custom reporter

Describe the bug
Unable to run Jest tests with a custom reporter (https://jestjs.io/docs/en/cli#reporters).
To Reproduce

Run ng test. OK
Run ng test --reporters=default. Failure:

ng test --reporters=default
Schema validation failed with the following errors:
  Data path ".reporters" should be array.

Run ng test --reporters=default --reporters=default. OK

Expected behavior
Jest builder should be able to pass single --reporters option to Jest.
Builder:

<EMAIL_ADDRESS>
Libraries

<EMAIL_ADDRESS>
Additional context
Looks like the issue is relevant for some other array options, e.g. --testPathPattern. But the issue is not reproduced for --runTestsByPath, though it doesn't work with --runTestsByPath either.

To be clear, it's not a blocking issue, there is a workaround of specifying the same reporter twice, is that right?
I think this is Angular CLI's issue (to be precise it's how it parses the arguments) but it needs further investigation.

@meltedspark Agree, not a blocker. You can specify the same reporter, or better another one --reporters=default.

I am having a hard time getting the jest-junit report to show with multiple apps project. I am using the  the builder v.7.2.1. Can anyone share an example app which can give a code coverage report(jest-junit) with multiple-apps config.


BLD: in VS code Docker Dev container No such file or directory: '/tmp/pip-build-env-na93e837/overlay/bin/pybind11-config'

Describe your issue.
In the latest VS Code in Win 11, I created a container with scipy in it, and use the (scipy-dev) conda environment. Building
(scipy-dev) codespace ➜ /workspaces/scipy (main) $ pip install -e /workspaces/scipy/
gives the rror
 FileNotFoundError: [Errno 2] No such file or directory: '/tmp/pip-build-env-na93e837/overlay/bin/pybind11-config'
but there is no even such directory:
cd /tmp/pip-build-env-na93e837/
bash: cd: /tmp/pip-build-env-na93e837/: No such file or directory

while
(scipy-dev) codespace ➜ /workspaces/scipy (main) $ pip install "pybind11[global]"
Requirement already satisfied: pybind11[global] in /home/codespace/micromamba/envs/scipy-dev/lib/python3.12/site-packages (2.12.0)
Requirement already satisfied: pybind11-global==2.12.0 in /home/codespace/micromamba/envs/scipy-dev/lib/python3.12/site-packages (from pybind11[global]) (2.12.0)

I am even unsure if this issue is scipy related, doing it for the first time...
Reproducing Code Example
pip install -e /workspaces/scipy/

Error message
Obtaining file:///workspaces/scipy
  Installing build dependencies ... done
  Checking if build backend supports build_editable ... done
  Getting requirements to build editable ... done
  Installing backend dependencies ... done
  Preparing editable metadata (pyproject.toml) ... error
  error: subprocess-exited-with-error

  × Preparing editable metadata (pyproject.toml) did not run successfully.
  │ exit code: 2
  ╰─> [192 lines of output]
      + meson setup --reconfigure /workspaces/scipy /workspaces/scipy/build/cp312 -Dbuildtype=release -Db_ndebug=if-release -Db_vscrt=md --native-file=/workspaces/scipy/build/cp312/meson-python-native-file.ini
      Traceback (most recent call last):
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/mesonmain.py", line 186, in run
          return options.run_func(options)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/msetup.py", line 363, in run
          app.generate()
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/msetup.py", line 187, in generate
          return self._generate(env, capture, vslite_ctx)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/msetup.py", line 226, in _generate
          intr.run()
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreter/interpreter.py", line 3011, in run
          super().run()
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/interpreterbase.py", line 162, in run
          self.evaluate_codeblock(self.ast, start=1)
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/interpreterbase.py", line 188, in evaluate_codeblock
          raise e
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/interpreterbase.py", line 180, in evaluate_codeblock
          self.evaluate_statement(cur)
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/interpreterbase.py", line 194, in evaluate_statement
          return self.function_call(cur)
                 ^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/interpreterbase.py", line 520, in function_call
          res = func(node, func_args, kwargs)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/decorators.py", line 250, in wrapper
          return f(*nargs, **wrapped_kwargs)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/decorators.py", line 569, in wrapper
          return f(*wrapped_args, **wrapped_kwargs)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreter/interpreter.py", line 2429, in func_subdir
          self.evaluate_codeblock(codeblock)
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/interpreterbase.py", line 188, in evaluate_codeblock
          raise e
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/interpreterbase.py", line 180, in evaluate_codeblock
          self.evaluate_statement(cur)
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/interpreterbase.py", line 233, in evaluate_statement
          self.evaluate_foreach(cur)
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/interpreterbase.py", line 471, in evaluate_foreach
          self.evaluate_codeblock(node.block)
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/interpreterbase.py", line 188, in evaluate_codeblock
          raise e
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/interpreterbase.py", line 180, in evaluate_codeblock
          self.evaluate_statement(cur)
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/interpreterbase.py", line 211, in evaluate_statement
          return self.evaluate_if(cur)
                 ^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/interpreterbase.py", line 301, in evaluate_if
          self.evaluate_codeblock(i.block)
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/interpreterbase.py", line 188, in evaluate_codeblock
          raise e
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/interpreterbase.py", line 180, in evaluate_codeblock
          self.evaluate_statement(cur)
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/interpreterbase.py", line 200, in evaluate_statement
          return self.method_call(cur)
                 ^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/interpreterbase.py", line 536, in method_call
          (h_args, h_kwargs) = self.reduce_arguments(node.args)
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/interpreterbase.py", line 592, in reduce_arguments
          reduced_pos = [self.evaluate_statement(arg) for arg in args.arguments]
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/interpreterbase.py", line 200, in evaluate_statement
          return self.method_call(cur)
                 ^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/interpreterbase.py", line 549, in method_call
          res = obj.method_call(method_name, args, kwargs)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/baseobjects.py", line 81, in method_call
          return method(args, kwargs)
                 ^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/decorators.py", line 663, in wrapped
          return f(*wrapped_args, **wrapped_kwargs)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/decorators.py", line 250, in wrapper
          return f(*nargs, **wrapped_kwargs)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreterbase/decorators.py", line 569, in wrapper
          return f(*wrapped_args, **wrapped_kwargs)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/interpreter/interpreterobjects.py", line 553, in variable_method
          return self.held_object.get_variable(
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/dependencies/configtool.py", line 156, in get_variable
          p, out, _ = Popen_safe(self.config + self.get_variable_args(configtool))
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-4j0d_pnt/overlay/lib/python3.12/site-packages/mesonbuild/utils/universal.py", line 1521, in Popen_safe
          p = subprocess.Popen(args, universal_newlines=True, encoding=encoding, close_fds=False,
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/home/codespace/micromamba/envs/scipy-dev/lib/python3.12/subprocess.py", line 1026, in __init__
          self._execute_child(args, executable, preexec_fn, close_fds,
        File "/home/codespace/micromamba/envs/scipy-dev/lib/python3.12/subprocess.py", line 1840, in _execute_child
          self._posix_spawn(args, executable, env, restore_signals,
        File "/home/codespace/micromamba/envs/scipy-dev/lib/python3.12/subprocess.py", line 1784, in _posix_spawn
          self.pid = os.posix_spawn(executable, args, env, **kwargs)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
      FileNotFoundError: [Errno 2] No such file or directory: '/tmp/pip-build-env-na93e837/overlay/bin/pybind11-config'
      The Meson build system
      Version: 1.4.1
      Source dir: /workspaces/scipy
      Build dir: /workspaces/scipy/build/cp312
      Build type: native build
      Project name: scipy
      Project version: 1.15.0.dev0
      C compiler for the host machine: cc (gcc 9.4.0 "cc (Ubuntu 9.4.0-1ubuntu1~20.04.2) 9.4.0")
      C linker for the host machine: cc ld.bfd 2.34
      C++ compiler for the host machine: c++ (gcc 9.4.0 "c++ (Ubuntu 9.4.0-1ubuntu1~20.04.2) 9.4.0")
      C++ linker for the host machine: c++ ld.bfd 2.34
      Cython compiler for the host machine: cython (cython 3.0.10)
      Host machine cpu family: x86_64
      Host machine cpu: x86_64
      Program python found: YES (/home/codespace/micromamba/envs/scipy-dev/bin/python3.12)
      Found pkg-config: YES (/home/codespace/micromamba/envs/scipy-dev/bin/pkg-config) 0.29.2
      Run-time dependency python found: YES 3.12
      Program cython found: YES (/tmp/pip-build-env-4j0d_pnt/overlay/bin/cython)
      Compiler for C supports arguments -Wno-unused-but-set-variable: YES (cached)
      Compiler for C supports arguments -Wno-unused-function: YES (cached)
      Compiler for C supports arguments -Wno-conversion: YES (cached)
      Compiler for C supports arguments -Wno-misleading-indentation: YES (cached)
      Library m found: YES
      Fortran compiler for the host machine: gfortran (gcc 9.4.0 "GNU Fortran (Ubuntu 9.4.0-1ubuntu1~20.04.2) 9.4.0")
      Fortran linker for the host machine: gfortran ld.bfd 2.34
      Compiler for Fortran supports arguments -Wno-conversion: YES (cached)
      Checking if "-Wl,--version-script" : links: YES (cached)
      Program tools/generate_f2pymod.py found: YES (/home/codespace/micromamba/envs/scipy-dev/bin/python3.12 /workspaces/scipy/tools/generate_f2pymod.py)
      Program scipy/_build_utils/tempita.py found: YES (/home/codespace/micromamba/envs/scipy-dev/bin/python3.12 /workspaces/scipy/scipy/_build_utils/tempita.py)
      Program pythran found: YES 0.16.1 0.16.1 (/tmp/pip-build-env-4j0d_pnt/overlay/bin/pythran)
      Found CMake: /usr/bin/cmake (3.16.3)
      DEPRECATION: CMake support for versions <3.17 is deprecated since Meson 0.62.0.
      |
      |   However, Meson was only able to find CMake 3.16.3.
      |
      |   Support for all CMake versions below 3.17.0 will be removed once
      |   newer CMake versions are more widely adopted. If you encounter
      |   any errors please try upgrading CMake to a newer version first.

      WARNING: CMake Toolchain: Failed to determine CMake compilers state
      Run-time dependency xsimd found: NO (tried pkgconfig and cmake)
      Dependency threads found: YES unknown (cached)
      Library npymath found: YES
      Dependency pybind11 found: YES 2.12.0 (cached)
      Program f2py found: YES (/tmp/pip-build-env-4j0d_pnt/overlay/bin/f2py)
      Run-time dependency scipy-openblas found: NO (tried pkgconfig)
      Dependency openblas found: YES 0.3.8 (cached)
      Dependency openblas found: YES 0.3.8 (cached)
      Program ../tools/version_utils.py found: YES (/home/codespace/micromamba/envs/scipy-dev/bin/python3.12 /workspaces/scipy/scipy/../tools/version_utils.py)
      Compiler for C supports arguments -Wno-maybe-uninitialized: YES (cached)
      Compiler for C supports arguments -Wno-discarded-qualifiers: YES (cached)
      Compiler for C supports arguments -Wno-empty-body: YES (cached)
      Compiler for C supports arguments -Wno-implicit-function-declaration: YES (cached)
      Compiler for C supports arguments -Wno-parentheses: YES (cached)
      Compiler for C supports arguments -Wno-switch: YES (cached)
      Compiler for C supports arguments -Wno-unused-label: YES (cached)
      Compiler for C supports arguments -Wno-unused-result: YES (cached)
      Compiler for C supports arguments -Wno-unused-variable: YES (cached)
      Compiler for C++ supports arguments -Wno-bitwise-instead-of-logical: NO (cached)
      Compiler for C++ supports arguments -Wno-cpp: YES (cached)
      Compiler for C++ supports arguments -Wno-class-memaccess: YES (cached)
      Compiler for C++ supports arguments -Wno-deprecated-declarations: YES (cached)
      Compiler for C++ supports arguments -Wno-deprecated-builtins: NO (cached)
      Compiler for C++ supports arguments -Wno-format-truncation: YES (cached)
      Compiler for C++ supports arguments -Wno-non-virtual-dtor: YES (cached)
      Compiler for C++ supports arguments -Wno-sign-compare: YES (cached)
      Compiler for C++ supports arguments -Wno-switch: YES (cached)
      Compiler for C++ supports arguments -Wno-terminate: YES (cached)
      Compiler for C++ supports arguments -Wno-unused-but-set-variable: YES (cached)
      Compiler for C++ supports arguments -Wno-unused-function: YES (cached)
      Compiler for C++ supports arguments -Wno-unused-local-typedefs: YES (cached)
      Compiler for C++ supports arguments -Wno-unused-variable: YES (cached)
      Compiler for C++ supports arguments -Wno-int-in-bool-context: YES (cached)
      Compiler for Fortran supports arguments -Wno-argument-mismatch: YES (cached)
      Compiler for Fortran supports arguments -Wno-conversion: YES (cached)
      Compiler for Fortran supports arguments -Wno-intrinsic-shadow: YES (cached)
      Compiler for Fortran supports arguments -Wno-maybe-uninitialized: YES (cached)
      Compiler for Fortran supports arguments -Wno-surprising: YES (cached)
      Compiler for Fortran supports arguments -Wno-uninitialized: YES (cached)
      Compiler for Fortran supports arguments -Wno-unused-dummy-argument: YES (cached)
      Compiler for Fortran supports arguments -Wno-unused-label: YES (cached)
      Compiler for Fortran supports arguments -Wno-unused-variable: YES (cached)
      Compiler for Fortran supports arguments -Wno-tabs: YES (cached)
      Compiler for Fortran supports arguments -Wno-argument-mismatch: YES (cached)
      Compiler for Fortran supports arguments -Wno-conversion: YES (cached)
      Compiler for Fortran supports arguments -Wno-maybe-uninitialized: YES (cached)
      Compiler for Fortran supports arguments -Wno-unused-dummy-argument: YES (cached)
      Compiler for Fortran supports arguments -Wno-unused-label: YES (cached)
      Compiler for Fortran supports arguments -Wno-unused-variable: YES (cached)
      Compiler for Fortran supports arguments -Wno-tabs: YES (cached)
      Checking if "Check atomic builtins without -latomic" : links: YES (cached)

      ERROR: Unhandled python OSError. This is probably not a Meson bug, but an issue with your build environment.
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

SciPy/NumPy/Python version and system information
import sys, numpy; print(numpy.__version__, sys.version_info);
2.0.0 sys.version_info(major=3, minor=12, micro=4, releaselevel='final', serial=0)

can you try pip install -e /workspaces/scipy/ --no-build-isolation or alternatively use the dev.py interface
https://docs.scipy.org/doc/scipy/building/index.html#building-from-source-for-scipy-development

Thanks for the report @lobpcg.

In the latest VS Code in Win 11, I created a container with scipy in it, and use the (scipy-dev) conda environment.

Can I ask for some more detail here? What exact steps did you take to create a container? The issue seems to involve the overlay that goes missing, so my first guess is that this has to do with the mechanism of container creation.

I have not actually done much manually, just followed the VS Code auto-suggested workflow. I recollect that VSCode has created a container upon my request to use the built-in git to get the scipy.
The whole directory /tmp/pip-build-env-na93e837/ is missing, and I am unsure where the name came from. Trying
grep -Rnw '/' -es 'na93e837' 2> /dev/null
but it still takes forever without any output.
Maybe VS Code made multiple containers somehow and is trying to refer to one from another... I have never used VS Code with Docker before, so kind of in the dark. I do not even know what the 'overlay' is...
It may be possible that I have done initial steps in the dev.py interface direction before settling on install -e. Let me just remove everything and start over, now being a bit better educated.

let me close this so far.


pull request for e2e test at 11/29/2016 00:26:04

:white_check_mark: Validation status: passed
For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Teltonika- How to extract IMEI from login bytes

Hi,
I am decoding protocol of Teltonika.
I am receiving following bytes in the login packet.
00 0F 33 35 36 31 37 33 30 36 34 38 33 34 32 30 38 (17 bytes)
It represents IMEI number :<PHONE_NUMBER>34208.
How can I convert the byte array to IMEI number in the JAVA?
Thanks in advance.

Traccar already does it. Check TeltonikaProtocolDecoder source code for more information.

Thanks for your help..
Closing this issue.


Crash

 Caused by: java.lang.IllegalStateException: Please invoke the 'FileDownloader#setup' before using FileDownloader. If you want to register some components on FileDownloader please invoke the 'FileDownloader#setupOnApplicationOnCreate' on the 'Application#onCreate' first.

I think the error log is specific enough to tell you how to do.

No, It's crash for Android 9, not for previous versions.
My code is:
public class MyApp extends MultiDexApplication {
@Override
public void onCreate() {
    super.onCreate();
    setupFileDowmloader();
}

private void setupFileDowmloader() {
    FileDownloader.setupOnApplicationOnCreate(this)
            .connectionCreator(new FileDownloadUrlConnection
                    .Creator(new FileDownloadUrlConnection.Configuration()
                    .connectTimeout(15_000) // set connection timeout.
                    .readTimeout(15_000) // set read timeout.
            ))
            .commit();
}

}

Two questions:

Do you invoke FileDownloader method in some methods before Application#onCreate? Such as attachBaseContext method.
If you don't use MultiDex, wether the problem will dismiss or not?


⚠ Bofrost.nl has degraded performance

In 3db8000, Bofrost.nl (https://www.bofrost.nl) experienced degraded performance:

HTTP code: 200
Response time: 1389 ms

Resolved: Bofrost.nl performance has improved in 40c259f after 9 minutes.


Bot posted a google amp link as a non-amp link

https://www.reddit.com/r/Baofeng/comments/looafu/uv5r_voice_modulation_improvement_mod/go7gahd/

Non-AMP Links:
https://www.google.com/amp/s/rolfje.wordpress.com/2015/05/10/better-modulation-for-the-baofeng-uv-5ra/amp/
https://rolfje.wordpress.com/2015/05/10/better-modulation-for-the-baofeng-uv-5ra/
I'm a bot. Why? | Code | Report issues

Happened again here:
https://www.reddit.com/r/conspiracy_commons/comments/mmz9rh/why_does_the_united_states_give_so_much_money_to/gtufyu5/

And here's: https://www.reddit.com/r/System76/comments/lcyont/system76_launch_keyboard/gm3ttdo?utm_medium=android_app&utm_source=share&context=3


Change download format for reporting

Description
[Describe what this change achieves]
Issues Resolved
[List any issues this PR will resolve]
Check List

[ ] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

should i add the backport 2.x, and backport main as well?

@kavithacm Can you address the comment and also look into failing CI:?
Thanks!

should i add the backport 2.x, and backport main as well?

Yes it should be backported to main and 2.x as well. Thank you!

@kavithacm Can you address the comment and also look into failing CI:?
Thanks!

The failing CI is due to a connection refused error, would you be able to rerun the CI again as I dont have permission to do so?
waiting on "http://localhost:5601" with timeout of 60 seconds
http://localhost:5601 timed out on retry 91 of 3, elapsed 90271ms, limit 90000ms
Error: connect ECONNREFUSED [1](https://github.com/opensearch-project/opensearch-dashboards-functional-test/actions/runs/6191602414/job/16810155131?pr=855#step:18:1)<IP_ADDRESS>:5601

Thanks!

Tried triggering twice. It fails with same error


Error: Execution of Slash Command without Additional Text in v0.9.65

Before submitting your bug report

[X] I believe this is a bug. I'll try to join the Continue Discord for questions
[X] I'm not able to find an open issue that reports the same bug
[X] I've seen the troubleshooting guide on the Continue Docs

Relevant environment info
- OS: macOS
- Continue: 0.9.65
- IDE: VSCode

Description
When executing a slashCommand without any other text, Continue throws an error starting from
version v0.9.65 (2024-02-16T03:10:28.49Z).
This issue first appeared with commit f8e968c0 in the resolveParagraph function in the
resolveInput.ts file due to the usage of the trimStart() method.
--- a/gui/src/components/mainInput/resolveInput.ts
+++ b/gui/src/components/mainInput/resolveInput.ts
@@ -148,25 +148,26 @@
 function resolveParagraph(p: JSONContent): [string, MentionAttrs[], string] {
   let text = "";
   const contextItems = [];
   let slashCommand = undefined;
   for (const child of p.content || []) {
     if (child.type === "text") {
-      text += child.text;
+      text += text === "" ? child.text.trimStart() : child.text;
     } else if (child.type === "mention") {

This leads to an issue in the resolveEditorContent function, as lastTextIndex becomes -1. This
throws an error when parts[lastTextIndex].text is executed.
https://github.com/continuedev/continue/blob/2753ed4c2283f1a92be5ee97e4c02b010f96d825/gui/src/components/mainInput/resolveInput.ts#L128-L131
TypeError: Cannot read properties of undefined (reading 'text')

proposed solution/ workaround
Ensure lastTextIndex has found a match; if not, simply pass the slashCommand along.
--- a/gui/src/components/mainInput/resolveInput.ts
+++ b/gui/src/components/mainInput/resolveInput.ts
@@ -127,7 +127,12 @@ async function resolveEditorContent(

   if (slashCommand) {
     let lastTextIndex = findLastIndex(parts, (part) => part.type === "text");
-    parts[lastTextIndex].text = `${slashCommand} ${parts[lastTextIndex].text}`;
+    if (lastTextIndex !== -1) {
+      parts[lastTextIndex].text = `${slashCommand} ${parts[lastTextIndex].text}`;
+    }
+    else {
+      parts.push({ type: "text", text: slashCommand });
+    }
   }

   return [contextItems, parts];

To reproduce

Enter a slash command in the continue GUI, without adding any text or context, for example, /edit.
Press ⏎ Enter
Notice the error message.


Add past slugs to works

Codecov Report

Merging #680 into develop will decrease coverage by 0.01%.
The diff coverage is 95.94%.

@@             Coverage Diff             @@
##           develop     #680      +/-   ##
===========================================
- Coverage    98.01%   97.99%   -0.02%
===========================================
  Files          222      223       +1
  Lines        12122    12185      +63
  Branches        66       66
===========================================
+ Hits         11881    11941      +60
- Misses         241      244       +3

This was a very straightforward port of the person slug logic, I downgraded the issue from 2 to 1 and don't think this needs review.
Worth noting, though — as I copied the code, it became clear that this would be pretty easy to generalize if we find we want to use it again (which seems possible). Convert the past slug models to use a generic foreign key, provide a model mixin to save old slugs and validate uniqueness, provide a view mixin for the redirect logic.  Shout out to @thatbudakguy for the awesome name suggestion of slug trails or slug tracks.


Dashing.AnimatedValue not refreshing data on scheduled jobs

Hi,
I try the example here
Works pretty well, values are being fetched from a google spreadsheet file on my gdrive.
But animated values (using widget Number, are not refresh on each tick of my job.
On the first load, it does animate the value to its actual value.
But when I change the value to display in my spreadsheet, the value is not refreshed (while the last modified message changes indeed in my number box...).
When I debug via console, I actually see the value is well refreshed.
Another curious thing: If I disable the AnimatedValue in the number.coffee file, the value gets well refreshed on each tick of my job...
Help me understand what's going on...I suspect some kind of async/sync...but what I can't explain is why the value that actually changes is not reflected in the widget.
Many thanks.
scoreboard.erb in dashboards
<% content_for :title do %>Tableau de suivi des scores<% end %>

extract of my scoreboard.rb in jobs
def authorize
  client = Google::APIClient.new(
    :application_name => 'Get Value from Google SpreadSheet for Dashing',
    :application_version => '1.0.0')

  file_storage = Google::APIClient::FileStorage.new('credential-oauth2.json')
  if file_storage.authorization.nil?
    flow = Google::APIClient::InstalledAppFlow.new(
      :client_id => ENV['GOOGLE_DRIVE_CLIENT_ID'],
      :client_secret => ENV['GOOGLE_DRIVE_CLIENT_SECRET'],
      :scope => %w(
        https://www.googleapis.com/auth/drive
        https://docs.google.com/feeds/
        https://docs.googleusercontent.com/
        https://spreadsheets.google.com/feeds/
      ),
    )
    client.authorization = flow.authorize(file_storage)
  else
    client.authorization = file_storage.authorization
  end

  client
end

SCHEDULER.every '10s', :first_in => 0 do |job|
  client = authorize
  session = GoogleDrive.login_with_oauth(client.authorization.access_token)
  ws = session.spreadsheet_by_key(ENV['DASHING_TARGET_SPREAD_SHEET_ID']).worksheets[WORKSHEET_NUMBER]

  lastA=currentA

  lastRankA=currentRankA

  currentA = ws[CELLS_ROW_NUMBER, CELLS_COLUMN_NUMBER]

  currentRankA = ws[CELLS_ROW_NUMBER, CELLS_COLUMN_NUMBER+1]

  ## output is correct ! as said previously
  puts "Tick A with #{currentA} - #{lastA} - #{currentRankA} - #{lastRankA}"

  # send_event('google_spreadsheet', { valueA: currentA, valueB: cell_valueB, valueC: cell_valueC, valueD: cell_valueD, valueE: cell_valueE, valueF: cell_valueF })
  send_event('google_spreadsheetA', { current: currentA, last: lastA, ranking: currentRankA, lastRanking: lastRankA })

end

I'm having the same issue. I'm also using hotness with this. The background colour changes based on the new value but the number displayed remains the same

Dashing.AnimatedValue has a bug which causes it to lock up if the old and new values are the same.


[3.x] CPUParticles - fix non-interpolated NOTIFICATION_TRANSFORM

Updates global particle transforms immediately on receiving notification, to match legacy behaviour.
Fixes #80697
Notes

Godot 3.5 and earlier worked in this way. It isn't super efficient as it often transforms the particles twice on a frame, but it fixes the regression and allows making more efficient versions at leisure.
One alternative way to fix this is to disable GODOT_CPU_PARTICLES_2D_LEGACY_COMPATIBILITY, so global particles are specified in proper global space and there is no need to "re-jig" when the parent object changes.

Discussion
The whole system of using the inverse transform I have confirmed was a historical bodge to work with the existing VisualServer. So there is the opportunity to move the legacy particles to true global space as used by physics interpolated global particles.
On the downside, the bounds calculation is more complex when using true global space, because bounds are expected in local space (see fixes here in #80887 for physics interpolated particles) so I'm of the opinion it probably makes more sense to get this working and tested with physics interpolation before attempting the same with non-interpolated particles.
For this reason I'm moving this out of draft as it should be a good fixup in the meantime.

@lawnjelly Well, you made me compile Godot on Windows just to test this patch 👍 and indeed, I can confirm that it fixes the particle glitches seen in the 3.6 beta3 release and reported in https://github.com/godotengine/godot/issues/80697. Modulo the one idle frame when toggling Local Coords on/off but as you explained it is not critical, beyond being annoying.
I guess I am now set to test other patches...

Thanks for testing! I suspect it will work fine when we test the other patch too.
I'll make a PR for this too soon, but I noticed another bug while working on the disabled GODOT_CPU_PARTICLES_2D_LEGACY_COMPATIBILITY version, which seems to be a transform problem in the fountain particles when physics interpolation is on with your MRP (the fountain moves twice as far as it should). I'll hopefully be tracking this down soon.
Be sure to try with physics interpolation on as well and report any strange behaviour. :+1:

Have figured out the bug above with interpolated particles. I had previously been testing particle systems that were moved by their parent, and thus their local transform was 0.
When moving the particle system directly (in this case the fountain), the local transform was changing too, and I had been applying this in visual server (so the particles were moving twice as far as they should). As the particles are already in global space, the obvious solution is not to apply either parent or local transform.
It has occurred to me we should also pass on the regular final_transform to any children, just in case anyone added a child to a particle system (so to the child it would appear as though the transforms were propagated normally).
I'll do a PR for this bug and the variation of this PR with disabled GODOT_CPU_PARTICLES_2D_LEGACY_COMPATIBILITY. :+1:

Thanks!