zipfile.BadZipFile exception when downloading WIDERFace (traced to download_file_from_google_drive function)

🐛 Describe the bug
While trying to download the WIDERFace dataset using the following code:
from torchvision.datasets.widerface import WIDERFace
w = WIDERFace('.', split='train', download=True)

I ran into the following error
$ python download_wider.py
Traceback (most recent call last):
  File "download_wider.py", line 2, in <module>
    w = WIDERFace('.', split='train', download=True)
  File "/home/josh/venv/lib/python3.7/site-packages/torchvision/datasets/widerface.py", line 72, in __init__
    self.download()
  File "/home/josh/venv/lib/python3.7/site-packages/torchvision/datasets/widerface.py", line 191, in download
    extract_archive(filepath)
  File "/home/josh/venv/lib/python3.7/site-packages/torchvision/datasets/utils.py", line 409, in extract_archive
    extractor(from_path, to_path, compression)
  File "/home/josh/venv/lib/python3.7/site-packages/torchvision/datasets/utils.py", line 284, in _extract_zip
    from_path, "r", compression=_ZIP_COMPRESSION_MAP[compression] if compression else zipfile.ZIP_STORED
  File "/usr/lib/python3.7/zipfile.py", line 1225, in __init__
    self._RealGetContents()
  File "/usr/lib/python3.7/zipfile.py", line 1292, in _RealGetContents
    raise BadZipFile("File is not a zip file")
zipfile.BadZipFile: File is not a zip file

Stepping through the code I found that when it reaches torchvision/datasets/utils.py:243:
243:        _save_response_content(itertools.chain((first_chunk,), response_content_generator), fpath)

the value of first_chunk contains:
b'<!DOCTYPE html><title>Google Drive - Virus scan warning</title><meta http-equiv="content-type" content="text/html; charset=utf-8"/><link rel="icon" href="null"/>

Google Drive can\'t scan this file for viruses.

WIDER_train.zip (1.4G) is too large for Google to scan for viruses. Would you still like to download this file?
<form id="downloadForm" action="https://docs.google.com/uc?export=download&id=15hGDLhsx8bLgLcIRD5DhYt5iBxnjNF1M&confirm=t" method="post"><input type="submit" id="uc-download-link" class="goog-inline-block jfk-button jfk-button-action" value="Download anyway"/></form>

'

and this is the only chunk in the response_content_generator as well.
This information is then written to the WIDER_train.zip file (which is supposed to be a zip file) and that causes the BadZipFile exception.

I'm not sure if this is the result of a recent change in google drive or related to my platform, or what. Either way it would be really nice if a more meaningful error could be presented on the BadZipFile file exception. Since this relies on the response from google drive, which is likely to change in the future, wouldn't it be nicer to have a more meaningful error message when things like this happen?
For example, wouldn't it be great if we had an error message that said something meaningful like
Oops, we tried to download the google drive file from

https://docs.google.com/uc?export=download&id=15hGDLhsx8bLgLcIRD5DhYt5iBxnjNF1M

but the file contains unexpected information and we don't know why.

You can download this file manually and place it at ./widerface/WIDER_train.zip to circumvent this issue.

rather than having the user step through the code to find the correct URL and destination path?
Also, why is this being unzipped before the hash is even checked? That seems like a potential security issue.
Versions
Collecting environment information...
PyTorch version: 1.11.0+cpu
Is debug build: False
CUDA used to build PyTorch: Could not collect
ROCM used to build PyTorch: N/A

OS: Ubuntu 18.04.6 LTS (x86_64)
GCC version: (Ubuntu 7.5.0-3ubuntu1~18.04) 7.5.0
Clang version: Could not collect
CMake version: version 3.13.4
Libc version: glibc-2.26

Python version: 3.7.5 (default, Dec  9 2021, 17:04:37)  [GCC 8.4.0] (64-bit runtime)
Python platform: Linux-5.4.0-99-generic-x86_64-with-Ubuntu-18.04-bionic
Is CUDA available: False
CUDA runtime version: Could not collect
GPU models and configuration:
GPU 0: NVIDIA GeForce RTX 2080 Ti
GPU 1: NVIDIA GeForce RTX 2080 Ti

Nvidia driver version: 510.47.03
cuDNN version: 8.0.2
HIP runtime version: N/A
MIOpen runtime version: N/A
Is XNNPACK available: True

Versions of relevant libraries:
[pip3] numpy==1.21.5
[pip3] torch==1.11.0+cpu
[pip3] torchaudio==0.11.0+cpu
[pip3] torchvision==0.12.0+cpu
[conda] Could not collect

cc @pmeier

Thanks for the report @josh-gleason. GDrive is just a pain in the behind to deal with. Since they don't have a proper API, we need to manually parse the response to find if anything is going wrong. For example, we have a proper error in case the daily quota for a file is exceeded:
https://github.com/pytorch/vision/blob/297e2b8746d32b46d20b0e6a6f867fde65e50e8d/torchvision/datasets/utils.py#L187-L191
I've never encountered the "Virus scan warning". Giving a proper error message doesn't seem hard here. I'll look into it.

Yeah I've run into my own problems automating Google drive downloads. Thanks for looking into this.
Unrelated, but how do you post those nice code blocks in github markdown?

Unrelated, but how do you post those nice code blocks in github markdown?

Go to any file, select one or more lines, click the dots on the left and select "Copy permalink". If you paste this into an issue or PR in the same repo, GitHub will automatically render the code for you. For example, the block above is just https://github.com/pytorch/vision/blob/297e2b8746d32b46d20b0e6a6f867fde65e50e8d/torchvision/datasets/utils.py#L187-L191.


Allow surgery tools in medbelt

About the PR

Title
Fixes #26010
Why / Balance

Technical details

Media

[ ] I have added screenshots/videos to this PR showcasing its changes ingame, or this PR does not require an ingame showcase

Breaking changes

Changelog

:cl:

tweak: Surgery tools can be placed in medical belt.

Ah yes, Surgery is tomorrow I see
Also syndie medical fellas will benefit nicely from basically a surgical weapons belt


Fix start/end dates for quarters that weren't on a standard 3 month boundary

When the start of the fiscal year wasn't 1, 4, 7 or 9 then the start and end dates weren't correct...assuming that meant start and end of the fiscal quarter. This fixes that.

This problem is currently blocking me. I hope this can be approved and merged.


Make parameterize decorator and use it in test_ndarray

fix #536
We want to use this decorator in chainer.

LGTM!


Fix batch size in user CLI

What changes are proposed in this pull request?
Fix recursive pool adding for distributedCP and distributedLoad
Why are the changes needed?
Please clarify why the changes are needed. For instance,

If you propose a new API, clarify the use case for a new API.
If you fix a bug, describe the bug.

Does this PR introduce any user facing changes?
Please list the user-facing changes introduced by your change, including

change in user-facing APIs
addition or removal of property keys
webui

Codecov Report

Merging #14500 (4655f76) into master (2d98ae2) will decrease coverage by 24.95%.
The diff coverage is 15.58%.

:exclamation: Current head 4655f76 differs from pull request most recent head cfc7fdf. Consider uploading reports for the commit cfc7fdf to get more accurate results

@@              Coverage Diff              @@
##             master   #14500       +/-   ##
=============================================
- Coverage     41.90%   16.94%   -24.96%
+ Complexity     9338     2702     -6636
=============================================
  Files          1495     1494        -1
  Lines         87524    87640      +116
  Branches      10432    10447       +15
=============================================
- Hits          36676    14853    -21823
- Misses        47864    71547    +23683
+ Partials       2984     1240     -1744

Impacted Files
Coverage Δ

...n/src/main/java/alluxio/metrics/MetricsSystem.java
51.35% <ø> (-10.09%)
:arrow_down:

.../java/alluxio/proxy/s3/MultipartUploadCleaner.java
0.00% <0.00%> (ø)

...xy/src/main/java/alluxio/proxy/s3/S3ErrorCode.java
0.00% <0.00%> (ø)

...in/java/alluxio/proxy/s3/S3RestServiceHandler.java
0.00% <0.00%> (-2.65%)
:arrow_down:

...a/alluxio/cli/fs/command/DistributedCpCommand.java
0.00% <0.00%> (ø)

...a/alluxio/cli/fs/command/DistributedLoadUtils.java
0.00% <0.00%> (ø)

...n/java/alluxio/underfs/s3a/S3AUnderFileSystem.java
0.00% <0.00%> (-17.50%)
:arrow_down:

...common/src/main/java/alluxio/conf/PropertyKey.java
98.06% <100.00%> (-1.38%)
:arrow_down:

...mon/src/main/java/alluxio/shell/CommandReturn.java
0.00% <0.00%> (-100.00%)
:arrow_down:

...mon/src/main/java/alluxio/util/ExceptionUtils.java
0.00% <0.00%> (-100.00%)
:arrow_down:

... and 691 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1a5376f...cfc7fdf. Read the comment docs.

ConcurrentFileInStreamIntegrationTest known flake test

alluxio-bot, merge this please

alluxio-bot, cherry-pick this to branch-2.7 please


How did you use the function snr_based_clustering?

Hi, I would like to know how you use the function snr_based_clustering? What will be the input snr for it? Will be the snr computed on the noisy latent or the noise itself? Thanks for reply in advance!

Hello!
To cluster timesteps $t$ into $N$ groups, you can use the function snr_based_clustering. In this context, $SNR$ means the signal-to-noise ratio across timestep $t$! Therefore, the input of that function can be a Numpy array having signal-to-noise ratios for all of the timesteps.
If you have further questions, feel free to ask!

Sorry for late response!
I think the latter one is correct!
For clarification, please see Variational Diffusion Models. In that work, SNR at timesteps (noise levels) are well defined.

Thank you! That's clear.


Make it easier to contact Collectives

Context
We get quite a few emails to<EMAIL_ADDRESS>from confused people trying to contact a specific Collective. They are sometimes developers with a technical question about a FOSS project, or a potential sponsor, etc. It's not clear enough how to get in touch with a Collective's core contributors.
User story
As a user, sponsor, contributor, or interested developer, I want to be able to directly contact the core contributors of a Collective from their page.
Best solution for this problem
A contact button or form on every Collective page that connects to<EMAIL_ADDRESS>which goes to the Collective's core contributors.
Metrics
Fewer support requests meant for Collectives coming to Open Collective Support
Documentation
Add a section to the Collectives > Communication section in the docs about how people can contact you from your page.

Adding to this: we also get confused people trying to reach admins of other hosts. Whatever solution we create for contacting Collectives directly should also be implemented for contacting hosts. Even as an Open Collective team member, I often find it difficult to know who to contact for specific host issues.

I am bumping this again because I still don't think the contact button in the new Collective page is obvious enough. Instead of hiding among the other menu items, it should be a big button in a highlight color. This is one of the top reasons people contact support and a big unnecessary wall between Collectives and potential sponsors.

@Betree @cuiki please address this before finishing the new Collective page.

I've also reported multiple times that having Contact in the NavBar was confusing because it's not a nav link, it's an external link. I actually miss clicked it multiple times trying to scroll the page so my intuition is that users will be confused.
@xdamman also gave a feedback I agreed on, with the Share button not being necessary on this page (so we could just replace it by Contact).
I'm all for this but the decision is up to @opencollective/design, waiting for their reply.

Hi guys, I would not do it as a CTA like in Alanna's example. Contacting the Collective is not the main action we want people to do and this will send that message.
We do agree on moving the Contact link to the right hand side in the same style as the Get Updates and Share buttons. The action will be to try and move the Share button to the area below the collective name and move the Contact link into a button on the right side.
@raulgrafico is on this.

if contact is (for now) a mailto link to an email address, why not putting it visually along side the website url of the collective?

This is fixed in NCP


Lowercased table name in migrations

What steps will reproduce the problem?
yii migrate/create add_API_PACKAGE_NAME_column_to_PROJECTS_SETTINGS_table --fields="API_PACKAGE_NAME:string(256)"
What is the expected result?
$this->addColumn('PROJECT_SETTINGS', 'API_PACKAGE_NAME', $this->string(256));
What do you get instead?
$this->addColumn('project_settings', 'API_PACKAGE_NAME', $this->string(256));
Additional info

Q
A

Yii version
2.0.10

PHP version
7.0.12

Operating system
Arch GNU/Linux

Issue confirmed. Do you want to fix / add unit test for it?

Yes, i can. I will do this on next week.


Cannot compile version 0.11.3

I've followed the quick start provided in this repo (https://github.com/rust-osdev/bootloader/blob/HEAD/docs/create-disk-image.md)
I've got the exact dependencies, files, directories, layout and so on. I'm compiling to x86_64-unknown-none with rustc version 1.71.0-nightly in WSL2 (Ubuntu)
I get the following output: https://sourceb.in/2wDVzkJ4ZV
I have LLVM15 installed and in my PATH (llvm-config --version shows 15.0.7)

Have you installed the llvm-tools rustup component using rustup component add llvm-tools? Bootloader's build script looks for the objcopy llvm tool exclusively in the rustc toolchain, not in your PATH.

That fixed it. I can't recall reading anywhere that I needed to do this, but I know for a fact that I wasn't reading everything. Thank you, it's now compiling


set CCD temperature in a more correct way

Right now the CCD temperatures are alll set to the temperture measured by the sensor HTR8A on the back of the UV2 channel.

This is actually done in L1A now. Should I move this issue there?

I dont understand where you want to move the issue. it is in L1-processing and L1A is part of that?  We have all the data we need for the decision now though so I add this to the todolist for next weekly meeting ( I am not sure when that will be though now during holiday time)

The temperature data, temperature_ADC and so on, are pre-calculated in L1A, rather than on the fly in L1B in the latest version. If those columns are what this issue is about, it seems to me it belongs in the dedicated level1a-repository rather than here.

OK, I see, yes, then the issue should be moved there.


Schema support

High level comment - @himank @efirs are we going to have the high level client in this same repo?

Yes, I think it natural to have them co-located in the  same repo.
And actually ideally we could have Golang client as a part of TigrisDB repo.
Pulling client as
go get github.com/tigrisdata/tigrisdb/client

look nicer to me.

Remember that we are not building a "go" only database. We need to make sure all languages have first class support and that the usage is similar.
So it would be unnatural for only the go client to be part of the server repo.
Secondly, tigrisdb allows HTTP access without requiring a special client. Thus, embedding a client in the server repo would not send a coherent message.

Yes, I think it natural to have them co-located in the  same repo.
And actually ideally we could have Golang client as a part of TigrisDB repo.
Pulling client as

go get github.com/tigrisdata/tigrisdb/client

look nicer to me.

High level comment - @himank @efirs are we going to have the high level client in this same repo?

yes, so low level client and high level client will be in same repo - in go client repo.

Codecov Report

Merging #15 (622c9cb) into main (b118be7) will increase coverage by 4.17%.
The diff coverage is 87.41%.

@@            Coverage Diff             @@
##             main      #15      +/-   ##
==========================================
+ Coverage   80.76%   84.93%   +4.17%
==========================================
  Files          10       11       +1
  Lines         863     1082     +219
==========================================
+ Hits          697      919     +222
+ Misses        133      123      -10
- Partials       33       40       +7

Impacted Files
Coverage Δ

client/database.go
27.08% <33.33%> (-5.35%)
:arrow_down:

schema/schema.go
92.24% <92.24%> (ø)

client/client.go
36.84% <100.00%> (+36.84%)
:arrow_up:

driver/driver.go
97.91% <100.00%> (ø)

driver/grpc.go
88.38% <100.00%> (ø)

driver/http.go
77.08% <100.00%> (ø)

driver/internal.go
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b118be7...622c9cb. Read the comment docs.


split js file after build

how to split js file for this module after compile, because when we register this module on nuxt.config, causing a large compiled js file

No activity, closing stale issue.


 You have to use internal-search. Amazon prefixes internal load balancers with 'internal'.

This seems to have been resolved somewhere along the way! Thanks!


Won't let me continue  because of no p tag cling tag

My challenge is makes sure all p elements have closing tag

CatPhotoApp

 Kitty ipsum dolor sit amet, shed everywhere shed everywhere stretching attack your ankles chase the red dot, hairball run catnip eat the grass sniff.

 Purr jump eat the grass rip the couch scratched sunbathe,

@monzamatt12
Thanks for reporting this. But your code is incorrect.
GitHub Issues are for reporting bugs on the website only.
Please use the Help chat room for getting challenge related help.
Happy Coding.


Align linux UDP performance optimizations with configuration

While attempting to run nebula on an older Synology NAS, it became
apparent that some of the performance optimizations effectively
block support for older kernels. The recvmmsg syscall was added in
linux kernel 2.6.33, and the Synology ds212j (among other models)
is pinned to <IP_ADDRESS>.
Similarly, SO_REUSEPORT was added to the kernel in the 3.9 cycle.
While this option has been backported into some older trees, it
is missing from the Synology kernel.
This commit allows nebula to be run on linux devices with older
kernels if the config options are set up with a single listener
and a UDP listen batch size of 1 (listen.batch = 1).

wow, this really helps! We spent days trying to figure out why nebula won't work on our old machines but to no avail.
Is there anyway to check whether recvmmsg is available?  if not, can the default value of config batch: 64 be changed   value to 1?  becausetun.routines already defaults to 1. So that user on old kernel will work if he uses the default configuration.

Changing the default value of listen.batch to 1 would likely hurt performance for a lot of the user base on upgrade if they are using the default value (currently 64) in their deployments, so that's probably not the right path forward.
As far as checking for availability of the syscall, perhaps a change to the log output if the syscall fails to suggest config tuning makes sense... dependent on this change getting in first though.


Setter for 'subscript(dynamicMember:)' is unavailable

Description
Error presented when writing a line in a test:
$0.destination?.addContact?.contact.name = "Blob Jr."
after following the tutorial https://pointfreeco.github.io/swift-composable-architecture/main/tutorials/composablearchitecture/02-03-testingpresentation
Reproduced using Xcode 16 Beta 2 / Swift 6
Checklist

[X] I have determined whether this bug is also reproducible in a vanilla SwiftUI project.
[X] If possible, I've reproduced the issue using the main branch of this package.
[X] This issue hasn't been addressed in an existing GitHub issue or discussion.

Expected behavior
That the code compiles
Actual behavior
This code isn't compiling:
await store.send(\.destination.addContact.setName, "Blob Jr.") {
      $0.destination?.addContact?.contact.name = "Blob Jr."
}

Showing this error:
Setter for 'subscript(dynamicMember:)' is unavailable: Write 'enum = .case(value)', not 'enum.case = value'

Steps to reproduce
No response
The Composable Architecture version information
54eb417
Destination operating system
iOS 18
Xcode version information
Version 16.0 beta 2 (16A5171r)
Swift Compiler version information
swift-driver version: 1.110 Apple Swift version 6.0 (swiftlang-<IP_ADDRESS>.52 clang-16<IP_ADDRESS>.3)
Target: arm64-apple-macosx15.0

Yes, the subscript was always a bit of a hack, so they disabled in Swift 6 and now you should use .modify.

Got it!
I changed to:
await store.send(\.destination.addContact.setName, "Blob Jr.") {
  $0.destination?.modify(\.addContact) { $0.contact.name = "Blob Jr." }
}

And added support in the enum to CasePathable:
extension ContactsFeature {
  @CasePathable
  @Reducer(state: .equatable)
  enum Destination {
    case addContact(AddContactFeature)
    case alert(AlertState<ContactsFeature.Action.Alert>)
  }
}

Thanks!

Please update the documents.


Cards get not removed from the Adapter

Using:
@Override
            public void removeFirstObjectInAdapter() {
                // this is the simplest way to delete an object from the Adapter (/AdapterView)
                Log.d("LIST", "removed object!");
                al.remove(0);
                arrayAdapter.notifyDataSetChanged();
            }

al.size() is always the same.

When you swipe away a card you are triggering onAdapterAboutToEmpty, which then adds another card, keeping the adapter at the same size.


Can't get Resource Group tooltip go away for Azure KS

Rancher versions: 2.0 master 7/3
Steps to Reproduce:

Go through the auth step in Create Cluster - Azure KS
Click on the tool tip for Resource Group
Now click anywhere else

Results:  Tooltip won't go away

@tfiduccia can you retest on latest? I followed your directions but I see the tooltip working correctly. If you still see it happening I may need more info. The only way I can think that this would happen is if there was a JS error on the page, which I don't see either.

Version - 2.0 master 7/9
Verified fixed


#236 Update the User Guide

Fixes #<236>

@shreyasbapat
@ritzvik

Your local git configurations are not correct. :)

Corrected them :)

Your local git configurations are not correct. :)

Corrected them!

Hi @shilpi1958 ,
Thanks for this. Wouldn't it be great if you can update the Coordinate Conversion section also.
This one https://github.com/einsteinpy/einsteinpy/blob/1e51e2179450a5cb1e22b93629fd7bd67e945d96/docs/source/user_guide.rst#coordinate-conversion

Yes, you will have to separate out coordinates and symbolic from utils :D

Yes, you will have to separate out coordinates and symbolic from utils :D

symbolic we would see later because specific classes for Kerr and all are not implemented till now.

On it :D !

@shilpi1958 , one more small thing to do, remove the first point from future plans.
https://github.com/einsteinpy/einsteinpy/blob/1e51e2179450a5cb1e22b93629fd7bd67e945d96/docs/source/user_guide.rst#future-plans


mate.libmatekbd: 1.20.0 -> 1.20.1

Semi-automatic update generated by https://github.com/ryantm/nix-update tools.
This update was made based on information from https://repology.org/metapackage/libmatekbd/versions.
These checks were done:

built on NixOS
Warning: no binary found that responded to help or version flags. (This warning appears even if the package isn't expected to have binaries.)
found 1.20.1 with grep in /nix/store/03zsljdh5dy4xidfi0hr9irs23z5lvj4-libmatekbd-1.20.1
directory tree listing: https://gist.github.com/16b4b6e371f933ba6a7c385070a069c0

cc @romildo for review

No attempt on x86_64-darwin (full log)
The following builds were skipped because they don't evaluate on x86_64-darwin: mate.libmatekbd
Partial log (click to expand)

a) For `nixos-rebuild` you can set
  { nixpkgs.config.allowBroken = true; }
in configuration.nix to override this.

b) For `nix-env`, `nix-build`, `nix-shell` or any other Nix command you can add
  { allowBroken = true; }
to ~/.config/nixpkgs/config.nix.

Success on x86_64-linux (full log)
Attempted: mate.libmatekbd
Partial log (click to expand)
glibPreFixupPhase
post-installation fixup
shrinking RPATHs of ELF executables and libraries in /nix/store/7yyvmf3778x5640iysl4hsgzw8jv04ms-libmatekbd-1.20.1
shrinking /nix/store/7yyvmf3778x5640iysl4hsgzw8jv04ms-libmatekbd-1.20.1/lib/libmatekbd.so.4.2.0
shrinking /nix/store/7yyvmf3778x5640iysl4hsgzw8jv04ms-libmatekbd-1.20.1/lib/libmatekbdui.so.4.2.0
strip is /nix/store/fzcs0fn6bb04m82frhlb78nc03ny3w55-binutils-2.28.1/bin/strip
stripping (with command strip and flags -S) in /nix/store/7yyvmf3778x5640iysl4hsgzw8jv04ms-libmatekbd-1.20.1/lib
patching script interpreter paths in /nix/store/7yyvmf3778x5640iysl4hsgzw8jv04ms-libmatekbd-1.20.1
checking for references to /build in /nix/store/7yyvmf3778x5640iysl4hsgzw8jv04ms-libmatekbd-1.20.1...
/nix/store/7yyvmf3778x5640iysl4hsgzw8jv04ms-libmatekbd-1.20.1

Success on aarch64-linux (full log)
Attempted: mate.libmatekbd
Partial log (click to expand)
glibPreFixupPhase
post-installation fixup
shrinking RPATHs of ELF executables and libraries in /nix/store/8xg65wm90pl51pk04n0445v1x7pxqxkd-libmatekbd-1.20.1
shrinking /nix/store/8xg65wm90pl51pk04n0445v1x7pxqxkd-libmatekbd-1.20.1/lib/libmatekbdui.so.4.2.0
shrinking /nix/store/8xg65wm90pl51pk04n0445v1x7pxqxkd-libmatekbd-1.20.1/lib/libmatekbd.so.4.2.0
strip is /nix/store/3zq400fri5dv7d30lpxlqm2v9y1iis6j-binutils-2.28.1/bin/strip
stripping (with command strip and flags -S) in /nix/store/8xg65wm90pl51pk04n0445v1x7pxqxkd-libmatekbd-1.20.1/lib
patching script interpreter paths in /nix/store/8xg65wm90pl51pk04n0445v1x7pxqxkd-libmatekbd-1.20.1
checking for references to /build in /nix/store/8xg65wm90pl51pk04n0445v1x7pxqxkd-libmatekbd-1.20.1...
/nix/store/8xg65wm90pl51pk04n0445v1x7pxqxkd-libmatekbd-1.20.1


fix:verification condition removed

⚠ ALL CHECKOBOXES MUST BE CHECKED BEFORE SUBBMITING A PULL REQUEST ⚠

[x] I confirm that everything below is true
[x] I understand that I'm not supposed to put solution to this repository
[x] I confirm that It is not a solution to the task, but fix in task itself
[x] In case if it is a solution I agree to get -100 points for the task

удалено условие проверки

удалено условие проверки

удалена проверка данных

condition check removed


Logging when a task is skipped (caused by mismatch condition)

Features Description
When analyzing output of a run it would be useful to have feedback about Task not executed because condition of the task is not ok.
Describe the solution you'd like

The minimal solution would be display for "skipped" task "Skipped" instead of "Running"

[cargo-make] INFO - Running Task: xxxx

become
[cargo-make] INFO - Skipping Task: xxxx
OR
[cargo-make] INFO - Running Task: xxxx [Skip]

Other alternative: allow to provide a message to display when condition is ko

condition = { ... else_msg = "the task is skipped X = ${X}" }

[cargo-make] INFO - Running Task: xxxx
[cargo-make] INFO - Task: xxxx - the task is skipped X = ...

A better solution could be to have the cause, (like "variable XXXX undefined")

Having an intermediary log level (DEBUG is too verbose) or a flag to enable this display is also possible.

Changing the output from 'running' to 'skipping' sounds good to me.
I am not sure about the message inside the condition as there is also condition_script that can filter out tasks.

@davidB running/skipped printout is now implemented in 0.24.1 development branch.

About the message inside the condition, it could be move out (at same level than condition and condition_script) by example named skip_message.
I never try condition_script, if there is an echo into the script called by condition_script does it is displayed ? if yes, I guess else_message(or skip_message) could be only an optional field of condition.
having more info (to debug) is something than need more reflexion, because it is something that can be useful in some condition (to know why an task is not skip) and sometimes it's the opposite (to hide some behavior).
Thanks for the quick fix.

This is now officially release so i'm closing this issue.
I'll create another issue and link to this one regarding the skip message.
i'm not 100% sure how useful it is if its static, but will get to it...


Fixes #690 Quotes in household name causes error

What is the context of this PR?
Fixes #690.
Render function gets called both with dict and string in different places.
When called with string (substituting piping values) need to escape characters to ensure valid JSON.
How to review
Re-test the defect.
Ensure can enter quotes or backslashes for household member names.
Names should be displayed appropriately.

Putting '<Chris' in the first name causes the name to be lost, is it related?

Actually putting < anywhere in the string loses all content after it..

I think they should be separate issues. One is to escape JSON when piping. The other is to bleach input values to escape HTML. I started looking at bleaching the input and got loads of failing tests.

I think this may be related to https://github.com/ONSdigital/eq-survey-runner/issues/699 arguably there should be no quotes in the name if the data is being bleached correctly?

@jonnyshaw89 Not sure about that, what I've you had an apostrophe in the name e.g. O'Neil?

but that should be stored in the json as "O'Neil" which then wouldn't error when being parsed by the template_renderer?


pact.publishPacts(opts) missing

Since 13.3.3 the function publishPacts() is not found.
Software versions

OS: node:lts-bullseye-slim
Pact Node version<EMAIL_ADDRESS>Node Version: node:lts-bullseye-slim
Other Versions<EMAIL_ADDRESS>
Issue Checklist
Please confirm the following:

[x] I have upgraded to the latest
[x] I have the read the FAQs in the Readme
[x] I have triple checked, that there are no unhandled promises in my code
[ ] I have set my log level to debug and attached a log file showing the complete request/response cycle
[ ] For bonus points and virtual high fives, I have created a reproduceable git repository (see below) to illustrate the problem

Expected behaviour
If I run the code from https://github.com/pact-foundation/pact-js-core#pact-broker-publishing it should publish pacts.
My version
let publisher = require("@pact-foundation/pact-core");
let path = require("path");
if(process.env.bamboo_planRepository_branch == 'master') {
    let opts = {
        pactFilesOrDirs: [path.resolve(process.cwd(), "../../artifacts/contracts/js")],
        pactBroker: "https://pact-broker.mydomain.net",
        consumerVersion: "1.0-" + process.env.bamboo_repository_revision_number.substring(0, 8),
        tags: ['master']
    };
    publisher.publishPacts(opts);
} else {
    console.log('Pact publishing only at master branch on bamboo');
}

Actual behaviour
build	27-Dec-2022 05:13:37	><EMAIL_ADDRESS>publish:pact
build	27-Dec-2022 05:13:37	> node ./assets/js/pact/publish.js
build	27-Dec-2022 05:13:37
error	27-Dec-2022 05:13:37	/opt/bamboo/xml-data/build-dir/APPLICATIONS-UM-JOB1/components/app/assets/js/pact/publish.js:10
error	27-Dec-2022 05:13:37	    publisher.publishPacts(opts);
error	27-Dec-2022 05:13:37	              ^
error	27-Dec-2022 05:13:37
error	27-Dec-2022 05:13:37	TypeError: publisher.publishPacts is not a function
error	27-Dec-2022 05:13:37	    at Object.<anonymous> (/opt/bamboo/xml-data/build-dir/APPLICATIONS-UM-JOB1/components/app/assets/js/pact/publish.js:10:15)
error	27-Dec-2022 05:13:37	    at Module._compile (node:internal/modules/cjs/loader:1159:14)
error	27-Dec-2022 05:13:37	    at Module._extensions..js (node:internal/modules/cjs/loader:1213:10)
error	27-Dec-2022 05:13:37	    at Module.load (node:internal/modules/cjs/loader:1037:32)
error	27-Dec-2022 05:13:37	    at Module._load (node:internal/modules/cjs/loader:878:12)
error	27-Dec-2022 05:13:37	    at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:81:12)
error	27-Dec-2022 05:13:37	    at node:internal/main/run_main_module:23:47

Ah, apologies. This one is my fault.
There's a break between 13.13.2 and 13.13.3 because I removed a hack in the exports that this particular usage relies on. I'll make a PR to put it back.
For now, you could work around it with:
let publisher = require("@pact-foundation/pact-core").default;

(this will work in all versions)
I believe the recommended path for publishing is to use the CLI binstubs anyway - is there a reason you need programmatic access?
You can find examples of the CLI usage here, and if you need the documentation for the CLI, you can print the usage information with npx pact-broker once you've installed pact.
(For maintainers: I can't find the publishing pacts instructions from the pact-js documentation any more. I know it used to be there - am I just looking in the wrong place?)

Fix is up in #427

Thx Timothy for your very fast fix!!!
For me the workaround with .default is totally fine.
I am not the producer of this nice custom script. That is an old relict from another team. At some places I replaced such things by using the official pact-broker/cli image for pact publishing.
To update the example code at https://github.com/pact-foundation/pact-js-core#pact-broker-publishing could help someone else.
Best, Ingo

I am not the producer of this nice custom script. That is an old relict from another team

Ah yes. In their defence, using this function in a custom script used to be the recommended way, but that changed in some release in the last couple of years.

To update the example code at https://github.com/pact-foundation/pact-js-core#pact-broker-publishing could help someone else.

This readme is intended for users of the pact-core package - which isn't intended to be end users. However, it does look like:

the the end-user documentation for publishing pacts has been lost in some re-shuffle of documentation at some point, so this seems like currently the best source - so it's not surprising that you found it
It could be clearer that this is maintainer documentation and not user documentation

I'll leave those for the current maintainers to pick up.
Thanks again for the report!
(cc @mefellows and @YOU54F) -  Also, my apologies to all for introducing a regression in a linting PR.


Fixed pattern apply for istio and app onboard linkerd

Description
This PR fixes #73
Notes for Reviewers
Signed commits

[x] Yes, I signed my commits.

Link to successful run
ISTIO :- https://github.com/hershd23/meshery-smp-action/actions/runs/4146216056


Implement memset memcpy memmove. Fixes #293

Fixes #293

This change is

Reviewed 4 of 5 files at r1, 1 of 2 files at r2.
Review status: 5 of 6 files reviewed at latest revision, all discussions resolved, some commit checks failed.

Comments from Reviewable

Reviewed 1 of 2 files at r2.
Review status: all files reviewed at latest revision, all discussions resolved, some commit checks failed.

Comments from Reviewable


cpuTemperature(): fix main temperature when sensors prints "Package id".

Pull Request
Changes proposed:

[x] Fix
[ ] Enhancement
[ ] Remove
[ ] Update

Description (what is this PR about)
On Ubuntu 18.04 running on an i7-8700, "sensors" prints this output:
coretemp-isa-0000
Adapter: ISA adapter
Package id 0:  +49.0°C  (high = +82.0°C, crit = +100.0°C)
Core 0:        +48.0°C  (high = +82.0°C, crit = +100.0°C)
Core 1:        +48.0°C  (high = +82.0°C, crit = +100.0°C)
Core 2:        +48.0°C  (high = +82.0°C, crit = +100.0°C)
Core 3:        +49.0°C  (high = +82.0°C, crit = +100.0°C)
Core 4:        +49.0°C  (high = +82.0°C, crit = +100.0°C)
Core 5:        +49.0°C  (high = +82.0°C, crit = +100.0°C)

Note that the main line starts with "Package id" instead of "Physical id". This PR fixes retrieval of the main temperature.

Fixed! Thank you!


Type of property ignored by ExtendObjectType.IgnoreProperties is still tried to be inferred

Is there an existing issue for this?

[X] I have searched the existing issues

Describe the bug
I think the cause of the issue is the same as #1447, but it also points to an issue with the ExtendObjectType as well.
It seems like Hot Chocolate tries to infer the type of a property, even if it was ignored by a Type Extension and you can end up with an error if the type of this property can't be inferred.
So this issue is less about the Unable to create instance of type ``. I get that is talked about in the other issue and more about how the property seems to not really be ignored.
Steps to reproduce

Have a model with an interface property

public class Test
{
    public string Prop1{ get; set; }

    public ITest Prop2{ get; set; }
}

The interface has a generic method that returns the same type (I could not get it to reproduce otherwise)

public interface ITest
{
    ITest SomethingGeneric<TValue>(TValue value);

    public string Prop3{ get; set; }
}

Have a type extension that ignores the property with the interface return type (and yes I've made sure it's registered)

[ExtendObjectType(typeof(Test), IgnoreProperties = new[] { nameof(Test.Prop2) })]
public class TestExtensions
{
}

Relevant log output
No response
Additional Context?
No response
Product
Hot Chocolate
Version
12.4.0-preview.12

The issue here is the initialization process... the ignore in this case is more of a remove :)


DJV 2.0 Feature request: Add shortcut to search in "Information"

I noticed the very handy feature to search in "Information". Great idea, thanks!
To enhance usability I would suggest to have a shortcut CTRL + F when "Information" has focus. This should set focus to the search field.

Hmm, what happens when you have two search fields visible (like the layers and information windows)? Maybe Ctrl+F would cycle between the visible search fields?

Hmm, what happens when you have two search fields visible (like the layers and information windows)? Maybe Ctrl+F would cycle between the visible search fields?

I didn´t know that "Layers" has a search as well. Anyway, I would suggest only the "active" ("has focus") window reacts to "context sensitive shortcuts" like CTRL + F.


error with custom_components/sonoff

i have version 0.104.3
home assistant bug
image

image

how to fix it?

?

Check device firmware update in ewelink app

Fixed https://github.com/AlexxIT/SonoffLAN/releases/tag/v1.10.3


Custom objects with children portable text objects are rendered as plain blocks

The problem
Custom objects that contain portable text blocks, spans or other typed objects in the children property are rendered as plain blocks. The custom serializer provided in the types is not used in this case, and a regular renderer with a p tag with a subsequent traversal is used.
For example, an object like this will be affected:
interface CustomObject {
  _type: 'customObject';
  children: PortableTextBlock[];
  someCustomProperty: any;
}

You can see a reproduction in this CodeSandbox (the demo was updated): https://codesandbox.io/p/github/dbanisimov/react-portabletext-repro/draft/jovial-jerry.
Expected behavior

The custom block should be rendered using the provided serializer according to the _type property
(optional) The traversal might continue with the children property of the custom object. This is how it used to work in sanity-io/block-content-to-react library, but it might not work for someone who expects to do some custom rendering of children objects.

Possible culprit
The check on this line is using a loose assertion of the block type from @portabletext/toolkit that accepts any block-like object without checking the type. This check happens before the custom node type check, so it always takes precedence.
Possible fixes

Stricter type checking in this library, e.g.:

    if (isPortableTextBlock(node) && node._type === 'block') {
      return renderBlock(node, index, key, isInline)
    }

Stricter type checking in isPortableTextBlock from @portabletext/toolkit. This will make that check much clearer for the user, but the change might break something that depends on it.
Handle custom object types when rendering blocks. Function renderBlock can be changed to check the _type property on a node, call a custom serializer if one found and use the default children traversal.

Use case
Just to provide the context for using custom objects with children that are typed objects themselves:
We're implementing a custom 'link' block. As with normal links it can contain other formatted text spans within it. The natural solution for that was to use portable text within the link itself. We are using a node here instead of a mark, because it's easier to work with nodes than to convert markDefs back and forth. It makes it easier to integrate with other rich text editing libraries that handle links in the nodes tree.

This should fixed in 3.0.0


Release latest dependency updates

Hi, would be great if we could get a release of this lib, lots of updates have happened since 2.6.0. Thanks!

Yeah, it's been a while since the last release. Not only have the dependencies been updated, but we've even got some new features. @typelevel/log4cats thoughts?

https://github.com/typelevel/log4cats/releases/tag/v2.7.0
Artifacts should appear in Maven Central in 4-8 hours normally.


👨💻🔎🐛 [Bug Fix] (code) Fix incorrect property value setter and error message.

Target

Fix incorrect property value setter and error message.

Modify Code Scope

Source Code

module crawler

Effecting Scope

Nothing, fix minor issue.

Description

Fix incorrect properties value.
Fix incorrect error message.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

2 of 4 (50.0%)  changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.006%) to 92.683%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

smoothcrawler_cluster/crawler.py
2
4
50.0%

Totals

Change from base Build<PHONE_NUMBER>:
0.006%

Covered Lines:
1064

Relevant Lines:
1148

💛  - Coveralls


Support chained 'bind' on components

I must be doing something wrong.
Made this component:

    <input bind="@myValue" />

@functions
{
    public string myValue { get; set; }
    public Action<string> myValueChanged { get; set; }
}

And use this in a page like this:
<input bind="@Test" />

<myInput bind-myValue="@Test"></myInput>

test: @Test

@functions {

    public string Test { get; set; }
}

Now I expect that typing in either input on this page would result in the same values in both inputs. But this seems to work only one-way: from the input to the control and not the other way around.
This is supposed to work right? What am I doing wrong?
Note (from @SteveSandersonMS)
I expect fixing this will also fix #1490. Any proposed fix for this issue should also be checked to verify it accounts for the scenarios raised at #1490, and if it doesn't we'll reopen #1490 as a separate issue.

I created a fiddle that shows I believe the same issue:
https://blazorfiddle.com/s/861k07nk
If you change the value in the calendar, the value is updated in the component, but not in the parent.
If you then change the value in the textbox, the value for the calendar is changed to what was originally bound to it.
I hope this helps.

We expect to handle this as part of #6351


Error: The process '/opt/hostedtoolcache/Ruby/3.2.0/x64/bin/bundle' failed with exit code 5

Checklist

[x ] I have read the newlest tutorials and know the correct effect of the functional design.
[ x] There is no similar question on existing issues (including closed ones).
[x ] I have tried to find the answer on Jekyll Forum and StackOverflow.
[x ] My question is based on the latest code of the master branch.

Description

i'm having trouble for uploading my post.md  as follows.
pls  help!!!

It seems like there are some dependency issue that would restrict the application to have ruby version <3.2. The temporary fix would be set the ruby version to 3.1 in pages-deployment.yml. Check the following issue for more detail: https://github.com/cotes2020/jekyll-theme-chirpy/issues/811#issuecomment-1364902702
For the maintainer of the project, the following screen shot should provide more detail about the issue:

i'm trying  to limit the Ruby version to 3.1 as follows .

It worked , thank you !

I'm having the same issue and changing the version to 3.1 doesn't save me, here's my workflow
#811

If you have CODE 16 error,
1.Run bundle lock --add-platform x86_64-linux on your local copy of the repository.
2.Add the modified gemlock to your repo and commit.
I'd had same trouble but it was solved by that task.
pls, read here

Thanks for the help, I got working it with: bundle helped me to solve the issue


Added order functionality to the web app

Added an order form above the Queue.

Merged in master and openshift.


Copy datamap-ui code into the admin-ui

Is your feature request related to a specific problem?
After much discussion, we have decided to open source the datamap UI code and merge it with our admin-ui 🎉
Describe the solution you'd like
This ticket is to do the bulk of the copying including package.json dependency management. Just enough to get the app building, even if it doesn't look quite right yet.
Describe alternatives you've considered, if any
A description of any alternative solutions or features you've considered.
Additional context
This would be part 1 of a multi-step process to get the datamap UI code in here.

moving to done


avoid potentially costly write barrier

This is a micro-optimisation (not reassigning a reference to itself, avoiding GC book-keeping code) which can make quite a big difference with G1. Here are some results (contrived so that container transitions actually happen, using G1 and a 4G heap) with the check:
Benchmark                                    (randomness)  (scenario)    (size)  Mode  Cnt      Score      Error  Units
WriteSequential.incrementalUseOrderedWriter           0.1      SPARSE    100000  avgt    5    626.854 ±    5.466  us/op
WriteSequential.incrementalUseOrderedWriter           0.1      SPARSE   1000000  avgt    5   5883.839 ±   12.712  us/op
WriteSequential.incrementalUseOrderedWriter           0.1      SPARSE  10000000  avgt    5  59593.382 ± 4854.011  us/op
WriteSequential.incrementalUseOrderedWriter           0.5      SPARSE    100000  avgt    5    616.751 ±   64.337  us/op
WriteSequential.incrementalUseOrderedWriter           0.5      SPARSE   1000000  avgt    5   6641.683 ± 2814.159  us/op
WriteSequential.incrementalUseOrderedWriter           0.5      SPARSE  10000000  avgt    5  59132.392 ±  650.023  us/op

And without the check as on master:
Benchmark                                    (randomness)  (scenario)    (size)  Mode  Cnt      Score       Error  Units
WriteSequential.incrementalUseOrderedWriter           0.1      SPARSE    100000  avgt    5    666.122 ±   269.082  us/op
WriteSequential.incrementalUseOrderedWriter           0.1      SPARSE   1000000  avgt    5   6781.537 ±    46.319  us/op
WriteSequential.incrementalUseOrderedWriter           0.1      SPARSE  10000000  avgt    5  69004.184 ±  1042.140  us/op
WriteSequential.incrementalUseOrderedWriter           0.5      SPARSE    100000  avgt    5    665.427 ±    33.605  us/op
WriteSequential.incrementalUseOrderedWriter           0.5      SPARSE   1000000  avgt    5   6925.019 ±   787.832  us/op
WriteSequential.incrementalUseOrderedWriter           0.5      SPARSE  10000000  avgt    5  76849.266 ± 19290.334  us/op

Restarting the CI tests.

Strange, but ok.


Hex literals containing "c" are not evaluated correctly?

I'm not sure what is going on here. Perhaps related to https://github.com/nortakales/vs-code-qalc/issues/23?
Just writing this down for now. I'll try to take a deeper look in a day or two and maybe I can figure out what's up.

Yeah indeed that is the problem. I'm ok with a workaround of disabling the temperature shortcuts for now.
Specifically this regex appears to match things like these hex literals containing "c", in some cases.

I think I found a suitable regex replacement. It passes my current tests, and fixes hex strings. We'll see if anyone reports a different issue after the update 😅

Fixed in 0.4.1
https://github.com/nortakales/vs-code-qalc/commit/59c16cdae7f4ce8f1d7fa3826f14015943056c00


Feature: Move "open with" to main menu when right clicking recent files

What feature or improvement do you think would benefit Files?
The recent files widget has an option to "open with" but it's in the overflow menu. Moving it to the main menu would improve the user experience and consistency between the layouts.
Requirements

This proposal will display "open with" in the main menu when right clicking in the recent files widget

Files Version
v2.4.34
Windows Version
Windows 11
Comments
No response

I'll do this


Finetune bug

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

[X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

[X] 我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior
Thank you for your greate job.
My configuration is:
MODEL="openbmb/MiniCPM-Llama3-V-2_5" # or openbmb/MiniCPM-V-2
ATTENTION: specify the path to your training data, which should be a json file consisting of a list of conversations.
See the section for finetuning in README for more information.
DATA="/home/ubuntu/MiniCPM-V/finetune/haha/xidian.json"
EVAL_DATA="/home/ubuntu/MiniCPM-V/finetune/haha/xidian.json"
LLM_TYPE="llama3" # if use openbmb/MiniCPM-V-2, please set LLM_TYPE=minicpm
DISTRIBUTED_ARGS="
--nproc_per_node $GPUS_PER_NODE
--nnodes $NNODES
--node_rank $NODE_RANK
--master_addr $MASTER_ADDR
--master_port $MASTER_PORT
"
torchrun $DISTRIBUTED_ARGS finetune.py
--model_name_or_path $MODEL
--llm_type $LLM_TYPE
--data_path $DATA
--eval_data_path $EVAL_DATA
--remove_unused_columns false
--label_names "labels"
--prediction_loss_only false
--bf16 false
--bf16_full_eval false
--fp16 true
--fp16_full_eval true
--do_train
--do_eval
--tune_vision false
--tune_llm false
--use_lora true
--lora_target_modules "llm..*layers.\d+.self_attn.(q_proj|k_proj)"
--model_max_length 128
--max_slice_nums 2
--scale_resolution 128
--max_steps 10000
--eval_steps 1000
--output_dir output/output_minicpmv2_lora
--logging_dir output/output_minicpmv2_lora
--logging_strategy "steps"
--per_device_train_batch_size 1
--per_device_eval_batch_size 1
--gradient_accumulation_steps 1
--evaluation_strategy "steps"
--save_strategy "steps"
--save_steps 1000
--save_total_limit 10
--learning_rate 1e-6
--weight_decay 0.1
--adam_beta2 0.95
--warmup_ratio 0.01
--lr_scheduler_type "cosine"
--logging_steps 1
--gradient_checkpointing true
--deepspeed ds_config_zero2.json
--report_to "tensorboard" # wandb
Below is the bug log:(MiniCPM-V) ubuntu@10-60-22-207:~/MiniCPM-V/finetune$ vim finetune_lora.sh
(MiniCPM-V) ubuntu@10-60-22-207:~/MiniCPM-V/finetune$ bash finetune_lora.sh
[2024-06-06 03:47:52,725] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[WARNING]  Please specify the CUTLASS repo directory as environment variable $CUTLASS_PATH
[WARNING]  sparse_attn requires a torch version >= 1.5 and < 2.0 but detected 2.1
[WARNING]  using untested triton version (2.1.0), only 1.0.0 is known to be compatible
[2024-06-06 03:47:53,467] [INFO] [comm.py:637:init_distributed] cdb=None
[2024-06-06 03:47:53,467] [INFO] [comm.py:668:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
/home/ubuntu/miniconda3/envs/MiniCPM-V/lib/python3.10/site-packages/huggingface_hub/file_download.py:1132: FutureWarning: resume_download is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use force_download=True.
warnings.warn(
Loading checkpoint shards: 100%|██████████████████████████████████████████████████████████| 7/7 [00:03<00:00,  2.24it/s]
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Currently using LoRA for fine-tuning the MiniCPM-V model.
{'Total':<PHONE_NUMBER>, 'Trainable': 116301824}
llm_type=llama3
Loading data...
max_steps is given, it will override any value given in num_train_epochs
Using /home/ubuntu/.cache/torch_extensions/py310_cu121 as PyTorch extensions root...
Detected CUDA files, patching ldflags
Emitting ninja build file /home/ubuntu/.cache/torch_extensions/py310_cu121/fused_adam/build.ninja...
Building extension module fused_adam...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
ninja: no work to do.
Loading extension module fused_adam...
Time to load fused_adam op: 0.05588507652282715 seconds
0%|                                                                                | 0/10000 [00:00<?, ?it/s]/home/ubuntu/miniconda3/envs/MiniCPM-V/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
warnings.warn(
/home/ubuntu/miniconda3/envs/MiniCPM-V/lib/python3.10/site-packages/torch/utils/checkpoint.py:61: UserWarning: None of the inputs have requires_grad=True. Gradients will be None
warnings.warn(
Traceback (most recent call last):
File "/home/ubuntu/MiniCPM-V/finetune/finetune.py", line 333, in
train()
File "/home/ubuntu/MiniCPM-V/finetune/finetune.py", line 323, in train
trainer.train()
File "/home/ubuntu/miniconda3/envs/MiniCPM-V/lib/python3.10/site-packages/transformers/trainer.py", line 1859, in train
return inner_training_loop(
File "/home/ubuntu/miniconda3/envs/MiniCPM-V/lib/python3.10/site-packages/transformers/trainer.py", line 2203, in _inner_training_loop
tr_loss_step = self.training_step(model, inputs)
File "/home/ubuntu/MiniCPM-V/finetune/trainer.py", line 203, in training_step
loss = self.compute_loss(model, inputs)
File "/home/ubuntu/MiniCPM-V/finetune/trainer.py", line 28, in compute_loss
outputs = self.model.base_model(data = inputs, use_cache=False)
File "/home/ubuntu/miniconda3/envs/MiniCPM-V/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "/home/ubuntu/miniconda3/envs/MiniCPM-V/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1527, in call_impl
return forward_call(*args, **kwargs)
File "/home/ubuntu/miniconda3/envs/MiniCPM-V/lib/python3.10/site-packages/peft/tuners/tuners_utils.py", line 179, in forward
return self.model.forward(*args, **kwargs)
File "/home/ubuntu/.cache/huggingface/modules/transformers_modules/openbmb/MiniCPM-Llama3-V-2_5/b9f5fa87759ba195bb866de9ab50510a5fe91bad/modeling_minicpmv.py", line 164, in forward
vllm_embedding, vision_hidden_states = self.get_vllm_embedding(data)
File "/home/ubuntu/.cache/huggingface/modules/transformers_modules/openbmb/MiniCPM-Llama3-V-2_5/b9f5fa87759ba195bb866de9ab50510a5fe91bad/modeling_minicpmv.py", line 156, in get_vllm_embedding
cur_vllm_emb.scatter(0, image_indices.view(-1, 1).repeat(1, cur_vllm_emb.shape[-1]),
RuntimeError: a view of a leaf Variable that requires grad is being used in an in-place operation.
0%|                                                                                | 0/10000 [00:00<?, ?it/s]
[2024-06-06 03:48:09,728] torch.distributed.elastic.multiprocessing.api: [ERROR] failed (exitcode: 1) local_rank: 0 (pid: 3339) of binary: /home/ubuntu/miniconda3/envs/MiniCPM-V/bin/python
Traceback (most recent call last):
File "/home/ubuntu/miniconda3/envs/MiniCPM-V/bin/torchrun", line 8, in
sys.exit(main())
File "/home/ubuntu/miniconda3/envs/MiniCPM-V/lib/python3.10/site-packages/torch/distributed/elastic/multiprocessing/errors/init.py", line 346, in wrapper
return f(*args, **kwargs)
File "/home/ubuntu/miniconda3/envs/MiniCPM-V/lib/python3.10/site-packages/torch/distributed/run.py", line 806, in main
run(args)
File "/home/ubuntu/miniconda3/envs/MiniCPM-V/lib/python3.10/site-packages/torch/distributed/run.py", line 797, in run
elastic_launch(
File "/home/ubuntu/miniconda3/envs/MiniCPM-V/lib/python3.10/site-packages/torch/distributed/launcher/api.py", line 134, in call
return launch_agent(self._config, self._entrypoint, list(args))
File "/home/ubuntu/miniconda3/envs/MiniCPM-V/lib/python3.10/site-packages/torch/distributed/launcher/api.py", line 264, in launch_agent
raise ChildFailedError(
torch.distributed.elastic.multiprocessing.errors.ChildFailedError:
finetune.py FAILED
Failures:
<NO_OTHER_FAILURES>
Root Cause (first observed failure):
[0]:
time      : 2024-06-06_03:48:09
host      : 10-60-22-207
rank      : 0 (local_rank: 0)
exitcode  : 1 (pid: 3339)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
期望行为 | Expected Behavior
Hope to finetune your wonderful model on my dataset. Best regards.

I can run inference code.

hi we will update the code tto solve the problem . You can change the code by yourself
like this: https://github.com/qyc-98/MiniCPM-V/blob/main/finetune/finetune.py#L273

遇到同样问题，按照上述修改仍未解决。

Thank you for your quick reply.
I modify the code as your guidance, and met new issue：
ils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
warnings.warn(
/home/ubuntu/miniconda3/envs/MiniCPM-V/lib/python3.10/site-packages/torch/utils/checkpoint.py:61: UserWarning: None of the inputs have requires_grad=True.
Traceback (most recent call last):
File "/home/ubuntu/MiniCPM-V/finetune/finetune.py", line 334, in
train()
File "/home/ubuntu/MiniCPM-V/finetune/finetune.py", line 324, in train
trainer.train()
File "/home/ubuntu/miniconda3/envs/MiniCPM-V/lib/python3.10/site-packages/transformers/trainer.py", line 1859, in train
return inner_training_loop(
File "/home/ubuntu/miniconda3/envs/MiniCPM-V/lib/python3.10/site-packages/transformers/trainer.py", line 2203, in _inner_training_loop
tr_loss_step = self.training_step(model, inputs)
File "/home/ubuntu/MiniCPM-V/finetune/trainer.py", line 203, in training_step
loss = self.compute_loss(model, inputs)
File "/home/ubuntu/MiniCPM-V/finetune/trainer.py", line 28, in compute_loss
outputs = self.model.base_model(data = inputs, use_cache=False)
File "/home/ubuntu/miniconda3/envs/MiniCPM-V/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "/home/ubuntu/miniconda3/envs/MiniCPM-V/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1527, in call_impl
return forward_call(*args, **kwargs)
File "/home/ubuntu/miniconda3/envs/MiniCPM-V/lib/python3.10/site-packages/peft/tuners/tuners_utils.py", line 179, in forward
return self.model.forward(*args, **kwargs)
File "/home/ubuntu/.cache/huggingface/modules/transformers_modules/openbmb/MiniCPM-Llama3-V-2_5/b9f5fa87759ba195bb866de9ab50510a5fe91bad/modeling_minicpmv.py", line 164, in forward
vllm_embedding, vision_hidden_states = self.get_vllm_embedding(data)
File "/home/ubuntu/.cache/huggingface/modules/transformers_modules/openbmb/MiniCPM-Llama3-V-2_5/b9f5fa87759ba195bb866de9ab50510a5fe91bad/modeling_minicpmv.py", line 156, in get_vllm_embedding
cur_vllm_emb.scatter(0, image_indices.view(-1, 1).repeat(1, cur_vllm_emb.shape[-1]),
RuntimeError: CUDA error: device-side assert triggered
Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.
0%|                                                                                | 0/10000 [00:00<?, ?it/s]
Are there any problems in the json file below?
[
{
"id": "0",
"image": "/home/ubuntu/MiniCPM-V/finetune/haha/xidian.jpg",
"conversations": [
{
"role": "user",
"content": "\nWhat is this image showing?"
},
{
"role": "assistant",
"content": "This image shows an aerial view of Xidian University(Guangzhou Institution)."
},
{
"role": "user",
"content": "Can you describe the buildings in the image?"
},
{
"role": "assistant",
"content": "The buildings in the image are part of Xidian University(Guangzhou Institution). The central tall building is flanked by several smaller buildings, all with a modern architectural style featuring red and beige tones."
},
{
"role": "user",
"content": "What is the main building in the center?"
},
{
"role": "assistant",
"content": "The main building in the center is the tallest structure in Xidian University(Guangzhou Institution), likely serving as the administrative or main academic building."
},
{
"role": "user",
"content": "What kind of area surrounds the university?"
},
{
"role": "assistant",
"content": "Xidian University(Guangzhou Institution) is surrounded by urban development with roads, other universities like Guangzhou caijing university, and green spaces visible in the background."
},
{
"role": "user",
"content": "What is the significance of this university?"
},
{
"role": "assistant",
"content": "Xidian University is a renowned institution in China, known for its strengths in electronics and information technology."
}
]
},
{
"id": "1",
"image": "/home/ubuntu/MiniCPM-V/finetune/haha/xidiangym.jpg",
"conversations": [
{
"role": "user",
"content": "\nWhat is shown in this image?"
},
{
"role": "assistant",
"content": "This image shows a sports field at Xidian University(Guangzhou), captured at night."
},
{
"role": "user",
"content": "Can you describe the sports field in the image?"
},
{
"role": "assistant",
"content": "The sports field is well-lit and has a green artificial turf with white markings. It is surrounded by a fence."
},
{
"role": "user",
"content": "What type of sports can be played on this field?"
},
{
"role": "assistant",
"content": "This field is suitable for playing soccer and other field sports."
},
{
"role": "user",
"content": "What time of day is it in the image?"
},
{
"role": "assistant",
"content": "The image appears to be taken at night, as the field is illuminated by floodlights."
},
{
"role": "user",
"content": "What is the significance of this sports field?"
},
{
"role": "assistant",
"content": "This sports field at Xidian University (Guangzhou) provides a space for students and staff to engage in physical activities and sports, promoting health and wellness."
}
]
}
]

issue solved, thank you for your help

exchange to A100

用的最新的代码，问题还在
./aten/src/ATen/native/cuda/ScatterGatherKernel.cu:144: operator(): block: [3991,0,0], thread: [88,0,0] Assertion idx_dim >= 0 && idx_dim < index_size && "index out of bounds" failed

exchange to A100

hi @udrs you mean you fix that by change to gpu A100?

用的最新的代码，问题还在 ./aten/src/ATen/native/cuda/ScatterGatherKernel.cu:144: operator(): block: [3991,0,0], thread: [88,0,0] Assertion idx_dim >= 0 && idx_dim < index_size && "index out of bounds" failed

got same problem, even updata new code

用的最新的代码，问题还在 ./aten/src/ATen/native/cuda/ScatterGatherKernel.cu:144: operator(): block: [3991,0,0], thread: [88,0,0] Assertion idx_dim >= 0 && idx_dim < index_size && "index out of bounds" failed

got same problem, even updata new code

I also have this issue with the most updated code, is there a way to solve it?

Same problem. Did you guys figure it out?


rename the default branch to 'main' for PXC Operator

Test name
Status

upgrade-haproxy
failed

storage
failed

scaling
failed

recreate
failed

haproxy
failed

big-data
failed

self-healing
failed

restore-to-encrypted-cluster
failed

init-deploy
failed

scaling-proxysql
failed

upgrade-proxysql
failed

self-healing-advanced
failed

demand-backup
failed

security-context
failed

limits
failed

smart-update
failed

operator-self-healing
passed

pitr
passed

monitoring-2-0
passed

affinity
passed

one-pod
passed

demand-backup-encrypted-with-tls
failed

auto-tuning
passed

upgrade-consistency
passed

proxysql-sidecar-res-limits
passed

users
failed


WIP: Nompi build centos6

still working on this -- I got it to build with no mpi on a centos6...

Looking here: https://github.com/Statoil/Carolina/network - I do think your git status would be slightly easier to understand if you rebased on upstream/master

I agree - need help to achieve this without loosing my changes.
I have tried:
    git checkout nompi_build_centos6
    git fetch upstream master
    git rebase --iteractive upstream/master
The result is that I loose many of my changes....

Alin, are there more changes than 01269e28 and d6bb0a87 you want in the PR?  If not, you can simply cherry-pick those.

Hi Pal,
I am going to do add a few more commits. I just managed to import pyDAKOTA into Python on centos6.
I want to clean up what I have up to now and add these to the PR. I can add them to a new one if it works better for you.

Pal/Joakim, I think this is ready to be reviewed.
It is building on centos6 and I can load dakota with all its things into python.
I have included boost_python library into the egg and it seems that allows for skipping setting LD_LIBRARY_PATH.

I just realized that there is one more thing to be done - I have to update the LinuxBuild.cmake I am not using it.

Please squash all the commits into as few sensible commits as possible.  Perhaps only one or two is necessary.

This should be it: 6 reasonable commits.... travis is still successful

OK - some uncertainty regarding the __init__.py file. @agchitu and myself have agreed it should go - easy to reintroduce if we were wrong.


Generate SQL: Procedure CALL

Is your feature request related to a problem? Please describe.
It would be very useful to get the procedure call with all the arguments declared and part of the call.

Output of MS SQL MS:
`USE [fresh_altdb]
GO
DECLARE @RC int
DECLARE @sPartNumber nvarchar(100)
-- TODO: Set parameter values here.
EXECUTE @RC = [dbo].[uspGet_PartNumber]
@sPartNumber
GO
`
Describe alternatives you've considered
I currently use MS SQL Management Studio for generating these calls.

thanks for suggestion

This issue continues to manifest.
You have queried the requisite system views ( sys.all_parameters ) and have all that you need to expose the programmable object's parameters.
Here is the query that you are using to query the procedure's parameters:-
declare @P0 bigint

/*
    Please indicate the procedure's object id
*/

/*

   set @P0 =

*/
SELECT
          p.name as proc_name

        , pp.*

FROM   sys.all_objects p

     , sys.all_parameters pp

WHERE  p.type IN ('P','PC','X','TF','FN','IF')

AND    p.object_id = pp.object_id

AND    p.object_id = isNull(@P0, p.object_id )

ORDER BY

      pp.object_id

    , pp.parameter_id


CB-18493 add Readme section about importing mock-infrastructure cert to your trust store and why/when it is needed

See detailed description in the commit message.

Isn't it duplicated with: https://github.com/hortonworks/cloudbreak/pull/14118 ?

Isn't it duplicated with: #14118 ?
Thanks @akanto
Yes, it look like, but this  has more details and more example. Should I remove the other one?
I think we can keep both to increase the chance of findings in this topic :smile:

We can keep this. The other pull request mentions the error symptom as well, so it might be worth moving that one over here.

We can keep this. The other pull request mentions the error symptom as well, so it might be worth moving that one over here.

This also has mentioned it, but moved missing part from the #14118 here. cc: @aszegedi


ERROR: column "encrypted" does not exist

Hi Bill,
I'm experiencing below issue with new versions of report. Last one which worked fine was from Apr 19. I'm using Bacula version: 13.0.4 (12 February 2024) x86_64-pc-linux-gnu debian 12.5
Is that related to old DB schema version? What can I do to use your latest report?
/etc/bacula/scripts/baculabackupreport.py -C /etc/bacula/scripts/baculabackupreport.ini --dbname bacula --dbuser bacula --dbpass bacula
- Reading configuration overrides from config file '/etc/bacula/scripts/baculabackupreport.ini', section 'DEFAULT' (if exists), and section 'baculabackupreport'

Problem communicating with database 'bacula' while fetching filtered jobs.

Error on line number: 577
ERROR: column "encrypted" does not exist
LINE 1: ...  PriorJobId, AGE(EndTime, StartTime) AS RunTime, Encrypted ...
                                                             ^

pgcode: 42703

BTW: I appreciate your work very much!

Yeah, it seems that the encrypted column first appeared in Bacula Enterprise 16.x (currently 16.0.15), which is tracked by community version 15.x (currently 15.0.2).

Hope this helps!
Bill


gpio: add support for get_config and get_direction in the nct38xx driver

This PR adds the implementations for the API used to get current configurations of the pins in the NCT38xx IO expanders family.

@semihalf-barnas-michal - can you please rebase. I'll approve again.
@henrikbrixandersen - PTAL


This plugin does not work in github

I can use this plugin locally to create an archive folder. Why is it that I can not generate a folder when it is pushed to github?

GitHub Pages runs Jekyll in safe mode for security reasons and only allows a bunch of white-listed plugins.
Alternately you can build your site and push it to GitHub on your GitHub Pages branch, configure Travis CI to do this for you, or link your GitHub repository and host your website on Netlify for instance.


Support "package" subcommand from Helm

Background: I'm using hypper as a full Helm replacement when working with Epinio and the latest release calls helm package which makes Hypper break.
Acceptance criteria: hypper is a full Helm replacement in an Epinio context
See also: https://github.com/epinio/epinio/issues/556

Initially I thought that it would be a good idea to add a hypper package, but the more I think about it, the more I would like to not wrap all of Helm with Hypper.
Hypper has backwards compat with Helm, and I would like to rely on that: everything should be working fine calling helm package, and installing the resulting charts with either Helm or Hypper (which of course brings more functionality).
For Helm commands that gain functionality when run in Hypper, I am all in though. Maybe we could add some Hypper-specific benefit to doing hypper package, such as checking for hypper repo consistency, but that sounds like a task for hypper repo index.

We should have the package command check the shared and optional dependencies for use of file:// for the repo and either throw and error or warning


🐞 - textArea context menu paste cipboard

steps:

copy any text to the clipboard
open a TextArea, for example https://taiga-ui.dev/v3/components/textarea#base.
Right-click below the cursor in the TextArea

expected:
there is an available "paste" button
actual:
there is no available "paste" button

This will have to wait for refactored textarea in v4, current one has pretty complex DOM structure which make it hard to apply min height


Policies don't migrate

self.availableObjsToMigDict[objToMigrateID]! unwraps to nil when selectively migrating policies and causes a hard crash. Other endpoints I checked seem to work fine. I'll try to resolve it, but wanted it out there as a known issue.

It affects both policies and computer groups. The cases for those two endpoints in getEndpoints(endpoint:completion:) don't populate self.availableObjsToMigDict


ESP-IDF ESP32 WPS Example cant connect to AP (IDFGH-11207)

Answers checklist.

[X] I have read the documentation ESP-IDF Programming Guide and the issue is not addressed there.
[X] I have updated my IDF branch (master or release) to the latest version and checked that the issue is present there.
[X] I have searched the issue tracker for a similar issue and not found a similar issue.

General issue report
Im trying to run the ESP32 WPS example on my ESP_Devkitc_V4 but i never wants to connect to my AP. I tried this in Arduino at first but kept getting the ASSOC_LEAVE error followed by a 4WAY_HANDSHAKE_TIMEOUT error in a loop. Now that i tried it in the ESP-IDF the monitor keeps saying the following:
I (802) example_wps: start wps...
I (802) example_wps: WIFI_EVENT_STA_START
I (912) main_task: Returned from app_main()
I (13382) wifi:new:<6,0>, old:<1,0>, ap:<255,255>, sta:<6,0>, prof:1
I (13382) wifi:state: init -> auth (b0)
I (13382) wifi:state: auth -> assoc (0)
I (13392) wifi:state: assoc -> run (10)
I (18402) wifi:state: run -> init (0)
I (18402) wifi:new:<6,0>, old:<6,0>, ap:<255,255>, sta:<6,0>, prof:1
I (18412) example_wps: WIFI_EVENT_STA_DISCONNECTED
I (18412) example_wps: WIFI_EVENT_STA_WPS_ER_FAILED
W (18512) wifi:sta_scan: STA is connecting, scan are not allowed!
I (20822) example_wps: WIFI_EVENT_STA_DISCONNECTED
I (23232) example_wps: WIFI_EVENT_STA_DISCONNECTED
I (23232) example_wps: Failed to connect!
Does anyone have any idea how i can solve this? I tried looking online but could not find anything to solve it.

Hi @Tomvdsch, can you please enable wpa_supplicant logs and share those? Please use this config option to enable that.
Also mention your IDF version and commit ID.

I selected version 5.1.1(stable) in VSCode and if i execute the idf.py --version command i get v1.0.3

@Tomvdsch can we also have sniffer capture during the connection.

@Tomvdsch Any update regarding the comment in https://github.com/espressif/esp-idf/issues/12373#issuecomment-1761005022 ?

@Tomvdsch
Any update? BTW, what's your esp-idf version? (git describe --tags output?)

Thanks for reporting, will close due to short of feedback, feel free to reopen with more updates.
Thanks for using our Espressif product!


fatal error LNK1112: module machine type 'x86' conflicts with target machine type 'ARM'

When using VS2019 Developer Command Prompt and trying to build the BusTools with

msbuild /p:Platform=ARM /p:Configuration=Release

was getting Linker error

fatal error LNK1112: module machine type 'x86' conflicts with target machine type 'ARM'

But all projects and solution seemed to have Target set correctly for ARM.
After some time found solution was that VS2019 did not have MSVC v142 - VS 2019 C++ ARM build tools (v14.21) installed via VS installer.
Personally not C++ experience much these days, is this type of issue expected, or should there be a more clearer error message indicating the ARM build tools may not be available?
As it was not clear in either CLI or VS that the /p:Platform=ARM switch was failing and falling back to using X86

I have similar problem when going through this sample (installing python on windows IoT core) and building process gives me similar error: fatal error LNK1112: module machine type 'x86' conflicts with target machine type 'ARM'.

I have similar problem when going through this sample (installing python on windows IoT core) and building process gives me similar error: fatal error LNK1112: module machine type 'x86' conflicts with target machine type 'ARM'.


[BEAM-10566] Update PythonDocker in GH README and template

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

[ ] Choose reviewer(s) and mention them in a comment (R: @username).
[ ] Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
[ ] Update CHANGES.md with noteworthy changes.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

R: @ibzib


Reload packer package compilation on VimEnter

First of all, thanks for maintaining your dotfiles very understandable. It's helping me a lot.
So, I've noticed that Packer hasn't a hot reload or some kind of auto compilation. I've to do :PackerSync ou :PackerCompile, sometimes even remove the plugin/packer_compiled.vim file, to be able to see configs modifications. So, is it the purpose of packer.nvim?
Thanks in advance.

Hi @sinetoami, I'm glad this repo is helping you with your dotfiles!
Packer compiles everything in order to optimize startup time by lazily loading plugins. So after you change something in plugin configurations, yeah, you need to compile plugins again. It's a trade-off for faster startup times.
Note that before running PackerCompile, you have to reload your Lua module, otherwise PackerCompile will still compile the old configuration. What I do is quit Neovim, enter on in again, run PackerCompile and then re-enter to have changes applied (quit > re-enter > PackerCompile > quit > re-enter).
I know this is NOT an ideal workflow, but it's because Lua modules are cached, so you can't simply "source" them again using require, hence why I quit and re-enter Neovim one first time before compiling plugins. In the future, I intend to use plenary.nvim, which has a utility to truly reload Lua modules, so I don't have to quit Neovim to compile plugins.

Got it! I do the same steps, and add one more step (remove packer_compiled.vim) when necessary. But I can understand the purpose now. Thanks for your explanation. Helps a lot.
About to build a plugin to reload Lua modules it's quite nice! I'll wait for that.
Thanks again!


Add a GPU FPS display

Also it was added a GPU work duration display.

Is it possible to make use of the metrics framework for tracking GPU time? GPU work duration seems like a useful metric in future automated tests, which would need exported data (presumably through the metrics framework).

Yes, when used through the Application class, the metrics already track framerate, CPU frame time and frame count. It is possible to add "GPU frame time" too, but I believe it would require a bit more work to make sure the calculation is accurate, especially if there are more than 1 frame in flight, or if you are on a mobile architecture (very likely).

Maybe @mdagois can also comment on if having a way for metrics to be visualized in the UI window is useful. I feel like there's some overlap between the goals here.

If the metrics are already used (or will be in the future), then you can get the N latest FPS measurements by using MetricGauge::GetEntriesCount and MetricGauge::GetEntry. Every application using metrics gathers framerate by default. You might need to add some API to access the data from Application::mMetrics::pFramerate.
However, the metrics might be overkill if you don't actually need them all the time. In that case, I'd use Application::GetAverageFPS directly. The Application class also has a rolling average mechanics if you want a more stable number.

Ready for review.

I added a new commit to apply the feedback.

Maybe @mdagois can also comment on if having a way for metrics to be visualized in the UI window is useful. I feel like there's some overlap between the goals here.

I'd suppose having some idea about the pipeline execution duration in the UI could be useful for driver investigators (even if not completely accurate). Since once they figured a potentially interesting scenario, they create a benchmark from it to track it over time and confirm/dismiss their guess.

Yes, when used through the Application class, the metrics already track framerate, CPU frame time and frame count. It is possible to add "GPU frame time" too, but I believe it would require a bit more work to make sure the calculation is accurate, especially if there are more than 1 frame in flight, or if you are on a mobile architecture (very likely).

Would that be an issue to have the GPU time computed like that for now, and refine the computations later on when we have the need to be more accurate?

Ready for review!

Would that be an issue to have the GPU time computed like that for now, and refine the computations later on when we have the need to be more accurate?

It should be easy to get an over estimation of the GPU frame time (that's what CPU frame time is with only 1 image in flight). I definitely think the metrics should be added to the framework side, so that we can improve the computation later and every app would benefit from it automatically. The only metrics that should be on the application side are the ones that are very specific to that application, like "image quality" for a particular algorithm.

some changes regarding the code as it is today.
Now, more design-wise: @mdagois my understanding was that the metrics framework not only brings the ability to export metrics, but would also be the canonical way to compute metrics. So I'd say the GPU work duration should be a gauge and not handled like we did with some legacy metrics like frame count? (I assumed framerate/timePerFrame was still handled application just because we haven't completed the transition to the metrics framework)

That makes sense yes, but, as of today, metrics do not come for free. They consume memory over time, as the main goal is to output all the data (along with statistics computed over all that data) to a file at the end of the application execution. If the goal is just to display framerate, I am not sure it is worth using metrics in their current form.

I was wondering if we can merge this PR. Based on https://github.com/google/bigwheels/blob/main/CONTRIBUTING.md, it seems only the reviewer who approved the PR can merge the PR?

That makes sense yes, but, as of today, metrics do not come for free. They consume memory over time, as the main goal is to output all the data (along with statistics computed over all that data) to a file at the end of the application execution. If the goal is just to display framerate, I am not sure it is worth using metrics in their current form.

So far my understanding is:

those metrics are not reliable, but can be an hint. Might need some additional work in the future.
long term, we should move this to the metrics framework, but it's not ready right now for this use case.

So far I'm fine merging this as-is, it's still an improvement vs today, even if it's incomplete. And I assume this could be replaced in the future as the metrics framework becomes the main way to gather metrics.

I was wondering if we can merge this PR. Based on https://github.com/google/bigwheels/blob/main/CONTRIBUTING.md, it seems only the reviewer who approved the PR can merge the PR?

Yes, was waiting on action on https://github.com/google/bigwheels/pull/215/files#r1244290570
(Seems like you still needed to add a separator?)

Ready for review.


Payments error

I started the swamp pool, it finds the blocks, but there are no payments.
[swamp] Error sending payments, decreased rewards by too much!!!
"paymentProcessing": {
"minConf": 10,
    "enabled": true,
    "paymentMode": "prop",
    "_comment_paymentMode":"prop, pplnt",
    "paymentInterval": 600,
    "minimumPayment": 0.01,
    "maxBlocksPerPayment": 5,
    "daemon": {
        "host": "<IP_ADDRESS>",
        "port": 33335,
        "user": "login",
        "password": "pass"

Immature: 47.52178643 Bal: 0
Paid: 0
What does he not like?

I don't know much about that coin, but it looks like you needs to be set up correctly.
https://github.com/z-classic/z-nomp/blob/104dcf33f649090c2dd6acda6b4aa37ea68c8f55/libs/paymentProcessor.js#L1186


Blog : Using BLE with Node-RED

Description
No response
Epic/Story
No response
Have you provided an initial effort estimate for this issue?
I have provided an initial effort estimate

Node is not supported


Explore delaying doing * activation extensions until initial activation events are finished

Today extensions which are * activated are resolved alongside other eager activation events. Explore whether deferring discovering and activating * activated extensions until the initial eager events have settled leads to better performance (e.g. in vscode.dev/github).

Notes from initial investigation
Initial activation events that we want to see settle before handling * and workspaceContains eager events include:

onFileSystem:vscode-vfs
onFileSystem:review

Eager activation happens here:
https://github.com/microsoft/vscode/blob/891a9e53fcc11aebc17e103183b44242c42fb4c1/src/vs/workbench/api/common/extHostExtensionService.ts#L621-L636
Debugging opening microsoft/vscode using Remote Repositories on desktop, these are the activation events I see coming in before eager activation takes place:

onFileSystem:file <-- this shouldn't show up in web
onFileSystem:vscode-userdata
onView:timeline 🤔 (this is unexpected because it fires even when the timeline view is collapsed)
onFileSystem:vscode-vfs
onLanguage:Log 🤔 (this is unexpected because there are no open editors at this point, is this extension output channels-related perhaps?)

After eager extension activation events are activated but before the explorer has resolved, I also see:

onSearch:vscode-vfs via here 🤔 (this is unexpected because the search viewlet is not focused at this point)

(Note, when viewing a PR, the actual onFileSystem:review event doesn't fire till after Remote Repositories has activated, figured out that we're looking at a PR based on the workspaceFolder URI, and activated the GHPRI extension via executing github.api.preloadPullRequest. If we wanted onFileSystem:review to be an 'initial' activation event we would likely need a faster path for firing onFileSystem:review.)


Query about requirement ^1.74.0

Hello, and thank you for the wonderful package!
I observed that it specifies vscode ^1.74.0 as a requirement. Could you clarify if this is a strict necessity? My workplace's environment is currently on 1.71.0, and upgrading isn't an option at the moment.
Is there a specific reason it might not function with earlier versions, or was 1.74.0 simply the version used during development? Thanks for your help!

I noticed that this alternative extension works well for me, although it might not support as many languages as you did.
Thus no more help needed here. Thank you!
https://marketplace.visualstudio.com/items?itemName=ruschaaf.extended-embedded-languages


Enabling Motion Controller Model in MRTK3 with Quest freezes app

Describe the bug
Whenever I enable "Motion Controller Model" in trhe OpenXR Features group the MR app freezes when I start it  on a Quest 2.
To reproduce
Steps to reproduce the behavior:

Setup MRTK3 project (can be any project, you can use the MRTKDevTemplate examples for this), with OpenXR
Import Oculus Interaction Toolkit and enable its OpenXR component. (Note that if I disable the OpenXR component behaviour is still the same)
In OpenXR feature groups enable following

Hand Tracking
Oculus Quest Support

Us the default MRTK3 profile with the following sub-systems enabled

Accessibility
Hands Aggregator
OpenXR Hands API
Hand Synthesis

Import KTX (2.2.3) and glTFast (5.0.0) as per the validation requirements (I understand this is required to be able to import the controller models from Oculus Interaction Toolkit).
When I Build and run the APK on a Quest 2 this way everything works fine.
When I enable the Motion Controller Model under the OpenXR Feature Group, and build and run the APK on a Quest 2 the App freezes right after startup, it shows 2 beams that should shoot out of the controllers and freezes.
Expected behavior
The 3D Model fo the Quest 2 controllers should load and bne shown in the app and the app should not freeze.

Your setup (please complete the following information)

Unity Version - 2021.3.16f1
MRTK Version 3 pre12
Windows 10

Target platform (please complete the following information)

Oculus Quest 2
OpenXR

Additional context
Add any other context about the problem here.

Are there any specific logs are you able to pull from the crash itself? In your configuration, you noted that in the OpenXR feature groups, you enabled

Oculus Quest Support

This feature is not one that's included in our one that comes from the Mixed Reality Open XR plugin, and I suspect it's coming from the Oculus Interaction Toolkit. What might be happening is that these 2 features (Oculus Quest Support, Motion Controller Model) are coming into conflict, but I would need more information and access to the code that each is using to get a better idea.
@keveleigh  since these are OpenXR features.

@mmoerman

Import KTX (2.2.3) and glTFast (5.0.0)

Can you give an older version of glTFast a try please? We've been testing on 4.7.0. I wonder if there are any breaking changes in the 5.0.0 release that cause us problems.

I had a same problem with controller visualization.
After downgrade glTFast & KTX, it fixed.
It seems have problems with recent version.
Thanks

@mmoerman

Import KTX (2.2.3) and glTFast (5.0.0)

Can you give an older version of glTFast a try please? We've been testing on 4.7.0 (and KTX 2.1.2). I wonder if there are any breaking changes in the 5.0.0 release that cause us problems.

Downgrading to these versions of KTX and glTFast worked, thank you for your help.


QF-1552: implement function to get number of active users

Note: this does NOT contain actual monthly bills (which we need to store in the DB, as the number of active of a past month can change if a user is removed from an organization)

Task linked: QF-1552 Implement function to get the number of active users of organization per period of time


Update telemetry removal documentation

Added KBs of all updates currently removed, both from 7/8/8.1 and 10.
Win 7/8/8.1: 971033, 2902907, 2922324, 2952664, 2976978, 2977759, 2990214, 3015249, 3021917, 3022345, 3035583, 3044374, 3068708, 3075249, 3080149, 3083710, 3083711, 3112336, 3123862
Win 10: 2902907, 2922324, 2952664, 2976978, 2977759, 2990214, 3012973, 3014460, 3015249, 3021917, 3022345, 3035583, 3044374, 3050265, 3050267, 3065987, 3068708, 3075249, 3075851, 3075853, 3080149

Closing due to conflicts; please re-open with the conflicts resolved if it's still an issue. Thanks


Instructor Selection: confirm or decline signups

As an admin user, I want to be able to confirm or decline signups from either event signup listing, or from all events signup listing.
Acceptance criteria:

Clicking "Confirm" adds a task for instructor (or supporting instructor) for this user and this event - this should trigger email automation mechanism (EDIT: "confirm instructor for the workshop", but not "introduce Host with Instructors")
Clicking "Confirm" changes signup status to "confirmed"
Clicking "Decline" sends an email "Thank you for your interest… we have placed other Instructors… please continue to …." (EDIT: moved to #2066)
Clicking "Decline" changes signup status to "declined"
Once confirmed or declined, signup entry may not be edited by the user.

UPDATE 2021-10-18: updated according to @maneesha comment down below.

If we confirm an instructor and then have to decline, that would happen through personal communication and would not be part of this system.


Emphasise keywords and rephrase awkward sentences in UG up to Bill command

Codecov Report
Base: 75.03% // Head: 75.03% // No change to project coverage :thumbsup:

Coverage data is based on head (dca624c) compared to base (84a1163).
Patch has no changes to coverable lines.

Additional details and impacted files
@@            Coverage Diff            @@
##             master     #187   +/-   ##
=========================================
  Coverage     75.03%   75.03%
  Complexity      529      529
=========================================
  Files            77       77
  Lines          1554     1554
  Branches        179      179
=========================================
  Hits           1166     1166
  Misses          343      343
  Partials         45       45

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Abapdoc rule bugfix - multiple html tags

got rid of false positives on multiple html tags

published as 2.98.0


DOC: add versionadded to new disjoint_subset_union docstring

Forgot about this in https://github.com/shapely/shapely/pull/1982/

Pull Request Test Coverage Report for Build<PHONE_NUMBER>2
Details

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.3%) to 88.106%

Totals

Change from base Build<PHONE_NUMBER>0:
0.3%

Covered Lines:
2637

Relevant Lines:
2993

💛  - Coveralls


KAFKA-5357 follow-up: Yammer metrics, not Kafka Metrics

As discussed with @ijuma offline, currently we want to still enforce Yammer metrics on the broker side except 1) selector used in socket server / controller / tc, and 2) quota which is related to clients.
ping @dguy @junrao @ijuma @hachikuji @apurvam for reviews.

Also addressed @apurvam 's comment on the previous PR.

@ijuma Addressed your comments.

@guozhangwang Thanks for the updates. I left a comment with regards to the name. Also, can you please add a simple test?

@ijuma thanks. Will add a test case under TransactionMarkerChannelManagerTest and then merge as is.

Merged to trunk and 0.11.0.


check for valid DeepImageState in DeepImageStateAttribute::readValueFrom()

Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=23996
Signed-off-by: Cary Phillips<EMAIL_ADDRESS>

On second thought, @peterhillman points out that if the enum is someday extended, new files with newly legal values would not be readable by old versions of the library, so not a good solution.


Creating boxes

Acceptance criteria:
Given that the user is identified
Ensure that new boxes can be created and assigned a name/description.

Its not finished yet, because we can't choose the name and description yet.

Whoops, I forgot that it would get closed automatically with the PR.

As a progress update, the serverside portion for this has been ready for awhile, but the clientside portion is still not done.


macOS: python38 beta build failed

Describe the bug
warning: there are multiple derivations named 'python3-3.8.0b2'; using the first one
installing 'python3-3.8.0b2'
these derivations will be built:
  /nix/store/s5axjrkbrq91fac6gg3y6g917v1579d9-python3-3.8.0b2.drv
building '/nix/store/s5axjrkbrq91fac6gg3y6g917v1579d9-python3-3.8.0b2.drv'...
unpacking sources
unpacking source archive /nix/store/q3n3agifb1n9yrz0hrqa3ngw594g1rgs-Python-3.8.0b2.tar.xz
source root is Python-3.8.0b2
setting SOURCE_DATE_EPOCH to timestamp<PHONE_NUMBER> of file Python-3.8.0b2/Misc/NEWS
patching sources
applying patch /nix/store/gd8ycd6j3qhcq1qccaqz68zdq5l4c2wf-no-ldconfig.patch
patching file Lib/ctypes/util.py
applying patch /nix/store/9kwzs3pplms8sijf55sdryypzvic4x1s-python-3.x-distutils-C++.patch
patching file Lib/_osx_support.py
patching file Lib/distutils/cygwinccompiler.py
patching file Lib/distutils/sysconfig.py
Hunk #1 FAILED at 170.
Hunk #2 FAILED at 187.
Hunk #3 succeeded at 225 (offset 17 lines).
2 out of 3 hunks FAILED -- saving rejects to file Lib/distutils/sysconfig.py.rej
patching file Lib/distutils/unixccompiler.py
Hunk #3 FAILED at 183.
1 out of 3 hunks FAILED -- saving rejects to file Lib/distutils/unixccompiler.py.rej
patching file Makefile.pre.in
Hunk #1 succeeded at 601 (offset 17 lines).
builder for '/nix/store/s5axjrkbrq91fac6gg3y6g917v1579d9-python3-3.8.0b2.drv' failed with exit code 1
error: build of '/nix/store/s5axjrkbrq91fac6gg3y6g917v1579d9-python3-3.8.0b2.drv' failed

To Reproduce
Steps to reproduce the behavior:

$ nix-env -i python3
...
...

Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Additional context
Add any other context about the problem here.
Metadata
$ nix run nixpkgs.nix-info -c nix-info -m
[2 copied (0.0 MiB), 0.0 MiB DL]
 - system: `"x86_64-darwin"`
 - host os: `Darwin 18.7.0, macOS 10.14.6`
 - multi-user?: `no`
 - sandbox: `no`
 - version: `nix-env (Nix) 2.2.2`
 - channels(libre): `"nixpkgs-19.09pre186574.88d9f776091"`
 - nixpkgs: `/Users/libre/.nix-defexpr/channels/nixpkgs`

Maintainer information:
# a list of nixpkgs attributes affected by the problem
attribute:
# a list of nixos modules affected by the problem
module:

Please use the attribute name (-A) when using nix-env, so nix-env -iA python3. This attribute corresponds to Python 3.7 and that one should build this fine. Now, you got instead the Python 3.8 beta build. While it ideally would build on OSX it does not currently.

@FRidh
libres-MacBook:~ libre$ nix-env -iA python3
error: attribute 'python3' in selection path 'python3' not found

If you use a channel it is something like nix-env -iA nixpkgs.python3 or nix-env -iA nixos.python3.

addressed by https://github.com/NixOS/nixpkgs/pull/71165


[Flink AI Flow] Events send order is not same as task completion order

Consider the following scenario:
the DAG looks like [op1, op2 -> op3], with event-based scheduler，op1 completed before op2, but the TaskStatusChanged event of op2 is sent to scheduler before op1.
when EventBasedScheduler#_find_schedulable_tasks receives a TaskStatusChanged event, it will check the task status of op1 and op2. So it would find op1 and op2 are SUCCEESS at each time it receives TaskStatusChanged event, and op3 would be triggered twice.

AIFlow has been moved to https://github.com/flink-extended/ai-flow.

AIFlow has been moved to https://github.com/flink-extended/ai-flow.
Please reopen the issue there if necessary.


Looking for new maintainer for spotify_player AUR package

I'm the maintainer of the AUR spotify_player package. However, I'm no longer have access to an Arch machine. I'm looking for a new maintainer for this package.
Anyone if interested, please reply to this issue.

Sure, it's alosarjos, the same as here :)

Sure, it's alosarjos, the same as here :)

Thanks, added. Can you try update the AUR package?

The AUR package is now updated to 0.7.0.
I also added a .gitignore file to make things easier.

Thank you 🙇 .

Also we may look into providing a precompiled binary created through Github actions (Both on AUR and the Github releases page)

That's definitely one thing I plan to add but always forget to do 😆