Can this be used for parameter identification?

I have observed displacement data and I want to recover the elasticity of the material by optimizing the elasticity parameter field through the forward model. Can this package compute sensitivity with respect to the material parameters for optimization?

Hi Matt,
Absolutely. We already used this package to optimize fiber orientation fields by minimizing the error between simulation and observed displacement fields [1].
Is your material model simply linear isotropic elasticity and you want to find E and nu in each element?
Nils
[1] https://opus.bibliothek.uni-augsburg.de/opus4/files/114634/114634.pdf

Thanks for the reply and reference. Yes, we are assuming isotropic linear elasticity and want to recover spatially inhomogeneous E. We are using a DL model to estimate a map of E and drive the simulation, so we need to solve the FEM model many times during training, with automatic differentiation, and preferably with GPU acceleration.

Okay, you may try something along these lines:
from tqdm import tqdm

# Initial stiffness guess
E0 = 1.0
# Let's assume that Poisson ratio is constant
nu = 0.3

# Set up intial model
C0 = Isotropic(E=E0, nu=0.3).C()
model = import_mesh("<your_mesh>", C=C0)

def compute_loss(E):
    lbd = E * nu / ((1.0 + nu) * (1.0 - 2.0 * nu))
    mu = E / (2.0 * (1.0 + nu))
    z = torch.zeros_like(lbd)
    model.C = torch.stack(
        [
            torch.stack([lbd + 2.0 * mu, lbd, lbd, z, z, z], dim=-1),
            torch.stack([lbd, lbd + 2.0 * mu, lbd, z, z, z], dim=-1),
            torch.stack([lbd, lbd, lbd + 2.0 * mu, z, z, z], dim=-1),
            torch.stack([z, z, z, mu, z, z], dim=-1),
            torch.stack([z, z, z, z, mu, z], dim=-1),
            torch.stack([z, z, z, z, z, mu], dim=-1),
        ],
        dim=-1,
    )
    u, _ = model.solve()
    return ((u-u_target)**2).sum()

# Optimize
E = E0 * torch.ones(len(model.elements))
E.requires_grad = True
optimizer = torch.optim.Adam([E], lr=0.1)

for _ in tqdm(range(100)):
    optimizer.zero_grad()
    objective = compute_loss(E)
    objective.backward()
    optimizer.step()

If you interpolate your E from a neural network written in pytorch, you should be able to seamlessly backpropagate the error through torchfem and the network. I did not experiment too much with GPU acceleration, but it should work in principle, too.

Thank you, this is great. Slightly offtopic question, but is there a way to evaluate the FEM displacement field at arbitrary points, for instance if I wanted to render it like an image?

There is no built-in function for that yet. However, it should be a straightforward task:

Determine the element, in which the query point is located (e.g. by finding the closest element center).
Use that elements shape functions to evaluate the displacement at the query point.


exp/ingest: Database state reader

PR Checklist
PR Structure

[x] This PR has reasonably narrow scope (if not, break it down into smaller PRs).
[x] This PR avoids mixing refactoring changes with feature changes (split into two PRs
otherwise).
[x] This PR's title starts with name of package that is most changed in the PR, ex.
services/friendbot

Thoroughness

[x] This PR adds tests for the most critical parts of the new functionality or fixes.
[x] I've updated any docs (developer docs, .md
files, etc... affected by this change). Take a look in the docs folder for a given service,
like this one.

Release planning

[x] I've updated the relevant CHANGELOG (here for Horizon) if
needed with deprecations, added features, breaking changes, and DB schema changes.
[x] I've decided if this PR requires a new major/minor version according to
semver, or if it's mainly a patch change. The PR is targeted at the next
release branch if it's not a patch change.

Summary
This PR adds a new StateReaderTempStore implementations (MemoryStateReaderTempStore and PostgresStateReaderTempStore) for holding temporary objects during processing of history buckets.
Close #1457
Goal and scope
The existing in-memory method for storing temporary object (keys seen in previous buckets) when processing history buckets is fast but requires ~4GB of RAM to process public network state. This requirement makes it impossible to ingest the state on machines with less memory.
To solve this we add an alternative PostgresStateReaderTempStore that dumps the keys to a temporary Postgres table when number of keys in memory exceed the limit. It still operates on in-memory cache but the requirements for it are much smaller than in MemoryStateReaderTempStore. The objects are loaded and saved in batches what reduces round trip time in DB connection. To achieve this, BucketEntryies read from history buckets are buffered (instead of reading one by one) and the keys are preloaded from a store. Additionally, to save memory MarshalBinaryCompress method has been implemented on some types in xdr package to make the marshalled LedgerKey smaller. The compression exploits the fact that XDR encoding inserts 0 bytes for padding which are not needed in this use case.
This PR also includes some refactoring, ex. MemoryStateReader was renamed to SingleLedgerStateReader which better explains it.
Finally, some helper scripts that compare results produced by new code with the state in stellar-core instance have been added.
Summary of changes

PostgresStateReaderTempStore that stores temporary objects in Postgres temporary table.
Scripts to comparing state processed by SingleLedgerStateReader using different stores to a state in stellar-core database.
Refactoring (MemoryStateReader was renamed to SingleLedgerStateReader).

Known limitations & issues

Tests that compare state to a stellar-core database are manual. In a future we should create another script that runs stellar-core to catchup to a given checkpoint and then compare results.

@bartekn would it make sense to use a bloom filter to store all the observed keys?

@bartekn would it make sense to use a bloom filter to store all the observed keys?

Unless you are thinking about a special kind of a bloom filter I think it's not a good use case. Wiki says:

False positive matches are possible, but false negatives are not – in other words, a query returns either "possibly in set" or "definitely not in set".

False positive can be really bad in our case as it would send a ledger entry twice or send it when it's actually a dead entry.


exactly_one_of is not functioning as expected and says missing

Definition:
params do
   optional :folder, type: String, default: nil
   optional :tag, type: Array, default: nil
   exactly_one_of :folder, :tag
end

header:
Content-Type: application/json;

request body:
{
	"tag": [1,2,3]
}

or
{
	"folder": "/hello"
}

got:
{
	"error": "folder, tag are mutually exclusive"
}

Does removing default: nil for both params change the behavior?

Definitely, did! Also, error message now shows the correct message. (not for mutually)
Instead of default value, I set allow_blank and/or regexp for better data integrity.

Still a bug, right?

Yes. Default value can be useful. Exactly one of means one of them will be empty or have a default value I gave.

Would appreciate a pull request even if it's just failing specs.

Before I send a PR, lets make sure my steps are correct.
After I review the code, I found that, In fact :default should be dropped. In exactly_one_of we should not use default. Because, if we do that then we cannot know which parameter given by user or by default. Due to this grape simply tell us that they are mutually exclusive, in other mean it is limited.
So, I no longer thinks this is a bug. This is an expected behavior.
I think clearly stating this on documentation will be enough.

Aha. If both values have a default it already violates exactly_one_of, but maybe if one of them has a default and you don't pass anything, then it should work?

Yes. To be clear;
Definition:
params do
   optional :folder, type: String, default: nil
   optional :tag, type: Array, default: nil
   exactly_one_of :folder, :tag
end

Request:
{
	"folder": "/hello"
}

It will fail. Why? Because I only give :folder but I also give default: nil for :tag in definition too. :tag should NOT exists in params as a key. It should not have a value like nil or empty string. It should not exists in the first place.
I believe current behavior is the more efficient and correct behavior. We just need to tell that "do not assign even nil values" to any exactly_one_of definitions.
At first I thought giving a default value should be okay. But we should not. Exactly one parameter should be exists in params bag. So we can check which key is exists not by nil or emptyness.
To prevent empty and nil values, we should use proc or regexp.

Correct. A default of nil is still a default. Maybe rewrite the title of this issue to say something like the above scenario should not even load?

This has been clarified by adding a note. #1720.

I think https://github.com/ruby-grape/grape/blob/master/UPGRADING.md#nil-values-for-structures is causing new problems here.
params do
   optional :folder, type: Array[String], default: []
   optional :tag, type: Array[String], default: []
   mutually_exclusive :folder, :tag
end

This will error even if neither param is provided.

If neither param is provided then both get the default value and those are mutually exclusive, which errors by design. LGTM.

The problem for me is this is a regression - it wasn't an issue before https://github.com/ruby-grape/grape/blob/master/UPGRADING.md#nil-values-for-structures, because we didn't need to provide a default. Which meant the mutually_exclusive validation would only error if both props were actually provided.
Now, requests that previously wouldn't fail will now fail. The alternative is to not use default: [] but then you get this regression instead:
  # 1.3.1 = []
  # 1.3.2 = nil

I understand this is not the way it behaved before, but I would say that this was a bug, fixed since. If you have a mutually exclusive set of values that are both set when none are provided by the caller they are no longer mutually exclusive, which violates the principle of least surprise.
I think the workaround is relatively straightforward:
params do
   optional :folder, type: Array[String]
   optional :tag, type: Array[String]
   mutually_exclusive :folder, :tag
end
get do
  folder_or_tag = params[:folder] || params[:tag] || []
  ...
end

Thoughts?

Now that we have more attention on this issue, I think we should close this. IMHO it behaves as intended.

Okay. I’m happy with that.
On Tuesday, May 26, 2020, Daniel Doubrovkine (dB.) @dblockdotorg <
<EMAIL_ADDRESS>wrote:

Now that we have more attention on this issue, I think we should close
this. IMHO it behaves as intended.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/ruby-grape/grape/issues/1717#issuecomment-634370708,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAD4PDJ5BG2WPT3UL3XI5UDRTRUURANCNFSM4EINFIKA
.


[enhancement]: Pasting an initial image from clipboard

Is there an existing issue for this?

[X] I have searched the existing issues

Contact Details
No response
What should this feature add?
It would increase my workflow immensely to be able to simply paste an image from the clipboard while on the Image to Image tab. (And eventually with inpainting, etc.)
This would make it easier to do quick one-off edits on images from the web without having to save to a temporary file.
I would be willing to volunteer to work on this feature if nobody else is interested. :sunglasses:
Alternatives
The current alternative is to save the image to a temporary file and load from the filesystem.
Aditional Content
No response

Implemented in #1225

I just might cry. Thank you. :smiling_face_with_tear: :beers:


[ODB] get negative size value from a aspx file

Category

[ ] Question
[ ] Documentation issue
[x] Bug

Hi all,
Symptom:

Get file information encounter size is negative
GET https://<user_domain>/_api/v2.0/drives/<drive_id>/items/<item_id>

This drive is Wikipage library which is one of the document library in Share Point Online

Download is fine for this file.

Response:
"name": "Home.aspx",
"file": {
        "hashes": {
            "quickXorHash": "YrWKTN7tmyGNyRicTMvDQltNmk0="
        },
        "irmEnabled": false,
        "mimeType": "application/xml"
    },
    ....
   "size": -425661

Header:
request-id →da46d69e-00c6-8000-12b2-435e588b9d2a
date →Thu, 25 Apr 2019 02:09:01 GMT

Thank you for further help.

Hi, thanks for reporting this issue.  We'll need to investigate further.
Do you observe this with any other ASPX pages or other files or just this particular one?

Hi @JeremyKelley ,
I encountered this issue before.
https://github.com/OneDrive/onedrive-api-docs/issues/926
and the previous one is about onenote files
"name" : "Open Notebook.onetoc2",
"size" : -4783,

I do not observe any ASPX file with the issue, it is the first.
In other document library this ASPX file could be downloaded properly.
Thanks

Thanks for your feedback; we're following up internally about this issue.

As part of a repository clean up effort we are closing older issues. If this issue remains, please: open a new issue, reference this issue, and provide any additional details that may help in resolution. Thank you for your understanding as we work to improve our responsiveness.


Fix x86 single-pop not emulating

Single pops, without a proceeding instruction do not emulate
Addressable registers (ah,al) should not be displayed

New cyclic size multiple was being multiplied by 0 if alignment was 1


A few things i am having trouble with.

so being 13, i don't get everything about this project. like, how to charge the battery. the battery comes with a charger, but to connect it directly to the servo control board means i have to snip off the connector thing. and then i cant charge it. do i have to buy a connector to mount on to the board? another one is, how do you control it via laptop or other device? i saw in the video that you were using a laptop to control Spot Micro, and i was wondering, was that just a bluetooth connection? or was it another linux device? Thanks a bunch!

Hi,
Thanks for the interest in my project!
I am using a lithium polymer battery (also called a lipo battery), which can be charged by a lipo battery charger. I use a charger similar to the B6 V2 Balance charger (just google it and you will find many similar ones, they are all basically the same).
The battery has a XT30 female connector which I use to both charge it and to plug it into my robot. Lipo batteries have a lot of different connectors these days, but the most popular ones currently are XT30/60/90 (the number refers to the max current it supports), deans connectors, and EC3 connectors. My wiring is a little complicated because I have some switches in line so I can power the robot off or on, but basically there are two wires going to the servo control board which I soldered a male XT30 connector to. The wires also go to a 5V UBEC, which steps down the battery voltage to a 5V output, which I use to power the electronics, such as a the raspberry pi. That's done through another small board I soldered with standard pin headers so I could use bread board wires.
Basically, a project like this will require a decent amount of soldering, some basic solderable bread boards, wires, and connectors.
The robot is controlled by my laptop keyboard. The laptop is running linux which is running a ROS python program which takes in keyboard button presses and converts them to speed or orientation commands. Both my laptop and the raspberry pi on the robot are connected my home router's wireless network. The commands are transmitted across the network, so no bluetooth is used. The data itself is transmitted via multicast UDP packets I believe.
Let me know if you have more questions!!!

ok thank you for your previous answers. i am awaiting parts that i can test on the 11th. so another question i had was can i use PuTTY to establish an ssh connection, and run multiple sessions? or can i use remmina and run the wireless screen? how exactly do i do that? and also, im wondering how i can merge a few nodes. because, is there a standing node? if so, in that node, can it rotate on its joints on place? and if it can, i want to run 2 different nodes, using a camera and face detection on one, and the standing node on the other and have it follow a face. is it possible to run those nodes separately, or do i have to merge the code? thanks a bunch!

oh and by the way, ive really wanted a unitree a1, so when i saw this, i remembered i had a raspberry pi. so i invested every penny i had into it. thanks for giving me something to work on!

and also, does your robot use a gyroscope or accelerometer?

You can use PuTTY to establish a ssh connection to the RPi. Make sure your RPi is connected to the same network, and then first start out pinging the rpi's ip address to make sure your computer can see it.
I haven't used putty that much, so I'm not sure if you can run multiple instances to have multiple ssh sessions. But as an alternative, you could install tmux onto the pi (a terminal multiplexer), and then from one ssh session you could effectively have multiple terminal windows. You'll need to look up the keyboard commands for using tmux, however, like for splitting panes and navigating windows. I would generally not recommend remina as it will probably be pretty slow, I would first connect the pi to a monitor and keyboard via a hdmi cable.
If you were to make a camera tracking node to send commands to the robot, you would not have to merge the code, the nodes could remain separate. Basically, a camera face tracking node could send commands to the spot_micro_motion_command node to stand the robot up, enter angle command mode, and then command the robot angle. The documentation I've written unfortunately isn't very detailed about the exact interface the commands go through, but if you look through the python node, spot_micro_keyboard_command, you should be able to see how the robot is commanded through its states.
In order to run ROS on the raspberry pi's own linux distro (raspbian), you would have to compile the ROS kinetic source code from source on the raspberri pi itself. Unfortunately that is a pretty complicated and tedious process and I really wouldn't recommend it. I tried doing it myself but quit because it was taking too long to figure out when an existing OS image was available with ROS prebuilt and ready to go.
If you look at the readme's "Control Instructions" section, there is at least some basic information of the steps of commands to get the robot to stand and transition through the state machine.
My spot does not currently have a gyroscope or accelerometer, but I'd like to incorporate one some time in the future.

BTW, I would recommend going through some of the ROS tutorials to get a handle on working with ROS nodes:
http://wiki.ros.org/ROS/Tutorials

ok this should be some of my final sets of questions. so when i type "rosrun i2cpwm_board i2cpwm_board" it spits out [rospack] Error: package '12cpwm_board' not found. and this command has to be run before all of the others right? so if i cant run that, i cant run anything. so pls explain that to me.

and i downloaded ubuntu on the pi and is working excellent otherwise

and one more, when i try to download the repository recursively, it wont let me. it will say "Permission denied (publickey). fatal: Could not read from remote repository" how should i bypass this?

ok i have figured out how to do all of the remote repository stuff, so now i am having trouble with the rospkg package. the computer says it cant find it, i know it is there. please help me

To address possible things to look into about your question about the i2cpwm_board not running, this sounds like your ROS workspace is not set up correctly. Do you have ROS installed on the raspberry pi? Have you sourced the setup.bash file to setup your catkin workspace? My catkin workspace is located in my home directory, so the way I set it up is by running the following at a terminal (this command will not output anything).
source /home/mike/catkin_ws/devel/setup.bash
This needs to be done for each terminal before you try running any local ROS packages. It is possible to automate this.
Note that the i2cpwm_board node will not run successfully if an actual PCA9685 board is not powered and connected to the raspberry pi (however it should still get past your error before then).
As for your second question, it sounds like you figured it out, but if not, you may have not setup a ssh key for your raspberry pi maybe? You can follow this guide to do so: https://docs.github.com/en/enterprise/2.15/user/articles/adding-a-new-ssh-key-to-your-github-account.


Unable to Get Store Front Rest Api list.

I am trying to get store front access token list by using admin api provided by shopify. But its not allowing me to retrieve those.
I am using this article https://shopify.dev/docs/admin-api/rest/reference/access/storefrontaccesstoken?api[version]=2020-07#index-2020-07
Api to get
/admin/api/2020-07/storefront_access_tokens.json
I am trying by this way https://prnt.sc/td6tpt
Expected Behavior
i want response to be like this https://prnt.sc/td6uqt

Please use template and reopen. As well, include the current response from your code.


Moved: Kingsoft.KDocs version 2.2.0

[x] Have you signed the Contributor License Agreement?
[x] Have you checked that there aren't other open pull requests for the same manifest update/change?

[x] Does your manifest conform to the 1.0 schema?

Note: <path> is the name of the directory containing the manifest you're submitting.

https://github.com/microsoft/winget-pkgs/pull/26122
Microsoft Reviewers: Open in CodeFlow

/azp run


[deps][question] The reason of outdated packages

Hi there!
Is there any reason to keep some of your deps outdated?
For example, you have
{
  "debug": "^2.6.9",
  "doctrine": "1.5.0",
  "read-pkg-up": "^2.0.0"
}

However, in my project, those packages are higher for most of the packages
{
  "debug": "^4.1.1",
  "doctrine": "^3.0.0",
  "read-pkg-up": "^7.0.1"
}

Because of it, such outdated deps are loaded inside of the package itself into <package>/node_modules/

I prefer to avoid it, but it's possible only if you update your deps.
Are those deps kept outdated because of some reason or just because of a lack of time to update it?

A few thoughts:

there is never anything inherently wrong with having a dep that's "not the latest major", code that works will likely work forever.
read-pkg-up aggressively drops support for older node versions, so we can't use a newer major; I'd prefer to see that dep removed before it's ever updated.
doctrine is unmaintained, so unless there's a concrete benefit of v2 or v3 over v1, there's no reason to update it
debug has the same problem as read-pkg-up: v4 doesn't support node < 6, and iirc v3 doesn't support node < 4, so we can't upgrade to it.

@ljharb, thanks for the explanation!
As I see here, https://endoflife.date/nodejs Node v12 is the oldest LTS with active support.
Is there any reason to support the older node versions?
As I see, eslint itself actively drops support for old versions https://github.com/eslint/eslint/releases/tag/v7.0.0
Here https://github.com/TrySound/postcss-inline-svg/pull/68 is also a PR for dropping not supported node version, but it looks like that repo isn't actively maintained.
Maybe it's better to sync up the latest node support version with eslint itself, releasing drops for support with major releases?
I'm just curious about the reasons.

Yes - for one, platform support is irrelevant. People use older nodes, and thus they should be supported. Additionally, we’d have to have a semver-major to drop them, and doing that just to drop support for something is highly user-hostile.
We still support eslint 2 - 7, and thus we support all the node versions those eslint versions do, and plan to continue doing so for as close to forever as is possible, so as to support the maximum amount of humans (something that’s far more important than theoretical or actual maintenance burden)

@ljharb It appears that the<EMAIL_ADDRESS>package is using a vulnerable dependency.

https://nvd.nist.gov/vuln/detail/CVE-2021-23362
Any chance this vulnerability would justify the version upgrade?


Improve "all bookmarks" button

By default, bookmarks in a digest are not displayed. User can use the "All bookmark button" to display them:

However, this button isn't very clear; we should use a switch button instead with the label "View all bookmarks".
There is another issue :

when an user clicks on the button, the page query should be removed to avoid weird state pagination

[ ] Use switch and change wording for all bookmarks button
[ ] Reset page number on switch

[ ] Fix DarkMode


Validation: description-missing fixes.

Fixes description-missing validation errors by adding missing descriptions.

Docs Build status updates of commit 8b7bb4f:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

Skype/WebSDK/docs/PTLocalUserStatus.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/PTMeetingsAnonJoinOnPrem.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/PTMeetingsAuthJoin.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/PTVideo.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/PTVideoAddVideo.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/PTVideoGroup.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/PTVideoGroupGoogleChrome.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/PTVideoIncomingP2P.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/PTVideoOutgoingP2P.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/PTVideoP2PEscalation.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/ReleaseNotes.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/RespondToInvitation.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/ReusingUcwaFqdn.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/SaveRestoreSnapshot.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/ScheduleMeeting.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/troubleshooting/auth/AADAuth-AdminConsent.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/troubleshooting/auth/AADAuth-EnableImplicitOAuth.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/troubleshooting/auth/AADAuth-IECORSRedirectURI.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/troubleshooting/auth/AADAuth-IESecurityZones.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/troubleshooting/auth/AADAuth-ReplyURLs.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/troubleshooting/auth/AADAuthFailures.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/troubleshooting/gatheringLogs/Logs-DesktopClient.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/troubleshooting/gatheringLogs/Logs-Media.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/troubleshooting/gatheringLogs/Logs-WebTraffic.md
:white_check_mark:Succeeded

Skype/WebSDK/docs/troubleshooting/handlingApplicationErrors.md
:white_check_mark:Succeeded

This comment lists only the first 25 files in the pull request.
For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

@lindalu-MSFT
The Content & Learning team is fixing build validation errors on docs.microsoft.com for the rest of H2. This will eliminate potential accessibility, security, and usability issues. This PR includes only build validation fixes and does not change other content. Please review within five business days and merge or comment in the PR with any changes you’d like to see. Thank you!

@lindalu-MSFT
The Content & Learning team is fixing build validation errors on docs.microsoft.com for the rest of H2. This will eliminate potential accessibility, security, and usability issues. This PR includes only build validation fixes and does not change other content. Please review within five business days and merge or comment in the PR with any changes you’d like to see. Thank you!


Highlighting issue with PHP when code contains xml snippet

Hello,
With the following code:
<?php

  echo '<?xml version="1.0" encoding="UTF-8"?><tracker />';
  echo PHP_EOL;

PrismJS does not syntax highlight the second statement (and the following ones, if any).
Tested on PrismJS 1.15.0
Best regards,
Nicolas

"Second statement" in the above example is the echo PHP_EOL; line?

Yes

Thanks for the fix!
Do you have any approximation date when it will be released?

You can create your own bundle on the download page to get it right now.
We don't have a date for the new release yet (#1713).


error with mac compile

attempting an OSX qt build with boost 1.57 i get this error.
In file included from ../src/net.cpp:5:
In file included from ../src/db.h:9:
In file included from ../src/serialize.h:22:
In file included from ../src/allocators.h:10:
In file included from /opt/local/include/boost/thread/once.hpp:20:
In file included from /opt/local/include/boost/thread/pthread/once_atomic.hpp:19:
In file included from /opt/local/include/boost/bind.hpp:22:
/opt/local/include/boost/bind/bind.hpp:253:36: error: cannot initialize a parameter of type 'void ' with an lvalue of type 'long'
unwrapper::unwrap(f, 0)(a[base_type::a1_]);
^~~~~~~~~~~~~~~~~
/opt/local/include/boost/bind/bind_template.hpp:20:27: note: in instantiation of function template specialization 'boost::_bi::list1<boost::_bi::value >::operator()<void ()(void ), boost::bi::list0>' requested here
BOOST_BIND_RETURN l(type<result_type>(), f_, a, 0);
^
/opt/local/include/boost/thread/detail/thread.hpp:116:17: note: in instantiation of member function 'boost::_bi::bind_t<void, void ()(void ), boost::_bi::list1<boost::_bi::value > >::operator()' requested here
f();
^
/opt/local/include/boost/thread/pthread/thread_heap_alloc.hpp:47:24: note: in instantiation of member function 'boost::detail::thread_data<boost::_bi::bind_t<void, void ()(void ), boost::_bi::list1<boost::_bi::value > > >::run' requested here
return new T(a1);
^
/opt/local/include/boost/thread/pthread/thread_heap_alloc.hpp:73:20: note: in instantiation of function template specialization 'boost::detail::heap_new_impl<boost::detail::thread_data<boost::_bi::bind_t<void, void ()(void ), boost::_bi::list1<boost::_bi::value > > >, boost::_bi::bind_t<void, void ()(void ), boost::_bi::list1<boost::_bi::value > > &>' requested here
return heap_new_impl<T,A1&>(a1);
^
/opt/local/include/boost/thread/detail/thread.hpp:230:52: note: in instantiation of function template specialization 'boost::detail::heap_new<boost::detail::thread_data<boost::_bi::bind_t<void, void ()(void ), boost::_bi::list1<boost::_bi::value > > >, boost::_bi::bind_t<void, void ()(void ), boost::_bi::list1<boost::_bi::value > > >' requested here
return detail::thread_data_ptr(detail::heap_new<detail::thread_data >(f));
^
/opt/local/include/boost/thread/detail/thread.hpp:390:25: note: in instantiation of function template specialization 'boost::thread::make_thread_info<boost::_bi::bind_t<void, void ()(void ), boost::_bi::list1<boost::_bi::value > > >' requested here
thread_info(make_thread_info(boost::bind(boost::type(),f,a1)))
^
../src/net.cpp:1840:5: note: in instantiation of function template specialization 'boost::thread::thread<void ()(void *), long>' requested here
boost::thread(&ThreadIRCSeed, NULL);
^
1 warning and 1 error generated.
make: *** [build/net.o] Error 1

Some troubles with IRC integrations.
You need disable ../src/net.cpp:1840 line.
Wallet will connected to network through DNS Seeding.

Fixed by https://github.com/CooleRRSA/crave/commit/a28b5d86df0c4a7f607ab9d91f64fe88d84e15a3


"DriverSetup" is not a registered WDTF system interface name

uring testing driver for Windows Certification programm I got an error in tests "DF - Reinstall with IO Before and After"
WDTF_TARGET : ERROR : "DriverSetup" is not a registered WDTF system interface name. Win32=2 - The system cannot find the file specified.
It looks like WDTF can not reinstall driver due to missing interface. We use preinstalled image with HLM Studio and installed client as described: \HLKInstall\Client\Setup.cmd.
Test PC OS: Windows 10 Home

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 6a940f18-8255-ae26-921c-1c4520e62738
Version Independent ID: 5dc86be7-b7fe-5b4c-c711-f4ad02a857ad
Content: Extending the Framework - Windows drivers
Content Source: windows-driver-docs-pr/wdtf/extending-the-framework.md
Product: windows-hardware
Technology: wdtf
GitHub Login: @DOMARS
Microsoft Alias: domars

@s0gray - This particular channel is monitored by the men and women who write the driver documentation posted on docs.microsoft.com/drivers. Though we'd like to, we don’t have the resources to provide support for specific scenarios.
Your best bet is to use one of the forums where other driver developers and Microsoft engineers can be found. For example the Hardware and Application Developers on Q&A.
I'm not aware of an easy way to determine the root cause of the issue that you are experiencing. To validate that the issue is with the driver code, you could consider using the toaster driver to see how it works with the test - https://github.com/microsoft/Windows-driver-samples/tree/master/general/toaster/toastDrv
Then you could enable WDTF tracing in both drivers as described in https://docs.microsoft.com/en-us/windows-hardware/drivers/wdtf/viewing-wdtf-traces, and see at what point in the trace logs things diverge or fail.
There may be a more efficient way to determine the cause, perhaps someone on the WDK DL will have a better idea then this suggested procedure. Good luck with your HLK test troubleshooting.


Don't use strtobool from distutils

Inspired by this question – one shouldn't need distutils/setuptools just to see if a string feels truthy.
The set of truthy-feeling strings was borrowed from setuptools.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


arrow-cpp: 6.0.1 -> 7.0.0

Motivation for this change
Bump arrow-cpp from 6.x to 7.x
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[x] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[x] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.05 Release Notes (or backporting 21.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 158157 run on x86_64-linux 1

6 packages failed to build:

python310Packages.apache-beam
python310Packages.tokenizers
python310Packages.transformers
python39Packages.apache-beam
python39Packages.spacy-transformers
python39Packages.tensorflow-datasets

21 packages built:

arrow-cpp
parquet-tools
python310Packages.datafusion
python310Packages.datasets
python310Packages.google-cloud-bigquery
python310Packages.ibis-framework
python310Packages.pyarrow
python310Packages.snowflake-connector-python
python310Packages.snowflake-sqlalchemy
python39Packages.datafusion
python39Packages.datasets
python39Packages.google-cloud-bigquery
python39Packages.ibis-framework
python39Packages.intake
python39Packages.intake-parquet
python39Packages.pyarrow
python39Packages.snowflake-connector-python
python39Packages.snowflake-sqlalchemy
python39Packages.tokenizers
python39Packages.transformers
streamlit

@veprbl What should we do about the failing packages?
There are two categories among them:

Packages that fail because apache-beam has an <7.0.0 upper bound on pyarrow
Packages that fail because tokenizers has some broken tests unrelated to pyarrow

I patched out the apache-beam constraint, and all of the tests still pass so we might consider doing that for beam to allow it and its dependents to pass.
For tokenizers, we might consider marking that package as broken.
Thoughts?

@ndl Thanks for the review. I had to also mark apache-beam broken for Python 3.10 as it cannot be imported due to the removal of the top-level types in the collections module in Python 3.10.

I had to also mark apache-beam broken for Python 3.10 as it cannot be imported due to the removal of the top-level types in the collections module in Python 3.10.

The latest version supported by upstream is 3.8 (see https://github.com/apache/beam/blob/master/sdks/python/setup.py#L256), it just happens to also work on 3.9 but yeah, I'm not too surprised it breaks afterwards. I think it's reasonable indeed to constrain it to <= 3.9 for now.

@cpcloud  Could you, please, squash last two commits and first two.

@veprbl Done!

nixpkgs-review reveals no new failures, macos 10.15 & nixos x86_64

Result of nixpkgs-review pr 158157 run on x86_64-darwin 1

2 packages marked as broken and skipped:

python39Packages.spacy-transformers
streamlit

13 packages failed to build:

python310Packages.datafusion
python310Packages.datasets
python310Packages.google-cloud-bigquery
python310Packages.ibis-framework
python310Packages.pyarrow
python310Packages.snowflake-connector-python
python310Packages.snowflake-sqlalchemy
python310Packages.tokenizers
python310Packages.transformers
python39Packages.apache-beam
python39Packages.ibis-framework
python39Packages.intake
python39Packages.tensorflow-datasets

11 packages built:

arrow-cpp (parquet-cpp)
parquet-tools
python39Packages.datafusion
python39Packages.datasets
python39Packages.google-cloud-bigquery
python39Packages.intake-parquet
python39Packages.pyarrow
python39Packages.snowflake-connector-python
python39Packages.snowflake-sqlalchemy
python39Packages.tokenizers
python39Packages.transformers

@GrahamcOfBorg eval
@GrahamcOfBorg build python39Packages.pyarrow

I can update ibis-framework in a follow up.

Result of nixpkgs-review pr 158157 run on x86_64-linux 1

3 packages failed to build:

python310Packages.tokenizers
python310Packages.transformers
python39Packages.spacy-transformers

23 packages built:

arrow-cpp
parquet-tools
python310Packages.datafusion
python310Packages.datasets
python310Packages.google-cloud-bigquery
python310Packages.ibis-framework
python310Packages.pyarrow
python310Packages.snowflake-connector-python
python310Packages.snowflake-sqlalchemy
python39Packages.apache-beam
python39Packages.datafusion
python39Packages.datasets
python39Packages.google-cloud-bigquery
python39Packages.ibis-framework
python39Packages.intake
python39Packages.intake-parquet
python39Packages.pyarrow
python39Packages.snowflake-connector-python
python39Packages.snowflake-sqlalchemy
python39Packages.tensorflow-datasets
python39Packages.tokenizers
python39Packages.transformers
streamlit

Result of nixpkgs-review pr 158157 run on x86_64-darwin 1

2 packages marked as broken and skipped:

python39Packages.spacy-transformers
streamlit

10 packages failed to build:

python310Packages.datafusion
python310Packages.datasets
python310Packages.google-cloud-bigquery
python310Packages.ibis-framework
python310Packages.pyarrow
python310Packages.snowflake-connector-python
python310Packages.snowflake-sqlalchemy
python310Packages.tokenizers
python310Packages.transformers
python39Packages.tensorflow-datasets

14 packages built:

arrow-cpp (parquet-cpp)
parquet-tools
python39Packages.apache-beam
python39Packages.datafusion
python39Packages.datasets
python39Packages.google-cloud-bigquery
python39Packages.ibis-framework
python39Packages.intake
python39Packages.intake-parquet
python39Packages.pyarrow
python39Packages.snowflake-connector-python
python39Packages.snowflake-sqlalchemy
python39Packages.tokenizers
python39Packages.transformers

^ without sandbox

Is there an upstream issue tracking apache-beam Python 3.10 support? I'm surprised how behind they are on this...


Point CommunityTechTree to curse for download

Small change to an already-broken .ckan, also let's me test https://github.com/KSP-CKAN/NetKAN/pull/3259 fully. Merging this but hoping for a quick +1 from anyone who wants to review post-merge.


go.mod: update dependencies

Codecov Report

Merging #85 (32f7af9) into main (c542fb2) will not change coverage.
The diff coverage is n/a.

:exclamation: Current head 32f7af9 differs from pull request most recent head b9efc93. Consider uploading reports for the commit b9efc93 to get more accurate results

@@           Coverage Diff           @@
##             main      #85   +/-   ##
=======================================
  Coverage   76.92%   76.92%
=======================================
  Files          17       17
  Lines        1872     1872
=======================================
  Hits         1440     1440
  Misses        321      321
  Partials      111      111

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c542fb2...b9efc93. Read the comment docs.


Generate null-safe .pbgrpc files

Now as grpc-dart migrated to null safety, we can generate null-safe .pbgrpc files

Looks good, thanks!


Only the datepicker?

Hello. I discovered this repo yesterday and "manually" pulled out the date picker (and the 4x.js). But is there a way to only get those and only those? I haven't looked but how much of the 4x is necessary for the date picker? Obviously, less payload is better :) Not that big of a deal but I wanted to ask.
Two additional bits of feedback that are unique to the project we're using the datepicker for, but worth mentioning since I'm here.

We're using it for a scheduling application. That is, some days within a range are pickable, some are not. I found the disable method but there was no date-specific un-disable. That is, it would easier to disable a range (min to max) and then un-disable any days that are pickable. As it is, and maybe I got it wrong, I hard to create dates data from min to mix, loop over that, check against my pitchable dates, skip those, and otherwise disable. Felt like a lot of work for something so simple.

As for the render() method. It would - again, in our case - be helpful to have a setting that opened the calendar and kept it open. Maybe that does exist, but I haven't seen it yet. Forgive me for asking if it's already there.

Otherwise, so far so good. Thanks for sharing all this.

Hi, thanks for writing.
All of the module files pull from the core functionality within 4X, so you won't be able to use the module file alone without it. You can use a standard script tag to load both though, instead of using the $A.import() function for this like so:
    <script  src="4X/4X.js"></script>
    <script  src="4X/Standard/Modules/Datepicker.js"></script>

About the other questions for setting disabled dates and manual rendering, yes you should be able to do this with no problem. Both start with getting a reference to the Datepicker object that is returned from the $A.setDatepicker() function.
E.G.
var dc = $A.setDatepicker({
// Configuration key / value map
});

Afterwhich you can use any of the following methods to disable various dates.
dc.setDayDisabled(dc, dateObj, isDisabled)

dc.setMonthDisabled(dc, dateObj, isDisabled)

dc.setDayOfWeekDisabled(dc, dateObj, daysOfWeekArray, isDisabled)

dc.setWeekdaysDisabled(dc, dateObj, isDisabled)

dc.setWeekendsDisabled(dc, dateObj, isDisabled)

dc.clearAllDisabled(dc)

For example, you could create a for loop to go through your date range, and then use the dc.setDayDisabled() method to choose which dates are meant to be disabled within that range.
The isDisabled param is meant to set the disabled state for that date using a boolean, so you could use the same method call to set that date one way or the other as you wish.
for (var i = 0; i < dates.length; i++) {
dc.setDayDisabled(dc, dates[i], isMeantToBeDisabled ? true : false);
}

For manual rendering, yes this is simple to do. You should be able to open it using the render() method. :)
dc.render();

// Or

dc.render(function() {
// Do something after the calendar finishes rendering...
});

// And to manually close it...

dc.remove();

// Or

dc.remove(function() {
// Do something after the calendar finishes closing...
});

Does this help?

Hey @accdc  - Wow! Thanks so much for the quick reply. I'm actually off for the holiday and will look at this in detail next week but...
if the *Disabled() methods are more like a toggle then that should be a big help. Thanks.
I'll look at the render() bit but I trust you know what you're doing. Thanks 2x
And again, thank you for sharing ALL this. TBH I don't know much about accessibility but I do know it matters. Finding the correct tools (e.g., this date picker) is a big help. Cheers.

Oops. One more thing. Is it possible to get the input and button wrapped in a div and not be siblings to the calendar?   More or less for styling purposes. NBD but I wanted to ask.

Thanks, no problem. :)
Yes, of course, you can set the rendering DOM location wherever you wish.
Within the setup declaration, simply add the following properties.
var dc = $A.setDatepicker({
// Configuration key / value map
root: "body", // CSS selector or DOM node.
append: true // Rendering behavior.
});

You can read about these various properties amongst others within the help folder:
Help/DC API/DC Object Configuration/Rendering
I'll close this issue for now, but please continue the dialog if you need help with anything else.


Misspelling of a table column in sqlwatch_logger_xes_long_queries and issues in datatypes

Picture of misspelling all the code on the back end and references are the same so this is just aesthetics.

"activity_seqeuence_xfer"  to "activity_sequence_xfer"
I did have an issue on this same table where there was a bigint value trying to go into a smallint datatype causing the usp_sqlwatch_logger_xes_long_queries stored procedure to fail. I manually modified on my side on the screenshot as well

Closing issue this is on the wrong github should be under the SQLWatch sorry. New and getting used to github


[2.6] Update route comparison when checking for active route

This resolves an issue where navigation trees were automatically collapsing when routing to a cluster's context in production.
The problem stemmed from a combination of ROUTER_BASE containing and the route comparison that is made when checking for active routes in Group.vue. In this scenario, with the ROUTER_BASE set to /dashboard, $route.fullPath  returns /c/local/explorer, while route.href returns /dashboard/c/local/explorer. In day to day development. Updating the comparison to route.route.fullPath produces /c/local/explorer, allowing us to properly determine if a route is active.
I tried testing this change in other pages that have navigation and didn't take note any regressions related to this change.
#3512
Backports #3680 into release-2.6

Closing because this duplicates work already done in #3681


Test is failing on my machine

It looks that new tests are 'order sensitive'. I'm using Fedora 24 (64bit).
PHPUnit output:
There was 1 failure:

1) LanguageServer\Tests\Utils\RecursiveFileSearchTest::testFilesAreFound
Failed asserting that two arrays are equal.
--- Expected
+++ Actual
@@ @@
 Array (
-    0 => '/home/wywrzal/git/php-language-server/fixtures/recursive/a.txt'
+    0 => '/home/wywrzal/git/php-language-server/fixtures/recursive/search/here/c.txt'
     1 => '/home/wywrzal/git/php-languag.../b.txt'
-    2 => '/home/wywrzal/git/php-language-server/fixtures/recursive/search/here/c.txt'
+    2 => '/home/wywrzal/git/php-language-server/fixtures/recursive/a.txt'
 )

/home/wywrzal/git/php-language-server/tests/Utils/RecursiveFileSearchTest.php:18

Yep, seems like the order output of the recursive file search is non-deterministic. We can simply call sort() on the array in the test.


Milestones list

What this PR does / why we need it:
This is getting the GetMilestone function to work

Special notes for your reviewer:
Release note:

Merged for now. Any small things could be fixed on subsequent PRs. For now it's a good base to have in master. Anything you are still wanting to add from your point of view?


Add Base45 operations

Closes #1219

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

I was looking into decoding the vaccination QR code (which uses Base45) and ran into this tweet which seems to indicate that there are variants of this encoding: https://mobile.twitter.com/jilles_com/status/1416758126372663305
It would be nice if these variants can be supported too.

@nielsbasjes The EU specification does not specify any variants. Are they documented somewhere properly?

FYI to properly decode the EU green pass files CyberChef will also need support for COSE

Ik have also not been able to find a good specification yet.
The best sources I have are the tweet I mentioned which shows a code fragment and this (Dutch) article which also mentions ASN.1 as being part of the Dutch variant.
https://tweakers.net/reviews/9166/het-digitale-coronapaspoort-hoe-de-app-om-te-kunnen-reizen-werkt.html
If I find something better I'll post it here.

It seems there are several publicly available photos that seem to actually show a valid (expired) Dutch QR code:
https://twitter.com/MinVWS/status/1438433503205597192/photo/1
https://www.ewmagazine.nl/nederland/achtergrond/2021/09/radicale-omslag-coronabeleid-toegangsbewijs-voor-horeca-en-theater-geen-afstandsregel-844321/
Note there are also a lot of images that have fake content. These two seem to contain (at a first glance) content that makes sense.

The code for the Dutch apps was opensourced by the Dutch government: https://github.com/minvws/nl-covid19-coronacheck-app-coordination

This seems to be their base 45 implementation:
https://github.com/minvws/base45-go
The rest of their implementation is in https://github.com/minvws/nl-covid19-coronacheck-mobile-core and https://github.com/minvws/nl-covid19-coronacheck-idemix
A few notes:

I think this is a completely different encoding than the one from this PR, so it probably should get its own dedicated operation.
There is no public specification, so you would have to work from the code which is licensed as EUPL, for which I'm not sure if it's compatible with the CyberChef license.

I fully agree.
This dutch encoding must be treated completely separate from this merge request.


Download-BcNuGetPackageToFolder Support package description for app name

Describe the issue
In the new implementation, the title element is required. Would it be possible to check if the title element is available and if not, check if the description field is available? I found a lot of packages, that use the description field for the app name.
https://github.com/microsoft/navcontainerhelper/blob/b4b554d4200c02fbff9058d612ee8dbc214d1c67/NuGet/Download-BcNuGetPackageToFolder.ps1#L149

Now I used the correct template :D

Next preview will have this functionality

Thank you for the quick implementation 🤝


[WIP]change the default buffer size and the ordering of the requests

This pull request is improvement for WebService insights.
change the default buffer size
I changed ApplicationPersistenceStore.BufferSize to configurable.
The parameter take from AppSetting's Glimpse:PersistenceStoreBufferSize key.
This is same as Glimpse:DisableAsyncSupport.
change the ordering of the requests
I changed ApplicationPersistenceStore.GetTop to returns descending result and modified client script(glimpse.history.js)
Currently Glimpse's history tab shows descending result but API returns ascending result.
It cause Standalone mode shows oldest result at first.
In web service insights shows latest result is desirable.
Modifing ApplicationPersistenceStore.GetTop's behaviour is breaking change.
I thought some of the way.

Add IReadOnlyPersistenceStore.GetLast, but it's big breaking change
Add configuration Glimpse:HistoryOrderMode and conforming behaviour, it's too complex for user

I choose change the behaviour of GetTop.
Order to same the appearance of history tab, I was modified client script.
(Client script is not send pull request)
fetch history size
This pull request is not completed yet.
If spread bufferSize but shows history tab limit is 50.
HistoryResource.Execute handles GetTop parameter and "top" parameter maybe can't set from client.

defaultSize change to same as ApplicationPersistenceStore.BufferSize (is this good or bad?)
add selectBox(25,50,100,250,500) to above the clear button
at reached maximum size, should be delete first data in client(current design maybe doesn't delete)

I added selectbox in this pull request.

What do you think about this?
I want to your help.
Thank you.

In terms of initial feedback, this looks great!!! First thing that would be good to do is split this into 3 different PRs. They seem to me like 3 different units of work and shouldn't really be tied into each other.
Buffer Size
I'm wondering if instead of making it an app setting, we add it as an attribute to the Glimpse configuration section? The reason that Glimpse:DisableAsyncSupport uses app settings is because it is a "semi" supported feature, where as this would be a fully supported feature. If you do this, you would inject the value of that attribute into the ApplicationPersistenceStore from within the factory (as an example, see how InstantiateInspectors does this). I'm thinking that this shouldn't be too hard to do but will make more sense given how people configure Glimpse today.
Request Order
I'm not sure if you have seen it yet, but we do actually have a dedicated repository for the client code base. The glimpse.js that you see in this repo is built from the client repo and transferred over when a "release" happens for the client. So if you could make the changes to the client code over there, you might find it easier to work with - there is even a test client which simulates data coming in from History and Ajax.
Additionally, I'm wondering, if we make this to the client for History, we should probably make the change for the Ajax tab to, otherwise people might get confused as to how and where things are happening.
In terms of test cases for this work, make sure you go through cases where odd and even numbers of requests come in from the polling process, that the data is layered in correctly and that the rows are coloured correctly.
History Size
The better way of doing this which will mean that the user wont have to adjust any UI or anything, is sending down the butter size in Metadata payload from the Metadata resource. You could take the number from the new configuration attribute you are making and add it to the Metadata payload here. Then we should be able to access this in the client like we do currently for the Hash, etc.
Let me know if this makes sense and keep up the good work!!!

Thank you for gread advice and sorry for late response.
I will send a new individual pull request.
Yes, I saw Glimpse.Client and understood build mechanism.
But I did not know the test client.
It is very helpful.
After I check test well, I will send a second pull request.
Thank you, your shown point is very great.

Sounds good!


Allow users to cancel their own opportunities/recurring donations

As part of this issue:

[x] Cancel recurring donations
[x] Cancel pending opportunities
[x] Have Salesforce send email to user when this happens

Closed with 8beea427868959e0955a1075dde49b7e6a2bdcac


Evaluator module to be able to evaluate two card hands

Since it's not a full hand, will return the probability of winning against any random hands.
https://web.archive.org/web/20200715014447/http://www.natesholdem.com/pre-flop-odds.php

As part of this, we can optimize evaluator for six and seven card cases using some sort of pruning or replacement scheme and taking advantage of shared board cards.

Superceded by https://github.com/SirRender00/texasholdem/issues/101


Fusion 9.02 Rendernode implementation

Hi Guys,
i'm trying to implement cryptomatte on our rendernode installations.
But i'm not able to get it working, as the installation instruction does not fit the circumstances of a rendernode installation.
I guess the issue itself is related to the LUA_PATH variable or package.path which seems to be ignored by Fusion. As the Rendernode shows an error which says cryptomatte_utilities.lua not found.
This even appears when i tried to:
set the LUA_PATH Windows environmental variable
Set package.path fusion variable
Copied all the files as described in the readme, but replaced the folder paths:
"C:\Program Files\Blackmagic Design\Fusion 9"
with
"C:\Program Files\Blackmagic Design\Fusion Render Node 9"
I had to create the subfolders for "config" and "lua" as they didn't exist.
I tried the workaround where you have to copy the cryptomatte_utilites.lua to "C:......\AppData\Roaming\Blackmagic Design\Fusion\Modules\Lua".
Your script could safe us a lot of work if we would be able to use it on our renderfarm :)
Best regards,
Philipp

Thanks everyone, I've labeled this as a question, and I think it's been answered, so I'm going to close it. Feel free to keep adding more information if there's something that should be here.


[Python] ImportError: libutf8proc.so.2: cannot open shared object file

Describe the bug, including details regarding any error messages, version, and platform.
After updating my Conda environment and trying to import pyarrow, I receive
ImportError: libutf8proc.so.2: cannot open shared object file: No such file or directory
I believe the breaking change was updating from pyarrow 11 to 12 and changing the channel from default to conda-forge. However, downgrading back doesn’t solve this.
A solution is to manually copy the file into the lib folder of that environment.
I’m running an environment with Python 3.10.11 on a CentOS 7 system.
Component(s)
Python

Could you check that you ensure using https://anaconda.org/conda-forge/pyarrow ?
Do you have https://anaconda.org/conda-forge/libutf8proc in your environment?

Yes, I can confirm both.

Hmm. It's strange because https://anaconda.org/conda-forge/libutf8proc should provide libutf8proc.so.2.

@daharn can you show the output of conda list in the broken environment? (giving that you mentioned switching from defaults to conda-forge, it might be a mix of the two channels that is causing it)

Checked that already, they all come from conda-forge (except for a few specific channels or pip installs)
But I can't even reproduce the error when I clone the environment, so I guess this might have just been a blip.

OK. Then can we close this?

Yes, I see no way of reproducing the issue.

Had the same error when trying to run the df.to_pandas() command. Remaking the conda environment fixed the ImportError: libutf8proc.so.2:.


chore: df 35 upgrade

Generally this is fine, have two questions:
* is there anything that you're worried about that the tests wouldn't cover?

* should we tag the release before this is merged or do you think this is going to be safe to release without further testing?

no i think this is fine, the impact surface was much smaller than our last upgrade, and i'd be suprised if our slts missed anything major


Won't join nor play music

the commands for music don't seem to work, the only command that i was able to use was ".$"

Public Nadeko has music feature disabled because of the amount of usage and slows down nadeko by a lot. If you want music you will need to host nadeko yourself by following one of the guides on the left side of this page: http://nadekobot.readthedocs.io/en/latest/


Add the ability to upload custom Blind/Ganon quotes

So currently all of the config file stuff is in the Tracking project, but I wonder if we should pull out the configs into their own project so that the merge functionality can be used in the randomizer project.


Image URL's not working correctly

When I add a images to my newsletter the img path seems to be broken.  I have used the the following code in my config file but once thats in, i get locked out of the admin section of silverstripe.
Config::inst()->update( 'Director', 'alternate_base_url', 'http://www.mysite.com/' );
Any help would be greatly appreciated.

@dleinbach might need to check your $_FILE_TO_URL_MAPPING is set up correctly. This is because the message queue module performs operations from the command line.
see http://doc.silverstripe.org/en/developer_guides/cli

@jedateach You are the man!  that worked great!


Planning: Buildpacks for DDEV-Local

Feature Description:
Investigate the state of buildpacks for ddev-local and the shared images initiative. We are looking into the feasibility of a layering approach with buildpacks and ddev-live.
To solve with a layering approach, we need buildpacks to make explicit what the layers are and how they are built and used.
Can we make it work? Can we produce a specific approach?
User stories:
Acceptance criteria:

[ ] Begin to assess implications of a layer-based approach for local, using buildpacks.
[ ] Identify some candidate layers, after doing some preliminary investigation

Related links or issues:
https://github.com/drud/buildpacks
https://github.com/buildpacks
Definition of Ready Checklist:

[ ] User-facing feature: provides story or A/C in Gherkin format, or
[ ] Architectural feature: provides technical A/C
[ ] Dependencies identified
[ ] Sized by team

RProduct Owner AScrum Master CEng. Lead ITeam
Definition of Done Checklist:

[ ] Acceptance Criteria tested and passing
[ ] Deployed on test environment
[ ] Internal documentation updated (if required)

REng. Lead, Team AScrum Master CIProduct Owner

notes from slack: Randy is underway on a PoC here

call reviewing the first PoC is https://github.com/drud/ddev-images/pull/3 is here.
The approach is different from initial description in this issue (non-buildpacks) so I've updated the issue title to reflect that.
The primary next steps are

get reviews on the PR and merge it in
beginning to address the discussion items
On the first discussion item, this effort will require some changes to DDEV-Live siteimagesource. Carving out availability to schedule that work is TBD.


GRE support

Brickner[CodePlex] Over IPv4.
RFC 2784.

Brickner[CodePlex]

Brickner[CodePlex] Implemented.
Tested.
Released (Version 0.6.0)
** Closed by Brickner 5/10/2010 11:09 AM


chore(package): update mocha to version 5.0.4

Closes #8

Coverage remained the same at 97.143% when pulling 593c2c81712d54c000f3b7d90ed71e0c3bc019e2 on greenkeeper/mocha-5.0.4 into 99b04447670dba6417478f3a8819efb61becbfaa on master.


Certificate of completion is broken

No longer possible over HTTP: "getUserMedia() no longer works on insecure origins. To use this feature, you should consider switching your application to a secure origin, such as HTTPS. See https://goo.gl/rStTGz for more details."

Broken due to a deprecation on HTTPS: "Use MediaStreamTrack.stop() to stop streaming, not MediaStream.stop()." https://developers.google.com/web/updates/2015/07/mediastream-deprecations?hl=en

(Still doesn't work over http but not sure what to do about that... should have better messaging of why it's failing, but time is short!!!)


The plugin doesn't seem to work anymore

Is it event supported? Maybe it's worth removing it from marketplace?
E.g. see reviews https://plugins.jetbrains.com/plugin/7453-haskell/reviews

Just noticed deprecated tag in the plugins repository but it's hard to see and it's not visible in IDE at all.
If it is really deprecated, it might be good to make it obvious in the plugin description and github readme.


UI: Add a copy button to the deployment config templates form

What this PR does / why we need it:

Which issue(s) this PR fixes:
Fixes #905
Does this PR introduce a user-facing change?:

NONE

Great. Thank you.
/approve


Avoid errors from shutting down LoggerThread

A Java Error in the LoggerThread can effectively cripple Tomcat JULI, preventing all AsyncFileHandler from writing to their files.
We experienced such a logging shutdown on a real Gerrit installation, when a toString() method threw a NoClassDefFoundError and stopped the logger thread used by all the applications on the server.
Should I file a BZ bug?

@markt-asf,
As far as I can see, the LoggerThread is the only part of JULI that needs to be concerned with Throwables. I inline the relevant part of ExceptionUtils#handleException. A stack overflow is not a problem in this case, since we are in a thread's run method.
On the other hand I would be tempted to replace LoggerThread entirely with a single threaded ExecutorService as in new-async-file-handler. That solution will require much more testing, but will solve another potential problem: the LoggerThread can have as context classloader the classloader of a web application.

Fixed via #545


Parsing multiple JSON objects from a string or stream

Hi, I just started using your library, so far I like your design, but I run into this problem.
Example input (received from TCP socket):

{"data":[164,227,155,136],"dir":"rx"}{"data":[249,88,104,174],"dir":"rx"}{"data":[148,105,74,58],"dir":"rx"}

Code fragment:
        string smsg((char*)buff, len);
        if (debuglevel_&1) cout << "Raw data Str: " << smsg << endl;
        json jmsg = json::parse(smsg);

Alternative code:
        stringstream ss;
        ss<<smsg;
        while (! ss.eof()) {
            json jmsg;
            ss >> jmsg;

Output:

parse error - unexpected '{'; expected end of input

Expected result:
I would like to be able to parse multiple concatenated JSON strings.
A possible implementation could be if the result were an array of json objects. like ‘[{…},{…},{…}]’
This could be achieved by replacing ‘}{‘ with ‘},{‘ and inserting a ‘[‘ and a ‘]’ at the beginning and ending of the string. (My current workaround.) But this is not a very robust implementation, would need to replace all possible ‘}\r\n{‘ … variant, not to mention strings containing “}{”. Also not very efficient, needs to pseudo pre parse the input. (It would help somewhat if json could accept whitespace* separated objects in arrays not requiring comma, though that would not be valid JSON. This could be a relaxed parsing, instead of strict.)
Second possible implementation (preferred IMHO) for the parsing to be resumable. Meaning extract one JSON object from a stream, leave the read position and start from there the next time. Or in case if it’s a string provide a method to query how much characters were processed, so that part can be “removed” from the input string and the rest can be parsed again. (Like: string smsg ((char*)&buff[position], len-position); … position+=jmsg.??)
I have found these related issues:
#367
#210
The suggested workaround here (counting matching ‘{‘ ’}’ would not work if any string inside the JSON contained non matching ‘{‘,’}’ characters like "{"test3":"}"}").
Thank you for all your work and efforts.

Yes, this should be fixed with #367. I shall close this ticket.
When I added support for streams, I never thought about the fact that streams could be reused. I hope to be able to add this feature without too much refactoring.

@szikra Sorry if closing this seems rude - please feel free to comment on #367.


feat: Solve Keccak opcodes

Related issue(s)
Related to (https://github.com/noir-lang/noir/issues/1189)
Description
Summary of changes
Solve Keccak opcodes
Checklist

[X] I have tested the changes locally.
[X] I have formatted the changes with Prettier and/or cargo fmt with default settings.
[X] I have linked this PR to the issue(s) that it resolves.
[X] I have reviewed the changes on GitHub, line by line.
[X] I have ensured all changes are covered in the description.

I'm not a fan of PRs that don't say what they do in the title, since it makes it harder to find where changes happened and why and it also invites feature creap into PRs.
Lets just add Keccak into this PR exactly like how it is done for other functions, then any other changes can be done in a separate PR and discussed.

Closing this as it's been superceded by #259 and #264


Environment state error

I have different environment states in hub and in console. I stopped container from hub side, env became unhealthy, then went to console and found that env is healthy there. Please view logs.
Karafs.zip

Console env containers can be stopped and their status does not become unhealthy


Update title and subtitle in the UI in AccountInfo and TitleInfo fragments upon edit.

When the user edits these fields in those fragments, update the UI to reflect the changes.

This is OK and good enough, but I think it's a bit more complex than necessary. I would pass or return a promise instead of a callback.

Sure. Will refactor later on.

OK


Unexpected behavior for AppFolder permissions

I created an app with Files.ReadWrite.AppFolder permission only.
Request to: https://graph.microsoft.com/v1.0/drive/special/approot
Response: 404, and the AppFolder is not created in my Onedrive.
The documentation states:

"OneDrive creates your app's folder in the user's Apps folder, located in the root of the user's OneDrive, when your app makes the first call to the folder using the special folder namespace. Below are the most common calls your app can make to create the folder for the first time."

So my AppFolder should have been created and not return 404.
If I try the exact same process after adding the Files.ReadWrite.All permission the request success and return the expected response:
{
<EMAIL_ADDRESS>"https://graph.microsoft.com/v1.0/$metadata#drive/special/$entity",
    ...
    "folder": {
        "childCount": 0
    }
}

and my AppFolder is successfully created. Isn't the whole point of the Files.ReadWrite.AppFolder permissions to avoid requiring full read/write access to our users?

I too have just experienced this same issue. Requesting Files.ReadWrite.AppFolder gives me access denied when I try to access my app folder via drive/special/approot. Only when I request Files.ReadWrite.All am I finally able to access my app folder.
Like OP said, this kind of defeats the point of having a sandboxed app folder if a user needs to give me total access for me to write to it. Hoping this gets fixed.

February 2018, still have this issue. Hope it will get fixed soon.

This issue has unfortunately changed owners a couple of times - let me get to the bottom of the status here see where we are.

For those who are seeing issues, are you trying to hit OneDrive Business or OneDrive Consumer. From what I can tell the fix for ODC should be deployed now.

@ificator had the bug with both, ODC and ODB

OK, so here's what the state of the world is:

OneDrive Consumer had an issue whereby provisioning wouldn't work when the Files.ReadWrite.AppFolder scope was the only one present, but that should now be fixed. To my knowledge OneDrive Consumer should be working as expected so please let me know if you're seeing anything that contradicts this.

OneDrive Business does not support Files.ReadWrite.AppFolder (see these remarks). We want to fix this so that it aligns with how OneDrive Consumer behaves, but it's a non-trivial change.

If support for OneDrive Business is something that you'd really like to see I'd suggest upvoting any appropriate asks on our uservoice page (or creating one if there aren't any already).

Any news about this issue?
I know it is closed but it's been few months and the uservoice task wasn't even acknowledged by the OneDrive team.

@ificator How is the status of uservoice. Looks like closed and we can't rate anymore.
By the way. If you give us developers a good way to store application information for users this scope should be working similar to personal users.
If you are an ISV and you have a produvt, then it is really difficult to tell customeer why we need different scopes for onedrive and onedrive for business to do the same stuff.

It looks like the uservoice was created in the archive forum - I'm not exactly sure how it was done, but my guess is that there's policy in that forum that disables voting. I'll see if I can track down someone who has control over our UserVoice to find out if it's possible to move the task into the appropriate area, otherwise we'll unfortunately have to create a new one and start from the beginning vote wise.
I can say that we're aware of the desire for appfolder permissions in ODB, and it's on our backlog, but I cannot comment on timeframes.

We managed to move it back to the developer area so you should be able to vote on it again!

I'm not sure how you can close this and somehow label this "not a bug it's a yet to be implemented feature". You public documentation doesn't even mention the fact that the appFolder scope is not available on OneDrive Business. When both share the same API but yet dependent on the kind of plan the end user chooses that same API behaves entirely differently and that behavior is undocumented, I'd be hard pressed to find anyone who would call this anything other than a bug.
Please reopen this issue, this smacks of nothing more than the overused "it's a feature, not a bug" scapegoat.

I want to remedy excessive scope requirements.
The following document describes whether ODB (OneDrive for Bussiness) supports Files.ReadWrite.AppFolder scope.
Is this true?
Is this ticket really closed?
https://docs.microsoft.com/en-US/onedrive/developer/rest-api/concepts/direct-endpoint-differences?view=odsp-graph-online#permissions

@komikoni I think, this issue is still not fixed. Currently you can just vote on UserVoice so that it get more priority.

Is there any news on that Topic?

It looks like it works partially. It works fo me if I use the v2 auth endpoint but not with v1. Unfortunately I need v1 because currently that's the only/easiest way to use device code flow with Node.js.

@OlliV using AppFolder permission to Enterprise/Business Accounts, or private MS Accounts?

@oFlo193o ah sorry, I didn't specify my plan. I'm using SharePoint Online which might actually have more OneDrive API features enabled than OneDrive for Business.

So should Files.ReadWrite.AppFolder be working when using the v2.0 API combined with an Office 365 E1 or E3 subscription?

It has been a while since I touched this but yes. Note that I said v2 authentication API not v2 Graph API.

It has been a while since I touched this but yes. Note that I said v2 authentication API not v2 Graph API.

Oh, okay, thanks for the clarification

The issue is still there, Files.ReadWrite.AppFolder works for most users but for some full RW access is the only workaround.

@jbostoen were you able to get Files.ReadWrite.AppFolder working with an e3 subscription?

@ificator seems like Files.ReadWrite.AppFolder is still not supported for OneDrive for Business (I am using the e3 subscription), any idea?

The issue is still there for v4, Files.ReadWrite.AppFolder works for most users but for some (ODC) full RW access is the only workaround.

I am trying to work out who gets affected by this, what does ODC mean @VitalyKnyazev?


Awaiting a function that returns never or Promise<never> does not mark the code below as unreachable

Bug Report

🔎 Search Terms
await, never, promise
🕗 Version & Regression Information

The last line starts being marked as unreachable in 3.7.x, but the others aren't in any version
⏯ Playground Link

Playground link with relevant code
💻 Code

declare function syncNever(): never;
declare function asyncNever(): Promise<never>;

async function run(): Promise<void> {
  if (true) {
    await asyncNever();
    await syncNever(); // not marked as unreachable
    syncNever(); // not marked as unreachable
  }
  console.log("foo"); // correctly marked as unreachable
}

🙁 Actual behavior
Only the last line is marked as unreachable.
🙂 Expected behavior
Expected everything after await asyncNever(); to be marked as unreachable.

Duplicate of #34955. Used search terms: await never in:title

I swear that didn't show up 🙈


add new trait for layer collection listing and return workflows instead of IDs

 LayerCollection für dynamische Workflows erweitern und ExternalDatasetProviders anpassen

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

31 of 69 (44.93%)  changed or added relevant lines in 10 files are covered.
7 unchanged lines in 4 files lost coverage.
Overall coverage decreased (-0.008%) to 84.806%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

services/src/workflows/workflow.rs
3
4
75.0%

services/src/handlers/layers.rs
0
2
0.0%

services/src/datasets/add_from_directory.rs
1
4
25.0%

services/src/layers/add_from_directory.rs
1
4
25.0%

services/src/pro/contexts/in_memory.rs
0
3
0.0%

services/src/pro/contexts/postgres.rs
8
12
66.67%

services/src/pro/datasets/add_from_directory.rs
0
4
0.0%

services/src/layers/storage.rs
3
11
27.27%

services/src/pro/layers/postgres_layer_db.rs
12
22
54.55%

Files with Coverage Reduction
New Missed Lines
%

operators/src/source/ogr_source/mod.rs
1
92.51%

services/src/server.rs
1
66.86%

services/src/datasets/add_from_directory.rs
2
11.27%

services/src/layers/layer.rs
3
66.67%

Totals

Change from base Build<PHONE_NUMBER>:
-0.008%

Covered Lines:
32529

Relevant Lines:
38357

💛  - Coveralls

bors merge

bors retry

bors retry


Setup hosted shiny for testing

The link is here:
https://waterdatascience.shinyapps.io/wateRuse/
Email me to add users

@grrmartin-USGS This email, Gary.  I never got the one during the call directly from shinyio.


TokenMismatchException Error Bug

Hi there, Please check my suggestion. I couldn't find any proper solution for "TokenMismatchException" error. So I looked into to library. And this is my suggestion to update it.
To resolve the "tokenmismatchexception in verifycsrftoken.php line 68." error.
old code wasn't working properly.

What exactly does this fix?
If you're getting a TokenMismatchException is because you're either not sending the token or you are sending the wrong one.

well, i had TokenMismatchException Error.  And I was sending correct token on form submit. when I looked into the code library. I found that "$request->input('_token')" code, outputs null value. So I tried changing below the line.
$token = $request->input('_token') ?: $request->header('X-CSRF-TOKEN');
with this
parse_str($request->get('inputs'),$inputs);
$token = $inputs['_token'] ?: $request->header('X-CSRF-TOKEN');
and it works now.

This isn't a bug, you're sending through _token in a inputs array.
Use the forums or slack groups for help


Update README for mahjong soul user

Sadly the public service is banned by mahjong soul. Hope the instruction can help mahjong soul users to use akochan reviewer.

There is a better and easier way to do this, tensoul is not even needed. I'm currently writing the guide for that.

That sounds good, thanks for the update.


Fix issue with missing fields for ps template

Fixes #28337
Fields exposed in the old formatter did not make it to the new formatter.
In addition, I also have some concerns exposing types.Container as a top-level item in the formatter. See #28339

LGTM


Access to paths in w10 iot using Core

Hey,
Im having some problems while using your libraries to manage gpio on mi rb pi 3 from my aspnet webapi core 2. When calling GpioController.Instance an error ocurred:

### fail: Microsoft.AspNetCore.Server.Kestrel[13]
Connection id "0HLB05C1JH9C2", Request id "0HLB05C1JH9C2:00000001": An unhandled exception was thrown by the application.
System.Exception: Could not find device path for Windows application ---> System.InvalidOperationException: Sequence contains no matching element
at System.Linq.Enumerable.Single[TSource](IEnumerable1 source, Func2 predicate)
at Bifrost.Devices.Gpio.GpioController.get_Instance() in C:\Users\alejandro\Documents\Visual Studio 2017\Projects\HomeApplication\Bifrost.Devices.Gpio\GpioController.cs:line 35
--- End of inner exception stack trace ---
at Bifrost.Devices.Gpio.GpioController.get_Instance() in C:\Users\alejandro\Documents\Visual Studio 2017\Projects\HomeApplication\Bifrost.Devices.Gpio\GpioController.cs:line 43

I obtained this error changing the references from nuget straight to your projects downloaded. Trying to figure it out, but probably you could be faster than me. Thanks in advance, let you know if i find smth.

Hi there - so just to clarify - setting the GPIO value to 1 turns the light on, but then setting it to 0 doesn't turn it off, is that correct?
It sounds like the FileSystemWatcher isn't registering the change for some reason.
Could you please paste the class that you've written to turn the light on and off? That would help me recreate the issue.

Hey,

Not exactly, its not relevant setting the 0 or 1, the issue is that at the beginning, 1,2 or 3 times, it turns the light on or off correctly, but after that stop responding. The values are correct in the files, but it takes no effect on GPIO(light in this case)

Yep, I think is something like that with the FileSystemWatcher or disposing the GPIO pin...no idea but Im stucked.

I have used those libraries

Install-Package Bifrost.Devices.Gpio.Core -Version 0.0.1
Install-Package Bifrost.Devices.Gpio.Abstractions -Version 0.0.1
Install-Package Bifrost.Devices.Gpio -Version 0.0.2
And this code
public class GPIOService : IGPIOService
{
private IGpioController gpioController;
    public GPIOService()
    {
        gpioController = GpioController.Instance;
    }

    public void SetState(int gpioId, bool value)
    {
        var pin = gpioController.OpenPin(gpioId);

        pin.SetDriveMode(GpioPinDriveMode.Output);

        pin.Write(value ? GpioPinValue.High : GpioPinValue.Low);

    }
}

Also tried this one trying to change something regarding dispossing but it doesn't work neither:
public void SetState(int gpioId, bool value)
{
using (IGpioPin pin = gpioController.OpenPin(gpioId))
{
pin.SetDriveMode(GpioPinDriveMode.Output);
pin.Write(value ? GpioPinValue.High : GpioPinValue.Low);
}
}


Disable node-reuse to allow rebuilding

Recent builds of msbuild have node reuse enabled by default. This locks up the task dlls after the test's completed preventing re-runs untill you kill the process.
Here's the process at work after running dotnet test.
"\.dotnet\x64\dotnet.exe" "\.dotnet\x64\sdk\2.1.300-preview2-008530\MSBuild.dll" \.dotnet\x64\sdk\2.1.300-preview2-008530\MSBuild.dll /nologo /nodemode:1 /nodeReuse:true

FYI @rynowak \ @ajaybhargavb


Error when using lmcache_vllm.vllm.LLM() with tensor parallelism

It seems that the tensor parallel support cannot work with vllm.LLM(). (After updating to https://github.com/LMCache/lmcache-vllm/commit/d4b647213b758f87f17841811858bfb53ae09bba, I can run the test_lmcache_local_distributed test normally.). When I run the code, it encounters the error:
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/home/miniconda3/envs/lmcache/lib/python3.10/multiprocessing/spawn.py", line 116, in spawn_main
    exitcode = _main(fd, parent_sentinel)
  File "/home/miniconda3/envs/lmcache/lib/python3.10/multiprocessing/spawn.py", line 125, in _main
    prepare(preparation_data)
  File "/home/miniconda3/envs/lmcache/lib/python3.10/multiprocessing/spawn.py", line 236, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/home/miniconda3/envs/lmcache/lib/python3.10/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
  File "/home/miniconda3/envs/lmcache/lib/python3.10/runpy.py", line 289, in run_path
    return _run_module_code(code, init_globals, run_name,
  File "/home/miniconda3/envs/lmcache/lib/python3.10/runpy.py", line 96, in _run_module_code
    _run_code(code, mod_globals, init_globals,
  File "/home/miniconda3/envs/lmcache/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/home/cpu001/LMCache/tby-test/run_lmcache_vllm.py", line 27, in <module>
    llm = vllm.LLM(model=model_path, tensor_parallel_size=2, gpu_memory_utilization=0.6)
  File "/home/miniconda3/envs/lmcache/lib/python3.10/site-packages/vllm/entrypoints/llm.py", line 178, in __init__
    self.llm_engine = LLMEngine.from_engine_args(
  File "/home/miniconda3/envs/lmcache/lib/python3.10/site-packages/vllm/engine/llm_engine.py", line 550, in from_engine_args
    engine = cls(
  File "/home/miniconda3/envs/lmcache/lib/python3.10/site-packages/vllm/engine/llm_engine.py", line 317, in __init__
    self.model_executor = executor_class(
  File "/home/miniconda3/envs/lmcache/lib/python3.10/site-packages/vllm/executor/distributed_gpu_executor.py", line 26, in __init__
    super().__init__(*args, **kwargs)
  File "/home/miniconda3/envs/lmcache/lib/python3.10/site-packages/vllm/executor/executor_base.py", line 47, in __init__
    self._init_executor()
  File "/home/miniconda3/envs/lmcache/lib/python3.10/site-packages/vllm/executor/multiproc_gpu_executor.py", line 89, in _init_executor
    worker = ProcessWorkerWrapper(
  File "/home/miniconda3/envs/lmcache/lib/python3.10/site-packages/vllm/executor/multiproc_worker_utils.py", line 162, in __init__
    self.process.start()
  File "/home/miniconda3/envs/lmcache/lib/python3.10/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/home/miniconda3/envs/lmcache/lib/python3.10/multiprocessing/context.py", line 288, in _Popen
    return Popen(process_obj)
  File "/home/miniconda3/envs/lmcache/lib/python3.10/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/home/miniconda3/envs/lmcache/lib/python3.10/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/home/miniconda3/envs/lmcache/lib/python3.10/multiprocessing/popen_spawn_posix.py", line 42, in _launch
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "/home/miniconda3/envs/lmcache/lib/python3.10/multiprocessing/spawn.py", line 154, in get_preparation_data
    _check_not_importing_main()
  File "/home/miniconda3/envs/lmcache/lib/python3.10/multiprocessing/spawn.py", line 134, in _check_not_importing_main
    raise RuntimeError('''
RuntimeError:
        An attempt has been made to start a new process before the
        current process has finished its bootstrapping phase.

        This probably means that you are not using fork to start your
        child processes and you have forgotten to use the proper idiom
        in the main module:

            if __name__ == '__main__':
                freeze_support()
                ...

        The "freeze_support()" line can be omitted if the program
        is not going to be frozen to produce an executable.
ERROR 10-28 02:27:46 multiproc_worker_utils.py:120] Worker VllmWorkerProcess pid 12137 died, exit code: 1
INFO 10-28 02:27:46 multiproc_worker_utils.py:123] Killing local vLLM worker processes

The test code is here (if I don't set the os.environ["VLLM_WORKER_MULTIPROC_METHOD"] = "spawn", the cuda initialization error will occur as in https://github.com/LMCache/lmcache-vllm/pull/22):
from lmcache_vllm import vllm
"""
and you are good to go!
"""
import os

prompts = [
    "Hello, my name is",
    "The president of the United States is",
    "The capital of France is",
    "The future of AI is",
]

os.environ["VLLM_WORKER_MULTIPROC_METHOD"] = "spawn"
sampling_params = vllm.SamplingParams(temperature=0.8, top_p=0.95)
model_path = "/home/models/huggingface.co/Qwen/Qwen2.5-7B-Instruct"

llm = vllm.LLM(model=model_path, tensor_parallel_size=2, gpu_memory_utilization=0.6)
outputs = llm.generate(prompts, sampling_params)

Hi @CriusT , thanks for your question! Can you maybe try wrapping the main script with if __name__ == "__main__"? Here's an example:
from lmcache_vllm import vllm, close_lmcache_engine
"""
and you are good to go!
"""
import os

os.environ["VLLM_WORKER_MULTIPROC_METHOD"] = "spawn"

if __name__ == "__main__":
    prompts = [
        "Hello, my name is",
        "The president of the United States is",
        "The capital of France is",
        "The future of AI is",
    ]

    sampling_params = vllm.SamplingParams(temperature=0.8, top_p=0.95)
    model_path = "/home/models/huggingface.co/Qwen/Qwen2.5-7B-Instruct"

    llm = vllm.LLM(model=model_path, tensor_parallel_size=2, gpu_memory_utilization=0.6)
    outputs = llm.generate(prompts, sampling_params)

    close_lmcache_engine()

I've tested locally with model_path = "mistralai/Mistral-7B-Instruct-v0.2" and it should work. Let me know if it doesn't work for Qwen models.

It works. Thanks a lot!


Show the output of Cargo's build

💡 Feature description
Compiling a crate can often take quite a long time and it's nice to know about the progress within the build when checking up on it. Would it be possible to avoid suppressing the output of cargo build and have it stream to the console?

i have also wanted this! i think it's possible, and i'd want it to be default, i think, though i do think we might want to give a flag option to turn it off. any one else have thoughts?

Personally, I'd prefer always displaying all output by default, but having a -q flag to wasm-pack which makes it not display subprocess's outputs.
It would be neat if we prefixed the output with the command that was run, eg:
cargo build (stderr): a warning message or something...
cargo build (stderr): some more warnings or whatever...
cargo build (stdout): something from stdout
[4/8] Compiling to wasm...


feat: Added CODE_OF_CONDUCT.md

Considering that a lot of people wish to contribute to this repository, I have added a Code of Conduct.

@bgstaal requesting a review. Apologies for any inconvenience caused.


PostgresDatabaseResource is a bad name. It should just be PostgresDatabase.

Adding "Resource" to the end of the name in UI is ugly and unnessessary.

Dupe of https://github.com/dotnet/aspire/issues/5555


[BEAM-2899] Decompose Direct Execution Components

Follow this checklist to help us incorporate your contribution quickly and easily:

[x] Make sure there is a JIRA issue filed for the change (usually before you start working on it).  Trivial changes like typos do not require a JIRA issue.  Your pull request should address just this issue, without pulling in other changes.
[x] Each commit in the pull request should have a meaningful subject line and body.
[x] Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue.
[x] Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
[x] Run mvn clean verify to make sure basic checks pass. A more thorough check will be performed on your pull request automatically.
[x] If this contribution is large, please file an Apache Individual Contributor License Agreement.

Specifically, this encapsulates Bundle Execution and Outstanding Work Management
into separate concepts. This enables other implementations to be provided to perform
the physical execution without the scheduling logic also being present.

R: @kennknowles
This is mostly a refactoring of ExecutorServiceParallelExecutor into multiple interfaces and independent components. Logic shouldn't have changed (and given that the TestStream tests still pass, I'm convinced that quiescence properties have been maintained)

retest this please

Jenkins failure is findbugs not liking you ignoring return values.

Run Java Gradle Precommit


update: gcc

Name: gcc
CVEs: CVE-2023-4039
CVSSs: 4.8
Action Needed: update to >= 13.2.1_p20231014
Summary: A failure in the -fstack-protector feature in GCC-based toolchains that target AArch64 allows an attacker to exploit an existing buffer overflow in dynamically-sized local variables in your application without this being detected. This stack-protector failure only applies to C99-style dynamically-sized local variables or those created using alloca(). The stack-protector operates as intended for statically-sized local variables. The default behavior when the stack-protector detects an overflow is to terminate your application, resulting in controlled loss of availability. An attacker who can exploit a buffer overflow without triggering the stack-protector might be able to change program flow control to cause an uncontrolled loss of availability or to go further and affect confidentiality or integrity.
refmap.gentoo: https://bugs.gentoo.org/914070

Fixed in 13.2.1_p20231014.


Chord Qutest DAC

Will this dac going to be supported?

I don't see why not. Can you post the output of
cat /proc/asound/cards
so I might help you create a configuration file.

Looking here it seems that the name of the device is "Qutest", so you might be able to make it work by running:
./configure.sh -n "Qutest"
then start the container using
docker-compose up -d --force-recreate
Watch the logs using
docker-compose logs -f

Hello, did this work?
If so, I might update the documentation and include a sample config file for this DAC. Thank you

I will update you next week, I am on holiday can not check now :)

Hello, have you tried this? If so, I can add sample configurations for others to use.
Thank you

Yes working with Qutest.

But it is strange that I can not get FLAC quality, my bitrate is only 44.1kHz
``Every 2.0s: cat /proc/asound/card0/pcm0p/sub0/hw_params                                                                                mopidy: Mon Aug  5 00:18:35 2024
access: MMAP_INTERLEAVED
format: S32_LE
subformat: STD
channels: 2
rate: 44100 (44100/1)
period_size: 2205
buffer_size: 11025``

Isn't that because tidal just removed all mqa content? This happened just a few days ago. I cannot try right now.
This implementation of tidal connect supports up to 24/48, rates up to 88/96 happen (or used to happen) because of mqa unfolding. I am afraid that with the latest move from tidal we might be limited to 24/48 or even to standard quality.
If hires is important for you, you might want to consider the alternatives listed on the readme.
BubbleUPnP playback to mpd/upmpdcli is cheap and convenient. You might want to use the tidal plugin for upmpdcli and use any dlna/upnp controller like mconnect.
Let me know if this helps or it you need further information.

Yes working with Qutest.

So is "Qutest" the name of the alsa device?

Yes working with Qutest.

So is "Qutest" the name of the alsa device?

correct

Isn't that because tidal just removed all mqa content? This happened just a few days ago. I cannot try right myself now, maybe next week... This implementation of tidal connect supports up to 24/48, rates up to 88/96 happen (or used to happen) because of mqa unfolding. I am afraid that with the latest move from tidal we might be limited to 24/48 or even to standard quality. If hires is important for you, you might want to consider the alternatives listed on the readme. BubbleUPnP playback to mpd/upmpdcli is cheap and convenient. Or you might want to use the tidal plugin for upmpdcli and use any dlna/upnp controller like mconnect. Let me know if this helps or it you need further information.

It seems that upnp will be only choice, Also tried mopidy-tidal still low bitrate. uPnP problem is that when track finished playing next similar song does not start (what is preffered). So will check all alternative solution, maybe you have idea?

Hello, the issue with next track not playing using UPnP depends usually on the fact that the media server is the Phone/Tablet.
If you are using BubbleUPnP, this can be solved by running BubbleUPnP server (a java application, runnable with docker as well): you need to let BubbleUPnP server "manage" your renderer (to be created if using upmpdcli with RENDERER_MODE=UPNPAV or RENDERER_MODE=BOTH) by creating an OpenHome Renderer. The java application will work with the renderer and the mobile app, will retain the playlist so you won't have the issue you have experimented.
Another option, if you want to use the tidal plugin for upmpdcli, is to simply create the renderer using either RENDERER_MODE=OPENHOME or RENDERER_MODE=BOTH. This way, when you use BubbleUPnP to browse the library offered by the upmpdcli media server, and you add tracks to the player, the phone going to sleep (or anything) will not determine the playback to stop. The playlist in this will be retained by the renderer, the phone is not the media server, so we avoid those issues.
About mopidy, it does work with hires at least a few days ago. It uses the same library as the tidal plugin for upmpdcli. The author of the plugin is now the main contributor to that plugin. Have you tried to follow the login instructions here?
It's a bit convoluted but it's generally a one-time only operation.
Other options, well you might try either Roon and Audirvana, they have a trial period. I tried both, no issues.
Lyrion Music Server (was Logitech) also works, maybe limited to standard or up to 24/48, but it works.

Just added the sample config file for the Qutest DAC :-)


Page not found ERROR 404

Describe the issue here.
Wanted to get started with Telegraf, but the link is an error 404
Relevant URLs

Provide relevant URLs
https://docs.influxdata.com/telegraf/latest/introduction/getting-started/

What products and version are you using?

The link was on this page : https://www.influxdata.com/time-series-platform/

Thanks for reporting @m4riu. I just pushed a fix for this. It should go to https://docs.influxdata.com/telegraf/v2.6/get-started/.


New release(s) cannot render old config file

The following configuration file, found here (because it is very large, I haven't included it directly in this issue), no longer works with any of the version 3.1.x builds. It was built with v3.0.1 and we used it in a previous study. The objects start erupting upwards and destroying my carefully crafted design 😢 . I am running the windows versions and interacting through examples/play.py.

@alhasacademy96 I found the issue here. It was in the yaml configuration - I specified too many objects and hadn't noticed. I have since edited the config files at the linked repository and everything works again.
With the old build (i.e., 3.0.2), these extra objects were ignored (hence why I missed them), but in the new builds (3.1.x+), they continue to render and then try to move everything else out of the way. It just means we have to be more careful with how we build configs, but thought that I would note that difference.


Giveaway issues

Add a last picked user to the UI
Update the timer to 0 if it's greater than 0 when a user is picked and close the giveaway

Added in v1.5.3-beta