Ignore top-level .vite output folder

I'm fine with the change since it shouldn't hurt, but I've never seen that folder being generated. Is there a specific condition for this to happen?

Interesting, now I can't reproduce it either. 👀

No idea how I did this. Apparently normally this folder should live in node_modules, and that's where I find it reproducibly now. Closing. 🤷♀


Dependabot - Uncaught Exception in yaml

This is coming through the package dependency on yaml-eslint-parser

I think you can solve the problem by deleting the lock file and reinstalling.


Zei/add pedant for status endpoint/2214

Description
Adding the pedant tests for the/_status endpoint
Issues Resolved
Adds more test coverage for the issue #2214
Check List

[ ] All buildkite tests pass
[ ] Full omnibus build and tests in buildkite pass
[x] All commits have been signed-off for the Developer Certificate of Origin.

Verify Pipeline - https://buildkite.com/chef/chef-chef-server-master-verify/builds/3179
Adhoc pipeline - https://buildkite.com/chef/chef-chef-server-master-omnibus-adhoc/builds?branch=zei/add_pedant_for_status_endpoint/2214


Add pagination controls to the table

We have pagination controls on the table, but they would need to be individually wired to url from each page. Some pages contain multiple tables, so their is no obvious one-solution-fits-all approach.


Updates to the python runtime.

Bunch of cleanups, add metaparticle/Kubernetes support.
@willnewby

If you're looking for a unit testing framework for Python, pytest is good. It's common to use it over the built in unittest module.

Those are some nice improvements @brendandburns. 👍 LGTM

@brendandburns should I close #44? or should we combine these PRs somehow? Alternatively I could break mine up into a few PRs.

@wagoodman ok, this is reabased onto your PR
@willnewby @Riprock
Please take another look.
Thanks!

@wagoodman thanks for the feedback! comments addressed, please take another look.

LGTM!


License?

Hey @cai-michael, very exciting work. What license have you released the code under? Would love to try it out at work. Cheers, J.

Hi @JoshuaMeyers! Sorry about that, I realized I never added a link to the publication which would specify the the Creative Commons Attribution License (CC BY). I've merged a PR which includes the license information in the repo as well as a link to the Frontiers in Immunology paper.
Thanks for pointing this out :)


player invincibility frames

There must be a cooldown on how often the player can get hit by an enemy. Currently the enemy weapon tabs nearly 400 hp/sec, despite its weapon damage being 7.

Make the weapon hitbox disappear after it has hit a player

attack point which only exists in the single frame in which the attack is made. check if point is inside player hitbox


added predict_proba function to Adversarial Debiasing and added new example

Added predict_proba function, which computes predicted scores, to Adversarial Debiasing by splitting predict function in two so Adversarial Debiasing can be coupled with post-processing algorithms such as Reject Option Classification for better performance.

Added new example notebook demo_pre_in_postproc.ipynb as an example to show an algorithm of pre-processing (reweighing), in-processing (adversarial debiasing) and post-processing (reject option classification) working on the same dataset and their results.

Hi, @guillemarsan. Thanks for your PR.
Actually, in AIF360 we don't have predict_proba() functions. Instead, you can modify the scores attribute in addition to or instead of labels in predict(). In this case, I think it would be fine to just add a line:
new_dataset.scores = np.array(pred_labels, dtype=np.float64).reshape(-1, 1)

@hoffmansc, thank you for your message. I will change that and open a new PR.


Fix font scaling issue

Small changes so that scaling via settings are working (see comments).

It looks like @nickmilo has solved the problem himself. Thank you.


Create high-level user/project statistics on Heap

Description
Product usage analytics helps us understand how Kedro is used. This information helps us determine if we have succeeded in developing certain features and gives us a guiding point for identifying if we must improve our approach.
We shipped the first version of Kedro-Telemetry to understand the usage of the CLI and Kedro-Viz. However, we're still missing some high-level information like:

How many Kedro users do we have? The research question is, "How many users identified by username have run at least one CLI command?"
How many users of Kedro-Viz do we have? The research question is, "How many users identified by username have opened Kedro-Viz or run the kedro viz CLI command?"
How many users of Kedro-Viz experiment tracking do we have? The research question is, "How many users identified by username have opened Kedro-Viz and have opened the runsList or experiment-tracking pages on Kedro-Viz?"
How many projects are using Kedro? The research question is, "How many projects identified by project_name have had someone run at least one CLI command from that project?"

All of these values assume that Kedro-Telemetry is installed and activated according to our consent-based workflow.

Context
Some of the complexities of why it is difficult to do this might lie in defining user identities on Heap.

There are two types of properties that Heap recognises, user and event. Properties are bits of metadata that are captured during user interactions with the application. User properties refer to any data related to the user. In contrast, event properties are metadata associated with any actions the user takes.

Here is what I have observed:

On the Heap, a User ID is created, and it is unknown if this field has a 1-to-1 mapping to our username field collected from Kedro-Telemetry. This field generates built-in charts on the Number of Users.
And on our side, we send all of our user properties like username or even project_name as event properties when they might be user properties.

Possible Implementation
There are two parts to this:

How do we have a consistent user identifier on Heap? Can we use the User ID field? Can we send username to replace User ID?
How do we make it possible to create a summative view of projects on Heap? Which may have to look at adding project_name or another project identifier to user properties.

Re: Point 2. This would require some discussion about what is a user. Is a user consistently defined by their username or is a user a username AND project_name.

This was completed in https://github.com/kedro-org/kedro-plugins/issues/50


add weburl identification in the CLI

Description
Adds weburl identificatiotn and unioning in the
cli, for both backup and restore of sharepoint
data.
Type of change

[x] :sunflower: Feature

Issue(s)

#1616

Test Plan

[x] :zap: Unit test

Can you please also post CLI output showing that both backup and restore work with these new selectors since there's no end to end test for it?

Will do when main catches up to this branch.

per request, screenshots of support.  There is a bug: we're not getting sharepoint details (id, url) for all items in the library.  I'll make an issue for that.  But the base functionality works.
backup

details/restore


Update strings.js

Update Italian language! Great Extension!

Thanks a lot for your help.

I'll push a new release in the days ahead. :)


No variable to set AS host:port

What did you expect?
A variable to set the AS host:port.
https://github.com/brocaar/loraserver/blob/master/cmd/loraserver/main.go#L595-L609
What happened?
I was running the servers using Docker and when publishing a message to Loraserver, it is trying to connect to Appserver on <IP_ADDRESS>:8001 (by default) but my Appserver is in another container and there is no EnvVar to set the AS host:port like NS_SERVER EnvVar for setting the host:port for NS.
What version are your using?
Latest version.
Could you share your log output?
loraserver_1       | time="2017-11-22T21:44:09Z" level=info msg="grpc: addrConn.resetTransport failed to create client transport: connection error: desc = "transport: Error while dialing dial tcp <IP_ADDRESS>:8001: getsockopt: connection refused"; Reconnecting to {localhost:8001 <nil>}"

That's defined in the lora-app-server configuration and stored at the loraserver DB in the routing_profile table. The specific flags are --as-public-server for the host:ip part, and --as-public-id for an AS id. You can check the docs on this here: https://docs.loraserver.io/lora-app-server/install/config/

@iegomez it worked, thank you


Shared playlist is empty for everyone after reconnection until something is added/removed in playlist

Describe the bug
When you're alone in the room and you added something to shared playlist, after reconnecting to server shared playlist will be empty for everyone until you change shared playlist (add/remove something).
To Reproduce
Steps to reproduce the behavior:

Start syncplay, connect to room (you need to be alone in the room) and add something to playlist.
Disconnect from network.
After reconnection you will still see playlist items, but anyone who joins will see empty playlist until something is added/changed in playlist.

Expected behavior
Playlist should not be empty for everyone who will join up after the one who updated playlist reconnected to server.
Screenshots
If applicable, add screenshots to help explain your problem.
Version and platform:

OS: Windows 11 Pro
Syncplay version and build type: Syncplay 1.7.0 beta 1
Media player and version:  latest mpv

Additional context
I've reproduced this in windows 11 <-> windows 11 with Syncplay 1.7.0 beta 1, with windows 11 <-> fedora kde 37 in vm with Syncplay 1.6.9 and with windows 11 <-> https://github.com/Reddnek/syncplay-android version 0.10.1

Thanks for the clarity of your bug report. It took me a bit of time to figure out a reasonable way to fix the issue by restoring the playlist when it is appropriate to do so (and not when it isn't), but I think I've got a working solution now.
@soredake Could you please test my proposed fix and and confirm that it resolves the issue: https://github.com/Syncplay/syncplay/actions/runs/4256136168

@Et0h when i tested this build yesterday your fix is worked and playlist is restored after re-connection, but after retesting I've again see empty playlist in vm and syncplay-android, don't know why it's worked yesterday.

@soredake Thanks for the testing. Hopefully this version should work: https://github.com/Syncplay/syncplay/actions/runs/4263298780
When testing, it is important to disconnect for at least 13 seconds to ensure that any 'ghost' version of the original connection have been timed out by the server.

@Et0h disconnected for 5/20 seconds - can see playlist in vm/mobile app, thanks!

This tweak is now included in Syncplay 1.7.0 RC 1: https://syncplay.pl/syncplay-1-7-0-release-candidate-1/

Thank you again for fixing this!


Source control UI improvements

The text labels in the source control view are a little verbose and repetitive because the phrase "Source Control" appears in every section (see the screenshot below). What do you think about simplifying the labels? For example:

Source Control Repositories → Workspace Repositories
Source Control → Repository
Source Control Graph → Graph

Interesting idea. @benibenj as an extension author, when I contribute a view container titled INTERSYSTEMS and a pair of views titled EXPLORER and PROJECTS which by default appear in that view container, then if a user drags either view to a different view container its title there gets prefixed with INTERSYSTEMS: . This is achieved by setting the view contribution's contextualTitle property to InterSystems.

I have submitted a PR for consideration.


Divide-by-zero and division overflow handling

According to the RISC-V spec, divide-by-zero and division overflow won't raise exception. Instead, it will return specific values.

In Jolt DIV, DIVU, REM, and REMU instruction this is not handled. There is AssertValidDiv0Instruction but it seems it is not used.

@moodlezoup Oh thanks! The code already handled that. The Jolt paper didn't mention these AssertValidDiv0Instruction instruction in DIV.
The sequence_output in divu and remu should be updated according to that?
https://github.com/a16z/jolt/blob/0220448cc8d515bbbaf2b9814ef02fd41d5d5261/jolt-core/src/jolt/instruction/divu.rs#L230-L232

Ah yes, nice catch. That method's only used in tests so not super urgent but will make a note to fix!


no errors or partial errors are detected

Description
When there are multiple errors, no errors or partial errors are detected. Here are some examples:
How to Reproduce
single is normal
pragma solidity ^0.8.17;

contract A {
    constructor() {
        /// ==== Unchecked return value from external call. ====
        /// SWC ID: 104
        address(0).call("");
    }
}

only assert is detected
pragma solidity ^0.8.17;

contract A {
    constructor() {
        /// no detected
        address(0).call("");
        /// ==== Exception State ====
        /// SWC ID: 110
        assert(false);
    }
}

nothing detected
pragma solidity ^0.8.17;

interface IERC20 {
    function transfer(address to, uint256 amount) external returns (bool);
}

contract A {
    constructor() {
        /// nothing detected
        address(0).call("");
        IERC20(address(0)).transfer(address(0), 0);
        assert(false);
    }
}

Expected behavior

Screenshots

Environment
> myth version
Mythril version v0.23.15

Additional Environment or Context

How is that possible that this issue is alive? I mean it basically affects the whole functioning of the software.
Is there something that triggers this behaviour or is it like this always for every project? Because I'm not able right now to detect issues in my contracts since the analyzer tells me there is none

Hi @damn1, This is not an issue. This should be under faq.
Can you provide the contract which results in a similar issue? As the issue is likely different.

Calls to contracts without code will result in revert, As mythril will make an onchain call to the blockchain. The contract "0x0" does not have any code (or transfer function), so the call will revert.


no connection to the process when working with a dump

There is no connection to the process when working with a dump. I tried it on three phones. The program simply does not respond. what could be the problem?

Make sure your system is root first. or, install the newest adb and try again.

does any emulator supported ?


RDKTV-32644: Remove ODM specific apis from tvsettings HAL to make it generic- phase1 [24Q4_sprint]

RDKTV-32644: Remove ODM specific apis from tvsettings HAL to make it generic- phase1 [24Q4_sprint]
Reason for change: To make the tvsettings HAL generic
Test Procedure:  as per JIRA
Risks: None
Priority: P1
Signed-off-by: Arjun Binu<EMAIL_ADDRESS>

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


MRTK uses OnValidate to initialize when it shouldn't be loaded

OnValidate is being called, when a blank scene is loaded without MRTK even enabled.
OnValidate should not be using to initialize objects:
NullReferenceException: Object reference not set to an instance of an object
Microsoft.MixedReality.Toolkit.Core.Definitions.MixedRealityCameraProfile.ApplySettingsForOpaqueDisplay () (at Assets/Libraries/Core/Assets/Core/MRTK/MixedRealityToolkit/Definitions/MixedRealityCameraProfile.cs:89)
Microsoft.MixedReality.Toolkit.Core.Services.MixedRealityToolkit.InitializeServiceLocator () (at Assets/Libraries/Core/Assets/Core/MRTK/MixedRealityToolkit/Services/MixedRealityToolkit.cs:181)
Microsoft.MixedReality.Toolkit.Core.Services.MixedRealityToolkit.InitializeInstance () (at Assets/Libraries/Core/Assets/Core/MRTK/MixedRealityToolkit/Services/MixedRealityToolkit.cs:458)
Microsoft.MixedReality.Toolkit.Core.Services.MixedRealityToolkit.OnValidate () (at Assets/Libraries/Core/Assets/Core/MRTK/MixedRealityToolkit/Services/MixedRealityToolkit.cs:548)

What version / branch produces these errors?

@Railboy This one is a migration from our internal bug tracker to GitHub. It was originally filed in February, so it's possible much of this has been mitigated by your work since then.
If I'm remembering correctly, this issue only occurred in a specific project where, after a build, Unity reloaded the scene in the editor and a Toolkit script was trying to reference the camera before it had been reloaded, causing Unity to crash. I've never been able to repro it though.

I don't believe this will be a problem moving forward but for good measure we ought to remove the OnValidate call altogether. I'll do so in PR #4035

Sounds good @Railboy! Will assign this issue to you

Just to clarify, the issue is that OnValidate is being used incorrectly for all of these scripts. Remove them and use Awake() or OnEnable().
If the intent is to validate an object inspector properties, you should be using editor scripts. Additionally, if you are checking Ranges for properties, ensure the appropriate tags are being used.

here is the list of of where we are still using OnValidate:
Find all "OnValidate", Subfolders, Find Results 1, Entire Solution, ""
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit\Utilities\ClippingPrimitive.cs(116):        protected void OnValidate()
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit\Utilities\Lines\DataProviders\BaseMixedRealityLineDataProvider.cs(307):        protected virtual void OnValidate()
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit\Utilities\Lines\DataProviders\ParabolaConstrainedLineDataProvider.cs(53):        protected override void OnValidate()
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit\Utilities\Lines\DataProviders\ParabolaConstrainedLineDataProvider.cs(60):            base.OnValidate();
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit\Utilities\Lines\DataProviders\ParabolaLineDataProvider.cs(24):        protected override void OnValidate()
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit\Utilities\Lines\DataProviders\ParabolaLineDataProvider.cs(26):            base.OnValidate();
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit\Utilities\Lines\DataProviders\RectangleLineDataProvider.cs(79):        protected override void OnValidate()
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit\Utilities\Lines\DataProviders\SimpleLineDataProvider.cs(37):        protected override void OnValidate()
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit\Utilities\Lines\DataProviders\SimpleLineDataProvider.cs(39):            base.OnValidate();
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit\Utilities\Lines\LineFollower.cs(72):        private void OnValidate() => EnsureSetup();
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit\Utilities\Lines\Renderers\MeshLineRenderer.cs(92):        private void OnValidate()
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit.SDK\Features\Audio\Influencers\AudioInfluencerController.cs(207):        private void OnValidate()
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit.SDK\Features\Audio\Influencers\AudioLoFiEffect.cs(94):        private void OnValidate()
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit.SDK\Features\Utilities\Solvers\InBetween.cs(55):        protected override void OnValidate()
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit.SDK\Features\Utilities\Solvers\InBetween.cs(57):            base.OnValidate();
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit.SDK\Features\Utilities\Solvers\Solver.cs(138):        protected virtual void OnValidate()
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit.SDK\Features\Utilities\Solvers\SurfaceMagnetism.cs(165):        protected override void OnValidate()
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit.SDK\Features\Utilities\Solvers\SurfaceMagnetism.cs(167):            base.OnValidate();
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit.SDK\Features\UX\Scripts\Collections\TileGridObjectCollection.cs(98):        protected virtual void OnValidate()
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit.SDK\Features\UX\Scripts\Cursors\CursorModifier.cs(245):        private void OnValidate()
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit.SDK\Features\UX\Scripts\Pointers\LinePointer.cs(84):        protected virtual void OnValidate()
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit.SDK\Features\UX\Scripts\Pointers\ParabolicTeleportPointer.cs(29):        protected override void OnValidate()
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit.SDK\Features\UX\Scripts\Pointers\ParabolicTeleportPointer.cs(31):            base.OnValidate();
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit.SDK\Features\UX\Scripts\Pointers\PokePointer.cs(36):        protected void OnValidate()
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit.SDK\Features\UX\Scripts\Pointers\SpherePointerVisual.cs(34):        public void OnValidate()
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit.SDK\Features\UX\Scripts\Tooltips\ToolTip.cs(339):        protected virtual void OnValidate()
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit.Services\InputSystem\GazeProvider.cs(335):        private void OnValidate()
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit.Services\InputSystem\NearInteractionTouchable.cs(167):        protected void OnValidate()
C:\dev\Unity\Finger Pointer\Assets\MRTK\MixedRealityToolkit.Examples\Demos\Gltf\Scripts\TestGltfLoading.cs(24):        private void OnValidate()


Enable building Apache Beam using Gradle

Follow this checklist to help us incorporate your contribution quickly and easily:

[x] Make sure there is a JIRA issue filed for the change (usually before you start working on it).  Trivial changes like typos do not require a JIRA issue.  Your pull request should address just this issue, without pulling in other changes.
[x] Each commit in the pull request should have a meaningful subject line and body.
[x] Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue.
[x] Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
[x] Run mvn clean verify to make sure basic checks pass. A more thorough check will be performed on your pull request automatically.
[x] If this contribution is large, please file an Apache Individual Contributor License Agreement.

Things that work:

compiling Java/Python/Go code
generating source from protos
generating source from avro
running rat, checkstyle, findbugs, jacoco
building docker containers
running Python tests
shading Java

Partially working:

running Java tests (~99% pass, hcatalog, hbase, hadoop input format tests are having dependency problems because of shaded/unshaded dependencies)
generating maven pom (albeit with wrong dependencies for some subprojects)

Things that aren't done:

running @NeedsRunner/@ValidatesRunner/integration tests

Do we have an equivalent to the enforcer plugin ? By the way, I'm testing the build right now.

FYI, I have a build failure with Gradle 4.3:
FAILURE: Build failed with an exception.

* Where:
Script '/home/jbonofre/Workspace/beam/build_rules.gradle' line: 87

It works fine using gradlew and so Gradle 4.2.x. However, I will take a look for the Gradle 4.3 support.

All builds passed:
https://builds.apache.org/job/beam_PreCommit_Go_MavenInstall/631/
https://builds.apache.org/job/beam_PreCommit_Java_MavenInstall/15565/
https://builds.apache.org/job/beam_PreCommit_Python_MavenInstall/717/
Following changes are only going to be for Gradle build files so we know that the current set of changes don't break the Maven based build.

OK. The only changes I could imagine messing with maven would be the move from ${property} to<EMAIL_ADDRESS>I think we should have some more discussion and review but I'm pretty excited to try it out. Once it is in we can try setting up some additional presubmits that use it, hopefully seeing how much the caching can help for modules that are not touched.

run dataflow validatesrunner

We have some basic unit tests for the property rules in: https://github.com/apache/beam/blob/master/sdks/java/core/src/test/java/org/apache/beam/sdk/util/ReleaseInfoTest.java

Dataflow validates runner tests also passed:
https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/4310/

PTAL

R: @kennknowles

Testing the latest changes. Thanks !

LGTM but I think there have been a couple things that changed since the tests last ran.

I think there is no real downside to rebasing to catch up and find those issues, and squashing anything you want squashed. Mostly I think the commits are OK as-is.

And might as well fork the jenkins job at the same time, so we can get that set up and start gathering experience and data.

I got this merged and updated the build changes so the gradle build is upto sync with all pom changes up to current master.

SUCCESS
--none--


Update dependency versions

This updates all the versions and brings in the latest ngx-widgets.

@joshuawilson fabric8/fabric8-ui:SNAPSHOT-PR-2239-3 is deployed and available for testing at https://fabric8-ui-fabric8-ui-pr-2239-fabric8-planner.badger.fabric8.io


Fix import issue

Fixes Import issue in Text2CoreferenceChains notebook.

Hi,
Make sure you have gone through all the steps in the updated version of readme file. Especially the command line that creates environments for Jupiter "python -m ipykernel install --user --name=env4fcrs".
BR, M.

Thanks Kevin for raising this. As we discussed the experimental part was not supposed to be here.


feat: support bridge FX token by value

Summary by CodeRabbit

New Features

Enhanced bridge call functionality to support ERC20 token conversions.

Bug Fixes

Improved handling of FX coins and bridge denomination coins in various scenarios.

Tests

Added comprehensive tests for converting coins to ERC20 tokens, ensuring robust functionality.

Refactor

Standardized method names for consistency across the codebase.

Chores

Updated test suite setup to include additional bridge token initialization.

@coderabbitai review

mg


Resolve connection failures for FTDI serial ports

In my environment, the DSKY and AGC Monitor would launch but no UI action would materially change any state.
Printing exceptions raised during connection attempts clarified that the board and USB cable combo did not return the expected info, and the application would then loop back to retry the connection.  The lack of state change is due to repeating failures to connect to the FPGA device.
Expanding the list of supported serial port manufacturers to include "FTDI" was sufficient for my system to connect to the configured FPGA and present a usable DSKY and AGC Monitor. No change to the vendor and product identifiers was necessary.

Thanks for the PR! It's kind of a bummer that check doesn't work on your system -- the problem I was trying to solve here is that 0x0403/0x6010 is a default FTDI vendor/product ID, and so if you've got some other thing that isn't a CMOD that shares that ID plugged into your system, the monitor could attach to the wrong device.
On your system, are you able to find any other attributes that would identify your CMOD as definitely a CMOD instead of a generic FTDI device?

There is nothing that appears useful in the QSerialPort attributes, nor in the Windows 11 Device Manager properties for that port. I would have to install the Vivado flow on a Linux  host in order to check if there are system portability issues at play.
Even if we could verify with certainty that the FTDI device was a CMOD, it could potentially be configured with a non-AGC bitstream. Short of an ID handshake with the AGC design on the FPGA, you may need to rely on the operator to select the correct port if there is more than one possible option.

Got it, thanks for checking!


import successfully but checsum failed with wrong delimeter

Bug Report
Please answer these questions before submitting your issue. Thanks!

What did you do? If possible, provide a recipe for reproducing the error.
Genrate data with go-tpc tpcc csv files. Then import data with tidb-lightning delimeter='"'.

What did you expect to see?
Import failed at the very beginning.

What did you see instead?
Failed after a table's checksum stage. When importing a large amount of data, this could be really frustrating for users. They'll wait for a long time to meet the failure

Versions of the cluster

TiDB-Lightning version (run tidb-lightning -V):
$ ./bin/tidb-lightning -V
Release Version: v4.0.3-9-gf18863a-dev
Git Commit Hash: f18863a6efe8ae16c5e84b4d11094c7e485ceb38
Git Branch: master
UTC Build Time: 2020-08-13 06:25:22
Go Version: go version go1.14.7 linux/amd64

TiKV-Importer version (run tikv-importer -V)
(paste TiKV-Importer version here)

TiKV version (run tikv-server -V):
(paste TiKV version here)

TiDB cluster version (execute SELECT tidb_version(); in a MySQL client):
(paste TiDB cluster version here)

Other interesting information (system version, hardware config, etc):

Operation logs

Please upload tidb-lightning.log for TiDB-Lightning if possible
Please upload tikv-importer.log from TiKV-Importer if possible
Other interesting logs

Configuration of the cluster and the task

tidb-lightning.toml for TiDB-Lightning if possible
tikv-importer.toml for TiKV-Importer if possible
inventory.ini if deployed by Ansible

Screenshot/exported-PDF of Grafana dashboard or metrics' graph in Prometheus for TiDB-Lightning if possible

@cyliu0 i don't see setting the delimiter to " is relevant, since abc,def,ghi without delimiter will still be correctly parsed into 3 fields.

@cyliu0 i don't see setting the delimiter to " is relevant, since abc,def,ghi without delimiter will still be correctly parsed into 3 fields.

Yes, but the checksum will not be passed.

please copy the error message here?

[2020/08/12 17:27:11.236 +08:00] [INFO] [split_client.go:289] ["split region meet not leader error, retrying"] ["retry times"=0] [regionID=134120] ["new leader"="id:134121 store_id:1 "]
Error: restore table `test`.`warehouse` failed: checksum mismatched remote vs local => (checksum:<PHONE_NUMBER>818337001 vs 0) (total_kvs: 1 vs 39900) (total_bytes:25 vs 997500)
tidb lightning encountered error:  restore table `test`.`warehouse` failed: checksum mismatched remote vs local => (checksum:<PHONE_NUMBER>818337001 vs 0) (total_kvs: 1 vs 39900) (total_bytes:25 vs 997500

this looks more like unique key violation. are there 39900 warehouses with different warehouse IDs?

I have met this failure and @3pointer  also met it today when run with tpcc data. After update the delimeter from '"' to '' I can run successfully. Maybe this is caused by recent changes, I'll look into this later

i've checked the original source. lightning was invoked with the default mydumper.csv.header = true, but the CSVs generated by go-tpc contains no headers.
[root@localhost data]# head test.warehouse.0.csv
1,DVpWp5N,6wmYWxoy0KX6JuvUM,FQFSqoKNFhMDrU,RKF9v0YrNEPB5,YP,793011111,0.066900,300000.000000
101,qWI2JXA3I,CWM2PGbo4bBRg6TNuN2l,IpOx2EvJE6VuZrOJCN,WdgqzrAX4a27eJt32AO,YJ,277711111,0.008400,300000.000000
201,Hs5OBy,Ci2oZA9apZss5iYERWqm,oR1TYOm3SH81Pjk,MPrSHFtQ4s,FA,725611111,0.178000,300000.000000


How to achieve up and down sliding page

hi，How to achieve up and down sliding page，

Hello,
Can you specify a bit more what you mean? Maybe you need a vertical ViewPager, in this case you can have a look at issues #76 #75 #46 #69 or #70.
Let me know if that's what you're looking for

There is a very simple solution to this, see my comment in another ticket: https://github.com/voghDev/PdfViewPager/issues/46#issuecomment-487297296

Thanks @TomTasche. Closing this due to inactivity & duplicated issue

Hi,
there is an updated version of the vertical_viewpager branch
You can try it using
implementation 'es.voghdev.pdfviewpager:library:1.1.3'
Let me know if it's useful for you


Conditionals seems to be evaluated eagerly

System Info

TensorRT-LLM version: 0.10.0.dev2024050700
(I doubt any other information is relevant)

Who can help?
@kaiyux
Information

[ ] The official example scripts
[X] My own modified scripts

Tasks

[ ] An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
[X] My own task or dataset (give details below)

Reproduction
Modify existing Transformer Decoder block structure to use conditional operation in the following way
    def forward(self, x, ...):
    	router_decision = constant_to_tensor_(True)
    	original = x
    	...
    	x = conditional(router_decision, self.input_layernorm(x), original)
    	x = conditional(router_decision, self.mlp(x), original)
    	...
    	return x

In Qwen case, the forward in QWenDecoderLayer:
    def forward(
        self,
        hidden_states: Tensor,
        attention_mask=None,
        use_cache=False,
        kv_cache_params=None,
        attention_params=None,
    ):
        router_decision = constant_to_tensor_(False)

        original_residual = hidden_states

        hidden_states = conditional(router_decision, self.input_layernorm(hidden_states), original_residual)

        attention_output = conditional(router_decision,
                                       self.attention(
                                            hidden_states,
                                            attention_mask=attention_mask,
                                            use_cache=use_cache,
                                            kv_cache_params=kv_cache_params,
                                            attention_params=attention_params,
                                       )[0],
                                       original_residual)

        if use_cache:
            attention_output, presents = attention_output, None

        hidden_states = conditional(router_decision, original_residual + attention_output, original_residual)

        residual = hidden_states

        hidden_states = conditional(router_decision, self.post_layernorm(hidden_states), original_residual)

        hidden_states = conditional(router_decision, self.mlp(hidden_states), original_residual)

        hidden_states = conditional(router_decision, residual + hidden_states, original_residual)

        if use_cache:
            return (hidden_states, presents)
        return hidden_states

Expected behavior
Changing True to False should lower the model latency by a lot
actual behavior
The latency is constant regardless of router_decision value
additional notes
I’m working on a dynamic token routing implementation for Transformer blocks. These are methods where, during inference, you route tokens either through the block or around the block. See the recent Mixture Of Depths paper for example: https://arxiv.org/abs/2404.02258.
The only way I found so far to implement this in TensorRT-LLM, is using conditional operation from functional.py. Unfortunately, during my experiments, it seems that both branches of conditional are executed eagerly rather than lazily.
In my code, I have a transformer block with structure like:
    def forward(self, x, ...):
    	router_decision = constant_to_tensor_(True)
    	original = x
    	...
    	x = conditional(router_decision, self.input_layernorm(x), original)
    	x = conditional(router_decision, self.mlp(x), original)
    	...
    	return x

So essentially, if router_decision is True, then we do a lot of computation, and if it is False we skip a lot of computation.
In this simplified example, router_decision is constant, while in real code it is data-dependent (calculated using x)
Nevertheless, it seems that it doesn’t matter what is the value of router_decision is, the computation time is the same (and consistent with executing the block, not skipping).
During my experiments, I’ve modified model.py of Qwen model and measured latencies using run.py script. Here are the values of avg. latency:

True: 4.05 sec
False: 4.05 sec
Deleted: 0.76 sec

Where True / False cases refer to the value of router_decision, and Deleted is “forced” skip connection:
    def forward(self, x, ...):
	    return x

Which should have similar latency to the False case.
This result is surprising, since in the TensorRT documentation https://docs.nvidia.com/deeplearning/tensorrt/developer-guide/index.html#work-with-conditionals we can read that conditional operations should be evaluated lazily (unless I’m missing something)
So here are my questions:

Am I abusing conditional operation by setting true_input not as simple tensor but result of some operation ( self.mlp(x) in conditional(router_decision, self.mlp(x), original)). If so, how would you implement this routing?
Are conditionals in TensorRT-LLM always eagerly evaluated?
Can we force them to be lazily evaluated?

It’s not easy for me to isolate the problem, and I’m not sure at which level it even is (conditional implementation in TensorRT-LLM? Some graph rewriting in TensorRT?)
Without lazy evaluation of conditionals, it’s unfortunately impossible to implement dynamic token routing methods in TensorRT, which is a promising research direction.
I can provide you with the code needed to reproduce the results if needed, and I’m happy to help in other ways.

Let me summarize: the issue is that the current API of TRT-LLM cannot efficiently implement real SkipLayer.

@AdamzNV  @ncomly-nvidia  for vis

Following up on this @CrimsonRadiator did you find a way to make this work?
This flow is also required in our project
@nv-guomingz @hijkzzz Any fix yet?

@avianion I didn't find any workaround
Replicating this bug (?) is not straightforward and unfortunately I didn't have time to do so.

It seems that a solution has been found.
You can either use the Class Conditional from commit b777bd6 or refer to its implementation.
https://github.com/NVIDIA/TensorRT-LLM/blob/b777bd64750abf30ca7eda48e8b6ba3c5174aafd/tensorrt_llm/functional.py#L1309
An example of its usage can be found below.
https://github.com/NVIDIA/TensorRT-LLM/blob/b777bd64750abf30ca7eda48e8b6ba3c5174aafd/tensorrt_llm/layers/attention.py#L648
The official documentation states the following:

Instances of IIfConditionalInputLayer can be used to specify which layers are invoked eagerly and which are invoked lazily. This is done by tracing the network layers backwards, starting with each of the conditional outputs. Layers that are data-dependent on the output of at least one IIfConditionalInputLayer are considered internal to the conditional and are therefore evaluated lazily. In the extreme case that no instances of IIfConditionalInputLayer are added to the conditional, all of the layers are executed eagerly, similarly to ISelectLayer.

In other words, you need to use add_input to provide an input tensor to IIfConditionalInputLayer and build the graph from there.
When using the previous conditional method, if you pass self.input_layernorm(x), it seems that the graph output tensor becomes the IIfConditionalInputLayer instead of being traced from x.
x = conditional(router_decision, self.input_layernorm(x), original)
The general structure will look something like this. I achieved lazy evaluation this way.
The following code has not been tested. It applies the Class Conditional implementation.
conditional = default_trtnet().add_if_conditional()
condition = router_decision
if condition.ndim() > 0:
    condition = F.view(condition, [])
conditional.set_condition(condition.trt_tensor)

# Input tensors
original_in_node = conditional.add_input(original.trt_tensor)
original_ = F._create_tensor(original_in_node.get_output(0), original_in_node)
x_in_node = conditional.add_input(x.trt_tensor)
x_ = F._create_tensor(x_in_node.get_output(0), x_in_node)
layernorm = self.input_layernorm(x_)

# Set outputs
x_out_node = conditional.add_output(layernorm.trt_tensor, original_.trt_tensor)
x = F._create_tensor(x_out_node.get_output(0), x_out_node)

Hi @CrimsonRadiator do u still have further issue or question now? If not, we'll close it soon.


XDG Base Directory Support (again)

Follow-up to #389 . I'm running 0.96.6 on Arch Linux. I recently started using the XDG Base Directory Specification. This caused, upon the next launch of musikcube, a new config directory to be created at $HOME/.config/.config/musikcube/ (so it behaved as a fresh launch, ignoring the existing $HOME/.config/musikcube/, and not knowing where the audio files were located.) And that seems to be what's going on in /src/musikcore/support/Common.cpp. I think the extra ".config" is not needed (and hence the whole if block).

This seems to have been resolved by #470.


recommendations for ARM64 Kernel arguments ... ?

Hello @TommyTran732,
for using coreos on a RPI4, could you recommend Kernel Arguments for arm64, or a way to acquire them ?
thank you in advance.

Hi,
I do not have any specific kargs recommendation for them. I just apply every mitigation options available across the board. If a kargs doesn't work for the hardware, then it is just ignored.
If you wanna find more kargs, you have to find them in the kernel docs. Please let me know if you find anything interesting.


No unique users defined

I'm using this code from the documentation, but when generating a graph it doesn't have unique users, just sessions, basically logging the same user multiple times. Missing something here?
amplitude.getInstance().init(api_key, null, {
  useNativeDeviceInfo: true,
});

Hi @ncoelho! The userId must be supplied as the second argument for init(). In the example above null is passed. Alternatively, you can also use setUserId() after init() to assign a user id for the events. More info regarding user id practices can be found here: https://help.amplitude.com/hc/en-us/articles/206404628-Step-2-Identifying-your-users#h_533ee533-f04d-49d3-873f-5836945f43a6


Polymorphic example has a type error with v0.0.13

Bug report
Reproducible example
https://codesandbox.io/s/rough-morning-n75t0?file=/src/App.tsx

Hi @tu4mo the sandbox doesn't seem to reflect the title, would you mind updating it to reflect the issue?
Thanks!

We may have to update the docs to revert to the old recommendation of casting: https://codesandbox.io/s/laughing-kapitsa-98rqk?file=/src/App.tsx

Well, that was embarrassing 😩. I updated the repro.

Thanks for that 👍  We've updated the docs to reflect the latest changes.


Changelog for 0.27.0

[Current coverage][cc-pull] is 87.24%

Merging [#1975][cc-pull] into [master][cc-base-branch] will not change coverage

@@             master      #1975   diff @@
==========================================
  Files           301        301
  Lines         53817      53817
  Methods           0          0
  Messages          0          0
  Branches       5554       5554
==========================================
  Hits          46955      46955
  Misses         5945       5945
  Partials        917        917

Powered by Codecov. Last updated by [d82102b...af236c2][cc-compare]
[cc-base-branch]: https://codecov.io/gh/numba/numba/branch/master?src=pr
[cc-compare]: https://codecov.io/gh/numba/numba/compare/d82102b3a3c9f445838c2042e2463c2e9ce133cf...af236c23475b6757e5a48f6d9989a626cf8304b9
[cc-pull]: https://codecov.io/gh/numba/numba/pull/1975?src=pr


Adding Register and Get RP routes

What is this PR for?
Overview or reasons

We need to register RP in our FIDO Server in order to keep Brazil's Open Finance No Redirect Payments workflow running even with new RP joining the ecosystem.

Tasks

Created two routes: One for registering a new RP and another one to get an registered RP.

Result

The expected result is to be allowed to register new RPs and fetch them from the database.

Bom ponto, Clei! Subi a app e vi que alguma lib já faz esse serviço automaticamente 🤩


Help changing video source.

Hello!
It is not an issue with the demo, but I was wondering what conditions I need to met in order to use other video source . I can see that it has a .m3u8 extension for live stream but I'm having some issues with that. I tried to change the url or even using a local file with .mp4 extension but I have not been able to make it work.
Any advice would be appreciated.

Hello, I believe this demo is restricted to steaming formats like m3u8. If you wanted to use an mp4 with ffmpeg to restream it in another format
I think we also have a demo that uses static video files like mp4


how to  change the svg icon for select field drop down if so how to give svg icon in icon style

Problem description
Link to minimal working code that reproduces the issue

Versions

Material-UI:
React:
Browser:

Please submit support requests and questions to StackOverflow using the tag [material-ui]. StackOverflow is better suited for this kind of support. The issue tracker is for bug reports and feature discussions. See also our CONTRIBUTING guidelines.


Sample Validaton Datasets -- What is Augraphy Trying to Reproduce?

In general, Augraphy is trying to simplify the process of creating synthetic realistic datasets using only ground truth documents.
Often, training data is not accompanied by clean ground truth sources, which leads to inaccurate training and severely limited volumes of available training data.  By starting with clean ground truth data, training sets can be created that represent printed, scanned, copied and faxed documents encountered in the real world AND have 100% accurate training data.
In order to recreate data from these real-world scenarios, we need to create a validation set that is inspired by examples from the real world.  Below are sources that may serve as useful source material for attempting to use Agraphy to reproduce the styles and detail seen in these data sets.

RVL-CDIP dataset consists of 400,000 grayscale images in 16 classes, with 25,000 images per class
https://www.cs.cmu.edu/~aharley/rvl-cdip/

NIST Structured Forms Reference Set of Binary Images (SFRS) consists of 5,590 pages of binary, black-and-white images of synthesized documents from 12 different tax forms from the IRS 1040 Package X for the year 1988. These include Forms 1040, 2106, 2441, 4562, and 6251 together with Schedules A, B, C, D, E, F, and SE.
https://www.nist.gov/srd/nist-special-database-2

Tobacco3482 dataset from Kaggle offers 10 different classes of forms, letters, reports, etc.
https://www.kaggle.com/patrickaudriaz/tobacco3482jpg

NoisyOffice data set from University of California, Irvine contains noisy grayscale printed text images and their corresponding ground truth for both real and simulated documents with 4 types of noise: folded sheets, wrinkled sheets, coffee stains, and footprints.  For each type of font, one type of Noise: 17 files * 4 types of noise = 72 images.
https://archive.ics.uci.edu/ml/datasets/NoisyOffice

FUNSD (Form Understanding Noisy Scanned Documents) dataset on Kaggle comprises 199 real, fully annotated, scanned forms that are noisy and vary widely in appearance.
https://www.kaggle.com/sharmaharsh/form-understanding-noisy-scanned-documentsfunsd

Randomly Collected Documents is a Google Drive share that contains randomly selected public domain documents.
https://drive.google.com/drive/folders/1JMwmRko1gZ_VYtwXkP7CXPPztsNa_3nv?usp=sharing

Creating the style should be feasible, take this example:
https://www.kaggle.com/patrickaudriaz/tobacco3482jpg

From here we can see several matching augmentations, such as page borders, ink bleed, dusty ink and etc. But the content itself could be a problem since it might not be possible if we want to create each of those contents on our own. So maybe we can find some open source digital documents and apply the relevant augmentations to them so that their style is matched?
For example, apply similar style's agumentations to the letter below :

we can see several matching augmentations, such as page borders, ink bleed, dusty ink and etc. But the content itself could be a problem since it might not be possible if we want to create each of those contents on our own

Good point.  We definitely want to have simple and clean inputs that would be representative of something one might have in their ground truth dataset.  In theory, a practitioner would generate the input from text so that the ground truth can be programmatically known in advance, much like you are doing in your "Lorem ipsum dolo" sample notebook.  But, for our test suite, we just need some simple and clean images that could plausibly be generated from a script.
The other consideration is the inclusion of images like the provided sample.

Okay, so i think we can do it either way. If the source document is having certain format, such as formal email, quotation, newspaper and etc, then we need to get digital copy of those documents, or at least having lines or squares to reproduce the document in similar format. Otherwise, generate text from code would be a better choice since it would be more straightforward.

It shouldn't be too hard to write some functions that produce different documents given some strings. We can already easily write strings into images, and if we had a decent specification of some different kinds of documents (where lines should be drawn, where different areas of text should go), we could turn these into classes that produce ground-truthed documents, which could then be fed into Augraphy to produce the larger training set, which will all have ground-truths.
This collection of document-generation classes should probably be its own package though.

I need your help.
We need to identify 5-10 archetypes, or sample documents, that we aim to reproduce using Augraghy.  For each type of sample document, we need to then create a clean version that closely resembles the original document.  This will then allow us to validate how well Augraphy can reproduce the noise we hope to be producing.
For each sample archetype, we can produce a notebook that demonstrates using Augraphy to go full circle, showing how that noise can be synthesized.  The initial notebooks might not look perfect, but they could serve as a sort of starting point for a competition that betters Augraphy towards faithful reproductions of each of these archetypes.
HELP: Can you help identify example documents that show variety in the types of noise and issue seen in these documents?
(Don't worry about creating the clean reproduction -- let's sort out the archetypes first!)
Original Target Document
This example document comes from the RVL-CDIP dataset and represents the kind of noisy document that we intend to reproduce with Augraphy:

Clean Reproduction
This is a reproduction made using Google Documents of what the original document might look like prior to being deteriorated by copying and scanning, etc:

So right now we are only looking at RVL-CDIP dataset right? I need some time to download it since the dataset size is large. As a first step,  I will check through those images and do a compilation of augmentations and their sample image in the dataset. Once i getting sufficient number of samples, i will share the details again here.

So right now we are only looking at RVL-CDIP dataset right?

I’d say any of the sources listed in this issue could be used as a reference for identifying sample documents.  It will likely take a lot of process of elimination work to narrow it down.

I started a collection of representative images we might reproduce. The five currently there were pulled from the Randomly Collected Documents set.
Here's why I like them, as a list of features we can aim to reproduce:
Image 1

The text is faded in many places and to varying degrees
the source document was slightly rotated when scanning
there is a page border effect on one side
some hand-written text is visible on the bottom, and faded on the side.

Image 2

distortion in the top-border
hand-written redaction done with a marker (new effect?)
visible print lines
"snow"/random noise in places around the image

Image 3

the bleedthrough effect is very pronounced here, and importantly the reverse side does not contain the same text as the front
distorted page edges
lighting gradient on page edges
stains
noise along the bottom edge
the texture of the page is apparent

Image 4

tons of noise
redactions
complex page border geometry
multiple styles of handwritten text
stamps!

Image 5

page borders
redactions
punched holes on the top edge!
noise along the top and bottom, noise in the top right
more handwritten text, some of which overlaps printed text

Replication
I think most of what I've listed here is reproducible with existing augmentations; in particular, I think all of the handwriting can be produced by (some straightforward generalization of) the new pencil augmentation, and we can already do serviceable page borders, fading, noise, brightness texturization, bleedthrough, and so on wherever we like.
What we don't have though, is a way to mimic stamps, redaction, or binder holes. We should be able to do binder holes synthetically rather easily, and the challenge with redaction would be correctly placing the mark on the text, but I'm not sure about how to approach stamps without having a collection of them included like the paper textures are. Maybe stamps are out of scope.

Here's the compiled list of images by looking only at rvl-cdip dataset imagesA folder :
https://drive.google.com/drive/folders/17Z4VRqc1w9ZKpjoO3dulSqXTpxPVutMN?usp=sharing
Some are not fully reproducible, i included them here since they look interesting enough.
img_67.png (Not fully reproducible, some augmentations not exist)
https://drive.google.com/file/d/1xJFoZ3XTA45MZ6LtC7sWMWOUGeUhHSKR/view?usp=sharing

Badphotocopy
Dirtydrum (half page with faded effect)
Page border (unique in this case because it is not in the page border)
Scribbles (Numbers) (we don't have this effect yet)
Punch holes (we don't have this effect yet)
Clips' marks (we don't have this effect yet)

img_299.png (Fully reproducible with some changes in the current code)
https://drive.google.com/file/d/17ev5mpuqMWd3l90nPCH9wbkNyekAhzB7/view?usp=sharing

Badphotocopy (Very random noises)
Page border on top

img_34123.png (Fully reproducible with some changes in the current code)
https://drive.google.com/file/d/1T34aLs58_V6xaHB0WfpttFMyyXYDQFB5/view?usp=sharing

Badphotocopy (surrounding the page at page border only)

img_34212.png  (Fully reproducible)
https://drive.google.com/file/d/1ctNWE9Fx7zOlBNfKoFCnRRhDuABu-OAL/view?usp=sharing

Dirty roller
Page borders

img_34462.png (Not fully reproducible, some augmentations not exist)
https://drive.google.com/file/d/1IKAlc0ejGLFKiuKMhnSSPbOfXtM95hEU/view?usp=sharing

Scribbles (words)(we don't have this effect yet)
Page borders

img_109076.png (Not fully reproducible, some augmentations not exist)
https://drive.google.com/file/d/1u1FSbsNYAXcfp3GLD_WkjmSuJpbSt6aB/view?usp=sharing

Incomplete page (torn off?) (we don't have this effect yet)
Page border
Bad photocopy
Punch holes (we don't have this effect yet)

img_136566.png (Fully reproducible)
https://drive.google.com/file/d/1MbcKbPDUNQlcVwFw4GoIPCZLJHcmUXdt/view?usp=sharing

Book binding
Dirty oller (minor)

img_166297.png (Fully reproducible)
https://drive.google.com/file/d/1Z5RAP_DkUMnVAqd2R0g4m2tEGHvjEIGK/view?usp=sharing

Letterpress
Page border (very minor at bottom)

img_171248.png (Not fully reproducible, some augmentations not exist)
https://drive.google.com/file/d/1iYzC3NbfIMMx7GcJ6JQUgOJouC_NM1ek/view?usp=sharing

Blobs of noises (we don't have this effect yet)

img_179298.png (Fully reproducible)
https://drive.google.com/file/d/1kRQarbuQF96tVUndHQUAyBqSFfW3qs0T/view?usp=sharing

Page border
Bookbinding


[ACS] BREAKING CHANGE: az aks nodepool update: Change rejecting the ability to use max-surge with node-image-only

Description

A customer noticed that we do not respect the max-surge parameter when node-image-only is specified. Not an easy case to fix this, so we are instead rejecting this case, and explaining how they can use max surge with it if desired.
Testing Guide

History Notes

[Component Name 1] BREAKING CHANGE: az command a: Make some customer-facing breaking change.
[Component Name 2] az command b: Add some customer-facing feature.

This checklist is used to make sure that common guidelines for a pull request are followed.

[x] The PR title and description has followed the guideline in Submitting Pull Requests.

[ ] I adhere to the Command Guidelines.

[ ] I adhere to the Error Handling Guidelines.

ACS

@charliedmcb Could you please fix the CI issues?

Instead of fixing the bug, the functionality is removed with a breaking change? Absolutely not happy...
By the way, why is this considered ACS instead of AKS?

@krsche
Sorry for the inconvenience. As you found it would require support within the API. This would be a significant change. We would still like to support this. However, as it was currently unfunctional (would drop the max-surge value), with no near-term API fix we made the decision that in this case it was worth blocking the combination of the two values so customer would be made aware this scenario was not working as intended. With the current API implementation, it should not have been exposed as a valid combination to begin with.

By the way, why is this considered ACS instead of AKS? @charliedmcb @yonzhan

This is legacy where ACS was previously used in place of AKS.


Reference to archived depedency

The documentation explaining how to use the node SDK behind a proxy here: https://github.com/IBM/ibm-cloud-sdk-common?tab=readme-ov-file#configuring-the-http-client recommends creating a dependency using this project https://github.com/koichik/node-tunnel/. However, the project is archived and not updated for 6 years. Requiring such as project is against IBM policy as it could introduce security risks. Please, provide a recommendation that we can use for IBM approved projects.

Good catch. That is definitely outdated and should be removed.
It was originally added as a workaround because axios, the underlying HTTP library we use, had a bug that prevented usage in this scenario. That package has been updated a lot since then.
Have you tried to use the SDK behind a proxy lately? I'd be curious to see if a workaround is even still necessary.

A customer we are working with suggested this library: https://github.com/TooTallNate/proxy-agents/tree/main/packages/https-proxy-agent
Does this fulfill all the requirements needed to replace the node-tunnel library and could be officially endorsed by IBM? Any other alternatives available?

@phaumer as discussed internally, yes - that package looks like an ideal alternative. I will open a PR to address this shortly.


[Improvement] Add validating column type in ddl for different format

Search before asking

[X] I searched in the issues and found nothing similar.

Motivation
Current paimon use avro/orc/parquet to store data which only support some of data type in sql. Paimon should validate the data type supported by format in ddl, otherwise the ddl will be successful and writing jobs will fail.
Solution
No response
Anything else?
No response
Are you willing to submit a PR?

[ ] I'm willing to submit a PR!

@hk-lrzy, welcome to contribute. I have assigned this issue to you.


Writing to Socket from Another Thread

Perhaps this is more of an Operating System problem- on Linux, I can spawn another thread and write to a connection using any of the write methods provided. On Windows, it hangs on std.net.Stream.write:
https://github.com/ziglang/zig/blob/cb308ba3ac2d7e3735d1cb42ef085edb1e6db723/lib/std/net.zig#L1863
I'm using the latest version of the library with Zig 0.13.0.
Is this a limitation of the library, of the Zig standard library, of my operating system (Windows) or of something else? What's the suggested way to send messages from a background thread?

The library doesn't do anything fancy with sockets, and I'm under the impression that this type of behavior should be fine on windows. I found this issue which I believe is what you're seeing.

Thanks for the reply, that issue looks likely to be the same since presumably the WebSocket server immediately starts reading before the other thread can start writing. I don't have time to look much into it, so if it's just Zig standard library issue then I guess I'll just use WSL2, which works fine.


Update to 0.16

I have no idea why, but despite the deprecation, pyproto is still needed, otherwise CustomList doesn't work. Additionally, CustomDict is not considered a sequence...

Codecov Report

Merging #25 (26ac099) into main (ec012da) will decrease coverage by 0.18%.
The diff coverage is 95.23%.

@@            Coverage Diff             @@
##             main      #25      +/-   ##
==========================================
- Coverage   80.99%   80.81%   -0.19%
==========================================
  Files           4        4
  Lines        1021     1027       +6
==========================================
+ Hits          827      830       +3
- Misses        194      197       +3

Impacted Files
Coverage Δ

src/de.rs
88.02% <95.23%> (-0.41%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9c1b162...26ac099. Read the comment docs.

Thanks for this!
Regarding the #[pyproto] deprecation, yes, it's a little unfortunate. Half of the pain is in PyO3 and the other half is here in pythonize.
The crux of the problem is illustrated by https://pyo3.rs/latest/migration.html#container-magic-methods-now-match-python-behavior. Both Python and PyO3 now generate containers implementations which satisfy both the "mapping" and "sequence" checks by default. (This is different in the #[pyproto] approach where the differences were explicit.) I would like to add some functionality to PyO3 to tease these apart again.
To deal with this, pythonize should perhaps try the sequence branch, and if that fails, the mapping branch.

@davidhewitt Thanks, that was the problem I could'nt pick between the two sequence/mapping signatures.


if using ordinary Conv2D, or drawing 17 joints in one heatmap, is OK?

1、Do you test the performance if using ordinary Conv2D, not using Conv3D?
您好，请问，在一些NPU上不支持3D卷积，如果不使用3D卷积，而是使用普通的2D卷积，效果如何呢？
2、Do you test If drawing 17 joints or limbs of one frame in one heatmap?The input size is from  K × T × H × W to T × H × W。
请问，如果将某帧的点和肢体都画在一幅图上，是否可行呢？像论文中的为了便于展示将点画在一张图中的Joint stream Input、Limb stream Input图片。

PoseConv3D uses 3D conv for temporal modeling, if replacing it with normal 2D conv, the temporal modeling capability may significantly deteriorate and the recognition accuracy will drop.
It's feasible, but again, it may lead to some performance drop. A better alternative might be reshape the input from K x T x H x W as (K * T) x H x W. You will still get a 2D input but more information can be kepts.


[ISSUE #2935] check kv config should not be null. otherwise broker may fail to start

Make sure set the target branch to develop
What is the purpose of the change
check kv config should not be null.  otherwise broker may fail to start.  see https://github.com/apache/rocketmq/issues/2935
Brief changelog
XX
Verifying this change
XXXX
Follow this checklist to help us incorporate your contribution quickly and easily. Notice, it would be helpful if you could finish the following 5 checklist(the last one is not necessary)before request the community to review your PR.

[x] Make sure there is a Github issue filed for the change (usually before you start working on it). Trivial changes like typos do not require a Github issue. Your pull request should address just this issue, without pulling in other changes - one PR resolves one issue.
[x] Format the pull request title like [ISSUE #123] Fix UnknownException when host config not exist. Each commit in the pull request should have a meaningful subject line and body.
[x] Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
[x] Write necessary unit-test(over 80% coverage) to verify your logic correction, more mock a little better when cross module dependency exist. If the new feature or significant change is committed, please remember to add integration-test in test module.
[x] Run mvn -B clean apache-rat:check findbugs:findbugs checkstyle:checkstyle to make sure basic checks pass. Run mvn clean install -DskipITs to make sure unit-test pass. Run mvn clean test-compile failsafe:integration-test  to make sure integration-test pass.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

Coverage increased (+0.2%) to 54.062% when pulling 5829fbd44965ed6d2559302f7ec5a1dd5b2a9de1 on yuz10:develop3 into 3e1d5015c6a0aa8b2fc1a5653f1e42088f2d1fc5 on apache:develop.

Coverage increased (+0.2%) to 54.062% when pulling 5829fbd44965ed6d2559302f7ec5a1dd5b2a9de1 on yuz10:develop3 into 3e1d5015c6a0aa8b2fc1a5653f1e42088f2d1fc5 on apache:develop.


RQL4

Use the preview tab to see the example given below. Edit the relevant information and preview the changes before submitting. You may delete these instructions.

Key
Value

ID
RQL4

Source
Vaaran Bhai Gurdas Ji

Page
28

Line
gur isKI imil swDsMig; sbd suriq jgu duqru qrxw [

Correction
THIS ≠ THAT

PROOF (EDITION)
Image:

Correction:
gur isKI ≠ gurisKI
Proof:
Vaaran Bhai Gurdaas Ji | November 2011 | Shamsher Singh Ashok | SGPC, Sri Amritsar
Image:


PLANNER-609 Replace CompareToBuilder with Comparator in optaplanner-benchmark

This also contributes to removal of commons.lang3 (https://issues.jboss.org/browse/PLANNER-539)

Can one of the admins verify this PR? Comment with 'ok to test' to start the build.

Can one of the admins verify this PR? Comment with 'ok to test' to start the build.

ok to test

To fix the naming issues that this PR exposed, I did this commit:
http://github.com/droolsjbpm/optaplanner/commit/1e7bccb8b


Update to Kafka <IP_ADDRESS>

Any thoughts on the delta between Kafka 0.8 and 0.9?  I'm looking to use Kafka 0.9 + melena so if there isn't already progress we might send in a PR - any experience you already have on this path would be appreciated.

The library works as-is with 0.9, but doesn't take advantage of the new protocols introduced in 0.9 (in particular the new-style groups). If you're using it to consume it's similar to the low-level 0.8.* consumer. I am actively working on implementing the new group protocols, so keep an eye out for those! I'll try to push a branch soon, and comments and PRs are welcome.
Sorry that development is so slow. This is a free-time only project and that free time is pretty much just on the bus!

I'll also update the readme to clarify support.

Great to hear, thanks @tylerholien for the information and library.


added merge without extra space.cpp

Description
Please include a summary of the change and which issue is fixed. List any dependencies that are required for this change.
Fixes #1817
Replace 1817 with the issue number which is fixed in this PR
Type of change
Please delete options that are not relevant.

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update
[ ] Documentation Update

Checklist:

[x] My code follows the style guidelines(Clean Code) of this project
[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas
[ ] I have created a helpful and easy to understand README.md
[ ] I have made corresponding changes to the documentation
[x] My changes generate no new warnings
[ ] I have added tests/screenshots(if any) that prove my fix is effective or that my feature works

@geekySapien add test cases


Feature Concept: recommended bar extra options for ease of discovery

PR Checklist

Please check all that apply to this PR using "x":

[X] I have checked that this PR is not a duplicate of an existing PR (open, closed or merged)
[ ] I have checked that this PR does not introduce a breaking change
[ ] This PR introduces breaking changes and I have provided a detailed explanation below

PR Type
What kind of change does this PR introduce?

[ ] Bugfix
[X] Feature
[ ] Code style update (formatting)
[ ] Refactoring (no functional changes)
[ ] Documentation changes
[ ] Other - Please describe:

Fixes
Issue Number:
What is the current behavior?
Recommended bar could be improved to ease discovery in less clicks for the user
What is the new behavior?
Added extra options for the recommended bar to allow for discovering more specific related content based on channel or tags, as shown in the pics:

Comparison to that one popular Odysee Alternative from Web2.0:

The main difference being that the odysee alternative platform doesn't allow to filter tags
Other information
This is a concept I've been testing on the weekend, there are some styling issues like if the channel name is too big you can't expand

Wow, this is a great start and good place to add improvements! For tag searches, are you using claim search?

Wow, this is a great start and good place to add improvements! For tag searches, are you using claim search?

Thanks! I just used a claim list discover with the selected tag as filter, so it's the same as going to each tags page, but faster and with less clicks

Yes, that's awesome! Maybe it can default to trending sort, and then let users change new/top also.
This would be a great one to add soon also: https://github.com/lbryio/lbry-desktop/issues/5181 (there's some other search improvements in another PR too).

Yes, that's awesome! Maybe it can default to trending sort, and then let users change new/top also.
This would be a great one to add soon also: #5181 (there's some other search improvements in another PR too).

You mean like this?

I had hid the filters so it doesn't look too different from before

this is a really cool idea but will need a style/UX pass from @seanyesmunt

This is great! For now lets just start with one category "more from". Then we don't have to worry about expanding the section for more categories. Once those are removed I will push up a commit to do some styling to this new section.
Thank you for the PR! This will be great to have 🙂

Done, and thanks for the feedback!!

I added your commits to this branch so I could rebase
https://github.com/lbryio/lbry-desktop/pull/5847
Will merge once the build completes


ARROW-9781: [C++] Fix valgrind uninitialized value warnings

@github-actions crossbow submit test-conda-cpp-valgrind

sounds good to me

The failed compute case is running with SimdLevel::AVX512(4), probably Valgrind doesn't support AVX512?
==5971== Your program just tried to execute an instruction that Valgrind
==5971== did not recognise.  There are two possible reasons for this.
==5971== 1. Your program has a bug and erroneously jumped to a non-code
==5971==    location.  If you are running Memcheck and you just saw a
==5971==    warning about a bad jump, it's probably your program's fault.
==5971== 2. The instruction is legitimate but Valgrind doesn't handle it,
==5971==    i.e. it's Valgrind's fault.  If you think this is the case or
==5971==    you are not sure, please let us know and we'll try to fix it.
==5971== Either way, Valgrind will now raise a SIGILL signal which will
==5971== probably kill your program.

Thanks.
We can work on the issue as a separated task. (We will disable the test with valgrind or disable AVX512 for valgrind build.)
I'll merge this.

I've bumbed the valgrind version in the conda forge feedstock, perhaps that will help.


Problem with Kibana liveness probe

We have a pretty complex readinessProbe in Kibana: https://github.com/sighupio/fury-kubernetes-logging/blob/master/katalog/kibana/kibana.yml#L49
I'm facing some issues with it, kibana is not ready, but it's ok if i try to port-forward to it.
The problem is that we are trying to put automatically the index patterns, but this causes kibana to ask elasticsearch, and this way we have a readiness that is dependent to another service
Can we remove or rethink this readinessProbe?

@nutellinoit  Does #40 solve this issue? Shall we close this in that case?


e2e tests for endpoints that send emails

Spinning up a SMTP server to catch emails for the api specific tests seems excessive, but some e2e tests would be good.
The endpoints that we should test are

[ ] /update-my-email
[ ] /user/report-user/
[ ] /certificate/verify

Can I work on this issue @raisedadead ?

IDEA: fake SMTP Server using mailhog or something else
https://medium.com/kreuzwerker-gmbh/e2e-testing-of-emails-in-mailhog-using-cypress-72ccb722bad7

While this will be useful, it's not strictly necessary for the MVP, so I'm moving it.

I think we can add a help wanted label here if someone wants to give it a try.

I do see tests for both of these endpoints. Unless we need further or more thorough testing, I can't think of anything that needs done with the endpoints.
https://github.com/freeCodeCamp/freeCodeCamp/blob/60d84b96486478370b890bd3209f68c6872d1579/api/src/routes/protected/certificate.test.ts#L25-L30
https://github.com/freeCodeCamp/freeCodeCamp/blob/60d84b96486478370b890bd3209f68c6872d1579/api/src/routes/protected/settings.test.ts#L349-L390

Those just test the api in isolation, rather than involving the client. There's an example of a true e2e test here:
https://github.com/freeCodeCamp/freeCodeCamp/blob/81b82e17c924fc6ab853eac1f46f341873298c6b/e2e/report-user.spec.ts#L14-L47

I'm confused. Do we have an update my email test?
https://github.com/freeCodeCamp/freeCodeCamp/blob/main/e2e/update-email.spec.ts

We do, but it doesn't go through the entire email update flow. It would need to inspect the email sent by the api to do so.


Julia: problem with symengine and exponentials ?

The following example raises an error when run with SymEngine activated.
type dummytype
end

eqs = [:(1/exp(a)+b)]
args = [(:a,0)]
parms = [:b]

using Dolang

println( make_method(Der{1}, dummytype, eq, args, parms) )

code = make_method(Der{1}, dummytype, eq, args, parms, funname=:fun)
f = eval(code)

a = [1.0]
b = [0.0]

f(Der{1},dummytype(),a,b)      # doesn't work

By looking at the generated code, it appears that Symengine transforms exp(x) into E^x . I don't know if it's supposed to be a bug of symengine, nor what is the right way to fix it. As a quick fix one could define E as e in all functions. Are there other similar transformations ?

Sorry I don't have symengine on my machine currently so I don't know what the error message look like. I'll add it later if needed.

Very good catch.
I looked in SymEngine.jl and it seems that the problem is known and they have a way around it: https://github.com/symengine/SymEngine.jl/blob/44c617328b31e340c2fa384eb4bdc47a85f41d8f/src/subs.jl#L29-L61
See the example:
julia> b = Basic(:(sin(x) + exp(y)))
E^y + sin(x)

julia> SymEngine.walk_expression(b)
:(e ^ y + sin(x))

We just need to call the walk_expression function on all of our SymEngine.Basic types to get the correct Julia version of the corresponding expressions

Fixed in 3164b1ddb621e9f3bac433a452dcb588241cf489
See below:
julia> type dummytype
       end

julia> eqs = [:(1/exp(a)+b)]
1-element Array{Expr,1}:
 :(1 / exp(a) + b)

julia> args = [(:a,0)]
1-element Array{Tuple{Symbol,Int64},1}:
 (:a,0)

julia> parms = [:b]
1-element Array{Symbol,1}:
 :b

julia> using Dolang

julia> println( make_method(Der{1}, dummytype, eqs, args, parms) )
begin
    function anonymous!(::Dolang.TDer{1},::dummytype,out,V,p)
        begin
            if size(out) != (1,1)
                msg = "Expected out to be size $((1,1)), found $(size(out))"
                throw(DimensionMismatch(msg))
            end
            fill!(zero(eltype),out)
        end
        begin
            begin
                _b_ = p[1]
            end
            begin
                _a_ = V[1]
            end
            begin
                out[1] = -1 * e ^ (-1_a_)
            end
            return out
        end
    end
    function anonymous(::Dolang.TDer{1},::dummytype,V,p)
        out = zeros(Float64,(1,1))
        begin
            begin
                _b_ = p[1]
            end
            begin
                _a_ = V[1]
            end
            begin
                out[1] = -1 * e ^ (-1_a_)
            end
            return out
        end
    end
end

Thanks, no idea what your code does though...

Instead of just inserting the string version of SymEngine's representation of each expression (the one with the E), we now use their utilities to map SymEngine expressions into valid Julia expressions (i.e. their utilities know to replace E with e).
This is what that SymEngine.walk_expression function does


Create new repertory for selected files

Description of the new feature / enhancement
Create a new folder for selected files on file explorer
Scenario when this would be used?
I select file on explore and with right clic got an option to create a new repertory with those files
Supporting information
No response

/dup #3569


Cron API is not documented for alerting

We had a question on the forums with regards to setting up an alert to run at a specific time - the answer was, of course, cron.
On the API page all examples of schedule are using period/interval and none use cron/expression.
The Cron expression reference shows how to write cron patterns (useful, although not unique to this software), but it doesn't show how you use this in context of the alerting plugin.
I had to setup an alert in Kibana with a cron pattern then look at the response in the DevTools api to find the proper JSON syntax - the average user would not do this.

Looks to be included as part of https://github.com/opendistro/for-elasticsearch-docs/pull/463


Reuse PluginDiscoveryService more to improve performance, especially when PluginSettingsService is used

Migrated from GitLab: https://gitlab.com/meltano/meltano/-/issues/2159
Originally created by @DouweM on 2020-07-10 21:15:23

View 2 previous comments from the original issue on GitLab


What is the different between astro and hbase-spark ?

https://github.com/apache/hbase/tree/master/hbase-spark
I find Hbase do something with Spark.

@guotong1988 hbase-spark module provides the Hbase API level integartion to Spark RDD. There is no support of SQL in that module. But Astro provides SQL layer over Hbase through Spark.

@guotong1988 , please add label for issues, it would be more convenient to view for other users.

@guotong1988 Astro provides SQL support on HBase, and various query optimization like region pruning, scan skip, aggregation pushdown by coprocessor. The goal of this project is to provide a faster access mechanism from Spark to HBase and introduce Spark ecosystem libraries to HBase, like MLlib.

Note that HBase-Spark now supports Spark SQL (https://issues.apache.org/jira/browse/HBASE-14181). The only added value I see for Astro it that has Python bindings.


Typo in .yarnrc.yaml

set to "node-modules" if need to edit 3rd party
dependencies for debugging purposes
nodeLinker: "node-modules"
is currently "node_modules"

closed in #1430


How to localize?

First of all you have build an amazing datepicker. It works fast, very well and looks excellent. I have however not been able to understand how to localize the months and days.
By checking the storybook implementation I have seen, that you are using a function to get the labels. Is this function provided by the library or do I have to provide the labels in another way? In which format would I have to provide the labels?
I understand that it might be something coming from the hooks library and probably the functions  dayLabelFormat, weekdayLabelFormat and monthLabelFormat. If that assumption is correct could you specify how to use these functions?
If I fully understand the process I could also write a little more documentation and submit a pull request, because this might be the hardest implementation aspect of this excellent component.

Thank you.
You pass the phrases as an object. DayLabelFormat, weekdayLabelFormat, and monthLabelForm, these are functions (callbacks) that take a date as an argument and return a string - formatted label. Below is an example with date-fns, but you can also use a moment or you can format labels by yourself.
Here is an example:`
import {es as locale} from 'date-fns/locale'
import {format} from 'date-fns'

function Test() {
  return (
    <DateRangeInput
      ...otherProps,
      displayFormat={displayFormat}
      phrases={{
        datepickerStartDatePlaceholder: 'Seleccionar',
        datepickerStartDateLabel: 'Fecha de inicio:',
        datepickerEndDatePlaceholder: 'Seleccionar',
        datepickerEndDateLabel: 'Fecha de inicio:',
        resetDates: 'Deshacer',
        startDateAriaLabel: 'Fecha de inicio',
        endDateAriaLabel: 'Fecha de inicio',
        startDatePlaceholder: 'Fecha de inicio',
        endDatePlaceholder: 'Fecha de inicio',
        close: 'Cerca',
      }}
      displayFormat={text('displayFormat', 'MM/dd/yyyy')}
      dayLabelFormat={(date: Date) => format(date, 'dd', {locale})}
      weekdayLabelFormat={(date: Date) => format(date, 'eeeeee', {locale})}
      monthLabelFormat={(date: Date) => format(date, 'MMMM yyyy', {locale})}
    />
  )
}

Here is a list of all possible phrases click

Thank you so much :) This worked for me. I guess my problem was more with how date-fns handles localization and less about this library after all.
Are you interested in a pull request which takes your answer and maybe a link and small explanation of a date-fns example to extend the Readme?

Yes, of course.


Add collect.sh usage to JUnit XML upload doc

This is an initial attempt at using a convenience script to upload JUnit XML results to the Test Analytics API. curling into Bash feels a bit dodgy, which I haven't addressed, but otherwise this shows the convenience method, then fills out the details by retaining the docs of doing it the hard way. More on this soon.

To do here:

[ ] Expand jq dependency details
[ ] Expand CI environment variable detection details

I decided to defer dealing with environment variables in more detail. It's something that I think needs more refactoring for Jest, etc., so I'm going to kick that can a little bit.

I know so much work has gone into this one! 💚 But I'd recommend we hold off on this, given we have the new jq'less way of uploading, https://github.com/buildkite/test-collector-junit/pull/4, and a Buildkite Test Collector Plugin on the way.

Closing this for now, to avoid confusion.


Make popularity score based on 7 day window so we don't have to load all bets

@jahooma do you think this is reasonable? If not, we can add a 3-day metric for unique bettors on the contract. But I figure maybe 7 days is just as good for this purpose anyway.

Hmm, I don't think that would be good, in fact, I think the trending algorithm should go in the other direction.
How about sorting by unique traders in the last 24 hours?
To solve for some groups where many markets would have 0 traders in this timeframe, you could add 1/10 of the 7-day traders.

Hmm, I don't think that would be good, in fact, I think the trending algorithm should go in the other direction.
How about sorting by unique traders in the last 24 hours?
To solve for some groups where many markets would have 0 traders in this timeframe, you could add 1/10 of the 7-day traders.

OK, if that's what you think is good I will happily implement it like that.


[Bug] Python incremental models hang on invocation, never submit to dataproc

Is this a new bug in dbt-bigquery?

[X] I believe this is a new bug in dbt-bigquery
[X] I have searched the existing issues, and I could not find an existing issue for this bug

Current Behavior

We've noticed lately that when a python incremental model is run in our CICD pipeline, sometimes it will hang indefinitely & never submit a job to dataproc. We haven't been able to identify why this happens in some invocations, but not others & this seems to be unique to incremental python models.

Expected Behavior

Run the python incremental model
See in logs: BigQuery adapter: Submitting batch job with id: ...
See in logs: created python incremental model ...

Steps To Reproduce
When running dbt run --target=unit-test --exclude tag:unit-test-new with a python incremental model caught in the result, the job will never be submitted & instead hang in invocation indefinitely.
Relevant log output
No response
Environment
- OS: debian:11-slim
- Python: 3.11
- dbt-core: 1.7.10
- dbt-bigquery: 1.7.6

Additional Context
The failing model also has these config properties
  materialized: incremental
  incremental_strategy: merge

We have started seeing this too ever since we got Python models working again with the latest regression fixes (batch ID and nested data structures). However, our problem is not just limited to incremental models. Like @nickozilla mentioned, dbt reaches the Python model in the execution stream and then just hangs without ever submitting a Dataproc job. We have tried to debug this further by turning on the debug flag, but this does not display anything useful. It will just reach the Python models, output the Python code in log output, and then the process hangs indefinitely until killed.
We have tried setting the various timeout configuration options to at least timeout these specific jobs and noticed this has no impact either. The dbt process will always hang here which suggests that there is no mechanism in place to gracefully handle Dataproc failures, and/or the Dataproc code itself is blocking the main dbt process from continuing when submitting Dataproc jobs.
Additional info:

python: 3.10.7
dbt-core: 1.7.11
dbt-bigquery: 1.7.7
Dataproc environment: serverless batch jobs

For us, the job submits but if there is an error in the job (e.g. in my case there was a JSON column and apparently that's not supported for writing to BQ), then dbt hangs and does not continue afterwards.
Not great for production, where we want it to behave like a normal failure and continue so that the post-run alerting will run.

Hi folks! I was curious when you started to noticed this? I'm curious if there was actually a change on the Datapoc side rather than dbt.


deadlock in WPF

.net 5 wpf client
    private async Task<int> Test()
    {
        return await proxy.Sum(10, 5).ConfigureAwait(false);
    }
    private  void Button_Click(object sender, RoutedEventArgs e)
    {
        var ttt = Test().Result; // deadlock.
        MessageBox.Show(ttt.ToString());
    }

.net 5 grpc service
public  Task Sum(int a, int b)
{
return Task.FromResult(a + b);
}
how to fix it?.  thanks

Thank you for the bug report.
The bug is in the ServiceModel.Grpc client call implementation: attempt to marshal the continuation back to the original captured SynchronizationContext. It leads to deadlock when you make a call from WPF main thread.
Deadlock also can be reproduced by the following code:
    private async Task<int> Test()
    {
        await Task.Delay(1000);
        return 1;
    }
    private  void Button_Click(object sender, RoutedEventArgs e)
    {
        var ttt = Test().Result; // deadlock
        MessageBox.Show(ttt.ToString());
    }

Fix for ServiceModel.Grpc comes in 1.3.2 version.
How to fix in your code:
variant 1
you code expects "blocking unary call", so change contract accordingly:
    // grpc service
    public int Sum(int a, int b) => a + b;

    // WPF
    private  void Button_Click(object sender, RoutedEventArgs e)
    {
        var ttt = proxy.Sum(10, 5); // blocking unary call
        MessageBox.Show(ttt.ToString());
    }

variant 2
make button click handler async:
    private async Task<int> Test()
    {
        return await proxy.Sum(10, 5).ConfigureAwait(false);
    }
    private async void Button_Click(object sender, RoutedEventArgs e)
    {
        var ttt = await Test();

        // identical call
        //// var ttt = await Test().ConfigureAwait(true);

        MessageBox.Show(ttt.ToString());
    }

details and explanation are here.

The fix for ServiceModel.Grpc is released in 1.3.2.

The fix for ServiceModel.Grpc is released in 1.3.2.
just now ,i already succeeded run the code .

thank you very much.


Fixed HLine/VLine invert_axes

Straightforward fix for #1475 along with unit tests.

Looks good. Merging.


Resolution for Linux customer_testing being marked bringup: true

In https://github.com/flutter/flutter/issues/154251 we are tracking that customer_testing has started to become significantly flaky, both in pre and post-submit:

Recent runs on post-submit
Pre-submit today (example, example)

Even for successful runs, we're within single minutes of the 30m timeout.
This test is valuable as it serves as a signal of accidental breaking changes of the Flutter SDK, as well as a smoke test of the impact of intentional breaking changes (and resolutions for them). At the same time, we don't have dedicated ownership for many of our infra tasks at the moment, including this one.
In order to not block the larger team, we'll be temporarily moving the task to bringup: true pending a prioritization decision.

Closing this as a duplicate of https://github.com/flutter/flutter/issues/154251.


🐛 Bug Report: CORS not allowed by web-browsers 🐛

👟 Reproduction steps
When I try to make user auth requests on http on my appwrite server which has different web address then my production one it gives me XLMHttpRequest Error.
And I dug a little into this and found that there are some rules that most of the modern browsers have is CORS policy to prevent the webpages to make request to different origin addresses.
👍 Expected behavior
Should auth users.
👎 Actual Behavior
Not authenticating users. and giving  XLMHttpRequest Error.
🎲 Appwrite version
Version 2.0.x
💻 Operating system
Linux
🧱 Your Environment
I use everythign stock, stock ubuntu 22, ann all everything.
👀 Have you spent some time to check if this issue has been raised before?

[X] I checked and didn't find similar issue

🏢 Have you read the Code of Conduct?

[X] I have read the Code of Conduct

@hemangjoshi37a thanks for creating this issue! 🙏🏼 Have you registered your app by adding the flutter platform? FYI, for now, you should register a web app since there's a bug with flutter-web.

@hemangjoshi37a thanks for creating this issue! 🙏🏼 Have you registered your app by adding the flutter platform? FYI, for now, you should register a web app since there's a bug with flutter-web.

I dont know about any registration . What kind of registration we are talking about? How to do it? can you give me any link to this documentaion or any steps you can suggest Please.

@hemangjoshi37a by registration, we mean adding platform as described here in the docs
https://appwrite.io/docs/getting-started-for-flutter#addYourPlatform

@hemangjoshi37a, anything else you need, or can this be closed now?

@hemangjoshi37a, anything else you need, or can this be closed now?

Ok can be closed


fail if any additional tasks fail. fixes #138

I'm just a spectator (I was about to create my own merge request when I've saw yours), but I don't think it's necessary to store the tasks in an associative array. A simpler var promisedTasks = []; and promisedTasks.push(run( ... )); would do the trick.
Another improvement: the entire runTasks method can be simplified to something like this:
    function runTasks(taskName) {
      var tasks = options[taskName];
      var promises = [];

      if (tasks.length) {
        grunt.log.ok('running ' + taskName + ' ');
        if (!nowrite) {
          for (var i = 0; i < tasks.length; i++) {
            promises.push(run('grunt ' + tasks[i], '-> ' + tasks[i]));
          }
        }

      return Q.all(promises);
    }

No need for the Q.fcall wrapper because the Q.all will return a promise too.

feel free to resolve merge conflicts and we'll get this pulled in.

@dorgan Hello, I recreated the merge request (with my own style), please review that: https://github.com/geddski/grunt-release/pull/155


Splitting apart OSF portion of TCGA

The OSF portion of TCGA data currently breaks the consensus of how each MAE dataset is structured. It should be considered, if the OSF data should be kept along as a separate MAE-entity, harmonizing the presentation of each dataset. Further, the added value of OSF over conventional TCGA dataset should be clearly reported, to avoid i.e. duplication of samples if user uses both datasets.

OSF: TPM-normalized superior method of normalization
CBio's median: Conventional approach but already breaks few assumptions for e.g. few immunedeconv methods

We've moved on to using GDC's HTSeq FPKM-UQ instead of OSF dataset.


Vickel: Watch (?-i:HwUU01xj)(?#cutt.ly)

Vickel requests the watch of the watch_keyword (?-i:HwUU01xj)(?#cutt.ly). See the MS search here and the Stack Exchange search in text, in URLs, and in code.

(?-i:HwUU01xj)(?#cutt.ly) has been seen in 1 true positive, 0 false positives, and 0 NAAs.

Approved by Jeff Schaller in Charcoal HQ


Pip install causing infinite loop on centos

Describe the bug
When I run a pip install awswrangler==2.0.0 on centos, I get into (assumed) infinite loop. I have attached the pip output that executed prior to killing the command.
To Reproduce
On CentOS, run pip install --upgrade awswrangler
pip_output.txt
P.S. Don't attach files. Please, prefer add code snippets directly in the message body.

Which is you python and pip versions? Is pip updated? Did you try creating a fresh and clean virtual environment?

I was using a fresh environment. I developed on a windows machine without issue, but my build environment is CentOS which is ephemeral so each build is clean.
Python version:
Python 3.6.9
Pip version:
pip 20.3

Thanks @rpmchale
Just for troubleshooting purpose, could you try to install pymysql directly?
pip install pymysql

Ran without issue
Collecting pymysql
Downloading https://company.com/artifactory/api/pypi/vpypi-eval/packages/packages/1a/ea/dd9c81e2d85efd03cfbf808736dd055bd9ea1a78aea9968888b1055c3263/PyMySQL-0.10.1-py2.py3-none-any.whl (47 kB)
|################################| 47 kB 1.0 MB/s
Installing collected packages: pymysql
Successfully installed pymysql-0.10.1

Hi @rpmchale. We've just released the 2.3.0 version with support for pymysql version 1.0.*. Could you test it in your scenario, please?

Hi @rpmchale. We've just released the 2.3.0 version with support for pymysql version 1.0.*. Could you test it in your scenario, please?

Closing by inactivity.

Closing by inactivity.


Add OpenAPI JSON handlers using go:embed

Pulling out the openapi.json routes that didn't work (file wasn't present in the actual container, only the build container. oops).
Using go:embed makes this pretty nice since it all just gets embedded into the binary. We can follow the same pattern for each openapi version we want to support.

/retest

/retest