HSEARCH-3510 Pass dsl or projection option to make a field "raw".

https://hibernate.atlassian.net/browse/HSEARCH-3510
Reopening #1921.

Pull Request Test Coverage Report for Build 1

227 of 246 (92.28%)  changed or added relevant lines in 58 files are covered.
12 unchanged lines in 6 files lost coverage.
Overall coverage decreased (-0.03%) to 88.66%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

backend/elasticsearch/src/main/java/org/hibernate/search/backend/elasticsearch/types/sort/impl/ElasticsearchStandardFieldSortBuilderFactory.java
6
7
85.71%

backend/lucene/src/main/java/org/hibernate/search/backend/lucene/types/predicate/impl/AbstractLuceneStandardFieldPredicateBuilderFactory.java
4
5
80.0%

backend/lucene/src/main/java/org/hibernate/search/backend/lucene/types/sort/impl/AbstractLuceneStandardFieldSortBuilderFactory.java
8
9
88.89%

engine/src/main/java/org/hibernate/search/engine/search/dsl/projection/spi/DelegatingSearchProjectionFactoryContext.java
0
2
0.0%

backend/elasticsearch/src/main/java/org/hibernate/search/backend/elasticsearch/types/sort/impl/ElasticsearchFieldSortBuilderFactory.java
0
3
0.0%

backend/lucene/src/main/java/org/hibernate/search/backend/lucene/types/predicate/impl/LuceneFieldPredicateBuilderFactory.java
0
3
0.0%

backend/elasticsearch/src/main/java/org/hibernate/search/backend/elasticsearch/types/sort/impl/ElasticsearchGeoPointFieldSortBuilderFactory.java
0
4
0.0%

backend/lucene/src/main/java/org/hibernate/search/backend/lucene/types/sort/impl/LuceneGeoPointFieldSortBuilderFactory.java
0
4
0.0%

Files with Coverage Reduction
New Missed Lines
%

backend/elasticsearch/src/main/java/org/hibernate/search/backend/elasticsearch/types/sort/impl/ElasticsearchStandardFieldSortBuilderFactory.java
1
85.19%

backend/lucene/src/main/java/org/hibernate/search/backend/lucene/types/sort/impl/LuceneGeoPointFieldSortBuilderFactory.java
1
58.82%

backend/elasticsearch/src/main/java/org/hibernate/search/backend/elasticsearch/types/sort/impl/ElasticsearchGeoPointFieldSortBuilderFactory.java
1
58.82%

backend/elasticsearch/src/main/java/org/hibernate/search/backend/elasticsearch/types/predicate/impl/ElasticsearchStandardFieldPredicateBuilderFactory.java
1
93.33%

backend/lucene/src/main/java/org/hibernate/search/backend/lucene/types/sort/impl/AbstractLuceneStandardFieldSortBuilderFactory.java
2
88.0%

backend/lucene/src/main/java/org/hibernate/search/backend/lucene/types/predicate/impl/LuceneTextFieldPredicateBuilderFactory.java
6
60.0%

Totals

Change from base Build 179:
-0.03%

Covered Lines:
16622

Relevant Lines:
18748

💛  - Coveralls

Merged, thanks!

Thanks!


Configure SDAP deployment in Unity Marketplace in Unity-Venue-Dev

SCOPE DECREASE:
the deployment to dev does not need to be done through marketplace, all we want in the existing sprint is:

mark 1-step deployment via terraform to "todo"
Manually (multiple terraform steps) deploy to unity-venue-dev manually, document that procedure.
Integrate SDAP with the unity-venue-dev API Gateway. Document that procedure
Integrate unity-dev dapa-api (in unity-dev )with the venue api (unity-venue-dev). Document this procedure. This is essentially the collection mapping bit that @zx128 did.

@jjacob7734 ping for status.

Status
Plan to do this in these steps (planned for 24.3.3 sprint due to vacation):

EKS cluster provisioning
Spark operator deployment
Partial SDAP deployment to mainly get the worker node(s) set up with Solr, Cassandra, and Zookeeper.  In this stage the driver node runs the web app, but only one Spark executor is deployed (the minimum).
Functional SDAP deployment with driver node set up with the ingest components and Spark executors scaled up to 3 per worker node.
Ingress/NGINX and load balancer deployment
API Gateway integration

Status:

Redeploying in Unity-Dev using new streamlined processes and latest security updates.
New Terraform automation scripted using the Terraform Helm Provider.
New Terraform deployment of the Spark Operator (one of the main SDAP dependencies) using the Terraform Helm Provider.
Now working on improving the parameterization of the Terraform Helm deployments and proceeding with the Terraform deployment of SDAP itself.

Status:

Terraform deployment now includes the Spark-Operator and SDAP components of Solr, Cassandra, Zookeeper, Webapp, and Spark executors.
Multi-stage deployment (all automated in terraform) ensures optimal mapping of the above components to a driver node and 1 or more worker nodes.
Remaining to automate with Terraform: SDAP Ingress/Nginx, Load Balancer, API Gateway/VPC Link

Status:

Completed Terraform automation of SDAP Ingress/Nginx, Load Balancer, API Gateway/VPC Link.
Now have multiple terraform apply steps to deploy from scratch.
Working on streamlining it a bit.
Also need to "hook up" the flow from the shared API gateway into the Venue API.

At end of 24.3 PI, SDAP deployed in Unity-Venue-Dev and accessible through the API Gateway (with Cognito Token) at https://0gaazm5nq8.execute-api.us-west-2.amazonaws.com/dev/sdap/....  Closing this ticket and future work may be delayed to a future PI as needed.


window.resolveLocalFileSystemURL(imageURI,win,fail) in android 34

Bug Report
Problem
The URL that returns for the images gives an error and the image is not displayed in the HTML
What is expected to happen?
What does actually happen?
Information

Command or Code

Environment, Platform, Device

Version information

Checklist

[ ] I searched for existing GitHub issues
[ ] I updated all Cordova tooling to most recent version
[ ] I included all the necessary information above

window.resolveLocalFileSystemURL itself is erroring or the FileEntry returned produces a .toURL() that fails?
If the latter, there's a known regression in 8.1.1. You revert back to 8.1.0 as a workaround. It will be fixed by https://github.com/apache/cordova-plugin-file/pull/640 which is currently in the release process to be fixed in 8.1.2


[DNM] Revert "Tweak test relying on versioned clang module re-scanning to not need it."

This reverts commit b2ac19551894dbd905fd0c68ea2b3dd429ea8977.
The underlying Dependency Scanner is fixed in: https://github.com/apple/swift/pull/36294
We will need to wait for that PR to make it to a toolchain snapshot before merging this.

@swift-ci please test


Stickbug returns error when run

Describe the bug
When trying to run the !stick command on an image the process fails and the bot messages "An error occured during the creation of the stick bugged video".  The plugin worked when I installed it a few weeks ago, but when someone tried to use it last night it wouldn't work.  I'm using this docker container to run my bot https://github.com/PhasecoreX/docker-red-discordbot.  I have already tried rebooting the system, updating the docker container, and updating my installed cogs.
Here is the console output from when the command is run:
Moviepy - Building video /data/cogs/StickBugged/916373653183164457stick.mp4.
MoviePy - Writing audio in<PHONE_NUMBER>83164457stickTEMP_MPY_wvf_snd.mp3
chunk:   0%|          | 0/341 [00:00<?, ?it/s, now=None]
chunk:   8%|▊         | 27/341 [10:59:08<127:45:37, 1464.77s/it, now=None]
chunk:   8%|▊         | 27/341 [10:59:08<127:45:37, 1464.77s/it, now=None]
[2021-12-03 09:01:45] [ERROR] red.flare.stick: Error sending stick bugged video
Traceback (most recent call last):
File "/data/cogs/Downloader/lib/moviepy/audio/io/ffmpeg_audiowriter.py", line 74, in write_frames
self.proc.stdin.write(frames_array.tobytes())
BrokenPipeError: [Errno 32] Broken pipe
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/data/cogs/CogManager/cogs/stickbugged/stickbugged.py", line 78, in stick
video_file = await asyncio.wait_for(task, timeout=300)
File "/usr/local/lib/python3.8/asyncio/tasks.py", line 494, in wait_for
return fut.result()
File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
result = self.fn(*self.args, **self.kwargs)
File "/data/cogs/CogManager/cogs/stickbugged/stickbugged.py", line 43, in blocking
video.write_videofile(
File "/data/cogs/Downloader/lib/decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
File "/data/cogs/Downloader/lib/moviepy/decorators.py", line 54, in requires_duration
return f(clip, *a, **k)
File "/data/cogs/Downloader/lib/decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
File "/data/cogs/Downloader/lib/moviepy/decorators.py", line 135, in use_clip_fps_by_default
return f(clip, *new_a, **new_kw)
File "/data/cogs/Downloader/lib/decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
File "/data/cogs/Downloader/lib/moviepy/decorators.py", line 22, in convert_masks_to_RGB
return f(clip, *a, **k)
File "/data/cogs/Downloader/lib/moviepy/video/VideoClip.py", line 293, in write_videofile
self.audio.write_audiofile(audiofile, audio_fps,
File "/data/cogs/Downloader/lib/decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
File "/data/cogs/Downloader/lib/moviepy/decorators.py", line 54, in requires_duration
return f(clip, *a, **k)
File "/data/cogs/Downloader/lib/moviepy/audio/AudioClip.py", line 206, in write_audiofile
return ffmpeg_audiowrite(self, filename, fps, nbytes, buffersize,
File "/data/cogs/Downloader/lib/decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
File "/data/cogs/Downloader/lib/moviepy/decorators.py", line 54, in requires_duration
return f(clip, *a, **k)
File "/data/cogs/Downloader/lib/moviepy/audio/io/ffmpeg_audiowriter.py", line 170, in ffmpeg_audiowrite
writer.write_frames(chunk)
File "/data/cogs/Downloader/lib/moviepy/audio/io/ffmpeg_audiowriter.py", line 117, in write_frames
raise IOError(error)
OSError: [Errno 32] Broken pipe
MoviePy error: FFMPEG encountered the following error while writing file<PHONE_NUMBER>83164457stickTEMP_MPY_wvf_snd.mp3:
b'916373653183164457stickTEMP_MPY_wvf_snd.mp3: Permission denied\n'
In case it helps, make sure you are using a recent version of FFMPEG (the versions in the Ubuntu/Debian repos are deprecated).`

Can you ensure that ffmpeg is up to date, it may stem from using an
unsupported hosting in which I will not provide support for.
I will have a look into this around Wednesday after my first set of exams
pass.
On Fri 3 Dec 2021, 17:09 Mfdas, @.***> wrote:

Describe the bug
When trying to run the !stick command on an image the process fails and
the bot messages "An error occured during the creation of the stick bugged
video". The plugin worked when I installed it a few weeks ago, but when
someone tried to use it last night it wouldn't work. I'm using this docker
container to run my bot
https://github.com/PhasecoreX/docker-red-discordbot. I have already tried
rebooting the system, updating the docker container, and updating my
installed cogs.
Here is the console output from when the command is run:
Moviepy - Building video
/data/cogs/StickBugged/916373653183164457stick.mp4.
MoviePy - Writing audio in<PHONE_NUMBER>83164457stickTEMP_MPY_wvf_snd.mp3
chunk: 0%| | 0/341 [00:00<?, ?it/s, now=None]
chunk: 8%|▊ | 27/341 [10:59:08<127:45:37, 1464.77s/it, now=None]
chunk: 8%|▊ | 27/341 [10:59:08<127:45:37, 1464.77s/it, now=None]
[2021-12-03 09:01:45] [ERROR] red.flare.stick: Error sending stick bugged
video
Traceback (most recent call last):
File "/data/cogs/Downloader/lib/moviepy/audio/io/ffmpeg_audiowriter.py",
line 74, in write_frames
self.proc.stdin.write(frames_array.tobytes())
BrokenPipeError: [Errno 32] Broken pipe
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/data/cogs/CogManager/cogs/stickbugged/stickbugged.py", line 78, in
stick
video_file = await asyncio.wait_for(task, timeout=300)
File "/usr/local/lib/python3.8/asyncio/tasks.py", line 494, in wait_for
return fut.result()
File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in
run
result = self.fn(*self.args, **self.kwargs)
File "/data/cogs/CogManager/cogs/stickbugged/stickbugged.py", line 43, in
blocking
video.write_videofile(
File "/data/cogs/Downloader/lib/decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
File "/data/cogs/Downloader/lib/moviepy/decorators.py", line 54, in
requires_duration
return f(clip, *a, **k)
File "/data/cogs/Downloader/lib/decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
File "/data/cogs/Downloader/lib/moviepy/decorators.py", line 135, in
use_clip_fps_by_default
return f(clip, *new_a, **new_kw)
File "/data/cogs/Downloader/lib/decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
File "/data/cogs/Downloader/lib/moviepy/decorators.py", line 22, in
convert_masks_to_RGB
return f(clip, *a, **k)
File "/data/cogs/Downloader/lib/moviepy/video/VideoClip.py", line 293, in
write_videofile
self.audio.write_audiofile(audiofile, audio_fps,
File "/data/cogs/Downloader/lib/decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
File "/data/cogs/Downloader/lib/moviepy/decorators.py", line 54, in
requires_duration
return f(clip, *a, **k)
File "/data/cogs/Downloader/lib/moviepy/audio/AudioClip.py", line 206, in
write_audiofile
return ffmpeg_audiowrite(self, filename, fps, nbytes, buffersize,
File "/data/cogs/Downloader/lib/decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
File "/data/cogs/Downloader/lib/moviepy/decorators.py", line 54, in
requires_duration
return f(clip, *a, **k)
File "/data/cogs/Downloader/lib/moviepy/audio/io/ffmpeg_audiowriter.py",
line 170, in ffmpeg_audiowrite
writer.write_frames(chunk)
File "/data/cogs/Downloader/lib/moviepy/audio/io/ffmpeg_audiowriter.py",
line 117, in write_frames
raise IOError(error)
OSError: [Errno 32] Broken pipe
MoviePy error: FFMPEG encountered the following error while writing file
916373653183164457stickTEMP_MPY_wvf_snd.mp3:
b'916373653183164457stickTEMP_MPY_wvf_snd.mp3: Permission denied\n'
In case it helps, make sure you are using a recent version of FFMPEG (the
versions in the Ubuntu/Debian repos are deprecated).`
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/flaree/flare-cogs/issues/139, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AHQXU6AOLOENNR2JWUF37ETUPD2TJANCNFSM5JKFFFVQ
.

Installing ffmpeg will solve your issue, how you go about doing that with an unsupported environment is up to you.


[a11y] Shared image is not labeled in Android Sharesheet

I am using the Share plugin to share image. There is an accessibility issue that the image preview is not labeled in the Android Sharesheet.
Steps to reproduce

Have an image saved locally.
Use Share.shareFiles() to share the image.

Observation

Device models:
Pixel 3, Pixel 4 XL

Closing, as share is now deprecated in favor of share_plus.


chore: update devenv and poetry

update devenv to get rust 1.75 on stable channel
this currently causes poetry installation (poetry v 1.7.1) to fail

Closed in #288


slow layer writes when writing features with hundreds of columns

Expected behavior and actual behavior.
I attempted to write a 35,000 record polygon dataset with 400 columns to FlatGeobuf using Fiona 1.8.21 (via geopandas). It took a couple of minutes to query and download this dataset from a remote server, and turn it into a geopandas GeoDataFrame in ram, so I expected it might take a minute or so to write. The write operation using geopandas engine="fiona" kept running for 10 minutes, until I interrupted it.
The current unreleased Fiona in master branch (rev 9c8fe736) appears to be substantially faster than Fiona 1.8.21.
Steps to reproduce the problem.
I am unable to share the original dataset, but here is a script to create synthetic data with similar characteristics and write it:
# pip install geopandas
# pip install pyogrio

import numpy
import pandas as pd
import geopandas as gpd
import random
import shapely
import string

ALPHABET = list(string.ascii_lowercase)

def make_vocab(n, w):
    return numpy.asarray([''.join(random.sample(ALPHABET, w)) for _ in range(n)], dtype=object)

def make_random_data(n_rows: int, n_cols: int, w: int):
    k = 4321
    vocab = make_vocab(n=k, w=16)
    data = {}
    for i in range(n_cols):
        col_values = [vocab[((i + (i*j))%k)] for j in range(n_rows)]
        col_name = 'col_%d' % (i, )
        data[col_name] = pd.Series(col_values)

    x_coords = numpy.random.uniform(-1.0, 1.0, (n_rows, ))
    y_coords = numpy.random.uniform(-1.0, 1.0, (n_rows, ))

    geom = [shapely.geometry.Point((x, y)) for (x, y) in zip(x_coords, y_coords)]

    return gpd.GeoDataFrame(data=data, geometry=geom)

def main():
    print('making random data...')
    n_rows = 25000
    n_cols = 400
    w = 16
    gpd = make_random_data(n_rows, n_cols, w)
    print('writing...')
    driver='FlatGeobuf'
    engine='fiona'
    # engine='pyogrio'
    gpd.to_file('data.fgb', driver=driver, engine=engine)

if __name__ == '__main__':
    main()

Operating system
Ubuntu 22.04.1 LTS
Fiona and GDAL version and provenance
Slow write performance noticed with Fiona 1.8.21  installed from PyPI using pip version 9.0.1.
Potential speedups
There appear to be some opportunities to make these writes faster with small, incremental patches:
OGRFeatureBuilder build method in fiona/ogrext.pyx is called for each record during writes, but some of the computation - determining field indices or normalising type names, is not specific to the record, it is specific to the layer schema, and could be cached instead of repeatedly computing it per record.

@fcostin I appreciate the report! Even though GeoPandas will probably stop using Fiona in the future, I agree that some optimizations would be good.


FancyZones: Cycle through layouts while dragging window

Description of the new feature / enhancement
While dragging a window using SHIFT, allow quickly cycling through the available layouts using the mouse wheel (and keyboard shortcuts).
Scenario when this would be used?
More often than not I start dragging a window subconsciously and only while dragging start thinking about how I want to arrange it. This feature would allow me to quickly adjust the layout and even "preview" it on the fly, rather than having to stop dragging the window and select the desired layout first.
Also, in general I believe this way of changing the layout is more convenient than memorizing the shortcut for each layout or using the GUI.
Supporting information
This has been suggested by @rifton007 a while ago and the proposed solution gained 14 upvotes, but it unfortunately got posted in a closed issue. I am reposting it to hopefully resume the discussion and get this implemented.

This shortcut is impossible to do with one hand.
WIN + CTRL  + ALT + [0-9] is not convenient and not easy at memorize each layout.
I propose that when we maintain SHIFT to display FancyZone, we could use :
KEY DOWN and KEY UP or use MOUSE WHEEL to switch layout.

With an image it is more evident. 😉

Originally posted by @rifton007 in https://github.com/microsoft/PowerToys/issues/1411#issuecomment-1002132083

This would be very useful. Keyboard shortcuts (I suggest z & x) to cycle through layouts would be a better option while dragging a window.
But this enhnacement need to be accompanied with the ability to reorder layouts. #16053

This shortcut is impossible to do with one hand.

You only need to press the number when you are dragging a window, and can activate FancyZone using a non-primary mouse button so you don't have to hold shift.
Also this is a dup of #4969 where I have posted an autohotkey script to do this. https://github.com/microsoft/PowerToys/issues/4969#issuecomment-1632883422

/dup https://github.com/microsoft/PowerToys/issues/4969


COUNT with an explicit : i32 can result in incorrect 0 values

Bug Description
Using : i32 in a column name for COUNT can result in a zero in the returned value, where the original value was a different one.
Minimal Reproduction
#[tokio::main]
async fn main() {
    let pool =<EMAIL_ADDRESS>        .await
        .unwrap();

    dbg!(
        sqlx::query!(r#"SELECT COUNT(x) AS "x!: i32" FROM UNNEST(ARRAY[1, 2, 3]) AS x(x)"#)
            .fetch_all(&pool)
            .await
            .unwrap()
    );
    dbg!(
        sqlx::query!(r#"SELECT COUNT(x) AS "x!" FROM UNNEST(ARRAY[1, 2, 3]) AS x(x)"#)
            .fetch_all(&pool)
            .await
            .unwrap()
    );
}

prints:
[src/main.rs:7:5] sqlx::query!(r#"SELECT COUNT(x) AS "x!: i32" FROM UNNEST(ARRAY[1, 2, 3]) AS x(x)"#).fetch_all(&pool).await.unwrap() = [
    Record {
        x: 0,
    },
]
[src/main.rs:13:5] sqlx::query!(r#"SELECT COUNT(x) AS "x!" FROM UNNEST(ARRAY[1, 2, 3]) AS x(x)"#).fetch_all(&pool).await.unwrap() = [
    Record {
        x: 3,
    },
]

Info

SQLx version: 0.7.4
SQLx features enabled: runtime-tokio and postgres
Database server and version: Postgres Debian 15.3-1.pgdg110+1 (from docker.io/postgres)
Tokio version: 1.37.0
Operating system: NixOS
rustc --version: rustc 1.79.0-nightly (c9f8f3438 2024-03-27)

After I removed the : i32 in the bigger project that caused me to find this; it turns out that the issue is that it returns an INT8 (⇒ i64), and overriding that type silently ignores the least significant 4 bytes.
#[tokio::main]
async fn main() {
    let pool =<EMAIL_ADDRESS>        .await
        .unwrap();

    dbg!(
        sqlx::query!(r#"SELECT CAST(4294967296 AS INT8) AS "x!: i32""#)
            .fetch_all(&pool)
            .await
            .unwrap()
    );
    dbg!(
        sqlx::query!(r#"SELECT CAST(4294967296 AS INT8) AS "x!""#)
            .fetch_all(&pool)
            .await
            .unwrap()
    );
}

outputs
[src/main.rs:7:5] sqlx::query!(r#"SELECT CAST(4294967296 AS INT8) AS "x!: i32""#).fetch_all(&pool).await.unwrap() = [
    Record {
        x: 1,
    },
]
[src/main.rs:13:5] sqlx::query!(r#"SELECT CAST(4294967296 AS INT8) AS "x!""#).fetch_all(&pool).await.unwrap() = [
    Record {
        x:<PHONE_NUMBER>,
    },
]

Yeah, this is because Postgres returns integers in big-endian, and decoding an 8 byte integer as i32 is going to read the first (high) 4 bytes of the value.
It could be changed to read the last 4 bytes instead so that it's a valid truncation, although I feel like it should error instead if the truncation is ignoring nonzero bytes.
We should just copy the approach of the MySQL driver and use ByteOrder::read_int (but with BigEndian instead of LittleEndian): https://github.com/launchbadge/sqlx/blob/1f6642cafa98a2ae8cc2c407d85fcad17564bf01/sqlx-mysql/src/types/int.rs#L93
Then use .try_into() to apply a checked conversion to the specific integer type in Decode.


Does it be adapted to support video to video lipsync?

So it can be used as wav2lip alternatives.

Unfortunately this model does not support vid2vid generation.


Produce test vectors for W3C VC Data Model 1.1

Produce language agnostic test vectors that can be used by each implementation to ensure that the following features work correctly:

Creation
Verification
Validation - this could just be a JSON schema that can be used in all SDKs

Related: #17

There are a set of test vectors in the test suite here. I don't think we need to use all of them.
What I've found to be sufficient is to replicate a few of the examples in the spec itself.

Closing as dupe of #168


chore(deps): upgrade dependencies

Upgrades project dependencies. See details in workflow run.

Automatically created by projen via the "upgrade-2.x" workflow

⚪ Backport skipped
The pull request was not backported as there were no branches to backport to. If this is a mistake, please apply the desired version labels or run the backport tool manually.
Manual backport
To create the backport manually run:
backport --pr 1144

Questions ?
Please refer to the Backport tool documentation


[Question]Regarding TVFPlay Extractor

What is the purpose of your issue?

[ ] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[x] Question
[ ] Other

Description of your issue, suggested solution and other information
Is there any predefined way to extract the actual url of the video in the InfoExtractor Class of common.py?
For instance, I am having a web url of https://tvfplay.com/episode/6/139/230/1056
But, the actual url of the video, when checked is https://youtu.be/mtUTZEh9VAU
Is it possible to somehow extract the 2nd url if user inputs the 1st one?
#14379

This depends on a particular site's embedding mechanism.


Question: Is it possible to show multiple slide ?

Hi,
Currently we can see now one slide in whole screen. Is it possible to show previous and next slide too ? i mean 3 slide at a time ?

@triniwiz Is there a way to implement this now?

You need to add spacing=“2%” peaking=“10%”

Thanks! I have to call this.pager.nativeElement.refresh(); after to get it to work. Before then it's a little broken like in the attached gif.

@FranciZ what version are you using core , angular , vue also what {N} version

Angular: 7.0.7
tns --version: 5.0.2
tns-android: 5.0.0
tns-core-modules: 5.0.5


Trying to understand.

Hello, first of thank you for this wonderful library.
I'm trying to understand the code, to improve it for my needs.
I noticed that something have a WriteTo(f format.Formatter) in order to generate
the formatted text while other have a Format(f format.Formatter).
Why the two different methods, it's not clear how they are supposed to differ.
Thank you,
Gautam.
Reading through the code, it seems that unifying it into only the Format(format.Formatter) makes the most sense.

Hello.
Thank you for reading the code and contributing this library.
As for WriteTo and Format, there are no significant difference between them.
It seems to be introduced when I implemented Formatter in 8cedcfc.
It will be nice to rename Section.WriteTo(format.Formatter) to Section.Format(format.Formatter).
I will revise code later to use Section.Format instead of Section.WriteTo.

Committed as 5a6d1e8.


Snapshot service - remove fallback to FilOps

Issue summary
Given that FilOps snapshot service is going down, it makes sense to eliminate this path of code in Forest (and consider a new self-heal mechanism?).
It is a low priority, given it will fail quickly on a failed snapshot anyway.
Other information and links

See https://github.com/ChainSafe/forest/pull/3878


Fix dd-builder logging in cronjob to use sh syntax

Mistakenly used bash syntax, which doesn't work...
Signed-off-by: Bradon Kanyid<EMAIL_ADDRESS>

recheck


--constraint support

What's the problem this feature will solve?
There are 2 projects:

lib is an internal library. It has setup.py with dependencies of the library.
srv is an internal service that uses lib. It has a lock file requirements.txt.

The goal is to generate lib/requirements.txt which has only packages from lib/setup.py but the same versions as specified in srv/requirements.txt. Motivation:

The same version is needed to make sure that if the tests have passed for lib, it will work as expected in the environment of srv.
Running tests for lib in the environment of srv is complicated on CI: the env of srv is too big, and we want to avoid making it for pipelines in lib.

Describe the solution you'd like
The idea is the same as in pip's Constraints Files (-c/--constraint option). So, it makes sense to introduce the same key for pip-tools.
Alternative Solutions
pip-tools already uses the output file as the constraint. So, a workaround I found is to specify the constraint file as the output file and then restore it. The PoC:
import sys
import shutil
import subprocess
from argparse import ArgumentParser

def main():
    parser = ArgumentParser()
    parser.add_argument('-c', '--constraint', required=True)
    parser.add_argument('--output-file', default='requirements.txt')
    args, rest = parser.parse_known_args()
    shutil.copy(args.constraint, '/tmp/c.txt')
    cmd = [sys.executable, '-m', 'piptools', 'compile', '--output-file', args.constraint]
    try:
        code = subprocess.call(cmd + rest)
        shutil.copy(args.constraint, args.output_file)
    finally:
        shutil.copy('/tmp/c.txt', args.constraint)
    sys.exit(code)

if __name__ == '__main__':
    main()

Additional context

I think the implementation can be pretty simple. We can just do the same for constraint file as we do for the output file for the purpose of detecting the current constraints.
        ireqs = parse_requirements(
            output_file.name,
            finder=tmp_repository.finder,
            session=tmp_repository.session,
            options=tmp_repository.options,
        )
        if constraint_file:
            ireqs = itertools.chain(ireqs, parse_requirements(
                constraint_file,
                finder=tmp_repository.finder,
                session=tmp_repository.session,
                options=tmp_repository.options,
            ))

Alternative approach:
Create lib/requirements.in with something like:
.
-c ../srv/requirements.txt

Relative paths may be trouble until a certain PR gets approved, but you can use absolute paths to test the approach.
Anyway, compile that to lib/requirements.txt

That's an interesting idea, thank you. I finally tried it today, it's close enough. However, the . itself is also added as a dependency which is not desired:
# WARNING: pip install will require the following package to be hashed.
# Consider using a hashable URL like https://github.com/jazzband/pip-tools/archive/SOMECOMMIT.zip
file:///home/gram/Documents/lib
    # via -r requirements.in

IDK why I didn't think about it, but apparently you can pass . as another argument: pip-tools requirements.in pyproject.toml. And requirements.in is just -c ../srv/constraint.txt. Now it works 👍🏿
It still would be great to have a separate flag for it, though. Sounds like a quite common case to me, let's see if there is demand for it.

Similar feature request here with comment about drawbacks of this solution and proposed alternative

I'm a -1 on this for now, since the method above (comment) and the comment linked by @lesnik512 seem to cover the need well.

The described method allows to pass the constraints file as a content of another file but not as a CLI argument. The first thing I tried before opening the issue is to pass it as --pip-args but it doesn't work. This is an ugly workaround I have now in my Taskfile:
echo "-c {{.CONSTR_PATH}}" > requirements.in
pip-tools requirements.in pyproject.toml
rm requirements.in

Even if we decide that this workaround is ok and there is no need for code changes, it still should be at least documented, I'd never figure it out on my own.

Thank you for providing the workaround, I was banging my head against a wall for a while before finding this thread. Agree with @orsinium that it would be great to at least get this documented, though an explicit --constraints flag for pip-compile would be a better user experience in my opinion.
As an additional data point, my use case involved creating separate requirements files for different extras defined in a pyproject.toml file. Having a constraints.in file that just adds -c constraints.txt works perfectly. Here's a short description of our use case, since it might be a bit more common than two separate libraries needing to share constraints:
We define our dependencies in addition to test and doc extras in pyproject.toml. What we expected to be possible was to run pip-compile --extra test,doc --output-file=constraints.txt pyproject.toml, then create different lockfiles with pip-compile -extra test --output-file=test.txt --pip-args=-c=requirements.txt pyproject.toml (repeat for doc and base, latter has no extras). However this leads to constraints.txt file being completely ignored, producing potentially incompatible test.txt and doc.txt files, when there is a valid solution.

Guys, how to make dependabot working with the proposed workaround?
We are getting these errors from dependabot:
Fetching info for <package>
  update for 'package: X.Y.Z' is impossible

We are using unconstrained in file, and we have one constraints.in file which includes inside using -r flag all unconstrained files. Then when constraints.txt file is built, we are using it again for files like this:
# content of `base.in` file

-c constraints.txt
-r unconstrained/base.in

Somehow it is not woking with dependabot...

I'm a -1 on this for now, since the method above (comment) and the comment linked by @lesnik512 seem to cover the need well.

@AndydeCleyre considering https://github.com/jazzband/pip-tools/issues/1891 wouldn't it makes sense to support pip-compile --extra dev -c requirements.txt -o dev-requirements.txt?

Yes probably, especially since AFAIK you can't specify constraints in a pyproject.toml the same way.

This PR #1936 adds -c option to the pip-compile. Any tests and reviews would be much appreciated.


Uint8Array.from failed to work in some safari version

System：mac 10.15.6
Safari Version: 13.1.2

I need more information.  FYI it is tested on Safari, too.   What happens when you open test/index.html with it?

I need more information.  FYI it is tested on Safari, too.   What happens when you open test/index.html with it?

I has the same problems,when i run in ios wkwebview,it's can not decode UTF-8,but when i choose to 1.25.1,It's ok

I has the same problems,when i run in ios wkwebview,it's can not decode UTF-8,but when i choose to 1.25.1,It's ok

happens to me too, safari 13.1.3,  any update @dankogai

I cannot reproduce your claim.  Please try the following. here we assume you already have node and npm installed (via Homebrew, MacPorts or .pkg).
from Terminal.app of your Mac.
% git clone https://github.com/dankogai/js-combinatorics.git
% cd js-base64
% npm install http-server
% npx http-server
Starting up http-server, serving ./
Available on:
  http://<IP_ADDRESS>:8080
  http://<IP_ADDRESS>:8080
  http://<IP_ADDRESS>:8080
Hit CTRL-C to stop the server

IP addresses are subject change.
from your iPhone or iPad:

open http://<IP_ADDRESS>:8080/test/index.html from Safari.  Choose IP address other than <IP_ADDRESS>.
It should be working like the screen shot below:


how  OAuth2 Client Web Monitoring?

Idont know how OAuth2 Client Web Monitoring ?Please give a brief introduction
Before logging a new issue, please have a quick read through the contribution guidlines.

Does this help? https://www.app-metrics.io/web-monitoring/aspnet-core/tracking-middleware/


Process WASM blocks from substreams

Add support for running WASM mappings on incoming substreams blocks.

The block stream will emit the encoded result as a byte array
The mapping will need to handle the decoding of the input

Example is provided here

I've approved this though I have pretty big reservations about the code duplication, and the fact that that code is pretty much undocumented (what's the high-level intended behavior of that code?) and very hard to follow.


[Request] Minetweaker support

Could you add support for ModTweaker/Craftweaker in 1.10.2 ?
When i'm using command /mt reload the recipe are duplicated xD

Already reported on MT's end, integration is stalled until they update to 1.11


Cleanup: regression for 0.2.0

An integration test failed because docker info via swarm displays extra information before printing Nodes: \d+. This PR fixed it.
Signed-off-by: Chanwit Kaewkasi<EMAIL_ADDRESS>cc @aluzzardi

Coverage remained the same at 39.16% when pulling b1803bc7e58ba8f7165cd99cfcd798ec2d5090d2 on chanwit:regression into 88b69e067111f7e3a751e133394d6b7371c39115 on docker:master.

LGTM thanks


The major open source projects using ruff list has gotten very long

It's obviously very cool that all of these (27) major open source projects are using ruff but the list has gotten so long that it has become a navigation hurdle for users looking for information in our README (you need to scroll further to get to the table of contents).
So I think it would make sense to reduce the list before the table of contents to maybe 3-4 projects and either remove the links to the other projects or move them to a section at the bottom of the README and link them with a link such as [and more](#projects-using-ruff).

Yeah I can own this. I'll have to make some decisions around what to highlight up-top.

Resolved by #2986. (Thanks!)


Add generic api key (fixes #1863)

Added generic-api-key to the Generic OAuth 2.0 configuration section per the linked issue (#1863 )--I just made my best guess of the details based on other entries in this doc, so let me know if I need to change anything. Thanks!

Thanks @Jared! So can you specify what you'd change or add to the new entry? The description above seems consistent to me with what I've added.

Sure! I suppose I'd probably just use exactly what's written in the server file: JSON lookup key into OpenID UserInfo. (Azure should be userPrincipalName.) This text, being slightly more specific about the underlying data representation, would I think help users understand how to use it.

@noramullen1 was this change included in the chronograf-1.7 branch?

@noramullen1 I think this PR is good as is, but the changes need to be copied into the v1.7 docs. Merge master into the chronograf-config-options branch to pull in the v1.7 docs, then make the same update on the corresponding doc and push to this branch. Then we'll merge this PR.


only about 1000 items out of 500,000 items in prediction result

I followed the movielens sample with the exact same config.json file (see below). My dataset has about 5 million users with about 100 million record on about 500,000 items/ titles. Then predict top 20. But in the prediction result, I only get only about 1000 distinct titles / items. I expect many more distinct items since in the dataset, I have about 500,000 of them. Could anyone help?
{
"Version" : 0.7,
"Name" : "AE",
"Kind" : "FeedForward",
"SparsenessPenalty" : {
"p" : 0.5,
"beta" : 2.0
},
"ShuffleIndices" : false,

"Denoising" : {
    "p" : 0.2
},

"ScaledMarginalCrossEntropy" : {
    "oneTarget" : 1.0,
    "zeroTarget" : 0.0,
    "oneScale" : 1.0,
    "zeroScale" : 1.0
},
"Layers" : [
    { "Name" : "Input", "Kind" : "Input", "N" : "auto", "DataSet" : "gl_input", "Sparse" : true },
    { "Name" : "Hidden", "Kind" : "Hidden", "Type" : "FullyConnected", "N" : 128, "Activation" : "Sigmoid", "Sparse" : true },
    { "Name" : "Output", "Kind" : "Output", "Type" : "FullyConnected", "DataSet" : "gl_output", "N" : "auto", "Activation" : "Sigmoid", "Sparse" : true }
],

"ErrorFunction" : "ScaledMarginalCrossEntropy"

}

So I'd have to see your data to be sure, but how are your items distributed in your training set?
If it follows a Power Law (or Zipf Distribution), your outputs might be heavily biased towards those 1000 items and the network is just learning that subset.  I'm not saying that's the case, but it is the first thing comes to mind here.

Also, try this network out, it gives the best performance on MovieLens I've seen...
 I will try the new settings. As for my data set distribution, about 23% top users account for 80% clicks, also about 8% top items account for 80% clicks. The current prediction is basically only covering top 1000 most popular items. I expect the dsstne model to be able to predict more items including those unpopular items. Are there any other parameters that can be adjusted to make dsstne's predition cover more items / movies?

I tried the "AIV NNC" config with my dataset. I got "cudaMalloc GpuBuffer::Allocate failed out of memory" even with batch size 8 on a K40c GPU with 12GB GPU ram. But with the default sample movielens "AE" config, I was able to go with batch size 896. Do I need to adjust network parameter to handle large dataset? I would assume DSSTNE can handle large dataset larger than what I have. Any suggestion will be appreciated.

So if you were on a Pascal or later GPU, you could stream the dataset from system memory, but you are not, so...
How many GPUs do you have in this machine?  If more than one try: "mpirun -np 2" at the front of your DSSTNE command and it will spread the model and data across 2 GPUs.
Alternatively, if you have just 1 GPU, try changing 1536 in the network config to 768.

Ok. I changed N from 1536 to 256, and batch size to 512. It's running now. Let's see if the new model can predict more items.

The new model is bad. The average error becomes larger and larger with each epoch.
NNNetwork::Train: Detected network divergence, attempting recovery.

Lower your learning rate.
On Nov 20, 2017 4:23 AM, "lightsailpro"<EMAIL_ADDRESS>wrote:

The new model is bad. The average error becomes larger and larger with
each epoch.
NNNetwork::Train: Detected network divergence, attempting recovery.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/amzn/amazon-dsstne/issues/147#issuecomment-345680718,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ARNK9qPpA24kuw0bHNf7yhsPc3ipEYCjks5s4W83gaJpZM4QiNMi
.

Where do I specify the learning rate for the training, and what value I should start with? I am trying to work around the following divergence issue.
NNNetwork::Train: Minibatch@3852288, average error 179.188812, (176.930328 training, 2.258480 regularization), alpha 0.025000
NNNetwork::Train: Minibatch@3852800, average error 696.496094, (694.237549 training, 2.258516 regularization), alpha 0.025000
NNNetwork::Train: Detected network divergence, attempting recovery.

This is the "alpha" parameter to the Train command, looking at the source
code (Train.cpp):
// Hyper parameters
float alpha = stof(getOptionalArgValue(argc, argv, "-alpha", "0.025f"));
float lambda = stof(getOptionalArgValue(argc, argv, "-lambda",

"0.0001f"));
float mu = stof(getOptionalArgValue(argc, argv, "-mu", "0.5f"));
lambda is your regularization coefficient, and mu is the momentum term for
RMSProp, AdaGrad, AdaDelta, and Nesterov Momentum...
Scott
On Mon, Nov 20, 2017 at 7:01 AM, lightsailpro<EMAIL_ADDRESS>wrote:

Where do I specify the learning rate for the training, and what value I
should start with? I am trying to work around the following divergence
issue.
NNNetwork::Train: Minibatch@3852288, average error 179.188812,
(176.930328 training, 2.258480 regularization), alpha 0.025000
NNNetwork::Train: Minibatch@3852800, average error 696.496094,
(694.237549 training, 2.258516 regularization), alpha 0.025000
NNNetwork::Train: Detected network divergence, attempting recovery.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/amzn/amazon-dsstne/issues/147#issuecomment-345721512,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ARNK9sWHWn3M_keH-i3YJpYvMeXcNe4pks5s4ZRegaJpZM4QiNMi
.

PS looking at my own code, try 0.01 to start...

Thanks, scotttlegrand.  I am running the training with alpha=0.01 now. I checked the predicted distinct item count from last run (after 1 epoch, diverged), it is surprising still 852, which is identical to the distinct item count of the result (converged) using default movielens config file. I am puzzled why two different networks generated exact same count. I am wondering if I did anything wrong in the process. Here is the command I am using.
--dsstne_n_year.txt sample row
sample_userid	itemid,timestamp:itemid,timestamp
1-1008     8752,1499631783:1473,1499632570
2-459      1170,1480168269
..........
/home/ml/amazon-dsstne/src/amazon/dsstne/bin/generateNetCDF -d gl_input -i dsstne_n_year.txt -o gl_input.nc -f features_input -s samples_input -c
/home/ml/amazon-dsstne/src/amazon/dsstne/bin/generateNetCDF -d gl_output -i dsstne_n_year.txt -o gl_output.nc -f features_output -s samples_input -c
/home/ml/amazon-dsstne/src/amazon/dsstne/bin/train -c config.json -i gl_input.nc -o gl_output.nc -n gl.nc -b 512 -e 1 -alpha 0.01
/home/ml/amazon-dsstne/src/amazon/dsstne/bin/predict -b 512 -d gl -i features_input -o features_output -k 24 -n gl.nc -f dsstne_n_year.txt -s recs -r dsstne_n_year.txt

The issue was accidently closed. Reopen it.

Hi, Scott: With alpha=0.01, the job finished successfully. But I still only get 852 distinct items (out of half million items) in the prediction result for all millions of users. Those items are basically most popular items. Can dsstne neural network model only be able to learn most popular items, not concurrent items? To me, the recommendation result is not very helpful, since I can generate most popular items rather easily without a gpu working many hours. I still feel that I may miss something here. Any help will be appreciated.

So are you filtering out items the viewer has already purchased/viewed?
Second, instead of trying to run this as an autoencoder of the viewing
history, you could instead try to predict the most recent (in training) or
next (in test) item.  This is what was performed here (
https://static.googleusercontent.com/media/research.google.com/en//pubs/archive/45530.pdf).
This is done with a different sort of network, but where DSSTNE shines is
in its ability to model the full input and output layers of large datasets
and in running them with sparse data like recommendations data.
Scott
On Tue, Nov 21, 2017 at 5:25 AM, lightsailpro<EMAIL_ADDRESS>wrote:

Hi, Scott: With alpha=0.01, the job finished successfully. But I still
only get 852 distinct items (out of half million items) in the prediction
result for all millions of users. Those items are basically most popular
items. Can dsstne neural network model only be able to learn most popular
items, not concurrent items? To me, the recommendation result is not very
helpful, since I can generate most popular items rather easily without a
gpu working many hours. I still feel that I may miss something here. Any
help will be appreciated.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/amzn/amazon-dsstne/issues/147#issuecomment-346025433,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ARNK9t1bYu2VvngdB0d_lv_kfGfVrfp2ks5s4s8wgaJpZM4QiNMi
.

Hi, Scott: From my understanding, with the same "-r" and "-f" parameter value in  "predict -b 512 -d gl -i features_input -o features_output -k 24 -n gl.nc -f dsstne_n_year.txt -s recs -r dsstne_n_year.txt", I am actually filter out the items users already purchased/views. To be honest, I am still little bit confused with those command line parameter. So please correct me if I am not using the correct syntax.

Is this data highly confidential?  I would love a sample of maybe 5% of your training set if you can provide it in a way to sanitize out any identifiable information besides numbers.  It's hard for me to guess what is actually going on right now, but I'm happy to build something to parse this data for you and train and generate recommendations.  In that case, I would indeed use this as the generation of a model zoo for people.  It gets 53% precision@1 on Movielens, significantly better than collaborative filtering approaches.

Hi, Scott, Thanks for the follow-up. It will be difficult. What I will do is to try the movielens data set again using my script and process, and check the prediction item coverage. precision@1 is most important kpi. In my case, I also need good item coverage in the prediction.  This will isolate if there is anything wrong with my script.

The configuration for ScaledMarginalCrossEntropy has to be adjusted when you have lot of popular Items with the configurations you are having you are penalizing both One and Zero the same way. Have you tried changing  it to a higher value when you miss a target as one. What it also does not not to penalize if you have a zero
"ScaledMarginalCrossEntropy" : {
"oneTarget" : 1.0,
"zeroTarget" : 0.0,
"oneScale" : 100.0,
"zeroScale" : 1.0
},

Hi, rgeorgej : I followed your suggestion and changed OneScale to 100. With the exact same data set, I still only got 852 distinct items in the prediction result set (prediction top 24 items for each user). See below for the config.json file.
{
"Version" : 0.8,
"Name" : "AIV NNC",
"Kind" : "FeedForward",
"ShuffleIndices" : false,
"ScaledMarginalCrossEntropy" : {
"oneTarget" : 1.0,
"zeroTarget" : 0.0,
"oneScale" : 100.0,
"zeroScale" : 1.0
},
"Layers" : [
{ "Name" : "Input", "Kind" : "Input", "N" : "auto", "DataSet" : "gl_input", "Sparse" : true },
{ "Name" : "Hidden1", "Kind" : "Hidden", "Type" : "FullyConnected", "N" : 256, "Activation" : "Relu", "Sparse" : false, "pDropout" : 0.37, "WeightInit" : { "Scheme" : "Gaussian", "Scale" : 0.01 } },
{ "Name" : "Hidden2", "Kind" : "Hidden", "Type" : "FullyConnected", "N" : 256, "Activation" : "Relu", "Sparse" : false, "pDropout" : 0.37, "WeightInit" : { "Scheme" : "Gaussian", "Scale" : 0.01 } },
{ "Name" : "Hidden3", "Kind" : "Hidden", "Type" : "FullyConnected", "N" : 256, "Activation" : "Relu", "Sparse" : false, "pDropout" : 0.37, "WeightInit" : { "Scheme" : "Gaussian", "Scale" : 0.01 } },
{ "Name" : "Output", "Kind" : "Output", "Type" : "FullyConnected",  "DataSet" : "gl_output", "N" : "auto", "Activation" : "Sigmoid", "Sparse" : true , "WeightInit" : { "Scheme" : "Gaussian", "Scale" : 0.01, "Bias" : -10.2 }}
],
"ErrorFunction" : "ScaledMarginalCrossEntropy"
}

Another method to try is to bagging on your data before feeding it to DSSTNE, sampling your training set inversely proportional to how popular its targets are.  This should make the rarer stuff effectively less rare.  Also, don't use the OneScale at 100 on the 3-layer dropout network I gave you, it works better for the network with a single hidden layer.


Add option to filter out breadcrumbs

Do you want to request a feature or report a bug?
This is a feature request.
Has someone had this problem before?
I haven't found anything similar in the issue tracker.
What is the current behavior?
At the moment, breadcrumbs are collected for e.g. all http requests, all console logs, etc.
What is the expected behavior?
I'm using the latest version 1.1.4.

The breadcrumb feature is really great, I love it!
However it would be really nice if we can specify some kind of filters for "tracking" the breadcrumb or not (e.g. some http requests should / must not be tracked, etc).
I think something like this should be enough:
<EMAIL_ADDRESS>{
  autoBreadcrumbs: {
    // pass a function that returns a boolean if you want to filter out some of them
    http: (breadcrumb) => {
      // filter out all GET methods
      return breadcrumb.method !== GET
      // filter out breadcrumbs matching a specific route
      return !/\/login/.test(breadcrumb.url)
      // and so on, depending on the available fields
      // https://github.com/getsentry/raven-node/blob/fa3aa077410346530bbff82956fb9f022b0121d4/lib/breadcrumbs.js#L96-L99
    },
    // pass a boolean to simply enable/disable all breadcrumbs for console
    console: true,
  }
})

Thanks a lot for the help!

Hi @emmenko! Great point to bring up. The browser JS SDK, raven-js, has roughly the functionality you're describing in the form of the breadcrumbCallback option (docs, pr).
There's sort of a bigger picture "events and filtering" ongoing discussion that this ties into so we didn't immediately add a corresponding breadcrumbCallback option to raven-node, but I wouldn't be against doing that if it would be useful; it can cover until we have a more permanent resolution on filter-callbacks/event emitted/etc. Take a look at the raven-js functionality and let me know if it's what you have in mind or if there's anything more to what you're imagining.

Ah cool, I missed that in raven-js. As far as I can see that is more or less what I imagined and should perfectly do the job 👍
Thanks!


[URGENT]. Transfer of STX stuck in pending for nearly 9 hours

Unlike prior recent transfers of STX from my Stacks Wallet 2.0 to my Coinbase account, today there seems to be a problem.  My transaction has been pending for over 8 hours - which seems like something might be wrong.  Is there some error that can be seen?
Transaction ID:
0x790249a2e7e7ca181ea52d2a23cca98b1fdf8f5301f2ea89daefd7efa376141c
Here is the link on the Stacks Explorer:
https://explorer.hiro.so/txid/0x790249a2e7e7ca181ea52d2a23cca98b1fdf8f5301f2ea89daefd7efa376141c?chain=mainnet
Can someone please urgently check if there is some problem?  This is a rather important transaction to complete.
Let me know what further info is required.
Thanks,
Jeff
email<EMAIL_ADDRESS>

Hi @jeffkaplan88 , this isn't an issue in the Explorer. Please ask for help in Discord


Config location

Nice work on this project, loving it! A little gripe I have is the config path however: ~/.config/prs feels a bit generic.
go-app-paths could come in handy here: https://github.com/muesli/go-app-paths
This sticks to the XDG specifications and return "native" paths on Windows/Mac as well. Let me know if I can help with this!
Keep up the great work!

I second this. Having the configuration file in ~/ makes it easier to sync with other dot files
Also, I really like how lazygit uses a configuration file. The default file is empty, so you can immediately start using the TUI. Then pressing e will open the config file in the default git editor)

@muesli, I would love to use your package, but I'm a mac user and I like my configs to sit in ~/.config/app
A lot of the apps I use respect the XDG_CONFIG_HOME=$HOME/.config env variable.
Maybe this should be added to your repo?

Relatedly, it might be worth dropping a note in the readme to os.UserConfigDir - a coworker was having trouble getting their config to work on Windows and I only knew where to look because of this issue mentioning the method. I'm happy to put up a PR for annotating the config location a little more clearly if desired while discussion on whether to change the path-determining continues.

@michaeltlombardi +1 for that. According to the readme, I should've been able to find the config file in ~/.config/gh-dash/ but it was actually in ~/Library/Application\ Support/gh-dash/config.yml for macos.

Fixed in #135

Sorry for commenting on this closed issue, but after reading all these comments im still unsure where to place my config.yml on windows.
is it under %user%/AppData\Local\GitHub CLI\extensions\gh-dash?
I have tried different solutions but cant make it work


Add wallet_switchEthereumChain to wc methods

Add wallet_switchEthereumChain to wallet connect methods so users can switch chains whenever it is requested from dApp

Resolved by https://github.com/Orange-Wallet/wallet-connect-dart/pull/22.


print_function for python2/3 compatibility; some import fixups

@rhiju I can re-start this PR again and resolve conflicts, but let's try to merge it right away -- since I don't have write access, you have to merge all PRs.


Traffic Router logs SocketTimeoutException for port 53 TCP health checks

This Improvement request (usability, performance, tech debt, etc.) affects these Traffic Control components:

Traffic Router

Current behavior:

To ensure that a Traffic Router can handle DNSSEC requests, a common practice is for an operator to create a health check that attempts to connect to Traffic Router over TCP on port 53, and, once successfully connected, close the request. When this happens, the following stack trace shows up in traffic_router.log:
ERROR 2022-09-21T18:44:42.289 [pool-13-thread-1] org.apache.traffic_control.traffic_router.core.dns.protocol.TCP - Read timed out
java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method) ~[?:?]
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:115) ~[?:?]
	at java.net.SocketInputStream.read(SocketInputStream.java:168) ~[?:?]
	at java.net.SocketInputStream.read(SocketInputStream.java:140) ~[?:?]
	at java.nio.channels.Channels$ReadableByteChannelImpl.read(Channels.java:388) ~[?:?]
	at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:65) ~[?:?]
	at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:107) ~[?:?]
	at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:101) ~[?:?]
	at java.io.DataInputStream.readFully(DataInputStream.java:200) ~[?:?]
	at java.io.DataInputStream.readFully(DataInputStream.java:170) ~[?:?]
	at org.apache.traffic_control.traffic_router.core.dns.protocol.TCP$TCPSocketHandler.run(TCP.java:108) [classes/:?]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
	at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
	at java.lang.Thread.run(Thread.java:829) [?:?]

New behavior:

org.apache.traffic_control.traffic_router.core.dns.protocol.TCP$TCPSocketHandler.run() should catch SocketTimeoutException and give a more descriptive error (including IP address).
Also, this case is also not currently recorded in access.log. Do we want to log this case there?

I was able to reproduce this using both curl and nc utilities

Additionally, if the connection is closed by the client prematurely, a different exception is thrown:
ERROR 2022-09-21T16:40:25.925 [pool-14-thread-78] org.apache.traffic_control.traffic_router.core.dns.protocol.TCP - null
java.io.EOFException: null
	at java.io.DataInputStream.readFully(DataInputStream.java:202) ~[?:?]
	at java.io.DataInputStream.readFully(DataInputStream.java:170) ~[?:?]
	at org.apache.traffic_control.traffic_router.core.dns.protocol.TCP$TCPSocketHandler.run(TCP.java:108) [classes/:?]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
	at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
	at java.lang.Thread.run(Thread.java:829) [?:?]

It would be beneficial to log a more descriptive error in this case as well (including IP address if available).

Additionally, if the connection is closed by the client prematurely, a different exception is thrown:

Reproducible by running
docker-compose exec trafficops sh -c '</dev/null nc trafficrouter 53'

I used to turn those messages off in the past when that was a problem. I'm glad there is some resolution to this.
log4j.logger.com.comcast.cdn.traffic_control.traffic_router.core.dns.protocol.TCP=off


(PDB-3852) Fix broken structured facts queries

This commit fixes structured facts queries that descend into arrays and
those that contain regexes.
Regexes on structured facts queries have been fixed by querying the
database for all paths that match the given path regex and then adding
the results from that into the original user-query with an "or"
statement around the returned paths.
Queries that descend into arrays have been fixed by examining the query
and using the #> operator instead of the @> operator in the where
clause.

Test PASSed

Test FAILed

Test PASSed

Test FAILed

Test PASSed

OK, think we're ready now.


STAT-49 ⁃ Account API for Smart Contract Developers #321

Github issue #321
Account API would provide access to:

an account's permission tables
an account's balance (provided it is in scope)
other information available to native code

basing current requirements off of what chain_plugin.cpp get_account returns.
will add account.h with:
bool account_balance_get(void* ptr, uint32_t len)
account.hpp will have:
struct PACKED( account_balance ) { uint32_t account;...} // see ***balance_object
with namespace (account) methods for:
bool get(account_balance& b);           // populate b based on search with b.account
Acceptance Test Criteria:
1)Setup contract similar to test_account::test_balance validating each parameter in the returned account_balance or eosio::print if logs can be retrieved
2) setup an account
3) transfer funds to the account
4) stake and unstake funds
5) send a transaction with message for the contract
6) verify transaction is successful or logs have desired content
┆Attachments: Screen Shot 2017-11-22 at 12.53.36 PM.png

➤ Brian Johnson commented:
[~admin][~thomas.cox]
We can story point this, but we need [~dan.larimer] to tell us what the (wasm_interface instrinsic) function declaration is, since this will affect contracts that will likely move to multi-threaded EOS.

➤ David Moss commented:
[~kevin.heifner] Agreed on story points for account balance.

➤ Kevin Heifner commented:

Account permissions are out of scope for STAT.

Account balance can be provided
Do we have any ideas what else would be useful?

[~admin] For STAT, I suggest we story point this for account balance. We can always create new issues for additional account data needed.

➤ David Moss commented:
[~brian.johnson] Okay, ask Dan in the private developers Telegram chat about the function declaration. He may not be available to respond until Monday, 10/23/2017.

➤ Kevin Heifner commented:
[~admin] You indicated that you would check with Dan.

➤ Kevin Heifner commented:
[~dan.larimer] Do you have an interface in mind for account balance?
I noticed today #585, someone is already asking for it.

➤ Brian Johnson commented:
SUGGESTED INTERFACE
Balance:
i64 account_balance(i64)   - pass in account name and return ShareType balance
Permissions:
in account.hpp:
struct Permission {  // everything in permission_object except id
i64       owner;
id_type parent;    // not sure what we want here, should it just be the parent account name
i64       name;
u64      auth;
}
in wasm_interface:
i64 account_permission(i64,i64,i32,i32)  -- pass in AccountName and PermissionName, and pointer to Permission (to populate) with size (for validation, could skip) and returns size if populated (or 1) and 0 if not
?? - do we need a function that returns all permissions for a given account name or all permissions with a given parent?  If so, do we want to use a pointer to an array of Permission objects, or what other suggestions?  If just look up by account name (not parent) could write into an pointer to array of i64 with PermissionNames
in account.hpp:
struct StakedBalance {
i64 ownerName;
i64 stakedBalance;
i64 unstakingBalance;
i32 lastUnstakingTime;
}
in wasm_interface:
i64 account_staked(i64,i32,i32)  -- pass in OwnerName, and pointer to StakedBalance (to populate) with size (for validation, could skip) and returns size if populated (or 1) and 0 if not
for more "other information available to native code", I need some clarification.  I think the already listed functions are the most important.
[~admin] [~dan.larimer] need input if this meets requirements

➤ Kevin Heifner commented:
[~dan.larimer]

Is the suggested API good for the suggested data?
Is the API complete or do we need more?

➤ Kevin Heifner commented:
11/1/2017 Meeting with Dan.
Would like an api that follows how table access is provided. So account info would be pulled from an account table. This should be possible from any contract that provides account scope.

➤ Brian Johnson commented:
Need [~dan.larimer] and [~kevin.heifner] to review added API design

➤ Christian Dunst commented:
This has been reviewed by Kevin. !Screen Shot 2017-11-22 at 12.53.36 PM.png|thumbnail!

➤ Dhanesh Valappil commented:
Tested using a test contract.


Scaling of a application

Hello!
How can i scale a application which uses the library? I would to connect 2 or more persons to one room and i hope they are routed to one instance of application. Else they cannot to text each other

Hi!
Could you expand on what you mean by scaling the application or give a bit more context? message-io supports multiple connections/listeners

Of course.
I mean that i want to launch a few instances of application in k8s.

I think this problem is out of the scope of message-io.
In the same way, you would solve this problem using any other library, you can apply for it.
Suppose you have a typical http server and you launch several instances in k8s, how do you share data between those instances? The same solution you use there you can use in message-io. i.e. a central coordination instance or sharing the same database among those instances

Ok, thanks
I thought there is a right way to route traffic between instances.
Maybe i need to use another library for that. More likely it will be consistent hashing by a room_id or another key

Maybe you can create connections between each instance, let each instance know the other, and pass the User3 info to User1, for example. From Instance1 perspective, Instance2 would be like "another" user.

Although the above would not imply "scaling" as it is. I think the best way is to redirect users belonging to the same room to the same instance.


Add KV Command: Bulk Remove Key/Value Pair from Namespace

Related to #344 - we should also support delete
As a Workers KV user, I should be able to delete many key/value pairs on my KV namespace from Wrangler at once.

closed by #452


Fixes issues with attachment previews

Fixes #1294

[ ] I have made corresponding changes to the documentation.
[ ] I have updated the types definition of modified exports.
[x] I have verified the functionality in some of the neeto web-apps.
[x] I have added the necessary label (patch/minor/major - If package publish
is required).

Merging this as the fix needs to be deployed to NeetoDesk production.


[Candidate 2v2 Morning Dew ZH v7] Sand bags near impassable terrain are destructible

Observed behavior
Sand bags near impassable terrain are destructible. It looks as if the space would become passable but it is not.
Expected behavior
Sand bags cannot be destroyed.
Screenshots

fixed.


ver.rc: fix misspelling

Changes proposed in this pull request:
This patch fixes the trademark statement in ver.rc file that indicates United Status. (misspelling of United States?)

Thank you very much for your contribution!


linux_*_hardened: update patches

Motivation for this change
The hardened kernels were using backported patches, but the upstream patches for the kernel versions we're using are now out.
Also includes some refactoring of the update script including use of pathlib and type annotations (requires a local branch of the git version of PyGithub to pass mypy --strict, will work on upstreaming that).
@GrahamcOfBorg test hardened latestKernel.hardened
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[ ] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

@GrahamcOfBorg test hardened latestKernel.hardened

@NeQuissimus pushed the patch updates already :)
Closing in favour of #86074.


Double border on CI/CD widget

There is a double bottom border on the Recent Workflow Runs card when it only has a small number of runs in it.

Probably a candidate for Good First Issue. I can't add labels.

Can I pick this up?

Sure!

@dtuite I am not able to see the Recent Workflow Runs section when I run the backstage application using yarn dev. I guess I have not setup my application properly, could you please tell me what else do I need to do to see other features like Recent Workflow Runs, Auditing etc.

How could I develop something like https://demo.roadie.so/catalog locally?

@abhishekjakhar I recommend creating a GitHub repo with some GitHub actions configured and only running one build just to get some sample data.  You can fork https://GitHub.com/RoadieHQ/sample-service if you like.


Remove circularity fallback deferral in getConditionalType

Per commentary in #30443, this reverts the code change in #30375, but keeps the new test.

@typescript-bot run dt

DT failure is in ramda:
Error in ramda
Error: /home/vsts/work/1/s/dtslint-runner/DefinitelyTyped/types/ramda/ramda-tests.ts:970:26
ERROR: 970:26  expect  TypeScript@local compile error:
Argument of type '<T>(obj: Record<"id", T>) => T' is not assignable to parameter of type '(a: Record<"id", T>) => string'.
  Type 'T' is not assignable to type 'string'.

    at /home/vsts/work/1/s/dtslint-runner/node_modules/dtslint/bin/index.js:210:19
    at Generator.next (<anonymous>)
    at fulfilled (/home/vsts/work/1/s/dtslint-runner/node_modules/dtslint/bin/index.js:5:58)
The following packages had errors: ramda
FAILED

It's the const a2 = R.indexBy(R.prop("id"))(list); - which looks like the last error left in ramda after today's fix (which I think the author already said might be due to some incorrect types in ramda, rather than a fault on our part - I haven't looked into this one, though).
In any case, not the fault of reverting this, so I'm going to merge this.


Added Rim Station

About the PR
I added Rim Station! My first map! Small map for 60 players with lots of roleplay opportunities
Media

[x] I have added screenshots/videos to this PR showcasing its changes ingame, or this PR does not require an ingame showcase

:cl:

add: Added Rim Station!

Please include screenshots and something akin to a map render.

Got a video or picture of it? Would be useful.

Map renderer can't render this map because it's not properly set up
NUnit.Framework.AssertionException: Multiple failures or warnings in test:
  1) SERVER: 4.510s [ERRO] station: The station detroit2 in map rim does not have an associated station config! Exception:

I am happy to report I have fixed some the issues. Standby for photos.

MY EYES!  Also how do I get my map render?

Photos posted and issues fixed so what is the next step?

Um I made a mistake the buffs and flavor text change was to be a separate PR. I am not good at github. I guess I am commuting a map and some minor balance stuff

Um I made a mistake the buffs and flavor text change was to be a separate PR. I am not good at github. I guess I am commuting a map and some minor balance stuff

you're gonna have to split the PRs if you want either to get merged

Um I made a mistake the buffs and flavor text change was to be a separate PR. I am not good at github. I guess I am commuting a map and some minor balance stuff

you're gonna have to split the PRs if you want either to get merged

Ok if we can split them that would be great! I dont know how. can it be done on your side?

run variantize on your grid and add some decals, it looks really bland atm

Dont use bananium for the clown room walls and stuff its an expensive resource.

Dont use bananium for the clown room walls and stuff its an expensive resource.

Ok I will fix that. Anything else?

Decals are too bright and theres generally not enough.

Decals are too bright and theres generally not enough.

What decal sorry?

Decals are too bright and theres generally not enough.

What decal sorry?

most decals, like departmental ones.


Getting Mixed Up in Output

I am experiencing an issue where the fields in the output are getting mixed up, resulting in incorrect values being assigned to the wrong fields.
For example, the correct output should be:
Prediction(
    rationale='produce the where_in_signature_flow. We need to clarify the user\'s response, particularly focusing on any ambiguous or abstract terms they used. The user mentioned "Considering the price elasticity of supply and demand, it will stabilize the cultivation volume." This phrase contains abstract terms like "price elasticity" and "stabilize the cultivation volume," which need further clarification to ensure we understand the user\'s reasoning correctly.',
    socratic_question='When you mention "price elasticity of supply and demand," could you explain what you mean by that in this context? How does it relate to stabilizing the cultivation volume?',
    where_in_signature_flow='A'
)

However, it often gets mixed up like this:
Prediction(
    rationale='Socratic Question: So, does that mean you believe that because the price of apples will not change, the cultivation volume will remain stable despite the presence of the parasite?\n\nWhere In Signature Flow: B',
    socratic_question='',
    where_in_signature_flow='So, does that mean you believe that because the price of apples will not change, the cultivation volume will remain stable despite the presence of the parasite?'
)

In the second output, the where_in_signature_flow content has been mistakenly placed in the rationale field, and the socratic_question field is left empty.
Why is this happening and how can I fix it? Should I combine all the output fields and then parse them?
The prompts in the input fields are quite large and there are five of them. Could this be the reason?
Would using Assertions and/or Suggestions be helpful in this case?
Any advice would be appreciated!

Could you just assert that no return value is allowed to be empty? Forcing the LM to go back and fill out the socratic_question would probably also lead to it then filling out the correct type of value in signature flow.
Also this helps with negative example bootstrapping. If you compile your program the LM will get this negative example and might learn to avoid skipping fields.

Thanks @tom-doerr! Yes, using the assertion did the trick. Just ouf of curiosity, are you aware of any example of for "negative example bootstrapping"? Many thanks again.

Don't have a trace that contains counterexamples at hand, but from the paper:
"Counterexample bootstrapping. During prompt optimization and example bootstrapping, another important contribution of LM Assertions is to develop demonstrations that contain failed examples and traces to fix the errors. When the counterexamples are mixed with bootstrapped few-shot examples, the LM is more likely to avoid the same mistakes without assertion-driven backtracking."
More details are in the paper: https://ar5iv.labs.arxiv.org/html/2312.13382

Thank so much @tom-doerr


feat(table): add ability to have unselectable rows

Summary

add capability to the Table card to have unselectable rows (by making isSelectable=false)

Acceptance Test (how to verify the PR)

Test out the two new stories with isSelectable true for Table rows

:tada: This PR is included in version 1.94.0 :tada:
The release is available on:

npm package (@release-1.x dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 2.5.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


blocked by some domain ?

hello, i'm using cors-anywhere, and it works fine until now, suddenly i can't use it to some domain like ultimate guitar, i'm using this code and it used to be work.
  $.ajaxPrefilter( function (options) {     if (options.crossDomain && jQuery.support.cors) {       var http = (window.location.protocol === 'http:' ? 'http:' : 'https:');       options.url = http + '//cors-anywhere.herokuapp.com/' + options.url;     }   });
my url example is : https://tabs.ultimate-guitar.com/c/calvin_harris/feels_ver2_crd.htm
when i try another url like musixmatch (https://www.musixmatch.com/lyrics/Calvin-Harris-feat-Pharrell-Williams-Katy-Perry-Big-Sean/Feels)
it works fine. Any idea what caused this issue?

I just tried to load the URL via the demo, and the request works just fine for me.
If this issue still occurs, please add a self-contained example that shows the issue, and include the error message(s) / HTTP responses that you've received.

oh, i works now! I'm pretty sure on that time, we can't get HTML from ultimate guitar website at that time


Add option to not install irssi for new users, and allow to enable/remove it post-creation

Some users straight up do not use autodl-irssi, and do not care for it, while others use it heavily. It's a hate it or love it kind of thing. It would be nice if enabling irssi for a user account were an option during account creation, and possible enable it later if it comes to it, or remove it if it's not being used at all.

I include it as standard as it has a very light footprint, so you can simply not use it, and it will have a negligible impact, so for now will not make it optional.
If you really want to remove it simply delete the folder from rutorrent and apt-get remove irssi.


Improve the functionallity of output::write() something like printf

atm the implemention of output::write() is simply std::cout << somestring; this could eventually replaced with printf c function

this enhancement has been applied by the following branch  #11


gccgo: internal compiler error for recursive variable declaration

Compilation of the following (invalid) program crashes gccgo:
$ cat x.go
package p

var a [len(a)]int

$ gccgo x.go
gccgo: internal compiler error: Segmentation fault signal terminated program go1
Please submit a full bug report,
with preprocessed source if appropriate.
See <http://go.ext.google.com/go/> for instructions.

$ gccgo --version
gccgo (google-gccgo-257955) 8.0.1 20180223 (experimental)
Copyright (C) 2018 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

Related: Compiling this program
package p

var a T

type T [len(a)]int

yields:
x.go:5:9: error: array bound is not constant
 type T [len(a)]int
         ^

which is better (no crash) but perhaps a bit misleading. Any constant size of the array would satisfy the program, were one chosen (e.g., 0). But the program should probably be simply invalid due to a cycle.

For reference:

cmd/compile reports a type-checking loop for the first program (no type T), and an "invalid argument a for len" error for the 2nd program (with type T).
go/types reports a cycle error (initialization cycle for a) for the 1st program (no type T), and accepts the 2nd program (with type T) choosing an array length of 0.

I believe we should disallow both programs.

CC @thanm

I'll take a look.

FWIW: I don't think this is an urgent bug to fix; I am recording these mostly so we can get a better understanding of the limits of what we should/should not accept in terms of cycling definitions. But if there's a simple oversight causing the crash, yes, that should perhaps be addressed.

Related to https://github.com/golang/go/issues/25315, https://github.com/golang/go/issues/25677, https://github.com/golang/go/issues/25680. Should be able to fix them together.


Projection does not handle nullable DateTimeFields correctly

Currently when no value is selected for a DateTimeField then GetFilterPredicate() determines min and max incorrectly as it expects a string formatted as yyyy-MM-dd HH:mm:ss.
The following change is needed to pass min and max as empty string (to avoid exception in IHQLCriterion.FormatValue()) or 0 when asTicks is true:

Can you provide some repro steps? I am not convinced of how it should impact the construction of the query with the Or and Ands. The rest of your code is fine.

This issue is basically a forerunner of issue #6979, the PR has been accepted already, so i close this as it's not relevant anymore. Btw: the Ors and Ands are there to leave existing code untouched, it just adds a new code path for handling the value is null case.


Include Operator Nexus - Network cloud to the CODEOWNER file

Contributing to the Azure SDK
: Adding Operator Nexus - Network Cloud code owners to receive bot notification

azp run net - codeowners- linter

/azp run net - codeowners-linter - ci


Relax VS add-in restrictions on .btdfproj file and directory names

Previously the Visual Studio add-in required the .btdfproj file to be located at <solutionNameNoExtension>.Deployment<solutionNameNoExtension>.Deployment.btdfproj.
Relax that restriction to include two more options: \Deployment<solutionNameNoExtension>.Deployment.btdfproj and \Deployment\Deployment.btdfproj.
This work item was migrated from CodePlex
CodePlex work item ID: '6885'
Assigned to: 'tfabraham'
Vote count: '0'

[UnknownUser@6/21/2010]
Resolved with changeset 47637.

[UnknownUser@2/21/2013]

[UnknownUser@5/16/2013]


[tf] Remove custom security checkers

The existing checkers have been made more robust and should now consider edge cases where endpoint reachability is conditional on control plane configuration.
Please provide a description of this PR:

/retest

@nmittler: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name
Commit
Details
Required
Rerun command

integ-security-multicluster_istio
39ac048627c0151ab0b7182afe7e8de427ad3857
link
true
/test integ-security-multicluster_istio

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@nmittler: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name
Commit
Details
Required
Rerun command

integ-security-multicluster_istio
4d07543000cc653eb9855ef7b4ccddf9483bc731
link
true
/test integ-security-multicluster_istio

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.


RecursionError: maximum recursion depth exceeded while calling a Python object

What happened?
Traceback (most recent call last):
File "/home/qiahan/.conda/envs/firstEnv/lib/python3.9/site-packages/xarray/core/variable.py", line 264, in _as_array_or_item
data = np.asarray(data)
File "/home/qiahan/.local/lib/python3.9/site-packages/dask/array/core.py", line 1701, in array
x = self.compute()
File "/home/qiahan/.local/lib/python3.9/site-packages/dask/base.py", line 314, in compute
(result,) = compute(self, traverse=False, **kwargs)
File "/home/qiahan/.local/lib/python3.9/site-packages/dask/base.py", line 599, in compute
results = schedule(dsk, keys, **kwargs)
File "/home/qiahan/.local/lib/python3.9/site-packages/dask/threaded.py", line 89, in get
results = get_async(
File "/home/qiahan/.local/lib/python3.9/site-packages/dask/local.py", line 511, in get_async
raise_exception(exc, tb)
File "/home/qiahan/.local/lib/python3.9/site-packages/dask/local.py", line 319, in reraise
raise exc
File "/home/qiahan/.local/lib/python3.9/site-packages/dask/local.py", line 224, in execute_task
result = _execute_task(task, data)
File "/home/qiahan/.local/lib/python3.9/site-packages/dask/core.py", line 119, in _execute_task
return func((_execute_task(a, cache) for a in args))
File "/home/qiahan/.local/lib/python3.9/site-packages/dask/core.py", line 119, in
return func((_execute_task(a, cache) for a in args))
File "/home/qiahan/.local/lib/python3.9/site-packages/dask/core.py", line 119, in _execute_task
return func((_execute_task(a, cache) for a in args))
File "/home/qiahan/.local/lib/python3.9/site-packages/dask/core.py", line 119, in
return func((_execute_task(a, cache) for a in args))
File "/home/qiahan/.local/lib/python3.9/site-packages/dask/core.py", line 38, in istask
return type(x) is tuple and x and callable(x[0])
RecursionError: maximum recursion depth exceeded while calling a Python object
What did you expect to happen?
When the for loop is 1500 times, no error, but when it is like 17000 times, I got this recursion error.
Minimal Complete Verifiable Example
for count_i,t in enumerate(all_resample.time.to_numpy()[96:17137],96):
        print(t, flush=True)
        ds_era5land = all_resample.sel(time=t, method='nearest').compute()
        ds = xr.merge([ds_era5land])
        ds_ss = xr.Dataset()
        ds_ss["Rin"] = Rin.sel(time=t, method='nearest').compute()
        ds_ss["Rli"] = Rli.sel(time=t, method='nearest').compute()
        ds_ss["p"] = ds["sp"]/100   # Pa -> hPa
        ds_ss["Ta"] = ds["t2m"] - 273.15  # K -> degC
        ds_ss["ea"] = vc.calculate_es(ds["d2m"] - 273.15)
        ds_ss["u"] = (ds["u10"] ** 2 + ds["v10"] ** 2) ** 0.5
        ds_ss["Precip_msr"] = ds["tp"]*1000   # mm
        ds_ss['LAI'] = lai.sel(time=t, method='nearest').compute()
        ds_ss['CO2'] = ds_co2_10km.sel(time=t, method='nearest').compute()
        ds_ss['SSM'] = SSM.sel(time=t, method='nearest').compute()

        ds_ss = ds_ss.to_array()
        Rin_line = ds_ss[0,:,:].to_numpy().reshape(1, ds_ss.latitude.size*ds_ss.longitude.size)
        Rli_line = ds_ss[1,:,:].to_numpy().reshape(1, ds_ss.latitude.size*ds_ss.longitude.size)
        p_line = ds_ss[2,:,:].to_numpy().reshape(1, ds_ss.latitude.size*ds_ss.longitude.size)
        Ta_line = ds_ss[3,:,:].to_numpy().reshape(1, ds_ss.latitude.size*ds_ss.longitude.size)
        ea_line = ds_ss[4,:,:].to_numpy().reshape(1, ds_ss.latitude.size*ds_ss.longitude.size)
        u_line = ds_ss[5,:,:].to_numpy().reshape(1, ds_ss.latitude.size*ds_ss.longitude.size)
        Precip_msr_line = ds_ss[6,:,:].to_numpy().reshape(1, ds_ss.latitude.size*ds_ss.longitude.size)
        LAI_line = ds_ss[7,:,:].to_numpy().reshape(1, ds_ss.latitude.size*ds_ss.longitude.size)
        CO2_line = ds_ss[8,:,:].to_numpy().reshape(1, ds_ss.latitude.size*ds_ss.longitude.size)
        SSM_line = ds_ss[9,:,:].to_numpy().reshape(1, ds_ss.latitude.size*ds_ss.longitude.size)

        features_arr = np.concatenate((Rin_line, Rli_line, p_line, Ta_line,ea_line, u_line, Precip_msr_line,
                                       LAI_line, hc_line, CO2_line, SSM_line, Vcmo_line,
                                       IGBP1, IGBP2, IGBP3,IGBP4,IGBP5,IGBP6,IGBP7,IGBP8,IGBP9,IGBP10,IGBP11))
        features_arr = features_arr.transpose()

        # Nan value.
        df_features = pd.DataFrame(data=features_arr)
        df_features_drop_nan = df_features.dropna()
        invalid_index = sorted(set(df_features.index.to_list()) - set(df_features_drop_nan.index.to_list()))

        # # Convert the nan value as 0 for the calculation
        where_are_NaNs = np.isnan(features_arr)
        features_arr[where_are_NaNs] = 0

        estimated_LEH = rfLEHmulti.predict(features_arr)

MVCE confirmation

[X] Minimal example — the example is as focused as reasonably possible to demonstrate the underlying issue in xarray.
[ ] Complete example — the example is self-contained, including all data and the text of any traceback.
[ ] Verifiable example — the example copy & pastes into an IPython prompt or Binder notebook, returning the result.
[ ] New issue — a search of GitHub Issues suggests this is not a duplicate.

Relevant log output
No response
Anything else we need to know?
No response
Environment

xarray version is 2022.9.0, python is 3.9.16

(trying to clear up old issues, keep us below 1K)
This needs an MCVE


UI: load domain lists only if listDomains API is available

Description
This PR fixes #8657

Types of changes

[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] New feature (non-breaking change which adds functionality)
[x] Bug fix (non-breaking change which fixes an issue)
[ ] Enhancement (improves an existing feature and functionality)
[ ] Cleanup (Code refactoring and cleanup, that may add test cases)
[ ] build/CI

Feature/Enhancement Scale or Bug Severity
Feature/Enhancement Scale

[ ] Major
[ ] Minor

Bug Severity

[ ] BLOCKER
[ ] Critical
[ ] Major
[ ] Minor
[ ] Trivial

Screenshots (if appropriate):
How Has This Been Tested?

How did you try to break this feature and the system with this change?

@blueorangutan ui

@weizhouapache a Jenkins job has been kicked to build UI QA env. I'll keep you posted as I make progress.

UI build: :heavy_check_mark:
Live QA URL: https://qa.cloudstack.cloud/simulator/pr/8660 (QA-JID-281)


Jumbled Console log over USB

Tested with sample/subsys/usb/console (zephyr 1.11.rc1 release) on Arduino 101 connected to Linux host:
Plug the board into a Linux host.
The board will be detected as a CDC_ACM serial device. To see the console output
from the zephyr board, used  command  "minicom -D /dev/ttyACM0".
The console output we are getting is jumbled:
ld!x8
Hello World! x86
HellWorld! x86
llo Word! x6
Hello Wordx6
Hello World! x86
Hello World!x6
Hello World! x86
Hel Wol! x6
HelWrdx6
Hlo Worl!x6
Hello o6
Heo rl!x6
Hello World! x86
Hello World! x86
Hello World! x86
Issue is easily reproducible in almost every iteration.

This looks related to  #3614

@nashif This is not fixed yet

Can not confirm, tested with current master, connected to xhci and ehci.

@jfischer-phytec-iot Do you mean it works for you? I just tested on master + PR #4661 - I see the same issue described in this bug and bug #3614.

@finikorg it works for me, also I noticed that the errors with Arduino 101 are host controller dependent.

@finikorg is still an issue?

That's a true low-priority bug, we don't see it on any other hardware than Arduino 101

Just like in #5678, we're closing it based on Arduino 101 not being actively maintained


defaults preferences?

Thanks for your work on this project. I'm pulling in the most recent versions of goldmark and chroma and building glance from source and would like to experiment with changing the rendered appearance of markdown files and the output of the quicklook previews altogether---e.g., fontsize, font type, coloring, etc. Are there any defaults settings that handle this from the command line? Or if one wanted to tweak these settings, are these changes that have to be made in the go modules? Thanks!

Hi resistor4u, these settings are not configurable from the command line. The changes need to be tweaked in the CSS files located here: https://github.com/chamburr/glance/tree/main/QLPlugin/Resources/shared.

Great thanks! I've only messed with font size in shared-main.css so far, but I'm assuming all the values there can be changed without having to recompile? If this is right, it might make sense to notate that somewhere in the readme with a trivial example?

Oh yeah they should work without recompiling. I don't think I want to include this in README since the changes don't persist across updates and reinstalls. Perhaps a feature we could work on is to read CSS files from some Library folder.


Update install.xml

disallow add_cart in case of zero price

Hello!
I do not quite understand what exactly you want to do.
Now there is a condition that if the product is over and it is forbidden to order such goods in the settings, the add to cart button will be disabled. In other cases, the button will always work.

In case of setting the price to zero for example by the mistake and the condition that if the product is over is enabled, you can buy the zero priced product. And I'd like to create prevention of this situation.

But there is no longer any correction required. If the product is over and it is forbidden to order such goods in the settings, it can not be ordered, regardless of its price.

Yes, you are right, but it is only one point of view. The second point of view is that you allow to show products which is out of the stock and by mistake set the price to zero, or you have another reason to set the price to 0. Than everybody can buy this product and it isn't wanted behavior. That's why is the reson why I'm suggesting this improvement. If you think it's useless, please, ignore this suggestion :) I will use it by my modification in opencart. I thought it's useful for other people to not "show" add cart in this case.

In many stores especially in manufacturing industry or custom design shops, the goods will be made after received an order (Make-to-order - MTO) instead of keeping in stock or made prior to an order (Make-to-Stock - MTS). In this case Customers need to possible to ordering the goods with the availability status of "Pre-Order" or "0" stock.
I've made small ext.to enable add-to-cart for "Pre-Order" or "0" stock. : https://www.opencart.com/index.php?route=marketplace/extension/info&extension_id=35272

It make sense.


Buttons First and Last not visible in mobile View

I can see the three middle buttons only on my phone.
Would be nice if one could swipe the button-row to the left or if the buttons are distributed to two rows if resolution is to small.
The only workaround on a phone is to switch to "desktop view" to reach the side buttons.
Or How about a dropdown menu on the number to reach older wordles?! Wouldnt need space!

Yes, that is what I had before - the mobile version only had the three buttons. Thank you for your request, I have added more navigation options to the mobile version, including a number drop-down. Hope that helps, closing this for now.


Please update podspec to proper version, still pointing to 2.4 instead of 2.6.2

The podspec file is still pointing to 2.4 instead of 2.6.2
This causes irritations when adding the pod into local project. regarding versioning.

Hi @Oggerschummer,
You have new release pointing to 2.7, newest version..
Enjoy!

Hello @litoarias , it works like a charm, thanks for the quick response.
Greetings from Frankfurt.


allow user control on has_atomic32 and has_atomic64

on OpenBSD, for i386 architecture, we use a slightly different specification that the one in src/librustc_target/spec/i686_unknown_openbsd.rs. we are targeting olders CPUs, possibly without atomic64.
this PR adds a user configurable way to specify if the target has atomic32 and atomic64.
it uses environment variables SERDE_HAS_ATOMIC32_targetname and SERDE_HAS_ATOMIC64_targetname to force a specific value, and fallback to hardcoded definition.

@dtolnay I understand your point of vue. my problem is "patching the build script" means "patching the build script" for all rust programs using serde in OpenBSD. which is lot of work. I will look to upstream src/librustc_target/spec change so.
Thanks.