Exception in thread "main" Unknown warehouse: bigquery

I'm trying to run metriql on a macbook.
My dbt project compiles and runs just fine.
I reinstalled docker and pulled the latest metriql image.
My dbt setup is customised a little:

profiles.yml is in the project root. This is configured as an env_variable
I'm building to ${workspaceFolder}/.dbt/artifacts/.  This is configured in dbt_project.
Both work fine except for metriql.

(.venv) daniel@dbrtly-MBP dbt_shop % pwd
/Users/daniel/git/dbrtly/dbt_shop
(.venv) daniel@dbrtly-MBP dbt_shop % export DBT_PROJECT_DIR=${PWD}
export DBT_PROFILES_DIR=${PWD}
export METRIQL_PORT=5656

docker run -it -p "${METRIQL_PORT}:5656" -v "${DBT_PROJECT_DIR}:/root/app" -v "${DBT_PROFILES_DIR}:/root/.dbt" -e METRIQL_RUN_HOST=<IP_ADDRESS> -e DBT_PROJECT_DIR=/root/app buremba/metriql \
 run
Aug 02, 2021 7:25:13 AM http://ru.yandex.clickhouse.ClickHouseDriver <clinit>
INFO: Driver registered
Exception in thread "main" Unknown warehouse: bigquery

Also FWIW I'd really prefer to use docker-compose rather than docker cli.

Hey @dbrtly, thanks for creating the issue. I fixed the bug and pushed a new version on latest tag, could you please try again? BTW, we currently support keyfile_json in BigQuery as the authentication method.
We do not run multiple apps (or dbt itself) inside the docker container, why do you think that docker-compose would be a better approach?

testing in progress.
Mostly because it's so much easier to type.
docker-compose up

new error now
(.venv) daniel@Daniels-MBP dbt_shop % export DBT_PROJECT_DIR=${PWD}
export DBT_PROFILES_DIR=${PWD}
export METRIQL_PORT=5656

docker run -it -p "${METRIQL_PORT}:5656" -v "${DBT_PROJECT_DIR}:/root/app" -v "${DBT_PROFILES_DIR}:/root/.dbt" -e METRIQL_RUN_HOST=<IP_ADDRESS> -e DBT_PROJECT_DIR=/root/app buremba/metriql \
 run
Aug 02, 2021 9:51:10 AM ru.yandex.clickhouse.ClickHouseDriver <clinit>
INFO: Driver registered
Exception in thread "main" Invalid config: java.lang.IllegalArgumentException: Cannot deserialize value of type `com.metriql.warehouse.bigquery.BigQueryWarehouse$BigQueryConfig$Method` from String "oauth": not one of the values accepted for Enum class: [service-account-json, service_account, oauth-secrets]
 at [Source: UNKNOWN; line: -1, column: -1] (through reference chain: com.metriql.warehouse.bigquery.BigQueryWarehouse$BigQueryConfig["method"])

Hey @dbrtly , the OAuth option was not available for BigQuery, just implemented it. Can you please test it again?

If you're using the local Oauth option, BigQuery credentials are in your local filesystem. In that case, here is how you can pass the credentials to the container:
export GCLOUD_DIR=${HOME}/.gcloud

# should be passed as an argument to docker
-v "${GCLOUD_DIR}:/root/.gcloud"

Could that be set as a default?
Get Outlook for iOShttps://aka.ms/o0ukef

From: Burak Emre Kabakcı @.>
Sent: Wednesday, August 4, 2021 11:34:17 AM
To: metriql/metriql @.>
Cc: Daniel Bartley @.>; Mention @.>
Subject: Re: [metriql/metriql] Exception in thread "main" Unknown warehouse: bigquery (#18)
If you're using the local Oauth option, BigQuery credentials are in your local filesystem. In that case, here is how you can pass the credentials to the container:
export GCLOUD_DIR=${HOME}/.gcloud
should be passed as an argument to docker
-v "${GCLOUD_DIR}:/root/.gcloud"
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/metriql/metriql/issues/18#issuecomment-892289634, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ADLXPTNL64KZOCIFFK7NZXLT3CKJTANCNFSM5BMFF63Q.

Not sure how I can set it via Docker command but I created a docker-compose.yml file per your suggestion. Does it work for you? https://github.com/metriql/metriql/blob/master/docker-compose.yml


ios Build error

when i do
$ ionic build ios
** BUILD FAILED **
The following build commands failed:
CompileSwift normal i386 /Users/bx/ionic/geoFenTry/platforms/ios/geoFenTry/Plugins/com.cowbell.cordova.geofence/GeofencePlugin.swift
CompileSwift normal i386 /Users/bx/ionic/geoFenTry/platforms/ios/geoFenTry/Plugins/com.cowbell.cordova.geofence/SwiftData.swift
CompileSwiftSources normal i386 com.apple.xcode.tools.swift.compiler
(3 failures)
Error code 65 for command: xcodebuild with args: -xcconfig,/Users/bx/ionic/geoFenTry/platforms/ios/cordova/build-debug.xcconfig,-project,geoFenTry.xcodeproj,ARCHS=i386,-target,geoFenTry,-configuration,Debug,-sdk,iphonesimulator,build,VALID_ARCHS=i386,CONFIGURATION_BUILD_DIR=/Users/bx/ionic/geoFenTry/platforms/ios/build/emulator,SHARED_PRECOMPS_DIR=/Users/bx/ionic/geoFenTry/platforms/ios/build/sharedpch
ERROR building one of the platforms: Error: /Users/bx/ionic/geoFenTry/platforms/ios/cordova/build: Command failed with exit code 2
You may not have the required environment or OS to build this project
Error: /Users/bx/ionic/geoFenTry/platforms/ios/cordova/build: Command failed with exit code 2
at ChildProcess.whenDone (/usr/local/lib/node_modules/cordova/node_modules/cordova-lib/src/cordova/superspawn.js:131:23)
at ChildProcess.emit (events.js:110:17)
at maybeClose (child_process.js:1015:16)
at Process.ChildProcess._handle.onexit (child_process.js:1087:5)

Hey. Which version of xcode do you have? I've recently merged some changes to support xcode 8.3 and swift 1.2 and there is no backwards compability between swift 1.2 and 1.1 :tired_face:

Hello,
I use XCode Version 6.3.1
Could you please help get & use that latest merged code?

I'm having the same issue.
Libtool /Users/Tom/Downloads/ionic-geofence-master/platforms/ios/build/emulator/libCordova.a normal i386
cd /Users/Tom/Downloads/ionic-geofence-master/platforms/ios/CordovaLib
export IPHONEOS_DEPLOYMENT_TARGET=6.0
export PATH="/Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/usr/bin:/Applications/Xcode.app/Contents/Developer/usr/bin:/opt/local/bin:/opt/local/sbin:/opt/local/lib/postgresql94/bin/:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/usr/local/gradle-1.12:/opt/X11/bin"
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/libtool -static -arch_only i386 -syslibroot /Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/iPhoneSimulator8.3.sdk -L/Users/Tom/Downloads/ionic-geofence-master/platforms/ios/build/emulator -filelist /Users/Tom/Downloads/ionic-geofence-master/platforms/ios/CordovaLib/build/CordovaLib.build/Debug-iphonesimulator/CordovaLib.build/Objects-normal/i386/Cordova.LinkFileList -o /Users/Tom/Downloads/ionic-geofence-master/platforms/ios/build/emulator/libCordova.a
=== BUILD TARGET ionic-geofence OF PROJECT ionic-geofence WITH CONFIGURATION Debug ===
Check dependencies
Swift is unavailable on iOS earlier than 7.0; please set IPHONEOS_DEPLOYMENT_TARGET to 7.0 or later (currently it is '6.0').
Seems to be an issue with the deployment target settings of the cordova lib

After the geofence plugin is installed all needed settings to support swift should be set. There is a hook for this. Try to clear everything ionic state clear and add platform once again ionic platform add ios. Make sure everything is correctly installed you should see something similar to this in your logs:
Creating new Bridging-Header.h at path:  /Users/tomasz/dev/ionic-geofence/platforms/ios/ionic-geofence/Plugins/Bridging-Header.h
Importing Geo-Bridging-Header.h into main bridging-header at: /Users/tomasz/dev/ionic-geofence/platforms/ios/ionic-geofence/Plugins/Bridging-Header.h
IOS project now has deployment target set as:[7.0] ...
IOS project option EMBEDDED_CONTENT_CONTAINS_SWIFT set as:[YES] ...
IOS project swift_objc Bridging-Header set to:[/Users/tomasz/dev/ionic-geofence/platforms/ios/ionic-geofence/Plugins/Bridging-Header.h] ...
IOS project Runpath Search Paths set to: @executable_path/Frameworks ...
IOS project Adding libsqlite3...

Thanks, this fixed the problem for me


Update packages to latest AngleSharp

The tests seem to pass fine
========================================
Run-Unit-Tests
========================================
Executing task: Run-Unit-Tests
NUnit Console Runner 3.0.5813
Copyright (C) 2015 Charlie Poole

Runtime Environment
   OS Version: Microsoft Windows NT 10.0.15063.0
  CLR Version: 4.0.30319.42000

Test Files
    C:/Users/Georgios/Documents/GitHub/AngleSharp.Scripting/src/AngleSharp.Scripting.CSharp.Tests/bin/Release/AngleSharp.Scripting.CSharp.Tests.dll
    C:/Users/Georgios/Documents/GitHub/AngleSharp.Scripting/src/AngleSharp.Scripting.JavaScript.Generator.Tests/bin/Release/AngleSharp.Scripting.JavaScript.Generator.Tests.dll
    C:/Users/Georgios/Documents/GitHub/AngleSharp.Scripting/src/AngleSharp.Scripting.JavaScript.Tests/bin/Release/AngleSharp.Scripting.JavaScript.Tests.dll

Run Settings
    WorkDirectory: C:/Users/Georgios/Documents/GitHub/AngleSharp.Scripting/bin/0.5.0
    RuntimeFramework: net-4.0
    NumberOfTestWorkers: 12

Test Run Summary
    Overall result: Passed
   Tests run: 95, Passed: 95, Errors: 0, Failures: 0, Inconclusive: 0
     Not run: 0, Invalid: 0, Ignored: 0, Explicit: 0, Skipped: 0
  Start time: 2017-05-05 12:57:35Z
    End time: 2017-05-05 12:58:03Z
    Duration: 28.188 seconds

Looks good so far.
Just some notes:

I can't accept this at the end as you PR to the master branch. PRs are only accepted to the devel branch. The master branch only contains the latest released version.
Why have you changed the Clr function implementation? Reasoning? Side-effects?

Regarding 1. you would need to re-PR in any case (I will close it once you re-opened).

Hey @FlorianRappl - the Clr function implementation change was necessary because it's not a nullable type any longer and the code wouldn't compile. Simples :)
I'll send you a PR on the devel branch

Well, on the devel branch it seems you are referencing AngleSharp 0.10.0 already which doesn't exist, so I'm not sure if it makes sense to send you a PR there, especially if you're not going to publish a new nuget for the Scripting 0.5.x

We could do a 0.5.1 (and make an exception to use the master branch, as v0.10 of AngleSharp is delayed). But for this to happen we need to solve the issue regarding the Clr function. It's not a nullable - fair enough. But why remove the logic? It should then return arg.Value.ToObject(), right? Or would Value?.ToObject() make more sense?

@FlorianRappl you're 100% correct - not sure how I missed that. Thanks :)

Looks good - I'll release a v0.5.1 then on NuGet!

Thank you :)


PT Run sleep does not trigger

Microsoft PowerToys version
0.74.1
Installation method
PowerToys auto-update
Running as admin
Yes
Area(s) with issue?
PowerToys Run
Steps to reproduce

Open PT Run
type 'Sleep'
select 'Sleep'
nothing happens

✔ Expected Behavior
Selecting 'Sleep' puts PC to sleep, Other system commands seem to work.
❌ Actual Behavior
Nothing happens
Other Software
No response

Not able to repro this, going to close. Let us know if you see this again!


Launching AdminMongo on a virtual machine

I'm trying to run mongodb and adminMong on a virtual machine using localhost and port 80 as configuration:
{     "app": {         "host": "localhost",         "port": 80,         "locale": "en",         "monitoring": true     } }
And when i open localhost:80 on google chrome it not working, What can I do please?

you need to be root to bind on port 80


Add root workspace in members

ref: https://github.com/gluesql/gluesql/pull/879/files#diff-254e37d1bdaec899062959fb14f59d4804fd9fc4886853fac7833121747f3e5a

ref. https://github.com/gluesql/gluesql/blob/f31a3c16f0f9421a5c71b0e3f65a8547ef605495/tests/glue.rs#L54-L72
This root test was supposed to fail but it wasn't checked by our current GitHub action.
That can be fixed by this PR.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.4%) to 97.877%

Totals

Change from base Build<PHONE_NUMBER>:
-0.4%

Covered Lines:
37536

Relevant Lines:
38350

💛  - Coveralls


feature: multiplatform support

as title says, it would be neat with KMP support

I need this as well


i'm struggling on installing it

the installing documentation is far incomplete, i only get error messages, and no kuler2gpl installed at all - in which directory should we enter "npm install -g kuler2gpl" from the terminal? anywhere, outside or inside the package folder? i tried all 3, none worked

Hello nitrofurano,
The module is a command-line utility; it does not do installation in the folder of palettes.
Entering npm install -g kuler2gpl installs the package as an NPM global.
You would have to install NodeJS prior to that.  May I refer you to one of the scripts at https://gist.github.com/isaacs/579814 , which works pretty well.
Do let me know should you have any issue.
Cheers!


Webchat does not show text from HTTPS Response despite HTTP Code 200

Hello
I'm calling a remote https service via the bot emulator by typing a text into the webchat, here "Hello". The response is coming back correctly with HTTP code 200, but the webchat does not show the response. What did I miss?
Bot Emulator version is 3.5.33
Startup Log
[11:16:23] Emulator listening on http://[::]:63840
[11:16:23] ngrok listening on https://08a7372a.ngrok.io
[11:16:23] ngrok traffic inspector: http://localhost:4040
[11:16:23] Will bypass ngrok for local addresses
[11:16:23] Checking for new version...
[11:16:25] Application is up to date.
I added the screenshots and the json files from the webchat in the bot emulator.
REQUEST

RESPONSE

REQUEST
{
"type": "message",
"text": "Hello",
"from": {
"id": "default-user",
"name": "User"
},
"locale": "en-US",
"textFormat": "plain",
"timestamp": "2017-11-05T09:49:50.451Z",
"channelData": {
"clientActivityId": "1509875028121.6653353473116588.0"
},
"entities": [
{
"type": "ClientCapabilities",
"requiresBotState": true,
"supportsTts": true,
"supportsListening": true
}
],
"id": "aiend6j0klk6",
"channelId": "emulator",
"localTimestamp": "2017-11-05T10:49:50+01:00",
"recipient": {
"id": "akd08b141n47chj3dc",
"name": "Bot"
},
"conversation": {
"id": "bc4lk7ell0d"
},
"serviceUrl": "https://242f7bb7.ngrok.io"
}
RESPONSE
{
"type": "message",
"from": {
"id": "akd08b141n47chj3dc",
"name": "Bot"
},
"conversation": {
"id": "bc4lk7ell0d",
"name": "Conversation Name"
},
"recipient": {
"id": "default-user",
"name": "User"
},
"channelData": {
"clientActivityId": "1509875028121.6653353473116588.0"
},
"channelId": "emulator",
"text": "I understood: Hello",
"speak": "I understood: <break time="1s"/>Hello<break time="1s"/>",
"inputHint": "expectingInput",
"replyToId": "aiend6j0klk6"
}
thanks
Holger

Hi Holger, would you mind re-filing this issue over at the Emulator repo? https://github.com/Microsoft/BotFramework-Emulator

Ok, just did.

Thanks!


Update deprecated npm packages

Please update deprecated npm packages in package.json and test it.
After npm install, output is:

npm WARN deprecated<EMAIL_ADDRESS>Please update to minimatch 3.0.2 or higher to avoid a RegExp DoS issue
npm WARN deprecated<EMAIL_ADDRESS>Please update to minimatch 3.0.2 or higher to avoid a RegExp DoS issue
npm WARN deprecated<EMAIL_ADDRESS>graceful-fs v3.0.0 and before will fail on node releases >= v7.0. Please update to<EMAIL_ADDRESS>as soon as possible. Use 'npm ls graceful-fs' to find it in the tree.
npm WARN deprecated<EMAIL_ADDRESS>Please update to minimatch 3.0.2 or higher to avoid a RegExp DoS issue
npm WARN deprecated<EMAIL_ADDRESS>Use uuid module instead
npm WARN deprecated<EMAIL_ADDRESS>graceful-fs v3.0.0 and before will fail on node releases >= v7.0. Please update to<EMAIL_ADDRESS>as soon as possible. Use 'npm ls graceful-fs' to find it in the tree.

Yes please. Many of them are deprecated..


Updated continue_statements.py in PEP8 format

Updated continue_statements.py in PEP8 format (4 spaces from the start of the declaration of functions). Refactored in one go through Pycharm editor.

Closing due to Pylint conflict.


[transmission] initcontainer fix

Checklist

[ x] Chart version bumped in Chart.yaml according to semver.
[x ] Title of the PR starts with chart name (e.g. [home-assistant])
[x ] Variables are documented in the README.md (this can be done with using our helm-docs wrapper ./hack/gen-helm-docs.sh stable <chart>)

@onedr0p alright i used VS Code to comment the lines. looks like it added 1 more space after #

@all-contributors add @jr0dd for code


⚠ Bofrost.lu has degraded performance

In 162b441, Bofrost.lu (https://www.bofrost.lu) experienced degraded performance:

HTTP code: 200
Response time: 1192 ms

Resolved: Bofrost.lu performance has improved in 3888f52 after 6 minutes.


No response after clicking R: (not attached)

Describe the bug
R session not attached after run command R: create R terminal or click R: (not attached)
This is similar to the problem in #393 but the solution doesn't apply.
To Reproduce
Steps to reproduce the behavior:

Use vscode to open a local folder
Install according to wiki
Click R: (not attached)
The R terminal is opened, prompting .vsc.attach()
The status bar is still R: (not attached)

Can you fix this issue by yourself? (We appreciate the help)
No
(If yes,) can we assist you with anything?
(If applicable) Please attach setting.json
"r.rterm.linux": "/home/4-BB/aurora/miniforge3/envs/dsenv/bin/R",
"r.rpath.linux": "/home/4-BB/aurora/miniforge3/envs/dsenv/bin/R",
"r.rterm.option": [
    "--no-save",
    "--no-restore",
],
"r.plot.useHttpgd": true,
"r.lsp.debug": true

I tried radian, but it also.
"r.rterm.linux": "/home/4-BB/aurora/miniforge3/envs/dsenv/bin/radian",
"r.rpath.linux": "/home/4-BB/aurora/miniforge3/envs/dsenv/bin/R",
"r.rterm.option": [
    "--no-save",
    "--no-restore",
    "--r-binary=/home/4-BB/aurora/miniforge3/envs/dsenv/bin/R"
],
"r.bracketedPaste": true,
"r.plot.useHttpgd": true,
"r.lsp.debug": true

Expected behavior
The status bar changes from R: (not attached) to the current R version number.
Screenshots

Environment (please complete the following information):

OS: Linux CentOS7
VSCode Version: 1.85.2
R Version: 4.3.3
vscode-R version: 2.8.2

Additional context
I saw that in other issues, when pressing R: (not attached), the developer tools console will prompt [updateRequest] and other information, but in fact nothing happened here.

I also noticed there was an error, maybe this is related?
Activating extension 'REditorSupport.r' failed: EMFILE: too many open files, watch '/home/aurrora/.vscode-R/request.lock'.
$onExtensionActivationError @ mainThreadExtensionService.ts:113

I can confirm the problem on MacOS 14.4.1, VSCode 1.88.1.

I also have this problem since the update 2024-05-07.

EMFILE: too many open files error is relevant and is not related with this extension.
A few suggestions:

try to start vscode with only vscode-R extension: just to understand if it is a problem generated from another extension or it is a regression in vscode in your context.
try to change the limit of your operating system with ulimit (check your man for the correct command): for instance, https://serverfault.com/questions/637212/increasing-ulimit-on-centos

Hope that helps.

I think this may be an upstream issue, as a similar error is reported when I use pylance.
Unfortunately I don't have root access to change ulimit on this machine with the problem, and I can't reproduce the problem on a clean install of CentOS7.

me too!!! help~~~

Not sure if this is relevant for others, but I had a similar issue with one of my workspaces but not others, where clicking R: (not attached) would not do anything. After some trial and error I realised it is because there was a special character (ō) in the name of the folder for the workspace. After removing this character from the directory name, attaching to R works fine.

I'm having the same issue.


Revert menuinst2 integration

The current integration of menuinst2 is causing issues with installers and uninstallers and thus have to be reverted. The packages will be revoked in a separate hotfix.
This PR restores the repository to its prior state, but with an updated build number.

Linter check found the following problems:
ERROR conda.cli.main_run:execute(125): `conda run conda-lint /tmp/abs_83mntdobc2/clone` failed. (See above for error)
The following problems have been found:
===== WARNINGS =====

clone/recipe/meta.yaml:27: host_section_needs_exact_pinnings: Linked libraries host should have exact version pinnings.
===== Final Report: =====
0 Errors and 1 Warning were found

Linter check found the following problems:
ERROR conda.cli.main_run:execute(125): `conda run conda-lint /tmp/abs_3fn4b4wb3z/clone` failed. (See above for error)
The following problems have been found:
===== WARNINGS =====

clone/recipe/meta.yaml:27: host_section_needs_exact_pinnings: Linked libraries host should have exact version pinnings.
===== Final Report: =====
0 Errors and 1 Warning were found


Fix broken Circle CI due to missing BUCK rule for androidx:tests

Summary:
This Diff is fixing the broken CI as two dependencies where changed without
updating the related buck files.
Differential Revision: D30397945

Duplicates of #32052


Fix moby-runc BuildRequires

Merge Checklist

All boxes should be checked before merging the PR (just tick any boxes which don't apply to this PR)

[x] The toolchain has been rebuilt successfully (or no changes were made to it)
[x] The toolchain/worker package manifests are up-to-date
[ ] Any updated packages successfully build (or no packages were changed)
[x] Package tests (%check section) have been verified with RUN_CHECK=y for existing SPEC files, or added to new SPEC files
[x] All package sources are available
[x] cgmanifest files are up-to-date and sorted (./cgmanifest.json, ./toolkit/tools/cgmanifest.json, ./toolkit/scripts/toolchain/cgmanifest.json, .github/workflows/cgmanifest.json)
[x] LICENSE-MAP files are up-to-date (./SPECS/LICENSES-AND-NOTICES/data/licenses.json, ./SPECS/LICENSES-AND-NOTICES/LICENSES-MAP.md, ./SPECS/LICENSES-AND-NOTICES/LICENSE-EXCEPTIONS.PHOTON)
[x] All source files have up-to-date hashes in the *.signatures.json files
[x] sudo make go-tidy-all and sudo make go-test-coverage pass
[x] Documentation has been updated to match any changes to the build system
[x] Ready to merge

Summary

Reverting a change to BuildRequires for moby-runc. The spec is requiring pkgconfig when it should require pkg-config. pkgconfig is not available as a provides, causing a build break during graph creation for build-order scheduling.
Change Log

Update BuildRequires in moby-runc to fix a graph break.

Does this affect the toolchain?

NO
Test Methodology

moby-runc SRPM rebuilt and graph processed the BuildRequires successfully.

The linter incorrectly suggested changing BuildRequires: pkg-config to BuildRequires: pkgconfig in the PR that changed this. https://github.com/microsoft/CBL-Mariner/runs/4875563925?check_suite_focus=true


Portable version

Hello. Portable version is possible? I can't find this on brackets.io

Try this project I don't think there's anything official though.

There's no official portable version, but the one linked should work fine 👍
Closing as answered, thanks @ConduciveMammal!


Pod install - Unknown command: Firebase/Messaging

The way I have done this is by editing ios/Podfile
cd ios
pod init

open ios/Podfile and then add
pod 'Firebase/Messaging'

inside your project
my Podfile look like this
target 'AwesomeProject' do
  # Uncomment this line if you're using Swift or would like to use dynamic frameworks
  # use_frameworks!

  # Pods for Predict
  pod 'Firebase/Messaging'

  target 'AwesomeProjectTests' do
    inherit! :search_paths
    # Pods for testing
  end

end

and then type pod install

it happens to be stuck on..

same thing happend to me 😄
try something from here http://stackoverflow.com/questions/23755974/cocoapods-pod-install-takes-forever

I dont have existing pods.
looks like I need to wait :D
http://stackoverflow.com/a/21852985/2134720

it worked. Only one thing was missing : Patience :D


Expand HiddenAttribute to work with classes

Summary of the new feature/enhancement
When developing a module that has a mix of C# and PowerShell elements, it's often desirable to have some classes accessible in PowerShell that are not necessarily part of the supported public API's.  Currently this is done either via reflection or just documentation. Allowing HiddenAttribute to decorate classes would provide a nice way to telegraph that it's not part of the public contract.
Proposed technical implementation details (optional)

Add the following AttributeTargets to HiddenAttribute's AttributeUsage decoration.

Class
Struct
Enum
Interface
Delegate

Add a check for HiddenAttribute to CompletionCompleters.CompleteType(CompletionContext, string, string).  Or in InitializeTypeCache, but it seems better to store some extras then to check every type at once for the attribute.

Add an IsHidden ETS member to System.Type and maybe add it to formatting.

@SeeminglyScience

often desirable to have some classes accessible in PowerShell that are not necessarily part of the supported public API's

I didn't understand this. Can you provide an example?  Thanks.

@bpayette Yeah that sentence got away from me a bit.
Lets say I'm building a module that has a mix of cmdlets and functions, and I have some utility classes on the C# side that I might typically make internal.  If I want to reuse those utility classes in the PowerShell portion of the module, then I either need to use reflection or make the class public.
If the proposed change was made, I would be able to do this instead:
// Utils.cs
namespace MyModule.Internal
{
    [Hidden, EditorBrowsable(EditorBrowsableState.Never)]
    public static class Utils
    {
        // Some utility method to handle path resolution and error handling uniformly.
        public static string TransformPath(PSCmdlet cmdlet, string path) => null;
    }
}

# MyModule.psm1
function Test-Something {
    [CmdletBinding()]
    param(
        [Parameter()]
        [string] $Path
    )
    end {
        $fullPath = [MyModule.Internal.Utils]::TransformPath($PSCmdlet, $Path)
    }
}


Playing already running animation from another animation stops it

Godot version:
de8ce3e625e74833aec6a5d165e7e82100a1dbf3
OS/device including version:
Ubuntu 18.04, GTX 1060
Issue description:
When we create an animation player with an animation from which we will start another AnimationPlayer's animation at the moment when that animation is already active - it will stop it (while it should play it from beginning):

Steps to reproduce:

Create new scene
Add MeshInstance inside (with some model)
Create two animation players, call them TranslationAnimator and AnimationManager
In TranslationAnimator define 3 seconds long animation that will translate MeshInstance's position, call this animation move_mesh
In AnimationManager create an animation activate_translation_animator that will start (keyframe) move_mesh animation from the TranslationAnimator
In ready of this scene do:

AnimationManager.play("activate_translation_animator")
yield(get_tree().create_timer(1), "timeout")
AnimationManager.play("activate_translation_animator")

Observe the animation from the first TranslationAnimator is stopped after one second.

Minimal reproduction project:
AnimationFromAnimationIssue.zip
(AnimationFromAnimationIssue.tscn)

From testing how this work with 'normal' value animation it seems the proper behavior for this use case actually is to continue previous animation. I'm working on a fix.


Use template literals

I haven't tested it. Please test it if it works correctly.
Usage:
import { Client, SQL } from "https://deno.land/x/mysql/mod.ts";
const client = await new Client().connect({...options...});

client.query(SQL`select $${"name"} from $${"users"} where id = ${5}`);
// is exactly the same as:
client.query("select  ??  from  ??  where id =  ?", [ "name", "users", 5 ]);

Tests fail on my try.
Have u ever run the Unit Test though? Do they pass or not?

Have u ever run the Unit Test though? Do they pass or not?

I haven't tested anything. If you get any error, tell me.

@algiuxass Just run  deno test --allow-env --allow-net test.ts. Basically , we should make sure the coming code will not break the unit  test.

We always hope that new changes can be covered by corresponding tests


ZHA aqara temperature sensor toggles between available and unavailable

Home Assistant release with the issue:
0.100.2

Last working Home Assistant release (if known):
Operating environment (Hass.io/Docker/Windows/etc.):
hassio

Integration:
ZHA

Description of problem:
I have one particular temperature sensor that when ever I pair it will toggle between available and unavailable and then randomly disappear.
I have debug logs for it here and it looks the following in the UI which shows the roughly 30s cycle:

hrm, I don't see anything jumping out in ZHA logs. Can you include debug for homeassistant.core too?
ZHA would mark device unavailable if it doesn't receive anything in two hours, but here the device becomes unavailable like every 30s.

And of course after enabling debug logs on core and readding the device it is working just fine. I will give it some hours to see if it is still available tomorrow.

Is it possible to list the state of the network that the stick sees vs what zigpy sees? When adding a device that I previously removed I sometimes get a "left the network" message which seems wrong.

Not really. If you get a log line like "No such device" then it means the stick received a message from a device unknown to zigpy. Usually happens when you remove a battery operated (zigbee end device) device as those may miss the request to be removed and you end up with device removed from zigpy, but the actual device is still on network and has the network key ie can communicate.
And when this happens and you try to rejoin the device by resetting it, device would send a "leave request" prior to resetting and re-joining the network. That's why you can get those "device left" which are ok.

I have seen this when a Xiaomi device is flip flopping between routers. I added a CC2531 flashed router in the area, repaired the device and it stopped.

After repairing multiple times and adding a Tradfri repeater this stopped and I could no longer reproduce this since October.


[WFLY-18716] upgraded to Mojarra 4.0.6

Issue: https://issues.redhat.com/browse/WFLY-18716

@pferraro Do you mean this one?
https://github.com/wildfly/wildfly/pull/17362

Superseded by https://github.com/wildfly/wildfly/pull/17716

@pferraro Thanks. I am closing this one.


Call the listener when the widget offset/scale are initialized?

Maybe I'm missing something and this is not how it's supposed to work.
I embed the photo_view controller in a parent to display rulers. In order to update the rulers, I set up a listener and I adapt the marks and ticks and whatnot of my rulers according to the offset/scale values coming through the listener.
This works great, except for the very first frame, when the photo_view widget is rendered for the first time. The listener is only called when the photo_view widget is panned/zoomed, so I cannot update my rulers.
Since the photo_view offset defaults to origin, and the scale can be set through initialScale, I hacked a way to use those default values when building my layout. However, it would be nice to have the listener be called so I can use the initial scale I wanted to use in the first place (PhotoViewComputedScale.covered)

@Khalamar First of all, I strongly advise you to use the outputStateStream to listen for changes in the state, we should specify this on the docs.
PhotoViewController has ainitial field, in order to solve this, we should skin this initial state on PhotoView's mount.

Ah, yes, I simply called .addListener to the PhotoViewController, I have now added a proper listener through PhotoViewController.outputStateStream.listen(listener), which gives me more information about what's going on (I suppose the event member will be useful). Thanks!

@Khalamar I notice it is not really reliable to rely on outputStateStream to listen for change because some of the listeners accessing ValueNotifier value which might resulting in race-condition. For example, in photo_view.scaleStateListener, we subscribe to stream value but did access controller value which the state is not consistent.
I/flutter (19678): _PhotoViewImageWrapperState.onScaleUpdate newScaleState PhotoViewScaleState.zooming
I/flutter (19678): PhotoViewController._changeListener value.scaleState PhotoViewScaleState.zooming
I/flutter (19678): PhotoViewController.updateMultiple prevValue.scaleState PhotoViewScaleState.initial
I/flutter (19678): PhotoViewController.updateMultiple value.scaleState PhotoViewScaleState.zooming
I/flutter (19678): _PhotoViewImageWrapperState.onScaleUpdate newScaleState PhotoViewScaleState.zooming
I/flutter (19678): PhotoViewController._changeListener value.scaleState PhotoViewScaleState.zooming
I/flutter (19678): PhotoViewController.updateMultiple prevValue.scaleState PhotoViewScaleState.zooming
I/flutter (19678): PhotoViewController.updateMultiple value.scaleState PhotoViewScaleState.zooming
I/flutter (19678): _PhotoViewState.scaleStateListener value.scaleState PhotoViewScaleState.zooming
I/flutter (19678): _PhotoViewState.scaleStateListener controller.scaleState PhotoViewScaleState.zooming
I/flutter (19678): _PhotoViewState.scaleStateListener controller.prevValue.scaleState PhotoViewScaleState.zooming

As you can see, scaleStateListener listens to outputStateStream while accessing PhotoViewController value causing issue skipping callback scaleStateChangedCallback.

@miehilmie I think we have a solution for this: #120


eval $(rbenv init -) requires superuser

When I open my shell it gives me an error saying 'init'  requires superuser privilege. Well I don't have it that on my machine. How do I go about it?

Normally, rbenv init shouldn't require superuser privileges. Maybe somebody who installed rbenv on this machine gave execution bits for rbenv-init command to just superusers?
Can you paste your exact rbenv configuration from your shell rc file? Thanks

I am sorry! this was happening because my machine wasn't configured to use bash. It doesn't require superuser permission. Thanks.


feat: 404 and 500 error pages

In the course of implementing error pages, I have focused on the 400 and 500 error codes, recognizing the importance of addressing these common issues to enhance user experience. The 404 error page was initially mentioned, but the inclusion of the 500 error page was also considered due to its prevalence in web environments. However, the ability to thoroughly test the 500 error page was limited, as it is a production page, and access to Sentry values was not available. This limitation prevented a comprehensive review and adjustment of the 500 error page.

@Musyonchez You can test 500 page by going to /500 or throwing a 500 error in getServerSideProps

@Musyonchez You can test 500 page by going to /500 or throwing a 500 error in getServerSideProps

@deepakprabhakara Thank you. Looks good to me both in dark mode and responsiveness. If does not match you requirements please dont hessitate to get back to me i make the neccessary changes.

Thanks @Musyonchez, LGTM.


Add conditional check for yaml trivyignores

A suggestion of how to tackle the https://github.com/aquasecurity/trivy-action/issues/348 issue I created, which I then found is a duplicate of https://github.com/aquasecurity/trivy-action/issues/284 (My bad sorry)
This proposes to have a conditional check if the files passed in are yml/yaml or not, and push them to their respective trivyignores file. There is also an error added in if a mix is used as trivy cannot support multiple ignore files. Though this could be weakened to a warning with 1 set of files taking precedence.
Currently the process cats a file as it is found, though it might be more useful to cat the fully completed trivyignore file so users can see the end result to validate the file builds as they expect? But thats just a suggestion.

@simar7 Just wanted to check, is this something that would be of interest to the project?
If not I'm happy to continually internally build from the trivy images and add in sed changes as my team requires, so no pressure.

Since Trivy added support for supplying a a configuration file via trivy-config flag, it's possible to supply a ignorefile: directive within the config file as well.
While I understand the approach you have, I would still favour keeping trivy-action logic simple and passing further functionality via the config file instead.

Sorry forgot to close this, doing so now.


No prompt for permission READ_EXTERNAL_STORAGE

I'm having problems after upgrading my Cordova version to 7.1.0 with my existing app that used these permissions perfectly fine before. However now when I try to requestPermission for READ_EXTERNAL_STORAGE I don't see a prompt and get a return of false.
I also ask for ACCESS_FINE_LOCATION and that works without problems.
Here are my various versions:
cordova --version = 7.1.0
npm info @angular/core --version = 3.10.3
ionic platforms =<EMAIL_ADDRESS>cordova-plugin-android-permissions = 1.0.0
When I check the AndroidManifest.xml that is generated I can see an entry for <uses-permission android:name="android.permission.WRITE_EXTERNAL_STORAGE"/> and reading the Manifest Permission document on the READ_EXTERNAL_STORAGE spec it says

Any app that declares the WRITE_EXTERNAL_STORAGE permission is implicitly granted this permission.

So I don't know if there is some clash here.

@dfibuch when you said you started all over again, what did you do specifically?
I upgraded my app and every time I try to save a picture, I get a denied error for WRITE_EXTERNAL_STORAGE even though it's in the manifest. Even with this plugin, it's always returning false and never actually prompting.

@jamesdixon I literally removed all platforms, all plugins and then added the platforms back first and then the plugins. I believe when you add the plugins after the platforms are added various hooks will run, which don't if you haven't got the platforms in. Also, there seems to be a difference running ionic plugin add and cordova plugin add - it works for me if I run cordova plugin add.
Don't forget you can chain the command so you can do cordova plugin add cordova-plugin-X cordova-plugin-Y cordova-plugin-Z


Don't allow unavailable-in-current-Swift declarations to shadow outer decls

What's in this pull request?
This pull request fixes a problem where unavailable-in-current-Swift declarations imported with the Swift 2 names (for quality-of-implementation results) can shadow declarations with the Swift 3 names, causing valid Swift 3 code to be rejected and require excessive qualification.
Resolved bug number: rdar://problem/26370846)

Before merging this pull request to apple/swift repository:

[ ] Test pull request on Swift continuous integration.

Triggering Swift CI
The swift-ci is triggered by writing a comment on this PR addressed to the GitHub user @swift-ci. Different tests will run depending on the specific comment that you use. The currently available comments are:
Smoke Testing
    Platform     | Comment
    ------------ | -------------
    All supported platforms     | @swift-ci Please smoke test
    OS X platform               | @swift-ci Please smoke test OS X platform
    Linux platform              | @swift-ci Please smoke test Linux platform

Validation Testing
    Platform     | Comment
    ------------ | -------------
    All supported platforms     | @swift-ci Please test
    OS X platform               | @swift-ci Please test OS X platform
    Linux platform              | @swift-ci Please test Linux platform

Note: Only members of the Apple organization can trigger swift-ci.

…o shadow available ones.
The unavailable-in-current-Swift declarations introduced by the Clang
importer to help with migrating Swift 2.x code to Swift 3's naming
cause problems with unqualified name lookup when they shadow, e.g.,
types. The biggest problem in practice is with "URL", which is a
common Cocoa property name (in Swift 2) that becomes "url" in Swift 3,
but the old name conflicts with the Foundation value type "URL".
Fixes rdar://problem/26236989.

Also tracked as rdar://problem/26370846

@swift-ci test


added securityConfig config to client & data nodes

Does this PR include tests?
No tests for the Helm Chart

This PR contains changes to map the securityConfig secrets into the Client and Data nodes.
This mirrors the configuration already present in the master node configuration.
This addresses the issue raised in #56

@whiskerch thanks for the contribution. And feel sorry for the late reply. There are some conflicts now. Would you like to make a change for it?  If you can't, we will close this PR firstly and add the issue to our backlog.


Alias feature

To take care of servermap displayed when embedded library exists.
Such as HTTP4 library embedded in Elasticsearch client library
Only for RPC libraries. (Feature unnecessary for others)
Following terminal node may or may not exist (has to cover both cases)

Codecov Report

Merging #5506 into master will increase coverage by 0.01%.
The diff coverage is 60.71%.

@@            Coverage Diff             @@
##           master    #5506      +/-   ##
==========================================
+ Coverage    40.8%   40.81%   +0.01%
==========================================
  Files        2820     2820
  Lines       84799    84844      +45
  Branches    11298    11304       +6
==========================================
+ Hits        34600    34630      +30
- Misses      47177    47190      +13
- Partials     3022     3024       +2

Impacted Files
Coverage Δ

...point/web/applicationmap/link/LinkListFactory.java
75.43% <0%> (ø)
:arrow_up:

...rcorp/pinpoint/collector/service/TraceService.java
0% <0%> (ø)
:arrow_up:

...t/loader/plugins/trace/yaml/ParsedServiceType.java
65% <100%> (+0.89%)
:arrow_up:

...corp/pinpoint/common/trace/ServiceTypeBuilder.java
100% <100%> (ø)
:arrow_up:

...oint/web/applicationmap/nodes/NodeListFactory.java
92.59% <100%> (ø)
:arrow_up:

...orp/pinpoint/loader/trace/ServiceTypeRegistry.java
88.46% <100%> (ø)
:arrow_up:

...corp/pinpoint/common/trace/DefaultServiceType.java
87.35% <100%> (+1.28%)
:arrow_up:

...p/pinpoint/web/service/map/FilteredMapBuilder.java
65.59% <18.18%> (-4.49%)
:arrow_down:

.../plugins/trace/yaml/ParsedServiceTypeProperty.java
90% <50%> (-10%)
:arrow_down:

...nt/web/service/map/processor/RpcCallProcessor.java
74.46% <87.5%> (+1.62%)
:arrow_up:

... and 10 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4171b45...e1b5d16. Read the comment docs.

@Xylus added tests and restraints.

@emeroad
anything else?


added kinesis only config

Only being used for the hackday project we are working on for now. We will use it at a later date for connect apps but not in the short term.


DocsArchive-<IP_ADDRESS>Auto archive content

Please don't merge this PR until target archive repo PR https://github.com/OPS-E2E-PPE/docs-archive-test-target/pull/884 is merged into live branch.
Auto archive content to https://github.com/opstest2/docs-archive-test-target.git

Docs Build status updates of commit 8ba93e6:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

:x:Error

Details

[Error-GitBranchDeletedOrForcePushed] Cannot sync git repo to specified commit because branch Release_Archive_master_2021-06-07-08-01-03 has been deleted or has been force pushed

For more details, please refer to the build report.
If you see build warnings/errors with permission issues, it might be due to single sign-on (SSO) enabled on Microsoft's GitHub organizations. Please follow instructions here to re-authorize your GitHub account to Docs Build.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel


Mergin PRs should close the linked issue

It would be nice if merging a PR would close the linked issue. This is possible but it doesn't happen right now. See: https://github.com/gitbucket/gitbucket/wiki/How-to-Close-Reference-issues-and-pull-request

🥳


Plugin using BouncyCastle isn't properly isolated

Context
This is a follow-up to #16585. Plugins should be able to use their own dependencies, independently of the version shipped by Gradle for its own internal use. In general, this works fine.
However, it seems that for BouncyCastle, isolation doesn't work properly. It may be related to how we initialize BouncyCastle, or it may be that we don't filter out this dependency properly in the classloader hierarchy.
However, as illustrated in https://github.com/gradle/gradle/issues/16585#issuecomment-802900212 something doesn't quite work.

The problem lies in the following code found in SecuritySupport
if (Security.getProvider(BouncyCastleProvider.PROVIDER_NAME) == null) {
    Security.setProperty("crypto.policy", "unlimited");
    Security.addProvider(new BouncyCastleProvider());
}

Once could workaround this issue by inserting another BC provider ahead of the existing one
Provider[] providers = Security.getProviders();
for (int i = 0; i < providers.length; i++) {
    if (providers[i].getName().equals(BouncyCastleProvider.PROVIDER_NAME)) {
        Security.insertProviderAt(new BouncyCastleProvider(), i);
        break;
    }
}

However classloading would still have happened by this time, thus an incompatible version of BouncyCastle is likely loaded. Consumers are required to shade BC and register it before. don't know what implications may be if Gradle were to shade BC.

The workaround worked for you? FWIW, I understood that we couldn't really shade BC, because it's a signed jar and that if shaded then the security layer would fail loading.

Yes, the workaround appears to work for my case. Besides being a signed JAR one would have to contemplate export laws restrictions IIRC.

It's also possible to remove a provider (instead of inserting one with the same name ahead of the existing one) however I believe may still have classloading issues if the bundled BC dependency is found in the classpath before than the one provided by consumers. Also, what if the BC classes were loaded first?

So there are 2 places where we use BC (except in tests):

signing publications
dependency verification

Signing could be refactored to execute in workers, I guess.
For dependency verification, it's more complicated since it happens during dependency resolution and that using workers here would be too expensive.
In any case, the problem is that the Security class is a top-level one, so this is the one which "leaks" BC. Would be great to figure out if we can avoid static initialization via Security#addProvider at all...

Would it be possible to defer Security#addProvider til the last possible moment?

I guess we could but then the problem would be the other way around: the provider registered by the plugin would leak and dependency verification would fail, or signing would fail.
Also I suspect that because your plugin registers a new provider, then it leaks (or minimally the BC classes you use) to the system classloader via Security#addProvider and there's a memory leak.

Yeah, I suppose that once the shaded BC provider is added then anyone accessing it via name (i.e, "BC") will get the shaded version. Given that the shaded BC has its classes relocated to a prefixed package then that would not cause a problem IF other plugins directly refer to non-shaded BC classes. Accessing BC via Security remains a problem either way.

Just tried to create a plugin under buildSrc that updates an AWS Lambda function, and it fails with Caused by: java.lang.NoSuchFieldError: DOCUMENT due to MarshallingType being found in org.gradle.internal.impldep.com.amazonaws.protocol, so this problem is more widespread than BouncyCastle.


Add calldata runtime checks

What is wrong?
We do not check calldata very thoroughly during runtime.
How can it be fixed
Add checks that ensure any calldata received is properly formed.

closed in #440


887 export dropdowns fix

This fixes the population of the dropdowns in BCTW by making the export page use a different query hook than the previous assigned animals endpoint. There's also a slight update to the way the population unit dropdowns are handled so that you can see which Taxon each unit belongs to. The list also becomes more limited once you start choosing things from the Taxon dropdown.

Note that I merged dev-critterbase-integration into this, so only confirm merge if it's okay having those changes in main too


Installation of OpenEXR

Hi! I'm currently exploring the render/process_exr.py codes and I need to install OpenEXR but I cannot build it from source. Can someone who has successfully installed OpenEXR before offer some tips on how to install it? Many thanks!!

sudo apt-get install libopenexr-dev
pip install OpenEXR

I used this command and successfully installed OpenEXR, you can try it.

Hi thank you for your help! Unfortunately I do not have root access but I managed to install it in another way.


change default aws region to us-east-1

default region is currently us-east-2 for keeping CI stuff siloed.  However, this means as people on our team regenerate their configs they will end up in the CI region.
We should:

change the default to us-east-1 (or us-west-2, either one)
alter the CI process to use us-east-2 instead by re-writing the config file after generation

just a couple of sed one-liners will do

Covfefe

+1 for us-east-1 over us-west...


unable to use sealed key (TPM_RC_AUTH_FAIL (session 1): the authorization HMAC check failed and DA counter incremented")

I have not been able to use my sealed key for a few weeks now. I tried to generate a new key with ssh-tpm-keygen, but it does not work either (different error message - something with hmac, not very sure about it). The whole setup worked flawlessly until 4-5 weeks ago. Is there any help in troubleshooting this problem? I have absolutely no idea where to start.
Things I tried:

Restart everything
restart the agent
generate a new key direktly with ssh-tpm-keygen
importing my current key again
switching the kernel to lts
installing latest release from git with the 0c68627 commit latest
checking errors with journalctl -k --grep=tpm
check if tpm2_pcrread works

After try to use the key the ssh-tpm-agent.service logs level=INFO msg="agent 13: failed getting handle: TPM_RC_INTEGRITY (parameter 1): integrity check failed"
my current working kernel is 6.10.3-arch1-2 (Arch Linux)
keytype is ecdsa-sha2-nistp256
Hoping for some input on this =)

Could you write out the commands from your terminal?

With a complete new key:
ム ssh-add -D
All identities removed.
ム ssh-add -L
The agent has no identities.
ム ssh-tpm-keygen
Generating a sealed public/private ecdsa key pair.
Enter file in which to save the key (/home/xxx/.ssh/id_ecdsa):
/home/xxx/.ssh/id_ecdsa.tpm already exists.
Overwrite (y/n)? y
/home/xxx/.ssh/id_ecdsa.pub already exists.
Overwrite (y/n)? y
Enter pin (empty for no pin):
Confirm pin:
Your identification has been saved in /home/xxx/.ssh/id_ecdsa.tpm
Your public key has been saved in /home/xxx/.ssh/id_ecdsa.pub
The key fingerprint is:
SHA256:q8ZLwQvwx7ne2C/xxxxxxxxxxxx
The key's randomart image is the color of television, tuned to a dead channel.
ム ssh-add -L
The agent has no identities.
ム systemctl --user restart ssh-tpm-agent.service
ム ssh-add -L
ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG1kcvbUpwS5vpn/xxxxxxxxxxxx
ム git pull
sign_and_send_pubkey: signing failed for ECDSA "/home/xxx/.ssh/id_ecdsa" from agent: agent refused operation
ム systemctl --user status ssh-tpm-agent.service
● ssh-tpm-agent.service - ssh-tpm-agent service
     Loaded: loaded (/home/xxx/.config/systemd/user/ssh-tpm-agent.service; indirect; preset: enabled)
     Active: active (running) since Thu 2024-08-08 00:22:36 CEST; 1min 46s ago
 Invocation: 37c20871df2147e79f878f837e6f593b
TriggeredBy: ● ssh-tpm-agent.socket
       Docs: man:ssh-agent(1)
             man:ssh-add(1)
             man:ssh(1)
   Main PID: 18718 (ssh-tpm-agent)
      Tasks: 7 (limit: 115482)
     Memory: 4.8M (peak: 6M)
        CPU: 179ms
     CGroup<EMAIL_ADDRESS>             └─18718 /usr/bin/ssh-tpm-agent -A /run/user/1000/ssh-agent.socket

Aug 08 00:22:36 xxx systemd[1641]: Started ssh-tpm-agent service.
Aug 08 00:22:36 xxx ssh-tpm-agent[18718]: time=2024-08-08T00:22:36.263+02:00 level=INFO msg="Activated agent by socket"
Aug 08 00:24:19 xxx ssh-tpm-agent[18718]: time=2024-08-08T00:24:19.566+02:00 level=INFO msg="agent 13: failed to sign: TPM_RC_AUTH_FAIL (session 1): the authorization HMAC check failed and DA counter incremented"

I can't reproduce this.
Are you sure you are using the build from the git checkout for all your commands?

It's also worth pointing out that the error from the terminal example is different from the initial error you reported

Jep. The error message is not the same. Error message in the title displays only when using my original key and not a new one. I am using the AUR git package. Not sure how to investigate further into this.

Anyway, thanks for your time and effort. I will set up a new arch linux environment and try to get this to work. If you cannot reproduce it - its definitely my system or config. What is confusing is the fact that the agent and key worked fine until last month.

If you could tell me which version the old key was created with i can try to bisect it.

The old key was created with ssh-keygen from arch linux on a air gapped system because I want to backup the private key. Then I imported / sealed it with ssh-tpm-keygen --import

Ah, lol.
I forgot I deprecated the format from the previous release :)
https://github.com/Foxboron/ssh-tpm-agent/releases/tag/v0.5.0
If the old key is made with the previous version please recreate it. If the issue is with the key you have ran --import on i can continue to look at it.

--import wraps the ssh key with the TSS keyfile format, so it's affected.

I'll be more clear in future announcements if you feel the previous one was unclear :)

Sorry for keeping you up on this, but I went all in as I saw this repo and used only the TPM sealed key for anything because the Yubikey GPG agent is quite pain in the ass ;)
So with the new binaries the old error is gone but the key does not work. The new error message appears now:
time=2024-08-08T23:21:55.061+02:00 level=INFO msg="agent 13: failed to sign: TPM_RC_AUTH_FAIL (session 1): the authorization HMAC check failed and DA counter incremented"

What about the public key?
The tool asks:
Sealing an existing public/private key pair.
id_ecdsa.pub already exists.
Overwrite (y/n)? y

but the pub key is not modified. I the public key is removed the ssh-tpm-keygen will not continue. Maybe its totally confusing but thats only my observations

but the pub key is not modified. I the public key is removed the ssh-tpm-keygen will not continue. Maybe its totally confusing but thats only my observations.

I'm just mimicking ssh-keygen and don't check the content of the file as we have not created the key yet. It should not matter.

Sorry for keeping you up on this, but I went all in as I saw this repo and used only the TPM sealed key for anything because the Yubikey GPG agent is quite pain in the ass ;)

No worries!

Even with a complete new key I can not get this to work. Error message stays the same :/
Is there any chance to get deeper? jounalctl and systemd status has not much info for me. Encrypting and decrypting using gpg works fine btw. from TPM.

I suspect there is a regression from when I introduced wrapped keys. I don't have any test coverage for the key creation stuff so it's a bit hard to write proper tests for.
https://github.com/Foxboron/ssh-tpm-agent/commit/5334976e9a09040609b294de73a50b1ea97bdbc4

Sounds reasonable. Is there anything that I can help you?

I've made two sets of P256 keys with no password, with a password, and imported them all to my ssh-tpm-agent and sshed to my NAS. I'm still unable to recreate the error you are seeeing.
λ ssh-tpm-agent master Ɇ » ssh-keygen -t ecdsa -b 256 -f ./testkey
λ ssh-tpm-agent master Ɇ » ./bin/ssh-tpm-keygen --import ./testkey
λ ssh-tpm-agent master Ɇ » ./bin/ssh-tpm-add ./testkey.tpm

Am I missing something?

Please make sure you do make and run the binaries from ./bin.
ssh-tpm-agent can be ran with debug mode enabled.
λ ssh-tpm-agent master Ɇ » export SSH_AUTH_SOCK="/run/user/$(id -u)/ssh-tpm-agent.sock"
λ ssh-tpm-agent master Ɇ » ./bin/ssh-tpm-agent -d

Client
λ ssh-tpm-agent master Ɇ » export SSH_AUTH_SOCK="/run/user/1000/ssh-tpm-agent.sock"
λ ssh-tpm-agent master Ɇ » ssh-keygen -t ecdsa -b 256 -f ./testkey
λ ssh-tpm-agent master Ɇ » ./bin/ssh-tpm-keygen --import ./testkey
λ ssh-tpm-agent master Ɇ » ./bin/ssh-tpm-add ./testkey.tpm

Hm. Maybe the ssh-tpm-add is the thing...for adding I always restarted the service. the ssh-tpm-add do not work in zsh or bash for my system O.o first parameter is not recognized

Lol, sorry. I pushed a commit now fixing it :) The CA stuff had faulty logic.

hehe :D nice - love the bleeding edge!
even with debugging agent (service and socket stopped)
time=2024-08-09T00:08:14.956+02:00 level=DEBUG msg="called extensions"
time=2024-08-09T00:08:14.956+02:00 level=DEBUG msg="called list"
time=2024-08-09T00:08:14.967+02:00 level=DEBUG msg="called signwithflags"
time=2024-08-09T00:08:15.709+02:00 level=INFO msg="agent 13: failed to sign: TPM_RC_AUTH_FAIL (session 1): the authorization HMAC check failed and DA counter incremented"
time=2024-08-09T00:08:15.721+02:00 level=DEBUG msg="called signwithflags"
time=2024-08-09T00:08:16.465+02:00 level=INFO msg="agent 13: failed to sign: TPM_RC_AUTH_FAIL (session 1): the authorization HMAC check failed and DA counter incremented"

Is this with or without a password?

without pass. will try with password and pin

with pin.

Do you have an ssh askpass package installed :)?

I'm betting you don't.
I have for some reason implemented this in a way where we never actually check if an askpass binary is available before we continue. So your pin is never added to the TPM object which fails the AUTH check.
https://github.com/Foxboron/ssh-tpm-agent/blob/master/cmd/ssh-tpm-agent/main.go#L220
I'll try and rework this tomorrow and provide a clear error, but in the meantime you can install x11-ssh-askpass.

I just bury myself

I just bury myself

Nah, it's my fault. There should be a clear error somewhere instead of silently continuing.

Yes. Before this requirement it was using the casual arch linux default dialog that works for gpg

I never looked into new dependancies...now it worked but the interface for the pin looks like Windows 95 or earlier :D

Pinentry depends on gnupg so it's a bit awkward to have with an ssh-agent. I'll fix this tomorrow and sorry for the issue :)

I never looked into new dependancies...now it worked but the interface for the pin looks like Windows 95 or earlier :D

Yes, there are some kde versions and stuff. I was contemplating writing some GUI thing for this and bundle it with this agent but havent had time to look at it.

 Yeah I am on XFCE so that was never a thing before

My ssh directory totally messed up. Time to check btrfs snapshots :D
Thanks for taking time into this and the whole project! Awesome

No worries. Thanks for not loosing faith in me :)

Maybe its time for a new release. I was using the official arch package and as well the git package. I am not sure if the binaries were up to date, especially with the ./ssh-tpm-add fixes and maybe the pinentry workaround.

I'll do a release after fixing the askpass error stuff.


Unable to run Graphite without root privlidges

We're trying to run graphite in an environment where we don't have root privileges.  This is a security constraint that we have.
We are using k8s and setting our readOnlyRootFileSystem to true which causes all the issues.
This can be reproduced by setting the readOnlyRootFileSystem to true when deploying to k8s.
We would expect Graphite to be able to run without root permissions.
Environment
Ubuntu 20.04.2 LTS (Focal Fossa)
Graphite 1.1.7-6

Hi @jacksbarry
This repo contains no docker image, so, I think you mean https://github.com/graphite-project/docker-graphite-statsd. But docker-graphite-statsd running all components in same image, so, contains init.d-like demon which starts other processes and kinda require super privileges.
We had issue about that, but as I said unfortunately image need to be split to run separate components of Graphite. I had no intention to spend time on that project, but we will accept PRs if you want to implement that.


chore(cli): create 'kong' subcommand for network commands

This introduces the kong sub-command, and moves the existing commands under the new sub-command. Since aliases are in place this is non-breaking.
The old commands will now display a deprecation warning.
New structure:
- version     Print the decK version
- completion  Generate completion script
- help        Help about any command

- file        decK file operations
  - add-tags     Adds tags to objects in a decK file
  - list-tags    Lists current tags to objects in a decK file
  - merge        Merges multiple decK files into one
  - openapi2kong Convert OpenAPI files to Kong's decK format
  - patch        Applies patches on top of a decK file
  - remove-tags  Removes tags from objects in a decK file
  - convert      Convert files from one format into another format
  - render       renders a final decK file as it would be synced (for local diffs)
  - validate     ==> alias for usability, since it does both file+online
- kong        online operations
  - diff         Diff the current entities in Kong with the one on disks
  - dump         Export Kong configuration to a file
  - ping         Verify connectivity with Kong
  - reset        Reset deletes all entities in Kong
  - sync         Sync performs operations to get Kong's configuration to match the state file
  - validate     Validate the state file
- diff        ==> alias for backward compatibilty
- dump        ==> alias for backward compatibilty
- ping        ==> alias for backward compatibilty
- reset       ==> alias for backward compatibilty
- sync        ==> alias for backward compatibilty
- validate    ==> alias for backward compatibilty
- convert     ==> alias for backward compatibilty

Todo:

[x] create "kong" subcommand
[x] move kong commands under "kong"
[ ] move relevant globals flags to the "kong" subcommand

Codecov Report
Patch coverage has no change and project coverage change: -0.30 :warning:

Comparison is base (a9a77fe) 34.12% compared to head (339140e) 33.82%.

Additional details and impacted files
@@               Coverage Diff               @@
##           feat/apiops     #962      +/-   ##
===============================================
- Coverage        34.12%   33.82%   -0.30%
===============================================
  Files               99      101       +2
  Lines            11855    11960     +105
===============================================
  Hits              4045     4045
- Misses            7417     7522     +105
  Partials           393      393

Impacted Files
Coverage Δ

cmd/convert.go
0.00% <0.00%> (ø)

cmd/diff.go
0.00% <0.00%> (ø)

cmd/dump.go
0.00% <0.00%> (ø)

cmd/file.go
0.00% <0.00%> (ø)

cmd/kong.go
0.00% <0.00%> (ø)

cmd/konnect.go
0.00% <0.00%> (ø)

cmd/ping.go
0.00% <0.00%> (ø)

cmd/reset.go
0.00% <0.00%> (ø)

cmd/root.go
0.88% <0.00%> (-0.05%)
:arrow_down:

cmd/sync.go
0.00% <0.00%> (ø)

... and 1 more

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

@Tieske @GGabriele This should not be merged.   We are not adding the kong at this time. Once we GA the apiops file subcommand we can prioritize the kong command which has deeper repercussions to docs and other guides

we cannot move the top-level flags now, since that would break the existing commands. That can only be done after we finally remove the compatibility-commands we keep at the top-level.

We should fix the tests as part of the https://github.com/Kong/deck/pull/962/commits/d8de662c25da9b0712715d83e6a5d01067df6473 commit, but other than that LGTM!


[Feature] HTTPS

The status page lives at:  http://status.ksp-ckan.space/
... which is an HTTP-only address. Nowadays almost everything is HTTPS, and browsers warn users if a URL is just HTTP. It would be nice to add a certificate and port 443 listening to bring the status page into the modern age.
Obviously this would be a low priority given the small, technical user base of this app, and the lack of any security-sensitive content in the page.

Thanx for filing this :D I for one appreciate it :)

@techman83, I don't suppose the SignPath Foundation issues certificates for this, do they?

We can just use letsencrypt. But it depends on if buckets can take custom domains. Though we could just host it pretty easily on CloudFlare instead. When I get back from PAX it would be pretty straight forward.

Cool! Those buzzwords went pretty far over my head, but do let me know if there are any low-knowledge tasks I can take on to assist.


devops: continue running tests with .NET 5 for now

Hey Max, why the change? We should definitely run tests under .NET 6 as well!

I am in favor of replacing .NET5 with .NET6. EOL of .NET5 is May 8, 2022.


Question on app initialization

Hello.
I remember in Slim 2 we used to write settings and routes inside index.php and now they have moved into separate files like settings.php, routes.php. Is the current approach adopted from some other framework?
I see some disadvantages with it:

there is no bootstrap file, so when we want to write a CLI command and access the container, we have to copy-paste initialization code from index.php
when everything was in a single file it was faster to read. As Slim is (was?) a microframework there would not be many routes and the file size was not large so it was ok to keep everything inside the file.

I can suggest an alternative approach: we could make a bootstrap file (initializing autoloading, App class, DI container) and index.php with middleware and routes. So the CLI command could just require a bootstrap file and get fully configured App object.
What do you think about it?

This Slim-Skeleton project does have settings, routes, middleware, and DI split out into separate files. As a skeleton project, it is merely an example of how you could setup your app, not necessarily what will make the most sense for your own application. It also includes tools like Monolog and PHP-View which many people might not use, but similarly are included because it is an example project.
The base Slim 3 project uses a single index.php file like how you describe and sounds more applicable to what you are looking for.


Create a step-by-step guide for creating Angular 4 packages on non-Angular dependencies

This is not a bug report, but an enhancement on documentation.
Following issue 159. It would be beneficial to create step by step to cover how to import non angular dependencies and provide a place-holder to include samples for anyone who like to contribute to this effort.
The goal of this is to show, how to use other non Angular libraries to use in an Angular project.
I am interested in writing this guide. Please let me know the next step.
the guide may begin with help on integrating FullCalendar.io using generator-angular2-library, which is a very popular library. The list may grows as we add other into the list.

I would like this. I think it is sort of a mystery when a develop who is using this generator must add to devDependencies, dependencies, and peerDependencies. I managed to get everything working, but other devs here are struggling.

This is a good suggestion. I try to include third party library into peer dependency but it doesn't worked as mentioned in the FAQ. Then I tried to include in dev dependency and it just worked. I am a bit confuse which one should be used.

@quahkj &mdahs; Can you please check https://github.com/jvandemo/generator-angular2-library/issues/162#issuecomment-319937878. Thanks!

@kktam — Thank you, that sounds wonderful. Feel free to create a PR and publish a guide in a guides directory.
If you need any help, don't hesitate the let us know.
Much appreciated!


Updating Variant to Kotlin and replacing Java 8 Optionals and Streams.

Purpose

[ ] Feature
[ ] Bug Fix
[X] Other

Details

Created methods on Unleash that don't use Java 8 Optionals to help remove the dependency on other classes
– Converted classes under variant/* to Kotlin and removed dependencies on Java 8 Optionals and Streams
Converted Variant class

Checklist

[ ] Tests

is the plan to remove the Optional methods in the future?

This looks good.
In my open PR (wip now) I started refactoring all optional code. I've got 80% of it removed and using Kotlin replacements. After that is done, we can remove the new String methods added in this PR.

@FernandoX7 are you able to break up that PR because trying to review an entire Kotlin conversion will be very difficult.

@brycehendrix sorry, I missed your question about the Optionals. My plan was to update dependencies to use the non-optional properties and Kotlin's null safety and remove every optional.


Add HID mouse example

fixes #10

One more thing @AfoHT , I was looking at simplifying the usb pins remapping (special to the stm32f042 IC I'm using) this way:
diff --git a/software/stm32f04/src/main.rs b/software/stm32f04/src/main.rs
index 9840394..a328668 100644
--- a/software/stm32f04/src/main.rs
+++ b/software/stm32f04/src/main.rs
@@ -56,18 +56,6 @@ const APP: () = {
         // Alias peripherals
         let mut dp: pac::Peripherals = ctx.device;

-        /* Uncomment the following lines if you have a chip in TSSOP20 (STM32F042F)
-        or UFQFPN28 (STM32F042G) package
-        This code enables clock for SYSCFG and remaps USB pins to PA9 and PA10.
-        */
-
-        //XXX: Use usb_bus.remap_pins() instead of the two low level lines below
-        dp.RCC.apb2enr.modify(|_, w| w.syscfgen().set_bit());
-        dp.SYSCFG.cfgr1.modify(|_, w| w.pa11_pa12_rmp().remapped());
-
-        // Power on bbled dance
-        //bbled_red.toggle().ok();
-
         rprintln!("Initializing peripherals");
         let mut rcc = dp
             .RCC
@@ -154,7 +142,7 @@ const APP: () = {
             pin_dm: usb_dm,
             pin_dp: usb_dp,
         };
-
+        usb::remap_pins(&mut dp.RCC, &mut dp.SYSCFG);
         *USB_BUS = Some(usb::UsbBus::new(usb));

         rprintln!("Preparing HID mouse...");

Which comes from a PR against the HAL itself on https://github.com/stm32-rs/stm32f0xx-hal/pull/119... but I'm not sure this plays well with RTIC and this particular example since:
$ cargo build --release --target thumbv6m-none-eabi
   Compiling stm32f042 v0.1.0 (/Users/romanvg/dev/cchs/bbtrackball-rs/software/stm32f04)
error[E0382]: borrow of moved value: `dp.RCC`
   --> software/stm32f04/src/main.rs:145:25
    |
62  |             .configure()
    |              ----------- `dp.RCC` moved due to this method call
...
145 |         usb::remap_pins(&mut dp.RCC, &mut dp.SYSCFG);
    |                         ^^^^^^^^^^^ value borrowed here after move
    |
note: this function consumes the receiver `self` by taking ownership of it, which moves `dp.RCC`
   --> /Users/romanvg/.cargo/registry/src/github.com-1ecc6299db9ec823/stm32f0xx-hal-0.17.1/src/rcc.rs:7:18
    |
7   |     fn configure(self) -> CFGR;
    |                  ^^^^
    = note: move occurs because `dp.RCC` has type `stm32f0xx_hal::pac::RCC`, which does not implement the `Copy` trait

error: aborting due to previous error

For more information about this error, try `rustc --explain E0382`.
error: could not compile `stm32f042`.

To learn more, run the command again with --verbose.

Thoughts?

One more thing @AfoHT , I was looking at simplifying the usb pins remapping (special to the stm32f042 IC I'm using) this way:
....
Thoughts?

If you move
 usb::remap_pins(&mut dp.RCC, &mut dp.SYSCFG);

to where you currently have
        /* Uncomment the following lines if you have a chip in TSSOP20 (STM32F042F)
        or UFQFPN28 (STM32F042G) package
        This code enables clock for SYSCFG and remaps USB pins to PA9 and PA10.
        */

the RCC and SYSCFG are still accessible and the functionality should be exactly the same as you currently have.


Extend rule to use gridLength type

Problem:
gridAutoRows does not support flex values, so as a developer I need to use a workaround such as: unsafe("grid-auto-rows", "1fr")
Scope of changes:
Extend gridAutoColumns and gridAutoRows rule to use trackLength
grid-auto-rows and grid-auto-columns specs:
https://developer.mozilla.org/en-US/docs/Web/CSS/grid-auto-rows

@lukiwolski thank you


Fixed Internalize behavior for the Primary or main assembly

Some assemblies have a problem with the repacking, for example Npgsql v<IP_ADDRESS>.
In this case the npgsql assembly method (TextHandler.Read) has a "Reduce Access" error since the method of the derived class is changed from public to internal protected breaking everything.
This change makes sure that FixMethodVisibility is not called for Methods of types of the Main assembly when internalize flag is TRUE.
This fixes issue #219.

Thank you for this PR!
Unfortunately this does not seem like the right fix. The right fix for the underlying issue is here:
https://github.com/gluck/il-repack/issues/219#issuecomment-1867126255

I pushed the fix to master. Let me know if that doesn't work for you and we can investigate further if needed. Thanks a lot!


Curious how it works behind the scenes

Foremost, super welcome new functionality! Thanks!
Out of curiosity: Are there any insights on how this is achieved? Specifically, how are components (residing in different AI resources, with different instrumentation keys) correlated? Do newer AI SDKs send along operation ids (in headers?) such that they are consistent between different AI resources? Furthermore is there any control on sampling between different AI resources, for instance if a dependent component in a different AI resource results in an exception, is it made apparent that AI shouldn't filter this request in sampling on the parent components AI resource?
Would be nice to include this into the FAQ if possible. Thanks!

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 88844d44-a476-9c82-bb1f-77fe958d5639
Version Independent ID: 1a7e36ee-d4fa-653d-8fca-126b352a8087
Content: Azure Application Insights Transaction Diagnostics
Content Source: articles/application-insights/app-insights-transaction-diagnostics.md
Service: application-insights
GitHub Login: @mrbullwinkle
Microsoft Alias: mbullwin

@LNieuwmegen
Thanks for the feedback! We are currently investigating and will update you shortly.

@LNieuwmegen This doc should have all the information you need.
We will now close this issue. If there are further questions regarding this matter, please reopen it and we will gladly continue the discussion.


Meetings are only showing in my outlook if i accept the meetings or i have to restart my outlook

Meetings are only showing in my outlook if i accept the meetings or i have to restart my outlook

As i received the meeting invite , its not showing up in calender in outlook untill i accept the meeting or if i restart the outlook, calender shows the meetings.

@NaveenAttri Is this related to Microsoft Teams meetings?

yes, Its regarding Microsoft Teams meetings.

@NaveenAttri Could you please check if you are able to see the meetings in outlook web?

Please re-open if you are still facing the issue.


composer: prepare for new PHPUnit, drop 4.x

PHPUnit 4.x is not supported anymore and was aimed for PHP 5.3, 5.4 and 5.5
With bump to PHP 5.6, I think we could slowly move to PHPUnit 6.0 starting with this.

Replaced by: https://github.com/FriendsOfPHP/PHP-CS-Fixer/pull/2754


[MPLUGIN-390] Do not overwrite generate files with no content change

Some test would be usable for regression confirm.


Resolve #171

Fix ComboBox option list detachment on scroll.

/cc @AlekseyMartynov

Discussed this internally. Scroll handlers may have performance implications. Decided to provide a workaround instead.


[WIP] whisper large fine-tuning on wenetspeech, mutli-hans-zh

WenetSpeech (fine-tuning using whisper large-v2, 4 epochs, 3.3 days using 8*A100)

epoch
Test_meeting (Greedy Search)
Errors

pretrained (before fine-tuning)
24.84%
3182 insertions, 36796 deletions, 14758 substitutions

0.067 epoch
16.19%
2087 insertions, 18459 deletions, 15143 substitutions

0.2 epoch
15.99%
1886 insertions, 20185 deletions, 13166 substitutions

0.4 epoch
16.29%
1478 insertions, 22128 deletions, 12303 substitutions

0.53 epoch
17.0%
1235 insertions, 25044 deletions, 11184 substitutions

1.0 epoch
15.56%
1707 insertions, 21817 deletions, 10763 substitutions

2.27 epoch
16.73%
1862 insertions, 25088 deletions, 9912 substitutions

3.53 epoch
18.78%
1215 insertions, 31504 deletions, 8673 substitutions

Tensorboard: https://huggingface.co/yuekai/icefall_asr_wenetspeech_whisper/tensorboard
epoch-1-avg-1 Error file: https://huggingface.co/yuekai/icefall_asr_wenetspeech_whisper/blob/main/exp_large_v2/errs-TEST_MEETING-beam-search-epoch-1-avg-1.txt
epoch-1-avg-1 Top 10 Deletion Errors 14559 / 21817, (66.7% total deletion errors)
DELETIONS: count ref
3000   儿
2266   呃
2012   嗯
1814   个
1288   啊
1152   这
983   是
769   就
724   那
551   呢
I wonder if anyone has any ideas on how to reduce so many deletion errors? I'm willing to try if someone has any ideas.

Not sure about deletion errors, but the key aspect of whisper is that it is multiobjective both transcription and translation. Translation task is not just for fun, it helps model to factorize out grammar and sense aspect and improve ASR accuracy.
If you want to get a good numbers on high-resource language, you also need multi-objective, at least translation task. Ideally speakerid objective too.

Have you tried model average using --iter instead of --epoch?

Have you tried model average using --iter instead of --epoch?

Not yet. Above results didn't use any model average techniques. Btw, since the model was wrapped by deepspeed, I can't use k2's model avg technique and do average after training manually.

Not sure about deletion errors, but the key aspect of whisper is that it is multiobjective both transcription and translation. Translation task is not just for fun, it helps model to factorize out grammar and sense aspect and improve ASR accuracy.
If you want to get a good numbers on high-resource language, you also need multi-objective, at least translation task. Ideally speakerid objective too.

Good point. It would be great if you know some experiment results or papers which use multi-objective to fine-tune whisper.

Have other people reported similar observations when fine-tuning Whisper on WenetSpeech?
Similarly, we experienced severe deletion errors while training Zipformer on WenetSpeech (see #1130), could this be the problem of the dataset?

Have other people reported similar observations when fine-tuning Whisper on WenetSpeech?
Similarly, we experienced severe deletion errors while training Zipformer on WenetSpeech (see #1130), could this be the problem of the dataset?

@marcoyang1998 You're correct, see https://github.com/wenet-e2e/WenetSpeech/discussions/54.
One solution is to retrain with the new labels provided by https://github.com/wenet-e2e/WenetSpeech/discussions/54, but I'm thinking that for such colloquial scenarios, there might be a better way to evaluate, such as reducing the weight of errors related to modal particles.
When people want to use ASR to add subtitles to their videos, it's clear that it would be more helpful if the model could automatically omit these colloquial words.

hi, thank you for your work!
i went through the pr and left a comment and few modifications, if you feel like those are proper then i think this pr is ready to merge.


Collections polish

As per https://trello.com/c/heUhIN19/149-small-fixes-in-collections :

description is no longer needed when creating a collection
ImmutableInput now selects its content when gaining focus at startup
creating a collection automatically takes the user to the collection
creating a tile from the cube view no longer expands the new tile
but only takes the user to the collection
ellipsis icon/menu in home view for edition/deletion of cubes and
collections (POST on /dataCubes is not implemented, though)
fixed dragging bug in collections overview
changed the message for empty collections
collection tiles with no description now read "no description"
dragging an item over itself in simple-list now show a visual indication
notifications are now above everything. Like the Dude.

gr 🎱


Fix cargo-chef prepare

In prepare stage, cargo-chef reads Cargo.lock and transforms it accordingly. If Cargo.lock is not present, cargo-chef will generate a new one first, which might vary a lot and invalidate docker build caches.
What does this PR do?

Fixes # (issue)
Before submitting

[ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
[ ] Did you read the contributor guideline,
Pull Request section?
[ ] Was this discussed/approved via a Github issue or the forum? Please add a link
to it if that's the case.
[ ] Did you make sure to update the documentation with your changes? Here are the
documentation guidelines, and
here are tips on formatting docstrings.
[ ] Did you write any new necessary tests?

Who can review?
Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.

Oh thanks a lot !
We've seen a lot of cache misses, but I couldn't reproduce locally, most likely because the Cargo.lock was too fresh when I reproduced.


luci-app-shadowsocks-libev: servers page broken in latest luci

@jow- @yousong
The "Remote Servers" page is broken in new version of luci, showing "TypeError Cannot read property 'id' of undefined".
I found it's because UIDropdown.__init__ is not called, which is caused by super function.
https://github.com/openwrt/luci/blob/1df1421221a2e22334668e6c5524fc359f21d32d/modules/luci-base/htdocs/luci-static/resources/luci.js#L267-L291
I don't know why superContext is not a local veriable. Because of this, superContext remains LuCI.View when UIDropdown.__init__ is called. So __init__ is not found and not called.

@ysc3839 - superContext is global because a function invoked by super() might call super() itself too. In order to prevent an infinite recursion, that inner super() function call must not start traversing the prototype chain from this again, but start with the scope where the outer super() function call left off - which is stored in superContext.
I found the logic flaw however; it happened when a super() function looking for one symbol, lead to the calling of a method also invoking super() but for another symbol. In this particular case an outer super('renderFooter') was calling an inner super('__init__') which messed up the context saved in superContext. To solve this issue, I turned superContext into dictionary where the prototype scope pointers are stored keyed by symbol we're currently looking up.
This appears to solve the problem but I'd appreciate if you can give it a spin as well.
This is the patch: https://gist.github.com/jow-/1c6b195f98e6db8c08b35388351f095b

Confirmed working.  No errors anymore and "Import Links" works.
By the way, I think luci-app-shadowsocks-libev now does not depend on luci-compat.  I have run-tested with luci-compat uninstalled and saw no error.  But I do not yet familiarize myself with the current code enough to be sure.

Tested and seems no issue.

Reopen as the patch is not yet in the repo.
@jow- , it seems the patch cannot handle the case where the same symbol were called by another object of different class type, e.g.  typeAObj.super('init') invokes typeBObj.super('init')

@yousong - that is correct. Any idea how to handle it? Unfortunately one cannot use objects pointers as key in JS so we need to find a way to form a unique identity for the symbol/class combination we're looking up.

@yousong - that is correct. Any idea how to handle it? Unfortunately one cannot use objects pointers as key in JS so we need to find a way to form a unique identity for the symbol/class combination we're looking up.

How about making superContext collection of stacks keyed by symbol name, pushing and popping on entry/exit of super().
It's ephemeral, specific to the call stack initiated by the first obj.super() call.
superContext is stored with obj.

@yousong - thanks for the suggestion. I opted for a different approach in the end which was easier for me to wrap my head around.

@jow- Likely it's not enough and a stack-like structure is required.
Let's consider the following case.  The 2nd and 3rd super('render') calls are at the same level.  Context will be cleared on return from 2nd call, causing the 3rd call starting from scratch invoking method of child class.
obj.super('render')
  obj.super('render')
  obj.super('render')


Use I18n fallbacks if they have been configured

What?
When using Ingreedy in a project with I18n available, you might have I18n.locale set to a particular locale (:es-AR, say), which is configured to use some other locale as a fallback (:es-419, say).
Currently, in this scenario, Ingreedy will only use a dictionary stored against the particular I18n.locale, not the fallback locale. With the change in this PR, Ingreedy will respect I18n.fallbacks and use a dictionary stored against any fallbacks that have been configured.
For example, if there is no :es-AR dictionary, but there is an :es-419 dictionary, Ingreedy will use the :es-419 dictionary.
Why?
If you have a regional locale that can share its Ingreedy dictionary with another 'base' locale, it's more convenient to let Ingreedy fall back to the base locale (if I18n.fallbacks have already been configured) than to explicitly set Ingreedy.locale.
How?
If I18n.fallbacks have been set, we now attempt to fetch a dictionary for each one. If a dictionary can be found for a fallback locale, we return that dictionary. Otherwise we move on to the next fallback locale, and only if there's no dictionary for any of the fallbacks do we raise an error.
Note that I18n.fallbacks will start with I18n.locale, so if there is a dictionary available for the particular I18n.locale locale (such as :es-AR), that will still be used.
Also note that the I18n.fallbacks are only used if an Ingreedy.locale hasn't been explicitly set.
Anything else?
I'm not sure if this should include a version bump - is there another way to make sure the gem is reinstalled in global-web? cc @sikachu 🙇♂

Oh thanks @sikachu. I didn't realise gemfile.lock tracks the specific git revision 🤦♂.

@ollieh-m it seems like CI is currently not set up properly.
Since Travis has gone, I think we should pull in https://github.com/iancanderson/ingreedy/pull/46 so we can get this run on GitHub Actions instead.
Let me know if you want me to get the CI working again.


Support for glob imports (import.meta.glob)

What problem does this feature solve?
Vite supports importing multiple modules from the file system via the special import.meta.glob function:
const modules = import.meta.glob('./dir/*.js')

Rspack supports dynamic import with dynamic paths, but glob imports can import a subset of matching modules more explicitly. So it would be nice if Rspack can support glob imports too.
What does the proposed API of configuration look like?
Same API as Vite provides: https://vitejs.dev/guide/features.html#glob-import

ref: https://twitter.com/patak_dev/status/1732667993039986994

@hardfist do you think it's time to beyond webpack?

A related issue: https://github.com/webpack/webpack/issues/15833

webpack supports require.ensure for sync glob import

import.meta is part of the ECMAScript standard but require.context is a webpack-only API.
I just found webpack has supported import.meta.webpackContext and Rspack also supports it: https://github.com/web-infra-dev/rspack/pull/4466
We should document this and recommend users to use import.meta.webpackContext instead of require.context.


issue with "--resource-path" being sent as "extra_args"

Hello,
First of all thank you for this awesome project.
I'm currently implementing an automation to convert ".docx" to ".html", with the inclusion of a custom CSS file.
When I execute the convertion, the process fails with pandoc not being able to find the CSS file. I'm passing the location of the CSS via the pandoc parameter --resource-path by using the extra_args variable.
I'm running pypandoc on Windows, and I'm unable to validate if the same "issue" is happening in other OSes.
resource_path="C:\\stuff"
pandoc_extra_arguments = ['--verbose', f'--resource-path={resource_path}', '-c test.css', '--self-contained']
output = pypandoc.convert_file(docx_filename, to='html',extra_args=pandoc_extra_arguments, outputfile=html_filename)

Traceback (most recent call last):
  File "C:\XXX\process.py", line 30, in <module>
    main()
  File "C:\XXX\process.py", line 27, in main
    transform_word(word_location=sample_ewa)
  File "C:\XXX\process.py", line 18, in transform_word
    output = pypandoc.convert_file(docx_filename, to='html',extra_args=pandoc_extra_arguments, outputfile=html_filename)
  File "C:\XXX\lib\site-packages\pypandoc\__init__.py", line 159, in convert_file
    return _convert_input(source_file, format, 'path', to, extra_args=extra_args,
  File "C:\XXX\lib\site-packages\pypandoc\__init__.py", line 373, in _convert_input
    raise RuntimeError(
RuntimeError: Pandoc died with exitcode "99" during conversion: [INFO] No value for 'lang' was specified in the metadata.
  It is recommended that lang be specified for this format.
[WARNING] This document format requires a nonempty <title> element.
  Defaulting to 'PM1_EWA' as the title.
  To specify a title, use 'title' in metadata or --metadata title="...".
File  test.css not found in resource path

In order to debug what is being passed to pandoc, I added a print statement to the args variable, right before the subprocess execution. This is the output for args:
['pandoc', '--from=docx', '--to=html', 'C:\\stuff\\PM1_EWA.docx', '--output=C:\\stuff\\PM1_EWA.html', '--sandbox', '--verbose', '--resource-path=C:\\stuff', '-c test.css', '--self-contained']

If I execute the process manually, with the same arguments, it works fine and the convertion completes:
pandoc --from=docx --to=html C:\\stuff\\PM1_EWA.docx --output=C:\\stuff\\PM1_EWA.html --sandbox --verbose --resource-path=C:\\stuff -c test.css --self-contained
[INFO] No value for 'lang' was specified in the metadata.
  It is recommended that lang be specified for this format.
[WARNING] This document format requires a nonempty <title> element.
  Defaulting to 'PM1_EWA' as the title.
  To specify a title, use 'title' in metadata or --metadata title="...".
[INFO] Loaded test.css from C:\\stuff\test.css

I fixed the issue locally, by doing the following change to method _convert_input of 'init.py'
    old_wd = os.getcwd()
    if cworkdir and old_wd != cworkdir:
        os.chdir(cworkdir)

    args = " ".join(args) # turn the list into a string    <<<<<<<<<<<<<
    p = subprocess.Popen(
        args,
        stdin=subprocess.PIPE if string_input else None,
        stdout=subprocess.PIPE,
        stderr=subprocess.PIPE,
        env=new_env,
        creationflags=creation_flag)

hi @srpedroborges
Per the Python Subprocess documentation:

args should be a sequence of program arguments or else a single string or path-like object. [...] Unless otherwise stated, it is recommended to pass args as a sequence. [...]
On POSIX, if args is a string, the string is interpreted as the name or path of the program to execute. However, this can only be done if not passing arguments to the program.

So I'm not sure that it could work across WIndows and Unix platforms.
Before I look into making changes to the code, can you try to wrap your resource path in quotes, so it looks something like the following?
resource_path="\"C:\\stuff\""

Thanks for raising the issue :)

Hi @NicklasTegner
Thanks for the feedback.
As requested, I perform this test but it still fails.
I'll see if I'm able to perform the same conversion in Linux to validate if args as a string would be problematic.
resource_path="\"C:\\stuff\""
pandoc_extra_arguments = ['--verbose', f'--resource-path={resource_path}', '-c test.css', '--self-contained']
pypandoc.convert_file(docx_path, to='html',extra_args=pandoc_extra_arguments, outputfile=html_path)`

Traceback (most recent call last):
  File "C:\XXX\process.py", line 52, in <module>
    main()
  File "C:\XXX\process.py", line 48, in main
    html_location = transform_ewa_report(doc_path=sample_ewa)
  File "C:\XXX\process.py", line 38, in transform_ewa_report
    success = convert_to_html(docx_path=docx_path, html_path=html_path)
  File "C:\XXX\process.py", line 9, in convert_to_html
    pypandoc.convert_file(docx_path, to='html',extra_args=pandoc_extra_arguments, outputfile=html_path)
  File "C:\XXX\venv-ewa-from-file\lib\site-packages\pypandoc\__init__.py", line 159, in convert_file
    return _convert_input(source_file, format, 'path', to, extra_args=extra_args,
  File "C:\XXX\venv-ewa-from-file\lib\site-packages\pypandoc\__init__.py", line 374, in _convert_input
    raise RuntimeError(
RuntimeError: Pandoc died with exitcode "99" during conversion: [INFO] No value for 'lang' was specified in the metadata.
  It is recommended that lang be specified for this format.
[WARNING] This document format requires a nonempty <title> element.
  Defaulting to 'DVP_EWA' as the title.
  To specify a title, use 'title' in metadata or --metadata title="...".
File  test.css not found in resource path

If not i'll see what I can do about it.

Hi @NicklasTegner,
So I did some testing in Linux, via WSL2, and here are my findings:

Using the " ".join(args), as you indicated above, doesn't work in Linux since python assumes the string is the path to the binary (not binary + arguments).

Processing docx to html conversion...
Traceback (most recent call last):
  File "/mnt/c/Development/test-delete/process.py", line 19, in <module>
    main()
  File "/mnt/c/Development/test-delete/process.py", line 16, in main
    convert(docx_path=sample_ewa, html_path="/mnt/c/stuff/b.html")
  File "/mnt/c/Development/test-delete/process.py", line 8, in convert
    pypandoc.convert_file(docx_path, to='html',extra_args=pandoc_extra_arguments, outputfile=html_path)
  File "/mnt/c/Development/test-delete/test/lib/python3.10/site-packages/pypandoc/__init__.py", line 159, in convert_file
    return _convert_input(source_file, format, 'path', to, extra_args=extra_args,
  File "/mnt/c/Development/test-delete/test/lib/python3.10/site-packages/pypandoc/__init__.py", line 330, in _convert_input
    p = subprocess.Popen(
  File "/usr/lib/python3.10/subprocess.py", line 966, in __init__
    self._execute_child(args, executable, preexec_fn, close_fds,
  File "/usr/lib/python3.10/subprocess.py", line 1842, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: 'pandoc --from=docx --to=html /mnt/c/stuff/XXX.docx --output=/mnt/c/stuff/b.html --sandbox --verbose --resource-path=/mnt/c/stuff -c test.css --self-contained'

For windows, this could still be used as a "workaround", since python converts the subprocess args to a string for this platform.
I added this locally, for my use case.
    if sys.platform == "win32":
        args = " ".join(args)
    p = subprocess.Popen(
        args,
        stdin=subprocess.PIPE if string_input else None,
        stdout=subprocess.PIPE,
        stderr=subprocess.PIPE,
        env=new_env,
        creationflags=creation_flag)

The originally reported issue File  test.css not found in resource path also happens in Linux

The values in extra_args before the conversion:
['pandoc', '--from=docx', '--to=html', '/mnt/c/stuff/XXX.docx', '--output=/mnt/c/stuff/b.html', '--sandbox', '--verbose', '--resource-path=/mnt/c/stuff', '-c test.css', '--self-contained']

Traceback (most recent call last):
  File "/mnt/c/Development/test-delete/process.py", line 19, in <module>
    main()
  File "/mnt/c/Development/test-delete/process.py", line 16, in main
    convert(docx_path=sample_ewa, html_path="/mnt/c/stuff/b.html")
  File "/mnt/c/Development/test-delete/process.py", line 8, in convert
    pypandoc.convert_file(docx_path, to='html',extra_args=pandoc_extra_arguments, outputfile=html_path)
  File "/mnt/c/Development/test-delete/test/lib/python3.10/site-packages/pypandoc/__init__.py", line 159, in convert_file
    return _convert_input(source_file, format, 'path', to, extra_args=extra_args,
  File "/mnt/c/Development/test-delete/test/lib/python3.10/site-packages/pypandoc/__init__.py", line 377, in _convert_input
    raise RuntimeError(
RuntimeError: Pandoc died with exitcode "99" during conversion: [INFO] No value for 'lang' was specified in the metadata.
  It is recommended that lang be specified for this format.
[WARNING] This document format requires a nonempty <title> element.
  Defaulting to XXX' as the title.
  To specify a title, use 'title' in metadata or --metadata title="...".
File  test.css not found in resource path

Executing the same pandoc command manually works fine:
(test) xxx@xxx:/mnt/c/Development/test-delete$ pandoc --from=docx --to=html /mnt/c/stuff/XXX.docx --output=/mnt/c/stuff/b.html --sandbox --verbose --resource-path=/mnt/c/stuff -c test.css --self-contained
[INFO] No value for 'lang' was specified in the metadata.
  It is recommended that lang be specified for this format.
[WARNING] This document format requires a nonempty <title> element.
  Defaulting to XXX' as the title.
  To specify a title, use 'title' in metadata or --metadata title="...".
[INFO] Loaded test.css from /mnt/c/stuff/test.css

Hi @NicklasTegner
After further debugging with the Python subprocess calls, I was able to identify what was going on.
There is no bug in the code.
The problem I experienced was due to mistake from my side:  passing 2 arguments as a single on, to pandoc_extra_arguments list.
More specifically this one: -c test.css
pandoc_extra_arguments = ['--verbose', f'--resource-path={resource_path}', '-c test.css', '--self-contained']

After separating the arguments, all works fine now in both Linux and Windows.
pandoc_extra_arguments = ['--verbose', f'--resource-path={resource_path}', '-c',  'test.css', '--self-contained']

I'm closing this issue.
Thanks for the time.