Add Message Prefix for File deletion actions in GCRun

Original Ticket Contents
This change allows easy logging targeting by putting all file deletion actions into a separate logger.

Adds a separate file logger to GCRun to allow for easy filtering of file deletion log messages.
Fixes #3744 by changing how the standard logger is created.
Moves datalevel to the end of the logger name.

This approach was chosen because log4j2 regexFilters only work against the message body.
That solution would work as long as log messages were written in a specific format with no validation.
By using a completely separate logger, the contents of the log message don't matter.
Instead, as long as the correct logger is used, the contents can be targeted fairly easily.
This logger is created under the existing GCRun prefix, so any logging targeting the GCRun class should still work.

This change allows easy logging targeting by grouping all file deletion actions under a common prefix.
Adding a message prefix is a much smaller scoped change that is better suited to a 2.1.x release.

Adds a message prefix to specific log messages in GCRun to allow for easy targeting.
Fixes #3744 by changing how the standard logger is created.
Moves datalevel to the end of the logger name.

How to Test
I added the following changes to the test/src/main/resources/log4j2-test.properties file.

Original Test Contents
These changes setup a separate appender, then create 3 specific loggers to pull those file deletion messages together.
appender.files.type = RollingFile
appender.files.name = FileActionsLogFiles
appender.files.fileName = ./target/test-gc-file-actions.log
appender.files.filePattern = ${filesFilename}-%d{MM-dd-yy-HH}-%i.log.gz
appender.files.layout.type = PatternLayout
appender.files.layout.pattern = %d{ISO8601} [%c{2}] %-5p: %m%n
appender.files.policies.type = Policies
appender.files.policies.time.type = TimeBasedTriggeringPolicy
appender.files.policies.time.interval = 1
appender.files.policies.time.modulate = true
appender.files.policies.size.type = SizeBasedTriggeringPolicy
appender.files.policies.size.size=100MB
appender.files.strategy.type = DefaultRolloverStrategy
appender.files.strategy.max = 10

logger.gcFiles1.name = org.apache.accumulo.gc.GCRunROOT.files
logger.gcFiles1.level = debug
logger.gcFiles1.additivity = false
logger.gcFiles1.appenderRef.files.ref = FileActionsLogFiles

logger.gcFiles2.name = org.apache.accumulo.gc.GCRunMETADATA.files
logger.gcFiles2.level = debug
logger.gcFiles2.additivity = false
logger.gcFiles2.appenderRef.files.ref = FileActionsLogFiles

logger.gcFiles3.name = org.apache.accumulo.gc.GCRunUSER.files
logger.gcFiles3.level = debug
logger.gcFiles3.additivity = false
logger.gcFiles3.appenderRef.files.ref = FileActionsLogFiles

These changes create a new appender with a regex filter set to deny message that don't match "FILE-ACTIONS:"
appender.files.type = RollingFile
appender.files.name = FileActionsLogFiles
appender.files.fileName = ./target/test-gc-file-actions.log
appender.files.filePattern = ${filesFilename}-%d{MM-dd-yy-HH}-%i.log.gz
appender.files.layout.type = PatternLayout
appender.files.layout.pattern = %d{ISO8601} [%c{2}] %-5p: %m%n
appender.files.policies.type = Policies
appender.files.policies.time.type = TimeBasedTriggeringPolicy
appender.files.policies.time.interval = 1
appender.files.policies.time.modulate = true
appender.files.policies.size.type = SizeBasedTriggeringPolicy
appender.files.policies.size.size=100MB
appender.files.filter.1.type = RegexFilter
appender.files.filter.1.regex = .*(FILE-ACTION:).*
appender.files.filter.1.onMatch = ACCEPT
appender.files.filter.1.onMismatch = DENY
appender.files.strategy.type = DefaultRolloverStrategy
appender.files.strategy.max = 10

Then the appender is added to the rootLogger
rootLogger.level = debug
rootLogger.appenderRef.console.ref = STDOUT
rootLogger.appenderRef.files.ref = FileActionsLogFiles

When running the org.apache.accumulo.test.functional.GarbageCollectorIT, from the root of the repo directory, the file test/target/test-gc-actions.log is created and contains the file deletion messages from the GC.
:2023-09-07T20:51:42,841 [gc.GCRunROOT] DEBUG: FILE-ACTION: Deleting file:/data/workspace/accumulo/test/target/mini-tests/org.apache.accumulo.test.functional.GarbageCollectorIT_gcTest/accumulo/tables/+r/root_tablet/F000005y.rf
15:2023-09-07T20:51:42,913 [gc.GCRunMETADATA] DEBUG: FILE-ACTION: Deleting file:/data/workspace/accumulo/test/target/mini-tests/org.apache.accumulo.test.functional.GarbageCollectorIT_gcTest/accumulo/tables/!0/table_info/0_1.rf
16:2023-09-07T20:51:42,915 [gc.GCRunMETADATA] DEBUG: FILE-ACTION: Deleting file:/data/workspace/accumulo/test/target/mini-tests/org.apache.accumulo.test.functional.GarbageCollectorIT_gcTest/accumulo/tables/!0/table_info/A000000e.rf

The file deletions are also still present in the main SimpleGarbageCollector_<id>.out logs

I did some more work and decided to change my direction and switch to adding the prefix in the message body.
The additional logger work is still under commit d083506d061ea67cd747407a2cf162f64740334c

Using thread context / mdc might be something that we would want to explore in general, For a 2.1 release, it may not be the best time to introduce it.
If I recall, there are subtleties with clearing the mdc stack (like lock / unlock semantics?) and sometimes using local variables?  Again, not sure, and I think I was considering what it would look like for scans / bulk imports where transaction id or other "per user / thread" could provide additional insight, so might not apply here? It been awhile since I last looked.

slf4j supports passing the MDC implementation to the underlying logging system, but has no direct support for MDC.
If the user's underlying logging system is log4j2 or logback, then this would work1.
If the log layout format has to be modified, is there a possibility that user established 2.1 log parsing may break between 2.1.x versions?
References:
1. https://www.slf4j.org/api/org/slf4j/MDC.html


Fix index error when building 'imports' array

The list macho.dylibs appears to include the current target file at index 0. Other dylibs therefore appear at index 1 and above. There is no need to subtract 1 from the dylib index; doing so leads to symbols being listed associated with the wrong dylibs.

I completely overhauled this project.  Take a look and if you think the problem still exists, I'll re-address.  Thanks!

Thanks. I'll close this PR now.


Google 2FA

When using this library, would it be possible to add Google 2FA as well? What's the recommended way to do this?

There is experimental support for two-factor authentication.
The two methods Auth#login and Auth#loginWithUsername have an optional fourth parameter named $onBeforeSuccess that takes a callable (e.g. an anonymous function) that receives the user’s ID as its single parameter and is executed before successful authentication. It must return true to proceed or false to cancel authentication:
function ($userId) {
    // ...
    return false;
    // or
    // return true;
}

In that callback, you can check your second factor. That means you perform a normal login, but in that callback, you check (in your custom database table) if a second factor is required. If required, return false to make the attempt fail. If not required, return true to let authentication complete as usual.
In any case, catch AttemptCancelledException for your login attempt. If that exception is thrown, you may display an input field asking the user for their 2FA code and repeat the login request with that code, afterwards.
Let us know if that works for you, if there’s anything missing, or if the design is flawed.
In general, see https://github.com/delight-im/PHP-Auth/issues/34 as well.


add --shallow option to import verb, git-only

This fails, if version is HEAD. Not sure of this is a supported use case.
I have been using this to select the default branch explicitly.

To cite the docs:

The HEAD in Git is the pointer to the current branch reference, which is in turn a pointer to the last commit you made or the last commit that was checked out into your working directory.

So without a working directory the term HEAD doesn't seem to make much sense.

I have been using this to select the default branch explicitly.

Can you please try it without a version instead?

So without a working directory the term HEAD doesn't seem to make much sense.

Yes, I know. That's why I wrote: "Not sure of this is a supported use case."
It made sense (beforehand), because the version was changed after cloning the repository.

Can you please try it without a version instead?

I works (and worked).
But IMHO this is not expressive enough, at least not in my use case.
I think I will keep the support for HEAD on my end and just drop the version in this case.
HEAD is a reserved name and cannot collide with any other branch or tag :)

But IMHO this is not expressive enough, at least not in my use case.

Can you elaborate how it is "not expressive enough"? It seems to be the same if you you git clone URL without passing a specific branch name.

I just added a note to the README mentioning the default value of the version key which wasn't documented before: #150.


Merge develop to master for release 2.3.0

Codecov Report

Merging #509 into master will increase coverage by 0.01%.
The diff coverage is 64.58%.

@@            Coverage Diff             @@
##           master     #509      +/-   ##
==========================================
+ Coverage   84.69%   84.71%   +0.01%
==========================================
  Files         145      142       -3
  Lines        6123     5993     -130
  Branches      890      873      -17
==========================================
- Hits         5186     5077     -109
+ Misses        594      580      -14
+ Partials      343      336       -7

Impacted Files
Coverage Δ

src/Core/Managed/Shared/TelemetryClient.cs
70.28% <ø> (-1.45%)
:arrow_down:

...ged/Shared/Extensibility/TelemetryConfiguration.cs
82.5% <ø> (-0.43%)
:arrow_down:

...hannel/Shared/Implementation/TransmissionSender.cs
73.68% <0%> (-5.57%)
:arrow_down:

...re/Managed/Shared/DataContracts/MetricTelemetry.cs
100% <100%> (ø)
:arrow_up:

...Channel/Shared/Implementation/TaskTimerInternal.cs
81.01% <100%> (+0.74%)
:arrow_up:

...ed/Extensibility/Implementation/SdkVersionUtils.cs
100% <100%> (ø)
:arrow_up:

.../Extensibility/Implementation/TaskTimerInternal.cs
97.46% <100%> (-1.22%)
:arrow_down:

...ty/Implementation/TelemetryConfigurationFactory.cs
92.77% <85%> (+0.17%)
:arrow_up:

...ility/Implementation/TelemetryContextExtensions.cs
0% <0%> (-100%)
:arrow_down:

...annel/Shared/Implementation/TransmissionStorage.cs
90.57% <0%> (-1.45%)
:arrow_down:

... and 1 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8cb6da6...a1e71dd. Read the comment docs.


Adds api for resetting entra users

My commits aren't showing in GitHub for some reason - @meyerjrr if they don't come through could you please ensure the package name is package commonfate.control.integration.reset.v1alpha1;?


made search box/list "reactive", a first step

Basically straight from the react tutorial, but it works.  Lots of interactions left to figure out, like w/css, flask templating, etc.

I got it running in my local environment, and tested it out -- seems to work nicely.


Problem on TTGO T-Beam :: need help

Hi things4u
!!! THANKS for your work !!!
It's a great project and I would like to get it running on my TTGO T-Beam v1.0
i compiled your project and started it on my TTGO T-Beam v1.0
But now I'm stuck in an endloop boot loop -> see 'DEBUG Output' below (ERROR hostByName NTP) ...
furthermore I also have some problems with the hardware configuration (_PIN_OUT==x, OLED, ...).
that would be my exact hardware https://github.com/lewisxhe/TTGO-T-Beam  -> someone can help me here ...
note: the Paxcounter (https://github.com/cyberman54/ESP32-Paxcounter) runs quite well on this Board!
`
..:: DEBUG Output ::..
ets Jun  8 2016 00:22:57
rst:0x1 (POWERON_RESET),boot:0x13 (SPI_FAST_FLASH_BOOT)
configsip: 0, SPIWP:0xee
clk_drv:0x00,q_drv:0x00,d_drv:0x00,cs0_drv:0x00,hd_drv:0x00,wp_drv:0x00
mode:DIO, clock div:1
load:0x3fff0018,len:4
load:0x3fff001c,len:1044
load:0x40078000,len:8896
load:0x40080400,len:5816
entry 0x400806ac
ESP32 defined, freq=868100000
ARDUINO_ARCH_ESP32 defined
SPIFFS init success
readConfig:: Starting
.readConfig:: reading line=SSID=ADW20-IoT
SSID=	ADW20-IoT
.readConfig:: reading line=PASS=xxXXxx
PASS=	iotADW20
.readConfig:: reading line=CH=0
CH=	0
.readConfig:: reading line=SF=9
SF=	9
.readConfig:: reading line=FCNT=0
FCNT=	0
.readConfig:: reading line=DEBUG=1
DEBUG=	1
.readConfig:: reading line=PDEBUG=64
PDEBUG=64
.readConfig:: reading line=CAD=1
CAD=1
.readConfig:: reading line=HOP=0
HOP=0
.readConfig:: reading line=NODE=0
NODE=	0
.readConfig:: reading line=BOOTS=202
BOOTS=	202
.readConfig:: reading line=RESETS=0
RESETS=	0
.readConfig:: reading line=WIFIS=203
WIFIS=	203
.readConfig:: reading line=VIEWS=0
VIEWS=	0
.readConfig:: reading line=REFR=0
REFR=	0
.readConfig:: reading line=REENTS=0
REENTS=	0
.readConfig:: reading line=NTPETIM=0
NTPETIM=	0
.readConfig:: reading line=NTPERR=0
NTPERR=	0
.readConfig:: reading line=NTPS=0
NTPS=	0
.readConfig:: reading line=FILEREC=0
FILEREC=	0
.readConfig:: reading line=FILENO=0
FILENO=	0
.readConfig:: reading line=FILENUM=0
FILENUM=	0
.readConfig:: reading line=DELAY=0
DELAY=	0
.readConfig:: reading line=EXPERT=0
EXPERT=	0
readConfig:: Fini
Assert=Do Asserts
debug=1
readConfig:: Starting
.readConfig:: reading line=SSID=ADW20-IoT
SSID=	ADW20-IoT
.readConfig:: reading line=PASS=xxXXxx
PASS=	iotADW20
.readConfig:: reading line=CH=0
CH=	0
.readConfig:: reading line=SF=9
SF=	9
.readConfig:: reading line=FCNT=0
FCNT=	0
.readConfig:: reading line=DEBUG=1
DEBUG=	1
.readConfig:: reading line=PDEBUG=64
PDEBUG=64
.readConfig:: reading line=CAD=1
CAD=1
.readConfig:: reading line=HOP=0
HOP=0
.readConfig:: reading line=NODE=0
NODE=	0
.readConfig:: reading line=BOOTS=202
BOOTS=	202
.readConfig:: reading line=RESETS=0
RESETS=	0
.readConfig:: reading line=WIFIS=203
WIFIS=	203
.readConfig:: reading line=VIEWS=0
VIEWS=	0
.readConfig:: reading line=REFR=0
REFR=	0
.readConfig:: reading line=REENTS=0
REENTS=	0
.readConfig:: reading line=NTPETIM=0
NTPETIM=	0
.readConfig:: reading line=NTPERR=0
NTPERR=	0
.readConfig:: reading line=NTPS=0
NTPS=	0
.readConfig:: reading line=FILEREC=0
FILEREC=	0
.readConfig:: reading line=FILENO=0
FILENO=	0
.readConfig:: reading line=FILENUM=0
FILENUM=	0
.readConfig:: reading line=DELAY=0
DELAY=	0
.readConfig:: reading line=EXPERT=0
EXPERT=	0
readConfig:: Fini
MAC: 24:6f:28:99:be:28, len=17
WlanConnect:: Init para 0
0:1:3. WiFi connect SSID=ADW20-IoT, pass=xxXXxx
A WlanStatus:: CONNECTED to ADW20-IoT
Host esp32-99be28 WiFi Connected to ADW20-IoT on IP=<IP_ADDRESS>
Local UDP port=1700
Connection successful
Gateway ID: 246F28FFFF99BE28, Listening at SF9 on 868.10 MHz.
Setup:: ERROR hostByName NTP
abort() was called at PC 0x400db3ae on core 1
Backtrace: 0x4008cc2c:0x3ffb1ed0 0x4008ce5d:0x3ffb1ef0 0x400db3ae:0x3ffb1f10 0x400ddb59:0x3ffb1f30 0x400e7c83:0x3ffb1fb0 0x40089341:0x3ffb1fd0
Rebooting...
ets Jun  8 2016 00:22:57
rst:0xc (SW_CPU_RESET),boot:0x13 (SPI_FAST_FLASH_BOOT)
configsip: 0, SPIWP:0xee
clk_drv:0x00,q_drv:0x00,d_drv:0x00,cs0_d...................
..................
...............
`

So what configGway.h configNode.h are you using. If the pin-out is not correct then the gateway complies but does not work, _PIN_OUT==5 seems most appropriate.

ttgo t-beam has a power management chip, which requires some initialisation for different radios, gps, lora, oled individually. Check this: https://github.com/kizniche/ttgo-tbeam-ttn-tracker

Hi,
The T-beam is compiling and working OK as of release 6.1.4. This version works on my version and probably should work on yours as well. Please set "#define GATEWAYNODE 1" in configGway.h
Unfotunately I cannot keep track of all the differences between T-Beam and its pin-out. That's why I ask for pin numbers.

How is the T-Beam doing?

T-Beam pinout can be found here https://github.com/kizniche/ttgo-tbeam-ttn-tracker/blob/master/main/configuration.h .


Ades/assets landing pages feature toggle

Feature toggle for asset landing pages
Changes 👷♀

adds a new feature toggle functionality and exposes as a react hook
adds a feature toggle AssetLandingPages for the new landing pages
implements this feature in the index page of the app, showing a different UI when the feature is enabled

How to test 🧪
Test local enable/disable of feature toggle:

run the app

observe that the original homepage is showing
observe that the local storage contains a new key called features that contains a JSON

inside features JSON in local storage, change the value of AssetLandingPages from false to true
reload the homepage

observe that the string "AssetLandingPages feature enabled ✅" is displayed on the homepage

Simulate a release

delete features from local storage
run the app

observe that the original homepage is showing
observe that in features in local storage, AssetLandingPages is set to false

inside helpers/useFeatureToggle set configuredFeatures.AssetLandingPages to true
recompile app and reload home page

observe that in features in local storage, AssetLandingPages remains set to false
observe that the string "AssetLandingPages feature enabled ✅" is displayed on the homepage

Can see features in localStorage

when editing localstorage in runtime it also works

Please address comments of other reviewers before merging, I have nothing more to add


Client Certificate

Client certificate
When a server asks for it, the app provides a local certificate.
To configure it needs a pkcs12 file name, extension and password.
The pkcs12 file has to be in the app bundle

Thanks for your PR. I looked at it but I think it is doing a bit too much and might be constraining the user. The way I was thinking about allowing self signed certificates was to just expose a challenge hook on the HttpOptions and have the user implement all the functionality the way they see it fit. TBH I don't want to make it easy and I am also considering making this hook available only in some circumstances (e.g. #ifdef DEBUG) - I am afraid people will use it and shoot themselves in a foot.

Right i see ... could it be like a callback function and let the users decide what they do with it . Something like clientCertificateRequestCallback and it could go to httpOptions.
Does it sound like a good plan ? What do you think ? Cheers

Yes, this is exactly what I was thinking. HttpOptionsOptions should make it possible to set a handler that would take all the parameters and make the user take all control. I am thinking about something like this:
public var authenticationChallengeHandler: (_ session: URLSession, didReceive challenge: URLAuthenticationChallenge, completionHandler: @escaping (URLSession.AuthChallengeDisposition, URLCredential?) -> Void) -> Void = {
  // possibly log an error or throw
}

With a handler like this users should be able to do anything they need to do and the framework will not impose any constraints on them. It will also not make their job easier but this is a non-goal in this scenario.

done

Thank you for your comments. I also noticed atm the app doesn't go through the tests in 2 cases. It says WebsocketsTransport requires iOS13 . Should we increase deployment target?

Thank you for your comments. I also noticed atm the app doesn't go through the tests in 2 cases. It says WebsocketsTransport requires iOS13 . Should we increase deployment target?

I must have missed this when replacing SwiftWebSocket with URLSessionWebSocketTask. We should do this but it should be a separate change.

My pleasure , love to help :)


Add ATSAMA5D2/D4 Secure Fuse Controller (SFC) driver

Summary
Adds driver for Microchip ATSAMA5D2 and D4 processors. The ATSAMA5D3 does not have "secure fuse" support so a different driver would be needed for that device, or a lot more #ifdef clutter added.
Impact
None expected. But NB: no testing has been done on an ATSAMA5D4 processor.
Testing
Custom board with ATSAMA5D27C-D1G. Various fuse patterns tested and verified.
Things I am not sure of

The comments in include/nuttx/efuse.h say the fuse fields
are mapped inside an arch efuse table and referenced in a header file inside include/nuttx/efuse/ directory
I am not sure that is really the right place for this, but I have created a generic header file and placed it there, but think it perhaps should be located in arch/arm/src/sama5/hardware instead?

A lot of the functionality came from existing code for the esp32c3 familly. There might be an argument for someone, sometime, to extract the common functions and relocate them as helper functions as part of the overall efuse support? That said, I think the esp32c3 efuse code has bugs in it....

Hi @TimJTi yes, I think the efuse table currently is located at arch directory as you can see at arch/xtensa/src/esp32/esp32_efuse_table.c but there is an issue: an application is nuttx-apps/ normally cannot access files inside arch/. So I think the right place should be inside include/nuttx/efuse/

Hi @TimJTi yes, I think the efuse table currently is located at arch directory as you can see at arch/xtensa/src/esp32/esp32_efuse_table.c but there is an issue: an application is nuttx-apps/ normally cannot access files inside arch/. So I think the right place should be inside include/nuttx/efuse/

Thanks @acassis  - I'll leave it were it is then!
Are the esp32 efuse drivers your concern? If so, I'll let you know what I think is wrong with them as they probably need looking at - but I might be missing something and they're actually OK.

Hey there @TimJTi :-)
Thanks for the PR! I have no hardware to verify.. and cannot find any develkit for quick testing.. this seems quite new and powerful SoC! Also I did not use/work with eFuse so I cannot really help here sorry :-(
I guess @acassis did most of the ESP32 porting to NuttX so Alan would be the best person to ask questions and talk about ESP32 family. I hope you can together work out a common eFuse interface/api that could be also propagated to other architectures :-)


Building a parser for countries with double byte characters

Hi
Would the required libraries support extended ASCI characters such as Ê or non-Latin double byte character sets such as Japanese 北海道
Thanks

yes


{Network} az network vnet-gateway: Migrate azure stack profiles to AAZ

Related command

Description

Testing Guide

History Notes

[Component Name 1] BREAKING CHANGE: az command a: Make some customer-facing breaking change
[Component Name 2] az command b: Add some customer-facing feature

This checklist is used to make sure that common guidelines for a pull request are followed.

[ ] The PR title and description has followed the guideline in Submitting Pull Requests.

[ ] I adhere to the Command Guidelines.

[ ] I adhere to the Error Handling Guidelines.

Network


clarify license

Clarify terms of license applied on this repository

Why are we mentioning beacon chain in the license?

Why are we mentioning beacon chain in the license?

Good catch, thanks! I've assumed people use the original text, but clearly it wasn't the case. Let me replace it with the real one.

fixed. Merging soon if no other comments.

LGTM


Razor adding indentation after @ when typing '@using html.BeginForm()'

Hi,
I'm finding that razor is adding an indentation after the @ when typing @using Html.BeginForm() in a VB.NET MVC Web Application. This can be recreated by creating a new empty VB.NET Web Application with MVC references and then add a new controller and view and then type @using Html.BeginForm() into the new view and press enter and you will see it then indents after the @.

/cc @ToddGrun @alexgav

Have also posted this onto the visual studio developer community
https://developercommunity.visualstudio.com/content/problem/42335/razor-adding-indentation-after.html

If this is an issue with .vbhtml then VS feedback is the right place to track it. This repo is for ASP.NET Core Razor, which doesn't include .vbhtml


Use randomized content ID for Azure multipart uploads

Which issue does this PR close?
Closes #6868.
Rationale for this change
Explained in the issue
What changes are included in this PR?
In object_store's AzureClient.put_block(), use a random, u128 for part_idx instead of the counter based part_idx parameter.
Are there any user-facing changes?
No

Could we get a test showing concurrent uploads not interfering with each other?

@tustvold, I have added an integration test (azure_parallel_put_multipart_test) to src/azure/mod.rs which tries to interleave blocks from 2 separate streams. The test fails without the changes to /home/avarnon/code/github/apache/arrow-rs/object_store/src/azure/client.rs because the final assert in the test shows that the file contents are from the second stream instead of the first one.

Pushed a fixup to satisfy AWS S3's minimum allowed upload size of 5,242,880

The limit is the other way round, all bar the last part must be 5MiB or more. Feel free to leave for now if you prefer

I have pushed a change which should make each block big enough for S3

Thanks for this


Add reusuable github workflows for linting and auditing

Experimental usage of https://docs.github.com/en/actions/using-workflows/reusing-workflows#access-to-reusable-workflows

Here's an early look at where this is being used: https://github.com/inrupt/solid-client-notifications-js/pull/212 (see the audit and lint actions)


updated decrepicated vim.api.nvim_buf_get_option() and vim.lsp.buf_ge…

https://github.com/ahmedkhalf/project.nvim/issues/169

@ahmedkhalf I think this is about ready, let me know what you think of the change


Terminate the grant from Coinversation

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


add netns volume mount to avoid agent warning when it starts

Description
since cli run as privileged we need to include netns volume mount to avoid warning when the agent starts
Dependencies

n/a
Checklist
If you are not familiar with our processes or don't know what to answer in the list below, let us know in a comment: the maintainers will take care of that.

[ ] Is this PR backed with a JIRA ticket? If so, make sure it is written as a title prefix (in general, PRs affecting the NetObserv/Network Observability product should be backed with a JIRA ticket - especially if they bring user facing changes).
[ ] Does this PR require product documentation?

[ ] If so, make sure the JIRA epic is labelled with "documentation" and provides a description relevant for doc writers, such as use cases or scenarios. Any required step to activate or configure the feature should be documented there, such as new CRD knobs.

[ ] Does this PR require a product release notes entry?

[ ] If so, fill in "Release Note Text" in the JIRA.

[ ] Is there anything else the QE team should know before testing? E.g: configuration changes, environment setup, etc.

[ ] If so, make sure it is described in the JIRA ticket.

QE requirements (check 1 from the list):

[ ] Standard QE validation, with pre-merge tests unless stated otherwise.
[ ] Regression tests only (e.g. refactoring with no user-facing change).
[ ] No QE (e.g. trivial change with high reviewer's confidence, or per agreement with the QE team).

/approve


Anonymous access

You can make a request like this:
GET /playlist/6rZ28nCpmG5Wo1Ik64EoDm HTTP/1.1
Host: open.spotify.com
User-Agent: Firefox/60

and in part of the HTML response, you get this:
{"clientId":"0971d",
"accessToken":"BQDLN9hyIJn0zvspT1OOHdJBQh7pJVrA1CMBMsuu3jOFDT6o37ti_pH8__M84opDUd0yqkzKxLIfjv9XmAw",
"accessTokenExpirationTimestampMs":1628533452806,"isAnonymous":true,
"recaptchaWebPlayerFraudSiteKey":"6LfCVLAUAAAAALFwwRnnCJ12DalriUGbj8FW_J39",
"app_name":"web_player_prototype","market":"US","locale":{"locale":"en","rtl":false,
"textDirection":"ltr"},"gtmId":"GTM-PZHN3VD","optimizeId":"GTM-W53X654","userCountry":null,
"isPremium":false,"correlationId":"f46dc1f60dc9e932d574104732a0173d",
"retargetingPixels":{"twitter":"o46zp","pinterest":"2617608197512",
"snapchat":"fff7f198-e6aa-4833-b900-92d3854473b2"}}

accessToken can then be used in a request like this:
GET /v1/playlists/6rZ28nCpmG5Wo1Ik64EoDm HTTP/1.1
Host: api.spotify.com
Authorization: Bearer BQDLN9hyIJn0zvspT1OOHdJBQh7pJVrA1CMBMsuu3jOFDT6o37ti_pH8__M84opDUd0yqkzKxLIfjv9XmAw

Cool! Is there any documentation for this that you know of? I can't find anything on the developer website.

I just opened a playlist in browser, then captured all the requests, then downloaded the HAR file, then matched the Bearer token against the other responses that were received. If you only want to implement official APIs thats cool, but I think it would be a useful addition.


What size should I make the ring buffer if you are using a virtual machine without l3?

According to the FAQ, the size of the ringbuffer is estimated according to the l3 of the CPU, but if you are using a virtual machine, how to estimate the size of the ringbuffer without l3?

If you are running on a virtual machine that level of performance tuning is probably not relevant.
That being said, you can get an empirical answer by trying different sizes and see which one you get the best performance with.


Network is unreachable error

Hi,
I encountered some issue when running the melodies-monet on Hera to generate the spatial overlay plots with the "Network is unreachable" error.
My run folder with the log file is in /scratch2/NCEPDEV/naqfc/Kai.Wang/MONET/main/ufsaqm_analysis/b4_c2
The output and data folder is in /scratch2/NCEPDEV/stmp3/Kai.Wang/monet_analysis/regional/processed/b4_c2.
The script can produce the ts and Taylor plots without problems for the same run.
Could you please help take a look into this issue?
Thanks,
Kai

I see from the log that it was trying to download shapefiles for cartopy.
On Hera, you can link already downloaded shapefiles to your home directory to get around this as in our instructions (step 3).

Hi @zmoon Thank you for looking into this quickly. Now I see what's wrong here. I did link the cartopy shapefiles in the past. However the links were pointed to /scratch1/NCEPDEV/rstprod/nexus_emissions/cartopy_shapefiles. It looks the access is closed to public now. I'm curious if you have another folder that doesn't have access restrictions?

Yeah, the location changed somewhat recently, we have some discussion in #86 . The new link script worked for me and I think @rschwant tested it too. Maybe @bbakernoaa can update the permissions to help?

@zmoon Thanks for pointing out the previous discussion on this issue. I was able to get the shapefile links fixed. I will do some testing to verify the results before closing this issue.

@KaiWang-NOAA Is this resolved?

Hi Barry,
@bbakernoaa https://github.com/bbakernoaa  Yes. It's resolved. I will
close the issue.
Thanks,
Kai
On Mon, Sep 19, 2022 at 1:27 PM Barry Baker @.***>
wrote:

@KaiWang-NOAA https://github.com/KaiWang-NOAA Is this resolved?
—
Reply to this email directly, view it on GitHub
https://github.com/NOAA-CSL/MELODIES-MONET/issues/103#issuecomment-1251322865,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/A2A5ALSDI4IAX4JJ4DROG33V7CO5XANCNFSM57XSDS3Q
.
You are receiving this because you were mentioned.Message ID:
@.***>

--
Kai Wang, Ph.D.
Lynker at NOAA/NWS/NCEP/EMC
5830 University Research Ct., Rm. 2029
College Park, MD 20740
@.***
(301) 683-3230


Page can be moved outside content directory

Move action allows page (.md file) to be placed outside configured content directory. Renaming page as ../something is allowed (if file permissions does not restricts this).

#51 hopefully solves this problem.


paket.reference to recognizing github packages in paket.lock file

Description
The paket.dependencies file is:
source https://www.nuget.org/api/v2

github fsprojects/Argu

Repro steps

Create a F# Windows console application using VS 2015/17 Community Edition (OS: Windows 2008 R2)
Perform paket init
Create paket.dependencies file with the following contents:

source https://www.nuget.org/api/v2

github fsprojects/Argu

Create paket.references file in project with contents:
Argu
Perform paket update (or paket install) from VS menu or commandline

Expected behavior
Argu would now exist as a reference within the project containing the aforementioned paket.reference file.
Actual behavior
The following error message is display (and is not completely represented in VS Error List when install or update is performed from VS' paket menu):
Paket failed with
-> Installation Errors :
    - <...full path to project...>\paket.references uses NuGet package Argu, but it was not found in the paket.lock file in group Main.

Known workarounds
clone the projects and manually link them into your solutions...ignoring paket.

I think this is related to the GitHub changes. Even after working around the paket download issue, my builds were still breaking on AppVeyor with an error that the file was not found. At least, I think this is related. If not, I'm happy to open a new issue.

@panesofglass with the new bootstrapper?

@forki yes.

@gdennie I looked at this. What makes you think this would work? you are referencing a github project - not a nuget package. Is this a feature request?

@forki I reviewed the documentation again, GitHub dependencies. At the time I somehow thought that paket allowed the import of github hosted libraries similar to how it treated nuget. Upon review, that is not the case. The documentation in this area could use some work.
Thanks for your attention.
George.

Did you look at https://fsprojects.github.io/Paket/git-dependencies.html#Using-Git-repositories-as-NuGet-source - with git dependencies you can let paket build the nupkgs for you.
Also please send improvements to the docs that clarify the problem

Either I did not notice that or did not recognize it as the defacto solution that it is. The fact that github packages must be built is an obvious but understated distinction from nuget that could use a bit more fanfare.
If time permits, I'll see what I can improve in the documentation.
Thanks again.

Hi. I'm fairly new to .NET Core tooling in general and I'm confused about the above discussion. Can someone clarify what the intended use-case is for including git repositories within the paket.dependencies file, if not to somehow reference it in the paket.references file?
Do I need to go through the process of making a NuGet package out of my project before it can be used as a dependency managed by paket? Thanks for any insights!

Hi. I'm fairly new to .NET Core tooling in general and I'm confused about the above discussion. Can someone clarify what the intended use-case is for including git repositories within the paket.dependencies file, if not to somehow reference it in the paket.references file?
Do I need to go through the process of making a NuGet package out of my project before it can be used as a dependency managed by paket? Thanks for any insights!

I am not a Paket expert, but my understanding is that the Paket GitHub dependencies can only be a single file that is fetched from GitHub. So, if your library is just one .fs file then you do not need to go via NuGet, but if it is more complex than that then you will need to publish.
See the instructions here for how to reference a single file from GitHub using Paket: https://github.com/xyncro/aether#installation
Another option is to use GitHub packages, which might be more convenient for you since you are already using GitHub.
I opened this issue about referencing whole GitHub projects.

The use case here is that Paket would allow DotNet to be used in the same way that NPM empowered NodeJS - we can create a complex ecosystem of interrelated packages that exist as source code only, and which are built at import time, instead of per package. This is one of NPM's greatest strengths - it makes code reuse at the package level trivial.


[doc] 'docs/guides/development.md' not found

docs/guides/development.md file is not found.
Below links are broken in Readme.md file:

Contributing to Deku

..Learn how to build and work on Deku in the documentation.

Should be closed as a duplicate of #266

@tejasmanohar Yes, it is. can you update the other ticket with Contributing to Deku link which is also broken.

same file


Drift terminating nodes without any drift in NodePool/EC2NodeClass

Description
Observed Behavior:
We recently attempted to upgrade from v0.32 to v0.37, as part of the upgrade the Drift feature was enabled by default. The drift feature seems to be terminating nodes randomly when there is no drift in NodePool/EC2NodeClass, The NodePool/EC2NodeClass we have are static and don't change often. Am trying to understand what else could be playing up here.
Disruption was observed through drift replace and delete, These events occurred within 2 minutes of the pods being scheduled on the nodes. The exact cause of the drift detected by Karpenter is unclear.
Log snippets:
{"level":"INFO","time":"2024-07-23T05:45:08.525Z","logger":"controller","message":"registered nodeclaim","commit":"490ef94","controller":"nodeclaim.lifecycle","controllerGroup":"karpenter.sh","controllerKind":"NodeClaim","NodeClaim":{"name":"default-npglm"},"namespace":"","name":"default-npglm","reconcileID":"3c30d9f0-0bae-4ffb-817c-f6766b4d3a2a","provider-id":"aws:///ap-southeast-2c/i-09c67717d3c4d1eab","Node":{"name":"ip-10-124-231-159.ap-southeast-2.compute.internal"}}
{"level":"INFO","time":"2024-07-23T05:45:21.678Z","logger":"controller","message":"initialized nodeclaim","commit":"490ef94","controller":"nodeclaim.lifecycle","controllerGroup":"karpenter.sh","controllerKind":"NodeClaim","NodeClaim":{"name":"default-npglm"},"namespace":"","name":"default-npglm","reconcileID":"2bb7ffbd-36c1-46fc-9491-392dcba33b47","provider-id":"aws:///ap-southeast-2c/i-09c67717d3c4d1eab","Node":{"name":"ip-10-124-231-159.ap-southeast-2.compute.internal"},"allocatable":{"cpu":"15890m","ephemeral-storage":"482038337146","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"28900828Ki","pods":"234"}}
{"level":"INFO","time":"2024-07-23T05:47:13.615Z","logger":"controller","message":"disrupting via drift replace, terminating 1 nodes (3 pods) ip-10-124-231-159.ap-southeast-2.compute.internal/c5.4xlarge/spot and replacing with spot node from types c7i-flex.4xlarge, r6a.2xlarge, c7i-flex.8xlarge, m6a.2xlarge, m5.2xlarge and 55 other(s)","commit":"490ef94","controller":"disruption","command-id":"e688f6e6-5e1a-4fef-95ec-29947ad8a6ff"}
{"level":"INFO","time":"2024-07-23T05:47:13.668Z","logger":"controller","message":"created nodeclaim","commit":"490ef94","controller":"disruption","NodePool":{"name":"default"},"NodeClaim":{"name":"default-frtfp"},"requests":{"cpu":"7650m","memory":"15Gi","pods":"7"},"instance-types":"c3.4xlarge, c4.4xlarge, c5.4xlarge, c5a.4xlarge, c5ad.4xlarge and 55 other(s)"}
{"level":"INFO","time":"2024-07-23T05:47:16.515Z","logger":"controller","message":"launched nodeclaim","commit":"490ef94","controller":"nodeclaim.lifecycle","controllerGroup":"karpenter.sh","controllerKind":"NodeClaim","NodeClaim":{"name":"default-frtfp"},"namespace":"","name":"default-frtfp","reconcileID":"6e79b03d-3bc3-496d-b1cb-0b1edea6eb8a","provider-id":"aws:///ap-southeast-2c/i-0b66abb67dba578d8","instance-type":"m4.2xlarge","zone":"ap-southeast-2c","capacity-type":"spot","allocatable":{"cpu":"7910m","ephemeral-storage":"449Gi","memory":"29317Mi","pods":"58"}}
{"level":"INFO","time":"2024-07-23T05:47:48.814Z","logger":"controller","message":"registered nodeclaim","commit":"490ef94","controller":"nodeclaim.lifecycle","controllerGroup":"karpenter.sh","controllerKind":"NodeClaim","NodeClaim":{"name":"default-frtfp"},"namespace":"","name":"default-frtfp","reconcileID":"86abdc20-2e12-4914-9248-66f7a956fecf","provider-id":"aws:///ap-southeast-2c/i-0b66abb67dba578d8","Node":{"name":"ip-10-124-231-213.ap-southeast-2.compute.internal"}}
{"level":"INFO","time":"2024-07-23T05:48:03.006Z","logger":"controller","message":"initialized nodeclaim","commit":"490ef94","controller":"nodeclaim.lifecycle","controllerGroup":"karpenter.sh","controllerKind":"NodeClaim","NodeClaim":{"name":"default-frtfp"},"namespace":"","name":"default-frtfp","reconcileID":"182ac87c-8316-4f69-9832-822d43b1a794","provider-id":"aws:///ap-southeast-2c/i-0b66abb67dba578d8","Node":{"name":"ip-10-124-231-213.ap-southeast-2.compute.internal"},"allocatable":{"cpu":"7910m","ephemeral-storage":"482038337146","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31839548Ki","pods":"58"}}
{"level":"INFO","time":"2024-07-23T05:48:10.361Z","logger":"controller","message":"command succeeded","commit":"490ef94","controller":"disruption.queue","command-id":"e688f6e6-5e1a-4fef-95ec-29947ad8a6ff"}
{"level":"INFO","time":"2024-07-23T05:48:10.405Z","logger":"controller","message":"tainted node","commit":"490ef94","controller":"node.termination","controllerGroup":"","controllerKind":"Node","Node":{"name":"ip-10-124-231-159.ap-southeast-2.compute.internal"},"namespace":"","name":"ip-10-124-231-159.ap-southeast-2.compute.internal","reconcileID":"fbdce59f-6c38-4dfc-929e-0681a8e773ca"}
{"level":"INFO","time":"2024-07-23T05:48:42.948Z","logger":"controller","message":"deleted node","commit":"490ef94","controller":"node.termination","controllerGroup":"","controllerKind":"Node","Node":{"name":"ip-10-124-231-159.ap-southeast-2.compute.internal"},"namespace":"","name":"ip-10-124-231-159.ap-southeast-2.compute.internal","reconcileID":"046081f7-18e1-4ae5-887b-e68ef098190e"}
{"level":"INFO","time":"2024-07-23T05:48:43.313Z","logger":"controller","message":"deleted nodeclaim","commit":"490ef94","controller":"nodeclaim.termination","controllerGroup":"karpenter.sh","controllerKind":"NodeClaim","NodeClaim":{"name":"default-npglm"},"namespace":"","name":"default-npglm","reconcileID":"a2cb44c5-fc04-49a6-bf2b-461b6f46b30e","Node":{"name":"ip-10-124-231-159.ap-southeast-2.compute.internal"},"provider-id":"aws:///ap-southeast-2c/i-09c67717d3c4d1eab"}

{"level":"INFO","time":"2024-07-23T06:27:13.503Z","logger":"controller","message":"registered nodeclaim","commit":"490ef94","controller":"nodeclaim.lifecycle","controllerGroup":"karpenter.sh","controllerKind":"NodeClaim","NodeClaim":{"name":"default-6kxff"},"namespace":"","name":"default-6kxff","reconcileID":"e325a1c3-a941-442b-bcb3-0d4aca63927d","provider-id":"aws:///ap-southeast-2a/i-06bd67b3cc9fac7a7","Node":{"name":"ip-10-124-230-9.ap-southeast-2.compute.internal"}}
{"level":"INFO","time":"2024-07-23T06:27:24.092Z","logger":"controller","message":"initialized nodeclaim","commit":"490ef94","controller":"nodeclaim.lifecycle","controllerGroup":"karpenter.sh","controllerKind":"NodeClaim","NodeClaim":{"name":"default-6kxff"},"namespace":"","name":"default-6kxff","reconcileID":"ceead006-314c-43db-bfa6-4b1dae5e9213","provider-id":"aws:///ap-southeast-2a/i-06bd67b3cc9fac7a7","Node":{"name":"ip-10-124-230-9.ap-southeast-2.compute.internal"},"allocatable":{"cpu":"7910m","ephemeral-storage":"482038337146","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"15056228Ki","pods":"58"}}
{"level":"INFO","time":"2024-07-23T06:28:12.779Z","logger":"controller","message":"disrupting via drift replace, terminating 1 nodes (1 pods) ip-10-124-230-4.ap-southeast-2.compute.internal/c7i-flex.2xlarge/spot and replacing with spot node from types c7i-flex.2xlarge, c7i-flex.4xlarge, c5.2xlarge, c6a.2xlarge, r6a.2xlarge and 55 other(s)","commit":"490ef94","controller":"disruption","command-id":"6dd9d311-ce69-49c7-84d3-23efb934fa36"}
{"level":"INFO","time":"2024-07-23T06:28:12.841Z","logger":"controller","message":"created nodeclaim","commit":"490ef94","controller":"disruption","NodePool":{"name":"default"},"NodeClaim":{"name":"default-c5lwp"},"requests":{"cpu":"2650m","memory":"5Gi","pods":"5"},"instance-types":"c3.2xlarge, c3.4xlarge, c4.2xlarge, c4.4xlarge, c5.2xlarge and 55 other(s)"}
{"level":"INFO","time":"2024-07-23T06:28:15.191Z","logger":"controller","message":"launched nodeclaim","commit":"490ef94","controller":"nodeclaim.lifecycle","controllerGroup":"karpenter.sh","controllerKind":"NodeClaim","NodeClaim":{"name":"default-c5lwp"},"namespace":"","name":"default-c5lwp","reconcileID":"22da63f7-22b5-460d-98df-1ab8d7e74532","provider-id":"aws:///ap-southeast-2a/i-07494db765c2a7d65","instance-type":"c7i-flex.2xlarge","zone":"ap-southeast-2a","capacity-type":"spot","allocatable":{"cpu":"7910m","ephemeral-storage":"449Gi","memory":"14162Mi","pods":"58"}}
{"level":"INFO","time":"2024-07-23T06:28:16.062Z","logger":"controller","message":"disrupting via drift replace, terminating 1 nodes (3 pods) ip-10-124-231-44.ap-southeast-2.compute.internal/c6a.4xlarge/on-demand and replacing with on-demand node from types m5a.2xlarge, m6a.2xlarge, m7i-flex.2xlarge, m5.2xlarge, m6i.2xlarge and 55 other(s)","commit":"490ef94","controller":"disruption","command-id":"e6e17196-0807-473d-b621-2ce91652dcb5"}
{"level":"INFO","time":"2024-07-23T06:28:16.125Z","logger":"controller","message":"created nodeclaim","commit":"490ef94","controller":"disruption","NodePool":{"name":"premium"},"NodeClaim":{"name":"premium-zxfct"},"requests":{"cpu":"7650m","memory":"18Gi","pods":"7"},"instance-types":"c3.4xlarge, c4.4xlarge, c5.4xlarge, c5a.4xlarge, c5ad.4xlarge and 55 other(s)"}
{"level":"INFO","time":"2024-07-23T06:28:18.214Z","logger":"controller","message":"launched nodeclaim","commit":"490ef94","controller":"nodeclaim.lifecycle","controllerGroup":"karpenter.sh","controllerKind":"NodeClaim","NodeClaim":{"name":"premium-zxfct"},"namespace":"","name":"premium-zxfct","reconcileID":"f81550a0-948d-4756-9109-1a846f49081b","provider-id":"aws:///ap-southeast-2b/i-0bcc91825f6a14671","instance-type":"m6a.2xlarge","zone":"ap-southeast-2b","capacity-type":"on-demand","allocatable":{"cpu":"7910m","ephemeral-storage":"449Gi","memory":"29317Mi","pods":"58","vpc.amazonaws.com/pod-eni":"38"}}
{"level":"INFO","time":"2024-07-23T06:28:37.906Z","logger":"controller","message":"registered nodeclaim","commit":"490ef94","controller":"nodeclaim.lifecycle","controllerGroup":"karpenter.sh","controllerKind":"NodeClaim","NodeClaim":{"name":"default-c5lwp"},"namespace":"","name":"default-c5lwp","reconcileID":"a720574a-b66d-4aa3-a493-370500b92cef","provider-id":"aws:///ap-southeast-2a/i-07494db765c2a7d65","Node":{"name":"ip-10-124-230-199.ap-southeast-2.compute.internal"}}
{"level":"INFO","time":"2024-07-23T06:28:48.829Z","logger":"controller","message":"initialized nodeclaim","commit":"490ef94","controller":"nodeclaim.lifecycle","controllerGroup":"karpenter.sh","controllerKind":"NodeClaim","NodeClaim":{"name":"default-c5lwp"},"namespace":"","name":"default-c5lwp","reconcileID":"fd3cf6b4-c811-4ec8-aba6-9390656fa631","provider-id":"aws:///ap-southeast-2a/i-07494db765c2a7d65","Node":{"name":"ip-10-124-230-199.ap-southeast-2.compute.internal"},"allocatable":{"cpu":"7910m","ephemeral-storage":"482038337146","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"15056228Ki","pods":"58"}}
{"level":"INFO","time":"2024-07-23T06:28:57.419Z","logger":"controller","message":"registered nodeclaim","commit":"490ef94","controller":"nodeclaim.lifecycle","controllerGroup":"karpenter.sh","controllerKind":"NodeClaim","NodeClaim":{"name":"premium-zxfct"},"namespace":"","name":"premium-zxfct","reconcileID":"24ef0c37-a4b9-4b0b-83d9-085e434e9750","provider-id":"aws:///ap-southeast-2b/i-0bcc91825f6a14671","Node":{"name":"ip-10-124-231-30.ap-southeast-2.compute.internal"}}
{"level":"INFO","time":"2024-07-23T06:28:58.197Z","logger":"controller","message":"command succeeded","commit":"490ef94","controller":"disruption.queue","command-id":"6dd9d311-ce69-49c7-84d3-23efb934fa36"}
{"level":"INFO","time":"2024-07-23T06:28:58.235Z","logger":"controller","message":"tainted node","commit":"490ef94","controller":"node.termination","controllerGroup":"","controllerKind":"Node","Node":{"name":"ip-10-124-230-4.ap-southeast-2.compute.internal"},"namespace":"","name":"ip-10-124-230-4.ap-southeast-2.compute.internal","reconcileID":"b119135e-964a-4d46-93cd-f46a353f8a01"}
{"level":"INFO","time":"2024-07-23T06:29:08.679Z","logger":"controller","message":"initialized nodeclaim","commit":"490ef94","controller":"nodeclaim.lifecycle","controllerGroup":"karpenter.sh","controllerKind":"NodeClaim","NodeClaim":{"name":"premium-zxfct"},"namespace":"","name":"premium-zxfct","reconcileID":"146aa3ed-bc69-4aad-9999-884b68cc64d3","provider-id":"aws:///ap-southeast-2b/i-0bcc91825f6a14671","Node":{"name":"ip-10-124-231-30.ap-southeast-2.compute.internal"},"allocatable":{"cpu":"7910m","ephemeral-storage":"482038337146","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31114592Ki","pods":"58"}}
{"level":"INFO","time":"2024-07-23T06:29:12.249Z","logger":"controller","message":"command succeeded","commit":"490ef94","controller":"disruption.queue","command-id":"e6e17196-0807-473d-b621-2ce91652dcb5"}
{"level":"INFO","time":"2024-07-23T06:29:12.294Z","logger":"controller","message":"tainted node","commit":"490ef94","controller":"node.termination","controllerGroup":"","controllerKind":"Node","Node":{"name":"ip-10-124-231-44.ap-southeast-2.compute.internal"},"namespace":"","name":"ip-10-124-231-44.ap-southeast-2.compute.internal","reconcileID":"136af19e-3d7b-48cc-9134-f37ad3ea3922"}
{"level":"INFO","time":"2024-07-23T06:29:29.706Z","logger":"controller","message":"deleted node","commit":"490ef94","controller":"node.termination","controllerGroup":"","controllerKind":"Node","Node":{"name":"ip-10-124-230-4.ap-southeast-2.compute.internal"},"namespace":"","name":"ip-10-124-230-4.ap-southeast-2.compute.internal","reconcileID":"e839096d-4719-4d53-ab3e-8ef2304570f5"}
{"level":"INFO","time":"2024-07-23T06:29:30.058Z","logger":"controller","message":"deleted nodeclaim","commit":"490ef94","controller":"nodeclaim.termination","controllerGroup":"karpenter.sh","controllerKind":"NodeClaim","NodeClaim":{"name":"default-sbwr2"},"namespace":"","name":"default-sbwr2","reconcileID":"c85c2b49-b2d4-4d85-8554-9c0e71205452","Node":{"name":"ip-10-124-230-4.ap-southeast-2.compute.internal"},"provider-id":"aws:///ap-southeast-2a/i-088c1a0478b2f694d"}
{"level":"INFO","time":"2024-07-23T06:29:39.294Z","logger":"controller","message":"disrupting via drift delete, terminating 1 nodes (2 pods) ip-10-124-230-9.ap-southeast-2.compute.internal/c7i-flex.2xlarge/spot","commit":"490ef94","controller":"disruption","command-id":"8c311bc8-c45d-411f-a395-9b19881900ab"}
{"level":"INFO","time":"2024-07-23T06:29:40.299Z","logger":"controller","message":"command succeeded","commit":"490ef94","controller":"disruption.queue","command-id":"8c311bc8-c45d-411f-a395-9b19881900ab"}
{"level":"INFO","time":"2024-07-23T06:29:40.346Z","logger":"controller","message":"tainted node","commit":"490ef94","controller":"node.termination","controllerGroup":"","controllerKind":"Node","Node":{"name":"ip-10-124-230-9.ap-southeast-2.compute.internal"},"namespace":"","name":"ip-10-124-230-9.ap-southeast-2.compute.internal","reconcileID":"76ae3633-b828-4296-8f38-032a22869d51"}
{"level":"INFO","time":"2024-07-23T06:29:44.803Z","logger":"controller","message":"deleted node","commit":"490ef94","controller":"node.termination","controllerGroup":"","controllerKind":"Node","Node":{"name":"ip-10-124-231-44.ap-southeast-2.compute.internal"},"namespace":"","name":"ip-10-124-231-44.ap-southeast-2.compute.internal","reconcileID":"93ae89f9-7043-4edd-9400-b57701261d77"}
{"level":"INFO","time":"2024-07-23T06:29:45.152Z","logger":"controller","message":"deleted nodeclaim","commit":"490ef94","controller":"nodeclaim.termination","controllerGroup":"karpenter.sh","controllerKind":"NodeClaim","NodeClaim":{"name":"premium-g7s5d"},"namespace":"","name":"premium-g7s5d","reconcileID":"2efc6258-a6c9-4869-9fa0-709c0b609ad8","Node":{"name":"ip-10-124-231-44.ap-southeast-2.compute.internal"},"provider-id":"aws:///ap-southeast-2b/i-0b4cf655aabe7d902"}
{"level":"INFO","time":"2024-07-23T06:30:12.957Z","logger":"controller","message":"deleted node","commit":"490ef94","controller":"node.termination","controllerGroup":"","controllerKind":"Node","Node":{"name":"ip-10-124-230-9.ap-southeast-2.compute.internal"},"namespace":"","name":"ip-10-124-230-9.ap-southeast-2.compute.internal","reconcileID":"82215786-a94b-42f6-9b49-4f37dc2e2f37"}
{"level":"INFO","time":"2024-07-23T06:30:13.354Z","logger":"controller","message":"deleted nodeclaim","commit":"490ef94","controller":"nodeclaim.termination","controllerGroup":"karpenter.sh","controllerKind":"NodeClaim","NodeClaim":{"name":"default-6kxff"},"namespace":"","name":"default-6kxff","reconcileID":"3b3bc37c-b97a-44c1-9d54-63939fa493cd","Node":{"name":"ip-10-124-230-9.ap-southeast-2.compute.internal"},"provider-id":"aws:///ap-southeast-2a/i-06bd67b3cc9fac7a7"}

Expected Behavior:
I would expect the drift feature not to terminate nodes when the NodePool/NodeClass specification hasn't changed
Reproduction Steps (Please include YAML):
NodeClass:
apiVersion: karpenter.k8s.aws/v1beta1
kind: EC2NodeClass
metadata:
  name: ${name}
spec:
  amiFamily: AL2023
  userData: |
    #!/bin/bash
    echo "$(jq '.registryPullQPS=100' /etc/kubernetes/kubelet/kubelet-config.json)" > /etc/kubernetes/kubelet/kubelet-config.json
    echo "$(jq '.registryBurst=50' /etc/kubernetes/kubelet/kubelet-config.json)" > /etc/kubernetes/kubelet/kubelet-config.json
  role: ${role}
  metadataOptions:
    httpEndpoint: enabled
    httpProtocolIPv6: disabled
    httpPutResponseHopLimit: 1
    httpTokens: required
  subnetSelectorTerms:
  - tags:
      Name: "*private*"
  securityGroupSelectorTerms:
  - id: ${sg_selector_terms}
  blockDeviceMappings:
  - deviceName: /dev/xvda
    ebs:
      volumeSize: 500Gi
      volumeType: gp3
      encrypted: true
  tags:
    Name : "${name_tag}"

The NodeClass has placeholder variables which gets replaced during the helm chart run.
NodePool:
apiVersion: karpenter.sh/v1beta1
kind: NodePool
metadata:
  name: default
spec:
  disruption:
    consolidateAfter: 5m0s
    consolidationPolicy: WhenEmpty
    expireAfter: 168h0m0s
  limits:
    cpu: 1k
    memory: 1000Gi
  template:
    metadata:
      labels:
        node.kubernetes.io/role: default-gitlab-executor
    spec:
      nodeClassRef:
        name: default
      requirements:
      - key: karpenter.sh/capacity-type
        operator: In
        values: ["spot"]
      - key: "karpenter.k8s.aws/instance-generation"
        operator: Gt
        values: ["2"]
      - key: "kubernetes.io/arch"
        operator: NotIn
        values: ["arm64"]
      - key: "karpenter.k8s.aws/instance-category"
        operator: NotIn
        values: ["t", "g", "p"]
      - key: "karpenter.k8s.aws/instance-cpu"
        operator: Gt
        values: ["7"]
      - key: karpenter.k8s.aws/instance-size
        operator: NotIn
        values:
          - nano
          - micro
          - small
          - 32xlarge
          - 48xlarge
          - metal
      - key: kubernetes.io/os
        operator: In
        values: ["linux"]
      taints:
      - effect: NoSchedule
        key: node-role.kubernetes.io/default-gitlab-executor

Versions: v0.37

Chart Version: v0.37
Kubernetes Version (kubectl version): 1.29

Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
If you are interested in working on this issue or have submitted a pull request, please leave a comment

Sorry for the delay on this, are you using debug level logging to get more information on what's happening? Can you share those logs? Also if you check your nodeclaims, you may see a status condition with Key Drifted that can tell you how it was marked as drifted

Hello,
I am also seeing this, overnight all nodes were replaced without any recent changes to the nodepool or class. We have several clusters in many regions and this happened in all of them during their respective disruption windows (all of the clusters with the same exact configuration). Could it be a new AMI release? In our case we have specified amiFamily: AL2 and I noticed that there is a new AMI in that family that was released a couple of days ago. If that can be the case, is it possible to avoid drift due to AMI change? I'd love to be able to "auto-update" AMIs but only when a node is replaced by some other reason.
Thanks!

@njtran Thanks for your input; I managed to figure out the issue. It turns out the drift was caused by the Security Group. Additional security groups were mapped to the EC2 instance due to a internal setup that we have, This has led to a drift from a NodeClass standpoint.
Log snippet for reference:
{"level":"DEBUG","time":"2024-08-12T02:14:18.069Z","logger":"controller","message":"marking drifted","commit":"490ef94","controller":"nodeclaim.disruption","controllerGroup":"karpenter.sh","controllerKind":"NodeClaim","NodeClaim":{"name":"default-j9wq9"},"namespace":"","name":"default-j9wq9","reconcileID":"82a5edea-8630-455d-8a0e-d65fad21c639","reason":"SecurityGroupDrift"}
{"level":"DEBUG","time":"2024-08-12T02:14:18.437Z","logger":"controller","message":"marking drifted","commit":"490ef94","controller":"nodeclaim.disruption","controllerGroup":"karpenter.sh","controllerKind":"NodeClaim","NodeClaim":{"name":"premium-kkdxm"},"namespace":"","name":"premium-kkdxm","reconcileID":"ab59d8c8-e6d4-48d2-bb6b-124daec1dd85","reason":"SecurityGroupDrift"}
{"level":"DEBUG","time":"2024-08-12T02:15:22.324Z","logger":"controller","message":"marking drifted","commit":"490ef94","controller":"nodeclaim.disruption","controllerGroup":"karpenter.sh","controllerKind":"NodeClaim","NodeClaim":{"name":"premium-gkrtn"},"namespace":"","name":"premium-gkrtn","reconcileID":"fd57e84f-0bd3-48f1-845c-564643a23a1a","reason":"SecurityGroupDrift"}
{"level":"DEBUG","time":"2024-08-12T02:15:22.513Z","logger":"controller","message":"marking drifted","commit":"490ef94","controller":"nodeclaim.disruption","controllerGroup":"karpenter.sh","controllerKind":"NodeClaim","NodeClaim":{"name":"premium-gkrtn"},"namespace":"","name":"premium-gkrtn","reconcileID":"cd71bf2b-414f-4d02-9c89-1876fceecda2","reason":"SecurityGroupDrift"}

i would vote to reopen issue, as it affects others, today we faced same behavior.
but as we don't log in with debug level, it is hard to understand what was changed.
but as @dbarrosop we faced full outage of cluster, as nodepools has some shared settings... but it definitely wasn't touched at night.
and if someone from aws will look into that, here is a support case opened:<PHONE_NUMBER>00955

so, this shiny feature was turned on by default in 0.33.
for everyone else who will get there:
!!!! FEATURE_GATES.DRIFT=true was dropped in 1.0.0 and promoted to Stable, and cannot be disabled.

Yes, but it can be configured not to disrupt depending on your requirements.
Ref: https://aws.amazon.com/blogs/containers/announcing-karpenter-1-0/
Karpenter v1 adds support for disruption budgets by reason. The supported reasons are Underutilized, Empty, and Drifted. This enables users to have finer-grained control of the disruption budgets that apply to specific disruption reasons. For example, the following disruption budgets define how a user can implement a control where:
0% of nodes can be disrupted Monday to Friday from 9:00 UTC for eight hours if drifted or underutilized
100% of nodes can be disrupted if empty at all times.
At any other time of day it allows 10% of nodes to be disrupted, when drifted or underutilized and a stricter budget is not active.
Users might use this budget to make sure that empty nodes can be terminated during periods of peak application traffic to optimize compute. If a reason is not set, then the budget applies to all reasons.
...
disruption:
  budgets:
  - nodes: “0”
    schedule: "0 9 * * mon-fri"
    duration: 8h
    reasons:
    - Drifted
    - Underutilized
  - nodes: "100%"
    reasons:
    - Empty
  - nodes: "10%"
    reasons:
    - Drifted
    - Underutilized
...


vector substitution not working?

TODO: confirm that the bug below is caused by vector substitution
https://github.com/hoburg/d8/issues/67#issuecomment-301487905

Not reproducible, and probably covered by the many other vector-sub issues opened around this time


VVCEasy release (v.0.9.2)

[x] i686 support on Android MPV Player (OpenVVC plugin)
[x] Update VVC encoder of three operating systems
Martin Eesmaa

Sorry for Mac OS build, that I ran on virtual machine with external hard disk. It might be best to buy external solid state drive for Mac OS only.

This should be finished of version 0.9.2


How to Build a Digit Predication Model Using a Machine Learning Approach

PREDICTING NUMBER DIGITS USING MACHINE LEARNING MODEL
Digit recognizer app is an application built to predict or get a handwritten number in png image format. The model is a way of simulating how computer vision works and the basics architect of how an image or object recognition might look like.
The API endpoint gets to read the image that was uploaded and predict the digit.png that was uploaded.
Key takeaways:
(1.) Understanding of the basic concept of Machine learning(ML)
(2.) Step-by-step tutorial guide on how to build a digit prediction  system using machine learning(ML) model
(3.) Introduction to other machine learning(ML) models like recommendation systems used for Youtube, Facebook, and Google algorithms that can be used to build other real-life applications.
References:
I worked on a similar article previously:
https://dev.to/aidelojep/how-to-build-an-educational-recommendation-application-with-python-and-fauna-4ba6
Templates to use as guides
-Introduction
-Table of contents
-Prerequisite
-Goal of tutorial
-Steps to follow
-Conclusion

I have a few questions.

What model are you using to train the model?
What dataset are you using?
Are you building a full stack app? If yes, what are you using for Frontend and backend.
I would stick to the project rather than cover introduction to ml, and the introduction of various other models.

The approach we take per article is to go in depth versus cover a lot of points.
@hectorkambow

Dear Section-Engineering-Education/Engineering-Education,
Thank you for your feedback. In response to your email, I have responded to
all your concerns below:
1.) This proposed project will be trained on the Tensorflow model.
2.)  The dataset is an inbuilt digit dataset gotten from Karas.
3.)  Yes, this project will run on a backend (using FastApi ) and CSS for
the FrontEnd.
I understand exactly what you mean by going in-depth rather than
touching on the surface of several other side topics. The project will be
implemented with a key focus on the subject area.
I await your approval/confirmation to proceed.
Best regards.
~Peter Lucky Aideloje.
On Fri, Jul 2, 2021 at 4:37 PM Lalithnarayan C @.***>
wrote:

I have a few questions.

What model are you using to train the model?
What dataset are you using?
Are you building a full stack app? If yes, what are you using for
Frontend and backend.
I would stick to the project rather than cover introduction to ml,
and the introduction of various other models.

The approach we take per article is to go in depth versus cover a lot of
points.
@hectorkambow https://github.com/hectorkambow
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/section-engineering-education/engineering-education/issues/2715#issuecomment-873087288,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ANXGABPOYGCN4CJYI5MFBQ3TVXMKPANCNFSM47IRZVEQ
.

Dear Lalith,
Thank you for your feedback. In response to your questions, I have responded to all your concerns below:
1.) This proposed project will be trained on the Tensorflow model.
2.)  The dataset is an inbuilt digit dataset gotten from Karas.
3.)  Yes, this project will run on a backend (using FastApi ) and CSS for the FrontEnd.
I understand exactly what you mean by going in-depth rather than touching on the surface of several other side topics. The project will be implemented with a key focus on the subject area.
I await your approval/confirmation to proceed.

Hello @aidelojep. I feel this is a very basic and widely covered topic that wouldn't add value to our readers. I suggest you to come up with a more unique article. Do let me know if you have any doubts.

@lalith1403
Be sure to leave a questions label - and follow up if needed 👍

@louisefindlay23 Thank you for your feedback, I intend to write a bit further on these topics option:
1.) Using Digit prediction model to facial recognition.
2.) Tunning a recommendation Engine to forecast future trends/occurrences.
3.) Building a Bulk SMS API with Django and Twilio API.
I am well versed in the above topics. Kindly let me know what you think.
Cheers.

@lalith1403 What is the update on this/

I am sorry I missed this issue. Well, can you elaborate on what project out of the 3 points mentioned will you be working on? This seems to be a diverse set of projects.
You may look at approved issues to get more clarity on the type of topic proposals we expect.

@lalith1403 thank you for your continued assistance. Please find below a recent detailed topic on recommendation model I want to elaborate on. I await your positive feedbacks.
HOW TO TUNE A RECOMMENDATION ENGINE TO FORECAST FUTURE TRENDS/OCCURRENCES
RECOMMENDER SYSTEM is a system widely used by online retailers and various business platforms to make suggestions to a pool of customer base in making a more likely selection from a list of items based on previous history or digital footprints.
This model is very helpful for developers who might choose to include this system in the overall infrastructural design for recent websites and e-commerce platforms.
Key takeaways:
(1.) Understanding of the basic concept of RECOMMENDATION ENGINE and how it works.
(2.) Step-by-step tutorial guide on how to build a RECOMMENDATION ENGINE.
(3.) Algorithms used to build the RECOMMENDATION ENGINE like Classification model.
(4.) Fine-tuning the recommendation model.
Templates to use as guides
-Introduction
-Table of contents
-Prerequisite
-Goal of tutorial
-Steps to follow
-Conclusion

Update the contents of the initial issue with the updated contents. Also, update the title of the article.
Thank you,
Lalith

The suggested topic is exciting. Look forward to reading it. Ping me once you update the topic proposal. We can then proceed with this topic.

I'm glad you find it exciting too. I'm charged up to jump on it already too. I have updated the topic proposal.

@aidelojep
Sounds like a helpful topic - let's please be sure it adds value beyond what is in the official docs and what is covered in other blog sites.
Please be sure to double-check that it does not overlap with any existing EngEd articles or incoming topic suggestions (if you haven't already) to avoid any potential article closure, please reference any relevant EngEd articles in yours.
Additionally, I would suggest paying keen attention to the grammar and formatting (there are a few formatting errors in the proposal) of the article to avoid any potential article closure.- Topic Approved :)

@lalith1403 noted with thanks. :)

@aidelojep
Just pinging you on this topic form - as I'm making some room in the topic queue.
No rush if you're still working on this one - if you need more time we can always re-open at a later date.

@aidelojep
Just pinging you on this topic form - as I'm making some room in the topic queue.
No rush if you're still working on this one - if you need more time we can always re-open at a later date

Hello Section-Engineering-Education/Engineering-Education,
I forked the repository and I am currently working on the project. Why was
it closed again?
I am set to complete this project before the weekend.
Best
Peter
On Tue, Sep 14, 2021 at 5:07 PM hectorkambow @.***>
wrote:

Closed #2715
https://github.com/section-engineering-education/engineering-education/issues/2715
.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/section-engineering-education/engineering-education/issues/2715#event-5300702532,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ANXGABLT42C2AMAC5A53CQTUB5XLHANCNFSM47IRZVEQ
.

You may re-open the issue before submitting the PR.

ok ,
Many thanks
On Tue, Sep 14, 2021 at 6:52 PM Lalithnarayan C @.***>
wrote:

You may re-open the issue before submitting the PR.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/section-engineering-education/engineering-education/issues/2715#issuecomment-919381931,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ANXGABNKX6FS7JMODTDU6DLUB6DWLANCNFSM47IRZVEQ
.

Just pinging you on this topic form - as I'm making some room in the topic queue.
No rush if you're still working on this one - if you need more time we can always re-open at a later date


How do you handle swift reserved words in the JSON?

For Example, what if I have this:
"thumbnails": {
     "default": {
      "url": "a"
     },
     "medium": {
      "url": "b"
     },
     "high": {
      "url": "c"
     }
    },

I can't define a struct with a property of default.

The key in the JSON is detatched from what you name your property on your model. You can name your property defaultURL and then use "default" when decoding:
statuc func decode(j: JSONValue) -> Thumbnail? {
  return Thumbnail.create
    <^> j <| "default"
    <*> ...

Closing for now but continue the convo if you're still having trouble.


VS code doesn't gray out unused variables

VS code doesn't gray out unused variables in javascript for exaple of i write :
let name = "Y"
the name it comes white not grey and if i put it in console.log(name) it stays the same thing white

This is by design. If the variable is the global scope in a non-module file, it can be used by other files. We don't track unused variables across files like this so instead always show this type of variable as being used


Feature Request / Exploration: Partial Ramdisk

Firstly, great work on this!
My setup is all Linux, but this likely applies generally too.
Of my plotters, I have one machine with only 64GB of memory.
For  machines like this, which have less than the required memory for tmp2 to run on a ramdisk, is there a recommended approach to benefit from the ~60GB of free memory with this plotter?
For my own use I was thinking about setting up something like dm-cache, bcache, or flashcash using the ramdisk as the cache device over nvme storage, but not 100% this makes sense.
A feature request along this path would be
tmpdir3 == tmpdir2-overflow
or some type of "tmp2 is full, so do this" input.
My apologies if this request overlaps a feature which I simply missed!

+1  I also have 64GB RAM and wonder if it can be utilized...

Well, if there is a tool that allows to create a ramdisk that can be converted into a dynamic disk, then you can create a 112 GB expanded disk that starts in ram and ends on your nvme disk, which would increase the thee plot creation speed quite a bit. Tell me which ram disk creation toolkit lets you create a ramdisk that can be converted to a dynamic disk if you find one.

Maybe PrimoCache can help to create small nvme drive with large ram cache

Maybe PrimoCache can help to create small nvme drive with large ram cache

PrimoCache is not great if you have sustained write. It is only an improvement with write and then pause as it wil pause any write while it will do flush of the cache.

Do not use PrimoCache or a similar tool for sustained writes like while chia plotting. Talking from experience here. PrimoCache and likewise make sense if you have write pauses. Not while plotting.

it's possible to do 40 GB ramdisk for phase 3 only yes, I will think about it


Enhance CS Form

[x] Update frontend flow
[x] Fallback to mailto:...

PR-Codex overview
This PR updates the useCreateTicket function to handle support ticket creation with improved error handling and email fallback.
Detailed summary

Updated useCreateTicket function for support ticket creation
Improved error handling with fallback to mailto: for direct email communication
Added success toast notification for sent support tickets

✨ Ask PR-Codex anything about this PR by commenting with /codex {your question}

moved: https://github.com/thirdweb-dev/js/pull/3395


Elasticache  NodeGroupConfiguration for ReplicaAvailabilityZone

Should the line for ReplicaAvailabilityZones not be ([basestring], False) since its a string list?
class NodeGroupConfiguration(AWSProperty):
props = {
'NodeGroupId': (validate_node_group_id, False),
'PrimaryAvailabilityZone': (basestring, False),
'ReplicaAvailabilityZones': (basestring, False),
'ReplicaCount': (integer, False),
'Slots': (basestring, False),
}
From the AWS Docs
ReplicaAvailabilityZones
A list of Availability Zones to be used for the read replicas. The number of Availability Zones in this list must match the value of ReplicaCount or ReplicasPerNodeGroup if not specified.
Required: No
Type: List of String
Update requires: Replacement
Thanks

This was address by Mark Peek and merged in to master, closing issue. Thanks


ruler: correct logging of alert name & template data

The error messages we see in the embedded ruler in Mimir right now are contain alert="unsupported value type" and data="unsupported value type"
ts=2024-10-04T09:59:56.900015691Z caller=alerting.go:384 level=warn component=ruler insight=true user=XXX alert="unsupported value type" msg="Expanding alert template failed" err="error executing template __alert_service_mesh_down_alert: template: __alert_service_mesh_down_alert:1:139: executing \"__alert_service_mesh_down_alert\" at <.registry_name>: can't evaluate field registry_name in type struct { Labels map[string]string; ExternalLabels map[string]string; ExternalURL string; Value interface {} }" data="unsupported value type"

now the log lines looks like this
time=2024-12-24T11:11:57.024+02:00 level=WARN msg="Expanding alert template failed" err="error parsing template __alert_HTTPRequestRateLow: template: __alert_HTTPRequestRateLow:1: bad character U+0022 '\"'" data="<Labels: {__name__=\"http_requests\", group=\"canary\", instance=\"1\", job=\"app-server\", severity=\"overwrite-me\"}, ExternalLabels: {__name__=\"http_requests\", group=\"canary\", instance=\"1\", job=\"app-server\", severity=\"overwrite-me\"}, ExternalURL: , Value: 80>"

sorry for taking so long. I made the changes you suggested @bboreham @krajorama . Please take another look when you get a minute.


[INTERNAL] manifestCreator: descriptorVersion option should be a string

Coverage remained the same at 94.763% when pulling be0586e9845e5b21009c58e392554d6ca30cd51d on adopt-manifestCreator into 391619ed730ac21a1c2583828bca2b04c6d7f5e7 on main.


Wellmen 2020

Reference
doi or URL: https://royalsocietypublishing.org/doi/10.1098/rspb.2020.2343
Otter calculus?

Raw sequence data is available through the NCBI SRA under BioProject accession PRJNA550086
I've not checked if the raw data is shotgun, from methods text it might just be mito capture.

No shotgun, only mitogenome capture


update the tests to reflect the GitLab URL change

so they do not fail with .env with up-to-date GitLab URLs

I updated the product definitions and PS constants cassettes. The product definitions data also changed in the meantime so I had to slightly update the related tests too. With this you can have up-to-date CEE GitLab URLs in your .env file and the tests will not fail.

LGTM. Do we know why CI tests are failing?
Edit: It seems we have to update vars also in CI.

@jobselko correct.

All tests pass for me. Thanks!

I updated the URLs in the project secrets here in GitHub and the originally failing tests are not failing any more but some new and seemingly unrelated test fails now :smile: fun ahead.


Update latest chrono

Which issue does this PR close?

Closes #.
Rationale for this change

New chrono, new deprecations.
This just does the bare minimum to get the CI green, follow on work is tracked in #4456 and #5480
What changes are included in this PR?

Are there any user-facing changes?

Merging this as the changes are mechanical and this is blocking the CI pipelines


upgrade syntax and configs to  allow terraform 0.12 usage

you removed outputs.tf and modules/subscription/outputs.tf but I think it should be available to have it correct based on the guidelines:

main.tf, variables.tf, outputs.tf. These are the recommended filenames for a minimal module, even if they’re empty.

see more: https://www.terraform.io/docs/modules/index.html


ci: add new build universe-domain

I am renaming the build universe-domain-demo to universe-domain.
This is the first step - create a new build named universe-domain.

This change is

/gcbrun


[GSSoC'23] : Memorization cards

PR Description 📜
Memorization Cards is a challenging and engaging card game designed to test and improve players' memory skills. The game is suitable for players of all ages and can be played individually or in small groups.

Fixes #2743

Mark the task you have completed ✅

[x] I follow CONTRIBUTING GUIDELINE & CODE OF CONDUCT of this project.
[x] I have performed a self-review of my own code or work.
[x] I have commented my code, particularly in hard-to-understand areas.
[x] My changes generates no new warnings.
[x] I have followed proper naming convention showed in CONTRIBUTING GUIDELINE
[x] I have added screenshot for website preview in assets/images
[x] I have added entries for my game in main README.md
[x] I have added README.md in my folder
[ ] I have added working video of the game in README.md (optional)
[x] I have specified the respective issue number for which I have requested the new game.

Add your screenshots(Optional) 📸

Thank you soo much for contributing to our repository 💗

You can directly add JS & CSS files without putting inside the folder, When you create react app then you need to put them inside a folder. For now Delete that src folder we don't need .DS_Store file & Resolve Conflicts too

Sure, I have removed the src folder and resolved conflicts. Could you please take a look, @gurjeetsinghvirdee?

Thank you  @Vedansh-777 , for your valuable time and contribution in our GameZone 💗.
It’s our GameZone, so Let’s build this GameZone altogether !!🤝
Hoping to see you soon with another PR again 😇
Wishing you all the best for your journey into Open Source🚀


Can you insert records by external ID using this test data factory

Quick question - Can you insert records by external ID using this test data factory?

Yes, see: https://github.com/benahm/TestDataFactory/blob/master/docs/EXAMPLES.md, you can create records whilst setting Boolean doInsert to false, this give you a list of records that you can upsert using the external ID like you would normally.


MC multisig addresses in ZenDAO native smart contract

Adding support for MC multisig addresses in ZenDAO native smart contract.

new ABI interface for adding an ownership link between SC address and MC multisig address
New HTTP API added
Nwe UT and py tests

please add also documentation related commits:

update changelog https://github.com/HorizenOfficial/Sidechains-SDK/blob/dev/CHANGELOG.md with short description of the changes
update release notes https://github.com/HorizenOfficial/Sidechains-SDK/blob/dev/doc/release/0.10.0.md with new method description and how to use it
update yaml  with sendMultisigKeysOwnership http endpoint
(new separate pr) update EON project with docs/api  sendMultisigKeysOwnership

please add also documentation related commits:
* update changelog https://github.com/HorizenOfficial/Sidechains-SDK/blob/dev/CHANGELOG.md with short description of the changes

* update release notes https://github.com/HorizenOfficial/Sidechains-SDK/blob/dev/doc/release/0.10.0.md with new method description and how to use it

* update [yaml ](https://github.com/HorizenOfficial/Sidechains-SDK/blob/dev/sdk/src/main/resources/account/api/accountApi.yaml) with sendMultisigKeysOwnership http endpoint

* (new separate pr) update EON project with [docs/api](https://github.com/HorizenOfficial/eon/blob/main/doc/api/index.md)  sendMultisigKeysOwnership

Updated release notes and changelog. As agreed updating doc and yaml file will be applied in a separate PR


Add support for graphql-cli

https://github.com/graphcool/graphql-cli  :tada:

Took a stab at it here: https://github.com/rricard/graphql-cli-codegen
Waiting for #203 to move it inside this repo.

Closing for now because we now have the Apollo CLI and Apollo Config which handles many of the same use cases.


fixed osx_buildver option

it would always print the OS X build version before because the option wasn't parsed before adding the build. Now it's removed after the fact if it needs to be.

:+1:


Add a filesystem-based LRU cache

Still need to verify env DISABLE_CACHE works as expected. Also needs to be implemented in the default Docker config


config/cable.yml isn't configurable

@bdunne are you sure about this? We were talking about moving to redis, isn't his conflicting with that a bit?

@skateman At the moment there is only postgresql.  If we switch to redis, won't that be the only supported option?

@bdunne actually if you have a redis installed on your machine and you change the file (or just delete it) it will work. I was thinking about keeping the support for both. As I see in the codebase, sessions can be also backed by PG, so if I replace memcached with redis we can always use the same backend for both sessions and actioncable. Unfortunately memcached doesn't support pubsub :disappointed:


Add 2FA using TOTP

This is part of the adding 2FA using TOTP to traccar

Closing as outdated. It needs to be added to the modern app now.


Question about pre extracted frame features for blip2

Will the code load the vision embedings extracted by get_vision_model_embs.py ?
If so, how to set the dir for vision embs?

Unfortunately, we don't support loading vision embeddings out of the box. We only use them for visualization purposes.


API key. Windows 'export' is not recognized as an internal or external command, operable program or batch file.

Hi there I'm unable to activate the API key on windows CMD.
I've tried
export CENSUS_API_KEY=......

Also to no avail below command. As is states API key not present.
censusdatadownloader --year 2018 --data-dir data/external/ race counties

Where should I add the API key in the query above?

I struggled with this for a few hours myself. If you are using the cmd prompt and a package like Anaconda3, try:
set CENSUS_API_KEY=
this will permanently set the variable CENSUS_API_KEY in your environment. I use Anaconda3 and this worked perfectly


Performance on cpu+gpu host for run_squad: only 1 CPU used for CPU part; only 1 GPU for GPU part

Following up from #500, I've noticed that I've had to wait quite some time for a predict-only use of run_squad for squad 2.
Specifics
Running bert_squad for 2M+ questions against multi-paragraph document. Running on cloud host with 2 v100 gpus, 16 cpus. For parts of processing  performed pre- and post- core run_squad processing (where processing occurs only on cpus) only one cpu is used. For core processing on gpus, both gpus configured and assigned to the task, but only one showing evidence of processing.
Background
I tried using progressively bigger/faster hosts, but noticed less improvement in overall processing duration than expected. What I'm using now is a host that's configured with 2 x V100 GPUs,  16 CPUs, and 120 GB RAM.
Granted, the task I'm trying to perform is not small - in some cases I'm asking a total of 2.5 million question/paragraph pairs (that is, a smaller set of questions, each asked against many paragraphs).
Observations
One key observation is that most of the processing appears to be single threaded. For much of the CPU-only code, only one core is used. I believe that this is happening during the creation of the eval.tf_record file. Interestingly, the work changes from core to core, leading me to wonder whether some of that could be parallelized.
I've also noticed that, for the processing that's being done on gpu, the work appears to be performed only on a single gpu, in spite of the fact that the host I'm running on has two gpus, and the log trace indicates that both are being recognized by tensorflow.
I've noticed that the work being done to create the eval.tf_record file, the GPUs are not in use. That's the part that appears to hop around from cpu to cpu, apparently changing for each of the 19 example sets. Also, the code for determining and writing nbest to disk runs on a single cpu.
As for the GPU, the log traces show that both GPUs are configured for use in tensorflow, and also nvidia-smi shows both gpu 0 and gpu 1 are assigned to the same python process  PID. gpu 0 shows most of its memory in use, gpu 1 shows very little. And the relative processor temperatures reflect one being active and the other idle. This appears to be happening during the "predict" work :
INFO:tensorflow:Processing example: 283000
INFO:tensorflow:Processing example: 284000
INFO:tensorflow:Processing example: 285000
INFO:tensorflow:Processing example: 286000
INFO:tensorflow:Processing example: 287000
INFO:tensorflow:Processing example: 288000
INFO:tensorflow:Processing example: 289000

Am I interpreting this correctly? Does it indicate a problem or is it simply made necessary due to the nature of the processing?

I'm going to close my own issue and recommend consideration of BERT Multi-GPU implementation using TensorFlow and Horovod, which does a good job of spreading BERT's GPU tasks across multiple GPUs. There still is a problem with performance of cpu-based tasks.

Update: Horovod appears to add no benefit for prediction.


Can I add an ArgoCD application via chart and not via git repo?

I'm looking through these parameters:
https://github.com/aws-ia/terraform-aws-eks-blueprints/blob/main/modules/kubernetes-addons/argocd/main.tf#L28
There does not seem to be an option to pull directly from a Helm repo. It's only git repo with Helm chart.
I need something like chart = "elasticsearch" instead of path and it does not seem possible with the current templates. The below example will not work in ArgoCD with the error rpc error: code = Unknown desc = repository not found:
      elastic-stack = {
        path               = "elasticsearch"
        repo_url            = "https://helm.elastic.co"
        values              = {}
        type                = "helm"
        target_revision = "7.17.3"
      }

Here is a part of the default example of an ArgoCD application where you use path for git repos and chart for Helm repos:
  source:
    repoURL: https://github.com/argoproj/argocd-example-apps.git  # Can point to either a Helm chart repo or a git repo.
    targetRevision: HEAD  # For Helm, this refers to the chart version.
    path: guestbook  # This has no meaning for Helm charts pulled directly from a Helm repo instead of git.

    # helm specific config
    chart: chart-name  # Set this when pulling directly from a Helm repo. DO NOT set for git-hosted Helm charts.

closing this issue for now - please see https://github.com/aws-ia/terraform-aws-eks-blueprints-addons/issues/114 where we are collecting feedback on how to improve the integration between Terraform and GitOps providers


application number enriching by cmp

application number enrich by cmp after status is completed

ticket- https://github.com/pucardotorg/dristi/issues/1928


Add geostat method

Add in the geostats model

Does not include variogram analysis, only the kriging component
Currently only uses direct simulation, so will be slow for a large number of interpolated points
This replaces #4 as that one is cluttered with iterative commits

@kmaterna sounds good! I'm still finding a few random bugs so I'll push those after I smash a few. :)

@jlmaurer I pushed my first couple bug fixes for incorporating this PR smoothly. There's still something inconsistent with gpsgridder and the new gradient function; I suspect it's swapping the order of return arguments somehow. I'll work on that since I can test it easily, no need for you to.

Interesting discovery with "np.gradient(udata, xinc, yinc)" : it returns du/dy followed by du/dx.  Something about the structure of my udata or numpy operating in row/col space?   Now I'm not sure which inc should go first.

So I just checked my syntax and it should be correct. My guess is that gpsgridder probably has x and rows and y and columns, or some such thing, which would cause the  problem.

okay I'll check back in gpsgridder and see if I can use the gradient function in the normal way.  I'd love to put the specific adjustments into their respective methods, keeping the toolbox as general as possible. likely a 4-line change coming soon.


more details in variable_hover

Just having "go to definition" thanks to fortls is great!
However, if variable_hover was improved, that would be even better!
In this example:
subroutine test()
    implicit none

    real(8), dimension(3, 3) :: A
    real(8), dimension(3, 3) :: B ! this is the matrix i'm going to transpose

    A = transpose(B)

end subroutine

when I hover over B, could I get:

the other keywords in the declaration (here: dimension, but could also be intent, parameter, save, ...)
the comment on that line

like this:
real(8), dimension(3, 3) ! this is the matrix i'm going to transpose?

The hover should actually show all the keywords already. However, the dimension keyword was not fully supported for explicit sizing, which was tripping up this particular case. I have a fix for this that I will merge in shortly.
I could also add trailing comments to the variable hover information without too much effort. I will work on that as well.

Terrific.
I have also run into a piece of code that makes VS with my extension crash completely, but I haven't found out whether it's a problem on the server side or Microsoft's Client implementation yet.
It'll be a while (probably till the end of the week) until I have time to debug that, but I will keep you posted in case it's an error on the server side.


Does installing using provisioning package from WCD work if you already have an older version of the app installed on the device?

Hi, I was just wondering if installing using provisioning package from WCD will still work even if there is already another version of the app installed on the device. I couldn't find any information about this on the docs and it doesn't seem to be working for my device.

Yes, this is supported. You need to ensure that both the provisioning pack version and APPX version numbers are incremented.
Here is a pointer to some provisioning information:
https://docs.microsoft.com/en-us/windows-hardware/manufacture/iot/add-a-provisioning-package-to-an-image

Additional documentation: https://docs.microsoft.com/en-us/windows/iot-core/develop-your-app/appinstaller

Thanks for the answer, @anphel31 - closing as resolved.


Add javadocs to Arduino API.

Follows the style layed out here: http://www.stack.nl/~dimitri/doxygen/manual/docblocks.html
There are several options. I chose the javadoc style but am not particularly attached to it.

First step towards #30

Yes, I think the room should be a good candidate for this, this could reduce the number of requests.

I am not sure I understand your last comment, is it on the right PR?

Yes, wrong PR.

LGTM, just nits.


Unused resources remain in output directory

In a scenario where a previously used image is no longer referenced and thus shouldn't be copied to the output directory, the image file will remain in the output directory unless it was deleted prior to building the project.
This is not going to cause any problems, however, the project output is not as "clean" as it could be.
I don't like the idea of simply clearing the output directory; a user can do this manually and it would cause a lot of unnecessary copy/move operations on every build. Maybe a warning could be issued? Maybe this isn't really a problem.

This might be easier to implement a check for now that image resources are all copied to the same directory.

Could look into adding an additional argument --clean (or similarly named) that cleans up leftover resources.


Is there a way to use the histogram_equalization_enabled option?

Before opening a new issue, we wanted to provide you with some useful suggestions (Click "Preview" above for a better view):

Consider checking out SDK examples.
Have you looked in our documentations?
Is you question a frequently asked one?
Try searching our GitHub Issues (open and closed) for a similar issue.

All users are welcomed to report bugs, ask questions, suggest or request enhancements and generally feel free to open new issue, even if they haven't followed any of the suggestions above :)

Required Info

Camera Model
D455

Operating System & Version
Win 10

Platform
PC

Language
python

When I searched, I know that histogram equalization enabled can only be changed on the L515 camera.
Is there any way to add histogram_equalization_enabled option in box_dimensioner_multicam.py code with D455 camera?

Hi @HyeYumKim   As confirmed in https://github.com/IntelRealSense/librealsense/issues/4125 histogram equalization can be toggled on-off on the 400 Series cameras using the Python instruction rs.option.histogram_equalization_enabled.  A Python script example for setting the option via the colorizer is at https://github.com/IntelRealSense/librealsense/issues/7089#issuecomment-672105974

Hi @HyeYumKim  Do you require further assistance with this case, please?  Thanks!

Case closed due to no further comments received.


Scaffold in Current Folder

Is your proposal related to a problem?
I am always frustrated when I want my react project files to be in the root directory of my project, but I need to scaffold them in a sub-folder.
(If this feature exists already, I am frustrated that it is not documented clearly in the README).
Describe the solution you'd like
Add a flag that scaffolds files in current directory instead of creating one.
Describe alternatives you've considered
?
Additional context
I think that describes it pretty well...
Thanks!

Can you provide a clear example of what you're wanting?

@ianschmitz I want the option to scaffold in the current working directory rather than create a new folder containing all the files.


fix: Remove deprecated inline_policy from cluster role

Description

Remove deprecated inline_policy from cluster role

Motivation and Context

Resolves #3162

Breaking Changes

No. This was implemented in response to prior issues https://github.com/terraform-aws-modules/terraform-aws-eks/issues/920 but the functionality does not have the desired effect since the cluster role is not the entity that is creating the cloudwatch log groups

How Has This Been Tested?

[ ] I have updated at least one of the examples/* to demonstrate and validate my change(s)
[ ] I have tested and validated these changes using one or more of the provided examples/* projects

[x] I have executed pre-commit run -a on my pull request

This PR is included in version 20.24.2 :tada:


It is possible to not have any checks for Flaky examples

And Schemathesis will fail with:
    flaky_example = result.checks[-1].example
IndexError: list index out of range

The case is when there are multiple different errors happening in the check itself (not AssertionError) or alternatively in the call (didn't check this case, but it should be the same since the errors are propagated to the upper levels to Hypothesis).


[Issue 78] Exposure only counts within 10 days from testing date

This issue is prioritized and will be part of a 2.x release.
In below table some examples are given:

This issue has been released today in version 3.0 of the Smittestopp app.


Feature Request: minimal source-able shell output

This is probably a strange request but here's the scenario:
Our projects are using the scripts to rule them all pattern. Many of these scripts rely on env vars that are set in .env, which we'd like to source.
We could simply source them. But then we have to ensure the .env file exists... and add a linter comment b/c shellcheck complains about the sourced file not existing...
We could do . <(dotenv export) but that dumps the entire env. Which shouldn't hurt anything but just feels... blech. And that also prepends export to everything, which we don't really want. (We'd love to just have the env vars set for just the shell that does the sourcing.)
So short story: I'd love a flag that would behave the same as dotenv export, but doesn't prepend export and only dumps the variables that are actually defined in .env.
Thoughts?

👍 I've wanted the same thing in the past.

@jasonkarns any interest in implementing that feature? (New maintainer here so sorry if I missed other conversations or PRs about this)

@jonmagic Ideally or practically? ;) yes, interest. but realistically speaking pretty low on my priority last at present.

@jonmagic Ideally or practically? ;) yes, interest. but realistically speaking pretty low on my priority last at present.

Right on, I'm in the same ⛵ right now. I'm going to close this as stale and maybe one of us will have time to revisit in the future!


css color class not working

Challenge http://freecodecamp.com/challenges/waypoint-use-a-css-class-to-style-an-element has an issue. Please describe how to reproduce it, and include links to screenshots if possible.

While you have assigned the red-text class to the element, you do not have any style tags which contain CSS to style that red-text class.

thanks


[WIP] Quantization/Dequantization support for IA backend

Closing this. Created #1301 with INT8 conv.