[EARLY REVIEW] feat: recover transient errors

This PR makes pg2kafka recoverable from transient errors, from database or broker.
Additionally it will retry on error to make sure that unprocessed events are published to the broker.
Finally, when a notification is received, the channel of notifications is emptied to avoid unnecessary DB load when a burst of notifications is received.
Relates to issue: https://github.com/codebgp/pg2kafka/issues/8
TODO: increase test coverage and integration tests to increase safety of the PR

Deprecated in favour of this PR: https://github.com/codebgp/pg2kafka/pull/11


Xnero: Blacklist ^Amazon_Prime_Phone_Number_ .+?(?<=support)

Xnero requests the blacklist of the keyword ^Amazon_Prime_Phone_Number_ .+?(?<=support). See the MS search here and the Stack Exchange search in text, in URLs, and in code.

^Amazon_Prime_Phone_Number_ .+?(?<=support) has been seen in 0 true positives, 0 false positives, and 0 NAAs.

Rejected by Makyen in Charcoal HQ. Reason: 'Going to use something a bit different'


Add a new t:removeSQLComments transformation

Summary
Writing rules for SQLi is difficult enough. Also, there could be plenty of evasions by using /**/ inside partial SQL queries.
Basic example

Raw:

select tags from tags WHERE 1=0 OR'{"name":"asd"}'?|/**/array/**/[/**/'a'/**/,'name'];

With t:removeSQLComments applied:

select tags from tags WHERE 1=0 OR'{"name":"asd"}'?|array['a','name'];

Motivation
By creating a new t:removeSQLComments transformation, that substitutes everything commented out using /**/, regular expressions to catch injections will get way simpler and cover more cases.
Caveat: some databases will interpret commands inside comments. Luckily this can be handled by an specific rule for this case.
Edge cases

we need to review if space needs to be substituted for the actual command to work, or we can remove everything that is commented. Example:
WHERE 1=0 OR a=/**/b -> WHERE 1=0 OR a=b
vs.
WHERE 1=0 OR a=/**/b -> WHERE 1=0 OR a= b (/**/ is substituted for a "space" character   )

I need to test t:replaceComments. Closing.


[WIP] Tighter shadow caster culling

Existing shadow caster culling using the octree only is very approximate. This PR adds the highly encapsulated class VisualServerLightCuller explicitly to deal with the problem, it is very easy and requires minimal change to use with the existing system and will also work with vulkan branch.
The tests done are very cheap and are unlikely to have any measurable detrimental effect even in extreme circumstances. In game levels using realtime lights the culling will typically offer a modest improvement to FPS, typically around 10%, although frame rate can more than double in some circumstances (directional lights like a sun particularly with PSSM can offer a large improvement).
There is functionality for spotlights, omni and directional.
Notes

The culling here is set to occur as a separate additional step after the octree cull. It is possible also to add the extra culling planes to the convex hull used for the octree, but I think this approach will be more efficient (broad phase with the octree, final accurate cull with the light culler).
As well as culling shadow casters, there are 2 extra interesting situations that the light culler can detect, which can potentially lead to further (possibly significant) performance gains:

Where there are zero shadow casters, there may be no need for the shadow render pass. However, there is still a need to zero that area of the shadow atlas. Currently it will still do the shadow render pass I believe.
If the call to prepare_light returns false, the light culler has detected that the light cannot possibly cast shadows or light objects within the camera frustum. In this case, there is the opportunity to eliminate the light from the rendering completely.

You can see how it works in this video (ignore the rooms and portals, that is a separate system):
https://www.youtube.com/watch?v=1WT5AXZlsDc
The blue lines from the light sources to the camera frustum show the extra culling planes.
References:
http://lspiroengine.com/?p=153
http://www.terathon.com/gdc06_lengyel.pdf
Note that LSpiro's article deals purely with directional lights, and both these articles rely on dot product - I am dealing with point lights (omni, spotlight) by using a distance to plane function to determine back facing frustum planes rather than dot product. I think this is a better approach than that suggested in the Lengyel article.
The most difficult cases for point lights are where the point is close to the camera frustum (possibility of concave silhouette which would not cull correctly). When the light source is inside the frustum I use a different approach and simply cull the shadow casters to the camera frustum, as any caster outside cannot by definition cast shadows back inside.

Closing this, because although the culling works, there were unforeseen implications for the shadow map caching, i.e. if you render a subset of the light view and the camera moves without the light being made dirty, then the shadow map will be incorrect. This is probably workaroundable, however it would be considerably more involved, and this is going to be changed anyway for 4.0.


Implement course id conditions

Summary

This pull request finishes implementing AP/IB conditions (more generally, course id conditions).

[x] modified getMatchedRequirementFulfillmentSpecification() to filter courses that don't satisfy the requirement conditions
[x] refactored graph builder to use eligible courses from the spec computation

Test Plan

Before:

After:

AP/IB conditions should work now. You can also test this with AP Statistics / Biological Sciences major.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Emit @overload comments on generated overloads in.d.ts

3 open questions:

Is this the right way to do it? It's similar to the way addPropertyToElementList.
Is it worthwhile to fix emit for multiple overloads in a single comment? That style only works without @template and with explicit @return for each signature, so I believe it's rare. I left it unfixed.
Is it worthwhile to fix indentation? I copied some text manipulation code from getTextOfNodeFromSourceText, but I don't want to put my new code there without evidence that it's useful for more than just my case.

Fixes #53350

why this is needed? it already overloads with TS function signature

It's not needed for types. But the jsdoc includes text that should appear in signature help—and that text is specific to each overload, so each overload needs its own jsdoc.


kolbuszowa

@K-Tecza lib/domains/kolbuszowa: this request has an incorrect file path format, please ensure that you are familiar with     this repository rules located at the bottom of this page and change     your request accordingly. If you don't know how to change request, close it and open a new one.     If you are not able to make the pull request according the instructions, please send us an email to<EMAIL_ADDRESS>Please mention this request URL in the message.

@K-Tecza Regrettably, I have to close the request without merging, because you made a mistake in a request and did not specify a correct filepath. Please ensure that you are familiar with this repository rules located at the bottom of this page and make a new correct request. Thank you for your understanding!


About function name style

Hi @Not-Nik, nice work you've being doing there!
This may be a little nitpicking, however, I wanna know are there any plan to make naming style more akin to zig's standard library?
InitWindow --> initWindow
SetTargetFPS --> setTargetFPS
WindowShouldClose --> windowShouldClose
CloseWindow --> closeWindow

I think it would nice to distinguish between functions and types more easily.

if zig has a way of forcing linkage such that a reference to initWindow links to InitWindow, that would be awesome. Does such a thing exist?

Not really sure. In my other c lib’s zig bindings, I simply use ‘pub const abc = Abc’, the bad part is editor’s auto-completion can’t give prototype of function, you need to jump over to check original declarations.

Sometimes I even create a zig wrapper for c api, it could introduce some overhead, but I get to make api more zig-like. For example, optional arguments can be wrapped into a struct, and change c pointer to zig’s non-nullable pointer etc.

I don't currently plan on implementing this, but if you want, you can update the function generator script to reflect your proposal.


Add Outbox support

Outbox is a feature of NServiceBus which higher l;evel of reliability with regard to processing messages exactly once (in non-dtc environments).
The feature requires persistence and as such would be a great addition to this package.
https://docs.particular.net/nservicebus/outbox/

@tekmaven do you have any plans to implement this? Maybe looking into how it is done here https://github.com/Particular/NServiceBus.RavenDB/tree/develop/src/NServiceBus.RavenDB/Outbox could help

Guys outbox support on MongoDB is not available because they do not support cross document transactions. The reason it is supported in RavenDB is because Raven does support cross document transactions.

With Mongo 4.0 supporting transactions across multiple operations Outbox will now be possible.  I'm afraid this GitHub repository has become a tombstone however...

Hey @mattwhetton,
We're closing this issue as this repository is no longer actively maintained. We have implemented Outbox support on the officially supported MongoDB persistence 🎉

Thank you @timbussmann


Closure Evaluation Misdiagnoses Initializer Type Checking

Describe the bug
When using a generic initializer of a type that is returned in a compactMap closure, the compiler gives misleading errors as part of the closure evaluation.
Steps To Reproduce
I found two separate reproduction cases that give two different errors
First Reproduction
struct FinalContainer {
  init(boolSequence: [Bool], intArray: [Int]) { }
}

let intArray = repeatElement(1, count: 2)

var containers: [FinalContainer] = []
containers = (0...3).compactMap { _ in
  // the guard itself doesn't matter, it's just to have the control statement to return 'nil'
  guard false else {
    return nil
        // ^^^^^^ 'nil' is incompatible with return type 'FinalContainer'
  }

  return FinalContainer(boolSequence: intArray, intArray: intArray)
}

Note: Changing intArray to be intArray = [1] causes the compiler to correctly diagnose the type mismatch on the FinalContainer initializer

Second Reproduction
struct FinalRepresentation {
  init(boolSequence: some Sequence<Bool>, intArray: [Int]) { }
}

let secondType = [1]

var storage: [FinalRepresentation] = []
storage = (0...3).compactMap { _ in
     // ^^^^^^ Type of expression is ambiguous without more context
  return FinalRepresentation(boolSequence: secondType, intArray: secondType)
}

Note: Changing boolSequence to be [Bool] causes the compiler to correctly diagnose the type mismatch on the FinalContainer initializer

Expected behavior
The compiler to correctly diagnose the type mismatch on the initializer: Cannot convert value of type '[Int]' to expected argument type '[Bool]'
Screenshots
N/A
Environment (please fill out the following information)

OS: macOS 12.6
Xcode Version/Tag/Branch: Xcode 14.0.1 (14A400)

Additional context
N/A

Reduced:
struct Foo {
  init(_: Bool) {}
}

func foo(_: () -> Foo?) {}

//let _: () -> Foo? = { // Works
foo {
  if true {
    return nil
  }

  return Foo(0)
}

I'll take a look!

@xedin I've looked at this issue, and there seems to be an issue with the constraint solver. If we take the code @AnthonyLatsis provided and further simplify it like so,
func foo(_: () -> Bool?) {}

// let _: () -> Bool? = { // Correct diagnostic
foo {
  if true {
    return nil
  }
  return 0
}

we can then print out all the solutions that the constraint solver found. In both scenarios, the correct solution is found with value 3. But in the incorrect case, the solver finds another winning solution with value 1 that looks like this: Fixed score: [component: applied fix(s), value: 1] [component: function conversion(s), value: 1] [component: value to optional promotion(s), value: 1]. This infers the type of the function to be Bool and emits wrong diagnostics about nil not being compatible with type Bool. I'm not sure where to look for implementation of the actual solving process that comes to this conclusion, and what I should look at to investigate this issue further.

You can anchor your search on this lines in the debug output:
      (attempting conjunction element syntactic element
        (return_stmt
          (integer_literal_expr type='<null>' value=0 builtin_initializer=**NULL** initializer=**NULL**))

This is where solving for return 0 happens.
First solver binding contextual (result) type to Bool? (this is the line (attempting type variable $T2 := Bool? where $T2 is the result type of the closure) and that results in a contextual failure with "impact" of 3, and afterwards it tries to re-solve return 0 with contextual type of (attempting $T2 := Bool) Bool (because it's allowed to unwrap the optional in certain circumstances).
To fix this issue we need to to make sure that the original fix where contextual type is Bool? has lower impact than the one where result type gets bound to unwrapped Bool.


Use GitHub Actions for NuGet Releases

This PR enables GitHub Actions for this repository. From now on, after a pull request marked with the release label is merged, a new NuGet package will be shipped and a new release with a change log will be published to GitHub Releases. Ideally, we should use the Commit Prefixes and squash-and-merge strategy to enable automatic commit categorization in release notes.
The yml configuration is based on the configurations we use in ReactiveUI.Validation.

Hey @JaggerJo!
As we are moving Live.Avalonia to AvaloniaCommunity, I prepared a GitHub Actions configuration that would allow pushing a new NuGet package every time a PR marked with the [release] label is merged. We are using this setup in ReactiveUI organization e.g. in the ReactiveUI.Validation repository. Package version is incremented automagically using NBGV and version.json.
Your input is required here. Someone with admin permission has to do a couple of things:

[ ] create a new release label, so an arbitrary PR could be marked with that label
[ ] define the NUGET_API_KEY variable in the repository secrets section https://github.com/AvaloniaCommunity/Live.Avalonia/settings/secrets/actions
[ ] mark this PR with the release label and try merging

@worldbeater you should have the required permissions now.
Will look into doing the same for FuncUI 👍🏼

Thanks @JaggerJo!
I could try setting up GitHub Actions the same way for FuncUI and Prism.Avalonia if you're ok with that 🚀
Mering this PR, going to try out the release process for Live.Avalonia now.

A new Live.Avalonia version has been successfully shipped 🎉
The change log: https://github.com/AvaloniaCommunity/Live.Avalonia/releases/tag/1.1.1
The package: https://www.nuget.org/packages/Live.Avalonia/1.1.1

hey @worldbeater  I tried to add this workflow to https://github.com/AngelMunoz/Mondocks but... I seem to be doing something wrong because the workflow is not triggered, would you mind helping me figure it out 😅?

@AngelMunoz I guess that's due to the main branch being named master in the repo you are referencing, and the Github Actions config uses the main name. So I guess you should either change the main branch name from master to main, or edit your Github Actions triggers config https://github.com/AngelMunoz/Mondocks/blob/master/.github/workflows/build.yml#L5 Immediately after you do this and open a new PR, Github Actions logs should become available here https://github.com/AngelMunoz/Mondocks/actions

😰 OH can't believe I didn't check the branch names 😅 I'll try that tomorrow morning asap thanks! Sorry for the bother


[QUERY] Messages picked up with a long delay using spring-cloud-azure-stream-binder-servicebus

Hi,
We have an application that is consuming messages from a service bus queue using spring-cloud-azure-stream-binder-servicebus and our code is similar to the one showed here:
https://docs.microsoft.com/en-us/azure/developer/java/spring-framework/configure-spring-cloud-stream-binder-java-app-with-service-bus
(not using manual checkpointing).
We are using openjdk 11.0.16, spring-boot version 2.5.6 and 4.0.0 for spring-cloud-azure-stream-binder-servicebus.
The application is running in Kubernetes, and there are 2 instances of our application that can pick the messages.
The service bus queue has a messgae lock duration of 5 minutes, a 10 minuted duplicate detection window and 20 for the max delivery count.
The scenario we see is similar to this one:
00.00.00 – a message is sent to the service bus queue
00.05.00 – a message is received with a delivery_count = 1 (read from ServiceBusMessageHeaders.DELIVERY_COUNT) and it is processed.
00.09.00 – a message is received with a delivery_count = 0 and it is processed
It’s odd that the message with the delivery_count = 0 is received 4 minutes after the message with delivery_count = 1.
Our hypothesis is that spring-boot gets the message, but does not have an available thread to process it for a time that is bigger than the lock duration we configured for the queue.
As the lock is lost, the second process gets it and starts processing it and then they may compete to process the same entities.

Do you have any suggestions on how I can work around this situation?
Given the message id, is there something that we can enable and see what happened to the message lock – when we get it, when we lost it?

Why is this not a Bug or a feature Request?
Service bus guarantees the delivery only once, so it works as expected from this point of view. I am not sure why the message with the delivery_count = 0 is logged much later than the message with delivery_count = 1 and why I didn't get a lock exception for the first message sooner.
Setup (please complete the following information if applicable):

OS: Debian GNU/Linux 11
Library/Libraries:
com.azure.spring:spring-cloud-azure-stream-binder-servicebus-core:4.0.0
org.springframework.boot:spring-boot-starter-parent:2.5.6

Information Checklist
Kindly make sure that you have added all the following information above and checkoff the required fields otherwise we will treat the issuer as an incomplete report

[x] Query Added
[x] Setup information Added

Our hypothesis is that spring-boot gets the message, but does not have an available thread to process it for a time that is bigger than the lock duration we configured for the queue.
As the lock is lost, the second process gets it and starts processing it and then they may compete to process the same entities.

Hi @LauraDamianTNA thank you for reaching out to us via this GitHub issue.  Folks from the Azure Spring and the Service Bus SDK team will follow up with you shortly.
/cc @Azure/azsdk-sb-java

Additional settings worth to mention:
spring.cloud.stream.servicebus.bindings.consumer-in-0.consumer.prefetch-count=0
spring.cloud.stream.servicebus.bindings.consumer-in-0.consumer.max-concurrent-calls=9
spring.cloud.stream.servicebus.bindings.consumer-in-0.consumer.max-auto-lock-renew-duration=60M

@fbeltrao thanks for sharing the detailed error messages, and does the error show up when the delivery count of the message increases and then the message with delivery_count_1 is sending to the client?

@yiliuTo a few additional details:

Attempt
Start
End
Outcome

RetryCount=1
3:08:57.275 PM
3:14:04.503 PM
error

RetryCount=0
3:10:49.477 PM
3:14:57.110 PM
error

RetryCount=2
3:14:04.508 PM
3:14:46.967 PM
error

RetryCount=3
3:14:46.972 PM
3:14:46.973 PM
completed (we give up after 3 tries)

Single lock duration error was at 3:14:46.973 PM.
Seems like the first attempt (with retryCount=0) didn't even have the lock when it started processing because transition from retry 1 to 2 and 3 are good.

Hi @LauraDamianTNA , for the library spring-cloud-azure-stream-binder-servicebus, we are using the ServiceBusProcessorClient to receive messages from Service Bus. And your issue looks related with this one, that I suppose it is caused due to the thread pool is exhaused for providing a new thread to consume messages. Thus the processor can receive messages from Service Bus but hangs for acquiring a thread to consume and then the lock duration gets expired.
As for your questions:

Q1: Do you have any suggestions on how I can work around this situation?
A: you could try the workaround mentioned in https://github.com/Azure/azure-sdk-for-java/issues/30483 to adjust your vm option of -Dreactor.schedulers.defaultBoundedElasticSize. And we can continue discussing if you have more finding after giving a try of that.

Q2: Given the message id, is there something that we can enable and see what happened to the message lock – when we get it, when we lost it?
A: spring-cloud-azure-stream-binder-servicebus provide some message header related with the lock, see ServiceBusMessageHeaders. And for more details, @anuchandy  could youe help to share how we can get the lock processing details via ServiceBusProcessorClient? Thanks

Hi @yiliuTo
The issue may not be the same as https://github.com/Azure/azure-sdk-for-java/issues/30483 but may be related to https://github.com/Azure/azure-sdk-for-java/issues/30530.
Hi @LauraDamianTNA and @fbeltrao
Except this message, does the application process for other messages? base on current content, it seems the process received message(delivery_count=0) but haven't processed it until lock timeout at 3:08:57.259, so the message(delivery_count=1) received again in other thread at 3:08:57.275. But what is error for delivery_count=1 and delivery_count=2, each end at 3:14:04.503 and 3:14:46.967?
Can you also provide more detailed logs (with thread name and all errors/warnings during that time) to help us understand your scenarios more?

@yiliuTo the prefetching of an additional message would explain what is happening.
The out of order message ID is 4987585e-70a8-40d2-846a-0953de65a903 which was produced at 3:03:57.094.
We have two instances of our application processing message from the queue. This the processing start of message 4987585e-70a8-40d2-846a-0953de65a903:

Instance
Retry-Count
Start

584bc9fb6b-6sljv
0
3:10:49.478

584bc9fb6b-xnsw2
1
3:08:57.276

584bc9fb6b-xnsw2
2
3:14:04.508

584bc9fb6b-6sljv
3
3:14:46.972

Around that time, the instance 584bc9fb6b-6sljv which had the delayed processing start received the following messages:

Message ID
Retry-Count
Time

e4e542cd-6dec-4190-b15f-8a4653c0e8bd
0
3:03:54.592

4987585e-70a8-40d2-846a-0953de65a903
0
3:10:49.478

4987585e-70a8-40d2-846a-0953de65a903
3
3:14:46.972

Why do retries 1,2 and 3 fail?
As the retry=0 is running in parallel they end up fighting for resources. We abandon the message once we try 3 times.
For additional context, this application is consuming messages from 2 queues from same service bus. Not sure if that information is helpful.

Thanks @fbeltrao for providing these details. This is really helpful.
To help us check the root cause, can you follow https://github.com/Azure/azure-sdk-for-java/tree/main/sdk/servicebus/azure-messaging-servicebus#enable-client-logging to provide the debug level log with period of at least +/- 10 minutes from when the issue occurred?

Sorry, currently the enable client logging wiki link is not valid, please directly use https://docs.microsoft.com/en-us/azure/developer/java/sdk/logging-overview#next-steps and choose one logging framework and configure to DEBUG level log.
Please also enable DEBUG level for AppInsights followed by: https://docs.microsoft.com/en-us/azure/azure-monitor/app/java-standalone-config#auto-collected-logging

We found the root cause was that the processing thread is blocked by the small default thread pool size, so we asked user to add the VM option "-Dreactor.schedulers.defaultBoundedElasticSize=50" to increase the pool size. Considering that things have worked well since they changed it and they have had no more questions, this issue is closed.
If you have more questions, please re-open this one or create a new issue.


Onboarding: Weight Goal input shifts when you click on spinner

Make sure that range bar does not shift entire page once it displays on the screen.

Fixed


MSIWarp on Maldi-TOF spectra

Hi !
Your package is great ! I would like to know if it works with MALDI-TOF spectra. I have tried on my spectra that I have to align but I do not know if my TypeError is because of my arguments or if the function is not adapted to MALDI-TOF spectra.
`---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
 in
1 # find an m/z recalibration function for each spectrum
----> 2 recal_funcs = mx.find_optimal_warpings_uni(my_spectra,reference_spectrum,params, epsilon, n_cores)
TypeError: find_optimal_warpings_uni(): incompatible function arguments. The following argument types are supported:
1. (arg0: List[List[msiwarp.msiwarp.peak]], arg1: List[msiwarp.msiwarp.peak], arg2: msiwarp.msiwarp.params_uniform, arg3: float, arg4: int) -> List[List[Tuple[float, float]]]
Invoked with: array([ 2001.16654336,  2001.58706881,  2001.99868969, ...,
21022.27408836, 21023.63702209, 21025.        ]), array([ 1959.07152996,  1959.48760921,  1959.89487849, ...,
20132.28967689, 20133.623449  , 20134.95726529]), parameters for node placement function, 1.5, 8`
Any idea ?

Hi!
It works on TOF data, provided that you can select a good reference spectrum.  So your error is likely related to how you setup your data. How do you initialize my_spectra, reference_spectrum, and params?

Hey !
Thank you for your quick reply. You're right ! Actually the error may comes from how I initialized my_spectra and reference_spectrum that are both np.ndarrays of float (m/z values) and int (intensities).
I just took a time to read warp.py code and I saw that I have to generate a list of MSIWarp spectra.
Do you know how can I use to_mx_peaks() with list of m/z values that is np.ndarrays of float and intensities np.ndarrays of int ?
I get this when I use this function:
`---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
 in
4 mz_begin = 1959
5 mz_end = 20000
----> 6 my_spectra = [get_mx_spectrum(spectra['Masse m/z'].iloc[0], spectra['Intensite'].iloc[0], i, sigma_1, instrument_type) for i in range(len(spectra['Intensite'].iloc[0]))]
 in (.0)
4 mz_begin = 1959
5 mz_end = 20000
----> 6 my_spectra = [get_mx_spectrum(spectra['Masse m/z'].iloc[0], spectra['Intensite'].iloc[0], i, sigma_1, instrument_type) for i in range(len(spectra['Intensite'].iloc[0]))]
~/.local/lib/python3.7/site-packages/msiwarp-0.1-py3.7-macosx-10.7-x86_64.egg/msiwarp/util/warp.py in get_mx_spectrum(file, meta, i, sigma_1, instrument_type)
14     and instrument type.
15     """
---> 16     s_i = read_spectrum_fs(file, meta[i])
17     return to_mx_peaks(*s_i, sigma_1, id=i, instrument_type=instrument_type)
18
~/.local/lib/python3.7/site-packages/msiwarp-0.1-py3.7-macosx-10.7-x86_64.egg/msiwarp/util/read_sbd.py in read_spectrum_fs(filepath, meta_item)
55     Tuple:tuple of mz and intensity vectors
56     """
---> 57     with open(filepath, 'rb') as filestream:
58         filestream.seek(meta_item[0])
59         (mz, intensity) = read_spectrum(filestream, meta_item[1])
TypeError: expected str, bytes or os.PathLike object, not numpy.ndarray
`
About my params initialization:
n_steps = 120
n_peaks = 80
max_n_nodes = 10
mz_begin = 1959
mz_end = 20000
n_cores = 4
scaling to test impact of sigma on alignment performance
sigma_1 = 1.5e-4
epsilon = 1.5
slack = 2.0 * epsilon * sigma_1
params = mx.params_uniform(mx.Instrument.TOF,
n_steps,
n_peaks,
max_n_nodes,
mz_begin,
mz_end,
slack)

Provided that you have a an numpy array of m/z values and one of intensity values, you can use to_mx_peaks in the following manner:
spectra = []
sigma_1 =
for idx, mz, intensity in enumerate(zip(mz_array, intensity_array)):
spectra.append(to_mx_peaks(mz, intensity,  sigma_1, id = idx, instrument_type = 'tof'))

Thanks for your answer !

Hi !
Just reopening this issue about find_optimal_warpings_uni function. I want to find the optimal warping among 4 spectra for a first test.
The spectra size is 18000 each. Here are my parameters :
n_steps = 100
n_peaks = 80
max_n_nodes = 50
mz_begin = 1959
mz_end = 20000
n_cores = 80

sigma_1 = 1.5e-4
epsilon = 1.5
slack = 2.0 * epsilon * sigma_1
params = mx.params_uniform(mx.Instrument.TOF,
                           n_steps,
                           n_peaks,
                           max_n_nodes,
                           mz_begin,
                           mz_end,
                           slack)
reference_spectrum = spectra[2]

However this function recal_funcs = mx.find_optimal_warpings_uni(spectra,reference_spectrum,                                            params, epsilon, n_cores)is taking a too long time to run.(more than 30 min...)
It not supposed to take so much time according to your paper and the examples on the notebooks. I have to stop the kernel every time I want to try it and so can't use this function. I thought I had to change the n_cores parameter (according warp_util.cpp code) to make it work but it don't.
Any idea what parameter I need to play with to make it work?

problem solved.


Build(deps-dev): Bump @types/node from 17.0.9 to 17.0.10 (#2444)

Pull request opened by the merge tool on behalf of #2444

Merged in 6fbfae7ea3eff7529417f1256ad78cd679f12ad5


Publishing in nucleus

Hello
Some example of executing the Publish command targeting Atlassian\nucleus?
The Nucleus project documentation indicates that the easy way to publish a release in Nucleus is by using the "Publish" command of electron-forge, that's all.
However, in the documentation the "Publish" command of electron-Forge does not say anything about nucleus as a target.
Could you show us the way?
Victor Perez

In Electron Forge 5.x, apparently this is how to find the docs for this: https://github.com/atlassian/nucleus/blob/1c3a1303699b22b3c959c0d6e06c88790ffd9812/docs/Uploading.md#easy-way
In Electron Forge 6 and above (currently in beta), the documentation is on the website: https://v6.electronforge.io/publishers/nucleus

As @malept said the forge v6 docs are on our site.  For now forge v5 usage is explained in the web UI of nucleus.  On the app page you should have a section that looks like this

Basically you use the nucleus-uploader package in forge v5 as a publish target


deprecate_field: accessing deprecated field NoneType.

We started used deprecate-fields and saw this warning in our logs.
Turns out django-fsm uses inspect.getmembers which in turn does a getattr(object, key) where the object is the class, not an instance.
Maybe simply catching the None value at the start would be enough.

This can also happen when you add a deprecated field to an admin.ModelAdmin.list_display
Workaround:
To find the problematic model, you can:

put a breakpoint in django_deprecate_fields/deprecate_field.py DeprecatedField.__get__
move up the call stack to django/contrib/adminchecks.py _check_list_display_item
inspect obj


AAC decoder not finding correct sample_rate for some streams (IDFGH-7951)

Noticed AAC decoder not finding the sample rate for some stream such as http://streamasiacdn.atc-labs.com/rdsaanthwanam.aac ,
For example, This stream is actually 44100Hz sample rate. But decoder is detecting as 22050.
How to produce:
Able to reproduce with examples/player/pipeline_living_stream/.
Apply following patch.
diff --git a/examples/player/pipeline_living_stream/main/play_living_stream_example.c b/examples/player/pipeline_living_stream/main/play_living_stream_example.c
index 91a8c43..398c5ad 100644
--- a/examples/player/pipeline_living_stream/main/play_living_stream_example.c
+++ b/examples/player/pipeline_living_stream/main/play_living_stream_example.c
@@ -37,7 +37,7 @@

 static const char *TAG = "HTTP_LIVINGSTREAM_EXAMPLE";

-#define AAC_STREAM_URI "http://open.ls.qingting.fm/live/274/64k.m3u8?format=aac"
+#define AAC_STREAM_URI "http://streamasiacdn.atc-labs.com/rdsaanthwanam.aac"

Log:
(9744) HTTP_LIVINGSTREAM_EXAMPLE: [ * ] Receive music info from aac decoder, sample_rates=22050, bits=16, ch=2
Attaching the VLC decoder output for
vlc http://streamasiacdn.atc-labs.com/rdsaanthwanam.aac

This example doesn't exist in esp-idf, suggest reporting the issue to esp-adf.

Thanks for reporting, will close now, please help create issue on https://github.com/espressif/esp-adf/issues, thanks.


factual/spelling corrections

Thanks for the fixes!

But you need to submit this PR on the master repo at heroku/mobile-template1.


Left over old build files in npm release

Describe the bug
Not exactly a bug in relation to the repository but while attempting to debug another bug I found what appears to be left over files from an earlier build no longer used in build/main/lib/video in the npm release, unless I missed their use somewhere?
To Reproduce
Steps to reproduce the behavior:

Install the npm version of this repository.
Inspect the downloaded files.

Expected behavior
The files to not be there on download.
Screenshots

Oh you're right, I forgot to rebuild the project before I published it. I'll publish a new version shortly. Thanks for noticing :)

I think you did rebuild it, just not cleanly, as there are updated files in there (even the ones from a couple hours ago I think?).

Yeah you're right, I manually removed the build folder and the build worked as expected.


fix(libsinsp): Add a CPU count check

In a scap file I have here, minfo->num_cpus is 0 when sinsp_filter_check_thread::extract_exectime is called. We handle this in debug builds with an ASSERT, but need to check for this in release builds as well. Bail out early if we either have no CPUs or if minfo is NULL.

What type of PR is this?

Uncomment one (or more) /kind <> lines:

/kind bug

/kind cleanup

/kind design

/kind documentation

/kind failing-test

/kind feature

Any specific area of the project related to this PR?

Uncomment one (or more) /area <> lines:

/area API-version

/area build

/area CI

/area driver-kmod

/area driver-bpf

/area driver-modern-bpf

/area libscap-engine-bpf

/area libscap-engine-gvisor

/area libscap-engine-kmod

/area libscap-engine-modern-bpf

/area libscap-engine-nodriver

/area libscap-engine-noop

/area libscap-engine-source-plugin

/area libscap-engine-savefile

/area libscap

/area libpman

/area libsinsp

/area tests

/area proposals

Does this PR require a change in the driver versions?

/version driver-API-version-major

/version driver-API-version-minor

/version driver-API-version-patch

/version driver-SCHEMA-version-major

/version driver-SCHEMA-version-minor

/version driver-SCHEMA-version-patch

What this PR does / why we need it:
Which issue(s) this PR fixes:

Fixes #
Special notes for your reviewer:
Does this PR introduce a user-facing change?:

NONE

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by: geraldcombs
Once this PR has been reviewed and has the lgtm label, please assign lucaguerra for approval. For more information see the Kubernetes Code Review Process.
The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: geraldcombs, incertum
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS [incertum]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

LGTM label has been added.  Git tree hash: c8feb133ef6cfb43b0e742d6a4cac7e770ca6f69

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: Andreagit97, geraldcombs, incertum
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS [Andreagit97,incertum]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment


Verified GitHub Profile Insights: Contribution Summary & Tech Specialization

Describe the feature
We propose enhancing the tool by adding a Contribution Summary and Language Statistics section.
Contribution Summary: Display the total number of contributions (commits, pull requests, issues), the number of active coding days in the past year (from the contributions calendar), and the user’s longest contribution streak. This gives users a clear view of their coding consistency and overall activity.
Language Statistics: Show the user’s most used programming languages in a visual format (e.g., pie chart or bar graph), and highlight their specialization (front-end, back-end, or full-stack development) based on their tech stack.
These features will provide users with a comprehensive and visually appealing summary of their GitHub contributions and expertise.
Add ScreenShots
....
Record

[X] I agree to follow this project's Code of Conduct
[X] I'm GSSOC'24 Extd registered Contributor
[X] I'm Hacktoberfest registered Contributor
[X] I want to work on this issue

It doesnt meets the requirements of the website and its purpose, its a addon for which there are already many websites and ways. Sorry for this time!
Closing the issue..


Unit Test Runner Does Not Support Double Value Checks in Event Property Assertions

Body
Description:
The current unit test runner does not support checks for double values when asserting the equality of an event property in ProcessingElementTestExecutor.run.
Idea:
Provide rounding for event validation. Users should be able to define a rounding parameter in the expected output events to dynamically set this value.
Example:
{
  "PROPERTY_VALUE": 1.0
}

{
  "PROPERTY_VALUE": { "value": 1.0, "rounding": 0.001 }
}

StreamPipes Committer
I acknowledge that I am a maintainer/committer of the Apache StreamPipes project.

Fixed in #3049


misc,python: Add pyupgrade to pre-commit

This adds the pyupgrade hook to pre-commit.
This hook automatically upgrades the syntax to the recommended standards for the newer version of the language.

This looks good to me, but I would suggest not adding a git blame ignore for this one.

This looks good to me, but I would suggest not adding a git blame ignore for this one.

Removed.
I'd like a second pair of eyes on this commit: https://github.com/gem5/gem5/pull/424/commits/c4156b06fb6e393ce9d253eb2af6e042267e84f0
When compiling gem5 without it there was an out of bounds exception. The tuple base was empty. I suspect it's because pyupgrade changes instances of class Foo(object) to class Foo and this meant base could be empty. I'm not 100% sure on this but the patch in that commit does appear to fix the error.

This looks good to me, but I would suggest not adding a git blame ignore for this one.

Removed.
I'd like a second pair of eyes on this commit: c4156b0
When compiling gem5 without it there was an out of bounds exception. The tuple base was empty. I suspect it's because pyupgrade changes instances of class Foo(object) to class Foo and this meant base could be empty. I'm not 100% sure on this but the patch in that commit does appear to fix the error.

That sounds like a plausible explanation to me.


Fix link to Promise.

Very simple link from Proc::Async to Promise while documenting the start method.

Thanks @fluca1978


[LiveComponent] Fix component syntax error in doc

Spotted by @fGuix in #1424 (thanks)

Thanks Simon!


Not working URL in README.md

The link to "Language-independent User's Guide" in the README.md gives a 404 error.
It looks like the page it is pointing to should be another one.
HTH

Fixed by #1754 I believe.


Add support for --version flag

This PR adds support for the --version flag to display Ballerina version information. The user can use the following commands to view Ballerina version and other, related environment information.

ballerina --version

ballerina -v

Closing this PR


Call the Rook API for SCC generation

Call the Rook api for SCCs. A rook api is available for generating the correct scc expected for rook components. Update to the new api so we don't have the ocs operator owning an outdated scc spec. The rook-ceph-rgw service account was missing in the scc, which is causing RGW to fail to start in 4.11 as seen in this issue: https://bugzilla.redhat.com/show_bug.cgi?id=2075581

/retest

/retest

/retest

The update to reference rook v1.9.2 was separated to #1652, this PR is just focusing on the scc reference.

/retest

/retest-required


Import error after upgrading to Python 3.11 Managed Layer

Describe the bug
After upgrading to the Python Managed Layer 3.11 on AWS Lambda, an import error is occurring when attempting to use the aws-sdk-pandas package.
Error when using:
arn:aws:lambda:us-east-2:336392948345:layer:AWSSDKPandas-Python311-Arm64:1
I did not previously get this issue using:
arn:aws:lambda:us-east-2:336392948345:layer:AWSSDKPandas-Python310-Arm64:2
How to Reproduce
To Reproduce
Steps to reproduce the behavior:

Upgrade to Python Managed Layer 3.11 on AWS Lambda from 3.10
Attempt to invoke the Lambda.
The following error message is displayed:

{
  "errorMessage": "Unable to import module 'handler': cannot import name 'DEPRECATED_SERVICE_NAMES' from 'botocore.docs' (/var/task/botocore/docs/__init__.py)",
  "errorType": "Runtime.ImportModuleError",
}

Expected behavior
The Lambda function should run successfully without any import errors.
OS
AWS Lambda
Python version
3.11
AWS SDK for pandas version
3.3.0

Hi @flowtrader2016

Upgrade to Python Managed Layer 3.11 on AWS Lambda from 3.10

You should only use 3.11 layers with Python 3.11 lambdas. Make sure you upgrade the runtime as well.
I also ran a quick check and I'm not able to reproduce this with Python 3.11 lambda running Python 3.11 layer, and Python 3.10 lambda running 3.10 so layers should be fine as long as they're used with the corresponding runtime.

Hi,
Can confirm I am using the 3.11 layer with Python 3.11 lambda.  For additional context the requirements.txt contains:
datetime
oandapyV20
pytz
s3fs
requests
notion-client
multiprocess
tabulate

As mentioned this works well with python/lambda layer <= 3.10.  Appreciate any feedback as to how I might fix this.
Thanks

Can you share the stack trace or the error / lambda logs?
"Unable to import module 'handler': cannot import name 'DEPRECATED_SERVICE_NAMES' from 'botocore.docs' (/var/task/botocore/docs/__init__.py)"

AWS SDK for pandas does not import from botocore.docs. Is there a chance this is caused by user code rather than the layer?

Why is this closed? I have the same error after upgrading from 3.8 to 3.11!

Can you print out which versions of boto3 and botocore you are using?I have not been able to reproduce this error either, and my Python 3.11 Lambda was using boto3==1.27.1 and botocore==1.30.1.
You can use the following code to print these values:
import boto3
import botocore

...

print("boto3 version:", boto3.__version__)
print("botocore version:", botocore.__version__)

It looks like this is likely related to this issue in boto3.


About  transformed tables result

hi, the input format of my code in Totto is the same as that in your paper . I also shuffle the row and the column of table，but the baseline（T5-base）result only drops 0.2 -1.0 in bleu and parent, even if I exchange the order of metadata and table. In your parper, the T5-base drops 4.5 bleu. I don't know what's wrong with it.  thanks.
here is one example:
before shuffle：
'page_title> List of Governors of South Carolina /page_title> section_title> Governors under the Constitution of 1868 /section_title> table> cell> 76 h> # /h> h> 75 /h> h> 74 /h> /cell> cell> Daniel Henry Chamberlain h> 76 /h> h> Governor /h> /cell> cell> December 1, 1874 h> 76 /h> h> Took Office /h> /cell> /table>'
after shuffle:
'section_title> Governors under the Constitution of 1868 /section_title> table> cell> Daniel Henry Chamberlain h> Governor /h> h> 76 /h> /cell> cell> December 1, 1874 h> Took Office /h> h> 76 /h> /cell> cell> 76 h> # /h> h> 74 /h> h> 75 /h> /cell> /table> page_title> List of Governors of South Carolina /page_title>'

As shown in the example, i also change the order of related headers. I think the way can make the Totto dataset more harder, but the drop in T5-base is still small.

the input format of my code in Totto is the same as that in your paper

No, it's not. At least the special markers are different. Note that our input format is designed for our method, where we simplify some layout markers because our proposed graph-based attention covers that information. For the T5 baseline, you can follow this paper's implementation.

I also shuffle the row and the column of table，but the baseline（T5-base）result only drops 0.2 -1.0 in bleu and parent

As described in our paper, in addition to row and column shuffling, we also perturb the table layout by table transposing.

I don't know what's wrong with it.

Given the current information, it is hard to say whether it's only the problem of your table layout perturbation or also the problem of baseline implementation.
To better understand what happened, please provide the following information:

The code base you used;
Data preprocessing code;
Table perturbation scripts;
BLEU scores on original/perturbed dev set.

The code base you used;

I completely use the code in your Lattice repo , including but not limited to T5 model and preprocess scripts.

Data preprocessing code;
the same to your repo, including but not limited to  lexicographic order, the only difference is that i replace <header> with <h>，replace </header> with </h> . I think the special markers difference will not influence the overall effect of the model. The reason I do this is to mitigate the influence of truncation.
Table perturbation scripts;
I shuffle the row and column order, and shuffle the row header and column header (I think this way of header shuffle is the same to table transposing in your paper)
For more details, here is one example.
Raw data（Json format is more convenient to display）：
'page_title': '<page_title> List of Governors of South Carolina </page_title> ',
'section_title': '<section_title> Governors under the Constitution of 1868 </section_title> ',
'table': {
         '<cell_3_0> 76': {
                       '<col_header>': {'<header> # </header> ': '', '<header> 75 </header> ': '', '<header> 74 </header> ': ''}},
         '<cell_3_2> Daniel Henry Chamberlain': {
                        '<row_header>': {'<header> 76 </header> ': ''},
                        '<col_header>': {'<header> Governor </header> ': ''}},
         '<cell_3_3> December 1, 1874': {
                       '<row_header>': {'<header> 76 </header> ': ''},
                       '<col_header>': {'<header> Took Office </header> ': }}
}

data without shuffle（will be tokenized to input_ids）:
'<page_title> List of Governors of South Carolina </page_title> <section_title> Governors under the Constitution of 1868 </section_title> <table> <cell> 76 <h> # </h> <h> 75 </h> <h> 74 </h> </cell> <cell> Daniel Henry Chamberlain <h> 76 </h> <h> Governor </h> </cell> <cell> December 1, 1874 <h> 76 </h> <h> Took Office </h> </cell> </table></s>'
data with shuffle（will be tokenized to input_ids）:
'<section_title> Governors under the Constitution of 1868 </section_title> <table> <cell> December 1, 1874 <h> Took Office </h> <h> 76 </h> </cell> <cell> 76 <h> 74 </h> <h> 75 </h> <h> # </h> </cell> <cell> Daniel Henry Chamberlain <h> Governor </h> <h> 76 </h> </cell> </table> <page_title> List of Governors of South Carolina </page_title></s>'
I think the way I use includes the row-wise shuffling, column-wise shuffling and table transpose in your paper except the different special marker(, <\h>). By the way, i also shuffle the metadata and table, because if i only shuffle table-inner information, the result drop will be less obvious;
If my shuffle method is different from yours, please post an example, including before and after shuffle.
BLEU scores on original/perturbed dev set.
for T5-base, Overall BLEU drops from 48.0 to 47.0, PARENT drops from 58.04 to 57.69. Overlap BLEU drops from 55.7 to 54.7, PARENT drops from 62.21 to 61.91.  Non-Overlap BLEU drops from 40.5 to 39.5, PARENT drops from 54.0 to 53.62.
I think the drop is too small, I intuitively judge that it is not normal on T5, but I haven't located the specific reason yet.

I have a question. Are you using the another preprocessing code(baseline preprocessing code in Totto repo) and transformers library(from transformers import T5ForConditionalGeneration) for T5 in your experimental process?
I read the code in your repo carefully. I think the preprocessing code in your repo can be used for both T5 and Lattice. And the model code(from model.modeling_t5 import T5ForConditionalGeneration) in your repo also can be used for both T5 and Lattice. For T5, we just set type_ids to None. For Lattice, we just reserve the parameter value of type_ids. Is there any deviation in my understanding. Or is there any other difference between the model code in your repo((from model.modeling_t5 import T5ForConditionalGeneration) ) and transformers library((from transformers import T5ForConditionalGeneration)).
Another question: you post an example of a-b pair, but he processing code is arranged by cell. For each cell, there is no related pair information. I really can't understand the meaning of Table Layout Perturbation you mentioned. Can you give me a real example in dev set. Like the example i posed before, only needs (the sequence will be tokenized to input_ids without any shuffle and transpose) and (the sequence will be tokenized to input_ids wiht shuffle and transpose) . Thanks.

The input format is part of a method. Vanilla T5 with our input format is the layout-agnostic input method introduced in our paper. Setting type_id, row_id, and/or col_id to None can lead to unexpected model behavior (e.g. activate a part of Lattice). If your goal is to develop your own method, then you can do whatever you want. However, if your goal is to reproduce existing methods, we highly suggest you follow our instructions.
Below is an example of table layout perturbation with transpose. For simplicity, this figure only presents the subsequence for data cells.

Thanks!
I follow your suggestion like following.
Replace preprocess_data_main.py and preprocess_utils.py in our preprocess folder with the corresponding baseline preprocessing code.
Replace the model, trainer, and tokenizer in train.py with the original ones: from transformers import T5ForConditionalGeneration, T5TokenizerFast, Seq2SeqTrainer.
but I I get a very high score. For T5-small, overall BLEU 48.7, overall PARENT 58.47. For T5-base, overall BLEU 49.1, overall PARENT 58.21. What is the reason? I use a larger batch size and smaller steps. for example, T5-base uses 16 batch size, 80000steps.

That's weird. Those results are even much better than the T5-3B performance (48.4 BLEU and 57.8 PARENT) reported by Kale and Rastogi, 2020. Can you try to reproduce their results with their hyper-parameters?
I forget to mention that the preprocess_function in train.py also needs to be cleaned (i.e. deleting all lines about type_ids, col_ids, and row_ids). However, that won't influence the performance as those params are not used.

I have deleted relevant type_ids, col_ids, and row_ids during the experiment. How do you reproduce the T5 baseline performance in your paper?  The performance of T5 baseline in your paper is basically equal to the performance reported by Kale and Rastogi, 2020.  Are you doing the same as you suggested me to do?

That is our way to reproduce the baseline. However, I'm not sure whether you are doing exactly the same thing. Your T5-base results are even higher than the current SOTA method, which also uses T5-base as the backbone. That makes no sense. Regarding reproducing the T5 baseline, you can email the authors of that paper directly.

Thanks. I have another question. For reproducing T5-baseline performance, do you also use the constant lr 2e-4 , batch size 8 and 150000 steps?  Because in Kale and Rastogi, 2020, it uses the constant 0.001 and 10K steps.

Their hyper-parameters.

Thanks. Can you provide specific batch size, learning rate and training steps for T5 baseline in your experimental process?


K8S new a node,the calico not ready

my four server  is  <IP_ADDRESS>,<IP_ADDRESS>,<IP_ADDRESS>，<IP_ADDRESS> and <IP_ADDRESS> is new
the <IP_ADDRESS> calico
+—————-+——————-+——-+————+————-+
| PEER ADDRESS | PEER TYPE | STATE | SINCE | INFO |
+—————-+——————-+——-+————+————-+
| <IP_ADDRESS> | node-to-node mesh | up | 2021-11-09 | Established |
| <IP_ADDRESS> | node-to-node mesh | up | 2021-11-09 | Established |
| <IP_ADDRESS> | node-to-node mesh | start | 01:50:43 | Connect |
the <IP_ADDRESS> calico
+—————-+——————-+——-+———-+———+
| PEER ADDRESS | PEER TYPE | STATE | SINCE | INFO |
+—————-+——————-+——-+———-+———+
| <IP_ADDRESS> | node-to-node mesh | start | 02:40:48 | Passive |
| <IP_ADDRESS> | node-to-node mesh | start | 02:40:48 | Passive |
| <IP_ADDRESS> | node-to-node mesh | start | 02:40:48 | Passive |
+—————-+——————-+——-+———-+———+

Please follow the issue template when creating new issues. There's not really enough information here to explain the failure. If I had to guess, it is due to a firewall rule between the two networks preventing BGP traffic.
This is likely a node routing issue and not a Calico issue anyway, as Calico relies on proper node networking for BGP to establish.


add support for setting the cache to use

swatinem/rust-cache supports two caching backends; github actions and buildjet.
This just plumbs that setting through defaulting to leaving the field empty.

This looks useful, could you elaborate on the usecase for toggling this setting? Are you also using buildjet runners? (I'm wondering if we can maybe just notice a custom runner with "buildjet" in the name and auto-flip the setting).

Yeah, essentially. I wanted to release on arm, noticed buildjet supports it, but also saw that the cache performance for non-gh runners is pretty awful (plus they are twice the size and free..)

If you're interested in implementing the auto-detect approach (less config is always nice), I think the relevant change is to check if this value contains a string with substring "buildjet": https://github.com/axodotdev/cargo-dist/blob/57e1712d0164aa88a757fb333d7d7b95da093fe7/cargo-dist/src/backend/ci/github.rs#L145

Pardon, the value of interest is github_custom_runners, although maybe you just want to look at the resulting local_runs
https://github.com/axodotdev/cargo-dist/blob/57e1712d0164aa88a757fb333d7d7b95da093fe7/cargo-dist/src/backend/ci/github.rs#L153-L158

(Happy to take the PR over if that's a pain, but this is a great idea so I super want to land some version of it)

Oh neat, just realized this value can be plumbed into GithubMatrixEntry to precisely set the cache provider per-target.

thanks for this again! I ended up implementing the autodetect version in #1129, should be in the next release in a day or two


When trottled we need to back down further.

Need to back down below the minimum size of mbus Q size.
This needs closer thought, but at least this should bive a better picture for the tests.
@bjorncs @jonmv

Yes ... the minimum number of inflight operations was probably too high here, still.


feat($compile): provide a minimizeStats function to prune stats json

Signature: minimizeStats(webpackStats) => needed stats json. The function is used to prune webpack
stats generated and leave just needed part by webpack-flush-chunks. It is useful when build env and
runtime env is different."

just a prototype, ideally, I think the most convenient way is making something like https://github.com/jamiebuilds/react-loadable#webpack-plugin

Looks like no interest


test failure under node-18

Test Failure
❯ ./node_modules/mocha/bin/mocha test/index.test.js

  integration tests
    1) "before each" hook for "should install lastest version of tools and run developer experience"

  0 passing (191ms)
  1 failing

  1) integration tests
       "before each" hook for "should install lastest version of tools and run developer experience":
     Error: Command failed: npm bin -g
      at checkExecSyncError (node:child_process:890:11)
      at execSync (node:child_process:962:15)
      at Context.<anonymous> (test/index.test.js:55:28)
      at process.processImmediate (node:internal/timers:476:21)

Repro:

Clone this repo
Make sure you are under node-18 node --version
Run npm i
Run ./node_modules/mocha/bin/mocha test/index.test.js
Note the test failure above

Fixed by #40


Rename Dockerfile and use depth 1

What does this PR do?
Address the feedback from the workshop.

renames the file
clones the code with depth 1

Motivation

Additional Notes

Possible Drawbacks / Trade-offs

Describe how to test/QA your changes

/merge


Add permission to benchmark CI

Pull Request Test Coverage Report for Build<PHONE_NUMBER>2
Details

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 72.505%

Totals

Change from base Build<PHONE_NUMBER>7:
0.0%

Covered Lines:
1424

Relevant Lines:
1964

💛  - Coveralls

okay, the segfault is caused by BridgeStan on macOS

I am going to merge this now, maybe in some PRs we can disable the MacOS benchmark momentarily

Oh yeah that segfault haunted our dreams for a while. It happens only on the newer Github runners with macOS-14 and ARM arch processors. So in Pigeons we decided to just the older runners (macOS-13).


Add easy to use bot (Yes it works  )

I thought it would be helpful for the community to have a user-friendly GUI bot that simplifies the process for individuals who are nobs like me
if you spot any issues in my code or anything to change please let me know.
Your feedback is invaluable and I'm eager to improve Thanks a bunch!

Can someone verify this PR please?

This added code in this PR is a repository on itself.
Please adjust your code so it builds further upon the existing tinderbotz library of which you can update the xpaths.

Bro not cool

Not cool

"Your feedback is invaluable and I'm eager to improve Thanks a bunch!"
-> I'm telling you what to adjust in order for the pull request to be merged
"Not cool!"
-> 👍👍👍

Fair enough  I'll do a PR to update the Xpaths


Create a cross-language registrar for SchemaTransform

This will be similar to following for SchemaIO.:
https://github.com/apache/beam/blob/master/sdks/java/extensions/schemaio-expansion-service/src/main/java/org/apache/beam/sdk/extensions/schemaio/expansion/ExternalSchemaIOTransformRegistrar.java
With this cross-language transforms will be able to share the same registrar.
Imported from Jira BEAM-14537. Original Jira may contain additional context.
Reported by: chamikara.

This is covered by https://s.apache.org/easy-multi-language


Suppress command dispatching during view building

FuncUI executes subscription methods when creating a control, not just when patching it later. This leads to unnecessary commands being dispatched initially, and furthermore invalid reversible commands registering in undo/redo.
Fix: add a state to dispatcher (bool + lock object) that is set during view update - this also means that initial view update should be a result of dispatching a InitializeEditorCommand which does nothing, but forces view update.

Decided not to introduce a new command, but rather schedule view update in SetActiveEditor.


the file contains a virus or potentially unwanted softwareAt

Program 'ysoserial.exe' failed to run: Operation did not complete successfully because the file contains a virus or
potentially unwanted softwareAt line:1 char:1
windows security ::
Detected:VirTool:MSIL/Vusrlize.A!MTB
Affected items:
file: C:\Users\folder\ysoserial.net\ysoserial\bin\Release\ysoserial.exe

Can confirm our anti-virus also flagging this as Trojan

Hey everyone,
This is not a trojan; rather, YSOSerial.Net is a legitimate security tool created for ethical testing by security professionals. It includes payloads for exploiting deserialization vulnerabilities in the .NET Framework/Mono. Antivirus programs often detect these embedded payload strings and flag them as potential threats because they resemble code patterns used in actual exploits.
If you're seeing this alert outside of a security testing context, it could indicate a compromise on your system. However, if you're a security professional using this tool intentionally, you likely understand the detection and can work around it by either excluding it in your antivirus settings or compiling a custom version to avoid generic string detection.
I’m providing this explanation in case you're not familiar with security testing tools. Unfortunately, we’re unable to discuss methods for bypassing antivirus detections in detail for security reasons. I hope this clears things up.


the RACTableView example of ios-xcode7-objc has a build error

Goals
What do you want to achieve?

Try to run RACTableView example

Expected Results
What did you expected to happen?

no errors

Actual Results
What did happened instead?

A building error happened, said that Xcode can't find the ReactiveCocoa library.

Steps to Reproduce
What are steps we can follow to reproduce this issue?

Just 'pod install', then open the 'RealmExamples.xcworkspace', run.

Code Sample
NO.
Version of Realm and Tooling
Realm version: 0.98.8
Xcode version: 7.3
iOS/OSX version: 10.11
Dependency manager + version: Cocoapods 0.39
Solution:
The error is the 'Per-configuration Build Products Path' in 'Build Settings', the path is '$(BUILD_DIR)/$(CONFIGURATION)$(EFFECTIVE_PLATFORM_NAME)-static'. If remove the suffix '-static' , it will be OK.

I think, you're hitting here an error in CocoaPods, which was fixed in the 1.0 prereleases. Can you try out the latest prerelease by gem install cocoapods --prerelease?

This may be an error in the Xcode project configuration for the RACTableView target. It appears not to be tested as part of our automated verification of our examples so I can see an error slipping in.

I can reproduce this... probably just a configuration error in our Xcode project with how CocoaPods dependencies are linked.


Create from snapshot boolean.

Hi,
Is there any option to explicitly mention whether or not to create a DB from snapshot? The reason why I'm asking this is it will be easier to reuse the same code for multiple environments when we have an option which easily can parameterize.
Say for example we have multiple sets of environments pulling from the same repo which contains the RDS module and since it is not possible to set snapshot_identifier to an incorrect value, is it possible to bring in another parameter like "create_from_snapshot" which when set to true will consider "snapshot_identifier" variable otherwise ignore it?

Hey,
Is it not possible to set snapshot_identifier to an empty string, which should cause it to be ignored? I've not tried it yet myself but that's the default according to the docs, so in theory it should act the same if you pass an empty string.

By default this is set to an empty string in the module (https://github.com/terraform-aws-modules/terraform-aws-rds/blob/85de0ce0deb7b2bb6088c01dbd6d0f7d3c233fb5/modules/db_instance/variables.tf#L41) and therefore, yes, you can either create from a base DB engine image or you can create from the snapshot that you pass to var.snapshot_identifier

@kirubakaran25 can we close this issue now?


Popup does not move with the task when dragging

The demo page clearly shows the popup moving along with the task as you drag it, but the repo version does not have this functionality working.
Instead what happens is the popup remains where it is, making it feel as if dragging is broken. But if you keep dragging past the width of the popup then the dragging resumes, but that's not intuitive and for a long time I actually thought this was just broken.
This is how the official repo version works right now:

Does anyone have a solution to this? If the popup could be moved to above or below the task that would be one solution, but there doesn't appear to be any way to do that.

search $.on(this.$svg, 'mousedown', '.bar-wrapper, .handle', (e, element) at frappe-gantt.js
then add this.hide_popup();
it's working for me

Unnecessary after #393.


feat(android): add MANAGE_EXTERNAL_STORAGE permission

Summary
Since Android 11, the OS ignores requestLegacyExternalStorage property in AndroidManifest.xml and needs to, either remove the global external storage usage, either add another new permission added in API 30 named MANAGE_EXTERNAL_STORAGE.
Android recommends to not use this permission, except in some conditions like:

File storage app
App storing documents
Etc

Source
Closes https://github.com/zoontek/react-native-permissions/issues/586
Test Plan
You only need to require it in Android 11 (API 30+).
What's required for testing (prerequisites)?
Android 11
What are the steps to reproduce (after prerequisites)?
Request the permission PERMISSIONS.ANDROID.MANAGE_EXTERNAL_STORAGE and let's see if it works.
Compatibility

OS
Implemented

iOS
❌

Android
✅

Checklist

[ ] I have tested this on a device and a simulator
[x] I added the documentation in README.md
[ ] I mentioned this change in CHANGELOG.md
[x] I updated the typed files (TS and Flow)
[ ] I added a sample use of the API in the example project (example/App.js)

Are you sure this is requestable? The permission level isn't dangerous https://developer.android.com/reference/android/Manifest.permission#MANAGE_EXTERNAL_STORAGE

Just checked, this will not work: https://stackoverflow.com/questions/65876736/how-do-you-request-manage-external-storage-permission-in-android

Hi @zoontek
Thanks for your feedback, you're right, it can't be requested like that.
Closing it.

any update on this? why is that not workable???

It's a closed issue from months ago and the platform is the same ?
This comment seems authoritative, that is, there will be no update: https://github.com/zoontek/react-native-permissions/pull/587#issuecomment-823497555

Hello, the only thing we can do with MANAGE_EXTERNAL_STORAGE is detect if it's accessed according to documentation here.
Users can be deeplinked to the permission section on their device, but there is no direct APP way to request it. Makes sense.
Curious will a getter be added to this package? People who want to handle file storage only in RN would need something like this to alert the user they need to add the permission.


build_visit python3/sphinx failures on rhel6

My sytem: Linux 2.6.32-754.2.1.el6.x86_6
running build_visit from a clone of develop
pyparsing 2.4.6 fails with:
Traceback (most recent call last):
  File "./setup.py", line 5, in <module>
    from setuptools import setup
  File "third_party/python/3.7.5/linux-x86_64_gcc-6.3/lib/python3.7/site-packages/setuptools/__init__.py", line 20, in <module>
    from setuptools.dist import Distribution, Feature
  File "third_party/python/3.7.5/linux-x86_64_gcc-6.3/lib/python3.7/site-packages/setuptools/dist.py", line 35, in <module>
    from setuptools import windows_support
File "/third_party/python/3.7.5/linux-x86_64_gcc-6.3/lib/python3.7/site-packages/setuptools/windows_support.py", line 2, in <module>
    import ctypes
  File "third_party/python/3.7.5/linux-x86_64_gcc-6.3/lib/python3.7/ctypes/__init__.py", line 7, in <module>
    from _ctypes import Union, Structure, Array
ModuleNotFoundError: No module named '_ctypes'

Some research seemed to suggest a missing libffi, so I compiled it myself and pointed the python3 build to the include and library location (as we do for zlib). That didn't seem to work, same error.
At the end of the Python 3 build, I see this:
*** WARNING: renaming "_ctypes" since importing it failed: libffi.so.7: cannot open shared object file: No such file or directory

If I also add the libffi location to LD_LIBRARY_PATH in my environment, then the build of python3 and sphinx support packages complete.

References to other reports of the same problem, can we modify bv_python to handle this?
visit-users, Jan 2020
live-response#38

No longer supporting rhel6.


all: change macros

I tried to clean up the macros a bit:

Change the main! proc macro to a bin! macro_rules macro. It is now in uucore since it's no longer a proc macro. This could be a bit faster, but mostly it's much simpler and smaller. It's called bin now, because I wanted to rename gen_uumain to main and it is the entry point for the bin target in Cargo.toml.
Re-export uucore_procs from uucore, so that we can reference the proc macros as uucore::[proc_macro_name]
Make utils to not import uucore_procs directly but access proc macros via uucore.
Remove the syn dependency and don't parse proc_macro input (hopefully for faster compile times)

All this combined means that main.rs now looks like this:
// before: uucore_procs::main!(uu_arch);
uucore::bin!(uu_arch);

And the main function in e.g. arch.rs is:
// before: #[uucore_procs::gen_uumain]
#[uucore::main]
pub fn uumain(args: impl uucore::Args) -> UResult<()> {
    // snip
}

Because there are so many changes, I'll put comments on the important files to review.

Impressive!  I love patches removing code ;)
Let's land it now!


[Removal]: of the person who decided to put my hotspots on deny list

Hotspot Name
Hot Dijon Lynx
Hotspot b58 Address
1121PdWys7iVjZZrQpyBYVzJhoPRENb4fSULERKYGDMPwRhBiMgD
Discord Handle
CSA-Mahone
Hotspot Manufacturer
Sensecap
Removal Reason
abuse, nothing wrong with the hotspots, check the map or the streets
Modifications
No
Extra forwarders
No
Extra antennas
No
Additional Information
When you ban hotspots you need to have proof at least of some credibility. If you ban hotspots by mistakes because you believe something and do not ask first explanation then you need to reinburse the damaged you caused meaning HNT money in this case.
My hotspots are on denylist for no reason, they don't break any rule. The only thing that can cause some discussion is yhe antennas which are 12 dbi omnidirectionals from RAK Wireless., There is no other reason and this cannot be a reason strong enough  to ban withoiut to ask first explanations.
The person who decided to ban my hotspots needs either to present a strong reason  which is practically impossible becasuse there is none or he has to pay the damage and be removed from taking any decison for this network!
   Please remove my hotspots from the denylist, there is nothing wrong with them.
I wasted so much time writting, I demand refund, my time cost money, I don't have time for idiots!

We do not have sufficient evidence to remove these hotspots from the denylist. This is an automated comment due to the volume of addition and removal requests. A future tool is in the works to provide more insight into the analysis approach made by the Helium team and community members that maintain this list.

We have taken into account this removal request in the next iteration of the denylist. It may take some time before it's processed. This is an automated comment due to the volume of addition and removal requests. A future tool is in the works to provide more insight into the analysis approach made by the Helium team and community members that maintain this list.


Examples marked as "deprecated" but nothing to replace it

Guys... come on...

@calston can you elaborate a bit?  We need some context here if we're going to help...

They are not deprecated, demonstrated by the fact that I have an open PR to maintain them right now.
What happened was that someone introduced Sphinx docs, but did not migrate the existing docs to the source tree that gets built for Read The Docs.


Unable to control single LEDs

Describe the bug
Single channel in QLC operates on three physical fixtures
To Reproduce
Steps to reproduce the behavior:

Connect a WS2811 LED strip
Add fixture Generic RGB
Go to Simple Desk tab
4a. Slider 1 operates red pixels on first three LEDs
4b. Slider 2 operates green pixels on same three LEDs
4c. Slider 3 operates blue pixels on sane three LEDs

Expected behavior
Each lider should only operate on a single LED
Screenshots

Desktop (please complete the following information):

OS: Debian
QLC+ Version: 4.2.17
hardware setup: DMXKing LeDMX4 PRO

Additional context
Please do explain if I am doing something wrong.

Bro this is how LED strip like this works.
You bought the cheap version which has 3 segment groupings.
Talk to your supplier if this is not expected

Thank you, I was completely unaware of groupings. How would I know what to look for? There is no documentation showing that unless I do not understand the terminology.

Thank you, I was completely unaware of groupings. How would I know what to look for? There is no documentation showing that unless I do not understand the terminology.

Your supplier will tell you if the strip is grouped like this, it's not really up to QLC+
For example, this strip is grouped:
https://www.enttec.com.au/product/led-pixel-strip/black-led-pixel-strip/
While this strip allows individual control of the LEDs:
https://www.enttec.com.au/product/led-pixel-strip/8px60-12-b2-5m-black-12v-single-led-control-pixel-strip/
Most of the time, the dead giveaway is the copper attachment points.
Notice that on your strip, the copper pads come every 3 LEDs where as on most individual controlled LED strips, the copper pads will be present after each LED.
Hope this helps. If you have any further questions please make a forum thread.

Thank you very much for the clear and detailed reply.


Doesn't is works with Java 16?

I have Java 16 but it shows this error
Extracting Crucial2-1.3.3.zip
Creating .minecraft directory
Creating symlinks
Creating launcher profiles
Installing modloader
Downloading https://files.minecraftforge.net/maven/net/minecraftforge/forge/1.16.5-36.2.2/forge-1.16.5-36.2.2-installer.jar
Status: 200
Traceback (most recent call last):
  File "/home/kushagra/Desktop/modpack-installer-master/install.py", line 196, in <module>
    main(args.zipfile, args.forge_disable)
  File "/home/kushagra/Desktop/modpack-installer-master/install.py", line 125, in main
    modloaders[modloader](manifest, mcver, mlver, packname, mc_dir, manual)
  File "/home/kushagra/Desktop/modpack-installer-master/forge_install.py", line 29, in main
    subprocess.run(['javac', 'ForgeHack.java'])
  File "/usr/lib/python3.9/subprocess.py", line 505, in run
    with Popen(*popenargs, **kwargs) as process:
  File "/usr/lib/python3.9/subprocess.py", line 951, in __init__
    self._execute_child(args, executable, preexec_fn, close_fds,
  File "/usr/lib/python3.9/subprocess.py", line 1821, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: 'javac'

Yes it should; however, you need the Java Development Kit (not just a JRE), as this tool needs to invoke the Java compiler.
Also, the JDK binaries (/usr/lib/jvm/{jdk name}/bin) need to be in your PATH; otherwise, this program will fail.
On a third note, automatic Forge installation only works for certain 1.12.2 Forge versions. I'd recommend using the --manual flag and setting the path manually.

Thanks
Get Outlook for Androidhttps://aka.ms/AAb9ysg

From: cdbbnny @.>
Sent: Tuesday, August 24, 2021 6:48:32 PM
To: cdbbnnyCode/modpack-installer @.>
Cc: Kushagra-Srivastava @.>; Author @.>
Subject: Re: [cdbbnnyCode/modpack-installer] Doesn't is works with Java 16? (#5)
Yes it should; however, you need the Java Development Kit (not just a JRE), as this tool needs to invoke the Java compiler.
Also, the JDK binaries (/usr/lib/jvm/{jdk name}/bin) need to be in your PATH; otherwise, this program will fail.
On a third note, automatic Forge installation only works for certain 1.12.2 Forge versions. I'd recommend using the --manual flag and setting the path manually.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/cdbbnnyCode/modpack-installer/issues/5#issuecomment-904634765, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AUCEXQG45WXCGFVT4EY4KVTT6OL2RANCNFSM5CUF6GEA.


Rename zeit to vercel

Hey! We're deprecating this repository hence why this PR hasn't been merged. I just updated the readme. Thanks for your contribution!


SmartBreadcrumbs does not work with MVC area

I have a MVC .net core Web Application.  I have a HomeController in the root controller folder.  I also have a EmployersController in the Employer folder under the areas.  When I click on Add Employer, it will put the breadcrumb correctly like "Home/Add Employer" with the URL (http://localhost:49932/Employer/Employers/AddEmployer) .  However, when I click on Home to go back to home, it took me to http://localhost:49932/Employer, which I guess to be the home of that area.  Is it possible to let it take me to http://localhost:49932/, which is the index URL for HomeController?

Can you please create a sample project and link it to me so that I try it?

Will close this due to inactivity.


Unity Build Issue on SQLite Plugins

Hello,
I just want to ask on how to fix auto copy files inside the folder Plugins when unity Build the app.

I didn't understand what you are talking about.
Do you want to know how to copy a file from Resources folder to another place?

Yes2x. but i think I'm in the wrong section to ask this question. Will Anyway yes I want to auto copy files when building the project.

A simple solution, that I use in my projects:
Put your file in the Resources folder, and rename it to add the ".txt" extension. Example: (mydatabase.db.txt)
Now you can to copy it from Resources to another place, like this:
TextAsset defaultDBTextAsset = Resources.Load("mydatabase.db") as TextAsset; // Dont use the .txt extension
string targetPath = System.IO.Path.Combine(Application.persistentDataPath, "mydatabase.db") ;
File.WriteAllBytes(targetPath , defaultDBTextAsset.bytes);

I was expecting on unity engine tool you can find something that check configurations , you'll just check some settings. I was not expecting to do some code staff. but Anyways thank you this could be a big help.


Jupyter notebooks for ice sheet ECVs

Notebook description
Notebook 1 (C3S_IC_GrIS_IV_UC1):
Quality assessment: Greenland ice sheet annual gridded velocity data from 2017 to present derived from satellite observations
Use Case: A study on the spatial variability of the uncertainty and fitness-for-purpose of the GrIS ice velocity product.
Use Question: How accurate is the GrIS ice velocity product and how does the uncertainty vary in space across the ice sheet?
Notebook 2 (C3S_IC_GMB_UC1):
Quality assessment: Gravimetric mass balance data for the Antarctic and Greenland ice sheets from 2003 to 2020 derived from satellite observations
Use Case: A study on the monthly and annual variability of the Greenland (GrIS) and Antarctic Ice Sheet (AIS) gravimetric mass balance (GMB) and its trend over time.
User Question: How well are the GrIS and AIS GMB products on the CDS suited to derive mean values, temporal variability and trends?
Notebook 3 (C3S_IC_GMB_UC2):
Quality assessment: Gravimetric mass balance data for the Antarctic and Greenland ice sheets from 2003 to 2020 derived from satellite observations
Use Case: A study on the accuracy of the GrIS and AIS gravimetric mass balance.
User Question: How accurate are the ice sheet gravimetric mass balance data for the GrIS and the AIS?
Notebook 4 (C3S_IC_SEC_UC1):
Quality assessment: Ice sheet surface elevation change rate for Greenland and Antarctica from 1992 to present derived from satellite observations
Use Case: A study on the monthly and annual variability of the Greenland (GrIS) and Antarctic Ice Sheet (AIS) surface elevation change (SEC) and its trend over time.
User Question: How well are the GrIS and AIS SEC products on the CDS suited to derive mean values, temporal variability and trends?
Notebook 5 (C3S_IC_SEC_UC2):
Quality assessment: Ice sheet surface elevation change rate for Greenland and Antarctica from 1992 to present derived from satellite observations
Use Case: A study on the spatial variability of the uncertainty / fitness-for-purpose of the GrIS and AIS surface elevation change product.
User Question: How accurate are the GrIS and AIS surface elevation change products and how does the uncertainty vary in space across the ice sheets?
Notebook link or upload
C3S_IC_GMB_UC1.zip
C3S_IC_GMB_UC2.zip
C3S_IC_GrIS_IV_UC1.zip
C3S_IC_SEC_UC1.zip
C3S_IC_SEC_UC2.zip
Anything else we need to know?
Download folder is still listed as my local folder
Environment

Hi @yoniv1,
The first template is ready. This one changed quite a bit, so please carefully check it and let me know if I'm doing anything wrong.
The main difference is that there's no need to use astropy nor convert the time axis.
Most of xarray, pandas, and numpy methods support datetime64 data (under the hood, they are stored in nanoseconds).
Therefore, we can use the original data. Note that the original data does not have monthly frequency (there are missing months as you pointed out in the notebook, but there's also a few months with more samples).

Here is the template: https://github.com/bopen/c3s-eqc-toolbox-template/blob/main/notebooks/wp5/gravimetric_mass_balance_trends.ipynb
Here is he notebook executed: https://gist.github.com/malmans2/0b0ac8de9d4888b21f1c177dc811ef42

Hi there,
The second notebook is ready. I integrated it to the first template, so same links as above.
Could you please check the errors units. In your notebook you compute the mean error, but then the units are changed from Gt to Gt/month. Is that right?

Hello,
The third notebook is also ready. I think the zoom in you notebook was wrong (y axis is flipped). I fixed it in the template.
Here are the templates:

https://github.com/bopen/c3s-eqc-toolbox-template/blob/main/notebooks/wp5/gravimetric_mass_balance_trends.ipynb
https://github.com/bopen/c3s-eqc-toolbox-template/blob/main/notebooks/wp5/greenland_ice_velocity.ipynb

Here are the notebooks executed:

https://gist.github.com/malmans2/0cf65fb6673840d8f145ea23208bfad8

Hi @yoniv1,
Unfortunately I can not work on the last two notebooks at the moment.
The product you are using is currently under maintenance: https://cds.climate.copernicus.eu/cdsapp#!/dataset/satellite-ice-sheet-elevation-change?tab=overview
I'll let you know when I'm able to download those data.

Hi @yoniv1,
The first template is ready. This one changed quite a bit, so please carefully check it and let me know if I'm doing anything wrong.
The main difference is that there's no need to use astropy nor convert the time axis. Most of xarray, pandas, and numpy methods support datetime64 data (under the hood, they are stored in nanoseconds). Therefore, we can use the original data. Note that the original data does not have monthly frequency (there are missing months as you pointed out in the notebook, but there's also a few months with more samples).

Here is the template: https://github.com/bopen/c3s-eqc-toolbox-template/blob/main/notebooks/wp5/gravimetric_mass_balance_trends.ipynb
Here is he notebook executed: https://gist.github.com/malmans2/0cf65fb6673840d8f145ea23208bfad8

Hi @malmans2
Looks good! I'll run it on monday. Is there any way we can make those 14.1% missing months in the time series visible? For example by a shaded interval in the background of the time series if a temporal data point is missing?
Thanks!

Hi there,
The second notebook is ready. I integrated it to the first template, so same links as above. Could you please check the errors units. In your notebook you compute the mean error, but then the units are changed from Gt to Gt/month. Is that right?

Hi Mattia @malmans2,
I think the units of individual monthly GMB measurements and their errors have units Gt month-1 (as the temporal resolution is more or less a month (not exactly though) and thus also their mean value have those units) whereas seen cumulatively, the units change to Gt (as in the time series)

Hi,
Please have a look at the latest template and let me know if any units is not correct.
I've added markers to the timeseries so it's easy to spot when there's larger time gaps (shades would require some sort of interpolation). Also, I've added a plot with the time difference in month.

https://gist.github.com/malmans2/0cf65fb6673840d8f145ea23208bfad8

Hi @malmans2
Looks good! Just a few remarks:

in the GMB notebook in your new time gap plot, what does it mean if there is a time gap of 0 months? Does this mean 2 measurements were conducted in the same month? In that case, it might be a bit confusing, since this could be for example 2 measurements on 1 January and 31 January respectively, and then you would still have a time gap of 0 months between two measurements.
Can you put units [yr] for time series which have time on the x-axis?
Can you change the units for the error estimate time series to Gt month^-1 as well (not the error bars, but the graph above it)?
In the printed out text of the acceleration of the mass changes, can you change the acceleration to 2*x^2 (as with the glacier mass change notebook, see my other issue on Github). So the equation for Antarctica is -1.177x^2 + ..., the acceleration is then -2.354 Gt yr^-2.
In the velocity notebook, can you make the Greenland maps a bit more elongated along the y-axis (i.e. so the map get stretched out a bit more above and below, it looks quite compressed now).

Thanks!

in the GMB notebook in your new time gap plot, what does it mean if there is a time gap of 0 months? Does this mean 2 measurements were conducted in the same month? In that case, it might be a bit confusing, since this could be for example 2 measurements on 1 January and 31 January respectively, and then you would still have a time gap of 0 months between two measurements.

That's the point I was tying to make about units. Sometimes the gap is much less then a month. This is what I was doing:
compute gap (in ns), convert to months, round to integer. I removed the rounding step, so you can see the exact gap. The minimum gap is 0.35month, which is about 11 days.

Can you put units [yr] for time series which have time on the x-axis?

Done, but be careful! The time unit is encoded in the datetime object, technically speaking it's not correct to hardcode it. When you plot time axis, xarray/matplolib/pandas are quite smart and pick a sensible string format for the ticks. Because you have a long timeseries, YYYY is chosen. If your timeseries was shorter (e.g., 1 month), you'd see YYYY-DD-MM.

Can you change the units for the error estimate time series to Gt month^-1 as well (not the error bars, but the graph above it)?

Done

In the printed out text of the acceleration of the mass changes, can you change the acceleration to 2*x^2 (as with the glacier mass change notebook, see my other issue on Github). So the equation for Antarctica is -1.177x^2 + ..., the acceleration is then -2.354 Gt yr^-2.

Done

In the velocity notebook, can you make the Greenland maps a bit more elongated along the y-axis (i.e. so the map get stretched out a bit more above and below, it looks quite compressed now).

Data is cached, you should be able to tune the plots yourself and decide how you want to present the results (e.g., change labels, figure sizes, colors, ...). The goal of these templates is just to help you out developing efficient notebooks, so they are quite general.
Side note: I'm using equal aspect ration for x/y axis. I thought that's the right way to plot using the underlying projection (I believe it's ESPG4326). If that's not the right projection, you should probably reproject (e.g., get a lat/lon projection rather than x/y), and plot using cartopy. If you don't care about the projection, you can just remove the equal axis constraint in the plotting function.
Let me know if the new template looks OK. In the meantime, I'll work on the last 2 notebooks. Looks like those data is now available on the CDS.

in the GMB notebook in your new time gap plot, what does it mean if there is a time gap of 0 months? Does this mean 2 measurements were conducted in the same month? In that case, it might be a bit confusing, since this could be for example 2 measurements on 1 January and 31 January respectively, and then you would still have a time gap of 0 months between two measurements.

That's the point I was tying to make about units. Sometimes the gap is much less then a month. This is what I was doing: compute gap (in ns), convert to months, round to integer. I removed the rounding step, so you can see the exact gap. The minimum gap is 0.35month, which is about 11 days.

Can you put units [yr] for time series which have time on the x-axis?

Done, but be careful! The time unit is encoded in the datetime object, technically speaking it's not correct to hardcode it. When you plot time axis, xarray/matplolib/pandas are quite smart and pick a sensible string format for the ticks. Because you have a long timeseries, YYYY is chosen. If your timeseries was shorter (e.g., 1 month), you'd see YYYY-DD-MM.

Can you change the units for the error estimate time series to Gt month^-1 as well (not the error bars, but the graph above it)?

Done

In the printed out text of the acceleration of the mass changes, can you change the acceleration to 2*x^2 (as with the glacier mass change notebook, see my other issue on Github). So the equation for Antarctica is -1.177x^2 + ..., the acceleration is then -2.354 Gt yr^-2.

Done

In the velocity notebook, can you make the Greenland maps a bit more elongated along the y-axis (i.e. so the map get stretched out a bit more above and below, it looks quite compressed now).

Data is cached, you should be able to tune the plots yourself and decide how you want to present the results (e.g., change labels, figure sizes, colors, ...). The goal of these templates is just to help you out developing efficient notebooks, so they are quite general. Side note: I'm using equal aspect ratio for x/y axis. I thought that's the right way to plot using the underlying projection (I believe it's ESPG4326). If that's not the right projection, you should probably reproject (e.g., get a lat/lon projection rather than x/y), and plot using cartopy. If you don't care about the projection, you can just remove the equal axis constraint in the plotting function.
Let me know if the new template looks OK. In the meantime, I'll work on the last 2 notebooks. Looks like those data is now available on the CDS.

Hi Mattia,
Thanks for the changes, it looks good!

Hi @yoniv1,
The ice sheet templates are also ready.
I've added 3 new templates:

https://github.com/bopen/c3s-eqc-toolbox-template/blob/main/notebooks/wp5/ice_sheet_all_data.ipynb
https://github.com/bopen/c3s-eqc-toolbox-template/blob/main/notebooks/wp5/ice_sheet_maps.ipynb
https://github.com/bopen/c3s-eqc-toolbox-template/blob/main/notebooks/wp5/ice_sheet_timeseries.ipynb

Here are the notebook executed: https://gist.github.com/malmans2/2e65212b09ce252edcab3fed63b92677
Please let me know if they work OK.

Hi @yoniv1,
The ice sheet templates are also ready. I've added 3 new templates:

https://github.com/bopen/c3s-eqc-toolbox-template/blob/main/notebooks/wp5/ice_sheet_all_data.ipynb
https://github.com/bopen/c3s-eqc-toolbox-template/blob/main/notebooks/wp5/ice_sheet_maps.ipynb
https://github.com/bopen/c3s-eqc-toolbox-template/blob/main/notebooks/wp5/ice_sheet_timeseries.ipynb

Here are the notebooks executed: https://gist.github.com/malmans2/2e65212b09ce252edcab3fed63b92677
Please let me know if they work OK.

Hi @malmans2
This looks great, thanks!


Reporter option : html, json, text, text-summary, badge (pick as many as you want)

Today, codehack-cli produce a cli output and badges. Badges can be disabled by cli option.
Like nyc does, it could produce output depending on selected reporters :

html (like html-coverage report)
json (all the results content dump in a json file)
badges
text (like the actual one in stdout, perhaps with an option like codehawk-cli already have to display all files or only the x worst)
text-summary (results.summary as text-output)

Today, it's hard for me to add a reporter matching my need without producing a bad smell code. Example in #115.
Reporters architecture could help me working/contributing on UI without understanding or breaking the complexity/maintainability code.
What do you think about it ?

Yep, I am open to this for sure.
A nyc-style reporting option makes sense, since this project is very similar.


fix some punctuation in index.html

put mdashes where they belong
put commas after e.g.
wrap a thing or two in backticks (which ReSpec will turn into <code /> wrappers)

e.g.:
Using character escapes in markup and CSS describing "when not to use escapes" https://www.w3.org/International/questions/qa-escapes#not :

It is almost always preferable to use an encoding that allows you to represent characters in their normal form, rather than using named character references or numeric character references.

Character Model for the World Wide Web: Fundamentals provides a common reference for text-manipulation, in particular a guideline for when to use escapes https://www.w3.org/TR/charmod/#C047 :

Escapes SHOULD only be used when the characters to be expressed are not directly representable in the format or the character encoding of the document, or when the visual representation of the character is unclear.

More generally, the Internationalization Best Practices for Spec Developers https://www.w3.org/TR/international-specs/ informatively references Character Model for the World Wide Web: Fundamentals's "character escaping" for basic guidelines related to the use of characters and encodings https://www.w3.org/TR/charmod/#sec-Escaping - among which is guideline C047 (linked above) although it is not explicitly called out in international-specs.

@csarven — I've merged your — in place of my —, but I will also note that WHEN ESCAPES CAN BE USEFUL (which follows WHEN NOT TO USE ESCAPES) says that a "particularly useful role for escapes is to represent characters that are invisible or ambiguous in presentation."  I believe this applies to hyphen vs en-dash vs em-dash, particularly when working in spaces where monospaced fonts are common (e.g., source editors).  Reasonable minds may differ.

If everyone's ok, I'll commit this PR soon.


[WIP] NuClick Tutorial

Signed-off-by: vnath<EMAIL_ADDRESS>Description
Adding NuClick Tutorial based on upcoming integrations to MONAI Core.
Status
Work in progress
Checks

[ ] Notebook runs automatically ./runner [-p <regex_pattern>]

I think these look reasonable, I can do some more polishing perhaps.
@wyli please check it out
@SachidanandAlle please provide some more thoughts for the visualization of transforms, if we need them.

@SachidanandAlle Thanks, will add the suggested kind of explanation for inference ..
@wyli I'll reach out again after updating Sachi's comments

@SachidanandAlle please check the changes.
@wyli Tests are running locally, will push again once tests finish etc.

LGTM

@wyli all tests cleared, thank you for the support

@wyli nuclick tests excluded from runner.sh as suggested. Links for pre-trained weight has also been added.


Updated release version for CDN republish

Updated version to 2.7.10 where needed (Readme,  package, etc)
https://github.com/photonstorm/phaser-ce/pull/222#issuecomment-302050710

Have you checked this is < 50MB? :)

Yeah, way less 👍  I can't imagine how it'd hit that limit

Ok. If you all want a 2.7.10 release then it needs to be packaged properly before I publish it. So update the readme + changelog, republish the docs and defs, and rebuild. Then I can npm publish and tag it (which the cdn will then hopefully pick up). @samme not sure if you want to merge any other changes into 2.7.10 first?

I can package a new release.
I think the 50MB limit must refer to the uncompressed size of the entire package.

Yeah, I agree, as the past 2 versions haven't been > 50MB. It must be calculating things differently now.

Merged in #228, thanks.


GeekOpsUA та Дизайн спільноти у фб

GeekOpsUA:
_https://discord.gg/jNwNr7g97F_
Чат про DevOps, знижки на курси, сертифікацію та пошуки роботи.
Contributor's Checklist:

[x] I have read and understood the contribution rules. My submission complies with these rules.
[x] My submission is grammatically correct.
[X] My submission follows the general Awesome List guidelines. You can check it running the Awesome Lint locally. We also run linter on CI.

By submitting this pull request I confirm I've read and complied with the below requirements 🖖

Hello, @grem11n
Could you, please, take a look?
Thanks.


Truffle does not migrate contracts to QM

In my migrations file I do the following:
https://gist.github.com/stefanionescu/6f0b2f565c34956f4e91cb35ddff77fb
Before migrating I unlock the first node with this code:
https://gist.github.com/stefanionescu/24e60d6ffa97011d2b921be47e91c950
Regardless, when I migrate to "node1Public", I don't see the transactions in QM. Do I do something wrong?

You may need to downgrade Truffle to v4.1.x or try https://github.com/trufflesuite/truffle/pull/1806
Also can you confirm that the port in truffle actually maps to what was set up in quorum-maker

Please reopen this if this solution does not work


64-bit bitpacked field support, more supported data types

All the BigInt stuff slows down loading by a HUGE amount (not sure it'll ever be done loading). Might need to only use it on fields that we -know- are 64-bit, but that complicates things a bit more. Pushing as draft for now, likely won't make it in time for 0.1.8.

Did a good amount of cleanup, should be more reviewable now.