Text alignment is not proper

The text alignment of the names are not proper, Please assign me this issue, i would like to work on it.
@vishanurag

Hi! I am eager to solve this issue and i will do the proper alignment of privacy page as well do i need to create new issue for that or assign this to me i will do it through this issue only. Please assign this issue to me.


Adding SBTB event

This is just a general promo for SBTB isn't it? It's fine to promote any Typelevel specific activities and mention the main conference in that context, but I think this it a bit too generic to belong on this typelevel.org as it stands.
@adelbertc, were you coordinating a Typelevel hack day/unconference/track at SBTB? Maybe you could describe what people can expect from that and help @anicolaspp rework the post more along the lines of the Lambda World one?

@milessabin No plans to coordinate a Typelevel track on my end. I remember we had entertained the idea of one but I think that fell through :/

Ok I was a little puzzled about this too. If there's no Typelevel event I don't think it really belongs on the website.

Well, according to typelevel/general/issues/29 there will be a typelevel track ... (if not, that issue probably should be closed).

Hmm ... that's a bit of a shame. Seems like a bit of a missed opportunity given that many TL contributors will be there, I'll be keynoting etc. etc.
I had thought that @adelbertc was coordinating something, but I guess not. Can anyone else pick up where he left off?

Apologies if I gave the impression I was planning something - I recall we tried reaching out to Alexy but at some point it slipped through the cracks. If you think we still have time to plan something I'd love to help. Never planned anything like this before so I'm not sure where to begin, but tell me what to do and you have my assistance :-)

SBTB is over so probably no Typelevel event ;)
That being said we did have a lunch gathering today to plan the next Typelevel Summit so stay tuned for more info!


renderToFile stops background audio being played on iOS

macOS Version(s) Used to Build
macOS 14 Sonoma
Xcode Version(s)
Xcode 14
Description
Hi,
I'm using AudioEngine and PitchShifter to apply an effect on an audio file.
I'm rendering an output file using engine.renderToFile. However, while rendering is being done other apps playing audio are getting paused.
I thought renderToFile used offline rendering, in which case I don't get why the shared AudioSession is getting tampered.
Is this an expected behavior, or I am missing something ?
Here is what I'm doing (removed optional handling etc for readability)
let engine = AudioEngine()
let inputFile = try AVAudioFile(forReading: inputURL)
let player = AudioPlayer(file: inputFile)
let pitchShifter = PitchShifter(player)
pitchShifter.shift = 10
engine.output = pitchShifter
try engine.renderToFile(
    outputFile,
    duration: inputFile.duration,
    prerender: { player.play() }
)

Thanks for helping
Crash Logs, Screenshots or Other Attachments (if applicable)
No response

Did you try setting the AVAudioSession to mixWithOthers? https://github.com/AudioKit/Cookbook/blob/1baba791b27e172ca0d4c548b66d42264ce8768d/Cookbook/Cookbook/CookbookApp.swift#L28

Hi, yeah I tried that and it obviously worked, but I don't get why a supposed offline rendering mode has to deal with audio session. It should only process audio frames

In the AudioKit render() method it looks like it is calling start() on AVAudioEngine after setting .offline render mode which state:
open class AVAudioEngine : NSObject {
...
On AVAudioSession supported platforms, this method may cause the audio session to be implicitly activated. It is recommended to configure and activate the app's audio session before starting the engine. For more information, see the `prepare` method above.
    */
    open func start() throws

The underlying engine is also reset() so I'm guessing one of these things might be the culprit. (Render method for reference):
func render(to audioFile: AVAudioFile,
                maximumFrameCount: AVAudioFrameCount = 4096,
                duration: Double,
                renderUntilSilent: Bool = false,
                silenceThreshold: Float = 0.00005,
                prerender: (() -> Void)? = nil,
                progress progressHandler: ((Double) -> Void)? = nil) throws
    {
        guard duration >= 0 else {
            throw NSError(domain: "AVAudioEngine ext", code: 1,
                          userInfo: [NSLocalizedDescriptionKey: "Seconds needs to be a positive value"])
        }

        // Engine can't be running when switching to offline render mode.
        if isRunning { stop() }
        try enableManualRenderingMode(.offline,
                                      format: audioFile.processingFormat,
                                      maximumFrameCount: maximumFrameCount)

        // This resets the sampleTime of offline rendering to 0.
        reset()
        try start()

        guard let buffer = AVAudioPCMBuffer(pcmFormat: manualRenderingFormat,
                                            frameCapacity: manualRenderingMaximumFrameCount)
        else {
            throw NSError(domain: "AVAudioEngine ext", code: 1,
                          userInfo: [NSLocalizedDescriptionKey: "Couldn't create buffer in renderToFile"])
        }

        // This is for users to prepare the nodes for playing, i.e player.play()
        prerender?()

        // Render until file contains >= target samples
        let targetSamples = AVAudioFramePosition(duration * manualRenderingFormat.sampleRate)
        let channelCount = Int(buffer.format.channelCount)
        var zeroCount = 0
        var isRendering = true

        while isRendering {
            if !renderUntilSilent, audioFile.framePosition >= targetSamples {
                break
            }
            let framesToRender = renderUntilSilent ? manualRenderingMaximumFrameCount
                : min(buffer.frameCapacity, AVAudioFrameCount(targetSamples - audioFile.framePosition))

            let status = try renderOffline(framesToRender, to: buffer)

            // Progress in the range of starting (0) - finished (1)
            var progress: Double = 0

            switch status {
            case .success:
                try audioFile.write(from: buffer)
                progress = min(Double(audioFile.framePosition) / Double(targetSamples), 1.0)
                progressHandler?(progress)
            case .cannotDoInCurrentContext:
                Log("renderToFile cannotDoInCurrentContext", type: .error)
                continue
            case .error, .insufficientDataFromInputNode:
                throw NSError(domain: "AVAudioEngine ext", code: 1,
                              userInfo: [NSLocalizedDescriptionKey: "render error"])
            @unknown default:
                Log("Unknown render result:", status, type: .error)
                isRendering = false
            }

            if renderUntilSilent, progress == 1, let data = buffer.floatChannelData {
                var rms: Float = 0.0
                for i in 0 ..< channelCount {
                    var channelRms: Float = 0.0
                    vDSP_rmsqv(data[i], 1, &channelRms, vDSP_Length(buffer.frameLength))
                    rms += abs(channelRms)
                }
                let value = (rms / Float(channelCount))

                if value < silenceThreshold {
                    zeroCount += 1
                    // check for consecutive buffers of below threshold, then assume it's silent
                    if zeroCount > 2 {
                        isRendering = false
                    }
                } else {
                    // Resetting consecutive threshold check due to positive value
                    zeroCount = 0
                }
            }
        }

        stop()
        disableManualRenderingMode()
    }

Indeed. However, this seems like a bug to me, as rendering to a file in an offline mode shouldn't have a side-effect on audio session


[KeyVault] - Update swagger for SKR per archboard

During the recent archboard review for the SDKs there were a few client-side renames that we'd like to have. This PR adds them via the x-ms-client-name property to allow our code generators to pick up these new names.
MSFT employees can try out our new experience at OpenAPI Hub  - one location for using our validation tools and finding your workflow.

Changelog
Add a changelog entry for this PR by answering the following questions:

What's the purpose of the update?

[ ] new service onboarding
[ ] new API version
[ ] update existing version for new feature
[ ] update existing version to fix swagger quality issue in s360
[ ] Other, please clarify

When are you targeting to deploy the new service/feature to public regions? Please provide the date or, if the date is not yet available, the month.
When do you expect to publish the swagger? Please provide date or, the the date is not yet available, the month.
If updating an existing version, please select the specific langauge SDKs and CLIs that must be refreshed after the swagger is published.

[ ] SDK of .NET (need service team to ensure code readiness)
[ ] SDK of Python
[ ] SDK of Java
[ ] SDK of Js
[ ] SDK of Go
[ ] PowerShell
[ ] CLI
[ ] Terraform
[ ] No refresh required for updates in this PR

Contribution checklist:

[ ] I commit to follow the Breaking Change Policy of "no breaking changes"
[ ] I have reviewed the documentation for the workflow.
[ ] Validation tools were run on swagger spec(s) and errors have all been fixed in this PR. How to fix?

If any further question about AME onboarding or validation tools, please view the FAQ.
ARM API Review Checklist

Applicability: :warning:
If your changes encompass only the following scenarios, you should SKIP this section, as these scenarios do not require ARM review.

Change to data plane APIs
Adding new properties
All removals

Otherwise your PR may be subject to ARM review requirements. Complete the following:

[ ] Check this box if any of the following apply to the PR so that label “WaitForARMFeedback” will be added automatically to begin ARM API Review. Failure to comply may result in delays to the manifest.

Adding a new service
Adding new API(s)
Adding a new API version
-[ ] To review changes efficiently, ensure you copy the existing version into the new directory structure for first commit and then push new changes, including version updates, in separate commits.

[ ] Ensure you've reviewed following guidelines including ARM resource provider contract and REST guidelines. Estimated time (4 hours). This is required before you can request review from ARM API Review board.

[ ] If you are blocked on ARM review and want to get the PR merged with urgency, please get the ARM oncall for reviews (RP Manifest Approvers team under Azure Resource Manager service) from IcM and reach out to them.

Breaking Change Review Checklist
If any of the following scenarios apply to the PR, request approval from the Breaking Change Review Board as defined in the Breaking Change Policy.

[ ] Removing API(s) in a stable version
[ ] Removing properties in a stable version
[ ] Removing API version(s) in a stable version
[ ] Updating API in a stable or public preview version with Breaking Change Validation errors
[ ] Updating API(s) in public preview over 1 year (refer to Retirement of Previews)

Action: to initiate an evaluation of the breaking change, create a new intake using the template for breaking changes. Addition details on the process and office hours are on the Breaking change Wiki.
Please follow the link to find more details on PR review process.

@jlichwa @herveyw-msft you okay with this? Should impact nothing more than generated clients using https://github.com/azure/autorest. Doesn't change the wire format at all.

Also, @jlichwa, I'm OOF tomorrow so if you're good with this, see if @tjprescott can merge it. I could now and will be online for a while yet today, but wanted to check with you first.


Refactor spark datasource

          does SparkSqlFunctionResponseHandle required, it do same thing as SparkSqlFunctionTableScanOperator

Originally posted by @penghuo in https://github.com/opensearch-project/sql/pull/1790#discussion_r1254854194

https://github.com/opensearch-project/sql/pull/1790#discussion_r1255023754


Alerts: support for fade

I would to have my alert fade out when clicked, rather than just be removed immediately from the DOM.  Ideally, I need a notification after the alert is invisible so that I can choose to remove it then (or at least, remove the directive containing the alert).
Right now, I'm kludging something together using a  with class "fade in", and I remove the "in" when closing. I then guess how long until it is invisible before removing from the DOM.

Has this been implemented? Should this issue be re-opened or is there some other place to track this feature?

I think this would be a good feature, which does not look like its been implemented yet.
@wesleycho, was there a decision not to add this feature in? I can look into opening a PR for this in the next few days.

@deeg, I did a really quick and dirty plunker to demo how we might do this.  Fading in is easy, you just add the in class to the element with the fade class.  Fading out stinks and basically involves incrementally decreasing the element's opacity until it's effectively invisible before removing it from the scope.

Here's a MUCH better plunker using the $animateCss service.

I'm going to move ahead with integrating alerts and migrating to latest release (1.0.3) and once that's done, I'll take look at the above suggestions. Thanks!

Should this issue be re-opened or should I create a new issue?


Support for ES2015 module as output format of sw-build

Library Affected:
sw-build
Right now, you can call generateFileManifest() on sw-build and get a file that, when imported, will set a __file_manifest global variable, based on this template.
Unless @gauntface objects, I'll add in support for doing something similar, but with a ES2015 module format as the template, and a method name like generateES2015FileManifest(). (I could imagine that method name might be improved upon.)

Maybe passing in a parameter to the function for format: 'es2015' would be a better approach?

Sure, that would be cleaner. If I went that route then it might make sense to adopt the Rollup syntax for its format option, and take in either 'iife' or 'es'.
Though I'd think in that case it should be a required parameter, instead of trying to default to one.

I think having a default is fine, only request from me is that it be something that runs in the browser. +1 following rollups format option.

Okay. Will do.

This was fixed in https://github.com/GoogleChrome/sw-helpers/pull/225

Sure, that would be cleaner. If I went that route then it might make sense to adopt the Rollup syntax for its format option, and take in either 'iife' or 'es'.

I like the idea of adopting Rollup's convention for formatting here. Consistency would also help devs reason about how to use this across different tools. 👍 from me!


gRPC Client - RpcException is thrown much later than the deadline (under high load, C#)

What version of gRPC and what language are you using?
C#, 1.17.0
What operating system (Linux, Windows, …) and version?
Windows Server 2016 standard
Windows 10 (locally)
What runtime / compiler are you using (e.g. python version or version of gcc)
.net core 2.1, hosted in iis
What did you do?
We have two services (asp.net core 2.1) interacting through gRPC (v 1.17.0).
The client sends requests to the second service with deadline=now+1s (DateTime.UtcNow.AddSeconds(1))
With a low load, everything is fine. If the server doesn't stop processing a request after the deadline, the client stops waiting for a response. (And throws RpcException with the status "Deadline Exceeded")
But at peak loads (~1K-2K RPS), an exception may occur 5-10 seconds after the request is sent, despite the deadline.
I tried to reproduce this behavior in the test project:
https://github.com/Chakrygin/GrpcDeadline
(in this project client starts 1000 threads and sends requests with deadline=1s, but RpcException is thrown only after 2-5 seconds on my machine)
It turns out that we cannot stop waiting the execution of the request (on the client side), even if the deadline has come.
How to handle such situations correctly?

It seems that this behavior is not related to the gRPC. The same effect is reproduced with HttpClient.
Thanks!


FileNotFoundError when using cache in parallel

Description
I've got a pytest test suite and I've recently started running it with -n 3, using pytest-xdist, so it'll run on 3 processes in parallel. I sometimes get a warning like this one:
test_polina/test_golden_runs.py::test_ipd_three_agent_golden_run
  C:\Program Files\Python312\Lib\site-packages\jax\_src\compiler.py:688: UserWarning: Error writing persistent compilation cache entry for 'jit_scan_outer_bigs': FileNotFoundError: [WinError 2] The system cannot find the file specified: 'J:\\jaxxy\\_temp_jit_scan_outer_bigs-43cfe1699669be4ee80585eba899a893fea7eb948b6e707293e0235d7fdbffe0' -> 'J:\\jaxxy\\jit_scan_outer_bigs-43cfe1699669be4ee80585eba899a893fea7eb948b6e707293e0235d7fdbffe0'
    warnings.warn(

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

When it does happen, the tests run a lot slower. I'm guessing sometimes the tests attempt to manipulate the cache at the same time and clash with each other, causing the cache to not be used and triggering compilation. I can't reliably reproduce this problem.
System info (python version, jaxlib version, accelerator, etc.)
jax:    0.4.30
jaxlib: 0.4.30
numpy:  1.26.4
python: 3.12.1 (tags/v3.12.1:2305ca5, Dec  7 2023, 22:03:25) [MSC v.1937 64 bit (AMD64)]
jax.devices (1 total, 1 local): [CpuDevice(id=0)]
process_count: 1
platform: uname_result(system='Windows', node='Turing', release='10', version='10.0.19045', machine='AMD64')

$ nvidia-smi
Mon Jul 29 15:48:53 2024
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 456.71       Driver Version: 456.71       CUDA Version: 11.1     |
|-------------------------------+----------------------+----------------------+
| GPU  Name            TCC/WDDM | Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  GeForce GT 710     WDDM  | 00000000:01:00.0 N/A |                  N/A |
| 50%   52C    P0    N/A /  N/A |   1627MiB /  2048MiB |     N/A      Default |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+

Can you try jax 0.4.31 which is just released?

I upgraded to 0.4.31 and now I'm getting different warnings:
  C:\Users\Administrator\.venvs\polina_env\Lib\site-packages\jax\_src\compiler.py:663: UserWarning: Error reading persistent compilation cache entry for 'jit_run_evaluation_rollout': PermissionError: [Errno 13] Permission denied: 'J:\\jaxxy\\jit_run_evaluation_rollout-ae9e0a0f7ccd64b22e7749a155df1b10cd93374b9af8ff3154d62baafe614222-atime'
    warnings.warn(

test_polina/test_dumb_on_dumb.py::test_dumb_on_dumb
  C:\Users\Administrator\.venvs\polina_env\Lib\site-packages\jax\_src\compiler.py:663: UserWarning: Error reading persistent compilation cache entry for 'jit_evaluate_population_vs_fixed_policies': PermissionError: [Errno 13] Permission denied: 'J:\\jaxxy\\jit_evaluate_population_vs_fixed_policies-f84b39d478dddc89b532239150355f5d699747470f65562e377b663be8e93bcc-atime'
    warnings.warn(

There were about 10 more, and all the filenames end with -atime, none end with -cache.

I think the key thing is that the temporary file the cache writes to does not have a per-process unique name:
https://github.com/google/jax/blob/fed7efd73003988282744b2f649df493b808c781/jax/_src/gfile_cache.py#L37-L55
All processes will attempt to open the same tmp_path = self._path / f"_temp_{key}", and any but the first will error.
A possible fix is suffixing the temporary file with the host and process id.
I include the hostname, since the usecase that brought me here is reusing the same cache for processes in possibly the same node but different MPI groups, but also processes in different nodes. In which case it is also important to differentiate based on hostname.
In NFS, a more complex solution and possibly unnecessary operation is doing NFS locking like described  here (see D) , or done in flufl.lock.

@LunarLanding The file you mentioned has been removed in recent version of JAX. Can you try again with the latest version?

@ayaka14732 I see, I mistakenly navigated to old code. Here’s the code in version 0.4.32, which works for a single machine if you have eviction enabled, but I’m not sure will work for NFS ( since SoftFileLock does not seem to follow all the steps described the link above regarding NFS; compare with flufl.lock implementation)
https://github.com/google/jax/blob/1594d2f30fdbfebf693aba4a2b264e4a3e52acc6/jax/_src/lru_cache.py#L120-L160

@ayaka14732 I see, I mistakenly navigated to old code. Here’s the code in version 0.4.32, which works for a single machine if you have eviction enabled, but I’m not sure will work for NFS ( since SoftFileLock does not seem to follow all the steps described the link above regarding NFS; compare with flufl.lock implementation)
https://github.com/google/jax/blob/1594d2f30fdbfebf693aba4a2b264e4a3e52acc6/jax/_src/lru_cache.py#L120-L160

Numba had to deal with the same issue. Instead of making a key that incorporates hostname/pid, they just open a temp file with a name built from a uuid:
https://github.com/numba/numba/blob/301ba23116864ef66a2caccfab7c7123e7bcbcfc/numba/core/caching.py#L599-L616


unify the spec argument definition for request (for unittest and ops script)

There are multiple locations for the spec definition for tests which makes hard to maintain.
They are under WMCore/WMSpec,  test/data/reqmgr and WMQuailty/Emulators/WMSpecGenerator, which need to located in one place
the candidates are either WMCore/WMSpec or  test/data/reqmgr

fixed


[T4A5][W09-A2]Dylan Sng

Work in progress

@dylansyj
Some comments added. Please close the PR after reading comments. Good job for doing many activities.


Desk Fan Import

Update includes:

Desk fan model (in 3 parts: base, motor, and blades)
Texture and material for fan
Desk fan prefab combining the model into a single object

Preview fan: ArtAssetsPreview scene

 Fan Model


Added rename button to right-click menu in the scene hirearchy

Added a simple rename button when right clicking an entity in the scene hierarchy.
Just a neat feature I wanted, and I want to experiment with Open Source projects.

Thanks for your contribution. To give some feedback for an open source project; we rely on the imgui.ini file to give a 'default' layout to imgui at this point. This file should show no changes in your PR. Other than that, you could've filled in the PR layout. It is a nice feature suggestion 👍

Obsolete.


overriding libclang on dependency does not propagate to workspaceShell

When building my project with cargo build, I get an error telling me that LIBCLANG_PATH is empty for dependency minisat:
  --- stderr
  thread 'main' panicked at 'Unable to find libclang: "couldn't find any valid shared libraries matching: ['libclang.so', 'libclang-*.so', 'libclang.so.*'], set the `LIBCLANG_PATH` environment variable to a path where one of these files can be found (invalid: [])"', /home/stites/.cargo/registry/src/github.com-1ecc6299db9ec823/bindgen-0.42.3/src/lib.rs:1664:31

I thought the obvious long term solution would be to override the derivation in the pkgs.rustBuilder.makePackageSet function defined in flake.nix:
          packageOverrides = pkgs: pkgs.rustBuilder.overrides.all ++ [
            (pkgs.rustBuilder.rustLib.makeOverride {
              name = "minisat";
              overrideAttrs = old: {
                nativeBuildInputs = old.nativeBuildInputs ++ [ pkgs.llvmPackages.libclang ];
                LIBCLANG_PATH = pkgs.lib.makeLibraryPath [ pkgs.llvmPackages.libclang.lib ];
              };
            })
          ];
        };

But I still get the same error. I can fix this issue by adding the path to my workspaceShell (ie: LIBCLANG_PATH = pkgs.lib.makeLibraryPath [ pkgs.llvmPackages.libclang.lib ];) but I was hoping that cargo2nix would build the dependency in the background and cargo build would lookup the cached result. Is this a bug or am I misunderstanding the relationship between cargo and cargo2nix?

Asked and answered. The extra caching must happen during nix build. Cargo development shouldn't be encapsulated in nix.

Use propagatedBuildInputs and the variable should make it out.  If not, see the propagateEnv function to be sure it makes it to the shell.
There's some side effects I don't like about propagateEnv that cause #238   If it works fine for you, great.  I'll make sure there's a better replacement if I can't fix it.
Libs don't have host / target offsets since they aren't executed, so no need for native


start mapping new enchantment system

I think the enchantment provider classes C_dpsarzgt, C_swckftoh, and C_ycmdmexf need mapping along with the providers classes: p (EnchantmentProviders): C_fudougzs and C_hzfgfhbe. This could be a seperate PR thought

I'll map those in my next PR


Allow passing trusted subnets

Fixes #6

Coverage remained the same at 100.0% when pulling 7a3f6786f82526cff7b42c8c0fe8fa73b43bd266 on allow-passing-trusted-subnets into 3c69a5d003ac70c7a3418b8c5fff4fd15794e14f on master.

Coverage remained the same at 100.0% when pulling 7b2339885a6080e68ea8483042ce06cf4f027bd4 on allow-passing-trusted-subnets into 3c69a5d003ac70c7a3418b8c5fff4fd15794e14f on master.


Where to get Windows build?

Hi.
Now, when appveyor is removed, where do I get Windows builds?

You can find them attached to the releases.
E.g. https://github.com/xiph/rav1e/releases/tag/v0.3.2

So no cutting edge, frequent releases from now on? :(

I'll try to get back to make pre-releases more often, sadly I had to focus on something different in the past months.


vcf-miner with ped files?

Hello,
If I understand correctly, vcf-miner does not utilize pedigree information to filter for variants. Is this correct? If so, is there any development in progress that would see this implemented in future releases?
thanks very much
Arun

Arun,
Can you describe the feature a little bit more that you are requesting?  You should be allowed to filter by different combinations of samples - even without a PED file.

Hello Steven,
Thanks for your quick response. I am looking to carry out analysis with
trios: denovo calling, compound heterozygotes and such. Is there a way to
carry this out in the current release?
thanks
On Tue, Jun 21, 2016 at 5:03 PM, Steven N Hart<EMAIL_ADDRESS>wrote:

Arun,
Can you describe the feature a little bit more that you are requesting?
You should be allowed to filter by different combinations of samples - even
without a PED file.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/Steven-N-Hart/vcf-miner/issues/2#issuecomment-227571102,
or mute the thread
https://github.com/notifications/unsubscribe/AFzoBpnWXTR4dTRXXMi8LP1iAaUIAfJVks5qOFGggaJpZM4I7J1Z
.

Yes.
To get de novo:
create a group for the parents And 1 for the Child.
In the Custom Tab of the filter modal, select "Variants NOT IN Group", with the "Either" radio button selected where the value = "Parents".  This removes any variant found in mom OR dad - hence de novo.
For compound het, select "Variants IN Group" = "Parent", but this time select heterozygous.  Next add another filter where "Variants IN Group" = "Child" and set the genotype to "Heterozygous".  Now, to get true compound hets - assuming neither parent has the disease, you would further select " "Variants NOT IN Group" = "Parent" but select "Homozygous" (remove variants that are homozygous in either parent)
Make sense?

Yes, makes sense. Let me try it out and let you know of I run into any
difficulties.
Cheers
Arun
On Tuesday, June 21, 2016, Steven N Hart<EMAIL_ADDRESS>wrote:

Yes.
To get de novo:
create a group for the parents And 1 for the Child.
In the Custom Tab of the filter modal, select "Variants NOT IN Group",
with the "Either" radio button selected where the value = "Parents". This
removes any variant found in mom OR dad - hence de novo.
For compound het, select "Variants IN Group" = "Parent", but this time
select heterozygous. Next add another filter where "Variants IN Group" =
"Child" and set the genotype to "Heterozygous". Now, to get true compound
hets - assuming neither parent has the disease, you would further select "
"Variants NOT IN Group" = "Parent" but select "Homozygous" (remove variants
that are homozygous in either parent)
Make sense?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/Steven-N-Hart/vcf-miner/issues/2#issuecomment-227575907,
or mute the thread
https://github.com/notifications/unsubscribe/AFzoBqFRsXYchuDWtO3bXmKJ6I6ft1DKks5qOFW0gaJpZM4I7J1Z
.


fix: migrate job

fixes #153

@tarioch this seems to have fixed the problem. I don't know why = caused a problem.
can you try it in your job yaml, If it works I'll merge this.

Running bench migrate without --site option works fine, so I guess that argument needs to be dropped

AFAIK It should work only if currentsite.txt has a site set. It is added by bench use {site-name} or using bench new-site --set-default ...
In case of multiple sites under a bench, the option is required to specify which site to run the bench command for.
There is also a magic keyword all which can be used to run command for all sites bench --site all ...

Doesn't look like it works. Still get no such option error.

make sure you are using the template from PR.
or just make the changes to the generated yaml and apply.
I've added test to confirm the migration job from PR works.

Maybe it only works if using the erpnext image and not with the custom ones built according to https://github.com/frappe/frappe_docker/blob/main/docs/custom-apps.md

You generate file?
the pipe command which does the | kubectl apply?
that is generating the file.
don't pipe it to kubectl apply.
pipe it to a file and edit it and replace = with space.
Then kubectl -n erpnext apply -f /path/to/file.yaml

no, I'm just doing a helm install/upgrade, not using kubectl manually

Maybe it only works if using the erpnext image and not with the custom ones built according to https://github.com/frappe/frappe_docker/blob/main/docs/custom-apps.md

Works with my custom app
https://gitlab.com/castlecraft/k8s_bench/-/jobs/3627147143
I used that app to confirm the fix.
Added the test because it will fail for erpnext in the current code.

check the version 6.0.2 now.
you will need to helm repo update locally so it pulls the latest index.

Can confirm that it works with 6.0.2, thank you very much


Add "cloud" to azure, gcp credentials

Adds "cloud" field to azure-service-principal
Adds "cloud" field gcp-service-account

Do these need a "regions" subfield like aws-iam-role? The use case that prompted this PR just needs the "cloud" field to exist.

Turns out regions is required! Will reopen once I figure all that out.


Embedding Layer is expanded every timestep in LSTM

Hi mxnet,
Not sure if this is true, but the embedding layer, say with shape (10000,256, i.e. 10000 vocabulary, 256-dimensional embedding) seems to be expanded at every timestep for the LSTM, even if the weights are shared. I don't know how to verify this but as far as what I observed I believe this is true, which causes huge memory consumption. I thought if we share weights for every timestep, we only need to allocate memory for the actual embedding (256 x t) for t-step lstm in this case but not allocating (10000 x 256 x t), which for the FullyConnected layer will be true. It seems that the current Embedding layer takes the same amount of memory as a FullyConnected layer, but I am not sure whether it's this issue that causes lots of memory overhead in lstm. I wonder where I should be looking at to try to fix this issue ?
Thanks!

@antinucleon probably this is one of the reason why our lstm isn't fast as expected?

Will check it tomorrow. Today & tomorrow morning I am benchmarking ELU.

This could be the reason, because the weight is binded with a shared variable, and current graph optimizer is yet not smart enough to change the gradient summation to an addto to the original variable.
Either we directly bind by ndarray, or make the graph executor smarter to handle the addto case more gracefully

has this problem been fixed?

Probably not. Seems that solving this will have to dive into mshadow code, which is harder  ?

@JianboTang @Kublai-Jing As tqchen pointed out, I think you can replace simple_bind with bind and directly provide the ndarrays as a temporary solution

Yeah that's what I am doing now : )

hopefully fixed by https://github.com/dmlc/mxnet/pull/1697


Which Nordic SDK used for this HX711 implementation?

I am working on HX711 and trying to interface it with NRF52832 . I have seen your example which is used for HX711 however I am unsure of SDK version you have used . Kindly advise which version to use also I am currently working with 14.2 SDK version. What adjustments should I make to work with 14.2

Since HX711 communication protocol is very basic and doesn't follow any specific standard protocol like I2C or SPI, all you need is to check:

GPIO pin init and read/write functions (they usualy don't change with newer SDKs),
TIMER init, start/stop and interrupt functions.

Both, gpio and timer drivers in this project were version 4.0.0-2.alpha, but I think you shouldn't have any problem porting this to newer SDK.


Offline support?

Hi,
I've seen this today on reddit and looks like a great project, does it have or will have sometime offline support for messages?
Thanks,
Keep up the good work!

This already is almost done by Socket.io, but, there are pitfalls.
If two users are chatting together; userA and userB. If userA lost the internet connection, the socket will detect there is a disconnection and will try to reconnect when the connection is up again. Now, any messages that will be sent by userA will be buffered and transmitted to all other active sockets when it's possible.
The problem is, any messages that will be sent by userB during the disconnection, won't be delivered to userA after reconnecting successfully, Why?  On re-connection, a new socket will be created, with a new id, and will join the room again, and when userB tried to send messages to all active sockets while userA was disconnected, the newly created socket(created after re-connection) wasn't included across active sockets.
The solution might be for userA has to ask for the messages sent by all users in the chatroom while disconnection. Therefore, the messages has to be stored somewhere for later fetching.
For this chat application, I don't store messages, So, it's hard to achieve this, but, can be implemented in the future.


How to assign a user as bot admin?

Describe the bug
Whenever I fire the command "v!restart" the bot response is "This command can only be executed by bot admins."
To Reproduce
Type command "v!restart"
Expected behavior
The bot should have restarted since I have the admin role
Bot Version
1.0.0

To assign a user as admin, create a collection in your database called "botAdmins"
Within this collection, add a document named the userID of the user that you wish to be a botAdmin. The document content can be empty. Hopefully this helps :)

To assign a user as admin, create a collection in your database called "botAdmins"
Within this collection, add a document named the userID of the user that you wish to be a botAdmin. The document content can be empty. Hopefully this helps :)
If you need more assistance, feel free to message reply here.

Hey, This worked perfectly. Thanks for the prompt response!

No worries, glad to help. Thanks for using scrimbot :)


No sound notification on some channels

Search before asking

I had searched in the issues and found no similar issues.

Operating System

Windows

Operating System Version
Windows 10
It happens on the web browser too?
Yes, it happens on the web browser too.
Rocket.Chat Desktop App Version
3.8.9
Rocket.Chat Server Version
3.0.4
Describe the bug
I have no sound notification on some channels.
It works on other channels so the global settings are OK.
The notification settings of the channels where there is no beep on new message are OK (using the global settings).
I don't know where to look for the per channel notification settings. Some configuration file or some database must exist but I can't find it.
I have the problem on 'discussions', 'channels', 'private groups' and 'direct messages' channels.
I tried to reset the client to default settings without success.

Looking at this screenshots you will find the configurations of notification for each channel.


WorldGuard with block-place set to deny make blocks from explosive spells drop.

Hello there,
just want to report that when I cast a spell that applies velocity to blocks (like Blast or tornado for example) and hit blocks that are in a worldguard region with the flag "block-place" set to deny, blocks from in the explosion area are being dropped.
This doesn't happen at all when I'm in a region without the flag.

Hoping this helped, unfortunately there's not much I can do about the core WorldGuard issue, and their team does not seem interested in fixings it.


Add support for Infineon XMC4500 SoC

This PR adds support for Infineon XMC4500 with development board relax kit. Currently the west module dependency points to https://github.com/linumiz/hal_infineon.
hal_infineon RFC request here: https://github.com/zephyrproject-rtos/zephyr/issues/24554
Support:

Initial revison adds support only for UART in polling mode
Uses DSRAM1 as default SRAM (64KB)
Clock defaults to 120MHz

WIP

Clock Control, GPIO and PINMUX support work is in progress and will be submitted in separate PR once the basic structure for infineon is accepted
RAM: 160KB is split into PSRAM1 64KB, DSRAM1 64KB and DSRAM2 32KB (communication RAM used for USB and Ethernet). CONFIG_BT_STM32_IPM in linker.ld will be extended to address this RAM split with the same name (SRAM1 & SRAM2).

At first glance this looks good.

Yes, I will be able to maintain this port. Thanks.

@parthitce we should be able to create the module repo soon. In the meantime, can you make sure this is rebased and up to date with the latest DT changes?

Apart from the comments fix, I did modify 2 major things now in the latest push.

Board named is renamed from relax_kit to xmc45_relax_kit. This is because infineon releases relax_kit for all the XMC series.

Renamed the uart node name from uart to usic. To brief, serial communication interfaces in XMC SoC is handled by (Universal Serial Interface Channel (USIC). XMC4500 got 3 USIC instances with 2 channels each. USIC can be configured to use as UART, SPI, I2C, I2S. Now the parent dtsi defines only usic with channels and consumed as uart in the board specific dts file.

Thanks in advance for your re-review @ioannisg @MaureenHelm @galak @carlescufi @stephanosio

DNM until this points at our hal_infineon repo

DNM until this points at our hal_infineon repo

@carlescufi updated pointer in west.yml to https://github.com/zephyrproject-rtos/hal_infineon

@parthitce i guess you can fix also the 3rd and 4th checkpatch warning about lines exceeding 89 chars

@parthitce i guess you can fix also the 3rd and 4th checkpatch warning about lines exceeding 89 chars

@ioannisg Fixed, thanks.

@galak use of DT macros seems correct to me. I will merge this unless there's any objections once CI is green.

@galak use of DT macros seems correct to me. I will merge this unless there's any objections once CI is green.

Yeah, looks good to me as well.


shared_embedding_columns are not supported when eager execution is enabled?

Please make sure that this is a bug. As per our
GitHub Policy,
we only address code/doc bugs, performance issues, feature requests and
build/installation issues on GitHub. tag:bug_template
System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow):
OS Platform and Distribution (e.g., Linux Ubuntu 16.04):
Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device:
TensorFlow installed from (source or binary):
TensorFlow version (use command below):
Python version:
Bazel version (if compiling from source):
GCC/Compiler version (if compiling from source):
CUDA/cuDNN version:
GPU model and memory:

You can collect some of this information using our environment capture
script
You can also obtain the TensorFlow version with:

TF 1.0: python -c "import tensorflow as tf; print(tf.GIT_VERSION, tf.VERSION)"
TF 2.0: python -c "import tensorflow as tf; print(tf.version.GIT_VERSION, tf.version.VERSION)"

Describe the current behavior
when i use tf.feature_column.shared_embedding(...)，code raises the RuntimeValue about "shared_embedding_columns are not supported when eager execution is enabled."
Then i see the feature_column_v2.py，find
  if context.executing_eagerly():
    raise RuntimeError('shared_embedding_columns are not supported when eager '
                       'execution is enabled.')

and i also find the tf.feature_column.embedding_column don't check eagerly。
So, my question is why they should be different? and can remove eager check?
Describe the expected behavior
Contributing

Do you want to contribute a PR? (yes/no):
Briefly describe your candidate solution(if contributing):

Standalone code to reproduce the issue
Provide a reproducible test case that is the bare minimum necessary to generate
the problem. If possible, please share a link to Colab/Jupyter/any notebook.
Other info / logs Include any logs or source code that would be helpful to
diagnose the problem. If including tracebacks, please include the full
traceback. Large logs and files should be attached.

@Peterisfar ,
In order to expedite the trouble-shooting process, could you please provide the tensorflow version,the complete code and dataset to reproduce the issue reported here.Thanks!

Also please take a look at this issue with the similar error.It helps.Link.Thanks

I met he same problem. When i use disable_eager_execution() to avoid this exception, build a keras model with shared_embeddings seems ok but shared_embeddings layer doesn't have any trainable variables, raise error [table not inicialized] (but other feature_column.embedding_column is ok).


Timing how long a user takes to complete the survey? (Question)

I have a question which I think is of interest to many surveyJS users.
I have a number of surveys on my site, some of which are quite long. I would like to know how long people take to answer questions (and if possible) notice when they started a survey but didn't finish it. I could then honestly say something like "This survey takes an average of 6 minutes to complete"
One solution might be to put some kind of timer into SurveyJS so that as the survey gets saved it also submits the total time the survey took. This might not be the best solution though, but it has the advantage of being stored in the same database as all the other survey submission data.
Another suggested solution might be to put Google Analytics (or Snowplow) JS code in each survey so that each time the user moves on that is recorded.
I am guessing that in either case we might add some javascript into an html question - or possibly add in a custom widget which does the timing for us.
Is there a standard/best practice way of doing this which I should be copying, or should I come up with a way which works for me.

browser: all
browser version: all
surveyjs platform (angular or react or jquery or knockout or vue): jquery (but probably of interest to all)
surveyjs version: latest as of three days ago.

@alexmc6 We have introduced the following functions/properties:
survey.startTimer(), survey.stopTimer(), survey.timeSpent, page.timeSpent.
Thank you,
Andrew


help center: Document notification triggers.

Documents the top checkboxes section for controlling mobile, desktop, and email notifications.
Fixes #23371.
Screenshots and screen captures:

Self-review checklist

[x] Self-reviewed the changes for clarity and maintainability

Communicate decisions, questions, and potential concerns.

[x] Explains differences from previous plans (e.g., issue description).
[x] Highlights technical choices and bugs encountered.
[x] Calls out remaining decisions and concerns.
[x] Automated tests

Individual commits are ready for review (see commit discipline).

[x] Each commit is a coherent idea.
[x] Commit message(s) explain reasoning and motivation for changes.

Completed manual review and testing of the following:

[x] Visual appearance of the changes.

@alya This PR is ready for your review.

Looks great other than the one comment above, thanks!

Let's drop the "You can also adjust whether notifications will be sent while you are online." sentence.

Yep, I agree. Done!

Merged, thanks @drrosa!
Though just now I had an added thought: we probably should advertise the fact that you can configure overrides for individual streams; you can configure that via the "manage streams" panel, and any that you've configured different from the defaults will appear in this table.
(As a side note, we should probably open an issue for having a UI for adding a stream exception to that panel)

Though just now I had an added thought: we probably should advertise the fact that you can configure overrides for individual streams; you can configure that via the "manage streams" panel, and any that you've configured different from the defaults will appear in this table.

Makes sense to me! @drrosa Can you take a it as a follow-up (not release-critical) to add a tip about this, linking to https://zulip.com/help/stream-notifications?

Yes, I can do that!


Some feature requests

Hi,
I've been following recent updates pretty closely and love them!
Would like to request the following

[ ] Radar animations (With lightning animations too?)
[ ] Refreshing without reloading site
[ ] Ruler tool
[ ] Current location
[ ] Mesoscale discussions
[ ] mPING reports
[ ] Soundings viewer (Would be an amazing feature, show soundings locations and allow users to view them when pressed)
[ ] Multiple panes
[ ] WPC and SPC Outlooks

Hey there!
There are all great features, and it's super helpful to have it all laid out here. I actually have plans to implement a lot of these, and I'll give the specifics on each request here.

Plans to add. These will not be difficult additions:

Refreshing without reloading site
Ruler tool
Current location
Mesoscale discussions
WPC and SPC Outlooks

Radar animations are tricky. The radar files I'm using are in a special binary format, and are parsed client-side, so it requires some memory and CPU usage for each radar scan. If we were to load several of these in quick succession for an animation, it crashes the browser on mobile devices, in my previous testings with this. It is also rather slow on desktop, where it won't crash. This is the same problem we'd run into with a dual or quad pane feature. I am absolutely not giving up on this, though, and I am determined to find a solution. Radar animations are a crucial feature.
For mPING reports, they are not completely public data. You would need to apply for special use from the University of Oklahoma, I believe, to gain access to their system. There are some ways to circumvent this that I've discovered, but I don't want to be breaking rules. So if mPING is added, it will be through the proper channels, but this will be further down the line if at all.
For a soundings viewer, that's a really neat idea! I have to admit, I'm not intensely familiar with soundings and their specifics, so I'd have to do a bit of research on where I could pull the data from, and what the standard is for Skew-T charts. If I did that, it would be a great addition, and certainly something that I'm not dismissing right away. However, similar to the mPING reports, that would be a bit in the future.
Again, I really appreciate these suggestions, it's very helpful to get feedback from others.
Thanks!

Hi,
No problem! I'm sure you'll be able to continue to improve the radar view!

@wilburcoding
Auto radar updating has hopefully been implemented with d39efd6! I added a new RadarUpdater class, which is much more efficient and easier to work with than how I had done it before.
If you would be willing, I would really appreciate some testing of this. It should check for a new radar scan every 15 seconds, and you can open the console to better see what's going on. Try and see if it still updates when changing stations, changing products, changing products AND stations, see if it will update for multiple radar scans in a row by just leaving it - basically anything you can think of. If you can't do that, I totally understand - it's a frustrating thing to test because it takes a bit for new scans to come in. But with MESO-SAILS, usually there is a radar station active that will update every 2-3 minutes.
Thanks!

@SteepAtticStairs
No problem! I have plenty of time today to test it out!
As of right now, it seems to be checking new radar scans successfully!

Now it's 25 times. Seems to occur when switching stations and radar types.

@wilburcoding
Hmm, I can't seem to replicate this.
I think it could possibly be because it seems to be taking your device 6835 ms at some points to calculate the vertices for the radar plot. The time it takes to query, download, parse, and plot the radar file is likely greater than the 15 second polling interval, so it probably gets confused because of that.
If you don't mind me asking, is your computer on the slower end? In other words, do other programs run quickly on your computer, but AtticRadar seems to run unnaturally slow? For me, I usually get 500 ms max on my MacBook Pro, but on my chromebook, it takes 2-3 seconds.

I’m currently on a really slow school issued chromebook. That might be the issue. However, I noticed that certain products such as velocity tend to load much slower than others.

Adding another feature I'd like to implement:

[ ] Pen tool


osm2streets terminology and structure

I find myself wanting to be precise about particular components or aspects of a road, but lacking the terminology. I think this is a good time to agree on some terminology that will allow us to describe the structure we want to aim for. I can add the terms as a primer to the README after some input.
Let me start with one way of slicing it up, and let's change it to match up with what is already used.

Lane: a single lane with designation, width, etc.
Buffer: medians, painted buffers, verges, ... with width etc.
Road: a collection of Lanes (and Buffers), travelling in the same direction; A "half street" if you will, or a slip road or slip lane.
Intersection: the area where multiple lanes of travel overlap and the road endpoints that join it.
Street: a collection of Roads (and cycletracks/footpaths) that all run (mostly) parallel to one "centerline", representing the whole corridor, "building to building".
Junction: A collection of Intersections (and some Roads) that make up one "junction". E.g., a roundabout is one Road and one Intersection per (single carriageway) arm.
RoadNetwork: A directed graph of Roads connecting Intersections
StreetNetwork: An undirected graph of Streets connecting Junctions

Those feel like the types I am expecting to find, which makes me want

geom::{Point, LineString, Area, ...} and all the right algos, and
osm::{Node, Way, Relation, Tag, Key, Tags} as well understood boring types.

How are these concepts weird or difficult or bad?

* `Road`: a collection of Lanes (and Buffers), travelling in the same direction; A "half street" if you will, or a slip road or slip lane.
* `Street`: a collection of Roads (and cycletracks/footpaths) that all run (mostly) parallel to one "centerline", representing the whole corridor, "building to building".

* `Intersection`: the area where multiple lanes of travel overlap and the road endpoints that join it.
* `Junction`: A collection of Intersections (and some Roads) that make up one "junction". E.g., a roundabout is one Road and one Intersection per (single carriageway) arm.

This is one thing that is a bit weird, mostly "road" and "street" being so different.
I would like to work with the network as a directed graph, and so each direction is it's own edge which can be treated independently. What should the term for that edge be? Why not "road"?
The two distinct levels will be very useful I think. E.g. a route would be calculated in the RoadNetwork but directions would be described in the StreetNetwork: "left at A street, right at B street, 4th house on the right."

I wonder if "Edge" or "HalfRoad" or "DirectedRoad"
"edge" loses context too quickly, so HalfRoad and DirectectRoad are sounding good. OnewayRoad? OneRoad?

Do we use Corridor instead of Street to keep both sides of "stroads" out of the namespace. A Corridor is a list of OneRoads and Buffers or something? Corridors and Junctions are what you would use to draw a metro map, for example.

I have come around to preferring "RoadWay" for the "half street" concept for most of the reasons that they are called "ways" in OSM. A "two way road" is made up of two RoadWays? Yep, sounds about right to me.

"Corridor" and "Curb" used to talk about this in a great talk at SotM US: OSM can help Inventory and Manage the Curb - Daniela Waltersdorfer


Support custom socket factory

We were trying to use the JDBC driver and attempt to override the socket factory with our own implementation. But it looks like the socketfactory/client overriding is unsupported as per https://github.com/forcedotcom/Salesforce-CDP-jdbc/blob/develop/src/main/java/com/salesforce/cdp/queryservice/util/QueryTokenExecutor.java#L62 . Is this true? Any other suggested workaround to address this problem?

Hello @anusudarsan - Thank you for the question. I am the product manager for Data Cloud Query.
Which client do you represent, and what is the use case for such override? Thank you!


Github access_token never stored

I'm not using the default web flow but calling the do_auth from my custom method:
user = backend.do_auth(access_token, ajax=True)

The problem is that GithubOAuth2  backend never stores the access_token in the extra_data field.
I came up extending the GithubOauth2 backend:
class GithubOAuth2Extented(GithubOAuth2):
    """docstring for GithubOAuth2Extented"""

    # overriding parent method because it did not saved the access_token
    def user_data(self, access_token, *args, **kwargs):
        """Loads user data from service"""
        data = self._user_data(access_token)
        if not data.get('email'):
            try:
                email = self._user_data(access_token, '/emails')[0]
            except (HTTPError, IndexError, ValueError, TypeError):
                email = ''

            if isinstance(email, dict):
                email = email.get('email', '')
            data['email'] = email

        # Added by me
        data['access_token'] = access_token
        return data
        super(GithubOAuth2Extented, self).user_data()

Not sure if it is the best solution tough

I think this is similar to #416


[AUTHZ] Generalize command specs and check duplicated class names of command spec

Why are the changes needed?

Generalizing command specs for the commands of tables (including lakehouse tables), functions, db, scans
Checking duplicated class names of command spes, to prevent breaking the serde design
Fix the output message for spec count written to file

Error message when there are duplicated class names in command specs:

How was this patch tested?

[ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

[x] Add screenshots for manual tests if appropriate

[x] Run test locally before make a pull request

Was this patch authored or co-authored using generative AI tooling?

No.

cc @yaooqinn @AngersZhuuuu

Codecov Report

Merging #5543 (85f1e1b) into master (5b9290a) will decrease coverage by 0.09%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##             master    #5543      +/-   ##
============================================
- Coverage     61.42%   61.33%   -0.09%
  Complexity       23       23
============================================
  Files           598      598
  Lines         34254    34254
  Branches       4488     4488
============================================
- Hits          21039    21010      -29
- Misses        11095    11118      +23
- Partials       2120     2126       +6

Files
Coverage Δ

.../kyuubi/plugin/spark/authz/serde/CommandSpec.scala
83.33% <ø> (ø)

... and 8 files with indirect coverage changes
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

Thanks, merged to master.


[SPARK-45267][PS] Change the default value for numeric_only.

What changes were proposed in this pull request?
This PR proposes to change the default value for numeric_only with related functions.
Why are the changes needed?
There are many functions that support numeric_only parameter have changed their default value from True to False from Pandas 2.0.0, so we should follow their behavior. See https://pandas.pydata.org/docs/dev/whatsnew/v2.0.0.html for more detail.
Does this PR introduce any user-facing change?
Yes, the default value for numeric_only is changed to False.
How was this patch tested?

Updated the related UTs.
Was this patch authored or co-authored using generative AI tooling?

No.

CI passes. cc @HyukjinKwon @zhengruifeng FYI

thanks, merged to master


Is this dead ?

Is this dead ?
What would be a good alternative?

More or less yes... I did not use RN for quite some time and therefore did not put time into the project.

Biggest issue was that I could merge stuff but was unable to release ;)


[RFC] Enhancement/one of validator

Hello there!
I wrote this for one of my projects and I thought it could be useful to others too. This is a validator called one_of(options) that allows you to check if the value is within the allowed values. In my particular case it was useful to test things like one_of(POSSIBLE_CHOICES), one_of(Animals), etc.
Example:
US_STATES = ['AB', 'AG', 'AK', ...]

@attr(slots=True)
class Location(object):
    city = attr.ib(validator=instance_of(str))
    state = attr.ib(validator=one_of(US_STATES))

I was wondering if you had any thoughts and whether it would make sense to add it to attrs. If that's the case, I'd be more than happy to adjust the code with your suggestions.
Thanks!
Pull Request Check List
This is just a reminder about the most common mistakes.  Please make sure that you tick all appropriate boxes.  But please read our contribution guide at least once, it will save you unnecessary review cycles!

[x] Added tests for changed code.
[ ] New features have been added to our Hypothesis testing strategy.
[x] Updated documentation for changed code.
[ ] Documentation in .rst files is written using semantic newlines.
[x] Changed/added classes/methods/functions have appropriate versionadded, versionchanged, or deprecated directives.
[x] Changes (and possible deprecations) are documented in CHANGELOG.rst.

If you have any questions to any of the points above, just submit and ask!  This checklist is here to help you, not to deter you from contributing!

This seems like a good idea however the naming (and docstring) seems too restrictive given the implementation.  Something like is_in(possible_values) seems more natural to me?

is_in sounds good. Given that other validators are single words (e.g. optional), what do you think about within?

@glyph try to talk me out of calling it in_() please.   We have precedents in sqlchemistry. ;)

found_in?

Since we’re going for and_() in #186 and ppl are used to them from sqlalchemy, please go for in_().

(I cannot promise this will make it into 17.1 b/c I need to get it out ASAP but it’s possible.  If you want to raise your chances, please double check CONTRIBUTING.rst; especially re: test docstrings.)

Just updated it to in_().

Thanks, I’ve made some small adjustments.

Thanks!

I just noticed I forgot to add in_() to __all__, I'll submit a PR later on.


DRAFT: GEODE-8040: Make BootstrappingFunction unit testable

@jdeppe-pivotal do you have any ideas why any changes to BootstrappingFunction causes the Tomcat session tests in UpgradeTest to fail?


Is there support for OpenAPI 3.1.0?

I was very much fascinated by the UI flexibility and the features docusaurus-openapi provide. But I'm a bit skeptical about the support for OpenAPI 3.1.0. Is it supported yet?

Have you tried testing with 3.1.0?

I tried with 3.1.0. Actually OpenAPI 3.1.0 supports multiple types in a schema (also specified here: Specifying multiple types for additionalProperties through Swagger/OpenAPI)
I tried debugging as follows:
node_modules/docusaurus-plugin-openapi/lib/openapi/createExample.js
function primitive(schema = {}) {
    let { type, format } = schema;
    if (type === undefined || type === null) {
        return;
    }
    console.log(type);
    let fn = primitives[type].default;
    if (format !== undefined) {
        fn = primitives[type][format] || fn;
    }
    if (fn) {
        return fn(schema);
    }
    return "Unknown Type: " + schema.type;
}

I logged the output to find that last type was an array and it the primitive function doesn't handle arrays well!
Here's the output:

Then I guess we don’t support 3.1.0

Okay cool!
I'll then go back to OpenAPI 3.0.3 as of now!
Should I close this issue?
Thanks and Regards,
Kinjal Raykarmakar


Add something to check that secrets aren't being checked in

As a pre-commit hook.
Something like this:
https://github.com/Yelp/detect-secrets

From the readme:
We recommend setting this up as a pre-commit hook. One way to do this is by using the pre-commit framework:

# .pre-commit-config.yaml
repos:
-   repo: https://github.com/Yelp/detect-secrets
    rev: v1.4.0
    hooks:
    -   id: detect-secrets
        args: ['--baseline', '.secrets.baseline']
        exclude: package.lock.json


bundle: updates manifests with scc changes

This updates the bundle manifests with the rbac changes made
for the SCC resource manager.
Signed-off-by: N Balachandran<EMAIL_ADDRESS>

/approve


Epidemic Sound

Checklist

[x] I'm reporting a new site support request
[x] I've verified that I'm running youtube-dl version 2021.12.17
[x] I've checked that all provided URLs are alive and playable in a browser
[x] I've checked that none of provided URLs violate any copyrights
[x] I've searched the bugtracker for similar site support requests including closed ones

Example URLs
Search anything on https://www.epidemicsound.com/
Here is the audio link: https://dkihjuum4jcjr.cloudfront.net/ES_ITUNES/Think It's over Now (Instrumental Version)/ES_Think It's over Now (Instrumental Version).mp3
Description
Epidemicsound allows the user to "preview" the tracks on the website. Whenever pressing the play button while inspecting the site traffic monitor, one can, see that the client receives a link that corresponds to the track's audio.
This should be reasonably easy to retrieve.
In case this is added, please consider that links from the search tool are an easy way to get a playlist of tracks in the user's taste, so being able to download from a search would be appreciated.

They also have multiple YouTube channels.

it's hard to search the youtube channels for particular genres

Very true, at least if they didn't have genre-specific channels, a long list of them, at that: https://www.youtube.com/@epidemicsound/channels
And each one has playlists for even more specificity, like in the case of jazz that I randomly picked: https://www.youtube.com/@EpidemicJazz/playlists

it all happens on teh same page:

You click the play button on a song
You get a response with the link and some metadata

I also found out that they have some kind of api at https://www.epidemicsound.com/json/search/tracks/ but there is no documentation on this, that's why I'm still sticking to yt-dl

This is not a real web site (as it doesn't have URLs for different resources within the site) and so isn't suitable for use with yt-dl. Unless anyone can persuade me otherwise this will be closed wontfix.

They do actually have URLs for all resources, but this might also be a recent addition. Just hover over a song/sound effect and on the right there is a link icon which copies the URL to the clipboard. Example: https://www.epidemicsound.com/track/yFfQVRpSPz/


Exclude specific file

Hello! i'm currently using your plugin and i find it wonderful, but in my latest project i had the need to exclude some specific images because my team didn't want the compressed size but the full one.
Is there a way to achive this goal? Maybe passing an array of custom images to exclude.
Thank you very much!

You can use the test option to define either a regex, glob, a function, or an array of either of them to specify which files you want included.
You can use that to exclude some files from being minified. For example, if you wanted to include all files except for one named "notme.jpeg", you could put the test regex as /^(?!notme).*/ which would match everything except for any file that has "notme" in the file path.
You can also do the same for globs if you find them easier, or you could even make it a function that takes the filename as the only argument and should return true if it keeps it, or false if it doesn't.
I hope that makes sense, and if you think it's overly complicated I can always look into adding an "exclude" option, but the logic behind what happens if test and a possible exclude option overlap is a little foggy to me, and I won't have time to get to anything for at least a week or 2...
Let me know if there's anything else you need!

Yeah that part isn't really spelled out well in the docs. I'd gladly take a PR that can improve that if you have time and don't mind! (no pressure though!)
I'm really bad with writing documentation, so any help that I can get I will gladly take!
Also, you are going to be the first person I know of that will use a function there, so if there are any problems or major performance issues or gotchas, i'd love a message back either here or in another Issue/PR letting me know so I can hopefully clean it up for you and others in the future!
Thanks

@Klathmon Could you give a config example please? With function with exclude


Fix get_boxes_img_without_det in the python api

Without this change, it just crashes when get_boxes_img_without_det is called

This is an example image, if that can be of help


Retest Only Bug: Facility filter disabled

Context
The facility filter on the cdd is not loading and stays disabled.
Steps to Reproduce
Compliance and allowance data types:

Navigate to the custom data download
Select and apply a data type and sub type

The facility filter doesn't load and is disabled
Emissions Sub types:

Navigate to the custom data download
Select and apply an emissions data type and sub type
Apply a time period

The facility filter doesn't load and is disabled

Bug resolved @tlageman-epa The facility filter is now enabled and working as expected

Bug resolved. The facility filter is now enabled and working as expected @tlageman-epa


onClick not working.

Problem Description
I have nearly an exact copy of the example, and yet the onClick event doesn't seem to be firing. The example page (https://sagiegurari.github.io/angular-web-notification/) works well. Everything else about it seems to work well. I am using SignalR to send a message to the client, and the client should be showing a notifications with the message and who sent it.
Code Example
...
// SignalR listener
'recieveIncomingMessage': (conversationID, message) => {
                var convo = this.conversationLookup[conversationID];

                // Handle browser notification
                if (webNotification.permissionGranted) {
                    webNotification.showNotification(convo.FirstName + ' ' + convo.LastName, {
                        body: message.Message,
                        icon: '/Images/Notification.png',
                        onClick: function onNotificationClicked() {
                            console.log('Notification clicked.');
                            //convo.expand(); // Popup the conversation
                        },
                        autoClose: 10000 // 0 for no autoClose
                    }, function onShow(error, hide) {
                        if (error) {
                            window.alert('Unable to show notification: ' + error.message);
                        } else {
                            console.log('Notification Shown.');

                            // don't need any of these atm
                            //setTimeout(function hideNotification() {
                            //    console.log('Hiding notification....');
                            //    hide(); //manually close the notification (you can skip this if you use the autoClose option)
                            //}, 5000);
                        }
                    });
                }

                // apply gui changes
                $rootScope.$apply();
            },
...

Error Stack/Info (if any)
No errors are produced in console.

This is the offending bit it seems:
            //add onclick handler
            if (options.onClick && notification && notification.webNotification) {
                notification.webNotification.onclick = options.onClick;
            }

notification.webNotification evaluates to undefined, so the onclick is never assigned

So I used https://rawgit.com/sagiegurari/angular-web-notification/master/angular-web-notification.js and it seems to be working, which is odd because I used the one from master as well which didn't work. Closing the issue for now. ;)

It should be the same file actually.

Yeah I know which is why it was odd to me. I dunno what happened with it. ¯_(ツ)_/¯


Project description is unclear about CA certificate importance on the client

Problem Description
The mitmproxy docs / starting page does not specify clearly enough that to successfully use mitmproxy on a secure connection (SSL, TLS, HTTPS), a CA certificate must be installed on the client. Without this condition fulfilled, any further attempt to perform a mitm attack is meaningless and will not work.
https://docs.mitmproxy.org/stable/concepts-certificates/
Proposal
The requirement, to have CA certificate installed on the client for mitm-ing secure connections, should be more clearly stated and pointed out that it is a crucial step and that it is "virtually" impossible to mitm a third party device on the network, to which you don't have a direct access, to install a mitmproxy CA certificate on.
By "virtually", i mean that default use of socket connections provided by the OS on the client device app, will always trigger a check of the certificate chain to verify the built-in root CA. Only an error in the code (of a programmer unskilled in the security context) on the client device could leave such a security hole.
Alternatives
None
Additional context
Please enlighten me, if i am missing a piece of the puzzle.

Thanks for the useful feedback! Being able to install mitmproxy's certificate is indeed usually a requirement to intercept TLS, otherwise there'd be fundamental security issues in TLS itself. Could you expand on where you would have expected such a warning?
FWIW, https://docs.mitmproxy.org/stable/concepts-certificates/ already mentions this in the first two sentences. https://docs.mitmproxy.org/stable/overview-getting-started/ also has a section on client configuration. This does in no way invalidate your feedback, I'm just trying to figure out where the rough corners are at the moment.

Docs are explaining every scenario pretty well, they are a great learning point, but they are unclear about TLS right from the start.

Being able to install mitmproxy's certificate is indeed usually a requirement to intercept TLS
What is the "unusual" way to intercept TLS? This word (usually) should be removed and instead explained right from the start that TLS/HTTPS is a secure protocol and cannot be intercepted, unless a CA certificate is installed on the client device. Period. It should also be explained in the certificates section, how certificate chaining works so it would be clear why CA is required on the client device. I believe that would put things in order for the reader right from the start.

What is the "unusual" way to intercept TLS?

The most common scenario would be that you have a valid server certificate, in which case you can configure mitmproxy to use this and not modify the client at all. Second, there still are plenty of IoT clients that don't verify certificates properly and mitmproxy "just works". Or you have no encryption at all.
Could you explain what you mean by certificate chaining? I think I'm not following there.

I mean how certificate verification works from the client's point of view, from the user certificate up to the root CA and finally there is also a new"ish" step that also verifies the certificate at the CA authority verification server.


Quality Assurance: Unread messages not showing after pinning

To reproduce this bug, you first need to find a stream that has unread messages (the number to the right of a stream's name shows how many unread messages in that stream you have). Hover over that stream and press the arrow to the right of that stream's name and press Pin stream ... to top. The number that indicates how many unread messages in that stream you have will not be shown, until you narrow to the stream itself or reload the page. This also works with unpinning a stream.

This first screenshot was taken just after pinning the stream test

This second screenshot was taken after clicking the test stream. As you can see, in the first screenshot it doesn't show that there are 46 unread messages in test.

Yep, I can replicate this behavior going from the description. Thank you for the report.

We rebuild the individual sidebar row for a stream after we pin it.  When you build the row from the template, we don't update the unread count.  (There are some subtleties here due to the fact that on page load you have to wait for accurate unread counts, and the code is the same for startup.)
I think we should make build_stream_sidebar_row take a boolean option that tells it to update its unread count.
Technically, I don't think we even need to rebuild the row when we pin streams, since we don't really use the pinned/unflagged row within the DOM for the row itself, but this may change when we add fancy icons or whatever.
I will probably end up doing this myself before the release, but I'm adding these notes in case anybody else gets here first.


config: add FalkorDB/FalkorDB repo to Graph Database collection

What problem does this PR solve?

Issue Number: close #xxx
Problem Summary:
What is changed and how it works?

@Mini256 please merge


Headless Remote Support

One of the things the official Visual Studio Code/ Visual Studio Codespaces has ahead of us is the ability to have one common frontend and have reproducible stacks with their own headless VS Code agents running inside of these containers. If we examine how VS Code Remote works:

We have a VS Code frontend capable of connecting to the container which itself has a headless instance of VS Code with extensions running in it.
code-server theoretically can implement this by implementing the same capabilities for a VS Code headless server.
Proposed strategy
We can implement this by going the extension-based route. This is basically the most publicly available way VS Code connects to a headless remote container. You install the extension which can be capable of handling containers, SSH, or WSL. These options on the Microsoft version can be installed independently from each other. For remote distributions (Codespaces) of VS Code, they have this preinstalled on the "frontend".
However, this also comes with another complexity in mind - we need to author a extensions that is capable of doing so, fortunately, all the APIs VS Code Remote uses is publicly available which makes it easier.
Theoretically if we have such a extension already we can bundle and have readily available as well for the VS Code Marketplace (and OpenVSX, if Coder decides to use that), it can be handled like this
# let's assume this is our "headless" server, nothing to change in the flags, we reuse the same port to expose the remote API
$ ./code-server --bind-addr=<IP_ADDRESS>:6972

# Now let's head over to another instance, this time, our "frontend" instance connects to it via a new argument or have our --bind-addr also serve the same purpose of connecting to it if it sees that there's a existing application connected to it.
$ ./code-server --connect-remote=remote-ijlr4.cdr.dev
$ ./code-server --bind-addr=remote-ijlr4.cdr.dev:6972

Advantages
Since we're aiming for VS Codespaces parity, this would allow code-server to be able to be a even more viable migration path for our venerable VS Codespaces users who likes to selfhost. This also opens other possibilities such as better integration paths for third party applications
Use cases
Coder Enterprise and Cloud IDE platforms
This is very relevant to Coder Enterprise and other Cloud IDEs such as Gitpod and Eclipse Che - as this would allow ISVs to seperate out the IDE itself from the reproducible containers. Since we can go the VS Code Remote path, we just update the IDE frontend and the containers can update themselves since the Remote extension will overwrite the code-server binary inside the container (since we're aiming for parity here after all).
Users Migrating from VS Codespaces
VS Codespaces users will be looking for a feature-parity equivalent of Microsoft's offering. As we don't have a confirmation that that GitHub Codespaces will get self-hosted options, this would allow code-server to have a early lead and snatch out of the main reasons some of the users of VS Codespaces came in the first place - the self-hosted option.
This would be a good long term strategy and would allow code-server to gain a early lead against Microsoft competition-wise on implementing one of the features VS Codespaces got sold in the first place - and this would allow as well a free open-source alternative to VS Remote for those FOSS junkies out there who hates the MS EULA.

It would be nice to have complete parity. Let's track this here: https://github.com/cdr/code-server/issues/1315


landing page: publication date should be localized

Describe the bug
The publication date is not localized on the publication date.
Steps to Reproduce

Go to the landing page of any record (https://<IP_ADDRESS>:5000/records/)

Expected behavior
The text should read like in the expected screenshot below. Note, do not add the version or make a label around the date. It's only the actual text which is wrong. The styling is fine.
Screenshots (if applicable)
Current:

Expected:

For the implementation, please create a template filter format_edtf that takes care of formatting an EDTF date.

Once moved to a different package it can be used by:

https://github.com/inveniosoftware/invenio-rdm-records/issues/203 (search results) solved in https://github.com/inveniosoftware/marshmallow-utils/pull/18/files and made use of in https://github.com/inveniosoftware/invenio-rdm-records/pull/211/files

Waiting for https://github.com/inveniosoftware/invenio-rdm-records/pull/240 and https://github.com/inveniosoftware/invenio-app-rdm/pull/362 to get merge to make things consistent

Currently, it's localized, but not in the long format.

Related to https://github.com/inveniosoftware/invenio-rdm-records/issues/248


Screen stays on...

Not sure which is causing my screen on a Chromebook Pixel to stay on (no time-out to black) as long as I leave my computer open.  Is it crouton with my new "trusty" install or is it the new Chrome version?
Version 40.0.2214.93 (64-bit)
Platform 6457.83.0 (Official Build) stable-channel link
Firmware Google_Link.2695.1.155
Just curious if anyone else has this issue...
kgm

Are you in crouton or in Chromium OS when this happens?  Is there a lot of motion on the screen?

I am in crouton and there is no motion at all.
[image: Ken Mages on about.me]
Ken Mages
about.me/KenMages
http://about.me/KenMages
On Wed, Feb 4, 2015 at 12:09 AM, David Schneider<EMAIL_ADDRESS>wrote:

Are you in crouton or in Chromium OS when this happens? Is there a lot of
motion on the screen?
—
Reply to this email directly or view it on GitHub
https://github.com/dnschneid/crouton/issues/1394#issuecomment-72796118.

You may want to check the screensaver settings in Unity, or try installing xscreensaver sudo apt-get install xscreensaver if there's no screensaver.

Already did that thanks David!
[image: Ken Mages on about.me]
Ken Mages
about.me/KenMages
https://t.yesware.com/tl/9b0ff9b8918d86354a71928f56afa01c3ee7c09a/c880972c87487c595b750b923ca0def1/a509eca0873b8be8377416d0e0403ae2?ytl=http%3A%2F%2Fabout.me%2FKenMages
On Thu, Feb 5, 2015 at 8:47 PM, David Schneider<EMAIL_ADDRESS>wrote:

You may want to check the screensaver settings in Unity, or try installing
xscreensaver sudo apt-get install xscreensaver if there's no screensaver.
—
Reply to this email directly or view it on GitHub
https://t.yesware.com/tl/9b0ff9b8918d86354a71928f56afa01c3ee7c09a/c880972c87487c595b750b923ca0def1/2f119854c545e3c0da3876b121ae4b59?ytl=https%3A%2F%2Fgithub.com%2Fdnschneid%2Fcrouton%2Fissues%2F1394%23issuecomment-73174461
.

Did it fix things?

Fixed!


Fix PATCH /ob/profile to update profile.Currencies

Fix #1823

Coverage increased (+0.07%) to 39.548% when pulling 2097045cad7ec686c7ae48631fe74a4e18233668 on 1823-patch-profile-currencies into 188a334ba7307c93aaae20e0e84efd2231fa73d6 on ethereum-master.


Tokenizer splits a script block, if it contains tags even if it is inside litterals.

I'm using the Tokenizer to chop up html snippets, and it is working like a dream. Unfortunately it has this one odd idea of splitting up a script block, if it contains tags - even though they are inside litterals. I don't know if this is by design or by accident, but I would expect it to handle the whole script block as one Character token.
Here is an example of the problem:

When tokenized, this snippet will result in something in the (simplified) neighbourhood of:

StartTag: body
StartTag: script
Characters: 'var x = "'
StartTag: a
Characters: 'myLink'
EndTag: script
EndTag: body

I would have expected 3-5 to be all in one Character node. The end a-tag also results in a ParseError, since it is escaped and thus does not get recognized. So my code ends up deeming this snippet for malformed, lacking the end a-tag.
Is this a bug, or is it by design, because it should be handled elsewhere (the Parser?). I'm not using the parser because of speed and a desire to keep everything streaming nicely not having to wait for the whole tree to be build and managed.
My guess is that this thing would count for poorly named selectors in a style tag too, but I haven't tried that out yet.

I'm O-Zone's colleague and I wound up working on the same piece of code and just stumbled upon this issue :)
The problem was a side effect of using the tokenizer on its own, because some of the tokenizer.content_model housekeeping is actually performed by the parser. I ended up copying the logic that transitions to SCRIPT_CDATA and PCDATA into the module in our code that uses the tokenizer, thus solving the problem.
It's kind of a gotcha for people who expect to be able to use the tokenizer on its own, but it doesn't really strike me as a bad design -- unless someone can come up with a clean way of moving that transitioning code into the tokenizer (I doubt it).

Yeah. The HTML5 algorithm doesn't leave the tokenizer separate, sadly. I'm still thinking of ways to minimally involve the parser to do the right state transitions.


make seperator memoized

fixes #8

i think its better to take separator component into a separate file
src/components/separator

You wanna take over?

alright , i'll merge it to feature/custom-separator 👍


Fix issue with case sensitivity when loading dataset from local cache

When a dataset with upper-cases in its name is first loaded using load_dataset(), the local cache directory is created with all lowercase letters.
However, upon subsequent loads, the current version attempts to locate the cache directory using the dataset's original name, which includes uppercase letters. This discrepancy can lead to confusion and, particularly in offline mode, results in errors.
Reproduce
~$ python
Python 3.9.19 (main, Mar 21 2024, 17:11:28)
[GCC 11.2.0] :: Anaconda, Inc. on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from datasets import load_dataset
>>> dataset = load_dataset("locuslab/TOFU", "full")
>>> quit()

~$ export HF_DATASETS_OFFLINE=1
~$ python
Python 3.9.19 (main, Mar 21 2024, 17:11:28)
[GCC 11.2.0] :: Anaconda, Inc. on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from datasets import load_dataset
>>> dataset = load_dataset("locuslab/TOFU", "full")
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "xxxxxx/anaconda3/envs/llm/lib/python3.9/site-packages/datasets/load.py", line 2556, in load_dataset
    builder_instance = load_dataset_builder(
  File "xxxxxx/anaconda3/envs/llm/lib/python3.9/site-packages/datasets/load.py", line 2228, in load_dataset_builder
    dataset_module = dataset_module_factory(
  File "xxxxxx/anaconda3/envs/llm/lib/python3.9/site-packages/datasets/load.py", line 1871, in dataset_module_factory
    raise ConnectionError(f"Couldn't reach the Hugging Face Hub for dataset '{path}': {e1}") from None
ConnectionError: Couldn't reach the Hugging Face Hub for dataset 'locuslab/TOFU': Offline mode is enabled.
>>>

I fix this issue by lowering the dataset name (.lower()) when generating cache_dir.

I also need this feature for "Cnam-LMSSC/vibravox "


IPNS is not working consistently

@BigLep @2color @lidel @tinytb
What we need
hey IPNS, publish a record with lifetime 100years using k1 keys. Published. Oh wait! there is new data, please update with same lifetime. Reslolves from a different node. Data relects. BAMMM!
In detail, what we need is:
1. Resolution of IPNS names to the latest value when records are published/updated within short time span such as 10 seconds.
2. Achieve IPNS Permanence - persist IPNS names for a long period of time(theoretically, forever. lifetime: 10... * 365 * 24 * 60 * 60 * 1000).
Current long standing issues with js-ipfs that we have not been able to fix or find root cause to:

The 1st ever resolution attempt with a new secp256k1 keypair always fails. we resolve 2 times as a work around.

We learned from the IPFS devs that since the subscription to topic happens in the first resolution hence it fails - Please correct/update us if this is not the case.

Resolution then starts working and gives us the 1st published record(the data that was published the first time). great! but subsequent new records(stringified json objects) that we publish does not get resolved to at all instead each resolution returns the 1st published record only. Inconsistent resolution as if the nodes dont honour the new record or the increased sequence number until the lifetime expires. This happens when longer lifetimes such as 24hr or 3day are used.
When the same scenario is tried with a lower lifetime value such as 2min, IPNS works consistently and resolves to the latest value each time. This probably happens because the DHT, maybe deletes the record after 2 mins and hence, by the time a new publish reaches, DHT adds a new entry and is able to resolve to the latest value but we have seen it resolving to the latest record even if we publish within the 2mins lifetime. strange. Now the problem with lower lifetime value is - we cannot achieve IPNS permanence and publishing every 2mins has is a major scalibilty issue for thousands of users.

Link to a sample we created with js-ipfs to reproduce the issue: https://github.com/imthe-1/keychain-ipns-sample/tree/debug/lifetime-persistence-verbose
We have the same sample use-case implemented in Helia as well althoug as an inital PoC only. Helia PoC findings:
We followed a similar approach as browser-ipns-publish in Helia for proper IPNS name propagation.

We like Helia but it seems to suffer from the same issue as js-ipfs when it comes to IPNS.
We need not resolve 2 times for the resolution to work.
After publishing via helia in the browser, IPNS resolution on our remote node and public gateways does not always work. Some IPNS names resolve but other IPNS names fail.
Of the IPNS names that do resolve from the our remote kubo node via API /api/v0/name/resolve or public IPFS gateways, they still returns the 1st published value even after new reocrds are published. There is still inconsistent resolution, latest record are not returned.
IPNS publish and resolution to latest value via helia works fine in the browser but also sometimes fails intermittently.
Using lower lifetimes(in ms here) such as 2 * 60 * 1000 OR 10 * 60 * 1000 did not result in any new outcomes and behaved the same as 24hrs or longer lifetimes.

Link to the sample code with Helia: https://github.com/imthe1self/helia-connectivity-demo-forked-/tree/debug/topic
PS: we used code from codesandbox.io that was probably created by @SgtPooki and added our sample use-case to it. thank you @SgtPooki!
Our use-case
Publish data to IPNS and update it over time from the client device(mobile app or browser). Update can happen as quickly as within a few seconds from the last publish in certain scenarios. For this we run an IPFS node in the browser, create an secp256k1 IPNS keypair, obtain the topic name and make this browser node and one remote kubo node subscribe to this topic. We then publish to IPNS.
We have followed this example for browser IPNS publish(link: https://github.com/ipfs-examples/js-ipfs-examples/tree/master/examples/browser-ipns-publish)
Note: we use secp256k1 IPNS keypairs and have modified "createKey" in js-ipfs to accept an optional private key "optPrivateKey" for creating the same IPNS keypair when required. There is a specific reason for this and we can't use RSA or ED25519 keypairs.

We followed a similar approach as browser-ipns-publish in Helia for proper IPNS name propagation.

We like Helia but it seems to suffer from the same issue as js-ipfs when it comes to IPNS.

I believe the implementation js-ipfs used is the same as what helia uses: https://github.com/ipfs/js-ipns

We need not resolve 2 times for the resolution to work.

That's good news, right?

After publishing via helia in the browser, IPNS resolution on our remote node and public gateways does not always work. Some IPNS names resolve but other IPNS names fail.

This is most likely due to problems called out in #182. follow that issue for more.

Of the IPNS names that do resolve from the our remote kubo node via API /api/v0/name/resolve or public IPFS gateways, they still returns the 1st published value even after new reocrds are published. There is still inconsistent resolution, latest record are not returned.

While #182 is not resolved, I imagine this will be an issue for browser-authored records.

IPNS publish and resolution to latest value via helia works fine in the browser but also sometimes fails intermittently.

Another item I expect resolving #182 to help resolve

Using lower lifetimes(in ms here) such as 2 * 60 * 1000 OR 10 * 60 * 1000 did not result in any new outcomes and behaved the same as 24hrs or longer lifetimes.

the lifetime value is set here. I get this is probably a naive question, but can you confirm you are passing the value properly?
The code where you're calling the actual js-ipns implementation with lifetime (1, 2) seems to be hidden behind the private @mdip/client library.
I was able to find the code for the function you're using on npm:
async linkToIPNS(ipfsAddr, keyName, keyId, opts = {}) {
    const namespace = '/record/';
    const b58 = base58btc.decode(`z${keyId}`);
    // console.log('b58', b58);
    const ipnsKeys = ipns.getIdKeys(b58);
    // console.log('ipnsKeys', ipnsKeys);
    const topic = `${namespace}${uint8ArrayToString(
      ipnsKeys.routingKey.uint8Array(),
      'base64url',
    )}`;
    // console.log('topic', topic);

    await this.coreClient.pubsub.subscribe(topic, (msg) => {
      // console.log('[coreClient]', msg);
    });
    await this.ipfsHttpClient.pubsub.subscribe(topic, (msg) => {
      // console.log('[ipfsHttpClient]', msg);
    });

    const httpClientSubs = await this.ipfsHttpClient.pubsub.ls();
    // console.log('[httpClientSubs]', httpClientSubs);
    if (
      !httpClientSubs ||
      !httpClientSubs.length ||
      !httpClientSubs.includes(topic)
    ) {
      console.warn('[httpClient could not subscribe]');
    }
    const coreClientSubs = await this.coreClient.pubsub.peers(topic);
    // console.log('[coreClientSubs]', coreClientSubs);
    const { id: clientPeerId } = await this.ipfsHttpClient.id();
    if (
      !coreClientSubs ||
      !coreClientSubs.length ||
      !coreClientSubs.includes(clientPeerId)
    ) {
      console.warn('[coreClient could not find peer]');
    }

    const multihash = uint8ArrayFromString(keyId, 'base58btc');
    const digest = Digest.decode(multihash);
    const libp2pKey = CID.createV1(0x72, digest);
    const ipnsName = `/ipns/${libp2pKey.toString(base36)}`;

    const httpClientNamesysSubs = await this.ipfsHttpClient.name.pubsub.subs(); // API
    if (!httpClientNamesysSubs.includes(ipnsName)) {
      console.warn('IPNS path not found');
    }
    const resp = await this.coreClient.name.publish(ipfsAddr, {
      key: keyName,
      resolve: false,
      lifetime: opts.lifetime || '3day',
    });
    return resp;
  }

3day isn't a valid option for lifetime in the js-ipns library. Have you tried using a valid nanosecond identifier?

Is there a modification to tests at https://github.com/ipfs/js-ipns/tree/3d3807f9a0ed5b1d5b06990c916a426d7c9200d0/test that could reproduce your problem more specifically?

hi @SgtPooki
apologies for the late reply.

That's good news, right?

Yes

This is most likely due to problems called out in https://github.com/ipfs/helia/issues/182. follow that issue for more.
While https://github.com/ipfs/helia/issues/182 is not resolved, I imagine this will be an issue for browser-authored records.
Another item I expect resolving https://github.com/ipfs/helia/issues/182 to help resolve

@SgtPooki after going through the details in https://github.com/ipfs/helia/issues/182 it feels like until this issue is addressed and the underlying 2 other issues Helia will continue to have this problem. We can also see that there is some progress on the issue(Enable WebRTC Transport to help solve https://github.com/ipfs/helia/issues/256). We do however, have the following concerns:

The issues #182 #255 #256 are still in "No Status" tab in the Helia Working Group since this is lower priority and not a pure Helia issue. Concern here is is there an estimated timeline by when this becomes available?
We specifically have issues with IPNS. will #182 solve all IPNS issues as well?

Meanwhile this above is worked upon can you please suggest some alternatives or guide us in a direction using which we can achieve:

Resolution of the mutable link to the latest value when records are published/updated within short time span such as 10 seconds.
Achieve IPNS/Mutable name Permanence - persist IPNS/Mutable name for a long period of time(theoretically, forever. lifetime: 10... * 365 * 24 * 60 * 60 * 1000).

My project, Lume, which uses helia also has some very bad hit/miss on IPNS when trying to even load things like ens.eth. I use a mix of transports including a custom one, and preload/delegate nodes, so a root cause is really not known, but from my pov... IPNS is highly unstable.
IPFS works a lot better, though I still have failed to load JS files from ens.eth, but getting WebRTC would be the best thing long term.

My project, Lume, which uses helia also has some very bad hit/miss on IPNS when trying to even load things like ens.eth

I think https://github.com/ipfs/helia-ipns/pull/55 may help out for users coming to this issue with problems resolving DNSLink records: https://github.com/ipfs/helia-ipns/pull/55
That is separate from this issue, as IPNS records being discussed here involve the records stored in the Amino DHT


Creepers drop brimstone when Hardcore Gunpowder is enabled

They should only be dropping nitre.

again???

Oh, I think I know what was going on, the 1.11.2 branch was started before that change was made, so those changes didn't get merged.