Tried to update docs-resources to latest main and getting  ERROR: could not locate or load the built-in pdf theme docs-resources/themes/riscv-pdf.yml' because of NoMethodError undefined method each' for "646b74":String;

❯ git submodule status
 005cb0db1c46c31fff163914f3e480dbda0306be docs-resources (remotes/origin/HEAD)

Tried with docker:
❯ make
Checking if Docker is available...
Docker is available, building inside Docker container...
make[1]: Entering directory '/home/kbroch/rvi/riscv/docs-spec-template'
Starting build inside Docker container...
make build-docs
make[2]: Entering directory '/home/kbroch/rvi/riscv/docs-spec-template'
docker run --rm -v /home/kbroch/rvi/doc-team-repos/docs-spec-template:/build -w /build riscvintl/riscv-docs-base-container-image:latest /bin/sh -c " asciidoctor-pdf --trace -a compress -a mathematical-format=svg -a revnumber=v0.0.0 -a revremark=Draft -a revdate=2024-04-25 -a pdf-fontsdir=docs-resources/fonts -a pdf-theme=docs-resources/themes/riscv-pdf.yml  -D build --failure-level=ERROR --require=asciidoctor-bibtex --require=asciidoctor-diagram --require=asciidoctor-mathematical src/spec-sample.adoc "
asciidoctor: ERROR: could not locate or load the built-in pdf theme `docs-resources/themes/riscv-pdf.yml' because of NoMethodError undefined method `each' for "646b74":String; reverting to default theme
make[2]: *** [Makefile:61: spec-sample.pdf] Error 1
make[2]: Leaving directory '/home/kbroch/rvi/riscv/docs-spec-template'
make[1]: *** [Makefile:78: build-container] Error 2
make[1]: Leaving directory '/home/kbroch/rvi/riscv/docs-spec-template'
make: *** [Makefile:68: build] Error 2

and without:
❯ make build-no-container
Starting build...
make SKIP_DOCKER=true build-docs
make[1]: Entering directory '/home/kbroch/rvi/riscv/docs-spec-template'
asciidoctor-pdf --trace -a compress -a mathematical-format=svg -a revnumber=v0.0.0 -a revremark=Draft -a revdate=2024-04-25 -a pdf-fontsdir=docs-resources/fonts -a pdf-theme=docs-resources/themes/riscv-pdf.yml  -D build --failure-level=ERROR --require=asciidoctor-bibtex --require=asciidoctor-diagram --require=asciidoctor-mathematical src/spec-sample.adoc
asciidoctor: ERROR: could not locate or load the built-in pdf theme `docs-resources/themes/riscv-pdf.yml' because of NoMethodError undefined method `each' for "646b74":String; reverting to default theme

            val.each do |key2, val2|
               ^^^^^
make[1]: *** [Makefile:61: spec-sample.pdf] Error 1
make[1]: Leaving directory '/home/kbroch/rvi/riscv/docs-spec-template'
make: *** [Makefile:83: build-no-container] Error 2

If you’re building locally you need to pull in the submodule content with
git submodule —init.   However, I haven’t seen that error before. I’ll look
at it tomorrow morning.
Bill Traynor
Documentation Build and Release Engineer
RISC-V International
On Thu, Apr 25, 2024 at 9:51 PM Kevin Broch @.***>
wrote:

❯ git submodule status
005cb0db1c46c31fff163914f3e480dbda0306be docs-resources (remotes/origin/HEAD)
Tried with docker:
❯ make
Checking if Docker is available...
Docker is available, building inside Docker container...
make[1]: Entering directory '/home/kbroch/rvi/riscv/docs-spec-template'
Starting build inside Docker container...
make build-docs
make[2]: Entering directory '/home/kbroch/rvi/riscv/docs-spec-template'
docker run --rm -v /home/kbroch/rvi/doc-team-repos/docs-spec-template:/build -w /build riscvintl/riscv-docs-base-container-image:latest /bin/sh -c " asciidoctor-pdf --trace -a compress -a mathematical-format=svg -a revnumber=v0.0.0 -a revremark=Draft -a revdate=2024-04-25 -a pdf-fontsdir=docs-resources/fonts -a pdf-theme=docs-resources/themes/riscv-pdf.yml  -D build --failure-level=ERROR --require=asciidoctor-bibtex --require=asciidoctor-diagram --require=asciidoctor-mathematical src/spec-sample.adoc "
asciidoctor: ERROR: could not locate or load the built-in pdf theme docs-resources/themes/riscv-pdf.yml' because of NoMethodError undefined method each' for "646b74":String; reverting to default theme
make[2]: *** [Makefile:61: spec-sample.pdf] Error 1
make[2]: Leaving directory '/home/kbroch/rvi/riscv/docs-spec-template'
make[1]: *** [Makefile:78: build-container] Error 2
make[1]: Leaving directory '/home/kbroch/rvi/riscv/docs-spec-template'
make: *** [Makefile:68: build] Error 2
and without:
❯ make build-no-container
Starting build...
make SKIP_DOCKER=true build-docs
make[1]: Entering directory '/home/kbroch/rvi/riscv/docs-spec-template'
asciidoctor-pdf --trace -a compress -a mathematical-format=svg -a revnumber=v0.0.0 -a revremark=Draft -a revdate=2024-04-25 -a pdf-fontsdir=docs-resources/fonts -a pdf-theme=docs-resources/themes/riscv-pdf.yml  -D build --failure-level=ERROR --require=asciidoctor-bibtex --require=asciidoctor-diagram --require=asciidoctor-mathematical src/spec-sample.adoc
asciidoctor: ERROR: could not locate or load the built-in pdf theme docs-resources/themes/riscv-pdf.yml' because of NoMethodError undefined method each' for "646b74":String; reverting to default theme
        val.each do |key2, val2|
           ^^^^^

make[1]: *** [Makefile:61: spec-sample.pdf] Error 1
make[1]: Leaving directory '/home/kbroch/rvi/riscv/docs-spec-template'
make: *** [Makefile:83: build-no-container] Error 2
—
Reply to this email directly, view it on GitHub
https://github.com/riscv/docs-spec-template/issues/45, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAAN6ZHNO3IVMQ2JTYAY3ODY7GXJ3AVCNFSM6AAAAABGZ5NAKKVHI2DSMVQWIX3LMV43ASLTON2WKOZSGI3DINZZGEYDAOA
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

Closing as this was just a problem with my local checkout. sorry for the noise.


Add convenience method for IFile{Open,Save}Dialog

might seem redundant, but this follows the case of IShellItem::from_path
https://github.com/rodrigocfd/winsafe/blob/c6bb0ba319be730e34cc657edebd10cdf48c0bf7/src/shell/com_interfaces/ishellitem.rs#L38-L63

You are proposing a wrapper for CoCreateInstance with some default arguments, but these arguments, which fit your particular situation, but that's not always the case. Plus, it would imply in wrappers to all other COM interfaces too, again with default arguments, which also are not the best for every case. I believe that, even if CoCreateInstance is still available, such implementation would create confusion – multiple ways to do the same thing.
Plus, CoCreateInstance is extremely familiar to C++ devs, and the current WinSafe implementation is rather short, with automatic IID deduction – way cleaner than the C++ one.
However, you made me realize that IShellItem::from_path is also not good. I wrote that wrapper because, at that time, I still didn't have an IBindCtx implementation, which I have now. This allowed me to fully expose SHCreateItemFromParsingName, which is the correct, idiomatic way to create IShellItem objects. So from_path was also removed.
Thank you.


[Bug] Stone Minecarts generate cobblestone

Minecraft version & Mod Version:
1.12.2
V 1.14.2
Single player or Server:
Single Player
Problem:
Stone minecarts are placed into the world carrying cobblestone. Breaking the cart and placing it again generates another new block of cobblestone.

https://minecraft.curseforge.com/projects/cyclic/files/2541669


Minor issue -- how do I get pycharm to recognize my virtualfish environments?

Hi Folks. I'm developing with PyCharm -- it's a great IDE.  But when I'm at terminal and I've got my python environment active, when I type "whereis python" -- I still get /usr/bin/python .. So I'm not exactly sure where my python virtual environment is.  I think I'm missing something fundamental about how virtualfish works.

That is the expected behavior. I believe the command you are actually looking for is:
which python

Ah, thanks. Thanks for the quick response, and yes, it's working now.


Restructure so project is easier to use.

Restructuring to make easier to locate executables.  Also removing VaultConfig.* dependencies from this library.

Temporarily breaking because build pipelines are moving to pendentive.


Link issue and pull requests status change in UI notifications directly to their event in the timelined view.

Adding the related comment to the issue and pull request status change in the UI notifications allows to navigate directly to the specific event in its dedicated view, easing the reading of last comments and to the editor for additional comments if desired.

Please send backport


Steps To Reproduce

Given the following .swift file

// foo.swift
public class Bar {
  static func f(){
    return g();
    func g() { }
  }
}

Run swiftc foo.swift
Observe linker error due to missing symbol g:

error: link command failed with exit code 1 (use -v to see invocation)
Undefined symbols for architecture arm64:
  "_$s3foo3BarC1fyyFZ1gL_yyF", referenced from:
      _$s3foo3BarC1fyyFZ in foo-1.o
ld: symbol(s) not found for architecture arm64

Expected behavior
Functions declared within functions are not dead-stripped for being "unreachable".
The above source should produce an output identical to:
public class Bar {
  static func f() {
    func g() { }
    return g();
  }
}

Screenshots
N/A
Environment (please fill out the following information)

OS: macOS 12.5.1 (Chip: Apple M1 Pro)
swiftc version:

swift-driver version: 1.45.2 Apple Swift version 5.6.1 (swiftlang-<IP_ADDRESS>3.66 clang-13<IP_ADDRESS>)
Target: arm64-apple-macosx12.0

FWIW, use case works as expected on my mbp Intel.
swift-driver version: 1.62.15 Apple Swift version 5.7.1 (swiftlang-<IP_ADDRESS>.3 clang-14<IP_ADDRESS>)
Target: x86_64-apple-macosx13.0

I believe this was fixed by https://github.com/apple/swift/pull/40792
@nickpdemarco I see you are in 5.6, this change probably made into 5.7 and as @kyouko-taiga mentioned this works fine.
Can you please verify and close if that's fixed? Thanks!


Finished with error: Package(s)  require the native assets feature. This feature has not yet been implemented for TargetPlatform.android_arm64

Steps to reproduce
My Flutter Version 3.16.5
Expected results
Expected successful run
Actual results
Finished with error: Package(s)  require the native assets feature. This feature has not yet been implemented for TargetPlatform.android_arm64
Code sample
Code sample
[Paste your code here]

Screenshots or Video

Screenshots / Video demonstration
[Upload media here]

Logs
Logs
[Paste your logs here]

Flutter Doctor output
Doctor output
[Paste your output here]

Hi @SheepYang1993, can you provide a minimal reproducible code sample so we can investigate this? Native assets is currently experimental on the master channel so if you're running a project that uses it on stable, that would be why you're getting this issue


Recommend page fixed

Related Issue
[Cite any related issue(s) this pull request addresses. If none, simply state “None”]
Fixes:  #4315
Description
In the privacy page recommend page is not correctly link which throws error, I fixed that error and make the links correctly working.

Type of PR

[x] Bug fix
[x] Feature enhancement
[ ] Documentation update
[ ] Other (specify): _______________

Screenshots / videos (if applicable)
Before:
https://github.com/user-attachments/assets/6d0e83d2-f984-4b48-81dc-85b058fcd449
After:
https://github.com/user-attachments/assets/f6cebff1-1170-473f-94ef-b8c5a03ec5e7
Checklist:

[x] I have made this change from my own.
[x] My code follows the style guidelines of this project.
[x] I have performed a self-review of my own code.
[x] I have commented my code, particularly in hard-to-understand areas.
[x] I have made corresponding changes to the documentation.
[x] My changes generate no new warnings.
[x] I have tested the changes thoroughly before submitting this pull request.
[x] I have provided relevant issue numbers and screenshots after making the changes.

@abhi03ruchi In your website recommend page its not working except home page, cookie policy and copyright recommend is working. Can  I work on this and divide it into 3 pr and each pr contain 9 pages changes (total 27 pages). can you assign each pr level 2 or 3 label?? or can I  made each separate pr??? for this issue.

fix it in other pages as well .

c009270d2e56ccf82fb1805043394838aeb993e8
@abhi03ruchi I have fixed in other pages also


execSync on Node 0.12.x is not working anymore

Can you consider the switch to sync-exec instead? See https://github.com/mgutz/execSync/issues/38
Thanks in advice :)

Thanks @julianxhokaxhiu. Switched to sync-exec now.


Additional Chrome arguments

How can I specify my own arguments for launching Chrome? I want to automatically open DevTools on my first page.

From another issue: https://github.com/GoogleChromeLabs/carlo/issues/16#issuecomment-435146117


[BUG] ListSlice(pad=True) does not generate valuecount.min and max properties in the schema

Describe the bug
When we add ListSlice(k, pad=True) op to a list column, it does not generate properties.value_count.min and properties.value_count.ma fields in the schema. These fields appear in the schema with ValueCount() op.
Steps/Code to reproduce bug
You can repro the issue with:
import cudf
import pandas as pd
import nvtabular as nvt
df = pd.DataFrame(
    {
        "user_id": [1, 3, 3, 4, 3, 1, 2, 4, 6, 7] *2,
        "item_id": [[1, 3, 10], [1, 3, 10], [4, 2, 1], [1, 2, 3], [1, 3, 10], [1, 3, 10], [1, 3, 10], [11, 3, 10], [11, 3, 10], [4, 2, 1]] *2,
    }
)

user_id = ["user_id"] >> Categorify() >> TagAsUserID()

item_id = ["item_id"] >> Categorify() >> TagAsItemID() >> ListSlice(5, pad=True)

train_dataset = nvt.Dataset(df)

workflow = nvt.Workflow(user_id + item_id)

workflow.fit(train_dataset)
workflow.transform(train_dataset).to_parquet("./train/")

# then run the following and check out the schema:
workflow.output_schema

Expected behavior
Environment details (please complete the following information):

Environment location: [Bare-metal, Docker, Cloud(specify cloud provider)]

merlin-tensorflow:22.12  container with the latest main branches pulled.

What should happen in the case where pad=False?

What should happen in the case where pad=False?

@karlhigley  It returns the sequence without padding, and since in the example we set the ListSlice trimming value as 5 that is longer than the sequence lengths in each sample in the dataset, it returns the original length of the each sample. No trimming happens, and no value_count in the schema as well.
if we set the ListSlice(2, pad=False) then the lists are trimmed to length of 2.

In that case, I think we know that the maximum length is no more than 5 though, right? So we can set an upper bound on the dimension of the shape that represents list length (currently captured in the value_counts.)

In the example above, all the list entries have length of 3. So we know the ListSlice(5) > 3, so it wont do any trimming. And yes, if we can capture the max_length of the longest list in the given train (input) dataset, we can set an upper bound on the dim of shape.

@karlhigley is there any update for this ticket? or any fixes going on? thanks.

AFAIK this has been fixed for a while now by the changes in #1760

@karlhigley it worked for me.. is #1760 part of 23.02 release?

Should be, yes!


interp1d returns incorrect values for step functions

For some inputs which have a step change, scipy.interpolate.interp1d returns incorrect values.
The conditions for this to happen are:

The same x value should be present twice in the input with different y values, and
Some random property of the input: if it happens for a certain input, it will always happen, but it may not happen for a subset of the input which includes the problem values

The problem appears to be that the order of the y values as used is swapped versus what is in the input; similar to what might happen if the x and y values are sorted using an unstable sort (ie: non-order-preserving for equal inputs).
Reproducing code example:

import numpy as np
import scipy.interpolate

x, y = (np.array([0.00000000e+00, 8.81834215e-05, 1.23456790e-03, 1.23456790e-03,
        2.29276896e-03, 2.29276896e-03, 2.55731922e-03, 2.55731922e-03,
        2.91005291e-03, 2.91005291e-03, 5.02645503e-03, 5.02645503e-03,
        5.11463845e-03, 5.11463845e-03, 2.40740741e-02, 2.40740741e-02,
        2.54850088e-02, 2.54850088e-02, 2.91005291e-02, 2.91005291e-02,
        3.08641975e-02, 3.08641975e-02, 5.41446208e-02, 5.41446208e-02,
        5.91710758e-02, 5.91710758e-02, 7.87477954e-02, 7.87477954e-02,
        9.88536155e-02, 9.88536155e-02, 1.16666667e-01, 1.16666667e-01,
        1.72927690e-01, 1.72927690e-01, 6.92151675e-01, 6.92151675e-01,
        8.38447972e-01, 8.38447972e-01, 1.00000000e+00]),
        np.array([0.        , 0.        , 0.        , 0.05555556, 0.05555556,
        0.11111111, 0.11111111, 0.16666667, 0.16666667, 0.22222222,
        0.22222222, 0.27777778, 0.27777778, 0.33333333, 0.33333333,
        0.38888889, 0.38888889, 0.44444444, 0.44444444, 0.5       ,
        0.5       , 0.55555556, 0.55555556, 0.61111111, 0.61111111,
        0.66666667, 0.66666667, 0.72222222, 0.72222222, 0.77777778,
        0.77777778, 0.83333333, 0.83333333, 0.88888889, 0.88888889,
        0.94444444, 0.94444444, 1.        , 1.        ]))

f = scipy.interpolate.interp1d(x, y)
print(f(0.90))
# output is 0.9656113509141464, should be 1.0

x2 = np.linspace(0,1,1000)
y2 = f(x2)
plt.plot(x,y)
plt.plot(x2,y2)

Note that the x value 8.38447972e-01 is present twice in the input; the interp1d function interpolates between the y value corresponding to the first of these x values and the following value, not between the  y value corresponding to the second of these x values and the following value.
The same thing happens at x values 7.87477954e-02 and 9.88536155e-02
Using mode='previous' and mode='nearest' shows an equivalent bug on this data.
Truncating the beginning of the input may make the bug disappear (or cause it to show up for different duplicated x values) depending on how much is truncated.
Error message:

Scipy/Numpy/Python version information:

1.4.1 1.18.1 sys.version_info(major=3, minor=6, micro=10, releaselevel='final', serial=0)

Thanks for the report. This is one of those situations where the correct output is ambiguous. Numpy makes one choice, and Jax makes another choice (the reason for the choice Jax makes is because it falls out of the implementation of interp1d in terms of available lax primitives).

@jakevdp

This is one of those situations where the correct output is ambiguous.

I don't think it's ambiguous; could you explain?
For example interp1d([0,1,1,2], [0,0,1,1]) should be 0 for x in [0,1) and 1 for x in (1,2]; if there is any ambiguity it is at x=1 only, but there is no reason for it to return any value other than 0 or 1, for any x value other than 1; it's a simple step function.   This is the kind of input that the buggy interp1d interprets as though the arguments passed were interp1d([0,1,1,2], [0,1,0,1]) (producing linear ramps, where the input is supposed to be a step function) - but only for specific inputs, and not others.

I think interpolation assumes that the x are distinct. How do you interpolate between two values at the same point? It's not a function anymore if y is not unique at each point.
Sorting of x is independent of y.

@josef-pkt

I think interpolation assumes that the x are distinct. How do you interpolate between two values at the same point?

That's true - at the point which is not distinct, the interpolator can do a number of things which would all be reasonable, eg return the first or last value, an average of the values, or even a nan or raise an Exception (as long as it is a defined behavior).  I would think last value or average is what most people would assume.
This bug report isn't about what happens at the duplicate points though.  Passing in an input with duplicate x causes wrong values at in-between points - and they are clearly wrong values (since they are not in between the given y values), and also it is a random effect.

@jakevdp @josef-pkt
Additional pointer that this is sort-related:  assume_sorted=True prevents the problem from happening.  Note that the input is already sorted, but the results with assume_sorted=False and assume_sorted=True is different.

Cross-ref https://github.com/scipy/scipy/issues/9886

@ev-br Yep, same issue.  I think it is better to not require unique x values since there are many use cases where duplicates can happen, either on purpose (describing step functions) or accidentally.
I looked at the source for interp1d, and it does almost exactly what I thought.
        if not assume_sorted:
            ind = np.argsort(x)
            x = x[ind]
            y = np.take(y, ind, axis=axis)

I would propose changing this to np.argsort(x, kind='stable') if the version of numpy has that (>= 1.15.0).
What do you think about that?

When several x values compare as equal, there is a choice on whether to keep them in the original order (=stable sort), or rearranged (=unstable sort).

"original order" might not be what's intended either. This assumes that the user presorted the y to get your desired behavior, but then the user could also presort x.
My main worry about these kind of cases is that we add a lot of overhead to handle some "unintended" cases for some users.
i.e. if I want a fast linear interpolation on strictly monotone x values, then I don't need a lot of additional checks and handling of ties in x.
I think having well defined choices for ties would be useful, but it shouldn't punish the currently intended usecase. maybe only piecewise continuous/linear using the min and max value makes sense in the interpolation case.
(statsmodels lowess has a similar problem in the smoothing case when there are too many ties. But it's too difficult to fix https://github.com/statsmodels/statsmodels/issues/2449 )
Also, ties with continuous variables might still produce arbitrary behavior and fluctuation if there is some numerical noise in x.

Most interp1d bugs are now features, simply because they've been around \approx forever.
That said, changing to a stable sort might be possible, esp early in the release cycle so that downstream projects have time to adapt.
Lastly, downstream users are almost always better off using specific interpolators instead of intetp1d.

@aizvorski care to send a PR with the stable sort?

@ev-br Sure!  Here you are.  I had to look a bit for which versions of numpy support this; as it is in the current PR we should be good back to numpy=1.3 at least.  Let me know what you think.


GPG encryption with multiple keys

I'm getting a generic "OpenPGP decryption error" when I try to decrypt my own message encrypted with two keys, the recipient's one and mine. The recipient can decrypt it, but the sender (me) can't.
The message is correctly encrypted with both keys, as I can decrypt it with the gpg tools.

Same problem at my place. I have multiple IDs but I can not decrypt a message I have received.

Check the last version, please.


docs(contributing): specify Chromium version format for releases

Suggestion: use a preferred Chromium version format in changelog/release note which is compatible with pptr.dev version parsing. Follow up to https://github.com/puppeteer/pptr.dev/pull/22.
Update: As the CHANGELOG.md is autogenerated from the Chromium roll commit-msg that is the one that requires specification.
The original problem explained in https://github.com/puppeteer/pptr.dev/issues/20#issuecomment-776271813.

While the regex matches: "Chromium 86.0.4240.0 (r800071)" (v5.3.0)
But it won't match: "chromium: roll Chromium to r848005" (v7.0.0)

Improvement: moving up step 5 of Rolling new Chromium version to make it more visible. Follow up to https://github.com/puppeteer/puppeteer/pull/6952#issuecomment-790366531.

Like this pptr.dev could remain up-to-date with Chromium versions.
Maybe my suggestion is a bit verbose, in that case, feel free to rephrase it 😊

Thanks!


Update LICENSE

The original repo (https://github.com/vjeantet/ldapserver) updated its license to MIT, so this repo can be updated as well.

@dogancanbakir any reason not to merge? Thank you.


Refactor scroll automation (#239)

/cc @inikulin @helen-dikareva
Here is the automation/playback/scroll.js refactored. Other automations and the structure of the files will be refactored next.

\r-
Tests fail. And let's enable eslint for those newly rewritten files.

It looks so much better. God bless ES6

\r-

FPR

lgtm

lgtm

thanks


Add an Ichimoku indicator

There has been talk of adding in TA-Lib integration, which is all well and good. In my spare time I'll be attempting to implement the ichimoku indicator which is what I use in graph based trading. With luck I'll be able to get it working in LEAN and do it all algorithmically.

Thank you @nii236! Lets keep this issue for a Lean naitive implementation of the Ichimoku Indicator; and if you're keen please submit separate issue for TA Lib integration.

@jaredbroad: Of course, I wasn't clear in my original post. What I meant was TA Lib integration was being considered by TA Lib itself did not support ichimoku indicators. Hence this issue was made specifically for an ichimoku indicator.

I've completed a (pull request)[https://github.com/QuantConnect/Lean/pull/126] regarding this issue which was merged a couple of days ago.


What is the key step for google indexing? Thank you very much!

@ljvmiranda921 Thank you!

At Google search console, select URL prefix as the verification type.


My nether portal isn't even lighting.

I have nether, fire spread enabled and I have a survival_nether world I created using multiverse. I go into my world called "survival" and I make a normal nether portal, try to light it and nothing happens, just plain old, cold obsidian.
If the issue is because I made the nether for my world using multiverse, then how do I get it to naturally make itself.

me too，help~~


Update Dockerfile

Bumped atlas to 1.4.3

I realised there's already an open pull request and the update to the version needs to be done on the folder as well thus this is not the proper way to bupt the version. Discard please.


Update search to enable live testing in sovereign clouds for multiple services

1.These changes enable search to run live tests against Public, UsGov and China.
2.Update file: recordedClient.ts
Default value of endpoint just can be used on Public cloud, update the value of search endpoint to be used on other clouds(UsGov, China).
3.Update file: test-resources.json
The number of free search service creations has exceeded the limit, so the defaultValue of searchSku has been revised to basic.
Pipeline results:
https://dev.azure.com/azure-sdk/internal/_build/results?buildId=1080366&view=results
@benbp, @dw511214992, @ramya-rao-a, @meeraharidasa for notification.

LGTM, but someone from the js team should review the changes as well.

@sarangan12 Can you review this please?

@benbp Do others need to review this PR? If not, maybe we can merge this PR.

Thank you @v-xuto !


Improve log messages for data directory and configuration details

Following up from https://github.com/talaia-labs/rust-teos/pull/210
fixes: https://github.com/talaia-labs/rust-teos/issues/202

Following up from #210
fixes: #202

@mariocynicys @sr-gi Apologies for the confusion in my recent pull requests. I've been having difficulties with Git rebase, which has caused some issues in my submissions. I'm currently working on understanding the process better. Please consider accepting this PR as I am committed to learning from this experience and ensuring that future contributions are free of similar issues. Your support and understanding in this matter are greatly appreciated, and I am confident that my future work will reflect the improvements I am making. Thank you for your patience and guidance.

Please fix the lint issues.

Please fix the lint issues.

Done

@anipaul2 commits need to be signed in order to be merged

@anipaul2 commits need to be signed in order to be merged

Done.

Thank you @sr-gi @mariocynicys for the continuous guidance, and I'm delighted that the PR has been finally merged. I am committed to learning from my mistakes and look forward to making further contributions to the project.


How to handle exceptions in server?

Hello! In WCF, the way to handle errors in the server is to raise FaultException. Throwing this exception won't crash the server and the exception is sent to the client to handle. This simplifies the design of the interface because there is no need to return error codes. Is there an equivalent to FaultException here?

@jacqueskang when I code the server to throw exceptions with specific messages, the client gets instead a generic exception that says:

Internal server error: Exception has been thrown by the target of an invocation.

Is it possible to have the client receive the information that's in the original exception thrown by the client?
(Also, in some situations you would want to never send exception information to the client for security reasons, so I see why this shouldn't be the default behavior).
So maybe we could send FaultExceptions and derived exceptions to the client, and generic exceptions otherwise?

@pablocar80  I realized this issue is already resolved by PR #85
Please reopen if you disagree.


Fix vs2012 warning - can't convert from double to float

Fixes Visual Studio 2012 warning

warning C4305: '=' : truncation from 'double' to 'float'

Thanks!


[BUG] Authorization header included when enableRequestHeaderTracking is enabled

Description/Screenshot
View in application insights portal:

Steps to Reproduce

OS/Browser: any
SDK Version [e.g. 22]: 2.6.2
How you initialized the SDK:

ai = new ApplicationInsights({
    config: {
      instrumentationKey: key,
      disableFetchTracking: false,
      enableCorsCorrelation: true,
      enableRequestHeaderTracking: true,
      enableResponseHeaderTracking: true
    }
  });

Enable request header tracing using enableRequestHeaderTracing. The Authorization/authorization header now gets logged and the token can be stolen by anybody looking at the logs.
Expected behavior
The Authorization/authorization header should not be logged, instead a redacted version should be logged, e.g. instead of Authorization: Bearer Asddsfsdafsdafdsafdsafdsaf it should say something like Authorization: {REDACTED}
Additional context

1000% agree, I'm not sure how or why this has not been brought up before...
I'm sure that the Authorization header is not this only one to fall into this category, this (to me) sounds like we should add the ability to supply a config (which default to known headers) to define which headers to exclude or redact (as suggested) from this (and response header tracking)
I'll raise this with the team and we will try and get this into the next release.


Reusable chunks missing

Problem
When calling SearchReusableChunks some chunks that have already been downloaded are not returned by this method.
So after downloading a file once and then calling  Sync or GetMissingChunks a second time. It will always show missing chunks despite the chunks having already been downloaded.
Possible cause
From what I understand this is caused by the distribution of work missing some chunks out.
This occurs when the division of chunks to workers has a remainder.
Example:
File:
001122334455667788

Zsync:
zsync: 0.6.2
Filename: test.txt
MTime: Tue, 15 Mar 2022 15:29:04 +0000
Blocksize: 2
Length: 18
Hash-Lengths: 2,2,3
URL: test.txt
SHA-1: b359128be3e76a423fb91f1ab7ff86f0a45b0eeb

...

Run SearchReusableChunks after having the full file contents already present.
If I have 8 workers, each will take 2 chunks each, leaving 2 which no worker will pick up. Which causes those chunks to be re-downloaded again despite them already existing.

@azubieta

@azubieta Sure, see https://github.com/AppImageCrafters/libzsync-go/pull/3


[Bug]: Compiler crashes for langlib call in query expression

Description
$title
Steps to Reproduce
type Employee record {|
    string id;
    string name;
|};

public function main() {
    string[] ids = [];
    Employee[] employees = [];
    string[] _ = from string id in ids
                    where employees.some(employee => employee.id == id)
                    select id;
}

Affected Version(s)
2201.3.0-RCs
OS, DB, other environment details and versions
No response
Related area
-> Compilation
Related issue(s) (optional)
May be related to https://github.com/ballerina-platform/ballerina-lang/issues/32710
Suggested label(s) (optional)
No response
Suggested assignee(s) (optional)
No response

Fixed with https://github.com/ballerina-platform/ballerina-lang/pull/39608


Manager merge

This was being developed in another repo, but it may make sense to move it here as it is closely related.

I don't like how it decreases testing coverage by almost 20%, but that can be addressed at a later date.


Have anyone tried this module from expressjs backend ?

I'm trying to use the same strings in the backend as well to render some stuff in the page markup, like prerender the <title></title> tag before react app is loaded

I think the main problem would be detecting the default language to use, because it access the Navigator object to identify it...

I see, will close this, just wanted to know if was checked there too, thanks


Can't drag and drop to move or open files after windows update KB4592438

VSCode Version: 1.52.1
OS Version: windows10 KB4592438(updated at 20210115)

Steps to Reproduce:
We meet this problem today(2021.1.15) on 3 different pc, and the same thing we have done is update windows10 automantically this morning, and the update version is KB4592438. Now i have tried to reinstall vscode and fallback windows, but it seems not work.

Does this issue occur when all extensions are disabled?: Yes/No

Is it possible you run VSCode as admin or different user and it happens?

Is it possible you run VSCode as admin or different user and it happens?

Is it possible you run VSCode as admin or different user and it happens?

no, i check the code.exe , and i don't use the "open as admin" config, and the problem is not frag files from other windows to vscode, even drag inside vscode is not worked...

Is it possible you run VSCode as admin or different user and it happens?

no, i check the code.exe , and i don't use the "open as admin" config, and the problem is not frag files from other windows to vscode, even drag inside vscode is not worked...

Can you try to reproduce with our nightly insider builds? You can give our preview releases a try from: https://code.visualstudio.com/insiders/

Can you try to reproduce with our nightly insider builds? You can give our preview releases a try from: https://code.visualstudio.com/insiders/

Can you try to reproduce with our nightly insider builds? You can give our preview releases a try from: https://code.visualstudio.com/insiders/

We have tried the insider version and it doesn't work either.
The specific windows update caused the problem for me is actually kb4598242. After the update, the open tabs in vscode are fixed and can't be dragged and moved left or right. We can not drag to open files from remote explorer at side bar either.

Can you try to reproduce with our nightly insider builds? You can give our preview releases a try from: https://code.visualstudio.com/insiders/

We have tried the insider version and it doesn't work either.
The specific windows update caused the problem for me is actually kb4598242. After the update, the open tabs in vscode are fixed and can't be dragged and moved left or right. We can not drag to open files from remote explorer at side bar either.

This sounds like an upstream issue to me, nothing VSCode can fix. Related KB: https://support.microsoft.com/en-us/help/4598242/windows-10-update-kb4598242

This sounds like an upstream issue to me, nothing VSCode can fix. Related KB: https://support.microsoft.com/en-us/help/4598242/windows-10-update-kb4598242


Roles from more than one organization doesn't show any more

Extension Version
1.7.6
Description
Not sure when it started as I'm 95% on the one organization.
Now I have to switch between users/orgs, the "Show All Profiles On Open" doesn't seem to show all profiles/roles, just the selected one.
I have 3 chrome profiles for simultanious multi-account work and all of them show this behviour.
I have tried the "reset all iam profiles" button and logged on to the start-portal for each org, but didn't change anything.
Browsers
Chrome
OS
Windows

'Show All Profiles on Open' is for when you don't want the list filtered to your favorite profiles by default.
Edit the profile list & check 'All Users' to show profiles from all users.
The settings in general are not super clear, I'll see what I can do in the next version.

 :)
In my mind this setting makes sense to put in the Users tab where you can switch users, which is a related to showing profiles from all users.
Again, thanks for the tool I use daily! (And still haven't learned)


feat: enable changesets and release workflow

Changesets and Release Workflow

To manage versioning and publishing of modules, changesets has been configured to be run locally by developers.
The changeset-bot has been enabled to add comments to PRs when no changesets are found in the PR.
The changeset GitHub Action is used in the pipeline to version and publish every commit merged to the main branch.
The README.md file has been updated with more information on changesets and the release workflow.

Merging using admin privileges to test pipeline.


[Request] : SkipLogs Management + Logs Auto-Cleaning Feature

ISSUE : query.log+blocked.log easily reaches > (300+300) Mb just in 2 days
Can you add a selective option do not show log output for some rules from the blacklist.txt ?
For example:
*.example-1.com
- SkipLog: *example-2* (not showing in the main log)
*.example-3.com

Log lines for *example-2* will not be present in the query.log, but in the blocked.log only.
(Or will be missed even in both log-files !)
Problem:
I can effectively use dnscrypt-proxy for blocking some software I use often, that generates huge DNS flow, unfortunatelly. Everybody knows that almost all software today have a spying behavior.
Firewall is not always your friend within some special tasks :(
Only dnscypt-proxy filtering is my last hope in some situations.
So, I have logs from different sources (Browser, Software, OS, Network) in one query.log file...
That's a trouble.
In case having lot of repetitive addressing garbage in the query.log it's hard to see and troubleshoot new entries. Heavy Log-files. Eye-catching or shooting the new suspicious links is hard.
1. Logs Management
logged_qtypes filter is not I'm talking about. This is another feature...
I'm expecting on some extra syntax feature in the blacklist.txt.
I want to manage existing blocked domains - what kind of rules output should not be shown in the main query.log (but I remember they were blocked or I can easily find "special" syntax in *.txt any time).
This have to be based on existing RULES: you may mark a RULES (repetitive output) you don't want to see in the main query.log (or even blocked.log).
So with only 1 "unlogged" rule you may free main logging stream (or 2 log-streams at once) for 10-ns lines per second (from the some most spying links/software). After some predefined time this software making an attempt again and again...
2. Logs Auto-Cleaning Feature
Can you implement Logs auto-cleaning in the *.toml after some defined time?
For example: 12h (by default)? (Simple recreating the same files)?
Anyhow, it would be nice and useful.
BENEFITS

Lighter logs, easier keep an eye what's going on in your Network
Easier finding suspicious links, making blocking list is more effective
Easier Disk system load, longer HDD/SSD life
Lower disk space for Logs with Auto-Cleaning feature
Faster opening *.log files

Thanks!

Thank you very much for the "Automatic log files rotation" feature in v2.0.6 !
Will test it further, spending time with it.

No mention, if you continue working on "Logs Management" feature, that still may be very helpful.
In this case I have an idea, where start from. A bit simplified variant, but also useful.

For example, an option in the *.toml config:
[blacklist]

# exclude_query_log = true

This means all blocked lines will not be written to 'query.log' , but 'blocked.log' only.
Nothing to do with *.txt files (rules).
This will be 50% done of my Logs Management request.
Thank you.

Please.........


Multiple domains enhancement

Greetings @Behemouth,
Will you consider add a feature to WeedProxite that can handle multiple domains like:
http://www.themirroredwebsite.com
http://static.themirroredwebsite.com
http://api.themirroredwebsite.com
http://video.themirroredwebsite.com

because at this time, it is not working. Or I missed something in the conf. files… ?
Thanks !

All available configurations are in Config.coffee : https://github.com/Behemouth/WeedProxite/blob/master/lib/Config.coffee#L38
This situation you can use allowHosts option.

Yeap… thanks @Behemouth I've seen that and added sub-domains, but actually even using this option, seems not enough to load called static files… :/

Try to simply add this line in your site's own main.html before client.run() （Example: https://github.com/Behemouth/WeedProxite/blob/master/lib/tpl/main.html#L121）:
client.rewriter.rule({attr:'data-img-size-big',rewrite:function (src) {
    return WeedProxite.rewrite.url(src,client.config);
})

Thanks a lot !!
WeedProxite rocks.


Docs: Add LLM training Examples using Lance

The following examples will be added to Lance under LLM training, each point is an individual page (ideally):

Creating a dataset for LLM training (Codeparrot subset or wikitext will be nice)
Training an LLM with a Lance dataset (along with the custom dataloader and sampler) + GPU util benchmarks

Hey can I work on this too ?. I have a background of training/finetuning LLMs.

Hey can I work on this too ?. I have a background of training/finetuning LLMs.

Hi @Aryan-Deshpande, thanks a lot for showing an interest!
Unfortunately I have already completed the code and demos and completing some backlogs before pushing the changes here.
However, we would love to see your contributions to Lance! Why don't you check out an Issue from Lance/issues and open a PR for one that you are passionate about?
Cheers!


lexer+formatter: Store raw number value along with NumericConstant

This allows the formatter to use the raw number value in the source
rather than the parsed NumericConstant when formatting.
Also fixed bitwise-and spacing.

Closing this and submitting a new PR as moving number parsing to the parser is a significantly different approach.


chore: item layout mobile

This adds a native version of ItemLayout. Using the web styles and its not looking quite right:
https://github.com/user-attachments/assets/ad0b40dd-8657-4548-bfbf-74841ae043fd
On native, it seems like alignItems doesn't support start / end so I have instead used flex-start and flex-end, maybe thats the issue?
When I check the web.storybook ItemLayout is not loading at all there so I can investigate fixing that and compare

Looks good @pete-watters 👍

Looks great! 🚀

Thanks 🙇

I'll merge this as it is adding the component correctly although the alignment of items (see demo) could need some work which we can tweak when consuming it.


Select all string does not work

I tried via command-palette, keybinding and right-click on the mouse, none of them selected the string around the caret/cursor.
I also tried if it was meant to only work when at least one character is selected, but that did not help either.
Versions:
atom: 1.5.3
python-tools 0.6.7

Could you give me a sample of a string you are trying to select please?

Sorry, i'm not using this plugin anymore.


Upgrade to Netty 4.0.24 to avoid POODLE vulnerability

There is a fix (#3031) made in Netty 4.0.24 to disable SSLv3. Those applications using Netty SslContext can benefit from this fix without need to make any other change in their code.

LP has been upgraded to a more recent Netty, so closing this issue.


Map username from SAML Assertion when new user is created.

Background:
When the SAMLResponse is recieved from the IdP, the assertion contains different user attributes. These attributes should be used when creating the federated user, but as it stands right now, this does not seem to work. This may very well be related to FKIS using different namespaces for user attributes than the SAML2 Standard.

This needs a more detailed description, what was the goal?
Are there  any relations to #54? Maybe?

More details:
When the SAMLResponse is recieved from the IdP, the assertion contains different user attributes. These attributes should be used when creating the federated user, but as it stands right now, this does not seem to work. This may very well be related to FKIS using different namespaces for user attributes than the SAML2 Standard.

Currently experimenting, but this should be by possible utilizing this


Add custom monitoring for extensions

How to categorize this issue?

/area monitoring
/kind enhancement
/priority normal
What would you like to be added:
The current extensions contract only supports adding monitoring in the shoot control plane. This concept should be extended to allow extensions to be monitored from the aggregate-prometheus in the garden namespace.
Why is this needed:
Custom metrics exposed by extension controllers (like the external-dns-management controller @MartinWeindel ) are not collected. These metrics can provide insights into the components and our landscape that we currently do not collect.
Proposal:
Extensions create a configmap either in the garden namespace or in the extension namespace that is picked up by gardener similar to the current contract. The configmap will have configuration for the aggregate-prometheus and contain dashboards for grafana.

After discussing with @MartinWeindel @timebertt and @istvanballok we came up with the following proposal. We will add a new singleton prometheus which we will call seed-prometheus in the garden ns (it could also be deployed in a different ns).
Seed-prometheus
Will be responsible for all system components running on the seed (i.e. everything other than shoot control planes).
Contract between seed-prometheus and extensions
The seed-prometheus will discover all pods in the extension namespaces and only scrape pods with annotations similar to those of the prometheus operator. Example:

prometheus/scrape: true
prometheus/port: 8080

Providing dashboards
The extensions can also provide dashboards for the grafana running in the garden ns. Grafana provides a sidecar that can discover and provision dashboards from configmaps. The configmap just needs the proper label to be discovered.

Thanks for your proposal! As said in person, I like it very much and I'm already looking forward to the improved monitoring experience! 🚀
One minor comments and one question from my side:

I would propose to use prometheus.io/{scrape,port} (not the .io), as it seems to be kind of a standard in the community (e.g. comes as part of many helm charts and the prometheus helm chart also uses those annotations by default, see here).
Can you clarify how the grafana box in the diagram relates to the current grafana instance in the garden ns of Seeds, that we already have? Is this the same instance or a new one? If it's a new one, will it also host existing seed monitoring dashboards? :)

Thanks for the feedback @timebertt!

You are right. I will update the comment to reflect that.
The grafana already exists and I propose we simply reuse it. The prometheus will have multiple prometheus datasources, but I don't see that being an issue. Either way it should be used to host existing and new seed monitoring dashboards.

@wyb1 Can you shortly explain how this new seed-prometheus is different from the Prometheus instance (seed monitoring stack) we already have in the garden namespace or what's the motivation for adding a new Prometheus instead of reusing the existing one?
Btw. which controller will be responsible for deploying seed-prometheus?
Thanks :)

The motivation of adding a new prometheus is so that we have a prometheus dedicated to only monitor components running on the seed. This should be the entry point for operators when debugging issues with the seed. There are 2 reasons for not reusing the aggregate-prometheus which is also running in the garden ns.

The purpose of the aggregate-prometheus is to aggregate data (i.e. data with low cardinality). If we start collecting data from every extension we will have lots of high cardinality data in this prometheus.
The seed-prometheus will act as buffer protecting the aggregate-prometheus from being overloaded with too many metrics and filling the disk since we could have any number of extensions exposing metrics and we don't have any control over which metrics we collect.

Maybe I am being overly cautious since we could reuse the aggregate-prometheus but we would most likely have to resize the disk at some point or perform some other operational tasks for aggregate-prometheus if we use it for this purpose.


1389/content + translation updates

Pull Request Template
Issue Overview
This PR addresses #1389

[ ] This change addresses the issue in full
[x] This change addresses only certain aspects of the issue
[ ] This change is a dependency for another issue
[ ] This change has a dependency from another issue

Description
This PR includes both content updates and translations based on the Ad Hoc Translations tab of https://docs.google.com/spreadsheets/d/1glJRJ6znXsYJwF2AAI0w6xhN59ebcEMO8Qr0JU2mLnU/edit#gid=1814435867. This PR doesn't include any Housing Basics page updates since those are handled in PRs #1405 and  #1411.
How Can This Be Tested/Reviewed?
This can be tested by verifying that each string on the google sheet is reflected in the previews. These strings are primarily found on the homepage and get assistance page.
Checklist:

[x] My code follows the style guidelines of this project
[x] I have added QA notes to the issue with applicable URLs
[ ] I have performed a self-review of my own code
[x] I have reviewed the changes in a desktop view
[ ] I have reviewed the changes in a mobile view
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes
[ ] Any dependent changes have been merged and published in downstream modules
[x] I have assigned reviewers
[ ] I have run yarn generate:client and/or created a migration if I made backend changes that require them
[ ] I have exported any new pieces added to ui-components
[ ] My commit message(s) is/are polished, and any breaking changes are indicated in the message and are well-described
[ ] Commits made across packages purposefully have the same commit message/version change, else are separated into different commits

Reviewer Notes:
Steps to review a PR:

Read and understand the issue, and ensure the author has added QA notes
Review the code itself from a style point of view
Pull the changes down locally and test that the acceptance criteria is met
Also review the acceptance criteria on the Netlify deploy preview (noting that these do not yet include any backend changes made in the PR)
Either explicitly ask a clarifying question, request changes, or approve the PR if there are small remaining changes but the PR is otherwise good to go

On Merge:
If you have one commit and message, squash. If you need each message to be applied, rebase and merge.

One translation concern that came out of this was that Markdown files when presented right to left are showing the linked phone numbers from right to left as well which I don't believe is correct based on this. Has this issue come up before?

@emilyjablonski Yep!


Document how to use and adapt to two-value display in CSS

We need to add content about how to make use of the two-value syntax for display. This should cover both how to write CSS using this syntax, but also how to update existing CSS to use the new syntax, where possible and/or appropriate. Should also cover the value of the new syntax, how it's different/better, and so forth.
This probably ought to be part of a larger guide article or set of articles on using display.
Acceptance criteria:

Guide added to display docs to show how to use the two value syntax

@rachelandrew this'd be a great one for you to do in the next sprint, if you feel like a break from learning area assessments.
You could crib a lot of it from your two value display syntax hacks post.

@chrisdavidmills sure, there are a few things we've discussed regarding display as ultimately the display spec is key to pretty much all of layout. So the property page is a bit weird as the minute you say display: grid you are off to the grid spec (which has loads of docs), display: flex same for flexbox. Then there is a bunch of stuff which I think the new values make clearer (what inline-block really means etc.)
I've also written a lot of stuff about display in the Learn Layout section.

I have written a new article on the two value syntax with some live examples: https://wiki.developer.mozilla.org/en-US/docs/Web/CSS/display/two-value_syntax_of_display
Also updated the property page for display to link to it. https://wiki.developer.mozilla.org/en-US/docs/Web/CSS/display

@rachelandrew awesome, thanks!
To neaten things up, I've put the info you added to the display ref page under a new heading:
https://wiki.developer.mozilla.org/en-US/docs/Web/CSS/display#Which_syntax_should_you_use_now
I've also copy edited the new article, and it looks fine, so closing this now.


Continuously listening to user input

It seems that the voice detecting function will terminate after starting detection a few seconds. Is there exist a way to keep listening to user input?
Thanks!

Would love to know this as well.

This has been a suggestion in the past, so I started implementing this with Android (first). In 0.2.x you now have (limited) access to the RecognizerIntent EXTRA_* options such as EXTRA_SPEECH_INPUT_MINIMUM_LENGTH_MILLIS
EXTRA_SPEECH_INPUT_COMPLETE_SILENCE_LENGTH_MILLIS
EXTRA_SPEECH_INPUT_POSSIBLY_COMPLETE_SILENCE_LENGTH_MILLIS are now customizable.
For example, to force the intent to recognize for 10 seconds without stopping,
Voice.start('en-US', {
  EXTRA_SPEECH_INPUT_MINIMUM_LENGTH_MILLIS: 10000
});

Awesome news! I had played around with setting these as hardcoded values in the component java files, but they didn't seem to have any effect. Have you been able to get them working?

This isn't working for me on android - is there an alternative to getting this running continuously? or at least increasing the time for silence?

Editing the hardcoded values in the java files don't work for me either.

not working to me as well :(

Hi, are there any updates on this issue? We have the same problem using target api 28. Would be happy to contribute to a fix of this issue.

Any updates on this? It is not working for me either.


Swift 3 on master?

Do you have any plans to merge your Swift 3 branch into master and make it the stable version?

Is this repo dead or will the swift 3 branch be merged back into master?

It's a shame that this pod isn't maintained as it should :|

@falkobuttler , @PranKe01 : Sorry for the late reply. The Swift 3 branch has been merged into master and we created a new version (1.0.6) with it.

Awesome, thanks!

Reopening - I can't load this repo neither from master, tag 1.0.6 or with that version from CocoaPods directly.
[!] Unable to find a specification for 'FLTextView'.

Same here :(
https://github.com/freeletics/FLTextView/issues/20

@falkobuttler should be fixed now


Beneficial to merge all processed vcfs into one prior to annotating?

average distribution of variants of VCFs:
wc -l vcf/processed/*
2 GENIE-
2 GENIE-
5 GENIE-
1 GENIE-
2 GENIE-
3 GENIE-
2 GENIE-
...

Angelica informed me that there isn't really much difference in speed and that the first time running through the annotation will be longer due to cacheing of the results in mongoDB.

I think it would be a good idea to do some real performance comparisons ... seeing how long a run for a center using hundreds of small vcf files take to complete. And compare that to an annotation run for the same center using a single merged maf (perhaps from the output of the first run) as the input.

Based on a previous conversation with @thomasyu888 the original decision to annotate the MAFs individually first before generating a "per-center" MAF was based on whether the suggested approach would be scalable or not. I believe it's been decided to do some performance tests first based on the currently available GENIE data. Performance tests will be:

total time to standardize and annotate individual MAFs from a center
total time to standardize and merge individual MAFs into a "per-center" MAF and then run that through the annotator


Orientation Fix

The code it's working right, but seems like the final video it's not being generated with the right orientation.

Face orientation issue.


KeyError: 'extraRinse1' after update to 0.7.X

After the latest update, I'm receiving the issue
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/helpers/update_coordinator.py", line 193, in _handle_refresh_interval
    await self._async_refresh(log_failures=True, scheduled=True)
  File "/usr/src/homeassistant/homeassistant/helpers/update_coordinator.py", line 341, in _async_refresh
    self.async_update_listeners()
  File "/usr/src/homeassistant/homeassistant/helpers/update_coordinator.py", line 142, in async_update_listeners
    update_callback()
  File "/usr/src/homeassistant/homeassistant/helpers/update_coordinator.py", line 401, in _handle_coordinator_update
    self.async_write_ha_state()
  File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 568, in async_write_ha_state
    self._async_write_ha_state()
  File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 632, in _async_write_ha_state
    state = self._stringify_state(available)
  File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 574, in _stringify_state
    if (state := self.state) is None:
  File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 1016, in state
    if (is_on := self.is_on) is None:
  File "/config/custom_components/hon/switch.py", line 360, in is_on
    setting = self._device.settings[self.entity_description.key]
KeyError: 'extraRinse1'

This avoid the component to load the other appliance attributes and all the attributes appear unavailable.

Hi, did you test also the v0.7.2? Thought it was fixed there 🤔

Yes, i've installed the 0.7.2

I have an idea where the problem is, I will fix that later today.

No hurry. I'm using a local fix as a workaround.
Anyway the integration does not provide temperature and current program now.

Sorry, I changed too much 🥴
Which device do you use? (appliancetype, brand, model)

It is a Candy WashDry RPW4966BWMR/1-S

I think the KeyError should be fixed now, can you please test v0.7.3-beta.1 to verify this? :slightly_smiling_face:
I added the temperature sensor again, but which program entity are you missing? I changed the prCode to the correct name recently, do you mean this? Can't you see the new sensor or do you really need the prCode?

OK, i tested the latest beta and working.
Which is the new prCode?

Thanks!
The key is now programName, here we have a look at the corresponding program and display now the program key (eg hqd_quick_dry) and if available the translation of the program name :slightly_smiling_face:


Add container poll interval and timeout

This PR should add poll_interval and poll_timeout to the k8s runners runtime (https://docs.gitlab.com/runner/executors/kubernetes.html)
Setting poll_timeout should help resolve the timeout issue below:
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/1 nodes are available: 1 Insufficient cpu, 1 Insufficient memory."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/2 nodes are available: 1 Insufficient cpu, 1 Insufficient memory, 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/2 nodes are available: 1 Insufficient cpu, 1 Insufficient memory, 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/2 nodes are available: 1 Insufficient cpu, 1 Insufficient memory, 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/2 nodes are available: 1 Insufficient cpu, 1 Insufficient memory, 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/2 nodes are available: 1 Insufficient cpu, 1 Insufficient memory, 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/2 nodes are available: 1 Insufficient cpu, 1 Insufficient memory, 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/2 nodes are available: 1 Insufficient cpu, 1 Insufficient memory, 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/3 nodes are available: 1 Insufficient cpu, 1 Insufficient memory, 2 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/3 nodes are available: 1 Insufficient cpu, 1 Insufficient memory, 2 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/3 nodes are available: 1 Insufficient cpu, 1 Insufficient memory, 2 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/3 nodes are available: 1 Insufficient cpu, 1 Insufficient memory, 2 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/3 nodes are available: 1 Insufficient memory, 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate, 2 Insufficient cpu."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/3 nodes are available: 1 Insufficient memory, 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate, 2 Insufficient cpu."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/3 nodes are available: 1 Insufficient memory, 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate, 2 Insufficient cpu."
Waiting for pod gitlab-runner-namespace/runner-eebxo6ax-project-12739762-concurrent-3zzpmw to be running, status is Pending
	Unschedulable: "0/3 nodes are available: 1 Insufficient memory, 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate, 2 Insufficient cpu."
 Check https://docs.gitlab.com/runner/shells/index.html#shell-profile-loading for more information

@wajdihajji Updated.

@MeNsaaH / @chickenandpork, can you please take a look/approve?

Hey @MeNsaaH -- need your approval to merge.  This looks really straightforward (thanks for contributing, @wajdihajji ) .. I don't see a huge risk unless you've got a different idea of a long-term schema or whatnot.

Maybe this helps -> https://docs.gitlab.com/runner/executors/kubernetes.html

@SadmiB, MensaaH left Diemos a year ago, according to his resume.  He may be hit by the industry layoffs, or crazy-busy at a newer role.  I've reached out to beg for more access to process these three PRs.  Will advise.

👋🏿 , As @chickenandpork  has mentioned, I'm no longer part of the Deimos Organization as such I cannot merge any PRs. I'll try to reach out to anyone within the company to see if they can help out here.


[Kernel] compressed-tensors marlin 24 support

Summary

Adds an additional CompressedTensorsScheme to supoprt w4a16 models with 24 sparsity, CompressedTensors24
Add support for w4a16 models with 24 sparsity quantized through sparseml and saved through compressed-tensors
Leverages the kernels (gptq_marlin_24_gemm) used for gptq_marlin-24

From Neural Magic, Co-authored by @alexm-neuralmagic

Please rebase or merge the latest main branch to update AMD CI config and numpy version to pass the CI.


[NWS-1354][NWS-1495] Notify team member when receives the full contract value

Aproveita e faz o rabase

Correçoes feitas


Standalone executable

Hi,
This seems to be exactly like flyway replacement for couchbase. I'm not familiar with Java and its tooling. So I'm not sure if this is a lib or there is standalone executable with command line/config file options to run migrations? Or even better to be run as docker container?

Hello, this is a great idea, I'll try to implement this as soon as I have enough time. Contributions to help are welcome!

Hi, Please can I know if this feature would be available soon ?

Sorry for taking so long, I finally find the opportunity and the time to work on this. It is part of 3.4 release.
You can download the binaries for each platform and java application, but you can also use it with docker: ghcr.io/tchlyah/couchmove:v3.4
I'll document everything pretty soon.


ebs scheduling

https://github.com/rancher/cattle/pull/2580 + https://github.com/rancher/storage/pull/41 + https://github.com/rancher/agent/pull/151 + https://github.com/rancher/scheduler/pull/43 should address the scheduling issue for rancher-ebs. So if volume is created through rancher-ebs, the availability zone will be persisted and scheduler will make the decision to schedule the instance to hosts which are in the same AZ. Since it is based on https://github.com/rancher/scheduler/pull/43, this scheduling feature only applies to service containers.

Needs an integration test

@cjellick integration test is added.

LGTM


Error: API rate limit exceeded for <IP_ADDRESS>. (But here's the good news: Authenticated requests get a higher rate limit. Check out the documentation for more details.)

Get error Error: API rate limit exceeded for <IP_ADDRESS>. (But here's the good news: Authenticated requests get a higher rate limit. Check out the documentation for more details.)

@w-site are you using the cli or the api? Github requires authentication if you do a lot of requests. This library is supposed to prompt you for credentials if you don't provide them.
If you're using the cli, a screenshot of the output would be helpful (please make sure to remove any passwords or github tokens)

@doowb  I'm using cli, but now if i'm try to do update-contrib all work fine, probably problem was in limit of request, in any way thanks for answer.


release-0.7: arg blocking in change_membership() can be removed

The behavior of argument blocking in change_membership() is not clear:
https://github.com/datafuselabs/openraft/blob/2896b98e34825a8623ec4650da405c79827ecbee/openraft/src/core/admin.rs#L144-L149
Currently, the change_membership() method depends on the state of the replication to every node and the blocking argument to decide what to do next:

replication state
blocking
action

up to date
true
do change-membership, block until committed

up to date
false
do change-membership, block until committed

lagging
true
do change-membership, block until committed

lagging
false
do nothing and return error

Problem with this behavior is:

Changing membership can just always run in blocking mode. The caller can choose not to wait for the change-membership call to complete.

On the other side, when replication lags, the application can just decide whether to return an error with the help of RaftMetrics.

Thus simplify it by just removing blocking:
It will always try to commit the membership log and block it until being committed.

Fixed in #582


have a problem with run 'blender --background --python render_blender.py -- --output_folder /tmp  --format OPEN_EXR ./Data/model-2.obj'

AL lib: (WW) alc_initconfig: Failed to initialize backend "pulse"
ALSA lib confmisc.c:768:(parse_card) cannot find card '0'
ALSA lib conf.c:4292:(_snd_config_evaluate) function snd_func_card_driver returned error: No such file or directory
ALSA lib confmisc.c:392:(snd_func_concat) error evaluating strings
ALSA lib conf.c:4292:(_snd_config_evaluate) function snd_func_concat returned error: No such file ordirectory
ALSA lib confmisc.c:1251:(snd_func_refer) error evaluating name
ALSA lib conf.c:4292:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:4771:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2266:(snd_pcm_open_noupdate) Unknown PCM default
AL lib: (EE) ALCplaybackAlsa_open: Could not open playback device 'default': No such file or directory
Traceback (most recent call last):
File "/tf/MyWorks/3D/stanford-shapenet-renderer-master/render_blender.py", line 56, in
links.new(render_layers.outputs['Depth'], depth_file_output.inputs[0])
KeyError: 'bpy_prop_collection[key]: key "Depth" not found'

I change use this cmd in docker env had problem as  ,but when change to new env without docker has same problem as such ,"Depth" not foud
AL lib: (WW) alc_initconfig: Failed to initialize backend "pulse"
AL lib: (EE) UpdateDeviceParams: Failed to set 44100hz, got 48000hz instead
Traceback (most recent call last):
File "/home/ad/MyWorks/3D/stanford-shapenet-renderer-master/render_blender.py", line 56, in
links.new(render_layers.outputs['Depth'], depth_file_output.inputs[0])
KeyError: 'bpy_prop_collection[key]: key "Depth" not found'

A lot of this logging is unrelated (from some issues with sound). The last line indicates that you're running on an old blender version. Can you please post the output of blender --version?

blender --version
Blender 2.76 (sub 0)
build date: 2016-02-06
build time: 01:10:10
build commit date: 1970-01-01
build commit time: 00:00
build hash: unknown
build platform: Linux
build type: None

how can i install blender=2.79 ? i apt-get update then install  via ppa but can only get version=2.76,have other install method?

There's instructions e.g. https://askubuntu.com/questions/4586/is-there-a-ppa-for-the-latest-blender-version. You'll need to add a custom repository.

@panmari Hi, blender --background --python render_blender.py -- --output_folder /tmp model.obj keeps giving me error:
blender: error: unrecognized arguments: --output_folder model.obj Any idea what's going on? model.obj is at the same folder as render_blender.py


Commands not working

Description
/luckperms commands do not work. When I do /luckperms editor it says "Unknown or incomplete command, see below for error ...rms editor<--[HERE]"
Reproduction Steps
Every time I write a command they don't work.
Expected Behaviour
The command is supposed to provide me with a link to access the permissions on the website
Server Details
Spigot 1.18.1
LuckPerms Version
v5.3.89
Logs and Configs
No response
Extra Details
No response

If you are using Minecraft Forge version on your client higher than 39.0.45, this is your issue.
https://github.com/MinecraftForge/MinecraftForge/issues/8438#issuecomment-1029526426
Since LuckPerms is using an older method of registering commands, an update in the Forge custom commands is causing a breakage. Unfortunately the only fix at the moment is to downgrade to 39.0.45 until LuckPerms updates to the newer way of registering commands that mark the commands as executable.

Duplicate of #3299 - fix will be released shortly


EU4 linux support broken

Currently unable to patch eu4 with current release, HOI4 still works

Fixed

Reopening this as the patch applies but does not allow achievements
EU4
Native
Patch applies but does not allow the user to get achievements
Proton With Windows Patch
Patch applies and allows the user to get achievements
HOI4
Both Versions
Work as intended
I can provide the files needed if necessary


[Proposal] weird foreach behavior

My friend just found a "weird behavior" in PHP, but it's acceptable.
$one = array('a');
$two = array('b');

foreach ($one as &$value) {
    $value = strtoupper($value);
}

foreach ($two as &$value) {
    $value = strtoupper($value);
}

foreach ($one as $value) {
}

var_dump($one, $two);

Outputs:
array(1) {
  [0]=>
  string(1) "A"
}
array(1) {
  [0]=>
  &string(1) "A"
}

Wow!
But, if we unroll all foreach'es:
<?php
$one = array('a');
$two = array('b');

$value = &$one[0];
$value = strtoupper($value);

$value = &$two[0];
$value = strtoupper($value);

$value = $one[0];

var_dump($one, $two);

... everything makes sense. $value points to last position of array $two. But it's weird hehe.
So, can we create a rule to check this?

@wandersonwhcr how would/should this check work?
What should it look for?
Seems to be quite an edge case...

Too old issue.


Fix incorrect templates assignment

🧰 Ticket
Closes #33
🚀 Overview:
Select templates based on current role instead of current  force
🤔 Reason:
when we retrieve the message types for a force-role, we just retrieve the first message-type description for that force. Instead, we should show the "union" of all message types allocated to that force-role in that channel.
🔨Work carried out:

[x] Update templates assignment on SET_ALL_MESSAGES action
[x] Update templates assignment on SET_LATEST_WARGAME_MESSAGE action
[x] Tests pass
Logic bug in providing templates for player

@zukilover - were you able to reproduce the problem from the current develop branch, and did you verify that this PR fixed it?

I'm getting this error intermittently.  It may be due to some inconsistency in the testing backend database - but it would be good to robustly handle it:


System.NullReferenceException

Hi,
I'm getting the below error often in my program but when I restart my program it works fine again after some time I'm getting null reference exception, though the node is present in the web site it showing me as null as below
System.NullReferenceException: 'Object reference not set to an instance of an object.'
HtmlAgilityPack.HtmlNode.SelectSingleNode(...) returned null.
Below is line throwing error
HtmlNode node = document.DocumentNode.SelectSingleNode("//table[@class='tableBorder trBgBlue tdAlignC font13 fontStyle']");
This works fine but sometimes I'm getting null exception again when I re-run my program it works fine with no exception

Hello @udayashree ,
Unfortunately, this issue is missing too much information to reproduce it or find the error.
I believe the issue is more in your code otherwise with the number of people using this library, it would have been reported way before. But we never know!
If you can easily reproduce it, I recommend you to add this two null check.
if(document == null)
{
	throw new Exception("Oops! Document is null... must find out why!)
}
else if(document.DocumentNode == null)
{
	throw new Exception("Oops! DocumentNode is null... must find out why!)
}

So if one of this error are throw, it could maybe help you to find out where the issue come.
I believe for an unknown reason, your document becomes null somewhere in your code.
Let me know if you find out why this is happening.
Best Regards,
Jonathan

Hello @udayashree ,
Do you think you could provide us additional information?

Help us to keep this library free: Donate

Hello @udayashree ,
We are currently making some issue cleanup by closing some unanswered question.
Feel free to reopen if you can provide us additional information.
Best Regards,
Jonathan

Help us to keep this library free: Donate

Hello @udayashree ,
We made some test and everything is fine every time.
We even made some loop using your code
HtmlNode tableNode = htmlDoc.DocumentNode.SelectSingleNode("(//table[contains(@class,'tdAlignC')])[2]");

if (tableNode == null)
{
    throw new Exception("Oops! table is null");
}

but unfortunately we are not able to reproduce it ;(
Are you getting an error on this page (http://racing.hkjc.com/racing/Info/meeting/Results/english/Local/20171227/HV/1)? Or that's on some page that you try to get value from?
Best Regards,
Jonathan


Help

Is It Just Me Or Like How Does The Victim Get The Malware Onto There Computer

Prob shouldn't be doing stuff that involves malware if you don't know how

Usually people say things like "oh, go test out this game I made" or something like that and then send that malware with a game name, and a game like icon.

Also, no reason to open an issue, you have a brain, 10 fingers (probably) and a search engine

Hey! I am really sorry for my recent absence. I will look forward to fix the issues in the following week.


Update Obs4MIPs names in perfmetrics_CMIP5

Description

Following discussion here https://github.com/ESMValGroup/ESMValTool/issues/2974
CERES-EBAF Ed2-7 is not available on ESGF anymore.
CERES-EBAF Ed2-8 is available for variable rlut, rlutcs, rsdt, rsut, rsutcs.
This PR removes the version facet for CERES-EBAF which fix automatic download from ESGF.
GPCP-SG v2.2 ['pr'] is GPCP-V2.2 on ESGF.
AIRS RetStd-v5 ['hus'] is AIRS-2-1 on ESGF
Note that when trying to download AIRS-2-1, ESMValTool adds the time_frequency facet to the ESGF query while AIRS-2-1 uses frequency.
The query does not return the data successfully. We have noticed that issue for a few other datasets, see https://github.com/ESMValGroup/ESMValTool/pull/3317 discussion.
I have updated the version to align with ESGF anyway.

Before you get started

[X] ☝ Create an issue to discuss what you are going to do

Checklist
It is the responsibility of the author to make sure the pull request is ready to review. The icons indicate whether the item will be subject to the 🛠 Technical or 🧪 Scientific review.

[X] 🛠 This pull request has a descriptive title
[X] 🛠 Code is written according to the code quality guidelines
[X] 🛠 Documentation is available
[X] 🛠 Tests run successfully
[X] 🛠 The list of authors is up to date
[X] 🛠 Any changed dependencies have been added or removed correctly
[X] 🛠 All checks below this pull request were successful

New or updated recipe/diagnostic

[X] 🧪 Recipe runs successfully
[X] 🧪 Recipe is well documented
[X] 🧪 Figure(s) and data look as expected from literature
[X] 🛠 Provenance information has been added

To help with the number of pull requests:

🙏 We kindly ask you to review two other open pull requests in this repository

@hb326 or @axel-lauer, could you weigh in on the shortened time span?

@hb326 or @axel-lauer, could you weigh in on the shortened time span?

I think the differences when going from edition 2.7 to 2.8 are probably similar to what could be expected when shortening the time period. So in short I think this should be fine, particularly since this is a legacy recipe. For scientific analyses done today, I would recommend using edition 4.2 (or later once available) anyways.

Thanks, @rbeucher! There are two more places that need adapting. To match the new names, the reference_dataset needs to also be changed from GPCP-SG to the appropriate version in recipe_perfmetrics_CMIP5.yml, line 616, and recipe_perfmetrics_CMIP5_4cds.yml, line 1274. This should also fix the test problems.

Oh yes. on it

:-/ What is going on here?

I think there is a few more reference_datasets that need adapting. So far, I found AIRS in line 974; will look further.

Yeah, seems to be just the AIRS in both those recipes in the same line 974.
I'm sorry the error message is not more helpful. Perhaps you could open an issue about that?

OK looks good now...

Cheers, @rbeucher! Thanks for all the work.


Connection must be valid and open Error with Maria DB- NPoco

We are using Maria DB with NPoco (version 3.1.0), for managing our database operations. But some times we are getting error saying the " Connection must be valid and open.". Below is the  stack trace :-

   at MySql.Data.MySqlClient.ExceptionInterceptor.Throw(Exception exception)
   at MySql.Data.MySqlClient.MySqlCommand.CheckState()
  at MySql.Data.MySqlClient.MySqlCommand.ExecuteReader(CommandBehavior behavior)
  at NPoco.Database.ExecuteReaderHelper(DbCommand cmd)
   at NPoco.Database.ExecuteDataReader(DbCommand cmd)
   at NPoco.Database.<QueryImp>d__155`1.MoveNext()
    at System.Linq.Enumerable.SingleOrDefault[TSource](IEnumerable`1 source)

another exception happen related to this error :
Object reference not set to an instance of an object.
stacktrace :--    at NPoco.Database.CreateCommand(DbConnection connection, String sql, Object[] args)
   at NPoco.Database.<QueryImp>d__155`1.MoveNext()
   at System.Linq.Enumerable.SingleOrDefault[TSource](IEnumerable`1 source)

Please let us know your thoughts.

Would need to know the scenario in which you are using NPoco?
Are you using the same instance of Database. These should be created once per request. They are not meant to be reused (singleton).

We are using NPoco in MVC web application that receive lots of concurrent web requests from different web-hooks and from users. Used FluentMapping to map model with table columns.
For we create an instance of AppsRepository class in Controllers to do the DB operation.

public static class MyFactory
{
    public static DatabaseFactory DbFactory { get; set; }

    public static void Setup()
    {
        var fluentConfig = FluentMappingConfiguration.Configure(new OurMappings());
        //or individual mappings
        //var fluentConfig = FluentMappingConfiguration.Configure(new UserMapping(), ....);

        DbFactory = DatabaseFactory.Config(x =>
        {
            x.UsingDatabase(() => new Database("connString"));
            x.WithFluentConfig(fluentConfig);
            x.WithMapper(new Mapper());
        });
    }
}

And in our repository class we declare  'db' globally

public class AppsRepository
{
 IDatabase db = MyFactory.DbFactory.GetDatabase();

  public AppsSettings GetSingleApp(int appId)
        {
            AppsSettings appsSettings = new AppsSettings();
            try
            {

                appsSettings  = db.SingleOrDefault<AppsSettings>(" where app_id=@0 and deleted=0", appId);
            }
            catch (Exception ex)
            {
                LoggingManager.Log(ex);
            }
            return appsSettings ;
    }

}

I got this pattern from Npoco wiki

What version are you running on? Have u tried the latest? 3.4.1?

Thank you for replying.
We are using 3.1.0. Will try with updated version 3.4.1.

What is the lifetime of the AppsRepository object?


chore: move a2docs.css to replace styles.css

This make effective the new a2docs.css as a replacement of styles.css.

Moot now that we are moving to new aio doc viewer


Test PowerBI connections to S3 data

Data is being loaded into S3 in Parquet format. This data needs to be accessible to PowerBI. There is a known issue where PowerBI's Parquet connector does not work when connecting to S3 (details here.
The goal for this issue is to test the following alternative options to access this data from PowerBI:

[x] Download locally and open with PowerBI Parquet connector (SUCCESSFUL)
[x] Use a Python script connector
[x] Write a connector which makes use of Binary.Buffer
[ ] Test connecting to gzipped files (instead of Parquet) using Binary.decompress https://learn.microsoft.com/en-us/powerquery-m/binary-decompress (NOTE: Decided not to test this option because there are successful methods for reading Parquet files which are superior)

Sample URL for Parquet file: https://caltrans-pems-dev-us-west-2-marts.s3.us-west-2.amazonaws.com/dbt_irose_performance/station_metrics_agg_monthly.parquet
Sample URL for Gzipped version: https://caltrans-pems-dev-us-west-2-marts.s3.us-west-2.amazonaws.com/dbt_irose_performance/station_metrics_agg_monthly.csv.gz
Example Python code Ian wrote to test:
import pandas
df = pandas.read_parquet("https://caltrans-pems-dev-us-west-2-marts.s3.us-west-2.amazonaws.com/dbt_irose_performance/station_metrics_agg_monthly.parquet")

Example of the error message received when trying to connect PowerBI to the parquet file on S3 using the Parquet connector:

From online article:
https://blog.crossjoin.co.uk/2021/03/07/parquet-files-in-power-bi-power-query-and-the-streamed-binary-values-error/
"The error is raised by Power Query but it’s not really a limitation of Power Query: it’s to do with how Power Query accesses the Parquet file. If the Parquet file is on a local file system you won’t have this problem, but if Power Query needs to access the Parquet file via an API then you probably will because most APIs don’t allow the kind of random file access that is necessary to read data from Parquet (ADLSgen2 being an exception). The workaround with Binary.Buffer is simply avoiding the API by downloading the entire file into local memory and accessing it from there, but then you will run into the limit on container size (see https://blog.crossjoin.co.uk/2019/04/21/power-bi-dataflow-container-size/); on a gateway the container size is calculated relative to the amount of memory on the machine it’s running on (see https://blog.crossjoin.co.uk/2022/02/13/speed-up-power-bi-refresh-by-increasing-the-amount-of-memory-on-your-on-premises-data-gateway-machine/) so your best bet is to increase the amount of RAM on the gateway PC."

Was able to successfully connect to the parquet data on S3 using a Python connector. Note that this requires Python be installed locally with the following packages installed:
pandas
matplotlib
pyarrow
fastparquet

@jkarpen will add the steps here for the Python connector, then close this issue. Will also add Jianfei's slide deck for the other options presented.

Steps to implement the Python connector option:

Install Python on the local machine (or server for PowerBI reporting service). Must have the following package libraries installed: pandas, matplotlib, pyarrow
In PowerBI, choose "Get Data", then "Get data to get started" to view more connector options
Choose the Python Connector option

Paste this code:

df = pandas.read_parquet("https://caltrans-pems-dev-us-west-2-marts.s3.us-west-2.amazonaws.com/dbt_irose_performance/station_metrics_agg_monthly.parquet")

The resulting data frame has all fields showing as the text data type. Numeric fields will need to be transformed in PowerBI (this is a one-time transformation for a given file). This can be done in the Edit Query menu. Select all the fields that need to be changed, then right-click the header for one of them. Choose Change Type > Decimal Number (or appropriate data type).

Power BI connect Amazon S3.pptx
Attaching the slide deck created by Jianfei Wu showing access using a custom M Query with the Binary.Buffer option for reading in the Parquet file. This also includes an example of a Python API connection. In this case the S3 bucket is publicly accessible so the access key parameters are not needed, but this would be useful if there is ever a need for Caltrans to utilize a non-public S3 bucket.

Closing this issue, we have confirmed there are multiple options for reading in Parquet files into PowerBI.


PERF-#4886: Use lazy index and columns evaluation in query method

What do these changes do?

[x] commit message follows format outlined here
[x] passes flake8 modin/ asv_bench/benchmarks scripts/doc_checker.py
[x] passes black --check modin/ asv_bench/benchmarks scripts/doc_checker.py
[x] signed commit with git commit -s
[x] Resolves #4886
[ ] tests added and passing
[x] module layout described at docs/development/architecture.rst is up-to-date
[x] added (Issue Number: PR title (PR Number)) and github username to release notes for next major release

How much of a performance boost are we seeing for this?

Here we do not wait for this operation to be completed, but can immediately proceed to the next one. Thus, we save time by 90%(or more) of this function.

I already tried these changes on the workload we are profiling. There is a speed up both in the single node (~7 sec) and in the cluster (~8 sec).


Multiple Errors on Page

I'll list the errors I ran into before I had to stop due to issues with Azure AD "Sync," which is not in the purview of this page.
-Step 2, Note insert: "Should be less than 20 GB" indicates more than 20 will work but is not recommended. In fact, a file larger than 20GB causes the application to crash.
-Step 2, part 3: The command given is [azcopy.exe copy "" ""] and examples below reflect the Source Location being a folder. The azcopy executable does not support folders as indicated by the error message it generates. The path needs to include the file name. If the folder contains multiple files, the command must be run multiple times.
-Step 4, part 3, FilePath field: Makes reference to command switches from an obsolete version of azcopy.exe which no longer function.
I recommend having one of the documentation staff go through the process of uploading a PST file to Exchange Online and rewrite the page from scratch. As I mentioned, I had to stop at this point, but I'd be surprised if those were the only errors in the instructions.
The reason I had to stop was that the client previously had an on premises Exchange server that "synchronized" with Exchange online, and since the sync is actually one-way and not a synchronization process, I can only enable email archives via the remote server. I'm not authorized to make major changes to the 365 account, so I've left the PowerShell commands to the engineer we assigned to the account.
Honestly I'm amazed that the first company to create cross-application copy paste managed to make file transfers so complicated you need to make a multi page instruction article. That takes commitment.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: d4271558-62a9-db3c-078c-13b5e5fe99da
Version Independent ID: 813d7002-20a2-b1be-2771-975a0b1cfd48
Content: Use network upload to import PST files - Microsoft Purview
Content Source: microsoft-365/compliance/use-network-upload-to-import-pst-files.md
Service: o365-seccomp
GitHub Login: @v-tophillips
Microsoft Alias: v-tophillips

@v-tophillips Please help us in resolving this issue. Thanks

The statement "should be less than 20 GB" was written as: each PST file that you upload to the Azure Storage location should be no larger than 20 GB.


Add codecov yaml to not fail the build

Codecov Report

Merging #600 into master will increase coverage by 0.04%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master     #600      +/-   ##
==========================================
+ Coverage   57.74%   57.78%   +0.04%
==========================================
  Files          37       37
  Lines        9978     9978
==========================================
+ Hits         5762     5766       +4
+ Misses       3168     3165       -3
+ Partials     1048     1047       -1

Impacted Files
Coverage Δ

msg.go
77.85% <0%> (+0.65%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update fbee4ce...5e95a59. Read the comment docs.


fix(settings): Disabled configuration of apps while Plex is not yet c…

…onfigured

:tada: This PR is included in version 1.6.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket: