bluealsa amixer usage

I have a soundcard I am controlling with amixer (volume control, routing etc.)
I'm trying to send line in into BT speaker but I cannot identify bluealsa as soundcard with aplay -l nor amixer
any advice?

thank you, amixer -D bluealsa comes up with an error.
amixer -D bluealsa ALSA lib bluealsa-ctl.c:956:(_snd_ctl_bluealsa_open) Unknown field interface amixer: Mixer attach bluealsa error: Invalid argument
My audio card can route audio from input (i.e. mic or line in) into output with the appropriate amixercommand, it is really neat. you can also make the sound through some filters to clean up noise or to amplify it
The use case is as follows, this is a car music computer solution. Normally in my car (or any decent car) I use the analog out put to play the music in the car's speakers, while the phone sounds (mainly GPS navigation) are streamed via Bluealsa into the computer and then joint stream the audio into the analog output so I can hear both the music and the phone - good thing about BT is when there is no sound it turns into mute so there is no disruption to the sound quality.
However though, I travel for long periods and have long drives so I take the music solution with me. there is a trend in EU cars not to provide solely BT connectivity (which sucks). Bluealsa again here is extremely useful allowing me to stream music directly from the computer into the car (in the past I used the phone as mediator to car audio system but since the "3.5mm jack is out trend" android set BT as realtime priority in the CPU which literally kills the phone).
I think I figured the issue, as long as I am streaming music from the computer (via bluealsa) to the car's BT, I cannot "append" additional stream to it - meaning I have to choose whether it would be music (MPD) or the phone (because if I stop MPD from using bluealsa output it works) - which is the core downfall of ALSA.
What I wanted originally is to route the phone into the bluealsa (via amixer) so the computer "would think" it is a single audio stream

bluealsa-ctl.c:956:(_snd_ctl_bluealsa_open) Unknown field interface

If you've upgraded from <2.0.0 to >=2.0.0 you will have to update ALSA configuration file as well. Note, the location of this file depends on the version of ALSA library. Also make sure, that your custom asoundrc files does not contain line interface "hci0", because right now interface is selected by bluealsa server instance, which you have to select via service "org.bluealsa" in asoundrc (or keep default if file 20-bluealsa.conf is properly installed).

I haven't upgrade yet...still on 1.4.0
this is my asoundrc below, and I also have the 20-bluealsa.cong installed in /etc/alsa/conf.d/20-bluealsa.conf
`defaults.bluealsa.service "org.bluealsa"
defaults.bluealsa.device "AB:CD:EF:12:34:56"
defaults.bluealsa.profile "a2dp"
defaults.bluealsa.delay 10000
pcm.bluealsa {
type plug
slave.pcm {
type bluealsa
device "AB:CD:EF:12:34:56"
profile "a2dp"
}
}
ctl.bluealsa {
type bluealsa
interface "hci0"
}
`

What I wanted originally is to route the phone into the bluealsa (via amixer) so the computer "would think" it is a single audio stream

That's the thing I think amixer cannot do. Your card may be able to combine multiple inputs from its own connectors to one of its outputs, but it cannot directly mix into bluealsa without some application to move the audio data from the card to bluealsa.
It would be nice if alsa's dmix plugin would accept bluealsa as a slave but I think dmix only accepts hardware devices as slaves. So we are missing that middle component that could take input from mpd and the soundcard then combine them into a single stream for delivery to bluetooth for output. I really hate to suggest this on the bluealsa project site, but just maybe what you need is pulseaudio?

Ok, so clearer head this morning, apologies for my last comment and hopefully I can make more sense now.
You've already said you have a hardware mixing card and want to use that to combine the audio streams. So I assume the card has loopback capability so that audio sent to it from the computer can be read back in directly by the computer.
Is that correct? How does the loopback show up as a device - is it just hw:0,2 or is there some other way to identify it in alsa? If you could post the make and model of the sound card I will find time to read up on it and try to understand how this works better.
So assuming the card is hw:0, the line in device is hw:0,1, and the loopback mixer device is hw:0,2, then I guess you configure MPD to output to hw:0,2 (ie directly to the mixer device), and somehow using amixer or alsamixer configure the card to also route audio from hw:0,1 (line-in) to hw:0,2.
Then what's missing is an application to transfer the samples from the card to bluealsa, such as :
alsaloop -C hw:0,2 -P bluealsa
or
arecord -D hw:0,2 -r 48000 -c 2 -f S16_LE | aplay -D bluealsa
Is this any closer to reality?
[
btw in your .asoundrc above, I think you should include an exclamation mark ! in the bluealsa pcm and ctl definitions, since these are overriding the definitions in /etc/alsa/conf.d/20-bluealsa.conf:
pcm.!bluealsa {...}
ctl.!bluealsa {...}

]

Thank you very much for taking your time and thought into this, I really appreciate it!

btw in your .asoundrc above, I think you should include an exclamation mark ! in the bluealsa pcm and ctl definitions, since these are overriding the definitions in /etc/alsa/conf.d/20-bluealsa.conf:
pcm.!bluealsa {...}
ctl.!bluealsa {...}

will do!

but just maybe what you need is pulseaudio?
no pulse, this is a HiFi audio card, and songs so it would be such a shame to throw this at pulse. I understand that streaming the music via BT downgrades the audio quality from HiFi but this is only the secondary use of the configuration (main is analog) so I'd rather keep pulse out of the picture entirely.

I will try the loopback proposal, the only thing I need to mention is that computer's BT would be the same one that will receive the audio from the phone and transmit it into the audio system, another challenge is that this BT is 2.1 dongle so I hope it would cope with the load of the bandwidth of both in and out streams (it handles each one them individually quite well to my surprise)

So I did upgrade to 2.1.0 and as expected, nothing works..meaning that I do get the BT and the BT speaker to connect but bluealsa does not register as playback device...so I cannot stream anything to it, the same configuration which worked on 1.4.0 now fails
I did change the .asoundrc file and removed the interface hci0 as suggested

I'm going to close this issue, I did a bunch of work which not necessarily related soley to bluealsa
thanks for the help!

Hi,
I have a same issue. And my requirement is to redirect the audio from hw:0,1 to bluealsa. From that moment, Audio should not come through hw:0,1. Its like bluealsa needs to act as virtual plugin at runtime.
bluealsa version : 4.1.1
For example,
--> If other music sources writes audio on hw:0,1, then if BT got connected it should redirect audio to bluealsa plugin without disturbing (closing pcm and reopen snd_pcm_open() with bluealsa plugin) other music services whoever writing audio.
--> alsaloop -C hw:0,2 -P bluealsa or arecord -D hw:0,2 -r 48000 -c 2 -f S16_LE | aplay -D bluealsa
I have tried above steps, I could hear audio mixed with noise. What is the issue here ?
I am new to Alsa and PCM . Any help will be appreciated. Thanks


After respawning, the wrong weapons are selected

I noticed that after respawning, both by restarting the game and by simply hitting "respawn" in the game menu, instead of the weapons I had used previously, the first two matching weapons in my inventory where equipped. I'm assuming that is unintended behaviour and I'll take a look.
I've only noticed this behaviour with the Hunter yet, but I'm reasonably sure that I never had the conditions described above present when I was using other ships. I will investigate further.

---
Want to back this issue? **[Post a bounty on it!](https://www.bountysource.com/issues/24984794-after-respawning-the-wrong-weapons-are-selected?utm_campaign=plugin&utm_content=tracker%2F15383776&utm_medium=issues&utm_source=github)** We accept bounties via [Bountysource](https://www.bountysource.com/?utm_campaign=plugin&utm_content=tracker%2F15383776&utm_medium=issues&utm_source=github).

Hi guys. I was looking into this and according to the following code the best weapons, armor, and shields are equipped when the ship is created/respawned. Do you want this changed to the previously equipped items or left as is?
if (i instanceof GunItem) {
    GunItem gNew = (GunItem) i;
    if (gunIsBetter(gNew, g1, ic, m1)) {
      ship.maybeEquip(game, gNew, false, true);
      g1 = gNew;
    } else if (m2 != null && gunIsBetter(gNew, g2, ic, m2)) {
      ship.maybeEquip(game, gNew, true, true);
      g2 = gNew;
    }
  } else if (i instanceof Armor) {
    Armor aNew = (Armor) i;
    if (a == null || a.getPerc() < aNew.getPerc()) {
      ship.maybeEquip(game, aNew, true);
      a = aNew;
    }
  } else if (i instanceof Shield) {
    Shield sNew = (Shield) i;
    if (s == null || s.getLife() < sNew.getLife()) {
      ship.maybeEquip(game, sNew, true);
      s = sNew;
    }
  }

It would be best if it respawns with the previously equipped items

Yeah I think that's better too for a future in which it may be harder to even determine if a weapon is better or not :-)

I agree with @Rulasmur and @Cervator, previously equipped items would be better.

Ok, I'll get on it.

Closing as complete!


JSHint error

modules/sl-ember-components/components/sl-tab-panel.js: line 15, col 10, 'Alignment' is not defined.

May become resolved by https://github.com/softlayer/sl-ember-components/issues/603

Resolved by https://github.com/softlayer/sl-ember-components/pull/609


Support for grammar

It would be highly beneficial if the library could incorporate support for Grammar and GBNF files.
https://github.com/ggerganov/llama.cpp/blob/master/grammars/README.md

Support this request. Would be massive to produce structured data at scale.

I will test whether Shopify/torch-grammar works around these lines.
Will be posting here if it works :)

Any updates?

Hi! Sorry for the delay. I ended up implementing a minor speedup for constrained generation on llama.cpp by skipping "obvious" tokens and just decoding the ones that need an LLM. Although it managed to reach around double the original decoding performance, it is still not enough for my use case, so I will likely revisit this approach with vLLM in the future.
It is not the current priority for my personal project though, so it may take some weeks before I start experimenting again.
If anyone is eager to try an implementation, the idea I had in mind is, on a high level, as follows:

Instantiate the grammars, one for each sequence that will need to be decoded in parallel. I think it should be an attribute of the Sampler class:
class Sampler(nn.Module):

    def __init__(self, vocab_size: int) -> None:
        super().__init__()
        self.vocab_size = vocab_size
        # Dict[int, GrammarSampler]. Maps a sequence_id to a fresh sampler
        self.grammars = defaultdict(lambda: GrammarSampler(input_text, "root", tokenizer))

    def forward(...):

This follows the example from torch-grammar's Readme. As I'm writing this, I don't see how to know how many grammar samplers to create in advance, so the idea is to use a defaultdict that will create a new grammar as soon as an unseen sequence_id needs it.

Somehow, we should keep track of all the token IDs generated so far, because they are needed in the grammar sampler to set the logits of invalid continuation tokens to zero, and thus prevent those tokens from being randomly sampled and selected. A great candidate for this seems to be the output_tokens = _get_output_tokens(input_metadata) call a few lines into the forward function. This holds a list of tokens ids for each sequence id. It's enlightening to read the definition of _get_output_tokens towards the middle of the file to know the general shape of the returned list.

Just before computing the logprobs, we could call the logits_processor for each pair of (seq_id, grammar). The important thing here is to match up a few things: each sequence id to the corresponding grammar, that keeps track of the state of the generation and defines which tokens will be discarded now, and also to the current output for each of those sequence ids.
def forward(...):
    # More sampling code above ...

    # We use float32 for probabilities and log probabilities.
    # Compute the probabilities.
    probs = torch.softmax(logits, dim=-1, dtype=torch.float)

    # I don't know how to vectorize this, so I unroll it in a simple for loop
    output_idx = 0
    for seq_ids, sampling_params in input_metadata.seq_groups:
        for seq_id in seq_ids:
            #  the defaultdict will create a clean grammar when a given seq_id doesn't exist yet
            grammar_sampler = self.grammars[seq_id]
            output_for_this_seq_id = output_tokens[output_idx]
            logits_for_this_seq_id = logits[output_idx]
            # call the logits_processor(ids, logits)
            logits[output_idx] = grammar_sampler.logits_processor(output_for_this_seq_id,
                                                                  logits_for_this_seq_id)
            # ^ this will zero out the logits that correspond to invalid token ids under the grammar
            output_idx += 1
            # Note that I deliberately don't use an `enumerate` to update the output_idx variable,
            # because the _get_output_tokens function appends a sequence once for each seq_id,
            # not on every seq_group!

    # Continue with the existing code

    # Compute the log probabilities.
    # Use log_softmax to ensure numerical stability.
    logprobs = torch.log_softmax(logits, dim=-1, dtype=torch.float)

Accept the tokens that have been sampled to update the grammar state for each sequence id. Each sampling strategy (greedy, random, beam) uses the same interface for the return: List[Tuple[List[int], List[int]]]. Refer to the implementation of _greedy_sample, _random_sample or _beam_sample for more details, but from what I can understand by skimming through the code, those functions return, for each sequence group that requested that specific sampling strategy (this is the outer List of the return type), a tuple of the form (next_token_ids, parent_ids) to support generating multiple completions (one new token id for each sequence_id) for any single sequence group. Apparently, this tracks which tokens are selected (in parallel) as the next id and which ones were responsible for that generation (parent_ids).
I know this is like the movie Inception, but hold on.
def forward(...):
    # More sampling code above ...

    # Compute the log probabilities.
    # Use log_softmax to ensure numerical stability.
    logprobs = torch.log_softmax(logits, dim=-1, dtype=torch.float)

    # Sample the next tokens.
    sample_results = _sample(probs, logprobs, input_metadata)

    # Now we accept the token for each sequence id inside every sequence group
    output_idx = 0
    for seq_group_id, (seq_ids, sampling_params) in enumerate(input_metadata.seq_groups):
        next_token_ids, parent_ids = sample_results[seq_group_id]
        for seq_id in seq_ids:
            grammar_sampler = self.grammars[seq_id]
            next_token_for_this_seq_id = next_token_ids[output_idx]
            grammar_sampler.accept_token(next_token_for_this_seq_id)
            output_idx += 1

    # Continue with the existing code

As a final note, I'm not well familiarized with this project, and this plan is only a high level review of how I would go about implementing grammars. Also, note that the torch-grammar library is clearly unmaintained, but I think it should work well enough as a proof of concept. At least its API is comfortable.

Another update. I wasn't aware of the existence of logits_processors, as implemented on this PR. That direction seems way more promising and already has one example in the form of a unit test.

@viantirreau
Take a look at https://github.com/noamgat/lm-format-enforcer
They're using logits_processors to enforce JSON schema's and regex = basically Grammar

What is the technical reason why we cannot port over GBNF? It could be a logits_processor, plus a grammar need to be passed via API requests (both vLLM and OpenAI).


Can ghz print gRPC output on the command line?

I am running ghz against an application returns errors as error codes at the application-level, inside the response, rather than throwing an exception. Unfortunately, since ghz simply outputs OK for any completed request, I cannot tell whether the correct arguments are being passed to the application.
Is there a way to get the proto output of the request from ghz?

Hello, ghz assumes you are familiar with the server implementation and are able to make correct calls, or intentionally making incorrect ones.
Right now there is no way to print out the data sent and received from server. This has been inquired about before so it may be a good feature to add debug logging option.


Update toolkit and googleapis in artman, fix golden tests

@lukesneeringer PTAL. A customer is blocked by this.


ComplexSTFTDiscriminator diverges from paper

The ComplexSTFTDiscriminator in:
https://github.com/lucidrains/audiolm-pytorch/blob/e28ff435104792c887b10eae10c83c4ca50880a9/audiolm_pytorch/soundstream.py#L208
seems to diverge from the paper description. Particularly, Figure 4 in https://arxiv.org/pdf/2107.03312.pdf seems to show that there is a skip connection in the form of addition in every ResidualUnit instance that is not implemented in ComplexResidualUnit here:
https://github.com/lucidrains/audiolm-pytorch/blob/e28ff435104792c887b10eae10c83c4ca50880a9/audiolm_pytorch/soundstream.py#L198
On the other end, I am not sure if I am missing something, but it also seems that such skip connection is not possible due to the different channel numbers of consecutive ResidualUnit blocks. For example, the first block in Figure 4 has N=C but the one right after has N=2C. This means, that the output of the second block will have twice the number of channels of the first block, and therefore those two tensors cannot be added at the end of the second block in the form of the proposed skip connection.
Any clarification about this would be really helpful.

I actually came across this and wasn't sure, and made the call to omit the residual. Our options would be a parallel conv with kernel size 1, projecting to 2C, or a residual added right after the activation.
Do you know how encodec built theirs?

@eagomez2 i'm just going to do some improvisation https://github.com/lucidrains/audiolm-pytorch/commit/d50ae9e31601f9737dbf05cac3b27816641382c9
there! now there's a residual :laughing:

Hi @lucidrains and thanks!
I am not really sure if these skip connections are fundamental in discriminators. My impression is that the identity propagation promoted by skip connections is not necessary for the task they do. Moreover, this is the first discriminator I bumped into that has them, although I may be wrong about the first statement.
On the other side, I looked into EnCodec because you mentioned it and found that even when the discriminator is not exactly the same, the approach is quite similar, but using a stack of real data types instead of complex numbers and with some differences in dilation and such. Here you can see the implementation:
https://github.com/facebookresearch/encodec/blob/main/encodec/msstftd.py
Have you already successfully used the ComplexSTFTDiscriminator as it was without skip connections? I'm considering using it and comparing it with the EnCodec one to see which one works best for the task at hand.

@eagomez2 so in the image arena, some of the more powerful discriminators definitely have residuals (stylegan2 etc)
yea, i've always thought that complex value network was a bit overkill, but during the early stages of the repository, some independent researchers reported better convergence, so i bit the bullet and made it work
i think you should just try the new version with the extra conv and skip connection. but honestly i'm fairly confident either case will work well


🎮 Game Request
This game is a 2D platformer where you control a character and navigate through different levels. Your objective is to collect coins, defeat enemies, and reach the exit point to progress to the next level.
Point down the features
Use arrow keys to move Link and interact with doors.
Avoid hazards and enemies to stay alive.
The game features multiple levels, scoring, and a game over screen displaying your final score.
Select program in which you are contributing
GSSoC23
Code of Conduct

[X] I follow CONTRIBUTING GUIDELINE of this project.

Hey @KhushiTayal  ! Thank you for raising an issue 💗 You have been assigned this issue you can start working on the issue 🎮

Hello @KhushiTayal, Time's Uppp!⏰
Sorry for closing your issue!
But it's more than a week since we haven't received anything from your side 😢 .
Come up with new ideas, create a new issue and make sure you finish it within a week! 🔥
All the best! 🚀
Happy Hacking! 💗

Hey @KhushiTayal ! Thank you so much for your raising the issue💗
It’s all yours, you can come anytime again and make some contributions! 🚀
Alone, we can do little, but together we can do so much! 😇


Allow other component to define shortcuts and services

No shortcuts, however everything else is now supported (constants, services, routes, preferences).


Agility marker not present at GWD crossbow shortcut

The green agility box is not present on the agility shortcut for the crossbow clue near GWD. It's not a major bug, but for consistency sake it probably should be fixed.
https://gyazo.com/015359dee527c5347b6b83db8b148870

World map location would be useful as I'm sure there are developers out there, myself included, who have 0 idea where that location specifically is, so would have to run around like headless chickens to locate it.

My apologies. It's right here, north-east of the god wars dungeon (not the shortcut going into the Wilderness).
https://gyazo.com/c37a101aa573c128f3041251913e9c57


PHP 8.2 Release

Hello @frederikbosch,
Now that #724 and #725 are merged, is there anything else needed before releasing a new version supporting PHP 8.2?
If this is not considered a major, it could be released as v4.0.5. Otherwise, it would be the first v5.0.0 release.
Let me know if there is something I can do on my side to help on releasing that new version.
Thank you!

I will tag v4.1.0 after the weekend. By tagging a minor version we leave room to create tags for non-PHP8.2 versions in the 4.0 range. A new major seems not necessary because there has been no backward incompatible change. Support for PHP 8.2 is a feature, and therefore I deem 4.1.0 the best decision.

@rogervila, if you have some time, could you have a look at PR #726? I know my colleague @sagikazarmark is mostly working on other libraries and I guess he is not in the opportunity to help. But Mark, if you read this and do have the opportunity, go ahead!

Since I am not working that often on this library, I want to have #726 in before tagging 4.1.0. It is almost ready to go.

In the latest commit I already prepared CHANGELOG.md for the new release, adding all modifications to the library since the latest release.

Version 4.1.0 has just been released.


test(NODE-3698): sync spec tests for crud operations with let option

Description
What is changing?
Support for the let option was added in: https://github.com/mongodb/node-mongodb-native/pull/2829
This PR pulls in spec changes from the following PRs:

https://github.com/mongodb/specifications/pull/1105
https://github.com/mongodb/specifications/pull/1094

While syncing the spec tests, two broken spec tests were found.  The work to fix these tests is tracked here and the tests have been skipped for now.
Is there new documentation needed for these changes?
No
Double check the following

[x] Ran npm run check:lint script
[ ] Self-review completed using the steps outlined here
[x] PR title follows the correct format: <type>(NODE-xxxx)<!>: <description>
[x] Changes are covered by tests
[x] New TODOs have a related JIRA ticket

Did you double check that our unified test runner definitely and correctly parses the specified let option input and expectations? (I know we made the runner adjustments in the original PR, but I am a bit paranoid about these things after all the misses we've discovered after the fact, so always worth a second look)

@dariakp yes, I've confirmed that the let option is being parsed as expected


Konflux update test-component-pac-cyutfz

Pipelines as Code configuration proposal
To start the PipelineRun, add a new comment with content /ok-to-test
For more detailed information about running a PipelineRun, please refer to Pipelines as Code documentation Running the PipelineRun
To customize the proposed PipelineRuns after merge, please refer to Build Pipeline customization

Pipelines as Code CI/test-component-pac-cyutfz-on-pull-request has successfully validated your commit.
Namespace: build-e2e-hwci-tenant
PipelineRun: test-component-pac-cyutfz-on-pull-request-629j7

Task Statuses:

StatusDurationName

✅ Succeeded
5 seconds
init

✅ Succeeded
15 seconds
clone-repository

✅ Succeeded
37 seconds
build-container

✅ Succeeded
8 seconds
push-dockerfile

✅ Succeeded
8 seconds
sast-snyk-check

✅ Succeeded
9 seconds
sbom-json-check

✅ Succeeded
11 seconds
ecosystem-cert-preflight-checks

✅ Succeeded
10 seconds
clair-scan

✅ Succeeded
9 seconds
deprecated-base-image-check

✅ Succeeded
41 seconds
clamav-scan

✅ Succeeded
8 seconds
apply-tags

✅ Succeeded
8 seconds
show-summary

✅ Succeeded
8 seconds
show-sbom


Updates needed

There are many major changes happening with Monitor, so I hope we have some backlog items to update this page.
I recently summarized this internally, let me just paste that info here. It's about how to collect and get alerts on guest OS diagnostics, mostly.

Continue using Linux Diagnostics Extension with classic alerts working from storage
a.	Can’t create new alerts after Aug 31
b.	Will be shut down in June 2020
c.	https://docs.microsoft.com/en-us/azure/virtual-machines/extensions/diagnostics-linux
Use Log Analytics VM Extension/Agent to pump metrics to a workspace – configure log query alerts or log metric alerts
a.	Tutorial to enable https://docs.microsoft.com/en-us/azure/azure-monitor/learn/quick-collect-azurevm
b.	Log queries https://docs.microsoft.com/en-us/azure/azure-monitor/platform/alerts-log-query
c.	Metric alerts on logs (for perf counters, Agent Health etc.) https://docs.microsoft.com/en-us/azure/azure-monitor/platform/alerts-metric-logs
Use Telegraf agent to send custom metrics to Monitor store, then set normal metric alerts
a.	Currently only available in select regions
b.	https://docs.microsoft.com/en-us/azure/azure-monitor/platform/collect-custom-metrics-linux-telegraf
(Linux Syslog only) Use LAD to send logs to storage, then to workspace – set log query alerts
a.	https://docs.microsoft.com/en-us/azure/azure-monitor/platform/collect-azure-metrics-logs#azure-diagnostics-to-storage-then-to-log-analytics
Use Azure Monitor for VMs/Insights – supposedly “health alerts” are available although I can’t find them in my environment
a.	https://docs.microsoft.com/en-us/azure/azure-monitor/insights/vminsights-performance#alerts

Mainly, the guest diagnostic experience is changing, and the "Alerts" section on this page is oversimplified when we have the options of metric alerts, log query alerts, log metric alerts, resource health alerts, Azure Monitor for VM health alerts, and so on. This is a frequent point of confusion for customers.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: c3605241-98cd-e6f2-79c6-9565b06d97e1
Version Independent ID: 9afcc8db-05e9-ccd3-32e4-da6111647402
Content: Monitor your Windows VMs in Azure
Content Source: articles/virtual-machines/windows/monitor.md
Service: virtual-machines-windows
GitHub Login: @cynthn
Microsoft Alias: cynthn

@dcbrown16 Thank you for your feedback and we immensly appreciate the time taken to put together the great summary. We will have this reviewed with the content team to see how this can be incorporated within the document.

@dcbrown16 Thanks for the putting these document enhancement togther. I am assigning this to the document author for commenting on the document update.

@cynthn Can you please take a look into this document enhancement request.

@dcbrown16 I did confirm we have backlog items to address this. Hence, I will close this out. Thank you for the feedback :)


Enhancements for running MinIO in different modes

Includes an extra var, MINIO_MODE to determine whether MinIO runs in server or gateway mode with a specific cloud provider gateway argument, eg "gateway azure".  Also included other minor fixes such as metadata and label cleanup so templates can also be deployed through the OpenShift web console, and default parameter values that align with MinIO

As the default environment variable in the DockerFile is set to "server" this ensures it doesn't break any existing deployments that won't yet know to set MINIO_MODE when deploying.  This allows more advanced MinIO users who want to start using it as a gateway the option to do so without having to break the entrypoint on purpose in their deployment.  For an example, see https://github.com/bcgov/cap-eagle-helper-pods/blob/master/openshift/templates/api/cap/minio-eagle-cwu-azure.dc.yaml

@daveram , can you please update .pipeline/pipeline-cli line to to read:
export OCP_PIPELINE_VERSION='0.0.7'

It is not exactly related to your changes, but this repo hasn't been built in a while and we need to update the scripts so that it can successfully build/deploy.

Commit added for pipeline-cli

config dir parameter was causing issues with gateway mode, turns out this has been deprecated as config is now stored on the backend.  Linked to MinIO docs as part of commit, tested with a local image build from my github fork with success

Also I checked to see if anyone was using the config dir for anything they wanted to keep, looks like we're in the clear
https://github.com/search?q=org%3Abcgov+MINIO_CONFIG_DIR&type=Code


Release Dink v1.6.1

DT2 support & config export fix for new webhook overrides

I'd love to wait until #162 but it's fine without it.


Add gitattributes, ignore the coverage folder for language detection.

This will prevent this repo being labeled as HTML.

FYI it can take some time to update


WebSocket Implemented in Front End Board Model

What does this implement/fix? Explain your changes.
Switched the Socket.IO socket connections in frontend_board_model.js into WebSocket connections in preparation for WebSocket changes. Should still respond the same to WebSocket events, functionality should be unchanged, it's just WebSockets all the way down now.
Does this reference any currently open issues?
Don't think so
Types of changes
What types of changes does your code introduce?
Put an x in the boxes that apply

[x] Bugfix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)

Checklist
Put an x in the boxes that apply. You can also fill these out after creating the PR. This is simply a reminder of what we are going to look for before merging your code.

[ ] I have linted my code and I have run tests locally that pass
[ ] I have added tests that prove my fix is effective or that my feature works
[x] I have added necessary documentation

Any other comments?
Due to the WebSocket change in progress and my own machine's apparent inability to use the mobile frontend, cannot currently test this.

@samwheeler2014 Break these into functions, will be easier to read


Add NP Atobarai plugin and configuration

In this pull request I'm adding:

a simple payment gateway plugin (to be extended in further tasks)
configuration management for NP Atobarai credentials

I have tested the configuration form with test credentials received from NP.
Impact

[ ] New migrations
[ ] New/Updated API fields or mutations
[ ] Deprecated API fields or mutations
[ ] Removed API types, fields, or mutations
[ ] Documentation needs to be updated

Pull Request Checklist

[ ] Privileged queries and mutations are guarded by proper permission checks
[ ] Database queries are optimized and the number of queries is constant
[ ] Database migration files are up to date
[ ] The changes are tested
[ ] GraphQL schema and type definitions are up to date
[ ] Changes are mentioned in the changelog

Any feedback here is covered in #8285


Custom field with anguler ng-click event

I put my jsgrid inside of angular controller to share data between them. I create one custom field with ng-click directive from this controller. But this directive fires only when page loades, and this field even not shown at my page
Field annuonce:
var MyDateField = function (config) {
                jsGrid.Field.call(this, config);
            };

            MyDateField.prototype = new jsGrid.Field({
                sorter: function (date1, date2) {
                    return new Date(date1) - new Date(date2);
                },

                itemTemplate: function (value, obj) {
                    if (value) {
                        //Link to new reporst popUP
                        return "" + value.length + "";
                    }
                }
            });`

field using:
{ name: "Param", type: "myDateField", width: 30 },

The reason is angular doesn't compile your html. So you need to compile it manually.
Inject $compile and return from your itemTemplate the following:
itemTemplate: function (value, obj) {
    return $compile("" + value.length + "")($scope);
}

This should work.
I'm currently working on integration of jsgrid with angular (here is the project https://github.com/tabalinas/ng-jsgrid).
It's close to be ready and soon will be published. But already now you can find some inspiration on how to use it with angular from demos (see demo dir).
This compilation, mentioned above, will be transparent with ngjsgrid.

It worked as for me, thanks)

You are welcome!


String transitions

We currently only support concat transition on String type.
Vote for which transitions we should support.

[ ] padEnd

repeat

replace

slice

substring

toLowerCase and toUpperCase

trim

@taras  Why is this closed?


update Llama 3.2 1B tests

I have removed the @pytest.mark.skip decorators from tests related to Llama 3.2. Additionally, I have separated the Llama 3b and Llama 3.2 tests to allow for independent testing.
fixes: #922

Reverted skips, waiting for either a Hugging Face token or storage to save models.


Remove optimism feature from consensus

Describe the feature
Remove optimism feature from consensus crates
Additional context
No response
### Tasks
- [ ] https://github.com/paradigmxyz/reth/pull/7324
- [ ] https://github.com/paradigmxyz/reth/pull/8487
- [ ] https://github.com/paradigmxyz/reth/issues/11108
- [ ] https://github.com/paradigmxyz/reth/pull/8462
- [ ] https://github.com/paradigmxyz/reth/issues/10713

marking this as completed because Consensus trait is fully off optimism


Error in Prompt.load(from_hf) : model_card (NoneType) is not iterable

the snippet from the video https://www.youtube.com/watch?v=JjgqOZ2v5oU
from llmware.prompts import Prompt
model_name = "llmware/bling-1b-0.1"

prompter = Prompt().load_model(model_name, from_hf=True)

yields
config.json: 100%|██████████| 2.27k/2.27k [00:00<00:00, 7.64MB/s]
pytorch_model.bin: 100%|██████████| 4.11G/4.11G [00:31<00:00, 131MB/s]
tokenizer.json: 100%|██████████| 2.11M/2.11M [00:00<00:00, 4.03MB/s]
---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
Cell In[39], line 3
      1 model_name = "llmware/bling-1b-0.1"
----> 3 prompter = Prompt().load_model(model_name, from_hf=True)

File [~/venv/lib/python3.10/site-packages/llmware/prompts.py:270](http://bcgx.luca-caniparoli.nibble.vip:8888/home/bcgx/venv/lib/python3.10/site-packages/llmware/prompts.py#line=269), in Prompt.load_model(self, gen_model, api_key, from_hf, trust_remote_code, use_gpu, sample, get_logits, max_output, temperature)
    267     hf_tokenizer = AutoTokenizer.from_pretrained(gen_model, trust_remote_code=trust_remote_code)
    269 #   now, we have 'imported' our own custom 'instruct' model into llmware
--> 270 self.llm_model = self.model_catalog.load_hf_generative_model(custom_hf_model, hf_tokenizer,
    271                                                          instruction_following=False,
    272                                                          prompt_wrapper="human_bot")
    273 # prepare 'safe name' without file paths
    274 self.llm_model.model_name = re.sub("[/]","---",gen_model)

File [~/venv/lib/python3.10/site-packages/llmware/models.py:766](http://bcgx.luca-caniparoli.nibble.vip:8888/home/bcgx/venv/lib/python3.10/site-packages/llmware/models.py#line=765), in ModelCatalog.load_hf_generative_model(self, model, tokenizer, prompt_wrapper, instruction_following)
    760 def load_hf_generative_model(self, model,tokenizer,prompt_wrapper=None,
    761                              instruction_following=False):
    763     """ Loads and integrates a Huggingface generative decoder-based 'causal' model with limited options
    764     to control model preprocessing prompt behavior """
--> 766     model = HFGenerativeModel(model, tokenizer, prompt_wrapper=prompt_wrapper,
    767                               instruction_following=instruction_following)
    769     return model

File [~/venv/lib/python3.10/site-packages/llmware/models.py:4152](http://bcgx.luca-caniparoli.nibble.vip:8888/home/bcgx/venv/lib/python3.10/site-packages/llmware/models.py#line=4151), in HFGenerativeModel.__init__(self, model, tokenizer, model_name, api_key, model_card, prompt_wrapper, instruction_following, context_window, use_gpu_if_available, trust_remote_code, sample, max_output, temperature, get_logits)
   4149 self.prompt_wrapper = prompt_wrapper
   4150 self.instruction_following = instruction_following
-> 4152 if "instruction_following" in model_card:
   4153     self.instruction_following = model_card["instruction_following"]
   4154 else:

TypeError: argument of type 'NoneType' is not iterable

Same issue

@remiconnesson and @ajarcik - thanks for sharing this issue so we can fix it.   For the example above, please remove the 'from_hf' flag, and everything should work fine, e.g.:    prompter = Prompt().load_model(model_name) with model_name = "llmware/bling-1b-0.1"    (We will update the example code too.)
When the 'from_hf =True' is set, we pass the model name and pull directly from HF/transformers Auto, and then take the instantiated HF object and wrap the HFGenerative class around it - in the course of doing that, we missed a safety check on a null config setting - which we are fixing in parallel - and should be merged in the code later today.
As an alternative to the 'from_hf' approach, you can register any custom model (Pytorch or GGUF) in the llmware ModelCatalog with a one-line registration process, and then pull directly with .load_model without using the from_hf flag.
Will keep the issue open until you confirm back that all good.

No activity - closing due to stale issue, which seems to have been resolved in prior message on April 20.   The example code was updated too.   If any ongoing problems, please raise a new issue.


First option for completion of "\theta" is upper-case Θ, not lower-case θ

I'm not sure if this is fixable but it would save me a lot of trouble if it was.  I use the lower-case θ often in my code and end up staring at UndefVarError messages in Julia until I suddenly twig on to the fact that I used the upper-case character instead of the lower-case version.  In many fonts these two are difficult to distinguish.

This always gets me with \pi and \Pi.
Last time I checked this was an issue with Atom's autocomplete engine being case insensitive. Maybe @MikeInnes or @pfitzseb has more recent info?

Dup of #15.


Send out ScienceMesh invite over email (if you fill in the email address)

@mrvahedi68 could you please clarify this?
The thing I understand is this:

Create a new button that input the user email
After generate token it will sent it by getting the value of that input and automatically send it to mentiond email.

Yes that's true, but I see a line inside the reva source code that seems to sends the invitation link to recipient email. I think we need only add an option to set the recipient email.
Reva code for sending email: https://github.com/cs3org/reva/blob/c6072ab50f90818a3555d0069c3ca7fce3433e25/internal/http/services/sciencemesh/token.go#L113

@mrvahedi68
Please review the Reva side to see if it's sending properly or not. I've not recieved anything once I tried to send.


Story to questions

Hey, Is there a way to find for each story (as downloaded from http://cs.nyu.edu/~kcho/DMQA/) the corresponding questions?
Thanks.

Both the stories and the questions have a URL in the content of the time so you could match them up based on that.
Best, Lasse

content of time
?

I do see the url in the top of the each question, but not for summaries.

Ahh yes, sorry about that. The filename of the stories are actually a hash of the URL so you should be able to match them up by hashing the URL in the questions.
https://github.com/deepmind/rc-data/blob/master/generate_questions.py#L376

Yes, this is what I did:
I saved each article's questions to a folder with the same name as the story name.
If someone what's to use:
`
url_hash = Hashhex(question_context.url)
s = question_context.ToString()
h = Hashhex(s)
directory = '%s/questions/%s/%s' % (corpus, dataset, url_hash)
if not os.path.exists(directory):
os.makedirs(directory)
with open('%s/%s.question' % (directory, h), 'w') as f:
f.write(s)
`


Add a warning when using an unsupported version of node for Erizo

Since many of us use Node Version Manager to switch between different versions of node, it would be helpful to show a warning if we're using the wrong version of node to compile Erizo.

Useful. Thanks!


Create a python package

It would be useful to have a package to manage dotfiles outside ~/, something like this (considering you already have a dotfiles repo installed and configured):
pip install dotbot
mkdir project
cd project
git init
dotbot --install gitignore-language-template

Where the file is inside the dotfiles dir and the install command would copy instead of symlinking. Where is the dotfiles dir? I guess that could be configured inside a dotfile ;)
This would make the dotfiles templating management works for projects outside ~/, which is an nice-to-have feature

Hm, interesting idea, though I'm not sure this falls within the scope of the Dotbot project.
Have you considered something like giter8?

Yes, I use Yeoman to manage project scaffolding but these tools work for that, projects. I think dotbot can manage dotfiles like .gitignore or .editconfig for little projects that don't need a big structure.
One use case I see interesting is creating "teaching repos" where you upload some demo code but have no defined structure. I don't see how I can use Yeoman or giter8 or something alike, but I definitely see an advantage doing dotbot --copy gitignore instead of writing everything from scratch, and I know all the needed rules are there.
Also another really powerful use case is I can create dotfiles and then do something like
mkdir new-project-templates
dotbot --install editorconfig
dotbot --install gitignore-specific-language
git init

So I can reuse my dotfiles even if I change my project layout, or modify them and just update my templates.

Also the dotbot command can link the dotfiles by default, so I can do something like:
pip install dotbot
git clone git:my-dotfiles-repo ~/.dotfiles
dotbot

Instead of cd ~/.dotfiles && python install.py.
Is this better? Well, I don't know, but for me is a clearer way of using it.

What's nice is that the current method doesn't require you to pip install anything. So you can install your dotfiles on a fresh system without having to do anything else first.

Well even in a fresh system I see the package option as something better, but this is just my opinion because I prefer to pip install instead of downloading files. It's easier for me to keep up to date with the project.
Install dotfiles
If you use dotbot you have python, and surely you have pip, so just do:
pip install dotbot
git clone git:my-dotfiles-repo ~/.dotfiles
dotbot

In a fresh system I have to do
git clone git:my-dotfiles-repo ~/.dotfiles
cd ~/.dotfiles
python ./install.py

Almost the same, but more power with the package installed (ok, this is true only if it includes the other options)
Create dotfiles repo
The initscript can be implemented in python to make this posible:
pip install dotbot
dotbot --create

With the initscript
curl -fsSLO https://raw.githubusercontent.com/Vaelatern/init-dotfiles/master/init_dotfiles.sh
./init_dotfiles.sh

Waking this up from the dead, so I apologize for that.
Curious what the rationale is that this doesn't exist as a pip package even for the expected use case? I get that it would require having python and pip installed before being able to use it, but don't most linux-based OS'es have that baked in by default?
The reason why I'd be interested in this is because submodules are sort of a nightmare to work with. It would be much easier to just pip install --upgrade dotbot rather than have to worry myself with keeping the submodule up to date, etc.
Thanks for clarifying :blush:

Hmm, true.
Okay, I'll do it! Will probably have time sometime in the next week or so.

This would also ease the downstream packaging of dotbot (I'm thinking of maintaining a Debian dotbot package). I really hope the feature lands.
The dotbot script would have to rewritten to use the system-wide installed libraries, but it should be doable.


When I start the bot I get this :c

Please help

Fixed https://github.com/DayColor/wumpcraft/commit/5001cdc78d2f2cab8c15a43b12f5d67c98052dee


No instance for (HasErrorCode (Error _a _b _c))

Summary
Getting the following error trying to build latest plutus.
Preprocessing library for plutus-tx-plugin-<IP_ADDRESS>..
Building library for plutus-tx-plugin-<IP_ADDRESS>..

<no location info>: warning: [-Wunused-packages]
    The following packages were specified via -package or -package-id flags,
    but were not needed for compilation:
      - transformers-<IP_ADDRESS>-6oYLJTvwHu7IJotjDUgOmp
      - ghc-prim-0.8.0
      - ghc-9.2.2-6TLZzObrRFC7DHAxONXPLT
[ 1 of 16] Compiling PlutusTx.Annotation ( src/PlutusTx/Annotation.hs, dist/build/PlutusTx/Annotation.o, dist/build/PlutusTx/Annotation.dyn_>
[ 2 of 16] Compiling PlutusTx.Compiler.Error ( src/PlutusTx/Compiler/Error.hs, dist/build/PlutusTx/Compiler/Error.o, dist/build/PlutusTx/Com>

src/PlutusTx/Compiler/Error.hs:42:38: error:
    • No instance for (HasErrorCode (Error _a _b _c))
        arising from a use of ‘errorCode’
      There are instances for similar types:
        instance HasErrorCode (PIR.Error _a _b _c)
          -- Defined in ‘PlutusIR.Error’
        instance HasErrorCode (PLC.Error _a _b _c)
          -- Defined in ‘PlutusCore.Error’
    • In the expression: errorCode e
      In an equation for ‘errorCode’:
          errorCode (NoContext e) = errorCode e
      In the instance declaration for
        ‘HasErrorCode (CompileError _a _b _c)’
   |
42 |     errorCode (NoContext e)        = errorCode e
   |                                      ^^^^^^^^^

Steps to reproduce the behavior
Using these shas
- git: https://github.com/Quid2/flat.git
  commit: 559617e058098b776b431e2a67346ad3adea2440
- git: https://github.com/input-output-hk/cardano-crypto.git
  commit: 07397f0e50da97eaa0575d93bee7ac4b2b2576ec
  # nix-sha256: sha256-oxIOVlgm07FAEmgGRF1C2me9TXqVxQulEOcJ22zpTRs=
- git: https://github.com/input-output-hk/cardano-base
  commit: 1587462ac8b2e50af2691f5ad93d3c2aa4674ed1
  subdirs:
    - base-deriving-via
    - binary
    - binary/test
    - cardano-crypto-class
    - cardano-crypto-praos
    - cardano-crypto-tests
    - measures
    - orphans-deriving-via
    - slotting
    - strict-containers
- git: https://github.com/mlabs-haskell/cardano-prelude
  commit: 713c7ae79a4d538fcd653c976a652913df1567b9
  subdirs:
    - cardano-prelude
    - cardano-prelude-test
  # nix-sha256: sha256-E+YSfUsvxdoOr7n7fz4xd7zb4z8XBRGNYOKipc2A1pw=
- git: https://github.com/input-output-hk/Win32-network
  commit: 3825d3abf75f83f406c1f7161883c438dac7277d
- git: https://github.com/input-output-hk/plutus
  commit: 64ab860d953cd0eb8aa35801e36cce280df920f4
  subdirs:
    - plutus-core
    - plutus-ledger-api
    - plutus-tx
    - plutus-tx-plugin
    - word-array
    - prettyprinter-configurable
    - stubs/plutus-ghc-stub
  # nix-sha256: sha256-HpI/ZXoj6SHlDYZQNkbzWEVMyPfZLrO8itUWQHD/I9Y=

Actual Result
It does not build
Expected Result
It would expect it to build
Describe the approach you would take to fix this
No response
System info
NixOS

Repro here: https://github.com/locallycompact/plutus-tx-plugin-fail

ghc-9.2.2-6

Are you trying to build with GHC 9.2? That's an extremely relevant piece of information. Who knows what might have changed then. I don't think we're going to invest effort in making things compile with 9.2 right now, although I'd take compatibility patches if you make them.

Yes I'm taking a stab at this now.

We will probably try and move the whole Cardano stack to 9.2 after Vasil, though.

We will probably try and move the whole Cardano stack to 9.2 after Vasil, though.

That has happened, plus we just killed the whole ErrorCode thing, thus closing.


GDF support

I know duckdb works well with Pandas DataFrames but I hope for the ability to write SQL the same way on GDFs. As of now, when I write SQL on GDFs it returns this error
NotImplementedException: Not implemented Error: Data type 'geometry' not recognized
This is with spatial installed and loaded. There is a workaround, but it's kind of wonky. Thank you for your time.

Hi! Thanks for opening this issue!
This is something I've been thinking about for a while and would be great to support some day. However, scanning the GDF in the same way DuckDB does with regular dataframes "zero copy" might be difficult as (as far as I know) geopandas geometries store pointers into GEOS geometries in memory. The problem is that DuckDB bundles its own version of GEOS, so while we technically could just pass the pointers around there's no guarantee that GEOS represents the geometries the same way across multiple versions or have stable ABI.
So there would have to be a conversion step, most likely to/from WKB (or maybe geoarrow, not sure if thats natively supported in geopandas now), similar to the workaround I imagine you got going. We could definitely look at "hiding" this by adding support for doing the conversion automatically to duckdbs BLOB type (which spatial then can ingest) inside the duckdb python client at some point in the future.

I think it would be great if we could make this conversion modular: DuckDB to Arrow to GeoPandas and vice versa instead of custom-built DuckDB to GeoPandas. It's fine in the near term to still serialize through WKB and just attach the geoarrow.wkb metadata onto the column.
There's discussion towards implementing native interop between GeoPandas and GeoArrow in https://github.com/geopandas/geopandas/issues/3156. That will probably get implemented in the next few months but maybe after GeoPandas 1.0. Using GeoArrow natively inside GeoPandas will take longer.

geopandas geometries store pointers into GEOS geometries in memory

Indeed, I don't believe GEOS objects are ABI stable, so you can't reliably share memory between Shapely and DuckDB spatial anyways.
FWIW I'm nearly done with an integration the opposite direction; from DuckDB to GeoArrow/GeoPandas in Python. But having the default .arrow() expose the unstable GEOMETRY type makes things a bit harder.

@kylebarron Thats sounds great! Id like to revisit #153 soon, even if support for "additional custom type metadata" is quite a bit away.


Update facetimehd for 4.8

The facetimehd kernel driver for 16.09 doesn't compile on the 4.8 series kernel. An upstream fix is available, see: https://github.com/patjak/bcwc_pcie/issues/92
We should update master to mainline, and backport the patch somehow to 16.09.

Thanks for working on the fix. Haven't hit any issues in 4.8 so far.
I'm also in favor or switching to mainline but I couldn't find anything upstream that mentions deprecating their master branch. Any sources?

This was resolved a while ago.


Changes to T.source inputs are ignored

I am having an issue with T.source. Sources marked as such are not listed by mill inspect and changes to them are not picked up by mill, only build from scratch works. This is the project: https://github.com/informarte/yuck, branch dev.
In particular, the dependencies listed by ./mill inspect corePackage are correct but incomplete. All the files defined by
    def documentation = T.source {millSourcePath / "doc"}
    def miniZincBindings = T.source {millSourcePath / "resources" / "mzn" / "lib" / "yuck"}
    def miniZincSolverConfigurationTemplate = T.source {millSourcePath / "resources" / "mzn" / "yuck.msc.in"}
    def unixStartScriptTemplate = T.source {millSourcePath / "resources" / "bin" / "yuck.in"}
    def winStartScriptTemplate = T.source {millSourcePath / "resources" / "bin" / "yuck.bat.in"}
    def debianControlFileTemplate = T.source {millSourcePath / "resources" / "debian" / "control.in"}

are missing.

Meanwhile I understood the issue; it's not caused by mill but by my build script. For compiling packages, it uses the os.copy method which does not replace already existing files by default. So building by scratch works fine and incremental building due to changes to Scala source files, too, but changes to all other files are ignored.


EthStorage Devs Meeting #3 Agenda

Meeting Info

Oct 18, 2022, 10:00 UTC+8
Duration: 60 minutes
Meeting link
Meeting Notes
Anyone can comment on the agenda where they would like this to be discussed.

Application

Sharded storage with P2P support

Design doc (Keep updating)
Implementation: splited to multi-small pr
Integration test (on-going: running 3 node on digitalocean and debug on local machine)

Research

Lens Protocol by Mingpeng (matters and rss3 related content added, will add Farcaster related and share the content on Fri?)
AR by Lun (go through inside the team)

Application

Web3URL website (https://web3q.io/w3url.eth/)

Research
Blockchain[sui/aptos] performance improvements (on-going 80%)
Write articles to summarize the results.
Backend
external call: split into small pr [1/3]

EthStorage Contract

Completed a test simulating a full mining cycle;
Started writing fusing Merkle tree inclusion proof to support large calldata submitting of RoRA

external call pr : https://github.com/QuarkChain/go-ethereum/pull/101
Tendermint & Hotstuff Article: https://literate-wolfsbane-bf0.notion.site/consensus-develop-article-f1ac7acac6cc411f9780c04d1ab2c8c9

Recording: https://drive.google.com/file/d/12KD9sSDsYCqc-4D81e7cidkWKrxx-zBp/view?usp=sharing

The meeting record has been uploaded, and the issue can be closed.

Design doc can be also linked here.


huge memory consumption during configure

Hi,
I am seeing a huge memory consumption (~ 1.3GB) while configuring NEDeconvolutionlayer.
inputSize 30 x 40 x 256 and weights 8 x 8 x 256 x 256.
Why is this happening?
Thanks,
Pranathi.

Hi @pranathibl
Could you please share all the values you use to configure the function? Data types and PadStrideInfo ?

Hi @morgolock
I have attached the setup i have used here

Hi @pranathibl.
Thanks for the setup and I could reproduce the issue with the setup.
From investigation, I found this is expected behavior on NEON mainly due to the Im2col. We'll start our internal discussion to plan the improvement.
As an alternative for now, if you can use OpenCL version of DeconvolutionLayer, it is expected to have smaller memory consumption.
I hope it helps.

Hi @pranathibl ,
We recently merged a patch which should solve your problem.
This is the line you might be more interested on:
https://review.mlplatform.org/c/ml/ComputeLibrary/+/3135/6/src/runtime/NEON/functions/NEConvolutionLayer.cpp#170
Basically we pick NEDirectConvolution in case of big input tensors and bigger weights shapes to avoid the need of huge allocations. In fact, this layer doesn't require more memory
Let us know,
Manuel

Hi @ManubARM ,
I have tried out with the patch provided. and still seeing the memory consumption to be high (1.3GB).
Thanks,
Pranathi.

Could you please try to print what are your values of:
input->total_size()  and weights->dimension(idx_h)
?
And also which ConvolutionMethod is get_convolution_method() returning?
Best,
Manuel

Hi @ManubARM ,
It is picking GEMM as Convolution method.
And input->total_size() = 21.7MB
weights->dimension(idx_h) = 8
-Pranathi

Hi @pranathibl
The following patch on the top of master solves the problem:  https://review.mlplatform.org/c/ml/ComputeLibrary/+/6806
I ran the test and it's now using DirectConv as Deconvolution method.
Hope this helps.


Update gir for new builder #[must_use] usage

See https://github.com/gtk-rs/gir/pull/1280

Nightly CI failures is https://github.com/rust-lang/rust/issues/91489


Feature request: include geographic distribution of stargazers

Hi!
I find your site really cool and insightful!
It could be nice to add, in the diversity tab, a map featuring the geographic distribution of stargazers of a project.
I know there are some limitations due to GitHub API query limits, but I was wondering if it would be feasible for you to introduce this feature.
Thanks for your work!

Hi @GyulyVGC!
Thanks for the suggestion, this is definitely something we should work on, getting more info about stargazers would allow to do many cool things.


Feature: Dark overlay view over the content ViewController while menus are open

This feature allows users to display a dark overlay over the content ViewController while left/right menu is open, just the way Google's NavigationDrawer works.
By default the feature is disabled, so there won't be any surprises.
Users have also the possibility to configure the overlay's alpha (by default is 0.54f).
I have modified the UnifiedSample to showcase this.

Thanks for the contribution. Code looks great!

New code is up on Nuget as 1.9.2: https://www.nuget.org/packages/SidebarNavigation/1.9.2


Turn account deletion into a web experience

Problem

Apple refused our last update because account deletion was an email experience
Turn account deletion into a web experience (not requiring an email client, I guess) by opening the following URL in a webview (should be a translatable string, so that we can provide localized versions)

https://blog.openfoodfacts.org/en/account-deletion
https://blog.openfoodfacts.org/en/account-deletion<EMAIL_ADDRESS>Food Facts account deletion

Eventually, we should make it a native experience, with a server side API
I'm not sure whether silently sending an email is enough, since it assumes the user has an email account setup

Reference
We noticed that your app supports account creation but does not include an option to initiate account deletion that meets all the requirements. Specifically:

Your app requires users to email to complete account deletion.
The process for initiating account deletion must provide a consistent, transparent experience for App Store users.
https://developer.apple.com/support/offering-account-deletion-in-your-app

Part of

#525

Should we implement it only on for the App Store or for all stores in general?

We could do all stores, and avoid per store custom behaviors ?
All users want account deletion, I guess.
@alexgarel mentioned he'd like something native server side, but given the resource strain server side, I guess we can move with this temporary solution.

I can work on this,
but I check and the localization can be set by url, e.g https://blog.openfoodfacts.org/fr/account-deletion will redirect to https://blog.openfoodfacts.org/en/account-deletion
Looks like internalization must be set by hand.
Also query parameters to autofill the form doesn't seems to work. Or I might just not have the correct ones ? 🤔

Typically, for i18n, turn the URL into a translatable string,  yes
Query params do work for me

Ok I get it for i18n, and I yes query params works, my bad


Use a low cost vpu for bastion host boot volume

By default, the bastion host uses a balanced VPU for its boot volume. This means, even though the bastion host is turned off (bastion_state = "RUNNING"), users are still charged for the 10 VPUs used for the default boot volume.
Instead, we should document how to change this to low cost so users are not charged when the bastion host is turned off.

It's already set at minimum


virtcontainers: Add vhost-user-net hotplug support

In order to fully move to network hotplug, we first need to support
vhost-user-net hotplug. This commit relies on appropriate QMP commands
to hotplug a vhost user network by first creating a new char device
pointing to the socket path, by creating the appropriate network
device, and finally by adding a virtio-net-pci device.
Fixes #610
Signed-off-by: Sebastien Boeuf<EMAIL_ADDRESS>

/cc @egernst

@devimc should be fixed now!

Depends on https://github.com/intel/govmm/pull/39

@amshinde PTAL

Need https://github.com/kata-containers/runtime/issues/758 to be fixed first.

@sboeuf  any updates? 😄  looks like #758 is closed.

@sboeuf any updates?

No, but this needs some time to be spent if we want it to be properly integrated with the device manager model.

@sboeuf ping, any updates? (From your weekly Kata herder)

@caoruidong @sboeuf ping, from your weekly Kata herder.

@caoruidong @sboeuf is this ready for merging?

ping @sboeuf

@sboeuf - shall we close this one?

@jodh-intel yes let's close it and get back later to it if needed.


How to use this tool on the Rancher platform？

You can download kubeconfig to local

Then, use it as normal kubernetes cluster


No easy way to get path of bats test.

I am migrating some existing tests I wrote in bash to bats. In my testing I am comparing results of an exec with known good results stored in a file in my spec dir. There seems to be no easy way to access the filename/path of the executing test within the test. Would it be possible to set this as an environment variable or make the original argv available in the tests?

From https://github.com/sstephenson/bats#special-variables -
"$BATS_TEST_FILENAME is the fully expanded path to the Bats test file."

Wow thanks, sorry I overlooked that!

No problem!


CICD workflow improvements

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.1 out of 2 committers have signed the CLA.:white_check_mark: tlmquintino:x: iainrussellYou have signed the CLA already but the status is still pending? Let us recheck it.


Add codecov.io

Current coverage is 100.00%

Branch #50 has no coverage reports uploaded yet.

No diff could be generated. No reports for master found.

Powered by Codecov. Updated on successful CI builds.


featureSupports reading CSV data using LF and CRLF as line separators. (#37687)

bp #37687
Proposed changes
Supports reading CSV data using LF and CRLF as line separators.
csv file:
1,abc
2,def\r
3,qwe
4,hello\r

if you  set keep_carriage_return = false
you will get :
1   abc
2   def
3   qwe
4   hello

Here, both \r\n and \n are used as delimiters.
if you  set keep_carriage_return = true
you will get :
1   abc
2   def\r
3   qwe
4   hello\r

Here only \n is used as a delimiter.
It should be noted that set keep_carriage_return = true is valid for tvf, but not for stream load/mysql load. This means that when you perform stream load/mysql load, crlf and lf will be automatically used as delimiters, even if you set keep_carriage_return = true.

run buildall


[Bug]: clash-verge-rev fail to uninstall for its service

Prerequisites

[X] I have written a descriptive issue title.
[X] I have searched all issues/PRs to ensure it has not already been reported or fixed.
[X] I have verified that I am using the latest version of Scoop and corresponding bucket.

Package Name
clash-verge-rev
Expected/Current Behaviour
Fail to uninstall clash-verge-rev by executing scoop uninstall clash-verge-rev for clash-verge-service.exe is running.
This program was registered as system service, it will be startup followed by system.
ERROR Couldn't remove '~\scoop\apps\clash-verge-rev\2.0.2'; it may be in use.

Steps to Reproduce
PS C:\Users\lnslf\sources\Extras> scoop uninstall clash-verge-rev
Uninstalling 'clash-verge-rev' (2.0.2).
Running uninstaller script...done.
Removing shortcut ~\AppData\Roaming\Microsoft\Windows\Start Menu\Programs\Scoop Apps\Clash Verge.lnk
Unlinking ~\scoop\apps\clash-verge-rev\current
ERROR Couldn't remove '~\scoop\apps\clash-verge-rev\2.0.2'; it may be in use.

Possible Solution
Run resources/uninstall-service.exe first would solve it.
Scoop and Buckets Version
PS C:\Users\lnslf\sources\Extras> scoop --version
Current Scoop version:
859d1db5 (HEAD -> master, tag: v0.5.2, origin/master, origin/HEAD) chore(release): Bump to version 0.5.2 (#6080)

'main' bucket:
9b87efb13 (HEAD -> master, origin/master, origin/HEAD<EMAIL_ADDRESS>Remove 'kotlin-dce-js.bat' (#6347)

'extras' bucket:
19c763fc1 (HEAD -> master, origin/master, origin/HEAD) clash-verge-rev: Update to Version 2.0.2 (#14460)

'versions' bucket:
7b23a1581 (HEAD -> master, origin/master, origin/HEAD) vlc-nightly-ucrt-llvm: Update to version 20241202

'nonportable' bucket:
47ca7d62 (HEAD -> master, origin/master, origin/HEAD) 10x-np: Update to version 1.0.241

'java' bucket:
488d52dd (HEAD -> master, origin/master, origin/HEAD) temurin8-nightly-jre: Update to version 8.0.442-4.0.202411291318

'mslxl' bucket:
72e4256 (HEAD -> master, origin/master, origin/HEAD) baidu-netdisk: Update to version <IP_ADDRESS>

Scoop Config
PS C:\Users\lnslf\sources\Extras> scoop config

last_update           : 12/2/2024 1:15:21 PM
scoop_repo            : https://github.com/ScoopInstaller/Scoop
scoop_branch          : master
aria2-enabled         : True
aria2-options         : --async-dns=false --all-proxy='http://<IP_ADDRESS>:7897'  --retry-wait=5
aria2-warning-enabled : False

PowerShell Version
PS C:\Users\lnslf\sources\Extras> $PSVersionTable

Name                           Value
----                           -----
PSVersion                      7.4.6
PSEdition                      Core
GitCommitId                    7.4.6
OS                             Microsoft Windows 10.0.22631
Platform                       Win32NT
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0…}
PSRemotingProtocolVersion      2.3
SerializationVersion           <IP_ADDRESS>
WSManStackVersion              3.0

Additional Softwares
No response

I suspect the issue is related to the requirement for administrative privileges when installing or uninstalling in service mode. I was able to successfully uninstall by adding sudo before running scoop uninstall clash-verge-rev.
If you don't have sudo available, you can first install gsudo by running scoop install gsudo.
Hope this helps!

I suspect the issue is related to the requirement for administrative privileges when installing or uninstalling in service mode. I was able to successfully uninstall by adding sudo before running scoop uninstall clash-verge-rev.
If you don't have sudo available, you can first install gsudo by running scoop install gsudo.
Hope this helps!

Thank you for your help.
I found it was caused by a clash-verge-services.exe being occupied, which was registered as system services to gain high privileges. Meanwhile, the service would not stop after the main process terminated. I referred to the old version of the JSON file and found the old one invokes uninstall-service.exe, so I tried executing sudo ./resources/uninstall-services.exe first and then running scoop uninstall clash-verge-rev manually. It works.
According to the above information, I added the uninstall script snippet back and tested it on my machine. You can see my changes in the second commit of #14494.
In addition, I didn't add the installation script of the service, which will be installed when the program starts first time automatically now. So I think it's meaningless to install the service with the script.


when the application occurs  an exeption , the global transaction didn't rollback ..

[ ] I have searched the issues of this repository and believe that this is not a duplicate.

Ⅰ. Issue Description
程序发生异常时seata日志打印说是回滚成功  undo_log表没有数据记录   但是涉及到的微服务并没有回滚事务
Ⅱ. Describe what happened
用的seata版本: v0.8.0   代码在这里https://github.com/Zorance/seata-demo      account和user项目是两个为服务 里面的config配了数据源交给seata做代理   gateway项目是调用服务方 配置了GlobalTransactionScanner
If there is an exception, please attach the exception trace:
Just paste your stack trace here!

Ⅲ. Describe what you expected to happen
Ⅳ. How to reproduce it (as minimally and precisely as possible)

xxx
xxx
xxx

Ⅴ. Anything else we need to know?
Ⅵ. Environment:

JDK version :
OS :
Others:

请问解决了吗？碰到同样的问题。使用版本<IP_ADDRESS>

please use 1.0.0


module and function formatter not working in placeholder in formatter config [JIRA: RIAK-2403]

Documentation states, that it's possible to use module and function placeholder in log formatter config:
https://github.com/basho/lager/blob/3.1.0/README.md#custom-formatting
The placeholders pid, file, line, module, function, and node will always exist if the parse transform is used.
But looks like it's just not implemented. It always produces Undefined and I can't find it anywhere in lager_transform.
e.g.
    {handlers, [{lager_file_backend, [
        {file, "service.log"}, {level, info}, {formatter, lager_default_formatter}, {size, 0}, {date, "$D0"}, {count, 7},
            {formatter_config, ["[", date, " ", time, "] severity=", severity, " module=", module," function=", function, " "," pid=", pid, " ", message, "\n"]}
        ]}
    ]}

Results both module and function as undefined.
Console backend is even worse (more undefined e.g. node).
    {handlers, [
      {lager_console_backend, [info, {lager_default_formatter, [date,"#",time,"#",severity,"#",node,"#",pid,"#",module,"#",function,"#",file,"#",line,"#",message,"\r\n"]}]},
      {lager_file_backend, [
        {file, "service.log"}, {level, info}, {formatter, lager_default_formatter}, {size, 0}, {date, "$D0"}, {count, 7},
            {formatter_config, ["[", date, " ", time, "] severityfbkend=", severity, " module=", module," function=", function, " "," pid=", pid, " ", message, "\n"]}
        ]}
    ]}

Shows output as:
/opt/opensource/lager_test# ./exec.sh
Erlang/OTP 18 [erts-7.2.1] [source] [64-bit] [smp:4:4] [ds:4:4:10] [async-threads:10] [kernel-poll:false]
Eshell V7.2.1  (abort with ^G)
(lager_test@<IP_ADDRESS>)1> lager:start().
ok
(lager_test@<IP_ADDRESS>)2> 2016-02-20#18:25:33.396#info#Undefined#<0.7.0>#Undefined#Undefined#Undefined#Undefined#Application lager started on node<EMAIL_ADDRESS>

Thanks for the report. We'll look into it. We haven't used lager with OTP 18 much - I wonder if its broken on older OTPs too.

Messges from error_logger don't have all the callsite information that native lager messages do.

But when I use 'lager_elogfmt_formatter'. They outputs module/function and even line without user entering it. I guess they are not fiddling with callsite in their source but relies on lager.
at https://github.com/heroku/lager_elogfmt_formatter/blob/master/README.md
the following line
lager:info("started/2"),

gives me a log liek the following:
app=lager_test severity=info msg="started/2"<EMAIL_ADDRESS>line=24 function=start module=lager_test_app application=lager_test


Customize Home Controller and Tests

Changed the members to our members' names.
Also updated the link to our repo link.
closes #3

Looks good!


⚠ Bofrost.de has degraded performance

In 7327332, Bofrost.de (https://www.bofrost.de) experienced degraded performance:

HTTP code: 200
Response time: 907 ms

Resolved: Bofrost.de performance has improved in b9351e6.


Adds information about generic Events

Commit for https://github.com/xenko3d/xenko-docs/issues/8

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Merged, thanks!


Updating mbed-os to mbed-os-5.3.4

Please test/merge this PR and then tag Master with mbed-os-5.3.4

Tested locally, looks good 👍


Remove use of obsolete operator-sdk

Depends on https://github.com/submariner-io/submariner-operator/pull/2199
Signed-off-by: Janki Chhatbar<EMAIL_ADDRESS>

Superseded by https://github.com/submariner-io/submariner-operator/pull/2204.


UWP Not working with DateTime object

Bug
When using the plugin without a DateTime object the notification work as expected, but with the DateTime object in UWP app I do not receive a notification
Plugin Version:  2.1.0
Platform:  UWP
Device/Hardware:  Local machine and windows phone emulator
Expected behavior
Recive a notification
Actual behavior
Do not receive a notification
Steps to reproduce the behavior

Create a Xamarin.forms PCL solution
On a button click, I have added the following code
CrossLocalNotifications.Current.Show("Test Title", "Test Body", 111, DateTime.Now.AddSeconds(5));

Same behaviour here, compiling for UWP version 14393.

Spotted the problem(s): in
https://github.com/edsnider/LocalNotificationsPlugin/blob/013c4345d25cd5df2f9de38f1f5a72d06ddb733f/src/Plugin.LocalNotifications.WinRT/LocalNotificationsImplementation.cs#L64 and many other places, a Tile updater is created, which is then passed a toast notification structure.

@mapgccv Wouldn't the problem be in the .UWP version, not the .WinRT?

@IeuanWalker: fair point. I have never developed a plugin and I'm not sure how, in case of the different versions windows, the platform-specific implementations are resolved at runtime. But looking at all windows projects, this is the only implementation I see, the other projects are empty, so I guess this file has got to be used, somewhat.
Moreover, I have tried it locally, by doing the correction I mention (namely:
creating a ScheduledToastNotification in place of a ScheduledTileNotification and queue it through a ToastNotificationManager instead of a TileNotificationManager and it works as expected - although I have tried it by manually replicating the plugin structure inside my application). I may try pushing the changes myself when I'll have a bit of time to learn how to test plugins.
Hope it helps.

Hi, @mapgccv could you create a simple project on GitHub so I can see how you implemented it?

Hi @IeuanWalker , in my solution I have modified the interface to accept a custom object, so the current source code would not apply to you. But, in short, I have included the interface in my .NET standard (or PCL) library, then copied the platform specific implementation files to the corresponding project and, in windows, I have replaced the function Show with DateTime with:
public void Show(string title, string body, int id, DateTime notifyTime)
{
      var xmlData = string.Format(_TOAST_TEXT02_TEMPLATE, title, body);
      var xmlDoc = new XmlDocument();
      xmlDoc.LoadXml(xmlData);
      var correctedTime = notifyTime <= DateTime.Now
        ? DateTime.Now.AddMilliseconds(100)
        : notifyTime;
      var scheduledToastNotification = new ScheduledToastNotification(xmlDoc, correctedTime)
      {
        Id = id.ToString()
      };
      ToastNotificationManager.CreateToastNotifier().AddToSchedule(scheduledToastNotification);
}

Hope this helps. If I find the time to learn a thing or two on plugins, I will try to contribute to this (as I have added custom sounds to notifications too).

@mapgccv that's great thanks, if you do find the time to update this plugin could you let me know thanks :)


Getting and error

How can i pass the base64 data to the uploader function?
I have cropped the image and i want that data to be uploaded.

@hwtech This plugin is not meant for uploading base64 data -- it uploads image files.


Storing document embeddings index

Is there a way to cache/load embedded documents and queries? That would help to save time on embedding big datasets such as ms marco and nq

Hi @svakulenk0,
Sadly at the moment, the only solution is to pickle save the document embeddings.
Recently, I have been working on getting faiss indexes to be integrated. That would allow caching or saving corpus embeddings as a faiss index. I can't say a fixed timeline of when this will be completely integrated into the repo, but I will let you know once it is done.
Kind Regards,
Nandan

Hi Nandan, thank you for the reply! I love the library :)

Hi @svakulenk0,
Update: In the latest version of the BEIR package, now you can save/load the corpus embeddings as a faiss index.
Check out: https://github.com/UKPLab/beir/blob/main/examples/retrieval/evaluation/dense/evaluate_faiss_dense.py
Kind Regards,
Nandan

nice!!! thank you

Is there a way to cache/load embedded documents and queries? That would help to save time on embedding big datasets such as ms marco and nq

Thanks Svitlana for this question and Nandan for providing this feature, it is beneficial!

nice!!! thank you

Hi Svitlana, have you tried this?


ROX-12578: Create unique constraint for groups

Description
This PR ensures that the tuple auth provider id, key, value, role name is unique across all groups. Previously, this was not the case and not enforce, and it was possible to create duplicated groups.
This had to be done in with workaround and manual changes to the generated code:

First, each field that should be a separate column had to have a search tag associated with it. Otherwise, the schema generation won't pick it up.
The code generation was run.
Afterwards, the gen.go file was removed, as well as the autogenerated headers from the generated store files. The files were changed to pass linting checks.
The group.go schema file was changed. Since the code generation doesn't support it yet, the uniqueIndex struct tag was added manually.

The search fields are both hidden, so they are not exposed to end-users. Once ROX-13790 lands, the search field workaround, as well as the changes to the autogenerated files can be reverted and hopefully autogeneration can be reused.
Note:
There will be a follow-up with the schema migration.
Checklist

[ ] Investigated and inspected CI test results
[ ] Unit test and regression tests added
[ ] Evaluated and added CHANGELOG entry if required
[ ] Determined and documented upgrade steps
[ ] Documented user facing changes (create PR based on openshift/openshift-docs and merge into rhacs-docs)

If any of these don't apply, please comment below.
Testing Performed

see added tests for Postgres enforcing the unique_constraint on the database level.

Current dependencies on/for this PR:

master

PR #5099   👈

This comment was auto-generated by Graphite.

Can you add a comment to ROX-13790 or link a ticket to it so we can return this to being generated at that time?

@dashrews78 I added the header to store.go, store_test.go, groups.go, if there's additional places where the comment should be let me know.

@dashrews78 I added the header to store.go, store_test.go, groups.go, if there's additional places where the comment should be let me know.

I think that covers it.

/test

/test gke-postgres-upgrade-tests

/retest


Make the Tag render function public

I have a case where I need access to render(render: Tag, level: Int = 0) -> String

Can I ask you why do you need access to this function? What's your use case?

I'm using HTML to assist in visualizing some large datasets.  However, it turns out the datasets are so large rendering every row using the Tags is a bottleneck.  So I use the tags to render a couple of header rows, add the rest of the rows as strings then add that String to the table using setContents.


Document gen

@adam-mesos @branden Thanks for the feedback; comments addressed. PTAL

Squashed and addressed @orsenthil 's minor changes. :ship:


WIP - More generic SNMP collector

[MIBs]
[MIBs.fortinet]
[[MIBs.fortinet.Keys]]
Name = "fortinet.cpu"
Oid = "<IP_ADDRESS>.4.1.123<IP_ADDRESS>.3.0"
Unit = "percent"
[[MIBs.fortinet.Keys]]
Name = "fortinet.mem.used"
Oid = ".<IP_ADDRESS>.4.1.123<IP_ADDRESS>.4.0"
Unit = "percent"
[[MIBs.fortinet.Keys]]
Name = "fortinet.mem.capacity"
Oid = ".<IP_ADDRESS>.4.1.123<IP_ADDRESS>.5.0"
Unit = "kbytes"
[[MIBs.fortinet.Keys]]
Name = "fortinet.vpn.tunnels"
Oid = ".<IP_ADDRESS>.4.1.123<IP_ADDRESS>.1.0"
[[MIBs.fortinet.Keys]]
Name = "vpnTunnelNames"
Oid = "<IP_ADDRESS>.4.1.123<IP_ADDRESS>.2.1.2"
Silent = true
Tree = true
[[MIBs.fortinet.Keys]]
Name = "fortinet.vpn.tunnelStatus"
Oid = "<IP_ADDRESS>.4.1.123<IP_ADDRESS>.2.1.20"
Tree = true
LabelTag = "name"
LabelKey = "vpnTunnelNames"
Unit = "bool" # 2 = true; 1 = false
[[SNMP]]
Host = "co-fw01"
Community = "s3cur3"
MIBs = ["fortinet", "ifaces"]

Here's a YAML version of what I imagine.  Converting to TOML is left as an exercise for the reader.
- MIBs.fortinet
  - Base: <IP_ADDRESS>.4.1.12356.101
  - .cpu
    - Oid: .<IP_ADDRESS>
    - Unit: percent
  - .mem.used
    - Oid: .<IP_ADDRESS>
    - Unit: percent
  - .mem.capacity
    - Oid: .<IP_ADDRESS>
    - Unit: kbytes
- MIBs.fortinet.tunnel
  - LabelSource: .<IP_ADDRESS>.2
  - Base: .4.1
  - .status
    - Oid: <IP_ADDRESS>.4.1.12356.101.4
    - Unit: bool
  - .bytesout
    - Oid: .6
    - Unit: kbytes
  - .bytesin
    - Oid: .7
    - Unit: kbytes

LGTM


Allow previews of full screen windows

Adding this features requires two things:

Fullscreen apps need to appear in the window picker dropdown (previews should already work correctly).
Overview windows need to be able to float on top of fullscreen apps (and borderless windows). This may be difficult.

https://blametest.sesse.net/content/browser/media/capture/screen_capture_kit_fullscreen_module.h.html
Will maybe help.

Partial support for "Fixed Window" fullscreen windows added in https://github.com/williamcpierce/Overview/releases/tag/v0.3.1-alpha

Related to #4


Fix Failing CI due to SGP

Codecov Report

Merging #75 (971958d) into main (af9158b) will decrease coverage by 0.07%.
The diff coverage is 50.00%.

:exclamation: Current head 971958d differs from pull request most recent head 8e9b775. Consider uploading reports for the commit 8e9b775 to get more accurate results

@@             Coverage Diff              @@
##               main      #75      +/-   ##
============================================
- Coverage     39.51%   39.44%   -0.08%
  Complexity      133      133
============================================
  Files           112      112
  Lines          1359     1359
  Branches        193      193
============================================
- Hits            537      536       -1
  Misses          759      759
- Partials         63       64       +1

Impacted Files
Coverage Δ
Complexity Δ

...l/dads/lib/presentation/viewmodel/BaseViewModel.kt
73.33% <50.00%> (-6.67%)
8.00 <2.00> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 30dee35...8e9b775. Read the comment docs.


Fix building graphene as a meson submodule

Fixes building graphene as a meson submodule
Proposed changes:

meson: Fix library version and soversion
meson: Do not use add_global_arguments but instead pass the args ourself

Looks good.


Publish

Codecov Report

Merging #12 into master will not change coverage.
The diff coverage is n/a.

@@          Coverage Diff          @@
##           master    #12   +/-   ##
=====================================
  Coverage     100%   100%
=====================================
  Files           4      4
  Lines         133    133
=====================================
  Hits          133    133

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3095bb0...2e6de41. Read the comment docs.


Add support for the ignoreWarnings parameter

A new warning has been introduced by the Visual Studio team when an extension may use unsupported APIs. It can't know for sure, so if you know what you're doing, it's safe to ignore this warning. The issue is that the warning prohibits the publishing to work
The docs for this parameter is here:

Actually, never mind. It turned out to be an error and not a warning.


[SMALLFIX] Improve javadoc in ObjectUnderFileSystem.java

What changes are proposed in this pull request?
Change Get into Gets in code comments.
Why are the changes needed?
Fix Alluxio/new-contributor-tasks#618
Does this PR introduce any user facing changes?
No.

Hi @dbw9580, thanks for your review! But the flow seems to be blocked, for I'm a first-time contributor in Alluxio.
Screenshot shows the details:

What should I do next? THX in advance!

@lunarwhite thx for the notice. the workflows should be unblocked now.

alluxio-bot, merge this please


App doesnot run, everything is done according to the instruction provided but gradle build fails in the emulator

Same issue. @Ashwin1002 did you manage to solve the issue?


Version 9 of Highlight.js has reached EOL and is no longer supported

Version 9 of Highlight.js has reached EOL and is no longer supported.
Please upgrade or ask whatever dependency you are using to upgrade.
https://github.com/highlightjs/highlight.js/issues/2877

Commenting console log in hexo-site/node_modules/highlight.js/lib/highlight.js.


Exception after merging two dataframes on index

What happened:
After I merge two data frames on their index, then reset_index and try to access the column that was the index, I get an exception.
Minimal Complete Verifiable Example:
import pandas as pd
import dask
import dask.dataframe as dd

A_df = dd.from_pandas(
    pd.DataFrame(
        [('aaa', 10), ('bbb', 20)],
        columns=['string_key_A', 'value1']
    ),
    npartitions=1
).set_index('string_key_A')

B_df = dd.from_pandas(
    pd.DataFrame(
        [('aaa', 100)],
        columns=['string_key_B', 'value2']
    ),
    npartitions=1
).set_index('string_key_B')

print(A_df.compute())
print()

print(B_df.compute())
print()

merged_df = dd.merge(A_df, B_df, left_index=True, right_index=True).reset_index()

print(merged_df)
print()

print(merged_df.dtypes)
print()

print(merged_df.compute())
print()

print(merged_df['string_key_A'])
print()

print(merged_df['string_key_A'].compute())

Here's the output I get, including the traceback:
string_key_A
aaa               10
bbb               20

              value2
string_key_B
aaa              100

Dask DataFrame Structure:
              string_key_A value1 value2
npartitions=1
                    object  int64  int64
                       ...    ...    ...
Dask Name: reset_index, 13 tasks

string_key_A    object
value1           int64
value2           int64
dtype: object

  index  value1  value2
0   aaa      10     100

Dask Series Structure:
npartitions=1
    object
       ...
Name: string_key_A, dtype: object
Dask Name: getitem, 14 tasks

Traceback (most recent call last):
  File "/home/ubuntu/.cache/pypoetry/virtualenvs/bug-TT33av2A-py3.9/lib/python3.9/site-packages/pandas/core/indexes/base.py", line 3621, in get_loc
    return self._engine.get_loc(casted_key)
  File "pandas/_libs/index.pyx", line 136, in pandas._libs.index.IndexEngine.get_loc
  File "pandas/_libs/index.pyx", line 163, in pandas._libs.index.IndexEngine.get_loc
  File "pandas/_libs/hashtable_class_helper.pxi", line 5198, in pandas._libs.hashtable.PyObjectHashTable.get_item
  File "pandas/_libs/hashtable_class_helper.pxi", line 5206, in pandas._libs.hashtable.PyObjectHashTable.get_item
KeyError: 'string_key_A'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/ubuntu/bug/bug.py", line 42, in <module>
    print(merged_df['string_key_A'].compute())
  File "/home/ubuntu/.cache/pypoetry/virtualenvs/bug-TT33av2A-py3.9/lib/python3.9/site-packages/dask/base.py", line 315, in compute
    (result,) = compute(self, traverse=False, **kwargs)
  File "/home/ubuntu/.cache/pypoetry/virtualenvs/bug-TT33av2A-py3.9/lib/python3.9/site-packages/dask/base.py", line 603, in compute
    results = schedule(dsk, keys, **kwargs)
  File "/home/ubuntu/.cache/pypoetry/virtualenvs/bug-TT33av2A-py3.9/lib/python3.9/site-packages/dask/threaded.py", line 89, in get
    results = get_async(
  File "/home/ubuntu/.cache/pypoetry/virtualenvs/bug-TT33av2A-py3.9/lib/python3.9/site-packages/dask/local.py", line 511, in get_async
    raise_exception(exc, tb)
  File "/home/ubuntu/.cache/pypoetry/virtualenvs/bug-TT33av2A-py3.9/lib/python3.9/site-packages/dask/local.py", line 319, in reraise
    raise exc
  File "/home/ubuntu/.cache/pypoetry/virtualenvs/bug-TT33av2A-py3.9/lib/python3.9/site-packages/dask/local.py", line 224, in execute_task
    result = _execute_task(task, data)
  File "/home/ubuntu/.cache/pypoetry/virtualenvs/bug-TT33av2A-py3.9/lib/python3.9/site-packages/dask/core.py", line 119, in _execute_task
    return func(*(_execute_task(a, cache) for a in args))
  File "/home/ubuntu/.cache/pypoetry/virtualenvs/bug-TT33av2A-py3.9/lib/python3.9/site-packages/dask/optimization.py", line 990, in __call__
    return core.get(self.dsk, self.outkey, dict(zip(self.inkeys, args)))
  File "/home/ubuntu/.cache/pypoetry/virtualenvs/bug-TT33av2A-py3.9/lib/python3.9/site-packages/dask/core.py", line 149, in get
    result = _execute_task(task, cache)
  File "/home/ubuntu/.cache/pypoetry/virtualenvs/bug-TT33av2A-py3.9/lib/python3.9/site-packages/dask/core.py", line 119, in _execute_task
    return func(*(_execute_task(a, cache) for a in args))
  File "/home/ubuntu/.cache/pypoetry/virtualenvs/bug-TT33av2A-py3.9/lib/python3.9/site-packages/pandas/core/frame.py", line 3505, in __getitem__
    indexer = self.columns.get_loc(key)
  File "/home/ubuntu/.cache/pypoetry/virtualenvs/bug-TT33av2A-py3.9/lib/python3.9/site-packages/pandas/core/indexes/base.py", line 3623, in get_loc
    raise KeyError(key) from err
KeyError: 'string_key_A'

Anything else we need to know?:
It looks like the problem is that after the merge, the metadata thinks that the index (now turned into a regular column by reset_index) is called string_key_A but when you actually compute to a pandas dataframe, it's called index. This causes things to crash later.
Interestingly if you call the column the same thing e.g. just string_key in both dataframes before you merge them, the same problem doesn't arise.
Environment:
Dask version: 2022.7.0
Python version: 3.9.7
Operating System: Ubuntu 20.04.3 LTS
Install method: poetry

@billiejoe-bw Thanks for reporting!
When we call compute(), Dask DataFrame results in the same thing as pandas.
You're right that the metadata inference is what's wrong here. So, the error is valid (pandas raises the same), we need to raise this before compute though such that merged_df['string_key_A'] fails.

@pavithraes @jsignell Hey both - i've been working on this issue for the past few days
Approach
At the minute, i'm looking at comparing the Dask Dataframe metadata to the Pandas equivalent using compute() all within the __getitem__ method. I don't know if this approach is necessarily optimal, but it passes the test cases i've written for it.
I do acknowledge that maybe:

I need to not touch __getitem__ and I just need to look at adjusting how _meta is adjusted by  reset_index()
Or I need to look at an alternate solution within __getitem__

Tests
I've already written out two tests that check when the merged indices are different and when the merged indices are the same, as per @billiejoe-bw examples above.
Problem
The problem with my solution at the minute, is that, no tests fail except one re materialization which keeps failing:
def test_repr_materialize():
    # DataFrame/Series repr should not materialize
    # any layers in timeseries->shuffle->getitem
    s = timeseries(end="2000-01-03").shuffle("id", shuffle="tasks")["id"]
    assert all([not l.is_materialized() for l in s.dask.layers.values()])
    s.__repr__()
    s.to_frame().__repr__()
    assert all([not l.is_materialized() for l in s.dask.layers.values()])

I believe, this is because compute() always materializes. Even making a deepcopy of the Dask Dataframe within __getitem__ does not solve this.
Is this the right approach?

@kutal10 Thanks for working on this! I think you may want to look into how meta is created by merge() when left_index=True, right_index=True. Dask is using 'string_key_A' as the index column name instead of 'index', while creating the meta.
Note that Dask creates the right meta here:
merged_df = dd.merge(A_df, B_df, left_on='string_key_A', right_on='string_key_B').reset_index()
print(merged_df)
# Output:
# Dask DataFrame Structure:
#                index value1 value2
# npartitions=1
#                int64  int64  int64
#                  ...    ...    ...
# Dask Name: reset_index, 13 tasks

So, I might also look at the code path this operation takes. :)

Beware, because what is happening here is:

When you join on 2 indexes with different names, Pandas sets the result index name to None, but not to 'index'. It's reset_index() the one that switches from None to 'index' when drop=False.
Dask is doing it wrong with meta, because it's assuming index.name should be string_key_A, but it should be None instead. And then string_key_A doesn't exist anymore (neither as index nor as column, so the KeyError can be raised before any compute().
This doesn't happen when both indexes are named the same, because in that case both Pandas and Dask keep index.name untouched. And when one does reset_index(drop=False) later on, that name is preserved as the column name.

So 2) must be corrected, but, aside from that I personally think that Dask should NOT allow doing reset_index(drop=False) when index.name is None. Introducing a column named 'index' is a poor approach, because 1) the fact that the index is anonymous should indicate that it was NEVER a column of the original data, but just an auxiliary thing, 2) there may be another column called 'index' already. This is related to my recent PR (which would make point2 fail), and to the discussion going on about this issue (which covers point 1).


Service worker does not work properly with dev server if config.paths.base is set.

Describe the bug
As the title says, service-worker will not load correctly if you specify a subdirectory in config.paths.base.
The sample confirms that it works correctly if config.paths.base is not set.
For example, if config.paths.base is set to /subdir, the service-worker will fail to start.
Looking at the devtools in the browser, it appears that loading<EMAIL_ADDRESS>is causing a 404 error.
If I open<EMAIL_ADDRESS>directly in my browser, the source can be read, so I think config.paths.base is not reflected in this section.
Reproduction
The sample repository is as follows
https://github.com/sinbino/issue-sveltekit-paths-base-serviceworker
I just added a small service-worker to the skeleton code created by npm create sveltekit.
However, since service-worker requires https to work, you may have to go through a reverse proxy that supports SSL to see it work.
When executed, the following error is printed to the console, confirming that the service worker is not running.
Uncaught (in promise) TypeError: Failed to register a ServiceWorker for scope ('https://example.com/subdir/') with script ('https://example.com/subdir/service-worker.js'): ServiceWorker cannot be started

Logs
No response
System Info
System:
    OS: Linux 5.15 Ubuntu 22.04.4 LTS 22.04.4 LTS (Jammy Jellyfish)
    CPU: (10) x64 Intel(R) Core(TM) i5-10600 CPU @ 3.30GHz
    Memory: 6.18 GB / 9.98 GB
    Container: Yes
    Shell: 5.1.16 - /bin/bash
  Binaries:
    Node: 20.5.1 - /usr/bin/node
    Yarn: 1.22.21 - /usr/bin/yarn
    npm: 10.4.0 - /usr/bin/npm
    pnpm: 8.15.3 - /usr/bin/pnpm
    bun: 1.0.28 - /usr/bin/bun
  npmPackages:
    @sveltejs/adapter-auto: ^3.0.0 => 3.1.1
    @sveltejs/kit: ^2.0.0 => 2.5.4
    @sveltejs/vite-plugin-svelte: ^3.0.0 => 3.0.2
    svelte: ^4.2.7 => 4.2.12
    vite: ^5.0.3 => 5.2.6

Severity
serious, but I can work around it
Additional Information
No response

I couldn't get the minimal reproduction working with the provided docker compose setup. Could you provide additional instructions for starting it?

I couldn't get the minimal reproduction working with the provided docker compose setup. Could you provide additional instructions for starting it?

https://codesandbox.io/p/devbox/sveltekit-basepath-service-worker-6gydt7
very easy reproduction, just use starter template, add service worker, add base path and its broken in dev 👍🏻
https://github.com/user-attachments/assets/2e31de02-f8d4-4fc3-94ff-24a8092919c1


Add landuse_industrial labels

I don't understand why there is a duplicate purple zone. One with the tag power = plant :

Here (hiding the power = plant) with the tag landuse = industrial :

Do we need the power = plant one @bchapuis ? Or I can maybe replace the tag in power_station layer by a [ "all", [ "==", "power", "plant" ], [ "!has", "landuse" ] ] to be sure ?

I think the styling rule should based on the landuse property.
https://wiki.openstreetmap.org/wiki/Tag:landuse=industrial

Actually, I'm not sure...
https://wiki.openstreetmap.org/wiki/File:Mapnik-power.png
https://wiki.openstreetmap.org/wiki/Tag:power=plant

I looks like openstreetmap-carto has two distinct rules.
One for industrial:
https://github.com/gravitystorm/openstreetmap-carto/blob/1178dfba278f1eee0ce018f72bcc88b5596d2929/style/landcover.mss#L22
And one for power (based on industrial):
https://github.com/gravitystorm/openstreetmap-carto/blob/1178dfba278f1eee0ce018f72bcc88b5596d2929/style/landcover.mss#L51

Ok thanks for the informations, I'll work on it.


node: avoid JSON unserializable log field

When setting logging up in such a way that logrus would attempt to serialise entries to JSON, it could fail with errors such as:
Failed to obtain reader, failed to marshal fields to JSON, json: unsupported type: map[types.Identity]*types.Node

Replace the broken Info log with logging just the number of deleted nodes and prepare a serializable slice of strings for the debug log with more detail.
Fixes: b855b2575f (node/manager: synthesize node deletion events)

/test

/test