Working example of list_flights with ObjectStore

Which part is this question about

https://github.com/apache/arrow-rs/blob/master/arrow-flight/examples/server.rs#L48
Describe your question

I've been struggling to understand how to implement something like list_actions in a non-trivial way (i.e., with an ObjectStore), but the example is unimplemented and the example for ObjectStore.list also doesn't give too many clues on how to use it in something like list_flights.
The issue I'm running into is that I initialize a connection to an ObjectStore and store it in a session context, but I cannot understand how to convert a stream of ObjectMeta from the object store into a steam of FlightInfo as a response to list_flights, since the ListFlightsStream has a static lifetime.
#[derive(Clone, Debug)]
struct SessionContext {
    object_store: Arc<dyn ObjectStore>,
}

pub struct FlightServiceImpl {
    sessions: Arc<Mutex<HashMap<String, SessionContext>>>,
}

#[tonic::async_trait]
impl FlightService for FlightServiceImpl {

    async fn handshake(&self, request: Request<Streaming<HandshakeRequest>>,) -> Result<Response<Self::HandshakeStream>, Status> {

        // Validate user and initialize an `object_store` with appropriate scope

        let session_token = self.generate_session_token();
        self.sessions.lock().unwrap().insert(
            session_token,
            SessionContext { object_store: Arc::new(object_store) },
        );

        // Complete handshake

    }

    async fn list_flights(
        &self,
        request: Request<Criteria>,
    ) -> Result<Response<Self::ListFlightsStream>, Status> {
        let context = self.check_session_token(&request)?;
        let prefix = None;
        // HELP: the response stream is 'static but context.object_store is not
        let object_meta = context.object_store.list(prefix);
        let result = object_meta.filter_map(|meta| async move {
            let Ok(file_meta) = meta else {
                return None;
            };

            // Build the FlightInfo

        });
        Ok(Response::new(Box::pin(result) as Self::ListFlightsStream))
    }

But I'm getting the error:
error[E0597]: `context.object_store` does not live long enough
   --> src/main.rs:164:27
    |
162 |         let context = self.check_session_token(&request)?;
    |             ------- binding `context` declared here
163 |         let prefix = None;
164 |         let object_meta = context.object_store.list(prefix);
    |                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ borrowed value does not live long enough
...
196 |         Ok(Response::new(Box::pin(result) as Self::ListFlightsStream))
    |                          ------------------------------------------- type annotation requires that `context.object_store` is borrowed for `'static`
197 |     }
    |     - `context.object_store` dropped here while still borrowed

Additional context

So the issue here is tonic is imposing a 'static lifetime bound on the returned stream, which is likely a historical artifact from when GATs were not supported.
You have a couple of options here:
let meta: Vec<_> = context.object_store.list(prefix).try_collect().await?;
let stream = futures::stream::iter(meta);

let (sender, receiver) = mpsc::channel(2);
tokio::spawn(async move {
    let mut stream = context.object_store.list(prefix);
    while let Some(n) = stream.next().transpose().await? {
        if sender.send(n).is_err() {
            break
        }
    }
})
let stream = receiver;

Otherwise you will need to use something like https://docs.rs/ouroboros/latest/ouroboros/index.html to construct a self-referential stream.

@tustvold, thank you very much for taking the time to respond. After quite a bit more experimentation, I was able to get the mpsc::channel method working!
It's a little weird since I need the object_store in the receiver task as well to fetch more metadata to generate the FlightInfo, I wasn't able to find a way to only pass the ObjectMeta. There may be a better way to do it than passing through the ParquetObjectReader but I'm going to include what I came up with in case it it gives anyone else a jumping off point. Caveat emptor that I only verified this with a couple files and the pyarrow client.

Imports
use arrow::ipc::writer::IpcWriteOptions;
use arrow_flight::IpcMessage;
use arrow_flight::{
    flight_descriptor::DescriptorType, flight_service_server::FlightService,
    flight_service_server::FlightServiceServer, Action, ActionType, Criteria, Empty, FlightData,
    FlightDescriptor, FlightInfo, HandshakeRequest, HandshakeResponse, PutResult, SchemaAsIpc,
    SchemaResult, Ticket,
};
use base64::prelude::BASE64_STANDARD;
use base64::Engine;
use bytes::Bytes;
use futures::channel::mpsc;
use futures::stream::{BoxStream, StreamExt};
use log::{debug, error, info};
use object_store::ObjectMeta;
use object_store::{local::LocalFileSystem, ObjectStore};
use parquet::arrow::async_reader::{AsyncFileReader, ParquetObjectReader};
use parquet::arrow::parquet_to_arrow_schema;
use rand::distributions::{Alphanumeric, DistString};
use std::collections::HashMap;
use std::path::Path;
use std::sync::{Arc, Mutex};
use tonic::transport::Server;
use tonic::{Request, Response, Status, Streaming};

    async fn list_flights(
        &self,
        request: Request<Criteria>,
    ) -> Result<Response<Self::ListFlightsStream>, Status> {
        let context = self.check_session_token(&request)?;
        let (mut tx, rx) = mpsc::channel::<(ObjectMeta, ParquetObjectReader)>(2);

        let store = context.object_store;
        tokio::spawn(async move {
            let prefix = None;
            let mut objects = store.list(prefix);
            while let Some(md) = objects.next().await.transpose().unwrap() {
                let reader = ParquetObjectReader::new(store.clone(), md.clone());
                if let Err(_) = tx.try_send((md, reader)) {
                    debug!("rx channel dropped");
                    break;
                }
            }
            tx.close_channel();
        });

        let result = rx.filter_map(|(object_md, mut pqt_reader)| async move {
            let Ok(pqt_md) = pqt_reader.get_metadata().await else {
                error!("Failed to get parquet metadata from {}", object_md.location);
                return None;
            };

            let file_md = pqt_md.file_metadata();

            // Convert file's schema to arrow format and serialize as IPC message
            let Ok(arrow_schema) = parquet_to_arrow_schema(file_md.schema_descr(), None) else {
                error!("Failed to convert schema for {}", object_md.location);
                return None;
            };
            let Ok(IpcMessage(schema)) =
                SchemaAsIpc::new(&arrow_schema, &IpcWriteOptions::default()).try_into()
            else {
                error!("Failed to serialize schema for {}", object_md.location);
                return None;
            };

            let flight_descriptor = Some(FlightDescriptor {
                r#type: DescriptorType::Path.into(),
                cmd: Bytes::new(),
                path: vec![object_md.location.to_string()],
            });

            return Some(Ok(FlightInfo {
                flight_descriptor,
                endpoint: vec![],
                total_records: file_md.num_rows(),
                total_bytes: object_md.size as i64,
                ordered: false,
                schema: schema.into(),
            }));
        });

        Ok(Response::new(Box::pin(result) as Self::ListFlightsStream))
    }


Tag hashicorp/go-slug to v0.5.0

Cherry-pick of https://github.com/openshift/hive/pull/1281
Tag go-slug to v0.5.0 for BZ 1914887

/assign @abhinavdahiya
/cc @akhil-rane


Add a method to get the pandoc version

In knitpy, I have the need to ensure that the used pandoc version is higher than 1.10  (and probably 1.12, similar to ipython nbconvert).
ipython has such a version check: https://github.com/jupyter/jupyter_nbconvert/blob/master/jupyter_nbconvert/utils/pandoc.py#L58, maybe that could be copied to pypandoc?

Yeah, feel free to make a PR for that.

done in #53

Merged. I published 0.9.7 with the feature in it.


Added assembly files to freertos_port_files()

Some ports have assembly as well as C files.

Apologies for taking a while on this. Seems like an easy one to accept - it makes sense to include assembly (and probably other port files) in the list so the rebuild happens when changing them. Two things:

Could you remove the eprintln!()? I guess it's probably a debug thing left in.
Does it make sense to add both .s and .S files? I think the string check is case sensitive.

1. Could you remove the `eprintln!()`? I guess it's probably a debug thing left in.

Will do.

2. Does it make sense to add both .s and .S files? I think the string check is case sensitive.

I did a search in the FreeRTOS kernel repo and there are both .s and .S. I'll add matching for both.

Thanks!


How to reset bindings?

I have some preloaded data and binded with rivets. Some of this data can generate dynamically new elements with binding. What is right way to reset (or reinitialize) bindings when new data appears?

According to the guide:

Every call to rivets.bind returns a fully data-bound view that you should hold on to for later. You'll need it in order to unbind it's listeners using view.unbind().

@maxkoshel do not forget to unbind the dynamc view when it's parent is removed programmatically.


"Podu Dâmboviței" is listed in the drop-down menu

Description:
"Podu Dâmboviței" is listed in the drop-down menu alongside its corresponding county and commune, according to the law
Precondition:
The website is up an running.

Step 1
Type "Podu Dâmboviței" in the search bar.

Expected results
The location is listed in the drop-down menu as "Podu Dâmboviței, Argeș (Dâmbovicioara)".


Add test_ascii_1h60.0s.MS.tar

Closes #21

Tested this works locally with
packratt get /test/ms/2021-06-24/elwood/test_ascii_1h60.0s.MS.tar


fix in cluster operator create namespace for istio control plane.

resolve: https://github.com/istio/istio/issues/29519
[ ] Configuration Infrastructure
[ ] Docs
[ X ] Installation
[ ] Networking
[ ] Performance and Scalability
[ ] Policies and Telemetry
[ ] Security
[ ] Test and Release
[ ] User Experience
[ ] Developer Infrastructure
Pull Request Attributes
Please check any characteristics that apply to this pull request.
[ ] Does not have any changes that may affect Istio users.

@morvencao: The following test failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

lint_istio
6ff94c4aa0336ca3190797bcedfc09242298ab56
link
/test lint_istio

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@morvencao Is this the right config to test with?
# iop.yaml
apiVersion: install.istio.io/v1alpha1
kind: IstioOperator
metadata:
  namespace: ns1
  name: example-istiocontrolplane
spec:
  profile: default
  namespace: ns1

$ ./out/linux_amd64/istioctl install -f iop.yaml

@shamsher31 yes, we also need to test the in-cluster operator.

$ ./out/linux_amd64/istioctl operator init --watchedNamespaces=ns1
Installing operator controller in namespace: istio-operator using image: gcr.io/istio-testing/operator:1.9-dev
Operator controller will watch namespaces: ns1
✔ Istio operator installed
✔ Installation complete

# iop.yaml
apiVersion: install.istio.io/v1alpha1
kind: IstioOperator
metadata:
  namespace: ns1
  name: example-istiocontrolplane
spec:
  profile: default
  namespace: ns1

It got stuck with the following error.
$ ./out/linux_amd64/istioctl install -f iop.yaml
This will install the Istio 1.9.0 default profile with ["Istio core" "Istiod" "Ingress gateways"] components into the cluster. Proceed? (y/N) y
2020-12-11T10:17:15.706573Z     error   installer       failed to update resource with server-side apply for obj ServiceAccount/istio-system/istio-reader-service-account: namespaces "istio-system" not found
2020-12-11T10:17:15.760166Z     error   installer       failed to update resource with server-side apply for obj ServiceAccount/istio-system/istiod-service-account: namespaces "istio-system" not found
- Processing resources for Istio core.                                                                                2020-12-11T10:17:15.840996Z     error   installer       failed to update resource with server-side apply for obj Role/istio-system/istiod-istio-system: namespaces "istio-system" not found
2020-12-11T10:17:15.905859Z     error   installer       failed to update resource with server-side apply for obj RoleBinding/istio-system/istiod-istio-system: namespaces "istio-system" not found
✘ Istio core encountered an error: failed to update resource with server-side apply for obj ServiceAccount/istio-system/istio-reader-service-account: namespaces "istio-system" not found
failed to update resource with server-side apply for obj ServiceAccount/istio-system/istiod-service-account: namespaces "istio-system" not found
failed to update resource with server-side apply for obj Role/istio-system/istiod-istio-system: namespaces "istio-system" not found
failed to update resource with server-side apply for obj RoleBinding/istio-system/istiod-istio-system: namespaces "istio-system" not found
2020-12-11T10:17:15.996240Z     error   installer       failed to update resource with server-side apply for obj EnvoyFilter/istio-system/metadata-exchange-1.8: namespaces "istio-system" not found
2020-12-11T10:17:16.050809Z     error   installer       failed to update resource with server-side apply for obj EnvoyFilter/istio-system/metadata-exchange-1.9: namespaces "istio-system" not found
2020-12-11T10:17:16.105218Z     error   installer       failed to update resource with server-side apply for obj EnvoyFilter/istio-system/stats-filter-1.8: namespaces "istio-system" not found
2020-12-11T10:17:16.159676Z     error   installer       failed to update resource with server-side apply for obj EnvoyFilter/istio-system/stats-filter-1.9: namespaces "istio-system" not found
2020-12-11T10:17:16.214687Z     error   installer       failed to update resource with server-side apply for obj EnvoyFilter/istio-system/tcp-metadata-exchange-1.8: namespaces "istio-system" not found
2020-12-11T10:17:16.268885Z     error   installer       failed to update resource with server-side apply for obj EnvoyFilter/istio-system/tcp-metadata-exchange-1.9: namespaces "istio-system" not found
2020-12-11T10:17:16.323775Z     error   installer       failed to update resource with server-side apply for obj EnvoyFilter/istio-system/tcp-stats-filter-1.8: namespaces "istio-system" not found
2020-12-11T10:17:16.378471Z     error   installer       failed to update resource with server-side apply for obj EnvoyFilter/istio-system/tcp-stats-filter-1.9: namespaces "istio-system" not found
✘ Istiod encountered an error: failed to update resource with server-side apply for obj EnvoyFilter/istio-system/metadata-exchange-1.8: namespaces "istio-system" not found
failed to update resource with server-side apply for obj EnvoyFilter/istio-system/metadata-exchange-1.9: namespaces "istio-system" not found
failed to update resource with server-side apply for obj EnvoyFilter/istio-system/stats-filter-1.8: namespaces "istio-system" not found
failed to update resource with server-side apply for obj EnvoyFilter/istio-system/stats-filter-1.9: namespaces "istio-system" not found
failed to update resource with server-side apply for obj EnvoyFilter/istio-system/tcp-metadata-exchange-1.8: namespaces "istio-system" not found
failed to update resource with server-side apply for obj EnvoyFilter/istio-system/tcp-metadata-exchange-1.9: namespaces "istio-system" not found
failed to update resource with server-side apply for obj EnvoyFilter/istio-system/tcp-stats-filter-1.8: namespaces "istio-system" not found
failed to update resource with server-side apply for obj EnvoyFilter/istio-system/tcp-stats-filter-1.9: namespaces "istio-system" not found
- Processing resources for Ingress gateways. Waiting for Deployment/ns1/istio-ingressgateway

@shamsher31 See: https://github.com/istio/istio/issues/26813 for more details:
Looks likes we still need:
# cat iop.yaml
apiVersion: install.istio.io/v1alpha1
kind: IstioOperator
metadata:
  namespace: ns1
  name: example-istiocontrolplane
spec:
  values:
    global:
      istioNamespace: ns1
    meshConfig:
      rootNamespace: ns1

@morvencao I confirmed and it worked after adding  meshConfig.rootNamespace.
$ ./out/linux_amd64/istioctl install -f iop.yaml
This will install the Istio 1.9.0 default profile with ["Istio core" "Istiod" "Ingress gateways"] components into the cluster. Proceed? (y/N) y
✔ Istio core installed
✔ Istiod installed
✔ Ingress gateways installed
✔ Installation complete

I still think there are a lot of namespace options we need to set in order for the operator to work properly. may be in future we should optimize it.


Deployment Failed for Enterprise ML

This is probably a dumb one, but I've reached the end of my understanding to solve the issue. When I run the pipeline the deployment fails because my ML resource is "enterprise"
Template deployment validation was completed successfully.
Starting Deployment.
Deployment name is cloud-environment-20200428-210003-a450
There were errors in your deployment. Error code: DeploymentFailed.
##[error]At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/DeployOperations for usage details.
##[error]Details:
**##[error]Invalid: Downgrade from Enterprise sku to Basic sku is not allowed**
##[error]Task failed while creating or updating the template deployment.
Finishing: Deploy MLOps resources to Azure

So I went into the template file and added the following code after "location":
    "sku":{
      "type": "string",
      "defaultValue": "enterprise",
        "allowedValues": [
          "basic",
          "enterprise"
      ],
      "metadata": {
         "description": "Specifies the sku, also referred as 'edition' of the Azure Machine Learning workspace."
      }
    },

Unfortunately I still get the exact same error message.

Just for clarification, if I use a "basic" ML workspace, and not an "enterprise" one, then everything goes as expected

To confirm, you added the code after "location", in the "parameters" section?
If you haven't done so already, you'll also need to add this code after "location" in the workspace definition in order to pass the sku tier to the workspace definition.
"sku": {
  "tier": "[parameters('sku')]",
  "name": "[parameters('sku')]"
},

@j-so works now, thank you for the help. I did not have the second step you provided.


RavenspearMkO.netkan

Install stanza defined in another way than mentioned on KS since I can find absolutly no reason to put this inside the Squad Folder. Thought it might be looking for certain files in hardcoded places first but looking through the part.cfg files that does not appear to be the case so I'm installing this into its own folder in GameData.
@politas have been hard at work trying to find a homepage but have been unable too so none is listed for this mod.

Quotes around GameData and spec_ver v1.4 jump out at me.


[Request] Include Release & Docker build for Raspberry Pi (ARMv6/7 Architecture)

Not a bug. This is a general feature request to include an Arm version of the Docker build (via Travis-CI).
I was able to build the image myself successfully using the steps in this Gist (leaving here for anyone else who might want to reference), but it would be nice to have a pre-built Docker image for running on a Raspberry Pi.
Thanks!

I think this can be closed by #39, can those interested double check?


Use typescript import() syntax for redis types

fix #15

Hey, @natesilva can we merge and release this?


OLS-1204: fully-configuratble authentication dependency

Description

fully-configuratble authentication dependency

Type of change

[ ] Refactor
[x] New feature
[ ] Bug fix
[ ] CVE fix
[ ] Optimization
[ ] Documentation Update
[ ] Configuration Update
[ ] Bump-up dependent library
[ ] Bump-up library or tool used for development (does not change the final image)
[ ] CI configuration change
[ ] Konflux configuration change

Related Tickets & Documents

Related Issue #OLS-1204

Codecov Report
Attention: Patch coverage is 80.55556% with 7 lines in your changes missing coverage. Please review.

Project coverage is 91.27%. Comparing base (e77efdf) to head (ed44586).
Report is 10 commits behind head on main.

Files with missing lines
Patch %
Lines

ols/src/auth/auth.py
71.42%
4 Missing :warning:

ols/src/auth/noop.py
33.33%
2 Missing :warning:

ols/src/auth/auth_dependency_interface.py
87.50%
1 Missing :warning:

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1899      +/-   ##
==========================================
- Coverage   93.47%   91.27%   -2.20%
==========================================
  Files          64       65       +1
  Lines        2941     2889      -52
==========================================
- Hits         2749     2637     -112
- Misses        192      252      +60

Files with missing lines
Coverage Δ

ols/app/endpoints/authorized.py
100.00% <100.00%> (ø)

ols/app/endpoints/feedback.py
69.56% <100.00%> (-30.44%)
:arrow_down:

ols/app/endpoints/ols.py
95.79% <100.00%> (-3.74%)
:arrow_down:

ols/app/metrics/metrics.py
68.75% <100.00%> (-31.25%)
:arrow_down:

ols/src/auth/k8s.py
77.70% <100.00%> (-3.23%)
:arrow_down:

ols/src/auth/auth_dependency_interface.py
87.50% <87.50%> (ø)

ols/src/auth/noop.py
71.42% <33.33%> (+71.42%)
:arrow_up:

ols/src/auth/auth.py
80.95% <71.42%> (-13.50%)
:arrow_down:

... and 4 files with indirect coverage changes

/test integration

/test e2e-ols-cluster-4-17

/approve
/override "Red Hat Konflux / ols-enterprise-contract / lightspeed-service"

/lgtm


Update drop-in sdk to 6.13.0

In order to mitigate the following PlayStore issue https://github.com/braintree/braintree-android-drop-in/issues/452 that can lead to your app being removed, we need to upgrade the native SDK.
This upgrades a bunch of stuff including the browser-switch dependency. Which in a newer version does not have the BrowserSwitchActivity anymore but by using the Custom Activity from this plugin, everything still works for me

Thank you!


The game hangs and freezes.

The game hangs and freezes when we try to walk on it!

It's really severe, okay?

ohh

thought 1 was very severe


Update office-365-management-activity-api-reference.md

Fixed minor error in text.

OPS Build status updates of commit 9166f6c:
:clock10: Preparing: average preparing time is 50 sec(s)

OPS Build status updates of commit 9166f6c:
:clock10: Incremental building: average incremental building time is 19 sec(s)

OPS Build status updates of commit 9166f6c:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

office-365-management-api/office-365-management-activity-api-reference.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


set inner text not working

What is this feature about (expected vs actual behaviour)?
I would like to fill an empty tag with text.
I tried the following:
                        echo $techSpecItem->innertext;

                        $techSpecItem->find(".hero_techSpecItemName", 0)->innerText = "bla";
                        $techSpecItem->find(".hero_techSpecItemValue", 0)->innerText = "blubb";

                        echo $techSpecItem->innertext;

The first echo is right. The second one is exactly the same.
How can I reproduce it?
Does it take minutes, hours or days to fix?
Any additional information?

I figured out, that when I'm able to find the element hero_techSpecItemName / hero_techSpecItemValue directly from the outer DOM object (in my case "$document"), it is working with "->innertext":
                        $document->find(".hero_techSpecItemName", 0)->innertext = "bla";
                        $document->find(".hero_techSpecItemValue", 0)->innertext = "blubb";


Load Git trees lazily on checkout

Exploring https://github.com/astral-sh/uv/pull/3950

Turns out this is still really hard. Some weird behavior due to our local checkout I think?

I suspect that we are doing a dynamic fetch and the promisor is the sparse local tree?

Since almost all Git code currently expects any referenced object to be present locally and because we do not want to force every command to do a dry-run first, a fallback mechanism is added to allow Git to attempt to dynamically fetch missing objects from promisor remotes.
When the normal object lookup fails to find an object, Git invokes promisor_remote_get_direct() to try to get the object from a promisor remote and then retry the object lookup. This allows objects to be "faulted in" without complicated prediction algorithms.
Dynamic object fetching will only ask promisor remotes for missing objects. We assume that promisor remotes have a complete view of the repository and can satisfy all such requests.

Which fails since https://github.com/git/git/commit/301f1e3ac1531dc3a15064a06b24fa98f02a3b78


Http Logging Middleware - MediaTypeOptions doc typos

HttpLogging Middleware documentation has typos in MediaTypeOptions section.

Just logging an issue here so that i can create a PR fix.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 7c772b2a-5d37-84af-624c-9022efe0758b
Version Independent ID: b39594cc-9d1c-611c-e3e7-8755d74253a6
Content: HTTP Logging in .NET Core and ASP.NET Core
Content Source: aspnetcore/fundamentals/http-logging/index.md
Product: aspnet-core
Technology: aspnetcore-fundamentals
GitHub Login: @jkotalik
Microsoft Alias: jukotali

created PR https://github.com/dotnet/AspNetCore.Docs/pull/22432

It's overloaded

@Rick-Anderson I know its overloaded. its  AddText(string contentType) - which will default to UTF-8 encoding and Addtext(string contentType, Encoding encoding) - where consumer provides the encoding.
The doc has two bullets with the same method signature:

public void AddText(string contentType, Encoding encoding)

Adds a contentType to be used for logging as text using UTF-8 encoding.

public void AddText(string contentType, Encoding encoding)

Adds a contentType to be used for logging as text using the specified encoding.

That was my point of filing the bug. The bullets need to be:

public void AddText(string contentType)

Adds a contentType to be used for logging as text using UTF-8 encoding.

public void AddText(string contentType, Encoding encoding)

Adds a contentType to be used for logging as text using the specified encoding.

Aad that's  the change I proposed in the PR.
thoughts ?


parallelization to speed up processes

the README mentions that "Speed-ups are possible with parallelization and installing libraries such as MRAN ". Would you be able to help me with that?  Any suggestions how to parallelize and/or decrease memory to fit within limits? Thanks

A faster version of MetaNeighbor is available at its permanent home - https://github.com/gillislab/MetaNeighbor/
Details can be found in section 5.3 of the updated vignette. We've been able to get it work with ~300K cells and 600 genes, but let us know if you have any problems.


[Issue] azd sets AZURE_PRINCIPAL_ID env var to --client-id

AZURE_PRINCIPAL_ID should exclusively refer to the local user's ID. However, azd is currently assigning it the --client-id used during user login via azd auth login --client-id.
This presents an issue because we rely on knowing the principalType for role assignments.
If azd sets AZURE_PRINCIPAL_ID to the Service Principal (SP) used for login, the type will be identified as ServicePrincipal rather than User.
Existing templates assume AZURE_PRINCIPAL_ID to represent the local user ID. Thus, this alteration will disrupt all GitHub actions that rely on this assumption, likely affecting all such actions.
Let's refrain from assigning anything other than the local user's ID to AZURE_PRINCIPAL_ID. Additionally, we need to ensure that it isn't overwritten with the client ID used during azd auth login with --client-id.
This appears to be a breaking change that should be addressed asap.

Existing templates assume AZURE_PRINCIPAL_ID to represent the local user ID. Thus, this alteration will disrupt all GitHub actions that rely on this assumption, likely affecting all such actions.

I think this is a bad assumption for the templates to make.  I suspect we are going to find that you're going to want to understand the object ID of the principal doing the deployment, regardless of if it represents a user account or a service account.  For example, when running in CI, I suspect we are going to want to grant role assignments to the service account that is running azd deploy so that same principal can access these resources.
For example, thinking ahead to something like the bind mount support in Aspire - we are going to need to use the data-plane to upload files to the bind mount target.  I suspect the same decisions that pushed us to add AZURE_PRINCIPAL_ID so we could grant access to the user is going to mean we want the object ID of the service principal in CI.
If we want to AZURE_PRINCIPAL_ID to mean just "the object ID of the currently logged in use, assuming they are logged in as a user account, not a service principal/managed identity" we can make that change.  It will mean that sometimes AZURE_PRINCIPAL_ID is empty, since we support logging into azd as a non user account.
If we do that, I think we will want to add some new value that always contains the object ID (and perhaps a property that says it is a service account vs user account), but I do think that long term people are going to want to access to both IDs.

As an alternative, we could introduce AZURE_PRINCIPAL_TYPE that you can check to know if it is a user or a SP.
In Aspire world, a bicep module is currently asking azd to set the type of the principal and azd is currently hardcoding it to Service Princial because it operates with a managed identity.
What we can do is to make azd auth aware of how the login was performed (might be interesting on the cases of az-delegation) and set the principal type in the .env, next to the principal id.  Then folks can check and take decisions based on that.
Would that work for your case @jongio ?

As an alternative, we could introduce AZURE_PRINCIPAL_TYPE that you can check to know if it is a user or a SP.
In Aspire world, a bicep module is currently asking azd to set the type of the principal and azd is currently hardcoding it to Service Princial because it operates with a managed identity.
What we can do is to make azd auth aware of how the login was performed (might be interesting on the cases of az-delegation) and set the principal type in the .env, next to the principal id. Then folks can check and take decisions based on that.
Would that work for your case @jongio ?

Yes, thanks


Add Universitas Putra Indonesia

@zaininijar First stage of verification passed, official domain for Universitas Putra Indonesia is upiyptk.ac.id as far as I verified. This is just an informational note. Pull request is still in the review. I appreciate your patience while waiting for the final decision.

thanks sir...
Pada Sen, 1 Jul 2024 20.15, Philip Torchinsky @.***>
menulis:

@zaininijar https://github.com/zaininijar First stage of verification
passed, official domain for Universitas Putra Indonesia is upiyptk.ac.id
as far as I verified. This is just an informational note. Pull request is
still in the review. I appreciate your patience while waiting for the final
decision.
—
Reply to this email directly, view it on GitHub
https://github.com/JetBrains/swot/pull/21263#issuecomment-2200112646,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AVS6FSFZ2A563JVY3BTYMX3ZKFI5LAVCNFSM6AAAAABKDOOPZ2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMBQGEYTENRUGY
.
You are receiving this because you were mentioned.Message ID:
@.***>

@zaininijar Thank you for your patience while waiting for a review and processing your request. Pull request merged.


HTML parsing example fails in script, but passes as test

I am working on updating the examples in the User Guide so that they are stand-alone scripts and the one for "Scraping Web Content (GET)" does not work as a script; however, the test for the same code works in the ExamplesSpec. The script code I have so far is:
@GrabConfig(systemClassLoader=true)
@Grab(value='org.jsoup:jsoup:1.9.2', initClass=true)
@Grab('io.github.http-builder-ng:http-builder-ng-core:0.14.1')
@GrabExclude('org.codehaus.groovy:groovy-all')

import static groovyx.net.http.HttpBuilder.configure
import org.jsoup.nodes.Document
import groovyx.net.http.optional.Html

Document page = configure {
    request.uri = 'https://mvnrepository.com/artifact/org.codehaus.groovy/groovy-all'
}.get()

String license = page.select('span.b.lic').collect { it.text() }.join(', ')

println "Groovy is licensed under: ${license}"

I have tried a few variations of the Grapes and they end up with:
org.codehaus.groovy.runtime.typehandling.GroovyCastException: Cannot cast object '[B@17d2fdb6' with class '[B' to class 'org.jsoup.nodes.Document'
at ConsoleScript30.run(ConsoleScript30:12)

which seems to point to the HTML parser (response handler) not being loaded. Its supposed to be loaded and used for text/html content when it is present on the classpath - seems like the grapes are not giving it what it needs at the right time.
@dwclark do you have an example script with JSoup from one of your demos where this works?

Odd, this seems to work now.


CASMNET-2099 canu fix dead links

/backport main

/backport release/1.6

/backport release/1.4

https://github.com/Cray-HPE/docs-csm/pull/5102


[revamp]: our values section with better styling on homepage ⚒✨

Description

The current state of the Our Values Section on Homepage does not attracts the user in terms of UI.
We need to make the UI more pleasant to the user so that they can feel free to explore other pages of Sampark, Because this part is from the Homepage.
If we don't care the UI on homepage, then it severely gonna reduce the number of users using our application.
The below screenshot is about current state, i will update the revamped design on my PR once i get assigned to this issue.

Screenshot (Current State)

Hey there @Gaurav-Verma07 👋🏻
Please make sure to assign this issue to me to make the work done!
Thank you.


Race condition with libuv fs poll

Description
We discovered a race condition when trying to poll fs events using uv_fs_poll_start.
The race condition happens when the fs poll watch is started for a newly created directory and directly afterwards a file is written to that directory. That file does most of the times not get recognized by the file watch.
If we add a sleep of approx. 1s between the watch start and file creation, the file gets recognized.
We first encountered this issue while debugging a failing test in nodejs:
(async () => {
    const root = '/tmp/debug-test';
    await fs.rm(root, {recursive: true, force: true});
    await fs.mkdir(root, {recursive: true});
    //await wait(duration({milliseconds: 500}));
    fscb.watchFile(root, {
        interval: 2000,
    }, (curr) => {
        console.log('watchFile', curr);
    });
    await fs.writeFile(path.join(root, 'test.txt'), 'foo');
    console.log('Printed file');
})()

Bug occurs don't he following systems and cloudproviders:

Provider: Azure on Flatcar stable (kernel 5.15.111), beta (kernel 5.15.113) and alpha.
Provider Equinix on Flatcar stable (kernel 5.15.94)
Provider PlusServer (German Hoster with Openstack) on Flatcar stable (kernel 5.15.111).

The bug does not occur on:

Provider PlusServer on Ubuntu 20.04
Azure Ubuntu 20.04
Laptop with ArchLinux (Kernel 6.3.3)

Impact

We always need a sleep second before we can be sure the watch recognizes all files.
This bug is a blocker for us using Flatcar.

Environment and steps to reproduce

Create a machine with Flatcar (tested on stable, beta and alpha)
start a ubuntu container sudo docker run -it --entrypoint bash --rm ubuntu:20.04
compile the following c program with gcc main.c -o main -luv

#include <stdio.h>
#include <uv.h>

void cb (uv_fs_poll_t* handle,
                           int status,
                           const uv_stat_t* prev,
                           const uv_stat_t* curr) {
  printf("Received %ld\n", curr->st_ino);
}

void writeToFile () {
 FILE *f = fopen("/tmp/debug-test/test6.txt", "w");

 fprintf(f, "foo");
 fclose(f);
}

void writeToFileCb (uv_work_t *req) {
   writeToFile();
}

void after(uv_work_t *req, int status) {
   printf("Finished\n");
}

static uv_fs_poll_t handle;
static uv_work_t req;
static char root[] = "/tmp/debug-test";

int main()
{
   setbuf(stdout, NULL);
   uv_loop_t *loop = uv_default_loop();

   uv_fs_poll_init(loop, &handle);
   const int err = uv_fs_poll_start(&handle, cb, root, 2000);
   if (err != 0) {
      printf("Error %d", err);
      return 42;
   }
   printf("--ready\n");
   uv_queue_work(loop, &req, writeToFileCb, after);
   return uv_run(uv_default_loop(), UV_RUN_DEFAULT);
}

Setup the tmp dir: mkdir /tmp/debug-test
run rm /tmp/dir/* && ./main multiple times -> the poll does not notice the file.

Expected behavior
The written file should always be reported by the poll as it does on other distros.

uv_fs_poll_start uses a very bad algorithm for polling directories - it checks mtime in the directory inode (for "portability") instead of using the correct kernel facilities for this purpose (fanotify/inotify).
The ext4 root partition on Flatcar is formatted with 128-byte inode size, which means filesystem timestamps have a granularity of "seconds" (not nanoseconds).
If you move your container storage to a different disk/filesystem, or reformat the root partition you won't hit this. Try the following butane snippet:
variant: flatcar
version: 1.0.0
storage:
  filesystems:
  - device: /dev/disk/by-partlabel/ROOT
    label: ROOT
    format: ext4
    wipe_filesystem: true

5. rm /tmp/dir/* && ./main

can confirm that this fixes the issue.
Thanks for helping.
@jepio is this something that is likely to be changed upstream. So that the root parition is formatted with a bigger inode size by default?

Yes, we should change that, thanks to both of you!
128-byte inodes cannot handle dates beyond 2038 and are deprecated

Fix merged and cherry-picked to all branches.
This won't apply to running systems though.


IC API reply_raw

Expose the reply_raw IC API on the ic object in ts. This should allow you do the following:
export function reply_raw(): QueryManual<blob> {
  return ic.reply_raw(new Uint8Array([104, 105])
}

See https://docs.rs/ic-cdk/latest/ic_cdk/api/call/fn.reply_raw.html

Blocked by #471 because v0.5.0 of ic_cdk doesn't expose this API publicly. See https://docs.rs/ic-cdk/0.5.0/ic_cdk/api/call/index.html


feat: create blogdown based on hugo-bootstrap-theme

@cjyetman crazy to think that all of these new files were generated by calling one single function LOL:
blogdown::new_site(theme = "filipecarneiro/hugo-bootstrap-theme")
Anyway, this PR creates some boilerplate for a potential blogdown technical blog. I'm just experimenting a bit with creating a blog (may scrap it entirely). Happy with a rubber stamp approval.
Created using: https://github.com/rstudio/blogdown
Which depends on: https://github.com/gohugoio/hugo
With the bootstrap theme: https://github.com/filipecarneiro/hugo-bootstrap-theme
Closes #3

Seems like there MUST be a way to make a blogdown site that doesn't involve just making a copy of the entire Hugo theme XD

LOL... I can't even load the diff page to approve it. Just force merge it hahaha

MOVE FAST, BREAK EVERYTHING!!


UseProjection does not work with filtered include in ef core

Is there an existing issue for this?

[X] I have searched the existing issues

Product
Hot Chocolate
Describe the bug
When using UseProjection together with a include and and a field expression to filter the inner join (using this tutorial to filter the inner join), the projection removes the filter.
Steps to reproduce
Example code:
public class Book {
    public int Id { get; set; }
    public Author Author { get; set; }
}

public class Author {
    public int Id { get; set; }
    public ICollection<Book> Books { get; set; }
}

Inside the service:
...
public IQueryable<Book> GetBooks() {
    return db.Books.Include(x => x.Author.Where(y => y.Id == 1));
}
...

The query:
query {
  books {
    id
    authors {
      id
    }
  }
}

Relevant log output
No response
Additional Context?
No response
Version
13.0.5

Closing this issue as answered


Garbage collection during the pod execution

With our move towards exposing application level operations and dynamic pods (see #2375 #2867 #2932), we should consider whether we need to modify our garbage collection model to be run during the execution.
Introduction of app-level operations means that we allow users to run pets instead of cattles, which are basically long-running pods, and when applications are ejected/removed out of a pod, after a while, uncollected garbage might be problematic.
cc @euank @yifan-gu @coreos/rkt-maintainers

So for the rktnetes, I am not sure we really want to redesign the gc, as the kubelet will enforce it's gc policy, and all it needs is the RemoveContainer interface.
I think we can keep today's gc for cleaning up at pod levels?

As previously discussed in #2932, gc by entrypoints seems to be enough for our purposes.
After our discussions AFAICT we don't need any changes to garbage collection semantics in rkt.

@tmrts @yifan-gu Just trying to imagine how the workflow will be (considering that rkt is not based on a central daemon model):

Who will handle the app level "prepare" (render image) phase?
Who will cleanup thing if the prepare phase (render image) or run phase fails (mount overlayfs etc..) at any point? Since the rkt process could just exit/die, who will remove the stale data?
Who will handle the app level "gc" (umount overlayfs etc...) phase?
If the idea is to do this in "removecontainer" there's the way to handle failure cases (rkt process exits with error/die), who will cleanup thing? how to handle problems when the "cleanup" fails?

I was under the impression that extending the current rkt pod lifecycle also to single apps will help on handling all possible problems like the ones handled at the pod level by the pod lifecycle.
Additionally not doing this will tie the per app handling to an external model enforced by the k8s interface and this won't work when doing per app management with "just" rkt.

@sgotti Good question especially when an app is a crashloop but the pod is still running.... I guess we will need k8s to handle this as it is the one who creates the crashloop.
In other cases, we can let rkt gc to remove them when it removes the whole pod.

@yifan-gu that case covers an application crashing, but what will happen when rkt has some problems preparing/starting/stopping the app? My impression is that using pods like lifecycle (with the assumption that an app when failed cannot be restarted but needs to be trashed and recreated) will ease and prpbably required by the rkt model.
Perhaps I'm missing something and if this is really needed will be discovered when implementing/testing #2932 .

Perhaps we should strongly encourage (and default?) to having a data directory specific to Kubernetes. This would allow the rktnetes code to nuke any pod it can't recognize vs the current state of things where we have to carefully classify "owned" vs "not owned" pods and avoid nuking ones we don't know about.

@euank I think that this issue should also cover how to handle garbage for pods not managed by k8s.
Instead I see this related #3029 (my understanding was that a missing pod manifest can't help distinguishing a k8s managed pod from other pods).
I'm not sure how to handle upgrades if the new version changes the datadir since it'll leave old k8s pods unmanaged.


[HUDI-443]: Added slides from Hadoop Summit 2019, Bangalore. Also updated Adoptions

Added slides for Hadoop summit 2019, Bangalore
Updated Adoptions to include Tathastu.ai

This is good to merge, will merge today.


epd/image2bit: e-paper 2 bit gray scale bit plane image format

Add image format with two bit planes as used by some waveshare e-Paper
devices.
Helps with implementing gray scale on these e-Paper devices, but needs a driver too.

Please fix the compile error.

gohci

Thanks!


[cxx-interop] Allow compiling with libc++ on Linux

This makes sure that Swift respects -Xcc -stdlib=libc++ flags.
Clang already has existing logic to discover the system-wide libc++ installation on Linux. We rely on that logic here.
Importing a Swift module that was built with a different C++ stdlib is not supported and emits an error.
The Cxx module can be imported when compiling with any C++ stdlib. The synthesized conformances, e.g. to CxxRandomAccessCollection also work. However, CxxStdlib currently cannot be imported when compiling with libc++, since on Linux it refers to symbols from libstdc++ which have different mangled names in libc++.
rdar://118357548 / https://github.com/swiftlang/swift/issues/69825

@swift-ci please smoke test

@swift-ci please smoke test

@swift-ci please smoke test

@swift-ci please smoke test

@swift-ci please smoke test

@swift-ci please smoke test

@swift-ci please smoke test

@swift-ci please smoke test

I tested this on windows, with some additional changes for custom libc++ and split out MSVC c++ support using sealing like before, and this kind of approach works great. This looks good to me.

Thanks @hyp for trying it out!

@swift-ci please smoke test

@swift-ci please build toolchain Ubuntu 24.04

@swift-ci please build toolchain Ubuntu 23.10

@swift-ci please build toolchain Ubuntu 22.04

@swift-ci please smoke test

@swift-ci please build toolchain UBI9


Add configuration file

Add configuration file containing the following information:

server name
connection endpoint (ip addr and port)
path for log file
path for pid file

File format: YAML

Resolved


Gtk.mainQuit doesn't quit.

Issue with GTK, affects even Java.

Why did I put an issue on my own program wtf


Add syntax-fm extension

Description
The aim of this extension is to have one of my favourite podcasts syntax.fm at your fingertips! ✨
It currently supports searching for episodes, opening directly on the syntax.fm website, opening on YouTube (if a video is present) and finally opening in the Apple Music application.
I plan on iterating on this, adding background checks to check for new episodes, and adding support to open directly in Spotify, but first I need to open an issue or contribute back to syntax to include the Spotify information for each track.
I think my only outstanding question is how to best cache the data from the useFetch hook and/or if we should consider pagination at this stage. The endpoint I'm using doesn't currently support pagination.

Screencast
https://github.com/raycast/extensions/assets/7691252/d4c9c1b0-9158-4459-a7e7-d206ad26d8d8

Checklist

[x] I read the extension guidelines
[x] I read the documentation about publishing
[x] I ran npm run build and tested this distribution build in Raycast
[x] I checked that files in the assets folder are used by the extension itself
[x] I checked that assets used by the README are placed outside of the metadata folder

Hey @wesbos @stolinski 👋  I read through the Syntax Terms of Service, and nothing stood out to me. I just want to make sure you're both happy with this and the consumption of the content.json endpoint.

Sick! Thank you @msmps

DAMN this is SO cool! Thanks a ton for doing this.
We have a new logo, I'm gonna PR it right now

cloning the repo. Give me 3 days


Update compiler-warning-level-2-c4307.md

The diagnostic currently contains the word "signed".  I added it to the text of the description.

#sign-off


Augmented assignments to WCR

@tbennun Can you review? I cannot request you, because it's your own PR :-)

@tbennun Requesting review again, please pay special attention to the changes to read_and_write_sets in both sdfg.py and state.py


Two minor changes

This PR addresses issues #19 and #20 regarding hard-coded parallelization and ImportErrors.

Looks good, thanks Brian.


Implement Window API

Implements SpongePowered/SpongeAPI#1189

@simon816 status of this PR?

Waiting until the API part is finalized. PR will get updates as I change the API

Closing in favor of https://github.com/SpongePowered/SpongeCommon/pull/752

Going to re-open as there is a difference between this and custom inventories.
See https://github.com/SpongePowered/SpongeAPI/pull/1189#issuecomment-247118530


Document Dragonboard API

As a developer, I want to be able to read and understand how Dragonboard's API works so that I can use it in my work.

I wasn't super creative in the user story because I am not 100% sure why we're documented the API. Can update with research. @jessehall3 and I are taking this issue.


Strange position of hands with a map

Maybe you're just holding the bread real close while trying to fumble around the map?
...yeah I'll try and find a fix for this

Maybe you're just holding the bread real close while trying to fumble around the map?
...yeah I'll try and find a fix for this

Hmm, I now tried to do it differently, but it still looks unnatural.

this is what it looks like in "natural":

I certainly don't think you can backport a miniature map, but if you can I would be very grateful.

Or, for example, so that when you hold a map, items in your left hand are hidden

Or, for example, so that when you hold a map, items in your left hand are hidden

Going with this fix for now. Otherwise you end up growing another arm while holding a map o_O
Thank you for the report!


Fusion: Install Pyside for Fusion16+

Install pyside now works for all Fusion Version.
It also installs pyside6 instead of pyside2
This is a re-pr of an OpenPype pr: https://github.com/ynput/OpenPype/pull/4932
Testing notes:

Start fusion with a python instance that doesn't have Pyside installed
Run Install pyside from the Ayon menu

This comment is not related to this PR but I have just noticed something during testing of this PR.
Perhaps it is happening also to you all @BigRoy and @EmberLightVFX. For some reason any log.info messages are showing up in Fusion console as warnings and it is causing a confusion because termminal icon is dressed with exclamation mark :warning:

Fusion has been moved to separate https://github.com/ynput/ayon-fusion. Please create PR there if is still relevant.


[CS] Add PHPStan rule to check constant strinrg value to have certain format

/**
 * @var string
 */
public const SOME_VALUE = 'yes_way';

:heavy_check_mark:

/**
 * @var string
 */
public const SOME_VALUE = '$no-wAY';

:no_entry_sign:

@TomasVotruba do you want constant string not allowed to have $ character ?

Yes. It should contain only small letters, underscore or numbers.

@TomasVotruba thank you, btw, I am online at Google Meet if you want to talk.


Container does not have write access to /config/

How do you overcome this issue?
Configuration file: True
Creating Home Assistant User mitblod:dev
Traceback (most recent call last):
  File "/usr/local/bin/hass", line 8, in <module>
    sys.exit(main())
  File "/usr/local/lib/python3.8/site-packages/homeassistant/__main__.py", line 286, in main
    return scripts.run(args.script)
  File "/usr/local/lib/python3.8/site-packages/homeassistant/scripts/__init__.py", line 67, in run
    return script.run(args[1:])  # type: ignore
  File "/usr/local/lib/python3.8/site-packages/homeassistant/scripts/auth.py", line 48, in run
    asyncio.run(run_command(parser.parse_args(args)))
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/homeassistant/scripts/auth.py", line 58, in run_command
    await args.func(hass, provider, args)
  File "/usr/local/lib/python3.8/site-packages/homeassistant/scripts/auth.py", line 86, in add_user
    await provider.data.async_save()
  File "/usr/local/lib/python3.8/site-packages/homeassistant/auth/providers/homeassistant.py", line 213, in async_save
    await self._store.async_save(self._data)
  File "/usr/local/lib/python3.8/site-packages/homeassistant/helpers/storage.py", line 154, in async_save
    await self._async_handle_write_data()
  File "/usr/local/lib/python3.8/site-packages/homeassistant/helpers/storage.py", line 224, in _async_handle_write_data
    await self.hass.async_add_executor_job(
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/homeassistant/helpers/storage.py", line 233, in _write_data
    os.makedirs(os.path.dirname(path))
  File "/usr/local/lib/python3.8/os.py", line 223, in makedirs
    mkdir(name, mode)
PermissionError: [Errno 13] Permission denied: '/config/.storage'
/usr/bin/container: line 17: /config/.storage/onboarding: No such file or directory
INFO: Trying to find the correct directory...

ERROR: Could not find the directory for Home Assistant
Manually change the directory to the root of your Home Assistant configuration
With the user that is running Home Assistant
and run the script again
/usr/bin/container: line 65: /config/.storage/lovelace_resources: No such file or directory
/usr/bin/container: line 89: /config/.storage/lovelace_resources: No such file or directory
[4828 ms] Error: Command failed: /bin/sh -c container setup && npm add
        at ag (/home/christian/.vscode/extensions/ms-vscode-remote.remote-containers-0.183.0/dist/extension/extension.js:169:15)
        at async rg (/home/christian/.vscode/extensions/ms-vscode-remote.remote-containers-0.183.0/dist/extension/extension.js:163:2458)
        at async /home/christian/.vscode/extensions/ms-vscode-remote.remote-containers-0.183.0/dist/extension/extension.js:145:7537

This is my devcontainer.json file and corrosponding source code in the repository
https://github.com/slimcdk/homeassistant-mitblod/blob/master/.devcontainer/devcontainer.json
I have also tried without having the hacs mount added as well as not having any mounts. Got same error.

Prepending sudo chown -R vscode /config to the post create command seems to work.
Closing.


Back to stable versions of poetry-core since v1.1.0

https://pypi.org/project/poetry-core/1.1.0a7/ was still being forced as the dependency version, but anything since https://pypi.org/project/poetry-core/1.1.0/ should support groups (which is why 7fef2acc9e7604ce312fed04d7122b3602381aac was done originally)

Thanks


About  "Reference number"

I tested the project and found some problem about the field "Reference number"
If I input something into "Reference Number" and generate the QR code. And then use my HSBC app to scan, it will pop out "this QR code does not match its designation of Merchant/personal".
If I input nothing in the field "Reference Number", the QR code is workable.
Do you have any idea?

I also face the same problem, but i think this is related to the HSBC app and FPS system.

My electric bill have a FPS QR code, the format is the same as my generator output. It works on HSBC app, I think it is related to the FPS ID, The FPS ID of HK Elec Co. starts with 1 but not 7

@nessgor Can you explain me more about the issue with HSBC? I could not figure out why when I put reference number, it fails each time.

@guysum @alexabidri If you are going to use the Reference Number field in the FPS QR Code, make sure you have enabled the "Request to Pay" feature for your FPS account. If not, please contact your bank to enable the feature first, or your QR Code will not work as expected.

I have requested my bank to enable the feature and they send me an agreement to sign then after a few working days they will send you the details about how to retrieve the FPS daily transaction report.


Consistently return errorType for super expressions in classes that extend null

fixes https://github.com/microsoft/TypeScript/issues/55499

Almost forgot
@typescript-bot test top200
@typescript-bot user test this
@typescript-bot user test tsserver
@typescript-bot test tsserver top100
@typescript-bot run dt
@typescript-bot perf test this

The heck is with that xstate perf
@typescript-bot perf test this faster

@typescript-bot perf test this bun

The heck is with that xstate perf

Not sure but I like it 🤣


Feature request: patch manager

It would be nice to see the patches made to the binary, and be able to turn them on-and-off individually.

I apparently did a bad job of searching before I created #3614. I am closing this issue in favor of that one, since it has broader scope and more information.


Is codecov report correct?

I was looking into codecov report to check how well the code is tested. But I found some disparity between codecov report and Xcode coverage report. For example look at the case of UISliderExtensions.
This is the codecov report for UISliderExtension where completion handler is not covered by test.

But when I run the same test in Xcode it is giving the following result where test coverage is 100%

Did anybody know why this disparity happens? Is it a bug with Codecov? Is there anything to do with xcpretty in travis file? Because following link says broken codecov with xcpretty.
codecov/example-swift

Hi @tapanprakasht, I'm not sure what the issue is regarding this. If xcpretty is indeed causing this issue, we will have to deal with it, because I value being able to read the build log more than hitting every line of code. That being said, I also know that the completion block for animate(withDuration:) is finicky. You can see this in the UITableView & UICollectionView method reloadData(completion:). Although, in this specific case we may need to change the time interval because vaguely from memory - I believe if the duration is zero then the completion won't be called until the next run loop. However, this is a separate issue 😃


statistics: Add support for entropy stats

Add statistics on the available entropy into Luci statistics.
This PR utilises collectd-mod-entropy, which was created by https://github.com/openwrt/packages/pull/1717
The amount of entropy is typically rather limited in embedded systems. Monitoring the available entropy might be useful in some debugging situations.
Example graph:

Thanks


BHBC-2166: Enhancements to EML Function to Support Project/Survey EML Generation

Overview
The current EML code builds an EML json object for a project and all of its surveys. We need to modify this code so that we have 2 distinct functions, one that builds an EML object for a project and one that builds an EML object for a survey.
Links to Jira tickets

https://quartech.atlassian.net/browse/BHBC-2166

Description of relevant changes

eml-service is enhanced to support a function for building EML for a single project, which includes references to any surveys under the related projects section.

eml-service is enhanced to support a function for building EML for a single survey, which includes a reference to the parent project under the related projects section.

All “system” node attributes are to be left as empty strings, as this will be populated by BioHub. Example:

<!-- before -->
<dataset system="https://sims.nrs.gov.bc.ca" id="a3659666-0879-4b4f-aedb-467891db198a">

<!-- after -->
<dataset system="" id="a3659666-0879-4b4f-aedb-467891db198a">

All “TaxonID” node “provider” attributes are to be left as empty strings, and the value of the node now reflects the primary key of taxonomic code. Example:

<!-- before -->
<taxonId provider="https://sims.nrs.gov.bc.ca">M-ALAM</taxonId>

<!-- after -->
<taxonId provider="">2065</taxonId>

Additionally, removed the following nodes:

eml.access node
eml.dataset.metadataProvider
additionalMetadata nodes associated with proprietaryDataCategory
additionalMetadata nodes associated with proprietorName
additionalMetadata nodes associated with proprietaryDataCategoryRationale
additionalMetadata nodes associated with dataSharingAgreementRequired

How to Test

Create a project and a survey.
Visit a survey.
Click Submit Data
Check the API logs. The project EML and survey EML strings should be printed

Looks like just some linting issues, and a few sonar cloud items

Looks like just some linting issues, and a few sonar cloud items.
Otherwise looks good

Roger that. Just adding a bit more test coverage


v3.0.1 is not published on npm

It appears that the v3.0.1 release was never published to npm:
$ npm info istanbul-instrumenter-loader

{ name: 'istanbul-instrumenter-loader',
  description: 'Istanbul instrumenter loader for webpack',
  'dist-tags': { latest: '3.0.0', beta: '3.0.0-rc.1' },
  versions:
   [ '0.1.0',
     '0.1.1',
     '0.1.2',
     '0.1.3',
     '0.2.0',
     '1.0.0',
     '1.1.0',
     '1.2.0',
     '2.0.0',
     '3.0.0-beta.0',
     '3.0.0-beta.1',
     '3.0.0-rc.0',
     '3.0.0-rc.1',
     '3.0.0' ],
  ...

Yep, I realized after git push --follow-tags ... && npm publish that I don't have npm access to this package and therefore it's on master but not published yet ¯_(ツ)_/¯. I pinged folks but no response there either yet...

@michael-ciniawsky any updates on this?  publish to a new name?

v3.0.1 is now available: https://www.npmjs.com/package/istanbul-instrumenter-loader?activeTab=versions
So I believe this issue can be closed :)


CPU Gets Hot

Hello,
What causes my CPU to work so hard in this?
Thanks,
David

Hello again @ob7.
So from our interaction yesterday, you mentioned that you set your DRIVE_GOMAXPROCS to 1000 or even 10,000. That could be the trouble -- I mostly use 4 or 8 and it works alright for me.

Well I set it down to 20, it still does something thats reall processor
intensive, and its during "Resolving".  So I was curious as the how that
worked since whatever its doing seems to be what gets CPU going so hard.
Thanks,
David
On Fri, Aug 14, 2015 at 12:16 AM, Emmanuel Odeke<EMAIL_ADDRESS>wrote:

Hello again @ob7 https://github.com/ob7.
So from our interaction yesterday, you mentioned that you set your
DRIVE_GOMAXPROCS to 1000 or even 10,000. That could be the trouble -- I
mostly use 4 or 8 and it works alright for me.
—
Reply to this email directly or view it on GitHub
https://github.com/odeke-em/drive/issues/344#issuecomment-131015327.

Hello @ob7, I think we already discussed this on what resolving was doing

So its go code?
On Aug 14, 2015 9:40 AM, "Emmanuel Odeke"<EMAIL_ADDRESS>wrote:

Hello @ob7 https://github.com/ob7, I think we already discussed this on
what resolving was doing
[image: screen shot 2015-08-14 at 11 39 44 am]
https://cloud.githubusercontent.com/assets/4898263/9280098/3bb9aa4a-4279-11e5-9e56-843919a2fc0a.png
—
Reply to this email directly or view it on GitHub
https://github.com/odeke-em/drive/issues/344#issuecomment-131191672.

Well the go code is what does all the resolution. You are welcome to check out the code in src/changes.go. My apologies if I respond late, as I am a little bit busy.

Oh not at all - Im rather impressed how ontop of your repo you are.  Thanks
for answering all of my questions.
Thanks,
David
On Aug 14, 2015 9:43 AM, "Emmanuel Odeke"<EMAIL_ADDRESS>wrote:

Well the go code is what does all the resolution. You are welcome to check
out the code in src/changes.go. My apologies if I respond late, as I am a
little bit busy.
—
Reply to this email directly or view it on GitHub
https://github.com/odeke-em/drive/issues/344#issuecomment-131192195.

Thank you :)

Can we close this issue since it is a bit subjective, relative to the computer you are running, the size of a "huge" push, the resources available -- too broad to exactly trace.

Yes.  Btw got an Asus G750 so no more overheating.
On Aug 16, 2015 8:22 PM, "Emmanuel Odeke"<EMAIL_ADDRESS>wrote:

Can we close this issue since it is a bit subjective, relative to the
computer you are running, the size of a "huge" push, the resources
available -- too broad to exactly trace.
—
Reply to this email directly or view it on GitHub
https://github.com/odeke-em/drive/issues/344#issuecomment-131675505.

Cool! I actually run drive off a Raspberry Pi as well, but I don't do as much work on it.

I use Arch Linux for everything, have yet to build a rasberry pi, just
ordered my first Arduino board though and am looking forward to learning C!
On Aug 16, 2015 8:28 PM, "Emmanuel Odeke"<EMAIL_ADDRESS>wrote:

Closed #344 https://github.com/odeke-em/drive/issues/344.
—
Reply to this email directly or view it on GitHub
https://github.com/odeke-em/drive/issues/344#event-383843106.

Aha nice! That's gonna be a great journey. Got your K & R C? ;)

Whats that?
On Aug 16, 2015 9:15 PM, "Emmanuel Odeke"<EMAIL_ADDRESS>wrote:

Aha nice! That's gonna be a great journey. Got your K & R C? ;)
—
Reply to this email directly or view it on GitHub
https://github.com/odeke-em/drive/issues/344#issuecomment-131680523.

https://en.wikipedia.org/wiki/The_C_Programming_Language#/media/File:The_C_Programming_Language_cover.svg

Oh u mean
http://www.amazon.com/The-Programming-Language-Brian-Kernighan/dp/0131103628
On Aug 16, 2015 9:15 PM, "OB7 Dev"<EMAIL_ADDRESS>wrote:

Whats that?
On Aug 16, 2015 9:15 PM, "Emmanuel Odeke"<EMAIL_ADDRESS>wrote:

Aha nice! That's gonna be a great journey. Got your K & R C? ;)
—
Reply to this email directly or view it on GitHub
https://github.com/odeke-em/drive/issues/344#issuecomment-131680523.

Yap, there you go! Hopefully it'll be a good one. I like that book ;)

Just ordered a copy cant wait!
On Aug 16, 2015 9:30 PM, "Emmanuel Odeke"<EMAIL_ADDRESS>wrote:

Yap, there you go! Hopefully it'll be a good one. I like that book ;)
—
Reply to this email directly or view it on GitHub
https://github.com/odeke-em/drive/issues/344#issuecomment-131683453.

Awesome, happy good will hunting!

Thank you kind sir.
On Aug 16, 2015 9:37 PM, "Emmanuel Odeke"<EMAIL_ADDRESS>wrote:

Awesome, happy good will hunting!
—
Reply to this email directly or view it on GitHub
https://github.com/odeke-em/drive/issues/344#issuecomment-131685146.


fix: update "please-upgrade-node" to version 3.0.2

Includes semantic version range checking that avoids incorrect flagging of Node.js version 10+. https://github.com/typicode/please-upgrade-node/issues/11
Resolves #432
Edit: Closes #433

Released in v7.0.5 :tada:
Thanks @ChristianMurphy!


[#99] Delete System.version & set elixir as ">= 1.7.4"

Delete System.version from mix.exs template and set elixir as ">= 1.7.4" to match the fixed version at Dockerfile template.

Can you add a bit more information on why this is the right thing to do.

Sure!
The last time I used raxx_kit to scaffold Ace server I had to change by hand the elixir version in the mix.exs and dockerfiles to 1.9.4, also I realized that there less version available at docker hub than I expected.
Now I am no sure if this is the righ thing to do. At least  set it to 1.7.4 or greater it tackle the problem in a simpler manner, but delegate responsibility to the raxx_kit's user to care about the mix configuration.
Another option could be a flag to set fixed version like --elixir_version x.x.x.

I think the thing to do is update the value in the dockerfile to the latest value. and leave the mix file to use the elixir version that generated it

Ah OK! the System.version value is for set  the elixir version that generated the server, not for only match the Elixir version that user it is using at the moment.
I will update this PR with only changing the Elixir version to 1.10.2 in the Dockerfile

Thanks, btw I hadn't reread the issue #99 now I've remembered there are a bunch of caveats doing anything cleverer. This is a helpful bump on the docker file.
Can you add a changelog entry with todays date and I can push it as 12.2

Thanks, btw I hadn't reread the issue #99 now I've remembered there are a bunch of caveats doing anything cleverer. This is a helpful bump on the docker file.
Can you add a changelog entry with todays date and I can push it as 12.2
Done !

published. thanks :whale:
Leave a update on the forum if you fancy it. https://elixirforum.com/t/raxx-kit-micro-framework-for-web-applications/13805/19


Error

"clusterName matches the value you supplied for CertDNSName when creating your cluster certificate" => No, it doesn't!

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 7b3032c3-cf9a-6ecf-a3ee-e28924ac2064
Version Independent ID: d3109420-2017-9b56-4368-d8812f70f1a0
Content: Create a Service Fabric cluster using Azure Resource Manager template - Azure Service Fabric
Content Source: articles/service-fabric/quickstart-cluster-template.md
Service: service-fabric
GitHub Login: @erikadoyle
Microsoft Alias: edoyle

Hi @mcurko ,
This doc instructs you to edit the parameter values in your azuredeploy.parameters.json so that the clusterName matches the value you supplied for CertDNSName when creating your cluster certificate. You have to edit the parameter values yourself to make them match.

For CertDNSName sfc1234.southcentralus.cloudapp.azure.com I had to use sfc1234 in the parameter file, otherwise the cluster creation failed.

mcurko, Yes the example in the doc seen below specifies which subsections of the CertDNSName should be used.

clusterName matches the value you supplied for CertDNSName when creating your cluster certificate
CertDNSName: sfquickstart.southcentralus.cloudapp.azure.com

{
  "$schema": "https://schema.management.azure.com/schemas/2019-04-01/deploymentParameters.json#",
  "contentVersion": "<IP_ADDRESS>",
  "parameters": {
    "clusterName": {
      "value": "sfquickstart"
    },
    "adminUsername": {
      "value": "testadm"
    },
    "adminPassword": {
      "value": "Password#1234"
    },
    "certificateThumbprint": {
      "value": ""
    },
    "sourceVaultResourceId": {
      "value": ""
    },
    "certificateUrlValue": {
      "value": ""
    }
  }
}

Closing this issue as the doc guidance and examples are correct.


Please document need to enable two enterprise apps and errors that show that.

Push notifications used to work.
I had authenticator set up years ago with AAD.
For some time push has not worked and i have to do the thing with the two digit numbers.
Saw issue trying to enable password less.
Searched on the terms found this article http://www.sharepointalex.uk/office-365/azure-password-less-sign-in-something-went-wrong-error/#comment-883
how nearly 3 years after that was published is the same info not it this documentation!?
Please update docs so someone searching bing/google for the error messages will find you docs with a solution.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: ee6ac70d-5853-6a3a-0964-23b46910b4c4
Version Independent ID: a5beda87-9845-8807-6221-7fdc64079587
Content: Passwordless sign-in with the Microsoft Authenticator app - Azure Active Directory
Content Source: articles/active-directory/authentication/howto-authentication-passwordless-phone.md
Service: active-directory
Sub-service: authentication
GitHub Login: @Justinha
Microsoft Alias: justinha

@scyto
Thanks for your feedback! I have assigned this issue to the author who will investigate and update as appropriate.

@scyto
Thanks for your feedback! I have assigned this issue to the author who will investigate and update as appropriate.

@scyto Thanks for the feedback! This has been added as a prerequisite.
#please-close


Add the ability to hide sensitive information

Based on the stackoverflow answer adjacent to the repo's author can we add the ability to filter out the sensitive json properties?
I could be just a simple Func or List<string> to filter out properties like password, base64Content.
It could be regex
var sensitiveProperties =new List<string>() { "password","sensitive.*" }

If that's something nice to have in this project, let me know if you would like to see a PR for that

That seems pretty sensible. For default things to scrub:

A regex for anything that looks like a credit card
Properties that match or contain any of the following keywords:

password
secret
passwd
api_key
access_token
accessToken
auth
credentials
mysql_pwd

It might also be worthwhile to replace the masked content with ***MASKED*** or ***REDACTED*** to avoid any confusion for someone viewing the logs that wasn't aware of the masking behavior.
I do think exposing something like a "preLogging" function would be helpful not only for this use case but also for things like reducing "noisy" log payloads.

Excellent ideas!

A regex for anything that looks like a credit card

Properties that match or contain any of the following keywords:

password
secret
passwd
api_key
access_token
accessToken
auth
credentials
mysql_pwd

I would prepare a list with default keywords and regex patterns to look out for, but at the same time give the user the ability to add their own.

It might be worthwhile to replace the masked content with ***MASKED*** or ***REDACTED*** to avoid any confusion for someone viewing the logs that wasn't aware of the masking behavior.

Agreed!

Besides clearly sensitive information I can also see people wanting to hide PII (personal identifiable information) things like FirstName, LastName, etc. That probably wouldn't be something enabled by default but I could imagine it being a common enough need that we should make it an easy add via configuration.

There alright might be a library out there for PII scrubbing, so the wheel doesn't have to be reinvented.

Exposing something like a "preLogging" function would be helpful not only for this use case but also for things like reducing "noisy" log payloads.

Could be an extension point based on e.g. Action<HttpContext> PreLogging. Is anyone willing to prepare a PR?

I'll give @Toumash the opportunity to take this on as he mentioned interest and brought the issue up but if for whatever reason he is not able to I would gladly prepare a PR.

I think that there are two different problems:

filtering properties by keys
filtering/masking data inside (property values) based on some regexes

For the first point im sure its fine, but not for the second one.
I've created something as a starting point:  #9

I think that there are two different problems:

filtering properties by keys
filtering/masking data inside (property values) based on some regexes

For the first point im sure its fine, but the second is much more complicated.
I've created something as a starting point:  #9
For me its enough to use

https://github.com/matthiasguentert/azure-appinsights-logger/pull/19


Move to Java 8

It's already Java 9 released and Java 8 is a go to java version. With Java 8 we can implement Take interface just in place with Lambdas:
new FtBasic(
    req -> new RsTest("Hello, world!");
).start(Exit.NEVER);

I don't think that supporting java 7 is relevant nowadays. Many libs and frameworks already moved to Java 8. It will be more attractive, if we had Java 8. Of course this framework can be used within java 8, but official support is still important. And also the fact that Cactoos is Java 8 based will in fact leave us with no choice.
In terms of implementation: the codebase should be build with Java 8 (jdk.version property in maven) and also the README.md should mention that it is Java 8 framework. We can adopt Java 8 features lately in appropriate places.

@yegor256/z please, pay attention to this issue

Job #808 is now in scope, role is DEV

Bug was reported, see §29: +15 points just awarded to @t-izbassar/z, total is +395

@yegor256 I could take this

The job #808 assigned to @paulodamaso/z, here is why; the budget is 30 minutes, see §4; please, read §8 and §9; if the task is not clear, read this and this; there will be a monetary reward for this job

@paulodamaso/z this job was assigned to you 5days ago. It will be taken away from you soon, unless you close it, see §8. Read this and this, please.

@0crat wait for #848 merge

@0crat wait for #848 merge (here)

@paulodamaso The impediment for #808 was registered successfully by @paulodamaso/z

The architect of the project has changed; @yegor256/z is not at this role anymore; @paulodamaso/z is the architect now

The job #808 is now out of scope


[DOCS] Update Image format enumeration documentation

Provides more information about each image format. I tried to provide some context and links where they felt appropriate, but there were a couple of formats I couldn't find any definitive information (like LA8).
This is related to godotengine/godot-docs#1214.
Suggestions welcome.

Thanks!

Cherry picked into 3.0.3


New Tasks

@Sarikak027
Task -12
Code verified.
Task -13
Code verified.
Task -14
Code verified.
Task -15
Code verified.
Task -16
Code verified.
Task -17
Code verified.
Task -18
Code verified.
Task -19
Code verified.
Task -20
Code verified.
wait for balance task to review and approve

@Sarikak027
Task -21
Code verified.
Task -22
Code verified.
Task -23
Code verified.
Task -24
Code verified.
Task -25
Code verified.
Task -26
Code verified.


fps drop

Sometimes when I open the addon, fps drop and the game is lagged

Please look into this. The lag is most apparent when on a busy server whenever someone advertises a dungeon boosting service. For example, it seems any mage that advertises "WTS SP BOOST" will cause the game client to stutter, lag, or freeze up entirely for seconds at a time. It happens for other dungeons that people like to boost like stratholme, stockages, you name it. I can't use the addon at all without lag.
 My computer isn't slow either; It's a Ryzen 9 5950x, 128GB of DDR4-3800MHz CAS14 RAM, RTX 3090, and Intel Optane 905P SSD. Nothing here should be bottlenecking the game or causing problems.

Lagg is confirmed, everyone actually has this, but ppl can't really determine the source of that lag, but disabling LFG Group Bulletin Board DO fixes the problem.

closing this as completed. A new thread should be opened whenever there are more performance issues.


publish_state excepts float

Hi,
When trying to flash it the Beaufort wind scale produces error as publish_state excepts float instead of char. It might be something that has changed with updates over time.
/config/esphome/weatherstation.yaml: In lambda function:
/config/esphome/weatherstation.yaml:77:40: error: cannot convert 'const char [2]' to 'float'
   77 |           id(wind_scale_code).publish_state("0");
      |                                        ^~~
      |                                        |
      |                                        const char [2]
In file included from src/esphome/core/controller.h:17,
                 from src/esphome/components/api/api_server.h:4,
                 from src/esphome/components/api/api_connection.h:6,
                 from src/esphome.h:3,
                 from src/main.cpp:3:
src/esphome/components/sensor/sensor.h:126:28: note:   initializing argument 1 of 'void esphome::sensor::Sensor::publish_state(float)'
  126 |   void publish_state(float state);
      |                      ~~~~~~^~~~~

github messed up the indentation, attached a screenshot for clarity

Use ``` and not ` for multiline block.
About the problem, I will look at that when I have some time.

Is this still relevant?
Have you updated ESPHome?

Hi, for me it is not relevant in the sense that I removed the Beaufort scale and been using the rest of the script happily. So I'm not sure if it compiles with new ESPhome versions. If it does feel free to close the issue.


CI: Jenkins: Test runs time out: cilium-health-ep reports "connect: no route to host"

Example run:
https://jenkins.cilium.io/job/Cilium-PR-K8s-1.18-kernel-4.9/1921/execution/node/136/log/?consoleFull
Symptoms:
The overall test run times out at 3 hours.
Many tests report taking a long time for kube-dns to become ready, eg first test in link above:
20:45:30  K8sKafkaPolicyTest Kafka Policy Tests
20:45:30    KafkaPolicies
20:45:30    /home/jenkins/workspace/Cilium-PR-K8s-1.18-kernel-4.9/src/github.com/cilium/cilium/test/ginkgo-ext/scopes.go:518
...
20:46:55  04:46:50 STEP: Waiting for Kubernetes DNS to become operational
20:46:55  04:46:50 STEP: Checking if deployment is ready
20:46:55  04:46:50 STEP: Kubernetes DNS is not ready yet: only 0 of 1 replicas are available
...
20:47:09  04:47:09 STEP: Kubernetes DNS is not ready yet: only 0 of 1 replicas are available
20:47:10  04:47:10 STEP: Checking if deployment is ready
20:47:11  04:47:10 STEP: Checking if pods have identity

A later test:
22:44:53  K8sDatapathConfig Host firewall
22:44:53    With VXLAN and endpoint routes
22:44:53    /home/jenkins/workspace/Cilium-PR-K8s-1.18-kernel-4.9/src/github.com/cilium/cilium/test/ginkgo-ext/scopes.go:518
22:44:53  06:44:50 STEP: Installing Cilium
22:44:55  06:44:55 STEP: Waiting for Cilium to become ready
22:45:35  06:45:30 STEP: Validating if Kubernetes DNS is deployed
22:45:35  06:45:30 STEP: Checking if deployment is ready
22:45:35  06:45:30 STEP: Checking if kube-dns service is plumbed correctly
22:45:35  06:45:30 STEP: Checking if pods have identity
22:45:35  06:45:30 STEP: Checking if DNS can resolve
22:45:35  06:45:35 STEP: Kubernetes DNS is not ready: %!s(<nil>)
22:45:35  06:45:35 STEP: Restarting Kubernetes DNS (-l k8s-app=kube-dns)
22:45:37  06:45:37 STEP: Waiting for Kubernetes DNS to become operational
22:45:37  06:45:37 STEP: Checking if deployment is ready
22:45:38  06:45:38 STEP: Kubernetes DNS is not ready yet: only 0 of 1 replicas are available
...
22:49:21  06:49:21 STEP: Checking if deployment is ready
22:49:21  06:49:21 STEP: Kubernetes DNS is not ready yet: only 0 of 1 replicas are available
22:49:22  06:49:22 STEP: Checking if deployment is ready
22:49:23  06:49:23 STEP: Checking if kube-dns service is plumbed correctly

Later unrelated test also had trouble with routes:
23:41:20  07:41:15 STEP: Performing K8s service preflight check
23:41:36  07:41:35 STEP: Cilium is not ready yet: controllers are failing: cilium-agent 'cilium-vz7wf': controller cilium-health-ep is failing: Exitcode: 0
23:41:36  Stdout:
23:41:36   	 KVStore:                Ok   Disabled
23:41:36  	 Kubernetes:             Ok   1.18 (v1.18.20) [linux/amd64]
23:41:36  	 Kubernetes APIs:        ["cilium/v2::CiliumClusterwideNetworkPolicy", "cilium/v2::CiliumEndpoint", "cilium/v2::CiliumNetworkPolicy", "cilium/v2::CiliumNode", "core/v1::Namespace", "core/v1::Node", "core/v1::Pods", "core/v1::Service", "discovery/v1beta1::EndpointSlice", "networking.k8s.io/v1::NetworkPolicy"]
23:41:36  	 KubeProxyReplacement:   Disabled
23:41:36  	 Cilium:                 Ok   1.10.7 (v1.10.7-f06d6eb)
23:41:36  	 NodeMonitor:            Listening for events on 3 CPUs with 64x4096 of shared memory
23:41:36  	 Cilium health daemon:   Ok
23:41:36  	 IPAM:                   IPv4: 6/254 allocated from <IP_ADDRESS>/24, IPv6: 6/254 allocated from fd02::/120
23:41:36  	 BandwidthManager:       Disabled
23:41:36  	 Host Routing:           Legacy
23:41:36  	 Masquerading:           IPTables [IPv4: Enabled, IPv6: Enabled]
23:41:36  	 Controller Status:      37/38 healthy
23:41:36  	   Name                                          Last success   Last error   Count   Message
23:41:36  	   bpf-map-sync-cilium_lxc                       9s ago         never        0       no error
23:41:36  	   cilium-health-ep                              2m8s ago       11s ago      3       Get "http://<IP_ADDRESS>:4240/hello": dial tcp <IP_ADDRESS>:4240: connect: no route to host

At a closer look, it seems like the failing report from the cilium-health-ep controller is likely what's causing most of the timeouts & failures. But it may be only a symptom for a deeper problem that is also causing kube-dns to take a long time to become ready.

v1.11 example: https://jenkins.cilium.io/job/Cilium-PR-K8s-1.16-net-next/2244/


probability diverges in some cases

The result of featured sample code in README.md diverges: it returns 0.9724554061259115.

This issue was resolved by the commit.


Pass in a serialization function

Either elixir, or :xmerl ?  Have to convert Strings to lists

Done in test branch


auto-update not working across filesystems

May 28 14:56:43 shoot--pq7kt8--durosint0-firewall-e4e50 ip[897]: 2021-05-28T14:56:43.201+0200        INFO        controllers.Firewall        reconciling firewall-controller        {"firewall": "firewall/firewall"}
May 28 14:56:43 shoot--pq7kt8--durosint0-firewall-e4e50 ip[897]: 2021-05-28T14:56:43.201+0200        DEBUG        controller-runtime.manager.events        Normal        {"object": {"kind":"Firewall","namespace":"firewall","name":"firewall","uid":"dcadec43-7af7-4635-a061-a03c5bffe82b","apiVersion":"metal-stack.io/v1","resourceVersion":"774589"}, "reason": "Self-Reconcilation", "message": "replacing firewall-controller version v1.0.0 with version v1.0.8"}
May 28 14:56:43 shoot--pq7kt8--durosint0-firewall-e4e50 ip[897]: 2021-05-28T14:56:43.564+0200        ERROR        controller        Reconciler error        {"reconcilerGroup": "metal-stack.io", "reconcilerKind": "Firewall", "controller": "firewall", "name": "firewall", "namespace": "firewall", "error": "could not replace firewall-controller with version v1.0.8, err: rename /var/tmp/firewall-controller510281648 /usr/local/bin/firewall-controller: invalid cross-device link"}

Possible solution: create the TempFile in /usr/local/bin

same issue with other files too:
rename /var/tmp/frr.conf858997763 /etc/frr/frr.conf: invalid cross-device link

This is only with newer firewalls created with with mep-8, right ?

This is only with newer firewalls created with with mep-8, right ?

Yes

Still:
firewall         0s          Warning   Error                          firewall/firewall                                       (combined from similar events): 2 errors occurred:
                 * rename /var/tmp/firewall-controller_nftables.v4891800078 /etc/nftables/firewall-controller.v4: invalid cross-device link
                 * error during network reconcilation: /var/tmp/frr.conf445395477: rename /var/tmp/frr.conf445395477 /etc/frr/frr.conf: invalid cross-device link

v1.0.5 still has old update-code. Only version >= v1.0.9 can update across filesystems.


Clickable Artists

If you're browsing by song, the artist column should be links that you can click to see their profiles/other works.

Fixed!


Don't extend Iterator.from

While it is not yet exactly clear what Iterator.from will do, its purpose seems to be converting anything into an Iterator instance using best effort (like Array.from), using the iterable protocol.
Using the same method to create an iterator over the properties of any arbitrary object would mean it would not work on iterable objects though. What's more, code using Iterator.from would be more fragile as it would break when objects become iterable due to code changes elsewhere (e.g. in a library update) - Iterator.from would suddenly return a different iterator.
I would therefore suggest to instead introduce a new static method, e.g. Iterator.entriesFromObject, Iterator.objectEntries or briefly Iterator.entries, for the purpose of iterating objects. (In the case of Iterator.entries, it could even sensibly fall back to calling .entries() on Map instances).
An alternative might be to expose an explicitly constructable ObjectIterator (we'll inevitably get to spec that subtype anyway), but I don't particularly like introducing yet another global.

Thanks for the valuable thoughts. I can see your concerns. How do you feel about putting such a method on Object instead? Like Object.iterate(obj) -> /* iterator on entries */

Oh, I completely forgot about that choice - sure, that would solve the issue as well.
However, it would also highlight the inconsistency of Object.entries not returning an iterator, also I'm not sure about web compatibility given things like this - probably not much of an issue but Object is more crowded than Iterator. Maybe also Object.iterator(…)? I don't deeply care about the name.

TC39 notes:
Dict() is shorthand for Object.create(null);
Dict.keys(o)   - iterable of keys
Dict.values(o) - iterable of values
Dict.items(o)  - iterable of pairs

The same as a module from pre-ES6 strawman.

(it was implemented in core-js@2)

Iterator.from(Object.entries(obj)) is fine.

@michaelficarra it's the creation of an intermediate array and not very compact.
Iterator.from(Object.entries(obj)).doSomething();
// vs
Object.entries(obj).values().doSomething();
// vs
Dict.entries(obj).doSomething();

@zloirock That's another good alternative, but I doubt we want to wait for the standard library proposal.
@michaelficarra Yes, that'll work, but we want a method that is a) more concise to call b) doesn't create an intermediate array

The standard library is not a requirement. It can be implemented as a global object.

@bergus As long as the VM keeps track of whether a few built-ins have their original value, that array doesn't necessarily need to be realised.

@michaelficarra true, but that depends on the engine optimizing this way. I prefer the explicit mechanism of retrieving an iterator directly.
@zloirock can you please help me understand the need for a new Dict global vs just adding to the existing Object global? For example, would it be sufficient to do something like:
Object.iterateKeys() // -> iterator on keys
Object.iterateValues() // -> iterator on values
Object.iterateEntries() // -> iterator on entry pairs

@decompil3d for consistency names with other methods that return iterators?
Array#keys
Array#values
Array#items
Set#keys
Set#values
Set#items
Map#keys
Map#values
Map#items
// ...and
Object.iterateKeys
Object.iterateValues
Object.iterateEntries
// ???

Because it's shorter?
Dict.keys
Dict.values
Dict.entries
// vs
Object.iterateKeys
Object.iterateValues
Object.iterateEntries

Because of that a new namespace opens many other possibilities for working with objects as with collections in the future? (See examples in core-js@2) Like:
const dict = Dict({ foo: bar });
// vs
const dict = Object.assign(Object.create(null), { foo: bar });
// or
Dict.has(object, key);
// vs
Object.prototype.hasOwnProperty.call(object, key);

@zloirock I see your point, but consistency is broken anyway as Object/Dict  methods are static while
Array/Map/Set are prototype ones. Btw, to throw another name in the ring, I'd prefer keysIterator/valuesIterator/entriesIterator over iterateKeys/….

@bergus more consistency better than less consistency. Object already has .keys / .values / .entries methods ant that confuses.

that depends on the engine optimizing this way

I am not really a fan of building in new APIs which are simple compositions of existing APIs on the rationale that engines might not optimize the composition away. If there's some other justification, sure, but I don't like that one.

Updated proposed solution to use Object.iterate{Entries, Keys, Values} instead and added a note about Iterator.from being unfeasible.


F14+F15 keys trigger brightness control

Checklist

[x] I have searched for existing issues
[x] I have looked through the wiki
[x] I have updated MonitorControl to the latest version

Describe the bug
Brightness control is triggered by F14 and F15 keys, even when these shortcuts are disabled in MacOS control panel.
This even happens when those keys are remapped to by Karabiner Elements.
To Reproduce
Have an Apple Keyboard with keypad (and therefore F13-F19 keys)
Go to Mac Control Panel --> Keyboard
go to tab: Shortcuts
left select Monitor
disable increase/decrease monitor brightness (or change their shortcuts to some other keys)
press F14/F15
see brightness still be adjusted
Expected behavior
Don't use F14/F15 for brightness control unless they are actually in use for that.
Additional context
This bug is a problem when these are actually used for something different. I need them as "scroll lock" and "pause" for remote work over Windows RDP. Yes, I actually need them many times in a day. Yes, I might be a dinosaur.
Besides that: huge f-in kudos for this app!
Environment Information (please complete the following information):

macOS version: 10.14 (Mojave)
MonitorControl version: 2.1
Monitor(s): irrelevant (but they are 2x Dell S2721DGF which absolutely rock)

Addition: it seems that the issue is not actually specific with the F14/15 keys, but with the "scroll lock" + "pause" function..? I've just remapped F18/F19 for that purpose in Karabiner and bam, they too now control the monitors' brightness.

See #100


Generate PlantUML Fails to Generate Multiple Sequence Diagrams with Multiple Usecases

Generate PlantUML fails to generate multiple sequence diagrams when multiple usecases are present in the same file. The first usecase is output and the rest ignored.
Steps to Reproduce
Run puml-sequence on the flow model: aac puml-sequence /workspace/AaC/python/model/flow/flow.yaml
Only a file, flow_sequence.puml is created with the first usecase present. The expected output should include a sequence diagram file for each usecase.

To further expand on this issue, we considered the same to be accurate for the component diagram where each model in a yaml file should have its own diagram generated.


[Epic] Switch to Furo Sphinx theme

Background
Moving away from Pytorch
There are two categories of problems with our current Sphinx theme, a fork of Pytorch:
User limitations

Poor mobile support
Looks a little dated
Not fully compliant with accessibility
No dark mode

Developer frustrations

12k line CSS file with

lots of conflicting rules (aka “specificity wars”)
“pytorch” references everywhere

Porting fixes from pytorch is getting harder, given that the CSS was not maintainable to begin with and we’ve made enough changes

Rather than trying to salvage the current theme, we are recommending using a new, more modern theme from https://sphinx-themes.org/. The newer ones are built to follow best practices like use Sass and have excellent mobile support.
Furo
We are recommending using Furo: https://sphinx-themes.org/sample-sites/furo/. It was built in 2020 for the new pip docs and is used by Black, urllib3, attrs, and the Python developer guide.
It meets all of our criteria, including looking modern, having great mobile support, being extensible to Qiskit's top-nav bar, and having maintainable Sass-based CSS.
We also strongly considered Book: https://sphinx-themes.org/sample-sites/sphinx-book-theme/. But it's top-nav bar would be much harder to get working with the Qiskit one, and we also believe it's not as nice-looking.

I tried building the Qiskit-Experiments docs with the current Furo theme (as of 97f2029899750629ecdb6aa80f058d1c7c9eea7e) and here are some points I noted so far:

I thought setting _THEME=_qiskit_furo in the tox build environment would be enough, but I had to set html_theme = "_qiskit_furo" in conf.py to get it to work since it was hardcoded to qiskit_sphinx_theme before. This is mostly a note for anyone else trying to test the theme on an existing project.
Building pages are quite a bit slower than with the previous theme, which is a problem. I'm not sure whether this is an Experiments-specific problem (the build on the example docs in this repo is very fast) and whether there's a way to speed things up.
I like that the destinations of links are highlighted now!
The scrolling animation when clicking on a sidebar link takes a while to get to the destination when the page is long. Maybe we can get rid of the animation?

Qiskit has been using Furo for a few weeks now 🎉 https://qiskit.org/documentation/


Export/Save mt5 model

!t5_mesh_transformer \
  --model_dir="gs://t5-data/pretrained_models/mt5/base" \
  --use_model_api \
  --mode="export_predict" \
  --export_dir="{saved_model_dir}"

saved_model_path = os.path.join(saved_model_dir, max(os.listdir(saved_model_dir)))

While running the above code, it  loads t5-base, resulting the below error due to the shape mismatch. How to export a mt5 model.

tensorflow.python.framework.errors_impl.InvalidArgumentError: Assign requires shapes of both tensors to match. lhs shape= [32128,768] rhs shape= [250112,768]
	 [[{{node save/Assign_281}}]]

This looks like the result of a vocab mismatch. Try adding `--module_import="multilingual_t5.tasks" so the export code would have a chance to grab the multilingual vocabulary.

Yes, tried with  --module_import="multilingual_t5.tasks, getting below error on t5==0.7.1
ModuleNotFoundError: No module named 'multilingual_t5'

You need to first clone this repo and make call the launch script from within the main repo directory.


setTriggerSolutionUpgrade conditions

Add conditional statement to setTriggerSolutionUpgrade task to only run when NOT importing unmanaged solution (importUnmanaged not equal to 'true')

This fixes https://github.com/microsoft/coe-starter-kit/issues/1499

@jenschristianschroder I haven't seen this issue. Looks like the condition you added makes sense, but I wonder why I haven't seen it in my testing. Does the pipeline actually fail or does it swallow the error in that step?

Hi Mike,
I hit this issue in a new CDX tenant that I had set up. The pipeline failed.
I'm trying to reproduce this in my own setup now. The CDX will be used for demo this week but after that I will see if I can reproduce in that tenant also.
In the end, I think the condition to only run SetTriggerSolutionUpgrade task if not importing unmanaged solution make sense.


how to suppress warning with mpl_toolkits when matplotlib installed

mpl_toolkits is a part of matplotlib and we can ignore the following warning when matplotlib is included in pyproject.toml file.
Warning: Failed to find corresponding package name for import `mpl_toolkits` in current environment.

No priority.

Thanks @lisphilar for raising this issue. I see that there is a file called top_levels.txt in the metadata of matplotlib. It should be possible to include this information during the checking for obsolete dependencies.
This will also help with #5, since these packages also have a file called top_levels.txt, stating google as the top level.

@lisphilar Should now be fixed in version 0.2.2!

@fpgmaas , Thank you always for your quick release!!
Finally I confirmed that version 0.2.2 (0.2.3) removed the warning.
Best Regards