A question about training with transcription

I appreciate your wonderful work and the open-resourced codes. It helps me a lot! And I have a question. Do the codes provide the method to fine-tune the model with transcription? If not, I'd like to implement that part myself. But I am not sure whether I missed that part when viewing the codes.
Looking forward to your reply!

@wangjs9 Do you mean finetuning the model to perform text-to-speech tasks?

@haoheliu yes, i am also interested in that. But, I want to make transfer learning of a vocal style of a person in speech. If you can guide me

Thank you for your reply!! Yes. I'd like to fine-tune a model that can perform the text-to-speech task well on my own dataset through the command line like:
audioldm2 -t "A female reporter is speaking full of emotion" --transcription "Wish you have a good day"
I have compared the codes here and the inference one(AudioLDM2). I did not find related codes.
I can implement it myself given your supremely clear codes and instructions. But I want to ask you and confirm it.

@Tortoise17 @wangjs9  The code for AudioLDM2 is in the repo already but the config has not been pushed and tested yet. You are most welcomed to make PR or other contributions.
I'm not sure about the transfer learning yet.
I suppose for the text-to-speech task it would not be painful to implement. I recommend you start by looking at this conditioning module https://github.com/haoheliu/AudioLDM-training-finetuning/blob/main/audioldm_train/conditional_models.py#L482, which perform AudioMAE prediction and prediction output will be used to condition the diffusion model. AudioLDM2 repo use similar (or say same) condition module and you can refer to the configuration there to implement the training configuration yaml file.

Thank you for your reply and your detailed suggestions! And I am confident that the implementation can be smooth given your clear codes! I asked it because I was worried that I would do redundant work. Now I think that the main modification is the configuration.
Thank you again!! Looking forward to further wonderful work from you and your lab!!

@haoheliu This is a great hint. So it means, I can take my vocal to generate using speech to text with autoregressive. I would like to make some research on this as I have found this work top super great. Really a supreme work.
One more question, we can train or fine-tune speech to text model for our own case? and for any other language? so far English works fine but it still needs refinement which I want to make.

@Tortoise17 @wangjs9 The code for AudioLDM2 is in the repo already but the config has not been pushed and tested yet. You are most welcomed to make PR or other contributions.
I'm not sure about the transfer learning. If you like to copy a voice from a vocal prompt, you can do in-context learning (or continuation) with the autoregressive part of AudioLDM 2.
I suppose for the text-to-speech task it would not be painful to implement. I recommend you start by looking at this conditioning module https://github.com/haoheliu/AudioLDM-training-finetuning/blob/main/audioldm_train/conditional_models.py#L482, which perform AudioMAE prediction and prediction output will be used to condition the diffusion model. AudioLDM2 repo use similar (or say same) condition module and you can refer to the configuration there to implement the training configuration yaml file.

@haoheliu is there any flag which I can use for in-context learning? How to add my input input.wav file for generation of specific output using speech-to-text model or any audioldm2-full model.


DOC: Fixing broken links

What's wrong with the existing documentation

Added admins all 3 social links
Added gssoc link in the open source projects section

Add ScreenShots
As visible in the bottom

Record

[X] I agree to follow this project's Code of Conduct
[X] I'm a GSSOC'23 contributor
[X] I want to work on this issue

Since I have added 4 links and also 2 distinct things, so can it be level2 issue?

/assign


#187 fix class prop for El

@TheHadiAhmadi what is this PR for? If we remove $$props.class and a class attribute is defined by users, it won't be passed to the html element.

I added it to line 336, $$props.class should not be inside if block


Return to start postion as you zoom out

As I zoom out of the image I want to it to return to it's starting position. Is there a way to this that you know of? Something like forcing the image to transtion towards the centre as you zoom out but I am unsure of how to do this.
Any ideas would be great!

Thanks for opening an issue. You should be able to accomplish this with the resetPan method. See http://jsbin.com/kileta/edit?js,output.


exportPCM not working?

Hi @katspaugh
In the latest version 3.0.0 does the "exportPCM" function work?
wavesurfer.on('ready', function() {
    var pcmData = wavesurfer.exportPCM(1024, 1024, true);
    console.log("PCM: "+pcmData);
});

All that shows in the console is:
PCM: []

what does wavesurfer.exportPCM() return?

Using just wavesurfer.exportPCM() on v3.0.0, v2.2.1 and v2.2.0 just opens a blank new tab and the console still shows PCM: [].

can you check the various variables and values in https://github.com/katspaugh/wavesurfer.js/blob/master/src/wavesurfer.js#L1494 and try to figure out what's going wrong there?

I've been trying various values as well as wavesurfer.backend.getPeaks() but nothing is working for and I've got back to v2.0.5 and still not working. Is there someone that can help with this, we're willing to pay for any one to help get this working for us and to help get our player working much faster.

@pmgrace
it is a timing issue, i can reproduce this with the zoom example, when i use
    wavesurfer.on('ready', function() {
        setTimeout(() => {
            const pcm = wavesurfer.exportPCM(1024, 1024, true);
            console.log('pcm', pcm);
        }, 1000);
    });

i get the pcm data returned
i will try to find a fix, maybe this can help as a hotfix

@pmgrace do you use backend: 'MediaElement' then try wavesurfer.on('waveform-ready', () => {})

@pmgrace
it is a timing issue, i can reproduce this with the zoom example, when i use
    wavesurfer.on('ready', function() {
        setTimeout(() => {
            const pcm = wavesurfer.exportPCM(1024, 1024, true);
            console.log('pcm', pcm);
        }, 1000);
    });

i get the pcm data returned
i will try to find a fix, maybe this can help as a hotfix

I will try this out.

@pmgrace do you use backend: 'MediaElement' then try wavesurfer.on('waveform-ready', () => {})

Yes I do use MediaElement, will also try this out.

@pmgrace do you use backend: 'MediaElement' then try wavesurfer.on('waveform-ready', () => {})

Tested this one first and I now get the pcm data! Finally I can start working on the next part of doing something with this and loading tracks quicker :)
THANK YOU @aburai :)

it is a timing issue, i can reproduce this with the zoom example, when i use

Instead of closing this issue, is there something we can do here to improve the situation?

maybe something for the FAQ section

maybe something for the FAQ section

can we not fix the timing issue? maybe make it async


Migrate Cassandra utils

Coverage remained the same at 100.0% when pulling c5e81238080a30beceef0ebff231a2e95b804c4f on cassandra-utils into 7f9363de3540ccd667cf0d9f56d4facf4c16b0f5 on master.


DMN Editor can not reopen List expression

To reproduce the issue please follow the steps:

open new DMN model
add a decision node
define the decision node as List expression
close the DMN model
reopen the node
try to open the decision node that is internally defined as List expression

I confirm that this issue is also reproducible in the current main, but I was unable to reproduce if the list expression is not empty (if it have an inner expression inside of each row).

I think we need a JIRA for this ticket, @jomarko , if you didn't created one yet.


Error when using tsconfig.json generated by npx tsc --init command.

I'm using the package with Typescript and it's working perfectly. But I found a little issue. When you generate the tsconfig file using "npx tsc --init" swagger-autogen cannot parse the JSON to an object due comments automatically inserted by generation.

I don't know if there is a way to remove the comments when you parse. I case there isn't, should be great to add this information in documentation.

Hi @matheusfenolio. Thanks for opening the issue.
Good to know about this! I've a function that remove all comments in the file. I can use it. Could you send me your tsconfig.ts file so that I can reproduce and handle the error here?

Hi @matheusfenolio. Thanks for opening the issue.
Good to know about this! I've a function that remove all comments in the file. I can use it. Could you send me your tsconfig.ts file so that I can reproduce and handle the error here?

It worked perfectly! :smiley:

It worked perfectly! :smiley:

Great @matheusfenolio!! In the next version I'll submit this.
Thank you!

Great @matheusfenolio!! In the next version I'll submit this.
Thank you!


hikey.conf: drop stale Xorg input drivers

Evdev handles everything, 'mouse' and 'keyboard' are deprecated.
Signed-off-by: Koen Kooi<EMAIL_ADDRESS>

lgtm


Hide only showing intro only once behind a flag or disable for now

cc @tessaSAC

Just realized there will be multiple people using this from the same station, so can't really using local storage for the event

thought as much... almost the big day! I don't think the intro thing is in master though. did you want me to take out the check for the tour?

Yes please! Or comment out as we'll need it eventually

What is a flag?

Basically a queryParameter, similar to this:
https://github.com/AngularNYC/angular-presentation/blob/tourError/src/app/presentation/presentation/presentation.component.ts#L44
We could something like "showIntroOnce" or something.
I think it would be cheaper just to comment it out for now.

ooh, I see


Sorin theme Git unmerged indicator causes rendering bug in iTerm2

The Unicode character ═ causes the cursor to shift right in iTerm2. It does not happen in Terminal.app. Replace the character as a workaround.

Please file an issue at iterm2.com/bugs and include a debug log reproducing the issue.

@gnachman Why isn't iTerm2 on GitHub? Forcing users to make GitLab accounts, even though they do not use the product, is an unnecessary barrier to filing bugs. When iTerm2 used Google Project Hosting, at least people had Google Accounts due to Gmail popularity.

Because github doesn't allow people to attach their config files and 90% of bugs require them for me to be able to help.

@sorin-ionescu fyi you can sign in on GitLab using your GitHub account (i've been doing this on @gnachman project for ages and no problem at all)

@DanyC97 I did not know. Thank you.

As far as I can tell this isn't an issue with the latest versions of iTerm2. Please feel free to open another issue (or ping me to reopen this one) if you're still having this problem.


error=fork/exec /usr/bin/kubectl: no such file or directory

error=fork/exec /usr/bin/kubectl: no such file or directory，when use Migrating a cluster from flannel to Calico。calico version is v3.11.1

When are you seeing that error? Are you getting logs from something that is reporting that or is that when you're executing commands from the docs?
Please provide more context. Thanks

when i Migrating a cluster from flannel to Calico
https://docs.projectcalico.org/v3.11/getting-started/kubernetes/installation/migration-from-flannel
kubectl apply -f https://docs.projectcalico.org/v3.11/manifests/flannel-migration/calico.yaml
configmap/calico-config created
customresourcedefinition.apiextensions.k8s.io/felixconfigurations.crd.projectcalico.org created
customresourcedefinition.apiextensions.k8s.io/ipamblocks.crd.projectcalico.org created
customresourcedefinition.apiextensions.k8s.io/blockaffinities.crd.projectcalico.org created
customresourcedefinition.apiextensions.k8s.io/ipamhandles.crd.projectcalico.org created
customresourcedefinition.apiextensions.k8s.io/ipamconfigs.crd.projectcalico.org created
customresourcedefinition.apiextensions.k8s.io/bgppeers.crd.projectcalico.org created
customresourcedefinition.apiextensions.k8s.io/bgpconfigurations.crd.projectcalico.org created
customresourcedefinition.apiextensions.k8s.io/ippools.crd.projectcalico.org created
customresourcedefinition.apiextensions.k8s.io/hostendpoints.crd.projectcalico.org created
customresourcedefinition.apiextensions.k8s.io/clusterinformations.crd.projectcalico.org created
customresourcedefinition.apiextensions.k8s.io/globalnetworkpolicies.crd.projectcalico.org created
customresourcedefinition.apiextensions.k8s.io/globalnetworksets.crd.projectcalico.org created
customresourcedefinition.apiextensions.k8s.io/networkpolicies.crd.projectcalico.org created
customresourcedefinition.apiextensions.k8s.io/networksets.crd.projectcalico.org created
clusterrole.rbac.authorization.k8s.io/calico-kube-controllers created
clusterrolebinding.rbac.authorization.k8s.io/calico-kube-controllers created
clusterrole.rbac.authorization.k8s.io/calico-node created
clusterrolebinding.rbac.authorization.k8s.io/calico-node created
daemonset.apps/calico-node created
serviceaccount/calico-node created
deployment.apps/calico-kube-controllers created
serviceaccount/calico-kube-controllers created
kubectl apply -f https://docs.projectcalico.org/v3.11/manifests/flannel-migration/migration-job.yaml
configmap/flannel-migration-config created
clusterrole.rbac.authorization.k8s.io/flannel-migration-controller created
clusterrolebinding.rbac.authorization.k8s.io/flannel-migration-controller created
job.batch/flannel-migration created
serviceaccount/flannel-migration-controller created
kubectl get pods -n kube-system
NAME                                       READY   STATUS    RESTARTS   AGE
calico-kube-controllers-648f4868b8-nnw2m   1/1     Running   0          79s
coredns-5644d7b6d9-2jh7z                   1/1     Running   1          3d21h
coredns-5644d7b6d9-c2fcq                   1/1     Running   1          3d21h
etcd-k8master                              1/1     Running   1          3d21h
flannel-migration-cv9pm                    0/1     Error     3          49s
kube-apiserver-k8master                    1/1     Running   1          3d21h
kube-controller-manager-k8master           1/1     Running   1          3d21h
kube-flannel-ds-amd64-98vqx                1/1     Running   2          3d21h
kube-flannel-ds-amd64-rss6z                1/1     Running   1          3d21h
kube-flannel-ds-amd64-wt4k6                1/1     Running   1          3d21h
kube-proxy-2t8mq                           1/1     Running   1          3d21h
kube-proxy-85vks                           1/1     Running   1          3d21h
kube-proxy-8cc7x                           1/1     Running   1          3d21h
kube-scheduler-k8master                    1/1     Running   1          3d21h
[root@k8master src]# kubectl logs -n kube-system flannel-migration-cv9pm
2019-12-31 02:57:58.457 [INFO][1] main.go 88: Loaded configuration from environment config=&config.Config{LogLevel:"info", ReconcilerPeriod:"5m", CompactionPeriod:"10m", EnabledControllers:"flannelmigration", WorkloadEndpointWorkers:1, ProfileWorkers:1, PolicyWorkers:1, NodeWorkers:1, Kubeconfig:"", HealthEnabled:true, SyncNodeLabels:true, DatastoreType:"kubernetes"}
2019-12-31 02:57:58.464 [INFO][1] k8s.go 228: Using Calico IPAM
W1231 02:57:58.464526       1 client_config.go:541] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
2019-12-31 02:57:58.466 [INFO][1] main.go 109: Ensuring Calico datastore is initialized
2019-12-31 02:57:58.481 [INFO][1] main.go 165: Loaded Flannel configuration from environment flannelConfig=&flannelmigration.Config{FlannelNetwork:"", FlannelDaemonsetName:"kube-flannel-ds-amd64", FlannelMTU:0, FlannelIPMasq:true, FlannelSubnetLen:24, FlannelAnnotationPrefix:"flannel.alpha.coreos.com", FlannelVNI:1, FlannelPort:8472, CalicoDaemonsetName:"calico-node", CniConfigDir:"/etc/cni/net.d", PodNodeName:"k8node2", FlannelSubnetEnv:"", DebugWaitBeforeExit:0, DebugWaitBeforeStart:0}
2019-12-31 02:57:58.481 [INFO][1] main.go 183: Starting status report routine
2019-12-31 02:57:58.481 [INFO][1] main.go 368: Starting controller ControllerType="FlannelMigration"
2019-12-31 02:57:58.481 [INFO][1] migration_controller.go 154: Starting Migration controller
2019-12-31 02:57:58.506 [INFO][1] migration_controller.go 258: Trying to read Flannel env config by executing into daemonet pod.
2019-12-31 02:57:58.517 [ERROR][1] k8s_resources.go 496: Kubectl exec kube-flannel-ds-amd64-rss6z(kube-flannel) error.
---[exec kube-flannel-ds-amd64-rss6z --namespace=kube-system -c=kube-flannel cat run/flannel/subnet.env]---

2019-12-31 02:57:58.517 [ERROR][1] migration_controller.go 159: Error checking status, Stopping Migration controller. error=fork/exec /usr/bin/kubectl: no such file or directory
2019-12-31 02:57:58.517 [FATAL][1] migration_controller.go 138: Migration controller stopped.

@song-jiang does the migration depend on kubectl on each of the nodes? or do you know what might be the issue here?

@tmjd The kubectl binary should be built into migration-controller image. https://github.com/projectcalico/kube-controllers/blob/master/docker-images/flannel-migration/Dockerfile.amd64#L32

@ElvisTan Looks like flannel-migration-controller:v3.11.x image is broken. Could you try calico version v3.10.2 instead?

@ElvisTan Looks like flannel-migration-controller:v3.11.x image is broken. Could you try calico version v3.10.2 instead?

@song-jiang I just installed v3.11.1 on a cluster and /bin/kubectl was present. Can you post the steps you ran that showed otherwise? Thanks

I am running into this too, I think the issue is that it's trying to run from /usr/bin/kubectl instead of /bin/kubectl
2020-01-01 23:06:03.994 [ERROR][1] migration_controller.go 159: Error checking status, Stopping Migration controller. error=fork/exec /usr/bin/kubectl: no such file or directory

In order to verify:
$ docker run --rm --entrypoint /usr/bin/kubectl calico/flannel-migration-controller:v3.10.2 version
The connection to the server localhost:8080 was refused - did you specify the right host or port?
Client Version: version.Info{Major:"1", Minor:"15", GitVersion:"v1.15.3", GitCommit:"2d3c76f9091b6bec110a5e63777c332469e0cba2", GitTreeState:"clean", BuildDate:"2019-08-19T11:13:54Z", GoVersion:"go1.12.9", Compiler:"gc", Platform:"linux/amd64"}

$ docker run --rm --entrypoint /usr/bin/kubectl calico/flannel-migration-controller:v3.11.0 version
docker: Error response from daemon: OCI runtime create failed: container_linux.go:346: starting container process caused "exec: \"/usr/bin/kubectl\": stat /usr/bin/kubectl: no such file or directory": unknown.

$ docker run --rm --entrypoint /usr/bin/kubectl calico/flannel-migration-controller:v3.11.1 version
docker: Error response from daemon: OCI runtime create failed: container_linux.go:346: starting container process caused "exec: \"/usr/bin/kubectl\": stat /usr/bin/kubectl: no such file or directory": unknown.

This returns a valid k

Using images flannel-migration-controller:v3.10.2 does not have this problem


Button: don't show text when isLoading is true

Description
So with many component libraries, or at least many design systems, buttons with isLoading is true don't show text, only a spinner. With current implementation of the NativeBase button, there is no neat way of not showing text when isLoading is true. One has to resort to set isLoadingText to a space in order to get it removed. Also one needs to update this text manually with each button instance, or one needs to make a abstract Button component purely to automate this.
Problem Statement
As mentioned above
Proposed Solution or API
A prop on the button component, called showTextWhenLoading or renderChildrenWhenLoading, that may be set to false as a default prop in your theme. This prop prevents the regular children from being rendered and only renders the spinner when isLoading is set to true.
Alternatives
No response
Additional Information
Maybe there is another smart way of doing this, but I couldnt figure it out. My ultimate goal here is not be forced to create a layer / custom component around the regular NativeBase button in order to achieve mentioned result.
I don't really like the proposed prop names because they are too long to my taste, but they do picture the desired behaviour of the button.

Ive created an example PR to demonstrate this feature
https://github.com/GeekyAnts/NativeBase/pull/4626

Hello @JaapWeijland, Thanks for reporting. We'll surely look into this request.

Hello @JaapWeijland, this issue has been fixed in the latest version release.


[TimeSeriesCard] Tooltip is showing date twice (due to a change in carbon-charts)

What package is this for?

[x] React
[ ] Angular

Describe the bug

The second should be removed.  I believe this was already recently fixed for BarChartCard

:tada: This issue has been resolved in version 2.115.3 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Multi-provider support including ProxyCheck, IP-API, IPHub and VPNAPI

Implemented ProxyCheck vpn check in https://github.com/gerolndnr/connection-guard/commit/fa005e00e21cb49cb22df7f7215362e68545ebad and IP-API geo check in https://github.com/gerolndnr/connection-guard/commit/4d113150c15a62f8ec84a7e2819e1423c60715da.

Implemented IP-API vpn check in 88b8568f9d4501da7bd48824c71bab5d9a851d0e.

Implemented IPHub vpn check in 5ce1c811beaa2763f5b1195550181fbc97792be8.

Implemented VPNAPI in 5290644ad9523d414fef86b063e6aed0d9fb616d.


BUILD.gn file is missing several header files

Missing header files could lead to incorrect incremental builds in some cases. I noticed this by running a validation script in the ANGLE integration of SPIRV-Tools:
https://chromium.googlesource.com/angle/angle/+/master/scripts/export_targets.py
Should be an easy fix to add the missing headers.

Thanks!


Game 2: Add more STI's

Complete the list of STI's for that game with other existing STI's. The name and symptoms of the STI's need to be added in the string properties files and the setting up of the game needd to be adapted. The names and symptom descriptions have to be in french eventually, but it is ok to write a dummy description like "Syphillis symptoms" for someone who doesn't speak French. One of the French speakers of the development team can add the real description later.
In my opinion, the STI's that need to be added are:

B Hepatitis (fr: Hépatite B)
A Hepatitis (fr: Hépatite A)
Syphilis
Trichonomas
Mycosis (fr: Mycose) (Not technically an STI, but still sexually transmissible)
Morpion (Not an STI, but still sexually transmissible)
Scabies (fr: Gale) (Not technically an STI, but still sexually transmissible)
For French speakers, this site is a good ressource about STI's and their symptoms: https://depistage.be/

Writing the Sti's names, symptoms and descriptions has been moved into the string.properties file with commit ba806aa8c4d30e5a2e9aecc8c9b9ab99d9f64293
The translation in English of these descriptions has been done in this commit : 005072feb4f8ff18aa774c16b2b37996378b6b8f
Note that certain fake-sti descriptions haven't be added in French (thus not in English neither). A placeholder is provided.
I'm closing this as done for now, we may reopen this ticket if more info need to be provided.


GoogleGenerativeAIError: [400 Bad Request] * BatchEmbedContentsRequest.requests: at most 100 requests can be in one batch

How do I resolve this error when using Google Gemini Pro along with GithubRepoLoader?
GoogleGenerativeAIError: [400 Bad Request] * BatchEmbedContentsRequest.requests: at most 100 requests can be in one batch

@dosu-bot these are the changes I implemented yet I am seeing the error:
const embeddings = new GoogleGenerativeAIEmbeddings({
modelName: "embedding-001", // 768 dimensions
taskType: TaskType.RETRIEVAL_DOCUMENT,
title: "Retrieval Document",
maxBatchSize: 100
});

I have also faced this issue @ajaykrupalk . I used a little hack to bypass this issue.
I created a processBatch function.
`async function processBatch(batch, i) {
console.log("processing " + i);
try {
// connecting to database
const sbApiKey = process.env.SB_API_KEY;
const sbUrl = process.env.SB_URL;
const client = createClient(sbUrl, sbApiKey);
const embeddings = new GoogleGenerativeAIEmbeddings({
modelName: "embedding-001", // 768 dimensions
taskType: TaskType.RETRIEVAL_DOCUMENT,
title: "data",
});
//vector store
const vector = await SupabaseVectorStore.fromDocuments(batch, embeddings, {
client,
tableName: "documents",
});
console.log(vector);
} catch (err) {
console.log(err);
}
}then I processed the array by this functionexport const processArray = async (array) => {
const batchSize = 50;
const delayInMilliseconds = 60 * 1000; // 1 minute in milliseconds
for (let i = 0; i < array.length; i += batchSize) {
const batch = array.slice(i, i + batchSize);
await processBatch(batch, i);

if (i + batchSize < array.length) {
  // Delay for 1 minute before processing the next batch
  await new Promise((resolve) => setTimeout(resolve, delayInMilliseconds));
}

}
};`
This worked for me.

hello @ajaykrupalk, I have also faced this issue. I used a little hack to bypass the issue. I processed the texts in batches. and we hit API every minute for one batch.

The code is designed to process an array of items in batches asynchronously.

processArray divides the input array into smaller batches and processes each batch using processBatch.

processBatch handles the actual processing logic, which includes database operations (connecting, creating clients), generating embeddings, and logging the generated vectors.

There's also a delay between processing batches to throttle the rate of processing.

This approach helps manage resource consumption and prevents overwhelming external services like databases or APIs by limiting the number of simultaneous requests.

async function processBatch(batch, i) {
  console.log("processing " + i);

  try {
    // connecting to the database
    const sbApiKey = process.env.SB_API_KEY;
    const sbUrl = process.env.SB_URL;
    const client = createClient(sbUrl, sbApiKey);
    const embeddings = new GoogleGenerativeAIEmbeddings({
      modelName: "embedding-001", // 768 dimensions
      taskType: TaskType.RETRIEVAL_DOCUMENT,
      title: "data",
    });
    //vector store
    const vector = await SupabaseVectorStore.fromDocuments(batch, embeddings, {
      client,
      tableName: "documents",
    });
    console.log(vector);
  } catch (err) {
    console.log(err);
  }
}

export const processArray = async (array) => {
  const batchSize = 50;
  const delayInMilliseconds = 60 * 1000; // 1 minute in milliseconds
  for (let i = 0; i < array.length; i += batchSize) {
    const batch = array.slice(i, i + batchSize);

    await processBatch(batch, i);

    if (i + batchSize < array.length) {
      // Delay for 1 minute before processing the next batch
      await new Promise((resolve) => setTimeout(resolve, delayInMilliseconds));
    }
  }
};

Hey @RitikSinha thank you, this will be really helpful.

This can be fixed using the following code. The below code is used to send 50 documents at a time to the vector store.
const batchSize = 50;
    const totalDocuments = documents.length;

    for (let i = 0; i < totalDocuments; i += batchSize) {
        const batch = documents.slice(i, i + batchSize);
        await vectorstore.addDocuments(batch);
    }```


HeapSnapshotObject.data is wrong for negative integers when snapshot is taken on web platform.

Steps to repro:
In counter application add two fields to _MyHomePageState:
  int _myAnchor = 555;
  int _myValue = -2;

Update devtools_app/lib/src/screens/memory/shared/primitives/memory_utils.dart of Devtools:
Future<HeapSnapshotGraph?> snapshotMemoryInSelectedIsolate() async {
  final isolate =
      serviceConnection.serviceManager.isolateManager.selectedIsolate.value;
  if (isolate == null) return null;
  final result =
      await serviceConnection.serviceManager.service?.getHeapSnapshotGraph(
    isolate,
  );

  _printValue(result!);

  return result;
}

void _printValue(HeapSnapshotGraph graph) {
  HeapSnapshotClass? theClass;

  for (final HeapSnapshotClass cl in graph.classes ?? []) {
    if (cl.name == '_MyHomePageState') {
      theClass = cl;
      break;
    }
  }

  for (final HeapSnapshotObject obj in graph.objects ?? []) {
    if (obj.classId == theClass?.classId) {
      bool foundAnchor = false;
      for (final int ref in obj.references ?? []) {
        final HeapSnapshotObject refObj = (graph.objects[ref])!;
        if (foundAnchor) {
          print('_myValue = ${refObj.data}');
          break;
        }
        if (refObj.data == 555) foundAnchor = true;
      }
      break;
    }
  }
}

Run counter on mac, connect to it from DevTools, take snapshot and notice debug output.
If DevTools is run on mac: _myValue = -2
If DevTools is run on web: _myValue =<PHONE_NUMBER>
The issue is coused by different size of integers in javascript.

Suggestion for short term: if parsing happens on web, integers should be parsed only for values that are known to be positive.

@rmacnak-google @bkonyi @a-siva

@rmacnak-google, observatory code worked on web too. Did it have the same issue?

It seems the problem will disappear when we switch to WASM.

dart2js doesn't respect Dart number semantics. Probably the SLEB128 decode in pkg:vm_service needs to written in a way that accounts for the implicit 32-bit conversion in JS bitwise operations.

Note that Dart number semantics are to use JS number semantics on the JS-based targets (ddc and dart2js) :smile:. If it helps, details are documented here https://dart.dev/guides/language/numbers


Revert "Make the context current before accessing GL in MakeSkiaGpuImage"

This reverts https://github.com/flutter/engine/pull/40208, which causes PictureRasterizationException (and screen flickering) on emulators when calling Naviagator.push.
══╡ EXCEPTION CAUGHT BY RENDERING LIBRARY ╞═════════════════════════════════════════════════════════
The following PictureRasterizationException was thrown during paint():
Failed to rasterize a picture: unable to create texture render target at specified size 720x1280.
The callstack when the image was created was:
#0      new Image._.<anonymous closure> (dart:ui/painting.dart:1711:32)
#1      new Image._ (dart:ui/painting.dart:1713:6)
#2      Scene.toImageSync (dart:ui/compositing.dart:34:18)
#3      OffsetLayer.toImageSync (package:flutter/src/rendering/layer.dart:1487:20)
#4      _RenderSnapshotWidget._paintAndDetachToImage
(package:flutter/src/widgets/snapshot_widget.dart:315:40)
#5      _RenderSnapshotWidget.paint (package:flutter/src/widgets/snapshot_widget.dart:345:22)
#6      RenderObject._paintWithContext (package:flutter/src/rendering/object.dart:3059:7)
#7      PaintingContext.paintChild (package:flutter/src/rendering/object.dart:253:13)
#8      RenderProxyBoxMixin.paint (package:flutter/src/rendering/proxy_box.dart:146:15)
#9      _ZoomEnterTransitionPainter.paint
(package:flutter/src/material/page_transitions_theme.dart:923:23)
#10     _RenderSnapshotWidget.paint (package:flutter/src/widgets/snapshot_widget.dart:335:15)
#11     RenderObject._paintWithContext (package:flutter/src/rendering/object.dart:3059:7)
#12     PaintingContext.paintChild (package:flutter/src/rendering/object.dart:253:13)
#13     RenderProxyBoxMixin.paint (package:flutter/src/rendering/proxy_box.dart:146:15)
#14     _ZoomExitTransitionPainter.paint
(package:flutter/src/material/page_transitions_theme.dart:995:23)
#15     _RenderSnapshotWidget.paint (package:flutter/src/widgets/snapshot_widget.dart:335:15)
#16     RenderObject._paintWithContext (package:flutter/src/rendering/object.dart:3059:7)
#17     PaintingContext.paintChild (package:flutter/src/rendering/object.dart:253:13)
#18     RenderProxyBoxMixin.paint (package:flutter/src/rendering/proxy_box.dart:146:15)
#19     _ZoomEnterTransitionPainter.paint
(package:flutter/src/material/page_transitions_theme.dart:923:23)
#20     _RenderSnapshotWidget.paint (package:flutter/src/widgets/snapshot_widget.dart:335:15)
#21     RenderObject._paintWithContext (package:flutter/src/rendering/object.dart:3059:7)
#22     PaintingContext.paintChild (package:flutter/src/rendering/object.dart:253:13)
#23     RenderProxyBoxMixin.paint (package:flutter/src/rendering/proxy_box.dart:146:15)
#24     RenderObject._paintWithContext (package:flutter/src/rendering/object.dart:3059:7)
#25     PaintingContext._repaintCompositedChild (package:flutter/src/rendering/object.dart:169:11)
#26     PaintingContext.repaintCompositedChild (package:flutter/src/rendering/object.dart:112:5)
#27     PipelineOwner.flushPaint (package:flutter/src/rendering/object.dart:1147:31)
#28     RendererBinding.drawFrame (package:flutter/src/rendering/binding.dart:494:19)
#29     WidgetsBinding.drawFrame (package:flutter/src/widgets/binding.dart:905:13)
#30     RendererBinding._handlePersistentFrameCallback
(package:flutter/src/rendering/binding.dart:358:5)
#31     SchedulerBinding._invokeFrameCallback (package:flutter/src/scheduler/binding.dart:1284:15)
#32     SchedulerBinding.handleDrawFrame (package:flutter/src/scheduler/binding.dart:1214:9)
#33     SchedulerBinding._handleDrawFrame (package:flutter/src/scheduler/binding.dart:1072:5)
#34     _invoke (dart:ui/hooks.dart:142:13)
#35     PlatformDispatcher._drawFrame (dart:ui/platform_dispatcher.dart:359:5)
#36     _drawFrame (dart:ui/hooks.dart:112:31)

The relevant error-causing widget was:
  MaterialApp
  MaterialApp:file:///home/swift/Git/plugins/packages/video_player/example/lib/main.dart:14:5

When the exception was thrown, this was the stack:
#0      Canvas.drawImageRect (dart:ui/painting.dart:5414:7)
#1      _drawImageScaledAndCentered (package:flutter/src/material/page_transitions_theme.dart:819:18)
#2      _ZoomExitTransitionPainter.paintSnapshot (package:flutter/src/material/page_transitions_theme.dart:987:5)
#3      _RenderSnapshotWidget.paint (package:flutter/src/widgets/snapshot_widget.dart:351:15)
#4      RenderObject._paintWithContext (package:flutter/src/rendering/object.dart:3059:7)
#5      PaintingContext.paintChild (package:flutter/src/rendering/object.dart:253:13)
#6      RenderProxyBoxMixin.paint (package:flutter/src/rendering/proxy_box.dart:146:15)
#7      _ZoomEnterTransitionPainter.paint (package:flutter/src/material/page_transitions_theme.dart:923:23)
#8      _RenderSnapshotWidget.paint (package:flutter/src/widgets/snapshot_widget.dart:335:15)
#9      RenderObject._paintWithContext (package:flutter/src/rendering/object.dart:3059:7)
#10     PaintingContext.paintChild (package:flutter/src/rendering/object.dart:253:13)
#11     RenderProxyBoxMixin.paint (package:flutter/src/rendering/proxy_box.dart:146:15)
#12     _ZoomExitTransitionPainter.paint (package:flutter/src/material/page_transitions_theme.dart:995:23)
#13     _RenderSnapshotWidget.paint (package:flutter/src/widgets/snapshot_widget.dart:335:15)
#14     RenderObject._paintWithContext (package:flutter/src/rendering/object.dart:3059:7)
#15     PaintingContext.paintChild (package:flutter/src/rendering/object.dart:253:13)
#16     RenderProxyBoxMixin.paint (package:flutter/src/rendering/proxy_box.dart:146:15)
#17     _ZoomEnterTransitionPainter.paint (package:flutter/src/material/page_transitions_theme.dart:923:23)
#18     _RenderSnapshotWidget.paint (package:flutter/src/widgets/snapshot_widget.dart:335:15)
#19     RenderObject._paintWithContext (package:flutter/src/rendering/object.dart:3059:7)
#20     PaintingContext.paintChild (package:flutter/src/rendering/object.dart:253:13)
#21     RenderProxyBoxMixin.paint (package:flutter/src/rendering/proxy_box.dart:146:15)
#22     RenderObject._paintWithContext (package:flutter/src/rendering/object.dart:3059:7)
#23     PaintingContext._repaintCompositedChild (package:flutter/src/rendering/object.dart:169:11)
#24     PaintingContext.repaintCompositedChild (package:flutter/src/rendering/object.dart:112:5)
#25     PipelineOwner.flushPaint (package:flutter/src/rendering/object.dart:1147:31)
#26     RendererBinding.drawFrame (package:flutter/src/rendering/binding.dart:494:19)
#27     WidgetsBinding.drawFrame (package:flutter/src/widgets/binding.dart:905:13)
#28     RendererBinding._handlePersistentFrameCallback (package:flutter/src/rendering/binding.dart:358:5)
#29     SchedulerBinding._invokeFrameCallback (package:flutter/src/scheduler/binding.dart:1284:15)
#30     SchedulerBinding.handleDrawFrame (package:flutter/src/scheduler/binding.dart:1214:9)
#31     SchedulerBinding._handleDrawFrame (package:flutter/src/scheduler/binding.dart:1072:5)
#32     _invoke (dart:ui/hooks.dart:142:13)
#33     PlatformDispatcher._drawFrame (dart:ui/platform_dispatcher.dart:359:5)
#34     _drawFrame (dart:ui/hooks.dart:112:31)

The following RenderObject was being processed when the exception was fired: _RenderSnapshotWidget#4aaf5:
  needs compositing
  creator: SnapshotWidget ← _ZoomExitTransition ← SnapshotWidget ← _ZoomEnterTransition ←
    DualTransitionBuilder ← SnapshotWidget ← _ZoomExitTransition ← SnapshotWidget ←
    _ZoomEnterTransition ← DualTransitionBuilder ← _ZoomPageTransition ← AnimatedBuilder ← ⋯
  parentData: <none> (can use size)
  constraints: BoxConstraints(w=315.9, h=561.7)
  size: Size(315.9, 561.7)
This RenderObject had the following descendants (showing up to depth 5):
    child: RenderIgnorePointer#a4dea
      child: RenderRepaintBoundary#a60a9
        child: RenderSemanticsAnnotations#8bb72
          child: RenderPhysicalModel#451e6
            child: _RenderInkFeatures#837b3
════════════════════════════════════════════════════════════════════════════════════════════════════

Easily reproducible with the sqflite_tizen and video_player_tizen examples on Flutter 3.10.
@flutter-tizen/maintainers Could someone take a closer look at this issue? Right now I don't fully understand what the purpose of the original commit is.

@xuelian-bai Could this be a GPU issue? As far as I can see from the Skia source code, none of the multisampling extensions in this function are supported by the emulator and thus fMSFBOType ends up with the default value (kNone_MSFBOType). Also this condition is not satisfied, so no MSAA flags are added to RGBA8's fFlags. As a consequence,

This check fails and thus fFormatTable[i].fColorSampleCounts is never increased.
GrGLCaps::maxRenderTargetSampleCount returns 0 because the table is empty.
GrGLCaps::isFormatRenderable always returns false. (sampleCount is 1.)
GrCaps::getDefaultBackendFormat returns an empty value.
GrDirectContext::createBackendTexture fails because the format is invalid.
Rasterizer::MakeSkiaGpuImage fails and finally the Dart exception is thrown.

This is a blocker for https://github.com/flutter-tizen/flutter-tizen/pull/497. Should we proceed by simply reverting the change for now?

for now, I think you can just revert the change


Flip CH Countrywide Coords

Closes: https://github.com/openaddresses/batch/issues/90
Closes: https://github.com/openaddresses/openaddresses/issues/5465


Wrong parameters how to debug ?

Hi,
trying to access the tool for future pentests after the nice podcast but so far no success (yet)
FYi : The host <IP_ADDRESS> has no AV
$masky  -d timatec -u fbu -p 'xxx' -dc-ip <IP_ADDRESS> -ca "DC01.timatec.local\timatec-DC01-CA" <IP_ADDRESS> -v
...
[] Loading options...
[] 1 target(s) loaded
[o] Initialization of the threadpool (size: 1)
[o] (<IP_ADDRESS>) Start of target processing
[o] (<IP_ADDRESS>) The Masky agent binary will be uploaded in: \Windows\Temp\wydxnkqo.exe
[o] (<IP_ADDRESS>) The Masky agent output will be stored in: \Windows\Temp\kwkcqilt.jpg
[o] (<IP_ADDRESS>) The Masky agent errors will be stored in: \Windows\Temp\rxqgmhcr.png
[+] (<IP_ADDRESS>) Current user seems to be local administrator, attempting to run Masky agent...
[o] (<IP_ADDRESS>) Masky agent was successfuly uploaded in: '\Windows\Temp\wydxnkqo.exe'
[o] (<IP_ADDRESS>) The service 'ocrooivu' was successfuly created
[o] (<IP_ADDRESS>) The 'ocrooivu' was restarted for command execution
[×] (<IP_ADDRESS>) The provided CA server seems to be invalid or unreachable, please check its value
[o] (<IP_ADDRESS>) The 'ocrooivu' service binary path has been removed
[] (<IP_ADDRESS>) No user session was hijacked
[o] (<IP_ADDRESS>) End of target processing
[] Exiting...
I've used : -ca "DC01.timatec.local\timatec-DC01-CA"
From Certipy:
more<PHONE_NUMBER>2059_Certipy.txt
Certificate Authorities
0
CA Name                             : timatec-DC01-CA
DNS Name                            : DC01.timatec.local

Hi,
Thanks a lot for your feedback !
The targeted host (<IP_ADDRESS>) seems to not be able to interact with the RPC services exposed by the ADCS hosted on your DC (<IP_ADDRESS> / DC01.timatec.local).
Could you please check if the targeted host is able to resolve the domain DC01.timatec.local and that no network restrictions are in place between both systems ?
If it works, it could be interesting to test running Certipy agent on the targeted host to ensure that it is possible to request a user certificate. You can do it with the following command: .\Certify.exe request /ca:'DC01.timatec.local\timatec-DC01-CA' /template:User.
Otherwise, you can run manually the Masky agent on the targeted host as following: .\Masky.exe /ca:'DC01.timatec.local\timatec-DC01-CA' /template:User and check for more precise debugging information within the newly created file Masky_debug.txt.
Hope this will help ! :)

I best recommend you contact Agent_huncho on Instagram he can get the bug issues resolved because when I had similar issues for some days back, all thanks to him for helping
@Agent_huncho on instagram

Mhmm basically with Certify, I'm unable to request a cert and with Masky agent I get this debug output.
it seems there is an issue with RPC, but I know that i can access the PKI with Certipy from my Kali machine.
System.Runtime.InteropServices.COMException (0x800706BA): CCertRequest::Submit: The RPC server is unavailable. 0x800706ba (WIN32: 1722 RPC_S_SERVER_UNAVAILABLE)
at CERTCLILib.ICertRequest3.Submit(Int32 Flags, String strRequest, String strAttributes, String strConfig)
at Masky.Cert.SendCertificateRequest(String CA, String message)
at Masky.Cert.GetCertUser()
at Masky.Impersonate.ExecuteActionWithToken(Action action, IntPtr& NewhProcToken, IntPtr& currentProcHH, Boolean revert)
System.Runtime.InteropServices.COMException (0x800706BA): CCertRequest::Submit: The RPC server is unavailable. 0x800706ba (WIN32: 1722 RPC_S_SERVER_UNAVAILABLE)
at CERTCLILib.ICertRequest3.Submit(Int32 Flags, String strRequest, String strAttributes, String strConfig)
at Masky.Cert.SendCertificateRequest(String CA, String message)
at Masky.Cert.GetCertUser()
at Masky.Impersonate.ExecuteActionWithToken(Action action, IntPtr& NewhProcToken, IntPtr& currentProcHH, Boolean revert)
System.Runtime.InteropServices.COMException (0x800706BA): CCertRequest::Submit: The RPC server is unavailable. 0x800706ba (WIN32: 1722 RPC_S_SERVER_UNAVAILABLE)
at CERTCLILib.ICertRequest3.Submit(Int32 Flags, String strRequest, String strAttributes, String strConfig)
at Masky.Cert.SendCertificateRequest(String CA, String message)
at Masky.Cert.GetCertUser()
at Masky.Impersonate.ExecuteActionWithToken(Action action, IntPtr& NewhProcToken, IntPtr& currentProcHH, Boolean revert)

I made few checks with Wireshark to reproduce the issue on my lab. I confirm that this error might be due to a network restriction from your targeted host to the ADCS RPC services.
From your initial example, the server <IP_ADDRESS> is not able to communicate via the DCERPC protocol through the TCP port 135 that your ADCS DC01.timatec.local exposed.
Certify and Masky tools requests a certificate from the host <IP_ADDRESS>. I think it works on your kali box via certipy because this tool directly query a certificate without going through the <IP_ADDRESS> server.
So I guess that the kali system is able to query the tcp/135 port of your ADCS where the system <IP_ADDRESS> cannot. Note that relying on MSRPC include the remote TCP/135 port as well as an ephemeral port (ex. 49761, etc.).
But still, this is an issue that could arise in some company networks. I will think to implement a fallback feature to proxify the certificate request to the attacker computer :)

mhmm I did packet capture and all, disable EDR, checked no RPC firewall neither Windows Firewall.
between <IP_ADDRESS> and <IP_ADDRESS> (ADCS) there is no FW.
TCP 135 is open as you can see from PrintScreen.

I just had this same issue but it was my fault. I specified the /ca parameter using /ca:'host.domain.com\rootca' with quotes. Once I removed the quotes it worked. Please specify the redacted command line options that you used @k4nfr3 .

Hi,
unfortunatly the issue is not there.
The Certify command or the Masky.exe command with ' or no ' doesn't change the output.
I will stay a mistery for the time being. :-|


No APEX Issue

If I don't have CUDA support, this code wouldn't work right, since you guys are using NVIDIA's apex which requires CUDA? Just wondering if there's an alternative?

You don't need apex to use the codebase, it's only if you want to do fp16 training.
The code base also run on CPU but I'm not sure you can do the training, it would be very slow.
If you only want to do inference (interact.py script) it should work.
The interact.py script works fine on my laptop on CPU.

Yeah I suppose I won't be able to run the code due to infeasible training time, but when I run train.py, I get AttributeError: 'NoneType' object has no attribute 'split', for the line return tuple(int(x) for x in torch.version.cuda.split('.')) and I'm guessing because there is no cuda on my laptop. I think the problem is that you guys use apex in the pytorch_pretraining_bert to implement OpenAIGPTDoubleHeadsModel and some other stuff that are imported in the module.

In which file is this line? (return tuple(int(x) for x in torch.version.cuda.split('.')))
I can't find it in our code base.
By the way if you have installed apex and don't have a GPU, you should uninstall it. It doesn't like having no GPUs.

It's not in your code, it's in apex's code which you guys import in modeling.py, which is imported in pytorch_pretrained_bert.py, which is imported in train.py.
Thanks for the advice I'll uninstall it.

It's not in your code, it's in apex's code which you guys import in modeling.py, which is imported in pytorch_pretrained_bert.py, which is imported in train.py.
Thanks for the advice I'll uninstall it.
edit:
Here is the full traceback if it's helpful:

Traceback (most recent call last):
File "", line 1, in
File "/Applications/PyCharm.app/Contents/helpers/pydev/_pydev_bundle/pydev_umd.py", line 197, in runfile
pydev_imports.execfile(filename, global_vars, local_vars)  # execute the script
File "/Applications/PyCharm.app/Contents/helpers/pydev/_pydev_imps/_pydev_execfile.py", line 18, in execfile
exec(compile(contents+"\n", file, 'exec'), glob, loc)
File "/Users/tnguyen/Desktop/recourse-nlp/transfer-learning-conv-ai/train.py", line 19, in
from pytorch_pretrained_bert import (OpenAIAdam, OpenAIGPTDoubleHeadsModel, OpenAIGPTTokenizer,
File "/Applications/PyCharm.app/Contents/helpers/pydev/_pydev_bundle/pydev_import_hook.py", line 21, in do_import
module = self._system_import(name, *args, **kwargs)
File "/usr/local/Cellar/python/3.7.3/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/pytorch_pretrained_bert/init.py", line 7, in
from .modeling import (BertConfig, BertModel, BertForPreTraining,
File "/Applications/PyCharm.app/Contents/helpers/pydev/_pydev_bundle/pydev_import_hook.py", line 21, in do_import
module = self._system_import(name, *args, **kwargs)
File "/usr/local/Cellar/python/3.7.3/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/pytorch_pretrained_bert/modeling.py", line 228, in
from apex.normalization.fused_layer_norm import FusedLayerNorm as BertLayerNorm
File "/Applications/PyCharm.app/Contents/helpers/pydev/_pydev_bundle/pydev_import_hook.py", line 21, in do_import
module = self._system_import(name, *args, **kwargs)
File "", line 983, in _find_and_load
File "", line 967, in _find_and_load_unlocked
File "", line 668, in _load_unlocked
File "", line 638, in _load_backward_compatible
File "/usr/local/Cellar/python/3.7.3/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/apex-0.1-py3.7.egg/apex/init.py", line 2, in
from . import amp
File "/Applications/PyCharm.app/Contents/helpers/pydev/_pydev_bundle/pydev_import_hook.py", line 21, in do_import
module = self._system_import(name, *args, **kwargs)
File "", line 983, in _find_and_load
File "", line 967, in _find_and_load_unlocked
File "", line 668, in _load_unlocked
File "", line 638, in _load_backward_compatible
File "/usr/local/Cellar/python/3.7.3/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/apex-0.1-py3.7.egg/apex/amp/init.py", line 1, in
from .amp import init, half_function, float_function, promote_function,
File "/Applications/PyCharm.app/Contents/helpers/pydev/_pydev_bundle/pydev_import_hook.py", line 21, in do_import
module = self._system_import(name, *args, **kwargs)
File "", line 983, in _find_and_load
File "", line 967, in _find_and_load_unlocked
File "", line 668, in _load_unlocked
File "", line 638, in _load_backward_compatible
File "/usr/local/Cellar/python/3.7.3/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/apex-0.1-py3.7.egg/apex/amp/amp.py", line 3, in
from .lists import functional_overrides, torch_overrides, tensor_overrides
File "/Applications/PyCharm.app/Contents/helpers/pydev/_pydev_bundle/pydev_import_hook.py", line 21, in do_import
module = self._system_import(name, *args, **kwargs)
File "", line 983, in _find_and_load
File "", line 967, in _find_and_load_unlocked
File "", line 668, in _load_unlocked
File "", line 638, in _load_backward_compatible
File "/usr/local/Cellar/python/3.7.3/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/apex-0.1-py3.7.egg/apex/amp/lists/torch_overrides.py", line 69, in
if utils.get_cuda_version() >= (9, 1, 0):
File "/usr/local/Cellar/python/3.7.3/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/apex-0.1-py3.7.egg/apex/amp/utils.py", line 9, in get_cuda_version
return tuple(int(x) for x in torch.version.cuda.split('.'))
AttributeError: 'NoneType' object has no attribute 'split'

I'm getting a the same error. The last two lines indicate that torch.version.cuda is returning None

@DannyDannyDanny
If no GPU is detected on the system, you won't be able to use apex.
We should improve the error message on importing apex and raise an Exception, if some apex methods are used.
A workaround would be to guard the apex import with if torch.cuda.is_available().
Your suggestion won't work, since
torch.version.cuda returns the CUDA version (e.g. 10.0.130), while torch.__version__ returns the PyTorch version (e.g. 1.3.0.dev20190923).

Is there any older version that works without a GPU?

If you are using 3090, cuda11.0 seems not ok for apex.
I do the following and successfully installed apex 0.1
 pip install torch==1.8.1+cu111 torchvision==0.9.1+cu111 torchaudio==0.8.1 -f https://download.pytorch.org/whl/torch_stable.html

cd apex

 pip install -v --no-cache-dir --global-option="--cpp_ext" --global-option="--cuda_ext" ./


Create starbreach.catpkg.yml

let me know if this is what you are after

First of all, thank you for patience - I'll need more of that, however, as we progress through some changes required in your repository (and maybe on our side as well).

Please save all files as unzipped .cat/.gst files.
Please accept the PR the bot will create. This will result in GH Actions adding necessary assets to releases you make.

/template-workflows-pr andreanespeca/StarBreach

/template-workflows-pr andreanespeca/StarBreach

All done let me know if i need to do anything else
Thanks

@andreanespeca it'd be nice if you had added a readme - but it's not necessary.
Now, let's see if this works...

Ah, I know - @andreanespeca you'll need to create a new release now as well, so see the repo on our Gallery 👍

All done let's see if it works!


[Issue-9926][Pulsar Functions] Pass through record properties from Pulsar Sources

<!--

### Motivation

Properties added to Records inside a Pulsar Source connector are not currently passed through to the message level properties like they can be for Pulsar Sinks. This PR makes that the default behavior of Pulsar Sources.

### Modifications

Added some logic that sets the `forwardSourceMessageProperty` property equal to true if the component type is a Source.

### Verifying this change

- [ ] Make sure that the change passes the CI checks.

*(Please pick either of the following options)*

This change is a trivial rework / code cleanup without any test coverage.

*(or)*

This change is already covered by existing tests, such as *(please describe tests)*.

*(or)*

This change added tests and can be verified as follows:

*(example:)*
  - *Added integration tests for end-to-end deployment with large payloads (10MB)*
  - *Extended integration test for recovery after broker failure*

### Does this pull request potentially affect one of the following parts:

*If `yes` was chosen, please highlight the changes*

  - Dependencies (does it add or upgrade a dependency): (yes / no)
  - The public API: (yes / no)
  - The schema: (yes / no / don't know)
  - The default values of configurations: (yes / no)
  - The wire protocol: (yes / no)
  - The rest endpoints: (yes / no)
  - The admin cli options: (yes / no)
  - Anything that affects deployment: (yes / no / don't know)

### Documentation

  - Does this pull request introduce a new feature? (yes / no)
  - If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)
  - If a feature is not applicable for documentation, explain why?
  - If a feature is not documented yet in this PR, please create a followup issue for adding the documentation

/pulsarbot run-failure-checks

/pulsarbot run-failure-checks

/pulsarbot run-failure-checks

/pulsarbot run-failure-checks

/pulsarbot run-failure-checks


Addon settings seved using Window.localStorage instead of storage.local

The storage.local API has some advantages over the Window.localStorage:

Overview
This API has been optimized to meet the specific storage needs of extensions. It provides the same storage capabilities as the localStorage API with the following key differences:

User data can be automatically synced with Chrome sync (using storage.sync).
Your extension's content scripts can directly access user data without the need for a background page.
A user's extension settings can be persisted even when using split incognito behavior.
It's asynchronous with bulk read and write operations, and therefore faster than the blocking and serial localStorage API.
User data can be stored as objects (the localStorage API stores data in strings).
Enterprise policies configured by the administrator for the extension can be read (using storage.managed with a schema).

(https://developer.chrome.com/extensions/storage)
For Firefox the localStorage usage causes some issues (lost settings after upgrade):

Although this API is similar to Window.localStorage it is recommended that you don't use Window.localStorage in extension code. Firefox will clear data stored by extensions using the localStorage API in various scenarios where users clear their browsing history and data for privacy reasons, while data saved using the storage.local API will be correctly persisted in these scenarios.
(https://developer.mozilla.org/en-US/Add-ons/WebExtensions/API/storage/local)

Would you be interested  in changing the API used? Or maybe you already have some code ready?
I would be working on changing it for Firefox so the settings are persistent during upgrades.

One important thins is that the storage.local is asynchronous, so the change to this API won't be just a simple rename of the function calls.

Based on the information provided it does seem like the better option in this case, I wasn't sure if I implemented Window.localStorage because it was the only option at the time or I simply wasn't aware of storage.local. In any case, I am interested in switching over, but I don't have any code ready, so the earliest I would be working on this is probably the coming weekend. A key point in my implementation is to ensure the settings of Window.localStorage is migrated over, not sure if you've taken that into consideration.
How would you prefer this done? Do you want me to work on it and you merge it over to your fork, or do you want to work on in separately and send me a pull request? I do not mind it either way.

If you haven't worked on it already, then I'll code it and send a pull request.
But I won't be able to work on the migration from the old settings. The settings are already gone during the upgrade (on Firefox), so I won't be able to test it.
Would it be OK?

@khloke I created pull request #129.
I made quite a lot of changes there related to this issue
Short summary of the changes:

changed all the places where the settings were used (asynchronous approach of the new API required more complicated changes)
implemented code which should migrate all settings from localStorage to browser.storage.
function doing upgrades used 4 digit number of some old version, now versions are 3 digit so I divide the versions > 999 by 10, to be able to compare properly
added some more debugging messages
settings_migration_test.js - file added to test the migration, if you want to test the migration include it in the manifest.json in the background array (it should not be added in the official addon)

If you find something is not working, require additional changes or have questions to the implementation let me know.


[firebase_auth] Confirm password reset

Description
This PR gives the ability to confirm password reset in order to control the entire "forgot password" flow from within an app.
Related Issues
#1739
Checklist
Before you create this PR confirm that it meets all requirements listed below by checking the relevant checkboxes ([x]). This will ensure a smooth and quick review process.

[x] I read the Contributor Guide and followed the process outlined there for submitting PRs.
[x] If the pull request affects only one plugin, the PR title starts with the name of the plugin in brackets (e.g. [cloud_firestore])
[x] My PR includes unit or integration tests for all changed/updated/fixed behaviors (See Contributor Guide).
[x] All existing and new tests are passing.
[x] I updated/added relevant documentation (doc comments with ///).
[x] The analyzer (flutter analyze) does not report any problems on my PR.
[x] I read and followed the Flutter Style Guide.
[x] I updated pubspec.yaml with an appropriate new version according to the pub versioning philosophy.
[x] I updated CHANGELOG.md to add a description of the change.
[x] I signed the CLA.
[x] I am willing to follow-up on review comments in a timely manner.

Breaking Change
Does your PR require plugin users to manually update their apps to accommodate your change?

[ ] Yes, this is a breaking change (please indicate a breaking change in CHANGELOG.md and increment major revision).
[x] No, this is not a breaking change.

@lanmonster I've got an implementation of confirmPasswordReset for firebase_auth_web (which prompted my submission of #1780). There's really not much to it, if you'd like to add it to this PR, otherwise I'm happy to open a separate one:
packages/firebase_auth/firebase_auth_web/lib/firebase_auth_web.dart:
  Future<void> confirmPasswordReset(
    String app,
    String code,
    String newPassword,
  ) {
    final firebase.Auth auth = _getAuth(app);
    return auth.confirmPasswordReset(code, newPassword);
  }

@bgetsug happy to include that in my PR, but I think it will have to wait until #1780 lands.

confirmPasswordReset in https://github.com/FirebaseExtended/flutterfire/pull/1780 has landed, can you please update this PR to use it?

@collinjackson I updated the PR


Support for permissions to edit the hosts file

If you try:
      def main():
	      print("Do stuff here that requires being run as an admin.")
	     (Path(Path().home().root) / "Windows" / "System32" / "drivers" / "etc").read_text()
	      # The window will disappear as soon as the program exits!
	if not pyuac.isUserAdmin():
		print("Re-launching as admin!")
		pyuac.runAsAdmin()
		main()
	else:
		main()  # Already an admin here.

It will drop a permission denied error.
In my case I need to programatically change the hosts file in order for some connections to work properly.

Err, yeah nvm xDD Should add the hosts file to the end of this path so it can work lol


[Translation Task] setup / backend

Files: setup/backend

I'd like to do it.

I'd like to do it.

Thanks, task is taken by @KAMIJYOUDOUMA

HI @KAMIJYOUDOUMA , what's the status of this task? You can create a pull request (even it includes only part of your works) and get reviewed by others 😄

HI @KAMIJYOUDOUMA , what's the status of this task? You can create a pull request (even it includes only part of your works) and get reviewed by others 😄

I created a pull request,but only part of my works.I will complete it today.


Fix Eureka Moment buff overwriting by Solid / Ageless

For high GP collectible rotation where Solid / Ageless can be used multiple times, the current code prioritizes use Solid / Ageless despite having Eureka Moment buff active, causing wasted Wise actions. The code changes to ShouldUseSolidAge function now checks that Eureka Moment buff is inactive before using Solid / Ageless.

I thought !(Dalamud.ClientState.LocalPlayer.StatusList.Any(s => s.StatusId == 2765)) is more verbose than Dalamud.ClientState.LocalPlayer.StatusList.All(s => s.StatusId != 2765), therefore I picked the latter. There shouldn't be performance difference since both All and Any has short-circuiting. Also tested that the parenthesis is required !(...) otherwise the Not operator won't work correctly. Regardless, I've made the changes and will submit again shortly.

I think it's mostly personal preference for Any vs All in this situation. I try to avoid using All when looking for a specific item in a list because I've seen it act unpredictably in other projects in such scenarios.
The contribution is much appreciated, ofc!


PTVSD not listening to port

Sorry if it's a stupid question, I'm new to programming and it's my first time using PTVS.
I've have a Django project running in a local container (Docker) and I'm trying to attach VS debugger to it.
So I:

Firstly added ptvsd.enable_attach("secret", address = ('<IP_ADDRESS>', 3000)) into setting file.
Secondly exposed and binded the container's port.
Thirdly ran the application.

So far so good, app is running and I can access it over the port 8000 (via browser)
But, since I'm getting an error while trying to attach VS2015 debugger to the process.I decided to check if there was any process actually listening to that port. So I ran lsof -i :3000 in the running container and got no return from it (lsof -i :8000 returned python  185 root    6u  IPv4  42821      0t0  TCP *:8000 (LISTEN))
Any guesses?

What error are you getting from the attach dialog?
I tried the using the same enable_attach values as you (my_secret instead of secret, which souldn't make any difference), for the guess a number example we have here:
https://github.com/Microsoft/PTVS/wiki/Cross-Platform-Remote-Debugging
I'm not using docker container, it's just all on the same Windows machine.  I'm also using the latest build of PTVS from master. It's possible you are running into a bug specific to your setup.
Anyway, in our example, if I enter tcp://my_secret@<IP_ADDRESS>:3000 in the connection target, then I get "could not connect, operation not supported."
If I enter tcp://my_secret@localhost:3000, then it connects fine.

Thanks @huguesv. Problem solved!
I was making a wrong logic while checking if Django was already listening to the port.
Solution here


IllegalStateException - Failed to introspect Class when trying to build project

When trying to build a project using mvn clean install which uses Axon 3.3.2 I am getting the following error:
java.lang.IllegalStateException: Failed to load ApplicationContext
Caused by: java.lang.IllegalStateException: Error processing condition on org.axonframework.boot.autoconfig.AxonAutoConfiguration.eventSerializer
Caused by: java.lang.IllegalStateException: Failed to introspect Class [org.axonframework.boot.autoconfig.AxonAutoConfiguration] from ClassLoader [sun.misc.Launcher$AppClassLoader@18b4aac2]
Caused by: java.lang.NoClassDefFoundError: org/axonframework/config/EventProcessingConfiguration
Caused by: java.lang.ClassNotFoundException: org.axonframework.config.EventProcessingConfiguration

@FranM28, do you by any chance have spring-boot-devtools as a dependency in your project?
This is known to cause class loader issues, which we are working on to figure it out. In the mean time I'd recommend against using spring-boot-devtools.

There is  no reference to spring-boot-devtools directly but we are using the following:

axon-spring-boot-starter
spring-boot-starter-data-jpa
spring-boot-starter-web
spring-boot-starter-json
spring-boot-starter-actuator
spring-boot-starter-logging
spring-boot-starter-data-mongodb
spring-boot-starter-test

So I'm not sure if it's included with any of the above packages?

Do you perhaps have different versions of Axon on the classpath? It looks like there still might be an older jar lingering around which doesn’t contain the EventProcessingConfiguration.

It does seem this was the case, the problem has now been resolved.  Thank you for your help :)

It does seem this was the case, the problem has now been resolved. Thank you for your help :)
what was the fix?


Added Rookis_bg.lua

I added a plugin where the user can change the background to a url image (png or jpg)

i found a bug rn please not merge i will try to fix it

I'd try to find a way to merge this as part of the existing background customizer by adding a "Background type" option. Otherwise I'm in the process of conceptualizing a system like you suggested in #5. If anything that system would be released with MPR v1.0.

Ok you could do it and cancel this then but i would like to have an idea what is my problem in my code it functions normally if you dont restart gmod after a restart it wont load my code correctly it wont call load() of my script but i used directly the code of the gradient_bg.lua code and i dont think its a bug its rather just me i tried to debug it with print(....) everywhere and it wont call the function at all but after reenabling it works

Added to Plugin repo: https://github.com/djsime1/redux-plugins/blob/main/Pdzly/rookis_bg.lua
Open a PR there if you wish to update it further.


:bug: fix: anthropic provider in interpreter.ts

Fix Anthropic Provider Detection in Firefox
Problem
The clipper was failing to properly detect Anthropic-based models in Firefox due to strict provider ID matching.
Solution
Modified the provider detection logic to check for 'anthropic' in the provider name (case-insensitive) instead of exact ID matching. This makes the detection more robust across different environments.
Changes:

Replace provider.id === 'anthropic' with provider.name.toLowerCase().includes('anthropic')
This change affects both provider detection conditions in the code

Testing
Verified working in Firefox 133.0 (aarch64) with Anthropic models:

Thanks!


Build independent extension (without submodules) and only require vscode-xml

[x] Move IDISS code to semantic-crosswalk-editor, completely

[x] Core components & functions
[x] Sort out contribution points (activations, configs, commands, menus, views, etc.)
[x] Pick only required dependencies from our vscode-xml fork
[x] Update build, launch & package scripts

[x] Remove vscode-xml & lemminx submodule
[ ] Add vscode-xml as required extension
[ ] Verify if we still depend on a custom vscode-xml fork

[x] Check propagation of settings from semantic-crosswalk-editor to vscode-xml
[ ] Check if we have to pin a specific version

Hoped they would bring version management in for extensionDependencies but sadly the issue went out of scope a few days ago ... https://github.com/microsoft/vscode/issues/82655
Anyway @svanteschubert I think it should be safe to just stick to the latest vscode-xml for now. I'll keep watching if they should introduce any breaking changes during the next phase. Later on, we can still try to publish a forked IDISS version of vscode-xml at the VSCode marketplace if we have to pin a specific version (or if we should require other changes there or at lemminx side again).
Meanwhile we can save some time by just keeping an eye on the upstream changes from the master forks.


Wrong icon for 'license.js'

Hey
when naming a file license.js, the license-icon is used. When using license.spec.js, the correct icon is displayed. Is this behavior expected? In my case, the js-icon would have been the correct one.

Some additional information:
vscode: 1.8.0
vscode-icons: 4.2.0

@robertohuertasm filename overrides languageId

@JimiC I was aware of that but didn't expect this greedy behavior. This seems like a bug in VSCode to me. Filename classes should only be added to files with the exact match. cc @aeschli, maybe you can give us a hand here. Is this the expected behavior?

@robertohuertasm I know you knew. Just wanted to point out the cause.

It seems that only happens with filenames that have no extension. Of course, we haven't had this issue before because we were mainly using file extensions.
I'm going to raise an issue in vscode's repo about this.

I've also submitted a PR #17865

It seems that the PR has been merged! :+1:

What does this mean for us? Do we have to fix anything or do we need to wait for the next update?

What does this mean for us? Do we have to fix anything or do we need to wait for the next update?

The next vscode will be in a few days (January release). We could wait a bit or close it. If somebody opens another issue we could point him/her to the right direction.

The next vscode will be in a few days (January release). We could wait a bit or close it. If somebody opens another issue we could point him/her to the right direction.

I didn't close it just to wait for the new functionality to be deployed and test it again just in case.

I didn't close it just to wait for the new functionality to be deployed and test it again just in case.

I've checked this in the Insiders version and it works so I'm closing this.

Confirming.


Updating travis provisioner

Travis will now be more resilient to composer self-update failures

Ping me when tests pass.

ping @tractorcow


mesa doesn't seem to be installing libva_mesa_drv (aka, hardware-accel'd video decode on radeonsi isn't enabled)

Describe the bug
As far as I can tell, we don't have things setup for AMD APU users to have accelerated video playback. Let's fix that!
I don't see any evidence of mesa's libva driver being installed on my Radeon/RyzenAPU system.
I'm not sure exactly what's required, I'm wondering if just providing libva will get mesa's configure to pick it up, I don't see an explicit libva-related config option in the AUR package. (But also, maybe we're just missing an explicit copy out of the build dir.)
ref: https://github.com/archlinux/svntogit-packages/blob/627b5b2cffa9113ac00870ab26837a2d0fe8376f/trunk/PKGBUILD#L149

Looks like it's just a matter of adding pkgs.mesa.drivers to hardware.opengl.extraPackages.
I'll update the wiki.

Never mind, looks like it's there by default, I missed it and Firefox-Nightly can't load it. I'll open a different issue.


Travis CI: Python syntax errors or undefined names

Use flake8 to stop the build if there are Python syntax errors or undefined names.
xrange() was removed from Python 3 in favor of range().

Thanks! The failing module and test use Apache Beam which is unfortunately still py2-only, but I can update it to use six anyways.

That's great! I'm looking forward to being able to use it in py3.


fix(contracts-rfq): FastBridge V2 prove race condition

Description
This PR adds the concept of "dispute penalty time":

Whenever a bridge request is getting disputed, the prover that submitted the proof for it loses their prover privileges for a predetermined disputePenaltyTime.

This happens automatically does not require any additional actions from the Guard.
The edge case where the prover has already been removed by the time of dispute is handled gracefully.

The dispute penalty time can be updated by the contract's governor.
Additionally, the prover that provided the proof for a bridge transaction is now exposed as part of BridgeTxDetails
Same as before, the contract's role admin is able to add and remove provers by using new exposed methods instead of grantRole().

Summary by CodeRabbit
Release Notes

New Features

Enhanced prover management with new functions to add and remove provers.
Introduced new events for tracking prover activities.
Added functionality for setting and querying prover timeouts.

Bug Fixes

Improved error handling for prover management scenarios.

Documentation

Updated interfaces to reflect new functions and events related to prover management.

Tests

Expanded test coverage for prover management functionalities and timeout scenarios.

@parodime sounds good, I updated the labeling and the PR description as well


fix(vault): sticky configuration

Summary
Fix a sticky vault configuration bug.
KAG-954

Here is a draft of a generic fix:
https://github.com/Kong/kong/pull/10785


feat(tutorial): complete step 2

Closes #
{{short description}}
Changelog
New

{{new thing}}

Changed

{{change thing}}

Removed

{{removed thing}}

Fix missing tabs.


Docker installation error

Describe the bug
Error while deploying docker instances.
To Reproduce
Steps to reproduce the behavior:

Deploy Ubuntu 22.04 as a LXC on Proxmox (unprivileged)
Update all the packages and reboot
Follow the steps, type docker compose up
Error:

`Recreating docker-main_setup_1 ... done
Recreating docker-main_es01_1  ... error
ERROR: for docker-main_es01_1  Cannot start service es01: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error setting rlimits for ready process: error setting rlimit type 8: operation not permitted: unknown
ERROR: for es01  Cannot start service es01: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error setting rlimits for ready process: error setting rlimit type 8: operation not permitted: unknown`
Operating System (please complete the following information):

OS
PRETTY_NAME="Ubuntu 22.04.2 LTS"
NAME="Ubuntu"
VERSION_ID="22.04"
VERSION="22.04.2 LTS (Jammy Jellyfish)"
VERSION_CODENAME=jammy
ID=ubuntu
ID_LIKE=debian
Version of Docker: Docker version 20.10.21, build 20.10.21-0ubuntu1~22.04.3
Version of Docker-Compose: docker-compose version 1.29.2, build unknown

@jackspiering - let me test and see if I can replicate this issue


basic WMS Getfeatureinfo implementation

What I am changing
I'm adding a basic GetFeatureInfo implementation to the Titiler WMS extension. This provides compatibility so that various WMS clients can automatically provide a users with queried point values.
How I did it
GetFeatureInfo reuses most of the logic from GetMap and queries a point within the returned image tile.
How you can test it
You can test this using the cog/wms endpoint in a WMS client like QGIS or nationalmap.gov.au and using the feature info capabilities to query a point. For some reason in QGIS some datasets like https://oin-hotosm.s3.amazonaws.com/56f9b5a963ebf4bc00074e70/0/56f9c2d42b67227a79b4faec.tif require invert axis orientation to be selected.

done in #698


pip and python3 mismatch on macos-14 runners

Description
It appears that the default pip binary and default python3 binary on the macos-14 runners use different python installs.  So any python modules you install via pip are cannot be found by python3.
Platforms affected

[ ] Azure DevOps
[X] GitHub Actions - Standard Runners
[ ] GitHub Actions - Larger Runners

Runner images affected

[ ] Ubuntu 20.04
[ ] Ubuntu 22.04
[ ] Ubuntu 24.04
[ ] macOS 12
[ ] macOS 13
[ ] macOS 13 Arm64
[ ] macOS 14
[X] macOS 14 Arm64
[ ] Windows Server 2019
[ ] Windows Server 2022

Image version and build link
Runner Version: 20240728.1
https://github.com/tstellar/llvm-project/actions/runs/10223278047/job/28289331074
Is it regression?
Yes, it was working with 20240722.3
Expected behavior
Python3 should be able to import modules installed via pip.
Actual behavior
pip install pygithub
python3 -c 'import github'

Traceback (most recent call last):
  File "<string>", line 1, in <module>
ModuleNotFoundError: No module named 'github'

Repro steps
You can reproduce the problem with this workflow:
name: Test Python

on:
  push:

permissions:
  contents: read # Default everything to read-only

jobs:
  test-python:
    runs-on: macos-14
    steps:
      - shell: bash
        run: |
          pip install pygithub
          python3 -c 'import github'

Hi @tstellar, We are looking in to it.

Hi @tstellar,
We could see the above behaviour only for ARM64 based images. We will check more on it and keep you posted on our investigation.
Currently, you can use the below two solutions to continue with our ARM64 images.
Solution #1: Use setup-python actions
steps:
  - uses: actions/checkout@v4
  - uses: actions/setup-python@v5
    with:
      python-version: '3.12'
  - name: Install PyGithub
    run: |
      pip install pygithub
      python3 -c 'import github'

Solution #2: To install a Python library, we can use a virtual environment
steps:
  - name: Install PyGithub
    run: |
      python3 -m venv .venv
      source .venv/bin/activate
      pip install pygithub
      python3 -c 'import github'

Hi @tstellar ,
We have two installations of Python here. One is via Homebrew and the other is via the official Python.org installer.
When we run "pip install pygithub" initially, it invokes the pip installed by the Python.org installer and downloads to the location - "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages"
pip --version
ARM : pip 24.2 from /Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/pip (python 3.12)

When we run "python3 -c import github" following it, it considers the pip which is installed by the homebrew now.
python3 -m pip --version
ARM : pip 24.0 from /opt/homebrew/lib/python3.12/site-packages/pip (python 3.12)

Since python3 used above is installed using Homebrew and Homebrew doesn't directly manage installation of pygithub we suggest using the above two options (setup-python actions / using virtual environment) to resolve the same.


Move SPAuthenticator & signingIn to protocol of SPAuthenticatorDelegate

I am using a custom authentication flow in my app, and I do not want to use SPAuthenticaionViewController. However when I subscribe to SPAuthenticatorDelegate I am forced to add the following properties to my view controller.
@property (nonatomic) SPAuthenticator *authenticator;
@property (nonatomic, assign, readwrite) BOOL signingIn;
Shouldn't these just be some required methods to implement in an a authentication protocol?

Hello there @lukegeiger!
Sounds accurate: those two properties would be probably better part of a protocol. Back in the day, this was implemented to be consumed by Simplenote iOS.
You can check out it's current implementation here and here. Long story short, the customized login screen inherits from SPAuthenticationViewController, and tweaks few things around.
I'm sorry to say we can't really provide a schedule of when we'd be able to update / enhance the SPAuthenticatorDelegate protocol, since this is a bit of a low priority at this moment.


Remove deprecated v1.10 options

Remove deprecated v1.10 options:

k8s-watcher-queue-size
blacklist-conflicting-routes
device
crd-wait-timeout (operator)

I've requested the review of André, Deepesh, Martynas and Chris as you have marked these options as deprecated as so should have the most context on them.

test-me-please

Looks like K8s-1.19-kernel-4.9 is failing due to a known flake: https://github.com/cilium/cilium/issues/13071
I'll restart the test

retest-4.9

retest-net-next


Download of qrencode fails

PS C:\WINDOWS\system32\WindowsPowerShell\v1.0> scoop install qrencode
Installing 'qrencode' (3.4.4) [64bit]
Too many automatic redirections were attempted.
URL http://khudob.in.s3-website-us-west-2.amazonaws.com/releases/qrcodegui_setup-3.4.4.exe is not valid

Obsolete.


Rework Doug

Doug was an early custom pet for BSO, it would be more in line with other custom pets if it worked on all non-PVM trips like the rest.

This wouldn't be overpowered as Doug is hardly used as-is.

With how rare Doug is compared to the newer pets it should probably be better in general.

Done in next update.


[WIP] fix docs_build job in circle ci

The error logs can be found at: https://circleci.com/gh/code-ready/crc/3325

@cfergeau Yeah, we could wait for a bit, but this happened around late yesterday.. i hadn't seen the other error

@cfergeau The build_docs job again failed today, https://app.circleci.com/pipelines/github/anjannath/crc/405/workflows/57f2f815-751e-4823-a6de-933cb36efce5/jobs/643
i don't think they're going to fix this, i'll try and open a bug report/issue on their tracker to get more details..

@cfergeau The build_docs job again failed today, https://app.circleci.com/pipelines/github/anjannath/crc/405/workflows/57f2f815-751e-4823-a6de-933cb36efce5/jobs/643
i don't think they're going to fix this, i'll try and open a bug report/issue on their tracker to get more details..

Yep, I've seen it as well a few days ago, since it seems to persist, we can get this in as a workaround and reevaluate when they close the bug report you open(ed)

@cfergeau  will look at using a newer ubuntu image, or just a ruby image!


Re-opening a submission for Arwa

Arwa had a problem with importing this submission - perhaps related to the submission app problems from last week https://www.ebi.ac.uk/gwas/deposition/submission/61f417323893270001d3376d.
She now needs to edit this submission, could you please re-open it @sajo-ebi?

@buniello the submission has been reset

thank you @sajo-ebi


Scroll ends with 404 "Could not parse server error" when ThrowOnElasticsearchServerExceptions is set

I'm using scroll search like this:
var scanResult = elasticClient.Search<OrganizationSuggestionDocument>(s => s.MatchAll().SearchType(SearchType.Scan).Scroll("1h").Size(100));
var scrollResult = elasticClient.Scroll<OrganizationSuggestionDocument>("1h", scanResult.ScrollId);
while (scrollResult.Documents.Any())
{
    foreach (var doc in scrollResult.Documents)
        yield return new OrganizationSuggestion {Name = doc.Name, Inn = doc.Inn};
    scrollResult = elasticClient.Scroll<OrganizationSuggestionDocument>("1h", scanResult.ScrollId);
}

It used to work OK, but now after I turned on ThrowOnElasticsearchServerExceptions the last call to scroll results into exception.
Is it the expected behavior? How could I avoid that exception? I was looking for anything like .IsFinal flag on scroll result, but didn't find any.

ThrowOn will turn any response that would otherwise be invalid into an exception.
You can however force 404 to be an OK response on a per request basis:
.Scroll<Project>(s => s
    .Scroll("5m")
    .ScrollId(id)
    .RequestConfiguration(r => r.AllowedStatusCodes(404))
);

Hope this helps!

Thanks! Worked for me.


When using remote debugger, new Date() does NOT reflect device time

Environment

react-native -v: 0.48.1
node -v: 8.0.0
npm -v: 5.4.0
yarn --version: 0.24.6

Target Platform: iOS
Development Operating System: macOS
Build tools: Xcode

Have not tested on Android device, but may apply too
Steps to Reproduce

Manually change date and time on mobile device
Add console.log(new Date()); anywhere
Run a debug build and read log in Xcode (should match manually changed time)
Turn on 'Debug JS Remotely'
Logged Date will now reflect the time on the computer, not the device

Actual vs. Expected Behavior
We stumbled upon this testing issues in our application when users' device time is not correct.
When we were debugging remotely we were baffled because our logs always showed the correct time, even when we manually changed the date and time on the device.
Expectation would be that new Date() would reflect the mobile device even when remotely debugging to aid debugging issues that arise from a user having their date and time offset from actual.

This is expected behavior. When debugging remotely, your js bundle is using chrome's jsc and when running on device it's using the jsc provided by apple on your phone.

While your explanation for why it is happening makes perfect since, the idea that is expected behavior is not adequate, in my opinion.
As explained by my use case, it's very difficult to debug a device with the incorrect time because of the mechanism you described. If there were a way to workaround this or write a patch that would use the device time to help debug these types of issues, I believe it would be useful for my current project, and others as well.

i'm worried about making exceptions when using jsc. This would only lead to more confusion down the road. I think this project is not using browser jsc: https://github.com/infinitered/reactotron. Try using that. i'm not sure if that will actually solve your problem tho.

I believe that @jasongaare is reasonable. This should not be labeled as a feature but rather as a bug because it might be really confusing for new react-native developers to understand why is this happening. Also, it makes debugging a lot harder in general.


Can't extract YAFFS

Sample attached:
firmware.zip
When executing:
binwalk firmware.fl1 --extract -M

it locks forever.
It seems a bug in yaffshiv because it loops in 100% CPU, but it seems logical to post it here as binwalk uses this tool.

Just realized that yaffshiv is from one of the main contributors of binwalk. Let me know if you want me to open an issue there.

What version of binwalk are you running, and what is binwalk's output without the --extract option specified? I don't see anything that looks like a YAFFS file system in that firmware image.

Version is:
Binwalk v2.1.2-a0c5315
These are the logs, it gets stuck right there:
yaffs_binwalk_log.txt

the file given above is not a yaffs2 file system
the firmware is  LENOVA UEFI bios firmware
binwalk  will not extract the file
i used uefi-firmware-parser and extracted firmware

After stumbling across the same (yaffshiv) bug, it seems to be caused because it tries to find the next page by appending the size of the last one without checking if that size is logical. For example, a false positive "YAFFS" file like this may have a next page size of 0 which will causes an infinite loop by re-finding the same page.
Anyway, this appears to have now been fixed (indirectly) by the recent code changes at https://github.com/devttys0/yaffshiv/pull/2 which were merged at https://github.com/devttys0/yaffshiv/commit/d57d68a225cdc8c4965e96ef05beef58911ff5eb.
For reference, I have attached the actual false positive "YAFFS" file which causes the infinite loop at yaffshiv and thus Binwalk.
14220C.zip


[#4558] Fixed to stop the stream when the agent stops

Codecov Report

Merging #5707 into master will increase coverage by <.01%.
The diff coverage is 0%.

@@            Coverage Diff             @@
##           master    #5707      +/-   ##
==========================================
+ Coverage   40.58%   40.59%   +<.01%
==========================================
  Files        2910     2911       +1
  Lines       87478    87494      +16
  Branches    11553    11554       +1
==========================================
+ Hits        35507    35521      +14
- Misses      48891    48897       +6
+ Partials     3080     3076       -4

Impacted Files
Coverage Δ

...point/profiler/sender/grpc/StatGrpcDataSender.java
0% <0%> (ø)
:arrow_up:

...orp/pinpoint/profiler/sender/grpc/StreamUtils.java
0% <0%> (ø)

...point/profiler/sender/grpc/SpanGrpcDataSender.java
0% <0%> (ø)
:arrow_up:

...pinpoint/profiler/monitor/DeadlockMonitorTask.java
18.6% <0%> (-1.17%)
:arrow_down:

...orp/pinpoint/rpc/server/DefaultPinpointServer.java
80.98% <0%> (+1.05%)
:arrow_up:

...java/com/navercorp/pinpoint/rpc/DefaultFuture.java
74.16% <0%> (+1.66%)
:arrow_up:

...navercorp/pinpoint/rpc/common/SocketStateCode.java
85.36% <0%> (+2.43%)
:arrow_up:

...vercorp/pinpoint/web/vo/ApplicationAgentsList.java
69.23% <0%> (+2.56%)
:arrow_up:

...ofiler/sender/StandbySpanStreamDataSendWorker.java
83.58% <0%> (+2.98%)
:arrow_up:

... and 3 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1f722b7...61a5662. Read the comment docs.


Add more prior classes and add composite prior example

Currently there is only uniform prior with a guard outside the domain available.
This create issue of broken waveform returning nan when the gradient is large in HMC, which shoot the test point outside the domain and raising nan.
Here is a list of priors that could be useful to have:

[x] Unconstrained uniform. Sample from an unconstrained distribution that corresponds to a uniform distribution over [a,b]
[x] Uniform on sphere. Sample from a sphere and transform them into Cartesian coordinate. Useful for spins.
[ ] Add example of composite prior. This should take a list of priors and return a prior

Peter and I were also interested in a DiracDelta prior, to fix e.g. the sky localisation to simplify the PE which might be useful to look into the sampling process itself and debug it. I haven't started on that, but that would also require a composite prior with some parameters having a uniform, and some having a DiracDelta prior. I'll ping u in case I start working on this at some point.

Hi @kazewong , I was doing some PE runs on GW170817 and the luminosty distances are a bit off, because we are using the Uniform prior instead of a cosmological prior on the distance, as done in the TurboPE repo here. We were wondering, since you seemed to be working on prior classes, if it would be easy for you to add such a prior class to Jim? I am more than happy to help by implementing it myself in case you don't have time for it right now, but just wanted to check in case you are already working on something like this. Thanks a lot in advance!


wr.dynamodb.read_items ignores max_items_evaluated kwarg

Describe the bug
wr.dynamodb.read_items ignores max_items_evaluated kwarg, resulting in a possibly-expensive full scan operation if it is the only kwarg provided to the method (beside to table_name, of course)
This bug also highlight the lack of a dedicated unit test in tests/unit/test_dynamodb.py
Some notes hopefully useful for debugging:

this bug already occurs in version 2.20.0, but I am pretty confident that this has been introduced after https://github.com/aws/aws-sdk-pandas/pull/1877 (released with 2.19.0), therefore my guess is that it's related to extension of the read_items feature to threads/chunks/indices rather than to version 3.x changes
the kwarg is correctly passed through from read_items to low level boto3 scan operation (e.g. passing max_items_evaluated=-1 a ParamValidationError would be raised), but it is somehow ignored/skipped
the kwarg corresponds to Limit kwarg of boto3 client scan operation

How to Reproduce
This unit test should do the job, and meanwhile is a good example of the current buggy behaviour
@pytest.mark.parametrize(
    "params",
    [
        {
            "KeySchema": [{"AttributeName": "id", "KeyType": "HASH"}],
            "AttributeDefinitions": [{"AttributeName": "id", "AttributeType": "N"}],
        }
    ],
)
@pytest.mark.parametrize("use_threads", [False, True])
def test_read_items_limited(params: Dict[str, Any], dynamodb_table: str, use_threads: bool) -> None:
    df = pd.DataFrame(
        {
            "id": [1, 2, 3, 4],
            "word": ["this", "is", "a", "test"],
            "char_count": [4, 2, 1, 4],
        }
    )
    wr.dynamodb.put_df(df=df, table_name=dynamodb_table, use_threads=use_threads)

    df2 = wr.dynamodb.read_items(table_name=dynamodb_table, max_items_evaluated=1)
    assert df2.shape == (1, len(df.columns))

Expected behavior
The method should abide to the given max_items_evaluated value, stopping the search once the given amount of items has been reached and returning up to max_items_evaluated items.
Your project
No response
Screenshots
No response
OS
Windows
Python version
3.10
AWS SDK for pandas version
3.2.1 (but bug already occurs in 2.20.0)
Additional context
No response

Good catch @a-slice-of-py, thanks for raising this.
Based on the note in this section of the DynamoDB docs, it seems that a LastEvaluatedKey is returned even when the specified Limit is returned:
Using aws dynamodb scan --table-name Prices --limit 1 returns a LastEvaluatedKey.

There must be a good reason for this behaviour but in this case it means that we cannot rely on LastEvaluatedKey as a signal that we have reached the end of the pagination.
I have put together a fix in #2372. Not entirely happy with it but we can discuss it there.


Implemented Positions. Bumped version to 2.1.

@JuliaRegistrator register

Comments on pull requests will not trigger Registrator, as it is disabled. Please try commenting on a commit or issue.


feat(blueprints): upgrade karma-coverage-istanbul-reporter

I've just added threshold reporting to this lib which might be handy for some users 😄

The following commit message should work:
feat(@angular/cli): upgrade the blueprint karma-coverage-istanbul-reporter version
You can use git commit --amend and then force push to update the PR. (https://help.github.com/articles/changing-a-commit-message/)

3rd times the charm 😄 https://github.com/angular/angular-cli/pull/5240


feat: add directus îles example (https://iles.pages.dev)

Closes #88
This pull request adds an example of how to integrate Directus in an îles project.

Thanks @ElMassimo!

LGTM! Tested locally and works great. Perhaps we can coordinate to get a guide for this example added to https://github.com/directus/guides 👍

@rijkvanzanten You want me to do that? I'm ready for it 🤠

Sure thing! Lets do it 🙂
@ElMassimo As lead maintainer of Îles, mind factchecking what we come up with?

Sounds good, ping me and I'll take a look 😃

Sure thing! Lets do it 🙂

Sweet. I have a few things on the agenda this week, plan to have it done by Monday.

@ElMassimo We are going to make a photo like this for iles:

Can you send an "Iles" logo over as a PNG? How about an image? (I can get an image of some totally sweet island if you don't have a specific island in mind.)
You can send it in this thread or email me at<EMAIL_ADDRESS>

(regarding the image, lets make sure it's licensed in a way that allows this sort of usage. Finding something on unsplash.com is a great way to ensure that)

Great! Feel free to use any background image 😃 🌴

SVG of the logo.
PNG of the logo, for reference


Benchmarking confidence intervals

For my dataset, I tried correlating the CIs to absolute error on the test set, and didn't find a relationship. I do get a relationship if I use the standard deviation of the predictions from individual decision trees. Do you see this with other datasets?

You raised a good point: in a noisy dataset (i.e., where a replicated sample could lead to different values for the target) a good model should have the IJK error correlate with the true error, or having  the errorbars in the parity plot touch the bisecting line.
In my experience with the IJK, this is quite the case for the prediction&error on the training set, but this is not the case for the test set unless I have a very good model: fitted on a well representative train set, and not overfitting. If it is hard for a ML model to guess the average value of the target in the prediction, it is intrinsically harder to get a good estimate of the variance, since you should have enough training samples to make the model learn the random noise of the dataset.
Therefore, I'm asking: can you please share your dataset example? How confident are you in your model? I feel like it is more likely that you don't have enough samples to have a good model to extract a reliable standard deviation on the test set with the IJK, than proposing that the IJK is making a wrong estimate of the error.
Thanks for your contribution, I'm very interesting to go deeper in assessing the power and limits of IJK by practical examples from users!

Closed as the dataset was not shared.


Update CheckColumnType to incorporate return type for function result

This PR fixes https://github.com/microsoft/Power-Fx/issues/1252 which has a description of the issue.
Turns out most of functions that take a single column table had this bug.  MathFunction.cs had a good solution to the problem, which I had initially propagated to the other functions.  After feedback from the team, I generalized the code to move this solution into the CheckColumnType functions, significantly simplifying the CheckTypes in each of the functions.
This fix is needed for Round* and Trunc in particular, because with decimal single column tables these functions would hit an assert and stop the test suite from proceeding. Something as simple as [1,2,3] would be a problem.

✅ No public API change.

✅ No public API change.

✅ No public API change.

✅ No public API change.

✅ No public API change.

✅ No public API change.

@Shpakh-MSFT , no this does not need to be in pa client immediately.  It is needed by consumers of Decimal.  And I need it as a base for the next PR of decimal functions.

✅ No public API change.

✅ No public API change.

✅ No public API change.

✅ No public API change.


Run basic 2018 edition fix

In order to use 2018 features we need the edition to be updated.
This commit is the result of running:
cargo fix --edition -p rustup -p rustup-dist -p rustup-mock -p rustup-utils -p download
And then adding 'edition = "2018"' to each requisite Cargo.toml

As a followup if this is accepted, I intend to sort out a cargo fmt across the workspace.  If anyone knows of a good way to mechanically do this to preserve as much authorship information as possible, I'd love to know, otherwise it'll just smear my name across an awful lot of the codebase :(

Thank you!