Error converting .pb model to .tflite

System information

OS Platform and Distribution : Windows 10 64-bit
TensorFlow installed from (source or binary): Binary
-TensorFlow Version - 1.13.1
-Onnx Version - 1.6.0

I have pytorch model and I have to deploy it into android, so I saved the model in onnx and then converted the model in .pb
But not able to convert the model in tensorflowlite.
` import tensorflow as tf
graph_def_file = "tensorf.pb"
input_arrays = ['Const']
output_arrays = ['concat_98']
converter = tf.lite.TFLiteConverter.from_frozen_graph(graph_def_file, input_arrays, output_arrays)
tflite_model = converter.convert()
open("tensorf_lite.tflite", "wb").write(tflite_model) `
Error log -
Traceback (most recent call last): File "tfliteconvertor.py", line 8, in <module> tflite_model = converter.convert() File "C:\Program Files\Python37\lib\site-packages\tensorflow\lite\python\lite.py", line 455, in convert **converter_kwargs) File "C:\Program Files\Python37\lib\site-packages\tensorflow\lite\python\convert.py", line 442, in toco_convert_impl input_data.SerializeToString()) File "C:\Program Files\Python37\lib\site-packages\tensorflow\lite\python\convert.py", line 205, in toco_convert_protos "TOCO failed. See console for info.\n%s\n%s\n" % (stdout, stderr)) tensorflow.lite.python.convert.ConverterError: TOCO failed. See console for info. 2019-10-01 12:18:57.243087: I tensorflow/lite/toco/import_tensorflow.cc:1324] Converting unsupported operation: PyFunc 2019-10-01 12:18:57.243738: E tensorflow/core/framework/op_kernel.cc:1325] OpKernel ('op: "WrapDatasetVariant" device_type: "CPU"') for unknown op: WrapDatasetVariant 2019-10-01 12:18:57.244227: E tensorflow/core/framework/op_kernel.cc:1325] OpKernel ('op: "WrapDatasetVariant" device_type: "GPU" host_memory_arg: "input_handle" host_memory_arg: "output_handle"') for unknown op: WrapDatasetVariant 2019-10-01 12:18:57.244653: E tensorflow/core/framework/op_kernel.cc:1325] OpKernel ('op: "UnwrapDatasetVariant" device_type: "CPU"') for unknown op: UnwrapDatasetVariant 2019-10-01 12:18:57.245022: E tensorflow/core/framework/op_kernel.cc:1325] OpKernel ('op: "UnwrapDatasetVariant" device_type: "GPU" host_memory_arg: "input_handle" host_memory_arg: "output_handle"') for unknown op: UnwrapDatasetVariant 2019-10-01 12:18:57.245590: F tensorflow/lite/toco/import_tensorflow.cc:114] Check failed: attr.value_case() == AttrValue::kType (1 vs. 6)

I am facing this same error, in tensorflow 1.14.0.
Converted a Pytorch ResNet-50 model to ONNX, then from ONNX to save graph (.pb). The execution of tf.lite.TFLiteConverter.from_frozen_graph is aborted with the following erros:
2019-10-02 17:21:46.869078: I tensorflow/lite/toco/import_tensorflow.cc:1336] Converting unsupported operation: PyFunc 2019-10-02 17:21:46.876495: F tensorflow/lite/toco/import_tensorflow.cc:114] Check failed: attr.value_case() == AttrValue::kType (1 vs. 6)

@mohitranawat,
Please refer this link of similar issue.Thanks!

@oanush  I am not facing this issue. My model is saved in cpu only, nowhere GPU comes into picture.
Hope you can give another solution or suggestion.Thanks!

@mohitranawat ,
Did you try using TFLITE_BUILTINS, SELECT_TF_OPS to convert your model?Thanks!

@oanush Tried, not working. Thanks!

same issue with me on windows 10
the following error pops up :
File "e:/Projects/Toolkits-for-me-by-me/Convert_Tensorflow_model_to_TfLite/Tflite_converter.py", line 5, in
tflite_model = converter.convert()
File "C:\Users\abhin\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow_core\lite\python\lite.py", line 428, in convert
"invalid shape '{1}'.".format(_get_tensor_name(tensor), shape_list))
ValueError: None is only supported in the 1st dimension. Tensor 'image_tensor' has invalid shape '[None, None, None, 3]'.

same issue with me on windows 10
the following error pops up :
File "e:/Projects/Toolkits-for-me-by-me/Convert_Tensorflow_model_to_TfLite/Tflite_converter.py", line 5, in
tflite_model = converter.convert()
File "C:\Users\abhin\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow_core\lite\python\lite.py", line 428, in convert
"invalid shape '{1}'.".format(_get_tensor_name(tensor), shape_list))
ValueError: None is only supported in the 1st dimension. Tensor 'image_tensor' has invalid shape '[None, None, None, 3]'.

I have the same problem.I just try to fix the size of the input node before frozen the graph.You can use the Netron to visualize your graph file.

Now I have the same problem. How did you solve it，please

Now I have the same problem. How did you solve it，please

this problem is about the model of faster rcnn.l can not solve it.l think it can not be solved because this version of tensorflow do not support mlir model.

Hi There,
We are checking to see if you still need help on this, as you are using an older version of tensorflow which is officially considered end of life . We recommend that you upgrade to the latest 2.x version and let us know if the issue still persists in newer versions. Please open a new issue for any help you need against 2.x, and we will get you the right help.
This issue will be closed automatically 7 days from now. If you still need help with this issue, please provide us with more information.


Consider adding (and tracking) the components necessary to produce and update ca-certificates and tzdata

While tzdata and ca-certificates release mostly data instead of source code, they are arguably critical to trust. I suggest adding (and tracking) the "build" dependencies of both.
For example, in Debian-based systems, tzdata not only relies on make (as all Debian packages do) but also on gawk or zic from libc, e.g., https://sources.debian.org/src/tzdata/2021e-1/debian/rules/#L28
Similarly, ca-certificates depends on python3 and the cryptography module, as well as OpenSSL: https://sources.debian.org/src/ca-certificates/20211016/debian/control/#L6

Both of these feel like they are broader concepts.
"Timezone data and CA Cert packages are critical. List of packages providing each that are popular"

Sure. And while there might be others, the named entities ca-certificates and tzdata are among the most popular packages providing said broader concepts.

Both of these feel like they are broader concepts.

That's true, but the important aspect of this issue IMO is that dependencies of critical (code or data) projects are themselves critical.


Workflows with Duplicate Lumi's

We have a number of Redigi Workflows that are not closing out due to duplicate Lumi's in the output datasets.  Julian checked, and double checked the input datasets and they are clear.  We did not run any sort of ACDC or recovery on these workflows.  I have run out of ideas as to what may have happened or what our best course of action for recovery is on these.  I need a developer to look at them and try to figure it out and give us advice as to what to do.
is the ful e-log thread on this issue.
https://cmslogbook.cern.ch/elog/Workflow+processing/12485
alahiff_BTV-Fall13dr-00050_T1_US_FNAL_MSS_00026_v0__140110_000836_4460
alahiff_BTV-Fall13dr-00052_T1_US_FNAL_MSS_00026_v0__140110_000857_3821
alahiff_BTV-Fall13dr-00053_T1_US_FNAL_MSS_00026_v0__140110_000908_6644
alahiff_BTV-Fall13dr-00054_T1_US_FNAL_MSS_00026_v0__140110_000918_809
alahiff_BTV-Fall13dr-00057_T1_US_FNAL_MSS_00026_v0__140110_000942_6330
pdmvserv_BTV-Fall13dr-00200_T1_US_FNAL_MSS_00055_v0_castor_tsg_131220_142050_3915
pdmvserv_BTV-Fall13dr-00200_T1_US_FNAL_MSS_00055_v0_castor_tsg_131220_142050_3915
pdmvserv_HIG-Fall13dr-00050_T1_FR_CCIN2P3_MSS_00019_v0_tsg_131219_010343_3987
pdmvserv_L1T-Fall13dr-00038_T1_US_FNAL_MSS_00015_v1_tsg_131219_004921_2006

@ticoann I guess we can close this issue. I believe these issues happened when we had 2 instances of GQ running in cmsweb.


Extensions are not showing/have very few downloads and no ratings

VSCode Version:
Version: 1.50.1
Commit: d2e414d9e4239a252d1ab117bd7067f125afd80a
Date: 2020-10-15T10:42:48.064Z
Electron: 9.3.2
Chrome: 83.0.4103.122
Node.js: 12.14.1
V8: <IP_ADDRESS>-electron.0
OS Version:
Linux x64 5.9.1-arch1-1

Steps to Reproduce:

Open VS Code
Check the Extensions tab

Does this issue occur when all extensions are disabled?: Yes
Since some time, extensions have a lot less downloads then they have on the marketplace website. Also, a lot of extensions are not visible, see screenshot below.

I can't find any information regarding this problem on the internet anywhere.
I have even completely reinstalled VS Code and deleted all of my user settings files in the ~/.config folder. What am I missing here or is this a bug?

Duplicate of #109365 and #107997. See https://github.com/microsoft/vscode/issues/107997#issuecomment-703245178

Sorry I did research but did not find this. Thank you.


Bootstrap select handle huge entries

Hello Experts,
I am using bootstrap-select (Version 1.12.2) in my JSP page and the requirement is to load  ~100000 entries in the dropdown dynamically using ajax javascript calls  (And I have 5 to 6 such dropdowns on the same page). I understand that if we load such huge data the browser becomes unresponsive and breaks and I also went through eariler issues reported for this #1229 . Is there a way to achieve this functionality using latest version?
Any other alternative suggestions are also welcome :)
TIA

Using the latest version should solve this problem. The latest version is available here: https://github.com/snapappointments/bootstrap-select. Development has moved there.


Are you willing to make the dataset public? And some questions about paper.

Firstly, thanks for your work, it's amazing.
And as the title says, It is helpful if you can make the dataset public. I mean, the 63,692 js seed files you mentioned in your paper.
Thank you in advance!

@DaramG Hello, I just finished reading your paper, it's great!  I have some questions about it and I wish you can help me. My questions as follows:

What's the mean of top-level statement?
Based on my understanding, both a non loop statement and a loop(including head and body) can be deemed as a top-level statement, right? Look a example:

var n = 42;
var arr = new Array(0x100);
for (let i = 0; i < n; i++)
{
    arr[i] = n;
    arr[n] = i;
}
var b = 1;

I think the number of top-level statement for this example is 4, am i right? If not, please tell me why.

In the section §VI-C Choosing Parameters, how do you determine if crash is unique? According to personal experience or manually analyse?

In the section §VI-D (2)Comparison on the Latest JS Engines, you mentioned that:

Table II presents the number of unique crashes each engine found after 2,112 CPU hours of fuzzing.

There are 3 fuzzers and 4 engines, the 2,112 CPU hours means using a fuzzer to fuzz a engine need to spend 2,112 CPU hours(actually 24 hours)?

In the timing comparison of the two fuzzers, will their different implementations affect the final experimental results? For example, there are two fuzzers named A and B respectively, A's fuzzing algorithm is better than B actually, but because of the implement of B is better than A, the final evaluation result of A is inferior to B. So how can we compare the algorithms of two fuzzers fairly?
This is a confusion of mine and I'd like to hear your opinion.

Looking forward you reply, thank you in advance.

Thanks for your interest and questions!

Dataset
We are very sorry to say that we don't have plan to make dataset public.

What's the mean of top-level statement?
Typically, program is a collection of statements and statements are defined recursively. So, some word is required to express the very first statement of program and it was top-level statement.  In your example, the number of top-level statement is 4 as you think.

How to determine unique crash in the section §VI-C (2) Choosing Parameters?
We first triaged crashes by their call stack and manually analyzed them.

CPU hours in §VI-D (2)Comparison on the Latest JS Engines
Yes, as you said, we spent 2,112 CPU hours (actually 24 hours in our environment) to run a fuzzer against a target engine.

How to compare fuzzing algorithms of two fuzzers fairly?
It's hard problem but I just write my thought here.
To compare only fuzzing algorithms, we should make everything same except the fuzzing algorithms. However, in case of comparing fuzzing algorithms of two fuzzers, it's very hard to make everything same. So, to prove fuzzing algorithms is good, papers usually evaluate two versions of their fuzzer, with and without the new fuzzing algorithm which they are willing to show. For example, in our paper, we evaluated two versions of CodeAlchemist with and without assembly constraints.

@DaramG I get it, thanks for your reply.
And i have a little advise about  the readme.md that says:

Installation for dotnet depends on OS version, so please refer this link.

When i enter this link and choose Ubuntu18.04 x64, the default version of .Net Core SDK is 3.1, then I installed 3.1 version as the page says.
However, When I run the command dotnet bin/Main.dll rewrite, i got an error:
(python2) ty@ty-virtual-machine:~/CodeAlchemist$ dotnet bin/Main.dll rewrite /home/ty/CodeAlchemist/conf/Chakra.conf
It was not possible to find any compatible framework version
The framework 'Microsoft.NETCore.App', version '2.1.0' was not found.
  - The following frameworks were found:
      3.1.0 at [/usr/share/dotnet/shared/Microsoft.NETCore.App]

You can resolve the problem by installing the specified framework and/or SDK.

The specified framework can be found at:
  - https://aka.ms/dotnet-core-applaunch?framework=Microsoft.NETCore.App&framework_version=2.1.0&arch=x64&rid=ubuntu.18.04-x64

Then, I uninstall .NET Core 3.1 and install .NET Core 2.1, it worked. I have to say that it took me some unnecessary time because of the missing info of default version.
So I think you can add a description of .NET Core version in Ubuntu18.04  to readme.md.
It's just a little advise, but i think it can make this repo more perfect.

Thanks for your suggestion and I will update in the near future!


Hi, can you help verify this simple 8b? I actually am quite confused over two things.

                • The selector value 2 corresponds to b = 1. This allows us to store 60 integers having values in {0,1}, which are packed in the data bits.

                • The selector value 3 corresponds to b = 2 and allows one to pack 30 integers having values in [0, 4] in the data bits.

shouldn't this be [0,3] instead of [0,4]? i mean it should only allow for 0,1,2,3 values right for bit length of 2.
                 • Selector values 0 or 1 represent sequences containing 240 and 120 zeros, respectively. In this instance the 60 data bits are ignored.

i'm not sure how to use this 240 or 120 zeros. is it for rare situations only?

I'm asking because I saw online there could be misunderstanding / misrepresentation of what simple8b can be. hope you can clarify.

I've yet to see it being implemented in golang. possible for you to write one?

I'm asking because I saw online there could be misunderstanding / misrepresentation of what simple8b can be. hope you can clarify.

I've yet to see it being implemented in golang. possible for you to write one?

@hiqsociety This does not appear to be an issue with respect to the code repository FastPFor. It is a not a valid software issue.
It seems, rather, that you are studying schemes from the Simple family introduced by Moffat and collaborators. Moffat and his collaborators are unrelated to the current repository.  This scheme was first described in the following reference :
Anh VN, Moffat A. Index compression using 64-bit words. Software: Practice and Experience 2010; 40(2):131– 14
I believe that they have made their source code available. I refer you to this reference and their source code as authoritative.
FastPFor provides a C++ implementation of some Simple schemes which you are invited to study, of course.

I've yet to see it being implemented in golang. possible for you to write one?

FastPFor is a community-maintained C++ library. We are unlikely to add Go code to the project.

@hiqsociety This does not appear to be an issue with respect to the code repository FastPFor. It is a not a valid software issue.
It seems, rather, that you are studying schemes from the Simple family introduced by Moffat and collaborators. Moffat and his collaborators are unrelated to the current repository.  This scheme was first described in the following reference :
Anh VN, Moffat A. Index compression using 64-bit words. Software: Practice and Experience 2010; 40(2):131– 14
I believe that they have made their source code available. I refer you to this reference and their source code as authoritative.
FastPFor provides a C++ implementation of some Simple schemes which you are invited to study, of course.

I've yet to see it being implemented in golang. possible for you to write one?

FastPFor is a community-maintained C++ library. We are unlikely to add Go code to the project.


Support vscode-erg.executablePath

Supported vscode-erg.executablePath
Replaced languageclinet restart with one provided by API

Thank you!


ChoreHide the job document.

After #26845 , insert job is not supported yet.
Proposed changes
Issue Number: close #xxx

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall


v5.5 scheduled messages aren't working

Hiya,
I'm having some issues with the scheduled messages in v5.5.
I setup a message to test this feature after upgrading, and they dont appear to be sending.

There's no issues sending the messages normally (without scheduling) so I'm unsure what it could be myself.

Hi @alexl-2397 ,
Thanks for trying out the latest version. Please respond to the below queries

Is it a fresh deployment?
Other than schedule message functionality, all are working fine?
Please share the application insight logs with screenshots. Here is the reference to reach to the logs section.

Hi Sai,
It's not a fresh deployment, I synced the deployment on the 21st of September.

All functionalities work, just not the scheduled ones.
Here's a screenshot of the application log for the timestamp of the above scheduled message

Hi @alexl-2397 .
Please share your mail id(outlook id/teams id) so that we can discuss the issue internally.

Following up internally

Hi @alexl-2397 ,
Please let us know if you have any queries otherwise we can make it to closure.


chore: add feathers-lowdb to database adapter list

Summary
Adding:
feathers-lowdb - Featherjs database service adapter for [Lowdb][https://github.com/typicode/lowdb]

This looks great, thank you for adding it!

no problem 👍


Issues using cloud_firestore: ^0.8.2+3 & cloud_firestore: ^0.8.2

Hi,
I was following the[ Firestore for Flutter tutorial (https://codelabs.developers.google.com/codelabs/flutter-firebase/#3) and received an error when adding "cloud_firestore: 0.8.2+3" to my pubspec.yaml file.
I've searched around but can't seem to find a solution.
This is the error I receive:
D8: Cannot fit requested classes in a single dex file (# methods: 69328 > 65536)

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':app:transformDexArchiveWithExternalLibsDexMergerForDebug'.
com.android.builder.dexing.DexArchiveMergerException: Error while merging dex archives: /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/4.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/5.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/6.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/7.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/8.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/9.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/10.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/11.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/18.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/23.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/28.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/33.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/38.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/43.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/48.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/53.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/58.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/63.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/68.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/73.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/78.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/83.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/88.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/93.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/98.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/103.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/108.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/113.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/118.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/123.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/128.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/133.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/138.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/143.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/148.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/153.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/158.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/163.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/168.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/173.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/178.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/183.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/188.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/193.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/198.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/203.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/208.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/213.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/218.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/223.jar, /Users/Kenton/AndroidStudioProjects/baby_names/build/app/intermediates/transforms/dexBuilder/debug/228.jar
  The number of method references in a .dex file cannot exceed 64K.
  Learn how to resolve this issue at https://developer.android.com/tools/building/multidex.html

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 2s
Finished with error: Gradle task assembleDebug failed with exit code 1

I found a solution:
https://stackoverflow.com/questions/51341627/android-gives-error-cannot-fit-requested-classes-in-a-single-dex-file

I found a solution:
https://stackoverflow.com/questions/51341627/android-gives-error-cannot-fit-requested-classes-in-a-single-dex-file

This also resolved my problem


sql: user account expiration (role LOGIN option and password expiry via VALID UNTIL option)

PR: https://github.com/cockroachdb/cockroach/pull/45541
From release notes:

Added the VALID UNTIL option to indicate passwords are only valid until a given timestamp. VALID UNTIL only affects PASSWORDS - if passwords are disabled, VALID UNTIL has no effect. Also, you can login even with expired password if passwords are not required to login-- same as PostgreSQL). [#45541][#45541] {% comment %}doc{% endcomment %}

Dup of https://github.com/cockroachdb/docs/issues/6882


feat: update swc_core to 0.69

closed #201

Have you tried npm run build:all locally for your change set? I came up with a similar fix and it still does not build with the given commend:
error[E0277]: the trait bound `CoverageVisitor<C, S>: VisitMut` is not satisfied
   --> src/lib.rs:138:15
    |
138 |     as_folder(visitor)
    |     --------- ^^^^^^^ the trait `VisitMut` is not implemented for `CoverageVisitor<C, S>`
    |     |
    |     required by a bound introduced by this call
    |

Have you tried npm run build:all locally for your change set?

Yes


Locality based routing via VirtualServices

Describe the feature request
Locality based routing via VirtualServices
Describe alternatives you've considered
Use serviceentry to route traffic, but then when using ServiceEntry, the endpoint for local region is pointing to kubernetes service, which results in envoy not using EDS for local communication, which has its disadvantages, for instance, then envoy is depending on kube-proxy to do the routing.
Affected product area (please put an X in all that apply)
[ ] Ambient
[ ] Docs
[ ] Dual Stack
[ ] Installation
[X] Networking
[ ] Performance and Scalability
[ ] Extensions and Telemetry
[ ] Security
[ ] Test and Release
[ ] User Experience
[ ] Developer Infrastructure
Affected features (please put an X in all that apply)
[X] Multi Cluster
[ ] Virtual Machine
[ ] Multi Control Plane
Additional context

Do you mean https://istio.io/latest/docs/reference/config/networking/destination-rule/#LocalityLoadBalancerSetting?

Do you mean https://istio.io/latest/docs/reference/config/networking/destination-rule/#LocalityLoadBalancerSetting?

The one you mentioned is different. What I am looking for is, be able to define two destinations in virtualservice, which have a matching criteria based on locality, just like what is available in service entries.
For example:
apiVersion: networking.istio.io/v1beta1
kind: ServiceEntry
metadata:
  name: test-se
spec:
  endpoints:
  - address: aws-lb-east.com
    labels:
      type: rollout
    locality: us-east-2
    ports:
      http: 443
  - address: aws-lb-west.com
    labels:
      type: rollout
    locality: us-west-2
    ports:
      http: 443
  hosts:
  - foobar.global
  location: MESH_INTERNAL
  ports:
  - name: http
    number: 80
    protocol: http
  resolution: DNS

I am almost certain this already works today:
apiVersion: networking.istio.io/v1alpha3
kind: VirtualService
metadata:
  name: test-vs
spec:
  hosts:
  - foobar.global
  http:
  - match:
     sourceLabels:
       topology.kubernetes.io/region: us-east-2
     route:
     - destination:
          host: aws-lb-east.com
  - match:
     sourceLabels:
       topology.kubernetes.io/region: us-west-2
     route:
     - destination:
          host: aws-lb-west.com

Make sure you are on 1.20 or so, there were some recent improvements here that indirectly enabled this

Great, thanks a lot @howardjohn for adding this information, I will test this out with > 1.20.
Thanks!

Discussed with @howardjohn and he mentioned that this would be possible even if we do a TLS PASSSTHROUGH on ingressgateway. Will test it out and report back.

Also, we can use this approach, will test this out:

For local endpoints, use VirtualServices, so traffic naturally goes there based on locality
For remote endpoints, use service entries, and make sure the service entries have only remote locality.

Looks like this iis working with the sourceLabels?

@howardjohn sourceLabels looks at the source region and sends the request to the labeled route, which works as expected.
Failover happens at the destination, so we expect the route to switch based on the destination rule locality settings.
Is there a way to achieve this ? Service Entry works this way


Pipeline Parallelism + FSDP

On PP + FSDP and PP + TP + FSDP:

Is there any documentation on how these different parallelisms compose?
What are the largest training runs these strategies have been tested on?
Are there benchmarks for how these strategies compare against other distributed training frameworks that expose similar parallelisms?

Particularly interested in how PP + FSDP work together as it seems DeepSpeed explicitly disallows ZeRO 2/3 + PP (see here specifically, and here for discussion).
@wconstab @weifengpy @wanchaol

specifically for Zero3+PP, we haven't published guides or anything, but we are working on it.  You can compose them, just have to be aware of scheduling the unshard/reshard well with respect to peak memory.  We don't have an out of the box support for this yet but are planning to offer that.
cc @H-Huang @donglimm about Zero3+PP and other PP schedule questions.
We do have a guide showing how to compose FSDP+PP without zero-3 in torchtitan-
https://github.com/pytorch/torchtitan/blob/main/torchtitan/parallelisms/parallelize_llama.py
For benchmarks, we do not have large benchmarks due to resource constraints but we are preparing 64-gpu benchmarks for torchtitan.  We are happy to collaborate on larger benchmarks if you have resources to run them and want help with any optimization opportunities.

@wconstab Hey! Any updates?

@jianzs , thanks for being interested in PP+FSDP, we have an implementation of Z3+PP, and plan to integrate it to OSS, we will keep you updated on this issue.

Hi! Any updates on this?
Thanks!


Multiple subdomains wrongly identified as domain

Hi,
First of all, thank you for tldjs, great library!
When I call tldjs.getDomain() on the following urls, tldjs identifies the entire url (without the protocol) as the domain, and no subdomains (tldjs.getSubdomain() returns empty).
This are the examples I have that cause an issue:
http://bntp-assets.global.ssl.fastly.net/
http://cres-wpstatic.freetls.fastly.net/
http://r3engage-live.global.ssl.fastly.net/
http://ticket-magic-ember-herokuapp-com.global.ssl.fastly.net/
Thank you!

@jonathanvandriessen, this is expected behavior since both of the following are public suffixes:

global.ssl.fastly.net
freetls.fastly.net

See https://publicsuffix.org/list/ for reference
The domain as returned by getDomain() is the public suffix plus one more element left to it. This is why you get the full domain.

Thanks for your reply @ctavan !

@jonathanvandriessen To add to the answer from @ctavan, if this is something blocking for your usage of the library, this could be solved by having a way to match only ICANN rules, ignoring the PRIVATE section of the suffix list (since the rules for fastly.net are in the PRIVATE section).
I already have some POC on one of my branches to do something like that. If there is some interest for such feature, we could try to integrate it.

@remusao it is blocking for my usage of the library indeed.
Currently, I'm considering a workaround where I check where:
IF I don't get a subdomain AND I do get a domain that has more than 2 dots in it THEN I consider the url to be having a subdomain. I know this is probably not perfect but it seems to do the trick for the exceptions I know of.
FYI: My use case is the following: given a domain (could include subdomains), I'm trying to determine if I need to add www in front of it to make it a valid url. I add .www if the domain does not seem to have a subdomain.
I'd be happy to test drive your solution!

@remusao how about simply adding an additional getIcannDomain()? I believe that could be useful. I believe that changing the behavior of the current getDomain() is probably to big of a breaking change.

@ctavan Agreed about not introducing a breaking change. Maybe we could, as you suggest, add a new method in the API + a new attribute in the result of parse to know what kind of rule triggered?


What Is the Rationale for Not Exporting Catlab?

Hi Semagrams team,
Great work on this! Just an initial thought and a suggestion on syntax:
Catlab seems to be a dependency of Semagrams - why not have Semagrams export functions from Catlab rather than making the user have to also write using Catlab? In the current Semagrams quickstart documentation section, it does not say that one has to also use Catlab.jl but for the tutorials to work, you do need it used. Doesn't seem like it would be an issue to re-export as it does not appear that Catlab overshadows or conflicts with Semagrams.
Only a suggestion for ease of use. Feel free to close!
~tcp

I would imagine this re-exporting would also solve issues as I saw here: https://github.com/AlgebraicJulia/Semagrams.jl/issues/45

The module usage in Catlab is a little bit nonstandard in the julia community. We definitely tend to keep things in more isolation than would be typical in a julia package. Since most users so far are developers of Catlab, having the imports explicit hasn't been too much of a problem and we have some desire to break up Catlab into smaller packages where these imports would be from different packages rather than from Catlab. But we keep running into places where this use of modules is unexpected by new users, so we will need to come to a resolution one way or the other soon.
I guess that semagrams could do the reexporting if it makes it easier on the users. @olynch, do you have any thoughts on it?

This issue is out of date as it refers to a different version of Semagrams.


Make account selection deterministic

Make it so, all other things being equal, accounts will be in the same order

Added with version v0.3.1


⚠ SceneTime has degraded performance

In a92b251, SceneTime ($ST) experienced degraded performance:

HTTP code: 200
Response time: 2810 ms

Resolved: SceneTime performance has improved in 0c74d88 after 12 minutes.


Spike: can we make the UUIDs more user friendly?

User Story

So that I can browse the Data Lake with the S3 API, as a Developer or Data Analyst, I want the directory names including the UUIDs to be as user friendly as possible.

This shouldn't replace other, richer ways to browse the data, e.g. via STAC files/API.
Acceptance Criteria

[x] Given that the S3 paths will be prefixed with human readable information, when a UUID is presented to the user, we know which style of UUID is as useable as possible by the end user (doesn't get in the way of reading the human readable part)
[x] Given the best UUID format is different from the current implementation, when we come to work on a user story to change it, then we have the information needed to make it 'ready'

Additional context

Potential problems
Tasks

[x] Research UUID formats - 2
[x] Decide which one is the least annoying to have as a suffix on names in the S3 path
[ ] Make any changes needed - 1

Definition of Ready

[ ] This story is ready to work on, according to the team's definition

Definition of Done

[ ] This story is done, according to the team's definition

Done in https://github.com/linz/geospatial-data-lake/pull/635


Server crash occur and corrupt the database when deleting data from a table when table have multiple triggers, functions defined.

Create a database and populate it with the attached sql file which has different tables, functions, triggers etc defined.
Now try to delete data from emp table. e.g.
delete from emp where mgr=7698;
A server crash will occur.
delete from emp where mgr=7698;
INFO:  Deleting employee 7499
INFO:  ..Old salary: 1600.00
INFO:  Deleting employee 7521
INFO:  ..Old salary: 1250.00
INFO:  Deleting employee 7654
INFO:  ..Old salary: 1250.00
INFO:  Deleting employee 7844
INFO:  ..Old salary: 1500.00
server closed the connection unexpectedly
This probably means the server terminated abnormally
before or while processing the request.
The connection to the server was lost. Attempting reset: Failed.
The connection to the server was lost. Attempting reset: Failed.
It will also corrupt the database and no other functionality will work on this database.
Here is the sql file.
pg_tde-sample.log

Server Log file
postgresql-Tue.log


Keep getting banned from discord 🤡

Can you make myuu grinder in python

??

Can you make myuu grinder in python

No


Update debugger.js DOM Text Interpreted As HTML

Description:
By using textContent it will avoid the risk of HTML injection, as these properties automatically escape any HTML special characters in the provided text. This helps prevent cross-site scripting (XSS) vulnerabilities by treating the input as plain text rather than interpreted HTML

Is this PR AI-generated? Please explain how a hardcoded string [console ready] can contain XSS... :)


Broken intellisense for mounted filesystem

I've got a broken intellisense for a mounted file system for VSCode. Though it works in older versions of TypeScript. Any thoughts on what is wrong?
Please check out:
https://github.com/Microsoft/vscode/issues/3160

@tinganho I see that you're having issues with the nightlies. Are you seeing issues with the release-1.8 branch? What about release-1.7?

release-1.8 does not work. release-1.7.5 works.

@DanielRosenwasser This was the the date when it didn't work<EMAIL_ADDRESS>So everything before that works.

And here is the PRs closed that day https://github.com/Microsoft/TypeScript/pulls?utf8=✓&q=is%3Apr+updated%3A2016-01-16+is%3Aclosed+

Is there anyway I can get the error output from VSCode? So I can get exactly what is wrong?

#6509 could very well be the source, though I could be wrong. You can select Toggle Developer Tools from the Help menu, but I don't know what you'll get out of that since TSServer runs out of process.

I have tried that already though it doesn't give me any error.
I was also thinking about that one.

Can you try running tsc --watch on the command line for a project and editing some files and see if it's detected/recompiled, or if you get any other errors or unexpected behavior this way?

@billti I'm getting:
fs.js:1315
    throw error;
    ^

Error: watch /users/tinganho/development/mount/library ENOENT
    at exports._errnoException (util.js:860:11)
    at FSWatcher.start (fs.js:1313:19)
    at Object.fs.watch (fs.js:1341:11)
    at addDirWatcher (/usr/local/lib/node_modules/typescript/lib/tsc.js:1007:39)
    at Object.addFile (/usr/local/lib/node_modules/typescript/lib/tsc.js:1022:21)
    at Object.watchFile (/usr/local/lib/node_modules/typescript/lib/tsc.js:1140:48)
    at Object.getSourceFile (/usr/local/lib/node_modules/typescript/lib/tsc.js:33897:49)
    at findSourceFile (/usr/local/lib/node_modules/typescript/lib/tsc.js:32763:29)
    at processSourceFile (/usr/local/lib/node_modules/typescript/lib/tsc.js:32715:27)
    at /usr/local/lib/node_modules/typescript/lib/tsc.js:32801:17

Maybe development/mount should be Development/Mount:

I also have a Library folder and not library. If that helps.

I feel that our useCaseSensitiveFileNames check for node case is incomplete. Do you know if you are using HFS+ or HFSX file system?

I use http://osxfuse.github.io/ on my Mac. I mount with sshfs on a local VM that has Ubuntu installed on it. And the repo I mount uses pascal case naming convention.
Don't know much about file systems.

Don't we decide based purely on OS whether to use case-sensitive filenames? I'm guessing if you mount a file-system different to the OS default, this logic is always going to fail:
            // win32\win64 are case insensitive platforms, MacOS (darwin) by default is also case insensitive
            const useCaseSensitiveFileNames = platform !== "win32" && platform !== "win64" && platform !== "darwin";

Yes, even for Darwin assumption that it is always case insensitive is incorrect - AFAIR HFS+ and HFSX will have different defaults. I was thinking if on darwin we should try to create a temp file and look it up with a different casing

Though it does not really help if case sensitivity changes between volumes

To test the case sensitivity on mac, can we change the casing of the first file opened and call something like fileExists to see if the file still exist?

I'm having the same issue. I have a case sensitive mac.

I have also a case sensitive mac and this problem. It has to be fixed on site of typescript. It must be checked with fileExists or something and not on process.platform() !== "darwin", because you can have different volumes on your mac.
First i thought the problem is on Node.js, because the process.platform() don't differentiate on darwin case sensitive or case insensitive. But actually platform is right. It has nothing todo with the actual filesystem.
In Typescript Version 1.7.5 there is no Problem with CaseSensitivity because the filename and not the path is taken and in one case the variable useCaseSensitiveFileNames doesn't matter at all.

// win32\win64 are case insensitive platforms, MacOS (darwin) by default is also case insensitive
const useCaseSensitiveFileNames = platform !== "win32" && platform !== "win64" && platform !== "darwin";

I just treat all TypeScript project files as case sensitive (i.e take care in tsconfig.json and any import / references). After all they are case sensitive on Git / git checkout so helps to make sure you can checkout on any and all file systems / operating systems. I have the same assumption in the devtools I write for TypeScript :rose:

@tinganho can you give #7658 a try? As I don't have the mounted environment. Thank you!

@zhengbli I pulled it down. It seems to work now. At least for my case.

@tinganho Thanks!

Actually I have pretty the same issue on OSX(10.11.4 (15E65))
tsc -w
fs.js:1315
    throw error;
    ^

Error: watch /users/ivan-zakharchuk/documents/my-proj ENOENT
    at exports._errnoException (util.js:890:11)
    at FSWatcher.start (fs.js:1313:19)
    at Object.fs.watch (fs.js:1341:11)
    at addDirWatcher (/Users/ivan-zakharchuk/.npm-packages/lib/node_modules/typescript/lib/tsc.js:1036:39)
    at Object.addFile (/Users/ivan-zakharchuk/.npm-packages/lib/node_modules/typescript/lib/tsc.js:1051:21)
    at Object.watchFile (/Users/ivan-zakharchuk/.npm-packages/lib/node_modules/typescript/lib/tsc.js:1172:48)
    at Object.executeCommandLine (/Users/ivan-zakharchuk/.npm-packages/lib/node_modules/typescript/lib/tsc.js:34532:44)
    at Object.<anonymous> (/Users/ivan-zakharchuk/.npm-packages/lib/node_modules/typescript/lib/tsc.js:34863:4)
    at Module._compile (module.js:413:34)
    at Object.Module._extensions..js (module.js:422:10)

Hope @tinganho will be able to look at this issue and reopen it.

Downgrade to 1.7.5 - fixes this problem.

@ivanzvakoms I don't think the working version is released yet. You probably have to use typescript@next.
As you can see the milestone is marked for 2.0.

@tinganho yeah, I see. I just noticed this bug which is connected to ver >1.7.5 and If I understand correctly, because of some regression this issues is happening on newest versions now(in typescript@next as well).

I haven't experience any regression. So have you ran?
npm install typescript@next -g

and then:
tsc -w

today?

yes, I've run this today, and error is the same as described above.

OK tsc -w doesn't work for me either.
But the intellisense from VSCode does.

I've got an error like bellow.
I use Mac on casesensitve root filesystem.
so I made a incasesinsive volume and mounted it. but it didn't work.
$ node -v
v5.11.1

$ tsc -v
Version 1.8.10

$ npm test

><EMAIL_ADDRESS>test /Volumes/quickstart/quickstart
> tsc && concurrently "tsc -w" "karma start karma.conf.js"

[0] fs.js:1425
[0]     throw error;
[0]     ^
[0]
[0] Error: watch /volumes/quickstart/quickstart ENOENT
[0]     at exports._errnoException (util.js:953:11)
[0]     at FSWatcher.start (fs.js:1423:19)
[0]     at Object.fs.watch (fs.js:1450:11)
[0]     at addDirWatcher (/Volumes/quickstart/quickstart/node_modules/typescript/lib/tsc.js:1036:3```

the error says that couldn't find "/volumes/quickstart/quickstart".

actuall path was...

```bash
$ pwd
/Volumes/quickstart/quickstart

so I've make a symbolic link for it.
sudo ln -s /Volumes /volumes

it works well just for now.
$ npm test

><EMAIL_ADDRESS>test /Volumes/quickstart/quickstart
> tsc && concurrently "tsc -w" "karma start karma.conf.js"

it seems work well.

@kazuhiko-hotta can you test using the nightly? The fix was merged in master, it wasn't ported to 1.8 yet.

Hey guys,
I'm with a problem about ENOENT in my project using Version 1.8.10.
How I can resolve? someone can help me, please?
this is problem:
Error: watch /users/pedropolisenso/applications/b2w/simple-basket-api ENOENT     at exports._errnoException (util.js:953:11)     at FSWatcher.start (fs.js:1423:19)     at Object.fs.watch (fs.js:1450:11)     at addDirWatcher (/Users/pedropolisenso/Applications/b2w/simple-basket-api/node_modules/typescript/lib/tsc.js:1036:39)     at Object.addFile (/Users/pedropolisenso/Applications/b2w/simple-basket-api/node_modules/typescript/lib/tsc.js:1051:21)     at Object.watchFile (/Users/pedropolisenso/Applications/b2w/simple-basket-api/node_modules/typescript/lib/tsc.js:1172:48)     at Object.executeCommandLine (/Users/pedropolisenso/Applications/b2w/simple-basket-api/node_modules/typescript/lib/tsc.js:34546:44)     at Object.<anonymous> (/Users/pedropolisenso/Applications/b2w/simple-basket-api/node_modules/typescript/lib/tsc.js:34877:4)     at Module._compile (module.js:541:32)     at Object.Module._extensions..js (module.js:550:10)

I run this command using npm run build-watch - "build-watch": "tsc -w --pretty",

@pedropolisenso is it possible for you to test using the nightly version of the compiler? The fix was merged in master but not ported in 1.8. You can using:
  "dependencies": {
    "typescript": "^1.9.0-dev.20160531-1.0"
  }

in your package.json.

I tested with TypeScript nigtly build.
    "typescript": "^1.9.0-dev.20160603-1.0",

removed the trick that I did before.
sudo rm -f /volumes
ls -l / | grep -i volumes

drwxrwxrwt@  4 root  admin   170  6  3 19:40 Volumes

checked "npm test" again.
% npm test

><EMAIL_ADDRESS>test /Volumes/quickstart/quickstart
> tsc && concurrently "tsc -w" "karma start karma.conf.js"

[1] 03 06 2016 20:39:12.405:WARN [watcher]: Pattern "/Volumes/quickstart/quickstart/app/**/*.html" does not match any file.
[1] 03 06 2016 20:39:12.412:WARN [watcher]: Pattern "/Volumes/quickstart/quickstart/app/**/*.css" does not match any file.
[1] 03 06 2016 20:39:13.245:WARN [karma]: No captured browser, open http://localhost:9876/
[1] 03 06 2016 20:39:13.265:INFO [karma]: Karma v0.13.22 server started at http://localhost:9876/
[1] 03 06 2016 20:39:13.277:INFO [launcher]: Starting browser Chrome
[0] 20:39:14 - Compilation complete. Watching for file changes.
[1] 03 06 2016 20:39:14.914:INFO [watcher]: Changed file "/Volumes/quickstart/quickstart/app/app.component.js".
[1] 03 06 2016 20:39:14.947:INFO [watcher]: Changed file "/Volumes/quickstart/quickstart/app/main.js".
[1] 03 06 2016 20:39:14.962:INFO [watcher]: Changed file "/Volumes/quickstart/quickstart/app/app.component.spec.js".
[1] 03 06 2016 20:39:15.178:WARN [karma]: No captured browser, open http://localhost:9876/
[1] 03 06 2016 20:39:15.429:INFO [Chrome 51.0.2704 (Mac OS X 10.11.5)]: Connected on socket /#sxj38cAB15UjpQmWAAAA with id 41710968
    Chrome 51.0.2704 (Mac OS X 10.11.5): Executed 3 of 3 SUCCESS (0.184 secs / 0.166 secs)

it works.
Thanks @zhengbli :-)

IntelliSense still not working for me on Sublime 3 with a project on a mounted filesystem under OSX El Capitan with Sublime 3 (build 3126) with tsc -v Version 2.0.3.
I copied the project folder to the local drive and everything is fine. While opening from the remote filesystem (which is a Raspberry Pi folder mapped through Netatalk as a local volume) IntelliSense is not working at all. No errors in the Sublime console but autocompletion is not working, for example.
I tried @kazuhiko-hotta 's solution with the symlink, I changed the paths to be fully lower case, set node_path in user settings, tried other solutions but to no avail.
I use nvm on both systems and Node is high enough on both ends (v5.x on the Mac, v6.x on the RasPi). TypeScript is up to date, so are all my Sublime packages.
Any clue on how could I debug this and see what's wrong?


Use exec() function in both Python 2 and Python 3

Legacy exec statements are syntax errors in Python 3 but exec() function works as expected in both Python 2 and Python 3.
This PR attempts to solve a corner case described in https://github.com/facebook/bistro/pull/34#issuecomment-513992204 where having a dict comprehension inside an exec() function call can be problematic.
@snarkmaster

I'll be merging this promptly.
I had to further fix this up since the patch still didn't pass the test case I gave on the prior PR:
$ ./cmake/targets_to_cmake_lists.py .
  File "./cmake/targets_to_cmake_lists.py", line 166
    exec(s, fn_locals)
SyntaxError: unqualified exec is not allowed in function 'parse_targets' it contains a nested function with free variables


Add support for creating containerd based VMs to CT

This PR tries to solve #2 which was an example of a VM that had an installation of Docker that was being converted to a CT via proxmox-vm-to-ct but the default  configuration does not support that use case.

This PR introduces a new default configuration for these scenario where containerd is installed on VM to enable:

Privileged Container
Features: nesting & keyctl

These are activated when you use the --default-config-containerd or the --default-config-docker switch.
proxmox-vm-to-ct.sh --source <IP_ADDRESS> \
                      --target the-matrix-reloaded \
                      --storage local-lvm \
                      --default-config-docker

After this PR and using the switch above:

The documentation states:

Ideally we would want to use unprivileged: 1 but that won't work with this scenario.

thank you this change fixes our dietpi9 VM to CT with docker compared to main. please see our comments in your issue.


Rollup canonicalization handling

Hi,
I have troubles trying to import a third party library in a SFX bundle. The project structure is:
src/myClass.js
import Lib from 'external-lib'

node_modules/external-lib/external-lib.js
module.exports = function() { ... }

system.config.js
(function () {
    var isNode = typeof window === 'undefined';

    System.config({
        baseURL: '.',
        transpiler: 'plugin-babel',
        defaultJSExtensions: true,
        format: 'esm',
        packages: {
            './node_modules/external-lib': {
                main: 'external-library.js',
                format: 'cjs'
            },
        },
        paths: {
            'plugin-babel': './node_modules/systemjs-plugin-babel/plugin-babel.js',
            'systemjs-babel-build': './node_modules/systemjs-plugin-babel/systemjs-babel-' + (isNode ? 'node' : 'browser') + '.js',
            'external-lib': './node_modules/external-lib',
        }
    });
})();

The output is:
$__System.registerDynamic("2", [], true, function($__require, exports, module) {
    // Library body
    return module.exports;
});

$__System.register("1", ["external-lib"], function($__export) {
    // myClass body
});

It fails because the external library has been registered as module "2", while the dependency of "1" is still "external-lib".
Am I missing something?
Really thanks for your job!

Which version of SystemJS builder are you using here? Is there anyway you can share an isolated replication of the build you ran to get this output?

SystemJS Builder version: 0.15.3
Here the sample: https://plnkr.co/edit/lLROSd38oMzlTwfBpcRa
Thanks @guybedford

@edoardocavazza do you have a test case of how you created this build file?

@guybedford I have created a repo from the plunker above: https://github.com/edoardocavazza/systemjs-test-case
You can run npm install && node build.js to bundle the source.

Thanks so much, that helped to track this down.
It turns out this is something a little more general which I will track here, which is that the rollup process needs to recanonicalize the dependencies in https://github.com/systemjs/builder/blob/master/lib/rollup.js#L274, and include the normalized depMap with externals.
To work around the issue set rollup: false in the build options.

Released in 0.15.8.


How are the ACCESS_EXP_LENGTH and REFRESH_EXP_LENGTH values used?

The docs reference ACCESS_EXP_LENGTH and REFRESH_EXP_LENGTH app config variables, but the only place I can find a reference to them is in the examples and conftest.py. Are these used by a dependency? Or should we use the JWT_ACCESS_TOKEN_EXPIRES and JWT_REFRESH_TOKEN_EXPIRES instead?

Thanks for issue!
That's my bad. We use JWT_ACCESS_TOKEN_EXPIRES and JWT_REFRESH_TOKEN_EXPIRES , not ACCESS_EXP_LENGTH and REFRESH_EXP_LENGTH. Could you open PR to update examples and conftest?


reverseproxy subfolder

Hello,
I am using Nginx in a docker, I also have the amongusbot hosted in a docker. The amongusbot is fully accessible and reachable via port, although I would like to configure this to work with proxy so I can close the port ofc.
the specific nginx docker that I'm using is "linuxserver/swag"
This docker has many pre-built templates for subdomain and subfolder for various apps that are commonly used, In creating this I decided I would copy the mylar subfolder template.
the docker running the discord bot is named "dbot" and port is set to "8123"
The nginx docker and discordbot are both set to run on the same bridge network that I have created.
After editing the template for mylar proxy through subfolder it looks like this.

I have also tried ## out the proxy_pass line that's there and creating a new one using the docker ip:port, both of these give me same result, when trying to connect with the Among Us Capture Client I get an error code 200.
Looking for some assistance to get this set up and working, thank you.

Something I just noticed, If I go to connect the captureclient without specifying a port, I get error code 200 no matter what. If I set this even to an incorrect port, I do not get the error code 200, which is leaving me to believe that the among us capture client is not capable of making a connection if a port is not specified. Although I see there are subdomain proxy's that go through. So I'm not sure.
To replicate what I'm seeing open the capture client, open the manual connection window and with any code in the box make the host "https://facebook.com" vs "https://facebook.com:1",
in this scendario just using facebook.com immediately comes back with status code 200, (the error I'm getting) and putting :1 at the end takes a bit to timeout, but ultimately tells me one or more errors occured and that it is unable to connect.

Further testing revealed that what I wrote above does not apply whatsoever.
The domain I am using ends with a .club instead of the usual .com, I tested using my domain although changed .club to .com to see the capture client's reaction, and it did attempt to connect. Although when I put .club back, it immediately gives error code 200.

Really don't think this belongs in this project. It's not anything unique to the bot.

I would say this is specific to the bot.
For HOST= I can't put in a domain name with a /subfolder as the bot errors and see's a problem with it.
I have multiple reverse proxy's working on other machines without issues, I am unable to connect to this bot, because either the way the capture client is set to connect, or because of how the bot is set to receive connections. I am doing nothing more than trying to point out the issues that are preventing me from connecting to this specific bot.
I am quite sure my current proxy setup is correct, as the bot is unable to set a / base url
This would not go in an nginx forum, nginx works fine and can forward subfolders fine
This would not go in to the docker forum, as this docker is doing exactly what it's supposed to be doing and I'm using it with other applications on other servers.
So this should go here because this issue is specific to this application. If you have a better idea of where this "should go" please inform me.

Yeah paths like https://reverse-proxy.com:443/path are not supported. Reverse proxy support right now is limited to redirecting from the base / path on a different port, but not subdomain paths. Happy to accept a PR that introduces this (it would be a reconfiguration of the regex specified here: https://github.com/denverquane/automuteus/blob/master/discord/message_handlers.go#L34), but it's not a priority of mine, personally.

Had a quick play and couldn't get it to work unfortunately.
Since this uses web sockets you will also probably need the following if you do find a way to make it work
proxy_set_header Upgrade $http_upgrade;
proxy_set_header Connection "upgrade";
proxy_hide_header X-Frame-Options;


Learn about numerical integration

Review research articles and books to get a better understanding of different applications of common numerical integration tools.

Finished reading through Numerical Methods by Robert Hornbeck.
Synopsis of chapter 8:

Numerical integration (a.k.a. numerical quadrature) is used to approximate the definite integral when an analytical solution is difficult or impossible to obtain.
Common techniques include Trapezoidal Rule, Simpson's Rule, and Gaussian Quadrature.

Trapezoidal Rule: a simple method that provides a good approximation for many functions.
Simpson's Rule: uses parabolic segments instead of linear ones to approximate the area. Provides a higher accuracy compared to the trapezoidal rule (particularly for smooth functions).
Gaussian Quadrature: uses specially chosen sample points and weights.

Error analysis is particularly important when considering numerical integration. The rate of convergence differs drastically between methods so it is important to understand which quadrature would be most appropriate in each scenario.
Adaptive quadrature methods adjust the number of subdivisions dynamically based on the function's behavior. They can refine the partitioning where the function changes rapidly and coarsen it when the function is smooth.
The best method for dealing with singularities is to eliminate them if possible. However, if this proves to be impossible, the book claims that the Gauss quadrature approach if used with care can yield quite accurate results in most cases. Note: it will not work if the function is oscillatory in the region considered.

Introduction to Numerical Analysis by F.B. Hildebrand (second edition):
Error analysis can be quite complicated. There are many considerations to make when rounding an infinite sig fig number and depending on your tolerance, your approximation might be significantly hindered by this rounding.
Chapter 4: Finite-difference Interpolation
Finite-difference interpolation is used to estimate values of a function at points where it is not explicitly known. It leverages known values of a function at discrete points to construct an interpolating polynomial.
Forward difference -- Del f(x_i) = f(x_i+1) - f(x_i)
Backward difference -- nabla f(x_i) = f(x_i) - f(x_i-1)
Central difference -- del f(x_i) = 1/2 * (f(x_i+1) - f(x_i-1))
Special formulas like Stirling's, Bessel's, and Everett's are used for more efficient computation and/or higher accuracy.
The technique used should be based on the data distribution and desired accuracy. Precomputed tables enhance efficiency and reduce error.
Chapter 5: Operations with Finite Differences
Euler-Maclaurin Sum Formula connects summation and integration. There are many variations of this and can lead to simplifications such as the trapezoidal rule and the repeated midpoint rule.

Chapter 6: Numerical Solution of Differential Equations
Open-type -- domain extends beyond the range of the data
Closed-type -- data points at the beginning and end of the limits of integration are known
Simplest procedure is Euler's method: y_n+1 = y_n + h*f(x_n,y_n)
More complicated equations such as the Adams-Bashforth method where several levels of differences are calculated and considered when computing the value in question.
Runge-Kutta method. There are variations such as order 2 and order 4. Here is one variation of this formula and performs far better than Euler's method for complicated functions.

Chapter 8: Gaussian Quadrature and Related Topics
Gaussian quadrature is a numerical method for approximating integrals using weighted sums at specific points (abscissas).
Hermite interpolation -- polynomial interpolation that includes both function values and derivate values at selected points.
Legendre-Gauss quadrature - a type of Gaussian quadrature using Legendre polynomials as basis functions.
Laguerre-Gauss quadrature - uses Laguerre polynomials and their roots. Effective for integrals involving exponential weight functions.
Hermite-Gauss quadrature - Hermite polynomials and their roots with Gaussian weight functions.
Formulas with preassigned abscissas:

Radau quadrature -- uses one endpoint of the integration interval as an abscissa.
Lobatto quadrature -- uses both endpoints of the integration interval as abscissas.

An Introduction to Numerical Analysis by Endre Süli and David Mayers:

Numerical Linear Algebra by Lloyd N. Trefethen and David Bau III:


Alpha Minting tool output should be in upper case

Issue
When we print the minting data with the Alpha minting tool, the resources should be in upper cases, as @xmonader mentioned.

Did you manage to check the new minting reports interface? On staging.dashboard.dev.grid.tf or https://dashboard.bknd1.ninja.tf/?

Did you manage to check the new minting reports interface? On staging.dashboard.dev.grid.tf or https://dashboard.bknd1.ninja.tf/?

Good point. On the latest versions it is in upper case. Closing the issue. Thanks!


feat: polished responsive styles

export utils from lib separately to simplify using components on both server and client
show copy code button on group hover and on specific focus to avoid button overlapping content
adds includeResult prop to Image POC

:tada: This PR is included in version 1.3.0 :tada:
The release is available on:

GitHub release
npm package (@latest dist-tag)

Your semantic-release bot :package::rocket:


New Tabbar Theme

Added my modern tabbar theme.

Wait this theme isnt good with module/tabbed

fixed! looks very hot btw...

I removed the min and float buttons, as they did not work for some reason (idk lol).
I also added the client icon.

fixed the margins a little to match properly


GoCenter has gone

https://jfrog.com/blog/into-the-sunset-bintray-jcenter-gocenter-and-chartcenter/

@floryut I'll merge this PR because the other PR has failed tests in CI.

@floryut I'll merge this PR because the other PR has failed tests in CI.

No problem man 👍


[JN-787] Adding myself as a superuser

DESCRIPTION
This PR adds me as a superuser in the dev so I can use my own email to login and test
TO TEST:  (simple manual steps for confirming core behavior -- used for pre-release checks)
repopulate the users in a clean database and try logging in with my email

merging since Pegah is out today


Adding advanced documentation

Closes: #684
Changes proposed in this PR:

Create new documentation folder
Create a .md file for advance features/ settings
Document RBAC server
Document Free pricing
Document allow / deny lists in the DDO

@mihaisc Thank you for the review, I have integrated your feedback

@kremalicious thanks a lot for the feedback, I have integrated your suggestions.


Change emulator.settings to settings

closure compiler fails.
I'm assuming it should be settings, in either case closure compiler compiles and it works.

Thanks.


CAMEL-11345: Remove dependency on spring-core from gRPC component

This is PR on top of the camel-2.19.1

Is there something on my end, but just got this compile error on the 2.19.x branch
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.6.1:compile (default-compile) on project camel-grpc: Compilation failure: Compilation failure:
[ERROR] /Users/davsclaus/workspace/camel/components/camel-grpc/src/main/java/org/apache/camel/component/grpc/GrpcUtils.java:[62,56] error: cannot find symbol
[ERROR]   symbol:   method findMethod(Class,String,Class[])
[ERROR]   location: class ReflectionHelper
[ERROR] /Users/davsclaus/workspace/camel/components/camel-grpc/src/main/java/org/apache/camel/component/grpc/GrpcUtils.java:[78,40] error: cannot find symbol
[ERROR]   symbol:   method findMethod(Class<CAP#1>,String,Class[])
[ERROR]   location: class ReflectionHelper
[ERROR]   where CAP#1 is a fresh type-variable:
[ERROR]     CAP#1 extends Object from capture of ? extends Object
[ERROR] /Users/davsclaus/workspace/camel/components/camel-grpc/src/main/java/org/apache/camel/component/grpc/GrpcUtils.java:[102,40] error: cannot find symbol
[ERROR]   symbol:   method findMethod(Class<CAP#1>,String,Class[])
[ERROR]   location: class ReflectionHelper
[ERROR]   where CAP#1 is a fresh type-variable:
[ERROR]     CAP#1 extends Object from capture of ? extends Object
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

with this PR merged

I have not rebuild 2.19.x branch but it pulled down the ASF SNAPSHOT JARs.

Yes that was the problem, after rebuild locally it works.

Thanks for the PR it has been merged. Do you mind closing this?

Thanks, PR closed


Fix container aggregation

Fixes #817

Can one of the admins verify this patch?

Sample, before/after:

LGTM


how to specify agent rotation in pointnav task ?

❓ Questions and Help
HI, i am working on a modified pointnav task and i would like my agent to not only navigate to the correct position in the environment but also turn into a certain direction/orientation. I have successfully trained a normal pointnav task and looked into the jsons for object goal task so now i see 2 possible options:

modify the json to include a goal rotation (in addition to position and radius) and try to modify the code so it is used for the reward check (i guess there will have to be a range requirement like the radius for the position)
add a measure for the correct rotation and call it when the reward is computed
If anyone is working on something similar or has suggestions please let me know.
thank you

In case anyone else stumbles upon this and wants to do this too - i registered an additional rotational measure that is called in habitat_baselines.common.environments.NavRLEnv.get_reward and it seems to work out. Im pretty sure its not the clean way to do it though.

Similar logic was implemented for ImageNav task implementation and you can check it here. To avoid editing the PointNav dataset goal rotation was set as random rotation using random seed equal to episode_id. That guarantees consistent goal orientation across episodes.
Then you will need to implement reward changes anyway.


 tag support

@fabiobatalha can you give me an example of the usage of the history tag? Which date-types are you using at SciELO? I'm asking because I want to build a UI for editing the history and would use some predefined date-types which can just be filled out.
Here's what I currently put into our kitchen_sink.xml:
      <history>
        <date date-type="received" iso-8601-date="1998-01-05">
          <day>05</day>
          <month>01</month>
          <year>1998</year>
        </date>
        <date date-type="rev-request" iso-8601-date="1998-03-14">
          <day>14</day>
          <month>03</month>
          <year>1998</year>
        </date>
        <date date-type="rev-received" iso-8601-date="1998-05-24">
          <day>24</day>
          <month>05</month>
          <year>1998</year>
        </date>
        <date date-type="accepted" iso-8601-date="1998-06-06">
          <day>06</day>
          <month>06</month>
          <year>1998</year>
        </date>
      </history>

@michael also have a look at the spec: https://jats.nlm.nih.gov/archiving/tag-library/1.1/attribute/date-type.html

So I'd recommend to support the suggested date-types: accepted,corrected,pub,preprint,retracted,received,rev-recd,rev-request

I'd allow selecting those pre-defined date-types using a dropdown. Maybe like this?

We can then implement a HistoryComponent which implements the UI and logic.

Sounds good

@michael @oliver----
Here at SciELO we are using these date types: received (ok), accepted (ok) and rev-recd
where rev-recd = reviewed status.
I will check if rev-recd is the same of rev-received.
The attribute iso-8601-date is not mandatory for us once we can produce any format from the day, month and year elements.

Done.


cannot build realsense/wrappers/opencv/kinfu with cmake

Required Info

Camera Model
D435i

Firmware Version
(Open RealSense Viewer --> Click info)

Operating System & Version
win11

Platform
PC

SDK Version
librealsense2

Language
{C opencv }

Segment
Robot

Issue Description
when i follow the rs-kinfu Sample installation steps to run the expample,but fail to build.
My CMake file is:
Internet connection identified
Info: REALSENSE_VERSION_STRING=2.50.0
Setting Windows configurations
Building libcurl enabled
using RS2_USE_WMF_BACKEND
Found OpenCV: C:/Project/opencv4.5.4/opencv/newbuild (found version "4.5.5")
Downloading MobileNetSSD_deploy.prototxt into C:/Project/librealsense/newbuild/wrappers/opencv/dnn
Downloading MobileNetSSD_deploy.caffemodel into C:/Project/librealsense/newbuild/wrappers/opencv/dnn
CMake Error at wrappers/opencv/kinfu/CMakeLists.txt:6 (find_package):
By not providing "Findglfw3.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "glfw3", but
CMake did not find one.
Could not find a package configuration file provided by "glfw3" (requested
version 3.3) with any of the following names:
glfw3Config.cmake
glfw3-config.cmake

Add the installation prefix of "glfw3" to CMAKE_PREFIX_PATH or set
"glfw3_DIR" to a directory containing one of the above files.  If "glfw3"
provides a separate development package or SDK, be sure it has been
installed.
Configuring incomplete, errors occurred!
See also "C:/Project/librealsense/newbuild/CMakeFiles/CMakeOutput.log".
i already build the expamples with no kifu once,it didn't show this problem.
what shold i can do

Hi, how did you fix it?


Please add 2 bool cmake entries for cmake-gui

Hi, I think may be add these 2 entries for cmake-gui is better for users build from scratch.
BUILD_SHARED_LIBS: bool, for users who want static or shared builds.
BUILD_PROGRAMS: bool, for users who want library builds only.

BUILD_SHARED_LIBS is a CMake internal option, and should thus be exposed when you set the GUI to show external libraries. Please correct me if I'm wrong, I'm not using the gui.
vvdecapp is super lightweight so I don't think there is need to skip building it. It is not being installed anyways.

Actually, it's a common choice to put frequently used entries into cmake-gui, like BUILD_SHARED_LIBS, BUILD_PROGRAMS. Just for convenience.
Here is what entries libfdk-aac put in camke-gui by default. As shown below, BUILD_SHARED_LIBS and BUILD_PROGRAMS are added.


Support for HTTP reason phrases

This could arguably be classified as a bug rather than a feature request.
Requests doesn't, as far as I can see, supply an API to return the server's HTTP reason phrase. What it instead supplies is an API that will return its own stringification of the server's HTTP status code.
While in many cases these will probably be the same, I am writing a reverse proxy, so I want to return to my client exactly what the origin server supplied to me.
For example, if the origin server said "200 Everything Is Awesome" instead of the more common "200 OK", then I want to return precisely "Everything Is Awesome" (not "OK") to my client in my reason phrase.
Note that the HTTP RFCs permit origin servers to supply custom reason phrases:

The reason phrases listed here are only
recommendations -- they MAY be replaced by local equivalents without
affecting the protocol.

By my reading, the HTTP RFCs permit anyone to supply any bytes they like other than CR and LF in this 'reason phrase', and still comply with HTTP.

My point in that last paragraph is that I don't see a way in the RFCs for the server to specify a character set or encoding for its "reason phrase", yet arbitrary bytes seem to be permitted, so either this should be exposed as Python bytes not a Python string, or perhaps there should be a documented WONTFIX bug that the encoding is always assumed to be ASCII-7, or one of the ISO8859 extended ASCIIs, or maybe UTF-8.

We pull the Response.reason attribute from urllib3's Response. That said,

Requests doesn't, as far as I can see, supply an API to return the server's HTTP reason phrase.

Is clearly wrong.
Python 3.6.5 (default, Mar 29 2018, 18:20:46)
[GCC 8.0.1 20180317 (Red Hat 8.0.1-0.19)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import requests
>>> requests.get("https://httpbin.org/status/418").reason
"I'M A TEAPOT"

And I can assure you that's not a standard reason. You can also access the original reason phrase from urllib3:
>>> requests.get("https://httpbin.org/status/418").raw.reason
"I'M A TEAPOT"
>>>


Python binding names: Pythonic, or consistent?

For the Python bindings, we now have Pythonic equivalents to the C++ codebase. To understand what that means: the method Individual::hasExcessCapacity() is available on the Python side as Individual.has_excess_capacity().
The upside of this is that we follow best formatting practices on both sides (camelCase in C++, PEP8/snake_case in Python). The downside is that the method names no longer agree.
Do we want the Python bindings to be Pythonic, or consistent with the C++ codebase?

We're doing all this 'Pythonic'.


Added Main site & Privacy Policy

Added Main site content & routes.

Note: @jaydeepukani create app-layout for main site aswell.

Invalid PR

only 3k files. ok?


lib.modules: support strings with absolute paths in disabledModules

Copy of commit message
This is particularly useful for disabling modules defined in a flake.
Example:
disabledModules = [ "${flake}/modules/mymodule.nix" ];

Previously, absolute string paths were internally prepended with modulesPath, which caused the module filtering to fail.
Discussion
A workaround for disabling a flake module is to convert the string to a path, which
requires discarding the string context:
disabledModules = [ (/. + (builtins.unsafeDiscardStringContext "${flake}/modules/mymodule.nix")) ];

Here is a flake which demos this fix:
nix eval --no-write-lock-file github:erikarvstedt/flake-disable-modules#before
# error: module2.nix was included
nix eval --no-write-lock-file github:erikarvstedt/flake-disable-modules#after
# Success

Note: --no-write-lock-file is required due to https://github.com/NixOS/nix/issues/6352

Seems like a good idea.
Please add a test case in lib/tests/modules.sh.
I think we'll also want to support modules that have a key attr at some point. A little trickier, but seems feasible. Not something you have to do now, unless you feel like it. I think you'd have to invoke the module with specialArgs and throw (msg attrName) values for the functionArgs of the module.

@roberth, this is now fixed (just in case you didn't get a commit notification).


Metrics: can we link the distinction between device type to duration of visit

As:
HIA coordinator at HQ
I want to:
Know what the average duration of a HIA visit is, without the average being higher because Aid Workers (i.e. active on the Helpdesk) have it open in a tab for a long time
So that I:
Can say more about the relevance and usefulness of the information that is on HIA

See https://learn.microsoft.com/en-us/azure/azure-monitor/app/javascript?tabs=snippet#enable-time-on-page-tracking


pca_projection in Main_PCA_Colors.m

Unfortunately, this function
pca_projection

gives the same error message
Unrecognized function or variable 'pca_projection'.

However, I have observed that there is a pca_projection_2.m file.
Can I replace the function pca_projection with pca_projection_2 instead ?

Use this one please.
On Fri, Nov 25, 2022 at 12:47 PM Jeremy Selva @.***>
wrote:

Unfortunately, this function
pca_projection
gives the same error message
Unrecognized function or variable 'pca_projection'.
However, I have observed that there is a pca_projection_2.m file.
Can I replace the function pca_projection with pca_projection_2 instead ?
—
Reply to this email directly, view it on GitHub
https://github.com/eelhaik/PCA_critique/issues/7, or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACXRSULLJDUSFADMXJHFZN3WKCRNVANCNFSM6AAAAAASLHUNZI
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

% pca_projection
% Projecting new color
% In order to represent a new point in the principal component space created by the original data, there are two steps:
% 1.  Subtract the mean of the original data from the new point.
% 2.  Multiply the result by the coefficients of the principle components.
% M_ is the new dataset to be projected on M.
% M is the original dataset
% M_ = single(Data_clear(PopA_indexes(:), Fewer_SNPs));
% M = single(Data_clean(:, Fewer_SNPs));
function [y, Y]= pca_projection(M_, M, handle_missingness)
if nargin==2
    handle_missingness=0;
end;

threshold = 0.3;

%pca_projection doesn't like data without a variation
[~,c1] = find(var(M_,1)==0);
[~,c2] = find(var(M,1)==0);

disp(['pca_projection: Removing ' num2str(numel([c1 c2])) ' out of ' num2str(numel(M(:))./min(size(M)))]);
M_(:,[c1 c2])=[];
M(:,[c1 c2])=[];

%Here, M is being centered and standardized.
%PCA returns the principal components based on the correlation matrix.
%Note, this function cannot take NaN
[W, Y] = pca(M, 'VariableWeights', 'variance', 'Centered', true);

%     plot(Y(:,1), Y(:,2),'.')
% Calculate the orthonormal coefficient matrix (check that W*W' = I)
W = diag(std(M))\W;

% Getting mean and weights of data (for M_)
[~, mu, sigma] = zscore(M);
sigma(sigma==0) = 1;

% New point in the original system
x = M_;
x = ***@***.***,x, mu);
x =<EMAIL_ADDRESS>x, sigma);

% New coordinates as principal components

%     y0 = Y(1,:); % point we should get in result
%handle missing values
if handle_missingness
    disp('Removing missing columns...')
    indexes_to_remove = (sum(~isnan(x))./size(x,1)) < threshold;
    x(:,indexes_to_remove) = [];
    W(indexes_to_remove,:) = [];
    disp([num2str(size(W,1)) ' columns remained']);

    %impute missing values in x
    disp('Imputing the missing values in the remaining columns...');
    for i=1:size(x,2)
        curr_x = x(:,i);
        values_to_impute = unique(curr_x(~isnan(curr_x)));
        num_of_values_to_impute = numel(curr_x(isnan(curr_x)));
        p = randsample(numel(values_to_impute), num_of_values_to_impute, 1);

        curr_x(isnan(curr_x)) = values_to_impute(p);
        x(:,i) = curr_x;
    end;
end;

y = (x*W); % our result

if isempty(y)
    error_message('pca_projection: y is empty');
end;

end

Hi,
I have tried to run the function pca_projection provided.
However, it gives an error saying
Error: File: pca_projection.m Line: 45 Column: 9
Invalid use of operator.

Looking at around line 45
% New point in the original system
x = M_;
x = ***@***.***,x, mu);
x =<EMAIL_ADDRESS>x, sigma);

Is a bracket missing in x = ***@***.***,x, mu);  ?

Something is wrong with your file
[image: image.png]
Here it is again
the code is running fine.
On Sat, Nov 26, 2022 at 3:07 AM Jeremy Selva @.***>
wrote:

Hi,
I have tried to run the function pca_projection provided.
However, it gives an error saying
Error: File: pca_projection.m Line: 45 Column: 9
Invalid use of operator.
Looking at around line 45
% New point in the original system
x = M_;
x = @.,x, mu);
x = @., x, sigma);
Is a bracket missing in x = @.***,x, mu); ?
—
Reply to this email directly, view it on GitHub
https://github.com/eelhaik/PCA_critique/issues/7#issuecomment-1327960178,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACXRSUMDNC5Z5FCBNAH4EMDWKFWF7ANCNFSM6AAAAAASLHUNZI
.
You are receiving this because you commented.Message ID:
@.***>

% pca_projection
% Projecting new color
% In order to represent a new point in the principal component space created by the original data, there are two steps:
% 1.  Subtract the mean of the original data from the new point.
% 2.  Multiply the result by the coefficients of the principle components.
% M_ is the new dataset to be projected on M.
% M is the original dataset
% M_ = single(Data_clear(PopA_indexes(:), Fewer_SNPs));
% M = single(Data_clean(:, Fewer_SNPs));
function [y, Y]= pca_projection(M_, M, handle_missingness)
if nargin==2
    handle_missingness=0;
end;

threshold = 0.3;

%pca_projection doesn't like data without a variation
[~,c1] = find(var(M_,1)==0);
[~,c2] = find(var(M,1)==0);

disp(['pca_projection: Removing ' num2str(numel([c1 c2])) ' out of ' num2str(numel(M(:))./min(size(M)))]);
M_(:,[c1 c2])=[];
M(:,[c1 c2])=[];

%Here, M is being centered and standardized.
%PCA returns the principal components based on the correlation matrix.
%Note, this function cannot take NaN
[W, Y] = pca(M, 'VariableWeights', 'variance', 'Centered', true);

%     plot(Y(:,1), Y(:,2),'.')
% Calculate the orthonormal coefficient matrix (check that W*W' = I)
W = diag(std(M))\W;

% Getting mean and weights of data (for M_)
[~, mu, sigma] = zscore(M);
sigma(sigma==0) = 1;

% New point in the original system
x = M_;
x = ***@***.***,x, mu);
x =<EMAIL_ADDRESS>x, sigma);

% New coordinates as principal components

%     y0 = Y(1,:); % point we should get in result
%handle missing values
if handle_missingness
    disp('Removing missing columns...')
    indexes_to_remove = (sum(~isnan(x))./size(x,1)) < threshold;
    x(:,indexes_to_remove) = [];
    W(indexes_to_remove,:) = [];
    disp([num2str(size(W,1)) ' columns remained']);

    %impute missing values in x
    disp('Imputing the missing values in the remaining columns...');
    for i=1:size(x,2)
        curr_x = x(:,i);
        values_to_impute = unique(curr_x(~isnan(curr_x)));
        num_of_values_to_impute = numel(curr_x(isnan(curr_x)));
        p = randsample(numel(values_to_impute), num_of_values_to_impute, 1);

        curr_x(isnan(curr_x)) = values_to_impute(p);
        x(:,i) = curr_x;
    end;
end;

y = (x*W); % our result

if isempty(y)
    error_message('pca_projection: y is empty');
end;

end

I am sorry but the same line is giving the same error

Is it possible to attach the function as a  .m file compressed in zip ?
Something like the one below.
pca_projection.zip

Can you check out the file from github? I just uploaded it there.
On Sat, Nov 26, 2022, 4:56 AM Jeremy Selva @.***> wrote:

I am sorry but the same line is giving the same error
[image: image]
https://user-images.githubusercontent.com/9066508/204071464-931d99a3-e4e6-4f54-a642-79843fc2c473.png
Is it possible to attach the function as a .m file compressed in zip ?
Something like the one below.
pca_projection.zip
https://github.com/eelhaik/PCA_critique/files/10095642/pca_projection.zip
—
Reply to this email directly, view it on GitHub
https://github.com/eelhaik/PCA_critique/issues/7#issuecomment-1327974223,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACXRSULU3VMZZIJJEPIQQ6DWKGC7ZANCNFSM6AAAAAASLHUNZI
.
You are receiving this because you commented.Message ID:
@.***>

I have tested out the file. It works and I am able to proceed further. Thank you.

Thanks for letting me know.
On Sat, Nov 26, 2022, 2:08 PM Jeremy Selva @.***> wrote:

I have tested out the file. It works and I am able to proceed further.
Thank you.
—
Reply to this email directly, view it on GitHub
https://github.com/eelhaik/PCA_critique/issues/7#issuecomment-1328043547,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACXRSUNJPTA5ATRBQTAYZUDWKIDTLANCNFSM6AAAAAASLHUNZI
.
You are receiving this because you commented.Message ID:
@.***>


add bash script to run sqlfluff dbt for multiple projects

@HengJiang0206 has run up in issues in #936 that it's awkward to run sqlfluff with dbt templater for a different project. This PR creates a script to make it a relatively simple call to run dbt in one step.
This removes the sqlfluff dbt templater section from pyproject.toml and instead only adds it in when we want to run it. This is an annoying hack since these configs can't just be passed to sqlfluff (maybe I need add this to my fork...)

@damonmcc do you think it'd be worth trying to do something similar around "check dbt files" job in tests? What exactly is going on there again?

@damonmcc do you think it'd be worth trying to do something similar around "check dbt files" job in tests? What exactly is going on there again?

seems worth doing something similar! maybe just moving pre-commit run --all-files to the end of the new bash script and deleting the entire job in test_helper.yml (I'll approve this PR tho, no need to hold up this useful change). so:
dbt deps --profiles-dir $dir --project-dir $dir
dbt build --select config.materialized:seed --indirect-selection=cautious --full-refresh --profiles-dir $dir --project-dir $dir
sqlfluff $command $dir/$folder --templater=dbt
pre-commit run --all-files

that job is doing very "dbt project" specific checks, rather than linting sql files to check for bad formatting. it's using dbt-checkpoint to enforce some conventions we've chosen like "All models have a properties file" or "All staging models have at least 1 child model"


[T4A4][W15-A2]Lam Guang Jun

Ready for review

Some comments added. Feel free to add more comment if you have any questions. Once you are done, you may close the PR after reading comments.


Hide postprocess of electrons and prettify names on the graph screen.

[ ] I have added the tests to cover my changes.
[x] I have updated the documentation and CHANGELOG accordingly.
[x] I have read the CONTRIBUTING document.

@santoshkumarradha Changes have been done. Except for the case when post process electron  fails, it will be hidden by default.
Have added @AlejandroEsquivel as reviewer.
cc : @mshkanth

The changes look good, it would be good to have some basic tests for the new Prettify code though.

Hi @tkdtaylor - We intend to bundle in unit tests along with every feature built on the UI. Sometimes, the timelines are steep, and we defer some unit tests to later. The fallback is that we have thorough manual QA done for every release from our side.

@santoshkumarradha - Going forward, could we bundle in a basic/intermediate amount of unit tests with every OS release we do. We are already at a 70% code coverage and writing on-going tests will push it higher.
The tradeoff is that development timelines might even be 2X. My suggestion is that, unless the time-to-market for a feature is very steep, Team Psi factors in the time needed to bundle in unit tests. Let me know what you think.

@mshkanth i would say that for front end, as long as manual qa is passed we can go ahead and backlog tests for critical features. But for usual steady state, I would agree to pack it with teats.

@santoshkumarradha - Going forward, could we bundle in a basic/intermediate amount of unit tests with every OS release we do. We are already at a 70% code coverage and writing on-going tests will push it higher.
The tradeoff is that development timelines might even be 2X. My suggestion is that, unless the time-to-market for a feature is very steep, Team Psi factors in the time needed to bundle in unit tests. Let me know what you think.

@mshkanth i would say that for front end, as long as manual qa is passed we can go ahead and backlog tests for critical features. But for usual steady state, I would agree to pack it with teats.

@Prasy12 - Good to deploy based on Santosh's feedback. Pls track unit tests for this feature in our backlog. Going forward, by default we can bundle in unit tests in our estimate unless we know it needs to deployed urgently.

@santoshkumarradha Since there is one failing test it cannot be automerged I guess. Can you help?

@santoshkumarradha Since there is one failing test it cannot be automerged I guess. Can you help?
pulling in @wjcunningham7  :D


Refunds from smart contract.

Hi!
Can someone tell me how I recover the eth from the smart contracr created? I mean, I'm using all time testnet, all works correctly but I see that the eth are in the smart contract not in the wallet that I have used.

Hello, you can do this through etherscan, under account your smart contract was created on

Thx a lot!!


[ko] Remove references to tf-nightly-2.0-preview package

The tf-nightly-2.0-preview package does not exist anymore. Please upgrade all notebooks to use %tensorflow_version 2.x like:
try:
  # %tensorflow_version only exists in Colab.
  %tensorflow_version 2.x
except Exception:
  pass

Affects:

/site/ko/tutorials/keras/text_classification.ipynb
/site/ko/tutorials/keras/overfit_and_underfit.ipynb
/site/ko/tutorials/structured_data/feature_columns.ipynb

REVIEWERS cc: @rickiepark @cre8tor @choiuijin1125 @JKIsaacLee @NoelBird @wckim @eat-toast @jaketae

I’ll work on the fix today and open a PR!

Thanks @jaketae :)


[] android push data

_firebaseMessaging.configure(
onMessage: (Map<String, dynamic> message) async {
print("push data $message")
},
);
Android device foreground push gets 2 same results,Print in above code

Hi @armygui
can you please provide your flutter doctor -v and flutter run --verbose?
Thank you

Hi @armygui
I see there's an open issue addressing the case you described.
Please follow up on that issue,
I'm closing the current one as duplicate.
If you disagree please write in the comments
and I will reopen it.
Thank you

I think this problem is because the corresponding result of the front desk push in android is transmitted through the form of broadcasting. I found only one result in the service printing in the source code, but there are two values corresponding to the printing in the broadcast.

Hi @armygui
I see there's an open issue addressing the case you described.
Please follow up on that issue,
I'm closing the current one as duplicate.
If you disagree please write in the comments
and I will reopen it.
Thank you

Hi @iapicca
Please confirm issue .
Thank you


Accessibility Team work

Accessibility Team work between @MICHAELKITH  @ritikarawat220

In this milestone:
I have changed the background-color, font-size and color of btm selector
I have changed the  alt to "scroll-down-arrow" in html file line 63


Use anonymous namespace in arrow/IPC/writer.cc

Describe the bug, including details regarding any error messages, version, and platform.
It is not a bug, but the following functions should be in in file scope:
GetSchemaPayload
GetDictionaryPayload
GetRecrdBatchPayload
Component(s)
C++

Please ignore- they are public functions

I agree this would be a good idea.  Do you want to propose a PR?

hi, @westonpace , @smahapatra1 , I am new here and would like to do this issue, would you like to assign  this to me?

Hi， @westonpace , @smahapatra1 ,
I am new here and wants to contribute in arrow,
Would you please allow me to try this task?

I would like to contribute to this if that's fine

Hi, I have no issues with you contributing. Thanks.

On Jul 27, 2023 at 12:27 PM,  <pegasas @.***)>  wrote:
Hi，  @westonpace (https://github.com/westonpace)  ,  @smahapatra1 (https://github.com/smahapatra1)  ,
I am new here and wants to contribute in arrow,
Would you please allow me to try this task?
—
Reply to this email directly,   view it on GitHub (https://github.com/apache/arrow/issues/36674#issuecomment-1653955931), or   unsubscribe (https://github.com/notifications/unsubscribe-auth/AJ7YFQENZ3LJ2BRH6FPVCRTXSKJGLANCNFSM6AAAAAA2JNIA2A).
You are receiving this because you were mentioned.Message ID:  @.***>

Thanks, will raise PR for tracking

Thanks @pitrou !


Do not used Pooled allocator for stats buffers

Motivation
To serialize the stats returned by the broker, we are using 2 heap based buffers coming from an allocator.
Since the buffers themselves are already being reused and are never going back to the allocator, there's no need to use the allocator. We should just use unpooled buffers.

retest this please


Sunny Triporwer X 12: DER DC Measurement (714) not available any more

Not available since Update SunSpec (09.09.2024)
Some days later: DER AC Measurement (701) only a few values are available

After reload of the integration before sunset i now get the DER AC Measurement (701).
But also after sunset i can connect to the inverter via webui (in my case https://<IP_ADDRESS>/webui/Plant:1,IGULD:SELF/dashboard)
=> in my opinion the cpu is not sleeping (see https://github.com/CJNE/ha-sunspec/issues/202)
DER DC Measurement (714) is still not available

a disgrace for SMA (ein Armutszeugnis für SMA) ...


.envrc file should be .envrc.example

With instructions added to README.md to copy it to .envrc.
.envrc should not directly be part of the repo since edits to it are for local development convenience and will inevitably get accidentally committed back to the repo.

May I suggest a modification of the title .envrc.example -> envrc.example so it's not hidden!


Multiple rootfolders

We were talking in the discussion page, and I didn't realize sonarr/radarr can have multiple root folders configured. We should deal with that somehow.
It was brought up, though, that we could make categories of settings that select the groups of those types of things so it only is one dropdown instead of selecting each one every time.
The config could look like
{:sonarr/categories [{:name "Anime"
                      :rootfolder "/straight/into/the/trash"
                      :language-profile "Japanese"
                      :tags ["weeb" "tv"]
                      :quality-profile "4K"}
                     {:name "Normal TV"
                      :rootfolder "/normal/root/folder"
                      :language-profile "Any"
                      :tags ["tv"]
                      :quality-profile "Any"}]}

Rootfolder selection added in 3.4.0


Always use datetime to generate timestamps, fixes #39

Only rely on datetime to generate timestamps, and not time and datetime.
This makes it easier for downstream projects to freeze time and get reproducible timestamps.
freezegun is a nice and easy way to do so, but I stuck to regular mocks for this PR to avoid a new dependency.
With freezegun:

- @pytest.mark.usefixtures("freeze_random", "freeze_datetime")
+ @pytest.mark.usefixtures("freeze_random")
+ @freezegun.freeze_time(datetime.datetime(2021, 10, 2, 20, 17, 35))
  def test_two_debits(sdd, today):
      payment1 = {

This PR fixes issue #39 .

Merged manually


Development

Content of this merge:

SVRG solver with fixed hyperparameters
Home page of the documentation improved
Navigation and website layout improvement
Fetch data module
styles module for plotting
_documentation_utils module
Code references index matching nested modules

Codecov Report
Attention: Patch coverage is 37.80488% with 306 lines in your changes missing coverage. Please review.

Project coverage is 75.94%. Comparing base (f62fcf8) to head (d40207a).

Files with missing lines
Patch %
Lines

src/nemos/_documentation_utils/plotting.py
0.00%
272 Missing :warning:

src/nemos/fetch/fetch_data.py
43.75%
27 Missing :warning:

src/nemos/tree_utils.py
86.95%
3 Missing :warning:

src/nemos/base_regressor.py
90.00%
2 Missing :warning:

src/nemos/_documentation_utils/__init__.py
0.00%
1 Missing :warning:

src/nemos/proximal_operator.py
90.90%
1 Missing :warning:

:exclamation:  There is a different number of reports uploaded between BASE (f62fcf8) and HEAD (d40207a). Click for more details.
HEAD has 69 uploads less than BASE

Flag
BASE (f62fcf8)
HEAD (d40207a)

72
3

Additional details and impacted files
@@             Coverage Diff             @@
##             main     #233       +/-   ##
===========================================
- Coverage   97.30%   75.94%   -21.36%
===========================================
  Files          18       24        +6
  Lines        1669     2353      +684
===========================================
+ Hits         1624     1787      +163
- Misses         45      566      +521

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


sample with delight

Hello,
Is it possible to have a sample with mixed sqlbrite and sqldelight.
Thanks.

Not in this project. We want to keep the sample focused on this library. Eventually we think SQL Delight will duplicate a lot of the functionality of this library so its sample will eventually be enough to have reactive queries.


Alt attributes to images for HTML proofer

Alt attributes to images for HTML proofer

@polkhe This is unfortunately going to conflict with https://github.com/galaxyproject/training-material/pull/478 where I've updated the 101 tutorial and also added alt attributes.

@nsoranzo I will merge first your PR and then fix the conflicts here