model.fit trains on (# of training samples)/batch_size

This template is for miscellaneous issues not covered by the other issue categories.
For questions on how to work with TensorFlow, or support for problems that are not verified bugs in TensorFlow, please go to StackOverflow.
If you are reporting a vulnerability, please use the dedicated reporting process.
For high-level discussions about TensorFlow, please post to<EMAIL_ADDRESS>for questions about the development or internal workings of TensorFlow, or if you would like to know how to contribute to TensorFlow, please post to<EMAIL_ADDRESS>

I'm using tensorflow 2.1.0 on windows 10, python 3.7.9, cudatoolkit 10.1.243, cudnn 7.6.5.
The problem started after using autokeras.
When I'm trying to run model.fit, it only trains on part of the training samples: (# of training samples)/batch_size.
For example, my batch size is 16 and the training samples size is 135,000, so it trains on 8438
rinacnnGPU_t.txt
.
Attached code.
When executing it prints:
2020-11-15 20:35:16.615885: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cudart64_101.dll
2020-11-15 20:35:20.084617: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2629556b420 initialized for platform Host (this does not guarantee that XLA will be used). Devices:
2020-11-15 20:35:20.084743: I tensorflow/compiler/xla/service/service.cc:176]   StreamExecutor device (0): Host, Default Version
2020-11-15 20:35:20.087375: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library nvcuda.dll
2020-11-15 20:35:20.135019: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1716] Found device 0 with properties:
pciBusID: 0000:05:00.0 name: Quadro P6000 computeCapability: 6.1
coreClock: 1.645GHz coreCount: 30 deviceMemorySize: 24.00GiB deviceMemoryBandwidth: 403.49GiB/s
2020-11-15 20:35:20.135068: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cudart64_101.dll
2020-11-15 20:35:20.143744: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cublas64_10.dll
2020-11-15 20:35:20.151341: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cufft64_10.dll
2020-11-15 20:35:20.154467: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library curand64_10.dll
2020-11-15 20:35:20.163847: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cusolver64_10.dll
2020-11-15 20:35:20.168680: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cusparse64_10.dll
2020-11-15 20:35:20.186400: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cudnn64_7.dll
2020-11-15 20:35:20.186549: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1858] Adding visible gpu devices: 0
2020-11-15 20:35:21.157331: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1257] Device interconnect StreamExecutor with strength 1 edge matrix:
2020-11-15 20:35:21.157396: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1263]      0
2020-11-15 20:35:21.157416: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1276] 0:   N
2020-11-15 20:35:21.157689: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1402] Created TensorFlow device (/device:GPU:0 with 22016 MB memory) -> physical GPU (device: 0, name: Quadro P6000, pci bus id: 0000:05:00.0, compute capability: 6.1)
2020-11-15 20:35:21.163602: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x262c257d2c0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices:
2020-11-15 20:35:21.163636: I tensorflow/compiler/xla/service/service.cc:176]   StreamExecutor device (0): Quadro P6000, Compute Capability 6.1
2020-11-15 20:35:21.165841: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1716] Found device 0 with properties:
pciBusID: 0000:05:00.0 name: Quadro P6000 computeCapability: 6.1
coreClock: 1.645GHz coreCount: 30 deviceMemorySize: 24.00GiB deviceMemoryBandwidth: 403.49GiB/s
2020-11-15 20:35:21.165881: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cudart64_101.dll
2020-11-15 20:35:21.165907: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cublas64_10.dll
2020-11-15 20:35:21.165929: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cufft64_10.dll
2020-11-15 20:35:21.165950: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library curand64_10.dll
2020-11-15 20:35:21.165972: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cusolver64_10.dll
2020-11-15 20:35:21.165993: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cusparse64_10.dll
2020-11-15 20:35:21.166014: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cudnn64_7.dll
2020-11-15 20:35:21.166183: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1858] Adding visible gpu devices: 0
2020-11-15 20:35:21.167224: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1716] Found device 0 with properties:
pciBusID: 0000:05:00.0 name: Quadro P6000 computeCapability: 6.1
coreClock: 1.645GHz coreCount: 30 deviceMemorySize: 24.00GiB deviceMemoryBandwidth: 403.49GiB/s
2020-11-15 20:35:21.167264: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cudart64_101.dll
2020-11-15 20:35:21.167289: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cublas64_10.dll
2020-11-15 20:35:21.167312: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cufft64_10.dll
2020-11-15 20:35:21.167334: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library curand64_10.dll
2020-11-15 20:35:21.167355: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cusolver64_10.dll
2020-11-15 20:35:21.167376: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cusparse64_10.dll
2020-11-15 20:35:21.167397: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cudnn64_7.dll
2020-11-15 20:35:21.167467: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1858] Adding visible gpu devices: 0
2020-11-15 20:35:21.167535: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1257] Device interconnect StreamExecutor with strength 1 edge matrix:
2020-11-15 20:35:21.167557: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1263]      0
2020-11-15 20:35:21.167574: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1276] 0:   N
2020-11-15 20:35:21.167736: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1402] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 22016 MB memory) -> physical GPU (device: 0, name: Quadro P6000, pci bus id: 0000:05:00.0, compute capability: 6.1)
2020-11-15 20:35:26.419022: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cublas64_10.dll
2020-11-15 20:35:26.736009: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cudnn64_7.dll
2020-11-15 20:35:27.753582: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: Invoking GPU asm compilation is supported on Cuda non-Windows platforms only
Relying on driver to perform ptx compilation.
Modify $PATH to customize ptxas location.
This message will be only logged once.
2020-11-16 07:35:10.172382: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1716] Found device 0 with properties:
pciBusID: 0000:05:00.0 name: Quadro P6000 computeCapability: 6.1
coreClock: 1.645GHz coreCount: 30 deviceMemorySize: 24.00GiB deviceMemoryBandwidth: 403.49GiB/s
2020-11-16 07:35:10.172518: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cudart64_101.dll
2020-11-16 07:35:10.172551: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cublas64_10.dll
2020-11-16 07:35:10.172576: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cufft64_10.dll
2020-11-16 07:35:10.172600: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library curand64_10.dll
2020-11-16 07:35:10.172624: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cusolver64_10.dll
2020-11-16 07:35:10.172647: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cusparse64_10.dll
2020-11-16 07:35:10.172670: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cudnn64_7.dll
2020-11-16 07:35:10.172861: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1858] Adding visible gpu devices: 0
2020-11-16 07:35:10.172976: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1257] Device interconnect StreamExecutor with strength 1 edge matrix:
2020-11-16 07:35:10.173003: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1263]      0
2020-11-16 07:35:10.173023: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1276] 0:   N
2020-11-16 07:35:10.173171: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1402] Created TensorFlow device (/device:GPU:0 with 22016 MB memory) -> physical GPU (device: 0, name: Quadro P6000, pci bus id: 0000:05:00.0, compute capability: 6.1)
2020-11-16 07:35:52.132852: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1716] Found device 0 with properties:
pciBusID: 0000:05:00.0 name: Quadro P6000 computeCapability: 6.1
coreClock: 1.645GHz coreCount: 30 deviceMemorySize: 24.00GiB deviceMemoryBandwidth: 403.49GiB/s
2020-11-16 07:35:52.132914: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cudart64_101.dll
2020-11-16 07:35:52.132942: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cublas64_10.dll
2020-11-16 07:35:52.132966: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cufft64_10.dll
2020-11-16 07:35:52.132991: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library curand64_10.dll
2020-11-16 07:35:52.133015: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cusolver64_10.dll
2020-11-16 07:35:52.133038: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cusparse64_10.dll
2020-11-16 07:35:52.133061: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library cudnn64_7.dll
2020-11-16 07:35:52.133140: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1858] Adding visible gpu devices: 0
2020-11-16 07:35:52.133231: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1257] Device interconnect StreamExecutor with strength 1 edge matrix:
2020-11-16 07:35:52.133255: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1263]      0
2020-11-16 07:35:52.133273: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1276] 0:   N
2020-11-16 07:35:52.133400: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1402] Created TensorFlow device (/device:GPU:0 with 22016 MB memory) -> physical GPU (device: 0, name: Quadro P6000, pci bus id: 0000:05:00.0, compute capability: 6.1)
1 Physical GPUs, 1 Logical GPU
x_train shape (135000, 57, 57, 3)
y_train shape (135000, 6)
629/8438 [=>............................] - ETA: 53s - loss: 1.7925 - accuracy: 0.1705

@rinashalibo,
Since you have specified the batch size as 16 here, the training dataset of size 135,000 is split into 8438 batches (i.e. each batch consisting of 16 samples). Please check the documentation for batch_size for more information.
Also, please take a look at this gist and let us know if it helps. Thanks!

Yes, but the model.fit should still output to screen the number of training
samples.
I have 135,000 samples, and the output to screen is:
4219/4219 [==============================] - 27s 6ms/step - loss: 1.7902 -
accuracy: 0.1698 - val_loss: 1.7917 - val_accuracy: 0.1675
From this I understand that only a part of the training samples are being
used for model.fit.
Before the autokeras installation, the output to screen was:
135000/135000 [======================== ...
On Tue, Nov 17, 2020 at 3:56 PM Abhilash Mahendrakar <
<EMAIL_ADDRESS>wrote:

@rinashalibo https://github.com/rinashalibo,
Since you have specified the batch size as 16 here, the training dataset
of size 135,000 is split into 8438 batches (i.e. each batch consisting of
16 samples). Please check the documentation for batch_size
https://www.tensorflow.org/api_docs/python/tf/keras/Model#fit for more
information.
Also, please take a look at this gist
https://colab.research.google.com/gist/amahendrakar/8653525cad3f28443a798d1b8fc62fc7/44893.ipynb
and let us know if it helps. Thanks!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/tensorflow/tensorflow/issues/44893#issuecomment-728943878,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ANLYL7MYQ4LKONUP2FCCBPTSQJ6IJANCNFSM4TWXEEMQ
.

--
The University http://facebook.com/theuniversity - My favourite Jazz
Band in Tel Aviv *- *האוניברסיטה http://facebook.com/theuniversity
♪♫

Before the autokeras installation, the output to screen was: 135000/135000 [======================== ...

@rinashalibo,
Could you please provide a minimal code snippet to reproduce this issue on our end? Thanks!


strtolower function in BaseHtml corrupt UTF-8 strings

What steps will reproduce the problem?
use yii\helpers\Html;
//Get a Model
$model = Bild::find()->one();
$field= 'bild_groß_dateiname';
echo Html::getInputId($model, $field);
A solution would be the function mb_strtolower
What is the expected result?
bild-bild_groß _dateiname
What do you get instead?
bild-bild_groÒ _dateiname
Additional info

Q
A

Yii version
<IP_ADDRESS>

PHP version
7.2.7

Operating system
Windows 7 (Development)

What is the point of using strtolower() in this case?

IDs in the DOM are case sensitive, but they are not handled consistently across browsers.
Having them all lowercase is an easy solution.
Alternatively we could also just use something like base64_encode which is available in PHP and JS...

IDs in the DOM are case sensitive, but they are not handled consistently across browsers.

Does it matter? If we always use the same ID, case sensitivity should be irrelevant.

@silberstreifen I've added some test coverage for that method but I wasn't able to reproduce the bug you described. The string bild_groß_dateiname was not corrupted by the current method implementation with strtolower(). Could you please provide a string which would break the tests?

@Kolyunya it actually was corrupted according to tests but in PHP 5.4 and PHP 5.5 only: https://travis-ci.org/yiisoft/yii2/builds/447569138?utm_source=github_status&utm_medium=notification

@samdark seems like there is some issue with the mb_internal_encoding()? Should we force the UTF-8 while converting to lower case?

I was pretty sure that is going to help (tests pass now). My question was if should force encoding different from the system default.

I think it should be done same as in encode():
Yii::$app ? Yii::$app->charset : 'UTF-8'

Reworked the code to select the charset like the encode() method does.


Failed to save as video

Got this error after generating all my images, seems it couldnt save as a video file
my inference was
python wav2lip_uhq.py -f C:/Users/leolo/Documents/bad2.mp4 -i C:/Users/leolo/Documents/test.mp4
Error:
[INFO] Create Video output!
Traceback (most recent call last):
  File "C:\Users\leolo\wav2lip_uhq\wav2lip_uhq.py", line 183, in <module>
    main()
  File "C:\Users\leolo\wav2lip_uhq\wav2lip_uhq.py", line 170, in main
    create_video_from_images(args, frame_number-1)
  File "C:\Users\leolo\wav2lip_uhq\wav2lip_uhq.py", line 30, in create_video_from_images
    subprocess.run(
  File "C:\Users\leolo\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 501, in run
    with Popen(*popenargs, **kwargs) as process:
  File "C:\Users\leolo\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 969, in __init__
    self._execute_child(args, executable, preexec_fn, close_fds,
  File "C:\Users\leolo\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1378, in _execute_child
    args = list2cmdline(args)
  File "C:\Users\leolo\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 561, in list2cmdline
    for arg in map(os.fsdecode, seq):
  File "C:\Users\leolo\AppData\Local\Programs\Python\Python310\lib\os.py", line 822, in fsdecode
    filename = fspath(filename)  # Does type-checking of `filename`.
TypeError: expected str, bytes or os.PathLike object, not int

Thank you for your report, I indeed made a mistake on line 30, it should be str(nb_frames), it should be corrected now


[Linux VM]the sudo requires password after reset password from Portal GUI

[Enter feedback here]
#1. Create a ubuntu 22.04 VM from marketplace, use ssh key for login.
#2. Login to the server, execute command "sudo ls", no password required. It's correct
#3. Reset password of current user in Portal GUI.
#4. Login to the server, execute command "sudo ls", password is required. why?
I notice that a new sudoer file /etc/sudoers.d/waagent is created with content  ALL = (ALL) ALL
It overwrites configuration in file /etc/sudoers.d/90-cloud-init-users
Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 9dce24b6-64e4-105f-2c26-323b2bb89d26
Version Independent ID: 9d513478-dc8f-40b9-607c-623f3f47439d
Content: Reset access to an Azure Linux VM - Azure Virtual Machines
Content Source: articles/virtual-machines/extensions/vmaccess.md
Service: virtual-machines
Sub-service: extensions
GitHub Login: @GabstaMSFT
Microsoft Alias: gabsta

@xingqiri
Thanks for your feedback! We will investigate and update as appropriate.

@GabstaMSFT
Can you please check and add your comments on this doc update request as applicable.
@xingqiri
Thanks for bringing this to our attention.
I'm going to assign this to the document author so they can take a look at it accordingly.

@xingqiri, I am currently reviewing this with the VM Access team.

This is the current behavior from the Portal because the option restore_backup_ssh is not yet exposed there. Therefore, we will use the default config, which will require a password.
For now, this can be worked around by using an ARM template instead of the UI and setting restore_backup_ssh to true, which will keep the current settings.

Since this issue has been evaluated and updated with a workaround, it could be closed accordingly. This is the expected behavior with the current settings until the option restore_backup_ssh is exposed/support is implemented from the backend. There is no doc update required to capture the expected behavior.
Should you think that the doc is inadequate to complete your task, please feel free to raise the issue again. Thank you!
#please-close


refactor: Align options and handling for requestOperationType and requestStatus

Description
Currently, the endpoints for get[x]Requests(forApprover) take an optional parameter

requestOperationType
requestStatus

Both have potential values defined as enum.
In FE, we use "ALL" as identifier for "please sent me all status".

requestStatus does have an "ALL" defined in it's type
requestOperationType does not have it defined

Both parameters shouldn't have "ALL". To get all status/types, we should not sent this parameter (BE will handle "ALL" like it's not defined, but we shouldn't rely on that).
Todo
We need to update the types from BE, our FE definition and find a useful and consistent handling for typing and creating the queries in FE (currently we're doing it a bit different everywhere). See also https://github.com/aiven/klaw/pull/902#discussion_r1146291474
We may want to create a Frontend-follow up issue for that if we want to split the scope of the PRs between "aligning API and typing" and "make fe handling of that consistent"

@programmiri I think this is already fixed.
Can be closed ?

@muralibasani  I will check if we updated that in Frontend already and if yes, close it! But we can at least remove the backend label I think?

I still see requestOperationType defined as this in main :o
          "requestOperationType" : {
            "type" : "string",
            "enum" : [ "CREATE", "UPDATE", "PROMOTE", "CLAIM", "DELETE" ]
          },


Hspec setup fails due to hsc2hs

Hi, I'm trying to setup test suites with Etlas, and bump the following error.
eta-test.cabal looks:
name:                eta-test
version:             <IP_ADDRESS>
build-type:          Simple
cabal-version:       >=1.10

library
  exposed-modules:     Lib
  build-depends:       base >=4.8 && <4.9
  hs-source-dirs:      src
  default-language:    Haskell2010

test-suite spec
  type:                exitcode-stdio-1.0
  hs-source-dirs:      test
  main-is:             Spec.hs
  build-depends:       base
                     , eta-test
                     , hspec
  default-language:    Haskell2010

$ etlas install --enable-tests
Resolving dependencies...
In order, the following will be installed:
unix-<IP_ADDRESS> (via: directory-<IP_ADDRESS>) (new package)
directory-<IP_ADDRESS> (via: hspec-core-2.4.8 hspec-discover-2.4.8
hspec-discover-2.4.8) (new package)
hspec-discover-2.4.8 (via: hspec-2.4.8) (new package)
hspec-core-2.4.8 (via: hspec-2.4.8) (new package)
hspec-2.4.8 (via: eta-test-<IP_ADDRESS>) (new package)
eta-test-<IP_ADDRESS> *test (reinstall)
Warning: Note that reinstalls are always dangerous. Continuing anyway...
Configuring unix-<IP_ADDRESS>...
Preprocessing library for unix-<IP_ADDRESS>..
etlas: The program 'hsc2hs' is required but it could not be found
Failed to install unix-<IP_ADDRESS>
etlas: Error: some packages failed to install:
directory-<IP_ADDRESS>-AVlgGxPWKOU6p1NilVT0Z8 depends on directory-<IP_ADDRESS> which
failed to install.
eta-test-<IP_ADDRESS>-BbpGhiInHFP1Hhc1mUafzt depends on eta-test-<IP_ADDRESS> which
failed to install.
hspec-2.4.8-Igx0gLtVPOiKPvj0uaydju depends on hspec-2.4.8 which failed to
install.
hspec-core-2.4.8-2OUbKlbSgveBVJbuNtzokf depends on hspec-core-2.4.8 which
failed to install.
hspec-discover-2.4.8-7ofwoopWznQFSsSYpAorLM depends on hspec-discover-2.4.8
which failed to install.
unix-<IP_ADDRESS>-EjsyPnKNuFmAYXDUkSFrP5 failed during the building phase. The
exception was:
ExitFailure 1

How can I address it?

Try running etlas update and the etlas install --enable-tests. That should fix it.

Oh, sorry it by a hair! The index 2018-02-27T07:18:10Z works, with hspec == 2.4.6 as mentioned in #655. Thanks your advice.


Want to create different buckets in the end

I want to implement a lambda function, where every video converted, will automatically create a new bucket with tag and if the video is from the same customer that video will go into that bucket

Hi @tapanjo92,
We don't plan on adding this functionality to the solution, but you can customize yourself if you want to. You'd have to change the encode function so that the file is saved to the desired bucket (instead of destBucket).
It's also important to be aware of S3 limits: You can only create up to 100 buckets by default, and this value can only be increased to a maximum of 1,000. If you have lots of customers, this might not be the best approach. An alternative is to use a single bucket, but use sub-folders for each customer.

Hi @dscpinheiro ,
Yes i figured that, given we have different customers, so we need to create lambda function for each of them in the encode? with their name?

No, you should be able to use only one encode function.
What you can do is: whenever you upload a new file to S3, specify the destBucket property to point to that customer's bucket (important to remember this is only possible if the workflow trigger is set to MetadataFile).

@dscpinheiro ,
can i get any sample code help if possible?
thank you

We don't have any sample code, but here's what you could do:
For customer A, you'd upload this metadata file:
{
  "srcVideo": "cust-A-video.mp4",
  "destBucket": "cust-A-bucket"
}

Whereas for customer B, the metadata file would look like this:
{
  "srcVideo": "cust-B-video.mp4",
  "destBucket": "cust-B-bucket"
}

This should be enough for the workflow to put the files in different buckets.
Again, as I stated in a previous comment (https://github.com/awslabs/video-on-demand-on-aws/issues/39#issuecomment-542208256), this might work, but you might run into some issues regarding S3 limits.

@dscpinheiro
Thank you for your recommendation. We decided to go with creating different folders instead of buckets.
Now each time you put video through Media convert, the folders are automatically created. So can we just edit the lambda function?

Hi @tapanjo92,
Yes, by default the encode function uses the execution id as the destination folder, but you should be able to change it so that it uses a custom folder instead.

@dscpinheiro
I tried editing the encode function, but I am getting a problem when I am trying to customise it because it has been referenced everywhere, can I get a more specific answer on which area I should edit the function. As u mentioned earlier on line 30, but I am not able to edit that as it is giving me an error.

@dscpinheiro
I tried editing the encode function, but I am getting a problem when I am trying to customise it because it has been referenced everywhere, can I get a more specific answer on which area I should edit the function. As u mentioned earlier on line 30, but I am not able to edit that as it is giving me an error.

What error are you getting?

No worries, sorry for the confusion on my part.
Here is what I'd do (and please let me know if any of these don't make sense):

Launch the template with the WorkflowTrigger parameter set to MetadataFile
Update line 30 on the encode function from this:

let outputPath = 's3://' + event.destBucket + '/' + event.guid;

To this:
let outputPath = `s3://${event.destBucket}/${event.subFolder}/${event.guid}`;

Whenever uploading a file, populate the subFolder property according to the customer. For instance:

{
  "srcVideo": "cust-A-video.mp4",
  "subFolder": "cust-A-folder"
}

@dscpinheiro Thak you for the help,
so we have an api call, wherein customer develop theor video file, but there is no way for the metadata to be embedded.

@tapanjo92,
It should still be possible without the metadata, it will just be slightly more complicated.
What I was thinking is, whenever a video file is uploaded to S3 via your API, you add some tags to the object so that the customer can be identified.
Then, in the encode function, instead of looking for that subFolder property, you check the tags to update the destination path.
Would that work?

Yes that should work!
what can I edit in the encode function?

Same place as before, when outputPath is populated.
The event variable has the S3 bucket and key, so you should be able to use the SDK to get the object tags.

@dscpinheiro
Thank you so much. I will work this weekend.
I will get back to you with more questions if any.

Hi @dscpinheiro ,
It was working fine, but when I created a new CFN template and edited the lambda code, I am getting this error whenever I insert .json file in the S3 bucket.

thank you

Which Lambda function is that message coming from? Could you post the JSON file you're using?

Looks like it's coming from lambda function 'error-handler'
The json file used was
{     "srcVideo": "animal.mp4",     "subFolder": "animal" }

The error-handler function is only invoked when another function fails.
Could you check the state machines? The failed execution should show up there, and you'll be able to see where the error happened.

hi @dscpinheiro  ,
looks like error came from 'input validate' - lambda function.
I have attached some screenshots.

@dscpinheiro
Also, I tried to create CFN this template given in this github
CFN template for vod-on-demand
I am getting this error again and again while creating it.

The template on GitHub is not meant to be used directly. You have to follow the steps in https://github.com/awslabs/video-on-demand-on-aws#creating-a-custom-build if you want to customize the solution.
For the previous comment, can you confirm that these two environment variables (FrameCapture and ArchiveSource) are defined for the input-validate function?

With the metadata option, they can be overwritten, but default values must be set.

Yes FrameCapture and ArchiveSource are defined and been set to false.

@dscpinheiro
As of now the template is working. I will get back to you if I get some more data after research with regards to why I was getting an error.
Thank You very much for helping me

Ok, thanks for the update.
If you do figure out what the problem was, please let us know. If it's an issue with the solution, we want to fix it for other customers as well.

@dscpinheiro
As AWS is ending support for Node.js 8.x
Any update on when CFN template will be updated with node.js 10.x?

We'll release a new version of the solution before Node 8 reaches its End of Life, and that version will update the runtime to Node 10.

hi @dscpinheiro ,
Is there a way in which I can get the total length of the video in sns notification from dynamodb?

Hi @tapanjo92,
Yes, there is. You could use the encodingOutput, as you showed on the screenshot, but an easier option is to use the mediainfo output.
The srcMediaInfo property on Dynamo should have the duration of the video.

but how can I get srcMediainfo's output on sns?

Hi @dscpinheiro
but how can I get srcMediainfo's output on sns?

Here's an example for the profiler function: https://github.com/awslabs/video-on-demand-on-aws/blob/16bef0e010d0cd340546b65af0e0a0723c7b50e3/source/profiler/index.js#L40-L42
This property is removed in the sns function, but you can modify it so that the duration is included: https://github.com/awslabs/video-on-demand-on-aws/blob/16bef0e010d0cd340546b65af0e0a0723c7b50e3/source/sns-notification/index.js#L34


Add non html suffix paths as slug migrations too

The old service manual sees /service-manual/agile.html and
/service-manual/agile as the same thing.

Does this mean people will have to be aware of the fact that they have to migrate both .html and non-.html slugs? Can't we just automate it by making two requests to publishing-api each time we migrate?

Yeah, you're probably right.

Although that approach means having an alternate content_id and url path for each item. It's a much larger, more hacky change.
Let's leave it like this.

Based on a slack convo this LGTM :+1:


Added the portfolio content

Added the Shubham Pawar portfolio link.
#64

you can also add the source code of your portfolio


Add view function

The 'Add view' feature is accessed via the Add view button on the Table page. This uses a lightbox effect to pop up the 'Add view' panel. The problem is that the 'Add view' panel can be closed by clicking anywhere within the dark grey area outside the 'Add view' panel (not just via the close button at the top of the panel). Therefore, if the user has entered any details into the various form fields, then accidentally clicks the grey area outside the panel, the panel closes and they lose their work.

Solved in Version 2.6.1


Disktensors don't realize correctly after slicing

repro:
from extra.utils import temp
from tinygrad.helpers import dtypes
from tinygrad.tensor import Tensor

lst = [[27, 0, 137, 119, 149, 157, 169, 229, 170, 105, 4, 103, 181, 117, 104, 99, 137, 158], [31, 0, 157, 201, 121, 201, 146, 21, 186, 194, 92, 89, 138, 217, 185, 102, 112, 85], [20, 128, 30, 182, 5, 122, 198, 96, 173, 147, 247, 129, 75, 98, 41, 6, 81, 236], [24, 0, 103, 101, 28, 108, 152, 212, 134, 139, 58, 78, 10, 155, 20, 214, 106, 170], [30, 128, 200, 167, 196, 212, 202, 138, 251, 168, 202, 8, 108, 250, 84, 54, 82, 86], [23, 128, 39, 91, 103, 186, 170, 80, 242, 185, 157, 146, 82, 108, 214, 42, 103, 91]]

def slice_and_realize(a, idx):
  print(f"{a.device}, index={idx}")
  d = a[:, :1]
  print(d[idx].numpy(), d.numpy()[idx])

for idx in range(2):
  slice_and_realize(Tensor(lst, device="CPU", dtype=dtypes.uint8).to(f"disk:{temp('asdf')}"), idx)
  slice_and_realize(Tensor(lst, device="GPU"), idx)
  slice_and_realize(Tensor(lst, device="METAL"), idx)

out:
DISK:/var/folders/dq/xnvkqjbx5b9c8cmh0q_50l_h0000gn/T/asdf, index=0
[27] [27]
GPU, index=0
[27.] [27.]
METAL, index=0
[27.] [27.]
DISK:/var/folders/dq/xnvkqjbx5b9c8cmh0q_50l_h0000gn/T/asdf, index=1
[31] [0] <----- See how this is different
GPU, index=1
[31.] [31.]
METAL, index=1
[31.] [31.]

Closing - This was due to the use of AS_STRIDED and how it was implemented in disk ops. After reverting #1846 I figured operations on the second dimension of a disktensor were never supported anyways. The long-term fix is to get rid of as_strided and there is an open issue for that already


Pub/Sub: max_rpc_timeout should be short like 10s

If we set max PRC timeout to be 10 minutes, we are also not retrying.

Same as https://github.com/GoogleCloudPlatform/python-docs-samples/pull/2398, I think the current sample is ok.


Hexamer run

I tried running a hexamer prediction and there was an error saying that I run out of memory. Is there a way to allocate more resources?

If you are running out of GPU memory but not host memory then you can try increasing the value of XLA_PYTHON_CLIENT_MEM_FRACTION here which controls the amount of host memory that can be used. Currently this is set to 4 times the amount of GPU memory available.


Show only card profiles which are available currently

Currently all the possible card profiles from pactl list cards are displayed in third tab "F3 Cards". I am wondering if this is attended or if it would be possible (e.g. via config file or cmd line argument) to only show currently available which can be detetcted via pactl list cards and searching available ports and their corresponding Part fo profile(s) properties.
Alternatively it would make it easier to mark them differently. If you think some of this is worth implementing it, I could also start a PR after some hints provided.
Example excerpts for

not available:

hdmi-output-2: HDMI / DisplayPort 3 (priority: 5700, latency offset: 0 usec, not available)
	Properties:
		device.icon_name = "video-display"
	Part of profile(s): output:hdmi-stereo-extra2, output:hdmi-stereo-extra2+input:analog-stereo, output:hdmi-surround-extra2, output:hdmi-surround-extra2+input:analog-stereo, output:hdmi-surround71-extra2, output:hdmi-surround71-extra2+input:analog-stereo

available:

hdmi-output-2: HDMI / DisplayPort 3 (priority: 5700, latency offset: 0 usec, available)
	Properties:
		device.icon_name = "video-display"
		device.product.name = "XXX TV"
	Part of profile(s): output:hdmi-stereo-extra2, output:hdmi-stereo-extra2+input:analog-stereo, output:hdmi-surround-extra2, output:hdmi-surround-extra2+input:analog-stereo, output:hdmi-surround71-extra2, output:hdmi-surround71-extra2+input:analog-stereo

pulsemixer always shows the same list of items, see screenshot:

Edit: Just saw that even the profile shows if it is available by displaying yes or no, see
output:hdmi-stereo-extra2: Digital Stereo (HDMI 3) Output (sinks: 1, sources: 0, priority: 5700, available: yes)

vs.
output:hdmi-stereo-extra2: Digital Stereo (HDMI 3) Output (sinks: 1, sources: 0, priority: 5700, available: no)

Should be doable via config now.
See hide-unavailable-profiles and hide-unavailable-ports options.

Works excellent, thanks!


[install] Bundler platform and mini_portile2

Background
Heroku recommends to set in bundler the platform to ruby and x86_64-linux. (See related Heroku documentation)
When doing so, the Gemfile.lock gets updated and has now the following entries
GEM
  remote: https://rubygems.org/
  specs:
    nokogiri (1.11.7)
      mini_portile2 (~> 2.5.0)
      racc (~> 1.4)
    nokogiri (1.11.7-x86_64-linux)
      racc (~> 1.4)

PLATFORMS
  ruby
  x86_64-linux

RUBY VERSION
   ruby 2.7.4p191

BUNDLED WITH
   2.2.21

New is the second platform x86_64-linux and the second entry for nokogiri (1.11.7-x86_64-linux)
Note that the second entry does not refer to mini_portile2 anymore.
This leads to the following error message when running the application
/usr/local/bundle/gems/bundler-2.2.21/lib/bundler/spec_set.rb:95:in `block in materialize': Could not find mini_portile2-2.5.3 in any of the sources (Bundler::GemNotFound)
246	from /usr/local/bundle/gems/bundler-2.2.21/lib/bundler/spec_set.rb:90:in `map!'
247	from /usr/local/bundle/gems/bundler-2.2.21/lib/bundler/spec_set.rb:90:in `materialize'
248	from /usr/local/bundle/gems/bundler-2.2.21/lib/bundler/definition.rb:191:in `specs'
249	from /usr/local/bundle/gems/bundler-2.2.21/lib/bundler/definition.rb:260:in `specs_for'
250	from /usr/local/bundle/gems/bundler-2.2.21/lib/bundler/definition.rb:242:in `requested_specs'
251	from /usr/local/bundle/gems/bundler-2.2.21/lib/bundler/runtime.rb:91:in `block in definition_method'
252	from /usr/local/bundle/gems/bundler-2.2.21/lib/bundler/runtime.rb:20:in `setup'
253	from /usr/local/bundle/gems/bundler-2.2.21/lib/bundler.rb:149:in `setup'
254	from /usr/local/bundle/gems/bundler-2.2.21/lib/bundler/setup.rb:20:in `block in <top (required)>'
255	from /usr/local/bundle/gems/bundler-2.2.21/lib/bundler/ui/shell.rb:136:in `with_level'
256	from /usr/local/bundle/gems/bundler-2.2.21/lib/bundler/ui/shell.rb:88:in `silence'
257	from /usr/local/bundle/gems/bundler-2.2.21/lib/bundler/setup.rb:20:in `<top (required)>'
258	from /usr/local/lib/ruby/2.7.0/rubygems/core_ext/kernel_require.rb:83:in `require'
259	from /usr/local/lib/ruby/2.7.0/rubygems/core_ext/kernel_require.rb:83:in `require'
260	from /usr/src/app/config/boot.rb:5:in `<top (required)>'
261	from bin/rails:3:in `require_relative'
262	from bin/rails:3:in `<main>'
263

The following focuses now on gem install, where a similar behaviour can be seen.
But to be honest, I don't know how Bundler handles the two platforms configured...
Have you read and followed the installation tutorial at http://www.nokogiri.org/tutorials/installing_nokogiri.html?

[x] Yes!

What is the complete output of gem install or bundle install?

with platform=x86_64-linux
# gem install nokogiri --platform=x86_64-linux
Fetching nokogiri-1.11.7-x86_64-linux.gem
Successfully installed nokogiri-1.11.7-x86_64-linux
1 gem installed

with platform=ruby
gem install nokogiri --platform=ruby
Fetching mini_portile2-2.5.3.gem
Fetching nokogiri-1.11.7.gem
Successfully installed mini_portile2-2.5.3
Building native extensions. This could take a while...
Successfully installed nokogiri-1.11.7
2 gems installed

If installation completed but is broken, what is the complete output from nokogiri -v?

with platform=x86_64-linux
# Nokogiri (1.11.7)
    ---
    warnings: []
    nokogiri:
      version: 1.11.7
      cppflags:
      - "-I/usr/local/bundle/gems/nokogiri-1.11.7-x86_64-linux/ext/nokogiri"
      - "-I/usr/local/bundle/gems/nokogiri-1.11.7-x86_64-linux/ext/nokogiri/include"
      - "-I/usr/local/bundle/gems/nokogiri-1.11.7-x86_64-linux/ext/nokogiri/include/libxml2"
      ldflags: []
    ruby:
      version: 2.7.4
      platform: x86_64-linux-musl
      gem_platform: x86_64-linux-musl
      description: ruby 2.7.4p191 (2021-07-07 revision a21a3b7d23) [x86_64-linux-musl]
      engine: ruby
    libxml:
      source: packaged
      precompiled: true
      patches:
      - 0001-Remove-script-macro-support.patch
      - 0002-Update-entities-to-remove-handling-of-ssi.patch
      - 0003-libxml2.la-is-in-top_builddir.patch
      - 0004-use-glibc-strlen.patch
      - 0005-avoid-isnan-isinf.patch
      - 0006-update-automake-files-for-arm64.patch
      - 0007-Fix-XPath-recursion-limit.patch
      libxml2_path: "/usr/local/bundle/gems/nokogiri-1.11.7-x86_64-linux/ext/nokogiri"
      memory_management: ruby
      iconv_enabled: true
      compiled: 2.9.12
      loaded: 2.9.12
    libxslt:
      source: packaged
      precompiled: true
      patches:
      - 0001-update-automake-files-for-arm64.patch
      - 0002-Fix-xml2-config-check-in-configure-script.patch
      compiled: 1.1.34
      loaded: 1.1.34
    other_libraries:
      zlib: 1.2.11

with platform=ruby
# nokogiri -v
# Nokogiri (1.11.7)
    ---
    warnings: []
    nokogiri:
      version: 1.11.7
      cppflags:
      - "-I/usr/local/bundle/gems/nokogiri-1.11.7/ext/nokogiri"
      - "-I/usr/local/bundle/gems/nokogiri-1.11.7/ext/nokogiri/include"
      - "-I/usr/local/bundle/gems/nokogiri-1.11.7/ext/nokogiri/include/libxml2"
      ldflags: []
    ruby:
      version: 2.7.4
      platform: x86_64-linux-musl
      gem_platform: x86_64-linux-musl
      description: ruby 2.7.4p191 (2021-07-07 revision a21a3b7d23) [x86_64-linux-musl]
      engine: ruby
    libxml:
      source: packaged
      precompiled: false
      patches:
      - 0001-Remove-script-macro-support.patch
      - 0002-Update-entities-to-remove-handling-of-ssi.patch
      - 0003-libxml2.la-is-in-top_builddir.patch
      - 0004-use-glibc-strlen.patch
      - 0005-avoid-isnan-isinf.patch
      - 0006-update-automake-files-for-arm64.patch
      - 0007-Fix-XPath-recursion-limit.patch
      libxml2_path: "/usr/local/bundle/gems/nokogiri-1.11.7/ext/nokogiri"
      memory_management: ruby
      iconv_enabled: true
      compiled: 2.9.12
      loaded: 2.9.12
    libxslt:
      source: packaged
      precompiled: false
      patches:
      - 0001-update-automake-files-for-arm64.patch
      - 0002-Fix-xml2-config-check-in-configure-script.patch
      compiled: 1.1.34
      loaded: 1.1.34
    other_libraries: {}

Tell us about your system!
What is the output from ruby -v? ruby 2.7.4p191 (2021-07-07 revision a21a3b7d23) [x86_64-linux-musl]
What is the output from gem -v? 3.1.6
What is the output from gem env?
RubyGems Environment:
  - RUBYGEMS VERSION: 3.1.6
  - RUBY VERSION: 2.7.4 (2021-07-07 patchlevel 191) [x86_64-linux-musl]
  - INSTALLATION DIRECTORY: /usr/local/bundle
  - USER INSTALLATION DIRECTORY: /root/.gem/ruby/2.7.0
  - RUBY EXECUTABLE: /usr/local/bin/ruby
  - GIT EXECUTABLE: /usr/bin/git
  - EXECUTABLE DIRECTORY: /usr/local/bundle/bin
  - SPEC CACHE DIRECTORY: /root/.gem/specs
  - SYSTEM CONFIGURATION DIRECTORY: /usr/local/etc
  - RUBYGEMS PLATFORMS:
    - ruby
    - x86_64-linux-musl
  - GEM PATHS:
     - /usr/local/bundle
     - /root/.gem/ruby/2.7.0
     - /usr/local/lib/ruby/gems/2.7.0
  - GEM CONFIGURATION:
     - :update_sources => true
     - :verbose => true
     - :backtrace => false
     - :bulk_threshold => 1000
     - "install" => "--no-document"
     - "update" => "--no-document"
  - REMOTE SOURCES:
     - https://rubygems.org/
  - SHELL PATH:
     - /root/.vscode-server/bin/507ce72a4466fbb27b715c3722558bb15afa9f48/bin
     - /usr/local/bin/adr-tools-3.0.0/src
     - /usr/src/app/bin
     - /usr/local/bundle/bin
     - /usr/local/sbin
     - /usr/local/bin
     - /usr/sbin
     - /usr/bin
     - /sbin
     - /bin

If you're using Bundler:

what is the output from bundle version? Bundler version 2.2.21 (2021-06-23 commit 0b5db72094)
what is the output from bundle config? (Take care to redact any credentials)

Settings are listed in order of priority. The top value will be used.
app_config
Set via BUNDLE_APP_CONFIG: "/usr/local/bundle"

build.ffi
Set for the current user (/root/.bundle/config): "--enable-system-libffi"

build.nokogiri
Set for the current user (/root/.bundle/config): "--use-system-libraries"

gemfile
Set via BUNDLE_GEMFILE: "/usr/src/app/Gemfile"

jobs
Set for your local app (/usr/local/bundle/config): 6

silence_root_warning

output of bundle platform

Your platform is: x86_64-linux-musl

Your app has gems that work on these platforms:
* ruby
* x86_64-linux

Your Gemfile specifies a Ruby version requirement:
* ruby 2.7.4p191

If Linux or a BSD variant, please note:

the distro you're using Alpine 3.13 with Docker image ruby:2.7-alpine3.13
the output of uname -a: Linux 040486625b79 5.10.25-linuxkit #1 SMP Tue Mar 23 09:27:39 UTC 2021 x86_64 Linux
the contents of /etc/lsb-release: File does not exist

Update to issue description: Added output of bundle platform

Hi, @tmaier, sorry you're having trouble. I'm not sure this is something that Nokogiri should try to handle (it feels likely to be bundler behavior, or that there are deployment workarounds), but I'll try to help.
I want to first make sure you saw this section in the installation manual:
http://nokogiri.org/tutorials/installing_nokogiri.html#using-vendorcache-to-deploy-to-another-architecture
which specifies that you can run bundle package --all-platforms to make sure your vendor/cache directory is fully populated.
If you are doing that, then can you tell me a bit more about when you're seeing that error message? Is it during the buildpack build phase, or when the app actually starts running?

@tmaier I'm going to go ahead and close this, but if you have more information on how we can help, please don't hesitate to post and we can pick up the conversation where we left off.

Thank you @flavorjones. I think you are right. It is a bundler issue. I will file it there.
I tried the idea around packaging, but I am not using this. I am using Bundler/nokogiri within a standard Dockerfile. So there is no vendor directory in-use.


feat: add DataFrame|LazyFrame.cast method

What type of PR is this? (check all applicable)

[ ] 💾 Refactor
[x] ✨ Feature
[ ] 🐛 Bug Fix
[ ] 🔧 Optimization
[ ] 📝 Documentation
[ ] ✅ Test
[ ] 🐳 Other

Checklist

[x] Code follows style guide (ruff)
[x] Tests added
[x] Documented the changes

If you have comments or can explain your changes, please do so below.
Additionally extends Expr|Series.cast with strict argument

Unrelated CI failure

thanks @FBruzzesi !
are we sure we need this? I think this can currently be accomplished with with_columns and Expr.cast, no? e.g.
df.with_columns(nw.all().cast(nw.String))

or
df.with_columns(nw.col(col).cast(dtype) for col, dtype in dtypes.items())

?
i'm just a little unsure about expanding the DataFrame / LazyFrame API when there's a simple Expr solution

i'm just a little unsure about expanding the DataFrame / LazyFrame API when there's a simple Expr solution

Fair enough!
Polars exposed it, it isa nice shortcut I am reaching out for, but definitly there is an Expr workaround

Closing as not planned for now

sure, thanks - we can always reconsider later

Yep, agree! This PR has so many conflicts that even if we want to consider adding it, it would be just easier to write it from scratch.
I am trying to do some cleanup, especially before sprints 😁


uniq function definition

Instead of
  uniq(): Sequence<T>;

Shouldn't definition look like?
  uniq(something:string): Sequence<T>;

because I am getting error 'Suplied parameters do not match any signature of call target'.

Hmm, what is giving you that error? The uniq method takes an optional keyFn parameter. It looks like you might be using some build system that doesn't like the way it's implemented, maybe?

I updated the doc for uniq to indicate that the keyFn argument is optional. That said, I'm not sure what build tool you're using that was giving you this error; so I don't know if this resolves the issue from your perspective. From my perspective, Lazy.js makes no commitment to work nicely with any particular external build tool.


Update quantized_generation_demo.ipynb

Fix version of torch to 2.0.1.
See https://github.com/pytorch/pytorch/issues/125109
What does this PR do?
Running this notebook with current pytorch version fails.
Test Platform: Windows 11 - Intel Core Ultra 7 165HL
Error Message: OSError: [WinError 126] ... Error loading "C:\Users\xyz\AppData\Roaming\Python\Python312\site-packages\torch\lib\shm.dll" or one of its dependencies.
Applying the recommendation in https://github.com/pytorch/pytorch/issues/125109, and rolling back the version to 2.0.1

Fixes # (issue)
Before submitting

[ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
[ ] Did you make sure to update the documentation with your changes?
[ ] Did you write any new necessary tests?

@dnoliver is it really necessary to use such old pytorch? As I can see in issue, downgrade on 2.2 should be enough

Will try with 2.2.2 and update you!

Run into an error in further cells:

The stack trace is:
---------------------------------------------------------------------------
RuntimeError                              Traceback (most recent call last)
Cell In[10], line 7
      4 # Tokenize the sample
      5 inputs = tokenizer([sample], return_tensors='pt')
----> 7 out = stateless_model.generate(
      8     **inputs,
      9     max_new_tokens=128,
     10     streamer=TextStreamer(tokenizer=tokenizer, skip_special_tokens=True),
     11     pad_token_id=tokenizer.eos_token_id,
     12     prompt_lookup_num_tokens=3,
     13 )

File ~\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.11_qbz5n2kfra8p0\LocalCache\local-packages\Python311\site-packages\torch\utils\_contextlib.py:115, in context_decorator.<locals>.decorate_context(*args, **kwargs)
    112 @functools.wraps(func)
    113 def decorate_context(*args, **kwargs):
    114     with ctx_factory():
--> 115         return func(*args, **kwargs)

File ~\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.11_qbz5n2kfra8p0\LocalCache\local-packages\Python311\site-packages\transformers\generation\utils.py:1559, in GenerationMixin.generate(self, inputs, generation_config, logits_processor, stopping_criteria, prefix_allowed_tokens_fn, synced_gpus, assistant_model, streamer, negative_prompt_ids, negative_prompt_attention_mask, **kwargs)
   1549     candidate_generator = self._get_candidate_generator(
   1550         generation_config=generation_config,
   1551         input_ids=input_ids,
   (...)
   1555         model_kwargs=model_kwargs,
...
Eltwise shape infer input shapes dim index: 3 mismatch

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@eaidova we were using this notebook to validate a Meteor Lake system that we later found that it had bad drivers for NPU and GPU.
We have validated it in another device, with good drivers, Windows 11, works fine:

@dnoliver great, I also tested your notebook, it is also working for me. Should we put some message about proper driver version requirements to install (e.g. refer on this page for NPU https://docs.openvino.ai/2024/get-started/configurations/configurations-intel-npu.html)?

This is how a healthy system looks like:

Display Adapters => Intel(R) Arc(TM) Graphics is healthy
Neural Processors => Intel(R) AI Boost is healthy

And this is how an unhealthy system looks like:

Both devices have a warning sign, and reporting error 43 in the Device Status.

The referenced documentation for the NPU is not accurate for Windows. In the docs it says "the NPU is most likely listed in “Other devices” as “Multimedia Video Controller.”", but it is in "Neural Processors". Other than that, installing latest drivers' versions should address most issues


Created a basic App

added material design
added simple speaker component
added mockup speaker Service
updated npm packages
live-Example: https://home.migula.net/fempire-angular

@lmigula whoops, missed this one - merged! thanks!


[BUG] ng add trows error leading to incomplete installation

Describe the bug
Installation failed while using ng add in a new project.
To Reproduce
In CLI
$ ng new test
? Do you want to enforce stricter type checking and stricter bundle budgets in t
he workspace?
  This setting helps improve maintainability and catch bugs ahead of time.
  For more information, see https://angular.io/strict Yes
? Would you like to add Angular routing? Yes
? Which stylesheet format would you like to use? CSS
$ cd test
$ ng add @alyle/ui
? Set up HammerJS for gesture recognition? Yes
? What themes should be added? minima-light
UPDATE package.json (1278 bytes)
✔ Packages installed successfully.
Cannot find module '@schematics/angular/utility/config'
Require stack:
-<EMAIL_ADDRESS>-<EMAIL_ADDRESS>-<EMAIL_ADDRESS>-<EMAIL_ADDRESS>-<EMAIL_ADDRESS>-<EMAIL_ADDRESS>-<EMAIL_ADDRESS>- /usr/local/lib/node_modules/@angular/cli/bin/ng

Expected behavior
No Error, updated app.module.ts, and probably some configs
Screenshots
N/A
Desktop (please complete the following information):

OS: Fedora 33
Browser N/A
Version N/A

Additional context
$ ng version

     _                      _                 ____ _     ___
    / \   _ __   __ _ _   _| | __ _ _ __     / ___| |   |_ _|
   / △ \ | '_ \ / _` | | | | |/ _` | '__|   | |   | |    | |
  / ___ \| | | | (_| | |_| | | (_| | |      | |___| |___ | |
 /_/   \_\_| |_|\__, |\__,_|_|\__,_|_|       \____|_____|___|
                |___/

Angular CLI: 11.1.2
Node: 14.15.4
OS: linux x64

Angular: 11.1.2
... animations, cli, common, compiler, compiler-cli, core, forms
... platform-browser, platform-browser-dynamic, router
Ivy Workspace: Yes

Package                         Version
---------------------------------------------------------
@angular-devkit/architect       0.1101.2
@angular-devkit/build-angular   0.1101.2
@angular-devkit/core            11.1.2
@angular-devkit/schematics      11.1.2
@angular/cdk                    10.2.7
@schematics/angular             11.1.2
@schematics/update              0.1101.2
rxjs                            6.6.3
typescript                      4.1.3

Hi! Thanks for informing. I was not able to reproduce the issue. Could you try following this guide on adding the library to your project - https://github.com/vvaldersteins/ngx-svg#installation ?

Closing due to no reply.


Application running on Linux (Ubuntu) Desktop with fractional scaling has fonts scaled while everything else - not

Is there an existing issue for this?

[X] I have searched the existing issues
[X] I have read the guide to filing a bug

Steps to reproduce
Linux desktop application has fonts scaled as per global system configuration, while everything else is unscaled.
Before Flutter 3.10 everything was unscaled (global system scaling was ignored) - this was not OK, but yet acceptable to my needs. Now it is broken and get worse: fonts are scaled, not matching all other application elements.
Expected results

Text size to match specified size: 48.
or
All application elements (including red square) to be scaled equally matching global system scale of 1.5

Actual results
Text is scaled (most likely because of global system fractional scale of 1.5) and is around 1.5 times bigger than expected, while other elements are not scaled
Code sample
Code sample
Build following application with Linux Desktop target:
import 'package:flutter/material.dart';
import 'package:google_fonts/google_fonts.dart';

const double size = 48;

void main() {
  runApp(const MyApp());
}

class MyApp extends StatelessWidget {
  const MyApp({super.key});

  @override
  Widget build(BuildContext context) {
    return MaterialApp(
      home: Material(
        child: DecoratedBox(
          decoration: const BoxDecoration(color: Colors.white),
          child: Center(
            child: DecoratedBox(
              decoration: BoxDecoration(
                border: Border.all(color: Colors.green),
              ),
              child: Row(
                mainAxisSize: MainAxisSize.min,
                crossAxisAlignment: CrossAxisAlignment.center,
                children: [
                  Container(
                    width: size,
                    height: size,
                    color: Colors.red,
                  ),
                  const SizedBox(width: 16),
                  Text(
                    '<- $size size square',
                    style: GoogleFonts.nunitoSans(fontSize: size),
                  )
                ],
              ),
            ),
          ),
        ),
      ),
    );
  }
}

Screenshots or Video

Screenshots / Video demonstration

Logs
No response
Flutter Doctor output
Doctor output
[✓] Flutter (Channel stable, 3.10.2, on Ubuntu 23.04 6.2.0-20-generic, locale en_US.UTF-8)
    • Flutter version 3.10.2 on channel stable at /home/kernel/work/common/flutter
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision 9cd3d0d9ff (4 days ago), 2023-05-23 20:57:28 -0700
    • Engine revision 90fa3ae28f
    • Dart version 3.0.2
    • DevTools version 2.23.1

[✗] Android toolchain - develop for Android devices
    ✗ Unable to locate Android SDK.
      Install Android Studio from: https://developer.android.com/studio/index.html
      On first launch it will assist you in installing the Android SDK components.
      (or visit https://flutter.dev/docs/get-started/install/linux#android-setup for detailed instructions).
      If the Android SDK has been installed to a custom location, please use
      `flutter config --android-sdk` to update to that location.

[✓] Chrome - develop for the web
    • Chrome at google-chrome

[✓] Linux toolchain - develop for Linux desktop
    • Ubuntu clang version 15.0.7
    • cmake version 3.25.1
    • ninja version 1.11.1
    • pkg-config version 1.8.1

[!] Android Studio (not installed)
    • Android Studio not found; download from https://developer.android.com/studio/index.html
      (or visit https://flutter.dev/docs/get-started/install/linux#android-setup for detailed instructions).

[✓] IntelliJ IDEA Ultimate Edition (version 2023.1)
    • IntelliJ at /home/kernel/work/common/idea
    • Flutter plugin version 73.1.1
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart

[✓] Connected device (2 available)
    • Linux (desktop) • linux  • linux-x64      • Ubuntu 23.04 6.2.0-20-generic
    • Chrome (web)    • chrome • web-javascript • Google Chrome 113.0.5672.126

[✓] Network resources
    • All expected network resources are available.

! Doctor found issues in 2 categories.

Hi @radzish
As my understanding, the Container on your sample code is not scaling by system scale, right?
If so, I think it works as intended due to the fixed size of Container:
Container(
    width: size,
    height: size,
    color: Colors.red,
),

Instead, you can use TextSpan to have the expected result:

Sample code with TextSpan
import 'package:flutter/material.dart';
import 'package:google_fonts/google_fonts.dart';

const double size = 48;

void main() {
  runApp(const MyApp());
}

class MyApp extends StatelessWidget {
  const MyApp({super.key});

  @override
  Widget build(BuildContext context) {
    return MaterialApp(
      home: Material(
        child: DecoratedBox(
          decoration: const BoxDecoration(color: Colors.white),
          child: Center(
            child: DecoratedBox(
              decoration: BoxDecoration(
                border: Border.all(color: Colors.green),
              ),
              child: Text.rich(
                textAlign: TextAlign.center,
                TextSpan(
                  children: [
                    WidgetSpan(
                      child: Container(
                        width: size,
                        height: size,
                        color: Colors.red,
                      ),
                    ),
                    TextSpan(
                      text: '<- $size size square',
                      style: GoogleFonts.nunitoSans(fontSize: size),
                    )
                  ],
                ),
              ),
            ),
          ),
        ),
      ),
    );
  }
}

Demo video
Screencast from 29-05-2023 17:04:58.webm

@huycozy, I have different issue: Font throughout application is scaled as per system configuration (note that I am on KDE and I am using fractional display setting, not fonts scaling). However, other widgets are not scaled.
What I had before - nothing was scaled, which is an issue in turn, but I understand that it is not easy to fix as GTK does not support fractional scaling and Flutter uses GTK wrapper for the app. But even that was better than what it is now - application looks completely broken because texts are scaled, while other elements - not.
The only workaround: to apply "scaling koef" to decrease all fonts in my app, which is not ideal, but works.

Thanks for your response. I'm not quite familiar with fractional scaling, I only can try it on Ubuntu distro. Not sure if KDE has better fractional scaling support than Gnome or not. But when trying it on Ubuntu (with your sample code), I can't see the issue.

Demo video (Ubuntu)
Screencast from 30-05-2023 10:57:31.webm

Can you please provide a video on KDE to show the issue more clearly when changing the scale?

I found the cause of fonts to be bigger: in my case (KDE + X11) MediaQuery.textScaleFactor is reporting to be 1.5 (when scaled to 150%). This causes fonts to be bigger as Text uses this property to scale text. So my workaround is that I am wrapping whole app with MediaQuery widget resetting textScaleFactor to 1.
However I noticed strange thing: for KDE + Wayland (as well as Ubuntu + Wayland) with scaling to 150%, MediaQuery.textScaleFactor does not change it keeps to be 1, the only thing that change is devicePixelRatio - it becomes 2 (why 2, not 1.5?).
@huycozy,  I will keep this info here and you if you feel like this is somehow to be expected or known issue I will close it, or feel free to close yourself.

With your information above, it might be helpful to address issue https://github.com/flutter/flutter/issues/65517 later. So I will keep this issue open for further insights from others. Thank you!

I posted some code on #65517 which shows how to get the fractional scale on KDE/Xorg.  It would be great to get something like that merged into Flutter, so please let me know if it's held up because of anything I can help with.
There seems to be a myth that Linux doesn't support fractional DPI scaling, as I've heard it from a few places.  In fact it has supported it perfectly for some years.  The system I'm using to type this reply uses it, as probably virtually all Linux systems do these days.  Most modern monitors need some sort of scaling, or the text ends up somewhere between tiny and completely unreadable...

See this suggestion for how to set the DPI scaling vs text scaling on X11 on various windowing systems.
The setup for this isn't consistent across different windowing environments.
This seems like we need to do some work to support this.
cc @robert-ancell @wmww

I have update to this issue. Looks like MediaQuery.textScaleFactor derives its value from org.gnome.desktop.interface text-scaling-factor setting. After I reset it to 1, all issues were fixed:
gsettings set org.gnome.desktop.interface text-scaling-factor 1.0


Feature/header magnifying glass url

ActionTray in Header

We need to change magnifying glass link in ActionTray to:
https://hk.jobsdb.com/hk/en/Search/FindJobs?JSRV=1&page=1
We also need to add the title tag to the SVG: "Search HK Jobs" for HK

BREAKING CHANGE:
Customisable title in <Icons title={...} />
EXAMPLE USAGE:
<Icons title={...} iconName={...} />

@patrickliu-sa plz let me know if any concern on the change of "icons" component


[FEATURE]UI Improvement-Home Page

Description
On the main page of LinkFree, it just shows the avatars of people part of the platform. Instead of just the avatars, if there is provision of providing more information, that would make the platform much better.
Suggestions:

[ ] 1. Cards interface having the avatar, name and description.
[ ] 2. Carousels widget
[ ] 3. List view
[ ] 4. Hover and show

Maybe add a toggle view option for user preference between the present view/ and the others suggested.
Screenshots

Additional information
None.

Can you please add a description for this issue?

By cards do you mean? Something like what github has:

If yes.. I guess we should keep it open to contributors for hacktoberfest. What do you think maintainers?

Yes, I guess this is a good start.

I don't think I have access

related to #144 #191 #122

As the profiles are now shown as chips with avatar and name and a hover effect is applied to show how many links they have in their profile, I’ll close this issue for now. Feel free to open new issues if you have ideas for how the ui could be improved further, preferably with a mock-up so it’s easy to visualise the changes.


Arg to choose PhantomJS version at build time

This change makes it possible to specify the PhantomJS version at image build time.
eg. docker build --build-arg PHANTOM_JS_VERSION=1.9.8-linux-x86_64 -t phantomjs198_image .
Omitting the build-arg defaults to version 2.1.1

Interesting trick. Thanks.


feature/BI-12229-Implementing-DownloadFile

Implementing Download the File from S3
and Clean up the code

Need to Clean Up and work


(FM-5972) gettext and spec.opts

https://github.com/puppetlabs/modulesync_configs/pull/114
https://github.com/puppetlabs/modulesync_configs/pull/112


rest example

An example using the buyers recommend and place trade

There is a trade example here
https://github.com/redhat-ipaas/connectors/tree/master/examples/trade-buy-place-example


Update router with auth check

Check for auth and redirect to Sign In page if not authorized

Done without redirect - requires an update


Error with TimeSeriesKMeans class import

Discussed in https://github.com/alan-turing-institute/sktime/discussions/2949

Originally posted by foe12 July  7, 2022
Please, help me to understand why I cant to import class TimeSeriesKMeans?  All my efforts to import TimeSeriesKMeans are handling to infinity.
For clarity, I have jupyter notebook with 1 row:
from sktime.clustering.k_means import TimeSeriesKMeans
sktime version is 0.11.2
OS windows
When I interrupt kernel I see errors:
err_log.txt
Hope for your help to understand what's wrong. Thank you in advance!

hi, seems like a permission error, can you import other modules, e.g.
from sktime.classification.dummy import DummyClassifier
PermissionError                           Traceback (most recent call last)
File C:\Program Files\Python39\lib\tempfile.py:255, in _mkstemp_inner(dir, pre, suf, flags, output_type)
254 try:
--> 255     fd = _os.open(file, flags, 0o600)
256 except FileExistsError:
PermissionError: [Errno 13] Permission denied: 'C:\Program Files\Python39\lib\site-packages\sktime\distances\pycache\tmpmax6l57o'

from sktime.classification.dummy import DummyClassifier

Yes, I can import DummyClassifier and other classes. I faced with this issue only at TimeSeriesKMeans import

I start check other classes and have problem with import:
from sktime.forecasting.naive import NaiveForecaster and other classes from forecasting.
Problem the same:
PermissionError: [Errno 13] Permission denied: 'C:\Program Files\Python39\lib\site-packages\sktime\utils\numba\pycache\tmpk9oih7d8'

I solve the problem by adding permission to write at C:\Program Files\Python39\ to my os user. Thanks!


chore(main): release 1.1.1

:robot: I have created a release beep boop
1.1.1 (2024-02-27)
Bug Fixes

bump (526bf0c)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/javalent/obsidian-utilities/releases/tag/v1.1.1 :sunflower:


Support exe/msi format

Hi
Not everyone likes UWP based and it is possible to get this app on exe/msi format?

It is not possible to get this app in exe/msi format. Maybe if this app is ported to WinUI 3 it could be possible but it is not planned.


Send template?

Does this support mandrill_client.messages.sendTemplate ?
Would like to use this transport to send templates if possible.

@rebelmailbot would you accept a PR for sendTemplate with tests.

@motdotla would you accept a PR for sendTemplate with tests.

Question for you guys: Why are you using Nodemailer at this point rather than just the Mandrill SDK?
For instance, we use Nodemailer and transports to abstract sending an email across multiple services. But at the point you're sending templates, it no longer makes any sense.

@devinus this is a pretty good question. For us it makes sense since we use a mix of custom built templates and mandrill hosted templates so that devs are in charge of the most complex templates and that that marketing is in the charge of the templates that are simple and/or that are changing a lot.

@devinus It also makes a lot of sense to support the same feature-set than the smtp based mandrill API that allows using a remote template.

@seriousben I'm not sure I understand. Why not use the Mandrill SDK? https://mandrillapp.com/api/docs/index.nodejs.html

@devinus because of the abstraction nodemailer gives us allows us to use different providers almost seamlessly with or without remote templates.
Depending on the API would mean moving that abstraction in our own code and we would need to depend on both nodemailer for some other providers we are using + the mandrill API.

I would suggest forking the repo and extending for more specifics to mandrill.
https://mandrillapp.com/api/docs/messages.JSON.html#method=send-template

Guys, I'm unsure why this can't be done using mandrillOptions, e.g. mandrillOptions: { template_name: 'mytemplate' }. Can you help me understand?

Make a PR ;-)

On Feb 18, 2016, at 9:30 PM, Devin Torres<EMAIL_ADDRESS>wrote:
Guys, I'm unsure why this can't be done using mandrillOptions, e.g. mandrillOptions: { template_name: 'mytemplate' }. Can you help me understand?
—
Reply to this email directly or view it on GitHub https://github.com/Rebelmail/nodemailer-mandrill-transport/issues/30#issuecomment-186060446.

@devinus I think I follow now.
There are 2 different endpoints. This transport hits the send endpoint meanwhile they need to hit a completely different endpoint.
Passing the template_name variable through the mandrillOptions object will have no effect since the endpoint the transport uses doesn't support it. My understanding is that #31 completely resolves the issue by extending the library seamlessly and with backwards compatibility.

Oh... Oooooooohhhh.

Merged in https://github.com/Rebelmail/nodemailer-mandrill-transport/commit/87e5f8a22ecd18906e139fc6ebf647e2a134f312.


feat: devotions, witnesses (wip)

Current dependencies on/for this PR:

main

PR #6   👈

This stack of pull requests is managed by Graphite.


Reduce build times and frontend JS size by removing excess dependencies.

Currently it takes ~10s to build release on a M2, and 16.1 MB to serve in dev.
All FTL builds and most CI rely on this install.

Looks like this might be adding a lot of deps that we don't need: https://github.com/jsonnext/codemirror-json-schema/issues/125

https://github.com/shikijs/shiki/issues/658

Removing codemirror deps and temporarily showing a blank div brings the build down to 3s and 1.7 MB.

@gak I just tried this locally on this branch and on main and didn't notice a massive difference:
this-branch: just build-all  22.41s user 9.17s system 144% cpu 21.893 total
main: just build-all  28.29s user 9.80s system 139% cpu 27.295 total

Definitely reduces the size though. I'm ok with pulling this out for now, but we might have to clean up the new version of the form a bit since this might be the most used feature on the console 😂

Also, without json-schema validation in the UI it might be really difficult for users to know what fields they need to send on a request. Maybe we need to solve that in another way, but there currently isn't a great way to see what should and should not be there. 🤔

I am bringing it back, just with less deps. It will at least save the size of the deploy at least.

Nice! Sounds great 👍

I think this was "fixed" with #2183

Ah of course, closing!


Update metadata schema url

This PR updates the metadata schema used by metadata.py to experiment-metadata/1-0-3.json
Closes #424. Related #429

Hello @dougiesquire! Thanks for opening this PR. We checked the lines you've touched for PEP 8 issues, and found:

In the file payu/metadata.py:

Line 39:80: E501 line too long (169 > 79 characters)


Signature nodes should be removed from the returned payload on verify()

When doing a verify() the payload returned contains the signature nodes. As these nodes have to be removed before generating the hash (At least for enveloped signatures) this means that any nodes inserted on the signature might be considered valid despite not being so which opens the risk for accepting unsigned data as valid.
I can submit a patch to this issue later if #46 is merged.

Great idea to remove unsigned data from verify() output, thanks for implementing.

My pleasure!


How to change the service configuration file for BC Production/Sandbox

I am having the issue when need to call the Standard API for Production. I get the following message.
{"error":{"code":"Internal_CompanyNotFound","message":"Cannot process the request because the default company cannot be found. You can specify a default company in the service configuration file, or specify one for each tenant, or you can add a query string in the form of "company=[name]". You can see the available companies by accessing the default OData web service, Company. For more information, see "OData Web Services" in Help."}}
Does anyone here know how to solve it ?

Which authentication is used AAD or webservice access key and can you please provide the URL

Which authentication is used AAD or webservice access key and can you please provide the URL

I am using Web Service access key. Here is a the URL to access API.
https://api.businesscentral.dynamics.com/v1.0/376ca222-0508-4937-9d40-dedde184b756/api/beta/paymentTerms

You need to be in the scope of a company to get the paymenttems (just like in the client)
Try
https://api.businesscentral.dynamics.com/v1.0/376ca222-0508-4937-9d40-dedde184b756/api/beta/companies
to get the companies
and then
https://api.businesscentral.dynamics.com/v1.0/376ca222-0508-4937-9d40-dedde184b756/api/beta/compnaies('the id of the company)paymentTerms

Unfortunately there is a bug where the default Company is not recognised by the API's despite the error message falsely stating that setting a default company will work.
Until the bug is fixed the only way to overcome this is to add the company to the URL
i.e.
https://api.businesscentral.dynamics.com/v1.0/xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx/odataV4/Company('CRONUS AU')/VendorLedgerEntries

Closing this issue as it seems like an application issue which is beyond the scope of this repository which is only for issues related to the AL compiler in the latest developer preview environment for Dynamics 365 Business Central.
If you are still experiencing this issue, we suggest that you open a support case or file a bug in Collaborate, to ensure that all Business Central users benefit from your catch as soon as possible.
To open a support case, you can:

Open a support request to CSS through the PartnerSource portal
Contact your Service Account Manager (SAM) in your local subsidiary to understand what is included in your contract as of support incident and PAH (Partner Advisory Hours). Your SAM might also direct you "step by step" how to open a support request or how to get credentials, if this is the first time for you or your company

If you file the bug in Collaborate, remember to include steps to reproduce the issue, and the Business Central build number and country version you're using.


Line Numbers

Can you put the line numbers in the comparison report?
It would be very useful.
Tanks

This is now fixed, see version <IP_ADDRESS>.


Add upgrade guide for v8

Closes #3516
This guide is generated from no-compat labelled PRs: https://github.com/cupy/cupy/issues?q=label%3Ano-compat
Note that no-compat changes between v8 pre-releases (alpha/beta/rc) are excluded from this guide.

pfnCI, test this please.

Jenkins CI test (for commit a8cc49434000247bc3eddc1b50be3d15d76726d1, target branch master) succeeded!

pfnCI, test this please.

Jenkins CI test (for commit adece501517fdf0768125852cff62a4e5b08d615, target branch master) succeeded!

pfnCI, test this please.

Jenkins CI test (for commit 65430debff0253de724f29b174a439b0105ac64d, target branch master) failed with status FAILURE.

Jenkins, test this please

Jenkins CI test (for commit 65430debff0253de724f29b174a439b0105ac64d, target branch master) failed with status FAILURE.

pfnCI, test this please.

Jenkins CI test (for commit 65430debff0253de724f29b174a439b0105ac64d, target branch master) succeeded!


Optimize scene UBOs

In this PR, new scene UBOs are created and used in subsystems where at least one data of the scene UBO (view/projection matrix, eye position) is modified compared to the regular (final) scene rendering.
It is the case for MirrorTexture, (CSM) ShadowGenerator and ReflectionProbe. In each case a new scene UBO (or 6 for reflection probe and n for CSM with n layers) is created and used in place of the regular scene ubo to perform the subsystem rendering. This way, the regular scene ubo (and each of the specifically created scene UBO) holds only a single GPU buffer which enables some optimizations inside the UniformBuffer class (we get rid of a comparison between two arrays of float + an array copy if the comparison is different). Also, having a single GPU buffer in the scene UB class is better for the fast path mode in WebGPU as it can lead to fewer recreations of the fast path bundle.
[EDIT]
I have also added support for clip planes in ShaderMaterial written in GSL.
The two changes in the validation tests are because those tests are overriding the Math.random function and thus potentially making validation tests coming after them fail.

Is this ready to be merged?

I think we should wait for the review from @deltakosh.

@deltakosh is it ok for you?


Improve ModelBuilder perf

By performing entity type culling once per model and storing derived types in EntityType
Fixes #3097

:shipit:


feat(examples): add NATS messaging provider example

Feature or Problem
This PR adapts our NATS messaging provider to simplify the options and configuration and set it up for our developer guide for building a provider. The action item here for developers is to generate this capability provider and then implement the functionality for the wasmcloud:messaging interface (instructions will be detailed on wasmcloud.com).
The TODOs and todo!s in the code are intentional and meant for developers to implement it after generating the project from the template. For a full implementation the README references our capability provider.

[x] We should bump the provider SDK as well, I will create a followup PR in order to do that, release the provider SDK 0.4.0, and rename actor to component in the context.

Related Issues

Release Information
N/A
Consumer Impact

Testing

Unit Test(s)

Acceptance or Integration

Manual Verification

Integration test probs failing because I changed the provider template 😄 Yay tests!

In order to bump the provider SDK to 0.4.0 and release it, I also had to bump wasmcloud-tracing to 0.3.0 in order to bring in the wasmcloud-core bump to 0.5.0. Wheee crates!
(no breaking changes in wasmcloud-tracing, it would just break projects that depend on both tracing and core, like the provider SDK)


Blank space above and below the chart

After upgrading to 1.11 I found blank space on top and bottom of the chart.

this is my modifier of the chart:
modifier = Modifier.height(dimens.standard320).background(Color.LightGray)

Hello! Thanks for the report. Since this isn’t a universal problem—it doesn’t occur in the sample app, for example—could you please let us know how to reproduce it? A minimal reproducible example or a list of steps will work. In the future, please use the “Bug report” issue template. Cheers!

I noticed this too when upgrading from 1.10.1 to 1.11.0.
It seems that the chart now reserves space for the marker. Before, the marker was drawn above the chart.
Not sure, if this behavioral change was intended.

It’s always been the expected behavior for space to be made for Markers, @p-fisher. I’ve compared the two Vico versions that you’ve mentioned and haven’t been able to spot any differences in this respect. Could you share some more information on your setup?

In my project I'm using markers with multiple lines of text.
To reproduce with the vico sample app:

Open Marker.kt
In line 104 set private const val LABEL_LINE_COUNT = 10

Compare versions 1.10.1 and 1.11.0.
Screenshot of 1.10.1:

Screenshot of 1.11.0:

I'm not sure what behavior I'd expect.
The behavior of 1.11.0 seems more logical but in my case it would be ideal to have the behavior of 1.11.0 but also have a parameter in dp of how much the marker is allowed to go beyond the chart composable.
Somewhat like this:
markerAboveChart: Dp = 0.dp,

Thanks, @p-fisher! We’ve recently resolved an issue where TextComponent#lineCount failed to be considered in some instances, and this is a result of that change. We can’t exactly draw outside of the bounds of the top-level elements, as this could lead to clipping, unwanted overlaps, etc. Also, while Compose seems to let us do this, I’m not sure if such drawing is possible in the view system. By default, at least, whatever a view draws seems to be clipped to its bounds. Please keep in mind that the top-level elements are resizable, so if your chart becomes too small once space is made for its Marker, you can make the top-level element larger. In the future, we’ll be looking into adding a feature that draws Markers in separate Windows (see Compose’s Popup). Markers will then not have to request any insets.

@patrickmichalik Sounds like a really good plan. I think showing markers using popups is a very good fit.

POPUP! 😃

Thanks for your replies, But I couldn't understand that you have planned to fix this issue or not?

Please see my first comment, @rezafaraji93. Once you’ve provided sufficient information for us to reproduce the behavior that you’re seeing, we’ll take a look and share our findings. It’s likely that there’s a connection between this behavior and what @p-fisher and I have been talking about, but there might be more to it.

I used custom marker component, then changing the inset value in marker component solved my problem.


Onboarding documentation for new project contributors

For different levels of project contributors, it would be helpful to have onboarding documentation on how to bring them onto the team.

What can I do to help?

Thanks for asking! This was written before much of the current documentation existed. I'd be interested in hearing how your experience has been and whether you feel like there are gaps in our current docs that would have made it easier or where things are confusing.
Are you familiar with the concept of friction logging?


Update README.md

Fixing a "Code sample is missing content" error from CATS report per https://mseng.visualstudio.com/TechnicalContent/_workitems/edit/1548981.
Reworked content to reflect only one value currently documented.

@Flanker32 - would you please be able to review and merge this fix? This corrects a "Code sample is missing content" error from a recent CATS report per https://mseng.visualstudio.com/TechnicalContent/_workitems/edit/1548981. Thanks much!

@craigcaseyMSFT Please made another pr to commit to develop branch, we will merge it at the release.


#1723 should address the latlon grid painting issue and then some

@mikebravoyes does this work for you?

@spyhunter99
That looks perfect. When will the new version 6.1.11 be on the market?

tonight

@spyhunter99
Thanks for the update, but there is still problem. My code is
LatLonGridlineOverlay2 gridOverlay = new LatLonGridlineOverlay2();
gridOverlay.setTextStyle(Paint.Style.FILL_AND_STROKE);

.setTextStyle(...) crashes with an InvocationTargetException - with the "detailMessage":
No virtual method setTextStyle(Landroid/graphics/Paint$Style;)V in class Lorg/osmdroid/views/overlay/gridlines/LatLonGridlineOverlay2; or its super classes (declaration of 'org.osmdroid.views.overlay.gridlines.LatLonGridlineOverlay2' appears in /data/data/net.braun_home.sensorrecording.pro/code_cache/.overlay/base.apk/classes.dex)
When I copy the code of LatLonGridlineOverlay2 to an own file (let's say LatLonGridlineOverlay3) and adapt the package, the class and constructor name accordingly, then everything works fine with:
LatLonGridlineOverlay3 gridOverlay = new LatLonGridlineOverlay3();
gridOverlay.setTextStyle(Paint.Style.FILL_AND_STROKE);

The code in both cases is identical, but when I invoke the method of the osmdroid library, it crashes. Any idea, why this happens?

Are you using version 6.1.11?
On Tue, Aug 3, 2021 at 9:08 AM Michael L. Braun @.***>
wrote:

@spyhunter99 https://github.com/spyhunter99
Thanks for the update, but there is still problem. My code is
LatLonGridlineOverlay2 gridOverlay = new LatLonGridlineOverlay2();
gridOverlay.setTextStyle(Paint.Style.FILL_AND_STROKE);
.setTextStyle(...) crashes with an InvocationTargetException - with the
"detailMessage":
No virtual method setTextStyle(Landroid/graphics/Paint$Style;)V in class
Lorg/osmdroid/views/overlay/gridlines/LatLonGridlineOverlay2; or its super
classes (declaration of
'org.osmdroid.views.overlay.gridlines.LatLonGridlineOverlay2' appears in
/data/data/net.braun_home.sensorrecording.pro/code_cache/.overlay/base.apk/classes.dex
http://net.braun_home.sensorrecording.pro/code_cache/.overlay/base.apk/classes.dex)
When I copy the code of LatLonGridlineOverlay2 to an own file (let's say
LatLonGridlineOverlay3) and adapt the package, the class and constructor
name accordingly, then everything works fine with:
LatLonGridlineOverlay3 gridOverlay = new LatLonGridlineOverlay3();
gridOverlay.setTextStyle(Paint.Style.FILL_AND_STROKE);
The code in both cases is identical, but when I invoke the method of the
osmdroid library, it crashes. Any idea, why this happens?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/osmdroid/osmdroid/pull/1724#issuecomment-891832186,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAPCIGI2NJOOWUNOJJ4KOMTT27S4BANCNFSM46PYAVDQ
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&utm_campaign=notification-email
.

Yes, of course. In the previous version 6.1.10, the method
public void setTextStyle(Paint.Style paint) { mTextPaint.setStyle(paint);}
did not yet exist.

@spyhunter99
Good news! I did another try today with LatLonGridlineOverlay2 and - to my surprise - now it works. No idea what went wrong yesterday. I didn't change anything, except a new start of Android Studio. Maybe there was an old code fragment somewhere in the cache, which was removed by the restart.
Anyway, now everything is OK. Thanks again for the modification.


Swiper Directive index not updating after swiping to last slide

v4.6.1
Swiper Directive index doesn't always update after swiping to last slide. After swiping to the last slide and then swiping again in direction of last slide then the index property sometimes updates. swiper.isEnd also returns false after swiping to the last slide.

If you are checking the isEnd and index from the Swiper instance then the problem should be in the Swiper and not in this library. I haven't seen such behavior though so have you tried with default configuration etc. to see if its some configuration option that is causing it. Also on which event are you checking the Swiper index / isEnd?

I'm checking the Swiper index on the indexChange event.

Ok can you get that problem happen on the example app? It logs the index in console. Also are you using any special configuration?

I fixed this issue by removing slidesPerView: 'auto' on Swiper config. Thanks

Ok so its Swiper bug then with that option.


Update upgrade.md

Proposed changes

Unreleased project version (optional)

Related issues (optional)

Deploy preview for docsdocker ready!
Built with commit 8f250e09d635f09f465c014a6a2a5acecdab0c98
https://deploy-preview-8718--docsdocker.netlify.com


[Fluff] Ths very polite conversation between two agents when generating a commit message.

Issue

Version and model info
No response

Is it just me or is this a gratuity loop? Are you using stop trigger tokens?

Thanks for trying aider and filing this issue.
Sometimes LLMs get confused. You can use --weak-model to pick a more capable LLM for your commit messages.

I'm labeling this issue as stale because it has been open for 2 weeks with no activity. If there are no additional comments, I will close it in 7 days.Note: A bot script made these updates to the issue.


Background doesn't complete fill up the canvas

Bug Description
There's a thin line of pixels when setting an image as background, see screenshot
Screenshots

Do not alter or remove anything below. The following sections will be managed by moderators only.
Acceptance Criteria
QA Instructions

As per #819, this is also true for the page thumbnails
/cc @pbakaus

Looks like adjust using the clip-path in masking seems to cause the issue. E.g. assigning -1 values here "fixes" it:
https://github.com/google/web-stories-wp/blob/f272e875c9e4fff8ea4632cebad5858ae2ca2217/assets/src/edit-story/masks/display.js#L29-L34
Not sure if the background element should be masked at all though.

Okay, just saw a comment from @samitron7 as well that shapes should not be allowed to be set as background. So for now, I'll see if I can disable mask for background. Probably better, otherwise it might look something like this:

@miina that makes sense, but the mask is supposed to cove 100% of the width/height anyway so there's another underlaying issue here. Do you mind looking into that? are masks not filling the entire shape?

The clip-path is the one that seems to use 1px from the edges.
And yes -- it looks like masks are filling the entire space -1px. I can look into it but not before Monday, probably good to follow up in a separate issue.

@wassgha This issue was specifically for the background and that is fixed.
Will create a separate issue for investigating if we should generally consider the 1px the clip-path reduces.

Follow-up issue for clip-path + masking: https://github.com/google/web-stories-wp/issues/855


MacOS runtime error (Unable to load shared library 'OpenCvSharpExtern' or one of its dependencies)

Summary of your issue
Hi! My issue is very similar to #949. The only difference is that I use C# .NET Core 3.1 project.
I get Unable to load shared library 'OpenCvSharpExtern' or one of its dependencies constantly while trying to create Mat object.
I have correct nuget packages and copiyng libOpenCvSharpExtern.dylib from runtimes to netcoreapp3.1 folder. I also made an app to run in x64, but it didn't help.
Environment
MacOS 10.15.4, Visual Studio for Mac 8.7.4 (build 11)
Output:

"Unable to load shared library 'OpenCvSharpExtern' or one of its dependencies. In order to help diagnose loading problems, consider setting the DYLD_PRINT_LIBRARIES environment variable: dlopen(libOpenCvSharpExtern, 1): image not found"

I have the same error

I had some error

Had the same problem with Xcode already installed. What worked for me was to update all required libs for OpenCV. You can find them here: https://github.com/shimat/opencvsharp/blob/master/.github/workflows/macos10.yml
brew install wget pkg-config mono-libgdiplus gtk+ ffmpeg glog yasm harfbuzz jpeg libpng libtiff openexr openjpeg metis openblas opencore-amr protobuf tbb webp

OpenCvSharp library looks amazing and I am looking forward to see it in action.
But right now, I am having the same problem with OpenCvSharpExtern (Unable to load shared library) in my web app created with Visual Studio for Mac and deployed on a local docker container.
Visual Studio doesn't give much information on his Docker compose deployment and I don't know if I need OpenCvSharp-runtime for Mac or the one for Debian (which I kind of think the container is deployed locally on).
It would be amazing to have a detailed list of what needs to be done to make sure this dll is accessible to the app.
Any help would be wonderful!


Call to private Instamojo\Instamojo::__construct() from scope App\Controllers\Donate

I followed the direction given in docs and I get an error: Call to private Instamojo\Instamojo::__construct() from scope App\Controllers\Donate

I apologize... I didn't pay attention to the README and directly jumped to docs...
It's working after I followed the directions in README...


Use Waymo Protos Directly

What changes do you make in this PR?
In this PR, we remove the dependency on waymo-open-dataset-tf-2-11-0 by including the Protobuf definitions inside the scenarionet repository itself.

Please describe why you create this PR

This allows users to avoid having to install waymo-open-dataset-tf-2-11-0, which has many dependencies like numpy==1.5.1 which are outdated.
Checklist

[x] I have merged the latest main branch into current branch.
[x] I have run bash scripts/format.sh before merging.
Please use "squash and merge" mode.

@QuanyiLi Do we have license issue here?

The protobuf definitions are under Apache 2.0, so it should hopefully be fine. I'm not sure under which license scenarionet is under though.

Like MetaDrive, ScenarioNet can use Apache 2.0 as well. So there won't be conflicts.


Better find behaviour and performance

This will result in find returning the first value to match a predicate rather than the last, and now the predicate is only run until the first match rather than on every item in the structure.
/cc @natefaubion @jonsterling

👍 Looks good


WKO site is unuseable

There is a big white overlay, so the site cannot be accessed: https://www.wko.at
Thanks for fixing!

With the latest update the consent screen is not blocked at all.
At least the site is usable.

@mbaierl Yeah for some sites that's the only option unfortunately. Closing this now 👍


[bazel] enable more bazelified C++ distribtests

Reenable the bazelified version of cpp_distribtest_cmake_linux and cpp_distribtest_cmake_pkgconfig_linux distribtests

Non-bazel tests are green: https://source.cloud.google.com/results/invocations/cdfabceb-692e-424a-b1de-90372509db5d


Fix event handler filling channel and being blocked

The goroutine consuming g.eventChan channel could get blocked if a
linker generate more than maxEvents events.
Fix this problem discarding events when the channel is full.
Return an error if this point is reached.
Increase the number of maxEvents to reduce the probability of event
discard.

run ovn-k8s-tests
run k8s-tests

run ovn-k8s-tests

run ovn-k8s-tests

run ovn-k8s-tests


Relax multi-level polymorph chain prohibition

Coverage decreased (-0.04%) to 99.956% when pulling 140080082cbcdcd6328e4a38829efb656542454b on CyberiaResurrection:AddMultilevelPolymorph into 122adff89700908ab65375d348bcb4572939486f on Algo-Web:master.

Coverage remained the same at 100.0% when pulling 6692baf3a3c80e26f10bd0bcd4c440077ef7280f on CyberiaResurrection:AddMultilevelPolymorph into 122adff89700908ab65375d348bcb4572939486f on Algo-Web:master.

Coverage remained the same at 100.0% when pulling a7f15b77f38abc569f453f3da8ecb972434685e7 on CyberiaResurrection:AddMultilevelPolymorph into 122adff89700908ab65375d348bcb4572939486f on Algo-Web:master.

Coverage remained the same at 100.0% when pulling a7f15b77f38abc569f453f3da8ecb972434685e7 on CyberiaResurrection:AddMultilevelPolymorph into 122adff89700908ab65375d348bcb4572939486f on Algo-Web:master.

Coverage remained the same at 100.0% when pulling a7f15b77f38abc569f453f3da8ecb972434685e7 on CyberiaResurrection:AddMultilevelPolymorph into 122adff89700908ab65375d348bcb4572939486f on Algo-Web:master.


fix: Update Typescript

Coverage remained the same at 100.0% when pulling ac2bd312a7578c204164956dea2995a78f3a99f9 on dev-update-packages into 6a4d4927150318ded936f90c433f7d68124bfb74 on main.


Fix behavior for PathPrefixStrip

When pushing data to downstream proxies; malformed requests were being
sent.
The corrected behavior is as follows:

Route Stripped
URL
Passed to Backend

/
/
/

Route Stripped
URL
Passed to Backend

/stat
/stat
/

/stat
/stat/
/

/stat
/status
/status

/stat
/stat/us
/us

Route Stripped
URL
Passed to Backend

/stat/
/stat
/stat

/stat/
/stat/
/

/stat/
/status
/status

/stat/
/stat/us
/stat/us

Prior, we could strip the prefixing /, and we'd also ignore the case
where you want to serve something like /api as both the index and as a
subpath.
Additionally, this should resolve a myriad of issues relating to
kubernetes ingress PathPrefixStrip.

Let me know if there's anything else we need (rebase, etc).

Will rebase as soon as we get a thumbs up.

@timoreimann your https://github.com/timoreimann/traefik/commit/224f2a1d86d9fe070e384a10f5b07f32d95ec22d is a very clean way to test ❤