OperatorNotAllowedInGraphError: Iterating over a symbolic tf.Tensor is not allowed when using a dataset with tuples

Click to expand!
Issue Type
Bug
Have you reproduced the bug with TF nightly?
No
Source
source
Tensorflow Version
2.11
Custom Code
Yes
OS Platform and Distribution
Windows
Mobile device
No response
Python version
3.9
Bazel version
No response
GCC/Compiler version
No response
CUDA/cuDNN version
No response
GPU model and memory
No response
Current Behaviour?
I am trying to create my own transformer and train it. For this purpose, I use dataset to handle my data. The data is created by a code snippet from the tensorflow dataset.from_tensor_slices() method [documentation article](https://www.tensorflow.org/api_docs/python/tf/data/Dataset#from_tensor_slices) . Nevertheless, tensorflow is giving me the following error when I call the fit() method:

> "OperatorNotAllowedInGraphError: Iterating over a symbolic tf.Tensor is not allowed: AutoGraph did convert this function. This might indicate you are trying to use an unsupported feature."

The used code is reduced significantly just for the purpose of reproducing the issue.

I've also tried passing the data as a dictionary instead of a tuple in the dataset and a couple more things but nothing worked. It seems that I am missing something.
Here is a link to [google colab example](https://colab.research.google.com/drive/1mn6iseJLnJwTmwakYa2XuxszKtR6sV9G#scrollTo=Cj9g0bGN1Fo3)

Standalone code to reproduce the issue
import numpy as np
import tensorflow as tf

batched_features = tf.constant([[[1, 3], [2, 3]],
                                [[2, 1], [1, 2]],
                                [[3, 3], [3, 2]]], shape=(3, 2, 2))
batched_labels = tf.constant([['A', 'A'],
                              ['B', 'B'],
                              ['A', 'B']], shape=(3, 2, 1))
dataset = tf.data.Dataset.from_tensor_slices((batched_features, batched_labels))
dataset = dataset.batch(1)
for element in dataset.as_numpy_iterator():
  print(element)

class MyTransformer(tf.keras.Model):
    def __init__(self):
        super().__init__()

    def call(self, inputs, training):
        print(type(inputs))
        feature, lable = inputs
        return feature

model = MyTransformer()
model.compile(optimizer=tf.keras.optimizers.Adam(learning_rate=1e-3),
              loss=tf.keras.losses.BinaryCrossentropy(),
              metrics=[tf.keras.metrics.BinaryAccuracy(),
                       tf.keras.metrics.FalseNegatives()])

model.fit(dataset , batch_size = 1, epochs = 1)

Relevant log output
No response

The bug in the code is that you are using the fit method of the tf.keras.Model with the train_data dataset, but train_data is not defined anywhere in the code.
Solution:
model.fit(dataset, batch_size=1, epochs=1)

Additionally, the call method of your custom MyTransformer model is not returning the labels lable which is required for the training process. You'll need to return both the features and the labels from the call method in order for the model to be trained properly:
def call(self, inputs, training):
    feature, lable = inputs
    return feature, lable

Finally, the loss function that you are using, tf.keras.losses.BinaryCrossentropy is designed for binary classification problems, but the labels in your dataset are categorical. To handle this, you should use a different loss function, such as tf.keras.losses.CategoricalCrossentropy, which is designed for categorical classification problems.

Let me know if it helps ?

Hi @DURGESH716, and thank you for the reply.
using the wrong variable was a mistake that I made when pasting the example here. Even if a not defined variable was used I would've expected "NameError: name 'train_data' is not defined" error and not one for a symbolic tensor. The link that was provided with the description of the issue points out to google colab example where the correct variable was used. So the original question still stands.
I've now modified the example according to your suggestions to return feature and label, plus using the CategoricalCrossentropy and nothing changes. Here is a link to the example in google colab:
https://colab.research.google.com/drive/1mn6iseJLnJwTmwakYa2XuxszKtR6sV9G#scrollTo=Cj9g0bGN1Fo3
Can you help me to understand what the real issue is?

Proceeding with the @pjpratik points, I think it is important to ensure that the data is correctly formatted and preprocessed before being passed to the model. Some common issues include incorrect tensor shapes, data types, and normalization. To resolve the issue, you may need to inspect and debug the data preprocessing steps, including any data augmentation or batching operations that are applied to the data before passing it to the model. Additionally, it may be helpful to compare the data and preprocessing steps used when passing features and labels directly to the model versus when using a tf.data.Dataset.
Rest everything logic and code is syntactically correct, please check the dataset properly and pre-process it carefully.

Hi, @mihail-vladov
Apologize for the delay and It seems like you haven't done pre-processing with your dataset, your batched_labels should be in numerical values but it was in string type so you'll have to do some pre-processing with batched_labels with one hot encoding approach so that batched_labels  will convert into numerical values so you can refer this official documentation
When you pass dataset from tf.data.Dataset() to model.fit() it is expected that it will directly generate batches, not individual examples. You just need to batch your dataset before training as shown below and please refer tf.data.Dataset():
batch_size=32
dataset = dataset.batch(batch_size)
model.fit(x=dataset)

I have added sample code example for your reference, How to use tf.data.dataset with model.fit() so please refer this gist-file and also refer our official documentation for Customize what happens in Model.fit
I hope it will help you to resolve your issue and if issue still persists please let us know ? or Could you please confirm if this issue is resolved for you ? Please feel free to close the issue if it is resolved ? Thank you!

Hi @gaikwadrahul8,
I'm a bit confused by your response, as the code in your gist-file appears to differ significantly from the code I provided, except for the use of TensorFlow and a dataset. Additionally, @pjpratik has confirmed that there is a bug, so I was hoping to receive an update on when the bug will be fixed.
Regarding your previous comment about the data preprocessing and batches, I understand your point and you would be typically right if there was no issue and I was actually able to use the data. However, this is not the case. Nevertheless, I've reworked the example to reflect your comments. Here is the updated example.
I would like to reiterate the issue I am encountering. According to the TensorFlow documentation, I should be able to use a dataset as the x argument for the model.fit() function and receive a tuple as inputs parameter in the model.call() function. Then, I would decide how to process and what operation to execute on the data in that function. However, I'm encountering an exception and can't obtain the data in the tuple format from the inputs parameter in the call function. This leaves me with the impression that the documentation is not accurate! Meaning there is a bug. Here is once again the exception:
File "<ipython-input-7-a0afc8cfb653>", line 8, in call   (feature, label) = inputs
OperatorNotAllowedInGraphError: Iterating over a symbolic tf.Tensor is not allowed: AutoGraph did convert this function. This might indicate you are trying to use an unsupported feature.
If you decide to provide an example of how to overcome the exception please use the code I've provided with the specified model and a dataset containing a tuple. Thank you for your time and consideration.

Hi, @mihail-vladov
Apologize for the delay and It seems like you're trying to use operation which does not support by autograph because of that reason you're getting that error and even error itself is saying the same thing but there is some workaround and I found similar issue over stack-overflow. and it seems like you'll have to use tf.shape(x), please refer this official documentation, please try with tf.shape(x) and check whether your issue is resolving or not ? I tried from my end and I'm getting different error AttributeError: 'NoneType' object has no attribute 'dtype' and I have added gist-file for your reference. I hope it will help you to resolve your issue.
tf.shape(x) and x.shape should be identical in eager mode. Within tf.function, not all dimensions may be known until execution time. Hence when defining custom layers and models for graph mode, prefer the dynamic tf.shape(x) over the static x.shape.
If issue still persists please let us know ? Thank you!

Hi, @gaikwadrahul8,
pjpratik already confirmed that this is a bug. Why are you trying to convince me that I am doing something incorrectly?
You said that I am trying to use an operation that is not supported. Could you please point out exactly which is that operation?
Regarding your comment on the different error you are getting, you have changed the code in the model, which is why the error is different.
I will repeat myself again. According to the TensorFlow documentation, I can use the dataset as input data. This data can be packed as a tuple. Please extract the data from the tuple in the model call function in a way that won't throw an error.

Hi, @mihail-vladov
Apologize for the delayed response and I see @pjpratik did not say explicitly it's bug, He only replicated that issue from his end and he said code execution is failing with tf.data.Dataset is passed to the model.fit() and I was referring there are similar issues with same error message while using Autograph mode like #32546, #51472 and users found some workaround for those issues.
I'm waiting for response from concerned team for this issue whether is there any workaround to handle this issue till then could you please have look into this Autograph reference guide which may help you to solve this issue and I'll update you soon here. Thank you!

Hi, @SuryanarayanaY
Could you please look into this issue ? Thank you!

Hi @mihail-vladov ,
The problem not seems to related to Autograph. The problem seems the code trying to get Two values(feature, lable) from a Tensor (model.fit converts the given input to Tensor that is internal details can be checked from the model.fit API code) and Tensor can't be unpacked to Two values and Please note that Tensor is immutable in Tensorflow.
You can check the behaviour clearly when you enable Eager mode using model.compile(...,run_eagerly=True) where you can see the error below.
not enough values to unpack (expected 2, got 1)
I have added print(inputs) in call() to understand what actually is inputs. Please refer attached gist.
Hope this will clear your doubts on root cause of this error. Thanks!

Hi @SuryanarayanaY, Thank you for the answer.
According to the TensorFlow documentation using tuple (feature, label) as inputs argument is allowed. Here is the quote:

inputs:	Input tensor, or dict/list/tuple of input tensors.

I am using a tuple. Here are my questions:

Why the model.fit function does not call the model.call function according to the documentation?
What is the correct way to obtain the feature and label data in the model.call function when I pass a dataset to the model.fit function?

Hi @mihail-vladov ,

Why the model.fit function does not call the model.call function according to the documentation?

The model.fit function called the call() function. You can check by adding print() to confirm same. But here when we pass a dataset as an argument to model.fit, the API converts it into Tensors internally.Outside the model.fit() the dataset might be a tuple but within model.fit the tuple is converting into Tensors which is default behaviour.

2. What is the correct way to obtain the feature and label data in the model.call function when I pass a dataset to the model.fit function?

To get the custom behaviour as per individuals requirement you need to override the train_step . Please refer to attached tutorials for more details.
Thank you!

I am facing the same issue and I am confused why the example in Neural Machine Translation doesn't run into the same issue but here we run into this issue?

@kiskani This was one of the issues that made me switch to PyTorch. Misleading documentation and bad support from the developers here. I do not regret my decision.

.call() and .fit() have different signatures. In Keras, .call(inputs) really behaves like the math model y=f(x) with f being implemented in .call(), so inputs should only match  x and not y, and y must not go into .call(). During .fit(dataset), the element (x,y) of dataset is automatically distributed such that x is passed to call() for the gradient step, and  y as well as the prediction  .call(x) are passed to the loss function loss(y_true, y_pred).
Some precautions to take when developing models outside the classic supervised learning framework, if you wish to reuse the standard Keras workflow :

dataset should have a (fake) label y. It can have the format ((x1, x2), y), and the tuple (x1, x2) treated as x by Keras can be obtained in .call(inputs) as x1, x2 = inputs without the mentioned error.
.call() should return a single tensor. For multiple outputs like return y1, y2, it seems only y1 will be passed to the loss. In this case they should be stacked like return keras.ops.stack([y1, y2]).
Custom loss must have the signature loss(y_true, y_pred) even if there is no y_true. In case of multiple tensors in y_pred, use keras.ops.take() to separate them, not y1, y2 = y_pred.

Then compile the custom model and train with .fit(). This is how I developped a self-supervised learning framework for all three backends without writing the custom .training_step() as promoted in the official doc. Hope this helps.


Adding myself as a Chef Maintainer

Spoke with Nathen Harvey about being added as a maintainer.

Hi there, generally we like to see a history of contribution but I suppose Provisioning is kind of in a weird state right now. You'll want to add yourself in the MAINTAINERS.toml file, not the markdown. The latter is generated automatically by the former.


Just recieved scanner notification of possible ban

never seen it before, but it happened literally on the minute of 12:00 midnight, and I closed the scanner within 3 seconds. Am I alone on this, or was there some sort of widespread ban hammer that just went down?

Set up a new PTC account around the same time, got the 'Possible Ban' immediately.   I can login with the PTC account on an old iphone through the same public IP address.   Time to read this code.

Back on the old scanner i used to get "possible ban" warnings all the time. They weren't always accurate, so i would just try to log in on your accounts most suspect of a ban. (generally the oldest, in my experience)

Happens to me all the time when I leave the scanner running all night while I sleep. Just log out and log back in.


unable to see the user when one user connects via mobile and the other via web app

Our application support 1:1 video calling
User A has an option to join from Web and Mobile app(Android/IOS) and Where as User B can join only through web application
Currently what we are experiencing is when both user is joining via web application both of them are able to see and hear each other where as
when as user "A" joins via mobile user "A" is able to see and hear user "B" where as user "B" who has joined via web application cannot see or hear the User "A"
in web app we are not receiving any joining events of user "a" where as when user "a" leaves the channel from mobile app we are able to receive response
Event name:"peer leaved"

reason: server time out
I have attached the screenshot for reference do kindly help us to fix the issue.
Agora React Native SDK:3.4.2
Agora web SDK:3.6.0

mayby you are using the string uid on web.

thats right when we changed the uid its working fine thanks


Skip double FindEntry in ScopedStorage.TryGetValue

Fast path when item is found in ScopedStorage, skips redundant FindEntry call

Thanks, that was super quick.
On Wed, 5 Jul 2023, 00:36 slozier, @.***> wrote:

Merged #268 https://github.com/IronLanguages/dlr/pull/268 into master.
—
Reply to this email directly, view it on GitHub
https://github.com/IronLanguages/dlr/pull/268#event-9723628948, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AA46MLJZT3GFNVXRYXMZZ2DXORBBRANCNFSM6AAAAAAZ54N3UY
.
You are receiving this because you authored the thread.Message ID:
@.***>


fix: replace deprecated gh release action

Summary

replace actions/create-release and actions/upload-release-asset (both unmaintained) with softprops/action-gh-release

This needs to be tested by creating and pushing a tag.

If this work, we can copy to gpm_api, ximage, and disdrodb


Fix de-ASTfication of the default namespace

It is serialized as xmlns => $URI but when de-serialized it ends up as a plain LibXML::Attr object.

Thanks. Released with LibXML 0.9.5.


Improve footer section

@sanjay-kv footer section can be improve  more for better appearance and footer bottom there are more space we should remove it..
please assign me and add labels

So, I can start the work..

you can work everything is assinged

@sanjay-kv I search many time footer codebase but not found, about footer codebase where it's present in the repo.
please tell me..

forgot to mention you this is on gh-pages @Pushpa472

@sanjay-kv there is no file gh-pages i search it.. where this repo exact

gh-page branch

@sanjay-kv  where i make mistake...

@17arindam can you help her.

@sanjay-kv footer section can be improve more for better appearance and footer bottom there are more space we should remove it also the font-size should be increased a little bit to make it look attractive. Please do assign me this task @sanjay-kv. I can help to do necessary changes

@Pushpa472 fork the whole project instead of just main branch there you will get a gh-pages branch which contain code of the website and then raise pr to gh-pages branch to contribute

@17arindam  I fork all repo , i click on gh-pages open in codespaces it not show and also do git checkout gh-pages even in main repo not show and i create my feature branch footer-section....
I want to contribute this project....

@Pushpa472 Is there any update regarding this Issue ?

@HimangshuSharma01 I didn't receive this file.

@sanjay-kv Actually I can't download zip file of code at my end. Can you ol. suggest me an alternative method how to take code at my end

use the command line, we have writtern in the readme file

@sanjay-kv @17arindam @HimangshuSharma01 please assign me my work , i want to contribute and I get gh-pages

@sanjay-kv @HimangshuSharma01 I complete my work, can I raise pull request

RitikaMaha commented last week
@sanjay-kv footer section can be improve more for better appearance and footer bottom there are more space we should remove it also the font-size should be increased a little bit to make it look attractive. Please do assign me this task @sanjay-kv. I can help to do necessary changes
I will do the necessary changes from Readme file.
@sanjay-kv pl assign me the task

@RitikaMaha can work on it.
@Pushpa472 you will be getting points for your PR

@RitikaMaha can work on it.
@Pushpa472 you will be getting points for your PR

Thanks for assigning me the task
I am able to push changes but some of the files from my desktop are also getting copied on gitrepo
So @sanjay-kv can you pl. Guide me or tell me the command that I can apply to remove unnecessary files from my desktop?
And just copy the changed files pl. @sanjay-kv

@sanjay-kv some files from my desktop are getting copied after pushing it to repo..can you pl. give me command to how delete al those file? and just add only the files from code and then push it
Showing 460 changed files with 22,259 additions and 0 deletions

dont do git add *


[cloud_firestore] Issue reestablishing connection

I'm currently facing an issue with a device (particularly a Redmi Note 3 • android-arm64 • Android 8.1.0 (API 27)). I have tested it with other 4 devices and didn't face this problem, though.
 If I close the app and start the app again it fires all the actions made at once (sure, because of the persistent mode). I would like to know if there's any way to force it to reestablish a connection with Firestore. Thanks!

@madtocc
The issue at https://github.com/flutter/flutter/issues/21852 has been closed and moved here. Future collaboration on this issue will be done here.

@holyspidoo @madtocc is the issue still relevant?

Hey @holyspidoo @madtocc I'm closing this issue due to a lack of activity.
If you are still experiencing the issue, please try a more up-to-date version. If your issue persists with a recent version, please feel free to open a new issue detailing your issue.


WGHourly copy paste bug

Expected behavior
This code does not compile
typedef struct WGHourly {
  String icon;
  String title;
  String temp;
  String hour;
  String PoP;
} WGForecast;

Actual behavior
Need to change WGForecast to WGHourly, looks like copy paste bug.
Test code
// add code here

Weather Station Color version
clean checkout
Hardware
Describe whether you run the code on the ThingPulse Weather Station Color kit or on some custom hardware.

Thanks but this code is not part of this repository it's part of the library at https://github.com/ThingPulse/esp8266-weather-station -> should be reported there. That being said I can't personally reproduce this.

sorry for accidentally creating the issue in the wrong repo.

No worries, it's just that we can't handle the issue here properly when code in the other repo is affected. Just checked and realized we have a pending PR over there: https://github.com/ThingPulse/esp8266-weather-station/pull/103

remember basic C to see that this is a bug.

I wasn't saying that this be not a bug - just that if you checkout this repo it will actually compile.

wind speed and direction

Hmm, this rings a bell...I closed https://github.com/ThingPulse/esp8266-weather-station/issues/14 the other day because it wasn't complete. Would you mind putting your improvements up as a PR?

Will not bother you again.

You're not bothering us.


Not working with DBS iBanking login

Browser using: Firefox 57
Version: 1.1
Website: https://internet-banking.dbs.com.sg/IB/Welcome
How to reproduce: Go to the above site, password field cannot be pasted into.

@zhongwei-z, I'm not the one who published this extension for Firefox. Even if I'm able to fix the problem, I won't be able to update it on Firefox Marketplace.


Point plugin links to the new separate repos

Description
Update the plugin documentation to point to the new package repositories now they've been moved out of core (see https://github.com/vitejs/vite/pull/11158)
Partial fix of https://github.com/vitejs/vite/issues/11192
Additional context

What is the purpose of this pull request?

[ ] Bug fix
[ ] New Feature
[x] Documentation update
[ ] Other

Before submitting the PR, please make sure you do the following

[x] Read the Contributing Guidelines.
[x] Read the Pull Request Guidelines and follow the Commit Convention.
[x] Check that there isn't already a PR that solves the problem the same way to avoid creating a duplicate.
[x] Provide a description in this PR that addresses what the PR is solving, or reference the issue that it solves (e.g. fixes #123).
[x] Ideally, include relevant tests that fail without this PR but pass with it.

I'm closing this PR since it seems like the changes have already been made, even though the changes were showing against main before I opened the PR 🤷 . It's not reflected on the website yet.

You can use https://main.vitejs.dev/ to see the latest changes from main. https://vitejs.dev/ is currently showing the docs for v3

The change to the docs should be backported though, right? Since the issue is that the links on the v3 website are broken.

Ah, yes, good point. We have also a https://v3.vitejs.dev we will keep (also v2, but probably too far already). If you would like you can PR this change to the v3 branch.


Life: My life in commits

It would probably be nice if this is to be your first post, seems an interesting way to talk about developer life by looking back at one year of coding. You can:

Annotate your commit history graph and talk about specific points and weeks with high level or low level of activity.
Talk about some of the things you've accomplished in software development, things you've learned, things you're currently learning, some challenges in starting out.
Look forward. What are you planning to learn next? New challenges and stuff?


Add auto allignement function for 61850 SLD

As an engineer,
I want to auto allign IEC61850 single line diagram incase it is lacking coordinates
So I can read the schema's easily
Background:
IEC61850 files sometimes don't contain any coordinate systems.
To test  and show the conversion from IEC CIM to IEC61850 it is needed to show the single line diagram in a readable way.
In case of complexity consider starting to work in this order:
Allign on bay, voltagelevel and substation.

FYI CoMPAS: https://github.com/com-pas/compas-open-scd/issues/100

For now the auto alignment functionality will only be build in the CoMPAS version of OpenSCD (https://github.com/com-pas/compas-open-scd).
This will use a back-end Services (https://github.com/com-pas/compas-scl-auto-alignment) to calculate these using PowSyBl.
Later can be decide to convert this services to a front-end functionality using a WebAssembly.


bioconda installable

Hey @bastiaanvonmeijenfeldt
I' would make a bioconda installable of CAT. here
Could you give CAT a license?
Do you have any test to run?
If I'm not wrong you can make the CAT executable. This information is somehow stored even on github.
It would be great if you could update the version and sha256 when you have new releases.

Hi @SilasK,
Thanks for the feedback! All of your suggestions have been added to the to-do list, and will be included in future releases!
Best wishes,
Bastiaan

Do you know which license you want to give CAT? In theory, I'm not allowed to use your code without a license.

status: https://github.com/bioconda/bioconda-recipes/pull/12536

Yes It needs a license.
@bastiaanvonmeijenfeldt You can modify the recipe here

Hi Silas,
CAT will be available under CC BY 2.0. Thanks for your work on the bioconda recipe!

It should bwork now!
conda install -c bioconda cat

It's not working for me yet:
Solving environment: failed

PackagesNotFoundError: The following packages are not available from current channels:

  - cat

Current channels:

  - https://conda.anaconda.org/bioconda/linux-64
  - https://conda.anaconda.org/bioconda/noarch
  - https://repo.anaconda.com/pkgs/main/linux-64
  - https://repo.anaconda.com/pkgs/main/noarch
  - https://repo.anaconda.com/pkgs/free/linux-64
  - https://repo.anaconda.com/pkgs/free/noarch
  - https://repo.anaconda.com/pkgs/r/linux-64
  - https://repo.anaconda.com/pkgs/r/noarch
  - https://repo.anaconda.com/pkgs/pro/linux-64
  - https://repo.anaconda.com/pkgs/pro/noarch

Also, I'm looking into the licenses and it will be CC BY 3.0.

Great, thanks! There is a preprint but it's super old and CAT has changed a lot since then so not worth mentioning...

@bastiaanvonmeijenfeldt Where are the releases gone? The bioconda package needs downloading it from the github.  or any other stable url..

Yes sorry for that! We have moved stuff around since yesterday and in the process removed the released. A new one will come online shortly!

@bastiaanvonmeijenfeldt
The cond build didn't worked because
psutil
is an additonal requeirement. I fixed it now. any other package to install?

Thanks for pointing this out to me! I've included psutil to get memory size but I don't want to have another dependency. All our other python imports are standard library. So I will remove the psutil import soon and fix this in another way...
List of packages CAT/BAT uses:
argparse
datetime
gzip
math
multiprocessing
os
psutil
subprocess
sys
tarfile
urllib.request

For the condo package there is no need to drop plutil.

I have removed the psutil dependency with the latest release (4.3.1). I'd rather have a dependency less for people that are only running a bare version of Python.

I could install CAT also on osx. Do you think it could work?

There is actually no reason it should not work, EXCEPT for the psutil-free memory check I just built in, haha. But this is not a big deal, I can make that work on mac OS as well, working on that now!
That being said, we have extensively tested CAT/BAT on Linux, and have not on mac OS, so no guarantees here. But I will build in mac compatibility and let's see what users think. :)

I have made CAT/BAT Mac OS compatible, the latest version is online.
@SilasK: I think it would be easiest if I update the sha256 and version in the Bioconda recipe every time I publish a new version, where can I do that? Is simply pushing the change enough or should there be versioning/tagging/releasing?


devel->master

:tada: This PR is included in version 1.7.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


[BUG] Date_day should be date_week

https://github.com/fivetran/dbt_recurly/blob/2da1316991d1498e85317150d2587c74ea358972/models/intermediate/int_recurly__account_rolling_totals.sql#L36
While looking through this I just realized I think this coalesce should be using date_week, not date_day!

@fivetran-catfritz is this issue able to be closed out? It seems the previous PR addressed the original issue.

@fivetran-joemarkiewicz Sorry about that. Yes #15 addresses this issue, so closing this out.


Change clear screen command for windows

Check for OS and use appropriate clear screen command

Solved by #10


Add sanity check for cached test sets

I interrupted sacreBLEU during the download of a WMT16 test set and did not realize it caches results, also incomplete results. Later usage kept using only 155 lines of the partially downloaded test set. Maybe sacreBLEU should check if the cached versions has the required number of lines?

This is a good idea. I was thinking of adding an md5sum check or something of that nature.

Version 1.1.7 now dies with an error if the input and reference streams have different lengths.


Bug: missing time information on publishes from Tray Publisher

Is there an existing issue for this?

[X] I have searched the existing issues

Current Behavior:
Published instance no longer contain time data by default. This means that any family published with Simple Creators will miss it too, in effect breaking loading logic in loaders. For example:
Publishing Plate from Tray Publisher will publish stuff with missing frame range information on version. This version is then displayed incorrectly in the Loader and Clip Loader in Nuke will crash.
Expected Behavior:
Tray Publisher - its collector - should add frame range information if it is publishing sequences. If files are list in representation, collect it using clique and set it. It is much more difficult to handle video files - in their case, it should either use something like ffprobe to get correct frame range (unreliable) or infer it from asset data (not precise enough).
Version
3.15.9
What platform you are running OpenPype on?
Windows
Steps To Reproduce:

Open Tray Publisher
Select Project
Select your context
Select Plate as family
Drop some image sequence
Publish
Open Nuke
In Loader, you won't see any time information
Load as Clip will crash

Are there any labels you wish to add?

[X] I have added the relevant labels to the bug report.

Relevant log output:
Traceback (most recent call last):
  File "C:\Users\annat\Documents\Projects\OpenPype\sources\op-py39\openpype\tools\loader\widgets.py", line 1590, in _load_representations_by_loader
    load_with_repre_context(
  File "C:\Users\annat\Documents\Projects\OpenPype\sources\op-py39\openpype\pipeline\load\utils.py", line 308, in load_with_repre_context
    return loader.load(repre_context, name, namespace, options)
  File "C:\Users\annat\Documents\Projects\OpenPype\sources\op-py39\openpype\hosts\nuke\plugins\load\load_clip.py", line 125, in load
    first -= self.handle_start
TypeError: unsupported operand type(s) for -=: 'NoneType' and 'int'

Additional context:
No response
[cuID:OP-6163]

There was this change a long time ago which is likely what removed it: https://github.com/ynput/OpenPype/pull/4383
However, I believe this PR https://github.com/ynput/OpenPype/pull/4891 should have re-added the missing data to what it was prior to #4383

It's good to note that the Nuke error mentioned above will STILL happen for standalone tray publishes if the Collect Asset Frame Data plug-in is disabled and the input for the publish is not a sequence but a video file.
So I'd actually recommend fixing the Nuke's load_clip logic too for the remainder cases.


KeyError: 'exchangeTimezoneName' when accessing ticker history

Current yfinance 0.1.75 raises an exception when running  the following:
import yfinance as yf

def _main():
    stock_data = yf.download(
        "AFN",
        start="2018-01-01",
        end="2018-12-31",
        group_by="ticker",
        threads=False
    )
    print(stock_data)

if __name__ == "__main__":
    _main()

  stock_data = yf.download(
  File "/Users/manoel/opt/anaconda3/envs/Qiskitenv/lib/python3.8/site-packages/yfinance/multi.py", line 120, in download
    data = _download_one(ticker, period=period, interval=interval,
  File "/Users/manoel/opt/anaconda3/envs/Qiskitenv/lib/python3.8/site-packages/yfinance/multi.py", line 205, in _download_one
    return Ticker(ticker).history(period=period, interval=interval,
  File "/Users/manoel/opt/anaconda3/envs/Qiskitenv/lib/python3.8/site-packages/yfinance/base.py", line 148, in history
    end = utils._parse_user_dt(end, self._get_ticker_tz())
  File "/Users/manoel/opt/anaconda3/envs/Qiskitenv/lib/python3.8/site-packages/yfinance/base.py", line 328, in _get_ticker_tz
    tkr_tz = self.info["exchangeTimezoneName"]
KeyError: 'exchangeTimezoneName'

Running the same sample against the previous release returns:
[*********************100%***********************]  1 of 1 completed
                 Open       High        Low      Close  Adj Close  Volume
Date
2018-01-02  29.799999  29.799999  29.799999  29.799999  29.799999       0
2018-01-03  30.000000  30.000000  30.000000  30.000000  30.000000       0
2018-01-04  30.000000  30.000000  30.000000  30.000000  30.000000       0
2018-01-05  30.200001  30.200001  30.200001  30.200001  30.200001       0
2018-01-08  30.000000  30.000000  30.000000  30.000000  30.000000       0
2018-01-09  30.200001  30.200001  30.200001  30.200001  30.200001       0
2018-01-10  32.799999  32.799999  32.799999  32.799999  32.799999       0
2018-01-11  31.799999  31.799999  31.799999  31.799999  31.799999       0
2018-01-12  30.799999  30.799999  30.799999  30.799999  30.799999       0
2018-01-16  30.200001  30.200001  30.200001  30.200001  30.200001       0
2018-01-17  30.799999  30.799999  30.799999  30.799999  30.799999       0
2018-01-18  30.799999  30.799999  30.799999  30.799999  30.799999       0
2018-01-19  30.799999  30.799999  30.799999  30.799999  30.799999       0
2018-01-22  31.400000  31.400000  31.400000  31.400000  31.400000       0
2018-01-23  32.000000  32.000000  32.000000  32.000000  32.000000       0
2018-01-24  31.600000  31.600000  31.600000  31.600000  31.600000       0
2018-01-25  31.200001  31.200001  31.200001  31.200001  31.200001       0
2018-01-26  32.200001  32.200001  32.200001  32.200001  32.200001       0
2018-01-29  31.799999  31.799999  31.799999  31.799999  31.799999       0
2018-01-30  31.520000  31.520000  31.520000  31.520000  31.520000       0

If I run with threads=True it will raise the exception and hang.

What is "AFN"? I don't see it in Yahoo. And the old price data looks bad - 0 volume, low=high.

The example above is actually from the London Stock Exchange. I found that using "AFN.L" it returns data and doesn't raise an exception .
So it seems the exception in the new release happens for invalid tickers. If I enter ticker "???" in the new release I get the key error exception. In the previous  version there was no key error, just a printed message:
[*********************100%***********************]  1 of 1 completed

1 Failed download:
- ???: No data found for this date range, symbol may be delisted

That's a good point, it should print a nice message. Will fix it.

hey, i got the same error. it used to print
BEFORE:
KGF.L
0
[100%]  1 of 1 completed
LAND.L
1
[100%]  1 of 1 completed
LGEN.L
2
[100%]  1 of 1 completed
LLOY.L
3
[100%]  1 of 1 completed
LSEG.L
4
[100%]  1 of 1 completed
MNG.L
5
[100%]  1 of 1 completed
MGGT.L
6
[100%**]  1 of 1 completed
1 Failed download:

???: No data found for this date range, symbol may be delisted

NOW:
raises error and hangs like this when i loop trough the ticker symbols. not fixable with try/except
KGF.L
0
[100%]  1 of 1 completed
LAND.L
1
[100%]  1 of 1 completed
LGEN.L
2
[100%]  1 of 1 completed
LLOY.L
3
[100%]  1 of 1 completed
LSEG.L
4
[100%]  1 of 1 completed
MNG.L
5
[100%]  1 of 1 completed
MGGT.L
6
Exception in thread Thread-38:
Traceback (most recent call last):
File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/usr/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/usr/local/lib/python3.7/dist-packages/multitasking/init.py", line 104, in _run_via_pool
return callee(*args, **kwargs)
File "/usr/local/lib/python3.7/dist-packages/yfinance/multi.py", line 193, in _download_one_threaded
keepna, timeout)
File "/usr/local/lib/python3.7/dist-packages/yfinance/multi.py", line 210, in _download_one
timeout=timeout)
File "/usr/local/lib/python3.7/dist-packages/yfinance/base.py", line 148, in history
end = utils._parse_user_dt(end, self._get_ticker_tz())
File "/usr/local/lib/python3.7/dist-packages/yfinance/base.py", line 328, in _get_ticker_tz
tkr_tz = self.info["exchangeTimezoneName"]
KeyError: 'exchangeTimezoneName'
hoping for a fix soon, thanks for your work and help

My interpreter returned this error message.
.../yfinance/base.py", line 341, in _get_ticker_tz
tkr_tz = self.info["exchangeTimezoneName"]
KeyError: 'exchangeTimezoneName'.
The issues seems to be related to line 341.  I think self.info needs to be changed to self._info.
https://github.com/ranaroussi/yfinance/blob/51f2c7301dfadcc64ad9d22f36a846f999860358/yfinance/base.py#L340-L346

Should be fixed now

This problem still exists with the new the latest .77 version. Before releasing a patch/update you need to run your main test script (the one that contains all the functions of the lib with all of the stock symbols to make sure it is safe to release).
To reproduce this:

Get all usa stocks into a list named 'all_assets' from a reliable source like finra or nasdaq (https://www.nasdaq.com/market-activity/stocks/screener).
Execute: data = yf.download(all_assets,start=(datetime.datetime.now()-datetime.timedelta(days=1)).strftime("%Y-%m-%d"),timeout=5)

There is no issue with the .74 version.

@c0mm0d0re Can you provide code that reproduces bug? I am getting correct behaviour for both listed and delisted tickers.

@ValueRaider I haven't gone through your code but if you do the steps below and you should see an error - i think something related to this error that you altered or another but def connected to this.

tickers = [] # get the tickers from here: https://pastebin.com/rhapPCyr
data = yf.download(tickers, start=(datetime.datetime.now()-datetime.timedelta(days=1)).strftime("%Y-%m-%d"),timeout=5)

I'm not going to run every ticker in the universe and get my IP blocked/restricted. Just tell me what ticker failed for you.

I'm having the same issue (using the dev branch)
Looking at the code there is a safeguard that checks for the key exchangeTimezoneName in self.info before getting it.
if not 'exchangeTimezoneName' in self.info:
    return None
tz = self.info["exchangeTimezoneName"]

However as info is backed by a property function (defined in the subclass) and calls self.get_info (defined in base class) it probably does multiple requests and the self.info can differ.
    @property
    def info(self):
        return self.get_info()

I updated the code in my forked dev branch so this issue should not be possible.
fork
However, the fact that the old code got different results from consecutive calls to self.get_info() is the root cause of this bug and not something my code change fixes
My Traceback:
Exception in thread Thread-1000:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 917, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 865, in run
    self._target(*self._args, **self._kwargs)
  File .virtualenvs/screener/lib/python3.7/site-packages/multitasking/__init__.py", line 104, in _run_via_pool
    return callee(*args, **kwargs)
  File "/yfinance-tz-cache/yfinance/multi.py", line 201, in _download_one_threaded
    keepna, timeout)
  File "/yfinance-tz-cache/yfinance/multi.py", line 218, in _download_one
    timeout=timeout)
  File "/yfinance-tz-cache/yfinance/base.py", line 157, in history
    tz = self._get_ticker_tz()
  File "/yfinance-tz-cache/yfinance/base.py", line 400, in _get_ticker_tz
    tz = self.info["exchangeTimezoneName"]
KeyError: 'exchangeTimezoneName'

it probably does multiple requests and the self.info can differ.

It does make multiple requests but only the first will do work. All subsequent requests will quickly return: https://github.com/ranaroussi/yfinance/blob/34dfe944d9c48640d5b8e5e1a30968d21acc1a17/yfinance/base.py#L362
Were you able to reliably produce 'different results from consecutive calls'?

That depends:
https://github.com/ranaroussi/yfinance/blob/34dfe944d9c48640d5b8e5e1a30968d21acc1a17/yfinance/base.py#L358
The get info does a lot of requests and some of them fails in the first call that set self._info, self._sustainability or  self._recommendations then all requests are redone if I read the code correctly.

Have now tired to understand the code a bit more.
The get_info method only does one HTTP request but a lot of parsing of that request.
If the parsing of request response fails on _sustainability or _recommendations fails it will redo the HTTP request next time it is called.

I understand now. Changing that if-statement from ors to ands seems best.

I created a #1109 with my fix, it does however not use and in the if statment just a simplified version of the if statment. I can update that if you feel that change would be safe.

@ValueRaider I looked at the json result we get from the endpoint that gets history ticker data
e.g https://query2.finance.yahoo.com/v8/finance/chart/TSLA
In that response there is already "exchangeTimezoneName" present.
Why do we get the timezone information from the scraping endpoint instead of from the ticker history response directly?
Using the scraping endpoint is probably slower and more error prone.

At that point in the code, where start & end dates being processed, the price request hasn't been sent.

Yes, but would it not be better to use that endpoint (giving a minimal period) to get the timezone?
That way any HTML scraping (and dependency on html not changing) would be avoided.
I did a quick comparison between the 2 endpoints and the

https://finance.yahoo.com/quote ~700ms
https://query2.finance.yahoo.com/v8/finance/chart/TSLA?period1=1666609904&period2=1666609904&interval=1d ~70ms

So it would be a speedup of 10 times.
And the extra query to ticker data could be avoided completely for longer ticker timeintervals (>1d) by asking for an extra day before and after and do the timezone filtering in of the returned data.

Good point. I'll push an update to dev

If you are going to do multiple request to query2 to get the timezone maybe the code that does the request should be refactored in order to be reused.
I noted that this try/except clause effectively negates the explicit raising of runtime error to inform about yahoo is down.
https://github.com/ranaroussi/yfinance/blob/dev/yfinance/base.py#L211-L226
What is the desired behaviour? Code like this seems very ambiguous error prone to me.
In most cases silencing all exceptions is a bad idea, instead catch the ones you are expecting and handle them (logging or re-raising etc.) and in case of unexpected exception at least log it if you catch it.

So that catch predates me. Introduced by PR #907, maybe they forgot to remove it - Ran has a habit of merging without reviewing.
Regarding timezone - I've pushed to fix/get-tz-performance. Actual performance boost not as good as 10x because still requires json parsing. Maybe I'm missing an obvious optimisation?

Can everyone update to 0.1.84 then report on the status of the bug? Is it solved?

Seems solved for me.


Ionic 2 rc3 image lazy load

I have many images cards on dashboard, that fluctuating images,
<ion-card class="custom" *ngFor="let post of posts" tappable (tap)="post.type == 3 ? detailPage($event,post) : ''">

                <ion-avatar item-right class="customb" *ngIf="post.going_picture != ''">

                </ion-avatar>

{{post.title}}

                    <ion-icon class="custom" name="md-pin"></ion-icon>
                    {{post.address}}

            </ion-item>
        </ion-card>

We already use ng2-lazyload-image, but it not working properly....
Can any one provide a example for this, in , as we can not use [virtualScroll] in .

@ykonstant thats rather more an Forum request then an issue.
I've added myself a image-loading-component (rather offline-caching).
In Angular2 you need to bypass the security:
import {DomSanitizer} from '@angular/platform-browser';
private sanitizer: DomSanitizer
obj.IMAGE_SRC = this.sanitizer.bypassSecurityTrustUrl(obj.IMAGE_URL);
And then you can set the src:
[src]="obj.IMAGE_SRC"

Hello! Thanks for using Ionic! While this is a support issue I will say that we have some very cool stuff coming up with ion-img that I think your gonna like! 😉


No location for

Running this command in github action
sarif summary ./*_scan.sarif -o ./hdf/issues.txt
The tool crashes on this jfrog xray sarif file with the following error :
xray_scan.zip
Traceback (most recent call last):
File "/home/runner/.local/bin/sarif", line 8, in
sys.exit(main())
File "/home/runner/.local/lib/python3.10/site-packages/sarif/cmdline/main.py", line 40, in main
exitcode = args.func(args)
File "/home/runner/.local/lib/python3.10/site-packages/sarif/cmdline/main.py", line 399, in _summary
summary_op.generate_summary(input_files, output, multiple_file_output)
File "/home/runner/.local/lib/python3.10/site-packages/sarif/operations/summary_op.py", line 40, in generate_summary
summary_lines = _generate_summary(input_files)
File "/home/runner/.local/lib/python3.10/site-packages/sarif/operations/summary_op.py", line 62, in _generate_summary
result_count_by_severity = input_files.get_result_count_by_severity()
File "/home/runner/.local/lib/python3.10/site-packages/sarif/sarif_file.py", line 957, in get_result_count_by_severity
result_counts_by_severity.append(input_file.get_result_count_by_severity())
File "/home/runner/.local/lib/python3.10/site-packages/sarif/sarif_file.py", line 741, in get_result_count_by_severity
get_result_count_by_severity_per_run = [
File "/home/runner/.local/lib/python3.10/site-packages/sarif/sarif_file.py", line 742, in
run.get_result_count_by_severity() for run in self.runs
File "/home/runner/.local/lib/python3.10/site-packages/sarif/sarif_file.py", line 572, in get_result_count_by_severity
records = self.get_records()
File "/home/runner/.local/lib/python3.10/site-packages/sarif/sarif_file.py", line 510, in get_records
self._cached_records = [self.result_to_record(result) for result in results]
File "/home/runner/.local/lib/python3.10/site-packages/sarif/sarif_file.py", line 510, in
self._cached_records = [self.result_to_record(result) for result in results]
File "/home/runner/.local/lib/python3.10/site-packages/sarif/sarif_file.py", line 530, in result_to_record
raise ValueError(f"No location in {error_id} output from {tool_name}")
ValueError: No location in CVE-2021-43[616](https://github.com//actions/runs/6628611502/job/18006238865#step:4:623)_npm_8.1.2 output from JFrog Xray SCA
Error: Process completed with exit code 1.

possibly duplicate of https://github.com/microsoft/sarif-tools/issues/12
However the fix is probably not in any released version

Hi, that's right, this is fixed in the latest code, which will be released as v2.0 very soon.  I've tested your sarif file in the new version and it's working.


[Unity][Op] Allow the argument to call_tir to be a var bound to a tuple, not a tuple literal

In response to the issue in common subexpression elimination noted in this forum post, this PR fixes the case noted by allowing call_tir and its variants to correctly handle the case where they are passed a variable bound to a tuple of arguments, rather than a tuple literal. This was an easy change to make and corresponds to user expectations.
In principle, we could address the issue highlighted in other ways, such as by changing common subexpression elimination to avoid doing elimination inside call_tir calls or treating call_tir as a special case during normalization. I went with this approach because I believe it to be simpler; however, we may consider other approaches if it is absolutely essential that the argument be a tuple literal. (I would argue that that would not be a particularly good design.)

This may be a duplicate of #15916, which also resolves the analogous problem for FuseOps, RewriteDataflowReshape, and FoldConstant.

Oh nice, this is great, thanks for this. I was running to issues in the some of the same passes when testing locally, and so I was starting to work on a fix to follow up this PR, but looks like they're all fixed in #15916, that saves me a bunch of time 😄, so thanks again for that.

Didn't see it, yep, they're duplicates. There is one case that the other PR misses so hopefully that can be updated.


How do I use the prebuilt docker image with local filesystem?

I develop an issue tracking system. People add images to the issues (screenshots etc.). I would like to use imgproxy to optimize the delivery of these images.
The images are stored in files on local disk. My first thought was to replace an image URL that
normally looks like this:
    https://example.com/issues/file14/face.jpg

with (URL wrapped for readability; I explain why I am using expires below):
    https://example.com/imgproxy/security_hash/rs:fit:300:200:0:0/
           filename:face/expires:XXXXX/plain/local:///0/file14

Then I run imgproxy with IMGPROXY_LOCAL_FILESYSTEM_ROOT=/images to reference the data stored in the file
   ~tracker/db/files/0/file14

and mount ~tracker/db/files on /images in the docker volume.
I tried this, but it does not look like the distributed docker image has a volume/mount point exposed
according to docker inspect.
The expires value XXXX will be set to  5 seconds after the web page request has been received. Using expires is an attempt to prevent the URL from being used by another party. Images have access controls
in the tracker that determine if the image is accessible to the user. So I use a short duration time to allow the user to access it while the web page is loading, but not be able to use the URL outside of the loading time for the current page. Granted the user can screenshot the image etc. however this
is additional protection to prevent direct access to imgproxy from leaking potentially sensitive data
since it can't authenticate/authorize the user.
So three questions:

can the distributed docker image be generated with a volume at /images (or other suitable mountpoint)

does my proposed deployment method sound workable

will the use of expires help "secure" the image data

Thanks and have a great week.
Also I added: https://github.com/imgproxy/imgproxy/pull/1135 to add /images volume to the
Dockerfile and image.
[ edited replacement url to put / between the processing options components and fix the resize option argument, and remove explicitly requesting a file type to set imgproxy choose the best
alternative. Added pull request]

Hi @rouilj!
If your images are located in the filesystem available to your Docker engine, then using the local:/// scheme is the most optimal way.
If you run imgproxy with docker run, you can use the -v flag to mount you:
docker run -v /path/to/local/dir:/images -it darthsim/imgproxy:latest

If you run imgproxy with docker service run you can use the --mount flag:
docker servive run --mount type=bind,src=/path/to/local/dir,dst=/www -t darthsim/imgproxy:latest

I don't think the expires option will enhance security much. If someone with access to the image wants to share it, they can just save the image and share it without the URL. If you don't want random people to be able to craft a URL for an image they don't have access to, it's enough to sign your URLs.
However, the expires option may make it difficult to share images by sharing their URLs. Though I think 5s is a too short period. If one has a bad internet connection, they may not be able to request the images.

Hello @DarthSim,

If you run imgproxy with docker run, you can use the -v flag to mount you:
docker run -v /path/to/local/dir:/images -it darthsim/imgproxy:latest

If you run imgproxy with docker service run you can use the --mount flag:
docker servive run --mount type=bind,src=/path/to/local/dir,dst=/www -t darthsim/imgproxy:latest

Interesting. I didn't realize you could mount a volume when the directory didn't exist in the docker image.
I thought you had to have a VOLUME directive in the Dockerfile to create/mount onto. I'll have to look
for docs on this and try it..

I don't think the expires option will enhance security much. If someone with access to the image wants
to share it, they can just save the image and share it without the URL. If you don't want random people
to be able to craft a URL for an image they don't have access to, it's enough to sign your URLs.

Well only the people with access to the original issue would be able share the image. I am concerned
about unintended leakage of the link to unauthorized parties.

However, the expires option may make it difficult to share images by sharing their URLs.

True, but if you didn't have authorization to see the image in the first place, having the original
URL (not pointing to imgproxy) wouldn't let you see it either. As it turns out, a short expired
option makes saving an image difficult. On chrome at least saving an image appears to download
it again. Which is weird. I would have expected it to pull from the cache. But the cache lifetime
is the URL lifetime apparently. So saving the file after 5 seconds may require downloading the
file again as it had been purged from the browser cache???
Speaking of cache, can I change the cache header to use private rather than public? I have the cache
lifetime set to 1 (IMGPROXY_TTL=1). Apparently 0 is not allowed. So it should disappear from any caching servers even if the expires property is set to 3 minutes.
Just out of curiosity, is there a way to modify the varies header? Currently it includes Accept.
I am running imgproxy behind a reverse proxy, so I could change the Varies and Cache headers seen upstream at the reverse proxy. That probably is a better choice than complicating imgproxy.

Though I think 5s is a too short period. If one has a bad internet connection, they
may not be able to request the images.

Good point. I have run into this when I had 30 images displayed in a ticket as well. Lazy loading
also can delay loading long enough to time out. I have a working implementation
I need to finish documenting it. It allows the user to set the TTL/expires time for just this
reason. I'll toss the URL for the implementation in this ticket in case anybody is interested.
I think of the signed URL the same way I think of a Java Web Token (JWT).
The signed URL in this use case is effectively an authentication/authorization token signed by the
URL generator. Same as a JWT. We can't revoke either a URL or a JWT, so I use short lifetimes to
reduce the risk from them leaking.
I also looked at thumbor. They have a similar signing mechanism for preventing DOS attacks. But they
are missing the ability to invalidate the URL (no expires equivalent).
This may be an incorrect way to look at the signed URL, but that's how I view them.
Thanks for your feedback. Have a great week.
-- rouilj

Just to close this up, I documented using this with Roundup at https://wiki.roundup-tracker.org/EfficientImageServing.
Thanks for the AWS reference. It looks like they move the expiration into into a policy tied to the
request by public/private key signature on the url. So they find the key used to sign the URL, determine
the expiration time using the key. Since the expiration time is not in the URL multiple URL's can
access the same data with a different expiration time.
Have a great weekend.
-- rouilj


Remove version: qBittorrent.qBittorrent version 4.4.5

[Automated] It returns code over 400 in all urls
Microsoft Reviewers: Open in CodeFlow

URL: https://sourceforge.net/projects/qbittorrent/files/qbittorrent-win32/qbittorrent-4.4.5/qbittorrent_4.4.5_setup.exe/download
Status Code: 200
(Automated message - build 896)

Close with reason: Package still available.;


Using OCaml standard Location format on .ml and .mli files

Thanks!

@jberdine looks like Location.print_loc always prints excape sequences, even when the output is redirected. Do you know if this can be turned off programmatically? Not a big deal either way.
https://github.com/cristianoc/reanalyze/commit/4f608c26d9ff0ecf620a54aceaf2d4075c6b8881

Hmm, that's suboptimal. Maybe Misc.Color.setup (Some Never) is in compilerlibs and can be called.

That does the trick. Thanks!


Emotional Face Recognition - schedule

!H (hi upside down),
I have the schedule for the faces task for ya:
main_faces_schedule.csv

Thanks.
Me and Ryan went over the schedule - hoping you could generete the name of the faces on your end?

Here is the schedule with the file paths: main_faces_schedule.csv

Here's the schedule with the file paths to the faces: main_faces_schedule.csv

Thanks.
Updated the schedule.
Use this link to test it out:
https://tasks.laureateinstitute.org/?index=2&task=emotional_faces&run=Pilot_R1.json

The for real for real schedule with 50/50 gender split:
faces_schedule_9_15_22.csv

Updated. with new task from 9/15/2022


fail to format long comment with liquid template

cannot format this
sql:
  -- very very very very very very very very long comment with {{ template }}
  select 1
;;

I can fix this issue by this PR (https://github.com/kitta65/lkmlfmt/pull/102).
But I think the comment shuld be fixed this way.
sql:
  {% comment %} very very very very very very very very long comment with {{ template }} {% endcomment %}
  select 1
;;

I found other bug.
https://github.com/kitta65/lkmlfmt/issues/103


Godot 4.0 alpha 4 not working on macOS i7 and NVIDIA GT 750M (VK_ERROR_INITIALIZATION_FAILED)

Godot version
4.4 dev
System information
macOS BigSur, Intel Core i7 quad-core, 16GB DDR3, NVIDIA GeForce GT 750M 2 GB
Issue description
Error messages requested by Rèmi Verschelde, @akien-mga
Steps to reproduce
drivers/vulkan/vulkan_context.cpp:159 -  - Message Id Number: 0 | Message Id Name:
VK_ERROR_INITIALIZATION_FAILED: Render pipeline compile failed (Error code 2):
Unhandled atom in intrinsic: llvm.fabs.f32.
Objects - 1
Object[0] - VK_OBJECT_TYPE_PIPELINE, Handle<PHONE_NUMBER>93856
vkCreateGraphicsPipelines failed with error -3 for shader 'SceneForwardClusteredShaderRD:6'.
servers/rendering/renderer_rd/pipeline_cache_rd.cpp:60 - Condition "pipeline.is_null()" is true. Returning: RID()
This render pipeline requires (0) bytes of push constant data, supplied: (16)
No render pipeline was set before attempting to draw.
Minimal reproduction project
No response

CC @godotengine/macos @godotengine/rendering

@bosga For additional context, on Twitter you were saying that Godot 4.0 alpha 3 works fine, but alpha 4 has the above issue, is that correct?

Try running it with the following command and upload mvk_log.txt here.
env MVK_DEBUG=1 MVK_CONFIG_LOG_LEVEL=4 /Applications/Godot.app/Contents/MacOS/Godot > mvk_log.txt 2>&1

I re-downloaded version 4.3 this morning and it gives me the exact same problem. 2 days earlier 4.3 was fine without any warning.
this is what version 4.3 tells me now:
drivers/vulkan/vulkan_context.cpp:157 -  - Message Id Number: 0 | Message Id Name:
VK_ERROR_INITIALIZATION_FAILED: Render pipeline compile failed (Error code 2):
Unhandled atom in intrinsic: llvm.fabs.f32.
Objects - 1
Object[0] - VK_OBJECT_TYPE_PIPELINE, Handle<PHONE_NUMBER>95584
vkCreateGraphicsPipelines failed with error -3 for shader 'SceneForwardClusteredShaderRD:6'.
servers/rendering/renderer_rd/pipeline_cache_rd.cpp:60 - Condition "pipeline.is_null()" is true. Returning: RID()
This render pipeline requires (0) bytes of push constant data, supplied: (16)
No render pipeline was set before attempting to draw.
note: Version 3.4.3 doesn't give me any problems.

2 days earlier 4.3 was fine without any warning.

Try deleting shader cache: ~/Library/Application Support/Godot/shader_cache (for editor cache) and .godot/shader_cache in the project folder.

Error in the log seems to be a bit different:
[mvk-error] VK_ERROR_INITIALIZATION_FAILED: Render pipeline compile failed (Error code 2):
Compiler encountered an internal error.
ERROR:  - Message Id Number: 0 | Message Id Name:
	VK_ERROR_INITIALIZATION_FAILED: Render pipeline compile failed (Error code 2):
Compiler encountered an internal error.
	Objects - 1
		Object[0] - VK_OBJECT_TYPE_PIPELINE, Handle<PHONE_NUMBER>29344
   at: _debug_messenger_callback (drivers/vulkan/vulkan_context.cpp:159)
ERROR: vkCreateGraphicsPipelines failed with error -3 for shader 'ClusterRenderShaderRD:0'.
   at: render_pipeline_create (drivers/vulkan/rendering_device_vulkan.cpp:6596)

This points to the cluster_render.glsl shader, the most recent change was https://github.com/godotengine/godot/pull/57980, which affects both alpha 3 and 4, try running alpha 2 to check.

alpha 2 says this (see photo

)

I also tried alpha 1. it gives me this error.
Version 4.3 was fine, it didn't give me any warnings, maybe it's my computer that has something wrong with it

.

Double-check the shader cache in the ~/Library/Application Support/Godot/shader_cache (if it's not showing up in the Finder, try entering full path into Command+Shift+G dialog or accessing it from the terminal), after successful editor start it definitely should be there.

For reference, mobile NVIDIA Kepler GPUS such as the GT 750M don't have Vulkan support on Windows/Linux. I wouldn't expect it to work on macOS either (even with Metal translation using MoltenVK), so I think this should be closed in favor of https://github.com/godotengine/godot/issues/58927.

I've been testing a Macbook with the same specs running the latest version of Big Sur, and have been running into the same issue in 4.3 Dev1 (though I've also tried running the stable versions of 4.0, 4.1, and 4.2 with similar results). I did some testing to find information that'll hopefully be useful.
According to Vulkan Hardware Capability Viewer, the GT 750M is running on API Version 1.2.268.

Interestingly, the error doesn't occur when using the Mobile renderer, which as far as I know also uses Vulkan.

However, when using Forward+, 3D objects all appear black, the editor runs at what appears to be <1 FPS, and the output log repeats the same error message until closed.

For the sake of thoroughness, I also tried using the integrated graphics option (Intel Iris Pro Graphics) by launching the editor with the "--gpu-index" argument. It runs the Forward+ renderer normally as far as I can tell, no errors come up in the output log, and the frame rate is what I would consider normal for a GPU of that type. According to Vulkan Hardware Capability Viewer, this GPU is also using API Version 1.2.268. The image below is Forward+ running on integrated graphics:

@bruvzg It sounds like we could use GPU model detection to force using Mobile or Compatibility when a NVIDIA graphics card is detected on macOS.


Bun: Weird Plugin behaviour (cached/wrong request yielded)

Describe the bug
When using Bun, the initial request will "prime" the server and it will refuse to yield the correct request on subsequent requests.
This works in Node.
Your Example Website or App
https://codesandbox.io/p/devbox/bun-yoga-yielding-wrong-request-dd3zzk
Steps to Reproduce the Bug or Issue
See README in the codesandbox!
I have also prepared the same repo in node, to verify that this works: https://codesandbox.io/p/devbox/bun-node-yielding-correct-request-67frsn
Expected behavior
It should work the same in Bun as in Node.
I have no clue if this is a Bun issue or Yoga/Envelop issue.
Screenshots or Videos
No response
Platform

Bun 1.0.15
See package.json for package versions, they are all the latest and greatest at the time of creating this codesandbox

Additional context
No response

The fix was
Bun.serve({
  fetch: req => yoga(req)
})

Thanks @EmrysMyrddin !


[Go Live][Feb 03]

pushing to live

Docs Build status updates of commit 458e5a0:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

msteams-platform/TOC.yml
:white_check_mark:Succeeded
View

msteams-platform/assets/images/apps-in-meetings/publish-status-publisher-signoff.png
:white_check_mark:Succeeded
View

msteams-platform/assets/images/apps-in-meetings/test-preview-add-offer-id.png
:white_check_mark:Succeeded
View

msteams-platform/assets/images/apps-in-meetings/test-preview-buy-subscription.png
:white_check_mark:Succeeded
View

msteams-platform/assets/images/apps-in-meetings/test-preview-monetize-app-image.png
:white_check_mark:Succeeded
View

msteams-platform/assets/images/apps-in-meetings/test-preview-monetized-apps-flow.png
:white_check_mark:Succeeded
View

msteams-platform/assets/images/apps-in-meetings/test-preview-monetized-apps-preview-offer-id.png
:white_check_mark:Succeeded
View

msteams-platform/assets/images/apps-in-meetings/test-preview-no-preview-audience.png
:white_check_mark:Succeeded
View

msteams-platform/assets/images/apps-in-meetings/test-preview-no-preview-offer-id.png
:white_check_mark:Succeeded
View

msteams-platform/assets/images/saas-offer/Plans-and-pricing-preview-offer.png
:white_check_mark:Succeeded
View

msteams-platform/assets/images/saas-offer/Preview-testing-no-offer-id.png
:white_check_mark:Succeeded
View

msteams-platform/assets/images/saas-offer/preview-testing-no-audience.png
:white_check_mark:Succeeded
View

msteams-platform/assets/images/saas-offer/preview-testing-offer-audience-available.png
:white_check_mark:Succeeded
View

msteams-platform/concepts/deploy-and-publish/appsource/prepare/Test-preview-for-monetized-apps.md
:white_check_mark:Succeeded
View

msteams-platform/concepts/deploy-and-publish/appsource/prepare/in-app-purchase-flow.md
:white_check_mark:Succeeded
View

msteams-platform/concepts/deploy-and-publish/appsource/prepare/include-saas-offer.md
:white_check_mark:Succeeded
View

msteams-platform/concepts/deploy-and-publish/appsource/prepare/monetize-overview.md
:white_check_mark:Succeeded
View

msteams-platform/concepts/deploy-and-publish/appsource/publish.md
:white_check_mark:Succeeded
View

msteams-platform/graph-api/rsc/test-resource-specific-consent.md
:white_check_mark:Succeeded
View

msteams-platform/mstdd-landing.yml
:white_check_mark:Succeeded
View

msteams-platform/whats-new.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel


About SwiftJson

if i use SwiftJson  how can i  convert the result json to [[String: Any]] ?
let swiftjson = JSON(data: response.data)
let json = swiftjson as! [[String : Any]]
//not work here
Sync.changes(json, inEntityNamed:"HomeTask", dataStack: appDelegate.dataStack) { error in
let request = NSFetchRequest(entityName: "HomeTask")
let items = (try! appDelegate.dataStack.mainContext.fetch(request)) as! [HomeTask]
self.delegate?.didFetchItems(entity: items)
}

Do you mean SwiftyJSON?
In my opinion there is no need to convert your response to JSON and convert it back directly to [[String : Any]]. Why don't you just use response.data as! [[String : Any]] directly?
If you intent to stay with SwiftyJSON their methods like rawData() or rawString() might come handy.

Thanks for clarifying this @dersvenhesse!


ADD Future Enhancements / Roadmap on the README file

Adding a Future Enhancements / Roadmap section to the README is important for several reasons:
Clarity on Project Direction: A roadmap provides contributors and users with a clear understanding of the long-term vision and future goals of the project. This transparency helps align everyone’s efforts towards the same objectives.
Encourages Contributions: By showcasing planned features or improvements, a roadmap can inspire developers to contribute by picking up tasks that align with their skills or interests. It helps developers know where their contributions would be most valuable.
Community Engagement: Users and contributors can get excited about upcoming features. It allows them to provide feedback, suggest features, or help prioritize tasks, fostering a more engaged community.
Organization and Focus: A roadmap provides structure to the development process by breaking down future features into achievable milestones. This helps keep the development process organized, especially in an open-source setting where multiple contributors are working together.
Trust and Commitment: A well-laid-out plan shows commitment from the maintainers, making users and potential contributors feel confident that the project will continue to be developed and supported in the future.
Overall, a Future Enhancements / Roadmap section helps manage expectations and increases the likelihood of attracting active participation and feedback from the community.
ADD GSSOC EXT 24 AND HACKTOBERFEST LABELS
ASSIGN ME THIS WORK @yashksaini-coder
THANK YOU!

Approach is good, while you are at it, can you also add hacktoberfest banner & improve the README overview

Approach is good, while you are at it, can you also add hacktoberfest banner & improve the README overview

Sure, I insist then you assign me the task under level 3 if possible.
THANK YOU!

Approach is good, while you are at it, can you also add hacktoberfest banner & improve the README overview

Sure, I insist then you assign me the task under level 3 if possible. THANK YOU!

Already did @alo7lika, but in case you didn't see the #24 discussion, this project is no longer a part of GSSOC or WoB
However it is accepted by the Hacktoberfest guidelines so any PR accepted here will count towards your hacktoberfest PR goal.

Approach is good, while you are at it, can you also add hacktoberfest banner & improve the README overview

Sure, I insist then you assign me the task under level 3 if possible. THANK YOU!

Already did @alo7lika, but in case you didn't see the #24 discussion, this project is no longer a part of GSSOC or WoB
However it is accepted by the Hacktoberfest guidelines so any PR accepted here will count towards your hacktoberfest PR goal.

I was talking about the "LEVEL" (1/2/3) that has to be assigned to get points.
So I asked you to assign the LEVEL 3 Label .

Approach is good, while you are at it, can you also add hacktoberfest banner & improve the README overview

Sure, I insist then you assign me the task under level 3 if possible. THANK YOU!

Already did @alo7lika, but in case you didn't see the #24 discussion, this project is no longer a part of GSSOC or WoB
However it is accepted by the Hacktoberfest guidelines so any PR accepted here will count towards your hacktoberfest PR goal.

I was talking about the "LEVEL" (1/2/3) that has to be assigned to get points. So I asked you to assign the LEVEL 3 Label .

I know what you were mentioning, but this project has been removed from the GSSOC-ext


[VideoConferenceMute] Unpin/Hide Toolbar

📝 Provide a description of the new feature
It will be great if we have the availability to unpin the toolbar even when the microphone and camera are turned on.
What is the expected behavior of the proposed feature?  What is the scenario this would be used?
To get a cleaner and minimalistic look, in case you do not want the toolbar disturbing your workflow.

If you'd like to see, this feature implemented, add a 👍 reaction to this post.

This seems to be already listed in the tracker #6374:

Add a close button to the toolbar https://github.com/microsoft/PowerToys/issues/6374#issuecomment-693464482

@khushrxnx
are you using version 0.24?
If mic and camera are on, there is an option to hide the toolbar

@enricogior He specifically asked for a close/hide button

@alannt777
yes, but there is no need for unpinning if it can already be achieved with turning on the exiting option.

@khushrxnx
are you using version 0.24?
If mic and camera are on, there is an option to hide the toolbar

Hi! I do have this option toggled on but I would like an option to close/hide the toolbar while say the mic is muted. When I'm not using an application that requires the use of the mute and I mute my mic, the toolbar is always on display and only hides if choose to unmute myself.


MGMT-12262: Document default DaemonSet image pull policy

Move the example resource under the "Module CRD" section to align with upstream docs.

/lgtm


Swift Package Manager support

Changes in this pull request
Added proper support for Swift Package Manager (SPM).

"inverted" the current master's files structure by putting all public headers to the include folder and all internal/private moved to the package's root. Swift Package Manager documentation

created symbolical links for IGListKit with the relative path to IGListDiffKit's private headers to work around an issue for private headers search path. Seems like it works pretty well for SPM, cocoapods and original Xcode workspace.

added macOS Catalyst support

Supported targets:
- IGListSwiftKit

- IGListKit

- IGListDiffKit

TODO:

[x] add a way to test SPM support.

Issue fixed: #1368 #1406
Checklist

[x] All tests pass. Demo project builds and runs.
[x] I added tests, an experiment, or detailed why my change isn't tested.
[x] I added an entry to the CHANGELOG.md for any breaking changes, enhancements, or bug fixes.
[x] I have reviewed the contributing guide

Not sure how to trigger CI?

So strange. If you checkout on commit c2caf741657552458560b25a4fe14655eb40a1ef IGListKit can be built as a Package from Xcode without errors, but if you try to integrate it as a dependency on a regular Xcode project as soon as you try import IGListKit you will see a compilation error. Maybe it's an Xcode bug since it's definitely related to the headers search path since imports in angle brackets (<IGListDiffkit/someheader.h> ) can't be resolved by the Xcode project which depends on IGListKit
I made some more experiments and moved all public headers to the include folder and changes all import to use local mode with double quotes "IGListDiffkit.h". This seems to work for IGListKit as a Swift package (from Xcode) and can be imported as a dependency for some regular Xcode project ( I have to define USE_PACKAGE_FROM_XCODE to properly manage imports). So the latest commit seems to work, now need to figure out if other things don't break cocoapods (lint passed locally, but I have doubts whether it works on real projects), unit test.

Hey hey, thanks for working on this! I also tried out a bit but couldn't figure out how to go around the file structure thing.
Looks like your latest approach is to change the files structure to go around the search path thing from Xcode setting, do they work in your latest version?

Hey @lorixx! Yes, I've "inverted" the current master's files structure by putting all public headers to the include folder and all internal/private moved to the package's root. Swift Package Manager documentation

created symbolical links for IGListKit with the relative path to IGListDiffKit's private headers to work around an issue for private headers search path. Seems like it works pretty well for SPM and cocoapods and original Xcode workspace.

So far I was able to verify:

that the cocoapods support works as expected, and projects from the Example folder passed tests (iOS one).
Xcode 12 SPM integration work as expected.

I have some issues with running unit tests from Xcode locally, but it's the same issue I see in the current master (my env is Xcode 12.0.1, Xcode 11.7). I see that .travis mapped to Xcode 10.2 but maybe there is some other way to make it work on a newer environment? BTW. do you trigger CI manually?

BTW. do you trigger CI manually?

@3a4oT I think one issue I saw might be related here is that the PR is in "Draft" mode, thus it doesn't trigger the CI I believe, for example https://github.com/Instagram/IGListKit/pull/1430 this PR triggered the CI.

We moved most of our dependencies to SPM because Cocoapods doesn't play very well with Xcode 12.
The only thing thats missing is IGListKit. Any Progress on this one?

I have some other work right now, but my plan is to alloc some time during the upcoming weekend. :)

So I take another attempt to synchronize the test environment before continuing work with this PR. As part of this attempt, I've created PR which allows us to run tests from Xcode 12, and added Github workflow to verify it.
@lorixx, would be awesome to get feedback on https://github.com/Instagram/IGListKit/pull/1478 before I continue with this one. Thanks in advance.

And converting this PR form a "draft" doesn't trigger the original Travis CI tests.

Tests (github workflow) passed on my fork:
https://github.com/3a4oT/IGListKit/actions/runs/368991395

@lorixx  friendly ping ...

Thanks again for working on this! Does this work for the other integrations? Cocoapods and Carthage.
Also looks like this change added a new github CI support which is great, did you get the build/test result from the previous travis CI tool? cc @bdotdub @maxolls @Ziewvater We might need to discuss the overall code structure change here.

Hey @lorixx . Yeah, Carthage and cocoa pods passed. The latest test results can be found here https://github.com/3a4oT/IGListKit/actions/runs/372069244 . I have opened separate PR for CI support if you want to go it first for better visibility.

Hey @lorixx . Yeah, Carthage and cocoa pods passed. The latest test results can be found here https://github.com/3a4oT/IGListKit/actions/runs/372069244 . I have opened separate PR for CI support if you want to go it first for better visibility.

yeah I think it's better to decouple the SPM support and the new Github CI support, since they are doing different things and related to each other.

https://github.com/Instagram/IGListKit/pull/1478 CI

@3a4oT Just tested out your spmBrain branch in my project and everything is looking great! I'll have our QA poke around and see if they find any issues but so far so good. Nice work :)

Just an update, no issues found! Seems production ready to me!

@lorixx is there a timeline available for getting this merged? We've actually pushed this to our production environment without issue, glad to finally be free of cocoapods!

@RamblinWreck77 thanks for the feedback!

Any progress on official support?

Any progress on official support?

any update on this?

You know what I'm going to ask :)

Hey folks! Sorry to revive this old thread. I'm going through the list of PRs now and seeing which ones we can close out in preparation of a new version launch.
It seems to me that this PR was further refined down the line and this was used to create the SPM setup we have today. I can definitely confirm that SPM support works great now (We're using it for the sample projects now!) so I think we can close this PR out having done its job.
Thanks again for all your contributions!


FIX: Don't import optional deps at the top-level

#138 imported openneuro at the top of the datasets module, but openneuro-py is not a hard dependency of pylossless.
This PR creates a soft import function that gets called only if/when a user calls the function in pylossless.datasets that needs openneuro-py, and raises an informative error if they don't have it installed.
This will likely become handy if we need to do similar soft imports in the future.

Waiting for  #168 to land, then CI's should be happy..


Frozen trying to translate from google

I have used your tool to create translations and all worked correctly the first time
I then tweaked some code, deleted all previous translations and folders and went to try again.
Unfortunately, it gets to the bit where it should go to google translate and freezes
I see no network traffic or info in the console window
Am i missing something?

Facing the same issue. Any update?

@ivonederlof I am facing same issue too. Any ideas?

I just forked the code and started some debugging myself, as this tool has great potential if we manage to make it work.
The first thing I noticed is there is incomplete handling of errors from the Google server.
For example, the app receives lots of BAD_REQUEST replies, probably because of the limits of the 'free' license terms.
My plan now: add improved error handling, then check the google terms and see if I need to subscribe to the service...

You are right. This does have really great potential. I had to go the long
route of using a combination of transifex.com which integrates aws or azure
translate to automatically do it. But transifex isn't free and needs some
work to setup.
~ Kevin
On Fri, May 15, 2020, 11:41 AM Reuben Sivan<EMAIL_ADDRESS>wrote:

I just forked the code and started some debugging myself, as this tool has
great potential if we manage to make it work.
The first thing I noticed is there is incomplete handling of errors from
the Google server.
For example, the app receives lots of BAD_REQUEST replies, probably
because of the limits of the 'free' license terms.
My plan now: add improved error handling, then check the google terms and
see if I need to subscribe to the service...
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/ivonederlof/xlf-translator/issues/2#issuecomment-629361727,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AHPIJTRHXQ7YPNY6J2FSBJLRRVWCLANCNFSM4I3FKJEA
.


Parent menu items translations

Currently parent menu items will not be translated as they miss the __() syntax, this tiny tiny PR fixes that.

this needs to be ported also to Core


[Strings/Permutations] - Anagram detecting

I have written a optimized version of Anagram detecting, do you guys accept optimization?
Before: 2n+2(n log n)+n
After: 3n

Hello @ivandrofly, sorry for the late reply, yes we definitely accept optimizations. Waiting for your pull request!

Hello @ivandrofly, any news on your optimizations PR?

Hello @ivandrofly, any news on your optimizations PR?

Oh yeah... will be send soon!

https://github.com/aalhour/C-Sharp-Algorithms/pull/37

Hello @ivandrofly,
Sorry for the late reply, going through the PR now.

Hey @ivandrofly, I am going to close this issue since we reached an agreement on the next steps.


Cannot send anonymous objects using EventGridClient

Hello,
I am attempting to use the EventGridClient class to send some events to EventGrid. I was unsuccessful when it came to sending custom data in the data property of the EventGridEvent. EventGrid would just receive a null value. If I set the data property to a string value, it was received by EventGrid correctly, however using a complex object, the object was not serialized to JSON.
I've tracked the issue down to the EventGridClient initializing the Json serializer with an instance of the rather ambiguously named ReadOnlyJsonContractResolver(). The description of this class is:

JSON contract resolver that ignores read-only properties during serialization.

So currently, the EventGridClient will not serialize any custom event data that is exposed via readonly properties - ie: all properties on your custom data object have to be read/write.
This in turn rules out anonymous objects as your custom event data payload, as anonymous objects only implement readonly properties.
Currently, the workaround is to explicitly override the contract resolver:
eventGridClient.SerializationSettings.ContractResolver = null; // Use the default resolver

What rationale is there for initializing the JSON serializer with ReadOnlyJsonContractResolver? It doesn't seem to be the correct contract resolver to be using for one way serialization.

I've also hit a snag regarding the ReadOnlyJsonContractResolver.
In my case, I was attempting to send an event whose Data was an object with a constructor and get-only properties (e.g. public Guid AccountId {get; }).
What I discovered was that when these events went across the wire, the Data property on the EventGridEvent had any get-only properties omitted.
In researching the issue, I came across https://github.com/Azure/autorest/issues/1904 from the AutoREST project, where it was closed as by-design.
Is it a correct assumption that it is by-design for AutoREST (which probably expects to be speaking to Azure APIs most of the time and not carrying arbitrary user objects over the wire) and not necessarily by-design by the EventGridClient?
At any rate, if we could get some guidance on how you think we should proceed regarding this issue, it would be much appreciated.
If you don't see any ill-effects from using the workaround provided above, we can continue forward with that, but if you'd prefer some kind of PR for a change in behavior we'll need some guidance on what you expect that behavior should be.

Same here. Anonymous objects should be supported.

Did anyone ever get a solution for this? It is almost an year and that is critical to the product, specially if you are not using the client directly, like in EventGrid bindings for Azure Functions.
It is impressive that nobody from the product team made a fix for that yet...

Same problem here, it should be supported

I just ran into this issue, but I've found a workaround which seems to be working exactly as I would like. Just make sure to not set your object directly in the Data property, but wrap it with JObject.FromObject. This way, the properties should be converted using your object configuration, while made available for the ReadOnlyJsonContractResolver.
Example:
return new EventGridEvent {
    Id          = Guid.NewGuid().ToString(),
    EventType   = ObjectType,
    Topic       = Topic,
    Subject     = $"/company/{CompanyUuid.Value}/{ObjectType}",
    DataVersion = DataVersion,
    EventTime   = eventTime,
    Data        = JObject.FromObject(yourObject)
};

As mentioned in https://github.com/Azure/azure-sdk-for-net/issues/12244, this is fixed in the new library that is currently in beta.

For anyone coming across this issue before the new library is out of beta, I was able to resolve this and restore the default Json.NET behavior by setting the EventGridClient's contract resolver back to DefaultContractResolver:
var client = new EventGridClient(topicCredentials);
client.SerializationSettings.ContractResolver = new DefaultContractResolver();

For anyone coming across this issue before the new library is out of beta, I was able to resolve this and restore the default Json.NET behavior by setting the EventGridClient's contract resolver back to DefaultContractResolver:
var client = new EventGridClient(topicCredentials);
client.SerializationSettings.ContractResolver = new DefaultContractResolver();


Make Vector resources sync from figgy

Folks in SC are going to start  creating smaller DPUL exhibits from various content that  is currently available in figgy. A geo-rectified map is one of the items they would like to include.
related to #777?

Vector resources don't have manifests so this would be a significant feature request.
@kelea99 Can you give us more background on the exhibit and this request? Is it possible there is a related scanned map that would work as an alternative?

Hi, @hackmastera was able to get one to sync, but the other may be a problem in figgy.  this is the item that Christina and I tested on Friday : https://figgy.princeton.edu/catalog/0aafa01b-7e1f-42de-b093-2a015fe1a039
and this is the one I had no problem with: https://figgy.princeton.edu/catalog/f5f26d2c-c3b7-4a50-98f6-8bd30a7eb623

Exhibit background: this is the first of a new program in SC:  thee Collections are selections of 10 to 15 images already available and publicly visible in Figgy, arranged and described around a theme.

Spoke with @kelea99. We'll ask curators to look for a way to point back to the maps portal in the text of a related object.


[operator] Introduce gardeneradmissioncontroller Golang component

How to categorize this PR?

/area usability
/kind enhancement
What this PR does / why we need it:
Similar to #8215, this PR introduces the Golang component for the gardener-admission-controller. API changes and component instantiation will follow in separate PRs.
Which issue(s) this PR fixes:
Part of #7016
Special notes for your reviewer:
/cc @rfranzke @ScheererJ @oliver-goetz
Release note:

NONE

/assign


Act 2 Event - Use Relic Tooltip when the player pass the mouse in each relic option

This had been done already.


StringFielddataFormat is missing StringEnumConverter attribute

NEST/Elasticsearch.Net version: 2.x, 5.x, master
Elasticsearch version: 2.x, 5.x
Description of the problem including expected versus actual behavior:
StringFielddataFormat is used to set the format of 'Fielddata' setting in a mapping.
The enum is missing a StringEnumConverter attribute, and as a result the mapping would contain the int value instead of the string value.
For example - fielddata: { format: 2 } instead of fielddata: { format: "disabled" }
ES will not complain about this invalid mapping, but it will just not honor it.
Steps to reproduce:

Create some mapping with Fielddata as disabled

field.Fielddata(fd => fd.Format(StringFielddataFormat.Disabled))

Check the actual request that is sent to ES

"fielddata": { "format": 2 }

Thanks for reporting @gilad61 👍


Feature/added test reports to pipeline

:star: PR built and available in a preview environment sashkica-azure-ms-pr-3 here


While working on adding Dart support I am not able to successfully integrate tree-sitter-dart.wasm in claude-dev

Description
I'm working on adding support for Dart in claude-dev using the tree-sitter-dart package (https://www.npmjs.com/package/tree-sitter-dart). However, I'm encountering issues with incorporating the WASM file into the build process, and subsequently having the dart support in claude-dev.
Current Behavior
The WASM file is not being loaded correctly in languageParser.ts. What I notice there is that the loading mechanism doesn't seem to be using the the location where the WASM files are supposed to be copied according to esbuild.js.
What I want to achieve
The WASM file should be properly incorporated into the build and loaded correctly by loadLanguage in  languageParser.ts.
Questions

Is there any special consideration or step I'm missing when adding the WASM file to the build?
How should the WASM file be correctly referenced in languageParser.ts?
Are there any specific configurations needed in esbuild.js to ensure the WASM file is copied to the correct location?

Additional Context

I'm using tree-sitter-dart version: 1.0.0
Claude-dev version/commit: f9b517c4d0895efc6f9204c48437a77c76d54d5f

Any guidance would be greatly appreciated.

@go-run-jump Dart support been included directly into tree-sitter, https://github.com/tree-sitter/tree-sitter/wiki/List-of-parsers, so no need for tree-sitter-dart.


feat: copy to curl

Description
no copy to curl

harus di solved sih ini..biar gampang ke postman ya mas @bayunugroho2022

https://github.com/bayunugroho2022/dio-request-inspector/pull/38


AFHTTPSessionManager Leak issue unsolved mystory

Hello Team,
Good work on such an awesome library. I am facing a leaks issue on following files always.
Have tried from the other sources and issue list in this repo for invalidatesessionbyCancellingtask: but none have worked. I still get the leaks shown at these lines for all the services I have created.
AFHTTPSessionManager *manager = [AFHTTPSessionManager manager];
manager.responseSerializer = [AFJSONResponseSerializer serializer];
manager.requestSerializer = [AFJSONRequestSerializer serializer];

Attached the Image as well for reference for one of the file.

@vickydhas hello, i suggest that you can use "dispatch_once" to create AFHTTPSessionManager. And the leaks maybe disappear.
+ (AFHTTPSessionManager *)sharedAFHTTPManager {     static AFHTTPSessionManager *AFHTTPManager;     static dispatch_once_t onceToken;     dispatch_once(&onceToken, ^{         AFHTTPManager = [AFHTTPSessionManager manager];         AFHTTPManager.requestSerializer = [AFJSONRequestSerializer serializer];         AFHTTPManager.responseSerializer = [AFJSONResponseSerializer serializer];     });     return AFHTTPManager; }

I will check this and let you know thanks for valuable input given.
Sent from my iPhone6+

I user "dispatch_once"",but How to update http headers?

Unfortunately, it is unconvenient to set HttpHeaders for some requests beause of singleton. But most of the time our httpHeaders is set to the same. You can set it separately for a few special requests before generate task, and reset it after task is generated. Or create a new manager which is not a singleton for special requests.


Added the basic Headers for the readme.md #1

Signed-off-by: Dipankar Das<EMAIL_ADDRESS>

This does not follow CNCF code of conduct - please create your own guidelines and rules for inclusive language
Contributing.md where is that ?
You need to mention how to use the bot as well
So first step would be to make the code working and then add the readme, closing this for now and when the initial code is working feel free to create another PR


chore(deps): bump getrandom from 0.2.8 to 0.2.12

This fixes build with musl libc.

Is there any crate needs to be bumped?

I don’t understand the question. The PR/commit title and the patch with changes in Cargo.lock clearly states what is bumped.

The change only effect the repository and won't work on the end user's side.


Fixed issue where report query by tag_ids would not work.

@sochix Please review/approve this pull request. It fixes not only tag_ids but all List properties. Thank you.

This is also causing us issues, can this be pulled in please

Merged! Thanks @tylerrbrown for your PR

@sochix any idea when it will be released on nuget?

I will do it ASAP


Forgot/reset password template missing

I've enabled the forgot password option on login page, on logi the styling is ok

but when open the reset password link, the template styling is not working.

Am I missing something or the template is curently not yet developed in unfold admin templates?
Thanks, best regards

Duplicate #384

@lukasvinclav just a ping


Is it possible to get photos?

Yes,
you can use get_post to get the photo in post now.
it will be a list in PostInfo.images


Allow to set bech32 prefix, tokens for faucet on command line

Either via cli arguments or via environment variables with defaults.
See https://github.com/CosmWasm/cosmjs/blob/master/packages/faucet/src/constants.ts#L8-L24
For the testnet, I want to set the token to SHELL/ushell and the bech32 prefix to coral but this is not possible with the current binary.

Please make this as a patch on 0.22 as a 0.22.1 release.

Done in the 0.22 branch and released as 0.22.1


Add changes for challenge one

Thanks for your contribution to challenge one!
The cell looks great, love the animation!


Crash when try to view camera

Using with Doorbird D110
My config:
    "platforms": [{
			"platform": "Camera-ffmpeg",
			"cameras": [{
    	  "name": "Camera",
    	  "videoConfig": {
        	"source": "-re -i rtsp://username:password@<IP_ADDRESS>:554/mpeg/media.amp",
        	"stillImageSource": "-i<EMAIL_ADDRESS>        	"maxStreams": 1,
        	"maxWidth": 1280,
        	"maxHeight": 720,
        	"maxFPS": 30
				}
			}]
		}]

Error: spawn ffmpeg ENOENT
    at exports._errnoException (util.js:1036:11)
    at Process.ChildProcess._handle.onexit (internal/child_process.js:193:32)
    at onErrorNT (internal/child_process.js:359:16)
    at _combinedTickCallback (internal/process/next_tick.js:74:11)
    at process._tickCallback (internal/process/next_tick.js:98:9)

ENOENT means either you didn't install ffmpeg or ffmpeg is not in a place where nodejs can access.

I'm using homebridge-docker, ffmpeg already in docker and everything worked 2 mounths ago

Then I'm not really sure... based on the error I can only say check where ffmpeg is being installed and see why spawn failed to run it.

I'll be very appreciate if you help me to do it, I'm have no idea how to do this

I knew how to do that in normal system but I have no idea how to solve this with docker ¯_(ツ)_/¯

Maybe you know how to install ffmpeg in seperate docker?

Or via install.sh

Check this or this?

Thanks, will try.

I found the problem. Docker don't include ffmped for some reason, but description says vise versa.
Solution for those who has the same problem:

Use docker with clean HomeBridge install (for example this).
Add in the top of install.sh a code bellow:

echo 'deb http://ftp.uk.debian.org/debian jessie-backports main' >> /etc/apt/sources.list
apt-get update
apt-get -y install ffmpeg
ffmpeg

Start docker and wait until it loads everything (2-15 mins, depend on your hardware and internet speed).

debian changed the sources of ffmpeg, it should be libav-tools.
But its not working for me (with libav-tools). Your workaround is working! Thanks!


set to always play in Landscape?

Hi Adam,
is it possible to set the video to only play in landscape so that it does not support portrait mode? I also have the problems with stretching as described here https://bitbucket.org/OctaneSoftware/octane.xam.videoplayer/issues/2/android-fillmode-video-resolution-appears so I'd prefer to display all my videos in landscape only, regardless how the user holds the cell phone. Is that possible?
Many thanks!

The answer located here should help:
https://forums.xamarin.com/discussion/9454/how-to-force-app-in-landscape-mode

Unfortunately not because it's about restricting the whole app, not just a single page.
But I understand that your video player is not able to restrict it so thanks for the info!