Understanding the concept of components in ReactJs.

This issue is a topic-issue.
Please write and contribute a technical article on this topic - "Understanding the concept of components in ReactJs.", to the "reactify-reactjs" branch.
Do you have an already published article on that topic or a very related topic? go ahead and contribute all the same.
Awaiting your PR.

please assign me, i would like to work on this

@Aribaskar-jb Thanks for you decision to contribute to Reactify. please go ahead and take it on.
But please take your time to write a very informative and interesting article. Remember to use graphic illustrations like screenshots as much as possible. In case you already have a published one, go ahead and contribute it.
You can read the Reactify project release article, to get more detail on how to contribute.
Thanks @Aribaskar-jb, I'll be anticipating your PR.

This tutorial does not require a project repo. But you can come up with any code additions if you wish @Aribaskar-jb .


Chore: Specify more precise time format in logs

Description

Logs in Claudie use the very simple time format HH:MM. This issue aims to change it for something more precise.
Time formats available
How to change it
Exit criteria

[ ] Logs now use a more precise time format

We agreed to proceed with the new time specification, the preferred time format is RFC3339.


Update bright theme

Coverage remained the same at 90.488% when pulling 22eb0e72e2903eea718becce7247ac1e23891a74 on khooroko:Update_BrightTheme into f0c3d0493b7103e570157e6f1d01f862dfe585ee on CS2103AUG2017-T17-B1:master.


[WIP]: compatibility for zarr-python 3.x

This is a WIP for compatibility with zarr-python 3.x. It's intended to be run against zarr-python v3 + the open PRs referenced in https://github.com/pydata/xarray/issues/9515.
All of the zarr test cases should be parameterized by zarr_format=[2, 3] with zarr-python 3.x to exercise reading and writing both formats.
This is currently passing with zarr-python==2.18.3. zarr-python 3.x has about 61 failures, all of which are related to data types that aren't yet implemented in zarr-python 3.x.
I'll also note that https://github.com/pydata/xarray/issues/5475 is going to become a larger issue once people start writing Zarr-V3 datasets.

[x] Closes https://github.com/pydata/xarray/issues/9515
[x] Tests added
[ ] User visible changes (including notable bug fixes) are documented in whats-new.rst
[ ] New functions/methods are listed in api.rst

This is not quite all passing yet but I changed this from WIP to ready for review anyway. Our goal is to get this wrapped up in the next couple days so we can continue testing ahead of the Zarr-Python beta release.

I added a number of folks as reviewers to this because I want to make sure it gets prompt review. We're still iterating on the Zarr-Python side but it would be great to get this into main so we can start with smaller PRs on the Xarray side from here. @TomAugspurger has done the lions share of the work so major kudos to him 🙌 !

Does anyone immediately see why the zarr engine might not be registered?

I don't, but usually this means that the backend libraries (in this case, zarr or its dependencies) failed to import properly.
If you'd like to reproduce, the setup is (for a unix system):
mamba create -n xarray-upstream-dev python=3.12
mamba env update -n xarray-upstream-dev -f ci/requirements/environment.yaml
mamba activate xarray-upstream-dev
bash ci/install-upstream-wheels.sh

(otherwise I'll try once I'm back home, I'm on train wifi right now)

Thanks. https://github.com/pydata/xarray/actions/runs/11306872757/job/31447959490?pr=9552#step:6:404 shows that zarr was not installed correctly. Unfortunately I can't reproduce that locally with those commands, zarr imports fine.
I found an earlier run where zarr was installed fine from main. I'll keep looking.

I can reproduce locally, and python -c 'import zarr' fails because donfig and crc32c have not been pulled in as dependencies. If I install those manually, the plugin tests pass. However, there's a bunch of other tests that fail now.

In https://github.com/pydata/xarray/pull/9552/commits/26081d4f950f39f7bbc24cea264d5aff24db730f, I added the donfig and crc32c deps.

I'm going to spend some time today working on the last few failures here.

@TomAugspurger - a thought that may help limit the scope of this PR. We may consider punting on full datatree support for zarr-v3 in this PR and fix that up in follow-on work. What do you think about adding pytest.skip decorators on the datatree failures?

I haven't looked at the datatree side of things yet, so that sounds good to me :)

Another idea to simplify things would be to disallow (or at least discourage) consolidated metadata with V3 data, given the uncertain status of consolidated metadata in the V3 spec. Maybe default to consolidated=False with V3 and issue a warning if True?

We may consider punting on full datatree support for zarr-v3 in this PR and fix that up in follow-on work.

What exactly is the scenario/version where this doesn't work? I would like to release a version of Xarray where you can still use DataTree to open a Zarr V2 store. Then I wouldn't mind us fixing other cases later.

What exactly is the scenario/version where this doesn't work? I would like to release a version of Xarray where you can still use DataTree to open a Zarr V2 store. Then I wouldn't mind us fixing other cases later.

@TomNicholas - my proposal would maintain existing datatree functionality for Zarr-Python 2 but would postpone doing the integration work for Zarr-Python 3 for another PR.
The specific issues are mostly upstream and may take a few days to sort out.

https://github.com/zarr-developers/zarr-python/issues/2358
https://github.com/zarr-developers/zarr-python/issues/2357

That sounds fine to me!

Another idea to simplify things would be to disallow (or at least discourage) consolidated metadata with V3 data, given the uncertain status of consolidated metadata in the V3 spec.

This might be a bit tricky to implement. The current default behavior is to try consolidated metadata and emit a warning and fall back to non-consolidated metadata. However, we might not know whether we have V2 or V3 data until after we've read the data, so we couldn't warn until after we've fallen back to non-consolidated and discovered what we have.
I'm not sure about the write side.
IMO, the downsides of lack of consolidated metadata, and my confidence that something like consolidated metadata will end up in v3 pushes me to try to support it with the current API. If we do need to adjust anything to comply with the spec I think we'll be able to paper over it in code and not have to change the user-facing API.

I'll have a fix for the failing TestInstrumentedStore tests soon.

xarray/tests/test_backends.py::test_zarr_storage_options is tricky to test. We should be able to just pass through storage_options to the call to zarr.open_group.
Currently, the only zarr store that supports storage options is RemoteStores with an async filesystem. The current test uses the memory filesystem, which doesn't support async operations. Zarr-python sets up a moto server to use the S3 filesystem.

xarray/tests/test_backends.py::test_zarr_storage_options is tricky to test. We should be able to just pass through storage_options to the call to zarr.open_group.

Let's skip this test with v3.

@pydata/xarray - are there others that are hoping to review this before it goes in? Noting that most of the surface area here is in the tests, the actual code changes are quite minimal.

I just pushed a commit reverting the changes to avoid values equal to the fill_value in the test cases, which aren't needed after Ryan's changes to fill value handling.
I think this is ready to go once CI finishes. I expect upstream-ci to fail on the xarray/tests/test_groupby.py::test_gappy_resample_reductions tests, but those should be unrelated.

There's one typing failure we might want to address:
xarray/tests/test_backends_datatree.py: note: In member "test_to_zarr_zip_store" of class "TestZarrDatatreeIO":
xarray/tests/test_backends_datatree.py:289: error: Argument 1 to "open_datatree" has incompatible type "ZipStore"; expected "str | PathLike[Any] | BufferedIOBase | AbstractDataStore"  [arg-type]

I'll do some reading about how best to handle type annotations when the proper type depends on the version of a dependency.

Edit: a complication here is that this is in open_datatree, which I think supports other backends like NetCDF too. It's not immediately clear to me whether the signature can of open_datatree needs to match for every implementation. This can maybe be addressed once we fully support datatree with zarr-python 3?

I'm don't see why the typing of open_datatree(<zarr-store>) would need to be any different to that of open_dataset(<zarr-store>). But I think it's fine to ignore this for now as we know we need to come back to it in another PR anyway.

but mypy doesn't like that

my 2 cents... we should not get hung up on this right now. a) there are plenty of other failures in the upstream-dev-mypy check unrelated to this PR and b) its probably not worth hacking something in here when there are bigger issues with the upstream zarr implementation to sort out.

Let's get this in by the end of the week.

👏 Thanks all! Especially @TomAugspurger for doing the lion's share of the work here.


[SPARK-42721][CONNECT] RPC logging interceptor

What changes were proposed in this pull request?
This adds an gRPC interceptor in spark-connect server. It logs all the incoming RPC requests and responses.

How to enable: Set interceptor config. e.g.
./sbin/start-connect-server.sh --conf spark.connect.grpc.interceptor.classes=org.apache.spark.sql.connect.service.LoggingInterceptor  --jars connector/connect/server/target/spark-connect_*-SNAPSHOT.jar

Sample output:
 23/03/08 10:54:37 INFO LoggingInterceptor: Received RPC Request spark.connect.SparkConnectService/ExecutePlan (id<PHONE_NUMBER>):
 {
   "client_id": "6844bc44-4411-4481-8109-a10e3a836f97",
   "user_context": {
     "user_id": "raghu"
   },
   "plan": {
     "root": {
       "common": {
         "plan_id": "37"
       },
       "show_string": {
         "input": {
           "common": {
             "plan_id": "36"
           },
           "read": {
             "data_source": {
               "format": "csv",
               "schema": "",
               "paths": ["file:///tmp/x-in"]
             }
           }
         },
         "num_rows": 20,
         "truncate": 20
       }
     }
   },
   "client_type": "_SPARK_CONNECT_PYTHON"
 }

Why are the changes needed?
This is useful in  development. It might be useful to debug some problems in production as well.
Does this PR introduce any user-facing change?
no
How was this patch tested?

Manually in development
Unit test

Need run ./build/mvn -Pscala-2.12 scalafmt:format -Dscalafmt.skip=false -Dscalafmt.validateOnly=false -Dscalafmt.changedOnly=false -pl connector/connect/common -pl connector/connect/server -pl connector/connect/client/jvm to format the code in connect modules

@LuciferYang thanks. Fixed.

fine to me, cc @zhenlineo @amaliujia @hvanhovell FYI

Hi, @rangadi and @hvanhovell . There is a scalafmt error. Here is a follow-up to recover CI

https://github.com/apache/spark/pull/40374

@dongjoon-hyun thank you! I should have checked. missed it.


How to use TranslationRecognizer with AutoDetectSourceLanguageConfig for dynamic language recognition on mobile SDKs (Java and iOS)

Hello,
I'm having trouble using the TranslationRecognizer together with AutoDetectSourceLanguageConfig for dynamic language recognition in the mobile SDKs (Java and iOS). I found that in the JavaScript SDK, it is possible to set the mode for AutoDetectSourceLanguageConfig to LanguageIdMode.Continuous. However, I cannot find this mode setting in the mobile Java and iOS SDKs.
Could you please guide me on how to implement dynamic language recognition and transcription of speech in these SDKs? Your help would be greatly appreciated.
Thank you.

Thanks for trying out the Speech SDK and interest in source language detection...
Unfortunately, as a preview feature Source Language Detection support hasn't yet made it to the Java and Objective-C versions of the Speech SDK for TranslationRecognizer scenarios.

Thanks for trying out the Speech SDK and interest in source language detection...
Unfortunately, as a preview feature Source Language Detection support hasn't yet made it to the Java and Objective-C versions of the Speech SDK for TranslationRecognizer scenarios.

Thank you for your response. Could you please provide an estimated timeline for when this feature will be added to the mobile SDKs? It would be very helpful for my project.

Internal work item ref. 5256732.

Closing this since a work item has been added to the backlog but there is no ETA. We will update here if more information becomes available. Please open a new issue if more support is needed.


Improve support of global dtype policy in seq2seq layers

The layers should not set a dtype, unless explicitly passed by the user.
Fixes #1968.

@bhack Thanks, I added the version check in the test fixture.


Octo client

An Octo client is needed to encapsulate API calls to printers. Methods should be async.

according to implementation of printer state API and printer command API, these operations are valid only when the printer is in operational state, so the client should check response status code of printer APIs and raise errors if needed.

Octo client async context manager should call connect() and disconnect()


Document external API(CodeSearcher.Interfaces

The creation of this issue was an user error due to beer ;-)


Allowing world name in backup file

I was switching between worlds from saves/worlds/ on my server and noticed that the backups don't reflect the world change if the world alters. This makes it impossible to tell which backup file belongs to which world.
Could the backup file use also contain the world name to avoid this problem?
Alternatively, could the filename format be specified as an ENV VAR in docker-compose so we have custom control over the name?

Backups are per your whole save folder and not per world. Thus, if you are switching world names its best to check the tar.gz file for the world you wish to restore. This is because many servers utilize multiple worlds.


Request for contribution: more efficient batchnorm

Currently Keras implements its own batchnorm system "manually", i.e. by creating update ops to maintain exponential averages of relevant statistics. However batchnorm ops are available natively in TF, and now Theano, which wrap the more efficient cuDNN implementation when available.
We should consider creating a batchnorm op in the Keras backend, which would wrap the TF and Theano implementations, and thus leverage cuDNN when available.
Anyone interested in making a valuable contribution to Keras is welcome to look into this.

Just a comment, cuDNN v4 and v5 have different interface. In Theano we only
wrapped v5 and so have that interface.
Documentation:
http://deeplearning.net/software/theano_versions/dev/library/sandbox/cuda/dnn.html#batch-normalization
On Thu, Jul 14, 2016 at 2:25 PM, François Chollet<EMAIL_ADDRESS>wrote:

Currently Keras implements its own batchnorm system "manually", i.e. by
creating update ops to maintain exponential averages of relevant
statistics. However batchnorm ops are available natively in TF, and now
Theano, which wrap the more efficient cuDNN implementation when available.
We should consider creating a batchnorm op in the Keras backend, which
would wrap the TF and Theano implementations, and thus leverage cuDNN when
available.
Anyone interested in making a valuable contribution to Keras is welcome to
look into this.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/fchollet/keras/issues/3227, or mute the thread
https://github.com/notifications/unsubscribe/AALC-4TW_3bkpU58nyAd1vxxKi_zlUZZks5qVn8zgaJpZM4JMtog
.

Thanks! To be clear, does this op just applies (inputs - mean) * gamma * stdinv + beta, right? The moving averages must still be maintained via an update op run manually?
In TF, tf.train.ExponentialMovingAverage returns a (potentially more efficient) update op for maintaining exponential moving averages:  https://www.tensorflow.org/versions/r0.9/api_docs/python/train.html#ExponentialMovingAverage
In Theano, do you think that an update such as (running_mean, momentum * running_mean + (1 - momentum) * mean) can have a significant performance impact?

Also --is there a Theano equivalent to "tf.nn.batch_normalization(x, mean,
std, beta, gamma, epsilon)" (simply application of already computer
quantities to normalize a batch)?
On 14 July 2016 at 12:00, Frédéric Bastien<EMAIL_ADDRESS>wrote:

Just a comment, cuDNN v4 and v5 have different interface. In Theano we only
wrapped v5 and so have that interface.
Documentation:
http://deeplearning.net/software/theano_versions/dev/library/sandbox/cuda/dnn.html#batch-normalization
On Thu, Jul 14, 2016 at 2:25 PM, François Chollet <
<EMAIL_ADDRESS>wrote:

Currently Keras implements its own batchnorm system "manually", i.e. by
creating update ops to maintain exponential averages of relevant
statistics. However batchnorm ops are available natively in TF, and now
Theano, which wrap the more efficient cuDNN implementation when
available.
We should consider creating a batchnorm op in the Keras backend, which
would wrap the TF and Theano implementations, and thus leverage cuDNN
when
available.
Anyone interested in making a valuable contribution to Keras is welcome
to
look into this.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/fchollet/keras/issues/3227, or mute the thread
<
https://github.com/notifications/unsubscribe/AALC-4TW_3bkpU58nyAd1vxxKi_zlUZZks5qVn8zgaJpZM4JMtog
.

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/fchollet/keras/issues/3227#issuecomment-232760305,
or mute the thread
https://github.com/notifications/unsubscribe/AArWb_z_EkVRcZar7FlOzSj5UZbstA06ks5qVodLgaJpZM4JMtog
.

It is an amazing task to enhance Keras more compatible with cuDNN. I will
keep testing the updating codes and try to post my comments if it is
necessary.
On Thu, Jul 14, 2016 at 5:18 PM François Chollet<EMAIL_ADDRESS>wrote:

Also --is there a Theano equivalent to "tf.nn.batch_normalization(x, mean,
std, beta, gamma, epsilon)" (simply application of already computer
quantities to normalize a batch)?
On 14 July 2016 at 12:00, Frédéric Bastien<EMAIL_ADDRESS>wrote:

Just a comment, cuDNN v4 and v5 have different interface. In Theano we
only
wrapped v5 and so have that interface.
Documentation:

http://deeplearning.net/software/theano_versions/dev/library/sandbox/cuda/dnn.html#batch-normalization

On Thu, Jul 14, 2016 at 2:25 PM, François Chollet <
<EMAIL_ADDRESS>wrote:

Currently Keras implements its own batchnorm system "manually", i.e. by
creating update ops to maintain exponential averages of relevant
statistics. However batchnorm ops are available natively in TF, and now
Theano, which wrap the more efficient cuDNN implementation when
available.
We should consider creating a batchnorm op in the Keras backend, which
would wrap the TF and Theano implementations, and thus leverage cuDNN
when
available.
Anyone interested in making a valuable contribution to Keras is welcome
to
look into this.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/fchollet/keras/issues/3227, or mute the thread
<

https://github.com/notifications/unsubscribe/AALC-4TW_3bkpU58nyAd1vxxKi_zlUZZks5qVn8zgaJpZM4JMtog

.

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/fchollet/keras/issues/3227#issuecomment-232760305,
or mute the thread
<
https://github.com/notifications/unsubscribe/AArWb_z_EkVRcZar7FlOzSj5UZbstA06ks5qVodLgaJpZM4JMtog
.

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/fchollet/keras/issues/3227#issuecomment-232795293,
or mute the thread
https://github.com/notifications/unsubscribe/ACchnYZa57Mon9arrA3qtfBS0-V8o5p-ks5qVqeHgaJpZM4JMtog
.

--
Sungjin (James) Kim, PhD
Postdoc, CCB in Harvard
<EMAIL_ADDRESS>[Web] http://aspuru.chem.harvard.edu/james-sungjin-kim/
[Linkedin] https://www.linkedin.com/in/jamessungjinkim
[Facebook] https://www.facebook.com/jamessungjin.kim
[alternative email]<EMAIL_ADDRESS>

Just FYI I'm about to push a refactor of batch norm which leverages
tf.nn.batch_normalization and seems to be incrementally faster with TF. On
the Theano side, it is functionally equivalent to the way it was working
before. The refactor also makes it easier to incorporate a manual call to
cuDNN in a future update.
After this refactor, I suggest that you look specifically at how to use
cuDNN on the Theano side.
On 14 July 2016 at 15:02, Sungjin Kim<EMAIL_ADDRESS>wrote:

It is an amazing task to enhance Keras more compatible with cuDNN. I will
keep testing the updating codes and try to post my comments if it is
necessary.
On Thu, Jul 14, 2016 at 5:18 PM François Chollet<EMAIL_ADDRESS>
wrote:

Also --is there a Theano equivalent to "tf.nn.batch_normalization(x,
mean,
std, beta, gamma, epsilon)" (simply application of already computer
quantities to normalize a batch)?
On 14 July 2016 at 12:00, Frédéric Bastien<EMAIL_ADDRESS>wrote:

Just a comment, cuDNN v4 and v5 have different interface. In Theano we
only
wrapped v5 and so have that interface.
Documentation:

http://deeplearning.net/software/theano_versions/dev/library/sandbox/cuda/dnn.html#batch-normalization

On Thu, Jul 14, 2016 at 2:25 PM, François Chollet <
<EMAIL_ADDRESS>wrote:

Currently Keras implements its own batchnorm system "manually", i.e.
by
creating update ops to maintain exponential averages of relevant
statistics. However batchnorm ops are available natively in TF, and
now
Theano, which wrap the more efficient cuDNN implementation when
available.
We should consider creating a batchnorm op in the Keras backend,
which
would wrap the TF and Theano implementations, and thus leverage cuDNN
when
available.
Anyone interested in making a valuable contribution to Keras is
welcome
to
look into this.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/fchollet/keras/issues/3227, or mute the thread
<

https://github.com/notifications/unsubscribe/AALC-4TW_3bkpU58nyAd1vxxKi_zlUZZks5qVn8zgaJpZM4JMtog

.

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
<https://github.com/fchollet/keras/issues/3227#issuecomment-232760305
,
or mute the thread
<

https://github.com/notifications/unsubscribe/AArWb_z_EkVRcZar7FlOzSj5UZbstA06ks5qVodLgaJpZM4JMtog

.

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/fchollet/keras/issues/3227#issuecomment-232795293,
or mute the thread
<
https://github.com/notifications/unsubscribe/ACchnYZa57Mon9arrA3qtfBS0-V8o5p-ks5qVqeHgaJpZM4JMtog
.

--
Sungjin (James) Kim, PhD
Postdoc, CCB in Harvard
<EMAIL_ADDRESS>[Web] http://aspuru.chem.harvard.edu/james-sungjin-kim/
[Linkedin] https://www.linkedin.com/in/jamessungjinkim
[Facebook] https://www.facebook.com/jamessungjin.kim
[alternative email]<EMAIL_ADDRESS>—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/fchollet/keras/issues/3227#issuecomment-232805818,
or mute the thread
https://github.com/notifications/unsubscribe/AArWbxQoE-4stPG4P-GE905dyMRCWgBsks5qVrH5gaJpZM4JMtog
.

It has been pushed btw.
On 14 July 2016 at 15:07, François Chollet<EMAIL_ADDRESS>wrote:

Just FYI I'm about to push a refactor of batch norm which leverages
tf.nn.batch_normalization and seems to be incrementally faster with TF. On
the Theano side, it is functionally equivalent to the way it was working
before. The refactor also makes it easier to incorporate a manual call to
cuDNN in a future update.
After this refactor, I suggest that you look specifically at how to use
cuDNN on the Theano side.
On 14 July 2016 at 15:02, Sungjin Kim<EMAIL_ADDRESS>wrote:

It is an amazing task to enhance Keras more compatible with cuDNN. I will
keep testing the updating codes and try to post my comments if it is
necessary.
On Thu, Jul 14, 2016 at 5:18 PM François Chollet <
<EMAIL_ADDRESS>wrote:

Also --is there a Theano equivalent to "tf.nn.batch_normalization(x,
mean,
std, beta, gamma, epsilon)" (simply application of already computer
quantities to normalize a batch)?
On 14 July 2016 at 12:00, Frédéric Bastien<EMAIL_ADDRESS>wrote:

Just a comment, cuDNN v4 and v5 have different interface. In Theano we
only
wrapped v5 and so have that interface.
Documentation:

http://deeplearning.net/software/theano_versions/dev/library/sandbox/cuda/dnn.html#batch-normalization

On Thu, Jul 14, 2016 at 2:25 PM, François Chollet <
<EMAIL_ADDRESS>wrote:

Currently Keras implements its own batchnorm system "manually",
i.e. by
creating update ops to maintain exponential averages of relevant
statistics. However batchnorm ops are available natively in TF, and
now
Theano, which wrap the more efficient cuDNN implementation when
available.
We should consider creating a batchnorm op in the Keras backend,
which
would wrap the TF and Theano implementations, and thus leverage
cuDNN
when
available.
Anyone interested in making a valuable contribution to Keras is
welcome
to
look into this.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/fchollet/keras/issues/3227, or mute the thread
<

https://github.com/notifications/unsubscribe/AALC-4TW_3bkpU58nyAd1vxxKi_zlUZZks5qVn8zgaJpZM4JMtog

.

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
<https://github.com/fchollet/keras/issues/3227#issuecomment-232760305
,
or mute the thread
<

https://github.com/notifications/unsubscribe/AArWb_z_EkVRcZar7FlOzSj5UZbstA06ks5qVodLgaJpZM4JMtog

.

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/fchollet/keras/issues/3227#issuecomment-232795293,
or mute the thread
<
https://github.com/notifications/unsubscribe/ACchnYZa57Mon9arrA3qtfBS0-V8o5p-ks5qVqeHgaJpZM4JMtog
.

--
Sungjin (James) Kim, PhD
Postdoc, CCB in Harvard
<EMAIL_ADDRESS>[Web] http://aspuru.chem.harvard.edu/james-sungjin-kim/
[Linkedin] https://www.linkedin.com/in/jamessungjinkim
[Facebook] https://www.facebook.com/jamessungjin.kim
[alternative email]<EMAIL_ADDRESS>—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/fchollet/keras/issues/3227#issuecomment-232805818,
or mute the thread
https://github.com/notifications/unsubscribe/AArWbxQoE-4stPG4P-GE905dyMRCWgBsks5qVrH5gaJpZM4JMtog
.

Main TODO would be to use cuDNN here when available: https://github.com/fchollet/keras/blob/master/keras/backend/theano_backend.py#L289

Great, I appreciate it.
On Thu, Jul 14, 2016 at 8:06 PM François Chollet<EMAIL_ADDRESS>wrote:

Main TODO would be to use cuDNN here when available:
https://github.com/fchollet/keras/blob/master/keras/backend/theano_backend.py#L289
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/fchollet/keras/issues/3227#issuecomment-232826991,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ACchnTdAJrCwWl9pnSJ4Y6Vio72Tf5v3ks5qVs7_gaJpZM4JMtog
.

--
Sungjin (James) Kim, PhD
Postdoc, CCB in Harvard
<EMAIL_ADDRESS>[Web] http://aspuru.chem.harvard.edu/james-sungjin-kim/
[Linkedin] https://www.linkedin.com/in/jamessungjinkim
[Facebook] https://www.facebook.com/jamessungjin.kim
[alternative email]<EMAIL_ADDRESS>

Do we have to write the batch-normalization equation manually in theano? I found implementation of bn pre-built in theano (ref: http://deeplearning.net/software/theano/library/tensor/nnet/bn.html). We have to pass arguments only I think so.

@shashankg7: Thanks for pointing this out. It does appear to be more efficient. I have patched the Theano backend to use this.

@fchollet : Sure, I am happy to help. Do you have any other similar issues in keras which require modifying theano backend? I am looking to contribute in theano based libraries and keras looks like the right place.

@shashankg7: absolutely. Consider investigating how to support multi-gpu training in Theano with Keras. It's currently possible in TF using the tf.device() scop API, but not in Theano. A unified API to do multi-GPU training in both backends would be great.

Theano supports multiple GPUs, its not just easy as the scope API of tensorflow. http://deeplearning.net/software/theano/tutorial/using_multi_gpu.html

@fchollet : Sure, will look into it. @farizrahman4u : I agree, it would not be as easy as in TF, but I'll try to figure something out.

http://deeplearning.net/software/theano/library/tensor/nnet/bn.html won't
use cudnn batch norm. They have different interface.
So if you want the fastest speed, if
theano.config.device.startswith('gpu'), you should use the cudnn batch norm
op.
On Sat, Jul 16, 2016 at 7:09 PM, Shashank Gupta<EMAIL_ADDRESS>wrote:

@fchollet https://github.com/fchollet : Sure, will look into it.
@farizrahman4u https://github.com/farizrahman4u : I agree, it would not
be as easy as in TF, but I'll try to figure something out.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/fchollet/keras/issues/3227#issuecomment-233155869,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AALC-2fwfUDVrGQ0Hu_4wrB_hUKDU4YTks5qWWSlgaJpZM4JMtog
.

Hello all,
Any luck with multi-GPU training?
Looking at what an implementation for both backends would like like:

A little hacky but straightforward: Device names need to be discovered so to be passed to the device() function for TF and to the "contexts" Theano flag/map. The dbus library and a little hacky parsing can do this.

Problem: one has to choose which GPU to assign subfunctions of a function. There is no scheduler that does this automatically. So one needs knowledge of the relative amount of resources subfunctions require to utilize multiple GPUs to their full capacities, making a general API difficult to attain. Though, simply cycling through devices as sub functions are built may be sufficient for a significant performance improvement from multiple GPUs (depends on the relative cost of transfers). Alternatively, this paper that I happen to be reading lately got some success from alternating layers on two GPUs but that was 8 years go: http://ronan.collobert.com/pub/matos/2008_nlp_icml.pdf

@fchollet , do you think this would be worth experimenting to see if simply cycling through devices when creating subfunctions or layers is a good stop-gap solution? Alternatively we could train different models on different GPUs. This obviously wouldn't improve training time for a single model but would provide a lot of value to rapid prototyping and tuning hyperparameters.
Regards, Buruk

Closing this issue as the batchnorm implemented now is efficient, and multi-gpu training likely won't be implemented for Theano since Theano is close to "end of life". Cf https://groups.google.com/forum/#!msg/theano-users/7Poq8BZutbY/rNCIfvAEAwAJ


Add hint for missing method error for dictionary where a field with a function is present

Based on a suggestion in #1916

Thanks!


Recursive inline saving

The result of saving a workflow with a subworkflow with inline steps has ugly ids and outputSources:
  align-texts-wf:
    run:
      cwlVersion: v1.0
      class: Workflow
      requirements:
      - class: ScatterFeatureRequirement
      inputs:
      - type:
        - 'null'
        - string
        id: _:align-texts-wf#align_c
      - type:
        - 'null'
        - string
        id: _:align-texts-wf#align_m
      - type:
          type: array
          items: File
        id: _:align-texts-wf#gs
      - type:
          type: array
          items: File
        id: _:align-texts-wf#ocr
      outputs:
      - type:
          items: File
          type: array
        outputSource: file:///home/jvdzwaan/code/ocr/cwl/align-texts-wf.cwl#char-align/out_file
        id: _:align-texts-wf#alignments
      - type: File
        outputSource: file:///home/jvdzwaan/code/ocr/cwl/align-texts-wf.cwl#merge-json-1/merged
        id: _:align-texts-wf#changes
      - type: File
        outputSource: file:///home/jvdzwaan/code/ocr/cwl/align-texts-wf.cwl#merge-json/merged
        id: _:align-texts-wf#metadata

Also the problem of duplicate ids arises if a subworkflow is added multiple times (related to #82).

Unfortunately, cwltool will insert URLs if you don't supply a URI yourself. The _: thing is a JSON-LD local identifier, which is accepted by cwltool and not replaced, and at least avoids having absolute file paths in there.
I agree that it's ugly though :).

Actually, the problem isn't so much that it is ugly (although that definitely is a problem!), it also doesn't work:
../../code/ocr/cwl/vudnc-preprocess.cwl:38:1: checking field `steps`
../../code/ocr/cwl/vudnc-preprocess.cwl:374:3:   checking object `../../code/ocr/cwl/vudnc-preprocess.cwl#align-texts-wf`
../../code/ocr/cwl/vudnc-preprocess.cwl:409:7:     checking field `steps`
../../code/ocr/cwl/vudnc-preprocess.cwl:410:9:       checking object `../../code/ocr/cwl/align-texts-wf.cwl#align`
../../code/ocr/cwl/vudnc-preprocess.cwl:443:9:         checking field `in`
../../code/ocr/cwl/vudnc-preprocess.cwl:444:11:           checking object `../../code/ocr/cwl/align-texts-wf.cwl#align/file1`
../../code/ocr/cwl/vudnc-preprocess.cwl:444:11:             Field `source` references unknown identifier `file:///home/jvdzwaan/code/ocr/cwl/align-texts-wf.cwl#ocr`, tried file:///home/jvdzwaan/code/ocr/cwl/align-texts-wf.cwl#file:///home/jvdzwaan/code/ocr/cwl/align-texts-wf.cwl#ocr

It seems that removing all the source fields (in the subworkflow) fixes the errors!

In the documentation, we recommend not using inline saving if you use subworkflows: http://scriptcwl.readthedocs.io/en/stable/saving_workflows.html#embedding-steps-in-the-workflow


error occurred during the pre-login handshake error:success

Hi,
maybe someone here can enlighten me, i receive once or twice in a day the following messages (lets say 1\100000 calls):
A connection was successfully established with the server, but then an error occurred during the pre-login handshake. (provider: TCP Provider, error: 0 - Success)
or
A connection was successfully established with the server, but then an error occurred during the pre-login handshake. (provider: TCP Provider, error: 0 - Unknown error)
The service running on Linux machine in a docker container (Rancher) and making calls to mssql 2016, i do know that the call is not completed and there is an error, it's just that "success"  doesn't tell me much about how to solve it...
i randomly get that from all my services..

no pod restarts
I have no events correlating in the DB servers

and have rad the whole internet and usually the error is more informative in other people posts...
can someone help me here?

Which client version??

@ErikEJ System.Data.SqlClient, Version=<IP_ADDRESS>

@RagingPuppies Can I ask for detail? What version of netcore is installed on your machine? we did have some similar issues in the past.

@JRahnama  yeah sure,
Machine Ubuntu 18.04 with Kubernetes v1.17.2
Docker: 5:18.09
Container with .netcore 3.1
Windows 2016 with MSSQL 2016 CU7 (13.0.5337.0)
anything else?

@RagingPuppies Thanks for the quick response. If possible, have you tried using the latest version of System.Data.SqlClient or  Microsoft.Data.SqlClient V<IP_ADDRESS>? Also one last thing, is it possible to share us a repro of your code? we will try to reproduce the issue here and follow from there.

@JRahnama
i would also like to add the it happens for 2 sec several time while we have heavy load  on our servers, 2.
you can use the following to repreduce
`async Task<List> ICurrenciesDal.GetCurrencies()
{
List result = new List();
        IBaseDal thisIBaseDal = this as IBaseDal;

        using (SqlConnection conn = new SqlConnection(thisIBaseDal.ConnectionString))
        {
            DynamicParameters parameters = new DynamicParameters();

            ErrorDbParameters.AddErrorDbParams(parameters);

            CommandDefinition command = new CommandDefinition(GET_CURRENCIES_STORED_PROCEDURE_NAME, parameters, commandType: CommandType.StoredProcedure);

            using (var reader = await conn.ExecuteReaderAsync(command))
            {
                while (await reader.ReadAsync())
                {
                    CurrenciesDO plRowData = await GetDataFromReader(reader);

                    result.Add(plRowData);
                }
            }

           ErrorDbParameters.ValidateErrorDbParams(parameters, new int[] { ErrorCodes.ERROR_GENERAL_NOROWS });
        }

        return result;
    }

`

@RagingPuppies based on the sample code you sent me I made an application and let it ran for a dayand a night, could not see the issue happening. Is it possible for you to run your application with Microsoft.Data.Sqlclient V2.0.0 or the latest preview ( we do not have that support in System.Data.Sqlclient) and run PerfView on your Windows container to capture EventSource Traces for Microsoft.Data.SqlClient.EventSource? This could be done either in command line or interface. If the answer is yes,
you need to run the command as perfview /onlyProviders=*Microsoft.Data.SqlClient.EventSource run <Your_Application.exe>
and set the path to the folder that has the executive file of your project.
you either can generate a secrete gist and send me the link in a private conversation if you are concerned about your information or even easier email me the link or the file itself.
Doing this will give us more information about the issue and its occurrences.

So the error code was solved, it was a network component (linkerd) answering to tcp even tho the sqlserver is not responding, skipping sql port will reveal the true error... Thank you all

@RagingPuppies I am glad the issue is resolved. Feel free to close the issue if there is no related topic to discuss here.


Address ScientificTypes renaming

Addressing fail in PR #137 , which is unrelated to the changes in that PR
@lhnguyen-vn

Codecov Report

Merging #138 (a534aa6) into dev (17aa6c5) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##              dev     #138   +/-   ##
=======================================
  Coverage   86.94%   86.94%
=======================================
  Files          11       11
  Lines         590      590
=======================================
  Hits          513      513
  Misses         77       77

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 17aa6c5...a534aa6. Read the comment docs.


(picard) Pop-up during update

The pop-up appears on update

Its even worse then that, if you click OK then it will just uninstall it and not run itself again.
This means that uninstallation must be done prior to installation (even with no update as cinst -f also fails)


Update Kiosk app with latest version of Pigeon Deliverance?

Hey, can we update the Kiosk gamelist.json file with the latest version of the Pigeon game?
Was going to have the hackathon folks play some of these games...
Thx!

@Jaqster I'm not sure how important this is anymore and am unsure what the latest version looks like, but this might be as simple as updating where the kiosk is pointing for the root, as long as gameIds stay the same. Currently, it is hitting v1.9 of arcade. I am planning on updating this soon.

@riknoll is there a latest version? If yes send to @srietkerk . I am closing this from tracking now.


fix(Locomotion): set position offset with rotation on dash teleport

The DashTeleport script was putting the play area into the incorrect
position if dash also had a rotation applied because the rotation
would affect the headset compensation.
This fix recalculates the position based on the headset offset and
the target rotation.

Superseded by https://github.com/thestonefox/VRTK/pull/1405


Dependency conflicts on com.fasterxml.jackson.core:jackson-core:jar, causing inconsisitent semantic behaviors

Hi, there are multiple versions of com.fasterxml.jackson.core:jackson-core:jar in DependencyCheck-v5.0.0-M1 (DependencyCheck-4.0.2\maven\src\it\629-jackson-dataformat module). As shown in the following dependency tree, according to Maven's dependency management strategy, only com.fasterxml.jackson.core:jackson-core:jar:2.4.5 can be loaded, and com.fasterxml.jackson.core:jackson-core:jar:2.8.9 will be shadowed.
Your project references the method <com.fasterxml.jackson.core.json.ReaderBasedJsonParser: com.fasterxml.jackson.core.JsonLocation   getTokenLocation()> via the following invocation path, which is included in the shadowed version com.fasterxml.jackson.core:jackson-core:jar:2.8.9. However, this method is missing in the actual loaded version com.fasterxml.jackson.core:jackson-core:jar:2.4.5. Surprisingly, it will not cause NoSuchMethodError at rumtime.
<com.fasterxml.jackson.databind.DeserializationContext: com.fasterxml.jackson.databind.JsonMappingException weirdKeyException(java.lang.Class,java.lang.String,java.lang.String)> C:\Users\Flipped\.m2\repository\com\fasterxml\jackson\core\jackson-databind\2.8.9\jackson-databind-2.8.9.jar
<com.fasterxml.jackson.databind.exc.InvalidFormatException: com.fasterxml.jackson.databind.exc.InvalidFormatException 'from'(com.fasterxml.jackson.core.JsonParser,java.lang.String,java.lang.Object,java.lang.Class)> C:\Users\Flipped\.m2\repository\com\fasterxml\jackson\core\jackson-databind\2.8.9\jackson-databind-2.8.9.jar
<com.fasterxml.jackson.core.json.ReaderBasedJsonParser: com.fasterxml.jackson.core.JsonLocation getTokenLocation()>

By further analyzing, I found that the caller <com.fasterxml.jackson.databind.DeserializationContext. weirdKeyException(Class, String, String)> would invoke the method ParserBase.getTokenLocation() defined in the superclass of ReaderBasedJsonParser (ReaderBasedJsonParser extends ParserBase) with the same signature of the expected callee, due to dynamic binding mechanism.
Although the actual invoked method belonging to ParserBase has the same method name, same parameter types and return type as the expected method defined in its subclass ReaderBasedJsonParser, but it has different control flows and different behaviors. Maybe it is buggy behavior.
Solution:
Use the newer version com.fasterxml.jackson.core:jackson-core:jar:2.8.9 to keep the version consistency.
Dependency Tree----
[INFO] --- maven-dependency-plugin:2.8:tree (default-cli) @ test-dataformat-jackson ---
[INFO] org.owasp.test:test-dataformat-jackson:jar:1.0.0-SNAPSHOT
[INFO] +- com.fasterxml.jackson.core:jackson-databind:jar:2.4.5:compile
[INFO] |  +- (com.fasterxml.jackson.core:jackson-annotations:jar:2.4.0:compile - omitted for conflict with 2.4.5)
[INFO] |  - com.fasterxml.jackson.core:jackson-core:jar:2.4.5:compile
[INFO] +- com.fasterxml.jackson.core:jackson-annotations:jar:2.4.5:compile
[INFO] +- com.fasterxml.jackson.dataformat:jackson-dataformat-cbor:jar:2.4.5:compile
[INFO] |  - (com.fasterxml.jackson.core:jackson-core:jar:2.4.5:compile - omitted for duplicate)
[INFO] +- com.fasterxml.jackson.dataformat:jackson-dataformat-xml:jar:2.4.5:compile
[INFO] |  +- (com.fasterxml.jackson.core:jackson-core:jar:2.4.5:compile - omitted for duplicate)
[INFO] |  +- (com.fasterxml.jackson.core:jackson-annotations:jar:2.4.0:compile - omitted for conflict with 2.4.5)
[INFO] |  +- (com.fasterxml.jackson.core:jackson-databind:jar:2.4.5:compile - omitted for duplicate)
[INFO] |  +- com.fasterxml.jackson.module:jackson-module-jaxb-annotations:jar:2.4.5:compile
[INFO] |  |  +- (com.fasterxml.jackson.core:jackson-core:jar:2.4.5:compile - omitted for duplicate)
[INFO] |  |  - (com.fasterxml.jackson.core:jackson-databind:jar:2.4.5:compile - omitted for duplicate)
[INFO] |  - org.codehaus.woodstox:stax2-api:jar:3.1.4:compile
[INFO] +- com.fasterxml.jackson.module:jackson-module-kotlin:jar:2.8.9:compile
[INFO] |  +- (com.fasterxml.jackson.core:jackson-databind:jar:2.8.9:compile - omitted for conflict with 2.4.5)
[INFO] |  +- (com.fasterxml.jackson.core:jackson-annotations:jar:2.8.0:compile - omitted for conflict with 2.4.5)
[INFO] |  - org.jetbrains.kotlin:kotlin-reflect:jar:1.1.1:compile
[INFO] |     - org.jetbrains.kotlin:kotlin-stdlib:jar:1.1.1:compile
[INFO] |        - org.jetbrains:annotations:jar:13.0:compile
[INFO] +- com.fasterxml.jackson.dataformat:jackson-dataformat-ion:jar:2.8.9:compile
[INFO] |  +- software.amazon.ion:ion-java:jar:1.0.2:compile
[INFO] |  +- (com.fasterxml.jackson.core:jackson-annotations:jar:2.8.0:compile - omitted for conflict with 2.4.5)
[INFO] |  +- (com.fasterxml.jackson.core:jackson-core:jar:2.8.9:compile - omitted for conflict with 2.4.5)
[INFO] |  - (com.fasterxml.jackson.core:jackson-databind:jar:2.8.9:compile - omitted for conflict with 2.4.5)
[INFO] +- com.fasterxml.jackson.datatype:jackson-datatype-hppc:jar:2.8.9:compile
[INFO] |  +- (com.fasterxml.jackson.core:jackson-core:jar:2.8.9:compile - omitted for conflict with 2.4.5)
[INFO] |  +- (com.fasterxml.jackson.core:jackson-databind:jar:2.8.9:compile - omitted for conflict with 2.4.5)
[INFO] |  - com.carrotsearch:hppc:jar:0.7.1:compile
[INFO] - com.fasterxml.jackson.jaxrs:jackson-jaxrs-yaml-provider:jar:2.8.9:compile
[INFO]    +- com.fasterxml.jackson.jaxrs:jackson-jaxrs-base:jar:2.8.9:compile
[INFO]    |  +- (com.fasterxml.jackson.core:jackson-core:jar:2.8.9:compile - omitted for conflict with 2.4.5)
[INFO]    |  - (com.fasterxml.jackson.core:jackson-databind:jar:2.8.9:compile - omitted for conflict with 2.4.5)
[INFO]    +- (com.fasterxml.jackson.core:jackson-core:jar:2.8.9:compile - omitted for conflict with 2.4.5)
[INFO]    +- (com.fasterxml.jackson.core:jackson-databind:jar:2.8.9:compile - omitted for conflict with 2.4.5)
[INFO]    +- com.fasterxml.jackson.dataformat:jackson-dataformat-yaml:jar:2.8.9:compile
[INFO]    |  +- (com.fasterxml.jackson.core:jackson-core:jar:2.8.9:compile - omitted for conflict with 2.4.5)
[INFO]    |  - org.yaml:snakeyaml:jar:1.17:compile
[INFO]    - (com.fasterxml.jackson.module:jackson-module-jaxb-annotations:jar:2.8.9:compile - omitted for conflict with 2.4.5)
Thanks!
Best regards,
Coco

The code snippet of <com.fasterxml.jackson.core.json.ReaderBasedJsonParser: com.fasterxml.jackson.core.JsonLocation getTokenLocation()> in verison com.fasterxml.jackson.core:jackson-core:jar:2.8.9 ----

com.fasterxml.jackson.core:jackson-core:jar:2.4.5 does not contain <com.fasterxml.jackson.core.json.ReaderBasedJsonParser: com.fasterxml.jackson.core.JsonLocation getTokenLocation()>.
The code snippet of <com.fasterxml.jackson.core.json.ParserBase: com.fasterxml.jackson.core.JsonLocation getTokenLocation()> in version com.fasterxml.jackson.core:jackson-core:jar:2.4.5----
The method  ReaderBasedJsonParser.getTokenLocation()  included in newer verison 2.8.9 deals with more cases and adds more control branches, which changes the control flows and data flows. So referencing ParserBase.getTokenLocation() in version 2.4.5 by
dynamic binding, may lead to inconsisitent semantic behaviors.
Thanks again.

May I pull a request to fix it?

Yes - PRs are always welcome.
Thanks!

So I think there might be some confusion with regard to this.  maven\src\it\629-jackson-dataformat is an integration test. The dependencies in this have absolutely nothing to do with the functionality within dependency-check. This integration test exists to identify if dependency-check can correctly identify the CVEs associated with jackson-dataformat.
Running mvn dependency:tree shows that there is no dependency on jackson in the core project.


Use all event metadata attributes in trigger filters

Example: I'm using Kafka and routing events across different topics. I want to use event types com.myshop.order.new and com.myshop.order.cancelled and i have some filtering logic in place already for this, e.g. those events go to different Kafka topics and are transformed a certain way.
Now I also want to start routing orders depending on their region or category. I'd like to add new CE metadata extensions category and region and then use then in filters.
Solution idea (including ideas from https://github.com/triggermesh/tmctl/issues/215): tmctl create trigger --filter "{"suffix": {"extension-category": "books"}}"

As discussed today, my use case is a workaround that would be solved by content-based filtering, so we might hold on on this while we wait for content-based filtering.

I'm finding some solutions by using versioned cloud event types, e.g. "orders-us-electronics-v1", and then "orders-us-electronics-v2"
But this also has me thinking of use cases in which I might want to route events to different places depending on their version. For example, we can route new versions of events to new versions of consumers, but old versions of consumers can keep receiving the previous version of events.
For this being able to filter on an event version metadata attribute would be powerful. So I can subscribe to event type "com.myshop.order.new" and version "v2", without having to modify the event type to "com.myshop.order.new-v1" to achieve this. Again seems to provide extra evolvability.

Adding to previous comment, we could even imagine that a transformation automatically updates the version number of an event. Any routing built on just the event type is not impacted, but those that want to start routing and consuming specific versions of events (e.g. before or after transformation) can create triggers specifically for that.
Even if transformations don't do automatic version updates, I can try to write them in as part of the transformation (but it would be hacky because there isn't an increment / arithmetic function).


incorrectly labels normal epithelial cells as tumor cells

Dear developers,
I'm testing ikarus using data (KUL3-21N and KUL3-21T) from "Lee, Hae-Ock, et al. "Lineage-dependent gene expression programs influence the immune landscape of colorectal cancer." Nature Genetics 52.6 (2020): 594-603."
I noticed that when I used normal samples, ikarus still labels normal epithelial cells as tumor cells, any suggestions for that?
The analysis can be found in https://github.com/neil-n-zhang/ikarus_LeeCRC/tree/main/code
Thanks so much!
Neil

Hi Neil
Does it label all of them as tumor or some of them?
On Thu, Jul 7, 2022 at 12:05 AM Neil Zhang @.***> wrote:

Dear developers,
I'm testing ikarus using data from "Lee, Hae-Ock, et al.
"Lineage-dependent gene expression programs influence the immune landscape
of colorectal cancer." Nature Genetics 52.6 (2020): 594-603."
I noticed that when I used normal samples, ikarus still labels normal
epithelial cells as tumor cells, any suggestions for that?
The analysis can be found in
https://github.com/neil-n-zhang/ikarus_LeeCRC/tree/main/code
Thanks so much!
Neil
—
Reply to this email directly, view it on GitHub
https://github.com/BIMSBbioinfo/ikarus/issues/13, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAE32EKKENCYIZ4QURPNGTDVSX7MHANCNFSM523JGZXQ
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

--
Sent from mobile, excuse the brevity

Hi @al2na , it labels all normal epithelial cells as tumor, the non-epithelial cells as normal.
Hi @frenkiboy, thanks so much for your reply and looking forward to the updates.
Two more suggestion: 1. From the paper, I saw you tested ikarus using healthy PBMC samples. It will be better to also add the specificity test using normal epithelial cells. It will help us make sure we have a tumor cells classifier rather than general epithelial cells classifier. 2. Even for the epithelial cells from the tumor, there are some normal epithelial cells. It may be better to only use the cells with high cancer hallmark scores as tumor cells during training.
Thanks so much!
Neil

Hey Neil,
I completely agree with you! We actually planned to test it on normal
epithelial cells, however,
we ended up testing it on a visium breast cancer sample provided by 10x,
and it performed quite well.
This part didn't end up in the paper, but should be in the response to the
reviewers.
Unfortunately, by the end , we were lacking manpower to push additional
analysis.
In general, the intuition we have now is that indirectly we are indirectly
measuring genetic changes - regions
that are common copy number aberrations across cancers, which would imply
that the method should
discriminate normal epithelial from cancer cells (there is always the
possibility that some of the epithelial lineages have genetic
abnormalities).
In a recent talk Christina Curtis showed quite convincing data that gastric
cancer epithelial cells evolve through
deterministic genetic changes (chromosome rearrangements/gain/loss), which
makes me a bit more confident that
pan cancer type genetic aberrations might not be so uncommon (of course,
constrained by the developmental lineage).
On Thu, Jul 7, 2022 at 7:34 PM Neil Zhang @.***> wrote:

Hi @al2na https://github.com/al2na , it labels all normal epithelial
cells as tumor, the non-epithelial cells as normal.
Hi @frenkiboy https://github.com/frenkiboy, thanks so much for your
reply and looking forward to the updates.
Two more suggestion: 1. From the paper, I saw you tested ikarus using
healthy PBMC samples. It will be better to also add the specificity test
using normal epithelial cells. It will help us make sure we have a tumor
cells classifier rather than general epithelial cells classifier. 2. Even
for the epithelial cells from the tumor, there are some normal epithelial
cells. It may be better to only use the cells with high cancer hallmark
scores as tumor cells during training.
Thanks so much!
Neil
—
Reply to this email directly, view it on GitHub
https://github.com/BIMSBbioinfo/ikarus/issues/13#issuecomment-1177976861,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAGY7CFHV3EIXRIHJP6EIUDVS4IJ7ANCNFSM523JGZXQ
.
You are receiving this because you were mentioned.Message ID:
@.***>

Thanks so much for the insights, I will close the issue for now. Looking forward to more ikarus updates in the future!

Hey Neil, I completely agree with you! We actually planned to test it on normal epithelial cells, however, we ended up testing it on a visium breast cancer sample provided by 10x, and it performed quite well. This part didn't end up in the paper, but should be in the response to the reviewers. Unfortunately, by the end , we were lacking manpower to push additional analysis. In general, the intuition we have now is that indirectly we are indirectly measuring genetic changes - regions that are common copy number aberrations across cancers, which would imply that the method should discriminate normal epithelial from cancer cells (there is always the possibility that some of the epithelial lineages have genetic abnormalities). In a recent talk Christina Curtis showed quite convincing data that gastric cancer epithelial cells evolve through deterministic genetic changes (chromosome rearrangements/gain/loss), which makes me a bit more confident that pan cancer type genetic aberrations might not be so uncommon (of course, constrained by the developmental lineage).
…
On Thu, Jul 7, 2022 at 7:34 PM Neil Zhang @.> wrote: Hi @al2na https://github.com/al2na , it labels all normal epithelial cells as tumor, the non-epithelial cells as normal. Hi @frenkiboy https://github.com/frenkiboy, thanks so much for your reply and looking forward to the updates. Two more suggestion: 1. From the paper, I saw you tested ikarus using healthy PBMC samples. It will be better to also add the specificity test using normal epithelial cells. It will help us make sure we have a tumor cells classifier rather than general epithelial cells classifier. 2. Even for the epithelial cells from the tumor, there are some normal epithelial cells. It may be better to only use the cells with high cancer hallmark scores as tumor cells during training. Thanks so much! Neil — Reply to this email directly, view it on GitHub <#13 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAGY7CFHV3EIXRIHJP6EIUDVS4IJ7ANCNFSM523JGZXQ . You are receiving this because you were mentioned.Message ID: @.>


Only 1x1 ration showing...

Hello, I only have the 1x1 flag appearing... Am I doing wrong? I am using angular 9:

       <span *ngFor="let lang of languages" (click)="frame.show()" class="flag-icon flag-icon-{{lang.isocode}}"></span>
I installed using standard npm install
Thanks.
UPDATE
I replaced the pics from the 3x4 folder into the 1x1 folder and now it work.. i have no idea why it charge the wrong folder....

this is what is generated for in my  in the inspector( AD for example)
.flag-icon-ad {   background-image: url('ad.svg'); } .flag-icon-ad.flag-icon-squared {   background-image: url('ad.svg'); }

Very random guess:
Do you use something like webpack and have it set up to e.g. store all assets in one directory like /filename.extension?hash=something?
Then you might be overwriting the 3x4 files with the 1x1 files on build as they have the same filename.

@Findus23 Thanks for you answer, the thing is I am not doing anything special: Angular 9 standard conf and material design. the only thing I have is the angular.json...

Inspect flag item and see the computed properties; I suppose there is strange behavior on background-size property.
I'm using ^3.4.6 version together Angular 9 without any issues.

Not a background property problem.. i try to deploy; all the ico are in the root folder :/

Very strange behavior; could you put a sample on plunker?

This is something that also happens to me. Using  "@angular/core": "~9.1.3" it gives the 1x1.
An example of the styles with the inspect element
.flag-icon-us {
    background-image: url(us.svg);
}

.flag-icon {
    background-size: contain;
    background-position: 50%;
    background-repeat: no-repeat;
    position: relative;
    display: inline-block;
    width: 1.33333333em;
    line-height: 1em;
}

I didn't add any custom style.

Very strange behavior; could you put a sample on plunker?

Never did that and didnt succefully put my whole project on it.

This is something that also happens to me. Using  "@angular/core": "~9.1.3" it gives the 1x1.
An example of the styles with the inspect element
.flag-icon-us {
    background-image: url(us.svg);
}

.flag-icon {
    background-size: contain;
    background-position: 50%;
    background-repeat: no-repeat;
    position: relative;
    display: inline-block;
    width: 1.33333333em;
    line-height: 1em;
}

I didn't add any custom style.

What OS are you using?

Very strange behavior; could you put a sample on plunker?

Never did that and didnt succefully put my whole project on it.

If you are able to reproduce the issue with "@angular/core": "~9.1.3"  you can create an empty project with a flag-icon-css package and sample.
Thank you.

Just deployed it, it's not a problem after a build...

Very strange behavior; could you put a sample on plunker?

Never did that and didnt succefully put my whole project on it.

This is something that also happens to me. Using  "@angular/core": "~9.1.3" it gives the 1x1.
An example of the styles with the inspect element
.flag-icon-us {
    background-image: url(us.svg);
}

.flag-icon {
    background-size: contain;
    background-position: 50%;
    background-repeat: no-repeat;
    position: relative;
    display: inline-block;
    width: 1.33333333em;
    line-height: 1em;
}

I didn't add any custom style.

What OS are you using?

I am using ubuntu. I didn't tried to build the project and see if it's somehow fixed, but while it is on serve, it is still showing as 1x1

@codevladimir Osx Here.
Anyway, would recommend not really taking care of it during dev since it work on deployment. you can replace put the content of 4X3 into 1X1 folder if you need to do css adjustments meawhile

Hi, I had the same issue and the problem comes from the fact that the structure of the icons is not kept during the compilation. "flags/1x1/ru.svg" and "flags/4x3/ru.svg" will both fo into the "dist" directory. The difference between dev and prod mode is that prod mode adds an hash to the filename, so there will be a "ru.foo.svg" and a "ru.bar.svg" while in dev it will be "ru.svg" for both and therefore, the second (so the 1x1, because is appears in second in the CSS) will override the first one.
So indeed, this issue only occurs in dev mode and has noting to do with this library :-) Can be closed in my opinion.
Cheers

Facing same issue but already read several SO posts regarding the problem and possible fix. As long as it is only in dev mode, it is okay I guess.

Was having the same issue, which led me to this solution when using this library with Angular during development (ng serve).
Add the following to your angular.json file under projects -> {{your project}} -> architect -> build -> options:
"outputHashing": "all"
and that should create the correct file hashes, which will give you separate 3x4 and 1x1 images.

I'm still running into this issue with Angular 11.0 when running in development mode, even when setting "outputHashing": "all".
Not sure if it was possible on earlier versions, but with 11.0 setting this option seems to be useless when running in dev mode:
Warning: 'outputHashing' option is disabled when using the dev-server.

I added the following script to my package json as a workaround:
{
  ...
  "scripts": {
    ...
    "postinstall": "rm -rf ./node_modules/flag-icon-css/flags/1x1 && cp -r ./node_modules/flag-icon-css/flags/4x3 ./node_modules/flag-icon-css/flags/1x1"
  },
  ...
}

It works, but I wouldn't really call it a solution.


hard negative dataset

is the dataset used in the hard negative commit changes available for download somewhere?
i'm assuming the MEDI instructions are different from the dataset originally released, since the eval instructions are different (e.g. dropping ; Input:)

Hi, the dataset with hard negative is now available for download here: https://drive.google.com/file/d/1_Ax8rTeeDKpNxj85LD2Yh7qsh3sYEiSH/view?usp=sharing
Thanks a lot for your interests! Feel free to leave your further questions!

thank you! great work with the paper :)


Remove version: CrystalDewWorld.CrystalDiskMark.ShizukuEdition version 8.0.4

[Automated] It returns code over 400 in all urls
Microsoft Reviewers: Open in CodeFlow

URL: - https://osdn.net/frs/redir.php?m=ipconnect&f=crystaldiskmark%2F75540%2FCrystalDiskMark8_0_4Shizuku.exe
Invalid URI: The URI scheme is not valid.
(Automated message - build 923)

Hi @Exorcism0666,
This manifest has the highest version number for this package. Is it available from another location? (This might be in error if the version is switching from semantic to string, or string to semantic.)
(Automated response - build 897.)


Reaching out for advice/opinions for superview.js incremental-dom template language

Forgive me posting here - I'm sure it's not the right forum. Please let me know where might be a good place to ask and I'll get it moved.
I wonder if anyone could offer their opinion on a how I should define static attributes values in the superviews.js template language I'm building.
Regular properties use single curly braces {} to define values.

I needed to distinguish statics and had settled upon {=} . This works ok for referencing simple values as in the first example in the list below, but I thought it didn't look great in the case where an assignment is made like the 6th example. This will define a static handler function against the onchange event. I thought having two equal signs looked a bit naff.
I've come up with some alternatives in the hope someone could offer some opinion/advice. :)
I've batted this round my head for a day or two but I'm not convinced by any of the options really, maybe I'm over thinking it? Aesthetically I like the greater than sign, semantically the hash sign given it has no special meaning in javascript (but html it does of course :( I have just realised).

data.title}">

<input type="text" value="{data.val}" onchange="{=data.val = this.value}">
<input type="text" value="{data.val}" onchange="={data.val = this.value}">
<input type="text" value="{data.val}" onchange="{>data.val = this.value}">
<input type="text" value="{data.val}" onchange="{#data.val = this.value}">
<input type="text" value="{data.val}" onchange="{{data.val = this.value}}">

When I was writing babel-plugin-incremental-dom, I decided to only promote literals (and the key attribute) to statics. Everything else get's set as a dynamic attribute.
Granted, I was a bit hamstrung by JSX's semantics. But it works well.

So you are saying don't worry about trying to distinguish statics at all? That solves all my problems.
I had thought about it but was concerned about losing any performance benefits of being able to define non-literal statics. Do you think they would be negligible benefits? (I haven't really tested the case and I'm only just starting to dig into the incremental-dom code to understand the mechanics)
Thanks for the input

Thanks for this. I went with your advice and only promoted literals to statics.


Daily Productivity Tip extension

The Daily Productivity Tip extension helps you boost your productivity by displaying a new, insightful productivity tip every day on your new tab page. Each tip is carefully selected to provide practical advice that can be easily implemented to improve your daily workflow and efficiency.
Features:
Daily Tip: Displays a new productivity tip each day to keep you motivated and on track.
Simple and Clean Design: The tips are presented in a user-friendly, aesthetically pleasing interface, making it easy to read and implement the advice.
Automatic Updates: The tip updates automatically every day without any need for user intervention.
Local Storage: Uses Chrome's local storage to remember the last tip displayed and ensures that you receive a fresh tip each day.
Motivational and Practical: Provides a mix of motivational quotes and practical tips to enhance your productivity.

@Sulagna-Dutta-Roy  please assign me this issue

Already added on my repository #257


Convert into a package

Move all functions into a package nwbpkg to clean-up namespace for use going forward.

https://github.com/schnitzer-lab/nwb_schnitzer_lab/pull/12
Close this issue once merged.


Ability score ordering

Fix for #6 .

It looks like the font on the image I provided is slightly different than the original image. Not sure if that's a platform/browser artifact or what.


Allow to fetch ALL artifacts

Since we cannot specify multiple artifacts to download, allow * to download all artifacts (behaviour described here: https://github.com/actions/download-artifact#download-all-artifacts)
This shouldn't break anything, but please double-check. Then, after the merge please rename get-all-artifacts to main in https://github.com/samply/beam/blob/main/.github/workflows/rust.yml

Why are you not merging, @torbrenner ?


aws sdk v2

this supersedes #6383  and #6349 (still including the same commits)
@blomquisg please review. If you want I can split it up into smaller PRs - but if you merge it, we can close the 2 PRs above

@miq-bot add_labels  enhancement, providers/amazon, technical debt

@miq-bot label_label wip
there are still two places in the code where sdk-v2 is used (in authenticator) - will remove that and open this PR again


SSH Command fails when pty input is set to "true"

ACTUAL BEHAVIOR:  The wrapper flow ssh_flow fails. When pty: "false" and the other inputs are the same, the run is successful.
The builder log writes: "DESCRIPTION=Post Input binding for operation/flow"
EXPECTED BEHAVIOR: ssh_flow runs successfully
HOW-TO-REPRODUCE:
Run ssh_flow.sl with cslang-builder (9.57) by setting the following inputs in a .inputs.yaml test:
inputs:

host: LINUX_HOST
port: "22"
username: root
password: *
command: echo testing
pty: "true"

ENVIRONMENT: (Hardware, OS, OS Version, Browser, etc)
Linux
NOTE The same issue was fixed for Studio content as #29414

A solution for this issue would be to write 'exit' at the end of the script when executed with pty set on true. Example:

echo testing
exit

When pty is set to true the channel used will not close automatically, so the operation times out because it waits for the channel to close. Appending 'exit' to your script will close the channel.

Closed in cloud-slang-content PR: https://github.com/CloudSlang/cloud-slang-content/pull/757
@mihaitusa Since this issue was fixed in the operation, can we close it? WDYT?


Add spin up for the Candidates number

Current the candidate's number in the stats card does not spin up as expected. Pls. help fix it.

its working like this already what's needs to be changed? @nmhung1210

/ 68 looks buggy


Variable-length structs

This may be a feature request as I couldn't find anything in the documentation about it. Does wil provide a way to deal with variable-length (or flexible array-member) structs like TOKEN_PRIVILEGES, ACE, TRACE_EVENT_INFO etc.?

I'm not entirely sure what you're looking for. If there's something specific that you're looking for, GitHub's search works decently well. Otherwise other search tools (e.g. VS Code) work pretty well also. E.g. searching TOKEN_PRIVILEGES will lead you to the token_helpers.h header.

Excuse me for being not more specific. I'm talking about replacing the following pattern:
ULONG bufferSize;
TdhGetEventInformation(event, 0, nullptr, nullptr, &bufferSize);
TRACE_EVENT_INFO* eventInfo = (TRACE_EVENT_INFO*)malloc(bufferSize);
TdhGetEventInformation(event, 0, nullptr, eventInfo, &bufferSize);

The malloc can be replaced by make_unique<byte[]>, but still requires casting and an additional variable to get the correct pointer type. A unique_pointer<TRACE_EVENT_INFO> requires a custom deleter and custom make functions taking the raw size. Since this pattern is so prevalent in the Windows SDK, I had thought or hoped wil might have something for this out-of-the-box.
I had already looked through the token_helpers.h header and only saw stuff for receiving token information. But when using e.g. AdjustTokenPrivileges, one has to allocate a variable-sized TOKEN_PRIVILEGES structure. Looking closer, get_token_information_nothrow goes through exactly those contortions I'm speaking about (and using ::operator new to allocate but delete obj to free is probably undefined behavior).


fix: added heading.mdx link

removed wrong link & added new link

I'm closing this PR & opening a new one.


Upgrade to Quarkus 3.9.2

Hey @mraible, please bump quarkus-resteasy-problem to 3.9.0 here:
https://github.com/jhipster/generator-jhipster-quarkus/blob/quarkus-3.9/generators/quarkus/templates/pom.xml.ejs#L52
This should fix some (maybe even all) failed builds.
Unfortunately our extension is not part of Quarkiverse (yet) so this version is kind of independent and needs to be bumped manually as of today.


Epic - Implementation of RFC 0007: Dataframe for Qiskit Experiments

Tasks to implement RFC 0007: Dataframe for Qiskit Experiments

[x] https://github.com/Qiskit-Extensions/qiskit-experiments/pull/1133
[x] https://github.com/Qiskit-Extensions/qiskit-experiments/pull/1253
[x] https://github.com/Qiskit-Extensions/qiskit-experiments/pull/1319 (followup of step2)
[x] https://github.com/Qiskit-Extensions/qiskit-experiments/pull/1360
[ ] https://github.com/Qiskit-Extensions/qiskit-experiments/pull/1342

hi @nkanazawa1989 with all the PR in this Epic merged, can we tag RFC0007 as implemented?

I just added two related PRs. The final one is going to be merged today. Then this can be marked as implemented.


bumblebee service: Fix pmMethod bbswitch check

Motivation for this change
Made useBbswitch work when pmMethod is "auto" and removed invalid pmMethod option "nouveau".
Without this when using the nvidia drivers bumblebeed looks for bbswitch and fails to find it because it is not included.
Things done

[ ] Tested using sandboxing
(nix.useSandbox on NixOS,
or option build-use-sandbox in nix.conf
on non-NixOS)
Built on platform(s)

[X] NixOS
[ ] macOS
[ ] Linux

[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[X] Fits CONTRIBUTING.md.

Ouch, nouveau is accidential leak of my out-of-tree patches. Thanks!


Add Fibonacci, Exponential search

I am creating a pull request for...

[X] New algorithm
[ ] Update to an algorithm
[X] Fix an error
[ ] Other - Describe below

#4

@abranhe can you review this PR? The algorithms I have written should work. I tested them (you can see tests in main.rs files).


Renovate/aws sdk js v3 monorepo

Hey, I just made a Pull Request!

Fix https://github.com/backstage/backstage/pull/20461
:heavy_check_mark: Checklist

[x] A changeset describing the change and affected packages. (more info)
[x] Added or updated documentation
[x] Tests for new functionality and regression tests for bug fixes
[x] Screenshots attached (for UI changes)
[x] All your commits have a Signed-off-by line in the message. (more info)

@freben  i'm a bit confused on these test errors.  They don't seem related (database related for the most part) and they pass on my local... thoughts?

Yeah don't worry, that's a frustrating flakiness in the tests.

Good to go?

thanks!  missed that bit not sure why all that got generated


Do not use go generate to run md-to-godoc

Coverage remained the same at 100.0% when pulling eed01fe4facfb0a6f605b651d4b3ee7e4c4303fd on md2doc into 99e5c1ffa17a2f1afbcccc8eea2bdf594589eaa9 on master.


fix: remove upper limit for required terraform version

/run pipeline

:tada: This PR is included in version 1.9.3 :tada:
The release is available on:

GitHub release
v1.9.3

Your semantic-release bot :package::rocket:


ci: basecamp

This pull request provide CI passing without altering functionality.  Meant as a basecamp for future PRs.

Tomorrow I'll probably do a rebase of all the pull request, so we are all on the same page. 😓


[BACKPORT][v1.2.5][BUG] Confusing description the label for replica delition

Describe the bug
backport https://github.com/longhorn/longhorn/issues/4430

Verified passed on v1.2.x-head (longhorn-ui d547a65) correct message is displayed without problem.


Performance hit after switching from an Image Fog scene to one without it

This can be reproduced using Foundry 0.7.9 and Image Fog 1.2.0.
Create three scenes:

One with normal FOW using:
1.a) Background  Image: "Ravaged Castle [40x50].webp"
1.b) Width: 3920
1.c) Height: 4900

Another one with Image Fog using:
2.a) Background  Image: "MermaidInnFloor_Interior.webp"
2.b) Width: 1862
2.c) Height: 1568
2.d) Unexplored Fog Background Image: "MermaidInnFloor_Fog.webp"

Another one with normal FOW using:
3.a) Background  Image: "MermaidInnFloor_Interior.webp"
3.b) Width: 1862
3.c) Height: 1568

From a newly loaded game, switching from scene 2 to 1 causes a performance hit, but switching from 3 to 1, or starting in 1 works correctly.
This is noticeable when holding the arrow buttons pressed in an install with no other modules.
This is a video of the issue:
https://www.youtube.com/watch?v=rUfDh4N9HN0
User Images.zip

Performance issues are pretty widespread with this module, I'm afraid I'm not really skilled enough with PIXI to be motivated to try and fix them.
Additionally, with overhead tiles and such coming in core 0.8.x, I'm probably going to let this module die when it breaks.

Hi Andrew,
Thanks for getting back to me. Shame, I really like the way this module makes scenes look, I use it a lot for house roofs - I much prefer it to the Roofs & Overhead Tiles module. However seems like 0.8 will do what I need so I'll just wait.
I opened this issue because the Foundry page for this module says:

This module should not affect scenes without a fog image set, if you find that it does please raise a Github issue with details.

Which is what is happening here.

Yeah, I appreciate the feedback and the report. Roofs is admittedly not a way I envisioned this being useful but it makes a lot of sense.

I really like it cause then the roof shows per room rather than the whole thing, and you can look inside rooms from doors.
Great job anyway, in smaller maps it works like a treat.


_brew: function definition file not found by pressing the Tab key

brew config output
HOMEBREW_VERSION: 3.3.6
ORIGIN: https://github.com/Homebrew/brew
HEAD: 32a3e1fe28f9372a6c6d5eca52129f92b0f00ba0
Last commit: 7 days ago
Core tap ORIGIN: https://github.com/Homebrew/homebrew-core
Core tap HEAD: 445d34e2c60e29ea9d41ce7ce1c01745fdc0ce69
Core tap last commit: 59 minutes ago
Core tap branch: master
HOMEBREW_PREFIX: /opt/homebrew
HOMEBREW_CASK_OPTS: []
HOMEBREW_CORE_GIT_REMOTE: https://github.com/Homebrew/homebrew-core
HOMEBREW_MAKE_JOBS: 8
Homebrew Ruby: 2.6.8 => /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/bin/ruby
CPU: octa-core 64-bit arm_firestorm_icestorm
Clang: 13.0.0 build 1300
Git: 2.30.1 => /Library/Developer/CommandLineTools/usr/bin/git
Curl: 7.77.0 => /usr/bin/curl
macOS: 12.0.1-arm64
CLT: <IP_ADDRESS>.1.1633545042
Xcode: N/A
Rosetta 2: false

brew doctor output
Your system is ready to brew.

Verification

[X] I ran brew update and am still able to reproduce my issue.
[X] I have resolved all warnings from brew doctor and that did not fix my problem.

What were you trying to do (and why)?
I press Tab after the brew command and get this error. I tried uninstalling and reinstalling brew, but the error won't go away
What happened (include all command output)?
~ > brew                                                               20:05:17
(eval):1: _brew: function definition file not found
(eval):1: _brew: function definition file not found
(eval):1: _brew: function definition file not found

What did you expect to happen?
proposed command selection
Step-by-step reproduction instructions (by running brew commands)
simply type `brew` and press the Tab key

I added the lines below to ~/.zshrc and everything worked
if type brew &>/dev/null
then
  FPATH="$(brew --prefix)/share/zsh/site-functions:${FPATH}"

  autoload -Uz compinit
  compinit
fi

It is not clear why brew did not do this itself when installing

It is not clear why brew did not do this itself when installing

Is the explanation given in the documentation not clear?


Enable website field to be searchable

Assigning to you @shakilhossain1 acknowledging it would also fall under streetlives/yourpeer.nyc-nextjs#140

@shakilhossain1 not done


DI Service Bus Isolated Worker Azure Function App

Library name and version
Microsoft.Azure.Functions.Worker.Extensions.ServiceBus 5.15.0
Query/Question
Hi there,
I'm just the boilerplate code / wizard / steps from VS Code to create my sample Service Bus Trigger Function App.  I'm using the Isolated Worker .Net 7.0 but when I run func host start --csharp.  I get an error saying No job functions found. Try making your job classes and methods public. If you're using binding extensions (e.g. Azure Storage, ServiceBus, Timers, etc.) make sure you've called the registration method for the extension(s) in your startup code (e.g. builder.AddAzureStorage(), builder.AddServiceBus(), builder.AddTimers(), etc.).
There were some forums saying that I should be using Function keyword in the method attribute instead of FunctionName, which is already the case from the boilerplate code.
I can't seem to use AddServiceBus() either and I can't find any way to DI the Service Bus Client to get the func host start to work.
Is there something wrong with the boilerplate code?
Attached is the screen cap of error.

Azure Functions Core Tools
Core Tools Version:       4.0.5030 Commit hash: N/A  (64-bit)
Function Runtime Version: <IP_ADDRESS>77

Code for Program.cs
using Microsoft.Azure.Functions.Worker;
using Microsoft.Extensions.Hosting;
using Microsoft.Extensions.DependencyInjection;
using Azure.Messaging.ServiceBus;
using Company.Function;

var host = new HostBuilder()
    .ConfigureFunctionsWorkerDefaults()
    .ConfigureServices(services =>
    {
        services.AddApplicationInsightsTelemetryWorkerService();
        services.ConfigureFunctionsApplicationInsights();
    })
    .Build();

host.Run();

Code for ServiceBusQueueTrigger.cs
using System;
using Azure.Messaging.ServiceBus;
using Microsoft.Azure.Functions.Worker;
// using Microsoft.Azure.Functions.Worker.Sdk;
using Microsoft.Extensions.Logging;

namespace Company.Function
{
    public class ServiceBusQueueTrigger
    {
        private readonly ILogger<ServiceBusQueueTrigger> _logger;

        public ServiceBusQueueTrigger(ILogger<ServiceBusQueueTrigger> logger)
        {
            _logger = logger;
        }

        [Function(nameof(ServiceBusQueueTrigger))]
        public void Run([ServiceBusTrigger("myqueue", Connection = "sbteamsqsdev_SERVICEBUS")] ServiceBusReceivedMessage message)
        {
            _logger.LogInformation("Message ID: {id}", message.MessageId);
            _logger.LogInformation("Message Body: {body}", message.Body);
            _logger.LogInformation("Message Content-Type: {contentType}", message.ContentType);
        }
    }
}

Environment
.NET SDK:
Version:   7.0.306
Commit:    f500069cb7
Runtime Environment:
OS Name:     Windows
OS Version:  10.0.22621
OS Platform: Windows
RID:         win10-x64
Base Path:   C:\Program Files\dotnet\sdk\7.0.306\
Host:
Version:      7.0.9
Architecture: x64
Commit:       8e9a17b221
.NET SDKs installed:
7.0.306 [C:\Program Files\dotnet\sdk]
.NET runtimes installed:
Microsoft.AspNetCore.App 6.0.20 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.AspNetCore.App 7.0.9 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.NETCore.App 6.0.20 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.NETCore.App 7.0.9 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.WindowsDesktop.App 6.0.20 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
Microsoft.WindowsDesktop.App 7.0.9 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
Other architectures found:
x86   [C:\Program Files (x86)\dotnet]
registered at [HKLM\SOFTWARE\dotnet\Setup\InstalledVersions\x86\InstallLocation]
Environment variables:
Not set
global.json file:
Not found
Learn more:
https://aka.ms/dotnet/info
Download .NET:
https://aka.ms/dotnet/download

Thank you for your feedback.  Tagging and routing to the team member best able to assist.

Hi @PandaBoy00, I haven't been able to reproduce the error you are seeing after creating a new isolated worker function app via the VS template. Can you share the contents of your csproj?

Hi @JoshLove-msft ,
As per request here is the csproj.
<Project Sdk="Microsoft.NET.Sdk">
  <PropertyGroup>
    <TargetFramework>net6.0</TargetFramework>
    <AzureFunctionsVersion>v4</AzureFunctionsVersion>
    <RootNamespace>CSharp2_POC</RootNamespace>
  </PropertyGroup>
  <ItemGroup>
    <PackageReference Include="Microsoft.Azure.WebJobs.Extensions.ServiceBus" Version="4.3.0" />
    <PackageReference Include="Microsoft.NET.Sdk.Functions" Version="4.2.0" />
  </ItemGroup>
  <ItemGroup>
    <None Update="host.json">
      <CopyToOutputDirectory>PreserveNewest</CopyToOutputDirectory>
    </None>
    <None Update="local.settings.json">
      <CopyToOutputDirectory>PreserveNewest</CopyToOutputDirectory>
      <CopyToPublishDirectory>Never</CopyToPublishDirectory>
    </None>
  </ItemGroup>
</Project>

Please reach out if you need anything else

The isolated worker extension is Microsoft.Azure.Functions.Worker.Extensions.ServiceBus. You are using an old version of the in-process extension currently. If you update to use the above package things should work.

Unfortunately I did try and updated the Microsoft.Azure.Functions.Worker.Extensions.ServiceBus and it's still giving the the 'No Jobs Found'
<PackageReference Include="Microsoft.Azure.WebJobs.Extensions.ServiceBus" Version="5.13.5" />

/unresolve

Your csproj is still pointing to the in-proc extension rather than the isolated extension.

I have revised the code with the correct Nuget package for isolated worker process but it still gives a 'No Jobs Found'.
Code for Program.cs
using Microsoft.Azure.Functions.Worker;
using Microsoft.Extensions.Hosting;
using Microsoft.Extensions.DependencyInjection;
using Azure.Messaging.ServiceBus;
using Company.Function;

var host = new HostBuilder()
    .ConfigureFunctionsWorkerDefaults()
    .ConfigureServices(services =>
    {
        services.AddApplicationInsightsTelemetryWorkerService();
        services.ConfigureFunctionsApplicationInsights();
        services.AddFunctionsWorkerDefaults();
    })
    .Build();

host.Run();

Code for ServiceBusQueueTrigger.cs
using System;
using Azure.Messaging.ServiceBus;
using Microsoft.Azure.Functions.Worker;
// using Microsoft.Azure.Functions.Worker.Sdk;
using Microsoft.Extensions.Logging;

namespace Company.Function
{
    public class ServiceBusQueueTrigger
    {
        private readonly ILogger<ServiceBusQueueTrigger> _logger;

        public ServiceBusQueueTrigger(ILogger<ServiceBusQueueTrigger> logger)
        {
            _logger = logger;
        }

        [Function(nameof(ServiceBusQueueTrigger))]
        public void Run([ServiceBusTrigger("testqueue", Connection = "sbteamsqsdev_SERVICEBUS")] ServiceBusReceivedMessage message)
        {
            _logger.LogInformation("Message ID: {id}", message.MessageId);
            _logger.LogInformation("Message Body: {body}", message.Body);
            _logger.LogInformation("Message Content-Type: {contentType}", message.ContentType);
        }
    }
}

Csproj file contents:
<Project Sdk="Microsoft.NET.Sdk">
  <PropertyGroup>
    <TargetFramework>net7.0</TargetFramework>
    <AzureFunctionsVersion>v4</AzureFunctionsVersion>
    <OutputType>Exe</OutputType>
    <ImplicitUsings>enable</ImplicitUsings>
    <Nullable>enable</Nullable>
    <RootNamespace>CSharp_POC</RootNamespace>
  </PropertyGroup>
  <ItemGroup>
    <PackageReference Include="Microsoft.Azure.Functions.Worker" Version="1.20.0" />
    <PackageReference Include="Microsoft.Azure.Functions.Worker.Extensions.ServiceBus" Version="5.15.0" />
    <PackageReference Include="Microsoft.Azure.Functions.Worker.Sdk" Version="1.16.4" />
    <PackageReference Include="Microsoft.ApplicationInsights.WorkerService" Version="2.21.0" />
    <PackageReference Include="Microsoft.Azure.Functions.Worker.ApplicationInsights" Version="1.0.0" />
  </ItemGroup>
  <ItemGroup>
    <None Update="host.json">
      <CopyToOutputDirectory>PreserveNewest</CopyToOutputDirectory>
    </None>
    <None Update="local.settings.json">
      <CopyToOutputDirectory>PreserveNewest</CopyToOutputDirectory>
      <CopyToPublishDirectory>Never</CopyToPublishDirectory>
    </None>
  </ItemGroup>
  <ItemGroup>
    <Using Include="System.Threading.ExecutionContext" Alias="ExecutionContext" />
  </ItemGroup>
</Project>

local.settings.json contents:
{
  "IsEncrypted": false,
  "Values": {
    "AzureWebJobsStorage": "UseDevelopmentStorage=true",
    "FUNCTIONS_WORKER_RUNTIME": "dotnet-isolated",
    "sbteamsqsdev_SERVICEBUS": "Endpoint=xxxxxxxxxxxxx<remove for security>"
  }
}

Screenshot of error:

Still unable to reproduce. Would you mind attaching a zip file containing your project with all secrets removed?

@JoshLove-msft hmmm that's weird,  I wonder if it is cache but I did clean the project, close and re-open.
Anyways here is the zip file.
CSharp-POC.zip
Thanks

Your project works for me:
[2024-01-21T18:03:48.582Z] 1 functions found (Worker)
[2024-01-21T18:03:48.595Z] Reading functions metadata (Custom)
[2024-01-21T18:03:48.604Z] 1 functions found (Custom)
[2024-01-21T18:03:48.610Z] 1 functions loaded

Can you check the version of the Functions Core Tools you have installed?
C:\Users\jolov\Downloads\CSharp-POC\CSharp-POC> func --version
4.0.5455

It isn't far off.  Here is my version of the Function Core Tools
PS C:\CSharp-POC> func --version
4.0.5030

Would you mind updating to the latest version?

@JoshLove-msft that did the trick.  It's weird that I was using Microsoft VS Template and it didn't work in my version.  Somehow I guess the regression test didn't catch it.
Thanks for your help @JoshLove-msft


Cannot read property 'req' of undefined

Seems to happen at setActiveReq(context.ssrContext.req);
"nuxt": "^2.11.0",
"nuxt-composition-api": "^0.9.0",
"@vue/composition-api": "^0.6.1",
"pinia": "0.0.6",

universal mode

This issue disappears if I uninstall nuxt-composition-api so I guess this is caused by nuxt-composition-api doing something to the ssrContext

Apart from creating a different plugin for nuxt to override the app.context like they do, I can't see a different solution

@posva I've now exposed a onGlobalSetup hook that could work for Nuxt users like:
// In a plugin file
import { onGlobalSetup } from 'nuxt-composition-api'
import { setActiveReq } from 'pinia' // if this is exposed

export default () => {
  onGlobalSetup((props, context) => {
    setActiveReq(context.ssrContext.req)
  })
}

Let me know if there is anything else I can do from the nuxt-composition-api end.

I haven't looked and probably won't be able to for a while but the solution shouldn't need any extra code from the users 🤔

It was intended for you :smile:
But I may have fixed the issue; will submit PR.


VTS - PWR Mgr - Update UTCore build to 4.x

Goals
Update the UT Core version to 4.x in the buils.sh file.

Merged to develop


Remove use of MSBuild API directly in dotnet-user-secrets

Use indirect project evaluation. Avoids possible numerous problems with using MSBuild API directly.
This will invoke msbuild indirectly to find the UserSecretsId property.
cc @prafullbhosale @NTaylorMullen @jeffkl

@natemcmaster it might be cool if the FindUserSecretsProperty.targets file was an embedded resource that gets written to %TEMP% at runtime.  Just a thought.
FYI @rainersigwald and @AndyGerlicher.  I wonder if this sort of thing should ship with MSBuild?


Create Promotional Material(s)

The purpose of this issue is to request help from people who are better at design than me.
I am looking for someone to create some promotional materials for advertising Gobo.
Sizes that are definitely needed:
640x288 (For MakerAds
250x250 (For Scratch Signatures)
125x125 (For Scratch Signatures)
Things to be included:
A picture of Gobo
"A Scratch URL Shortener" or something similar

Something like this?

Yes! That is perfect!

@KennethSweezy When are we going to make the official release and what promotional material do we need for it?

Yeah, I can get this on Prouducthunt. I'm adding it as a prouduct right now, so if you can give me your twitter ign's or make  an acc there. It's a place where makers and people Pubilsh Prouducts.
I'm making one right now btw, gonna make one soon

@IamTregsthedev I appreciate all of the help you have provided already, however, I would prefer that I create the ProductHunt page since I am the founder of the project.

Sure. Just make sure to add all members, like me as makers.

@Andreto I think I am going to schedule the release for April 1st, 2019. This would allow us to do any extra changes that are needed as well as work out any bugs.

Also, if anyone would like to see the stats of our ad you can look here.

@KennethSweezy Maybe we should make it April 3rd or something, April 1st is not really a trustworthy day on the internet.

@Andreto  @KennethSweezy  I agree, April 3rd or April 6th would be good dates. It's best to launch a product on a Saturday (april 6th).

@Andreto Yea, I totally agree. I just wanted to give a rough estimate of when I would like to publish.
@IamTregsthedev Not trying to discredit what you say, but it appears that it is best to launch during the early morning hours of Sunday.
Also according to the article, it appears that we will need 7-9 images in order to yield the best result.
I will draft a tagline and description for the PH page.
What is everyone's PH Username?

My is Tregsthedev

Bb code snippet for forum signatures:
[center][url=https://gobo.cf/][img]https://u.cubeupload.com/andreto/goboposter1200x300.png[/img][/url][/center]

@Andreto True, I just wanted to give a rough estimate of when we should release.
@IamTregsthedev Well, from what I see it is best to launch in the early morning on Sunday.
But anyways, I will draft a ProductHunt description and tagline.


Error opening engine file with ./trtexec

Hi, I am trying to test the speed of the trt models.
I ran yolo_to_onnx.py and onnx_to_tensorrt.py and successfully ran eval_yolo.py and saw the fps and bounding boxes.
However, I ran ./trtexec --loadEngine= + other settings for inference phase (reference: https://docs.nvidia.com/deeplearning/tensorrt/developer-guide/index.html#trtexec-serialized-timing-cache) to obtain a different fps estimate and I got "Error opening engine file".

Likewise, when I use the trt files I obtain from converting darknet models to onnx using tianxiaomo's directory, then convert those to trt using ./trtexec, those models are not usable in this repo.

Could you clarify on this issue?
Also a separate clarification, is the conversion in onnx_to_trt by default fp16?

@lpkoh  The TensorRT YOLO engines built with this repo would contain the "yolo_layer" plugin.  So you'll have to call trtexec with something like the following.
$ ./trtexec --loadEngine=yolo/yolov4-tiny.trt --plugins=plugins/libyolo_layer.so


bsp/board.h no such file or directory

dirtyjtag.c:7:10

This file is part of the pico_sdk This app is coded according to the sdk rules. I just verified that it builds without error or warning using the sdk version 1.40
Please refer to this guide.

I have just created a release if you just want to use this project without having to build it first


Support S3 snapshot remove when rancher server is not configurated to access s3 bucket

This is to support functional S3 backup for cases where IAM profiles are used to authenticate managed clusters cluster backup, while rancher server doesn't have access to use the same IAM profile. Use cases may include:

Rancher server running outside of AWS, and cluster nodes are provisioned on AWS with IAM auth.
Rancher Server is running on AWS but in a different AWS account.
Rancher server nodes are not configured with the same IAM profile as the clusters for security reasons.

An example use case: https://github.com/rancher/rancher/issues/22711#issuecomment-530177536

Rancher version: 2.4 master-head (12/02/2019) 1304c55a2

Rancher server in Linode, the etcd nodes having IAM policy - cluster creation succeeds when access/secret key are not provided. Snapshot creation is successful
Created a Daemonset workload, and an ingress.
Triggered a manual snapshot.
Clicked Restore Snapshot  in the cluster and selected the first snapshot created during cluster creation.

The cluster gets completly frozen in Rancher as it says the API is unavailable and the docker logs show lots for norman errors due to this:
[etcd] Failed to restore etcd snapshot: Failed to start [etcd-remove-snapshot] container on host [x.x.x.x]: Error response from daemon: OCI runtime create failed: container_linux.go:346: starting container process caused "exec: \"/opt/rke-tools/rke-etcd-backup\": stat /opt/rke-tools/rke-etcd-backup: no such file or directory": unknown
Reopening.

@izaac does restore work fine in Linode cluster that has API/Secret key set in the snapshot configuration section of a cluster? As opposed to being read from IAM creds on the node.

@alena1108 I will check that scenario too. I was going through the first of these:
https://github.com/rancher/rancher/issues/22711#issuecomment-531018019

@alena1108 it does fail with credentials too. Same error message:
[etcd] Failed to restore etcd snapshot: Failed to start [etcd-remove-snapshot] container on host [x.x.x.x]: Error response from daemon: OCI runtime create failed: container_linux.go:346: starting container process caused "exec: \"/opt/rke-tools/rke-etcd-backup\": stat /opt/rke-tools/rke-etcd-backup: no such file or directory": unknown

@izaac can you open a separate bug for the ^ as it seems to be its own separate issue.
As a part of this bug, we should just verify that snapshot delete functionality works with IAM credentials from the disk. You can close this issue once delete scenario is verified.

@alena1108 opened #24360 for the restore fails. I checked this was working in Rancher v2.3.3 I'm still validating the delete, once I'm finished with the scenarios I'll proceed to close this issue, I will move it To Test status in the meantime.
I assigned you and set the status To Triage.

Validated functionality with Rancher v2.3.3
Tested with Rancher version 2.4 master-head (12/03/2019) 1df888a33

S3 Snapshot files are not getting deleted without IAM profile and providing amazon keys in cluster.
S3 Snapshot files are not getting deleted using IAM profile without credentials.

Above issues are passing in v2.3.3
Reopening.

Tested in Rancher version: 2.4 master-head (12/05/2019)
For all scenarios:

One time snapshots create and remove. Passed.
Recurring snapshots. Passed
Snapshot backup restore. Passed.
Snapshot create and Remove with AD user for RBAC. Passed.
Backup restore with offline etcd. Passed

Scenario 1:  HA installation - S3
In AWS with Rancher nodes without IAM Profile Ubuntu. Cluster under tests etcd nodes with IAM profile.
Scenario 2:  HA installation - S3
In AWS with Rancher nodes without IAM Profile Ubuntu. Cluster under tests etcd nodes without IAM profile. Using AWS  credentials.
Scenario 3: Single install Rancher not in AWS - S3
Rancher single install in Linode. Cluster under tests etcd nodes with IAM profile.
Scenario 4: Single install Rancher not in AWS - S3
Rancher single install in Linode. Cluster under tests etcd nodes without IAM profile Using AWS credentials
Scenario 5: Single install Rancher in Linode - Local
Rancher single install in Linode. Etcd backups local
I'm just missing the dual AWS account scenario from the above description. cc @sangeethah

Made the following basic checkups in Rancher version: 2.4 master-head (12/06/2019) c08cedf76

One time snapshots create and remove. Passed.
Snapshot backup restore. Passed.

Scenario 1: Different account for Rancher server and cluster nodes. S3
Cluster under test etcd nodes with IAM profile.
Scenario 2: Different account for Rancher server and cluster nodes. S3
Cluster under test etcd nodes without IAM profile. Using AWS access keys.