Panic in newChunkForEncoding

I had a prometheus which was crash-looping. On each restart it would complete crash recovery, wait for a minute, and then panic. The error message was always the same.
The host machine also suffered a disk-full condition about a day before, just like in #877 . Or, possibly, prometheus was SIGKILLed while it was still dealing with its SIGTERM. Either way, a write didn't happen, and recovery didn't recover.
Here's a clip of the stderr:
time="2015-11-27T08:12:38-05:00" level=warning msg="Crash recovery complete." source="crashrecovery.go:143"
time="2015-11-27T08:12:38-05:00" level=info msg="18125 series loaded." source="storage.go:267"
time="2015-11-27T08:12:38-05:00" level=info msg="Starting target manager..." source="targetmanager.go:114"
time="2015-11-27T08:12:38-05:00" level=info msg="Listening on localhost:9090" source="web.go:223"
time="2015-11-27T08:12:55-05:00" level=warning msg="Ignoring sample with out-of-order timestamp for fingerprint 9df8b97ea5a704cc (requests_total{<redacted>}):<PHONE_NUMBER>.858 is not after<PHONE_NUMBER>0904.95" source="storage.go:570"
panic: unknown chunk encoding: 212

goroutine 7425 [running]:
github.com/prometheus/prometheus/storage/local.newChunkForEncoding(0x7f4f5f1b72d4, 0x0, 0x0)
	/Users/fabianreinartz/repos/src/github.com/prometheus/prometheus/storage/local/chunk.go:287 +0x259
github.com/prometheus/prometheus/storage/local.(*persistence).loadChunks(0xc8203e6300, 0x7a14e1da1e245688, 0xc828e92760, 0x2, 0x2, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
	/Users/fabianreinartz/repos/src/github.com/prometheus/prometheus/storage/local/persistence.go:435 +0x4e6
github.com/prometheus/prometheus/storage/local.(*memorySeriesStorage).loadChunks(0xc8201c6000, 0x7a14e1da1e245688, 0xc828e92760, 0x2, 0x2, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
	/Users/fabianreinartz/repos/src/github.com/prometheus/prometheus/storage/local/storage.go:1121 +0x8d
github.com/prometheus/prometheus/storage/local.(*memorySeries).preloadChunks(0xc824aad4a0, 0xc828e92730, 0x2, 0x2, 0x7a14e1da1e245688, 0xc8201c6000, 0x0, 0x0, 0x0, 0x0, ...)
	/Users/fabianreinartz/repos/src/github.com/prometheus/prometheus/storage/local/series.go:329 +0x3b7
github.com/prometheus/prometheus/storage/local.(*memorySeries).preloadChunksForRange(0xc824aad4a0, 0x1514913e33c, 0x1514913e33c, 0x7a14e1da1e245688, 0xc8201c6000, 0x0, 0x0, 0x0, 0x0, 0x0)
	/Users/fabianreinartz/repos/src/github.com/prometheus/prometheus/storage/local/series.go:419 +0x4fd
github.com/prometheus/prometheus/storage/local.(*memorySeriesStorage).preloadChunksForRange(0xc8201c6000, 0x7a14e1da1e245688, 0x1514913e33c, 0x1514913e33c, 0x45d964b800, 0x0, 0x0, 0x0, 0x0, 0x0)
	/Users/fabianreinartz/repos/src/github.com/prometheus/prometheus/storage/local/storage.go:646 +0x32c
github.com/prometheus/prometheus/storage/local.(*memorySeriesPreloader).PreloadRange(0xc82990c540, 0x7a14e1da1e245688, 0x1514913e33c, 0x1514913e33c, 0x45d964b800, 0x0, 0x0)
	/Users/fabianreinartz/repos/src/github.com/prometheus/prometheus/storage/local/preload.go:34 +0x79
github.com/prometheus/prometheus/promql.(*Analyzer).Prepare(0xc826e7edc0, 0x7f4f5ebc1c00, 0xc828edc420, 0x0, 0x0, 0x0, 0x0)
	/Users/fabianreinartz/repos/src/github.com/prometheus/prometheus/promql/analyzer.go:144 +0x628
github.com/prometheus/prometheus/promql.(*Engine).execEvalStmt(0xc82019b040, 0x7f4f5ebc1c00, 0xc828edc420, 0xc826ea8500, 0xc827bfbef0, 0x0, 0x0, 0x0, 0x0)
	/Users/fabianreinartz/repos/src/github.com/prometheus/prometheus/promql/engine.go:386 +0x3be
github.com/prometheus/prometheus/promql.(*Engine).exec(0xc82019b040, 0xc826ea8500, 0x0, 0x0, 0x0, 0x0)
	/Users/fabianreinartz/repos/src/github.com/prometheus/prometheus/promql/engine.go:357 +0x4ca
github.com/prometheus/prometheus/promql.(*query).Exec(0xc826ea8500, 0xc8290fe540)
	/Users/fabianreinartz/repos/src/github.com/prometheus/prometheus/promql/engine.go:195 +0x2e
github.com/prometheus/prometheus/rules.(*AlertingRule).eval(0xc8206bb490, 0x1514913e33c, 0xc82019b040, 0x0, 0x0, 0x0, 0x0, 0x0)
	/Users/fabianreinartz/repos/src/github.com/prometheus/prometheus/rules/alerting.go:157 +0x140
github.com/prometheus/prometheus/rules.(*Manager).runIteration.func1(0xc828ed7750, 0x1514913e33c, 0xc8201a8480, 0x7f4f5f133310, 0xc8206bb490)
	/Users/fabianreinartz/repos/src/github.com/prometheus/prometheus/rules/manager.go:252 +0xd3
created by github.com/prometheus/prometheus/rules.(*Manager).runIteration
	/Users/fabianreinartz/repos/src/github.com/prometheus/prometheus/rules/manager.go:278 +0x209

@beorn7 seems like corruption caused by the disk running full. Can we just log and error and delete corrupted chunks as we encounter them?

That's exactly what https://github.com/prometheus/prometheus/issues/877 is about.


⚠ Turnos 24x7 has degraded performance

In 09684f4, Turnos 24x7 (https://reservas-dev.alternativasinteligentes.com/) experienced degraded performance:

HTTP code: 200
Response time: 959 ms

Resolved: Turnos 24x7 performance has improved in 7173792.


add lemon juice and fix bad sprite allocation

About the PR

added a lemon juice carton to the boozemat
Why / Balance

Lemon juice now no longer requires botany to mass produce lemons
Technical details

Media

[X] I have added screenshots/videos to this PR showcasing its changes ingame, or this PR does not require an ingame showcase

Breaking changes

Changelog

Make sure to take this Changelog template out of the comment block in order for it to show up.
🆑 :

add: Added lemon juice to the Boozemat!
fix: Fixed bad sprite allocation for lemon-related entities

Why does the glass look like a lemon, this is weird

Why does the glass look like a lemon, this is weird

Because that's what the lemon juice containers I buy look like

I don't mind the lemon shaped lemon juice container, but the sprite doesn't really look like a lemon to me... at least compared to our existing lemon sprite

I don't mind the lemon shaped lemon juice container since I have those too, but the sprite doesn't really look like a lemon to me... at least compared to our existing lemon sprite

I don't want it to look to similar to the lime juice bottle and I don't want people to confuse it for an actual lemon.  This one is unique enough to net be seen as either.

i think it looks a bit too much like a lemon?

perhaps go with a flatter bottom, ditch the leaf, and add an outline for more definition?

perhaps go with a flatter bottom, ditch the leaf, and add an outline for more definition?

I like the leaf too much but added outline and changed the shape

imo just make it a yellow circle bottle

imo just make it a yellow circle bottle

that wouldn't stand out

Closed due to feature freeze May 10th-June 14th. Comment to have it reopen after this.

please reopen

It has been 2 months since I posted this PR.  Can I please just get a yes or no so it can be closed?


address typos, missing words and structure throughout tutorials

fix some typos
add missing words
make structure more homogeneous across examples
address further questions and unclear parts in comments

First of all, I would like to apologize for any unnecessary change I made and for potentially wrong and/or misleading adaptions. I wasn't sure about one or the other thing...
I tried to limit the changes in the PR to wording, typos, missing/wrong words, punctuations, etc. . However, there were some other things I would like to address, but wasn't sure on how/where to do it best and if it's useful at all. A put together a list below and are happy to work on this further, either within this PR or a new one.

in <IP_ADDRESS>. should the citation style of the reference study be changed and a DOI link included?
in <IP_ADDRESS>. the definition of the tr, events, etc. could be explained (perhaps the TR) could be fetched through nibabel?
in <IP_ADDRESS>. the plot of the contrast could be adapted so that the respective contrasts don't overlay one another anymore
in <IP_ADDRESS> maybe add a short explanation why the model performs poorly
in <IP_ADDRESS>. should the FirstLevelModel function be referenced (this accounts for all object/function mentions through out the tutorials)
in <IP_ADDRESS>. should code parts be highlighted (e.g. interpolation = "nearest") (also throughout tutorials)
in <IP_ADDRESS>. more explanations on how to view the report could be added
in 2.2.2 maybe a reference to the Neurospin Localizer could be included
in <IP_ADDRESS>. a (function) reference to DataFrames could be included
in <IP_ADDRESS>. maybe include more information on how to view the reports (this also accounts for any other example that refers/includes a report)
in <IP_ADDRESS>. maybe include link to utilized dataset
in <IP_ADDRESS> a link/reference to fmriprep could be included
in 2.2 the examples plot_fixed_effects.py and plot_predictions_residuals.py are not included in the docs
in <IP_ADDRESS>. a reference to the localizer dataset as utilized in the previous examples could be included
in <IP_ADDRESS>. the wording of the first sentence could be improved/adapted
in <IP_ADDRESS>. should the list of tutorial authors be included and if so, should the way of displaying them be adapted
in 2.3.5 the second sentence includes some brackets that are (at least for me) hard to grasp
in 2.3 the example plot_proportions_activated_voxels.py not in docs
in 2.4.2 a reference to Glover could be included
in 2.4.3 the reference to Pinel could be adapted and a link added
in <IP_ADDRESS>. the final plot is not showing up
in 2.5.1. the reference to the BIDS paper could be included
in <IP_ADDRESS>. the docs mention a "left lateralized fronto-temporal network", but the utilized plot does not allow to see that, hence it could be adapted
2.5. the example plot_haxby_block_classifier.py is not included in the docs

in <IP_ADDRESS>. should the citation style of the reference study be changed and a DOI link included?

First, of all, huge thx !
Yes.

in <IP_ADDRESS>. the definition of the tr, events, etc. could be explained (perhaps the TR) could be fetched through nibabel?

Yes for explaining
I'm rather negative on fetching from nibabel. This may not be relaible (people tend to edit image headers, and software are not always consistent); For the TR at least I would rely on BIDS meta data whenever we deal with BIDS data.

in <IP_ADDRESS>. the plot of the contrast could be adapted so that the respective contrasts don't overlay one another anymore

in <IP_ADDRESS> maybe add a short explanation why the model performs poorly

in <IP_ADDRESS>. should the FirstLevelModel function be referenced (this accounts for all object/function mentions through out the tutorials)

in <IP_ADDRESS>. should code parts be highlighted (e.g. interpolation = "nearest") (also throughout tutorials)

in <IP_ADDRESS>. more explanations on how to view the report could be added

in 2.2.2 maybe a reference to the Neurospin Localizer could be included

OK for all those: thx for spotting all these aspects.

in <IP_ADDRESS>. a (function) reference to DataFrames could be included

Well, the current code is quite poor. Here, we should modify the fetcher so that it returns BIDS-compatible data. For that, we should open an issue, and maybe address it after merge into Nilearn.

in <IP_ADDRESS>. maybe include more information on how to view the reports (this also accounts for any other example that refers/includes a report)

in <IP_ADDRESS>. maybe include link to utilized dataset

in <IP_ADDRESS> a link/reference to fmriprep could be included

in 2.2 the examples plot_fixed_effects.py and plot_predictions_residuals.py are not included in the docs

in <IP_ADDRESS>. a reference to the localizer dataset as utilized in the previous examples could be included

in <IP_ADDRESS>. the wording of the first sentence could be improved/adapted

Yes for those.

* in [<IP_ADDRESS>.](https://nistats.github.io/auto_examples/03_second_level_models/plot_oasis.html#vbm-analysis-of-aging) should the list of tutorial authors be included and if so, should the way of displaying them be adapted

Yes.

in 2.3.5 the second sentence includes some brackets that are (at least for me) hard to grasp

in 2.3 the example plot_proportions_activated_voxels.py not in docs

in 2.4.2 a reference to Glover could be included

in 2.4.3 the reference to Pinel could be adapted and a link added

in <IP_ADDRESS>. the final plot is not showing up

in 2.5.1. the reference to the BIDS paper could be included

2.5. the example plot_haxby_block_classifier.py is not included in the docs

OK with all your comments.

in <IP_ADDRESS>. the docs mention a "left lateralized fronto-temporal network", but the utilized plot does not allow to see that, hence it could be adapted

Indeed, the plot should show 3 views.

Hi @bthirion,
thank you very much for your fast reply, the feedback and all the pointers.
Also thanks for catching the mini-glitches. I actually also have a typo in the name of the branch within which I wanted to correct typos...
As suggested by you, I work on the other points within a new branch/PR.
Thanks again, cheers, Peer

@kchawla-pi this one can merged I think.


compile_commands.json is in .vscode directory, but it seems clangd Failed to find compilation database,

clangd cant find include header . the compile_commands.json was generated in .vscode directory,
and clangd output like this:
 Failed to find compilation database for d:\Code\MyProject\cxx\finance\commonlib\include\Commonlib\Thread\Thread.h I[19:15:02.213] ASTWorker building file d:\Code\MyProject\cxx\finance\commonlib\include\Commonlib\Thread\Thread.h version 1 with command clangd fallback
it works if compile_commands.json in build directory or project directory, why cant work in .vscode directory?
Loaded compilation database from d:\Code\MyProject\cxx\finance\commonlib\compile_commands.json I[19:27:30.545] ASTWorker building file d:\Code\MyProject\cxx\finance\commonlib\src\MessageLoop\Task.cpp version 1 with command  [D:\Code\MyProject\cxx\finance\commonlib
System information
clangd version 14.0.0
vscode
windows

The search algorithm for compile_commands.json is documented at https://clangd.llvm.org/installation#compile_commandsjson:

clangd will look in the parent directories of the files you edit looking for it, and also in subdirectories named build/. For example, if editing $SRC/gui/window.cpp, we search in $SRC/gui/, $SRC/gui/build/, $SRC/, $SRC/build/, …

You can also instruct clangd to look in a custom location with the --compile-commands-dir command-line argument.

ok, I got it,

The search algorithm for compile_commands.json is documented at https://clangd.llvm.org/installation#compile_commandsjson:

clangd will look in the parent directories of the files you edit looking for it, and also in subdirectories named build/. For example, if editing $SRC/gui/window.cpp, we search in $SRC/gui/, $SRC/gui/build/, $SRC/, $SRC/build/, …

You can also instruct clangd to look in a custom location with the --compile-commands-dir command-line argument.

ok ,thanks, i got it.


Introduce minimum amount in Tier management

This PR introduces minimumAmount to tier data replacing the need to use Min(amount, presets[0]).
Ref (#1938)

Coverage increased (+0.01%) to 66.808% when pulling e1d3eaf778f8ead7f53e93e298635db39c153e03 on tier-managment into ee427fd397adf874e63f463cf02d412791e66651 on master.

@flickz Can you also edit amountStr in Tier.js?

@flickz let's make it clear that we're using the smallest preset instead of assuming that presets[0] is the smallest. Unless there is a guarantee that presets[0] is the smallest of course.

No change to TierInputType? Is that tested?

We need also to support minimumAmount everywhere we create Tiers automatically such as https://github.com/opencollective/opencollective-api/blob/master/server/models/Collective.js#L72

@flickz To be able to merge the API while being compatible with the old Frontend, we need a last small change.
In the mutation, if minimumAmount is not sent, we should set it to minimumAmount = Math.min(amount, ...presets);. Can you do that?

Yes, I'll do that now

@flickz Sorry, I was actually asking about the mutation to editTiers.

Oh alright, I'll change that.


Added gnosispools.info

What

Added gnosispools.info under Monitoring your node(s) section

Refs

Issue #435

#435 closed.


so is --link deprecated or still a valid option?

On documentation for --link parameter, there is a mention of it being deprecated and not using it. But in this documentation on container communication, it is provided as a solution. It is a bit confusing in my opinion.
File: engine/userguide/networking/default_network/container-communication.md, CC @mstanleyjones

It is deprecated, which means that it may be taken away in the future. Deprecation does mean that it is already gone. You should not rely on it if at all possible. For most use cases, there are better options than --link, such as using user-defined networks.


Using a self-signed certificate on the InfluxDB HTTP endpoint makes Unifi-Poller fail.

How to reproduce:
1/ Set up InfluxDB with a self-signed certificate on the HTTP endpoint
2/ Point Unifi-Poller in it's direction
3/ See Unifi-Poller fail to connect with
"Sep 20 15:02:55 zabbix unifi-poller[20425]: 2019/09/20 15:02:55 [ERROR] (1/0) reporting metrics: influxdb.Write(points): Post https://<IP_ADDRESS>:8086/write?consistency=&db=unifi&precision=ns&rp=: x509: certificate signed by unknown authority
" - or other funky errors.
Would there be a way to disable SSL certificate checking?

Set verify_ssl to false.
https://github.com/davidnewhall/unifi-poller/blob/master/examples/up.conf.example#L64-L67

Can you elaborate on this statement:

or other funky errors.

Can you elaborate on this statement:

or other funky errors.

Other types of SSL errors, eg: I started out with a certificate without CN or SANs and got another one.

Set verify_ssl to false.
https://github.com/davidnewhall/unifi-poller/blob/master/examples/up.conf.example#L64-L67

Is set to false, but only seems to be valid for the connections to the Unifi Controller, not for the http connection to Influx

That is correct, it does not control influx. There is no way to turn that off. Recommend using Lets encrypt or something to get a free cert.

I have a test package to try that provides a new config option to ignore the SSL cert on influx. Are you using deb or rpm? docker maybe? Lemme know which.. Thanks!

I have a test package to try that provides a new config option to ignore the SSL cert on influx. Are you using deb or rpm? docker maybe? Lemme know which.. Thanks!

A .deb would be nice, I'm running Debian 10.

Give this a whirl.
unifi-poller_1.5.3-424_amd64.deb.gz
The config file has a new option available. See example here: https://github.com/davidnewhall/unifi-poller/blob/dn2_fixes/examples/up.conf.example#L46-L47

Nice, looks like it works perfectly! Data is flowing from the Unifi setup into Influx.
Impressive support, David, it's greatly appreciated!

Thank you for testing! I'll release an updated version with this fix soon. For now the deb you're running is the latest code. Hope the poller proves useful! Good luck!


Ember Upgrade for conduit-ui

Bug description
Description
In order to keep up with security vulnerabilities more easily, we should upgrade Ember and it's related dependencies, such as ember-cli, ember-data, as well as version-dependent addons, e.g. ember-auto-import, ember-changeset, etc. to either

the latest available minor version (4.12 as of date). This way, we will be able to upgrade more quickly to Ember 5.x (which has already been released as of today)

or the latest LTS version 4.8.x. This way we can still benefit from critical security patches within Ember until December 11, 2023

Blockers
This is a list of blockers that we encountered during the upgrade (tbd, once the issue is worked on):

[ ] ...

Steps to reproduce
.
Version
.

@jayjayjpg are you doing this work?

@jayjayjpg is focussed elsewhere and thus will not be tackling this ember upgrade work. For now we will push this work until the next version of Conduit after 0.7.0.

@simonl2002 I just timeboxed exploration on how much effort it would be to upgrade to at least 4.8 (the latest LTS version of Ember that still receives security patches until December 2023) as I mentioned briefly before and will close this ticket if the tests for this PR pass
I can create a follow-up ticket for the final upgrade to 4.12 which could be tackled in a future Conduit release (e.g. 0.7.0)

I created this follow-up ticket for the missing part of the upgrade: https://github.com/ConduitIO/conduit/issues/1012


Credhub login

What version of the credhub server you are using?
Standalone bosh
What version of the credhub cli you are using?
2.2
What did you expect to happen?
I need to login and store all the credential.
What was the actual behavior?
./credhub login --server https://*********.com:8844/api --skip-tls-validation
username: admin
password: ********************
invalid_token: An I/O error occurred while reading from the JWK Set source: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target

Hi, can you you provide a little more information about your environment? Also, what version of CredHub server are you running?

Hi Tom,
       We are trying to install credhub on  standalone bosh director.

UAA is already pre-configured in our PAS (ERT) environment, we are planning to use the existing UAA with new credhub server.
credhub               credhub/2.2.0
bosh                    vsphere-esxi-ubuntu-xenial-go_agent/170.12   -
fim              -       1.3.4
postgres             30

HI Team,
      Any input on this.

@ranjithfd - thanks for your patience. We noticed that you referenced a commercial Cloud Foundry offering. We would recommend going through the support channels for that particular commercial offering instead of using the open source GitHub repository. We believe that you will reach a faster resolution to your issue through the PAS support channels.
That being said, we can try to offer assistance here.  I noticed that your command above contains /api in the server address: ./credhub login --server https://*********.com:8844/api --skip-tls-validation. Did you try removing the /api from that server address? Perhaps you have a custom setup for your CredHub, but I am used to being able to access CredHub using the root path, i.e., ./credhub login --server https://***.com:8844 --skip-tls-validation.

Closing, please see above comment. Feel free to reach out again if the issue arises again, thanks!


Add preprocessing scripts for the librilight datasets

✨ Description
This update introduces preprocessing scripts for the Libri-Light datasets, enhancing their usability and compatibility with our processing workflows.
🚧 Related Issues
No related issues.
👨💻 Changes Proposed

[x] Implemented the main workflow preprocessors/librilight.py for preprocessing Libri-Light datasets.
[x] Developed a utils/cut_by_vad.py script to segment audio files using multiprocessing (Step 1: Segmentation).
[x] Created an utils/mfa_prepare.py script to convert audio files to 16kHz and 16-bit PCM, and to filter out longer audio files (Steps 2 & 3: Filter and Preprocess).
[x] Added utils/whisper_transcription.py for audio transcriptions using distilled-whisper – a more efficient variant of Whisper, and included text preprocessing functions for these transcriptions (Steps 4 & 5: Transcription & Text-Preprocess).
[x] Integrated an MFA alignment function specifically tailored for Libri-Light  in preprocessors/librilight.py(Step 6: Alignment).
[x] Enabled data splitting into train/dev/eval sets, along with statistics calculation and metadata construction for Libri-Light in preprocessors/librilight.py (Steps 7-9).
[x] Provided support for different subsets of Libri-Light, including "tiny", "small", "medium", and "large".

🧑🤝🧑 Who Can Review?

@lmxue
@RMSnow
@HeCheng0625

🛠 TODO

[x] Test on Libri-Light-tiny (custom split from Libri-Light-small).
[ ] Test on Libri-Light-small.
[ ] Test on Libri-Light-medium.
[ ] Test on Libri-Light-large.

✅ Checklist

[x]  Code has been reviewed
[x]  Code complies with the project's code standards and best practices
[x]  Code has passed all tests
[x]  Code does not affect the normal use of existing features
[x]  Code has been commented properly
[x]  Documentation has been updated (if applicable)
[x]  Demo/checkpoint has been attached (if applicable)

In this comment, I provide screenshots from testing the implemented scripts on Libri-Light-tiny (a custom split from Libri-Light-small).
The Running Process
preprocessors/librilight.py
Part 1 of 5:

Part 2 of 5:

Part 3 of 5:

Part 4 of 5:

Part 5 of 5:

The Outcome:
Processed Data:

MetaData:

Thanks for your efforts. Please check out the comments

Thank you so much for reading my PR; I have addressed your concerns, and please see my most recent commits.

LGTM.
P.S. This PR has been tested on Libri-Light-tiny. However, three other subdatasets need to be tested as listed in TODO. You may need to test them when the dataset is ready.

LGTM.

P.S. This PR has been tested on Libri-Light-tiny. However, three other subdatasets need to be tested as listed in TODO. You may need to test them when the dataset is ready.

sure, I test them then.


sync2: Add handling for swapchain images

Hook vkGetSwapchainImagesKHR() and related functions so that we can track state for swapchain images.
Fixes #90

CI Vulkan-ExtensionLayer build queued with queue ID 16106.

CI Vulkan-ExtensionLayer build # 95 running.

CI Vulkan-ExtensionLayer build # 95 passed.


Update sbt-ci-release to 1.5.9

Updates com.geirsson:sbt-ci-release from 1.5.7 to 1.5.9.
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "com.geirsson", artifactId = "sbt-ci-release" } ]

labels: sbt-plugin-update, semver-patch

Codecov Report

Merging #186 (0dba692) into master (8d57629) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #186   +/-   ##
=======================================
  Coverage   87.30%   87.30%
=======================================
  Files          28       28
  Lines         843      843
  Branches       39       39
=======================================
  Hits          736      736
  Misses        107      107

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8d57629...0dba692. Read the comment docs.


await for exported file open on export commands

We didn't wait for the exported file to be opened in the export commands, thus the tests might fail as they are checking activeTextEditor for validation.

Codecov Report

Merging #10138 (cc6845b) into main (2f5f881) will decrease coverage by 0%.
The diff coverage is 0%.

@@          Coverage Diff          @@
##           main   #10138   +/-   ##
=====================================
- Coverage    55%      55%   -1%
=====================================
  Files       203      203
  Lines      9238     9238
  Branches   1490     1490
=====================================
- Hits       5099     5088   -11
- Misses     3737     3745    +8
- Partials    402      405    +3

Impacted Files
Coverage Δ

src/platform/export/fileConverter.ts
31% <0%> (ø)

src/platform/logging/consoleLogger.ts
38% <0%> (-12%)
:arrow_down:

src/platform/logging/outputChannelLogger.ts
38% <0%> (-12%)
:arrow_down:

src/platform/common/platform/fileSystem.ts
48% <0%> (-5%)
:arrow_down:

src/platform/common/cancellation.ts
50% <0%> (-4%)
:arrow_down:

...form/common/process/pythonExecutionFactory.node.ts
49% <0%> (-3%)
:arrow_down:

...ommon/process/environmentActivationService.node.ts
43% <0%> (ø)

Closing in favor of https://github.com/microsoft/vscode-jupyter/pull/10140


map

If running the main.py, the mAP IOU is 0.5 or 0.5:0.75 ?

I think it's 0.5
Refer to lines 12, 572 and 577 of main.py

Can it set the IOU 0.5:0.75  to eval？

Try changing line 577 (main.py) from:
            if ovmax >= min_overlap:
to:
            if ovmax >= min_overlap and ovmax <= 0.75:
I haven't tried it but I think that should work.

Thanks for your advance.
But the it should mean with IOU 0.5:0.75.

min_overlap is already defined to be 0.5 at the start of main.py. I think the variable name is different, but it gets passed to min_overlap.

Try changing line 577 (main.py) from:
 if ovmax >= min_overlap:
to:
 if ovmax >= min_overlap and ovmax <= 0.75:
I haven't tried it but I think that should work.

if set  ovmax >= min_overlap and ovmax <= 0.75
So it show the ovmax 0.9 is fail.
It is good detect when ovmax = 0.9.


Enforce Sass/CSS compatible variable names in color.palette

So that validation handles making clear variable names and downstream users, like Shiny, don't need to make the change.

Done in brand_yml in adbcbb630506f8dfc0936f709c91fc9fc0491fcb and 00cb57b859bdfeb908527704c35328e7e783fedf


Allow anonymous read access for endpoints protected by APIRestrictedPermission

This was not working as advertised in the docstring.
Fixes #1659.

I believe this is already addressed in #1672, with a more fully automated testing solution. Would love review of that.

True. I missed that.

The tests in this PR are more comprehensive and should be included in the other PR I think

Pushed them into the other PR.


Just a collection of different issues encountered with mekanism v.<IP_ADDRESS>5

Hello aidan,
I'm gonna to write down here a list of issues that i encountered with mekanism before you release mekanism v.9.
(Most of them related with rftools too)
Some of these may you already know, others maybe you don't.
The first one is what happened in a all-day-dimension from rftools. When i've used the lasers to start a fusion reaction in the reactor all my solar panels became non-functional and even the new ones i was placing down after was non-funcional too

Another issue was a visual issue, the reaction inside the reactor was no more visible if the controller got removed and re-placed.
This one you see in the image instead:

Is still visual but i'm not sure because i don't remember exactly if it was also practical, because for example this one was practical:

As you can see in the screenshot when the chunk or the entire dimension was unloaded most of chunks was getting glitching.
Fluidic plenishers that you see in this screenshot had to be removed and re-placed down in order to operate again and fill again the basin that was needed for electric pumps because all the water gone every time the chunk was unloaded.
The last thing is about the reactor and i'm sure you already know that when you set the reactor on fuel usage of 22% it glitches and no longer need fuel to operate and start on it's max and if you set the fuel usage on an higer level than 22% the reactor begin to burn out.
I managed to resolve most of this problems putting down chunk loaders from chikken chunks in the area when this mekanism complex was built but some day later i encountered some massive lag problems.  https://github.com/CyberdyneCC/Thermos/issues/356
Probably related to solar evaporation towers.
This is kinda the summary, i hope this could be helpfull.

I'm pretty sure that the majority of these issues have been fixed as a result of the internal overhauls of all those depicted machinery.  If you still encounter them in v9 upon its release then I'll see about fixing them :)


IA-59 add device list

- Monitoring menu is added under admin

- Devices are listed using the SingleTable component

Same remark as on tasks table: ordering table by columns is active on the table, python code should order data too then. Otherwise disable sort on each column with sortable: false,

Same remark as on tasks table: ordering table by columns is active on the table, python code should order data too then. Otherwise disable sort on each column with sortable: false,

Done

Same remark as on tasks table: ordering table by columns is active on the table, python code should order data too then. Otherwise disable sort on each column with sortable: false,

Done


Shadowbringers (5.0) Actions and Recipes

All 5.0 recipes are missing from the crafting solver, and several actions need removed or changed in their placement. For example, all of the "Brand of [Element]" and "Name of [Element]" actions have been removed along with Byregot's Brow, and Byregot's Blessing and Steady Hand II are now innate skills and no longer cross-class actions, despite showing up in the cross-class macro generation.
Further, recipes over level 70 are not present.
Other changes may include calculations for recipe difficulty over 70, although the calculations for progress/quality seem accurate when using the solver for recipes =<70 even with gear >70.

There are also new foods e.g. blood bouillabaise which are not in the database for buff purposes.

There were a few minor adjustments as well, such as Inner Quiet and Innovation having a combined control cap of 3000, all specialist heart skills being limited to five uses per recipe, and Muscle Memory and Piece by Piece being capped at 1000 progress. I'm not certain if there were any others beyond those.

I have scraped the new recipes but I had to guess at the effective levels. However, my source for food/medicine buffs no longer works and I need to rewrite that code to use a new source.

I've uploaded the updated recipe database to the beta site. This includes things like level 71-80 recipes, the removal of elemental aspects and other new and changed recipes in the 1-70 range.
Let me know if the effective level for the 71-80 recipes seems off.

Suspect the scraper has some kind of issue, most of the 71-80 recipes are still missing. For example, in-game the Blacksmith 71-75 has 56 new recipes, like this:

Yeah, there was another change I had to make to the scraper. It's running again now but it takes a while since the Lodestone server throttles how fast it can load pages. I'll probably be able to update it tomorrow morning.

I feel stupid, where can I find the beta site to try out the 5.0 algorythms?

http://ffxiv-beta.lokyst.net/
On Sat, 6 Jul 2019 at 02:50, ikoyy<EMAIL_ADDRESS>wrote:

I feel stupid, where can I find the beta site to try out the 5.0
algorythms?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/doxxx/ffxiv-craft-opt-web/issues/272?email_source=notifications&email_token=AAFFQNFX2UAOKD5LOIKL4NTP6A6DZA5CNFSM4H4KKKH2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODZKTY5A#issuecomment-508902516,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAFFQNBESBKYPAEQF6XCVT3P6A6DZANCNFSM4H4KKKHQ
.

I know this is a separate issue but at least somewhat related to 5.0
My level is now above 70 and I cant set my level to be above 70 in the attributes section.

Another item not yet addressed is the various 'elemental' brands and names have been consolidated into one of each, "Name of the Elements" and "Brand of Elements." Appears to be available to all job types at level requirements, so not required to be a cross-class action.

More recipes should be available now and I've increased the max level in the attributes page.

Name/Brand of the Elements poses a bigger problem. Some countries like China are not on patch 5.0 yet AFAIK (@kongspark can you confirm?), so I can't simply remove the Name/Brand of Wind/Water/etc. actions. One solution would be to introduce a setting for patch level, which is a significant change that will take some time. I could add Name/Brand of the Elements in the meantime, but the solver won't know to avoid the old Name/Brand actions.

Although, I just realized that the recipe updates have removed elemental aspects so that's broken it partially for China already. :P

For the Chinese players, I've deployed the latest patch 4.x compatible code to the main site and will continue deploying patch 5.0 changes to the beta site.

Hey @doxxx have you considered changing the source of recipes mined from the ffxiv-datamining CSV's shouldn't have any issues with parsing that and getting all that data points, could also help replace the tooltip issues. It has all the data. Alternative you could use the tools they use to extract that data directly
ffxiv-datamining

@unfaiyted That looks interesting, although the data is very noisy. Lots of weird incomplete entries. And it looks like it's missing a lot of the crafting actions.
I'm currently looking at using Garland Tools as a data source for actions. See #276.

Saved synths which use removed actions should now show a ? icon instead of just an empty slot.

I was thinking that now the game shows the values of progress at 100% perhaps that would be useful to include on the initial display as a double check that the base calcs are right.
I'm assuming that work needs to be done to determine the 71+ scaling levels is there anything we can do to assist determining those values?

@ShammyLevva Could you post a screenshot?

He's talking about this, look at the top right.
https://i.imgur.com/GAtflSi.png

Another option would be a way to override the quality/progress calculation by inputting the values the game gives you for a more accurate solve, until we have figured out the algorithm properly

Yes but the issue with that is the numbers can and do change after certain skills are used - eg: when you use a skill that buffs the quality. So changing the starting progress/quality numbers whilst potentially useful for debugging doesn't help understand how the figures are derived by the game and how the skills used affect it because you'd not be able to change inaccurate values mid way through a skill sequence.

This does give us a non-destructive way to collect data from the game about the relationships between the various attributes, levels, etc.
On Jul 11, 2019, 7:29 AM -0400, Alexander Bisset<EMAIL_ADDRESS>wrote:

Yes but the issue with that is the numbers can and do change after certain skills are used - eg: when you use a skill that buffs the quality. So changing the starting progress/quality numbers whilst potentially useful for debugging doesn't help understand how the figures are derived by the game and how the skills used affect it because you'd not be able to change inaccurate values mid way through a skill sequence.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

@ShammyLevva
That is already handled, the most inaccurate thing about the solver right now is the base progress/quality calculation

@gr3ger yup hence my suggestion that with this info on the page and the info in game it would be possible to do a data collection exercise and actively test different functions solver vs game to see if there was an identifiable pattern that could lead to fixes and more accuracy.
It might also allow better reporting by users if they can say I did X and it indicated Y but in game it said Z.

To do that we will need to know the "effective crafter level" for levels 71-80. This is the current table:
    51: 120,
    52: 125,
    53: 130,
    54: 133,
    55: 136,
    56: 139,
    57: 142,
    58: 145,
    59: 148,
    60: 150,
    61: 260,
    62: 265,
    63: 270,
    64: 273,
    65: 276,
    66: 279,
    67: 282,
    68: 285,
    69: 288,
    70: 290

With the values for 71-80, I should be able to calculate the base progress & quality amounts using our current formula a display those like you suggested.

Happy to help - how do we go about determining those figures? They look a bit like the average gear level for an item at that level?

One way is to take the existing base progress/quality formula and using an actual progress/quality value from the game plug those values along with craftsmanship/control into the formula to determine the crafter to recipe level difference that would result in that value. Basically, reformulate the equation such that level difference is the output instead of the base progress/quality value.
That only applies if the coefficients for the current tier are correct for the new level range. If not, then we'll need a bunch of progress/quality values with corresponding crafter level, recipe level, craftsmanship and control, and apply the Excel solver (😄) to the data to determine the effective crafter levels and coefficients. This requires a broad set of data from different crafters to cover enough variation to achieve a good fit.

@ShammyLevva's changes have been deployed to the beta site.

Note that the new actions have placeholder icons and are not actually distinguishable yet. I need to add simple name tooltips to replace the XIVDB tooltips.

I've implemented replacement action tooltips with all the basic information.

I don't really get how you want us to fill in the table.
Don't we need: crafter level, craftmanship, control and level of recipe to be able to determine the correct values?

Yes, see my description above.
On Jul 12, 2019, 3:09 AM -0400, Jonas Henriksson<EMAIL_ADDRESS>wrote:

I don't really get how you want us to fill in the table.
Don't we need: crafter level, craftmanship, control and level of recipe to be able to determine the correct values?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

I'm still not a hundred percent sure what the second value in the table is.
But if you want I can give you some samples from my different crafters and
different recipes, and then skew the stats by equipping different gear.
Ironically, math isn't my strong suit.
On Fri, 12 Jul 2019, 15:11 Gordon Tyler<EMAIL_ADDRESS>wrote:

Yes, see my description above.
On Jul 12, 2019, 3:09 AM -0400, Jonas Henriksson<EMAIL_ADDRESS>wrote:

I don't really get how you want us to fill in the table.
Don't we need: crafter level, craftmanship, control and level of recipe
to be able to determine the correct values?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/doxxx/ffxiv-craft-opt-web/issues/272?email_source=notifications&email_token=AADPPMGS3E26MH7N7F57NZLP7B7G5A5CNFSM4H4KKKH2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODZZWX2Y#issuecomment-510880747,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AADPPMCKD2IYUYMXU65ZWZ3P7B7G5ANCNFSM4H4KKKHQ
.

Given the gearing I suspect the following values:
71 is 330,
74 is 370,
77 is 400,
80 is 430.
These all seem consistent with previous levels. Interpolating thus gives...
71=330,
72=343,
73=357,
74=370,
75=380,
76=390,
77=400,
78=410,
79=420,
80=430.
I've stuck that in a pull request so you can import them. I'm not sure what Ing1RecipeLevelTable & Ing2RecipeLevelTable values are for though?
If you can add the display values for 100% progress and 100% quality to the beta site as suggested above. We can then compare to see if the projected values from this interpolated values match in game.

The beta site now shows 100% efficiency values for progress and quality. These values will obviously be wrong for levels 71-80.
I've created a branch (dev/272-level-71-80-model) with the proposed effective crafter levels, which you should be able to try out with a local copy of the site.

We have a new set of formulas for progress and quality increase. These changes are available on the beta site (ffxiv-beta.lokyst.net). Please let me know if these discrepancies are resolved.


fix: IntrospectionData gone in @urql/exchange-graphcache v5.2.0

Describe the bug
In v5.0.9 I used import { IntrospectionData } from '@urql/exchange-graphcache/dist/types/ast' but that does not work anymore in v5.2.0. In the new version I see IntrospectionData as non-exported type in dist/urql-exchange-graphcache-chunk.d.ts. Am I not supposed to access it anymore?
Reproduction
will provide if description is not clear already
Urql version
@urql/exchange-graphcache 5.2.0
Validations

[X] I can confirm that this is a bug report, and not a feature request, RFC, question, or discussion, for which GitHub Discussions should be used
[X] Read the docs.
[X] Follow our Code of Conduct

2db32951dbfdb849616a909721ee1085b99096e3 somehow didn't keep the exports, could that be?

Generally it's not really the purpose to rely on nested imports when they're not defined in the export-maps as these are considered internal. We could however export this type and as an in-between typeof CacheExchangeOpts['schema'] offers the same result.

Thank you for the information and alternatives!


Move to Next's app directory

This app would definitely benefit from nested layouts and such.

Tried this but didn't work out great. Reconsider when these features stabilise.

Thinking about this a little more I feel like I probably prematurely closed this and gave up too soon. It should be absolutely fine to make this move, especially for this app. Going to reopen and probably do this is part of #202.


Feature/wireframe updates

Summary of changes
Free-response form:

Fix character count to show number of characters used
Do not translate times, instead change it to say "19:00 (7pm)" instead of just "7pm"

Card-sort form:

Add labels to the free-response answers displayed above the cards to clarify what question they belong to:

Rating form:

Alternate condition in rating-form question

Testing notes
Needs https://github.com/CenterForOpenScience/isp/pull/44 merged

Done making those changes @samchrisinger! ☀  https://github.com/CenterForOpenScience/isp/pull/45 saves the experiment condition on the session so it needs to be merged before this one.

Thanks!


MONAI Label req support for OIDC authorisation code flow

Current support only includes password auth against OIDC provider.

Closed and moved to AIS project


XLA Asynchronous compilation

XLA Asynchronous compilation
1) add option to opt into asynchronous compilation
2) asynchronous compilation uses a dedicated number of threads
to start a cluster instance compilation while the fallback path
is executed
3) limit number of ongoing compilations to a fixed threshold
change some VLOG levels to make level 2 less verbose

@bas-aarts  Can you please check @sanjoy's comments and keep us posted ? Thanks!

@bas-aarts  Can you please check @sanjoy's comments and keep us posted ? Thanks!

@bas-aarts Any update on this PR? Please. Thanks!

It has been 15 days with no activity and the awaiting response label was assigned. Is this PR still valid? Assigning the stalled label. Please comment to reassure me that this is still being worked on.

This PR is still being worked on

@bas-aarts Can you please check @sanjoy's comments and keep us posted ? Thanks!

@bas-aarts Can you please check @sanjoy's comments and keep us posted ? Thanks!

will also add a test

will also add a test

Are you still working on this or do you want me to review this now?

Are you still working on this or do you want me to review this now?

Are you still working on this or do you want me to review this now?

Haven't gotten to the test yet. Will ping you when it's there.

added a test

investigating the failures

@sanjoy please advise how to fix the cla issue. I only have one account, and don't know how to address

@googlebot I fixed it.

@sanjoy please advise how to fix the cla issue. I only have one account, and don't know how to address

The f234816e414e1842a7cdbcd2962d1b97dde2e080 commit has a different icon on github, can you please verify if that one is also from your NVIDIA email address?

the last commit came from on machine where I did not set my email address (git config user.email is empty).
How do I fix it at this point?

the last commit came from on machine where I did not set my email address (git config user.email is empty).
How do I fix it at this point?

I suspect editing the commit to have the right email and then force pushing should do the trick?

@googlebot I fixed it.

the last commit came from on machine where I did not set my email address (git config user.email is empty).
How do I fix it at this point?

I suspect editing the commit to have the right email and then force pushing should do the trick?

yep. Thanks. My last change should fix the errors in the CI


Update why-cset.rst

substantial re-write

HOw do I get rid of the trailing white space if editing through the github browser please?

The trailing whitespace is where you have multiple (or none) newlines at the end of the file.
TBH the GitHub browser editor isn't great for that kind of thing. I'll check it out locally and reflow the text.

changes addressed. thanks you  :-)


add custom endpoint path

Before submitting

[ ] Was this discussed/agreed via a Github issue? (no need for typos and docs improvements)
[ ] Did you read the contributor guideline, Pull Request section?
[ ] Did you make sure to update the docs?
[ ] Did you write any new necessary tests?

What does this PR do?
Fixes #90
PR review
Anyone in the community is free to review the PR once the tests have passed.
If we didn't discuss your PR in GitHub issues there's a high chance it will not be merged.
Did you have fun?
Make sure you had fun coding 🙃

this came up yesterday while serving an agentic model with endpoint path in an specific format. but yeah, make total sense about standardization @williamFalcon


Merged pattern includes together for text.html.basic

Except that this would cause tags‑valid, tags‑invalid and entities to be loaded before EJS tags.

Taking the work from here, I have been working on loading html as the default language then load EJS then javascript. It is working about 80%. I do not see any issues with the highlighting but when I inspect the scopes, it seems like javascript block is taking precedence over ejs when there is nested blocks.
`
<% for(var i = 0; i < 10; i++) { %>
Hi
<% if(i%2 == 0) { %>
foo
<% } %>
bye
<% } %>
`
The second set of ejs tags is registering as javascript. Does not really cause issues with highlighting, just annoying that the scope is not being recognize correctly. I create a branch with my changes. I do not want to push it to prod yet.

See branch: top-level-html for updated code.

Thank you for that insight, I didn't realize that the order of includes was relevant.


Dynamic options list in Editable select column

I have a problem where I have one column that is a type and another that is a refine on said type:
const posTypes = ["Any", "Noun", "Verb", "Adjective", "Adverb", "Cardinal number"];
const posRefineTypes = {
  "Any": [],
  "Noun": ["Any", "Single", "Plural", "Proper noun single", "Proper noun plural"],
  "Verb": ["Any", "Base form", "Past tense", "gerund or present participle", "past participle", "non-3rd person singular present", "3rd person singular present"],
  "Adjective": ["Any", "Comparative", "Superlative"],
  "Adverb": ["Any", "Comparative", "Superlative"],
  "Cardinal number": []
};
...

           <TableHeaderColumn
                dataField='Pos' editable={ {type: 'select', options: {values: posTypes}} }
                width={"120px"}>
              Pos
            </TableHeaderColumn>

            <TableHeaderColumn
                dataField='Refine'
                editable={  {type: 'select', options: {values: posRefineTypes[Pos]}} }
                width={"120px"}>
              Refine
            </TableHeaderColumn>

I need the options in the sub type to match the type, but it has to be a constant.
Is there a way to get it done?

Pos is one column select value (stands for Parts Of Speech)
Refine is the next column, which has options that relate to the value selected in Pos.
Hope this clears a bit ...

@yakirg, I probably know your requirement, I'll consider to add this feature by a callback function, you can decide what options list you want depend on row data, that's what I think but I need to check code and no schedule promise here, sorry for that due to busy recently. thanks

@Allen, a callback will be great!  Thanks.

Created a PR with a suggested fix.
It is still problematic on the insert new dialog part, because the row doesn't exist, but it's usable as is.

@yakirg, nice !! I will check this out. 👍

Fixed on v4.0.0-beta.8

v4.0.0 release

Hi can you give an example of how to implement this? I need a similar functionality

Hi, I believe I am still having the problem @yakirg mentioned where the the "row" is undefined in the insert dialog, and so I cannot choose my values this way for the insert dialog. Is there a fix for this?

The insert dialog was never fixed, and I had difficulty implementing it, as
there is no 'row' object available at that stage. I wish it was fixed, but
it was not critical for my application, so I did not pursue it further.
On Thu, Dec 7, 2017, 6:25 PM Shannon Benson<EMAIL_ADDRESS>wrote:

Hi, I believe I am still having the problem @yakirg
https://github.com/yakirg mentioned where the the "row" is undefined in
the insert dialog, and so I cannot choose my values this way for the insert
dialog. Is there a fix for this?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/AllenFang/react-bootstrap-table/issues/1423#issuecomment-350125910,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AIyabC-eJA5z4CPbTmY5IGQNUpkY62Z2ks5s-HPdgaJpZM4OF32Q
.

I am not able to get this going. I am trying to filter the drop down menu options based on the value of one of the other columns, but the column it depends on is not editable.
    const dropDownOptions = {
      type: 'select',
      options: { values: this.state.selected_values['Product_Name'] }
    };

this.state.selected_values is an object which has the same structure as posRefineTypes defined above, with the key being values of 'Product_Name' and the values being array of facilities.
  <TableHeaderColumn width='35%' dataField='Product_Name' isKey dataAlign="center" dataSort={ true } >Product Name</TableHeaderColumn>
  <TableHeaderColumn width='35%' dataField='facility_name'  dataAlign="center" editable={dropDownOptions} dataSort={ true }>Fixed Facillity Name</TableHeaderColumn>

Is this correct?

@AllenFang @yakirg was the insert dialog issue fixed here ?
Please respond, critical situation.
Thanks & Regards,
Ashish Deshpande

My last comment still stands. The insert was never fixed (to my knowledge) but it's not too critical for me, my users create first and edit later.

I am not able to get this going. I am trying to filter the drop down menu options based on the value of one of the other columns, but the column it depends on is not editable.
    const dropDownOptions = {
      type: 'select',
      options: { values: this.state.selected_values['Product_Name'] }
    };

this.state.selected_values is an object which has the same structure as posRefineTypes defined above, with the key being values of 'Product_Name' and the values being array of facilities.
  <TableHeaderColumn width='35%' dataField='Product_Name' isKey dataAlign="center" dataSort={ true } >Product Name</TableHeaderColumn>
  <TableHeaderColumn width='35%' dataField='facility_name'  dataAlign="center" editable={dropDownOptions} dataSort={ true }>Fixed Facillity Name</TableHeaderColumn>

Is this correct?

i am facing a similar issue how to resolve it?


Issue with writeCharacteristic()

I am trying to connect to an Adafruit nrf8001 hooked up to an Arduino. It uses the UART service with the UUID 6E400001-B5A3-F393-E0A9-E50E24DCCA9E as defined here. I communicates with the TX and RX characteristics. I can connect to the device perfectly fine, but when I try to write to the TX characteristic, I get the error:
D/FlutterBluePlugin(20492): [onCharacteristicWrite] uuid: 6e400002-b5a3-f393-e0a9-e50e24dcca9e status: 128
E/flutter (20492): [ERROR:flutter/lib/ui/ui_dart_state.cc(148)] Unhandled Exception: Exception: Failed to write the characteristic
E/flutter (20492): #0      BluetoothDevice.writeCharacteristic.<anonymous closure>
    ../…/src/bluetooth_device.dart:132
... full output below

I set up my scanning for devices with:
setState(() {
  _scanning = true;
});
_scanSubscription =
  flutterBlue.scan(timeout: Duration(minutes: 1)).listen((scanResult) {
    if (scanResult.advertisementData.connectable) {
      setState(() {
        scanResults[scanResult.device.id] = scanResult;
      });
    }
  }, onDone: _cancelScanning);

and then I connect with:
setState(() {
  _deviceConnection = flutterBlue.connect(device).listen((s) {
    if (s == BluetoothDeviceState.connected) {
      print('Connected');
      setState(() {
        _device = device;
        _connected = true;
        _statusMessage = 'Connected to Cycler';
      });
      _cancelScanning();
      _discoverServices();
    } else {
      print('Not Connected');
      print(s.toString());
    }
  });
});

I then find the UART service and related characteristics as follows:
_discoverServices() {
  setState(() {
    _statusMessage = 'Discovering device services';
  });
  _device.discoverServices().then((s) {
    setState(() {
      _statusMessage = 'Services discovered';
      _deviceServices = s;
    });
    _findUART();
  });
}

_findUART() {
  if (_deviceServices != null && _deviceServices.isNotEmpty) {
    _deviceServices.forEach((service) {
      //servicesList.add(Text(service.uuid.toString()));
      if (service.uuid.toString().toLowerCase() ==
          '6E400001-B5A3-F393-E0A9-E50E24DCCA9E'.toLowerCase()) {
        print('UART found');
        _uartService = service;
        service.characteristics.forEach((c) {
          if (c.uuid.toString().toLowerCase() ==
              '6E400002-B5A3-F393-E0A9-E50E24DCCA9E'.toLowerCase()) {
            _tx = c;
            print('TX found');
          } else if (c.uuid.toString().toLowerCase() ==
              '6E400003-B5A3-F393-E0A9-E50E24DCCA9E'.toLowerCase()) {
            _rx = c;
            print('RX found');
          }
        });
      }
    });
  }
}

Then I have a button onPressed: linked to the method _sendTest
_sendTest() async {
  final value = await _device.writeCharacteristic(_tx, [0x12, 0x34],
      type: CharacteristicWriteType.withResponse);
  print(value);
}

Using Flutter 1.2.1. Running on Samsung Galaxy S8. Please let me know if you need any more relevant information.
  I found that to be a problem before on iOS.

I have tried that before.

Hey,
I'm also having a similar problem with writing a characteristic, but only on Android devices.
iOS is working fine.
E/flutter ( 7662): [ERROR:flutter/lib/ui/ui_dart_state.cc(148)] Unhandled Exception: PlatformException(write_characteristic_error, writeCharacteristic failed, null) E/flutter ( 7662): #0      StandardMethodCodec.decodeEnvelope (package:flutter/src/services/message_codecs.dart:564:7) E/flutter ( 7662): #1      MethodChannel.invokeMethod (package:flutter/src/services/platform_channel.dart:302:33) E/flutter ( 7662): <asynchronous suspension> E/flutter ( 7662): #2      BluetoothDevice.writeCharacteristic (file:///Users/earyzhe/dev/SDKs/flutter/.pub-cache/hosted/pub.dartlang.org/flutter_blue-0.5.0/lib/src/bluetooth_device.dart:114:10) E/flutter ( 7662): <asynchronous suspension> E/flutter ( 7662): #3      BluetoothInstance._turnSwitchOff (package:battery_saver/bluetooth_functions.dart:131:13) E/flutter ( 7662): <asynchronous suspension> E/flutter ( 7662): #4      BluetoothInstance.stopCharging (package:battery_saver/bluetooth_functions.dart:40:5) E/flutter ( 7662): #5      MainBloc.batteryChargeChanged (package:battery_saver/bloc.dart:87:18) E/flutter ( 7662): #6      _rootRunUnary (dart:async/zone.dart:1132:38) E/flutter ( 7662): #7      _CustomZone.runUnary (dart:async/zone.dart:1029:19) E/flutter ( 7662): #8      _CustomZone.runUnaryGuarded (dart:async/zone.dart:931:7) E/flutter ( 7662): #9      _BufferingStreamSubscription._sendData (dart:async/stream_impl.dart:336:11) E/flutter ( 7662): #10     _DelayedData.perform (dart:async/stream_impl.dart:591:14) E/flutter ( 7662): #11     _StreamImplEvents.handleNext (dart:async/stream_impl.dart:707:11) E/flutter ( 7662): #12     _PendingEvents.schedule.<anonymous closure> (dart:async/stream_impl.dart:667:7) E/flutter ( 7662): #13     _rootRun (dart:async/zone.dart:1120:38) E/flutter ( 7662): #14     _CustomZone.run (dart:async/zone.dart:1021:19) E/flutter ( 7662): #15     _CustomZone.runGuarded (dart:async/zone.dart:923:7) E/flutter ( 7662): #16     _CustomZone.bindCallbackGuarded.<anonymous closure> (dart:async/zone.dart:963:23) E/flutter ( 7662): #17     _rootRun (dart:async/zone.dart:1124:13) E/flutter ( 7662): #18     _CustomZone.run (dart:async/zone.dart:1021:19) E/flutter ( 7662): #19     _CustomZone.runGuarded (dart:async/zone.dart:923:7) E/flutter ( 7662): #20     _CustomZone.bindCallbackGuarded.<anonymous closure> (dart:async/zone.dart:963:23) E/flutter ( 7662): #21     _microtaskLoop (dart:async/schedule_microtask.dart:41:21) E/flutter ( 7662): #22     _startMicrotaskLoop (dart:async/schedule_microtask.dart:50:5)

Hmm.... I can't find any documentation on the error code 128 I was getting. I've been looking for a few days. Anyone?

On iOS with iPhone 7 i still get an error
didWriteValueForCharacteristic
[VERBOSE-2:ui_dart_state.cc(148)] Unhandled Exception: Exception: Failed to write the characteristic
#0      BluetoothDevice.writeCharacteristic.<anonymous closure>
../…/src/bluetooth_device.dart:132
#1      _rootRunUnary (dart:async/zone.dart:1132:38)
#2      _CustomZone.runUnary (dart:async/zone.dart:1029:19)
#3      _FutureListener.handleValue (dart:async/future_impl.dart:126:18)
#4      Future._propagateToListeners.handleValueCallback (dart:async/future_impl.dart:639:45)
#5      Future._propagateToListeners (dart:async/future_impl.dart:668:32)
#6      Future._complete (dart:async/future_impl.dart:473:7)
#7      _cancelAndValue (dart:async/stream_pipe.dart:63:12)
#8      Stream.first.<anonymous closure> (dart:async/stream.dart:1170:11)
#9      _rootRunUnary (dart:async/zone.dart:1132:38)
#10     _CustomZone.runUnary (dart:async/zone.dart:1029:19)
#11     _CustomZone.runUnaryGuarded (dart:async/zone.dart:931:7)
#12     _BufferingStreamSubscription._sendData (dart:async/stream_impl.dart:336:11)
#13     _BufferingStreamSubscription._add (dart:async/stream_impl.dart:263:7)
#14     _ForwardingStreamSubscription._add (dart:async/stream_pipe.dart:132:11)
#15     _WhereStream._handleData (dart:async/stream_pipe.dart:207:12)
#16     _ForwardingStreamSubscription._handleData (dart:async/stream_pipe.dart:164:13)
#17     _rootRunUnary (dart:async/zone.dart:1132:38)
#18     _CustomZone.runUnary (dart:async/zone.dart:1029:19)
#19     _CustomZone.runUnaryGuarded (dart:async/zone.dart:931:7)
#20     _BufferingStreamSubscription._sendData (dart:async/stream_impl.dart:336:11)
#21     _BufferingStreamSubscription._add (dart:async/stream_impl.dart:263:7)
#22     _ForwardingStreamSubscription._add (dart:async/stream_pipe.dart:132:11)
#23     _MapStream._handleData (dart:async/stream_pipe.dart:232:10)
#24     _ForwardingStreamSubscription._handleData (dart:async/stream_pipe.dart:164:13)
#25     _rootRunUnary (dart:async/zone.dart:1132:38)
#26     _CustomZone.runUnary (dart:async/zone.dart:1029:19)
#27     _CustomZone.runUnaryGuarded (dart:async/zone.dart:931:7)
#28     _BufferingStreamSubscription._sendData (dart:async/stream_impl.dart:336:11)
#29     _BufferingStreamSubscription._add (dart:async/stream_impl.dart:263:7)
#30     _ForwardingStreamSubscription._add (dart:async/stream_pipe.dart:132:11)
#31     _MapStream._handleData (dart:async/stream_pipe.dart:232:10)
#32     _ForwardingStreamSubscription._handleData (dart:async/stream_pipe.dart:164:13)
#33     _rootRunUnary (dart:async/zone.dart:1132:38)
#34     _CustomZone.runUnary (dart:async/zone.dart:1029:19)
#35     _CustomZone.runUnaryGuarded (dart:async/zone.dart:931:7)
#36     _BufferingStreamSubscription._sendData (dart:async/stream_impl.dart:336:11)
#37     _BufferingStreamSubscription._add (dart:async/stream_impl.dart:263:7)
#38     _ForwardingStreamSubscription._add (dart:async/stream_pipe.dart:132:11)
#39     _WhereStream._handleData (dart:async/stream_pipe.dart:207:12)
#40     _ForwardingStreamSubscription._handleData (dart:async/stream_pipe.dart:164:13)
#41     _rootRunUnary (dart:async/zone.dart:1132:38)
#42     _CustomZone.runUnary (dart:async/zone.dart:1029:19)
#43     _CustomZone.runUnaryGuarded (dart:async/zone.dart:931:7)
#44     _BufferingStreamSubscription._sendData (dart:async/stream_impl.dart:336:11)
#45     _DelayedData.perform (dart:async/stream_impl.dart:591:14)
#46     _StreamImplEvents.handleNext (dart:async/stream_impl.dart:707:11)
#47     _PendingEvents.schedule.<anonymous closure> (dart:async/stream_impl.dart:667:7)
#48     _rootRun (dart:async/zone.dart:1120:38)
#49     _CustomZone.run (dart:async/zone.dart:1021:19)
#50     _CustomZone.runGuarded (dart:async/zone.dart:923:7)
#51     _CustomZone.bindCallbackGuarded.<anonymous closure> (dart:async/zone.dart:963:23)

Just guessing- but have you tried without CharacteristicWriteType.withResponse ? I found that to be a problem before on iOS.

If we don't use CharacteristicWriteType.withResponse, what alternatives do we have?

Just guessing- but have you tried without CharacteristicWriteType.withResponse ? I found that to be a problem before on iOS.

If we don't use CharacteristicWriteType.withResponse, what alternatives do we have?

CharacteristicWriteType.withoutResponse

Just guessing- but have you tried without CharacteristicWriteType.withResponse ? I found that to be a problem before on iOS.

If we don't use CharacteristicWriteType.withResponse, what alternatives do we have?

CharacteristicWriteType.withoutResponse

Using CharacteristicWriteType.withoutResponse, the error doesn't show, but the information is never sent.

Brad,
Just partially used your example and it's working for me. main.dart here -> http://sayaw.net/main_dart.txt

Please note sonny's example requires version 0.5.0
Version 0.6.0 will break it

For some reason, the code just recently began working using CharacteristicWriteType.withoutResponse. I think I updated flutter so not sure if there were any updates during that time. My code is here

I am having the same issue with the example application provided with flutter_blue. Is there a particular version of fluttter_blue(0.5.0?) and a certain version of flutter the only solution to fix this issue?

hey, guys, I am having the same issue, any update?

Also getting the status 128 issue when my message size exceeds 244 bytes.

My code works using flutter_blue: ^0.5.0. I only send a few bytes of info to keep latency low. Again, a link to my working code: https://github.com/BradHacker/cycler-controller
There is an Arduino on the other end that reads the values sent and does some logic to control a humanoid robot. Everything seems to work bluetooth wise. Having some issues on the Arduino end that have nothing to do with bluetooth (primarily being just plain out of pins using an Uno).
I'm a student and currently on summer break so I have to wait till September to begin working again on the robot. We ordered some Teensy 3.6 boards to replace them which will only improve the processing time. I highly recommend these boards.

flutter_blue 0.6.2 PlatformException (PlatformException(write_characteristic_error, service (daebb240 - 00ffffffff ) could not be located on the device, null))method used:
await vibChar.write(startVibrating, withoutResponse: true);

how flutter_blue knows that he is talking to correct device? im writing simply to characteristic, and i have no place to specify device.

I have this issue specifically if I connect to a bottle, write and get data successfully, disconnect, but then try to connect again. Any ideas why this might be?

Guys, the code and troubleshooting in this thread helped me build my product faster. Parts of the code in the question and answers should be included in the official documentation and readme. I spent almost 6 hours trying to find answers online and in code.

hi, I have been trying to connect mi band 5 to my flutter app using flutter_blue but I'm getting an empty array which means characteristics are null. I can't find the issue why specifically happening this and if I can get help to solve this issue it will be a great help.
thank you for your time and considerations!


grd.me messaging

From @arnottcr on March 3, 2015 17:43
while we are considering pipe dreams, how about we add a messaging service that is interoperable with textsecure/signal; this will require pfs, and we should aim to stay close to the reference axolotl implementation, but I think we can leverage the unused portions of the phone-number namespace, so that we can communicate with textsecure users.
Copied from original issue: winhowes/grd.me#32

From @winhowes on September 19, 2015 4:43
This looks like it's going to be feasible after all with the pfs implementation we've agreed on ;)

From @winhowes on March 5, 2015 1:39
+1 (and pfs hijack :p)

From @winhowes on March 5, 2015 1:39
+1 (and pfs hijack :p)

From @winhowes on September 19, 2015 4:43
This looks like it's going to be feasible after all with the pfs implementation we've agreed on ;)


T::Struct#with can't be aliased for some reason

Input
→ View on sorbet.run
# typed: strict

class MyStruct < T::Struct
  extend T::Sig

  const :name, String

  alias update with
end

MyStruct.new(name: 'Donald').with(name: 'Mickey')

Observed output
editor.rb:10: Can't make method alias from update to non existing method with https://srb.help/5037
    10 |  alias update with
                       ^^^^
Errors: 1

Expected behavior
I'd expect alias not to raise an error since Sorbet clearly knows the method exists.

Thank you for pointing that out @froydnj, I'm not really sure how I missed that!
I was going crazy because I could definitely see Sorbet knows about the method, but the explanation about the resolution order makes sense 👍


OpenFyde r108

When will r108 or newer be available for x64 Intel PCs? Thanks!

It’ll be released in next week. Thanks.

It was released just now. So Im gonna close the issue.

Thank you!


🐛 [BUG]: panActivationKeyCode does not enable panOnDrag

Is there an existing issue for this?

[X] I have searched the existing issues and this is a new bug.

Current Behavior
When the panActivationKeyCode is triggered, panOnDrag is disabled and panning the viewport is not possible unless a user is using scroll to pan.
Expected Behavior
When the panActivationKeyCode is triggered, panOnDrag should be enabled, even if panOnDrag is set to false.
Steps To Reproduce
No response
Relevant log output
No response
Anything else?
No response

Fixed with 1.24.1


Add EndpointSecret Validation

Ensure that incoming endpoint secrets are validated; this also fixes a possible panic in deserialization when an invalid secret shorter than the key prefix is submitted.

This works, although it would be nice to not have to re-encode for validation


argon4:// url handler not working

Tried argon4://shadow-test-argon-vuforia.glitch.me and it starts Argon4, but doesn't open the page

Fixed on iOS, one remaining issue on Android: https://github.com/argonjs/argon-app/issues/85


[py2py3] fix issue #10398

Fixes #10398
Status
Ready
Description
Using next(iter(dictbinds)) instead of dictbinds.keys()[0] in test/python/WMCore_t/Database_t/DBCore_t.py/
Is it backward compatible (if not, which system it affects?)
Yes
Related PRs
Follow-up to #10262
External dependencies / deployment changes
No change

Thanks Alan! sorry for opening such a small issue, when I noticed this problem I had no idea where to put this! :sweat_smile: Thanks again!


nowide::cout crashes in multithreaded

When I call nowide::cout from different threads it crashes. std::cout works fine.

reviewfixes branch seemed to fix that problem, so closing.

Just FYI there is no thread safety guarantee on neither std::cout/cerr nor on std::nowide::cout/cerr

I'm aware of it, but std::cout just produce mangled output. Thanks for fixing it though.


An unexpected error occurred. FileSystemException: Cannot open file, path =

Hello,
after "dart run arcgis_maps install" i become the error "An unexpected error occurred.
Thank you for your feedback.
For the initial phase of the beta, we are only supporting macOS as a development host, and so that is why the installation has failed with the Windows path as you describe.
It should be technically feasible to use Windows as the development host and target Android for deployment -- we just have to devote the resources to making it work (and that includes the Samples workflows). We chose macOS initially with it being required for iOS development, and with the ArcGIS Maps SDK targeting both Android and iOS.
All that said - the fact that you are looking to use Windows as the development host is useful feedback to us!
Out of interest, do you plan to target iOS as well, or Android only?
Please feel free to respond here, or use the Early Adopter forum if you wish to discuss further.
Thanks again for your feedback!

we are targeting all 3 platforms ios, android and web.
thx

For deployment targets we are initially supporting iOS and Android.
Deploying on Windows and macOS is on our longer-term roadmap, and your feedback helps us prioritize our future efforts.
As for web, we don't intend to support web as a target with ArcGIS Maps SDK for Flutter as it is not suitable for our Native SDKs - our ArcGIS Maps SDK for JavaScript is better placed for web projects.
Your feedback is useful, so thanks again!

Ok thanks for the answer. but with Flutter you can very quickly
create an exe for windows or a web app with just one click and you don't need any additional knowledge about a java-script sdk.
and that is ultimately a huge advantage!
But time will tell.

Closing this issue as answered. We will be releasing a Beta 2 release of ArcGIS Maps SDK for Flutter in just a few weeks in August, and we will be officially supporting Windows as a development host. Our position on support for Desktop and web deployment remain as per my above response.
Don't hesitate to reopen this issue or get in touch via our Early Adopter forum if you have any other questions. Thank you!


Need clean&simple quickstart base on shell without docker.

Describe This Problem
Is possible to prepare a non-docker quickstart. Or prepare a tips with docker versions(and other tools like docker-compose). The quick-start is not work for some old version or unclear and complex docker network. It`s hard to start (mostly is blame on docker).
Proposal
Maybe we can start the mysql mongodb and anyothers with a simple shell on standard linux whatever the distribution is. And so on  the new starters can quickly take a view of the whole software.
Thanks for times.
Additional Context
No response

Hi @ferdiknight. Thank you for your feedback.
Could you provide your docker & docker-compose version info and your computer configuration info?
The 'quick-start' does not use any advanced features of docker & docker-compose. So it is expected to run in most docker versions.

The 'Quick Start' demo requires docker-compose V2.
I test docker-compose V1 and docker-compose V2 locally.
docker-compose V1 doesn't work for 'Quick Start' demo.

I fix the doc firstly. See https://github.com/traas-stack/holoinsight/pull/187
And I will use another PR to supports docker-compose V1.

Hi @ferdiknight .
I test the 'quick start' demo with docker-compose v1.29.2 and docker compose v2.
This two versions work well. I have update the docs with tips about the docker compose version.
See https://github.com/traas-stack/holoinsight/pull/188.
The demo bootstrap is somewhat complicated. It need 3 external db, and need to initialize them(schema or initial data) before running the server. And then install agent into the server container.
I thinks the demo bootstrap based on docker is the best choice.


bootstrap failed

sudo CLUSTER_DOMAIN=** flynn-host bootstrap --min-hosts=3 /etc/flynn/bootstrap-manifest.json
sudo: unable to resolve host ip-10-200-128-22
20:31:26.017048 check online-hosts
20:31:26.021445 require-env require-env
20:31:26.021605 gen-random pg-password
20:31:26.022217 gen-random pg-password ee0be2f8f149800c1052bece0dd3a590
20:31:26.022237 run-app postgres
20:31:29.255903 gen-random controller-key
20:31:29.256067 gen-random controller-key 877bda8c8ae080e3d44ad7f45171aaca
20:31:29.256074 gen-random dashboard-session-secret
20:31:29.256101 gen-random dashboard-session-secret ee4896577d9158321e835983736f75de
20:31:29.256105 gen-random dashboard-login-token
20:31:29.256131 gen-random dashboard-login-token 5171688bc9b7da4cfc08681cfbdef37c
20:31:29.256135 gen-random name-seed
20:31:29.256213 gen-random name-seed a1de831061e71ca9d5a2
20:31:29.256218 wait postgres-wait
20:31:34.614995 run-app controller
20:31:38.481692 gen-tls-cert controller-cert
20:31:39.400287 gen-tls-cert controller-cert pin: i1QmOyahDi2M9hjUaS2qb7VtGlaoVhVqd4Jp7L1pAnM=
20:31:39.400330 wait controller-wait
20:31:40.098587 add-app controller-inception
20:31:40.160315 add-app postgres-app
20:31:40.189049 scale-app scheduler-scale
20:31:40.197299 run-app scheduler
20:31:40.841277 deploy-app blobstore
20:31:42.871298 deploy-app router
20:31:44.551499 gen-ssh-key gitreceive-key
20:31:45.185815 deploy-app gitreceive
20:31:45.238412 wait router-wait
20:31:45.926161 add-route gitreceive-route
20:31:45.929072 add-route gitreceive-route error: unknown_error: Something went wrong

Please run flynn-host collect-debug-info and post the link here.

node 1, https://gist.github.com/anonymous/4937a50af634e414f92b
node 3, https://gist.github.com/anonymous/fb7bdaf396b4f5fa9724
there were six attempts,
all subsequent displayed different error:
20:38:40.463358 check online-hosts
20:38:40.469382 require-env require-env
20:38:40.469524 gen-random pg-password
20:38:40.470175 gen-random pg-password 2ccf06bc51c1860aa979b474bf79bac9
20:38:40.470246 run-app postgres
20:38:48.221546 gen-random controller-key
20:38:48.221694 gen-random controller-key db91cd302e3ff5da03411834edd08537
20:38:48.221700 gen-random dashboard-session-secret
20:38:48.221738 gen-random dashboard-session-secret db9919f52571bcd49bcd5da2fc90a919
20:38:48.221743 gen-random dashboard-login-token
20:38:48.221770 gen-random dashboard-login-token b22eea0afe607ecbd6dce9321ad03543
20:38:48.221775 gen-random name-seed
20:38:48.221821 gen-random name-seed a786988dc5e80659cb71
20:38:48.221825 wait postgres-wait
20:38:48.224570 run-app controller
20:38:52.292649 gen-tls-cert controller-cert
20:38:53.862250 gen-tls-cert controller-cert pin: 4ZKuXtQvNe9Ysn50g3htAqlBMOMMfEZcYpPoYeRTAdI=
20:38:53.862282 wait controller-wait
20:38:53.866226 add-app controller-inception
20:38:53.869441 add-app controller-inception error: POST http://<IP_ADDRESS>:80/apps: httpclient: unexpected status 401

I'm going to close this, as I believe it was resolved in IRC.

yes, thank you


Avoid Adapters in task graphs?

Looking at an open_zarr computation from @rabernat I'm coming across intermediate values like the following:
>>> Future('zarr-adt-0f90b3f56f247f966e5ef01277f31374').result()
ImplicitToExplicitIndexingAdapter(array=LazilyIndexedArray(array=<xarray.backends.zarr.ZarrArrayWrapper object at 0x7fa921fec278>, key=BasicIndexer((slice(None, None, None), slice(None, None, None), slice(None, None, None)))))

This object has many dependents, and so will presumably have to float around the network to all of the workers
>>> len(dep.dependents)
1781

In principle this is fine, especially if this object is cheap to serialize, move, and deserialize.  It does introduce a bit of friction though.  I'm curious how hard it would be to build task graphs that generated these objects on the fly, or else removed them altogether.  It is slightly more convenient from a task scheduling perspective for data access tasks to not have any dependencies.

https://github.com/pangeo-data/pangeo/issues/99#issuecomment-363852820
also cc @jhamman

In principle this is fine, especially if this object is cheap to serialize, move, and deserialize.

Yes, that should be the case here. Each of these array objects is very lightweight and should be quickly pickled/unpickled.
On the other hand, once evaluated these do correspond to a large chunk of data (entire arrays). If this future needs to be evaluated before being passed around that would be a problem. Getitem fusing is pretty essential here for performance.

Do these objects happen to store any cached results?  I'm seeing odd performance issues around these objects and am curious about any ways in which they might be fancy.

Any concerns about recreating these objects for every access?

Do these objects happen to store any cached results? I'm seeing odd performance issues around these objects and am curious about any ways in which they might be fancy.

I don't think there's any caching here. All of these objects are stateless, though ZarrArrayWrapper does point back to a ZarrStore object and a zarr.Group object.

Any concerns about recreating these objects for every access?

No, not particularly, though potentially opening a zarr store could be a little expensive. I'm mostly not sure how this would be done. Currently, we open files, create array objects, do some lazy decoding and then create dask arrays with from_array.

No, not particularly, though potentially opening a zarr store could be a little expensive

What makes it expensive?

I'm mostly not sure how this would be done. Currently, we open files, create array objects, do some lazy decoding and then create dask arrays with from_array.

Maybe we add an option to from_array to have it inline the array into the task, rather than create an explicit dependency.
This does feel like I'm trying to duct tape over some underlying problem that I can't resolve though.

What makes it expensive?

Well, presumably opening a zarr file requires a small amount of IO to read out the metadata.

Well, presumably opening a zarr file requires a small amount of IO to read out the metadata.

Ah, this may actually require a non-trivial amount of IO.  It currently takes a non-trivial amount of time to read a zarr file.  See https://github.com/pangeo-data/pangeo/issues/99#issuecomment-363782191 .  We're doing this on each deserialization?

Ah, this may actually require a non-trivial amount of IO. It currently takes a non-trivial amount of time to read a zarr file. See pangeo-data/pangeo#99 (comment) . We're doing this on each deserialization?

We're unpickling the zarr objects. I don't know if that requires IO (probably not).

Where did we land here? Is there an action item that came from this discussion?
In my view, the benefit of having consistent getitem behavior for all of our backends is worth working through potential hiccups in the way dask interacts with xarray.

If things are operational then we're fine.  It may be that a lot of this
cost was due to other serialization things in gcsfs, zarr, or other.
On Fri, Mar 9, 2018 at 12:33 AM, Joe Hamman<EMAIL_ADDRESS>wrote:

Where did we land here? Is there an action item that came from this
discussion?
In my view, the benefit of having consistent getitem behavior for all of
our backends is worth working through potential hiccups in the way dask
interacts with xarray.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/pydata/xarray/issues/1895#issuecomment-371718136, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AASszGISdLyCz1vL3SwpdNv8CplC5hi1ks5tchQNgaJpZM4R9Svr
.

Maybe we add an option to from_array to have it inline the array into the task, rather than create an explicit dependency.

dask.array.from_array does now have an inline_array option, which I've just exposed in open_dataset in #6566. I think that would be a reasonable way to close this issue?


astral microtubule/astral spindle assembly

Follow on from
https://github.com/geneontology/go-ontology/issues/13106
Could astral microtubule be a descendent of "spindle pole"
There is a strange term
astral spindle assembly
The aggregation, arrangement and bonding together of a set of components to form the spindle, the array of microtubules and associated molecules that serves to move duplicated chromosomes apart, in the presence of centrosomes.
This sounds like  just "spindle assembly" ?

Plants are different. That is why this term exists.

But the term
astral spindle assembly
is a descendant of
mitotic spindle assembly
and it is only used once by FlyBase @hattrill could you have a look?
so it does not seem to have been requested for plant (even though Tanya added it)
Also,  based on Tanya's response that still does not explain this terms meaning...
Astral microtubules are defined as part of the SPB centrosome, so there can't be a logical difference between  a "mitotic spindle" and an "mitotic astral spindle"

[ ]  make astral microtuble a decendent of spindle pole (this should fit all logical defs)

[ ]  @hattrill  investigate what "astral spindle assembly" really means, if it is different from "spindle assembly" (astral microtubules are microtubules which  emenate from the SPB or centrosome)

Depending on Helen's reponse, possible merge  (or obsolete)
"astral spindle assembly"  -> spindle assembly
and
"astral spindle assembly involved in male meiosis" -> "mieotic spindle assembly involved in male meiosis"

I claim no specialist knowledge whatsoever, but from existing terms I infer that "astral spindle assembly" is the assembly of an astral spindle, as opposed to an anastral spindle. The latter form without centrosomes/spindle pole bodies, or so I gather from the definitions of the relevant terms:
GO:0051225 spindle assembly
-- is_a GO:0055048 anastral spindle assembly
-- is_a GO:0055049 astral spindle assembly

Note that the parent (GO:0051225) def does not mention centrosomes or SPBs, suggesting that the snippet above is basically correct.
Corresponding CC terms are not present, as far as I can tell; perhaps they should be added. Then astral MT could be part_of astral spindle pole.

Sorry the question should be what is the difference between
mitotic spindle assembly/meiotic   and  sibling
astral spindle assembly (both of these would be astral  spindles, are there others?)

The existence of GO:0055048 implies that there are others, namely anastral spindles. I don't know whether they come in mitotic, meiotic or both flavors, but at least one of 'mitotic spindle' and/or 'meiotic spindle' can't be a subclass of astral spindle (maybe both, depending on when the anastral spindles form).

OK, we can close. If some organisms "main mitotic spindle"  in anastral,  we would need astral and anastral flavours of everything and that isn't really necessary.
Will ignore...

OK, there are definitely anastral meiotic spindles in oocytes, e.g.:
http://www.cell.com/biophysj/pdf/S0006-3495(09)01362-9.pdf
http://bmccellbiol.biomedcentral.com/articles/10.1186/1471-2121-12-1
Tanya's comment on #13106 suggests that plants have anastral mitotic spindles, but double-check with her.  @tberardini

Glad you sorted this out before I lifted a finger - I had three papers set aside for some bedtime reading on the astral/anastral question, but I'll go back to my Mills and Boon now!


Ensure mount the volumes before sap-notes

Problem
There's an issue related to compat-sap-c++-x, the link is being created to /usr/sap/lib/libstdc++.so.6 before mounting the volume, and this shouldn't be the case.
Solution
Ensure mounting the volume before calling sap-notes role.
Tests

Notes

@nnoaman and @KimForss , let us have a quick call before we take a call on this PR.


Targa: Fix parsing of TGA 2.0 extension area.

Skip 3 bytes between "software" and "background (key) colour" for the "software
version" (was simply missing). Avoids that m_alpha_type is overwritten with
wrong values.
Tests
Did not create a new test case. Existing targa test fails for me (probably unrelated) with:
131/161 Test: targa
Command: "/usr/bin/python3.9" "/some_prefix/src/testsuite/runtest.py" "/some_prefix/src/build-debug/testsuite/targa"
Directory: /some_prefix/src/build-debug
"targa" start time: Feb 04 09:19 CET
Output:
----------------------------------------------------------
Traceback (most recent call last):
  File "/some_prefix/src/testsuite/runtest.py", line 452, in <module>
    exec (code)
  File "run.py", line 3, in <module>
ModuleNotFoundError: No module named 'OpenImageIO'
<end of output>
Test time =   0.04 sec
----------------------------------------------------------
Test Failed.
"targa" end time: Feb 04 09:19 CET
"targa" time elapsed: 00:00:00
----------------------------------------------------------

Checklist:

[x] I have read the contribution guidelines.
[ ] If this is more extensive than a small change to existing code, I
have previously submitted a Contributor License Agreement
(individual, and if there is any way my
employers might think my programming belongs to them, then also
corporate).
[ ] I have updated the documentation, if applicable.
[ ] I have ensured that the change is tested somewhere in the testsuite
(adding new test cases if necessary).
[x] My code follows the prevailing code style of this project.

CI fails testsuite, is printing different metadata than before. Either it was wrong before and right now, and the reference output from the targa test needs to be updating as part of the PR, or else it indicates that something about this patch is not correct.