fix: Fix Tekton installation

There is an issue by applying single app.yaml file and we fail to create CRDs and CRs in the same apply request [1]. This patch changes the approach on how to install tekton, first by creating CRD and then apply the rest of the Tekton Stack with CRs
[1]. https://github.com/kubernetes/kubectl/issues/1179
Thank you for wanting to submit a Pull Request to the Civo Kubernetes Marketplace repository!
If your pull request is to submit a new application to the marketplace, please answer the following questions:

[ ] Have you followed the guidelines in our Contributing document in setting up the application?
[ ] Have you checked that the application your submission is proposing to add does not yet exist on the Marketplace, or as a pull request to be processed?
[ ] Have you tested your application on the Civo managed Kubernetes service? Please include a screenshot.
[ ] Can you confirm that the software you are submitting licensed for use in a publicly-available Kubernetes marketplace?
[ ] Have you included the specific version of the application to be installed?

If your pull request concerns an existing Marketplace application, please make sure you have:

[x] Notified the Maintainer of the application in this pull request so that they are aware of your proposal.
[x] Outlined the changes you are proposing, and the reasons these are required (e.g. stability, compatibility with new versions of Kubernetes implementations, etc).
[x] Tested that the application works with the proposed updates applied (including a screenshot).
[x] Updated the version number of the app if that has changed.

Here is installation check:

Hello @ssmiller25, could you please review the patch?

@SergK Thanks for the PR!  Excellent bug you found - something that probably donesn't always appear in testing.  Out of curiosity, why did you only put one CRD in the install.sh script?  There are 16 in the app.yaml, and I assume all of them could potentially suffer the same issue?
Again, great find.  Just hoping to make sure this fully resolves any future issues.

@ssmiller25 The installation process creates only one type of custom resource (CR), which is the "clusterinterceptors" CR.
Therefore, we are only pre-creating CRD clusterinterceptors initially, and there's no need to pre-create other CRDs. Another goal is to keep everything working with the original Makefile (upstream updates), simplifying further manual updates so that the Make build will produce the expected results from upstream.

@SergK Gotcha!  Thanks for the clarification!  I should have looked to see actual CRs that were created during the install.  In that case, everything LGTM!

@saiyam1814 Everything looks good from my perspective, but I’m unable to submit an approval on GitHub.

@ssmiller25, those CRs are part of the official Tekton interceptor installation payload:
https://storage.googleapis.com/tekton-releases/triggers/previous/v0.25.3/interceptors.yaml
Here is how they are provisioned now:
https://github.com/civo/kubernetes-marketplace/blob/master/tekton/app.yaml#L5286

I will approve sorry for the  delay


Typechecking: Abstract the typechecker behind a trait similarly to parser

We want to do this because we don't want to couple the rest of the compiler to the current typechecking implementation. Having a trait similar to Parser but for typechecking will allow us to write code that typechecks opaquely and is thus more reusable.

Done in https://github.com/hash-org/lang/tree/compiler-pipeline


Ximage.ExistFile Erroneously returning false

I'm not sure I understand what PDFRreader.TestPdfFile is doing... but its whats being run inside XImage.ExistsFile. This is somewhat problematic because file does indeed exist (even though its not proper pdf file).
I'd just go ahead and fix this one, but I figure as I don't understand what TestPdfFile check is supposed to be doing... I'm gonna leave this one here. In XImage.FileExists, there is old platform specific code that just returns File.Exists(path) for netfx, and with that there, the code operates as expected.
public static bool ExistsFile(string path)
        {
            // Support for "base64:" pseudo protocol is a MigraDoc feature, currently completely implemented in MigraDoc files. TODO: Does support for "base64:" make sense for PDFsharp? Probably not as PDFsharp can handle images from streams.
            //if (path.StartsWith("base64:")) // The Image is stored in the string here, so the file exists.
            //    return true;

            //if (PdfReader.TestPdfFile(path) > 0)
            //    return true;
            return File.Exists(path);
#if !NETFX_CORE && !UWP && !PORTABLE
            return File.Exists(path);
#else
            return false;
#endif
        }

Actually with this little patch, I'm rendering a massive 100page report, and the only artifacts I can see now, are oddities with the color pallete stuff (honestly probably a bug in System.Drawing compat libs)

So I glanced over the code, and it's essentially just checking if the file is a valid PDF. It checks the file header (initial X bytes) for a specific string, and if not found, it return false.
Naturally that's fine for validating PDFs before trying to open them, but I don't think ExistsFile should have anything to do with validating a file, as it's just supposed to determine if the file exists or not, right?

We might need more tests for writing/generating PDF files and validating them, but I'll go ahead and make this change, as well as comment the code so it's more apparent what's changed.


Minor dependencies and code updates

Minor updates and adjustments to keep the code fresh.

Thanks!

@saket you are welcome, we are using your library so that is a little help ;)


[Feature][Module Name] Log viewing is inconvenient

Search before asking

[X] I had searched in the issues and found no similar feature requirement.

Description
查看日志不方便：希望是点开日志直接显示最新的并且滑柱是在下面，鼠标向下滑动在继续拉取最新的，向上滑动到没有数据在拉取之前的部分日志
（View the log is not convenient: I want to open the log directly to display the latest and the slider is below, slide the mouse down to continue to pull the latest, slide up to the part of the log without data before pulling ）
Use case
No response
Related issues
No response
Are you willing to submit a PR?

[ ] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

It is expected to be updated in 2.0.6

hope update in version 2.0.6

hope update in version 2.0.6

Thank you for your feedback. There will be no functional changes for the 2.x version.

This problem needs to be confirmed whether it is a front-end implementation or a back-end implementation. The back-end implementation may need to check back, and the front-end implementation may cause the problem that the data requested for multiple times is not displayed, resulting in a waste of resources. @caishunfeng @zhongjiajie

the 2.x version  new features are not added? or Only bug fixes?

@songjianet the 2.x version new features are not added? or Only bug fixes?

Only bug fixed will be added in 2.0.X version.


Fix builder dependencies on generated files

This should fix https://github.com/snowleopard/hadrian/issues/359.

@izgzhen Can you clarify why so many packages depend on inplaceLibCopyTargets? I thought only executables, such as ghc-stage2 really need them.

Can you clarify why so many packages depend on inplaceLibCopyTargets? I thought only executables, such as ghc-stage2 really need them.

The reproduction is simple: compile everything normally, then delete inplace/lib/settings for example, then delete haskeline's package-data.mk. Then when you require ghc-stage2, it will require ghc-cabal configure to compile the missing package-data.mk. But there is no rule relating a single package to settings.
The ghc-stage2 failed because it is not the top level target, and only requires the packages. However, packages don't require settings, so there is error.

But there is no rule relating a single package to settings.

This is the part I don't understand. Why should haskeline, or any other library, depend on settings? How is this file used when building haskeline?
Perhaps, ghc-stage2 and/or ghc-cabal actually require settings in order to run? Then they should depend on settings, not library packages.

I mean, shouldn't this need inplaceLibCopyTargets go somewhere into this function instead?
https://github.com/snowleopard/hadrian/blob/master/src/Util.hs#L240-L246

Or, even better, into https://github.com/snowleopard/hadrian/blob/master/src/Util.hs#L222-L228?

ghc-cabal configure requires settings so far as I see, and you are right on this point. I've updated the code.

@izgzhen I think ghc-stage* also depend on inplaceLibCopyTargets. Furthermore, hsc2hs depends on template-hsc.h, and there is a hack to track this:
https://github.com/snowleopard/hadrian/blob/master/src/Settings/Builders/Hsc2Hs.hs#L23
I suggest we try to fix all such special cases in this PR.

what do you think about this now?

@izgzhen I think build rules (e.g. buildProgram) and arguments (e.g. ghcCabalBuilderArgs) are very surprising and non-obviuos places for runtime dependencies of certain executables.
Why don't we add it to runBuilder, i.e. somewhere here?
https://github.com/snowleopard/hadrian/blob/master/src/Util.hs#L242-L249
We could have something like:
-- Make sure runtime dependencies are built
case builder of
    Ghc _ _  -> need inplaceLibCopyTargets
    GhcCabal -> need inplaceLibCopyTargets
    Hsc2Hs   -> need [templateHscPath]
    _ -> return ()

... runtime dependencies of certain executables.
Why don't we add it to runBuilder, i.e. somewhere here?

The reason is that I thought the root cause of needing inplaceLibCopyTargets is ghc-cabal configure, rather than the builder being built. So in fact I interpret it as the dependency of ghc-cabal configure, rather than runBuilder.

So, we have two (at least, maybe more) types of dependencies:

Build dependencies. An example: to build ghc-cabal we first need to build the Cabal library.
Runtime dependencies. An example: to run ghc-cabal we first need to build inplaceLibCopyTargets.

Build dependencies can be discovered automatically, e.g. by parsing the cabal file.
Runtime dependencies unfortunately cannot be discovered automatically, so we need to hard-code them into the build system. It's not obvious where these hard-coded dependencies should live. My proposal is: since they are "runtime" dependencies, we should need them right before we "run" these builders. Not earlier, because that would be potentially suboptimal.
@izgzhen Do you agree with this reasoning? If not, what do you suggest instead?

So, your proposal is to see runBuilder tries to run ghc-cabal, and need inplaceLibCopyTargets if so?

@izgzhen Yes.
But I've just realised that runBuilder is not the only way to run builders such as ghc-cabal. For example, there is customBuild which usually does all the work when invoking a particular builder.
Perhaps, a better place to do this is in needBuilder:
https://github.com/snowleopard/hadrian/blob/master/src/Util.hs#L224-L230
As you can see, we already depend on Makefile there, which actually is a runtime dependency of Make.
The semantics of needBuilder will then be: make sure a specified builder and all its runtime dependencies are up-to-date.

The problem is that (from current patch):
   when (package context /= deriveConstants) $
        lift (need inplaceLibCopyTargets)

Here you can see a /= deriveConstants. My observation is that ghc-cabal configure [deriveConstants] stuff don't need deriveConstants etc. (if not there will be cyclic dependency introduced), while other packages need. So we need to know what does GhcCabal exactly configures to decide whether or not inplaceLibCopyTargets is needed.

Oh, I see. Not only this is a runtime dependency, but it is also a conditional one! Not sure what the right approach is then...

@izgzhen OK, let's merge this then. Could you fix the merge conflict?

Could you fix the merge conflict?

Fixed, you can check it out later

fixed, sorry

Thanks, merged!


[GHSA-rp65-9cf3-cjxr] Inefficient Regular Expression Complexity in nth-check

Updates

Affected products
CWEs

Comments
Did not contain proper cwe one being denial of service

👋 This pull request has been marked as stale because it has been open with no activity.  If you do nothing this pull request will be closed eventually by the stale bot. Please see CONTRIBUTING.md for more policy details.


PackOp race condition / heisenbug

tensorflow (1.x trunk) has a peculiar kernel:
https://github.com/tensorflow/tensorflow/blob/master/tensorflow/core/kernels/pack_op.cc#L168-L174
it is registered for the op "Pack" as a GPU kernel, but it is implemented on the host (CPU), and it takes its inputs in host memory. (There may be others like it, this is merely the one I noticed.)
Consider what happens when its input comes from the GPU memory. Graph builder will insert a HostRecv op, which copies the data from the GPU to the host. HostRecv is, by default, asynchronous.
After HostRecv, tensorflow will call BaseGPUDevice::Compute() on the PackOp kernel.
https://github.com/tensorflow/tensorflow/blob/master/tensorflow/core/common_runtime/gpu/gpu_device.cc#L479
Which will immediately proceed calling Compute() on the assumption that it is a GPU kernel that's going to be executed in the same stream (therefore synchronization is unnecessary).
Since HostRecv is asynchronous, the data may or may not be there by the time Pack attempts to read it, resulting in a race condition.
(There was some code in BaseGPUDevice::Compute() that did attempt waiting for inputs up until about 2 weeks ago, but it did not prevent the race condition either.)

May be related to https://github.com/ROCmSoftwarePlatform/tensorflow-upstream/issues/325.


Configure location of Info Panel?

Hi,
Might we add a config so the Info Panel could be Top, Right, Bottom, or Left versus always at the bottom?
Thanks!

Yes! I meant to respond to this when this was first opened, but this seems like a great idea.

I intend to start on this. Just wanted to know should this appear as a separate filter in Storybook or as an manual option similar to animation etc.

Hi @varun1101,
I think ideally that the DateRangePicker and SingleDatePicker would take a calendarInfoPosition prop and that it would behave very similarly to the inputIconPosition prop. It would be good to add like INFO_POSITION_TOP, INFO_POSITION_BOTTOM, INFO_POSITION_LEFT, and INFO_POSITION_RIGHT to the constants file and use those as enums.
I would just add examples to https://github.com/airbnb/react-dates/blob/master/stories/DateRangePicker_calendar.js and https://github.com/airbnb/react-dates/blob/master/stories/SingleDatePicker_calendar.js in much the same way as the 'with info panel' story.

Thanks @majapw for the help.

Hi @mariepw,
Would be nice to update the documentation about the use of this feature ;-)
calendarInfoPosition is missing within the README file. Let me know if I can help with that.
Thanks.

@Airboy you're right, thanks. I'll try to make a PR to add it during the week-end :) Or you can do it if you want to ..


Rewrite scalar dumper for correctness

Rewrote the scalar dumper with an emphasis on rigor, based on a
careful reading of the YAML 1.2 spec and testing against LibYAML.
Corrections
Block style chomping accounts for added the extra newline
added by subsequent elements or at the end.
Fixes #238.
Top-level block scalars are indented.
Fixes dumper side of #221.
Folded style should be reliable now. The old dumper was not aware of
the subtle rules for more-indented lines.
More-indented lines no longer cause extra newlines to be added.
(The old dumper also had an off-by-one error that dropped
the last character from a long first word on a line.)
Fixes #215, #222. Removes #217 workaround.
Literal and folded styles can represent arbitrary "printable" strings,
including leading/trailing whitespace.
(Hopefully this improves readability for many use cases.)
NB. For the 'construct-string-types' dumper test, the strings are
dumped correctly. The test fails because a loader bug
loses a newline when using the keep "+" chomping indicator.
Additional improvements
Added test suite covering several former bugs, new edge cases,
and new expected behaviors. All previous applicable tests are included.
Styles are chosen in a well-defined order.

Plain and single are preferred for single lines under the width limit.
Folded is preferred when a line is longer than the width limit
(if enabled) and does not begin with a space.
Literal is used for all other multi-line "printable" strings.
Double-quoted is only used when a string is unrepresentable otherwise.

Plain style is relaxed to include more characters and strings.
Progress on #183.
As indent increases, line width decreases down to min(lineWidth, 40).
Setting lineWidth to -1 disables wrapping.
Previously there was unexpected behavior past 40 indent:
narrow lineWidth suddenly jumped to 40,
and -1 (no limit) suddenly enforced a limit of 40.

Very impressing. This week surprised me so much - 2 PRs (here & in pako), impossible without deep understanding of subject by authors.
@dervus could you take a look?

I can take a look on the weekend. Very busy right now, sorry.

Thanks for the compliment and the quick responses. I've updated the tests.
Regarding the loader bug, it seems to occur whenever the scalar is anything but trailing empty lines:
> yaml.safeLoad('a: |+\n\n\n')
{ a: '\n\n' }
> yaml.safeLoad('a: |+\n  \n\n')
{ a: '\n\n' }
> yaml.safeLoad('a: |+\n b\n\n')
{ a: 'b\n' }

> yaml.safeLoad('a: >+\n\n\n')
{ a: '\n\n' }
> yaml.safeLoad('a: >+\n  \n\n')
{ a: '\n\n' }
> yaml.safeLoad('a: >+\n b\n\n')
{ a: 'b\n' }

Also assert.equal in tests could be replaced with assert.strictEqual for consistency. But I don't really care about it.
Overall that's very good piece of work. Thank you, @aepsilon!
@puzrin, it's good for merge. However, we need to fix that loader bug before releasing this. I'll try to look into it during next week.

https://github.com/nodeca/js-yaml/commit/e0c4e4e3dea07b68bd62022a38944ce3a5b1afb9 - updated asserts use everywhere.


[Gekidou - MM-48279] Remove the team picker when a member of only one team

if the team picker is not shown, shift the filter icon add some left margin remove @app/ from import prefix
pass the teams as props and remove the index.tsx file
Summary
This PR removes the team picker with for the Initial search screen and the Header when showing message and file results.

passes teams to the components that instantiate the TeamPickerIcon and conditionally renders the component.
removes @app/ prefix in from imports
observe the teams in the search component and pass to the the components that need it.
when the team picker is not shown in the file results view, add right margin to the filter icon so it is not hugging the RHS of the view

Ticket Link
https://mattermost.atlassian.net/browse/MM-48278
Checklist

[ ] Added or updated unit tests (required for all new features)
[ ] Has UI changes
[ ] Includes text changes and localization file updates
[ ] Have tested against the 5 core themes to ensure consistency between them.

Device Information
This PR was tested on:
Screenshots

Release Note

Building app in separate branch.


Update AXIOS version

Upgrades AXIOS package to address vulnerabilities - https://github.com/advisories/GHSA-wf5p-g6vw-rhxx

Tested locally without any observed problems or issues

hi there
perfect
thank you so much for this
ill merge and test, but looks good


Page dimensions not updated when page range changes

When a pattern has different sized pages e.g. simplicity instruction page is larger than the other pages, the layout is based on the last loaded page which sometimes is the too large page. Instead all page sizes should be stored and only those in page range used for the layout, maybe the most frequent dimensions.

Fixed in #189


Bumping against C stack limit?

I get this error:
Output created: 03-data-manip-basics.html
Error: C stack usage  8678916 is too close to the limit
Execution halted

when I try to run the tutorial below
---
title: "Data Manipulation Basics"
output: tutor::tutorial
runtime: shiny_prerendered
---

```{r setup, include=FALSE}
library(tidyverse)
library(nycflights13)
```

what's going on?

```{r}
flights
```

I'm not sure what is happening, but I can avoid the error it in two ways. If I do either of these things, the tutorial runs without error:

(sensibly) show only the head of flights (but notice that flights is a tibble, so it displays concisely anyhow)
 ---
 title: "Data Manipulation Basics"
 output: tutor::tutorial
 runtime: shiny_prerendered
 ---

 ```{r setup, include=FALSE}
 library(tidyverse)
 library(nycflights13)
 ```

 what's going on?

 ```{r}
 head(flights)
 ```

Remove the ' in the line before the last code chunk:
 ---
 title: "Data Manipulation Basics"
 output: tutor::tutorial
 runtime: shiny_prerendered
 ---

 ```{r setup, include=FALSE}
 library(tidyverse)
 library(nycflights13)
 ```

 whats going on?

 ```{r}
 flights
 ```

Thanks for the easy repro case. Fixed within rmarkdown


Icon not showing correctly

Details
The bug doesn't seem to be related to the selected theme, since it's still present with the default theme.
I've got the same problem on my Android phone too.
I don't have any further explanation, but here is a screenshot that illustrate the bug.

Steps to reproduce

Add an banner_icon

Debug information
{"version":4,"homepages":{"Main Homepage":{"value":"99 - Ressources/00 - Accueil","kind":"File","openOnStartup":true,"openMode":"Replace all open notes","manualOpenMode":"Keep open notes","view":"Reading view","revertView":true,"openWhenEmpty":true,"refreshDataview":true,"autoCreate":false,"autoScroll":false,"pin":false,"commands":[],"alwaysApply":false,"hideReleaseNotes":false}},"separateMobile":false,"_defaultViewMode":"default","_livePreview":"default","_focusNewTab":"default","_plugins":["remotely-save","templater-obsidian","calendar","obsidian-kanban","obsidian-icon-folder","obsidian-emoji-toolbar","dataview","heatmap-calendar","obsidian-minimal-settings","obsidian-style-settings","obsidian-image-gallery","homepage","obsidian-banners","obsidian-excalidraw-plugin"],"_internalPlugins":["file-explorer","global-search","switcher","graph","backlink","canvas","outgoing-link","tag-pane","page-preview","daily-notes","templates","note-composer","command-palette","editor-status","bookmarks","outline","word-count","audio-recorder","file-recovery"],"_obsidianVersion":"1.6.7"}

Checklist

[X] I updated to the latest version of the plugin.

Does this occur when Homepage is disabled?
Since from my testing, this happens regardless of whether Homepage is active, and instead seems to be related to the emoji image hosting having issues. If you disable "Use Twemoji" in Banner's settings, that seems to fix it for me.


Unify 'ROM Status' Tracking

Currently, Status tracking is relatively loose.

Implement 'no-rom'/'partial'/'playable'/'good'
Remove excess CRC/PH Comments
Combine game data maps where appropriate

Implemented in 0.1.1


Provide an image break option if the code is too long

The idea is simply great! @carbon is in congratulations. But one question I want to raise is this: when the code is too long, I think there should be an image break, at least one option for this.

Closing to track in #725 instead


please add TypeScript and GraphQL syntax highlighting

Describe the feature you'd like
please add TypeScript and GraphQL syntax highlighting.
This was asked already in 2020.
Describe the benefits this would bring to existing BookStack users
Users documenting TypeScript and GraphQL will have propper syntax highlighting in their pages.
Can the goal of this request already be achieved via other means?
NO
Was this asked before?
Partly > but attached to an issue asking for VB support, see anutator's feature request at the bottom of this issue talk: https://github.com/BookStackApp/BookStack/issues/2255
Have you searched for an existing open/closed issue?

[X] I have searched for existing issues and none cover my fundemental request

How long have you been using BookStack?
1 to 5 years
Additional context
No response

Thanks for the request @ionics,

Looks like there's a typescript mode built into the JavaScript mode we can use.
For GraphQL, there's no official codemirror mode which makes me apprehensive and I don't usually support non-official modes. But there is a mode provided & maintained by graphql themselves, so maybe that's viable. Just need to double check weight impact and support stability.

Typescript now added as of the changes in #3512 which will be part of the next release.
While doing those changes, I quickly attempted adding the official graphql mode also but I could not seem to use it without massively impacting the JS bundle size. I didn't dig too far into it though.
Since there's not official codemirror mode, and due to the above with the officially supported graphql mode, I'm going to say we won't support it but if there is a way to (directly) use the offical graphql with minimal impact I'd be happy to accept a PR for it.


CommonJS or AMD dependencies can cause optimization bailouts.

Thanks for such a cool library.
Ever since upgrading to Angular 12 and then 13, I have been getting this warning from this package.
Warning: path_to_my_service/my-service.ts depends on '@codewithdan/observable-store'. CommonJS or AMD dependencies can cause optimization bailouts.
For more info see: https://angular.io/guide/build#configuring-commonjs-dependencies
Is there a plan to remove the dependency on common.js?

Due to the number of ways this can be used outside of Angular and the small overall size of the library I don't have plans to change that right now. The warning can be removed using angular.json if you need it to stop displaying though. In the future I'll reevaluate that, but there are specific testing scenarios outside of Angular where people are using it that still require CommonJS.

Thanks very much for such a prompt reply.

No problem. :-) I'd like to change that at some point (especially since I personally only use it with Angular) but don't want to break other folks. I'll consider it again in the next major version. It's so small that the bailout doesn't have much affect. It's annoying to have to suppress the warning I know, but fortunately angular.json makes it pretty easy.


requirements.txt

I just cloned the repo and typed:
streamlit run app.py

and get:
2024-07-24 19:12:01.144 Uncaught app exception
Traceback (most recent call last):
  File "/Users/arilamstein/python/venv/lib/python3.11/site-packages/streamlit/runtime/scriptrunner/script_runner.py", line 535, in _run_script
    exec(code, module.__dict__)
  File "/Users/arilamstein/python/datasci-earthquake/app.py", line 3, in <module>
    from streamlit_folium import st_folium
ModuleNotFoundError: No module named 'streamlit_folium'

I'm not an expert in python, but I think that most repos have a file called requirements.txt that lists all the packages needed to be installed to run the app. Perhaps we could add one so that it's easy for people to run the app?

From a discussion during the meetup it sounds like this project does not require requirements.txt (although I think it would if you wanted to deploy it on Streamlit's Community Cloud). But perhaps updating the README to have installation instructions would be helpful.


The matching algorithm in findValues.ts calculates wrong scoring.

Versions
BF 4.2, Typescript
Describe the bug
The algorithm implemented in the findValues.ts ignores any leading words when calculating the distance, that might be not expected behaviour. It computes the distance only between tokens in the choice option and ignores the structure of utterance.
To Reproduce

Implement the ChoicePrompt with one of the options equal to "Navigate".
Type something like "bla navigate lala".
Check step.result.score in the next step of the WaterfallPrompt.

Expected behavior
The score in step.result after the ChoicePrompt executed should not be equal to 1. So the leading "bla" word should be taken into account when calculating the score.
Similar, if one of the choice options is "Band Search" and the utterance it "blala band bla search" the score should be less, than 2/3 (as it is now) because of the leading "blala" word.
[bug]

Hi @kichinsky, @Stevenic,
We reviewed this issue and found that the score in step.result is not the position where the matching word is. It's a number that represents the quality of the match. It's calculated as:

This field is relevant when allowPartialMatches option is set to true, where, in case of a partial match, the score would be less than 1.
For example, if the Option is "Adaptive Card" and the user types  "adaptive",  the score of the result would be 0.5

If you agree, would you please close this issue?
Thanks!

Hi @ceciliaavila, I didn't mean that the score is the position of the matching word. From your example I see that your calculation formula comes from the idea of partial matching, when you give user some "multi word options" and they are able to choose by typing just some of the "word"s.
My test use case was quite opposite: user actually types more words, than are expected in the choicePrompt, or something totally different by meaning but still containing some of the words.
E.g.: one of the expected options is "Navigate", and user types "I wanna navigate". I wouldn't expect that the score is "1" in that case (that I interpret as perfect match).

Hi @kichinsky, @Stevenic,
We did some more tests and, as you mentioned, the score is the same (1) if the Choice's value matches complete or partially with the utterance from the user.
E.g.:

Choice value
User's utterance
Score

Navigate
navigate
1

Navigate
web navigate
1

Web Navigate
navigate
0 (*)

(*) AllowPartialMatches = false (default). If this option is set to true, then the score would be 0.5
@tellarin, can you please tell us if this is the expected behavior or is it a bug that needs to be fixed? (This is implemented like this in DotNet as well).
Thanks!

This looks to be a bug. We should try to fix in 4.4 if we have the cycles.

@stevenic Any update on this?

@Stevenic, did you have a chance to take a look at this one?

Actually... Digging back into this code the behavior above is currently "By Design".  The score returned is our confidence that we found a given choice within a utterance.  So if we find all of the terms for a given choice our confidence is 1.0 that choice exists within the utterance.  To understand why this works the way it works lets look at an example involving multiple choices. Lets say our choices are:
['green peppers', 'red peppers', 'onions', 'tomatoes', 'lettuce', 'cheese']

With an utterance of "I would like lettuce, tomatoes, and peppers" we would get the following results returned:

Choice value
Score

red peppers
0.5

green peppers
0.5

tomatoes
1.0

lettuce
1.0

This basically tells us that we found "tomatoes" and "lettuce" with high confidence but "red peppers" and "green peppers" were ambiguous. This could lead to us sending a clarifying question of "did you mean green peppers or red peppers".

Closing for now. Please reply if you'd like additional examples


fix(master): linting issue from Rust 1.80

Summary
Similar to the work done for the next branch on https://github.com/arlyon/async-stripe/pull/582, this fixed the Clippy warning about lazy doc continuation.
This should fix issues with the pipeline for other PR's, like this one: https://github.com/arlyon/async-stripe/actions/runs/10114673863/job/27973827484
Checklist

[x] ran cargo make fmt
[x] using conventional commits to hightlight user-facing fixes and features

Merged, feel free to rebase :)

:tada: This PR is included in version 0.37.3 :tada:
The release is available on:

v0.37.3
GitHub release

Your semantic-release bot :package::rocket:


Rewire GHData-CHAOSS Metric Description Links

The metrics committee changed the links on the wiki, but many of the links are dead.
As an example, the 'community activity' link on the current ghdata deployment:  http://ghdata.sociallycompute.io/?repo=rails+rails
under the "community activity" graph at the top, links here: https://wiki.linuxfoundation.org/oss-health-metrics/metrics/community-activity
Which links to a dead github link, here: https://github.com/chaoss/metrics/blob/master/metrics/community-activity.md
I think we do need links for EACH metric pointing to specific MD files on the CHAOSS Repository.
@GeorgLink : I think this is yours, but let's start a discussion.

Thank you for pointing this out, I already forgot about the old wiki pages :-D
I can fix the dead links on the wiki.

I did my part and fixed all the links.
I propose that GHdata links to the new location directly because I want the old wiki pages to go away.

Hi @GeorgLink : OK, this seems like it would not be a big deal.  In the wiki, there used to be one link per metric.  Does a corrallary exist in the CHAOSS GH Repository?
Thanks!  @howderek  & @ChristianCme  .. just a heads up on this discussion. :)

Yes and No:
Yes:
All pages that were in the wiki continue to exist in GitHub.
No:
We only have metric detail pages for those metrics where Anna developed SQL
statements.
Most metrics never had a page of their own because we had nothing to put on
them - feel free to create new metric detail pages as you are implementing
them.

@howderek and @ChristianCme : I think this is done, yes?


All PNGs uploaded are experiencing color shifts, even "originals"

All PNGs uploaded to Squoosh are experiencing color shifts and loss of color, even the "originals" - it appears to most affect neutral grays, removing them entirely or replacing them with a pink tint.
Tried in latest builds of Chrome 71 and Firefox 64 for OSX 10.14.2

😱 Nobody expected the Spanish Inquisition! 😱
It looks like Firefox’s gfx.color_management.mode affects the saved files (and how they look in the browser too, but that part is predictable). All is well with the default setting of 2. But as this setting is a very bad thing, with a proper setting of 1 colours are well muted (well, on my wide gamut monitor). It looks like display profile has a bearing on the saved files!
This is irrespective of source PNGs having or not sRGB and/or iCCP chunks.
Source image:

Conversion in Chrome:

Conversion in Firefox (84 & 85) with gfx.color_management.mode set to 1:

Conversion in Firefox (84 & 85) with gfx.color_management.mode set to 2 (default):

Admittedly, this is a Firefox problem. Maybe colour management in canvas, maybe something else, I wouldn’t know. And value of 1 isn’t a default. But it took me a while of testing all binaries manually to even entertain the thought that browser setting may be at fault. Which underlines a dependence of swanky in-browser apps being dependent on… browsers they run in. Silly me!


:construction_worker: Add a step for building the docs in the CI.

Description
To make sure they actually build, in case we forget to run them locally. Probably more important when/if they become more complex.
I've opted for including a step within the test job rather than running it in its own job to reduce overheads, but can be easily extracted, if deemed more appropriate.
Fixes # (issue)
Type of change

[ ] Documentation (non-breaking change that adds or improves the documentation)
[x] New feature (non-breaking change which adds functionality)
[ ] Optimization (non-breaking, back-end change that speeds up the code)
[ ] Bug fix (non-breaking change which fixes an issue)
[ ] Breaking change (whatever its nature)

Key checklist

[x] All tests pass (eg. python -m pytest)
[x] The documentation builds and looks OK (eg. python -m sphinx -b html docs docs/build)
[x] Pre-commit hooks run successfully (eg. pre-commit run --all-files)

Further checks

[x] Code is commented, particularly in hard-to-understand areas
[x] Tests added or an issue has been opened to tackle that in the future. (Indicate issue here: # (issue))

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 86.03%. Comparing base (0af776b) to head (594657a).

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #280   +/-   ##
=======================================
  Coverage   86.03%   86.03%
=======================================
  Files          38       38
  Lines         580      580
=======================================
  Hits          499      499
  Misses         81       81

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Cancel legacy Java SDK client api-client

What

[ ] Publish the next release of io.lakefs:api-client with a changed
description.  Instead of "lakeFS OpenAPI Java client legacy SDK", state
"[EOL] Do NOT use: lakeFS OpenAPI Java client legacy SDK". (#8368)
[ ] Remove support from the lakeFS and stop publishing new versions of
io.lakefs:api-client.

Why
This is the pre-1.0 Java SDK.  It shows very low usage.  Indeed, the code
migration guide mistakenly says that this is the
io.lakefs:lakefs-client package.  In fact it is io.lakefs:api-client.
We have seen no complaints even about this.
Supporting this legacy implementation requires some real work.  In
particular, we do not want to upgrade the OpenAPI release we use to build
this client, and it has occasional low-threat CVEs.  I would rather dedicate
this work to tasks that bring real value to users and to customers.

Remove support from the lakeFS and stop publishing new versions of
io.lakefs:api-client.

@arielshaqed can you please elaborate on what that means technically? Should we remove the source code / just the maven package from the maven repository...?

WAIT until we finish verifying that  we can actually remove support.
Remove clients/java-legacy from source code and from Makefile, build processes, etc.
Do NOT remove the Maven package from the repository - it did nothing wrong!

I believe that we do not need to publish something like this announcement for the legacy Java client.

It is barely used.
We marked it deprecated around 1.0.


Update WIFF2 SDK to support all(?) instruments

I don't know if it's really ALL instruments that can make WIFF2s, but it's a lot more than just the X500 now.
Although the new SDK can read MRM chromatograms, it can't tell you the Q3 mass for the chromatograms it gives you. I have reported that defect to Sciex. In the meantime I added a warning that WIFF2 MRM/SIM data should point at the WIFF file instead, which led me to discover that MSConvertGUI wasn't displaying the stderr warnings that msconvert.exe shows. I spent a lot of time trying to read the stderr on the .NET side without modifying the C++ side; it might be possible but I couldn't figure it out, so there's a new C function in the binding that will redirect cerr/cout output to a callback function. This might also be useful in Skyline when importing results.

@bspratt @nickshulman Can you set this as the integration branch for a few days to see if it causes any leaks or other new issues?


update and translate zh-CN

make zh-CN locales up to date
translate

Hello @sbilly! We're using Transifex to manage our translations, please update the translations there:
https://www.transifex.com/ipfs/ipfs-webui/
Then we'll surely update the languages here!

I can not login transifex.com with my account @ github.com

I've clicked the 'join team' button.

Hey @sbilly. I see no pending requests. Does it work now?

I've finished my zh_CN translation at https://www.transifex.com .
Can you see this? @hacdias

And there are no explore.json.

IPLD explorer comes from here: https://www.transifex.com/ipfs/ipld-explorer/languages/

@hacdias  all done.

Thank you very much!


A question about the model_zoo models

Hello. I am sorry that I am asking this question here, but I could not find my answers anywhere. I am working on implementing AI on FPGAs, and I found Vitis AI really interesting for this purpose. However, after reviewing the available models in model_zoo, I noticed that almost all of them are CNNs. I have a question about the Vitis AI and the available modes. First, is there any fully connected (not CNN) model sample in Vitis AI to implement on FPGAs? I know that Vitis AI supports fully connected layers since it's the last layer in CNN, but can I create my own only fully connected (not CNN) model using Vitis AI? I am also curious if I can customize the pre-trained model in model_zoo and create my own model. I really appreciate it if you could help me with my questions. Thank you very much.

Hi @MehdiRh17,
Thanks for your interest and questions about Vitis-AI. In Vitis-AI 2.0 model zoo, we released three non-CNN reference models (BERT) that applied to NLP. You could find them in this table. No.86, No.87 and No.125
https://github.com/Xilinx/Vitis-AI/tree/master/models/AI-Model-Zoo#model-details
We have a dedicated page to introduce the deployment of RNN models in FPGA. You could find demos of DPU for RNN models. I think it will be useful to you.
https://github.com/Xilinx/Vitis-AI/tree/master/demo/DPU-for-RNN
In the next version of Vitis-AI, we will provide more non-CNN reference models, please keep your expectations！

Since haven't received your reply for a long time, we're going to close it. If you still have any questions, please feel free to raise it. Thank you very much.


chore(main): release 1.3.0

:robot: I have created a release beep boop
1.3.0 (2023-10-26)
🚀 Features

Add ignoreProcessEnv option (22f2cb4)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/Meqn/gulp-env-loader/releases/tag/v1.3.0 :sunflower:


support Scala 2.12.0-M1

I think I just published 0.5.3 to Bintray. I'll update the README once I've verified that the resolver seems to be working.

Alright, I just tested the release and updated the README.
Thanks for open this issue. Please feel free to continue doing this for future releases as well! :)

thanks!

added to https://github.com/scala/make-release-notes/blob/2.12.x/projects-2.12.md

Thanks @lrytz !


add docs for properties in config.meta

Close #1300
I tried my hand at this. I'm not sure if the description for env.config is right, I tried figuring out what it does from looking at the code.

Yes, that was actuall all accurate.
Merging, but let me know if you object with any of my changes.


Additional audit trails

For:

Comment processing
Article sending for approval

In addition to changes in Core

All done by addition of an audit log.


[Feature Request] Like IDM, start downloading the file before clicking the "Start Download" button

From my observation, in IDM, before clicking the "Start Download" button, IDM has already started downloading files. This can save a few seconds of download time. I hope abdm can also provide similar functions.

Hi there. unfortunately its not possible in this app. because this app does not use any temp directory and all downloaded data written directly to the final output file. because of that the output file should be selected by user before any download progress


Catch all application events

I not sure if this is now possible, or maybe be implement nearly.
I need to catch all application events (Yii2 based and own emits). Its that possible?
Logic should be define a function who can catch all Application events, maybe like:
'on' => function($event) {

},

No, it's not possible.

is a design question ? tech limitation ? or maybe i ask something stupid ?
Is there any way i can implement that by develop a plugin o similar ? Please, let me know some points of entry to test that.
thanks in advance.

Events aren't handled in a centralized way, they could be attached to any descendant of the Component. You can collect all events from a concrete component but you'll need to determine and inspect all components in order to get a full set.

Just for info, how can i get all events for a component ?
thanks

Seems you can't except to query for particular event name... That could be improved.

Related to: https://github.com/yiisoft/yii2/issues/14349
The event implementation in Yii suffers from tight coupling, hardcoded invocation of static methods make it hard to change behavior.

Plus, just for add two use-case. I work on complex Yii project, and use lot of Events. After try-and-fail-and-try again one problem for hours, i find it was an event problem related.
I think is really ussefull (for me it is) get a debug bar plugin who shows the events and who it whould be fired, but i need to catch all events on that.
Second case, on a old project, previous developer use events, but there is no related docs on that.

A simple solution could be add a Yii::info In Component::trigger with message `Event triggered: {$name}

Events aren't handled in a centralized way, they could be attached to any descendant of the Component. You can collect all events from a concrete component but you'll need to determine and inspect all components in order to get a full set.

@samdark , should at least possible get al events triggers with Yii::$app->trigger ?

Obvious solution will be introducation of the event wildcard binding, which was proposed at #3250 and rejected.

The arguments give there don't specifically hold for prefix matches though; prefix matches can be done efficiently and is theoretically more efficient than registering multiple events.
Of the top of my head a simple, ugly implementation would be to register events in a deep array by splitting the keys to individual characters...

Radix tree could be a good structure for it.


Status covering Profile pictures

Recently ive been getting this bug where the person's status colour covers 90% of the persons profile when I click on their names like this:

how do i fix this?

this is not a BD issue. update your theme(s).


Can't copy paste content from the doc itself

Bug Report
Problematic behavior
I can't copy paste content from the doc I'm working on.
When I copy paste from outside the docs it works
Steps to Reproduce

Select content on the doc
Ctrl + C
Ctrl + V
Nothing happens

Environment
docs.numerique.gouv.fr on firefox

Impress version:
Platform:

Possible Solution

Additional context/Screenshots
Add any other context about the problem here. If applicable, add screenshots to help explain.

:fox_face: :cry: Thanks for investigating


Closing websocket io.fabric8.kubernetes.client.vertx.VertxWebSocket

Hi Team,
Currently am working on creating Operator using Quarkus SDK framework.
quarkus-sdk.version : 6.1.1
Operator has reconciliation loop run every 500 seconds and also we wrote logic to override based on user requirement using CR object configuration and also it has one cronjob as dependent resource.
Operator is working fine util it getting connection issue with Kubernetes API server for some time.
During Connection issue between Operator to K8s api server getting below Connection reset error.
ERROR [io.ver.cor.net.imp.ConnectionBase] (vert.x-eventloop-thread-7) Connection reset: java.net.SocketException: Connection reset
at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
and we found
[io.fab.kub.cli.dsl.int.AbstractWatchManager] (vert.x-eventloop-thread-7) Force closing the watch io.fabric8.kubernetes.client.dsl.internal.WatchConnectionManager@c00f5e3
DEBUG [io.fab.kub.cli.dsl.int.WatcherWebSocketListener] (vert.x-eventloop-thread-7) WebSocket error received: io.vertx.core.http.HttpClosedException: Connection was closed
Later this if connection is restored and operator reconciliation loop successfully executing with older version of the CR object, it not identifying and reacting any changes on CR object as well dependent resource object
Can you please help us how to reload or restart websocket connection
Note: kubeclient is functional after restore k8s api server. We are using OCP4 env to run this Operator.

My first question is why do you run a loop? The operator should be notified if any of the watched resources change and therefore polling shouldn't be necessary.
Is there a particular reason you're not using the latest version?

There were improvements regarding to this in fabric8 client (although not sure if since that version), simply updating to most recent version might fix it.

@csviri thank you updated my quarkus-sdk.version version from 6.1.1 to 6.4.0, issue is fixed

@csviri thank you updated my quarkus-sdk.version version from 6.1.1 to 6.4.0, issue is fixed

Why didn't you update to the latest one, which 6.6.4?

@metacosm Not sure. I thought 6.4.0 was the latest release; I will update to 6.6.4 and tested it now. Working as expected.
Thank you so much for you Info.


cannot find

cannot find ASP.NET Core Web Application in the new project tab

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: a25bf940-8977-fec4-461b-542a9f550fc8
Version Independent ID: 5492c641-af15-64b8-beaa-ddf511be73e6
Content: Get started with Razor Pages in ASP.NET Core
Content Source: aspnetcore/tutorials/razor-pages/razor-pages-start.md
Product: aspnet-core
GitHub Login: @Rick-Anderson
Microsoft Alias: riande

Hello @RFrancis10 ... are you on a recent version of VS? It should look like ...

I think so
I have just downloaded it
On Mon, 10 Dec 2018 at 12:33 am, Luke Latham<EMAIL_ADDRESS>wrote:

Hello @RFrancis10 https://github.com/RFrancis10 ... are you on a recent
version of VS? It should look like ...
[image: capture]
https://user-images.githubusercontent.com/1622880/49703868-2bb74300-fbd0-11e8-9c07-6e6e25762c30.PNG
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/aspnet/Docs/issues/9917#issuecomment-445578302, or mute
the thread
https://github.com/notifications/unsubscribe-auth/Arn6ZVwfDAc11el52PV9eZHyaphFUKrAks5u3Y_VgaJpZM4ZKWd2
.

... did you install the ASP.NET and web development workload? .... and you have the 2.2 SDK from https://dotnet.microsoft.com/download?

That workload should give you 2.2 (one would think! lol) ...

downloading these but what is the web development workload ?
On Mon, Dec 10, 2018 at 12:37 AM Luke Latham<EMAIL_ADDRESS>wrote:

... did you install the ASP.NET http://ASP.NET and web development
workload? .... and you have the 2.2 SDK from
https://dotnet.microsoft.com/download?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/aspnet/Docs/issues/9917#issuecomment-445578530, or mute
the thread
https://github.com/notifications/unsubscribe-auth/Arn6ZeY4Ry5t6uxbYTBV1DhK03udQ3j0ks5u3ZCVgaJpZM4ZKWd2
.

Yes, now they are all downloaded but still no difference
On Mon, 10 Dec 2018 at 12:55 am, ramez maged<EMAIL_ADDRESS>wrote:

downloading these but what is the web development workload ?
On Mon, Dec 10, 2018 at 12:37 AM Luke Latham<EMAIL_ADDRESS>wrote:

... did you install the ASP.NET http://ASP.NET and web development
workload? .... and you have the 2.2 SDK from
https://dotnet.microsoft.com/download?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/aspnet/Docs/issues/9917#issuecomment-445578530, or mute
the thread
https://github.com/notifications/unsubscribe-auth/Arn6ZeY4Ry5t6uxbYTBV1DhK03udQ3j0ks5u3ZCVgaJpZM4ZKWd2
.

Use the taskbar search and search for "Visual Studio Installer" ... run it ... then click the "Modify" button. You'll get the workloads. Under Web & Cloud, you should see the ASP.NET and web development workload. Check that off and the installer should install the bits.


Is there any alternative for :TestLast?

The title speaks of itself. Thank you for the plugin.

I've added a new UltestLast command and plug mapping which should do the trick :grin: Please try the latest commit!


fix(components): style fix for nav item when active

Description
Adjustment to expand/collapse nav item when its sub nav is active. Consumer will have to apply this styling and use hasActivatedChild property on the nav item when it's subnav item is activated.
 [hasActivatedChild] {
      --cv-list-item-background-color: var(--cv-theme-primary-24);
      --cv-theme-on-surface: var(--cv-theme-primary);
    }

    cv-app-shell[open] cv-nav-list-item[hasActivatedChild]:not([subNav]) {
      --cv-list-item-background-color:var(--cv-theme-on-surface-variant-8);
      --cv-theme-on-surface: var(--cv-theme-on-surface-variant);
      --cv-list-item-text-color: var(--cv-theme-on-surface-variant);
    }

What's included?

added properties --cv-list-item-background-color and --cv-list-item-text-color to nav list item component

Test Steps

[ ] npm run storybook
[ ] then open the app shell story
[ ] finally overwrite the local styles with the snippet given to see it work

General Tests for Every PR

[ ] npm run start still works.
[ ] npm run lint passes.
[ ] npm run stylelint passes.
[ ] npm test passes and code coverage is not lower.
[ ] npm run build still works.

Screenshots or link to StackBlitz/Plunker

:tada: This PR is included in version 8.16.1 :tada:
The release is available on:

v8.16.1
GitHub release

Your semantic-release bot :package::rocket:


UI/UX theming (interface theme definition)

Theming
Colours
Button types and colours
Backgrounds
Typography
Fonts
Check out Figma
A resource to check out Atomic design

resource file found UI-UX folder.


Remove penalty manager from local search

This PR:

[x] Removes the penalty manager reference from local search, partly implementing #100 and #157.
[x] Adds and passes relevant tests.
[x] Has well-formatted code and documentation.

Could this not be merged into main directly?


Ordered subsample option for batches

Adds a keep_ordered_samples option to batches_from_mapper to not shuffle samples within stacked batches. This can speed up loading by a lot, depending on the number of timesteps per batch and the data chunking.
ex. preprocessing about half the timesteps in the PIRE dataset took >3-4 hrs, with this option enabled and using the LRUCache option for batches_from_mapper it takes about 20-25 min.
Adds the in_memory option to batches_from_netcdf. Existing copies of each batch aren't getting garbage collected after use, so memory usage builds up and eventually crashes during training. The future usage of tf dataset may fix this. In the meantime since I believe the preprocessed data should fit in memory, we can use this to speed up training and prevent OOM'ing.
(Delete unused sections)
Added public API:

keep_ordered_samples option in batches_from_mapper. Defaults to False.
in_memory option for batches_from_netcdf. Defaults to False.

Internal change:

Deleted the select_first_samples function and replaced it with select_fraction so it could be used for either case of samples being shuffled/ not shuffled. select_fraction returns a random subset that can be drawn from the entire dataset, but keeps its original order.

[x] Tests added

Now this has both shuffle_timesteps and shuffle_samples args but the default behavior should be the same as before (timesteps are still all shuffled, samples are shuffled).
There is a small change in behavior for subsampling stacked data since I replaced select_first_samples (or whatever it was called) with select_fraction which selects out of the entire dataset but keeps the order. But since I think the only experiments that would change are Oli's current RF training, and this effect is not nearly the same as changing the timestep shuffling before batching, I thought that was ok.


NoMethodError: undefined method `key?' for nil:NilClass

[cf@host-cf springmysql]$ cf push -f springmysql.yml
Using manifest file springmysql.yml
Creating app springmysql in org sitech / space test as admin...
OK
Using route springmysql.bosh-lite.com
Binding springmysql.bosh-lite.com to springmysql...
OK
Uploading springmysql...
Uploading app files from: /tmp/unzipped-app201822465
Uploading 107.3K, 30 files
Done uploading
OK
Binding service mysql1 to app springmysql in org sitech / space test as admin...
OK
Starting app springmysql in org sitech / space test as admin...
Downloading java_buildpack...
Downloaded java_buildpack
Creating container
Successfully created container
Downloading app package...
Downloaded app package (5.4M)
Staging...
[Buildpack]                      ERROR Compile failed with exception #<NoMethodError: undefined method key?' for nil:NilClass> undefined method key?' for nil:NilClass
Failed to compile droplet
Exit status 223
Staging failed: Exited with status 223
Destroying container
Successfully destroyed container
FAILED
Error restarting application: BuildpackCompileFailed
TIP: use 'cf logs springmysql --recent' for more information

@jiajiahong0078 this sounds like a java buildpack issue not a diego issue. I would suggest opening an issue in the java-buildpack repo or pinging the team on slack

sorry, thanks, @jvshahid


configfile contains private and/or demo data

Newly added file <config.ini> contains the path </Users/michele.pasin/.ontospy/models/> which seems either accidentally leaked private data or example data.
I recommend to avoid filling in "dummy" data only in files clearly intended as examples - e.g. by placing such files below subdirectory  in source.

Sorry that file ended up there by mistake


Adding sections in README corresponding to Henry's updates to the developer doc

This change is

Cool, thanks for doing this!  Just one comment.  :+1:
Previously, xwsxethan (Ethan) wrote…
> #### Adding sections in README corresponding to Henry's updates to the developer doc

Review status: 0 of 1 files reviewed at latest revision, 1 unresolved discussion.

README.md, line 353 [r1] (raw file):

* You can login via CLI to get more info.
  * `redis-cli -h catfish.redistogo.com -p 10290 -a fa537e8f6dfa5c327ff2825759d71b91 info`
* You can also wipe redis clean and start over.

I think there's a line after this that gives an example of how to do the wipe.  Can we add it?
redis-cli -h catfish.redistogo.com -p 10290 -a fa537e8f6dfa5c327ff2825759d71b91 flushall

Comments from Reviewable

Reviewed 1 of 1 files at r1, 1 of 1 files at r2.
Review status: all files reviewed at latest revision, 1 unresolved discussion.

README.md, line 353 [r1] (raw file):
Previously, blueandgold (Henry Chang) wrote…
> I think there's a line after this that gives an example of how to do the wipe.  Can we add it?
> ```redis-cli -h catfish.redistogo.com -p 10290 -a fa537e8f6dfa5c327ff2825759d71b91 flushall```

Whoops, the page ended in the developer doc so that line flowed over, and I just missed it. Thanks for the catch. It is added now.

Comments from Reviewable


"services" instead of "products"

There are no changed files in this pull request.

@MichaelCzcz True but I do not see the changes I made live yet. Is there a delay that's longer than usual?


 Something like:
{
    version: 1.0.0 ( tag-release version ),
    command: tag-release ( -p, -i, -dev, etc.. ),
    step: getUpstreamMaster ( if possible, get the currently step it was running ),
    error: "This is a bad error" ( give raw error )
}

This way if there is an error that arises, they can just paste the output so we know exactly what they were doing, what version they were on, where it failed, and the reason it failed.

should be addressed with https://github.com/LeanKit-Labs/tag-release/pull/143


Validation of Delete Question

In Case of delete Question what will be the validation ??
I Assume that If Question Exists in the test then the question cannot be deleted.
Is my Assumption correct?
If there are any other validations then let me know.

Yes, there will be only one validation that you have mentioned.


cookieParser issue

You have to not only npm install express, but to npm install cookie-parser as well since you will get a error trying to use cookie-parser (at least for express version 4.15.2).

Hi! Thank you for reporting this. Does it occur only when using CookieParser middleware or also in general? I'm trying to figure out where to put the information about cookie-parser dependency.

@nkly
This occurs only while using CookieParser. May be nodejs express had cookie-parser in it automatically some time ago and now they both just come as a separated packages (not sure on this, just my own guess). I think you can update readme ("Usage part").


Update git clone to save the step of renaming

Streamline the process just that tiny bit more by cloning the repo straight into the folder of what you want to name your bot, just to save the step of renaming the folder.

Great,
thanks @jszaszvari !


How to run a captured function

I'd like to do the following use-case:

I run multiple experiments using a sacred script
I store the results using a FileObserver, and some files that I write out directly myself.
I collate all the results using a separate script, which makes plots etc.

In the plotting script, I want to loop over all the directories generated by the FileObserver, and load the configuration from the json file. My current stumbling block, is that I want to setup a model in the same way as is done in the sacred experiment. The function is defined as:
@ex.capture
def setup_model(param1, param2):
    ...

In my processing script, I would like to pass the configuration which I loaded from the json file, directly to the captured function setup_model. How could I go about this, ideally without manually finding the right parameters from the configuration dict?

Hi, I think a custom command (https://sacred.readthedocs.io/en/latest/examples.html?highlight=ex.command#my-commands) could be a good fit in this situation. Set it up like
@ex.command
def analyze():
    model = setup_model()
    # do plotting

and run the command for each configuration in a loop like.
for config in config_extracted_from_json_files:
    ex.run("analyze", config_updates=config)

Hope that helps.

Great, this works!


Add & doc webpack loader.

Resolves https://github.com/wombleton/webkit-assign-loader/issues/1

Thanks!


VS Code remote debugging .NET app doesn't work after upgrading C# extension to v1.25.2

It took me a while to figure out why my remote debugging suddenly stopped working. Here is short version:
I've managed to find how to enable engine logging and here is output:
-> (C) {"command":"threads","type":"request","seq":6}
<- (R) {"seq":13,"type":"response","request_seq":6,"success":true,"command":"threads","body":{"threads":[]}}
v1.25.0 successfully goes further, v1.25.2 stucks at this point until you terminate debugging session.

I am seeing the same thing but with launching local debugging on Ubuntu 20.04 using Dotnet 6. Just stops never loads any debug symbols. Works fine with 1.25.0

@gregg-miskelly  Win10 as client OS running VS Code, .net core 6 & 7 (tried both) on Ubuntu 20.04 as remote OS. It worked like a charm 2 weeks ago (launch) and I would agree that many factors may contribute to this strange behaviour, but downgrading to v1.25.0 fixes that immediately. And looking to changelog gives me idea that this is what has changed in my setup during last week, cause v1.25.1 and v1.25.2 were released a few days ago and v1.25.0 was around for monthes. So you still may be right, but I would say "it is highly likely that recent extension upgrade caused the trouble". Btw I've checked with Golang and it's remote debugging works perfectly. And just in case I've disabled extensions auto update...

Please provide a full log

@gregg-miskelly  opened #5461

@gregg-miskelly
<- (C) {"command":"runInTerminal","arguments":{"kind":"integrated","title":"mailer.dll","cwd":"","args":["/home/dmitry-naumov/.vscode-server/extensions/ms-dotnettools.csharp-1.25.2-linux-x64/.debugger/vsdbg","--interpreter=vscode","--connection=/tmp/CoreFxPipe_vsdbg-ui-1301ed2865b1464b9286cc174539dd89"]},"seq":2,"type":"request"}
-> (C) {"command":"initialize","arguments":{"clientID":"vscode","clientName":"Visual Studio Code","adapterID":"coreclr","pathFormat":"path","linesStartAt1":true,"columnsStartAt1":true,"supportsVariableType":true,"supportsVariablePaging":true,"supportsRunInTerminalRequest":true,"locale":"en-us","supportsProgressReporting":true,"supportsInvalidatedEvent":true,"supportsMemoryReferences":true,"supportsArgsCanBeInterpretedByShell":true},"type":"request","seq":1}
-> (R) {"type":"response","seq":3,"command":"runInTerminal","request_seq":2,"success":true,"body":{"shellProcessId":28895}}
-> (C) {"command":"launch","arguments":{"name":".NET Core Launch (console)","type":"coreclr","request":"launch","preLaunchTask":"build","program":"/home/dmitry-naumov/src/mailer/bin/Debug/net6.0/mailer.dll","args":[],"cwd":"/home/dmitry-naumov/src/mailer","console":"integratedTerminal","stopAtEntry":false,"logging":{"engineLogging":false},"__configurationTarget":6,"internalConsoleOptions":"openOnSessionStart","__sessionId":"d4f72c22-cd70-4e96-b6b2-70fc4008c876"},"type":"request","seq":2}
<- (E) {"seq":3,"type":"event","event":"output","body":{"category":"console","output":"-------------------------------------------------------------------\nYou may only use the Microsoft .NET Core Debugger (vsdbg) with\nVisual Studio Code, Visual Studio or Visual Studio for Mac software\nto help you develop and test your applications.\n-------------------------------------------------------------------\n","severity":"ok"}}

@gregg-miskelly
See attached
Log.txt

Got it. When you said 'remote debugging' I was thinking of PipeTransport, which would mean that it would be very strange that a new version of the extension would break anything. But you mean you are using VS Code remoting, which makes much more sense. It looks like the two issues are indeed the same.
@DmitryNaumov How did you install the .NET SDK into your Linux machine?

The underlying problem is tracked with https://github.com/dotnet/diagnostics/issues/3510. This issue will be used to track updating the C# extension once there is a new libdbgshim.so with the fix.

How did you install the .NET SDK into your Linux machine?

I've installed .NET via Snap

But why downgrading extensions helps to overcome the issue?

.NET Debuggers include a library named libdbgshim.so that comes from the .NET team that is used to load the .NET debugging services. The new version of this library has the bug referenced above. The old version of the extension shipped the previous version of libdbgshim.so. We can't just roll back to the old version though, as new versions of the debugger depend on functionality from the new libdbgshim. So for now, you can either continue using the old version of the C# extension, or you can switch to the Microsoft-built versions of the .NET runtime, such as the one pulled by the dotnet-install script, or the version on the Microsoft apt feed.


Prevent scrolling toolbar with content

If content is wider than screen, during scrolling toolbar is not moving anymore.

I dig it, and I don't see any complications.

@arxeiss Thank you for the contribution!

@mAAdhaTTah @arxeiss Shouldn't we check for the existence of the wrapper so that calling Prism highlighting multiple times on the same block does not add multiple toolbars? (Condition on line 62 suggests this case was handled before)

@Golmote You are right! I did not see it..
And I found maybe another problem. That if another plugin will need wrapper as well, there can be conflict. Maybe adding some wrapping method to the core? That only 1 wrapper can be present?
Any ideas?

I think it's OK if we don't handle this in a generic way for now, cause we don't need other wrappers.

@Golmote Nice catch, and agreed. If we need a wrapper for other plugins, we can develop a generic method then.


docs(README.md): fix a typo in 'Build Instructions' section

Notice

[x] I understand the code that I have edited, and have the means to test it before making changes to Concord.

What?
This pull request fixes a typo in 'Build Instructions' section of README.md.
Why?
I believe root privilege is required to install packages via pkg.
jdeokkim@freebsd:~ % pkg install curl
pkg: Insufficient privileges to install packages

#

THANKS 👍


Dont abbreviate format to fmt

The Readme class uses fmt to describe the format of the README aka Markdown or RestructuredText. Abbreviating format to fmt seems unneeded. It would help readability to use no abbreviations where possible.

Agreed, but:
$ python
Python 3.6.9 (default, Oct  8 2020, 12:12:24)
[GCC 8.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> format
<built-in function format>
>>>

Let's rename it to file_format.

PR was merged, closing


menu bar not filling full width

hi!
first: thank you so much for this compenent, it is truly awesome.
I am working on an application where the horizotal menu-option would come in handy.  I have 7 menu items and unfortunately icons and labels are starting to show in separate lines, even if there is enough space. I would prefer them to stay on a single line and also to be left adjusted. In addition the top margin could be set to zero, so there is less blank space. I am aware that these may be limitations of streamlit, but maybe there is a workaround? This is a feature request rather than a issue, if you prefer I can post this elsewhere, e.g. on the streamlit discussion forum. Just let me know. Thanks again for this wonderful component.

Hi @lcalmbach thanks for the note. That definitely seems fixable (may add some options to allow CSS style definition). I will get back to you when it's done (I am currently on holiday so it may take longer than usual)

awesome, there is absolutely no rush, as everything is working, it would be just nicer on a single line. thanks again for looking into this

I met the same problem, when i switch the icon to another, the width of the bar is changing and can't fill the width

Hi @lcalmbach @qianchen94 the problem has been fixed in the latest release, please upgrade :)

fantastic, in version 0.3.2 the menu bar adjusts perfectly and the menu items apprera on 2 lines only when required. thanks so much for the fast fix.


App fails to build after adding this plugin

Windows app fails fo build and run right after adding this plugin as a dependency (on its own or with another plugin, e.g. windows_manager).
Steps:

Create a new Flutter application project
Run flutter pub add screen_retriever
See the debug console in VS Code
4 (optional). Try to run the app in debug mode

The error immediately appearing in the console is:

Creating symlink from source to dest failed with ERROR_INVALID_FUNCTION. Try moving your Flutter project to the same drive as your Flutter SDK.

For me, the project and Flutter SDK are in the same parent folder. Most likely reason is that all this files are stored on exFAT volume.
FYI:
Flutter (Channel stable, 3.16.2, on Microsoft Windows [Version 10.0.19045.3570], locale en-US)
• Flutter version 3.16.2
• Framework revision 9e1c857886 (5 days ago), 2023-11-30 11:51:18 -0600
• Engine revision cf7a9d0800
• Dart version 3.2.2
• DevTools version 2.28.3

It doesn't look like it's caused by a plugin.
https://stackoverflow.com/questions/77753875/flutter-windows-build-error-creating-symlink-from-source-to-dest-failed-with-e
https://www.reddit.com/r/flutterhelp/comments/18egm5b/symlink_error_after_moving_to_new_external_drive/


ImportError: No module named 'LSP'

I get this error in my console:
reloading python 3.3 plugin LSP-tailwindcss.plugin
Traceback (most recent call last):
  File "/Applications/Sublime Text 4.app/Contents/MacOS/Lib/python33/sublime_plugin.py", line 308, in reload_plugin
    m = importlib.import_module(modulename)
  File "./python3.3/importlib/__init__.py", line 90, in import_module
  File "<frozen importlib._bootstrap>", line 1584, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1565, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1532, in _find_and_load_unlocked
  File "/Applications/Sublime Text 4.app/Contents/MacOS/Lib/python33/sublime_plugin.py", line 1692, in load_module
    exec(compile(source, source_path, 'exec'), mod.__dict__)
  File "/Users/adhoc/Library/Application Support/Sublime Text 3/Installed Packages/LSP-tailwindcss.sublime-package/plugin.py", line 5, in <module>
ImportError: No module named 'LSP'

But I have LSP v1.7.0 installed.

Have you restarted ST after installing those packages?

Yes.

Is there maybe some other error earlier in the sublime text console output?

Somehow LSP, though installed, was disabled. I re-enabled it and that fixed the problem.


500 Error (must include parameter) - No logs

Version: dev-master (50fb4dfd432a2290e08cc6ecde29ee83f7794912)
I'm currently running into an issue getting things setup on a custom app.  I've gotten everything setup according to the docs and I'm getting back a response, but I don't seem to be able to get past this recurring issue.
I've been able to locate the error in the library, but I haven't been able to identify the best way to resolve the issue.
I get the following error when trying to fetch the GraphQL schema using a GraphQL client.  This error is accompanied by a http 500 response, yet there aren't any logs being written for this (This shouldn't be a 500 response).  So, it's either squashing Exceptions, or it's sending out a 500 response explicitly.  Regardless, debugging this issue hasn't been so straight forward as a result.

GraphQL Request must include at least one of those two parameters: "query" or "queryId"

In addition to getting this error when fetching the schema, I also get the same error when executing the example GraphQL query, directed at the endpoint.
{
  hello(name: Jacob)
}

This error goes away when you actually pass a query param with the GraphQL query instead of using a GraphQL client's functionality.  This also seems to be, regardless of the http Content-Type header, whether it's set as application/json or application/graphql.  There is logic in the middleware to confirm the application/graphql header though.
Any suggestions or thoughts here?  Thanks.

Looks like this is an issue with Webonyx.  I'll post it there.


Change the model and the training method

55->33(filter size of the last conv. layer)
55->77(size of output feature map)
new training method

@D0048 , you need to review this. I will merge it soon.


Multiple document equivalences

While fixing https://github.com/hypothesis/h/issues/1777 I found that it could be a problem that only one document is returned when looking for equivalent documents; it may happen that there are several documents in the database that later on will turn out to become equals. I'm not sure what the exact behaviour is or should be, but it may be something to scrutinise at some moment.
Code in question:
https://github.com/openannotation/annotator-store/blob/d44c7c028bff9625808e43fabd3487dc6661533a/annotator/document.py#L37
https://github.com/openannotation/annotator-store/blob/d44c7c028bff9625808e43fabd3487dc6661533a/annotator/annotation.py#L60

Fixed by https://github.com/openannotation/annotator-store/pull/112


feat: Create 'help' command

Creates a simple 'help' command that will print out commands available given the current context.
Executing 'help' without specifying a known command will show you the top level commands available.

Executing 'help' after a command will display the available subcommands.

One more thought (and Im not married to this one way or another), but should this be help --help or both?

One more thought (and Im not married to this one way or another), but should this be help --help or both?
I took some inspiration from the Flutter CLI and how it handles help vs --help. And they handle it by supporting help from the top level, but --help for any subcommand.

flutter help
flutter run --help
Does this seem like a good strategy to follow?

@Daeluse yeah that sounds great to me.

@Daeluse any other thoughts or concerns before merging this one in?

@bradcypert - Nope, I think we're good here.


Presets not being listed?

After creating a Preset where does it goes?
I'm thinking it would be listed on the new chat modal along with other models.
Is this a bug or Presets work in a different way?

Thanks.

I noticed that the Provider options is not being saved correctly, sometimes it opens empty.

Click on "Quick setting"

In quick settings :)

In quick settings :)

dear god


Added Timer protocol, RepeatingTimer protocol, VariableTimer, VariableTimer unit tests, and generalized typealised closures

@eddies5 @schun93 This looks good to me, so as a long as the tests work feel free to push and release. Make sure Travis shows the build as passing in the pull request before merging and remember to bump the pod version. I'll probably release the Objective-C version soon after a bit more refactoring.
Also a general comment, I think this is a good read: http://nshipster.com/xctestcase/
In particular, I didn't know about the expectation API in Xcode 6 which is pretty nifty...

It wont work with Travis because of Swift 1.2 and Xcode 6.3 update.

Right, forgot. xctool then.


Create Sequence Diagrams

Sequence Diagrams must be created especially for core functionalities such a creating, matching, searching services or events etc. There must be a sequence flow for each use case.

Sequence Diagrams are created.


'AuthorizedSession' object has no attribute 'credentials'

Sometimes when reading parquet files I get this error:
</srv/conda/envs/notebook/lib/python3.7/site-packages/decorator.py:decorator-gen-6> in _do_list_objects()

/srv/conda/envs/notebook/lib/python3.7/site-packages/gcsfs/core.py in _tracemethod()
     52         logger.log(logging.DEBUG - 1, tb_io.getvalue())
     53
---> 54     return f(self, *args, **kwargs)
     55
     56

/srv/conda/envs/notebook/lib/python3.7/site-packages/gcsfs/core.py in _do_list_objects()
    565         items = []
    566         page = self._call('GET', 'b/{}/o/', bucket,
--> 567                           delimiter="/", prefix=prefix, maxResults=max_results
    568                           ).json()
    569

</srv/conda/envs/notebook/lib/python3.7/site-packages/decorator.py:decorator-gen-2> in _call()

/srv/conda/envs/notebook/lib/python3.7/site-packages/gcsfs/core.py in _tracemethod()
     52         logger.log(logging.DEBUG - 1, tb_io.getvalue())
     53
---> 54     return f(self, *args, **kwargs)
     55
     56

/srv/conda/envs/notebook/lib/python3.7/site-packages/gcsfs/core.py in _call()
    459                     time.sleep(min(random.random() + 2**(retry-1), 32))
    460                 r = self.session.request(method, path,
--> 461                                          params=kwargs, json=json, headers=headers, data=data, timeout=self.requests_timeout)
    462                 validate_response(r, path)
    463                 break

/srv/conda/envs/notebook/lib/python3.7/site-packages/google/auth/transport/requests.py in request()
    202         request_headers = headers.copy() if headers is not None else {}
    203
--> 204         self.credentials.before_request(
    205             self._auth_request, method, url, request_headers)
    206

AttributeError: 'AuthorizedSession' object has no attribute 'credentials'````

Do you have any more information on "sometimes?"

If I access a 5/10 file the processing works. If I try to read all the data one of the workers always crashes.

Didn't understand, what are the two cases there?
How are you authenticating in this case? Is this happening in the client process or workers?

The difference between the two cases is the number of parquet files handled by dask. The files to be processed are filtered by pyarrow according to date, one file per month.
If I process a small number of files (a dozen for one year) the processing works.
If I process several years (in this case I have to process more than a hundred files), the processing starts and after a while, the reading of one of the files to be processed raises an error.

@martindurant do you think some of the work you've done on thread safety recently may resolve this?
@fbriol any info you can provide to make this easier to isolate would be welcome (though understood that this is difficult). Are you using this from within Dask or xarray, or are you using gcsfs directly?

do you think some of the work you've done

Hope so! Specifically, the issue was around reconnections at the time of deserialisation.

Just to add some infos. I have a similar problem (Dask 2.6.0) where the job crash with this exact same error when a I try to access AVRO files directly from a gcs:// path. I don't have this problem with local data. Could it be related to some credentials/token expiring during a long loading ?
Is there a quick fix for this ?

@mlaprise , please try using gcsfs and fsspec from master (on your client and workers too)

ok I just checked and I didn't had the latest version of gcsfs & fsspec. So I installed the latest version (0.3.2, 0.5.2)... same problem. I'll try installing directly the master version

Same problem with the master version. The weird thing is that it's only happening with multiple files (gs://foo/*.avro). With a single file as input (gs://foo/00000.avro) it's working fine. Also, IRC the latest version I used (2.3.0) didn't had this issue

which scheduler are you using?

I'm using the distributed scheduler on a single big instance. I don't pass any token to the client, instead I let the client pick the credential from the JSON defined in the GOOGLE_APPLICATION_CREDENTIALS env. var.  Here's a typical traceback:

Traceback (most recent call last):
File "scripts/preprocess_graph_dataset.py", line 138, in
edgelist_df.to_parquet(os.path.join(output_path, 'edgelist.parquet'))
File "/opt/conda/lib/python3.7/site-packages/dask/dataframe/core.py", line 3629, in to_parquet
return to_parquet(self, path, *args, **kwargs)
File "/opt/conda/lib/python3.7/site-packages/dask/dataframe/io/parquet/core.py", line 527, in to_parquet
out = out.compute()
File "/opt/conda/lib/python3.7/site-packages/dask/base.py", line 165, in compute
(result,) = compute(self, traverse=False, **kwargs)
File "/opt/conda/lib/python3.7/site-packages/dask/base.py", line 436, in compute
results = schedule(dsk, keys, **kwargs)
File "/opt/conda/lib/python3.7/site-packages/distributed/client.py", line 2545, in get
results = self.gather(packed, asynchronous=asynchronous, direct=direct)
File "/opt/conda/lib/python3.7/site-packages/distributed/client.py", line 1845, in gather
asynchronous=asynchronous,
File "/opt/conda/lib/python3.7/site-packages/distributed/client.py", line 762, in sync
self.loop, func, *args, callback_timeout=callback_timeout, **kwargs
File "/opt/conda/lib/python3.7/site-packages/distributed/utils.py", line 333, in sync
raise exc.with_traceback(tb)
File "/opt/conda/lib/python3.7/site-packages/distributed/utils.py", line 317, in f
result[0] = yield future
File "/opt/conda/lib/python3.7/site-packages/tornado/gen.py", line 735, in run
value = future.result()
File "/opt/conda/lib/python3.7/site-packages/distributed/client.py", line 1701, in _gather
raise exception.with_traceback(traceback)
File "/opt/conda/lib/python3.7/site-packages/dask/utils.py", line 29, in apply
return func(*args, **kwargs)
File "/opt/conda/lib/python3.7/site-packages/dask/dataframe/io/parquet/fastparquet.py", line 480, in write_partition
fil, df, fmd.schema, compression=compression, fmd=fmd
File "/opt/conda/lib/python3.7/site-packages/fastparquet/writer.py", line 645, in make_part_file
f.write(MARKER)
File "/opt/conda/lib/python3.7/site-packages/fsspec/spec.py", line 1161, in exit
self.close()
File "/opt/conda/lib/python3.7/site-packages/fsspec/spec.py", line 1129, in close
self.flush(force=True)
File "/opt/conda/lib/python3.7/site-packages/fsspec/spec.py", line 1004, in flush
self._initiate_upload()
File "</opt/conda/lib/python3.7/site-packages/decorator.py:decorator-gen-19>", line 2, in _initiate_upload
File "/opt/conda/lib/python3.7/site-packages/gcsfs/core.py", line 54, in _tracemethod
return f(self, *args, **kwargs)
File "/opt/conda/lib/python3.7/site-packages/gcsfs/core.py", line 1009, in _initiate_upload
json={'name': self.key, 'metadata': self.metadata})
File "</opt/conda/lib/python3.7/site-packages/decorator.py:decorator-gen-2>", line 2, in _call
File "/opt/conda/lib/python3.7/site-packages/gcsfs/core.py", line 54, in _tracemethod
return f(self, *args, **kwargs)
File "/opt/conda/lib/python3.7/site-packages/gcsfs/core.py", line 463, in _call
params=kwargs, json=json, headers=headers, data=data, timeout=self.requests_timeout)
File "/opt/conda/lib/python3.7/site-packages/google/auth/transport/requests.py", line 204, in request
self.credentials.before_request(
AttributeError: 'AuthorizedSession' object has no attribute 'credentials'

ok, so I just did a test with the "Local Processes" scheduler instead and it didn't encountered the problem. An other thing I noticed is that pickling the fs.session.credentials is not possible:
import gcsfs
import pickle

fs = gcsfs.GCSFileSystem(project=settings.GCP_PROJECT_ID)
pickle.dumps(fs.session.credentials)
---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
<ipython-input-13-cf0a51346f35> in <module>
----> 1 pickle.dumps(fs.session.credentials)

TypeError: can't pickle CompiledFFI objects

Dunno, if the session credential is serialized and sent to the worker, it might be related.

Would you mind trying for one file, and then for multiple files in the same session (using threading)? It would be interesting to see if that works, and what the contents of GCSFileSystem._cache are at each stage.

You have a binder available here to read the data. To reproduce the problem, increases the time period.

Sorry, there are two notebooks and quite a lot of code there - what should I run to reproduce? Perhaps you could make a pared-down example?

fwiw I was seeing this on gcsfs master and fsspec==0.5.2 but no longer see it after upgrading fsspec to master...but if it might be random then that's probably not very informative 🤷♂

To reproduce the problem. You run the following notebook "analysis.ipynb" on binder. You have to execute the 11 cells of the notebook.
The first cell is used to correct the problem encountered. You pushed this modification on the master branch, so this code is useless for future versions.
Then you execute all the cells up to cell 8. On cell 9, you change the start year 2018 by 2005 :
ddf = get_dask_dataframe(     path,     datetime.date(2005, 1, 1),     datetime.date(2018, 2, 1))
Then you execute cells 9, 10 and 11.
I am currently AFK, so it is impossible to do better at the moment. If that is not enough, I will make a more compact example next week.

I ran to cell 11 without your modified code and got no error :|

Increases the size of the interval (cell 9):
ddf = get_dask_dataframe( path, datetime.date(1995, 1, 1), datetime.date(2018, 2, 1))

That runs successfully too! Let's reconnect next week.

Interesting, I had this intuition that it might be some race condition issue. I tried the master with the new fix and I'm still having the same issue. The traceback is different however, might be useful:
Exception: AttributeError("'AuthorizedSession' object has no attribute 'credentials'")

/src/gcsfs/gcsfs/core.py:266: DeprecationWarning: invalid escape sequence \A
  """
Traceback (most recent call last):
  File "scripts/preprocess_graph_dataset.py", line 136, in <module>
    pvs_bag = bag.read_avro(pvs_dataset_path).filter(lambda r: len(r['uid']) > 20)
  File "/opt/conda/lib/python3.7/site-packages/dask/bag/avro.py", line 105, in read_avro
    out = compute(*[dhead(fs, path, compression) for path in paths])
  File "/opt/conda/lib/python3.7/site-packages/dask/base.py", line 436, in compute
    results = schedule(dsk, keys, **kwargs)
  File "/opt/conda/lib/python3.7/site-packages/distributed/client.py", line 2545, in get
    results = self.gather(packed, asynchronous=asynchronous, direct=direct)
  File "/opt/conda/lib/python3.7/site-packages/distributed/client.py", line 1845, in gather
    asynchronous=asynchronous,
  File "/opt/conda/lib/python3.7/site-packages/distributed/client.py", line 762, in sync
    self.loop, func, *args, callback_timeout=callback_timeout, **kwargs
  File "/opt/conda/lib/python3.7/site-packages/distributed/utils.py", line 333, in sync
    raise exc.with_traceback(tb)
  File "/opt/conda/lib/python3.7/site-packages/distributed/utils.py", line 317, in f
    result[0] = yield future
  File "/opt/conda/lib/python3.7/site-packages/tornado/gen.py", line 735, in run
    value = future.result()
  File "/opt/conda/lib/python3.7/site-packages/distributed/client.py", line 1701, in _gather
    raise exception.with_traceback(traceback)
  File "/opt/conda/lib/python3.7/site-packages/dask/bag/avro.py", line 63, in open_head
    with OpenFile(fs, path, compression=compression) as f:
  File "/opt/conda/lib/python3.7/site-packages/fsspec/core.py", line 88, in __enter__
    f = self.fs.open(self.path, mode=mode)
  File "/opt/conda/lib/python3.7/site-packages/fsspec/spec.py", line 708, in open
    path, mode=mode, block_size=block_size, autocommit=ac, **kwargs
  File "</opt/conda/lib/python3.7/site-packages/decorator.py:decorator-gen-17>", line 2, in _open
  File "/src/gcsfs/gcsfs/core.py", line 54, in _tracemethod
    return f(self, *args, **kwargs)
  File "/src/gcsfs/gcsfs/core.py", line 871, in _open
    **kwargs)
  File "/src/gcsfs/gcsfs/core.py", line 907, in __init__
    **kwargs)
  File "/opt/conda/lib/python3.7/site-packages/fsspec/spec.py", line 875, in __init__
    self.details = fs.info(path)
  File "/opt/conda/lib/python3.7/site-packages/fsspec/spec.py", line 504, in info
    out = self.ls(self._parent(path), detail=True, **kwargs)
  File "</opt/conda/lib/python3.7/site-packages/decorator.py:decorator-gen-11>", line 2, in ls
  File "/src/gcsfs/gcsfs/core.py", line 54, in _tracemethod
    return f(self, *args, **kwargs)
  File "/src/gcsfs/gcsfs/core.py", line 700, in ls
    combined_listing = self._ls(path, detail) + self._ls(path + "/",
  File "</opt/conda/lib/python3.7/site-packages/decorator.py:decorator-gen-12>", line 2, in _ls
  File "/src/gcsfs/gcsfs/core.py", line 54, in _tracemethod
    return f(self, *args, **kwargs)
  File "/src/gcsfs/gcsfs/core.py", line 712, in _ls
    listing = self._list_objects(path)
  File "</opt/conda/lib/python3.7/site-packages/decorator.py:decorator-gen-5>", line 2, in _list_objects
  File "/src/gcsfs/gcsfs/core.py", line 54, in _tracemethod
    return f(self, *args, **kwargs)
  File "/src/gcsfs/gcsfs/core.py", line 553, in _list_objects
    listing = self._do_list_objects(path)
  File "</opt/conda/lib/python3.7/site-packages/decorator.py:decorator-gen-6>", line 2, in _do_list_objects
  File "/src/gcsfs/gcsfs/core.py", line 54, in _tracemethod
    return f(self, *args, **kwargs)
  File "/src/gcsfs/gcsfs/core.py", line 569, in _do_list_objects
    delimiter="/", prefix=prefix, maxResults=max_results
  File "</opt/conda/lib/python3.7/site-packages/decorator.py:decorator-gen-2>", line 2, in _call
  File "/src/gcsfs/gcsfs/core.py", line 54, in _tracemethod
    return f(self, *args, **kwargs)
  File "/src/gcsfs/gcsfs/core.py", line 463, in _call
    params=kwargs, json=json, headers=headers, data=data, timeout=self.requests_timeout)
  File "/opt/conda/lib/python3.7/site-packages/google/auth/transport/requests.py", line 211, in request
    self.credentials.before_request(
AttributeError: 'AuthorizedSession' object has no attribute 'credentials'
Task exception was never retrieved
future: <Task finished coro=<BaseTCPConnector.connect() done, defined at /opt/conda/lib/python3.7/site-packages/distributed/comm/tcp.py:341> exception=CommClosedError('in <distributed.comm.tcp.TCPConnector object at 0x7fc6a7d0a6a0>: ConnectionRefusedError: [Errno 111] Connection refused')>
Traceback (most recent call last):
  File "/opt/conda/lib/python3.7/site-packages/distributed/comm/tcp.py", line 348, in connect
    ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs
  File "/opt/conda/lib/python3.7/site-packages/tornado/tcpclient.py", line 280, in connect
    af, addr, stream = await connector.start(connect_timeout=timeout)
  File "/opt/conda/lib/python3.7/site-packages/tornado/tcpclient.py", line 143, in on_connect_done
    stream = future.result()
tornado.iostream.StreamClosedError: Stream is closed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/conda/lib/python3.7/site-packages/distributed/comm/tcp.py", line 360, in connect
    convert_stream_closed_error(self, e)
  File "/opt/conda/lib/python3.7/site-packages/distributed/comm/tcp.py", line 130, in convert_stream_closed_error
    raise CommClosedError("in %s: %s: %s" % (obj, exc.__class__.__name__, exc))
distributed.comm.core.CommClosedError: in <distributed.comm.tcp.TCPConnector object at 0x7fc6a7d0a6a0>: ConnectionRefusedError: [Errno 111] Connection refused

@mlaprise you tried with gcsfs & fsspec master?
Note, I think that this will also be solved by https://github.com/intake/filesystem_spec/pull/181, but I need to verify that.

I still get this error ( AttributeError: 'AuthorizedSession' object has no attribute 'credentials') with the latest releases, i.e. dask 2.7.0 and gcsfs 0.3.1.
Maybe this issue could be reopened, if a few users are still experiencing it? (Was it closed unintentionally by @martindurant's comment  Maybe Fixes #180 in the merged PR #192, or because it couldn't be reproduced?)

I'm reasonably confident that this was fixed by https://github.com/intake/filesystem_spec/pull/181. Trying out @fbriol's binder to try to confirm.
https://github.com/intake/filesystem_spec/pull/181 will be in a release later today or tomorrow.

Ok, I was able to confirm that things are fixed on master, at least for @fbriol's example reading from gcs with pyarrow.
I was able to reproduce the ArrowIOError: Arrow error: IOError: 'AuthorizedSession' object has no attribute 'credentials' with the versions in the image (I think gcsfs 0.3.0 and fsspec 0.5.2).
Upgraded to master on the client and workers, and I can no longer reproduce.
I'll do some releases later today.

Might be good to also ask the S3 crowd (e.g.,  @birdsarah ) if all is now well for them too.

I still have the same problem. I updated my repo, just run it to reproduce the error. I hope I have taken the correct version of the corrected software.

@fbriol do you mean in https://github.com/fbriol/pangeo-argo/commit/0c9b4521bda5c9e23f7bf9aa80c61d5ac6373175? That's not getting gcsfs and fsspec master AFAICT.
In my experiment, I manually updated the versions on the client and workers with
def update():
    subprocess.call(['pip', 'install', '-U', ...])

but that's fragile. We'll have releases later today, and I'll look into updating pangeo-stacks as well.

I hope I have taken the correct version

Since this is just merged, you will require a pip install of gcsfs and fsspec from github.

pangeo-stacks doesn't pin fsspec or gcsfs, so this will be available via pangeo stacks in the next update.

Okay, thank you very much.

I no longer get the error with fsspec 0.6.0. Many thanks!


Union type resolving to one side of the union when spread operator is used

Bug Report
This issue may be related but they were different enough to warrant a write up here: https://github.com/microsoft/TypeScript/issues/42665
When assigning a union type to a variable, which is immediately instantiated as an object that could possibly be either type at run time, and the spread operator is used to "optionally" apply a property, the type of the variable falls to the type without the extra properties automatically.
🔎 Search Terms
Spread operator, object, union type
🕗 Version & Regression Information
This changed between versions 3.7.5 and 3.8.3.
⏯ Playground Link
Playground link with relevant code
💻 Code

interface Foo {
    bar: string;
}

type Bar = Foo & {
    baz: string;
}

const produceBoolean = () => Math.random() > 0.5;

const obj: Foo | Bar = {
    bar: 'baz',
    ...(produceBoolean() && {
        baz: 'bar'
    })
}

if ('baz' in obj) { // obj is "Foo" here
    console.log(obj); // obj is "never" here
}

🙁 Actual behavior
Instead of remaining a union type until some discrimination was made, it assumed the object was the side of the union without extra properties.
🙂 Expected behavior
It would remain possibly either or any type in the union until discriminated in the code.

I can resolve this issue at a faster pace & with a better approch

I ran into an issue with the spread operator that I suspect is related.  Using TypeScript 4.1 but also tested in 3.7.5 and 3.5.1, to be sure.  Simple example showing the core of the problem:
function example<T extends string>(x: { [name in T]: string; } | null) {
    const s = { ...x }; // inferred to have type `{}`.
}

More complex example that is closer to my actual use case of merging two ProseMirror SchemaSpec objects:
type AnimalSounds<M extends string> = { [name in M] : string } | null;

let catSounds:AnimalSounds<"cat"> = { "cat": "meow" };
let dogSounds:AnimalSounds<"dog"> = { "dog": "woof" };
type SoundT<S> = S extends AnimalSounds<infer T> ? T : never;
type DogT = SoundT<typeof dogSounds>

function combineWithDog<T extends string>(base: AnimalSounds<T>): AnimalSounds<T|"dog"> {
	// EXPECT: { dog? : string | T }
	// ACTUAL: { dog? : string }
	let sounds = { ...base, ...dogSounds };
	return sounds;
}

// USAGE
let catdogSounds = combineWithDog(catSounds);

Getting the types right here isn't critical and I have a workaround, but it would be nice to have.