feat: add PipelineConcurrency option

This adds a pipeline option to the DMap pipeline interface, which should be backwards compatible. It also changes the default from 1 to runtime.NumCPU(), which from the variable naming, appears to have been the original intent.
Fixes #201

Some tests are broken. I'll investigate this problem. See this: https://github.com/buraksezer/olric/actions/runs/3794919996/jobs/6457100150#step:7:1353

Glad the testing triggered that race condition! Running the tests locally passed for me

Hey, @derekperkins could you please update derekperkins:pipeline-cpus? It doesn't include your latest improvements. https://github.com/buraksezer/olric/tree/release/v0.5.0

Closed in favor of #206


Passing DataFrame from Python to Scala not working

When passing a DataFrame from Python to Scala using the Scala Bridge, the DataFrame comes across as null in Scala.

This should be working as of version 0.46. I've also added support for RDD and GraphFrames.
@hackerguy: please let me know if you still have issues.


Is this project dead?

I don't know the details of this project, but at first it looks promising - if we can get this to run on linux and use it as a backend for ReVive, we might be able to get Oculus exclusives running.

This project is still under development, just in a private repo.

Something like Echo VR, though, would, as the new versions have an entitlement patch

There isn't a reason for Oculus apps to be actively supported as the main purpose of ReLinked is to remove Meta and the dash. You can try using ReVive, but it likely won't be added to ReLinked.

Sorry, maybe I am confused as to what this project does. I thought that this project was a implementation of the Oculus SDK to remove the dependency of the Oculus Store, is this incorrect?

This project is designed to remove as much Meta things from Oculus Link, and make it an almost-native steam vr headset. The oculus api won't be intentionally supported, and will likely be removed with the full release.

Okay.


Adding pop tokens sample

Purpose

Adds a new sample where React SPA acquiring PoP tokens to call Node.js web API which validates the token using jose

cc @hectormmg
Does this introduce a breaking change?

[ ] Yes
[ x ] No

Pull Request Type
What kind of change does this Pull Request introduce?

[ ] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Documentation content changes
[ x ] Other... Please describe: **new sample**

How to Test

Get the code

git clone https://github.com/Azure-Samples/ms-identity-javascript-react-tutorial.git
cd ms-identity-javascript-react-tutorial
git checkout pop-sample
cd 6-AdvancedScenarios/2-call-api-pop/API
npm install
cd ../SPA
npm install

What to Check
Verify that the following are valid

Test in Chrome, Edge, Firefox
Test in private mode

"dependencies": {

delete this file?

Refers to: 3-Authorization-II/1-call-api/SPA/package-lock.json:6 in 3e8d6a7. [](commit_id = 3e8d6a7d8c3a8f054648fc291b1fd33a202924dc, deletion_comment = False)


feat(python): support merge_columns via Ray integration

Expose merge_columns via Ray integration, and add one step to Commit the merge OP.

V2 does not support merge_column yet
https://github.com/lancedb/lance/issues/1929
I will resume this work once v2 merge_column support is done.

@eddyxu IMO I think we should use the same API as Dataset.add_columns() instead of merge_columns. It's similar but has a few more capabilities (like a SQL option). Also the merge_columns name is confusing because there is that older merge API that literally performs a join with pre-computed data.

Codecov Report
Attention: Patch coverage is 78.12041% with 149 lines in your changes are missing coverage. Please review.

Project coverage is 79.83%.

Files
Patch %
Lines

rust/lance-encoding-datafusion/src/lib.rs
0.00%
36 Missing :warning:

rust/lance-encoding-datafusion/src/zone.rs
81.29%
9 Missing and 17 partials :warning:

rust/lance/src/dataset.rs
80.19%
16 Missing and 4 partials :warning:

rust/lance-file/src/v2/writer.rs
82.69%
13 Missing and 5 partials :warning:

...ust/lance-table/src/io/commit/external_manifest.rs
50.00%
9 Missing and 4 partials :warning:

rust/lance-encoding/src/encoder.rs
88.75%
4 Missing and 5 partials :warning:

rust/lance-io/src/local.rs
62.50%
2 Missing and 7 partials :warning:

rust/lance-table/src/io/commit.rs
86.95%
6 Missing and 3 partials :warning:

...ust/lance-encoding/src/encodings/physical/value.rs
55.55%
4 Missing :warning:

.../lance-encoding/src/encodings/logical/primitive.rs
62.50%
0 Missing and 3 partials :warning:

... and 2 more

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #2278   +/-   ##
=======================================
  Coverage   79.82%   79.83%
=======================================
  Files         202      202
  Lines       55462    55462
  Branches    55462    55462
=======================================
+ Hits        44274    44276    +2
  Misses       8621     8621
+ Partials     2567     2565    -2

Flag
Coverage Δ

unittests
79.83% <78.12%> (+<0.01%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

Any updates on this?

Any updates here? I need it to keep on living ... :)

Any updates here? I need it to keep on living ... :)

I'm going to be working on this next week.


CreatingClientSecretsFile Page is Out of Date

Full steps to reproduce the issue:

Navigate to Client Secrets Wiki Page
Attempt to create client secrets using the GCP website
Note that several of the steps are out of date. For instance, there is no "Other" application type, creating a client key is different with different tabs all together, etc. At this moment I have stopped trying to go through it not confident that the APIs to be enabled are still correct.

Expected outcome (what are you trying to do?):
The instructions should be in sync with the current GCP UI/workflow.
Actual outcome (what errors or bad behavior do you see instead?):
It is confusing and I (as a novice user in this area) can't quite figure out all the right settings, nor can effectively trouble the correct steps when I'm getting API permission errors as I am receiving.
I would try and update the page myself but I am not that familiar with GCP and can't quite work through the entire process myself.  I think someone much more knowledgeable who knows what they're doing would be better suited to update this.

The wiki can be edited by anyone with a GitHub account. I'm unlikely to
have time to get this article updated soon but would appreciate if someone
did.
Jay
On Tue, Jul 6, 2021, 2:01 PM MattPennerVVUSD @.***>
wrote:

Assigned #1394 https://github.com/jay0lee/GAM/issues/1394 to @jay0lee
https://github.com/jay0lee.
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
https://github.com/jay0lee/GAM/issues/1394#event-4984744079, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/ABDIZMA4AHG6XBGPUHGEEWTTWNAIRANCNFSM475BYYIQ
.

Thx, I totally get it.  I'm just floundering in the GCP on this side of things.  I can screenshot with the best of them but have little knowledge on what the best steps are.  I haven't been able to recreate my own client keys so I'd just lead others astray.
If it helps and someone can define the steps I'd be happy to clean up the formatting and add screenshots.
In the mean time I'm deleting the project in GCP and starting as if with a fresh install of GAM.
Long time user of GAM though, for like 10 years, seriously.  Love your stuff, thanks!!! I only ran into a problem when recently upgrading to a new Win10 Azure joined machine and can't figure out where the gap was in getting the initial authentication set up. Just finally had a chance to start looking into it.
Matt Penner
Director of Information and Instructional Technology, CCTO
Val Verde Unified School District
<EMAIL_ADDRESS>(951) 940-6100 x10709
From: Jay Lee @.>
Sent: Tuesday, July 6, 2021 11:04 AM
To: jay0lee/GAM @.>
Cc: Penner, Matthew @.>; Author @.>
Subject: Re: [jay0lee/GAM] CreatingClientSecretsFile Page is Out of Date (#1394)
CAUTION: This email originated from outside of the VVUSD organization. DO NOT CLICK links or open attachments unless you recognize the sender and know the content is safe.
The wiki can be edited by anyone with a GitHub account. I'm unlikely to
have time to get this article updated soon but would appreciate if someone
did.
Jay
On Tue, Jul 6, 2021, 2:01 PM MattPennerVVUSD<EMAIL_ADDRESS>wrote:

Assigned #1394 https://github.com/jay0lee/GAM/issues/1394 to @jay0lee
https://github.com/jay0lee.

You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
https://github.com/jay0lee/GAM/issues/1394#event-4984744079, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/ABDIZMA4AHG6XBGPUHGEEWTTWNAIRANCNFSM475BYYIQ
.

You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fjay0lee%2FGAM%2Fissues%2F1394%23issuecomment-874971440&data=04|01|mpenner%40valverde.edu|8f25bedd0bd94c09ca9208d940a8760e|990fe1e8e06749c6b4fbcf1661d4bcc5|0|0|637611914555200459|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=d903VzZdlYK4DeFv4kGI9GD%2FU5IL6EDPfKzcoTbj950%3D&reserved=0, or unsubscribehttps://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAMEBH7DU4HD755ZTSYWKIDTTWNARZANCNFSM475BYYIQ&data=04|01|mpenner%40valverde.edu|8f25bedd0bd94c09ca9208d940a8760e|990fe1e8e06749c6b4fbcf1661d4bcc5|0|0|637611914555205451|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=mcRKemtmUwo%2BvUHdnsqyRqtKyxwv%2FZsEcUfESU%2FWkfs%3D&reserved=0.

Other has been renamed to Desktop.

Also, why not follow the quick start guide:
https://github.com/jay0lee/GAM#quick-start
GAM will walk you through the full process with a lot less guesing.


WG: iPad not autocompleting when choosing starting article

My android tablet still offers the dropdown of possible article titles.

@johnnycrich maybe investigate and if code looks good, add back to the QA pipeline with reproduce me tag

Unable to reproduce on lab locker's iPad no. 32 in both Chrome and Safari.

Reproduced 9/9 AM build--started game with just an iPad and an android tablet, autocomplete failed to load at beginning of first round.

This should be resolved, please try to repro again and confirm.

Unable to reproduce


chore(docs): run generator directly from msbuild

Adds a target to allow for faster running of interface generation.

When is this target going to be called?

This is purely convenience. I'm torn if I really want to see it in the csproj or not.


Create fractalcreatures

You should create a folder first, then put meta.json and inscriptions.json under that folder. Then put the whole folder under "Collections" directory.


js: Break cyclic dependency between modules related to stream_data.

Moved stream_data.is_active to stream_sort.has_recent_activity to remove the cyclic dependency between stream_data and stream_topic_history.

Self-review checklist

[ ] Self-reviewed the changes for clarity and maintainability
(variable names, code reuse, readability, etc.).

Communicate decisions, questions, and potential concerns.

[ ] Explains differences from previous plans (e.g., issue description).
[ ] Highlights technical choices and bugs encountered.
[ ] Calls out remaining decisions and concerns.
[ ] Automated tests verify logic where appropriate.

Individual commits are ready for review (see commit discipline).

[ ] Each commit is a coherent idea.
[ ] Commit message(s) explain reasoning and motivation for changes.

Completed manual review and testing of the following:

[ ] Visual appearance of the changes.
[ ] Responsiveness and internationalization.
[ ] Strings and tooltips.
[ ] End-to-end functionality of buttons, interactions and flows.
[ ] Corner cases, error conditions, and easily imagined bugs.

Made some comment adjustments and marked this to merge once CI passes. Thanks @Lalit3716!


Something wrong with backtick positioning

When I try to write some inline code using a backtick, the initial position of the backtick is wrong.

Yeah. This is a font update issue. Super annoying. I think we need to change our font.


Add anonymous usage statistics

Add a module that does some fancy SQL stuff to collect anonymous usage statistics

was done since 213b1d5022390bdc99b252088fe96409b3005648, forgot to close this issue


level 2 (even with all: false) incorrectly re-orders animation name

ping @jakubpawlowicz
let css = `
    .spinner {
        animation: x .5s infinite linear;
    }
`
var CleanCSS = require('clean-css');
var input = css;

var options = {
    level: {
        2: {all: false}
    }
};

var output = new CleanCSS(options).minify(input);

console.log(output.styles);

actual:
.spinner{animation:.5s linear infinite x}

expected:
.spinner{animation:x .5s infinite linear}

works as expected without level 2

hmm, maybe this isn't a bug. most examples for the animation short-hand have the animation names at the front, but i guess it could be an the end, too.

@leeoniya this is a bug,this makes animation ineffective in chrome


MNT: rerender

Hi! This is the friendly automated conda-forge-webservice.
I've rerendered the recipe as instructed in #30.
Here's a checklist to do before merging.

[ ] Bump the build number if needed.

Fixes #30

Hi! This is the friendly automated conda-forge-linting service.
I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

Seems this might not work based on local testing. Going ahead and closing so as to replace with PR ( https://github.com/conda-forge/python-spams-feedstock/pull/29 ).

Replaced by PR ( https://github.com/conda-forge/python-spams-feedstock/pull/34 ).


All delimiters to numbers in PR status

/c @codeclimate/review

Commit message is a typo (only mentioning b/c this is OSS). LGTM


apollo_fpga: get rid of poetry and add prompt-toolkit dependency

Fixes #35.

Thank you for catching this! I only tested installing this in editable mode and the bug did not appear.
I am able to reproduce this now, but the packages solution did not solve it for me. Using apollo_fpga* did, though.

I tried testing this with a user pip install, replacing a previous installation. The initial uninstall worked:
mossmann@costard:~/src/apollo$ pip3 uninstall apollo_fpga  --break-system-packages
Found existing installation: apollo-fpga 0.0.5
Uninstalling apollo-fpga-0.0.5:
  Would remove:
    /home/mossmann/.local/bin/apollo
    /home/mossmann/.local/lib/python3.11/site-packages/apollo_fpga-0.0.5.dist-info/*
    /home/mossmann/.local/lib/python3.11/site-packages/apollo_fpga/*
Proceed (Y/n)? y
  Successfully uninstalled apollo-fpga-0.0.5

Then the install worked:
mossmann@costard:~/src/apollo$ pip3 install .  --break-system-packages
Defaulting to user installation because normal site-packages is not writeable
Processing /home/mossmann/src/apollo
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Installing backend dependencies ... done
  Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: pyusb>1.1.1 in /usr/lib/python3/dist-packages (from apollo-fpga==0.0.5) (1.2.1.post1)
Requirement already satisfied: pyvcd>=0.2.4 in /home/mossmann/.local/lib/python3.11/site-packages (from apollo-fpga==0.0.5) (0.2.4)
Requirement already satisfied: prompt-toolkit>3.0.16 in /usr/lib/python3/dist-packages (from apollo-fpga==0.0.5) (3.0.36)
Building wheels for collected packages: apollo-fpga
  Building wheel for apollo-fpga (pyproject.toml) ... done
  Created wheel for apollo-fpga: filename=apollo_fpga-0.0.5-py3-none-any.whl size=33337 sha256=3bdea1a94735c5f6d2551e562a2e15f679e1f76911113b66c492ec3cb5acdcc9
  Stored in directory: /tmp/pip-ephem-wheel-cache-61jsvh74/wheels/e8/8c/ac/f7cce1ec4ddb45ffe2cc29d17b39d287331da0a67f85a743c7
Successfully built apollo-fpga
Installing collected packages: apollo-fpga
Successfully installed apollo-fpga-0.0.5

But a subsequent uninstall did not:
mossmann@costard:~/src/apollo$ pip3 uninstall apollo_fpga  --break-system-packages
Found existing installation: apollo-fpga 0.0.5
Can't uninstall 'apollo-fpga'. No files were found to uninstall.

I got the same result using a hyphen instead of an underscore:
mossmann@costard:~/src/apollo$ pip3 uninstall apollo-fpga  --break-system-packages
Found existing installation: apollo-fpga 0.0.5
Can't uninstall 'apollo-fpga'. No files were found to uninstall

My uninstall failure only happens if my working directory is the top level of the repo. We're guessing that this has to do with the way pip resolves package names and is not a bug in apollo. Removing pyproject.toml did not change my result.


ARROW-16581: [C++][Java] Upgrade ORC to 1.7.4

Bump ORC to 1.7.4.
Apache ORC 1.7.3 is a maintenance release with the following bug fixes.

https://github.com/apache/orc/releases/tag/v1.7.4
https://orc.apache.org/news/2022/04/15/ORC-1.7.4/

Thank you, @pitrou and @williamhyun !


Install pretty on ipython

Type of changes

[ ] Bug fix
[x] New feature
[ ] Documentation / docstrings
[ ] Tests
[ ] Other

Checklist

[x] I've run the latest black with default args on new code.
[x] I've updated CHANGELOG.md and CONTRIBUTORS.md where appropriate.
[ ] I've added tests for new code.
[x] I accept that @willmcgugan may be pedantic in the code review.

Description
#471  describes the issue of injecting the display hook into ipython.
The issue is that the sys.displayhook cannot be changed inside of the ipython repl. Instead, I've added the display_hook into the ipython plain text formatter.

@nathanrpage97 There is an unfortunate glitch where iPython print "In [X]:" and Rich expects the cursor to be at the start of the line. This can break rendering of the first line. It's really obvious for something like Panel, but occurs in other places.

The default pretty printing in iPython will insert a new line when printing containers like dicts or lists. I'm thinking that Rich should do the same, and also print a new line for Rich renderables.
I think the logic should be something like the following:
requires_newline = (ConsoleRenderable, abc.Mapping, abc.Sequence, abc.Set)
if isinstance(value, requires_newline):
    console.line()

What do you think?

Alright, I've added in the change you suggested for the new line. Still needs testing in a few environments including jupyter.

Note there seems to be a recursion error issue when running it in jupyter.

Alright, I've tweaked it to make sure rich will play well with terminal ipython and rich display jupyter.

Great, thanks.


Update opts documentation for capture_* functions

-add details pointing users toward valid accepted options
-closes #763

@savhappy I don't think we should refer to how we split options internally (users don't really have to know that we are using nimble_options and stuff). I think what we had in mind here is that we want to list all the options in one place and link to that place as much as possible.

Ah very clear! I'll take that approach. Thanks 👌

@whatyouhide this what you had in mind?

@savhappy I think Sentry.Options is a great idea to store all the options, validation, and so on. However, if we make it public then we are committing to supporting the Sentry.Options module being available. What if, instead, we do:
defmodule Sentry.Options do
  @moduledoc false

  ...
end

and then document all options in a ## Options section in Sentry? You can always say "see the Options section in the Sentry documentation" if you want to link people to options. Thoughts?


Support for custom command aliases

Added support for custom aliases. You can add aliases by yourself in commands.json

good idea, thanks

released


Polymorphic scalar function implementation for BETWEEN

Like https://github.com/apache/pinot/pull/13711, but for BETWEEN.
This wasn't added in the original PR that was targeted specifically towards the multi-stage query engine, since the Calcite compiler rewrites BETWEEN filter predicates to an AND of the equivalent >=, <= filter predicates.
However, this is still needed because string based BETWEEN comparisons for instance aren't currently supported with the default double based implementation. Currently, the argument type based scalar function lookup is used in:

CompileTimeFunctionsInvoker: so literal-only usages of BETWEEN with string arguments currently fails in the v1 query engine.
FunctionOperand: used in the v2 query engine to evaluate filter predicates. While this isn't currently an issue due to the aforementioned Calcite compiler rewrite, we have been discussing potentially disabling this automatic re-write due to a correctness issue with MV columns (see here). This polymorphic implementation would be needed in order to prevent regressions with string based BETWEEN comparisons in the multistage query engine.
PinotEvaluateLiteralRule: literal-only usages of BETWEEN with string arguments would fail in the v2 query engine if we disabled the Calcite rewrite rule.
PostAggregationFunction: so BETWEEN on the result of an aggregation that returns a string (there aren't too many of these and there might not even be any genuine use cases for BETWEEN on these) currently fails.

In the future, all remaining usages of the argument count based scalar function lookup (ingestion transforms for instance) will be moved to argument type based function lookup, so the utility of this polymorphic BETWEEN implementation will only increase.

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 0.00%. Comparing base (59551e4) to head (f0833ea).
Report is 1101 commits behind head on master.

:exclamation:  There is a different number of reports uploaded between BASE (59551e4) and HEAD (f0833ea). Click for more details.
HEAD has 48 uploads less than BASE

Flag
BASE (59551e4)
HEAD (f0833ea)

integration
7
2

integration2
3
2

temurin
12
2

java-21
7
2

skip-bytebuffers-true
3
1

skip-bytebuffers-false
7
1

unittests
5
0

unittests1
2
0

java-11
5
0

unittests2
3
0

integration1
2
0

custom-integration1
2
0

Additional details and impacted files
@@              Coverage Diff              @@
##             master   #14113       +/-   ##
=============================================
- Coverage     61.75%    0.00%   -61.76%
=============================================
  Files          2436        3     -2433
  Lines        133233        6   -133227
  Branches      20636        0    -20636
=============================================
- Hits          82274        0    -82274
+ Misses        44911        6    -44905
+ Partials       6048        0     -6048

Flag
Coverage Δ

custom-integration1
?

integration
0.00% <ø> (-0.01%)
:arrow_down:

integration1
?

integration2
0.00% <ø> (ø)

java-11
?

java-21
0.00% <ø> (-61.63%)
:arrow_down:

skip-bytebuffers-false
0.00% <ø> (-61.75%)
:arrow_down:

skip-bytebuffers-true
0.00% <ø> (-27.73%)
:arrow_down:

temurin
0.00% <ø> (-61.76%)
:arrow_down:

unittests
?

unittests1
?

unittests2
?

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

Consider adding a test in v2 which mixes different types in BETWEEN? What is the expected behavior?

Do you mean something like intCol BETWEEN '5' AND 10.5? Also, in the v2 case currently, this function will never get invoked anyway due to the Calcite conversion of BETWEEN.


Unable to generate gantt diagram with mermaid CLI

Hi!
This project looks super awesome and I wanted to give it a try to play with generating some Gantt diagrams. However after a couple of attempts I'm unable to even generate a png with the mermaid cli from the example given on the page. I've installed it from GitHub master as I ran into the problem with comments not being parseable which is fixed with #141. However it still breaks for me with comments and it also breaks with some missing attribute "height" in the phantomjs phase. I've tried to generate png and svg with -p and -s as well.  I have no idea how to debug this, so any pointers would be great. If attached some information below, let me know if there's something else I can provide.
% mermaid --version
0.4.0

% npm list -g | grep mermaid
├─┬<EMAIL_ADDRESS>(git://github.com/knsv/mermaid.git#11a30dd50541b107cadfa57e20add80c34094867)

# with comment
% mermaid gantt.mmd
CONSOLE: Mermaid Syntax error: (from line #undefined in "undefined")
CONSOLE: Parse error on line 2:
...lection of syntaxesgantt        dateFo
----------------------^
Expecting 'NEWLINE', 'SPACE', 'GRAPH', got 'ALPHA' (from line #undefined in "undefined")
TypeError: 'undefined' is not an object (evaluating 'action[0]')

  ../dist/mermaid.full.js:27485 in parse
  ../dist/mermaid.full.js:25891
  ../dist/mermaid.full.js:30956
  ../dist/mermaid.full.js:31018
  phantomjs://webpage.evaluate():33 in executeInPage
  phantomjs://webpage.evaluate():39
  phantomjs://webpage.evaluate():39
PHANTOM ERROR: TypeError: 'null' is not an object (evaluating 'element.setAttribute')
TRACE:
 -> /usr/local/lib/node_modules/mermaid/lib/phantomscript.js: 156 (in function resolveSVGElement)
 -> /usr/local/lib/node_modules/mermaid/lib/phantomscript.js: 76%

# without comment
% mermaid gantt.mmd
PHANTOM ERROR: TypeError: 'null' is not an object (evaluating 'oDOM.documentElement.attributes.getNamedItem('height').value')
TRACE:
 -> /usr/local/lib/node_modules/mermaid/lib/phantomscript.js: 88%

% cat gantt.mmd
%% Example with slection of syntaxes
gantt
        dateFormat  YYYY-MM-DD
        title Adding GANTT diagram functionality to mermaid

        section A section
        Completed task            :done,    des1, 2014-01-06,2014-01-08
        Active task               :active,  des2, 2014-01-09, 3d
        Future task               :         des3, after des2, 5d
        Future task2               :         des4, after des3, 5d

        section Critical tasks
        Completed task in the critical line :crit, done, 2014-01-06,24h
        Implement parser and jison          :crit, done, after des1, 2d
        Create tests for parser             :crit, active, 3d
        Future task in critical line        :crit, 5d
        Create tests for renderer           :2d
        Add to mermaid                      :1d

        section Documentation
        Describe gantt syntax               :active, a1, after des1, 3d
        Add gantt diagram to demo page      :after a1  , 20h
        Add another diagram to demo page    :doc1, after a1  , 48h

        section Last section
        Describe gantt syntax               :after doc1, 3d
        Add gantt diagram to demo page      : 20h
        Add another diagram to demo page    : 48h

Hello!
Turned out to be some issues with that. Given the recent changes... :)
Youc an generate the gannt diagram with something like this command line:
node bin/mermaid.js -t ./dist/mermaid.forest.css -g ./test/gconfig.json test/gantt.mmd
You need to add some width for the body in the css to make it a bit wider then the default.
This is committed and pushed but not yet (fully tested and) included in a release.

(And yes I noticed the %% in before the graph definition messes thing up... Will look at that sometime, you can have comments in the defintion though).

oh sweet, I will give it a try. Thanks for the quick response!

Just to follow up here. I couldn't get the cli to work as it kept breaking for configuration missing. But I got some basic charts working in the browser. Just needs some more CSS tweaking :)

Yeah I can see how that would have been unclear. Sorry about that. So the command line would be:
node bin/mermaid.js -t ./dist/mermaid.forest.css -g ./test/gconfig.json test/gantt.mmd

A sample config file would contain:
{
"titleTopMargin":25,
"barHeight":20,
"barGap":4,
"topPadding":50
,"sidePadding":75,
"gridLineStartPadding":35,
"fontSize":11
,"numberSectionStyles":3
}

I used the chart definition above without the leading %%. The configuration regarding the axis formatting will not work, so I have excluded that. This is because it contains javascript and the configuration is in a JSON file.
I hope this makes it easier to get things to work.

awesome, that works! Somehow I managed to break something before as I ran almost the same thing. Thanks again!

A fix for this has been released in version 0.5.0


Expand tests around referential actions and referential integrity

Right now we have minimal test coverage around referential actions:

https://github.com/prisma/prisma/blob/main/packages/client/src/__tests__/integration/happy/referentialActions-onDelete-cascade-mysql/test.ts
=> tests that cascading deletes work
https://github.com/prisma/prisma/blob/main/packages/client/src/__tests__/integration/errors/referentialActions-onDelete-default-foreign-key-error-mysql/test.ts
=> tests that restricting deletes works

(and equivalents for PostgreSQL, SQLite and SQL Server)
We should try to get full test coverage of all the referential actions and related settings like referentialIntegrity=prisma:
https://www.prisma.io/docs/concepts/components/prisma-schema/relations/referential-actions
https://www.prisma.io/docs/concepts/components/prisma-schema/relations/referential-integrity
Implementation Steps:

[ ] Test all the supported referential actions (defaults and explicitly set)

[ ] Duplicate all tests for referentialIntegrity=prisma and/or MongoDB

Current plan https://www.notion.so/prismaio/How-do-we-GA-the-referentialIntegrity-preview-feature-8a656fe445ae4a69ad19c5000e5c7191#8a3a59ebfddd4b50bb32aa5819a55b6e

Follow up issue when this is resolved: https://github.com/prisma/prisma/issues/15733

Done in https://github.com/prisma/prisma/pull/14221
Now merged to main


not finding inferenceservice_patch.yaml

/kind bug
What steps did you take and what happened:
cant find an example file inferenceservice_patch.yaml
https://github.com/kserve/kserve/blob/d1c24cd127523af1cc74d4e1536a816584699411/config/overlays/dev-image-config/kustomization.yaml#L5
What did you expect to happen:
inferenceservice_patch.yaml should be there
Anything else you would like to add:
using kserve in kubeFlow v1.5.0
Environment:

Istio Version:
Knative Version:
KFServing Version: kfserving/kfserving-controller:v0.6.1
Kubeflow version: 1.5.0
Kfdef:[k8s_istio/istio_dex/gcp_basic_auth/gcp_iap/aws/aws_cognito/ibm]
Minikube version: using aks 1.21
Kubernetes version: (use kubectl version):
Client Version: version.Info{Major:"1", Minor:"23", GitVersion:"v1.23.4", GitCommit:"e6c093d87ea4cbb530a7b2ae91e54c0842d8308a", GitTreeState:"clean", BuildDate:"2022-02-16T12:38:05Z", GoVersion:"go1.17.7", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"21", GitVersion:"v1.21.7", GitCommit:"118c47a50b26423bb47369437d0b7592bf5e67ba", GitTreeState:"clean", BuildDate:"2022-02-07T20:48:54Z", GoVersion:"go1.16.10", Compiler:"gc", Platform:"linux/amd64"}
WARNING: version difference between client (1.23) and server (1.21) exceeds the supported minor version skew of +/-1
OS (e.g. from /etc/os-release):
ubuntu wsl

This is the dev overlay which is only used for development purpose.


[Admin/News] The news cannot be edited/Updates are uploaded after reloading at least three times in POST & PUT & DELETE DTO

Environment: All
Reproducible: Always
Build found:
Preconditions

The site is open.
Logged in as an admin.

Steps to reproduce

Go to the 'Новини' page.
Click on the 'Створити новину' button.
Fill in all required fields.
Click on the 'Зберегти' button.
Reload the page and go to the end of the list of the news.
Click on the 'Edit' button.
Add some changes (e.g. url).
Repeat 4 and 5 steps.

Actual result

The news doesn't appear in the list immediately after creation.
There are no changes (400 Bad Request in the DevTools).

https://github.com/ita-social-projects/StreetCode/assets/135108144/36f81d55-56e1-45a2-b414-fe6401bdb748
https://github.com/ita-social-projects/StreetCode/assets/135108144/659a87bf-7248-48eb-ada7-c8eec8335b07

Expected result

The news appears in the list immediately after creation.
The news has been successfully created and updated.

Postconditions
Delete the news.
User story and test case links
User story #835
[Test case] #1001

After making some changes to the body text, the image disappeared.


Add runtime check for Ghost version

Quill will not work against all Ghost versions because the Ghost API is not stable and public yet. So we must add a runtime check that tests what version the user is running and inform them in case we don't support it / haven't tested against it. It might even make sense to refuse to proceed if the version is unsupported, to avoid messing with the user's data.

Useful API endpoints:
In 0.6.3:
GET /ghost/api/v0.1/configuration/ HTTP/1.1

HTTP/1.1 200 OK
{
    "configuration": [{
        "key": "version",
        "value": "0.6.3"
    }]
}

In 0.7.9:
GET /ghost/api/v0.1/configuration/about/ HTTP/1.1

HTTP/1.1 200 OK
{
    "configuration": [{
        "database": "sqlite3",
        "environment": "development",
        "mail": "",
        "version": "0.7.9"
    }]
}


[GEARPUMP-349] Optimize Graph topologicalOrderIterator performance

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

[ ] Make sure the commit message is formatted like:
[GEARPUMP-<Jira issue #>] Meaningful description of pull request
[ ] Make sure tests pass via sbt clean test.
[ ] Make sure old documentation affected by the pull request has been updated and new documentation added for new functionality.

Codecov Report

Merging #223 into master will decrease coverage by 0.02%.
The diff coverage is 96%.

@@            Coverage Diff             @@
##           master     #223      +/-   ##
==========================================
- Coverage   69.05%   69.03%   -0.03%
==========================================
  Files         191      191
  Lines        6104     6116      +12
  Branches      350      352       +2
==========================================
+ Hits         4215     4222       +7
- Misses       1889     1894       +5

@manuzhang

@huafengw could you explain a bit why it's faster now.

We also do an extra check for cycle here. Can it be removed ?
    if (dag.hasCycle()) {
      LOG.warn(s"Detected cycles in DAG of application $name!")
    }

    val indices = dag.topologicalOrderWithCirclesIterator.toList.zipWithIndex.toMap

Verified Beam ValidatesRunnerTests can be run much faster now.

LGTM


Add rakudobrew rehash command

I found that when using Rakudobrew bailador commadn line tool was not available untill after I used the "rakudobrew rehash" command.

thanks


[A11y] Fix bug - Screen reader is not announcing the associated information with axis selection radio buttons in data analysis chart view

Description

Announce associated information for axis selection radio button

Checklist

[ ] I have added screenshots above for all UI changes.
[ ] I have added e2e tests for all UI changes.
[ ] Documentation was updated if it was needed.

Codecov Report

Merging #1736 (abb45e3) into main (c86bfff) will increase coverage by 11.44%.
The diff coverage is n/a.

:exclamation: Current head abb45e3 differs from pull request most recent head 6a80a15. Consider uploading reports for the commit 6a80a15 to get more accurate results

@@             Coverage Diff             @@
##             main    #1736       +/-   ##
===========================================
+ Coverage   78.95%   90.39%   +11.44%
===========================================
  Files          19       39       +20
  Lines        1321     1718      +397
===========================================
+ Hits         1043     1553      +510
+ Misses        278      165      -113

Flag
Coverage Δ

unittests
90.39% <ø> (+11.44%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

raiwidgets/raiwidgets/constants.py

...dgets/raiwidgets/error_analysis_dashboard_input.py

...iwidgets/raiwidgets/fairness_metric_calculation.py

...idgets/raiwidgets/responsibleai_dashboard_input.py

raiwidgets/raiwidgets/fairness_dashboard.py

raiwidgets/raiwidgets/explanation_dashboard.py

raiwidgets/raiwidgets/model_analysis_dashboard.py

raiwidgets/raiwidgets/error_analysis_dashboard.py

raiwidgets/raiwidgets/error_analysis_constants.py

...iwidgets/raiwidgets/explanation_dashboard_input.py

... and 48 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Fix KAS HealthCheck for non DNS-Based ingress points in LB service

What this PR does / why we need it:
on non AWS platform, the LB ingress point for the kube-apiserver might not be DNS-based ('.svc.status.loadBalancer.ingress[].hostname'), but IP-based (.svc.status.loadBalancer.ingress[].ip).
In that case, the healthcheck won't succeed, since we are passing only the hostname into the healthCheckKASEndpoint() function, resulting in an error message like:
message: 'Get https://:7443/healthz: dial tcp :7443: connect: connection refused'

Which issue(s) this PR fixes (optional, use fixes #<issue_number>(, fixes #<issue_number>, ...) format, where issue_number might be a GitHub issue, or a Jira story:
Fixes # CNV-30376
Checklist

[ ] Subject and description added to both, commit and PR.
[ ] Relevant issues have been referenced.
[ ] This change includes docs.
[ ] This change includes unit tests.

/retest

thanks @orenc1
/lgtm


11557 - Homepage updates

This PR ...
Website Redesign - Homepage V3
Test Steps:

Log into RS
See changes

Changes

Additions per Figma

Checklist
Testing

[x] Tested locally?
[ ] Ran ./prime test or ./gradlew testSmoke against local Docker ReportStream container?
[x] (For Changes to /frontend-react/...) Ran npm run lint:write?
[ ] Added tests?

Linked Issues

Fixes #11557

Thanks, @penny-lischer!

[ ] It looks like "See our full network" is linking to the old where we're live page and not the new "our network" page.

@jakefishbein-navapbc the external link icon is added automatically to external links and is a CDC requirement. so that's fine. We just don't add it to Figma because the code automatically does it for us so eng doesn't need to do that

 @penny-lischer I added some screenshots pointing out discrepancies with the Figma file. Please let me know if you have questions. Thanks.
CC: @jillian-hammer

@jakefishbein-navapbc the body is 1.06rem which is the same size as listed under the Public health entities. The figma and our fonts are not always one-one. @jillian-hammer please advise.


Progress Button

The problem
When users double-click the call to action, feedback is missing and might lead to confusion about the status of the process/progress.
The solution
A progress button will help to avoid this mess. It prevents duplicate orders by disabling the button after the first click. It displays a progress bar over the button to let users know their order is processing. Users get clear and immediate feedback, so they won’t feel the need to click the button again.
Examples

Dupllikat => ttps://github.com/db-ui/design-feedback/issues/78


FIX: Improvements to archiving tool

When generating markdown for the archive, do not create links
to individual chat messages, because these will just show a
404 message when clicked.
Add a site setting to determine what to change the status of
the archive destination topic to. Before it was always changed
to archived, new options are open, archived, closed.
Hide the chat icon next to the topic title if the related channel
is read_only or archived.
Fix some issues in chat-setup initializer -- we were getting the chat
service twice, and also the chat quote datetime decorator would not
work for users without chat enabled. This is wrong because the post
decorations should always work.

When generating markdown for the archive

Can you share with me what this means?

@nattsw all the let usages are basically unintentional, will change to const where it makes sense :)


Error parsing events due to GEO location

Hello,
I have a self-hosted instance of exceptionless running. I noticed several unprocessed json files in the storage/q folder and started investigating the cause. According to the exceptionless log there is an error parsing a field. The exception is:
2016-02-09 09:17:00.0871  136 ERROR EventPostsJob Error while processing event post "q\a204f4f23850409e85c8b515d7eb4c86.json": MapperParsingException[failed to parse]; nested: NumberFormatException[For input string: "3667,4,9"];  System.ApplicationException: MapperParsingException[failed to parse]; nested: NumberFormatException[For input string: "3667,4,9"];
   at Foundatio.Elasticsearch.Repositories.ElasticRepositoryBase`1.<AddAsync>d__4.MoveNext() in C:\projects\foundatio-repositories\src\Elasticsearch\Repositories\ElasticRepositoryBase.cs:line 53
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Exceptionless.Core.Pipeline.SaveEventAction.<ProcessBatchAsync>d__4.MoveNext() in C:\projects\exceptionless\Source\Core\Pipeline\040_SaveEventAction.cs:line 22

Then I started to look into the elasticsearch logs and I got this snippet of log:
[2016-02-09 09:17:00,087][DEBUG][action.bulk              ] [ex-es01] [events-v1-201602][1] failed to execute bulk item (index) index {[events-v1-201602][events][56b9a07c7957130410333b16], source[{"id":"56b9a07c7957130410333b16","organization_id":"5508472bfcce2921ecec573d","project_id":"55084d9dfcce2a21ecb3d5d4","stack_id":"56698a3679571410f00c975b","is_first_occurrence":false,"is_fixed":false,"is_hidden":false,"created_utc":"2016-02-09T08:17:00.0714496Z","idx":{"session-r":"56b997e279571311a8efc20c"},"type":"error","date":"2016-02-09T09:15:37.8804443+01:00","message":"Er zijn één of meer fouten opgetreden.","geo":"52,3667,4,9","data":{"@version":"<IP_ADDRESS>","@error":{"message":"Er zijn één of meer fouten opgetreden.","type":"System.AggregateException","data":{"@target":{"ExceptionType":"System.Net.WebException"}},"inner":{"message":"Er is een fout opgetreden bij het verzenden van het aanvraag.","type":"System.Net.Http.HttpRequestException","inner":{"message":"Kan geen verbinding met de externe server maken","type":"System.Net.WebException"}}},"@environment":{"processor_count":8,"total_physical_memory":34031341568,"available_physical_memory":25194328064,"command_line":"\"C:\\Users\\Ilyass\\AppData\\Local\\Programs\\ReflexSystems\\Reflex NG (Acceptation)\\ReflexNG.DesktopClient.exe\" ","process_name":"C:\\Users\\Ilyass\\AppData\\Local\\Programs\\ReflexSystems\\Reflex NG (Acceptation)\\ReflexNG.DesktopClient.exe","process_id":"9496","process_memory_size":179843072,"thread_id":"8628","architecture":"x64","o_s_name":"Microsoft Windows 10 Pro","o_s_version":"6.2.9200.0","ip_address":"<IP_ADDRESS>","machine_name":"WKS055","install_id":"3edc1ce15d874c1ba5080afcda8f622b","runtime_version":"4.0.30319.42000","data":{"AppDomainName":"ReflexNG.DesktopClient.exe"}},"@user":{"identity":"Ilyass"},"@location":{"country":"NL"},"@ref:session":"56b997e279571311a8efc20c"}}]}
org.elasticsearch.index.mapper.MapperParsingException: failed to parse
	at org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:565)
	at org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:493)
	at org.elasticsearch.index.shard.IndexShard.prepareIndex(IndexShard.java:492)
	at org.elasticsearch.action.bulk.TransportShardBulkAction.shardIndexOperation(TransportShardBulkAction.java:409)
	at org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:148)
	at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$PrimaryPhase.performOnPrimary(TransportShardReplicationOperationAction.java:574)
	at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$PrimaryPhase$1.doRun(TransportShardReplicationOperationAction.java:440)
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:36)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.lang.Thread.run(Unknown Source)
Caused by: java.lang.NumberFormatException: For input string: "3667,4,9"
	at sun.misc.FloatingDecimal.readJavaFormatString(Unknown Source)
	at sun.misc.FloatingDecimal.parseDouble(Unknown Source)
	at java.lang.Double.parseDouble(Unknown Source)
	at org.elasticsearch.common.geo.GeoPoint.resetFromString(GeoPoint.java:69)
	at org.elasticsearch.index.mapper.geo.GeoPointFieldMapper.parsePointFromString(GeoPointFieldMapper.java:551)
	at org.elasticsearch.index.mapper.geo.GeoPointFieldMapper.parse(GeoPointFieldMapper.java:527)
	at org.elasticsearch.index.mapper.object.ObjectMapper.serializeValue(ObjectMapper.java:706)
	at org.elasticsearch.index.mapper.object.ObjectMapper.parse(ObjectMapper.java:497)
	at org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:544)
	... 10 more

As far as I can determine the parsing of this particular part of json "geo":"52,3667,4,9" seems to cause the issue. Is this a bug or is this a setting gone wrong somewhere?
Thank you for your time,
Ivar

What local are you running in? I think it's an issue with the number format of the client or server? It should be a lat,long

The server is running on US locale. The clients with the problem are running on NL-nl.

Hmm, yeah, guess we need to make sure that we specify the string format instead of letting it use the default.

@InlineAsm I have a fix for both server and client that fixes this issue. I'll try and getting a new client release out soon: https://github.com/exceptionless/Exceptionless.Net/commit/0a4e07ee458c73efbc213a615be756f37b8adfce

The server side is minor and you won't have to update. It's mainly the client that is broken under different cultures and needs the update.

Thank you very much for the fast response and fix!

I'm afraid the fix didn't fix it. You need to specify the CultureInfo.InvariantCulture in the ToString method to properly format the decimal with a point regardless of the culture. I missed it earlier when I was reviewing your change.

So even though we are specifying a custom format, it will still change the decimal point to a comma in some locales? Didn't think it would automatically change a custom format string.

Yes, the format alone is not enough. I created a pullrequest on the exceptionless.net repo that fixes it.

Aw thanks!

I'm fixing this server side as we speak.

Thanks again! Can you please let me know if you run into any issues. I can push a new client build soon. If you need a new server build you can grab it via our build artifacts or let me know.

Thanks! I need the client update most as I now have to delete around 8000 json files every 2 days because the clients are sending invalid data. I don't think that I need to update the server. It's running on US-us.

Pushing the latest release now (1565) to nuget,

Thanks, I updated the client. I would be interested in the server artifacts too since I checked again and although the server runs and english version of Windows the locale is dutch there too... I couldn't find artifacts for the server build.

Looks like we aren't pushing artifacts as part of the build. Can you let me know if the current server works under the different locale or if you still have issues. If you have issues is there any chance you could download the master repo and build it or I'm going to need to push a new minor release and I wanted to wait a week or two to get a few more things into it.

I built the server myself and it works now with the Dutch locale. No need to rush a release. Thank you very much.

Awesome, thank you for the feedback!


Create valid certificates

Right now the certificates that are automatically generated will work, but you have to tell the browser its okay, and the https thing in the URL has a red cross through it. See if you can remedy all of that by generating proper certificates.

I'm not planning on having https or http2 support for local development


Failed to send message results in kt not responding

Failed to send message, quitting. err=kafka server: Tried to send a message to a replica that is not the leader for some partition. Your metadata is out of date. ^C2016/10/13 09:38:55 Received interrupt - shutting down...
When failing to produce a message, if you try kill kt (ctrl + c) it just hangs forever.

Also looks like you can't kill kt if it's in the middle of producing.

@jackhopner That err message was removed in June, could you try running
go get -u github.com/fgeller/kt

that would get you the latest (unreleased) or download the latest release from https://github.com/fgeller/kt/releases ?

closing this for now - please re-open if you see it again @jackhopner


Error Query is not bootstrapped any are not .net console project

Describe the bug
error Query is not bootstrapped. in blazor project when using lambda syntax

How to Reproduce

run project from this repository https://github.com/sabuydee/ZeroQL-Lab
go to fetch data page and see error

Screenshots
code in ZeroQLLab/Pages/FetchData.razor

Environment (please complete the following information):

Nuget package version [All version)
IDE: VS, VS for Mac, Rider, VS Code
.Net Version 6.0.400

Looks like there is nothing I can do. The modern razor files are processed via source generator. The resulted C# then executed at runtime. As a result, other source generators do not have access to generated code. Here more information about it
You can try to legacy razor processing by adding
<UseRazorSourceGenerator>false</UseRazorSourceGenerator>

or move ZeroQL query to a independent C# service.

It seems that a work around for the issue is to use a partial class for the razor component. For example, using Index.razor for markup and Index.razor.cs for code.
G.


Slider doesn't play well with big thumb size

Describe the bug
Increasing the size of the thumb of a slider brings up the issue that the position of the thumb is not calculated properly on drag,
relatively to the current position of the thumb. Also clicking on the track will not place the thumb where you expect it to be, the more you are clicking away from the center of the track.
To Reproduce
Add a slider, and increase the thumb width.
If the thumb is on the very left, you will notice, that on drag it will jump quit a bit right, before it will move along with the movement of the pointer. On the very right, it will jump to the left. If you place the thumb on the exact middle, this jump will not happen.
<Slider Width="200">
        <Slider.Resources>
            <x:Double x:Key="SliderHorizontalThumbWidth">48</x:Double>
        </Slider.Resources>
</Slider>

Expected behavior
That the thumb will always move along with mouse cursor, regardless of its size, and that a click on the track will place the thumb center directly under the pointer.
Screenshots

Desktop (please complete the following information):

OS: MacOS 12
Version: 0.10.10

I've created a Pull Request fixing this behaviour:

How can I change the thumb size on the slider? How and where can I change it?
I tried with the code above but nothing changes.


Issue 363 - Unable to save new workspace

Fixes #363

I added a min-height to master-controls class because the active/inactive switch on workspaces was overlapping with the list when user is not able to edit workspaces. Otherwise, LGTM


[Suggestion] Coping with subdirectories of webserver document root.

Due to the issue #107 I wondered whether Expressive could have some option to deal with subdirectories.
For instance using environment dependant configuration options. In my case it is only necessary for the test environment where a developer has multiple websites under one document root, and no way to change the document root (i.e. no root access).
From the cookbook (http://zendframework.github.io/zend-expressive/cookbook/using-a-base-path/) I gather that the problem is well know and well understood.
Would it be a good idea to incorporate such an option into Expressive? Or at least enter into the standard expressive docs how to accomplish this?

That URL is the location of the official standard expressive docs. Well, sort of. It's actually https://docs.zendframework.com/zend-expressive/cookbook/using-a-base-path/ but they both point to the same files.
There are several other ways to accomplish what you want for developing multiple sites locally:

Use a .htaccess file and some rewrite rules.
Use vagrant or docker and build an exact copy of your server.
Use the host file. Add something like my-site.dev and my-site2.dev to the host file and make apache point to the right source code.

=== Quick start ===
I am new to Zend (and Zend 3). For me the cookbook was too far from the "quick start" instructions. I got stuck at point 5 (Start a webserver) when I replaced the internal server (php -S <IP_ADDRESS>) by a subdirectory of my company's testserver.  Point 5 in the quickstart might be a good location for a quick remark and some pointers (f.i. to the cookbook) for ppl that want to use subdirectories on testservers.
=== Middleware ===
The other part of the question I had is whether the expressive skeleton could automatically take care of subdirs. From the cookbook I understand that .htaccess rewrite rules are only part of the solution. The middleware needs adapted to take care of the rest.
P.S. I wish I had the knowledge to propose a code change, but I am still wrestling with the Zend3 contents, so for now that is out.


Refactor the BuilderInputWrapper into InputController

[ ] Include BuilderInputWrapper inside InputController (consider Mouse input)
[ ] Refactor InputController to include input key inside the Scriptable Object
[ ] Include Scriptable Object per platform

Check in new Unity Input Controller could help solve most of this issues


Change Event?

I can't seem to get the (change) event to fire on the mdInput or the md-datetimepicker
<md-input-container floatPlaceholder="never" class="scheduledDateContainer">
    <input mdInput [MdDatetimepicker]="picker" placeholder="Select a date and time."
        [(ngModel)]="article._setup_sendDateTime"
        (change)="changeScheduledDateTime($event)">
    <button mdSuffix [mdDatetimepickerToggle]="picker"></button>
</md-input-container>
<md-datetimepicker #picker (change)="changeScheduledDateTime($event)"></md-datetimepicker>

Have you tried ngModelChange?
On Jul 14, 2017 12:09 PM, "chrishawn"<EMAIL_ADDRESS>wrote:

I can't seem to get the (change) event to fire on the mdInput or the
md-datetimepicker

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/michael-mcanulty/md-datetimepicker/issues/1, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ASl-NBRitFqI7XDAYSDGsd5vi6Lfu_7rks5sN7z8gaJpZM4OYoKF
.

I hadn't but that does fire thanks

Yeah no prob. BTW I don't use the 2-way binding though on ngModel when I
use ngModelChange, I just use the brackets, it has always not worked.
On Jul 14, 2017 12:15 PM, "chrishawn"<EMAIL_ADDRESS>wrote:

I hadn't but that does fire thanks
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/michael-mcanulty/md-datetimepicker/issues/1#issuecomment-315444393,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ASl-NE94OR9Xdt4LQhWJHDw2M42tja9cks5sN74zgaJpZM4OYoKF
.


Check cluster ID hasn't changed on each request

This catches the case where the cluster is rebuilt from a backup
or replaced unexpectedly.  Without this change, we'd potentially
watch on an etcd index that was only valid on the old cluster.

On read, record the cluster ID of the server.  We have to defer loading of
the resource so we can check the headers before blocking on a
watch.
On watch, check the cluster ID hasn't changed.

Thanks a lot, this makes a lot of sense, but I was thinking of going further with this:

If no cluster ID is given to the client upon instantiation, the first request we do (the one for the machines in the cluster) should set it.

Any subsequent request should raise an exception if the cluster id doesn't appear

This would make your code a lot thinner and more beautiful too. I'm fixing some issue with self.machines today so you may want to wait for that - or I can take your patch and modify it.
Very good work anyways!

Hi,
The patch does set the cluster ID if it's not passed in IIRC. I allow it to
be passed in so that it can be transferred from one client to another if
the user needs to recreate the client.
I'm happy for the exception to be raised on any request (i.e. not just
watch requests) but I was worried that unsuspecting users might get tripped
up by the new exception.
-Shaun
On 26 Apr 2015 12:31 am, "Giuseppe Lavagetto"<EMAIL_ADDRESS>wrote:

Thanks a lot, this makes a lot of sense, but I was thinking of going
further with this:

If no cluster ID is given to the client upon instantiation, the first
request we do (the one for the machines in the cluster) should set it.
Any subsequent request should raise an exception if the cluster id
doesn't appear
This would make your code a lot thinner and more beautiful too. I'm fixing
some issue with self.machines today so you may want to wait for that - or I
can take your patch and modify it.
Very good work anyways!
—
Reply to this email directly or view it on GitHub
https://github.com/jplana/python-etcd/pull/92#issuecomment-96336632.

@fasaxc you're right, you set it, but the code right now is a bit complicated tbh. What I as a developer would expect is that the cluster id is an inherent property of my connection to etcd, which can be set when instantiating the object, or explitictly changed with a specifc method call.
This would really simplify your code - I guess I'll try to show you a simplified version whenever I have time.

I was keen to set it on the first request, whatever that is. IIRC the code
doesn't always get the list of machines, depending on the arguments passed
to the constructor.
For my use case I'd be happy if we checked the cluster ID on every request
but I was worried about raising new exceptions from all reads, which breaks
compatibility with existing apps.
If you're not worried about that then there's no need for the flag.
Shaun
On Sun, 26 Apr 2015 23:57 Giuseppe Lavagetto<EMAIL_ADDRESS>wrote:

@fasaxc https://github.com/fasaxc you're right, you set it, but the
code right now is a bit complicated tbh. What I as a developer would expect
is that the cluster id is an inherent property of my connection to etcd,
which can be set when instantiating the object, or explitictly changed with
a specifc method call.
This would really simplify your code - I guess I'll try to show you a
simplified version whenever I have time.
—
Reply to this email directly or view it on GitHub
https://github.com/jplana/python-etcd/pull/92#issuecomment-96523986.

@lavagetto I've removed the condition, it now checks the ID every time, which is much simpler.  I also rebased onto the current master and fixed up the UTs.
I couldn't move the initialization of the cluster ID to the the machines() method because it is only called if allow_reconnect is True.

Sorry to keep changing this but one of my colleagues got tripped up by the new behaviour, he wasn't expecting the EtcdClusterIdChanged error to be persistent and raised on every call.  I think I should adapt it to better match his expectations.  Otherwise, common patterns like this will start failing after this change:
client = etcd.Client()
while True:
    try:
        ...
        client.set(...)
    except EtcdException:
        print "Etcd request failed, retrying..."

OK, I've updated the PR with that change.

@fasaxc I think the last version of the patch is what I as an user would expect to see.
LGTM and thanks again for the wonderful work.


Sharpen wording in docs on passwordless SSH connection

The docs state that the user should "Set up passwordless ssh to your server. Usually this means you have ssh-agent running with your private key loaded". Does it matter if ssh-agent is not used? It would be nice with an additional sentence along the lines of "This has only been tested by using ssh-agent for passwordless access", or "As long as you have passwordless access (i.e. you are not prompted for a password when running `ssh @<ip_adress>, you are good to go.", to inform users about what they should do and expect.

You need passwordless access of some kind. Basically, running the ssh process to set up the tunnel shouldn't require any user input. I don't know whether there's options other than ssh-agent, so we could mention that.
We should probably just search for a good tutorial on how to set up ssh and link to that.

I just followed the setps in https://www.strongdm.com/blog/ssh-passwordless-login. Essentially just the following:

On the client, run ssh-keygen -t rsa. Accept default filename and location, and set no password.
On the server (RPi), create .ssh dir by mkdir -p .ssh
From the server, run ssh-copy-id<EMAIL_ADDRESS>to upload key

It was somewhat different for non-linux client, but those instructions are also included. Could you verify that this tutorial looks good, and follows best practices? This is my first go as passwordless SSH, so I have no idea what the best practices are, if there are any.


SocketException: Connection refused (OS Error: Connection refused, errno = 111)

What version of Prisma Dart is running?
5.2.0
What version of Prisma CLI is running?
5.21.0
What type of app are you using?
Dart Native (Server/CLI)
What database are you using?
PostgreSQL
What steps can reproduce the bug?
Setup a basic shelf_modular server. Then try to access the database once a route is called. The entire codebase producing the error can be found here.
What is the expected behavior?
The database is queried correctly and results are returned.
What do you see instead?
ERROR - 2024-10-16 17:24:08.947090
GET /admin/licenses/123
Error thrown by handler.
SocketException: Connection refused (OS Error: Connection refused, errno = 111), address = <IP_ADDRESS>, port = 45628
dart:_http                                        _HttpClient.openUrl
package:webfetch/src/client/client.io.dart 22:23  Client.send
client.io.dart:22
package:webfetch/src/fetch.dart 63:24             fetch
fetch.dart:63
package:orm/src/engines/binary_engine.dart 62:28  BinaryEngine.request
Additional information
Love the package ❤

@mcquenji We are investigating, please wait. I will comment on this issue if there is any progress. ❤

@mcquenji https://github.com/necodeIT/license_server/blob/main/bin/main.dart#L55
I noticed that you shut down the engine in main. This approach is suitable for disposable apps (such as CLI), for web you should shut it down in the logic that confirms your web server exits.
Or you don't need to shut down the database query engine (it just has a certain probability that the chind process will not be shut down after the Dart process exits unexpectedly)

Maybe I should update the documentation to tell developers that this method of ensuring the query engine is shut down is not applicable to Web Server applications.

oh god, now i feel stupid 😓 But thanks for your help ❤


GCP Logging - logs are segmentated randomly

Describe the bug
Some of the Falco logs are separated into multiple lines when pushed to GCP Cloud Logging. The logs in the container are intact.
How to reproduce it

Deploy Falco via GCP Market into GKE cluster.
Create Cloud Logging sink to gather logs from Falco
Open Logs Explorer and check the logs.
After some time broken logs will arrive.

Expected behaviour
Logs are visible in the same manner as in the container itself.
Screenshots

The split log is marked with red rectangles. Same log is a single line in Falco container.
Environment

Falco version:
Fri Sep 15 07:52:33 2023: Falco version: 0.34.1 (x86_64)
Fri Sep 15 07:52:33 2023: Falco initialized with configuration file: /etc/falco/falco.yaml
Falco version: 0.34.1
Libs version:  0.10.4
Plugin API:    2.0.0
Engine:        16
Driver:
API version:    3.0.0
Schema version: 2.0.0
Default driver: 4.0.0+driver

System info:
{
"machine": "x86_64",
"nodename": "gke-asia-east1-001-workload-16-b191d2cc-bym8",
"release": "5.15.0-1036-gke",
"sysname": "Linux",
"version": "41-Ubuntu SMP Wed Jun 7 04:23:11 UTC 2023"
}

Cloud provider or hardware configuration:
Google Cloud Platform

OS:
PRETTY_NAME="Debian GNU/Linux 11 (bullseye)"
NAME="Debian GNU/Linux"
VERSION_ID="11"
VERSION="11 (bullseye)"
VERSION_CODENAME=bullseye
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"

Kernel:
Linux gke-asia-east1-001-workload-16-b191d2cc-bym8 5.15.0-1036-gke 41-Ubuntu SMP Wed Jun 7 04:23:11 UTC 2023 x86_64 GNU/Linux

Installation method:
Kubernetes (GKE), Falco deployed via GCP Market Applications.

Additional context
I tried changing Falco config, to adjust the throttling settings or buffering but it didn't solve the issue. If it can be solved by changing the config I will appreciate it greatly if someone points me how to fix it.

ei that's interesting, thank you for reporting! do you know if all Falco versions are affected by this behavior? I've seen that you are using Falco 0.34.1, do you mind to try also Falco 0.35.1?
I'm not 100% sure this is a problem in Falco but we could investigate

ei that's interesting, thank you for reporting! do you know if all Falco versions are affected by this behavior? I've seen that you are using Falco 0.34.1, do you mind to try also Falco 0.35.1?
I'm not 100% sure this is a problem in Falco but we could investigate

Hi @Andreagit97 ! 👋
Thanks for your reply. No, I haven't tried other versions.
It won't hurt to try the newer release and see if that happens as well.

Sorry for taking so long, I've been away for two weeks.
I deployed Falco via Helm chart, just as suggested in the official documentation.
The pods are running, the logs are gathered and collected in GCP Cloud Logging, but even on version 0.36 the issue is still there.
@Andreagit97 , can you investigate that please? 🙏

ok thank you for the feedback, we will try to take a look!

Awesome! Don't hesitate to reach out via this thread. I'll be checking it daily. 🙂

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.
If this issue is safe to close now please do so with /close.
Provide feedback via https://github.com/falcosecurity/community.
/lifecycle stale

Hi @Andreagit97 👋 Any luck with this one?

ei @zubmic, I've tried to reproduce the issue without success...
I've deployed Falco with the latest helm chart in the following way (the Falco shipped in the market place seems not updated, we need to update it!):
helm install falco falcosecurity/falco \
    --set driver.kind=modern-bpf  --namespace falco --create-namespace

and then I observed the logs for almost 2 hours using the following query:
resource.type="k8s_container"
resource.labels.project_id=...
resource.labels.location=...
resource.labels.cluster_name=...
resource.labels.namespace_name="falco"

Maybe I'm missing something...
BTW I'm pretty convinced that this is not a Falco issue if the logs are not fragmented in the Falco container... In the end, the Logs Explorer should only use the output of the container so Falco shouldn't be involved in how logs are rendered in the Logs Explorer :thinking:
@Issif have you ever seen something similar in GKE environments?

Seems more related to the way GKE scrap or parse the logs.
I'm curious, if you enable the json format for the Falco output, do you get the same result?

I checked again and changed the output format to json. The outcome is still the same, the logs get fragmented.

Stale issues rot after 30d of inactivity.
Mark the issue as fresh with /remove-lifecycle rotten.
Rotten issues close after an additional 30d of inactivity.
If this issue is safe to close now please do so with /close.
Provide feedback via https://github.com/falcosecurity/community.
/lifecycle rotten

/remove-lifecycle rotten

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.
If this issue is safe to close now please do so with /close.
Provide feedback via https://github.com/falcosecurity/community.
/lifecycle stale

Stale issues rot after 30d of inactivity.
Mark the issue as fresh with /remove-lifecycle rotten.
Rotten issues close after an additional 30d of inactivity.
If this issue is safe to close now please do so with /close.
Provide feedback via https://github.com/falcosecurity/community.
/lifecycle rotten

/remove-lifecycle rotten
to be honest I'm not sure what we can do here on the Falco side... @Issif do you have other ideas?

This is a tricky question. There's a max length for sure, not by character but by size of the payload: https://cloud.google.com/logging/quotas. I don't know which process is in charge of splitting the lines to fit in the max size but I hope it does that correctly and the multiple parts are consistent with the initial payload when merged.
I don't know how to solve that, if the log line was in JSON, we could:

try to UnMarshal it into a struct
if it fails (because the JSON is invalid, as truncated), keep the string into a buffer
wait for a next Unmarshal failure
concatenate the strings (the current and the one in the buffer)
repeat the process
drop old strings from the buffer periodically

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.
If this issue is safe to close now please do so with /close.
Provide feedback via https://github.com/falcosecurity/community.
/lifecycle stale

Stale issues rot after 30d of inactivity.
Mark the issue as fresh with /remove-lifecycle rotten.
Rotten issues close after an additional 30d of inactivity.
If this issue is safe to close now please do so with /close.
Provide feedback via https://github.com/falcosecurity/community.
/lifecycle rotten

Rotten issues close after 30d of inactivity.
Reopen the issue with /reopen.
Mark the issue as fresh with /remove-lifecycle rotten.
Provide feedback via https://github.com/falcosecurity/community.
/close

@poiana: Closing this issue.

In response to this:

Rotten issues close after 30d of inactivity.
Reopen the issue with /reopen.
Mark the issue as fresh with /remove-lifecycle rotten.
Provide feedback via https://github.com/falcosecurity/community.
/close

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.


"Auto" values?

Currently you have to specify 2 parameters (height and width) in order to generate a thumbnail with focusCrop.
In kirby you can do something like: echo thumb($image, array('width' => 1920)) and kirby will take the image ratio into account and calculate the proper height.
With focus crop you can just do this: echo $image->focusCrop(200); which will crop a square. Is there a possibility to get something like focusCrop(200, auto) ? For me I almost always just use the width parameter for my thumbnail generations without a height so I can't use your plugin then in those cases.

Thanks for your suggestion. Maybe I'm wrong, but …
If you create thumbnails by defining either width or height and calculating the other value taking the ratio of the original image into account, then there's no cropping – you just scale the image. And if you don't crop the image, you don't need to define a focus point. In this case I would simply stick to the thumb() method as you described.
But maybe you mean something different and I don't understand your use case. I would like to hear your feedback.
Thanks and regards.
Flo.

Ouh I never thought it that way. Seems you're right and it doesn't make sense with auto as an argument :)


Fix deprecated RSClusterLayout use in layouts and examples

Switch the use of the deprecated class RSClusterLayout in favor of RSClusterTreeLayout as suggested in the RSClusterLayout documentation.

Closed in #6


transform a live in VOD

Purpose
When a live is ended we want to transform it in a VOD. In a first time only an instructor will be able to access this VOD.
To transform it in VOD, we need to copy all the HLS files in the destination bucket and generate an MP4 video.
To copy the HLS files, we need to create a mediapackage harvest job.
Once the harvest job succeeded we will transcode this HLS video into an MP4 container and save it in the destination bucket related to the current video.
We also have to rework on the front application to display the video only for instructor
Proposal
mediapackage lambda
We need a new lambda. This lambda will receive an event from mediapackage harvest when a job is SUCCEEDED. With this event we transcode the HLS copied in the destination bucket in an MP4 container. To do this we use FFMPEG. The stdin is the hls manifest read from the cloudfront endpoint. The ouput is an MP4 file upadted later on S3.
We have a restriction to solve with a lambda here. It is not possible to write more than 512MB of data in the /tmp directory, the only writable directory in our lambda. To solve this issue we dediced to use EFS, a shared filesystem provided by AWS. To mount this filesystem in a lambda we also have to configure a VPC. The filesystem will be accessible in a private subnet. The private subnet has a gateway with the public one to access internet.
Both services are then configure on the lambda.
Missing:

[x] generate a thumbnail

backend
The back application is responsible to create the harvest job. When a live is ended, before destroying all the medialive stack it creates the harvest job
frontend
TODO

@lunika reading your description I realized that, now that we removed Dash and know how to generate all the files without MediaConvert, there's nothing more to do to display the resulting VOD to the student as well... is there?

@lunika reading your description I realized that, now that we removed Dash and know how to generate all the files without MediaConvert, there's nothing more to do to display the resulting VOD to the student as well... is there?

@lunika reading your description I realized that, now that we removed Dash and know how to generate all the files without MediaConvert, there's nothing more to do to display the resulting VOD to the student as well... is there?

Yes it's easy to generate all the profiles. We will maybe have to modify the medialive profiles to match exactly the profiles generated by media convert.

@lunika reading your description I realized that, now that we removed Dash and know how to generate all the files without MediaConvert, there's nothing more to do to display the resulting VOD to the student as well... is there?

Yes it's easy to generate all the profiles. We will maybe have to modify the medialive profiles to match exactly the profiles generated by media convert.

@lunika definitely! I thought it was already the case ^^

@lunika definitely! I thought it was already the case ^^

Update 18/01
We decided to change how this feature will be implemented.
We will transmux the live in all existing resolution. Transmuxing long video can take several minutes and the lambda will end with a timeout. To avoid this we must split the video during transmuxing and then concatenate it at the end. Repeat this for each resolution.
How to split the video during transmuxing : https://trac.ffmpeg.org/wiki/Seeking
This command will split the video in a chunk of 20 minutes. -copyts will keep the original timestamps, this is important to keep it for further concatenation. -avoid_negative_ts 1 is also needed for futther concatenation.
$ ffmpeg -ss 0 -i https://distribution_id.cloudfront.net/a3e213a7-9c56-4bd3-b71c-fe567b0cfe19/cmaf/dev-manu_a3e213a7-9c56-4bd3-b71c-fe567b0cfe19_1610458282_hls_2.m3u8 -t 1200 -codec copy -copyts -avoid_negative_ts 1 -f mp4 fragment1.mp4

Once all fragments created, we have to list them in a file, here all fragments path are relative to this file :
$ cat list.txt
file 'fragment1.mp4'
file 'fragment2.mp4'
file 'fragment3.mp4'

And the command to concat all the fragments : https://trac.ffmpeg.org/wiki/Concatenate
$ ffmpeg -f concat -i list.txt -c copy -f mp4 merged.mp4

Update 18/01
We decided to change how this feature will be implemented.
We will transmux the live in all existing resolution. Transmuxing long video can take several minutes and the lambda will end with a timeout. To avoid this we must split the video during transmuxing and then concatenate it at the end. Repeat this for each resolution.
How to split the video during transmuxing : https://trac.ffmpeg.org/wiki/Seeking
This command will split the video in a chunk of 20 minutes. -copyts will keep the original timestamps, this is important to keep it for further concatenation. -avoid_negative_ts 1 is also needed for futther concatenation.
$ ffmpeg -ss 0 -i https://distribution_id.cloudfront.net/a3e213a7-9c56-4bd3-b71c-fe567b0cfe19/cmaf/dev-manu_a3e213a7-9c56-4bd3-b71c-fe567b0cfe19_1610458282_hls_2.m3u8 -t 1200 -codec copy -copyts -avoid_negative_ts 1 -f mp4 fragment1.mp4

Once all fragments created, we have to list them in a file, here all fragments path are relative to this file :
$ cat list.txt
file 'fragment1.mp4'
file 'fragment2.mp4'
file 'fragment3.mp4'

And the command to concat all the fragments : https://trac.ffmpeg.org/wiki/Concatenate
$ ffmpeg -f concat -i list.txt -c copy -f mp4 merged.mp4

closed by #850


Issue faced with adding a global validator

Codepen
https://codepen.io/xavianaxw/pen/EGeWLj
Description
I've tried setting up PristineJS with a custom global validator my-range that throws an error when the value input is not between the minimum and maximum value. This was as per the example on the README.
In my HTML, I've set the input to respect the required and data-pristin-my-range="10,30" rule.
Expected behavior

Input throws an error on required
Input throws an error on data-pristine-my-range if not between 10 - 30

Outcome

Input does throw an error on required
Input does not respect data-pristine-my-range rule set.

Would be best if you can help point me in the right direction!
Cheers

Hi @xavianaxw, this issue has been fixed. Please check https://codepen.io/sha256/pen/ZPOoYp

Cool


CUDA out of memory

In your dataset ,cuda run out of memory as long as the trainer begins:
however, without changing any other element/parameter,just switch dataset to LineByLineTextDataset,everything becames OK.

Could you provide more details ? What's the code you ran ?

`
tokenizer = FunnelTokenizer.from_pretrained('funnel-transformer/small')
def tokenize(batch):
return tokenizer(batch['text'], padding='max_length', truncation=True,max_length=512)
dataset = load_dataset("bookcorpus",split='train[:1000]').shuffle()
dataset = dataset.map(tokenize, batched=True, batch_size=512)
dataset = LineByLineTextDataset(
tokenizer=tokenizer,
file_path="./wiki1000.txt",
block_size=128
)
data_collator = DataCollatorForLanguageModeling(
tokenizer=tokenizer, mlm=True, mlm_probability=0.15
)
config=FunnelConfig(
return_dict=True
)
model= FunnelForMaskedLM(config=config)
training_args = TrainingArguments(
output_dir="./checkpoints",
overwrite_output_dir=True,
do_train=True,
num_train_epochs=1,
per_device_train_batch_size=16,
per_device_eval_batch_size=16,
save_steps=10000,
logging_dir='./ptlogs'
)
trainer = Trainer(
model=model,
args=training_args,
data_collator=data_collator,
# train_dataset=traindata,
# eval_dataset=evaldata
train_dataset=dataset,
)
trainer.train()
`

RuntimeError: CUDA out of memory. Tried to allocate 954.00 MiB (GPU 0; 15.90 GiB total capacity; 14.35 GiB already allocated; 753.75 MiB free; 14.39 GiB reserved in total by PyTorch) Exception raised from malloc at /pytorch/c10/cuda/CUDACachingAllocator.cpp:272 (most recent call first):
part of error output

from funnel model to bert model : error still happened
from your dataset to LineByLineTextDataset : error disapeared

notice i just loaded 1000 rows of data

the error happens when executing loss.backward()

Since you're using a data collator you don't need to tokenizer the dataset using map. Could you try not to use map and only the data collator instead ? The data collator is supposed to pad to the longest sequence in each batch afaik, instead of padding to 512.
Also cc @sgugger

Closing this one.
Feel free to re-open if you have other questions about this issue


test: CHESSPWA-68 increase test coverage

Codecov Report

Merging #67 into master will increase coverage by 0.56%.
The diff coverage is n/a.

@@             Coverage Diff             @@
##           master       #67      +/-   ##
===========================================
+ Coverage   99.43%   100.00%   +0.56%
===========================================
  Files          21        21
  Lines         713       713
  Branches      162       162
===========================================
+ Hits          709       713       +4
+ Misses          4         0       -4

Impacted Files
Coverage Δ

src/components/integrations/WithMoveValidation.tsx
100.00% <0.00%> (+2.81%)
:arrow_up:

src/index.tsx
100.00% <0.00%> (+100.00%)
:arrow_up:


Deleted entities are not cleared from any entity where they are inlined

deleted entities are marked as such and are removed from pagination sections
deleted entities however remain in any entity where they are inlined. For example an org entity has a collection of spaces. Deleted spaces remain in this list.
Possible solution - ensure missing or entities marked as deleted are not returned after the normalize process runs

We do actually catch the space deletion case. We should sit down and find areas that we're missing this functionality.


How to download the training dataset?

A silly question: where to download the specific training datasets?
Thanks!

You can download the training datasets from their official website.
LaSOT
GOT-10k
TrackingNet
COCO 2017

Great! Downloading.
Thanks!


player's accountId

hey andshrew,
congratulations for this amazing project.
I wonder if you know some route in the playstation api to get player's accountId of any player non related to the npsso key. For example, to get accountId of all player's friends.

Hi @rafaelfgyn
Thanks for your comment. I know of the following endpoints you can use. You should be able to authenticate to these in the same way which is mentioned here.

https://m.np.playstation.net/api/userProfile/v1/internal/users/me/friends
This returns a list of the accountIds on the friends list of the account you used to authenticate with. You can also swap me for another accountId and you will get their friends list back (assuming the authenticating account has permission to view the other accounts friends list).

https://m.np.playstation.net/api/userProfile/v1/internal/users/{accountId}/profiles
This returns the basic profile details for an account so you can discover the onlineId (their PSN name) from an accountId.

https://m.np.playstation.net/api/userProfile/v1/internal/users/me/friends/{accountId}/summary
This gives you a relationship summary between the accountId and the authenticating account (are they a friend, a close friend, how many mutual friends you have etc).

It would be nice if there was a way to get the accountId and onlineId in a single request but I've not come across such an endpoint for doing that.

man, thank you so much for all the hard work that you put in discovering some much about Sony's API. I'm about to launch a webpage so players can see their accounts, all thanks to your work, I have been work on this for about 2 years lol, so thank you again.
That been said, I have to ask:
How did you manage to discovery so much about Sony' Api? How did you find the endpoints ,etc... I would like to help investigating the api, I believe there're more useful endpoints to be found.

Hi @rafaelfgyn
You're welcome, I'm glad it's been a useful resource for developing your web site.
Regarding discovery, as Sony have reduced the amount of services which are available via a regular web browser the majority of the current APIs come from inspecting the mobile PS App. You could discover a lot just by inspecting the files within the app package. They were originally visible in the plain text Javascript file (or at least visible enough that you could work out what they would be). You can still do this, but current versions of the app have these files compiled into Hermes bytecode so you have to disassemble it with a tool like https://github.com/bongtrop/hbctool.
The other way is capturing and inspecting the traffic that the app is generating as you use it but that's not straight forward now due to the lengths developers go to try prevent this (eg. SSL certificate pinning), although it is still possible.

I did manage to get the endpoints via regular web browser, after the launch of ps5 with the new api, they ended the old api and I lost all my job, it was a sad day to me (lol), now that everything turns around the mobile app, I'm lost. I know too little about mobile =/. I've tried to use some app the inspects the traffic but with no success.

Hey man, do we have any endpoints to get the Id of a specific user?

Hi @rafaelfgyn
The closest thing I'm aware of which can effectively do a username to id lookup is their search API (so whether someone appears in this is going to depend on their privacy settings relative to the account you are using to perform the request).
The endpoint URL is: https://m.np.playstation.com/api/search/v1/universalSearch
You need to POST an application/json request with the following content:
{
  "searchTerm": "rafaelfgyn",
  "domainRequests": [
    {
      "domain": "SocialAllAccounts",
      "socialSearchParams": {
        "strictGrouping": true
      },
      "pagination": {
        "cursor": "",
        "pageSize": 20
      },
      "featureFlags": {
        "isSpartacusEnabled": true
      }
    }
  ],
  "countryCode": "gb",
  "languageCode": "en",
  "age": 99
}

You'll get a response like:
{
  "domainResponses": [
    {
      "domain": "SocialAllAccounts",
      "domainTitle": "Results for SocialAllAccounts with search term \"rafaelfgyn\"",
      "domainTitleMessageId": "msgid_null",
      "domainTitleHighlight": [
        "Results for SocialAllAccounts with search term \"",
        "rafaelfgyn",
        "\""
      ],
      "zeroState": false,
      "next": "",
      "totalResultCount": 1,
      "results": [
        {
          "id": "id",
          "type": "social",
          "score": 236.3765,
          "socialMetadata": {
            "accountId": "1234567890",
            "country": "BR",
            "language": "pt",
            "onlineId": "rafaelfgyn",
            "isPsPlus": false,
            "isOfficiallyVerified": false,
            "avatarUrl": "http://static-resource.np.community.playstation.net/avatar/3RD/UP00011308076_37E14E48D0E885B75F69_L.png",
            "verifiedUserName": "",
            "highlights": {
              "onlineId": [
                "",
                "rafaelfgyn"
              ]
            }
          }
        }
      ]
    }
  ],
  "fallbackQueried": false
}

You can use the same method of authentication as all of the trophy endpoints.

Hello @andshrew,
I am getting this response using your example. I've tried to change username but no luck:
{
    "error": {
        "referenceId": "80d3d30c-5812-453f-81bf-135ee0279002",
        "code": 3415813,
        "message": "Friend finder requires a valid account",
        "reason": "invalid_parameter",
        "source": "api"
    }
}

Yeah, already figured that out. Thank you)

Man, thanks again for that. this endpoint is extremely useful. If you have any endpoints still to share please don't hesitate, or just update your documentation. If there's anything I can do to help just reach me out.
Changing of topic... did see this?
https://blog.playstation.com/2022/07/14/introducing-playstation-stars-an-all-new-loyalty-program/

You can use https://us-prof.np.community.playstation.net/userProfile/v1/users/{online_id}/profile2?fields?accountId%2ConlineId%2CcurrentOnlineId to get the account id from online id

You can use https://us-prof.np.community.playstation.net/userProfile/v1/users/{online_id}/profile2?fields?accountId%2ConlineId%2CcurrentOnlineId to get the account id from online id

That seems to work perfectly, but there's a small typo it should be fields= not fields?
https://us-prof.np.community.playstation.net/userProfile/v1/users/{online_id}/profile2?fields=accountId%2ConlineId%2CcurrentOnlineId

Yes, there is a typo. I messed up when copying from python to URL format.

I know this old, but just FYI for others searching, the us-prof.np.community.playstation.net endpoint is the best endpoint for getting accountId from an online ID as the universal search does not always find every PSN account by online ID I discovered. 😮

@kamranayub Yes. That is what I do in my api wrapper


eshell completion fails if directory name has a space

This might actually be related to this issue: #3007
If it is, it is important to note that I do not have fish shell.
What did you expect to happen?
Given a path of ~/.wine/drive_c/Program Files/Common, I would expect to be able to hit a series of tabs to complete the given path.
What actually happened?
Completion stops at the directory with the space in the name, and will not go any further. No errors appear in the minibuffer.
Steps to reproduce:

Install stock Doom, no config changes.
Run eshell
Try to use tab completion with a directory name that has a space in it, and try to tab to the next file or directory beyond it.

The completion works correctly in a stock Emacs, running emacs -Q
System information:

emacs   version    27.0.91
        features   XPM JPEG TIFF GIF PNG RSVG CAIRO SOUND GPM DBUS GSETTINGS GLIB NOTIFY INOTIFY ACL LIBSELINUX GNUTLS LIBXML2 FREETYPE HARFBUZZ M17N_FLT LIBOTF ZLIB TOOLKIT_SCROLL_BARS GTK3 X11 XDBE XIM MODULES THREADS PDUMPER LCMS2 GMP
        build      May 11, 2020
        buildopts  (--prefix=/usr/local --with-sound=alsa --without-gconf --with-x=yes --with-x-toolkit=gtk3 --with-toolkit-scroll-bars --with-cairo --with-json --with-modules --without-pop --with-mailutils)
        windowsys  x
        daemonp    server-running
doom    version    2.0.9
        build      HEAD -> develop, origin/develop, origin/HEAD f5e120eef 2020-05-26 20:32:55 -0400
        dir        ~/.doom-test/
system  type       gnu/linux
        config     x86_64-pc-linux-gnu
        shell      /bin/bash
        uname      Linux 5.3.0-7648-generic #41~1586790036~18.04~600aeb5-Ubuntu SMP Mon Apr 13 17:47:15 UTC  x86_64
        path       (~/perl5/bin ~/.cargo/bin ~/bin ~/programs/share/node/bin ~/programs/lib/chicken/bin ~/programs/share/golang/bin ~/programs/sbin ~/programs/bin ~/.guix-profile/bin ~/.nix-profile/bin ~/.roswell/bin ~/.local/bin ~/perl5/bin ~/.guix-profile/bin /usr/local/sbin /usr/local/bin /usr/sbin /usr/bin /sbin /bin /usr/games /usr/local/games /snap/bin ~/.komodoide/12.0/XRE/state /usr/local/libexec/emacs/27.0.91/x86_64-pc-linux-gnu/)
config  envfile    envvar-file
        elc-files  0
        modules    (:completion company (ivy +icons) :ui doom doom-dashboard doom-quit hl-todo modeline neotree ophints (popup +defaults) tabs treemacs vc-gutter vi-tilde-fringe workspaces :editor file-templates fold multiple-cursors snippets :emacs (dired +ranger +icons) electric ibuffer undo vc :term eshell vterm :checkers syntax spell grammar :tools ansible editorconfig (eval +overlay) lookup lsp magit taskrunner :lang clojure common-lisp data emacs-lisp json javascript markdown org perl php (python +pyvenv +lsp) racket rest scheme sh yaml :app calendar irc (rss +org) twitter :config literate (default +bindings +smartparens))
        packages   (n/a)
        unpin      (n/a)
        elpa       (n/a)

The thought did not cross my mind, until now, but this might very well be an upstream issue with bash-completion for eshell.

After installing fish shell, and then uninstalling fish shell, I have been unable to replicate this problem, which makes no sense. I even tried installing in a fresh container, to no avail. Upstream fish shell completion reported a bug a while ago with an issue with bash fallback, where the problem was with the user's setting of $PS1 in bash. https://gitlab.com/ambrevar/emacs-fish-completion/-/issues/2
This doesn't seem relevant, but since I am unable to replicate this bug in a fresh OS container, I am going to mark this up as a fluke in my environment and close this ticket.


A more complete solution for sampling

Fixes #95.

@ofrobots PTAL

What are your thoughts on using the sampling decision earlier? Right now this change traces all the operations, just omits writing the collected traces to the buffer. An alternative implementation would skip tracing the root span.

It will be a refactor of the agent and hooks that I'd prefer to do in a separate PR. Tracking in #95.

test-trace-policy is not yet able to check the higher sampling rates due to the slowdown of date creation. I'll look into mocking that out tomorrow with timekeeper.

@ofrobots PTAL with the removal of opaque spans in mind.

@ofrobots Ready for another look.

LGTM, w/ expectation that OpaqueSpan will be cleaned up in a follow up PR.


undefined is not a function

I am getting the error TypeError: undefined is not a function when trying to use this package. Didn't have time to investigate but other packages are working fine for me.

Can you give me more details? The tests are passing as they should.

Can I get the stack trace?

Sure:
console.log(inflect.pluralize('apples'));
                    ^
TypeError: undefined is not a function
    at Object.<anonymous> (/path-to-my-app/server.js:34:21)
    at Module._compile (module.js:460:26)
    at Object.Module._extensions..js (module.js:478:10)
    at Module.load (module.js:355:32)
    at Function.Module._load (module.js:310:12)
    at Function.Module.runMain (module.js:501:10)
    at startup (node.js:129:16)
    at node.js:814:3

Are you sure you have initialised inflect? Can you give me that line in the code too?

yes its the standard
var inflect = require('i');

I am afraid you are using it wrongly. From the README,
var inflect = require('i')();

aha sorry, I completely missed that. working great now, thanks!


Fix 'Resolvable' to 'Resolver' in documents and comments

s/Resolvable/Resolver/

Thanks for the PR! 👍


Please add support for power reading on Shelly 1 PM

Hi,
I am looking to use several Shelly 1 PM s in a household energy project.
Are there plans to support reading of power data from the device?
Thanks,
Rob

I will add this


asyncDataTree adopt diffIdentityProvider

This PR fixes https://github.com/microsoft/vscode/issues/114580
This PR does the following:

Adds the diffIdentityOptions to the setChildren method in AsyncTree
Adopts this in debug console and explorer in order to be able to test this

This PR is work in progress. I did not test it yet (plan to do it tomorrow).
I just created this PR to potentially get some early feedback if this looks okey. I simply bubbled up the diffIdentityProvider options where it made sense to me.
Type conversion between regular and async trees is a bit of a pain, thus early feedback is welcome. Thanks

Lgtm!

Lgtm!

Ran some tests for the debug repl before the diff identity and with diff identity, I see a slight performance improvement. Though I guess the biggest performance improvement should be when just a single element comes to a full debug console.
Before:

After:

Ran some tests for the debug repl before the diff identity and with diff identity, I see a slight performance improvement. Though I guess the biggest performance improvement should be when just a single element comes to a full debug console.
Before:

After:

After talking to @joaomoreno I am happy how this PR turned out, thus merging it in.
Joao will do some follow up work for cleaning the options bag.

After talking to @joaomoreno I am happy how this PR turned out, thus merging it in.
Joao will do some follow up work for cleaning the options bag.


If I select text and cmd/ctrl + c more than once, it deselects all the previously selected text and copies only 1 character

VSCode Version: Code 1.17.2 (b813d12980308015bcd2b3a2f6efa5c810c33ba5, 2017-10-16T13:47:41.889Z)
OS Version: Darwin x64 16.6.0
Extensions:

Extension
Author (truncated)
Version

jshint
dba
0.10.15

vscode-gist
dba
1.0.0

file-icons
fil
1.0.5

color-highlight
nau
2.3.0

vscode-icons
rob
7.17.0

Align
ste
0.2.0

vim
vsc
0.10.2

(1 theme extensions excluded)

Steps to Reproduce:

cmd/ctrl + a to select file of text
cmd/ctrl + c multiple times
cmd/ctrl + v will produce only the character where the cursor last was

Reproduces without extensions: Yes/No

After your first Cmd+C the selection is cleared. Don't know if this behavior can be toggled via a setting.

@morriswchris I cannot reproduce this on a default installation of VSCode. Does this reproduce for you when disabling extensions that take over input like e.g. vim ?

@alexandrudima you are correct facepalm. I should have tried disabling vim first.

Well actually I use Vim too so it repros for me. I guess you can file an issue on VSCodeVim to treat y and cmd+c differently.

VSCodeVim has actual filed an issue with VSCode (#217) to address this as well. As a work around then mention setting "vim.overrideCopy" to false, which has seemed to solve the issue for me


allow client to use any type for extra log values instead of just strings

addresses #2

this repo/pr seems inactive, so we're going to continue the development of this project in our fork.