Feature request: Unfurl Soundcloud links and allow the user to play them in NewDot.

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Problem
Unable to play soundcloud links in the NewDot
Solution
Unfurl Soundcloud links and allow the user to play them in NewDot. (Both slack and NewDot screenshots attached)
Context/Examples/Screenshots/Notes:

Logs: https://stackoverflow.com/c/expensify/questions/4856
Expensify/Expensify Issue URL:
Issue reported by: @AndrewGable
Slack conversation: https://expensify.slack.com/archives/C049HHMV9SM/p1704930238839509
View all open jobs on GitHub

cc @quinthar

@AndrewGable - is this something that can be implemented by a contributor?

I haven't looked into it deep enough to know. I thought other link previews were generated on our back end, but I could be wrong.

Okay, raising this for discussion here because while nice to have, I think there are other things we could be working on.

I think we have some stuff for link previews in the back-end but they were turned off. cc @marcaaron
Also – I'd think if we were doing this (setting up inline audio player), we'd want a holistic design that works for uploaded audio clips (such as voice memos) in addition to link previews from Spotify, Soundcloud, Apple Music, etc...

Briefly looked at whether SoundCloud docs had anything in their oEmbed section for this. And they were surprisingly unhelpful

Tried the standard curl oembed dance and got this back:
curl -X GET "https://soundcloud.com/oembed?url=https://soundcloud.com/dubbeldutch/rare-earth-elements-vol-1-demo&format=json"

{"version":1.0,"type":"rich","provider_name":"SoundCloud","provider_url":"https://soundcloud.com","height":400,"width":"100%","title":"Rare Earth Elements Vol. 1 Demo by dubbel dutch","description":"Get it now at Splice!\n\nhttps://on.splice.com/dubbel-dutch-pack","thumbnail_url":"https://i1.sndcdn.com/artworks-000345743616-or91kn-t500x500.jpg","html":"<iframe width=\"100%\" height=\"400\" scrolling=\"no\" frameborder=\"no\" src=\"https://w.soundcloud.com/player/?visual=true&url=https%3A%2F%2Fapi.soundcloud.com%2Ftracks%2F441183414&show_artwork=true\"></iframe>","author_name":"dubbel dutch","author_url":"https://soundcloud.com/dubbeldutch"}

So, their player embed code is an iframe. Not sure how this will look/behave on mobile.
Agree with @roryabraham here though that a holistic approach would be interesting to explore though we are kind of at the mercy of whatever platform embeds are offered at the end of the day.
I checked this out and we don't get that embed code back from our metadata proxy (already built but not used yet) so we would at least need a backend change to grab that. Here's the output I did get:
{
  "onyxData": [
    {
      "onyxMethod": "merge",
      "key": "reportActions_210960085665009",
      "value": {
        "4103202628908714323": {
          "linkMetadata": [
            {
              "lang": "en",
              "author": null,
              "title": "Rare Earth Elements Vol. 1 Demo",
              "publisher": "SoundCloud",
              "image": {
                "url": ["https://i1.sndcdn.com/artworks-000345743616-or91kn-t500x500.jpg"](https://i1.sndcdn.com/artworks-000345743616-or91kn-t500x500.jpg),
                "type": "jpg",
                "size": 27555,
                "height": null,
                "width": null,
                "size_pretty": "27.6 kB"
              },
              "date": "2024-01-17T00:34:46.000Z",
              "description": "Get it now at Splice! https://on.splice.com/dubbel-dutch-pack",
              "url": ["https://soundcloud.com/dubbeldutch/rare-earth-elements-vol-1-demo"](https://soundcloud.com/dubbeldutch/rare-earth-elements-vol-1-demo),
              "logo": {
                "url": ["https://a-v2.sndcdn.com/assets/images/sc-icons/ios-a62dfc8fe7.png"](https://a-v2.sndcdn.com/assets/images/sc-icons/ios-a62dfc8fe7.png),
                "type": "png",
                "size": 3144,
                "height": 114,
                "width": 114,
                "size_pretty": "3.14 kB"
              }
            }
          ]
        }
      }
    }
  ],
  "jsonCode": 200,
  "requestID": "846a83a95de46a19-HNL"
}


Deprecated imports in docstring examples in io.harwell_boeing and optimize.nonlin

Just a start on gh-16531

Hmm, not sure what's going on with the InverseJacobian, BroydenFirst, and KrylovJacobian : importing them from scipy.optimize.nonlin triggers a deprecation warning and a recommendation to use a main scipy.optimize namespace. However, none of these can be imported either:
In [1]: from scipy.optimize.nonlin import InverseJacobian
<ipython-input-1-0e387586be55>:1: DeprecationWarning: Please use `InverseJacobian` from the `scipy.optimize` namespace, the `scipy.optimize.nonlin` namespace is deprecated.
  from scipy.optimize.nonlin import InverseJacobian

In [2]: from scipy.optimize import InverseJacobian
---------------------------------------------------------------------------
ImportError                               Traceback (most recent call last)
Input In [2], in <cell line: 1>()
----> 1 from scipy.optimize import InverseJacobian

ImportError: cannot import name 'InverseJacobian' from 'scipy.optimize' (/home/br/repos/scipy/scipy/build-install/lib/python3.8/site-packages/scipy/optimize/__init__.py)

Trying in ipython:
In [1]: import scipy.optimize as so

In [2]: any(['Krylov' in _ for _ in dir(so)])
Out[2]: False

In [3]: import scipy.optimize._nonlin as sno

In [4]: any(['Krylov' in _ for _ in dir(sno)])
Out[4]: True

So I'm not sure what is the intent: keep them in optimize.nonlin or in the top-level optimize. Or are they supposed to really be private (a deprecation period, maybe?)
And I'm surprised these things being not importable is not caught by real tests, are these completely untested?
Not sure who's the main optimize resident these days. Mind if I ask you @andyfaff ?

It looks like this goes back to https://github.com/scipy/scipy/pull/14966.  Ping @czgdp1807 and @rgommers.  I suspect the question will be if those names should also be added to the scipy.optimize namespace.

This goes back to commit 0c9c174c3 from 2010, which added InverseJacobian to nonlin.py but didn't expose it in optimize. Since that commit also set .. currentmodule:: scipy.optimize in the optimize.nonlin docstring, it is pretty clear that optimize.nonlin was never really public.
So now the question is whether InverseJacobian should be public yes or no. I'm not sure to be honest. WDYT?

While I don't have a horse in this race, I'd say let's add them to the main optimize namespace and be done with them. As a guess they are not very widely used, but in those rare cases when they are needed, having them available is really helpful (no trouble unless there is trouble, and then maybe a whole lot of trouble) .

While I don't have a horse in this race, I'd say let's add them to the main optimize namespace and be done with them.

+1 from me. Do you prefer to add that to this PR, or do we need a separate PR?

+1 from me. Do you prefer to add that to this PR, or do we need a separate PR?

No need for a separate PR I'd say; have updated this PR with the three names to the scipy.optimize namespace.


Update contributing.md

//

Any additional content? Here something that might inspire you: https://github.com/swapagarwal/awesome-inspiration

Quote from the rules:

If a maintainer reports your pull request as spam or behavior not in line with the project’s code of conduct, you will be ineligible to participate.

The timeline is seven days. The email is<EMAIL_ADDRESS>


"Image of code" suggestion

I think there are problems with images of code that are not mentioned in idownvotedbecause.
Here is the currently viewable copy:

One of the first things we do when examining code for errors is to try compiling (if necessary) and running the code to see what happens. We may also copy part of the code to paste into search engines in order to learn about the types or algorithms we are using, and to find other similar questions. When we are provided an image of code, this process becomes much more difficult.

I would suggest:

One of the first things we do when examining code for errors is to try compiling (if necessary) and running the code to see what happens. We may also copy part of the code to paste into search engines in order to learn about the types or algorithms we are using, and to find other similar questions. We may want to search your code.  We may want to fix the formatting of your code, or show you a modified version of your code with a solution.  We may want to view your code in large print, or an assistive typeface, or with a screen reader.  When we are provided an image of code, these processes become much more difficult.

You make a valid point. The only argument I have against is that I'm not sure if it improves enough to make up for the increase in text.


StringUtils: mention in javadoc that Character#isWhitespace(char) def…

…ines which characters are considered whitespace

Coverage increased (+0.007%) to 93.563% when pulling 03da07d1b62f10193caa7d6175f107bafaf55ea1 on PascalSchumacher:StringUtils_whitespace_definition_javadoc into ff4497aff8cc9de4e0b2c6e5e23e5b6550f76f29 on apache:master.


bug: JavaScript heap out of memory

<--- JS stacktrace --->
FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory
1: 0xa03530 node::Abort() [ng build --prod]
2: 0x94e471 node::FatalError(char const*, char const*) [ng build --prod]
3: 0xb7773e v8::Utils::ReportOOMFailure(v8::internal::Isolate*, char const*, bool) [ng build --prod]
4: 0xb77ab7 v8::internal::V8::FatalProcessOutOfMemory(v8::internal::Isolate*, char const*, bool) [ng build --prod]
5: 0xd32345  [ng build --prod]
6: 0xd32ecf  [ng build --prod]
7: 0xd40f5b v8::internal::Heap::CollectGarbage(v8::internal::AllocationSpace, v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [ng build --prod]
8: 0xd43615 v8::internal::Heap::HandleGCRequest() [ng build --prod]
9: 0xce9c57 v8::internal::StackGuard::HandleInterrupts() [ng build --prod]
10: 0x101bef3 v8::internal::NativeRegExpMacroAssembler::CheckStackGuardState(v8::internal::Isolate*, int, v8::internal::RegExp::CallOrigin, unsigned long*, v8::internal::Code, unsigned long*, unsigned char const**, unsigned char const**) [ng build --prod]

https://github.com/tailwindlabs/tailwindcss/pull/3032#issuecomment-744569275

https://github.com/project-owlly/website/pull/43

well for the time being, I fear that without proper fix in tailwind this will happen again one day...

yes indeed! but this we have tracked in another issue


Support PNGs and JPGs in reportlets

Closes #124.
Changes proposed:

Add a section to embed PNGs and JPGs in the HTML report.
Raise an exception if an extension isn't supported.

@effigies if you end up merging this, would you be willing to make a new release (23.2.2?) so QSIRecon can use the modified version?

Do you want to rebase onto the maintenance branch?

Can do!

nope i messed it up. i'm just going to open a new PR


Settings option to make mouse operations behave like Xterm (middle button pastes)

Description of the new feature/enhancement

It would be useful if Windows Terminal had an option to make it behave like Xterm, i,e. middle mouse button pastes. The way it currently behaves, every time I switch from an X environment to Win10 I keep pressing the wrong button.
Proposed technical implementation details (optional)

This is likely covered by issue #1553.

It indeed is. Thanks @j4james! /dup #1553.


Add Auto-Indentation in Editor for improved Ergonomics

A small but mildly annoying experience (at least for me) has been typing out the request body. Auto-indentation makes editing much faster and intuitive.
(wait for the GIFs to load)
Before:

After:

Hey @Snehil-Shah, thanks for the PR, it looks nice!


[NEBULA-549] fix: lock needle version to 3.0.x

https://snyksec.atlassian.net/browse/NEBULA-549
Fix needle version to 3.0.x, not 3.x.y. This prevents us from pulling in https://github.com/tomas/needle/pull/382 which causes problems with how we're currently using global-agent to configure the proxy for code-client, both in cli and code-agent.
In parallel we will look into a more permanent solution that is compatible with newer needle versions and properly uses CONNECT requests, e.g., tunnel.

:tada: This PR is included in version 4.12.1 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Add support / documentation for native assets in pub executables

I'm looking for a way to use native assets in a pub-configured executable.
I apologise in advance if this is already implemented / documented somewhere, but having tried to minimally change the native_add_app example I haven't had much luck.
Steps to reproduce:

run dart pub get in native_add_app and native_add_library
add the following to native_add_app/pubspec.yaml:

executables:
  native_add_app:

activate the package globally

dart pub global activate --source path ./native_add_app

Run

native_add_app

Result:
$ native_add_app
Building package executable...
Built native_add_app:native_add_app.
Invoking a native function to calculate 1 + 2.
Unhandled exception:
Invalid argument(s): Couldn't resolve native function 'add' in 'package:native_add_library/native_add_library.dart' : No asset with id 'package:native_add_library/native_add_library.dart' found. No available native assets. Attempted to fallback to process lookup. /home/jackd/programs/flutter/bin/cache/dart-sdk/bin/dart: undefined symbol: add.

#0      Native._ffi_resolver.#ffiClosure0 (dart:ffi-patch/ffi_patch.dart)
#1      Native._ffi_resolver_function (dart:ffi-patch/ffi_patch.dart:1523:20)
#2      add (package:native_add_library/native_add_library.dart)
#3      main (file:///home/jackd/Development/dart/native/pkgs/native_assets_cli/example/build/native_add_app/bin/native_add_app.dart:9:18)
#4      _delayEntrypointInvocation.<anonymous closure> (dart:isolate-patch/isolate_patch.dart:297:19)
#5      _RawReceivePort._handleMessage (dart:isolate-patch/isolate_patch.dart:184:12)

Managed to get things working with
dart pub global run --enable-experiment=native-assets native_add_app:native_add_app

Not quite as convenient as native_add_app but I can't see any way to make the script pub makes at ~/.pub-cache/bin/native_add_app play nicely.
Having said that, it would be nice if the error message was a little more informative. If I dart run bin/native_add_app I get the much more helpful message:
Package(s) native_add_library require the native assets feature to be enabled. Enable native assets with `--enable-experiment=native-assets`.


Official AdoptOpenJDK icon for kiosks/websites

Hi all,
It would be great to have a square-shaped icon for use in “Self Service” kiosks such as Jamf Pro for macOS made available on the Branding page. Right now we are stuck with Oracle’s Java icon.
Cheers
Graham

@grahampugh Is that an icon you'd expect to be able to grab off our website's branding page?


revert code from #93 MR which was removed by someone.

Revert code from #93 MR which was removed by someone (remove async code and unit test...).
This MR #93 which didn't do appropriate way to fix async build fail issue (The root cause is someone removed async IO method code then led to build fail)
#91 that issue should be fixed by this MR instead of #93

❤ Merged, please feel free to feedback


Smart_Farm does not work with "alien-biomes"

Mod source
Factorio Mod Portal
Which mod are you having an issue with?

[X] pyalienlife
[ ] pyalternativeenergy
[ ] pycoalprocessing
[ ] pyfusionenergy
[ ] pyhightech
[ ] pyindustry
[ ] pypetroleumhandling
[ ] pypostprocessing
[ ] pyrawores

Operating system
GNU/Linux
What kind of issue is this?

[X] Compatibility
[ ] Locale (names, descriptions, unknown keys)
[ ] Graphical
[ ] Crash
[ ] Progression
[ ] Balance
[ ] Pypostprocessing failure
[ ] Other

What is the problem?
When "alien-biomes" mod is used - SmartFarm does not generate resources(plants).
After researching the problem, I found where it is.
pyalienlife/scripts/smart-farm/smart-farm.lua
in function Smart_Farm.events.on_rocket_launched
row is 112:
if not surface.get_tile(ore_location).collides_with('resource-layer') then
Expression return false
I don't understand why, but it is.
Steps to reproduce
No response
Additional context
No response
Log file
No response

Fixed. Thank you for the report.
https://github.com/pyanodon/pyalienlife/commit/5564e86761d95ce268e5a42ee94485e3012cbc39


Support UInt64

Currently UInt64 is not supported. This is annoying, because it means you have to convert it to and from a string yourself to encode a large int.

try
let myUInt64 = json["num64"].uInt64Value


Fix numerous issues with widows for tcp/udp connection support.

Add a wrapper to pull network and pid data.
Since the GetExtendedUdpTable and GetExtendedTcpTable functions we now use in windows returns a pid, make use of that optimization.

+1!


Fixed regression in module completions

Fixed regression in module completions introduced by #771 and added integration tests to prevent regressions in the future. This fixes #799.

Codecov Report

Merging #806 into main will increase coverage by 0.04%.
The diff coverage is 87.50%.

@@            Coverage Diff             @@
##             main     #806      +/-   ##
==========================================
+ Coverage   94.07%   94.11%   +0.04%
==========================================
  Files         289      289
  Lines       12116    12121       +5
  Branches       12       12
==========================================
+ Hits        11398    11408      +10
+ Misses        718      713       -5

Flag
Coverage Δ

dotnet
94.83% <87.50%> (+0.04%)
:arrow_up:

typescript
25.98% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

....LangServer/Completions/BicepCompletionProvider.cs
98.16% <0.00%> (-0.37%)
:arrow_down:

src/Bicep.Core/TypeSystem/DeclaredTypeManager.cs
87.93% <100.00%> (+5.47%)
:arrow_up:

...cep.LangServer.IntegrationTests/CompletionTests.cs
87.23% <100.00%> (+0.27%)
:arrow_up:

....IntegrationTests/Helpers/IntegrationTestHelper.cs
96.42% <100.00%> (ø)


Live

test PR

Docs Build status updates of commit df3494c:
:white_check_mark: Validation status: passed
For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

Test PR


chore(color): Allow whitespace in rgb and hsl values.

As per the spec: https://drafts.csswg.org/css-color-3/#rgb-color.

White space characters are allowed around the numerical values.

This looks good to me, but I'd like @nikgraf to give the final sign off since he is more familiar with this mixin.

yep, looks good. thanks @10xjs 🙌


Added UI  & !except snippets

I'm not quite sure if you only take suggestions for snippets or just allow user submitted ones, but I think these are quite useful for the 2.0 version of discord.py. If you like these snippets, I'm more than happy to help expand the UI category further.

Alright! I wasn't quite sure about the 1.5.0, but yes, I agree that it should be that. Also naming it !except makes a lot more sense. I think im gonna see next if i can do something useful with the discord.ui.View or add some other functionality to from the 2.0 version. Thanks for approving !


Support for docker buildx

Hello 👋
Today, the default way of building images using docker is to use buildx where you need to add the --load flag to the build command if you want to be able run docker push after that. Here are the last line of running a quickstart on a sample repo using a fresh install of docker version 25.
#8 DONE 3.0s

#9 [5/5] COPY . .
#9 DONE 0.2s
WARNING: No output specified with docker-container driver. Build result will only remain in the build cache. To push result image into registry use --push or to load image into docker use --load

-----> Pushing image to Docker registry
The push refers to repository [harbor.XXX.com/library/mtracker]
An image does not exist locally with the tag: harbor.XXX.com/library/mtracker
Cuber: docker push failed

I use Docker Desktop (engine v27) on MacOS and I cannot reproduce the issue that you describe... It works properly.
Also note that based on documentation there isn't any --load flag for the docker build command.
Can you describe your scenario more precisely and send a pull request?


Remove version: Peppy.Osu! version 2022.1117.0

https://github.com/microsoft/winget-pkgs/issues/152768#issuecomment-2102735187

Resolves #152768

Microsoft Reviewers: Open in CodeFlow

URL: https://github.com/ppy/osu/releases/download/2022.1117.0/install.exe
OK
(Automated message - build 882)


unhide newly released java mgmt t2 SDKs

Thanks Wes. I saw 2 new column added, FirstGADate and Support. I've re-aligned the columns of the modified rows.


How can I Share private youtube videos automatically?

Hi dear, unfortunately, this functionality is not provided by the package...


Enhance AbstractMetadataReportTest test case

What is the purpose of the change
Brief changelog
Verifying this change

Checklist

[x] Make sure there is a GitHub_issue field for the change (usually before you start working on it). Trivial changes like typos do not require a GitHub issue. Your pull request should address just this issue, without pulling in other changes - one PR resolves one issue.
[ ] Each commit in the pull request should have a meaningful subject line and body.
[ ] Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
[ ] Check if is necessary to patch to Dubbo 3 if you are work on Dubbo 2.7
[ ] Write necessary unit-test to verify your logic correction, more mock a little better when cross module dependency exist. If the new feature or significant change is committed, please remember to add sample in dubbo samples project.
[ ] Add some description to dubbo-website project if you are requesting to add a feature.
[ ] GitHub Actions works fine on your own branch.
[ ] If this contribution is large, please follow the Software Donation Guide.

Codecov Report

Merging #13126 (c1cc729) into 3.2 (da5c7ed) will increase coverage by 0.00%.
Report is 12 commits behind head on 3.2.
The diff coverage is n/a.

:exclamation: Current head c1cc729 differs from pull request most recent head 4154050. Consider uploading reports for the commit 4154050 to get more accurate results

@@            Coverage Diff            @@
##                3.2   #13126   +/-   ##
=========================================
  Coverage     69.39%   69.39%
  Complexity        2        2
=========================================
  Files          1649     1649
  Lines         68574    68569    -5
  Branches      10002    10001    -1
=========================================
- Hits          47587    47585    -2
- Misses        16396    16398    +2
+ Partials       4591     4586    -5

see 39 files with indirect coverage changes
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Update Dapr to 1.8.0-rc.2

Description
Update Dapr to 1.8.0-rc.2
Signed-off-by: Hal Spang<EMAIL_ADDRESS>Issue reference
We strive to have all PR being opened based on an issue, where the problem or feature have been discussed prior to implementation.
Please reference the issue this PR will close: Endgame
Checklist
Please make sure you've completed the relevant tasks for this PR, out of the following list:

[ ] Code compiles correctly
[ ] Created/updated tests
[ ] Extended the documentation

This PR is opened just to test out the RC with our integration tests. It should not be merged until the CLI also has an RC.


Angular 7 unmask value is not woking

Hi
i have try to use text mask plugin into my angular 2 project.
unmask value is not working over there
ngModel update with mask value so that's why my 16 digit validation is not working
Trying to use modelClean: true but is not worked.
Here is my code
<input id="cardNumberTextId" type="text" [textMask]="{mask: cardNumberMask,guide: true,modelClean: true}"  name="cardNumber16" class="form-control"  [required]="!free" placeholder="XXXX XXXX XXXX XXXX" [(ngModel)]="paymentInfoObj.CardNumber" [disabled]="disabledPaymentInput"  (keyup)="checkCredirCardNumber()">

TEMPLATE
<input [(ngModel)]="data.cnpj" [textMask]="{mask: mask, guide: false, modelClean: true}" type="text" name="telephone"
class="form-control" (ngModelChange)="data.cnpj = unmask(data.cnpj)">
{{data.cnpj}}
COMPONENT
public mask = ['(', /[1-9]/, /\d/, /\d/, ')', ' ', /\d/, /\d/, /\d/, '-', /\d/, /\d/, /\d/, /\d/]
unmask(val) {
// console.log(val.replace(/\D/g, ''))
return val.replace(/\D/g, '')
}

ngModelChange will cause mouse click issue . Cursor will point to the beginning always on click of text box  after entering some values . Ideally it should point to last character.


Join - Quoting Issue within ON Clause

$select->join('ksba_lnk_benutzer-rollen', 'ksba_lnk_benutzer-rollen.rollen_id = ksba_rollen.rollen_id', array(), SqlSelect::JOIN_LEFT);
this produces following: ksba_lnk_benutzer``-``rollen.rollen_id
(see the quotes arround the dash "-" )
the quoting should be this (for mysql):  ksba_lnk_benutzer-rollen.rollen_id
Is this a bug?

I don't know it's the same thing, but @petersonwpm found this issue:
use Zend\Db\Sql\Select;

// Condition with "\n"
$condition = <<<CONDITION
one.foo_id = two.foo_id
AND one.bar_id = two.bar_id
CONDITION;
// Select
$select = (new Select())
    ->from('one')
    ->columns(array('foo_id', 'bar_id'))
    ->join('two', $condition, array());
// Result
echo $select->getSqlString();

... outputs:
SELECT "one"."foo_id" AS "foo_id", "one"."bar_id" AS "bar_id" FROM "one" INNER JOIN "two" ON "one"."foo_id" = "two"."foo_id"" "AND "one"."bar_id" = "two"."bar_id"

... indenting:
SELECT
    "one"."foo_id" AS "foo_id",
    "one"."bar_id" AS "bar_id"
FROM "one"
INNER JOIN "two" ON
    "one"."foo_id" = "two"."foo_id"
    " "
    AND "one"."bar_id" = "two"."bar_id"

This issue has been closed as part of the bug migration program as outlined here - http://framework.zend.com/blog/2016-04-11-issue-closures.html


Refactor User schema constraints

If User works for every game, it shouldn't have:

null constraint in experience and level.
kalina_tree_level is required

All of above are champions-only fields.

username should be provided from client, not autogenerated.

I'm touching some Kaline Tree stuff in #593 so I'll be deleting the kaline_tree_level requirement!


Get current route stack

Is there a way to get the current route stack or the route on the top of the route stack? The navigator object seems to be hidden by the library. Thank you.

Actions.currentRouter.currentRoute

12 янв. 2016 г., в 20:38, James Zhang<EMAIL_ADDRESS>написал(а):
Is there a way to get the current route stack or the route on the top of the route stack? The navigator object seems to be hidden by the library. Thank you.
—
Reply to this email directly or view it on GitHub https://github.com/aksonov/react-native-router-flux/issues/117.

Thank you!


Missing files and wrong doc?

Hi,
First I'm not sure what purpose your readme/documentation has to do with your 'my-goal' project.
Now, I cloned this repo ('my-goal'), typed 'npm install' and afterwards 'npm start'.
It seems though when doing so, all base javascript files are missing (no '/js' directory can be found).
So I'm missing init.js, materialize.js, ...
Thanks in advance

Hi,
I will look into it and get back you.
Thanks!


GH-2558: Fix Possible NPE in FailedBatchProcessor

Back port of issue https://github.com/spring-projects/spring-kafka/pull/2559

Fixed via: https://github.com/spring-projects/spring-kafka/commit/397da7d48328a5ab2c5861f9c879af7446ad2e2c


Site Visitor > Family Conversion

In the current state, there is no protocol/process for converting a site visitor to a full family record type without duplicity of records in both user types.
Design a process for streamlining the conversion process both for front-end users and Keystone admins.
KEYSTONE ADMIN:
-Add button to "Convert Site Visitor to Prospective Parent" record type
-Triggers actions:
-Opens and transfers known data to Family registration template
-Prompts user to complete additional information fields and save data
-Removes site visitor record (eliminates redundancy)
FRONT-END USER (Is this a repeat of the action above with just a different trigger?-If so, proceed. If not check-in with time estimate for doing the front-end work)
-Add a button to  "Fully Register Your Account"
-Triggers actions:
-Opens and transfers known data to Family registration template
-Prompts user to complete additional information fields and save data
-Removes site visitor record (eliminates redundancy)

@bchiaruttini  can you please review to assure that this meets the standards that we discussed? TY

looked at prevalence of issue and only 180 site visitors created to date, about 1/2 eventually became or should have been user accounts.  So low priority although if simple to do would still complete.


Prepare 3.2.2

Bump version and changelog for 3.2.2. Also includes a bit of cleanup to some outdated javadocs in the code generator, and temporarily fixes travis by commenting out the emulators that are currently broken.

LGTM


Getting Split data

The split_metric and split_standard collections on my activity returns None. I don't know if I understand the splits entirely, but I think it represents the Splits in Strava next to the map. In which case, for this specific workout activity, I should have split results as a collection on the Activity model, but I get None

Sorry, I haven't had a chance to look at this yet.  As all my usage has been cycling-specific, it wouldn't surprise me if there's just a bug in this feature.  When you make the query do you see debug logs indicating the Strava API URL being hit, etc. ?

Note that those attributes are only expected to be available for the DETAILED view (i.e. when the activity is being fetched on behalf of the authorized user -- not available for activities of auth user's friends / leaderboards, etc.)

@hozn I authenticate as myself with the 'view_private' scope, so I should be able to see the splits, right? I am not sure if I've correctly configured the logging, but I've set the following:
app.debug = True
logging.basicConfig()

and don't see any Strava API URL in the shell output logs
I have to functions that just dumps some info:
def dump_athlete():
    athlete = client.get_athlete()
    print repr(athlete)

def dump_splits():
    now = datetime.datetime.utcnow()
    week_start = now - datetime.timedelta(days=now.weekday())
    week_end = week_start + datetime.timedelta(days=6)

    activities = client.get_activities(before=week_end, after=week_start)
    results = list(activities)
    for activity in results:
        print activity.splits_metric
        print activity.splits_standard

Ok -- try:
logging.basicConfig(level=logging.DEBUG)

I will record a running activity which should have some splits and make sure this shows up as expected.  I see it in the sample activity file that is checked in, but that doesn't mean we have unit tests validating that specific feature (I will add once I get to the bottom of this).

I've enabled debugging and this is what I get:
INFO:stravalib.protocol.ApiV3:GET u'https://www.strava.com/api/v3/athlete/activities' with params {'per_page': 200, 'after':<PHONE_NUMBER>, 'page': 1, 'before':<PHONE_NUMBER>}
DEBUG:requests.packages.urllib3.connectionpool:"GET /api/v3/athlete/activities?access_token=some_token&per_page=200&after=1468250409&page=1&before=1468768809 HTTP/1.1" 200 22
DEBUG:stravalib.client.BatchedResultsIterator:Requested page 1 (got: 0 items)

I definitely have done activities within the past 14 days. 0 items returned for page 1

Ok, the good news is that I can't reproduce any problems here; splits are working well for me. So either this has been fixed by strava or by side effect of other fixes here.


endless loop with multiple DOCTEST_SUBCASEs when an exception is thrown prior to any subcase

The following file causes an endless loop:
#define DOCTEST_CONFIG_IMPLEMENT_WITH_MAIN
#include <doctest/doctest.h>

TEST_CASE("wtf")
{
    static int cnt = 0;
    if (cnt++ >= 1) {
        throw std::runtime_error{"wat"};
    }
    DOCTEST_SUBCASE("1") {}
    DOCTEST_SUBCASE("2") {}
}

The expected behavior is that this simply reports an unexpected exception, and terminates cleanly.

doctest version: v2.4.11
Operating System: NixOS
Compiler+version: clang 16.0.1, GCC 12.2.0 (both produce the same results)

I've bisected this to eb8b04a2b1db23ea5665cd8b5cbe859beb0ef80d, hence ccing @Saalvage .
We started getting this in a real codebase where some common, boring setup code started accidentally throwing an exception on its second run.

I also experienced the same bug in the latest version! Please fix it!!!


fix: docker image size

Signed-off-by: Avik Basu<EMAIL_ADDRESS>Reduces the image size from 4.26GB to 1.66GB

Codecov Report

Merging #36 (b1fb6e3) into main (dbfedea) will not change coverage.
The diff coverage is n/a.

:exclamation: Current head b1fb6e3 differs from pull request most recent head 8ba2c81. Consider uploading reports for the commit 8ba2c81 to get more accurate results

@@           Coverage Diff           @@
##             main      #36   +/-   ##
=======================================
  Coverage   81.09%   81.09%
=======================================
  Files          16       16
  Lines         656      656
  Branches       68       68
=======================================
  Hits          532      532
  Misses        106      106
  Partials       18       18

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Cannot read property 'canonicalUrl' of undefined

As of v0.5.1 I am seeing an unhandled exception of "Cannot read property 'canonicalUrl' of undefined".
This occurs when changing routes. I have created a plunker(http://plnkr.co/edit/4vczoQv6Ufm5QUkx3azB?p=preview) to demonstrate the issue. The plunker does a redirect to a 'test1' component when the plunker loads. As you can see when changing routes the following code is run within the router.
forEach(lastHandler.components, (function(componentName, viewportName) {
instruction.viewports[viewportName] = $__0.recognize(childUrl, componentName);
}));
instruction.canonicalUrl += instruction.viewports[Object.keys(instruction.viewports)[0]].canonicalUrl;
From what I can see the lastHandler.components are the components from the previous route. The code iterates them and ends up with undefined viewports for the current instruction if they are not recognized for the new route. Thus instruction.viewports[Object.keys(instruction.viewports)[0]] throws the exception.
Uncaught TypeError: Cannot read property 'canonicalUrl' of undefinedrecognize @ router.es5.js:1453recognize @ router.es5.js:752(anonymous function) @ router.es5.js:342jQuery.event.dispatch @ jquery.js:4430jQuery.event.add.elemData.handle @ jquery.js:4116

Just switched to 0.5.3 from the last commit that still allowed $scope to be injected into the controllers (a6166ffb6794e64669ddd1c91dfcfc7f49d9614a) and am running into this same issue.  Exactly the same as described by ryanflowers.

@ryanflowers  This seems to happen because of the empty path. If you add a '/' to it then is does not throw anymore. (And also if the MainController is added and the ng-viewport="main" is changed to 'div ng-viewport="main"')
http://plnkr.co/edit/A3YxOobjU8EdvbQ3cqAP?p=preview
But this error is thrown when I insert a route that doesn't exist in my app. What normally should be handeld as a 404.

Yes in debugging it the code seemed to think it was a path not declared in my routes. The strange part is that when I remove the hashtag from my urls they work again. Does the new router no longer support hashtags for some reason? Anyone else run into this? Could just be my setup..

This also happens when clicking a mailto: link. Doesn't prevent it working, just throws this error.

As @ryanflowers said I removed /# from beginning of link and it fixed the issue.
before /#/foobar
After: /foobar
I don't get the canonicalUrl error anymore.


date math not very right

I used the c# built in class for it but not in the right way
see DateTime class (AddMonths() etc).

@zhouruiapple do you want to take a look. Without this, we may not able to run tpch very correctly.

@zhouruiapple do you want to take a look. Without this, we may not able to run tpch very correctly.

I test the subquery in those sql containing date, and find the answers are the same as the postgreSQL.

But this test case I don't understand.
        public void HopWindow()
        {
            var phyplan = "";
            var sql = "select count(*) from ast group by hop(a0, interval '5' second, interval '10' second)";
            TU.ExecuteSQL(sql, "2;4;2;1;1", out phyplan);
            Assert.AreEqual(1, TU.CountStr(phyplan, "ProjectSet"));
        }

and the table is
05/12/2020 07:22:16|0|1|2|3
05/12/2020 07:22:17|1|2|3|4
05/12/2020 07:22:26|2|3|4|5
05/12/2020 07:22:28|3|3|4|5
05/12/2020 07:22:56|4|3|4|5

07:22:56-07:22:16= 40s
And there is one hop per 5s. W
hy the result has only 5 value.


Bump jackson-databind to a newer version or shade

This is a discussion issue.
This project is currently using the 2.2.3 version of jackson-databind. That is a very old version (about 5 years as of now) and can be a problem for a number of reasons:

It is likely that will get evicted by other dependencies of the user of the iglu-scala-client with unexpected results (I recently saw that happening in SCE).
It is likely that there have been performance and possibly also security improvements.

I tested this library with the 2.9.5 version and the only visible consequence seemed to be the improvement of the error deserialisation.
If for some reason we need to stick to that version we should consider shading. We may wan't to shade anyway (or provide an additional artefact that has this shaded, depending on how many use this library)

Related https://github.com/snowplow/iglu-scala-client/issues/78

Closing this, as it was bumped to 2.10.3 for the 1.0.2 release of iglu-scala-client (#143) and it will be bumped again in the forthcoming 1.1.0 release (#154)


Openresty 1.15.3 profile issues.

The issue is when Openresty 1.15.3 is in use, where lj_trace_exit function is
only called on the first 10 request, after that, the function is never called
again.
The result is that profile jobs are not working correctly, due to not all the
request are using luajit at all:
Output of  `stapxx ./samples/ngx-lj-trace-exits.sxx -x $(worker PID)
289 out of 19088 requests used compiled traces generated by LuaJIT.
Distribution of LuaJIT trace exit times per request for 289 sample(s):
(min/avg/max: 1/1/9)
value |-------------------------------------------------- count
    0 |                                                     0
    1 |@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@           160
    2 |@@@@@@@@@@@@@@@@@@@@@@@                             92
    4 |@@@@@@@@@                                           36
    8 |                                                     1
   16 |                                                     0
   32 |                                                     0

To validate this behaviour:
nginx.conf
worker_processes  1;
daemon off;
pid       /tmp/nginx.pid;
error_log logs/error.log;

events {
    worker_connections 1024;
}

http {
  server {
  listen 8080;
  access_log  off;
    location / {
      content_by_lua_block {
        function main()
          local j = 0
          for i=0,1000 do
            j = i+j
          end
        end
        main()
        ngx.say("Hello world")
      }
    }
  }
}

Run openresty in debug mode:
openresty-debug -c nginx.conf -p $(pwd)

For this test, we can test with stapxx, but a simpler systemtap file can be
used:
probe process("/usr/local/openresty-debug/nginx/sbin/nginx").function("ngx_http_free_request")
{
    println("Request finish")
}

probe process("/usr/local/openresty-debug/luajit/lib/libluajit-5.1.so.2.1.0").function("lj_trace_exit") {
    println("Trace exit")
}

And if we run this tap, on the first 10 request, lj_trace_exit probe will
work correctly, but after the 10th request there is no longer called, example:
#stap lj.stp
Trace exit
Request finish
Trace exit
Request finish
Trace exit
Request finish
Trace exit
Request finish
Trace exit
Request finish
Trace exit
Request finish
Trace exit
Request finish
Trace exit
Request finish
Trace exit
Request finish
Request finish
Request finish
Request finish
Request finish

Trying to debug why this happens, there are no suspect code in
ngx-lua-module, but Openresty bump the version of Luajit, and this commit
maybe break something:
https://github.com/openresty/luajit2/commit/864c72e31e9ea9488bd64a441790fee916481da3#diff-d232eb340601b1fd167c69f58d20f8f1
Also, try to get a proper traceback on this function, but for reasons all the
systemtap traps only return the hex direction of the Luajit, so I couldn't find
any pattern, and Luajit code is quite hard to understand :-(.
Systemtap taps: https://sourceware.org/systemtap/tapsets/
Example to get the caller:
probe process("/usr/local/openresty-debug/luajit/lib/libluajit-5.1.so.2.1.0").function("lj_trace_exit") {
    println("Trace exit")
    println(symfileline(caller_addr()))
}

Also try to get the human-readable code using addr2line but I have no luck.
Moving forward I try to get trace on perf, maybe systemtap issue, but in perf I
did not see the lj_trace_exit call at all:
perf record -a  -p 19191 -g

perf output: https://gist.github.com/eloycoto/60567b0f6de63a7e86792ad79331c6d6
perf data perf.zip
Also, tried with a custom perf probe, but no calls where seen in lj_trace_exit:
# perf probe -x /usr/local/openresty-debug/luajit/lib/libluajit-5.1.so.2.1.0 --funcs | grep lj_trace_exit
lj_trace_exit
# perf probe -x /usr/local/openresty-debug/luajit/lib/libluajit-5.1.so.2.1.0 lj_trace_exit
Failed to get call frame on 0xa6376
Added new event:
  probe_libluajit:lj_trace_exit (on lj_trace_exit in /usr/local/openresty-debug/luajit/lib/libluajit-5.1.so.2.1.0)

You can now use it in all perf tools, such as:

        perf record -e probe_libluajit:lj_trace_exit -aR sleep 1

next steps:

Asked on the openresty-en about this, let's see if I get a reply: https://groups.google.com/forum/#!topic/openresty-en/Re0fft3syuU

Installation
These are the steps that I follow to install all the things commented above:
yum install yum-utils
yum-config-manager --add-repo https://openresty.org/package/centos/openresty.repo
yum install openresty openresty-debug-debuginfo openresty-debug openresty-pcre-debuginfo openresty-pcre-devel openresty-zlib-debuginfo

yum install -y kernel-devel kernel-debuginfo kernel-debuginfo-common
debuginfo-install kernel-3.10.0-957.12.2.el7.x86_64
yum install -y systemtap systemtap-runtime

Useful information:

@lukego has a lot of good youtube videos that explain quite a lot of things
about Luajit https://www.youtube.com/channel/UC-ATWoBhU7ae5w7s5Rc0sSA/videos
Systemtap tapset: https://sourceware.org/systemtap/tapsets/
Perf guide: http://www.brendangregg.com/perf.html
Tracing and Troubleshooting by @agentzh https://www.youtube.com/watch?v=NR8U1qYHGqk

Ok,
I think that I found the problem, I think that it's related to this commit:
https://github.com/openresty/luajit2/commit/0a9ff94c4a1fcec2c310dcb092da694f23186e23
Now If I run this nginx.conf to update some params, things are getting in a good shape:

^C[vagrant@localhost ~]$ cat /vagrant/nginx.conf
worker_processes  1;
daemon off;
pid       /tmp/nginx.pid;
error_log logs/error.log;

events {
    worker_connections 1024;
}

http {
  server {
  listen 8080;
  access_log  off;
    location / {
      content_by_lua_block {
        require "jit.opt".start("hotexit=100")
        function main()
          local j = 0
          for i=0,100 do
            j = i+j
          end
        end
        main()
        ngx.say("Hello world")
      }
    }
  }
}

So, my understanding is that it's a trace issue, not a Luajit compiling issue, maybe the best way is to add to stapxx the following probe:
probe process("/usr/local/openresty-debug/luajit/lib/libluajit-5.1.so.2.1.0").function("lj_vm_exit_interp") {
    println("VM_exit_interp")
}

Also this commit https://github.com/openresty/luajit2/commit/99304a93bb661b3f3afbe4c54d50c705e14c35a3 can be a problem, but in Openresty 1.13 that commit is in there.
Regards


[SPARK-25778] WriteAheadLogBackedBlockRDD in YARN Cluster Mode Fails …

…due lack of access to tmpDir from $PWD to HDFS
WriteAheadLogBackedBlockRDD usage of java.io.tmpdir will fail if $PWD resolves to a folder in HDFS and the Spark YARN Cluster job does not have the correct access to this folder in regards to the dummy folder. So this patch provides an option to set spark.streaming.receiver.blockStore.tmpdir to override java.io.tmpdir which sets $PWD from YARN Cluster mode.
What changes were proposed in this pull request?
This change provides an option to override the java.io.tmpdir option so that when $PWD is resolved in YARN Cluster mode Spark does not attempt to use this folder and instead use the folder provided with the following option: spark.streaming.receiver.blockStore.tmpdir
How was this patch tested?
Patch was manually tested on a Spark Streaming Job with Write Ahead logs in Cluster mode.

Can one of the admins verify this patch?

Can one of the admins verify this patch?

Can one of the admins verify this patch?

@lresende any possibilities of getting this change committed or at least getting it on the radar for key changes for spark to work with YARN Cluster mode specifically since $PWD creates issues with Spark when a similar path is used within HDFS and users do not have access to it when using writeAheadLogs.

History from JIRA and error
WriteAheadLogBackedBlockRDD in YARN Cluster Mode Fails due lack of access to HDFS path
due to it using a similar name was $PWD folder from YARN AM Cluster Mode for Spark

While attempting to use Spark Streaming and WriteAheadLogs. I noticed the following errors
after the driver attempted to recovery the already read data that was being written to HDFS
in the checkpoint folder. After spending many hours looking at the cause of the following
error below due to the fact the parent folder /hadoop exists in our HDFS FS..  I am wonder
if its possible to make an option configurable to choose an alternate bogus directory that
will never be used.
hadoop fs -ls /
drwx------   - dsadm    dsadm           0 2017-06-20 13:20 /hadoop
hadoop fs -ls /hadoop/apps
drwx------   - dsadm dsadm          0 2017-06-20 13:20 /hadoop/apps
streaming/src/main/scala/org/apache/spark/streaming/rdd/WriteAheadLogBackedBlockRDD.scala
val nonExistentDirectory = new File(
System.getProperty("java.io.tmpdir"), UUID.randomUUID().toString).getAbsolutePath
writeAheadLog = WriteAheadLogUtils.createLogForReceiver(
SparkEnv.get.conf, nonExistentDirectory, hadoopConf)
dataRead = writeAheadLog.read(partition.walRecordHandle)
18/10/19 00:03:03 DEBUG YarnSchedulerBackend$YarnDriverEndpoint: Launching task 72 on
executor id: 1 hostname: ha20t5002dn.tech.hdp.example.com.
18/10/19 00:03:03 DEBUG BlockManager: Getting local block broadcast_4_piece0 as bytes
18/10/19 00:03:03 DEBUG BlockManager: Level for block broadcast_4_piece0 is StorageLevel(disk,
memory, 1 replicas)
18/10/19 00:03:03 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on ha20t5002dn.tech.hdp.example.com:32768
(size: 33.7 KB, free: 912.2 MB)
18/10/19 00:03:03 WARN TaskSetManager: Lost task 0.0 in stage 3.0 (TID 71, ha20t5002dn.tech.hdp.example.com,
executor 1): org.apache.spark.SparkException: Could not read data from write ahead log record
FileBasedWriteAheadLogSegment(hdfs://tech/user/hdpdevspark/sparkstreaming/Spark_Streaming_MQ_IDMS/receivedData/0/log-1539921695606-1539921755606,0,1017)
at org.apache.spark.streaming.rdd.WriteAheadLogBackedBlockRDD.org$apache$spark$streaming$rdd$WriteAheadLogBackedBlockRDD$$getBlockFromWriteAheadLog$1(WriteAheadLogBackedBlockRDD.scala:145)
at org.apache.spark.streaming.rdd.WriteAheadLogBackedBlockRDD$$anonfun$compute$1.apply(WriteAheadLogBackedBlockRDD.scala:173)
at org.apache.spark.streaming.rdd.WriteAheadLogBackedBlockRDD$$anonfun$compute$1.apply(WriteAheadLogBackedBlockRDD.scala:173)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.streaming.rdd.WriteAheadLogBackedBlockRDD.compute(WriteAheadLogBackedBlockRDD.scala:173)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
at org.apache.spark.scheduler.Task.run(Task.scala:108)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:338)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.security.AccessControlException: Permission denied: user=hdpdevspark,
access=EXECUTE, inode="/hadoop/diskc/hadoop/yarn/local/usercache/hdpdevspark/appcache/application_1539554105597_0338/container_e322_1539554105597_0338_01_000002/tmp/170f36b8-9202-4556-89a4-64587c7136b6":dsadm:dsadm:drwx------
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319)
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259)
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205)
at org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer$RangerAccessControlEnforcer.checkPermission(RangerHdfsAuthorizer.java:307)
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190)
at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1827)
at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3972)
at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1130)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:851)
at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:640)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:982)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2313)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2309)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1740)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2307)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:73)
at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2110)
at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1305)
at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1301)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1317)
at com.wandisco.fs.client.ReplicatedFC.xlateAndGetFileStatus(ReplicatedFC.java:283)
at com.wandisco.fs.client.FusionHdfs.getFileStatus(FusionHdfs.java:277)
at org.apache.spark.streaming.util.FileBasedWriteAheadLog.initializeOrRecover(FileBasedWriteAheadLog.scala:245)
at org.apache.spark.streaming.util.FileBasedWriteAheadLog.(FileBasedWriteAheadLog.scala:80)
at org.apache.spark.streaming.util.WriteAheadLogUtils$$anonfun$2.apply(WriteAheadLogUtils.scala:142)
at org.apache.spark.streaming.util.WriteAheadLogUtils$$anonfun$2.apply(WriteAheadLogUtils.scala:142)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.streaming.util.WriteAheadLogUtils$.createLog(WriteAheadLogUtils.scala:141)
at org.apache.spark.streaming.util.WriteAheadLogUtils$.createLogForReceiver(WriteAheadLogUtils.scala:111)
at org.apache.spark.streaming.rdd.WriteAheadLogBackedBlockRDD.org$apache$spark$streaming$rdd$WriteAheadLogBackedBlockRDD$$getBlockFromWriteAheadLog$1(WriteAheadLogBackedBlockRDD.scala:140)
... 12 more

@vanzin trying this.. I'll advise shortly
private val tmpDir = "file:///" + System.getProperty("java.io.tmpdir")

@vanzin I made the following change and it didn't work. How do you want to proceed?
--- a/streaming/src/main/scala/org/apache/spark/streaming/rdd/WriteAheadLogBackedBlockRDD.scala
+++ b/streaming/src/main/scala/org/apache/spark/streaming/rdd/WriteAheadLogBackedBlockRDD.scala
@@ -98,6 +98,8 @@ class WriteAheadLogBackedBlockRDD[T: ClassTag](
override def isValid(): Boolean = true

private val tmpDir = "file:///" + System.getProperty("java.io.tmpdir")
override def getPartitions: Array[Partition] = {
assertValid()
Array.tabulate(_blockIds.length) { i =>
@@ -136,7 +138,7 @@ class WriteAheadLogBackedBlockRDD[T: ClassTag](
// this dummy directory should not already exist otherwise the WAL will try to recover
// past events from the directory and throw errors.
val nonExistentDirectory = new File(

     System.getProperty("java.io.tmpdir"), UUID.randomUUID().toString).getAbsolutePath

     tmpDir, UUID.randomUUID().toString).getAbsolutePath
   writeAheadLog = WriteAheadLogUtils.createLogForReceiver(
     SparkEnv.get.conf, nonExistentDirectory, hadoopConf)
   dataRead = writeAheadLog.read(partition.walRecordHandle)

It did not work.. Looks like it needs an HDFS path..
18/10/30 01:06:50 ERROR Executor: Exception in task 0.2 in stage 3.0 (TID 73)
org.apache.spark.SparkException: Could not read data from write ahead log record FileBasedWriteAheadLogSegment(hdfs://hdpmgmt1.hdp.senia.org:8020/user/sparkstreaming/sparkstreaming/Spark_Streaming_MQ/receivedData/0/log-1540875768007-1540875828007,0,988)
at org.apache.spark.streaming.rdd.WriteAheadLogBackedBlockRDD.org$apache$spark$streaming$rdd$WriteAheadLogBackedBlockRDD$$getBlockFromWriteAheadLog$1(WriteAheadLogBackedBlockRDD.scala:147)
at org.apache.spark.streaming.rdd.WriteAheadLogBackedBlockRDD$$anonfun$compute$1.apply(WriteAheadLogBackedBlockRDD.scala:175)
at org.apache.spark.streaming.rdd.WriteAheadLogBackedBlockRDD$$anonfun$compute$1.apply(WriteAheadLogBackedBlockRDD.scala:175)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.streaming.rdd.WriteAheadLogBackedBlockRDD.compute(WriteAheadLogBackedBlockRDD.scala:175)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
at org.apache.spark.scheduler.Task.run(Task.scala:109)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:338)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.IllegalArgumentException: Pathname /hadoop/yarn/local/usercache/sparkstreaming/appcache/application_1540875581273_0002/container_e09_1540875581273_0002_01_000002/file:/hadoop/yarn/local/usercache/sparkstreaming/appcache/application_1540875581273_0002/container_e09_1540875581273_0002_01_000001/tmp/57b411fc-d4ed-4ac9-a32c-ecfc901dc29e from /hadoop/yarn/local/usercache/sparkstreaming/appcache/application_1540875581273_0002/container_e09_1540875581273_0002_01_000002/file:/hadoop/yarn/local/usercache/sparkstreaming/appcache/application_1540875581273_0002/container_e09_1540875581273_0002_01_000001/tmp/57b411fc-d4ed-4ac9-a32c-ecfc901dc29e is not a valid DFS filename.
at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:197)
at org.apache.hadoop.hdfs.DistributedFileSystem.access$000(DistributedFileSystem.java:106)
at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1305)
at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1301)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1317)
at org.apache.spark.streaming.util.FileBasedWriteAheadLog.initializeOrRecover(FileBasedWriteAheadLog.scala:245)
at org.apache.spark.streaming.util.FileBasedWriteAheadLog.(FileBasedWriteAheadLog.scala:80)
at org.apache.spark.streaming.util.WriteAheadLogUtils$$anonfun$2.apply(WriteAheadLogUtils.scala:142)
at org.apache.spark.streaming.util.WriteAheadLogUtils$$anonfun$2.apply(WriteAheadLogUtils.scala:142)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.streaming.util.WriteAheadLogUtils$.createLog(WriteAheadLogUtils.scala:141)
at org.apache.spark.streaming.util.WriteAheadLogUtils$.createLogForReceiver(WriteAheadLogUtils.scala:111)
at org.apache.spark.streaming.rdd.WriteAheadLogBackedBlockRDD.org$apache$spark$streaming$rdd$WriteAheadLogBackedBlockRDD$$getBlockFromWriteAheadLog$1(WriteAheadLogBackedBlockRDD.scala:142)
... 12 more

@vanzin this seems to work.. Not sure what your thoughts are on this
private val tmpDir = broadcastedHadoopConf.value.get("hadoop.tmp.dir",
System.getProperty("java.io.tmpdir"))

@vanzin can you please review latest patch thanks!

@gss2002 Sorry I missed this initially, but great that @vanzin is helping you with the fix.

I think the reason your original attempt didn't work is because of how you wrote the code.
private val tmpDir = "file:///" + System.getProperty("java.io.tmpdir")

That seems to have too many slashes. I suggested using "File.toURI" which results in a different URI:
scala> new java.io.File("/tmp").toURI()
res0: java.net.URI = file:/tmp/

Could you try that instead? If that really doesn't work we can go with hadoop.tmp.dir, but I'd rather really use something that is local to the application instead of something that lives in HDFS and can pose problems if you have multiple applications, and can also leave garbage behind.

@vanzin you are right! I appreciate the help with this one. I will cut a patch in the AM after testing on a large scale cluster job that is taking from IBM MQ and ETLing data and shipping off to Kafka.
But this looks to work:
val nonExistentDirectory = new File(
System.getProperty("java.io.tmpdir"), UUID.randomUUID().toString).toURI.toString

@vanzin can you review the latest PR. This seems like it works without issue. I ran this on my home cluster and my larger clusters at work where the issue was first discovered and it seems to solve it. Thanks again for the help

ok to test

Test build #98831 has started for PR 22867 at commit c539c94.

Test build #98831 has finished for PR 22867 at commit c539c94.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98831/
Test PASSed.

Merging to master / 2.4.


fix homepage

fix homepage
@RachellCalhoun

Looks good! I would just suggest to

pull and merge current master (to include footer)
add some padding to the 'learn more button'

@RachellCalhoun  I fixed it!


[WIP] pythonPackages.cq-editor: init at 0.1RC1

Motivation for this change
Things done

[X] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[X] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nix-review --run "nix-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[X] Fits CONTRIBUTING.md.

Nearly complete and working with the cq-editor but broken for now.

This pull request has been mentioned on Nix community. There might be relevant details there:
https://discourse.nixos.org/t/running-a-qt-application-that-has-been-installed-by-anaconda/3527/7

@costrouc, I've made some progress in my own fork. I thought I could submit a pull request to costrouc/nixpkgs, but Github won't let me select yours (perhaps there are too many forks of nixpkgs).
Currently struggling with qtconsole not finding any pyqt version.
[nix-shell:~/tempbuild/nixpkgs]$ cq-editor
Traceback (most recent call last):
  File "/nix/store/in688ijxjgw6ndqkkq92m1y8r6szkdj5-cq-editor-0.1RC1/bin/.cq-editor-wrapped", line 7, in <module>
    from cq_editor.__main__ import main
  File "/nix/store/in688ijxjgw6ndqkkq92m1y8r6szkdj5-cq-editor-0.1RC1/lib/python3.7/site-packages/cq_editor/__main__.py", line 12, in <module>
    from .main_window import MainWindow
  File "/nix/store/in688ijxjgw6ndqkkq92m1y8r6szkdj5-cq-editor-0.1RC1/lib/python3.7/site-packages/cq_editor/main_window.py", line 14, in <module>
    from .widgets.console import ConsoleWidget
  File "/nix/store/in688ijxjgw6ndqkkq92m1y8r6szkdj5-cq-editor-0.1RC1/lib/python3.7/site-packages/cq_editor/widgets/console.py", line 3, in <module>
    from qtconsole.rich_jupyter_widget import RichJupyterWidget
  File "/nix/store/5pygklssig4piyfrdc9sjmdwjclvgqn2-python3.7-qtconsole-4.5.1/lib/python3.7/site-packages/qtconsole/rich_jupyter_widget.py", line 9, in <module>
    from qtconsole.qt import QtCore, QtGui
  File "/nix/store/5pygklssig4piyfrdc9sjmdwjclvgqn2-python3.7-qtconsole-4.5.1/lib/python3.7/site-packages/qtconsole/qt.py", line 23, in <module>
    QtCore, QtGui, QtSvg, QT_API = load_qt(api_opts)
  File "/nix/store/5pygklssig4piyfrdc9sjmdwjclvgqn2-python3.7-qtconsole-4.5.1/lib/python3.7/site-packages/qtconsole/qt_loaders.py", line 387, in load_qt
    api_options))
ImportError:
    Could not load requested Qt binding. Please ensure that
    PyQt4 >= 4.7, PyQt5, PySide >= 1.0.3 or PySide2 is available,
    and only one is imported per session.

    Currently-imported Qt library:   'pyqt5'
    PyQt4 installed:                 False
    PyQt5 installed:                 False
    PySide >= 1.0.3 installed:       False
    PySide2 installed:               False
    Tried to load:                   ['pyqt5']

@marcus7070 since this PR is most important to you do you mind opening a PR for this package? I will close this one. I am happy to give you any help you might need. I will say that the hardest part of this packaging is qt (which I don't have much experience with).
Let me know if this is okay with you and I'll close this PR in favor of yours

@costrouc Sure. I'm going to start an issue for this instead of going straight to a pull request, just in case I hand it off to someone else again.

Great saw that you opened a PR. Thanks! I will close this one


ARROW-11929: [C++][Dataset][Compute] Promote expression to the compute namespace

Moves Expression and its test and benchmark into the compute/exec/ directory. I haven't introduced an exec namespace.

Ah, looks like clang-format/cmake-format are unhappy, and the CMake magic that makes the new header gets installed is missing.

This just moves the code? There's no change in how or where expressions are evaluated yet, correct? I.e. they're still only for datasets here, they're just in a different namespace?

TODO: update bindings

@bkietz This caused a failure in the test-r-minimal-build nightly test:
https://dev.azure.com/ursacomputing/crossbow/_build/results?buildId=4423&view=logs&j=0da5d1d9-276d-5173-c4c4-9d4d4ed14fdb&t=d9b15392-e4ce-5e4c-0c8c-b69645229181&l=952
Do you know off the top of your head how to resolve this? Thanks

@ianmcook I think we just need to add Expression to compute/type_fwd.h. I'll do this now.


Paused state on AutoQueue?

Everything works and I even got passwords-less working! on my Ubuntu VM
Speeds where a little slow, but changing VM LAN properties from  to virtio helped!
BUT for some reason Seedsync pauses folders that are selected for AutoQueue´?

If I manually start them it all run fine again?
I really need it to run automatically any thing I am missing?
People who have it working are you not using AutoQueue?
Best regards

BTW: I have not enabled auto extraction!

I'm not sure if this is quite the same problem but mine will also randomly stop/pause, nothing in the logs.
My scanner is a writeable folder, and most of the time it works fine. Until it doesn't. I have to manually unpause it once or twice a week.


vos for spectro seems to ignore slit

For a Von Hamos spectrometer:

That's due to the way the LOS approach approximates the VOS for each pixel:

The projected aperture on the crystal is used fir all corners of the pixels
It's a good approximation if the pixel is small, but in the case of very large pixels like this, it falls apart.

Please bear in mind that this is just visualization.
It shoud have little incidence on the etendue computation.
A more accurate VOS estimate can be obtained by proper reverse ray tracing, using the method, but it takes much more time.
It's overkill if the objective is just visualization.
It's necessary if the objective is accurate synthetic data computation.


Syncing latest changes from main for cephcsi-operator

PR containing the latest commits from main branch

/lgtm
/approve

/lgtm
/approve


Desk works with fish

@ole108
Roll in first-class support for fish shell, and add basic tests.

@ole108 I'm going to go ahead and merge because I'm pretty sure this is a substantial improvement in the way desk works with fish, but if you notice anything missing or wrong, feel free to follow up with an issue or PR.


Map chemicals to pdb structures

The molecules dataset from OpenTargets has ChEMBL identifiers. These identifiers can be mapped to PDB compound identifiers using UniChem resources. These compound identifiers then can be used to find PDB structure identifiers where the given molecule is in the complex.
Requirements:

[x] Explore possibilities to establish these links in a reliable fashion
[x] Document process
[x] Generate stats on the mapping: number of molecules with structures, number of structure
[x] Write up the process in a standalone function or script
[x] The resulting table is stored in a Google Cloud bucket.

Cf. script on GitHub

From ChEMBL identifiers to PDB structures identifiers
- Result extracts -
Molecules from parquet files

MOLECULE_CHEMBL_ID

CHEMBL1079742

CHEMBL1083993

CHEMBL110458

CHEMBL1169388

CHEMBL1173055

CHEMBL1200443

CHEMBL1200910

ID in UniChem
src 1 : ChEMBL ID
src 2 : PDB ID

From src:'1'
To src:'3'

CHEMBL313405
ABZ

CHEMBL1399676
MQN

CHEMBL2347208
1HL

CHEMBL334167
SG2

CHEMBL3342582
8CF

CHEMBL328910
DOB

CHEMBL1364
UEG

Table obtained after joining parquet molecules and UniChem molecules

MOLECULE_CHEMBL_ID
MOLECULE_PDB_ID

CHEMBL313405
ABZ

CHEMBL334167
SG2

CHEMBL328910
DOB

CHEMBL1364
UEG

CHEMBL614
PZA

CHEMBL295698
KLN

CHEMBL1427
HPA

Apply function on DataFrame to get foreach PDB identifiers the structures associated

MOLECULE_CHEMBL_ID
MOLECULE_PDB_ID
STRUCTURE_ID

CHEMBL313405
ABZ
[1s9g, 6qbb]

CHEMBL334167
SG2
[1kwr]

CHEMBL328910
DOB
[1dod, 1doe, 1pbb]

CHEMBL1364
UEG
[4c5l, 4c5n, 5eb3...

CHEMBL614
PZA
[3r4x, 3r55, 5fpd...

CHEMBL295698
KLN
[2jjp, 2v0m]

CHEMBL1427
HPA
[1a9q, 1a9r, 1a9t...

Statistics

Stats
Count

Total molecules in UniChem database
14452

Molecules in parquet
12594

Molecules from parquet found in UniChem
3657

Percentage of parquet molecule found in UniChem
29

Total structures
137175

Molecules without structure
12

Unichem cross reference dataset has been replaced by Inchikeys data set because the mapping was more important with Inchikeys.
Inchikeys dataset
+------+---------------------------+
|CCD_ID|InChIKey                   |
+------+---------------------------+
|000   |CXHHBNMLPJOKQD-UHFFFAOYSA-N|
|001   |NBYCDVVSYOMFMS-VMPREFPWSA-N|
|002   |MWZOULASPWUGJJ-NFBUACBFSA-N|
|003   |NNZDBCPMOOEFTE-UHFFFAOYSA-N|
|004   |ZGUNAGUHMKGQNY-ZETCQYMHSA-N|
|005   |LDSJMFGYNFIFRK-IUCAKERBSA-N|
|006   |KKTYZYHUPKXLPL-RIQJEONASA-N|

36500 rows
3752 molecules from parquet files (12594 rows) are mapped by Inchikeys
Unichem dataset
+-------------+---------------+
|    chembl_id|pdb_compound_id|
+-------------+---------------+
| CHEMBL313405|            ABZ|
|CHEMBL1399676|            MQN|
|CHEMBL2347208|            1HL|
| CHEMBL334167|            SG2|
|CHEMBL3342582|            8CF|
| CHEMBL328910|            DOB|
|   CHEMBL1364|            UEG|

14452 rows
3657 molecules from parquet files (12594 rows) are mapped by Unichem
For more information cf. Notebook unichem_inchikey.ipynb


QMessageBox doesn't show title on macOS

Version and Platform (required):

Binary Ninja Version: 2.5.3150ish
OS: macOS
OS Version: 12.0.1

Bug Description:
Might not necessarily be our bug, but it likely impacts us in a number of places. On macOS, QMessageBox dialogs don't show their title text and could be missing relevant context.
Someone needs to take a close look at uses of QMessageBox and make sure nothing is being lost. Or, we should hack (patch?) Qt to display the title as expected.
Steps To Reproduce:
from PySide6.QtWidgets import QMessageBox
execute_on_main_thread_and_wait(lambda: QMessageBox.warning(None, "Title", "Text"))

Expected Behavior:
I expected the message box to show both its title and text.
Screenshots:

Qt (and macOS HIG) claim this is intended behavior. Personally, that seems Kinda Dumb and like we might lose imporant contextual information in some dialogs. It would be pretty trivial to patch Qt itself to include titles, but supposedly there is a workaround with the power of C++ virtual functions:
msgBox.QDialog::setWindowTitle("My Title");

Whatever the case, someone should definitely make sure all the dialogs are actionable even without their title, or otherwise patch the title text back onto the dialogs somehow.

Closing for now -- if specific popups are problematic we'll fix them as needed but since the primary dev platform is macos I'd argue that they're all fairly self-explanation.


fix(chainspecs): Paseo ss58Format value

Closes #833

Afaik paseo ss58 should be 42, at least we were doing that when I was in charge of the maintenance. We could reach out to ensure it is not a bug on their side

Afaik paseo ss58 should be 42, at least we were doing that when I was in charge of the maintenance. We could reach out to ensure it is not a bug on their side

The on-chain constant is 0. Therefore, unless there is a runtime update that changes it, the chainspec should be consistent with the on-chain value. I.e: the on-chain constant is the actual SS58Format. I already opened this issue on their repo.

Yes, exactly, we should match the constant. Let's discover in that issue what's going on. Thanks!

Hello ! i can bring some light here. @carlosala is right, we started with the 42 but after runtime upgrade 1.3.0 we decided to change it to 0 to make it closer to Polkadot.
Here is the GH issue where the fix was deployed: https://github.com/paseo-network/support/issues/103


[Feature Request]: User Info

Is there an existing issue for this?

[X] I have searched the existing issues

Feature Description
I would like to request the addition of a "User Info" page to the website. This page would allow users to input and view their personal information, including their name, age, contact details, and any relevant medical history. This feature will enhance user experience by providing a dedicated space for managing personal data.
Use Case
Currently, there is no specific page for users to enter or view their information. Users may find it challenging to manage personal details without a centralized location.
This form is built with HTML and styled with CSS, utilizing JavaScript for form validation.
Benefits

Data could be stored in a backend database (e.g., Firebase, MongoDB) for easy access and management.
An API could facilitate the fetching and updating of user information.
Adding this page would significantly improve user experience by streamlining the management of personal information and health records.

Priority
High
Record

[X] I agree to follow this project's Code of Conduct
[X] I'm a GSSOC contributor
[X] I want to work on this issue
[X] I'm willing to provide further clarification or assistance if needed.

Make sure you add the appropriate level for this.
I will create a new user info landing page


Add simple distcp job publishing to S3 as an example

Tested From local.

Issue: https://issues.apache.org/jira/browse/GOBBLIN-8
Please update your PR title with following prefix: [GOBBLIN-8]


To do list for Validation

In order to catch up with the existing validation mechanisms, this new validation library implementation needs to:

[ ] Cover all the edge cases with integration tests.
[ ] Add support for custom error messages defined via the options. This also includes changing the docs for options. See the error message format in rule.proto. Maybe, as a part of this change, we should move validation options from base into this repo.
[x] Implement the (is_required) constraint;
[ ] Implement the (when) constraint;
[ ] Deal with (maybe, dispose of), the (validation_for) related constraints;
[ ] Implement a Gradle plugin that would configure the default validation behaviour for Java projects;

Post v2.0.0-M1

[ ] Support JS and Dart.

@armiol, let's discuss this issue and our actions  on Monday. It's dated, but still relevant in several items.

As discussed vocally, the list of our actions will presumably be as follows:

Deprecate and remove the 'external" validation as a feature.
Review the state of the custom error messages once the respective works by @alexander-yevsyukov @yevhenii-nadtochii are done.
Postpone JS/TS/Dart validation until we are feature-complete with JVM.
Close this issue.


Tests in nested directories are not detected

I work mostly in larger codebases where the tests directory is often nested a few levels deep i.e. engines/some_engine/test/models/some_model_test.rb. For these projects, this plugin does not detect those tests.
Looking into this, I noticed that the implementation of filter_dir filters out directories that are not at the root or have "test" in their name. That causes the nested tests to be ignored (in my example the directory engines/some_engine returns false from filter_dir and so no file deeper than that is examined).
As I understand it, filter_dir is supposed to filter out directories that  should not be searched for tests, and so I'm not sure if the current implementation is correct. If I look at other plugins (for example neotest-vitest or neotest-python), they simply check if the directory is one of the well known ones for each language that will contain dependencies (and so tests that are not strictly part of the project).
I have a fork of this plugin and updated the implementation there to what I think it should be and the plugin now behaves as I expected and I'm not seeing any negative performance as a result.
I just wanted to sense check I'm not missing something here. I'm happy to send a PR for this if my thinking is correct.

Your understanding makes sense to me. I'd be happy to accept a PR with your implementation.

@zidhuss sorry this took me a while to get to, but I just sent a PR for it https://github.com/zidhuss/neotest-minitest/pull/15


Travis CI tests failing at git clone

Expected Behavior
Travis CI tests shouldn't fail at the git clone step
Current Behavior
This error happens during downloading of .dcm files by the Travis server at the
$ git clone --depth=50 https://github.com/concept-to-clinic/concept-to-clinic.git concept-to-clinic/concept-to-clinic
step.
Error downloading object: tests/assets/test_image_data/full/LIDC-IDRI-0001/<IP_ADDRESS>.4.1.145<IP_ADDRESS>.6279.6001.298806137288633453246975630178/<IP_ADDRESS>.4.1.145<IP_ADDRESS>.6279.6001.179049373636438705059720603192/000101.dcm (75aa4c8): Smudge error: Error downloading tests/assets/test_image_data/full/LIDC-IDRI-0001/<IP_ADDRESS>.4.1.145<IP_ADDRESS>.6279.6001.298806137288633453246975630178/<IP_ADDRESS>.4.1.145<IP_ADDRESS>.6279.6001.179049373636438705059720603192/000101.dcm (75aa4c8288eb31e7f6a40b8103019f664cfdd4e5b80e7a1e5d3d842c65cecfa5): batch response: Rate limit exceeded: https://github.com/concept-to-clinic/concept-to-clinic.git/info/lfs/objects/batch

Errors logged to /home/travis/build/concept-to-clinic/concept-to-clinic/.git/lfs/objects/logs/20170824T153416.634441969.log

Use `git lfs logs last` to view the log.

error: external filter 'git-lfs filter-process' failed

fatal: tests/assets/test_image_data/full/LIDC-IDRI-0001/<IP_ADDRESS>.4.1.145<IP_ADDRESS>.6279.6001.298806137288633453246975630178/<IP_ADDRESS>.4.1.145<IP_ADDRESS>.6279.6001.179049373636438705059720603192/000101.dcm: smudge filter lfs failed

warning: Clone succeeded, but checkout failed.

You can inspect what was checked out with 'git status'

and retry the checkout with 'git checkout -f HEAD'

The command "eval git clone --depth=50 https://github.com/concept-to-clinic/concept-to-clinic.git concept-to-clinic/concept-to-clinic " failed. Retrying, 2 of 3.

fatal: destination path 'concept-to-clinic/concept-to-clinic' already exists and is not an empty directory.

The command "eval git clone --depth=50 https://github.com/concept-to-clinic/concept-to-clinic.git concept-to-clinic/concept-to-clinic " failed. Retrying, 3 of 3.

fatal: destination path 'concept-to-clinic/concept-to-clinic' already exists and is not an empty directory.

The command "eval git clone --depth=50 https://github.com/concept-to-clinic/concept-to-clinic.git concept-to-clinic/concept-to-clinic " failed 3 times.

The command "git clone --depth=50 https://github.com/concept-to-clinic/concept-to-clinic.git concept-to-clinic/concept-to-clinic" failed and exited with 128 during .

Your build has been stopped.

Possible Solution

Can't help here, not familiar with LFS
Steps to Reproduce

Trigger a build by submitting a PR

Link to example build:
https://travis-ci.org/concept-to-clinic/concept-to-clinic/builds/268024624?utm_source=github_status&utm_medium=notification
Context (Environment)

Can't get my PRs to be green because of this.
Detailed Description

Possible Implementation

Checklist before submitting

[ ] I have confirmed this using the officially supported Docker Compose setup using the local.py configuration and ensured that I built the containers again and they reflect the most recent version of the project at the HEAD commit on the master branch
[x] I have searched through the other currently open issues and am confident this is not a duplicate of an existing bug
[x] I provided a minimal code snippet or list of steps that reproduces the bug.
[ ] I provided screenshots where appropriate
[x] I filled out all the relevant sections of this template

Chiming in here with the thought that #59 might be part of this issue. I think we'll have to do some history rewriting there to get the DICOM images out of git for good, and then after that I think that we can ensure git lfs is turned off for travis so that we don't try to pull anything down.
IIRC, we don't need any of the git lfs files for the travis builds.

I'm going to see if turning off git-lfs on Travis will fix this, thanks for the report!

Appears to be closed by 600b307.
Thank you to @iriberri and the Travis team for looking into this. Technical background for posterity:

I've been investigating this error and it looks like GitHub is rate-limiting the Git-LFS requests during the git clone process. I believe that this problem is surfacing after switching your project to our Open Source infrastructure because, for private projects, git clone requests are authenticated whereas for public projects these aren't. This is causing Travis CI to hit the GitHub's API rate limit for unauthenticated requests while fetching your git-lfs files.
Unfortunately, this initial git clone is automatically performed by Travis CI and it's not possible at the moment to make these requests to be authenticated through the .travis.yml file.
Taking this into consideration, and to sort this out, my recommendation would be to skip fetching the git-lfs files during the initial git clone, and then configure the authentication with GitHub and download these assets during the before_install phase of your build. To achieve this, you can use the following configuration:
git:
lfs_skip_smudge: true
before_install:

echo -e "machine github.com\n  login $GITHUB_TOKEN" >> ~/.netrc
git lfs pull

where GITHUB_TOKEN is the GitHub token which you can generate here: > https://github.com/settings/tokens/new and then encrypt in an environment variable.

Tests are still failing from the same error.

EDIT: Nvm just realized people should rebase onto the latest commit first.

:smile:

Glad to hear this helped!
As a bit more information, and related to https://github.com/concept-to-clinic/concept-to-clinic/issues/69#issuecomment-324764725, if you don't need these git-lfs files during build time, it'd just be enough to add the following to your .travis.yml to tell Travis not to fetch these assets during git clone:
git:
  lfs_skip_smudge: true


Caching of dependencies in container builds

We were looking for ways to adopt docker containers for our .NET Core web apps and discovered this native container publish feature which we found really awesome because that way we don't have to worry about our project references or maintaining Dockerfiles. However we have a question concerning caching of project dependencies in GitHub workflows to optimize build speed.
Before containerizing we would cache the ~/.nuget/packages directory (using the actions/cache action) so the dotnet build process can leverage packages downloaded from previous builds. Also when using a Dockerfile we can write it so that the dependencies layer is cached properly with the docker/build-push-action action. How can we accomplish the same thing with the built-in container publish functionality? Does caching the ~/.nuget/packages directory in the runner still work in this case or should we look for some other ways to do that?
Any help will be highly appreciated.

Yes! The publish command to create the container would reuse whatever NuGet packages cache that you've set up - this is one of the big benefits of making container generation more 'native' to the tools. You also get to seamlessly reuse your NuGet authentication, which has historically been difficult for Dockerfile-based builds.


SSL?

A quick question: I have a websocket server behind https. How
hard would it be to use lua-websockets in such a context?
Cheers
/Joakim

Since lua-websockets doesn't support ssl yet, we ended up using stunnel as a workaround.

My PR #91 has WSS support for Sync Clients


Some Plugins Are Stopped Working In AEM 6.4

Hi Ahmed,
This was really useful in AEM 6.2 but while we upgrade to AEM 6.4 some of the plugins stopped working for me.
Do you have any idea how to get it resolved ?

Thanks @ahmed-musallam, that would be very grateful of you.

Hi @ahmed-musallam ,
Did you find any fix for this ? We are actually in process of Upgrade and this is now blocker for us.
Let me know if you can help me in anyway.
Thanks,
Amogh

@AmoghDaryapurkar It seems to me that you are using this in production?? This project was made as a proof of concept and not really something to be used in production. Unless you understand how it was implemented and are able to debug and fix if an issue occurs.
I understand that this is a blocker for you and I'll do my best to look into it, but I can't promise that I will be able to fix it in-time for you. I also have a full time job :)
I'll give it a shot this weekend and see if I can find a quick fix. But, again, can't make any promises :)
Thanks!

@AmoghDaryapurkar were you able to get this going? I am almost unable to get this working, keep getting this error:
19.02.2019 11:29:02.903 *ERROR* [0:0:0:0:0:0:0:1 [1550600942849] GET /content/aem/index2.html HTTP/1.1] org.apache.sling.servlets.get.impl.DefaultGetServlet No renderer for extension html, cannot render resource JcrNodeResource, type=aem/components/content/advanced-rte, superType=null, path=/content/aem/index2/jcr:content/root/responsivegrid/advanced_rte


Make sure it is abundantly clear we approximate log(c(a_0))

Whilst pretty much everything would be the same for approximating c(a_0), the truth is that we are concerned with the log partition function, since that's what goes into the actual normalisation of the model computationally.

Think it's pretty clear now.


X-Per-Page not included when default page size is used

When I don't include per_page in the request, the header isn't returned. When I do include it, the header is returned as expected. See below:

Also, the default page size in the gem is 10, but I get 25 when I don't send a page size. Where else could this be configured? I know it's possible to override the default as follows:
paginate per_page: 20, max_per_page: 30, offset: 5
However, I haven't written that anywhere, so I'm not sure why the default isn't 10. Any help would be greatly appreciated.

@teamon if you could point me in the right direction, i'll do all of the work if any needs to be done to fix this. i think the header should be returned all the time regardless of if it's passed in or not.

@bandtank please take a look at this gist: https://gist.github.com/teamon/f87f9a96603018c9568c
It seems to be working fine. Please ensure you are using v0.18 of grape-kaminari.

@teamon That was the issue. Thank you. I didn't realize a new version had been released.


hop-node: Db: Track incomplete items as seperate keys

@shanefontaine ready for review

@shanefontaine the commit https://github.com/hop-protocol/hop/pull/255/commits/817926c10ba8d96d018ca0aa56d6d082dc30c76c should address the points we just talked about. Going to merge. Let me know if anything stands out as incorrect


Added 'hover' and 'responsive' in variants

fixes issue: hover is not working in light mode

Thanks!


cannot install cattle-cluster-agent in tainted nodes

Rancher Server Setup

Rancher version: 2.6.3
Installation option: Helm Chart
Proxy/Cert Details: Self-Signed +  Private CA

Information about the Cluster

Kubernetes version:  v1.20.11-eks-f17b81
Imported: Running kubectl apply onto an existing k8s cluster, generic
Hosted: EKS
Infrastructure Provider: AWS

Describe the bug
Default deployment of cattle-cluster-agent fail when provisioned in tainted nodes.
To Reproduce

Import a cluster using Generic option
Copy the command but instead of apply it just download the manifest and change de toleration section to add your own specific config
Apply the manifest

Result
Only one replica is scheduled with tolerations config applied, the second one doesn't have the config, it's necessary edit each pod to change the configuration or remove the taints to install the agent, after that the cluster is imported and then it's possible to change the deployment throught the Rancher UI
Expected Result
Possibility to install the agent with tolerations at once with less manipulations of config files.
Screenshots

Additional context
Relatable issue about fleet -> https://github.com/rancher/rancher/issues/35834

This  is still an issue and breaks our usage of imported EKS clusters in Rancher. All our EKS Worker Nodes are tainted and the cattle-cluster-agent cannot schedule now.


DeciCoder addition

Thanks for adding this! Looks like the formatting's a bit off but I'll fix it.


Video Recording

The video is not saving. just only save the name with mp4 extension and the file size is 0kb

Really? I will check the code.

Really? I will check the code.

thank

I tested ant it's OK. Can you give me more info?

1, Perssimion problem.
2, Save path.


rrohm33 no functions found

Originally posted by @rrohm33 in https://github.com/Azure/azure-functions-nodejs-library/issues/123#issuecomment-1693928356
@ejizba Am noticing a similar discrepancy. When deploying the same commit of a function app prior to rollout on v4.23 azurefunctions sdkVersion, resulted in 47 functions loaded. Then after rollout on v4.24.4 have only 31 functions loaded, and I don't see anything indicating a failure to load a file. Was just wondering if there is any way to manually specify using older version by setting linuxFxVersion or any other means, to get back up and running?

@rrohm33 please share your app name or follow these instructions: https://github.com/Azure/azure-functions-host/wiki/Sharing-Your-Function-App-name-privately

InvocationId: dfe0028f-d11b-4203-afaa-8f9ba70e8f92
Timestamp: 2023-08-23T21:26:41.5774037Z
Region: US-EAST

Here's what I see:

Worker was unable to load entry point 'dist/src/functions/products/index.js': A function with id 'getManufacturers' has already been registered.

This behavior changed in 4.24 (release notes here) related to https://github.com/Azure/azure-functions-nodejs-library/issues/62
Ideally you would fix the error, but you can also catch & ignore the error in your own code if you want. It's not recommended to pin to an old host version, but yes that is possible. Instructions here: https://learn.microsoft.com/en-us/azure/azure-functions/set-runtime-version?tabs=portal#manual-version-updates-on-linux

Ahh thanks a ton! Don't know how I missed that.

No problem, you can't see the error yet in Azure 😢 Once https://github.com/Azure/azure-functions-nodejs-library/issues/85 finishes rolling out with host 4.25 you will see the error in app insights traces table


Importing compiled flow libraries

I've being struggling to type check apps that use compiled flow libraries.
The problem is that in my program I import a package 'foo' who's package.json#main points to ./dist/index.js where dist file are generated via babeljs and have an UMD format and look roughly like this:
(function (global, factory) {
  if (typeof define === 'function' && define.amd) {
    define(['exports', 'react'], factory);
  } else if (typeof exports !== 'undefined') {
    factory(exports, require('react'));
  } else {
    var mod = {
      exports: {}
    };
    factory(mod.exports, global.React);
    global.index = mod.exports;
  }
})(this, function (exports, _react) {
  'use strict';
/*::
  import type {VirtualElement} from "reflex/src/core";
  import type {Address} from "reflex/src/signal";

  type RenderTarget = Node|Element|HTMLElement;
  type Configuration = {target: RenderTarget};
...

What this gives us is:

If you ignore dist flow fails to import foo and fails to type check for that reason.
If you do not ignore dist it will attempt to also type check foo/dist/index.js and still fail but in this case with "Unexpected token import", presumably because imports supposed to be at the top level not inside the function.

Either options seems bad though and even if flow was able to handle foo/dist/index.js and not complain about import inside a function it still would not be ideal as comments could be stripped out in dist files. It would make much more sense if it was passible to tell flow that source for this package is in this in this directory. I guess it has to be something like [include] directive but with a package name mapping so that imports would be resolved correctly.
Another (probably better) alternative could be to introduce "flow" field for the package.json so that package.json#flow.main could take precedence over package.json#main when flow resolves import path.

Note that this issue arises only if your program A depends on flow checked library B that depends on flow checked library C.

I think #838 is somewhat relevant here as it could have resolved this issue.

Posting a quote from IRC that helps with this issue:
2:13 PM — •jeffmo looks for the docs on module.name_mapper ...
2:14 PM <•jeffmo> gozala: This *might* do what you’re looking for: http://flowtype.org/docs/advanced-configuration.html#options (see “module.name_mapper")
2:15 PM <•jeffmo> it lets you intercept Flow’s internal module name resolution steps
2:15 PM <•jeffmo> by specifying a regexp replacement pattern
2:15 PM <gozala> jeffmo: oh right I have not realized I could use that for this
2:15 PM <gozala> jeffmo: thanks
2:15 PM <•jeffmo> Maybe you could specify that “node_modules/your_package” maps to “node_modules/your_package/pre-build-version.js"

I'm keeping this one open as I still think that mapping via package.json field is worth having specially because .flowconfig based configuration becomes more complicated with a number of libraries (see #238 )

Relevant: https://github.com/facebook/flow/issues/593. I just did with a manual work-around:

For my ud library, I've included a hand-written Flow type declaration file and instructions in the readme to include that file under the [libs] section of the application's .flowconfig (and instructions on working around Flow bug #676).

It would be convenient for users if I could specify the Flow declaration file in package.json like Typescript supports.

I think there's room for improvement here, but we've implemented a scheme where you can include .js.flow files in your npm module, and Flow will use those instead of the corresponding .js files. Check out the "flow" build step in the fbjs project for an example of this in practice.


Downloading Files

Are there any examples of saving multiple files? For example, saving multiple images for each Crawly request. So far I came across the WriteToFile pipeline which seems to be used for saving data into one file, CSV, JSON, etc.

If you do not mind, could you also mention streaming large files to disk.

https://stackoverflow.com/questions/30267943/elixir-download-a-file-image-from-a-url
Use a custom pipeline to manage the downloading . In your spider, scrape the media urls and pass it as a nested map key. Then pattern match on it.
https://hexdocs.pm/crawly/basic_concepts.html#custom-item-pipelines.
Crawly processes the items sequentially, but for long downloads you might want to offload it to a queue or use an async Task to download it.

@s0kil I think @Ziinc gave a good answer, pipeline is a good way to go! Otherwise, in my own projects, I am downloading media from the parse_item callback directly. Crawly is a queue management system itself, so technically your worker will just spend a  bit more time downloading the image, that's it.
@Ziinc shall we create a pipeline capable for autodowloading images? e.g. {Crawly.Pipelines.DownloadMedia, field: image, dest: /folder_name}?

@oltarasenko Will downloading a larger file in parse_item block the spider from continuing to crawl and parse?

No, it does not block the Crawly itself, just one worker which is downloading something, but all other workers are operational. (Comparing it with Scrapy, where non-reactor based downloads will block the world, Crawly operates without problems)

Is it too much to ask for an example project such https://github.com/oltarasenko/crawly-spider-example, saving the blog posts into each individual file?

@oltarasenko sounds like a good idea, i'll think a bit more about the api and update here. I should have time for it in the coming weeks.
@s0kil i think it would be more appropriate to have a how-to article in the docs. There are some inherent issues with having many example repos, such as maintenance and keeping them in sync.

@s0kil could you give some info on how you are working around the downloading of files now?

shall we create a pipeline capable for autodowloading images? e.g. {Crawly.Pipelines.DownloadMedia, field: image, dest: /folder_name}?

Just a heads-up - I've started working on such generic pipeline today.

@Ziinc I could not get it working yet.

@oltarasenko I will implement a generic task execution process as mentioned here https://github.com/oltarasenko/crawly/pull/88#issuecomment-626103255 for pipelines to hook into.


📖 docs: Update litellm.md with Redis and Langfuse

Pull Request
Summary
Add Redis caching and Langfuse monitoring
Change Type
Please delete any irrelevant options.

[x] Documentation update

Testing
Performed the tasks as documented in the PR
Test Configuration:
Checklist

[x] I have made pertinent documentation changes

Thanks!


chore!: align to draft 16, update dependencies

This PR updates the implementation to (actually) match the draft 16 of the protocol. Most notable (and breaking) change is the change of the context string to OPAQUEv1-. Terminology around aPAKE has been updated to match the changes done in the draft as well (from asymmetric to augmented).
I've also tweaked the cargo deny config to get it working on newer versions (as well as bumping the action to v2), and ditched unmaintained json dependency in favor of serde_json.
Side note, that is probably more of a protocol-level nit than something to do with the lib: RFC 9497 (OPRF) uses an uppercase V1, whereas OPAQUE uses a lowercase v. Very specific, but an inconsistency nonetheless 😄

Ah, thank you, this is awesome!!
And nice catch on my mistake of claiming it was updated to version 16 without actually having updated it in the previous release. Apologies on that.


Testing workflow very slow with python 3.6

🐛 Bug
Python 3.6 was removed from the ci-all-testing workflow because the dependency installation was taking too much time (~25mins in "Setup dependencies").
I'm not sure why that's happening, installing locally doesn't reproduce the problem

fixed with poetry 1.1


Inconsistent barcode results?

I got quaggaJS working from a tutorial online which uses my laptops webcam. Everything works perfectly fine but the barcode barely ever scans as the correct barcode? 2 in 10 scans actually gets the correct barcode and I've used 2 different products.
Why is the scanning so erratic? I'm in an average lit area but I find it hard to believe that lighting has such a drastic impact on the results?

I've got 3 different webcams and a laptop built in camera, and none of them have image quality good enough to reliably scan.  Just because a camera says it's HD, doesn't mean it gives a very good image. :-S

Cool thanks. Moving to QR Codes as they seem way more reliable when using a webcam/laptop cam.