Setup Jenkins unit tests with Oracle backend

Impact of the new feature
WMAgent / Jenkins unit tests
Is your feature request related to a problem? Please describe.
We already need to have this ability to run a complete set of unit tests against Oracle backend (instead of MariaDB), however, it will become even more important for the migration to Oracle 19c.
Describe the solution you'd like
Current jenkins unit tests are based on MariaDB backend, where each VM (slice) runs its own MariaDB backend in localhost (with a total of 11 slices).
We should implement a jenkins project to run all the WMCore unit tests against Oracle backend, even if that does not run against pull requests, but only twice a day on top of the baseline tag. It will likely have to be a single slice, because unit tests usually "destroy" the database between unit tests.
We already have a INT2R integration account allocated for this (well, we need to coordinate it with Dario :-D), so it's a matter of securely shipping the oracle credentials to our dmwm jenkins node(s). Shahzad is the expert to contact on this matter.
Describe alternatives you've considered
none, it really has to happen at some point.
Additional context
Better to be done before https://github.com/dmwm/WMCore/issues/10414

As discussed over slack, Erik will have a look at it and ping Kenyi/myself if help is needed. We will definitely need help from Shahzad for the secrets though.

Unit tests using an Oracle backend and python3 were configured and can be seen here: https://cmssdt.cern.ch/dmwm-jenkins/job/DMWM-WMCore-TestOracle/
Tests that consistently fail with the Oracle backend:
WMComponent_t.ErrorHandler_t.ErrorHandler_t.ErrorHandlerTest.testA_Create
WMCore_t.JobStateMachine_t.ChangeState_t.TestChangeState.testIndexConflict
WMCore_t.ReqMgr_t.Service_t.ReqMgr_t.ReqMgrTest.testRequestSimpleCycle
WMCore_t.WMBS_t.Job_t.JobTest.testSaveTransaction
WMCore_t.WMBS_t.Workflow_t.WorkflowTest.testWorkflowInjectMarking
WMCore_t.WMBS_t.WorkUnit_t.WMBSWorkUnitTest.testCreateDeleteExists
WMCore_t.WMBS_t.WorkUnit_t.WMBSWorkUnitTest.testCreateTransaction
WMCore_t.WMBS_t.WorkUnit_t.WMBSWorkUnitTest.testDeleteTransaction
WMCore_t.WMBS_t.WorkUnit_t.WMBSWorkUnitTest.testGetInfo
WMCore_t.WMBS_t.WorkUnit_t.WMBSWorkUnitTest.testLoad
WMCore_t.WMInit_t.WMInit_t.testMySQLDatabase
WMCore_t.WMSpec_t.Steps_t.Executors_t.CMSSW_t.CMSSW_t.testB_ExecuteNonZeroExit
WMCore_t.WMSpec_t.Steps_t.Executors_t.CMSSW_t.CMSSW_t.testC_ExecuteSegfault
WMCore_t.WMSpec_t.Steps_t.Executors_t.CMSSW_t.CMSSW_t.testD_ExecuteNoOutput
WMQuality_t.Emulators_t.DBSClient_t.MockDbsApi_t.MockDbsApiTest.testDBSApiMembers

More info of which unit tests are failing with respect to the database backend can be found here: https://docs.google.com/spreadsheets/d/1D_VUgjooXFzn-bOWw_mB405jGT8sd2FTDYO017QB_xg/edit?usp=sharing

These tests are now running with 1.5.4.pre1, which includes the Oracle 19 client. The tests showed some new failures after the change, but all were related to 404 errors for missing phedex APIs. Similar phedex related errors were seen for the standard WMCore py3 unittests. I think we can say the new client did not have a negative impact the results of the Oracle tests.

@goughes Erik, could you please open a new GH issue providing the list of unit tests above, such that we can in the near future get those fixed (which is unrelated to the oracle upgrade, as mentioned above)?
In addition to that, if there is any other relevant information to be shared within this issue, could you please post it here?
Once this is done, I think we can close this issue. Thanks!

Final thoughts on this issue.
Jenkins+Oracle tests can be found here: https://cmssdt.cern.ch/dmwm-jenkins/job/DMWM-WMCore-TestOracle/
Description of the tests is under DMWM-WMCore-TestOracle section of the Jenkins wiki: https://github.com/dmwm/WMCore/wiki/Understanding-Jenkins#headmaster-tasks
Marking closed.

Thanks, Erik! We missed a GH issue to address the failing unit tests, but here we go: https://github.com/dmwm/WMCore/issues/10851


[move-prover] Using immutable collections for SetDomain and MapDomain

This reimplements the collection types for DFA using base types from the im crate.
In DFA, we often have types like maps or sets which are copied and refined with each basic block. Traditional Rust collections are not well suited for this, because for each instruction we need to make a deep clone of the input domains. The im types are designed with structure sharing in mind. Clone is O(1), and subsequent write leads only to a delta with a reference to the original value.
The API of those collections is slightly different which lead to some adoptions in our code. The PR also attempts to complete the wrapping traits for SetDomain and MapDomain such that they (mostly) behave as the underlying representation.
Motivation
Make the DFA framework more sensible.
Have you read the Contributing Guidelines on pull requests?
Yes
Test Plan
Existing tests.
This PR also fixes a test failure which exists in main and breaks the new disable_inv.move test for invariants v2. This test needs it's separate baseline, since the other features produce different errors.


Replace text in the client app with internationalizing formatter calls to expedite translation

Background on the problem the feature will solve/improved user experience
When users come to the application we want them to be able to read text in the language they're most comfortable. In order to do this we must replace all plain text displays with calls to the internationalization formatter. At the time of this issue being created that is react-intl. You may see examples in the client app by looking for intl.formatMessage
Describe the solution you'd like
Display text should be moved to the /src/nls/messages/en/messages.js file and then properly looked up from there by the component.
Tasks
For each piece of text being moved

[ ] Write a component test (or add an assertion to an existing test) to verify the text displays on the screen
[ ] Move the text to the English translation file. Do not add to other translation files unless you can also provide that translation. Hint: Reuse things like 'Add', 'Update', etc...
[ ] Use the formatting pattern in place to pull the text
[ ] Make sure test still passes

Acceptance Criteria
All of the remaining display text (text the user sees) has been moved to the English translation file.
Tests exist for the items moved.

@Fiewor
An example of where it is used:
https://github.com/Call-for-Code-for-Racial-Justice/Truth-Loop/blob/main/client/src/privacyNotice/PrivacyNotice.js
English:
https://github.com/Call-for-Code-for-Racial-Justice/Truth-Loop/blob/main/client/src/nls/messages/en/messages.js
Here is an example of where you can start:
https://github.com/Call-for-Code-for-Racial-Justice/Truth-Loop/blob/main/client/src/PolicyNotice.js
basically replace Policy Notice with {intl.formatMessage(messages.policyNotice)}

I say create a pull request and in the meantime I'll look for other spots.
Thank you!
On Thu, Feb 17, 2022, 7:48 AM Fiewor John @.***> wrote:

Collaborator
@Fiewor https://github.com/Fiewor
An example of where it is used:
https://github.com/Call-for-Code-for-Racial-Justice/Truth-Loop/blob/main/client/src/privacyNotice/PrivacyNotice.js
Where the english translations are stored:
https://github.com/Call-for-Code-for-Racial-Justice/Truth-Loop/blob/main/client/src/nls/messages/en/messages.js
Here is an example of where you can start:
https://github.com/Call-for-Code-for-Racial-Justice/Truth-Loop/blob/main/client/src/PolicyNotice.js
basically replace Policy Notice with
{intl.formatMessage(messages.policyNotice)} and add a policyNotice:
'Policy Notice' into the messages.js file. Hint: it has to be there for
the en because that is default.
I've implemented this in the starting point you suggested (i.e.
PolicyNotice.js) but I can't seem to find other places within the client
that haven't already has this done. In the mean time should I just push my
changes?
—
Reply to this email directly, view it on GitHub
https://github.com/Call-for-Code-for-Racial-Justice/Truth-Loop/issues/242#issuecomment-1042967214,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AASQF7KAXPXFSBQ7LHS3MFDU3T4BPANCNFSM5G7EWM2A
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
You are receiving this because you authored the thread.Message ID:
@.***
com>


support Xml Object

https://swagger.io/specification/#xml-object

Thanks for the PR! Question for ya.... is this a part of the true openapi spec or is it a swagger specific extension?

I believe it's part of the OpenApi specification.  At least that's what the top of the page at https://swagger.io/specification says?

Hey :wave: gonna close this as stale since it's been almost a year.  Feel free to open it back up if you migrate this to Kompendium V3 :)


add from W3C lesser known semantics element

It's not a pure HTML5 article, but I think is precious for this awesome list.

Excellent! Thanks for your contribution


Update Cloud component and output directive to use React components in streamlit.json

📚 Context
This is a variation/alternative to #1059
🧠 Description of Changes
This implements the same underlying correction as #1059. However, instead of pushing the raw text of the output directive into streamlit.json, this instead pushes the React code <Cloud ... /> into the "example" sections of streamlit.json. Within <Table>, the component is parsed and rendered with a slightly more human-friendly regex expression to pick out each embedded app.
This makes an easier template to follow if we desire other directives to produce React components (as would be particularly nice for SiS exceptions and version-preserving links in the future).
This PR updates all existing embedded apps in docstrings to <Cloud ... /> so older versions are styled consistently. The remainder of the older docstrings are preserved so no source links are broken and no newer information has bled into older versions.
Contribution License Agreement
By submitting this pull request you agree that all contributions to this project are made under the Apache 2.0 license.

FYI I updated stoutput.py in your PR with some comments and linting. PTAL!

I'll generate 1.35.0 docstrings real quick to test, then merge it. TYSM!


Issue with running the code

Hi @Vizonex , I tried to use your repo to generate stubs and I saw that there are issues with the constructor of the PyWriter itself. Its constructor doesn't take 2 arguments. It seems to me like there are some missing changes that you've never committed. Can you please help me understand your code a bit more?
Here is the output of my terminal when I try to run stub generator on some simple cython example.

Thanks a lot!

On Fri, Mar 15, 2024 at 9:36 AM teodoramilanovic @.***>
wrote:

Hi @Vizonex https://github.com/Vizonex , I tried to use your repo to
generate stubs and I saw that there are issues with the constructor of the
PyWriter itself. Its constructor doesn't take 2 arguments. It seems to me
like there are some missing changes that you've never committed. Can you
please help me understand your code a bit more?
Here is the output of my terminal when I try to run stub generator on some
simple cython example.
image.png (view on web)
https://github.com/Vizonex/CyStub/assets/64530200/f4e4f83d-2fad-4cd6-b9ad-d3b46ddf39d6
Thanks a lot!
—
Reply to this email directly, view it on GitHub
https://github.com/Vizonex/CyStub/issues/1, or unsubscribe
https://github.com/notifications/unsubscribe-auth/A3K7GGX6SOYHCOA234SZ6U3YYMBNZAVCNFSM6AAAAABEYDZNR2VHI2DSMVQWIX3LMV43ASLTON2WKOZSGE4DQNRXGQ2DMNI
.
You are receiving this because you were mentioned.Message ID:
@.***>

So I could go in and try to fix the problem your having when I have the
time to but basically I abandoned this project due to the sheer amount of
time that I had to put into it. After attempting to make a pull request to
Cython for it. It almost seemed as if it would never pass so I stopped
trying. But maybe I will go back to this in the future.

I think what would be helpful if I decide to make a return is additional stub files being made for Cython's Visitors and compilers so that I'm not having to guess what types are being used since the last time I did this it felt like I was playing a guessing-game of will this work.

I understand. Thank you for the feedback anyway.


Location state change ?

Please let me know how to get update location when user change permission from never to always or when in use in settings ?

@dungcgd You should be able to just call the appropriate method that you are using when the app comes back into the front. I expect it should work fine. Does it not for you?


Video Flicker when I pass AVMutableComposition with Multiple Video tracks

When i am creating the AVMutableComposition (inserting Multiple Video Tracks) and Pass it to the AVPlayer Item with MTIVideoComposition  then AVPlayer Flicker between the both Frames of Video track. I think when AVPlayer goes at timing of Second Video track then First Video Frame is not hide
  Need to  some improvements in  MTIMutableVideoComposition class .
Checklist

[ ] I've read the README
[ ] If possible, I've reproduced the issue using the master branch of this repo
[ ] I've searched for existing GitHub issues

Environment

Info
Value

MetalPetal Version
e.g. 1.13.0

Integration Method
e.g. CocoaPods / SwiftPM

Platform & Version
e.g. iOS 14.0 / macOS 10.15

Device
e.g. MacBook Pro 16' / iPhone X

Steps to Reproduce
Replace this paragraph with an explanation of how to reproduce the incorrect behavior.
Expected behavior
Describe what you expect to happen.
Actual behavior
Describe or copy/paste the behavior you observe.

Need to some improvements in MTIMutableVideoComposition class .

Do you mean MTIVideoComposition, because there's no MTIMutableVideoComposition.

If you have multiple video tracks. Do not use request.anySourceImage. It is your responsibility to select the track/tracks to display using request.sourceImages[trackID].


Updates This Week in Fluvio 50.

Newsleeter updated. @tjtelan can you please check and add the CDK install and generate scripts to pass - This Week In Rust Sniff Test.

@drc-infinyon I just pushed changes to the branch. I embedded some codeblocks to hopefully invite users to click into the docs

bors r+


Add more logs for timestamp validation

Is your feature request related to a problem?
When using the notation verify command to validate a signature with timestamp validation enabled, the signature verification succeeds even if the signing certificate has expired, provided the signature was generated before the certificate’s expiry. This behavior is expected. However, the verbose log output is not informative, as shown below:
INFO Performing timestamp verification...
INFO TSA identity is: ***
Successfully verified signature for ***

What solution do you propose?
The current log indicates that timestamp validation is enabled and is now validating the timestamp:
INFO Performing timestamp verification...

Subsequently, the log shows the TSA identity:
INFO TSA identity is: ***

It is proposed to enhance the log output to provide more detailed information about the timestamp verification process. For example, the log should indicate whether each certificate in the certificate chain has expired or not.
Examples for valid certificates:
INFO Performing timestamp verification...
INFO The certificate <Subject of Leaf> is still valid and will expire on <Time>.
INFO The certificate <Subject of Intermediate> is still valid and will expire on <Time>.
INFO The certificate <Subject of Root> is still valid and will expire on <Time>.

Examples for an expired leaf certificate:
INFO Performing timestamp verification...
WARN The certificate <Subject of Leaf> has expired. It expired on <Time>.
INFO The certificate <Subject of Intermediate> is still valid and will expire on <Time>.
INFO The certificate <Subject of Root> is still valid and will expire on <Time>.

Additionally, we can make it more clear about what TSA identity is
INFO The subject of TSA leaf/signing certificate is: ***

What alternatives have you considered?
There could be other information printed out for timestamp validation. Any suggestions are welcome.
Any additional context?
Notation v1.2.0-beta.1

Closing as completed.


Explain that recent change to after hook resolution could break deploys

Fixes #1652
/cc @leehambley @dreyks

@mattbrictson for a pure doc change are you fine with not re-releasing? I just ask because CHANGELOG.md is part of the Gem bundle a..

I'm fine with not re-releasing.


Combine Request Modifier and Custom HttpClient?

Is it possible to combine a Request Modifier with a Custom HttpClient?
I'm currently using a custom http client to add a proxy and ignore ssl validation errors, but I also need to be able to handle oauth.
I was able to get the oauth part to work with a request modifier, as per the readme example, but there is no override that accepts a custom http client as well as a request modifier.
I'm guessing there is probably a way to implement the oauth part using the custom http client but I couldn't see an obvious way to achieve that.
Is there a way achieve both?

The RequestModifier is just used with a custom HttpClientHandler: [ModifyingHttpClientHandler](https://github.com/canton7/RestEase/blob/63e5e0f3c521d88e6cebcf784a95c4eb97d742d9/src/RestEase/Implementation/ModifyingClientHttpHandler.cs, see here.
You can create your own HttpClientHandler instead of using RequestModifier, or you can instantiate a ModifyingHttpClientHandler directly.

Ok, I see what its doing now.
I already used a custom HttpClientHandler to add retry policies for another api, so I should be able to do everything I need.
Thanks!


Add default tslint json

Thanks for the great custom rules. Unforunately I ran into some troubles when integrating them into a tslint-config package.
Using tslint-immutable in a tslint-config is problematic when using yarn. For example, a tslint-config package would add ./node_modules/tslint-immutable/rules to its rulesDirectory, but if the tslint-config package is installed into another project through yarn, the node_modules folder structure is flattened and the rulesDirectory path can't be found (because tslint-immutable is at the top level of the directory, rather than nested as it would be using npm).
Adding a default tslint-immutable.json to the project allows other tslint-configs to extend it, and not worry about missing rules.

Nice, I was not aware tslint could do this :-). Thanks for the contribution!


Update Windows aria2 executables per architecture

Description
Package architecture-specific executables with Motrix.
Related Issues
As mentioned in the comment, https://github.com/agalwood/Motrix/issues/271#issuecomment-494309859, Motrix did not ship 64bit aria2 in windows binaries was because of packaging issues in electron builder.
Checklist:

[x] Have you checked to ensure there aren't other open Pull Requests for the same update/change?
[x] Have you linted your code locally prior to submission?
[x] Have you successfully run the app with your changes locally?

@agalwood, I have looked into agalwood/aria2 but have not been able to understand, if the aria2c.exe is compiled by the CI for this repository or is it simply copied over?
Currently, in the last commit of this draft, the x64 folder contains a copy of the ia32 aria2c.exe. Locally I have tested this using official aria2 release binaries.
Can you provide me with the 64bit binary or should I use the official binary?
As for agalwood/aria2, since that repo is 74 commits behind, is it going to be rebased to the recent aria2 release?

I have opened a PR at agalwood/aria2#1 to bump aria2 to 1.36.0. The windows binaries used in the PR are generated from 1.36.0. As for Linux and macOS, maybe a separate PR can be opened for them.


Predicted Nan labels

do you have any idea why would the model predict labels as NaN instead of 0 or 1 in a binary classification problem?

@Mahmedturk hi! Sorry for the slow reply. Do you still have this problem?
First, the outputs of most DL models are logits, not labels. You have to convert logits to labels manually in the same manner as described here.
Second, NaNs are not expected even in the case of logits. Usually NaNs indicate that the input contains NaNs, or model's weights contain NaNs, or model's weights are too large in their magnitude (which can be cause by many reasons) etc.

Feel free to reopen the issue if the help is needed!


[Enhancement] Set enable_recursive_listing equal to true as the default for hive/hudi connector

Set enable_recursive_listing equal to true as the default for hive/hudi connector
What type of PR is this:

[ ] BugFix
[ ] Feature
[x] Enhancement
[ ] Refactor
[ ] UT
[ ] Doc
[ ] Tool

Checklist:

[ ] I have added test cases for my bug fix or my new feature
[ ] This pr will affect users' behaviors
[ ] This pr needs user documentation (for new or modified features or behaviors)

[ ] I have added documentation for my new feature or new function

Bugfix cherry-pick branch check:

[x] I have checked the version labels which the pr will be auto-backported to the target branch

[x] 3.1
[x] 3.0
[x] 2.5
[ ] 2.4

[FE PR Coverage Check]
:heart_eyes: pass : 2 / 2 (100.00%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/connector/hive/HiveConnectorInternalMgr.java
1
1
100.00%
[]

:large_blue_circle:
com/starrocks/connector/hudi/HudiConnectorInternalMgr.java
1
1
100.00%
[]

@Mergifyio backport branch-3.1

@Mergifyio backport branch-3.0

@Mergifyio backport branch-2.5


How to search on column translatable

i use this library https://github.com/Astrotomic/laravel-translatable/ how to search on colum translatable?

I no know.

Does anyone have a solution? I am facing the same problem.
So far my solution is via the join configuration:
    /**
     * Searchable rules.
     *
     * @var array
     */
    protected $searchable = [
        'columns' => [
            'article_translations.title' => 10,
            'article_translations.keywords' => 8,
            'article_translations.description' => 2,
        ],
        'joins' => [
            'article_translations' => [
                'articles.id', 'article_translations.article_id',
            ],
        ],
    ];

But all translations are always returned and so I have each modal n times, where n is the number of possible translations.

Hi all, I'm using this code:
$prods = Product::whereIn('product_id', function($query) use ($search){
    return $query->fromSub(
        ProductTranslation::search($search, 0)->select('product_id')->distinct(),
        'tmp'
    );
})->get();

where Product is the main model, ProductTranslation is the translation models, and the searchable array looks like this:
protected $searchable = [
    /**
     * Columns and their priority in search results.
     * Columns with higher values are more important.
     * Columns with equal values have equal importance.
     *
     * @var array
     */
    'columns' => [
        'products_translations.product_name' => 10,
        'products_translations.product_description' => 5,
    ],
];

this works, but there is for sure better way to do this


pull request for e2e test at 12/20/2016 01:26:19

:white_check_mark: Validation status: passed
For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


RuntimeError: Sizes of tensors must match except in dimension 1

Hi @LightwheelAI ,
I tried to run your awesome project on my 3090 computer, but got some error while training

I also have some problem in data processing, so I use the preprocessed data<PHONE_NUMBER>939952000 that you provided
I modified frame_select  as indicated in the README

I use points3D2.bin as init points

when I ran train.sh, I got error below:
File "/home/sil/miniconda3/envs/street-gaussians-ns/bin/sgn-train", line 8, in <module>
    sys.exit(entrypoint())
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/scripts/train.py", line 262, in entrypoint
    main(
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/scripts/train.py", line 247, in main
    launch(
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/scripts/train.py", line 189, in launch
    main_func(local_rank=0, world_size=world_size, config=config)
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/scripts/train.py", line 100, in train_loop
    trainer.train()
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/engine/trainer.py", line 298, in train
    self.eval_iteration(step)
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/utils/decorators.py", line 70, in wrapper
    ret = func(self, *args, **kwargs)
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/utils/profiler.py", line 112, in inner
    out = func(*args, **kwargs)
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/engine/trainer.py", line 536, in eval_iteration
    _, eval_loss_dict, eval_metrics_dict = self.pipeline.get_eval_loss_dict(step=step)
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/utils/profiler.py", line 112, in inner
    out = func(*args, **kwargs)
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/pipelines/base_pipeline.py", line 324, in get_eval_loss_dict
    model_outputs = self.model(ray_bundle)
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
    return forward_call(*args, **kwargs)
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/models/base_model.py", line 143, in forward
    return self.get_outputs(ray_bundle)
  File "/home/sil/simulation_ws/scripts/street-gaussians-ns/street_gaussians_ns/sgn_splatfacto_scene_graph.py", line 363, in get_outputs
    out = super().get_outputs(camera)
  File "/home/sil/simulation_ws/scripts/street-gaussians-ns/street_gaussians_ns/sgn_splatfacto.py", line 858, in get_outputs
    colors_crop = torch.cat((features_dc_crop, features_rest_crop), dim=1)
RuntimeError: Sizes of tensors must match except in dimension 1. Expected size 626493 but got size 809985 for tensor number 1 in the list.
Exception in thread Thread-13:
Traceback (most recent call last):
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/threading.py", line 932, in _bootstrap_inner
    self.run()
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/viewer/render_state_machine.py", line 224, in run
    outputs = self._render_img(action.camera_state)
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/viewer/render_state_machine.py", line 168, in _render_img
    outputs = self.viewer.get_model().get_outputs_for_camera(camera, obb_box=obb)
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
    return func(*args, **kwargs)
  File "/home/sil/simulation_ws/scripts/street-gaussians-ns/street_gaussians_ns/sgn_splatfacto.py", line 1106, in get_outputs_for_camera
    outs = self.get_outputs(camera.to(self.device))
  File "/home/sil/simulation_ws/scripts/street-gaussians-ns/street_gaussians_ns/sgn_splatfacto_scene_graph.py", line 363, in get_outputs
    out = super().get_outputs(camera)
  File "/home/sil/simulation_ws/scripts/street-gaussians-ns/street_gaussians_ns/sgn_splatfacto.py", line 858, in get_outputs
    colors_crop = torch.cat((features_dc_crop, features_rest_crop), dim=1)
RuntimeError: Sizes of tensors must match except in dimension 1. Expected size 626493 but got size 809985 for tensor number 1 in the list.

Should I change any configurations?
Best

I notice that object_hsZGh_tYp9MXN_75m601LA appear two times, which cause an AssertionError from assert model_name not in self.visible_model_names  at line 387(street_gaussians_ns/sgn_splatfacto_scene_graph.py)

I use another preprocessed dataset<PHONE_NUMBER>967750070, it seems work, and will update when I get model out, thanks~

Hi @LightwheelAI ,
I tried to run your awesome project on my 3090 computer, but got some error while training

I also have some problem in data processing, so I use the preprocessed data<PHONE_NUMBER>939952000 that you provided
I modified frame_select  as indicated in the README

I use points3D2.bin as init points

when I ran train.sh, I got error below:
File "/home/sil/miniconda3/envs/street-gaussians-ns/bin/sgn-train", line 8, in <module>
    sys.exit(entrypoint())
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/scripts/train.py", line 262, in entrypoint
    main(
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/scripts/train.py", line 247, in main
    launch(
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/scripts/train.py", line 189, in launch
    main_func(local_rank=0, world_size=world_size, config=config)
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/scripts/train.py", line 100, in train_loop
    trainer.train()
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/engine/trainer.py", line 298, in train
    self.eval_iteration(step)
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/utils/decorators.py", line 70, in wrapper
    ret = func(self, *args, **kwargs)
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/utils/profiler.py", line 112, in inner
    out = func(*args, **kwargs)
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/engine/trainer.py", line 536, in eval_iteration
    _, eval_loss_dict, eval_metrics_dict = self.pipeline.get_eval_loss_dict(step=step)
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/utils/profiler.py", line 112, in inner
    out = func(*args, **kwargs)
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/pipelines/base_pipeline.py", line 324, in get_eval_loss_dict
    model_outputs = self.model(ray_bundle)
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
    return forward_call(*args, **kwargs)
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/models/base_model.py", line 143, in forward
    return self.get_outputs(ray_bundle)
  File "/home/sil/simulation_ws/scripts/street-gaussians-ns/street_gaussians_ns/sgn_splatfacto_scene_graph.py", line 363, in get_outputs
    out = super().get_outputs(camera)
  File "/home/sil/simulation_ws/scripts/street-gaussians-ns/street_gaussians_ns/sgn_splatfacto.py", line 858, in get_outputs
    colors_crop = torch.cat((features_dc_crop, features_rest_crop), dim=1)
RuntimeError: Sizes of tensors must match except in dimension 1. Expected size 626493 but got size 809985 for tensor number 1 in the list.
Exception in thread Thread-13:
Traceback (most recent call last):
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/threading.py", line 932, in _bootstrap_inner
    self.run()
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/viewer/render_state_machine.py", line 224, in run
    outputs = self._render_img(action.camera_state)
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/nerfstudio/viewer/render_state_machine.py", line 168, in _render_img
    outputs = self.viewer.get_model().get_outputs_for_camera(camera, obb_box=obb)
  File "/home/sil/miniconda3/envs/street-gaussians-ns/lib/python3.8/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
    return func(*args, **kwargs)
  File "/home/sil/simulation_ws/scripts/street-gaussians-ns/street_gaussians_ns/sgn_splatfacto.py", line 1106, in get_outputs_for_camera
    outs = self.get_outputs(camera.to(self.device))
  File "/home/sil/simulation_ws/scripts/street-gaussians-ns/street_gaussians_ns/sgn_splatfacto_scene_graph.py", line 363, in get_outputs
    out = super().get_outputs(camera)
  File "/home/sil/simulation_ws/scripts/street-gaussians-ns/street_gaussians_ns/sgn_splatfacto.py", line 858, in get_outputs
    colors_crop = torch.cat((features_dc_crop, features_rest_crop), dim=1)
RuntimeError: Sizes of tensors must match except in dimension 1. Expected size 626493 but got size 809985 for tensor number 1 in the list.

Should I change any configurations? Best

Hi, thanls for your trying! I think this may be a problem caused by the initial point cloud, if there are SfM floaters in the initial point cloud, there is a possibility that they may block the dynamic object so that its gaussians are censored to zero causing the error to be reported.
best

Hi @LightwheelAI ,
Thanks for your reply, I just reinstall all dependencies then error disappear
I use<PHONE_NUMBER>939952000 and results are as below:
background_rgb
https://github.com/LightwheelAI/street-gaussians-ns/assets/43367892/1498f776-4137-4299-8af6-8b73e8d6d39b
object_rgb
https://github.com/LightwheelAI/street-gaussians-ns/assets/43367892/897d5765-695b-4ec1-8f15-849320fabddf
rgb
https://github.com/LightwheelAI/street-gaussians-ns/assets/43367892/f04e04cd-f621-42c0-a138-10c923e0291d
It seems that there is a problem with moving object segmentation, resulting in the reconstructed moving object being blurry
I'd like to know if you have any suggestions for improvement?
Best

Hi, thanks for your trying!
There are three key factors to improve the quality of moving target reconstruction in our practice.

Remove the floater of the moving target in the SfM point cloud
Improve the accuracy of the bounding box
Improve the accuracy of the camera pose

I use another preprocessed dataset<PHONE_NUMBER>967750070, it seems work, and will update when I get model out, thanks~

hello, which init point cloud file you used for training sequence<PHONE_NUMBER>967750070?

It seems that the problem is caused by viewer of nerfstudio. After turning off nertstudio in explorer when I trained the model, this error disappeared

It seems that the problem is caused by viewer of nerfstudio. After turning off nertstudio in explorer when I trained the model, this error disappeared

Hello, I have encountered the same problem, my computer is Ubuntu system, may I ask you how to operate, to solve this problem

It seems that the problem is caused by viewer of nerfstudio. After turning off nertstudio in explorer when I trained the model, this error disappeared

Hello, I have encountered the same problem, my computer is Ubuntu system, may I ask you how to operate, to solve this problem

Yeah, I met the error when I tried to open nerfstudio viewer and move around the scene while training. So I just run the train.sh without nerfstudio viewer or any operation, then it worked well.
Regarding other cases in the issue, it can also be caused by some dependencies, especially some packages about nerfstudio. For example, you can try gsplat 0.1.11 and nerfstudio 1.1.0 as https://github.com/LightwheelAI/street-gaussians-ns/issues/31 mentioned. Here is my environment, hope it helps
Ubuntu 20.04 with RTX 3090
requirements.txt


Non displayed divs on screen don't have any child

I am parsing html page from google search engine result page. There are 10 news as a carousel but I can access only the first three (Displayed news on screen). Why I cannot access to non-displayed items infos?

Hello,
The page might be generated by javascript, in which case grabbing the html will not get the same document you see in the browser. Also note that google has an API for search results, which might be a better fit (https://developers.google.com/custom-search/v1/overview).
Hope this helps,
Martin

Okay thanks Martin I will try it and share my experience.

I tried your response but the Google API is a bit expensive and insufficient. I am trying to parse Google SERP and probably as you said, some elements generated by javascript that's why I can't access them. I can't see any solution other than Selenium to run scripts.

Gotcha, ok. Regarding parsing pages with javascript, there are some tips as to how to use goquery with other tools to achieve that: https://github.com/PuerkitoBio/goquery/wiki/Tips-and-tricks#handle-javascript-based-pages. Note that those are community-provided, I haven't tried them myself.
Good luck with your project!
Martin


chore: minor storybook package bumps

Description
Bump storybook to latest minor release.
Tested locally, no apparent regressions.
Notice

[x] Have you followed the guidelines in our Contributing guide?
[x] Have you checked to ensure there aren't other open Pull Requests for the same update/change?

Pull Request Type

[ ] :bug: Bug fix (Non-breaking Change: Fixes an issue)
[x] :hammer_and_wrench: Chore (Non-breaking Change: Doc updates, pkg upgrades, typos, etc..)
[ ] :nail_care: New Feature (Breaking/Non-breaking Change)

Issue (if applicable)
N/A
Risk
Minimal - minor release, and not production code.
Testing
Storybook should continue to work as it always has, with no regressions.
Screenshots (if applicable)
N/A

Putting in draft until I have a moment to look into the build issue: dep.getContext is not a function.

Messed around for a bit, something something third party package issue - going to close and park this for now.


Support Stimulus 2.0 Values API

Support for Stimulus 2.0's Values API would be useful, so that flatpickr options could be provided as attributes like data-flatpickr-the-option-value (in addition to deprecated support for data-flatpickr-the-option).
I think that support would be straight-forward and I could likely provide a PR.
(And thanks for providing this helpful and clean library!)

yes this is definitely on my roadmap to support the value API. And some overalls clean up of this library, but I was quite busy with Stimulus Use recently.
Also initially I wanted to wait for this PR to be merged as I think it could simplify the implementation. But it is not mandatory to wait for that.
A PR would be very welcome and could be a starting point for a v2.0 of this package.

A PR would be very welcome and could be a starting point for a v2.0 of this package.

Do you want it to be backwards compatible with v1.0 this.data support, or to only support the new *-value attribute names?  Either seems reasonable, with the latter an option if you're planning on a breaking 2.0 release.


chore(docs): add instructions for npm-link-better

Overview

Added instructions for using npm-link-better instead of yarn link

PR Checklist

[ ] Related to designs:
[ ] Related to JIRA ticket: ABC-123
[ ] I have run this code to verify it works
[ ] This PR includes unit tests for the code change

🚀 Styleguide deploy preview ready!https://604255a4fb04af0fa778b544--gamut-preview.netlify.appDeploy Logs

🚀 Styleguide deploy preview ready!https://6042571cec518b1aac3f80ed--gamut-preview.netlify.appDeploy Logs

🚀 Styleguide deploy preview ready!https://6042670cfc41c90c7db8fba1--gamut-preview.netlify.appDeploy Logs


Bad design of AbstractEpollStreamChannel spliceTo

The new spliceTo functions seem to be cool but I don't like the current design.
The offset and len parameters should be long instead of int. Some crazy dudes might want to transfer several GB of data, or not?
I also don't like the use of Integer.MAX_VALUE to copy infinitely. You might create a new constant EpollStreamChannel.INFINITE_TRANSFER which is -1 or something like that. Or maybe a spliceTo function without a len param can do the same.
In case I use this new sliceTo stuff I would also like to have a ChannelProgressiveFutureListener. Or it's already supported?

@normanmaurer - I will assign to you...just some thoughts...

length data type we expose - splice supports a size_t length and for linux we should be able to use a jlong for this.
Using Integer.MAX_VALUE for indefinite splice -  I agree we should not use a legitimate value from the input domain as special meaning.

@WhiteTrashLord thanks for the feedback. I think it makes sense, let me come up with something :)

I also have a question here :
Why "Both channels need to be registered to the same EventLoop"? Is that because of performance reasons or because of netty design?
I have a scenario in which I have a proxy that forwards messages between two event loops...

I think we should just drop it for 5.0

This was dropped for 5.0


Corrected typo on License title.

Hello @marcorichetta , thanks for the PR, but we do not accept PRs into the master branch.
Please see the contribution guidelines in the README.


Add missing deps for imagej

imagej app is missing deps in central requirements file, causes:
Traceback (most recent call last):
  File "./apps/imagej/run_imagej.py", line 3, in <module>
    import imagej
ModuleNotFoundError: No module named 'imagej'

I can look at this myself, but without knowing which versions you used, I'd simply be using the latest available of each.


Use ag-grid in data viewer

What problem did you solve?
Closes #506
This PR replaces DataTables with ag-grid in the data viewer.
(If you have)Screenshot
https://user-images.githubusercontent.com/4662568/125810901-cd8f28d4-a35b-4399-903e-4ae3d03b4e4c.mp4
(If you do not have screenshot) How can I check this pull request?
View any data.frame or matrix and the data viewer will use ag-grid to present the table with the following features:

Sortable columns (hold shift for multi-sort)
Filterable columns (filter number, date, text by conditions)
Resizable columns
Movable columns
Pagination
Great performance
Dark theme

Looking great! By any chance "Pagination" means dynamic loading? It would be perfect.

Looking great! By any chance "Pagination" means dynamic loading? It would be perfect.

It's not dynamic loading here.

Is there another setup requirement in addition to running yarn? I'm getting several errors due to missing files, e.g.:
(Error: Unable to resolve non-existing file 'vscode-remote://wsl+ubuntu-20.04/vscode-resource?{"requestResourcePath":"/home/elian/coding/VS/vscode-R/dist/resources/ag-grid-community.min.noStyle.js"}')

We need those js css resources to be copied from node_modules to dist/resources as specified in webpack.config.js. You might need to run node .guthub/scripts/enableWebpack.js and run.

Lists and data.frames work nicely both locally and on live share! Not a must, but do you think it would be worth using some custom css to better fit the vscode theme? I threw a little css together for an example:

Otherwise, LGTM

Lists and data.frames work nicely both locally and on live share! Not a must, but do you think it would be worth using some custom css to better fit the vscode theme? I threw a little css together for an example:

Looks great! Would you like to provide a better css here?

I've done some changes to make it also work with high-contrast theme. Now everything looks good.

Looks good and works well, thanks!


feat: implement WalletConnect Sign-API

Description
WalletConnect Sign-API heavily inspired by https://github.com/WalletConnect/WalletConnectRust/pull/48 with refactoring, deduplication and code organization.
I will add more unit test and proceed to implement Core Pairing API.
Due Diligence

[ ] Breaking change
[ ] Requires a documentation update
[ ] Requires a e2e/integration test update

closing in favor of https://github.com/KomodoPlatform/komodo-defi-framework/pull/2223

closing in favor of https://github.com/KomodoPlatform/komodo-defi-framework/pull/2223


feat: Nx.abs/1 supports s64

Bumping candle-core to latest version should make this work because of https://github.com/huggingface/candle/commit/154c674a798fd5a40d57ff9a8664856d9c41ca56.


Resize intent

Is it possible to change the size of the map that is displayed?
I'm using ionic 3

What map?

@EddyVerbruggen  sorry I'm wrong. It is resizing the intent. To be displayed in a popup

Perhaps a screenshot of another app that has this feature is needed to shed some light on what you mean exactly..

@EddyVerbruggen

The facebook window To be able to give that size to the attempt of the social network

That's just what the OS does for you. Nothing I can change there..

But for it to work on android is it possible?


Storage driver for Google drive

Pull request for the issue : #1875

Please sign your commits following these rules:
https://github.com/docker/docker/blob/master/CONTRIBUTING.md#sign-your-work
The easiest way to do this is to amend the last commit:
$ git clone -b "master" git@github.com:manoj535/distribution.git somewhere
$ cd somewhere
$ git commit --amend -s --no-edit
$ git push -f

Ammending updates the existing PR. You DO NOT need to open a new one.

hi @manoj535 .  Thanks for the contribution.  Out of curiosity, what is your use case for storing registry content in google drive?

Hi @RichardScothern, this PR mostly came because of following requirements.
1)Need a repository which is hosted on cloud for a small team or an individual.
2)Easy to setup(I don't need any setup like OpenStack)
3)And mostly it must be free.
For these type of requirements, people require this type of Cloud storage systems.

This is a good start. I will take a deeper look when I have time to test out the driver myself. Also consider adding a package comment which instructions on the easiest way to set it up. Assume the reader already knows how to access the Google api console. That will make reviewing easier and give a better start on documenting the driver. Also highlight the difference with the GCS driver (note camlistore also has separate backends for Drive and GCS if you find some inspiration there).
More generally on the design, I can see this as being useful for developers and more casual users. I would be really interested to see this be able to integrate with the OAuth work being done so each user could use their own Google Drive storage. I am not expecting any related work in this PR but consider that as a possibility in the way the driver is authorized and setup. Getting that actually working would involve changes higher up the stack to pass in the token.
Thank you for this significant contribution, we really appreciate following up proposals with working code. Going forward is supporting bugs and issues something the two of you would be able to support? We rely on driver contributors to continue to help in supporting their drivers after merge and take that into considering before hitting the merge button.

@dmcgowan We have addressed the comments that you have raised. Please check.
May I know , what kind of differences between gdrive and gcs you are expecting, is it from installation point of view ?
Yes, We are interested in supporting this driver , if there are any issues.

Would you mind splitting the commit into a vendor commit and change commit, makes it easier to review on github.

Please sign your commits following these rules:
https://github.com/docker/docker/blob/master/CONTRIBUTING.md#sign-your-work
The easiest way to do this is to amend the last commit:
$ git clone -b "master" git@github.com:manoj535/distribution.git somewhere
$ cd somewhere
$ git rebase -i HEAD~2
editor opens
change each 'pick' to 'edit'
save the file and quit
$ git commit --amend -s --no-edit
$ git rebase --continue # and repeat the amend for each commit
$ git push -f

Ammending updates the existing PR. You DO NOT need to open a new one.

@dmcgowan We have addressed the comments mentioned, pls check. But the circleci is failing after adding the build tag

How is this different from the gcs driver? Anyone from google willing to support this or coalesce this with the gcs driver?

Hi @stevvooe as some of the users who wants to store their docker images in easy to setup platform and inexpensive. And this uses google drive API. We have contacted with google for this. Let me why do you  think  this has to be coalesced with gcs driver

@bharaththiruveedula Are you going to be able support this driver? We can't really take on this patch without having someone to support it. I also don't really understand the difference between this and the gcs driver. What is the point of running a production registry against a Google Drive folder?

@stevvooe
1)Yes, I would like to support this driver in future too.
2)As @dmcgowan commented in  this is being  useful for developers and more casual users and not specifically for production registry.

@bharaththiruveedula Here is an example of a well-formed proposal: https://github.com/docker/distribution/issues/2041.
I really don't understand the use case and I am not sure if we want to take on the extra technical debt.

This would be a great addition to docker.

Are there any plans to merge this to the project? I just read through and understand the hesitance to accept with regards to support / technical debt, but it looks like @bharaththiruveedula has said repeatedly that there is intent to provide resources for support.

@mdwheele I still haven't received a great answer to what the use case is. Does this run on end user machines? This could be that I misunderstand the differences between google drive and google cloud storage from a product perspective.
Effectively, this PR needs to include some documentation that provides users help with making a choice between the configurations.
@mattmoor Do you have someone who could weigh in on the benefits of drive vs gcs for registry storage?

would love this feature..

@stevvooe A proper use case is that many people (students for example) are offered Drive storage cheaper than GCS as far as I know. Hence they could benefit from this for example, and I think it would be a good cause to support students by all means, including offering them cheaper storage when learning / using Docker! What do you think?
Keep up the good work guys!

@stevvooe @pmjohann This is exactly my use case. I'm a student and my school gives me Google Drive for use for my school work. As it is for school I can't publish anything publicly until after the term is up, which means that I can't just use Docker Hub. My school also gives me computation resources so I can run the registry software, but not nearly enough space for the images I would need to store. I already pay for Google Drive through tuition and other associated fees, whereas Google Cloud Storage would be an additional cost.

@manoj535 Looks like there are a few build errors.

@manoj535 are you still willing to work on this?
If so, can you rebase?

Please sign your commits following these rules:
https://github.com/moby/moby/blob/master/CONTRIBUTING.md#sign-your-work
The easiest way to do this is to amend the last commit:
$ git clone -b "master" git@github.com:manoj535/distribution.git somewhere
$ cd somewhere
$ git rebase -i HEAD~842354132976
editor opens
change each 'pick' to 'edit'
save the file and quit
$ git commit --amend -s --no-edit
$ git rebase --continue # and repeat the amend for each commit
$ git push -f

Amending updates the existing PR. You DO NOT need to open a new one.

I dont think we'll consider adding more storage drivers to registry at this point, so I'm closing this PR. feel free to reopen if you disagree.


Pepr Onboarding Document

Document should outline:

Our tests, Pepr Excellent Examples (e2es), Soak Test, Journey Tests, and unit tests
Watch, the relist, checkResync, and the connection.

What is would look like if each fails.
How they remediate during a failure.

https://docs.google.com/document/d/1P4jA145z6xr1Yt8e4flKv2hgkBPNm09QDqwxXQthKYQ/edit


[Algo] Merge Sort in Java

Algorithm

[x] I have gone through the repository and made sure this algorithm has not been implemented

Information about my new algorithm

Algorithm Name: Merge Sort

Programming Language: Java

Time complexity: nlog(n)

Is this your first contribution to this repository?
No

Hi @Amminexx thank you but this is already under review. #179


Variables are not properly parsed from GraphiQL POST

GraphiQL is sending along the variables field as a string, but graphql is expecting a JSON object.  Somewhere along the line, the variables string field needs to get converted to JSON, otherwise GraphQL never receives the variables!
Here is the offending line:
https://github.com/RisingStack/graffiti/blob/master/src/koa/koa.js#L32
Here's an example POST body getting passed over the network:
{
  "query":"mutation M($foo: updateUserInput!) { updateUser(input: $foo) { clientMutationId changedUser { id, gender } } }",
  "variables":"{ \"variables\": { \"foo\": { \"clientMutationId\": \"549b5e7c-0516-4fc9-8944-125401211592\", \"id\": \"VXNlcjo1NmFhYTM4OTZkZjhmMDgxNDM4ODliNzQ=\", \"gender\": \"female\" } } }"
}

The problem is that, by the time we get to the line referenced above, variables is still a string.  It needs to be a JSON object.  I'm just getting started with this stack, but it seems like you just need to JSON.parse() the variables object there, right?  Or is there somewhere else in the stack where it should be getting converted?

Here's an example of a potential solution:
https://github.com/wellth-app/graffiti/commit/bef6176ba9f88b8529eac953bec6b864be92a5c1

@zopf Thanks for the report! Can you try it with version 3.0.0. The body parser has been removed from the middleware, you need to register one beforehand. Take a look at the examples.

Sorry for the delay!  Was traveling.
Same issue with 3.0.1 and .2.  The body parsing works properly, but we're still getting a this.request.body.variables which is a string.  That's the proper format for GraphiQL, but it's the wrong format for GraphQL.
GraphiQL requires variables to be a string.
GraphQL requires variables to be an object.
So, just need to parse variables string to object before it hits GraphQL.
Example after-body-parsing input:
{ query: 'mutation addPhotoRecord($input: addPhotoRecordInput!) {\n  addPhotoRecord(input: $input) {\n    changedPhotoRecordEdge {\n      node {\n        id,\n        photo {\n          photoURL\n        }\n      }\n    }\n    clientMutationId\n  }\n}\n }\n',
  variables: '{ \n  "input": {\n    "kind": "PhotoRecord",\n    "photo": "56aa944aeca0f60651df0ba8",\n    "clientMutationId": "123123123"\n  }\n}' }

Example updated handler:
const parsedVariables = (typeof variables === 'string' && variables.length > 0) ?
    JSON.parse(variables) : variables;
this.body = yield graphql(schema, query, this, parsedVariables);

Here's a test:
GraphQL input:
mutation m($input: addPetInput!) {
  addPet(input: $input) {
    changedPetEdge {
      node {
        name
        type
        age
      }
    }
  }
}

With variables:
{
  "input":{
  	"name": "Test1",
    "type": "Dog",
    "age": 5,
    "clientMutationId": "abcdef"
  }
}

Without the fix, I get:
{
  "statusCode": 400,
  "error": "Bad Request",
  "message": "Variable \"$input\" of required type \"addPetInput!\" was not provided."
}

With the fix, I get:
{
  "data": {
    "addPet": {
      "changedPetEdge": {
        "node": {
          "name": "Test1",
          "type": "Dog",
          "age": 5
        }
      }
    }
  }
}

PR incoming shortly...


Adds Vue and Simple JS in the Jamstack framework in the home page

Pushed to dev, Closing this issue!!


About Claims

Hello, it's not clear for me when I am suposed to use each type of claim, as I have read, we have ApiResource claims, IdentityResource claims and Scope Claims. Actually, my doubt is more about how to use them, not when. Can someone help me to understand this? Thanks in advance.

https://brockallen.com/2019/02/25/scope-and-claims-design-in-identityserver/

Thanks, it helped but I still have some doubts. Scope Claims, for example, can I use them both for clients and users? This kind of definition is not very clear.


Increase GitHub Stars to over 100 ⭐

https://github.com/opencollective/opencollective/issues/1755#issuecomment-466119947
"If you would like to be fiscal sponsored by the Open Source Collective then you'll need at least a repo of 100 stars. If you have a bank account you can use, then you just need to go to your collective /edit and select fiscal host and create your own host organization. You just need to have a stripe account."
Let's ask the Techqueria community to star this repo so we can get over 100 stars!

✅ By submitting this issue, I have verified the following

[x] Checked to see if the issue has already been discussed before 🤔
[x] Made sure enough details were provided if proposing a new feature 🔍

we are at 104 stars 🎉as of 4/5/2019


New version: PostgreSQL.pgAdmin version 8.10

Created by 🥟 Dumplings in workflow run #6949.

Log
Updated: 8.9 → 8.10
Submitting WinGet manifests
Creating manifests
Uploading manifests and making commits
Creating a pull request

Microsoft Reviewers: Open in CodeFlow

/azp run


Topic: EU Cyber Resilience Act

... and possible effects on Open Source users and makers in the EU.
Maybe we can invite @oej to tell us about it?
Link: https://digital-strategy.ec.europa.eu/en/library/cyber-resilience-act

What is the EU Cyber Resilience Act?
When will it become law? (Will it?)
How will it affect manufacturers of software in Europe if/when enacted?
How will it affect Open Source projects?
Can we do anything to change it, does it need changing?

If we're focusing on Open source we need to take a wider scope and discuss what's happening in the US and why the OpenSSF exists and what they do...

Yes, I think we should see and talk about this from an Open source angle, even with a focus at Open Source hackers/contributors. Staying true to who we are.

Some suggestions if/when you want to dive in a bit deeper:

what is the NLF and how did product-legislation get extended to software, as such?
how to interpret the terms "commercial" and "placing on the market" in the context of open source software?

how do policymakers interpret these terms?
what about the FOSS community, to the limited extent it has been engaged thusfar?

who is this 'manufacturer' that is central to the the mechanics of the CRA when it comes to open source?

Happy to discuss the topic, if that is of any utility; I have been following the topic for a while now.

While intentions are good behind EUCRA, I get strong ISO9000 vibes here.
However good the regulation will become, the business opportunity for certification companies arise. This could make it spread like cancer through the industry. Any, however small, software consulting could require anyone to be EUCRA certified. And how often does one need to be re-certified? Every year?
While software developers outside the EU will not be bothered with this. Do we all move to Northern Ireland or Norway then? What would prevent this? An exemption for "small" businesses?

The law specifies that standard bodies will have to define what exactly will the criteria be to be certified. As such

Which of the standardization committees or bodies will this be? This has a massive impact because they have fairly different members
Can we have FOSS represented there? If yes how?
In particular because what we do in practice has not a lot to do with what is considered "SDLC" in... well everywhere.
If you had to define what your own good practices, that you are doing today, are, what would they be? Can we start talking about that, instead of the SLSA or OpenSSF framework which afaict are not realistic?

On certification:

What would a certification for a FOSS project look like?
Who would audit it? So far none of the usual certification industry players seem interested
Who would answer the audit?
If we are not certified... what happens? Are we still used? Will the industry user need a certification?
What happens if the industry simply... refuse to do it for FOSS because it is too hard? This has happened multiple times in the past with this kind of EU rule in other industries.

You might want to talk to @berthubert as well. He wrote a good article about it and is in discussions with lawmakers/civil servants.

I really like the discussion here, so keep it going. The recording of the podcast is today, but that doesn't mean we can't discuss :-)

The creation of new standards is not a route that will save open source projects from concern. First, far too long a timeline. Second, there's a critical lack of representation in ETSI and CEN/CENELEC.

Since this topic has now been discussed in a recorded episode, I'm closing.


Author App Doesn't initialize after Migration

Re-deployment of new 2.1 version was success; however after updating the Author App in the Team Manage Apps and trying to add to a Team there is a failure to add to the channel.
An error occurred while starting the application.
.NET Core 4.6.29220.03 X86 v<IP_ADDRESS>    |   Microsoft.AspNetCore.Hosting version 2.1.1-rtm-30846    |    Microsoft Windows 10.0.14393    |   Need help?

Reason for above issue: Latest code is not deployed
Solution:
Login to Azure portal -> Navigate to resource group ->Open app service ->Click on "Deployment center" in left rail -> Click on "Sync" to deploy latest code.
It will take a while to deploy the code. Once it is deployed, above issue will be resolved.

Closing due to inactivity. Please re-open if you're still facing this issue.


Support flag --trace-python-allocators when running the memray pytest plugin

Feature Request
Is your feature request related to a problem? Please describe.
I've read through the doc about how pymalloc affects profiling results.
It seems that when running a test suite using the memray pytest plugin, not all the memory allocations from a test would be reported if the pymalloc allocator finds memory available in the arenas and memory pools that had been previously allocated by the tests in the test suite that ran before. Is this something that might happen?
Describe the solution you'd like
In such a case, would help if the pytest memray plugin could be run with the option --trace-python-allocators to always track the calls to the pymalloc memory allocator?

not all the memory allocations from a test would be reported

Well, this depends on what you define as "memory allocations". Take into account that in a real program you will not run without pymalloc so you will not allocate memory from the system allocator for each Python object. At the same time, memory is getting allocated when arenas are allocated, is just that this happens in a different fashion.
In any case, I do agree that because no report is intrinsically better than the other, it makes sense to expose this flag.
Are you interested on making a PR? Otherwise @gaborbernat. @godlygeek  or myself we can get to this eventually :)


docs: Fix link to TravisCI URL in README.md

What kind of change does this PR introduce?

[ ] bugfix
[ ] feature
[ ] refactoring / style
[ ] build / chore
[x] documentation

Did you add tests for your changes?

[ ] Yes, my code is well tested
[x] Not relevant

If relevant, did you update the documentation?

[ ] Yes, I've updated the documentation
[x] Not relevant

Summary

Current URL to TravisCI doesn't take the user to where they should go.

Does this PR introduce a breaking change?

Nope.
Other information

Already fixed it. Thanks!


Missing "Events" chapter in the latest (2.1.3) documentation

Version
Version 2.1.3
Test Environment
Browser: Firefox, OS: Windows 11
Current Behavior
In the documentation for version 1.11.0, in the "Calendar" section, is present a chapter dedicated to the events exposed by the library. Here an example. Instead, for the version 2.1.3 (latest), in "Calendar Core", the chapter "Events" is missing.
I tried to use the same events from version "1.11.0", like "clickSchedule" or "beforeCreateSchedule" in the "calendar.on()" method, but the events are not triggered. Probably the events name has been changed.
Expected Behavior
Have a list of available events in the documentation for the version 2.1.3.
"Events" in V.1

No "Events in" V.2

Sorry for the inconvinience but Please refer to #1313.

Closing since it's not actually 'missing'.


[FeatureRequest] Implements callbackFormatter

When i request data from some service, this service can return many fields. Some of then i want to show in search results as description field, another times i just want format data before it's showed. So, if CompleterData class is changed to receive some callback function to format this data and place it in description field, it turns this API more flexible.
Tt's the same of "remote-url-response-formatter" In ghiden/angucomplete-alt:
"A function on the scope that will modify raw response from remote API before it is rendered in the drop-down. Useful for adding data that may not be available from the API. The specified function must return the object in the format that angucomplete understands."

@tigredonorte you can create a custom CompleterData for this purpose.

how can i do this?

see in the demo the CompleterData and how to use it


Apim 822 entrypoint permissions

Issue
https://gravitee.atlassian.net/browse/APIM-822
Description
Add @Permissions to v4.
All entrypoint resources controlled by: Scope = organization, rights = read
Additional context

📚  View the storybook of this branch here

🚀 CI was able to deploy the build of this PR, so you can now try it directly here
Notes: The deployed app is linked to the management API of APIM master. (Same login and password as APIM master)

Being authenticated is enough, so we decide to not apply permissions. At least for the moment.


Fix BLE advertisement service data format

Problem
Several components are using an incorrect format for BLE advertisement.

Summary of Changes
The correct format is implemented in ChipBLEDeviceIdentificationInfo.
Update the Linux, ESP32, Android, and Darwin ports to support the
correct format during Rendezvous.
Fixes #3556

The answer seems to be that they are in, but optional and should be specified as zero if omitted. The advertisement length is fixed.

Agreed on 0x0A instead of 0x06 in this case. And I would be fine if you remove the deprecated case in the Darwin BLE connection code.
But can we add a build flag in _GetBLEDeviceIdentificationInfo that defaults to false and that you explicitly need to turn true for adding those productId and vendorId informations to BLE. Otherwise the default will be to include them all the time since productId and vendorId, even if you don't intend to use them for BLE advertisement, will likely be part of the product by default.

Having that be configurable seems fine.

Mind opening a followup to add a build flag that default to false ? r+ with the followup opened.

BTW, a bunch of demos are setting these already. The immediate issue is that various commissioner/commissionee pairs are not compatible.

I did not realised the nrf*/Zephyr platform already does that :(

Not sure if about defaulting to false. Currently 3 platforms include vid/pid (linux, efr32, nordic) and 1 does not (esp32).


Api Pipeline: Failure of a single endpoint (with many connected) doesn't seem to work - investigate.

Check failedEntityHandler (and corresponding reducers) can handle the failing one endpoint with multiple endpoints connected.

Unit tests should be created to cover these cases.

This is fixed


CentOS 6.x compatibility?

I was looking at this issue
https://forums.docker.com/t/libc-incompatibilities-when-will-they-emerge/9895
Will this Dockerfile image run on the glibc 2.12 found in CentOS 6 images?

We hit issues with our early testing on CentOS 6.9, but haven't tested it extensively.
If anyone is hitting issues on CentOS 6.X please let us know!

I have a CentOS 6.10 box but I am unsure of the disk free being sufficient

No worries, let us know how you get on whenever you get around to it.


Set timeout for unifi tracker

Home Assistant release (hass --version):
0.20.2
Python release (python3 --version):
Python 3.4.3
Component/platform:
Unifi tracker
Description of problem:
My unifi app server became unresponsive, and caused HomeAssistant to no longer serve web pages.
Expected:
unifi tracker should have a sane timeout set.
Problem-relevant configuration.yaml entries and steps to reproduce:
  platform: unifi
  host: <redacted>
  port: 8443
  username: <redacted>
  password: <redacted>

unifi host was unresponsive. In my case the disk was RO after a bad vmotion.
rebooted unifi host to get back into RW disk and problem went away

Can you replicate this by turning off the UniFi app server? Or was the RO disk causing connections to hang without failing? If the later this may be tricky to replicate/test.
The python library for unifi doesn't have timeouts in their calls nor constructors. I also not sure what would cause a block on get_clients to block HA's webserver. Can anyone else shed more light here? I am under the impression that updates are called in a separate worker thread.

Has this been resolved?

Is this still relevant @JTurpin?

Closing this issue as it appears to no longer be relevant.


Compatibility with Greenplum 6.0 fix

Hello! Unfortunately, there were changes in Creenplum 6.0 and now DBeaver generates incorrect "distributed by" DDL for this new version of the DB. Can you please improve this? Using the method mentioned in https://github.com/dbeaver/dbeaver/issues/5526 (psql --echo-hidden database_name), you can generate necessary SQL statements for direct selects from the DB. For instance, I received the following statements:
gpadmin@pd-db-1:~$ psql --echo-hidden test
psql (9.4.24)
Type "help" for help.
test=# \d+ test_table
********* QUERY **********
SELECT c.oid,
n.nspname,
c.relname
FROM pg_catalog.pg_class c
LEFT JOIN pg_catalog.pg_namespace n ON n.oid = c.relnamespace
WHERE c.relname OPERATOR(pg_catalog.~) '^(test_table)$'
AND pg_catalog.pg_table_is_visible(c.oid)
ORDER BY 2, 3;

********* QUERY **********
select pg_catalog.version()

********* QUERY **********
select oid from pg_catalog.pg_class where relnamespace = 11 and relname  = 'pg_attribute_encoding'

********* QUERY **********
SELECT c.relchecks, c.relkind, c.relhasindex, c.relhasrules, c.relhastriggers, c.relhasoids, pg_catalog.array_to_string(c.reloptions || array(select 'toast.' || x from pg_catalog.unnest(tc.reloptions) x), ', ')
, c.reltablespace, CASE WHEN c.reloftype = 0 THEN '' ELSE c.reloftype::pg_catalog.regtype::pg_catalog.text END, c.relpersistence, c.relreplident
, c.relstorage as relstorage FROM pg_catalog.pg_class c
LEFT JOIN pg_catalog.pg_class tc ON (c.reltoastrelid = tc.oid)
WHERE c.oid = '16544';

********* QUERY **********
SELECT a.attname,
pg_catalog.format_type(a.atttypid, a.atttypmod),
(SELECT substring(pg_catalog.pg_get_expr(d.adbin, d.adrelid) for 128)
FROM pg_catalog.pg_attrdef d
WHERE d.adrelid = a.attrelid AND d.adnum = a.attnum AND a.atthasdef),
a.attnotnull, a.attnum,
(SELECT c.collname FROM pg_catalog.pg_collation c, pg_catalog.pg_type t
WHERE c.oid = a.attcollation AND t.oid = a.atttypid AND a.attcollation <> t.typcollation) AS attcollation,
NULL AS indexdef,
NULL AS attfdwoptions,
a.attstorage ,
CASE WHEN a.attstattarget=-1 THEN NULL ELSE a.attstattarget END AS attstattarget,
pg_catalog.col_description(a.attrelid, a.attnum)
FROM pg_catalog.pg_attribute a
LEFT OUTER JOIN pg_catalog.pg_attribute_encoding e
ON   e.attrelid = a .attrelid AND e.attnum = a.attnum
WHERE a.attrelid = '16544' AND a.attnum > 0 AND NOT a.attisdropped
ORDER BY a.attnum;

********* QUERY **********
SELECT c2.relname, i.indisprimary, i.indisunique, i.indisclustered, i.indisvalid, pg_catalog.pg_get_indexdef(i.indexrelid, 0, true),
pg_catalog.pg_get_constraintdef(con.oid, true), contype, condeferrable, condeferred, i.indisreplident, c2.reltablespace
FROM pg_catalog.pg_class c, pg_catalog.pg_class c2, pg_catalog.pg_index i
LEFT JOIN pg_catalog.pg_constraint con ON (conrelid = i.indrelid AND conindid = i.indexrelid AND contype IN ('p','u','x'))
WHERE c.oid = '16544' AND c.oid = i.indrelid AND i.indexrelid = c2.oid
ORDER BY i.indisprimary DESC, i.indisunique DESC, c2.relname;

********* QUERY **********
SELECT c.oid::pg_catalog.regclass FROM pg_catalog.pg_class c, pg_catalog.pg_inherits i WHERE c.oid=i.inhparent AND i.inhrelid = '16544' ORDER BY inhseqno;

********* QUERY **********
SELECT c.oid::pg_catalog.regclass FROM pg_catalog.pg_class c, pg_catalog.pg_inherits i WHERE c.oid=i.inhrelid AND i.inhparent = '16544' ORDER BY c.oid::pg_catalog.regclass::pg_catalog.text;

********* QUERY **********
SELECT pg_catalog.pg_get_table_distributedby('16544')

                     Table "public.test_table"

Column  |  Type   | Modifiers | Storage  | Stats target | Description
---------+---------+-----------+----------+--------------+-------------
address | inet    | not null  | main     |              |
rating  | integer | not null  | plain    |              |
info    | text    |           | extended |              |
Indexes:
"test_table_pkey" PRIMARY KEY, btree (address, rating)
Distributed by: (address)

For this table DBeaver incorrectly generates "DISTRIBUTED BY (address, port)". The true value is "DISTRIBUTED BY (address)".

So, to get correct "distributed by" statement, you can simply use the last SQL command:
SELECT pg_catalog.pg_get_table_distributedby('16544');
The result looks like the following:
pg_get_table_distributedby
DISTRIBUTED BY (address)
(1 row)

Unfortunately we don't have GP 6 server to test it. pg_get_table_distributedby is not supported by earlier versions.
Currently we use SELECT attrnums FROM pg_catalog.gp_distribution_policy and list column names after DISTRIBUTED BY CLAUSE (see https://github.com/dbeaver/dbeaver/blob/a11fac61bbb4f291ebb1cdb14500f32b8465157a/plugins/org.jkiss.dbeaver.ext.greenplum/src/org/jkiss/dbeaver/ext/greenplum/model/GreenplumTable.java)

Yes, pg_get_table_distributedby is not supported by Greenplum versions prior to 6.0. But you have to use it for 6.0, because there were changes mentioned here in the official documentation:
https://gpdb.docs.pivotal.io/6-0/install_guide/migrate.html
Here is a quote:
In the gp_distribution_policy system table, the attrnums column is renamed to distkey and its data type is changed to int2vector. A backend function pg_get_table_distributedby() was added to get the distribution policy for a table as a string.

I can test it if you send me a new version of DBeaver.


Cursor placement bug

Hi, I am having issued placing my cursor in desired location within the embedded text editor. I am using google chrome, and the only way this seems to fix itself is if i restart my entire computer. Shutting down browser and reopening does not resolve the issue.
Challenge Create a Text Field has an issue.
User Agent is: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.2924.87 Safari/537.36.
Please describe how to reproduce this issue, and include links to screenshots if possible.
My code:

<link href="https://fonts.googleapis.com/css?family=Lobster" rel="stylesheet" type="text/css">

CatPhotoApp

Click here for cat photos.

Things cats love:

cat nip

laser pointers

lasagna

Top 3 things cats hate:

flea treatment

thunder

other cats

Resetting my code just worked. I will keep you posted on this bug as i progress through the tutorials.

Resetting my code appears to be working, but every time i advance to the next lesson the cursor bug resurfaces.

@Tony-Thomas thanks for the issue. This is unfortunately a known bug https://github.com/freeCodeCamp/freeCodeCamp/issues/7847. Take a look at the thread of comments for some solutions for this bug. So closing as duplicate. Happy coding!


Sync all readme files with update_docs

Ran update_docs.py on the whole directory - we should make sure to keep this in-sync better with each PR ;-)

Closing this PR in favour of https://github.com/explosion/projects/pull/160


please add a "scope" or "limitations" heading

I have been monitoring this capability for some time, but I'm disappointed I can't manage on-premises security groups in this way.  FIM 2010 R2 provided group management in a browser, but it wasn't ideal. I was hoping Azure AD Group Management would let me delegate group management to owners who can manage membership in Azure AD, then write back to on premises Active Directory.  Unfortunately, this isn't possible :-(  I only discovered this by looking at closed issues; if you could set this out explicitly in this feature description, it would be clearer.  Thanks in advance.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 4404d856-2612-f4a2-ed5c-fff65761293a
Version Independent ID: 35b07132-7d8a-2c29-3988-54a2ae8fcc25
Content: Setting up self-service application access management in Azure Active Directory
Content Source: articles/active-directory/users-groups-roles/groups-self-service-management.md
Service: active-directory
GitHub Login: @curtand
Microsoft Alias: curtand

@anwarmahmood1
Thanks for your feedback! We will investigate and update as appropriate.

I am seeing the groups available to join only if its created in the access panel. Once I request joining the group with justification, my request is  being auto approved. I was expecting the owner of the group gets a notification to approve.(I have kept the "Owner can manage the group acess… option to YES").
But for the groups which were created in the AAD Azure Portal its not allowing to join at all from the access panel(https://account.activedirectory.windowsazure.com/r#/joinGroups).
Kindly advise me where would I need to look for resolving this.

I'm seeing the same symptoms. I can either set groups to "auto approve" or there is no option to join the group at all from access panel (https://account.activedirectory.windowsazure.com/r#/joinGroups).
Is there any update on this case?

Hi @anwarmahmood1
I'm following up with the PM again right now.
@sakusuma
@bamekait

@sakusuma
@anwarmahmood1
@bamekait
Hi all. The PR above adds a section on membership defaults that answers this query. It will be live around 4 PM PST today.
@MarileeTurscak-MSFT
#please-close

Can you please post the PR link? .


Injecting dynamic values in code snippet

I have a code snippet displayed with this great code-sample element:
<my-element my-attribute="DEFAULT_VALUE"></my-element>

However, I would like to replace "DEFAULT_VALUE" by a value retrieved dynamically. For example, a value available in an existing Polymer property. I mean something like the following:
<my-element my-attribute="[[myAttributeDefaultValue]]"></my-element>

The purpose is to display a configuration example. Unfortunately, the Polymer expression is not evaluated. Is there a way to achieve that?

Ah, I just saw your "Change content dynamically" on the samples page:
https://kcmr.github.io/code-sample/components/code-sample/demo/


The filter apps are creating zombies.

In the program ppd/ppd-collection.cxx, whenever you call PipeCommand, you should also call wait() or waitpid() so the zombies can be put to rest.
    if ((fp = PipeCommand(&pid, realname, argv, 0)) != NULL)
    {
      if ((fd = cupsTempFd(tempname, sizeof(tempname))) < 0)
      {
        if (log) log(ld, FILTER_LOGLEVEL_ERROR,
                     "libppd: [PPD Collections] Unable to copy PPD to temp "
                     "file: %s",
                     strerror(errno));
        return (NULL);
      }
      while ((bytes = cupsFileRead(fp, buffer, sizeof(buffer))) > 0)
        bytes = write(fd, buffer, bytes);
      cupsFileClose(fp);
      close(fd);
      fp = cupsFileOpen(tempname, "r");
      unlink(tempname);
>>>>>> call wait() here to put the zombie to rest.
    }
    else
    {
      if (log) log(ld, FILTER_LOGLEVEL_WARN,
                   "libppd: [PPD Collections] Unable to execute \"%s\": %s",
                   tempname, strerror(errno));
      return(NULL);
    }

Same for the other place where PipeCommand is called.

Fixed in commit 3260d9a1. Please test
Thank you for the bug report.

Fixed in commit 3260d9a. Please test
Thank you for the bug report.

Perfect.   No zombies when running "ps axf".


Added SSL support to the runserver development server.

The Django admin runserver command now optionally supports SSL. The
server key and certificate files can be specified independently or as a
concatenated certfile. The admin command documentation and test cases
have been updated accordingly.
Some changes were necessary in the django.core.servers.basehttp module.
Specifically SecureWSGIServer and SecureWSGIRequestHandler were added as
SSL-enabled versions of their similarly named parent classes. The run
function needed to be abstracted slightly to support variable server and
handler classes originating in the runserver command itself. Rather
than adding additional parameters for the certfile and keyfile
arguments, the explicit ipv6 parameter was removed in favor of a kwargs
dict to make the run function more generic.
The SecureWSGIServer class deliberately uses an ssl_version of
ssl.PROTOCOL_SSLv23. With the socket thusly wrapped, a more permissive
set of SSL/TLS versions are accepted by the development server. This
flagrantly disregards the security recommendations made in response to
the discovery of the POODLE vulnerability. However, the development
server is not intended for production use, so this not of serious
concern.
Furthermore, the ssl package is imported within the __init__ method of
the SecureWSGIServer so as not to contribute to the overhead of
importing the basehttp module elsewhere.

Hi @sjberry. Thank you for the patch. It seems that you have opened a pull request without an existing ticket. Please follow our feature request process. Thank you.

@MarkusH Sorry about that, new to this. I'll take care of it.

@sjberry Would be possible to access to server with both https and http at the same time without running to runserver ?

@Alir3z4 As far as I can tell this wouldn't be possible with a single runserver command. Please correct me if I'm off base here (anyone). Also forgive the patronization if that is the case, I'm just framing my response so that others might understand your premise and the issues at hand as well.
Let's say you're working with the default port. When you run the runserver command you're instantiating a single django.core.servers.basehttp.WSGIServer that has one exposed socket available in self.socket listening on port 8000. You can access this server/socket over HTTP with a simple request to http://localhost:8000. This is consistent with the behavior found in the default wsgiref.simple_server.WSGIServer inherent to Python (at least it's located there in Python 3).
All this proposed patch does is wrap that single socket in the SSL/TLS protocol. With this as the case, plain HTTP no longer understands how to interact with this socket, thus necessitating HTTPS requests.
What you lack in your desired scenario is a convenient web server layer such as nginx that can expose multiple sockets and listen for traffic in compliance with their corresponding protocols (e.g. 80 for HTTP and 443 for HTTP + SSL/TLS). So I think the behavior you're after, while likely possible, is outside the scope of this change proposal.
There is a current discussion on the Django developers board concerning whether or not this patch is even desirable in the core functionality of Django. One suggestion was to use gunicorn as a replacement for the runserver command if SSL/TLS support was required. This may also address your need to expose more than one socket/port simultaneously.

@apollo13 I wanted to support TLS 1.0+. Unfortunately it didn't appear that that option was supported. I know you're probably trying to catch me being lazy, but trust me, I checked. :)
Here's the Python 2 documentation:
https://docs.python.org/2/library/ssl.html#socket-creation
And the Python 3 documentation:
https://docs.python.org/3/library/ssl.html#socket-creation
Sadly it doesn't even seem possible to only support TLS 1.2. This is likely because a major release hasn't been pushed out since POODLE, before which those best practices weren't taken as seriously.
This also assumes I'm interpreting the SSLv23 constant properly, because it isn't particularly well explained.

@Alir3z4 I was poking around gunicorn and from what I can tell what you're interested in isn't possible with that either. You're stuck with one port per process as far as I can tell. Though I'm obviously not very experienced with gunicorn so take this for what it's worth.

Discussion on the Django developer list concerning this issue is in stasis. I will maintain the corresponding branch should a ticket ever be assigned. For those who are interested, the most fruitful suggestion (in my opinion) was to use gunicorn to serve the WSGI application locally. This may involve making a few changes.
If you modify your path in your manage.py script or passenger_wsgi.py script (if you use Passenger), you'll want to add those path modifications to your wsgi.py script pointed to in your application settings. The resulting wsgi.py script may look like:
import os
import sys

from django.core.wsgi import get_wsgi_application

wd = os.path.dirname(__file__)
lib_path = os.path.join(wd, 'lib')
sys.path.append(os.path.abspath(lib_path))

application = get_wsgi_application()

To make these changes available to your passenger_wsgi.py module and gunicorn you'll want to update passenger_wsgi.py to import application from the wsgi module. As far as I can tell you're still stuck replicating the path changes in manage.py.
In your main urls module you'll want to include the static URLs if you want to serve the static files in development with gunicorn. This is handled automatically by runserver but it is not by the wsgi.application object. Your final urls module may look something like:
from django.conf import settings
from django.conf.urls import include, patterns, url

...

if settings.DEBUG:
    from django.contrib.staticfiles.urls import staticfiles_urlpatterns
    urlpatterns += staticfiles_urlpatterns()

You can install gunicorn to a virtual environment or your root Python installation with:
pip install gunicorn

There are no dependencies, but it only works on *nix systems for the time being.
Then, assuming your application is called "webapp" and you're in the directory where that package would be on the Python path, you can run gunicorn with:
gunicorn webapp.wsgi --env DJANGO_SETTINGS_MODULE=webapp.settings --certfile server.pem --reload

@sjberry Thank for your time to explain it for me.
I asked that question since I use https://github.com/teddziuba/django-sslserver in some projects and having 2 different runserver was annoying.
I see this pull got closed, I wish it could get merged and it would be a real good feature to have.

@Alir3z4 Yeah, same deal here. I agree it was a little annoying, especially having to have sslserver in your installed apps.
Give gunicorn a shot if you're not on Windows. It still has the same request logging as runserver (which as far as I can tell is built into Python WSGI) and seems generally more powerful. Let me know if you run into any issues and if I can be of any more assistance setting it up.

Nice! : )


try to release the lock while shutting down

Hey @yunfangjuan I can't get the signal handler to catch SIGTERM when running within Resque.   Works fine from a Ruby script but not from Resque.   From my reading of the internets, Resque isn't known for correctly propagating signals to workers.
https://stackoverflow.com/questions/15074551/recovering-cleanly-from-resquetermexception-or-sigterm-on-heroku
I am going to try a few more things and then probably just turn off this lock completely and look for some other way to run a daemon.

I am also a bit unclear on how safe it is to simply override the TERM handle in some RAILS source file;   what if that file gets loaded into the running webapp or some other important process?    Normally there would be a chain of handlers, similar to the exit chain in C...  So this really looks like the wrong way to do it, and unfortunately I don't know what the right way is.

This new way of doing it -- rake daemon instead of resque scheduler, and versioned locks for the workers --- seems to work fine in local development.    In order to test more fully on alpha, I've created a branch merging Charlse' changes to the alpha DB with this work:  https://github.com/chanzuckerberg/idseq-web/pull/723

Testing on alpha confirmed this works correctly.   Yay.


feature request: transactions support

I don't know if this project is still alive but transactions would be nice.

Thanks!
for reference: 3224125a45930634bad08d8a0303900a9d2128f7


Added lithuanian language.

Hey,
I am using this package in my personal project. My audience will be Lithuanian, so I've decided to make my translations public.
There is few problems (see comment my comment in test). However other than that should be fine.

Codecov Report

Merging #153 (75da7a8) into next-release (f192e82) will not change coverage.
The diff coverage is n/a.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
@@              Coverage Diff               @@
##           next-release      #153   +/-   ##
==============================================
  Coverage        100.00%   100.00%
==============================================
  Files                 1         1
  Lines               298       298
  Branches             60        60
==============================================
  Hits                298       298

Flag
Coverage Δ

core
100.00% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

Thanks so much for your contribution, @Kudze ! I'm going to get this released ASAP.

@all-contributors please add @Kudze for translation


Use union query for listing relations.

For whatever reason, this is MUCH faster that then regex + join query

Cool! I think it's not weird - union all is way cheaper than a join and can be done in parallel/distributed fashion!
Using lower is a great change too.

@friendofasquid what about using lower in athena__get_columns_in_relation for consistency too? The macro ilike could also be removed after this from the code.

Done. I must admit I have not tested either commit against the your spec, so I wouldn't necessarily merge just yet.

I ran the tests and they aren't passing.
_______________________________________________________________________________ usecase: test_dbt_base _______________________________________________________________________________
Unknown error: Got an unexpected relation type of table for relation view_model, expected view
assert <RelationType.Table: 'table'> == 'view'
  - view
  + table in test index 4 (item_type=relation_types)

I can see the tests run the following SQL:
create or replace view
    dbt_athena_dev_210328102104666104722654.view_model
  as

select * from dbt_athena_dev_210328102104666104722654.base

It does suggest there is something wrong with my logic here, but can't see it. This should very come back as a view in the information_schema.views unless it also comes back in the tables table. I will need to check if views end up in the tables table in addition to the views table.

OK, so the views do show up in views and tables, and I had to change the SQL to account for that.
All good now. All tests pass. No idea if this is any faster now, but probably :)

Hey @friendofasquid, apologies for the slow reply but a big thanks for the contribution. I'm going to run a few benchmarks on your query but I do suspect it will scale better than my previous implementation 👍

So actually I'm pretty sure this is overcooked and you don't need to query the views table at all. Still likely a lot faster than current implementation but could be made better.


Current release seems broken in my DS (DSM 6.1.5-15254)

I uploaded the currently reased mediathek.host file, and when trying do download something (in my case, from ARD), the plugin wasn't trigged.
By doing a tail -f /var/log/messages on my DS, I found out, that the mediathek.host file was extracted by the DS in flat structure and the sub directories utils and mediatheken where empty.
Moving the files to the right place, sorting them into the subdirectory manually, fixed the problem.
Though, I let you know.
Thanks for the great work you did! Very much appreciated!
Manfred

Which version of Download Station are you using?

Closing for no response. If this error still occurs feel free to open a new issue


pass user jacobian to cvode

Hi,
I am looking to implement the required code to pass the rhs jacobian to sundials to avoid expensive finite-difference approximations. According to the example cvde_Roberts_dns.jl, at line 26 (this link) this needs implementing a wrapper from Sundials._DlsMat to Matrix and the user jacobian wrapper.
My strategy for the latter is as follows:
# Type to store user rhs and jacobian, no data are provided,
# as these can be defined using efficient closures in v0.5.
type FunJac{F, J}
    fun::F
    jac::J
end
funjac(f, J) = FunJac(f, J)

function cvodefunjac(t::Float64,
                     x::N_Vector,
                     ẋ::N_Vector,
                     funjac::FunJac)
    funjac.fun(t, convert(Vector, x), convert(Vector, ẋ))
    return CV_SUCCESS
end

function cvodefunjac(N::Clong,
                     t::realtype,
                     x::N_Vector,
                     ẋ::N_Vector,
                     J::DlsMat,
                     userjac::FunJac,
                     tmp1::N_Vector,
                     tmp2::N_Vector,
                     tmp3::N_Vector)
    funjac.jac(t, convert(Matrix, J), convert(Vector, x))
    return CV_SUCCESS
end

i.e. the same FunJac type is used to store the rhs and the jacobian. Appropriate julia callbacks are then defined for the rhs and jacobian using cfunction and dispatch, along the lines of:
fun = cfunction(cvodefunjac,
                Cint,
                (realtype,
                 N_Vector,
                 N_Vector,
                 Ref{typeof(funjac)}))

jac = cfunction(cvodefunjac,
                Cint,
                (Clong,
                 realtype,
                 N_Vector,
                 N_Vector,
                 DlsMat,
                 Ref{typeof(funjac)},
                 N_Vector,
                 N_Vector,
                 N_Vector))

ynv = NVector(copy(x₀))
CVodeInit(mem, fun, 0.0, convert(N_Vector, ynv))
CVodeSetUserData(mem, funjac)
CVDlsSetDenseJacFn(mem, jac)

Now the missing piece is how to define the convert(::Type{Matrix}, J::DlsMat) method called in the jacobian. Any pointers (no pun intended) are welcome. Is the code in cvode_Roberts_dns.jl a valid approach? It looks beyond my CJulia-fu skills...
I am actually writing this as part of a personal package but could contribute it to Sundials if requested.

I think this is something that should be added to the simplified interface, which is being overhauled (see #75). We would love the contribution.

But I need a solution first 😅👍🏻

What exactly is the DlsMat data structure in C?

It is defined in include/sundials/sundials_direct.h (see here)
typedef struct _DlsMat {
  int type;
  long int M;
  long int N;
  long int ldim;
  long int mu;
  long int ml;
  long int s_mu;
  realtype *data;
  long int ldata;
  realtype **cols;
} *DlsMat;

Hi Steven, acroy,
In types_and_consts.jl we have
type _DlsMat
    _type::Cint
    M::Clong
    N::Clong
    ldim::Clong
    mu::Clong
    ml::Clong
    s_mu::Clong
    data::Ptr{realtype}
    ldata::Clong
    cols::Ptr{Ptr{realtype}}
end

typealias DlsMat Ptr{_DlsMat}
```

I think I somewhat figured it out. The convert method is
````julia
function convert(::Type{Matrix}, J::DlsMat)
    _dlsmat = unsafe_load(J)
    # own is false as memory is allocated by sundials
    pointer_to_array(_dlsmat.data, (_dlsmat.M, _dlsmat.N), false)
end

I have tests passing in a custom problem where I provide the rhs and the jacobian. I suspected I could have had troubles with the row/column-order difference between C and julia, but this seems to work.

While C uses row-major ordering, apparently the matrix in DlsMat.data is stored columnwise (according to the docs). So this might indeed have been the problem ...

Not really a problem! Much better 😏

As a step forward I report here @ChrisRackauckas 's hints on solving this:
We need to grab has_jac from DiffEq and use that to define the Jacobian.
The same setup can be done to IDASpilsPrecSolveFn and IDASpilsPrecSetupFn.

Well, @gasagna's solution is great for the simplified interface. The common interface can just check has_jac(f) and if it does, put a closure over f(Val{:jac},t,u,du) and all of the other steps are the same. It looks like @gasagna has a full solution to this, so I'll look into this.
It looks like setting up the preconditioners has the same difficulties, so I think this solution can be applied there as well (for KINSOL, CVODE, and IDA).

The common interface now passes the Jacobian to CVODE. IDA is next and I'll close the issue.

Thanks for your help @gasagna. I was able to use this and now the Jacobians pass to CVODE and IDA on the common interface bindings.


Changed some variable names and such in paste handler. No change in functionality.

Making a new pull request.


DIF10: Add error message for missing Sensor Characteristic Data Type

Is this a new check? Please describe the check and the field.
</DIF/Platform/Instrument/Sensor/Characteristics/DataType>: If sensor characteristic data type is not provided, give users a warning message suggesting that they add one
Describe the checks in steps

Check to see if a sensor characteristic is provided (/DIF/Platform/Instrument/Sensor/Characteristics)
If one is, check to see if a data type is provided
If no data type is provided, output an error message that says "A characteristic data type is missing for the provided characteristic. Please provide a data type for the provided characteristic."

Is there a similar check already implemented? Please list the name of the check
Characteristic Field Dependency Check
Additional context
pyQuARC is already catching it when an sensor characteristic data type is not provided, but no instructions for the user are being output

this was fixed with the feature/ummg_support branch