python312Packages.manimpango: 0.5.0 -> 0.6.0

Automatic update generated by nixpkgs-update tools. This update was made based on information from passthru.updateScript.
meta.description for python312Packages.manimpango is: Binding for Pango
meta.homepage for python312Packages.manimpango is: https://github.com/ManimCommunity/ManimPango
meta.changelog for python312Packages.manimpango is: https://github.com/ManimCommunity/ManimPango/releases/tag/v0.6.0
Updates performed

Ran passthru.UpdateScript

To inspect upstream changes
Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 0.6.0 with grep in /nix/store/6cz4cbap38p39476zhd594hr7smz335l-python3.12-manimpango-0.6.0
found 0.6.0 in filename of file in /nix/store/6cz4cbap38p39476zhd594hr7smz335l-python3.12-manimpango-0.6.0

Rebuild report (if merged into master) (click to expand)

11 total rebuild path(s)

11 package rebuild(s)

First fifty rebuilds by attrpath

emote
manim
manim-slides
python311Packages.manim
python311Packages.manim-slides
python311Packages.manimpango
python312Packages.manim
python312Packages.manim-slides
python312Packages.manimpango
smile

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/6cz4cbap38p39476zhd594hr7smz335l-python3.12-manimpango-0.6.0 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A python312Packages.manimpango https://github.com/r-ryantm/nixpkgs/archive/2140fb6b0144159dac26c46ad5651b258632291c.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/2140fb6b0144159dac26c46ad5651b258632291c#python312Packages.manimpango

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/6cz4cbap38p39476zhd594hr7smz335l-python3.12-manimpango-0.6.0
ls -la /nix/store/6cz4cbap38p39476zhd594hr7smz335l-python3.12-manimpango-0.6.0/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

16 packages built:

emote
manim (python312Packages.manim)
manim-slides
manim-slides.dist
manim.dist (python312Packages.manim.dist)
python311Packages.manim
python311Packages.manim-slides
python311Packages.manim-slides.dist
python311Packages.manim.dist
python311Packages.manimpango
python311Packages.manimpango.dist
python312Packages.manim-slides
python312Packages.manim-slides.dist
python312Packages.manimpango
python312Packages.manimpango.dist
smile

Maintainer pings
cc @emilytrau for testing.

[!TIP]
As a maintainer, if your package is located under pkgs/by-name/*, you can comment @NixOS/nixpkgs-merge-bot merge to automatically merge this update using the nixpkgs-merge-bot.

Add a :+1: reaction to pull requests you find important.

Result of nixpkgs-review pr 341877 at a909e63b run on aarch64-darwin 1

2 packages failed to build:

python311Packages.manimpango
python312Packages.manimpango


Create File Profile

The logs within the network and API category event classes could have enriched file information. Create a file profile and apply to these categories.

Do we want to add this profile to all application category event classes? @pladam @floydtree @pagbabian-splunk @zschmerber @mikeradka


Cannot start plugin: ModuleNotFoundError: No module named 'cellshape_cloud'

Dear all,
I can install the napatrackmate plugin through napari successfully but when I start the plugin I get this error:
\miniconda3\envs\napari\lib\site-packages\vollseg_napari_trackmate\_widget.py in plugin_wrapper_track()
     27 def plugin_wrapper_track():
     28
---> 29     from cellshape_cloud import CloudAutoEncoder
        global cellshape_cloud = undefined
        global CloudAutoEncoder = undefined
     30     from cellshape_cluster import DeepEmbeddedClustering
     31     from napatrackmater import load_json

ModuleNotFoundError: No module named 'cellshape_cloud'

Even if i do pip install cellshape_clould, it throws other errors
Can you please help me?

Yes this is happening because after my PR's that I made to cellshape-helper and cellshape-cloud a new version has not been released on Pypi yet: Request for new release. Till @DeVriesMatt carves a new release you can clone my forks and install them in your virtual environment using pip install -e . My forks are here: cellshape helper and cellshape cloud, after you install these then launching the Napari plugin from the environment would work.

Hi both, I'm sorry about this. I will make a new release asap! There were just some formatting issues that needed fixing.

Hi there, I installed both forks as suggested by @kapoorlab and when trying to open the plugin I had the following error:
~/opt/anaconda3/envs/napari_env/lib/python3.8/site-packages/vollseg_napari_trackmate/_widget.py in plugin_wrapper_track()
     28
     29     from cellshape_cloud import CloudAutoEncoder
---> 30     from cellshape_cluster import DeepEmbeddedClustering
        global cellshape_cluster = undefined
        global DeepEmbeddedClustering = undefined
     31     from napatrackmater import load_json
     32     from napatrackmater.pretrained import (

ModuleNotFoundError: No module named 'cellshape_cluster'

@sebgoti Ah can you please also install this fork of mine and then it will load the missing module: cellshape-cluster kapoorlabs fork

Thanks, I removed the old file that was requiring those as dependencies, I will also update the package from using setup.py to setup.cfg file as we do not use requirements.txt anymore. Another item in the list would be to upload the pytorch models in the format required by this plugin to run, till then you can run the plugin without obtaining the cell shape cluster class plots.


feat: add kotlin sdk

This PR

adds the Kotlin SDK
bumped the SDK READMEs
updates the server-side JS SDKs to use Node.js.

Notes
Similar to the Node.js SDK, I referred to this as the Android SDK since that's how it's intended to be used.
How to test
Review the Netlify preview
Signed-off-by: Michael Beemer<EMAIL_ADDRESS>

Closing in favor of this PR
https://github.com/open-feature/openfeature.dev/pull/261


Refactor KubeVirt tests

What this PR does / why we need it:
Which issue(s) this PR fixes (optional, in fixes #<issue number> format, will close the issue(s) when PR gets merged):
Fixes #
Special notes for your reviewer:
Optional Release Note:

None

/test
pull-machine-controller-e2e-kubevirt

/test pull-machine-controller-e2e-kubevirt


Add Non-blocking Circular Buffer APIs

Current CB usage forces blocking operations on the caller, which somewhat restricts programmability. This issue tracks a feature request to add non-blocking APIs to CBs so that a caller can check CB status (fullness/emptiness). I've marked this as a P2 for the time being although I think this feature will be very useful for CCL performance in the near future (about a month from now)
Proposal
Add check/get functions corresponding to reserve_back/wait_front that allows a user to query these instead. The APIs are nearly identical and just require a wrapper around the internal check portions of each of those functions. Just need 2 functions here:

cb_has_(full)_pages_at_front(cb_id, n_pages);
cb_has_(empty)_pages_at_front(cb_id, n_pages);

or

cb_can_reserve_back(cb_id, n_pages)
cb_can_pop_front(cb_id, n_pages)

I'm not particularly opinionated on the name although the latter are more inline with the existing ones.
The higher priority use case is for data movement kernels but there are also (lower priority) use cases that would call for this API in math kernels.
Use cases
Here are some general use cases that are directly needed by CCLs today:

Allow a reader kernel to implement two (logical) threads of execution where it can keep reading from DRAM any time there is space in the CB, rather than having to wait for data from Erisc before looping back to start. This hides DRAM read latency from the datapath as much as possible - lowers latency.

e.g.
Complexities due to synchronizing different read streams etc omitted
(reader kernel BEFORE - pseudo code)
for t : n_transfers {
    // read from input tensor
    cb_reserve_back(cb_id0, n_pages)
    in_read_addr = get_l1_ptr(cb_id0)
    read_from_tensor(cb_id0, n_pages, addrgen)

    // read from Erisc
    semaphore_wait(edm_signal_addr, 1);
    semaphore_set(edm_signal_addr, 0);
    cb_wait_front(cb_id1, n_pages);
    in2_read_addr = get_l1_ptr(cb_id1);
    noc_async_read(edm_buffer_addr, in2_read_addr, n_pages);
}

(reader kernel AFTER - pseudo code)
in0_transfers = 0
in1_transfers = 0
in0_in_progress = true;
in1_in_progress = true;
while (in0_in_progress || in1_in_progress) {
    if (cb_can_reserve_back(cb_id0, n_pages) {
        // read from input tensor
        cb_reserve_back(cb_id0, n_pages);
        in_read_addr = get_l1_ptr(cb_id0);
        read_from_tensor(cb_id0, n_pages, addrgen);
        in0_transfers++;
        in0_in_progress = in0_transfers == n_transfers;
    }

    if (cb_can_reserve_back(cb_id1, n_pages) && *edm_signal_addr == 1) {

        // read from Erisc
        semaphore_wait(edm_signal_addr, 1);
        semaphore_set(edm_signal_addr, 0);
        cb_wait_front(cb_id1, n_pages);
        in2_read_addr = get_l1_ptr(cb_id1);
        noc_async_read(edm_buffer_addr, in2_read_addr, n_pages);
        in1_transfers++;
        in1_in_progress = in1_transfers == n_transfers;
    }
}

Save kernel args and host code complexity.

A math kernel can conceivably now have a sideband signal sent by a reader kernel that acts as a termination signal. This can save host having to compute (and pass as args) certain values such as total number of tiles/blocks to process.
e.g. math kernel could look like this:
while (*terminate_signal_addr != 0 || cb_can_pop_front(db_id0, n_pages)) {
    if (!cb_can_pop_front(db_id0, n_pages)) {
       continue;
    }
    // Do the math kernel main body for one input
}

The example above is applicable in reduce scatter and likely many datamovement-compute fused ops.

Enable math to service multiple "work streams"
I have use cases where we could benefit if we setup multiple logical pipelines through a math kernel and have the reader kernel asynchronously feed data through two sets of input streams. This can improve worker utilization and core use efficiency, especially in CCL ops.

Marking closed since this has been added to dataflow api


Gitea can't intialize repositories during creation

Issue description
Enabling the Initialize Repository option during repository creation makes it fail with Internal Server Error.
Additionally, the repository creation page doesn't list .gitignore, License and README templates.
Steps to reproduce
Enable services.gitea in NixOS configuration, open Gitea in browser, register a user, go to Create Repository page, enter repository name, check the Initialize Repository checkbox, click Create  Repository, see it fails.
Technical details

system: "x86_64-linux"
host os: Linux 4.14.76, NixOS, 18.09.932.09195057114 (Jellyfish)
multi-user?: yes
sandbox: yes
version: nix-env (Nix) 2.1.1
channels(paul): ""
channels(root): "nixos-18.09.932.09195057114, nixos-unstable-19.03pre155751.45a419ab5a2"
nixpkgs: /nix/var/nix/profiles/per-user/root/channels/nixos

The reason for this is that the gitea package doesn't include templates for README and other initial repository contents. It's easy to fix, I'll submit a PR.

There is a similar upstream issue about the Debian package.


adding more external entry poin please

Is your feature request related to a problem? Please describe.
I'd like to request adding an external entry point:
Describe the solution you'd like
In the Android system, when text is selected various options pop up. If a function like "Send to LocalSend" or even "Send to a specific device" could be added, that would be even more convenient.

Describe alternatives you've considered
No response
Additional context
thanks

Adding some new features here will be better ❤

Hi, LocalSend should show up if you go to the share menu first. Adding LocalSend right into the popup would be better of course.


Widen compats and update dependencies

Crud, we need a ClimaCore release 🤦🏻♂.

This appears to be doing better than what the main branch is doing, so I'm going to go ahead and manually merge.


Build build images at docker hub

So, the images are now built under https://registry.hub.docker.com/u/slavek/atomic-reactor/. I'll try to see what it'd take to build them under projectatomic namespace.

I'm wondering if pushing images to dockerhub will actually benefit anyone. From what I understand, fedora maintains its own buildroot.

This was meant to be for anyone who would like to use this project.

Closing this as there hasn't been any interest in using a container image with just atomic-reactor in docker hub.


✨ Bedrock in Analytical Platform Apps

Describe the feature request.
Raising on behalf of @jtattersall09403
Request for the Prison Data Science team to have access to use the Claude generative AI models in Apps. Ideally Claude Sonnet and Claude Haiki; if that's not possible then the older Claude 2.1 model would be OK.
To meet the requirement 2 in the context section below, we need to be able to provide Bedrock access to three existing apps in production:

safety-diagnostic-tool https://github.com/ministryofjustice/safety-diagnostic-tool
bentham-app https://github.com/ministryofjustice/bentham-app/tree/c313a91cad65b2dd27bdb21c564a38224e14ab49
prison-visitor-app https://github.com/ministryofjustice/prison-visitor-app

Describe the context.
Four current projects, and more in the pipeline. All use sensitive data; CDDO have agreed the use of Bedrock in the EU (Frankfurt & Paris currently, London, Ireland to come) for these purposes, subject to the completion of a DPIA. For all projects, we need to be able to:

Test the capabilities of the different models. We need to be able to answer questions like, 'how good each Claude model at summarising intelligence reports' (or classifying casenotes, or classifying text messages, or allocating a 'reason' tag to incident reports). This would be via jupyter notebooks on the AP, using AP data (e.g. casenotes from the nomis pipeline, or Seized Media Database data from s3).
Run the models for inference in production. If the models meet our evaluation thresholds, we then want to be able to use them in production. In practice, this means things like the below (which are in order of priority):

Calling the models via API from a deployed R Shiny application, hosted on the cloud platform

Project details can be found in the original feature request
Value / Purpose
We have extensively tested methods that are possible using current infrastructure (e.g. huggingface open source models). All methods fall short of what is needed for these projects. Testing on dummy/synthetic data suggests that the Claude models will substantially outperform these simpler alternatives, unlocking a huge amount of value for our frontline users. All four projects (and others like them that we will do in future) will save a huge amount of time for frontline users, meaning they will spend less time on paperwork and more time running our prison system safely and effectively.
User Types
Data scientists in Prison Data Science

Timelines copied from here:

Just to add after our call just now. In priority order, we need to be able to:

Run analysis manually on the AP (e.g. in Jupyterlab) using LLM models hosted in Bedrock. 8th May deadline to enable us to meet our 'mid May' deadline for analysis outputs with customers.
Schedule scripts that call Bedrock LLMs, using Airflow. Would need this by mid June to start implementation.
Call Bedrock LLMs in real time from AP apps deployed on the cloud platform. More flexible on timelines - end of June perhaps? Initially these apps would be:

safety-diagnostic-tool https://github.com/ministryofjustice/safety-diagnostic-tool
bentham-app https://github.com/ministryofjustice/bentham-app/tree/c313a91cad65b2dd27bdb21c564a38224e14ab49
prison-visitor-app https://github.com/ministryofjustice/prison-visitor-app

This looks great, and I would appreciate if some more apps (not yet in CP) could be added. I would appreciate if this feature request could include access to the Titan Text Express model as well, which is the one I am aiming to customise as part of my MSc/Apprenticeship final project. the region for that model should be (at this stage) North Virginia (as it supports customisation). What I envision for my final project is:

A console app which will be used to customise the Titan Text Express model

costs for customising a model/storing the customised model are not very high, and if due to time constraints I cannot prepare the data to customise the model, I can potentially use some 'fake' data from hugging face or something like that, so I can present on the dissertation.
This can potentially be implemented as part of the web API

A web API to access Amazon Bedrock

Due to the costs of inferring from a customised model, I may work with a proof of concept and just infer from the 'normal' model (Titan Text Express)
I will also explore the API and check how to enable/disable programmatically the provisioned throughput, to. keep costs at a minimum, if/when exploring inference from a customised model.

A simple website to interact with the API and as a front-end for users

Please feel free to get back to me with any queries you may have.
thanks!!

Hi team! any news on this? thanks!!

Hey Carlos, we have a draft PR to enable this, which we hope to be ready to test soon. Will keep you updated.


support defining a Random from fork  https://github.com/owiber/faker/…

…commit/aa43c223367140b46b0130f590e2c98750ea5327 and newer master
Added support to customize your own random. Backport from another fork https://github.com/owiber/faker latest commit.

Is there another way to accomplish this goal besides sprinkling Faker::Config throughout the code?  That will be tedious to maintain with future contributions.

Unless you add a test to ensure no entropy is leaked, except from Faker::Config.random, then this will surely become buggy in short order.  Any PR could use rand or sample and kill the whole concept, allowing random numbers to come from other random generators or sources.  See related https://github.com/factory-helper/factory-helper/blob/b96ece91ef1301d27151d461c6e01eca0b151e6d/test/test_determinism.rb#L28-L29

Well, the only way would be alias rand (on Random and Kernel) and Sample (on Array) but not sure that's a good idea either.
I like the idea of test . I will look at how FactoryHelper does it

You don't have to alias rand-- you just have a build failure if they are being called from anywhere

@stympy Not sure there is another way beside wrapping sample and rand . But even so, it would require someone to use wrapping method/alias. Seems FactoryHelper took the same approach and I don t see how else it can be done?
@b264 I looked at the test file.. But there are some area where that fails (things that are marked as protected or private)

The test I linked does not test private methods unless by extention they end up leaking entropy into a public method, which is almost always or always, and if not, it shouldn't matter.  The only thing it may miss is a method_missing call but since the yaml files don't have calls to rand that should be ok as well

@b264  Unfortunely  methods(false) return protected methods.. I believe FactoryHelper also has default value for params passed in many methods. But not all methods have default value /optional params in Faker
See https://github.com/stympy/faker/blob/master/lib/faker/date.rb between and between_except as an example
or the finance.rb, internet.rb have some method with required args..

I tried big stab at fixing the issue. Let me know what you think. But I like the idea of testing all the public method since I caught many remaining issues after pulling from master. That being said, it requires thinking about having default options as well...

Wow, that looks great!  :-) The only suggestion I have is to mention the determinism in the README as some folks can hook this up to their test suite random seed as well, to make the entire build deterministic so intermittent failures can be reproduced

This probably needs a minor version bump

Sure! I can update the README and also I agree about a minor Version bump
For the Base, I would love to figure out a solution. Only thing I can come up with is write a specific test for those methods in that same file to add more specific tests? I ll see what I can do

Just pushed README, Version bump and a test around fetch .

done! Added actually the list of method to start watching for

sounds good . Just added them

Is this looking good now? Would love to get this merge so I can move from my fork back to the released gem :)

@b264 any chance we could get this merged in master or is there anything still missing from this  PR?

I can't merge it -- I can only help.  @stympy can do merges

This is looking good. What if we had a sample class method in Base? Then we could do sample(some_list) rather than some_list.sample(random: ...) through the code.

Ok, I implemented that and merged.  Thanks for the PR!

Is this PR having problem ?
> Faker::Time.between(16.years.ago, 100.years.ago)
NoMethodError: super: no superclass method `between' for Faker::Time:Class

Tests are passing on master, so I'm going to say no, it isn't having a problem. :)


Update README according to new template

This PR aims to update the README according to the new template (https://github.com/neuropoly/axondeepseg/wiki/Template-for-Readme-of-new-models).

Here is the version file for BF:
version_info.zip
This one is a little bit more complicated because the dataset was not annexed at training time, in the README, I put the link on duke (the version file only have the local link I used in rosenberg).


Modify Plant to not take in a token as a parameter

modify plant(address token) to plant()

ltgm


No matching distribution found for cattrs-3.8==0.9.0

According to the package's release history on PyPI, the package cattrs-3.8 doesn't have a 0.9.0 version.
~/Desktop/DeleteFB
venv ❯ pip3 install -r requirements.txt
Requirement already satisfied: attrs==19.1.0 in ./venv/lib/python3.7/site-packages (from -r requirements.txt (line 1)) (19.1.0)
Requirement already satisfied: bitarray==0.9.3 in ./venv/lib/python3.7/site-packages (from -r requirements.txt (line 2)) (0.9.3)
Requirement already satisfied: bleach==3.1.0 in ./venv/lib/python3.7/site-packages (from -r requirements.txt (line 3)) (3.1.0)
ERROR: Could not find a version that satisfies the requirement cattrs-3.8==0.9.0 (from -r requirements.txt (line 4)) (from versions: 0.9.1)
ERROR: No matching distribution found for cattrs-3.8==0.9.0 (from -r requirements.txt (line 4))

For what it's worth, the cattrs-3.8 package was added as a workaround for another bug where cattrs doesn't support Python 3.8. So maybe there's a better solution than using this package.

Yeah I'm pretty sure there are enough other utility tools that will provide the same functionality. Not sure if they won't suffer from a problem similar to the cattrs issue.


Todo: implement detailed step by step deployment instructions for typescript operator example

Work started here: https://github.com/Layr-Labs/hello-world-avs/blob/wf-step-by-step-instructions/README.md#steps-to-deploy
Getting errors in the operator registration function

Similar concerns as here: https://github.com/Layr-Labs/hello-world-avs/issues/35#issuecomment-2252844195

Note - adding "--revert-strings debug" to my forge deploy commands helps provide better detail.


du-dust: 0.8.1 -> 0.8.2

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://github.com/bootandy/dust/releases.
meta.description for du-dust is: "du + rust = dust. Like du but more intuitive"
meta.homepage for du-dust is: "https://github.com/bootandy/dust"
meta.changelog for du-dust is: ""
Updates performed

Rust version update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 0.8.2 with grep in /nix/store/w9w0jmag9s20g1ymxqr9g8xc4lgsabcx-du-dust-0.8.2
found 0.8.2 in filename of file in /nix/store/w9w0jmag9s20g1ymxqr9g8xc4lgsabcx-du-dust-0.8.2

Rebuild report (if merged into master) (click to expand)

1 total rebuild path(s)

1 package rebuild(s)

First fifty rebuilds by attrpath
du-dust

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/w9w0jmag9s20g1ymxqr9g8xc4lgsabcx-du-dust-0.8.2 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A du-dust https://github.com/r-ryantm/nixpkgs/archive/5902c536aa4687bd09439b006fe6975ddc391a94.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/w9w0jmag9s20g1ymxqr9g8xc4lgsabcx-du-dust-0.8.2
ls -la /nix/store/w9w0jmag9s20g1ymxqr9g8xc4lgsabcx-du-dust-0.8.2/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

du-dust

Maintainer pings
cc @infinisil @SuperSandro2000 for testing.

Result of nixpkgs-review pr 188154 run on x86_64-linux 1

1 package built:

du-dust


Add Group Policy Template for Schannel (SSL settings)

Please consider adding Group Policy Template for Schannel (SSL settings)
Here's the github repo
https://github.com/Crosse/SchannelGroupPolicy

Hi Jonathan,
Thanks for the suggestion, but that repository does not have versioning or releases for that matter.
I cannot check for new versions.
Consider using the CustomPolicyStore option if your want to process this template, and update it yourself whenever you find the repo was updated.
Cheers,
Arjan


request to include another web service

This is really helpful, I wanted to bring to the forefront an open source web service that is free and straightforward https://container-hosting.anotherwebservice.com?gh

hey, @jimmyedagawa78 . If it's your service then you should always disclose it in the comments. Also, tracking query strings are not wished here.


Create a file and style it with inline , internal and external css

Hey! I will create a file like that, can you assignee me

Can i use different colors?

@Pranavv213  Can you assign me this issue!

@Pranavv213  assign me this task, I'm a front end developer

@Pranavv213 Can you assign me this issue?

@Pranavv213 I will do it. assign me.


Bug in absolute import handling in python 2.7

I think this is the same issue: https://grokbase.com/t/gg/cython-users/1417hszq2d/pxd-import-problem-when-modules-added-to-package
I have code in a .pyx file in my package PDSim (https://github.com/ibell/pdsim) that reads:
from PDSim.flow cimport flow_models

which yields the error (though somehow not terminal):
PDSim/scroll/_scroll.pyx: cannot find cimported module 'PDSim.flow'

in which the folder flow in my package has the contents:
>> ls -l
-rw-rw-r-- 1 ian ian  2216 Dec 19  2017 fanno.pyx
-rw-rw-r-- 1 ian ian  1933 Dec 19  2017 flow_models.pxd
-rw-rw-r-- 1 ian ian 24767 Sep 30 18:32 flow_models.pyx
-rw-rw-r-- 1 ian ian  2407 Dec 19  2017 flow.pxd
-rw-rw-r-- 1 ian ian 13527 Dec 19  2017 flow.pyx
-rw-rw-r-- 1 ian ian     0 Dec 19  2017 __init__.py

Why does it not find this module?

I can "fix" the issue with the replacement of
from PDSim.flow cimport flow_models

by
cimport PDSim.flow.flow_models as flow_models

which is pretty verbose, and smells like a bug.  The parallel python import is
from PDSim.flow import flow_models

which works fine.

This case might need special-casing in the path search. I guess it tries to look for a cimportable PDSim.flow package, which would succeed if there was a PDSim/flow/__init__.pxd file, but ignores the __init__.py file as something non-cimportable. Instead, it should look for it, and continue the name list search only for name.pxd files.

From what we could figure out the problem stems from the cimported_files-method in Dependencies.py, when pxd_file is None:
    def cimported_files(self, filename):
        ...
            pxd_file = self.find_pxd(module, filename)
            if pxd_file is not None:
                pxd_list.append(pxd_file)
            elif not self.quiet:
                print("%s: cannot find cimported module '%s'" % (filename, module))

This seems to be ultimately due to search_include_directories-function in Utils.py, which doesn't cover all the cases of package/module-discovery, which are:

pkg/a.pxd where b is definied in the a.pxd
pkg/a/__init__.pxd where b is definied in the __init__.pxd
pkg/a/b.pxd and pkg/a/__init__.[pxd|py|pyx]

The self.cimports(filename) call returns an "incomplete" list of possible dependencies to include.
i.e. in case of from pkg.a cimport b it would only return pkg.a, which would miss the aforementioned case 3 (package structure of pkg/a/b.pxd together with pkg/a/__init__.[pxd|py|pyx])


Add volume mounting to podman play kube

Before, podman play kube ignored HostPath and VolumeMounts fields in a k8s yaml file. Add this functionality, allowing for a user to create a volume mount from a .yaml file
Signed-off-by: Peter Hunt<EMAIL_ADDRESS>

fixes #2536

I also want to add the other direction in generate kube, but I'm having some trouble differentiating default mounts to ones the user added (e.g. /etc/hosts vs '...-v <HOST_MNT>:<CTR_MNT>')

Hold the latter part until my volume refactor is finished - that will make it clear what named volumes were in use

@mheon ah perfect SGTM

@mheon @rhatdan @TomSweeneyRedHat @baude PTAL

/approve

LGTM

/lgtm


Add fp-ts as peer dependency

This PR

adds fp-ts as peer dep
adds latest fp-ts as dev dep

Thanks @mstn


Initialize All Tables

Ensure all the tables are created, to support client usages & joins, which expect the tables to exist even if empty.

Approved, but it would be nice to include test coverage for this and anything else here you're willing to do.

Let me punt on the testing here as this whole piece might be changing soon.  Thanks!


pvsystem.retrieve_sam('cecmod') missing missing am_coeff values for Canadian_Solar_CS5P_220M

I'm trying to use the forecast_to_power.ipynb notebook, but I get an error on the effective_irradiance = pvsystem.sapm_effective_irradiance(poa_irrad.poa_direct, poa_irrad.poa_diffuse, airmass, aoi, sandia_module) function call for this module because there aren't any values for A1, A2, A3, A4, etc.
Can this be fixed quickly?  This seems to be the case for many different modules.
pvlib usage questions can be asked on Stack Overflow and tagged with the pvlib tag.
The pvlib-python google group is used for discussing various topics of interest to the pvlib-python community. We also make new version announcements on the google group.

You cannot use the "cec" modules with the "sapm" functions. Please search the Google group and stack overflow for several related discussions.

You cannot use the "cec" modules with the "sapm" functions. Please search the Google group and stack overflow for several related discussions.


Issues creating a Bluesky post

Hey Jeff! I reached out on Bluesky about this but I'm trying to get things setup with your module. I am having trouble getting the create post function to work for me however.
I'm able to from Get-BskyProfile, Get-BskyFollowers, etc. without an issue.

You need to specify the credential when you post, unless you set a PSDefaultParameterValue. Try again and include the -Credential parameter.

I see that now. You can run Get-BskyProfile and it returns your profile using the Credential stored in $PSDefaultParameterValues. That tells us the credential is good and configured properly. Can you run any of the other Get commands in the module?

Let's confirm that you are running on a Windows platform.

Ok. That's a good sign. I don't think the Mac should make a difference,  but now I know I should at least test from Linux. Let's see if the information stream gives us any more data.  Re-run the post command and add -InformationVariable iv
Assuming the command fails, run $iv.messagedata | format-list and paste the results.

PS /Users/matthew/Documents/Scripting> $iv.MessageData | Format-List
{
"record": {
"$type": "app.bsky.feed.post",
"text": "Test posting to Bluesky via PSBluesky module from VSCode",
"createdAt": "2024-11-11T15:08:32.7856370-06:00"
},
"collection": "app.bsky.feed.post",
"repo": "matthewrstreeter.com"
}

That is what I would expect to see up until the error. I'm assuming the repo value matches your credential username including casing.
The error message sounds like a DNS-type problem, but that doesn't make sense since the other commands work. I am puzzled and don't have an immediate solution. I'll have to think about how else to troubleshoot.

Yes very odd but I was wondering if it might be DNS. My account is only a few days old.
Would using my non custom domain Bluesky username be something to try potentially?

I'm using a custom domain name without issue. I was able to post from Linux. You've posted content so that shouldn't be an issue. Let's try another approach.
#use whatever variable name you are using for the credential object.
$repo = $cred.UserName
$pw = $cred.GetNetworkCredential().Password
$PDSHOST = 'https://bsky.social'
$headers = @{
    'Content-Type' = 'application/json'
}
$body = @{
    'identifier' = $user
    'password'   = $pw
} | ConvertTo-Json

$s = Invoke-RestMethod -Uri "$PDSHOST/xrpc/com.atproto.server.createSession" -Method Post -Headers $headers -Body $body
$token = $s.accessJwt
$headers = @{
    'Authorization' = "Bearer $token"
    'Content-Type'  = 'application/json'
}
$url = "$PDSHost/xrpc/com.atproto.repo.listRecords?repo=$repo&collection=app.bsky.feed.post&limit=5"
$r = Invoke-RestMethod -Uri $url -Method Get -Headers $headers

#this should return the last 5 posts
$r.records.value

Maybe this will validate the repo name.

I don't think you finished setting up the verification for your custom name. https://bsky-debug.app/handle?handle=%40matthewrstreeter.com

Never mind.

Also run: (get-bskysession).diddoc and let's see what you get. It should look like
@context           : {https://www.w3.org/ns/did/v1, https://w3id.org/security/multikey/v1,
                     https://w3id.org/security/suites/secp256k1-2019/v1}
id                 : did:plc:ohgsqpfsbocaaxusxqlgfvd7
alsoKnownAs        : {at://jdhitsolutions.com}
verificationMethod : {@{id=did:plc:ohgsqpfsbocaaxusxqlgfvd7#atproto; type=Multikey;
                     controller=did:plc:ohgsqpfsbocaaxusxqlgfvd7;
                     publicKeyMultibase=zQ3sheWesAS13yhm6HYUwLqhZoBLHfWuT721feVqbVFR3w7hP}}
service            : {@{id=#atproto_pds; type=AtprotoPersonalDataServer;
                     serviceEndpoint=https://amanita.us-east.host.bsky.network}}

I'm back at my desk now. I'll give the code block a shot in a moment.
Here is the (Get-BskySession).diddoc output:
`PS /Users/matthew/Documents/Scripting> (Get-BskySession).diddoc
@context           : {https://www.w3.org/ns/did/v1, https://w3id.org/security/multikey/v1,
https://w3id.org/security/suites/secp256k1-2019/v1}
id                 : did:plc:6sa7bzdm7behw6k45oaprg7f
alsoKnownAs        : {at://matthewrstreeter.com}
verificationMethod : {@{id=did:plc:6sa7bzdm7behw6k45oaprg7f#atproto; type=Multikey;
controller=did:plc:6sa7bzdm7behw6k45oaprg7f;
publicKeyMultibase=zQ3shkW3pzC8TyxNmCeror2d4PCrx3bA6vcJiH9jz3ykf93vq}}
service            : {@{id=#atproto_pds; type=AtprotoPersonalDataServer;
serviceEndpoint=https://velvetfoot.us-east.host.bsky.network}}`

The session looks right, which shouldn't be a surprise since most of the module commands work.

A Bluesky user confirmed no problems using a Mac so the issue is something about your account.  I think this means creating the credential with your pre-custom name. First, try to get your profile with the old name. I'm not sure it will work.

I think I did things as instructed here. I stored my Bsky pass in a variable.

That's the same problem. The repo is your username, which is getting pulled from the credential. I don't understand why the repo endpoint can't find the name.

My non-custom domain profile url still loads
Unfortunately no luck getting authenticated unless I did something wrong in my quick attempt.

I stripped everything down to the bare essentials in this script file.
Param(
    [PSCredential]$Credential
)

$message = "This is a debug test Bluesky message sent from VSCode."

$user = $credential.UserName
$pw = $credential.GetNetworkCredential().Password
$PDSHOST = 'https://bsky.social'

#create a session
$headers = @{'Content-Type' = 'application/json'}
$body = @{
    'identifier' = $user
    'password'   = $pw
} | ConvertTo-Json

$s = Invoke-RestMethod -Uri "$PDSHOST/xrpc/com.atproto.server.createSession" -Method Post -Headers $headers -Body $body
$headers.Add('Authorization', "Bearer $($s.accessJwt)")

$apiUrl = "$PDSHOST/xrpc/com.atproto.repo.createRecord"
$record = [ordered]@{
    '$type'   = 'app.bsky.feed.post'
    text      = $Message
    createdAt = (Get-Date -Format 'o')
}
$body = @{
    repo       = $Credential.UserName
    collection = 'app.bsky.feed.post'
    record     = $record
} | ConvertTo-Json -Depth 7

Invoke-RestMethod -Uri $apiUrl -Method Post -Headers $headers -Body $body -Verbose

Save this as a .ps1 file. Then run script-fullname.ps1 $YourCredential and see if it runs without errors. It just worked for me in VSCode.  Is your credential user name matthewrstreeter or matthewrstreeter.com?

Tried from my Windows machine with the same results bummer!

I posted before seeing your recent post. I'll give that a try.
Store credential in SecretManagement
$username = 'matthewrstreeter.com'

That is what I would expect and since the other commands work, I didn't think that should be a problem.

I initially had the same issue.

My login account is<EMAIL_ADDRESS>My handle is @thedavecarroll.com

actually dropping the @ worked.

Running 7.4.6 on MacOS 14.7.1.
Instead of using the email account I use to login to Bluesky, I used my did and that worked, as did my domain name.
I can run more commands later tonight if needed.
Might be worth mentioning that an entity could use subdomains die multiple people using the .well-known non-DNS method as mentioned in How can I set and manage multiple subdomain handles?.

Just tried this from my Windows system

@thedavecarroll  When you define your credential for use with this module, what do you set for the username?

I used:

<EMAIL_ADDRESS>
failed
my login

@thedavecarroll.com

failed

did:plc:rlwd5iajr3btl5e7gyvfwk67

succeeded

thedavecarroll.com

succeeded

This helped me.
https://bsky-debug.app/handle

I tried the did:xyzabc value for the repo and that was the trick (at least from my Windows machine so far)

@thedavecarroll thanks for posting that the DID value worked for you.

I created a new Bluesky test account without a custom domain (matthew-test.bsky.social).
I saw the same error posting to that on my Mac system but I had success posting on my Windows system.

I think we've narrowed down the problem is OS-related. The module works fine on Windows. And it mostly works on a Mac except for posting a message. This is going to take some external research.

Does the Mac do any sort of proxy filtering?

It’s actually a brand new Mac Mini (yay me haha). Nothing customized for network or routing on this system either.
I can try from my work Mac too just to see if  the results are the same.
Matthew Streeter
Associate Manager, Enterprise Identity
Office:<PHONE_NUMBER>
Mobile:<PHONE_NUMBER>
IT Service Desk:<PHONE_NUMBER> | ticket.powerschool.com
PowerSchool
Field Kansas | Central Time Zone

From: Jeff Hicks @.>
Sent: Thursday, November 14, 2024 8:49:07 AM
To: jdhitsolutions/PSBluesky @.>
Cc: Matthew Streeter @.>; Manual @.>
Subject: Re: [jdhitsolutions/PSBluesky] Issues creating a Bluesky post (Issue #15)
EXTERNAL

I can see your test profile.
image.png (view on web)https://github.com/user-attachments/assets/84866080-337b-40eb-aa6c-9bb76ad3ac37
And search for it in the browser
image.png (view on web)https://github.com/user-attachments/assets/cf47550d-7633-4237-8747-31c7190c7982
Which indicates there is nothing wrong with the account itself. Only when the Mac attempts to resolve and validate the account name.
—
Reply to this email directly, view it on GitHubhttps://github.com/jdhitsolutions/PSBluesky/issues/15#issuecomment-2476550060, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BDAUCU6FUDLGOJMNBQJB2V32ASZ6HAVCNFSM6AAAAABRSSWZVCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINZWGU2TAMBWGA.
You are receiving this because you are subscribed to this thread.Message ID: @.***>

Well... I was just successful posting from my work Mac. I'm wondering if the install of the module on my personal Mac went wonky or I happened to mess that up.

Curious. I'm assuming the same version of PowerShell is installed on both.  Was your work Mac on the same network as the Mac Mini?  I can't imagine what you would have messed up installing the module.

That is odd and frustrating because we're running out of things to test. I'm assuming PowerShell commands and other modules work just fine on the mini.

Can you do any type of network capture like Wireshark to compare the New-BskyPost on each system?

I can post to my test account from my Mac Mini actually. It seems to be specific to my username as I cannot seem to use the New-BskyPost cmdlet for my 'matthewrstreeter.com' handle but I can post to my 'matthew-test.bsky.social' handle from any of my Macs.
Nothing on the Mac Mini for VPN or Private Relay either. Just rebooted too just be sure there 😄

From my Mac Mini trying to post to my test account first and then my primary account.

I'm curious if the debug web page shows different results. I'm expecting if you open https://bsky-debug.app/handle?handle=matthew-test.bsky.social in a browser on both systems that they will show the same thing.  Is the same true when opening https://bsky-debug.app/handle?handle=matthewrstreeter.com ?

Yessir. Both links output the same results on both Macs.
Mac Mini

MacBook Pro

Here's another test script.
Param(
    [PSCredential]$Credential,
    [string]$Repo = "jdhitsolutions.com"
)
$user = $credential.UserName
$pw = $credential.GetNetworkCredential().Password
$PDSHOST = 'https://bsky.social'

#create a session
$headers = @{'Content-Type' = 'application/json' }
$body = @{
    'identifier' = $user
    'password'   = $pw
} | ConvertTo-Json

$s = Invoke-RestMethod -Uri "$PDSHOST/xrpc/com.atproto.server.createSession" -Method Post -Headers $headers -Body $body
$headers.Add('Authorization', "Bearer $($s.accessJwt)")

$apiUrl = "https://bsky.social/xrpc/com.atproto.repo.listRecords?repo=$repo&collection=app.bsky.feed.post&limit=5"

$splat = @{
    Uri                     = $apiUrl
    Method                  = 'Get'
    Headers                 = $headers
    ErrorAction             = 'Stop'
    OutVariable             = 'global:ov'
    ResponseHeadersVariable = 'global:rh'
    Verbose                 = $true
}

$r = Invoke-RestMethod @splat
$r.records.value | Select CreatedAt,Text

If I use your test name, this works as expected.

But it fails with your other account name.

However, I can get your DiD ( did:plc:6sa7bzdm7behw6k45oaprg7f) from your profile, and that WILL work.

There is something about the com.atproto.repo endpoint that can't resolve matthewrstreeter.

Try my test repo list script on both systems testing both account names and the DID of your DNS account and see if you get the same results I do.

I'm getting some guidance from the Bluesky developer's Discord. I may need to revise my code to use the DiD instead of an account handle.

Holding off on any more testing until Bluesky's network issues are resolved.

Did I break everything haha 😆 /s

I made a major change to the posting command in the latest version. Update to v1.3.0 and let's see if this makes a difference.

Success!

Excellent. It appears some API endpoints don't work well with handles so I revised commands to use the accounts DID where it was supported.


DebugExchange's usage of Logger is a bit counterintuitive

Default instance (defaults to debug = True) of DebugExchange will use Logger#debug. Yet, default SwiftGraphQLClient.Client's configuration initializes logger with logLevel that does not include debug. This means that just adding DebugExchange to the list of client's exchanges will not enable logs from that exchange. This is a bit confusing.
Right now, in addition to having DebugExchange, I needed to do something like this:
var config = SwiftGraphQLClient.ClientConfiguration()
config.logger.logLevel = .debug

SwiftGraphQLClient.Client(
  request: request,
  exchanges: exchanges,
  config: config
)

Great catch, thanks!
Do you by chance have a minute to also prepare a PR for it? I'd be more than happy to immediately merge it in 😄


Bundled code includes eval(), requiring a relaxed CSP

Operating System: OSX
Node Version: 8.11.3
NPM Version<EMAIL_ADDRESS>webpack Version: 4.9.2
webpack-hot-client Version: 4.1.1

Expected Behavior
Webpack hot client should be able to work without requiring an 'unsafe-eval' CSP.
Actual Behavior
I think that requiring the "dist" version of loglevelnext like this results in bundling code with eval()'d modules:
https://github.com/webpack-contrib/webpack-hot-client/blob/0ac06733c7eafdd8f1a89dea2c2df9000de9a70b/lib/client/log.js#L2
Snippet from the resulting bundle:
/***/ "./lib/LogLevel.js":
/*!*************************!*\
  !*** ./lib/LogLevel.js ***!
  \*************************/
/*! no static exports found */
/***/ (function(module, exports, __webpack_require__) {

"use strict";
eval("\n/* global window: true */\n\nfunction _classCallCheck(instance, Constructor) { if (!(instance instanceof Constructor)) { throw new TypeError(\"Cannot call a class as a function\"); } }\n\nfunction _defineProperties(target, props) { for (var i = 0; i < props.length; i++) { var descriptor = props[i]; descriptor.enumerable = descriptor.enumerable || false; descriptor.configurable = true; if (\"value\" in descriptor) descriptor.writable = true; Object.defineProperty(target, descriptor.key, descriptor); } }\n\nfunction _createClass(Constructor, protoProps, staticProps) { if (protoProps) _defineProperties(Constructor.prototype, protoProps); if (staticProps) _defineProperties(Constructor, staticProps); return Constructor; }\n\nvar PrefixFactory = __webpack_require__(/*! ../factory/PrefixFactory */ \"./factory/PrefixFactory.js\");\n\nvar MethodFactory = __webpack_require__(/*! ./MethodFactory */ \"./lib/MethodFactory.js\");\n\nvar defaults = {\n  factory: null,\n  level: 'warn',\n  name: +new Date(),\n  prefix: null\n};\n\nmodule.exports =\n/*#__PURE__*/\nfunction () {\n  function LogLevel(options) {\n    _classCallCheck(this, LogLevel);\n\n    // implement for some _very_ loose type checking. avoids getting into a\n    // circular require between MethodFactory and LogLevel\n    this.type = 'LogLevel';\n    this.options = Object.assign({}, defaults, options);\n    this.methodFactory = options.factory;\n\n    if (!this.methodFactory) {\n      var factory = options.prefix ? new PrefixFactory(this, options.prefix) : new MethodFactory(this);\n      this.methodFactory = factory;\n    }\n\n    if (!this.methodFactory.logger) {\n      this.methodFactory.logger = this;\n    }\n\n    this.name = options.name || '<unknown>'; // this.level is a setter, do this after setting up the factory\n\n    this.level = this.options.level;\n  }\n\n  _createClass(LogLevel, [{\n    key: \"disable\",\n    value: function disable() {\n      this.level = this.levels.SILENT;\n    }\n  }, {\n    key: \"enable\",\n    value: function enable() {\n      this.level = this.levels.TRACE;\n    }\n  }, {\n    key: \"factory\",\n    get: function get() {\n      return this.methodFactory;\n    },\n    set: function set(factory) {\n      factory.logger = this;\n      this.methodFactory = factory;\n      this.methodFactory.replaceMethods(this.level);\n    }\n  }, {\n    key: \"level\",\n    get: function get() {\n      return this.currentLevel;\n    },\n    set: function set(logLevel) {\n      var level = this.methodFactory.distillLevel(logLevel);\n\n      if (level == null) {\n        throw new Error(\"loglevelnext: setLevel() called with invalid level: \".concat(logLevel));\n      }\n\n      this.currentLevel = level;\n      this.methodFactory.replaceMethods(level);\n\n      if (typeof console === 'undefined' && level < this.levels.SILENT) {\n        // eslint-disable-next-line no-console\n        console.warn('loglevelnext: console is undefined. The log will produce no output.');\n      }\n    }\n  }, {\n    key: \"levels\",\n    get: function get() {\n      // eslint-disable-line class-methods-use-this\n      return this.methodFactory.levels;\n    }\n  }]);\n\n  return LogLevel;\n}();\n\n//# sourceURL=webpack://log/./lib/LogLevel.js?");

/***/ }),

I'm not sure off the top of my head why the dist specifically is being require'd instead of require("loglevelnext") (which I don't think would have this problem).
I know it's probably a little unusual to set a CSP like this in development, but it reflects the way that the code is run in production.
How Do We Reproduce?
Set a CSP that prohibits 'unsafe-eval'.

There's https://github.com/webpack-contrib/webpack-log which might just supersede the direct use of loglevelnext in this project regardless.

Friendly ping -- is this something you'd be open to a PR for?


PROPOSAL - add option to complete and publish standup publicly to channel immediately - one step

Is your feature request related to a problem? Please describe.
it appears user needs to complete standup and then
post standup publicly
Describe the solution you'd like
One step process where user completes and can publish standup (publicly) in one step.
Describe alternatives you've considered
Step 1) issue command /standup
Step 2) complete standup
Step 3) issue command ) /standup report public

it appears user needs to complete standup and then
post standup publicly

You need to do this only if the standup was submitted after the standup window closed. Any standup submitted before the window end time is part of the automatic report. Is this what's happening in your case?

Thank you @harshilsharma63. I didn't realize there was an automatic publish within the window. Regardless, I will train staff to use the two commands if outside the window.
Thanks for all you do on this project.

@eyebank Yes, you'll need t manually publish the report only if you want it before or after the window close time.
Glad it worked out!


Simplify error handlers

Change description
Few things that changed for the 404 error handler:

Change create_app to use utility_processor for injecting service_title - now it only gets executed if invoked, rather than every request.
Change base.py to default to static title if is_error exists and is True
Simplify the 404 error_handler to prevent potential error cascades

Things that changed for the 401 error handler:

Deleted all the logic from the error handler. It was passing data to the 500.html and not doing anything with it.

How to test
Are tests passing?

Squeezed in the 401 error handler simplification in this PR.

shall re-review tomorrow (nudge me if i forget - cheers)


Update various Go dependencies. [phab:D2182]

Created by fromberger at 2018-02-11 23:34:33:

Drop unused gogo protobuf reference from the WORKSPACE.


To prevent access if the user is not authenticated

Fixed bug: check user permissions to prevent access if the user is not authenticated

Purpose
Fixed bug.
To prevent access if the user is not authenticated.
Changes
Add permission definition permission_required = 'osf.view_osfuser', and add PermissionRequiredMixin to the inherited class list of the following View classes.

UserEmailsFormView
UserEmailsSearchList
UserEmailsView
UserPrimaryEmail

QA Notes

No data migration

Documentation

Side Effects

Ticket

User who is_staff == True and is_admin == False can not use this feature.
I expect them to use this feature.

Sorry and thank you.
It's alright.


1639 upgrade to polkadot release v100

Goal
The goal of this PR is upgrade to Polkadot v1.0.0
References
https://forum.polkadot.network/t/polkadot-release-analysis-v1-0-0/3585
https://github.com/paritytech/polkadot/releases/tag/v1.0.0
https://github.com/paritytech/substrate/compare/polkadot-v0.9.43...polkadot-v1.0.0#diff-e5be9978262555d1f400caa5ae803ffc96be0ba25fd4ed8bd917c12529474c44R105
Closes #1639
Closes #1605
Discussion
See original issue.
Checklist

[x] Chain spec updated
[ ] Custom RPC OR Runtime API added/changed? Updated js/api-augment.
[ ] Design doc(s) updated
[ ] Tests added
[ ] Benchmarks added
[ ] Weights updated

lgtm, but I won't approve just yet so others have time to review; also, I maybe don't have as much context for some of the changes. lmk if this hangs out & you need an approval, though.
Also, thank you Rust for making it so we need 2 different toolchain versions 😐


[C++][Parquet] Link dynamically to libarrow in toolchain build, set LD_LIBRARY_PATH

Reporter: Wes McKinney / @wesm
Assignee: Wes McKinney](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=wesm) / @wesm
Note: This issue was originally created as PARQUET-989. Please see the migration documentation for further details.

Wes McKinney / @wesm:
PR: https://github.com/apache/parquet-cpp/pull/331

Wes McKinney / @wesm:
Issue resolved by pull request 331
https://github.com/apache/parquet-cpp/pull/331


jdk_math_jre tests fail on win32 openjdk8-openj9

jdk_math_jre tests are failing on win32 openjdk8-openj9 builds with the following message:
03:56:03  Error: JDK not found: C:\Users\jenkins\workspace\openjdk8_j9_openjdktest_x86-32_windows\openjdkbinary\j2re-image

e.g. https://ci.adoptopenjdk.net/job/openjdk8_j9_openjdktest_x86-32_windows/232/console.
Only affecting win32 openjdk8-openj9 builds, not other platforms and not win32 openjdk8-hotspot builds

Job was configured as running against nightly sdk, which doesn't have jre jdk. Updated configuration.
Looks good. https://ci.adoptopenjdk.net/job/openjdk8_j9_openjdktest_x86-32_windows/238/console
Job failure status is due to jenkins issue.


Remove APIBridge

Need to remove the legacy APIBridge and all of the references to it in the tools.

The APIBridge has been removed from the Game Creator source code.


Business profile links are easily broken

Describe the bug
Adding a website link to a business profile often creates an invalid URL.
To reproduce
Steps to reproduce the behavior:

Sign up for a new account
Visit /businesses/new
Fill out the form
Set https://example.com as the Website field
Visit your profile
Click your company name

Expected behavior
You navigate to https://example.com.
Actual behavior
You are navigated to https://https://example.com
Additional context
We handle this type of normalizing in the developer profile. Logic from there can be extracted or copied over to handle this issue.

Hi @joemasilotti, I would love to help with this. 🙂

Thanks! All yours.

Closed via #577.


Unused warn in third_party/benchmark/src/complexity.cc

I tried to build the source shortly after i clone the repo:
[ 71%] Building CXX object third_party/benchmark/src/CMakeFiles/benchmark.dir/complexity.cc.o
leveldb/third_party/benchmark/src/complexity.cc:85:10: error: variable 'sigma_gn' set but not used [-Werror,-Wunused-but-set-variable]
  double sigma_gn = 0.0;
         ^
1 error generated.
make[2]: *** [third_party/benchmark/src/CMakeFiles/benchmark.dir/complexity.cc.o] Error 1
make[1]: *** [third_party/benchmark/src/CMakeFiles/benchmark.dir/all] Error 2
make: *** [all] Error 2

It seems that the sigma_gn did not get used at any place.
And the solution is to simply remove this two lines:
LeastSq MinimalLeastSq(const std::vector<int64_t>& n,
                       const std::vector<double>& time,
                       BigOFunc* fitting_curve) {
-  double sigma_gn = 0.0;
+ //  double sigma_gn = 0.0;
  double sigma_gn_squared = 0.0;
  double sigma_time = 0.0;
  double sigma_time_gn = 0.0;

  // Calculate least square fitting parameter
  for (size_t i = 0; i < n.size(); ++i) {
    double gn_i = fitting_curve(n[i]);
-     sigma_gn += gn_i;
+ //    sigma_gn += gn_i;
    sigma_gn_squared += gn_i * gn_i;
    sigma_time += time[i];
    sigma_time_gn += time[i] * gn_i;
  }

I have the commit ready. Can anyone assist me in generating the PR.
I am recieving the error:
`git push -u origin kv_warning_fix
remote: Permission to google/benchmark.git denied to krishnacx.
fatal: unable to access 'https://github.com/google/benchmark/': The requested URL returned error: 403
`

This is because the benchmark under the third_party dir is managed by git-submodule, and its source code is locked by the git commit id benchmark @7d0d906.
I think we have to first take a PR based on benchmark @7d0d906, then update the submodule's version. 😢

THis looks like a generic code copy-pasted for computing Khi2 or other variance-mean fitting metrics. But given this function, that sum is not needed. If there's a need of additional metrics, such sums should be computed on demand and cached with some hash  or timestamp indicating when it needs to be refreshed (to avoid repeating this summation loop if that function is used repeatedly to get multiple benchmark metrics). However as this function is specific to benchmarks, it has no impact on the normal use of leveldb at runtime. Such warning emitted by the compiler is harmless and should not be treated as an error blocking benchmarks to be performed, when it also does not impact at all the measurements already registered made on the normal API (that function is just to render the results of these benchmarks).


⚠ GitLab Server has degraded performance

In 4e6360d, GitLab Server (https://gitlab01.its-telekom.eu) experienced degraded performance:

HTTP code: 200
Response time: 6536 ms

Resolved: GitLab Server performance has improved in 1ecded7.


Convert src/routers to TS

Is your feature request related to a problem? Please describe.
Convert src/routers to TS.
Describe the solution you'd like
Convert src/routes to TS.
Considerations

There shouldn't be any logical changes to these files.
Prettier will automatically format these files which is okay.
If these files require types or interfaces, please create new types and interfaces to strongly type functions, objects, etc.

Router files to convert to TS
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.

Hello @ijemmao I would love to take this.

@IAmYoungbossy all yours!


update version

change the init matrix function.
change the bp error.

You may need to solve the conflicts first and update the pull request again.


[BUG] 1.12: Applying ISM policy triggers fault

 Issue by ict-one-nl
Friday Feb 19, 2021 at 09:49 GMT
Originally opened as https://github.com/opendistro-for-elasticsearch/index-management/issues/406

Describe the bug
I created the following index policy:
{
    "policy": {
        "policy_id": "telegraf-delete-1d",
        "description": "A simple default policy that changes the replica count between hot and cold states.",
        "last_updated_time":<PHONE_NUMBER>366,
        "schema_version": 1,
        "error_notification": null,
        "default_state": "hot",
        "states": [
            {
                "name": "hot",
                "actions": [
                    {
                        "replica_count": {
                            "number_of_replicas": 0
                        }
                    }
                ],
                "transitions": [
                    {
                        "state_name": "cold",
                        "conditions": {
                            "min_index_age": "1d"
                        }
                    }
                ]
            },
            {
                "name": "cold",
                "actions": [
                    {
                        "delete": {}
                    }
                ],
                "transitions": []
            }
        ]
    }
}

Applying this through the UI (Indices -> appy policy) gives the following logging:
elasticsearch [2021-02-19T09:37:02,040][INFO ][c.a.o.j.s.JobSweeper     ] [elasticsearch-1] Indexing failed for job QAS1uBu2QyatrZYmZoRxeQ on index .opendistro-ism-config                                                                   ││ elasticsearch [2021-02-19T09:37:02,040][INFO ][c.a.o.j.s.JobSweeper     ] [elasticsearch-1] Indexing failed for job 8GoUnKh-RQGhK60DZ6BtLg on index .opendistro-ism-config                                                                   ││ elasticsearch [2021-02-19T09:37:02,040][INFO ][c.a.o.j.s.JobSweeper     ] [elasticsearch-1] Indexing failed for job pnYPr2wsRgGEMf5JuhKyFQ on index .opendistro-ism-config                                                                   ││ elasticsearch [2021-02-19T09:37:02,041][INFO ][c.a.o.j.s.JobSweeper     ] [elasticsearch-1] Indexing failed for job _SaT4oQoTOqN3ej1cZjucA on index .opendistro-ism-config                                                                   ││ elasticsearch [2021-02-19T09:37:02,073][INFO ][c.a.o.j.s.JobScheduler   ] [elasticsearch-1] Scheduling job id _SaT4oQoTOqN3ej1cZjucA for index .opendistro-ism-config .                                                                      ││ elasticsearch [2021-02-19T09:37:02,073][INFO ][c.a.o.j.s.JobScheduler   ] [elasticsearch-1] Scheduling job id UjbhLLgmRGOgmEUSZ1tBlA for index .opendistro-ism-config .                                                                      ││ elasticsearch [2021-02-19T09:37:02,074][INFO ][c.a.o.j.s.JobSweeper     ] [elasticsearch-1] Indexing failed for job yAoESYhxRFqPaOkOwvyO_A on index .opendistro-ism-config                                                                   ││ elasticsearch [2021-02-19T09:37:02,075][INFO ][c.a.o.j.s.JobSweeper     ] [elasticsearch-1] Indexing failed for job UjbhLLgmRGOgmEUSZ1tBlA on index .opendistro-ism-config                                                                   ││ elasticsearch [2021-02-19T09:37:02,075][INFO ][c.a.o.j.s.JobSweeper     ] [elasticsearch-1] Indexing failed for job q7VRNsH5SZWWPrVq_zaBgw on index .opendistro-ism-config                                                                   ││ elasticsearch [2021-02-19T09:37:02,075][INFO ][c.a.o.j.s.JobScheduler   ] [elasticsearch-1] Scheduling job id 33naRUNfTTytWNLtx_Uhqw for index .opendistro-ism-config .                                                                      ││ elasticsearch [2021-02-19T09:37:02,075][INFO ][c.a.o.j.s.JobSweeper     ] [elasticsearch-1] Indexing failed for job 33naRUNfTTytWNLtx_Uhqw on index .opendistro-ism-config                                                                   ││ elasticsearch [2021-02-19T09:37:02,075][INFO ][c.a.o.j.s.JobSweeper     ] [elasticsearch-1] Indexing failed for job 9R86WyXzTL2ufaeCFL9c1A on index .opendistro-ism-config                                                                   ││ elasticsearch [2021-02-19T09:37:02,075][INFO ][c.a.o.j.s.JobScheduler   ] [elasticsearch-1] Scheduling job id 9R86WyXzTL2ufaeCFL9c1A for index .opendistro-ism-config .                                                                      ││ elasticsearch [2021-02-19T09:37:02,076][INFO ][c.a.o.j.s.JobSweeper     ] [elasticsearch-1] Indexing failed for job TrYQzM4wQrGM4gP9g475tg on index .opendistro-ism-config                                                                   ││ elasticsearch [2021-02-19T09:37:02,076][INFO ][c.a.o.j.s.JobScheduler   ] [elasticsearch-1] Scheduling job id vJasNETOS-qlUqRWWUrOvQ for index .opendistro-ism-config .                                                                      ││ elasticsearch [2021-02-19T09:37:02,076][INFO ][c.a.o.j.s.JobScheduler   ] [elasticsearch-1] Scheduling job id TrYQzM4wQrGM4gP9g475tg for index .opendistro-ism-config .                                                                      ││ elasticsearch [2021-02-19T09:37:02,077][INFO ][c.a.o.j.s.JobScheduler   ] [elasticsearch-1] Scheduling job id OtAW9G-gRc2CQYXobKyJGQ for index .opendistro-ism-config .                                                                      ││ elasticsearch [2021-02-19T09:37:02,077][INFO ][c.a.o.j.s.JobSweeper     ] [elasticsearch-1] Indexing failed for job vJasNETOS-qlUqRWWUrOvQ on index .opendistro-ism-config                                                                   ││ elasticsearch [2021-02-19T09:37:02,077][INFO ][c.a.o.j.s.JobSweeper     ] [elasticsearch-1] Indexing failed for job OtAW9G-gRc2CQYXobKyJGQ on index .opendistro-ism-config                                                                   ││ elasticsearch [2021-02-19T09:37:02,077][INFO ][c.a.o.j.s.JobScheduler   ] [elasticsearch-1] Scheduling job id 3_qRy6SFS42bvUCHZmnEoQ for index .opendistro-ism-config .                                                                      ││ elasticsearch [2021-02-19T09:37:02,077][INFO ][c.a.o.j.s.JobSweeper     ] [elasticsearch-1] Indexing failed for job VR_qHwJ2QSC1hafleVx7Lg on index .opendistro-ism-config                                                                   ││ elasticsearch [2021-02-19T09:37:02,077][INFO ][c.a.o.j.s.JobSweeper     ] [elasticsearch-1] Indexing failed for job 3_qRy6SFS42bvUCHZmnEoQ on index .opendistro-ism-config                                                                   ││ elasticsearch [2021-02-19T09:37:02,078][INFO ][c.a.o.j.s.JobScheduler   ] [elasticsearch-1] Scheduling job id jCKXDEgLTCi_UlrrAgXJzw for index .opendistro-ism-config .                                                                      ││ elasticsearch [2021-02-19T09:37:02,078][INFO ][c.a.o.j.s.JobSweeper     ] [elasticsearch-1] Indexing failed for job jCKXDEgLTCi_UlrrAgXJzw on index .opendistro-ism-config                                                                   ││ elasticsearch [2021-02-19T09:37:02,078][INFO ][c.a.o.j.s.JobSweeper     ] [elasticsearch-1] Indexing failed for job d1SP3DK0QpS9C5LzVe8sgw on index .opendistro-ism-config                                                                   ││ elasticsearch [2021-02-19T09:37:02,078][INFO ][c.a.o.j.s.JobSweeper     ] [elasticsearch-1] Indexing failed for job vcBhO31NQlWBY1A-lrLr6w on index .opendistro-ism-config                                                                   ││ elasticsearch [2021-02-19T09:37:02,079][INFO ][c.a.o.j.s.JobSweeper     ] [elasticsearch-1] Indexing failed for job UsMWSsw4R5-p3QJ6nJuFDQ on index .opendistro-ism-config
Job status is stuck on initializing:

Other plugins installed
Standaard 1.12 docker containers
To Reproduce
Expected behavior
Index policy is applied or a clear fault pops up with a job status failed in UI.
Screenshots
Desktop (please complete the following information):
Docker v1.12 containers running in kubernetes with a 3 node cluster
Additional context

 Comment by ict-one-nl
Saturday Feb 20, 2021 at 09:05 GMT

Made sure we are running 1.12.0:

it seems I do not have the Index:

It is a fresh cluster (new persistent volume claims) where the security tool has been run:

 Comment by dbbaughe
Saturday Feb 20, 2021 at 00:40 GMT

Hey @ict-one-nl,
Can you paste a copy of your index mappings for the .opendistro-ism-config index?

 Comment by ict-one-nl
Sunday Feb 21, 2021 at 08:56 GMT

Okay, this is weird:
Index is there now:

Applying the ILM policy with an template does work now.

 Comment by dbbaughe
Tuesday Feb 23, 2021 at 16:59 GMT

Hey @ict-one-nl,
Seems like things are working now.. a bit confused on steps here to replicate the issue though.
Is this something you are able to replicate yourself? My best guess before were your mappings were incorrect for the index perhaps from an index template with index_patterns: [*], but if it's working now that doesn't seem to be the issue.

 Comment by ict-one-nl
Tuesday Feb 23, 2021 at 22:01 GMT

I will be building a new cluster (1.13.0) later this week, will try it again

 Comment by ict-one-nl
Tuesday Mar 16, 2021 at 21:47 GMT

I've set up several new clusters with 1.13 and haven't seen it since. Maybe it has something to do with the upgrade. Will be on the lookout.
Sorry for the late reply, busy weeks.

 Comment by dbbaughe
Friday Mar 05, 2021 at 22:49 GMT

Any update on this @ict-one-nl ?

Sorry missed this, was idd probably caused by the update


Minor typo

"They are a set of SOAP based APIs that cat be used to create..."
Should "cat" be "can"?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 58fa4b52-1f5c-11c5-329b-2526613833fa
Version Independent ID: 6d1fb152-1612-a0ec-06fc-4ea2e2135541
Content: Deprecation of the Work Item Tracking (WIT) and Test Client OM - Azure DevOps
Content Source: docs/integrate/concepts/wit-client-om-deprecation.md
Product: devops
GitHub Login: @danhellem
Microsoft Alias: dahellem

@yuxuan-ji Thank you for letting us know, it is fixed and should be live soon.


Server version should report tagged release or git commit ID

It is great to see this info in the footer, but I was expecting to see something like a tagged release version or a git commit ID so that it is easier to cross-reference against the git commit history and see what features in the main branch have not yet arrived to production (or dev).

Also the "local_dev" is because on Friday's patch, a release was not made prior to deploying to the server.  Doing a release on github fills in the version.txt details, but the 'local_dev' comes from a developer's checkin instead


some kind of error on startup under pr345

Looks like this:

I did "conda install six" which seemed to work fine, and if I go into ipython, I can do "import six" without any error. So I'm not sure if it's really a problem with six or what.

oh this is not supposed to work. can you use phy cluster-manual instead?

Hm, well I worked out this strategy last time I tried to phy, because "phy
is not recognized as an internal or external command". Some kind of path
issue? I am in the phy/scripts directory though.
On Tue, Jun 16, 2015 at 10:20 PM, Cyrille Rossant<EMAIL_ADDRESS>wrote:

oh this is not supposed to work. can you use phy cluster-manual instead?
—
Reply to this email directly or view it on GitHub
https://github.com/kwikteam/phy/issues/346#issuecomment-112572751.

And I am in the venv that I've used phy from before.
On Tue, Jun 16, 2015 at 10:21 PM, Nick Steinmetz<EMAIL_ADDRESS>wrote:

Hm, well I worked out this strategy last time I tried to phy, because "phy
is not recognized as an internal or external command". Some kind of path
issue? I am in the phy/scripts directory though.
On Tue, Jun 16, 2015 at 10:20 PM, Cyrille Rossant <
<EMAIL_ADDRESS>wrote:

oh this is not supposed to work. can you use phy cluster-manual instead?
—
Reply to this email directly or view it on GitHub
https://github.com/kwikteam/phy/issues/346#issuecomment-112572751.

do python setup.py develop in phy's root

Great, worked, thanks! Am I still using git for checking out different versions now, or has that been overwritten by this setup.py? I'm not exactly sure what it did exactly, I guess.

yeah it's still using git. I'm not sure how it could work before actually...


Is it possible to create backend plugins?

If so, how do you do it in v.1 vs v.2?
For instance, I have multiple wavesurfer instances in the same window, each that have different methods of handling playback rate (timestretch vs normal etc).
I experimented in "next" branch... is this correct?
https://gist.github.com/mdahlgrengadd/fb25657bb54ed9b2314e4c9f3ac552b3
But for version 1 I dont know how to do it without forking.
Thanks!
/Martin.

I think v. 2 is the way to go. If it works for you, then I would just keep using it until we release the next branch.

Ok, guess its time to move on to the "next" branch! Exciting :-) Thanks!

Actually since the backend is initialised in the wavesurfer instance after registerPlugins is called you could just monkeypatch a custom backend in like so: https://gist.github.com/mspae/34b6ad436608c1887f3e32bd4fc371e5 (e.g. replacing this.Backend with your own backend class, which is then instantiated by createBackend)
Pros: Super easy, Actually I'm thinking if we should make the init and destroy methods optional for the plugins since for use cases like this they're just boilerplate. – Cons: This pattern means you can't use "hot" enabling and disabling of plugins (= this plugin can't be dynamically called after wavesurfer was initialised) – But then again custom backends are probably not the kind of functionality people want to enable and disable the whole time.
Your approach would definitely work also.
I was also thinking if we couldn't change the backend wavesurfer option. Currently it can be a string (WebAudio|MediaElement) – What if we add a check if it's an object and then just use that as backend. (Kind of like the renderer option but with backward compatibility) – Then you wouldn't even need a plugin and could just inject your own subclassed webaudio backend as parameter.

@mspae Thanks! Very useful information, and nice to know I'm on the right track :-)

But then again custom backends are probably not the kind of functionality people want to enable and
disable the whole time.

No, probably not. Nice option to have, but atleast not a deal breaker for me.

I was also thinking if we couldn't change the backend wavesurfer option. Currently it can be a string (WebAudio|MediaElement) – What if we add a check if it's an object and then just use that as backend.

This would be one way to do custom backends in v.1 anyways.

@mdahlgrengadd Yes, although v1 also does some things a little differently. For instance the Media Element backend extends the Web Audio backend by using the util.extend function and relies on the global window.WaveSurfer variable, so you wouldn't be able to use ES6 class extends in the same way.

@mspae can you create a ticket and PR for an alpha release of v2?

@thijstriemstra I think it was already released as 2.0.0-beta01 – Why a ticket and PR?

I suggest we announce the beta version on the homepage and encourage people to try it out. Then, hopefully, release by the end of May, perhaps?

@mspae I had no idea ;)

I can't find it in releases. A note as suggested by @katspaugh would be essential.

@katspaugh @thijstriemstra Announcement issue is: #1092  – I've also made a release
The announcement on the website could probably be extracted from the issue. I'm unsure how to proceed with the generated documentation … I would very much like to publish it on the website at the same time as announcing the beta. Then we can just refer to that for more advanced info, otherwise it will be the doc-syncing game again. Maybe the person (probably you, k.) who builds and releases can commit the built doc directory and rebase the gh-pages branch on that commit. (I've been trying to figure out the proper git way of doing that but haven't come to a good conclusion) – How do you sync the dist directory with the gh-pages branch at the moment? – Am I maybe overthinking this and we should just move the generated doc dir over (good ole copy & paste) and commit that … ?

@mspae see #1090 for the docs issue.


feat(ci): codecov integration

:x: We are unable to process any of the uploaded JUnit XML files. Please ensure your files are in the right format.


Add Swin model

Thanks! I fixed the issues we discussed and did some refactoring, it works as expected now :)


Wait for iOS UI buttons to exist before tapping

Wait for buttons to exist before attempting to tap on them.
Validate the 2 marquee texts in dual Flutter views by waiting for both of them instead of waiting for one and validating two exist.

Fixes https://github.com/flutter/flutter/issues/85578

LGTM, there might be an opportunity to split out a helper function since this pattern is repeated a bit.

This code is a bit repetitive, but the file is short and at least within a test it's clear what it's doing.


Server components with JavaScript backend

I'm interested in this because I'm thinking of build an app in the following way:

Make the app use server components for all data coming from the server (think todo list app - just render on the server, like liveview)
No add a service worker that captures the websocket and runs the logic on the client, with some database solution (indexeddb as an option), and performs background sync between that database and the server.
This allows me to have online and offline clients, and debug on the server initially.

I'm happy to try and get this to work, but would like some input as to what prevents server components from working with the JavaScript backend right now.

Hey that's a super interesting use-case, definitely an idea I'd love to pursue for Lustre. Currently there is an implementation of the server component runtime for javascript; you should be able to use lustre.start_server_component and it'll work.
The caveat is that this runtime is super untested, I think you would be the first user. Very happy to work out any hiccups or problems you run into though!

I'll need to figure out how to create a service worker using gleam. I will start by creating a basic app with server components to get a feel for it, then try to add this layer. I'll reach out for help if needed.
I'm thinking we can close this issue as the functionality exists (though untested) and I can create issues or contribute fixes as I hit them.


Fix for maximum number of objects

This PR properly applies the maximum number of objects, as tested by printouts.
Timing
Master:

This PR:

Validation
Master:
https://www.classe.cornell.edu/~evourlio/www/SDL_GPU/fixObjectMaxNumber/eff_plots__GPU_explicit_cache_1cad1b0_PU200/
This PR:
https://www.classe.cornell.edu/~evourlio/www/SDL_GPU/fixObjectMaxNumber/eff_plots__GPU_explicit_cache_84a74b2_PU200_fixObjectMaxNumber/
The efficiency is slightly lower (<1%) for this PR, which makes sense since we are now properly cropping the number of objects.

This is what I'm seeing from the multiplicies in the first event. Other events I think look ok though. Could you run this and double check please?

I confirm the issue, which I tracked down to the triplets. I think it's unrelated to this PR. It seems that we are missing some cudaMemsetAsync here, including the one for totOccupancyTriplets?
Can you please confirm?

Yes that seems to fix it. Can you push that change to this PR? And also check to make sure this doesn't happen in other files. Lastly, in the unified section, there are memcpys that are within an ifdef for track extensions. Can you please remove the ifdef lines and keep the memcpys

This is what I'm seeing from the multiplicies in the first event. Other events I think look ok though. Could you run this and double check please?

The issue mentioned above has been fixed, as it can be seen in the screenshot below:

I am attaching the updated timing (no real change):

The validation plots have also been updated (no real change as well). After inspecting the plots, it seems that efficiency differences are observed for all of the objects (as expected) and the efficiency can both decrease or increase slightly (due to the undefined behavior of overwriting).


Fixed IsResourceNotFoundError.

Fixed the IsResourceNotFoundError function.
The type to cast to had to be changed due to the recent changes in the definition of the getAzureError function.

I'm not sure why this is the case, we used to return pointers, now we don't. So the old code sounds right to me @aznashwan?

I have trouble getting why this happens as well.
I strongly suspect that it's because casting an interface auto-implies some pointer vodoo.
The point is that after the change to getAzureError if you try to cast to the struct it fails; saying that the value it got was of type *AzureError which is uncastable to AzureError...

@aznashwan removing your pkg/ dir, go get -u and rebuilding may help. Apparently you still have the old code somehow. From what I can tell, this shouldn't be happening. Please let us know if it still happens after building again.

@ahmetalpbalkan after some internal code review I realised I had written not one; but two if statements which were complete utter bogus :disappointed:
Thank your for your patience; and my apologies for the misunderstanding.


Add a way to search for suggestions with granularity

This could help find specific suggestions.

What do you men 'search with granularity'?

@Restioson Council members should be able to search for submitters and or emoji name. We can even decide to provide options for filtering by upvotes/downvotes and or suggestion status, and sorting by those metrics.

For bonus points, we can use a fuzzy searching algorithm to help make the bot easier to use. Optional, though.

Ah, I see - more specific search criteria. Levenshtein distance could be used so that slight misspellings wouldn't be detrimental to searching (btw, is this waat you mean by a fuzzy search?)

Yes.

slice using caps - 2017 colourised

@DudeVoid lmao


Add parameter to register_daemon() to make daemon run on startup

Also a command krugs startup should be added that starts all those daemons that should run on startup. Could be added to a crontab @reboot

Not needed for now, simply use Cron @reboot.


import vren

Hello,
I searched vren module but I can't figure it out.
How to install vren module?
Thank you

This is my bad.
I missed the information from the front page:
"Install vren from the ngp_pl".


Flow Manager - Flow with 'switch' and 'change' nodes is not working properly

I create a flow to write a string value in a virtual device based on a switch rule, but errors are appearing in the log.

Log  snippets (flowbroker)
---
got TypeError: util.evaluateNodeProperty is not a function:undefined from switch
---
got Error: Failed to parse rule (target is invalid):undefined from change

It is working as expected now!


Move config to separate files - from branch in this repo

The reason for the change is to make it possible to use external storages. At the moment jaeger configuration is embedded in the resource files with storage deployment.

I will update the readme, this is a preparation to be able to use external storage deployment .eg. https://github.com/RHsyseng/docker-rhel-elasticsearch/tree/5.x


Fix execute function command

Fixes #3716
Firstly, the new http client throws an error if the body isn't a string or stream or buffer. So I am stringifying the body.

And also the content type needs to be set in order for service bus queue triggers to work.
These things must have been happening automatically with the older client, so we'll need to investigate applying a better fix later.

These things must have been happening automatically with the older client, so we'll need to investigate applying a better fix later.

I can confirm that these things were done automatically when we used ms-rest-js.
Body is stringified by default: https://github.com/Azure/ms-rest-js/blob/master/lib/webResource.ts#L473-L475
Content type is set to JSON by default: https://github.com/Azure/ms-rest-js/blob/master/lib/webResource.ts#L450-L452

So yeah new client has a default serialization policy but it's only executed when there is an operation spec. I think this means it will only be applied if the client is being used in an SDK request.

It might really be worth creating our own custom request pipeline without any of the default pipeline policies. We make a lot of requests to non-Azure Resource Management API endpoints yet we are using a client with a ton of Azure SDK specific pipeline policies attached to it.
This makes it hard to know what policies are doing what, since when they behave differently depending on if they have an operation spec.


Implement Planner support for Union ALL

The Union ALL planner support uses a Union operator in the LogicalPlanner
which generates a UnionPlan. The plan consists of a sub plan for each side of
the union. When the union is planned, both sides are executed as a branch of the
execution tree. The result is fed to the MergePhase which receives data from
both sub plans and merges them into buckets encoded by the node id and the input
id set during planning.
In MergePhase the number of different inputs was added to ensure that a merge
with multiple inputs can be detected. The input id is encoded at the beginning
of the 32bit bucket id.

@matriv @mfussenegger Ready for an initial review.

tests are failing?

They were passing before locally and here in the PR. I only squashed the commits. Still passing locally. Need to investigate.

Now passing. Still investigating the cause of the previous test fails but maybe you could take a look at the PR in the meantime?

Codecov Report

:exclamation: No coverage uploaded for pull request base (union-new@808452f). Click here to learn what that means.
The diff coverage is 88.27%.

@@             Coverage Diff              @@
##             union-new    #6535   +/-   ##
============================================
  Coverage             ?   83.05%
  Complexity           ?    13244
============================================
  Files                ?     1515
  Lines                ?    49228
  Branches             ?     5923
============================================
  Hits                 ?    40884
  Misses               ?     5546
  Partials             ?     2798

Impacted Files
Coverage Δ
Complexity Δ

sql/src/main/java/io/crate/planner/Merge.java
88.73% <ø> (ø)
26 <0> (?)

...main/java/io/crate/jobs/PageDownstreamContext.java
82.78% <ø> (ø)
47 <0> (?)

...io/crate/planner/operators/GroupHashAggregate.java
94.33% <ø> (ø)
19 <0> (?)

...java/io/crate/planner/operators/HashAggregate.java
95.52% <ø> (ø)
15 <0> (?)

...rc/main/java/io/crate/planner/operators/Count.java
83.33% <ø> (ø)
3 <0> (?)

...src/main/java/io/crate/planner/operators/Join.java
92.11% <ø> (ø)
63 <0> (?)

...ql/src/main/java/io/crate/planner/PlanPrinter.java
75% <0%> (ø)
3 <0> (?)

...te/executor/transport/SubSelectSymbolReplacer.java
82.22% <0%> (ø)
3 <0> (?)

...rate/analyze/relations/OrderedLimitedRelation.java
83.33% <100%> (ø)
14 <4> (?)

...tion/projectors/DistributingDownstreamFactory.java
82.14% <100%> (ø)
6 <0> (?)

... and 12 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 808452f...c27ae66. Read the comment docs.

The previous issues visible in some tests runs have been resolved.

btw we might need some tests for union with array columns. Afaik currently we only ever load the values for array column using a fetchPhase - fetchPhase does source lookups; But since now we don't have the fetch support yet it will try to load the array values without source lookup - and I think that's not yet implemented in the LuceneReferenceResolver

I've tested and verified that union with array and object columns work correctly. Adding a test case to ensure it stays that way.

@mfussenegger I've fixed the object collecting problem. Not sure if the fix is adequate directly in the LuceneRefenceResolver but I find that it is the best place to ensure source lookup conversion is performed: https://github.com/crate/crate/pull/6535/commits/b00f1e4d95e18c6a827084c86eacddec3aca044c

I'd like to merge this to union-new within the next days. If you have more suggestions, feel free to comment.

@mxm  I would add some more Integ Tests:

System tables
"Scalar" subqueries  (return 1 value -> use MultiPhase plan)
UnionAll as wrapped as a subquery, maybe also in a join or so.

Not sure if you've seen my last comment since the change is shown as outdated:
https://github.com/crate/crate/pull/6535#discussion_r153014720

@mfussenegger Thx for pointing out. I've commented inline.

Thank you @matriv. I've addressed your comments.


Rasa - Resolving environment variables on the fly

Rasa version: 0.13.7
Python version: 3.6.6
Operating system: debian/jessie
Issue:

Assume the environment variable DUCKLING_URL is set to http://duckling-1:8000
A model is trained
Rasa can reach Duckling at http://duckling-1:8000
DUCKLING_URL is updated to http://duckling-2:8000 on the spot
Rasa still reaches Duckling at http://duckling-1:8000

It seems like environment variables are resolved when training the ML model (?). Is this intended? Is there any particular reason that prohibits the code from resolving environment variables on the fly? How can I make DUCKLING_URL configurable per environment, without the need to re-train my model. Am I missing something here?
Content of configuration file (config.yml):
language: "en"

pipeline:
- name: "tokenizer_whitespace"
- name: "ner_crf"
- name: "ner_duckling_http"
  url: ${DUCKLING_URL}
  locale: "en_GB"
  timezone: "UTC"
  dimensions:
  - time
  - number
  - ordinal
  - duration
- name: "ner_synonyms"
- name: "intent_featurizer_count_vectors"
- name: "intent_classifier_tensorflow_embedding"

Hey there @pchristos! I just checked out the duckling extractor and found this method:
def _url(self):
        """Return url of the duckling service. Environment var will override."""
        if os.environ.get("RASA_DUCKLING_HTTP_URL"):
            return os.environ["RASA_DUCKLING_HTTP_URL"]

        return self.component_config.get("url")

which should be called each time when [parsing] via duckling. (https://github.com/RasaHQ/rasa_nlu/blob/0.13.7/rasa_nlu/extractors/duckling_http_extractor.py#L95). Have you tried setting that environment variable?

Ah, perfect, thank you!

@pchristos awesome! Seems like this option needs to be better documented so others can find it too. Would you be able to create a quick PR to add the info to the docs?


aborting large workflows times out

while trying to abort
https://cmsweb.cern.ch/reqmgr2/fetch?rid=mcremone_task_EXO-RunIISummer15wmLHEGS-04802__v1_T_170811_181808_305
https://cmsweb.cern.ch/reqmgr2/fetch?rid=mcremone_task_EXO-RunIISummer15wmLHEGS-04800__v1_T_170811_181958_1008
the command takes a while, times out and sends a "server error"

The first one seems to be hitting the frontend timeout (5min). According to the reqmgr2 logs, there was a (document?) couch conflict [1].
I'm trying to abort both of them, if that doesn't work, then we might need to script it. For the next deployment, I think we should make this operation asynchronous (same for force-complete).
[1]
[06/Sep/2017:13:50:16] vocms0136.cern.ch <IP_ADDRESS> "GET /reqmgr2/data/request?name=vlimant_ACDC0_Run2016H-v1-SingleElectron-07Aug17_8029_170903_163807_8496 HTTP/1.1" 200 OK [data: 2734 in 5650 out 318309 us ] [auth: OK "/DC=org/DC=opensciencegrid/O=Open Science Grid/OU=Services/CN=wmagent/wmagent.fnal.gov" "" ] [ref: "" "WMCore.Ser
vices.Requests/v001" ]
[06/Sep/2017:13:50:17]  SERVER OTHER ERROR WMCore.Database.CMSCouch.CouchConflictError e368a00b4b787dc0940cad80dd3c0e1c (CouchConflictError - reason: Conflict, data: None result: None)
[06/Sep/2017:13:50:17]    Traceback (most recent call last):
[06/Sep/2017:13:50:17]      File "/data/srv/beHG1707d/sw/slc6_amd64_gcc493/cms/reqmgr2/1.1.5.pre5/lib/python2.7/site-packages/WMCore/REST/Server.py", line 711, in default
[06/Sep/2017:13:50:17]        return self._call(RESTArgs(list(args), kwargs))
[06/Sep/2017:13:50:17]      File "/data/srv/beHG1707d/sw/slc6_amd64_gcc493/cms/reqmgr2/1.1.5.pre5/lib/python2.7/site-packages/WMCore/REST/Server.py", line 787, in _call
[06/Sep/2017:13:50:17]        obj = apiobj['call'](*safe.args, **safe.kwargs)
[06/Sep/2017:13:50:17]      File "/data/srv/beHG1707d/sw/slc6_amd64_gcc493/cms/reqmgr2/1.1.5.pre5/lib/python2.7/site-packages/WMCore/ReqMgr/Service/Request.py", line 477, in put
[06/Sep/2017:13:50:17]        result = self._updateRequest(workload, request_args)
[06/Sep/2017:13:50:17]      File "/data/srv/beHG1707d/sw/slc6_amd64_gcc493/cms/reqmgr2/1.1.5.pre5/lib/python2.7/site-packages/WMCore/ReqMgr/Service/Request.py", line 462, in _updateRequest
[06/Sep/2017:13:50:17]        report = self._handleOnlyStateTransition(workload, request_args, dn)
[06/Sep/2017:13:50:17]      File "/data/srv/beHG1707d/sw/slc6_amd64_gcc493/cms/reqmgr2/1.1.5.pre5/lib/python2.7/site-packages/WMCore/ReqMgr/Service/Request.py", line 439, in _handleOnlyStateTransition
[06/Sep/2017:13:50:17]        self.gq_service.cancelWorkflow(workload.name())
[06/Sep/2017:13:50:17]      File "/data/srv/beHG1707d/sw/slc6_amd64_gcc493/cms/reqmgr2/1.1.5.pre5/lib/python2.7/site-packages/WMCore/Services/WorkQueue/WorkQueue.py", line 211, in cancelWorkflow
[06/Sep/2017:13:50:17]        return self.updateElements(*elements, Status='CancelRequested')
[06/Sep/2017:13:50:17]      File "/data/srv/beHG1707d/sw/slc6_amd64_gcc493/cms/reqmgr2/1.1.5.pre5/lib/python2.7/site-packages/WMCore/Services/WorkQueue/WorkQueue.py", line 190, in updateElements
[06/Sep/2017:13:50:17]        self.db.makeRequest(uri=thisuri, type='PUT')
[06/Sep/2017:13:50:17]      File "/data/srv/beHG1707d/sw/slc6_amd64_gcc493/cms/reqmgr2/1.1.5.pre5/lib/python2.7/site-packages/WMCore/Database/CMSCouch.py", line 123, in makeRequest
[06/Sep/2017:13:50:17]        getattr(e, "reason", None), data)
[06/Sep/2017:13:50:17]      File "/data/srv/beHG1707d/sw/slc6_amd64_gcc493/cms/reqmgr2/1.1.5.pre5/lib/python2.7/site-packages/WMCore/Database/CMSCouch.py", line 144, in checkForCouchError
[06/Sep/2017:13:50:17]        raise CouchConflictError(reason, data, result)
[06/Sep/2017:13:50:17]    CouchConflictError: CouchConflictError - reason: Conflict, data: None result: None
[06/Sep/2017:13:50:17] vocms0136.cern.ch <IP_ADDRESS> "PUT /reqmgr2/data/request/mcremone_task_EXO-RunIISummer15wmLHEGS-04802__v1_T_170811_181808_305 HTTP/1.1" 500 Internal Server Error [data: 4948 in 743 out 323452251 us ] [auth: OK "/DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=vlimant/CN=652956/CN=Jean-Roch Vlimant" "" ] [ref: "http
s://cmsweb.cern.ch/reqmgr2/fetch?rid=mcremone_task_EXO-RunIISummer15wmLHEGS-04802__v1_T_170811_181808_305" "Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Firefox/52.0" ]

Second workflow
mcremone_task_EXO-RunIISummer15wmLHEGS-04800__v1_T_170811_181958_1008
had been aborted already. It has around 12k wqe docs.
The first one has almost 20k wqe docs.

+1 on asynchroneous, though this will require a new state like "force-abort" or "abort"

I have a script running right now to mark workqueue elements to CancelRequested for
mcremone_task_EXO-RunIISummer15wmLHEGS-04802__v1_T_170811_181808_305
it's going to take a while though, I'd say it has a rate of 10hz or so. Once that's done, I'll flip that workflow to aborted.

The other has been aborted as well.

@amaltaro, So the bottleneck here is (WorkQueue) couch db updates?

Yes, it happens when there are way too many workqueue elements. Same for force-complete that can take several secs or minutes or even timeout.


question about FixedSizeArena's implementation

Describe this problem
point1:
https://github.com/CeresDB/ceresdb/blob/main/components/arena/src/fixed_size.rs#L55
layout.pad_to_align() only expand and pad the size, it does not guarantee that the returned address is aligned according to the user's needs.  Currently, its normal operation depends entirely on the alignment property of the core. ptr returned by the operating system malloc during allocation of the entire block
point2:
https://github.com/CeresDB/ceresdb/blob/main/components/arena/src/fixed_size.rs#L64
why not self.ptr.as_ptr().add(self.len())?
Server version
Omitted
Steps to reproduce
need inject some code to the core.ptr alloc.
for example:

core.ptr = malloc().add(1);
in Core::drop, free(core.ptr.sub(1))

Expected behavior
No response
Additional Information
No response

it's my fault

https://github.com/CeresDB/ceresdb/blob/main/components/arena/src/fixed_size.rs#L64
why not self.ptr.as_ptr().add(self.len())?

point1:
https://github.com/CeresDB/ceresdb/blob/main/components/arena/src/fixed_size.rs#L55
layout.pad_to_align() only expand and pad the size, it does not guarantee that the returned address is aligned according to the user's needs. Currently, its normal operation depends entirely on the alignment property of the core. ptr returned by the operating system malloc during allocation of the entire block
point2:
https://github.com/CeresDB/ceresdb/blob/main/components/arena/src/fixed_size.rs#L64
why not self.ptr.as_ptr().add(self.len())?

@guoxiangCN Thanks for your reports. Actually, it looks like the FixedSizeArena is just a demo in the codebase, because it is not used at all. So it may have some bugs.
As for your two points, I agree on them. And as for the point2, I guess the answer to it is that it is a bug.
Maybe we should remove the FixedSizeArena from the codebase.
@guoxiangCN Are you reading the source code? It will be appreciated if you give more suggestions when you dig into the codebase.

I want to learn more about Rust and database, and I have seen this open source project through some publicity, so I plan to learn about it. I wonder that if the open source version is consistent with your internal version?

thanks for your reply!

I want to learn more about Rust and database, and I have seen this open source project through some publicity, so I plan to learn about it. I wonder that if the open source version is consistent with your internal version?

Actually, there is no internal version at all.

I want to learn more about Rust and database, and I have seen this open source project through some publicity, so I plan to learn about it. I wonder that if the open source version is consistent with your internal version?

Actually, there is no internal version at all.

Got it