Fix checking shape in BatchNormalizationFunction

Type checking is loose.
In [1]: import numpy

In [2]: import chainer

In [3]: bn0 = chainer.links.BatchNormalization(64)

In [4]: bn0(chainer.Variable(numpy.zeros((1,100,1,1),dtype='f')))
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-4-ddda6c9bb1a9> in <module>()
----> 1 bn0(chainer.Variable(numpy.zeros((1,100,1,1),dtype='f')))

/home/okuta/env/chainer/chainer/chainer/links/normalization/batch_normalization.pyc in __call__(self, x, test, finetune)
     92         if use_batch_mean:
     93             func = batch_normalization.BatchNormalizationFunction(self.eps)
---> 94             ret = func(x, self.gamma, self.beta)
     95
     96             if finetune:

/home/okuta/env/chainer/chainer/chainer/function.pyc in __call__(self, *inputs)
    121         # Forward prop
    122         with cuda.get_device(*in_data):
--> 123             outputs = self.forward(in_data)
    124             assert type(outputs) == tuple
    125         for hook in six.itervalues(hooks):

/home/okuta/env/chainer/chainer/chainer/functions/normalization/batch_normalization.pyc in forward(self, inputs)
     62             x_mu = x - mean[expander]
     63             self.x_hat = x_mu / self.std[expander]
---> 64             y = gamma * self.x_hat
     65             y += beta
     66         else:

ValueError: operands could not be broadcast together with shapes (1,64,1,1) (1,100,1,1)

I added comments.

@delta2323: I fixed.

Thank you for your work. Could you consider applying this comment, too?

@delta2323 I fixed.

Could you add test case where the argument of Batchnormalization.init is other than int?

@okuta  LGTM except the comment.

https://github.com/pfnet/chainer/pull/1232/files#diff-9ba9992ebffe5029a4bb23a18efb9691R315
I tested. Is it OK?

I see. What I meant was tuple of int case. Actually size argument can also accept it (see the description of L.BatchNormalization here).

I fixed.

LGTM 👍


feat: add lark provider

Signed-off-by: sh1luo<EMAIL_ADDRESS>

Demo link: http://testb.rescld.cn/


Gofmt's federate.go

Fixes issue #496

This is an issue with my dev environment. I was using go v1.10, which appears to have a gofmt bug. Gofmt is trying to remove the spaces here. I no longer experienced this issue after upgrading to go v1.11.


Label test failure in master

This is in Chrome on my home Windows machine.  I haven't tested any other systems.
Scene/LabelCollection can render after adding a label
Expected 11 to be less than 10.
Error: Expected 11 to be less than 10.
    at stack (http://localhost:8080/ThirdParty/jasmine-2.2.0/jasmine.js:1475:17)
    at buildExpectationResult (http://localhost:8080/ThirdParty/jasmine-2.2.0/jasmine.js:1445:14)
    at Spec.Env.expectationResultFactory (http://localhost:8080/ThirdParty/jasmine-2.2.0/jasmine.js:584:18)
    at Spec.addExpectationResult (http://localhost:8080/ThirdParty/jasmine-2.2.0/jasmine.js:332:34)
    at Expectation.addExpectationResult (http://localhost:8080/ThirdParty/jasmine-2.2.0/jasmine.js:528:21)
    at Expectation.toBeLessThan (http://localhost:8080/ThirdParty/jasmine-2.2.0/jasmine.js:1399:12)
    at http://localhost:8080/Specs/Scene/LabelCollectionSpec.js:359:27
    at Object.<anonymous> (http://localhost:8080/Specs/spec-main.js:139:30)
    at attemptAsync (http://localhost:8080/ThirdParty/jasmine-2.2.0/jasmine.js:1793:24)
    at QueueRunner.run (http://localhost:8080/ThirdParty/jasmine-2.2.0/jasmine.js:1746:26)
Expected 11 to be less than 10.
Error: Expected 11 to be less than 10.
    at stack (http://localhost:8080/ThirdParty/jasmine-2.2.0/jasmine.js:1475:17)
    at buildExpectationResult (http://localhost:8080/ThirdParty/jasmine-2.2.0/jasmine.js:1445:14)
    at Spec.Env.expectationResultFactory (http://localhost:8080/ThirdParty/jasmine-2.2.0/jasmine.js:584:18)
    at Spec.addExpectationResult (http://localhost:8080/ThirdParty/jasmine-2.2.0/jasmine.js:332:34)
    at Expectation.addExpectationResult (http://localhost:8080/ThirdParty/jasmine-2.2.0/jasmine.js:528:21)
    at Expectation.toBeLessThan (http://localhost:8080/ThirdParty/jasmine-2.2.0/jasmine.js:1399:12)
    at http://localhost:8080/Specs/Scene/LabelCollectionSpec.js:360:27
    at Object.<anonymous> (http://localhost:8080/Specs/spec-main.js:139:30)
    at attemptAsync (http://localhost:8080/ThirdParty/jasmine-2.2.0/jasmine.js:1793:24)
    at QueueRunner.run (http://localhost:8080/ThirdParty/jasmine-2.2.0/jasmine.js:1746:26)

This passes on my work Windows laptop.  Will try to reproduce on my home laptop.

I still get this all of the time in Chrome on my Windows 10 laptop (Intel HD 4000).

It also happens under my nvidia card on the same machine.

Sir can you please elobrate what type of error is this and when you encounter this error??

@AmayAgrawal I don't think this is a good beginner issue.

So, what's happening here is we're expecting the Red channel to be bright, and the Green and Blue channels to both be dark (we asked for zero, and we expect less than 10 / 255 as a result).  Some machines use color profiles to tweak rendered colors to look nicer on the particular type of monitor attached, and sometimes this affects our render test results, hence the sloppy expectation.
In this case, the failed rendered result got 11 / 255 when we expected less than 10, but only on some machines.  I would say this is OK -- perhaps a rather extreme color correction, but not out of the realm of the expected.  We could increase the tests to expect less than 20, as opposed to less than 10.
Note that some of these tests look for brightness by expecting "more than 10".  Really these should probably be moved up to expect more than 210.  I wouldn't expect that to break unless we got aggressive and expected more than 245.

@bagnell please close this if #4379 fixed it.


show descriptions in auto-complete + set_option

This is a cool feature :-)

@avigad is showing many features to the students. I'll add things that I want to improve :-)

description goes to the bottom (mini-bar)
shows type and current value

Nice!


NotificationService does not remove references to closed notifications

Detailed description

Open https://angular.carbondesignsystem.com/?path=/story/notification--dynamic
Open developer tools
Set a breakpoint at NotificationService.showNotification
Click the 'Show info notification button' and allow code to proceed past the breakpoint
Close the notification
Repeat previous two steps a few times
Click the 'Show info notification button'
Inspect NotificationService.notificationRefs and you will notice that the references to all of the notifications are still there.
Expect that they would be cleaned up when a notification is closed.

Is this a feature request (new component, new icon), a bug, or a general issue? Bug

Is this issue related to a specific component? NotificationService

What did you expect to happen? What happened instead? What would you like to see changed? References to notifications are removed when they are closed

What browser are you working in? Chrome

closed by #602


rstudio dies when clicking on dropdown on wayland

Describe the bug
First of all this bug looks exactly like this qutebrowser issue. Basically it's fixed in Qt 5.15.1. Could someone confirm it?
To Reproduce
Steps to reproduce the behavior:

Starts rstudio on wayland.
Get in the global config menu.
Click a dropdown menu.

Expected behavior
No crash.
Screenshots
Video
Notify maintainers
Ping @ciil @changlinli @ehmry
Metadata
 - system: `"x86_64-linux"`
 - host os: `Linux 5.7.19, NixOS, 20.03.2910.42674051d12 (Markhor)`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.3.6`
 - channels(root): `"nixos-20.03.2910.42674051d12, nixos-unstable-20.09pre242714.a31736120c5"`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixos`

Maintainer information:
# a list of nixpkgs attributes affected by the problem
attribute:
# a list of nixos modules affected by the problem
module:

Fixed after I swap to nixos-20.09 channel.


AlexeyAB/darknet version of darknet ROS Integration

I find this version of darknet much optimized and fast to run yolo v3 - https://github.com/AlexeyAB/darknet/
I was trying to integrate this version with ROS based on darknet_ros, but i am facing compilation issues. Help is really appreciated. Here's the link to my fork - https://github.com/pushkalkatara/darknet_ros

Nice idea, +1 for that. I am trying the same currently and will let you know if progress is made.

yolo_v2_class.cpp - This file might help with the fetch, detect, publish thread setups.
yolo_console_dll.cpp

Hi everyone,
please find my fork of this repo using AlexeyAB's version of darknet instead of the one by pjreddie here:
https://github.com/MilkWithCoffee/darknet_ros


Package version

PkgDependency 0.4:

the "PkgGraph v0.4.0-dev" at the top is nice.
Don't do for all deps though, by default: too noisy
So, add to circle in dot (either behind or newline) could even do fancy html, faded or sth.
(and then only for the one)

this is same as / merge with:

#65


Lots of "build timed out" failures

https://performance-dot-grpc-testing.appspot.com/explore?dashboard=5642906408845312
Shows >20% timeout failures.
In particular:
tsan/c++/linux
tsan/c/linux
msan/c/linux
debug/python/macos

This failure says "Build timed out (after 120 minutes). Marking the build as failed.".
However, our smallest unit is 5 min and biggest multiplier is 20:
{
"config": "helgrind",
"timeout_multiplier": 20,
"tool_prefix": [
"valgrind",
"--tool=helgrind"
]
}
It seems this 2-hour timeout is set somewhere else.

This timeout was defined in the Jenkins job configuration. I increased it to 180 min.

Obsolete. All *-san tests are green now.


feat: add model gpt-4

I added gpt-4 model, for now, users need access to gpt-4 to use it.

This commit removes semicolons. I didn't do that, seems like it's your .prettierrc in this repo, which automatically removes the semicolons.

This commit removes semicolons. I didn't do that, seems like it's your .prettierrc in this repo, which automatically removes the semicolons.

Thank you. No worry for the prettier.
I just want to confirm have you tested the gpt-4 model works in your side. Cause I don't have the access to gpt-4 now, I can't perform test with this

Yes, I have tested it.

#13 finished


Basic syntax highlighting support

This patch adds basic syntax highlighting support using the syntect crate and the default themes & languages supported by that crate.
This unfortunately does increase the size of the wasm blob, and can slow down display of large documents (especially when building without optimizations). This appears to mostly be due to the inclusion of the regex crate and a blob containing language definition regexes.
It may make sense to use more tailored asset sets with only the used theme & languages in the future to keep down on binary size.

This is so awesome, thank you! This was very high on my wishlist to support.
This does roughly double the size of the WASM, but I think it's worth it. We can look into some strategies to improve the code size later, but having working syntax highlighting makes the tool a lot more useful in my opinion.


Docs: when to use jinjasql

Just based on this section:

JinjaSQL is not meant to replace your ORM. ORMs like those provided by SQLAlchemy or Django are great for a variety of use cases, and should be the default in most cases. But there are a few use cases where you really need the power of SQL.
Use JinjaSQL for -
Reporting, business intelligence or dashboard like use cases
When you need aggregation/group by
Use cases that require data from multiple tables
Migration scripts & bulk updates that would benefit from macros
In all other use cases, you should reach to your ORM instead of writing SQL/JinjaSQL.

It would be good to know why this would be better than SQLAlchemy (I'm less familiar with Django's ORM) - some examples: SQLAlchemy has Group By support, you can get data from multiple tables using it, and you can dynamically build queries using it. Also it has the core API as a lower level SQL DSL.
Thanks!

Yes, SQLAlchemy is great. In general, if your use case can be met with SQLAlchemy core, then you really should use it.
There are times when a report or a transformation needs significantly complex queries. You want to incrementally work on the query, look at performance, make tweaks and so on. Once you have the final working query - it is much simpler to put into a JinjaSQL template, than to take that monstrosity and convert it into equivalent SQLAlchemy core.
Your mileage may vary!


TypeError: 'pyrealsense2.pyrealsense2.config' object is not subscriptable

Required Info

Camera Model
D435i

Operating System & Version
windows 10

Platform
Laptop

Language
{python/opencv}

I am currently using Realsense D435i camera for my project. I am using the pyrealsense2 library for getting the stream but I am facing the error "TypeError: 'pyrealsense2.pyrealsense2.config' object is not subscriptable" every time I try to access the frames from the camera for detection purpose.
I have mentioned the code below to get a better picture:-
`pipeline = rs.pipeline()
    config = rs.config()

    config.enable_stream(rs.stream.color, 640, 480, rs.format.bgr8, 30)

    pipeline.start(config)
    colorwriter = cv2.VideoWriter('output_realsense.avi', cv2.VideoWriter_fourcc(*'XVID'), 30, (640, 480), 1)

    # the main loop
    batch_size  = 1
    images      = []
    video = []
    while True:
        frames = pipeline.wait_for_frames()
        color_frame = frames.get_color_frame()
        color_image = np.asanyarray(color_frame.get_data())
        image = color_image
        ret_val = True
        if ret_val == True: images += [image]

        if (len(images)==batch_size) or (len(images)>0):
            batch_boxes = get_yolo_boxes(infer_model, images, net_h, net_w, config['model']['anchors'], obj_thresh, nms_thresh)

            for i in range(len(images)):
                draw_boxes(images[i], batch_boxes[i], config['model']['labels'], obj_thresh)

                cv2.imshow('video with bboxes', images[i])
                colorwriter.write(images[i])

            images = []
        if cv2.waitKey(1) == 27:
            break  # esc to quit
    cv2.destroyAllWindows()
    colorwriter.release()`

The error occurs when batch_boxes are created (infer_model = loading the Keras model, net_h and net_w = defined value, config values from the config file containing box dimensions and Obj_thresh and nms_thresh are defined values)
If I use my laptop webcam as the source of stream, it works but If i use pyrealsense and realsense camera, I face this issue. Kindly provide me with some insight on what I can do or why its not able to access the frames.

Hi @vigkrish123   Your pipeline setup and config code looks okay.  As a starting point in investigating your case, I note that you have placed your colorwriter instruction directly after the pipe start instruction, whilst a similar .avi saving line in https://github.com/IntelRealSense/librealsense/issues/2731#issuecomment-529938267 places it immediately before the pipe start line.
Please try moving the colorwriter instruction to the line before pipe start in order to eliminate it as a possible cause of your problem.
colorwriter = cv2.VideoWriter('output_realsense.avi', cv2.VideoWriter_fourcc(*'XVID'), 30, (640, 480), 1)
pipeline.start(config)

I tried moving the pipeline start line but I  still get the same error. I don't understand why it says 'pyrealsense2.pyrealsense2.config' object is not subscriptable because normal rgb streaming and saving works fine but when it reaches batch_boxes, it stops

I have not seen a script like this before.  Since the program is apparently failing at the batch_boxes line though, I wonder whether the error message is referring to having problems with the config['model'] part of that line (the config values from the config file containing box dimensions) and not the camera stream config.

I kinda fixed the issue. I used rs.align and align.process and it somehow worked. But facing issue with saving the stream though. Anyways I will close the issue. Thanks a lot for your quick response.

You are very welcome, @vigkrish123 - it's great to hear that you made progress!


Speed up nightly tests

All NCTL nightly tests are now waiting for era 2 when they wait for genesis. They should theoretically work correctly when the code is updated to wait for era 1.  This should slightly speed up the nightly script execution.

Triage update:

Descoped from Condor/2.0.0 release.


Some ptrace functions don't allow signal injection

From ptrace(2):

After signal-delivery-stop is observed by the tracer, the tracer should restart the tracee with the call ptrace(PTRACE_restart, pid, 0, sig) where PTRACE_restart is one of the restarting ptrace requests. If sig is 0, then a signal is not delivered. Otherwise, the signal sig is delivered. This operation is called signal injection

As far as I understand, the restarting requests correspond to cont, detach, step, and syscall in the sys::ptrace module. cont and step allow signal injection through an Option<Signal> argument. detach and syscall don't have such an argument so signal injection is not possible. I think they should all have this optional signal argument.

Let me know if you'd be interested in a pull request.

Yeah, this sounds like a good feature to add.


Unknown flag --config with golangci-lint

Hello, after reading the doc, I faced an issue that I don't really understand.
Here is my precommit config :
# See https://pre-commit.com for more information
# See https://pre-commit.com/hooks.html for more hooks
repos:
-   repo: https://github.com/pre-commit/pre-commit-hooks
    rev: v4.4.0
    hooks:
    -   id: trailing-whitespace
    -   id: end-of-file-fixer
    -   id: check-yaml

-   repo: https://github.com/tekwizely/pre-commit-golang
    rev: v1.0.0-rc.1
    # ? add a hook in the order you want to run it
    hooks:
    -   id: go-fmt
        name: go fmt
    -   id: golangci-lint
        name: go lint
        args: [--config .golangci.yaml]

    -   id: go-test-pkg
        name: go test
        args: ["--hook:env:GO111MODULE=on"]
        stages: [push]

But the run result in a weird error:
ERRO Can't get config for command line: can't parse args: unknown flag: --config .golangci.yaml
Since the doc itself recommande to use the --config args, idk what i'm doing wrong to have this error.
I tested with
        args: ["--", --config .golangci.yaml]

since i read that the first "--" is consumed but I'm really blocked rn.
Thank you for help

Hi @Dysta - After a quick glance at your description, I believe what you need is:
args: [--config, .golangci.yaml]

notice the ,
args: [] is an array type and arguments that you would separate with spaces on the command line need to passed as individual array elements here.
The pre-commit code passes each individual argument in a way that treats spaces as part of the same argument.  i.e. without the ',' you're passing a single argument with value "--config .golangci.yaml" which the program doesn't recognize.
Hope that helps ! Give it a try and let me know how it goes - Thanks for taking the time to report an issue and for using my project !
-TW

Hello, sorry for late response, not enough time atm, i'll let you know this monday

Hello, sorry for late response, not enough time atm, i'll let you know this monday

@Dysta No problem, just want to make sure you get it working - Lemme know when you have a chance to look at it.

Hello, sorry for very late response.
It tested with  hooks:     -   id: go-fmt         name: go fmt     -   id: golangci-lint         name: go lint         # entry: golangci-lint run --config .golangci.yaml --timeout 5m0s         args: [--config, .golangci.yaml, --timeout, 5m0s]
and still the same error :
ERRO Can't read config: can't read viper config: open --timeout: no such file or directory
ERRO Can't read config: can't read viper config: open 5m0s: no such file or directory
ERRO Can't read config: can't read viper config: Unsupported Config Type "go"
Note that the "entry" is a workaround that work well

@Dysta  Sorry I forgot an important part, I believe you need:
args: [--config, .golangci.yaml, --timeout, 5m0s, --]

Because your args contain a reference to a file an existing, you need to pass a trailing -- so the hooks know where the args stop and the actual file list begins.
Please try that and report your findings,
-TW

@Dysta Just checking to see if you tested the trialing -- fix ?

Hello, sorry again for the late response, with the trailing -- its working like a charm 👍
Not very clear in the doc thought


While training the  Fashion Segmentation model, is there  a way to train only bbox detection and turn off segmentation

Hi I have a fashion dataset that I want to train. The issue is I have only bbox coordinates with me. I dont want to train segmentation . I am using the configuration deepfashion/mask_rcnn_r50_fpn_15e_deepfashion.py. I am able to train by providing random segmentation points. But the issue is this would impact loss and hence the model (since model is also taking loss for segmentation predictions) so this would affect my detection results as well for the trained model. Is there any way in ehich I can turn off the segmentation mask pipeline in this model. Also if not are there any other alternatives to achieve this ?
Thanks

You could try Faster RCNN by deleting the mask head in the config. An example of faster rcnn is here

I tried using the faster_rcnn_r50_fpn.py model in my configuration. I got the error KeyError: 'the cfg dict must contain the key "type", but got {'num_classes': 15}'
and when I tried editing the configuration of mask_rcnn_r50_fpn_15e_deepfashion.py (making it same as the example you shared). I got the same error again. This is while training the deep fashion dataset (In-Shop) dataset. It does have the segmentation coordinates. I just dont want to use them . Any help on this error would be appreciated. Thanks :-)

You could try Faster RCNN by deleting the mask head in the config. An example of faster rcnn is here

How i can delete mask in faster_rcnn?

You could try Faster RCNN by deleting the mask head in the config. An example of faster rcnn is here

How i can delete mask head in this config? I don't see anything...

_base_ = [
    '../_base_/models/faster_rcnn_r50_fpn.py',
    '../_base_/datasets/deepfashion.py', '../_base_/schedules/schedule_1x.py',
    '../_base_/default_runtime.py'
]
model = dict(
    roi_head=dict(
        bbox_head=dict(num_classes=15)))
# runtime settings
total_epochs = 15

The above codes should work as a Faster RCNN detector. The documentation of the config system might do help to you.


Bug fixed

issues solved:  #725   #718
I fixed the issue with the wishlist page on the website where it showed a 404 error the first time it was accessed.
I also resolved layout issues on the wishlist page, such as misaligned image and header, as well as content overflow or improper containment.
Before:

After:

@KajalBhatt123 Kindly work on a singlee issue in one PR, create a new PR for issue no #718


Model $touches does not like many-to-many relationships

Example models:
class Address extends Eloquent
{
    public $touches = ['people'];

    public function people()
    {
        return $this->morphedByMany('Person', 'addressable');
    }
}

class Person extends Eloquent
{
    public function addresses()
    {
        return $this->morphToMany('Address', 'addressable');
    }
}

Saving an Address gets a exception 'Symfony\Component\Debug\Exception\FatalErrorException' with message 'Call to undefined method Illuminate\Database\Eloquent\Collection::touchOwners(). I'm guessing the model's touchOwners should be looping through the collection since I cannot seem to find a touchOwners() method anywhere but on the Model.
May be a dupe of #6386 ?

Yeh, please can you comment on the original issue, and include this example.


Fix/eslint no unused vars

This pull requests adds eslinting for unused imports and parameters, to prevent them e.g. in #430
For strict function signatures, we make the eslint rule ignore function parameters starting with a _, e.g. function(a: string, _b: string)

@nephix :D let me know when this will be ready for review, that is a great addition :)

@kelsos yes I thought so 😅


Upgrade connect package and add needed dependencies for upgrade

This pr is for #237 and gets rid of the current NPM deprecation warning.

Hi @AveVlad, any chance to release a new version with this PR? Would greatly appreciate it! Thx for your work!


按照魔改的方法搭建，怎么直接报错。。。。。。

Warning: require(/home/wwwroot/face.xxxx.com/vendor/guzzlehttp/promises/src/functions_include.php): failed to open stream: No such file or directory in /home/wwwroot/face.xxxx.com/vendor/composer/autoload_real.php on line 55
Fatal error: require(): Failed opening required '/home/wwwroot/face.xxxx.com/vendor/guzzlehttp/promises/src/functions_include.php' (include_path='.:/www/server/php/56/lib/php') in /home/wwwroot/face.xxxx.com/vendor/composer/autoload_real.php on line 55

请看最新的wiki


Swiper is not working in car carousel.html page

I would like to work on this. I will be using the swiper.js for this .This can help the images move. So can you please assign this to me under @GSSOC'24 @arghadipmanna101

sure. go ahead @suraj-9849

yeah sir the jqeury which is present in the index.html is making the problem I made the changes and included the carousel.html code in the index.html it is working perfectly but when I am keeping the code in the carousel.html it is not working. So what should I do! @arghadipmanna101

ok. keep it in the index.html file

I also added the auto play feature in it sir Thank you for assigning this work to me @arghadipmanna101  sir. I loved to work with this project.

https://github.com/arghadipmanna101/Flipkart_Clone/assets/146669517/46a053c8-b7f5-4820-bda2-7fd86c57e1b5

solve it @suraj-9849


CSV: add support for csvw:null

Motivation:
In tabular data representations, one problem is how to represent the
absence of information; for example, if a field not apply to all rows
what value should be placed in the cell where the information is either
missing or not applicable?
A common solution is to use a place-holder value that represents the
absence of information.  Examples of such place-holder values include
the empty string (""), a dash ("-") or a phrase (or abbreviation
thereof) such as "N.A.".
It would be useful if such place-holder values were identified as such
and RMLMapper refrained for making any corresponding assertions.
The CSVW namespace [1] provides metadata describing a CSV file.  Within
RMLMapper, this may be used to configure the CSV parser.  One feature of
CSVW is its ability to describe how certain values correspond to the
null value.  This is useful as RMLMapper will not include triples
where the object value is null.
Although RMLMapper provides partial support for CSVW, this currently
lacks support for csvw:null assertions.
[1] https://www.w3.org/ns/csvw
Modification:
Add limited support for csvw:null assertions.
CSVW supports potentially multiple csvw:null assertions; however,
Commons CSV parser only supports a single null String (see [2]).
Therefore, support for csvw:null is only partial.
[2] https://issues.apache.org/jira/browse/CSV-293
Result:
A CSV-backed mapping may now be defined with a specific string
identified as a place-holder indicating missing information.  If a cell
contains the place-holder value then any corresponding assertions are
suppressed.  This is achieved using the csvw:null assertion; however,
please note that current support is limited to a single csvw:null
assertion; any subsequent assertions are silently ignored.

Hi!
Thanks for your MR!
It seems we had similar ideas :) Support for this was merged yesterday internally in the development branch with support for multiple NULL strings.
It will be available soon in the next release! In the meantime you can try it from the development branch on Github.
Please let us know if that fixes the issue you're having ;)

Indeed, it's certainly encouraging that we had similar ideas.  I'll definitely need to switch to the development branch!
Also, I noticed that my patch contains a mistake: the code looks for  csvw:null under the csvw:Dialect, rather than the csvw:Table :see_no_evil:
My use-case is actually different.  I would like to suppress specific assertions associated with the cell containing the null String value.
Here is an example:
"id";"acronym";"status";"nature";"rcn"
"824064";"ESCAPE";"SIGNED";"";"219246"

The first row is the header, the second row is the actual data. In this data, not all rows have a nature field and, for those with an empty string, I would like RMLMapper to suppress the corresponding assertions, rather than making assertions using the empty string value.
However, I do still want to generate an instance for this row, with all the non-empty cells contributing assertions.
Commit d14ac9d4 does something different.  It suppresses the entire row if any of the cells contains the csvw:null value.
I can imagine this could be useful under certain circumstances; however, it's a different use-case from mine.
Going back to the definition of csvw:null:

An atomic property giving the string or strings used for null values within the data. If the string value of the cell is equal to any one of these values, the cell value is null.

Note it says cell value here.  It also doesn't say what semantics a null cell value carries.  Therefore, I'd say that RMLMapper is free to react to a cell value being null in whichever way it chooses.
So, perhaps this behaviour could be configured?
For example, RMLMapper could to null cell values by rejecting the specific assertions (my use-case), or by rejecting the entire row (your use-case, I guess).
Would that sound reasonable approach?

@paulmillar Oh good catch!

However, I do still want to generate an instance for this row, with all the non-empty cells contributing assertions.
Commit d14ac9d does something different. It suppresses the entire row if any of the cells contains the csvw:null value.
I can imagine this could be useful under certain circumstances; however, it's a different use-case from mine.
Going back to the definition of csvw:null:

An atomic property giving the string or strings used for null values within the data. If the string value of the cell is equal to any one of these values, the cell value is null.

Note it says cell value here. It also doesn't say what semantics a null cell value carries. Therefore, I'd say that RMLMapper is free to react to a cell value being null in whichever way it chooses.
So, perhaps this behaviour could be configured?

This doesn't need to be configured as the behavior doesn't properly match what was intended with csvw:null :)
It should behave like you said: ignore the cell instead of the whole row.
Would you like to hack on this as you have a nice use case? Or do I make an internal issue so that somebody can have a look?

Hmmm...
I don't know if I'm missing something here but, looking at functional test RMLTC1002a_null-CSVW, it seems like skipping the row is the behaviour @winniederidder intended.
Perhaps we should come up with a consensus view on what effect csvw:null should have, just to make sure everyone's happy.
In terms of hacking on this, yes, I'd be happy to; however, I can only working on this in my spare time, which is (at the moment) very limited and unpredictable.  So, I wouldn't want to promise anything!

@DylanVanAssche Was the intended behaviour not ignoring the entire row? Else the column containing a null value should be set to null, which of course isn't too difficult and can easily be added. But ignoring is how I understood the original issue atleast.

@winniederidder I misread the original issue when checking the MR.

Else the column containing a null value should be set to null, which of course isn't too difficult and can easily be added.

Lets change the behavior into this :)
We can use withNullString() to set the NULL string to the first value of csvw:null and before processing the CSV file, we replace all other possible NULL values provided by csvw:null with the first value of csvw:null.

@paulmillar Don't worry about it ;) We will fix this.
I just wanted to avoid that we both do the same work.

OK, thanks.

@paulmillar We pushed some new commits to development on Github, feel free to check them out and let us know if your issue is resolved :)

Hi @DylanVanAssche ,
I've checked the development branch and it works perfectly for me.
Thanks again!

Awesome! Will be available in the next release then :)


[FEAT]: Scheduled Blog Post with Time Zone Handling (Admin-Only)

Description
Develop backend support to schedule blog posts with time zone handling. This feature will enable admins to create and schedule blog posts for future publication, considering different time zones.
Acceptance Criteria

Blog posts can be scheduled through the API with specified publication times and time zones.

All unit and integration tests pass successfully.

Both API and user documentation are updated to reflect the new scheduled blog post feature.

Purpose
To provide admins with the ability to schedule blog posts for future publication, taking into account different time zones.
Requirements

Admin must be authenticated and authorized.

Develop server-side logic to add scheduled blog posts to the database with time zone handling.

Error Handling

Log errors for invalid requests.

Display clear error messages for invalid inputs.

Security Measures

Use HTTPS for secure data transmission.

Validate user input on the server side.

Expected Outcome

The backend should handle scheduled blog post creation efficiently.

The system should log responses and errors properly.

Endpoints
Endpoint: HTTP POST /api/v1/blog/schedule
Request Body:
{
  "title": "String",
  "content": "String",
  "publication_time": "ISO 8601 datetime string",
  "time_zone": "String"
}

Response (Success):
{
  "id": "String",
  "title": "String",
  "content": "String",
  "publication_time": "ISO 8601 datetime string",
  "time_zone": "String"
}

Response (Error):
{
  "message": "string",
  "status_code": int
}

Tasks

Create an endpoint (HTTP POST /api/v1/blog/schedule) to schedule new blog posts.
Write unit tests for the endpoint.
Write integration tests for the blog post scheduling process.

Testing

[ ]  Write unit tests for authorization and scheduling blog posts.

[ ]  Write integration tests for the end-to-end scheduling process.

[ ]  Perform security testing to ensure data protection and compliance.

Overkill, we do not need post scheduling


python39Packages.ruamel: adopt

Motivation for this change
Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
21.11 Release Notes (or backporting 21.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Ping for eval error, didn't see what exactly was causing it
Hyphenated names look good to me, and appear to be predominant on repology :+1:

Hyphenated names look good to me, and appear to be predominant on repology 👍

and this follows PEP something which is written in the python language docs for nixpkgs.

Some ruamel_yaml occurrences remained.  That now causes a problem, as some places are strict in not allowing aliases, e.g. it would become a channel blocker: https://hydra.nixos.org/build/157517452

I was in the wrong directory when I did the replacement. Fixing that right now.


ModuleNotFoundError

Checklist

[ ] I'm reporting a broken site support issue
[x] I've verified that I'm running yt-dlp version 2021.01.27
[x] I've checked that all provided URLs are alive and playable in a browser
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x] I've searched the bugtracker for similar bug reports including closed ones
[x] I've read bugs section in FAQ

Verbose log

youtube-dlc -v -x -f bestaudio https://www.youtube.com/watch?v=UsYkLXycbYU
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dlc/youtube_dlc/extractor/__init__.py", line 6, in <module>
ModuleNotFoundError: No module named 'youtube_dlc.extractor.lazy_extractors'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/local/bin/youtube-dlc/__main__.py", line 16, in <module>
  File "/usr/local/bin/youtube-dlc/youtube_dlc/__init__.py", line 45, in <module>
  File "/usr/local/bin/youtube-dlc/youtube_dlc/extractor/__init__.py", line 13, in <module>
  File "/usr/local/bin/youtube-dlc/youtube_dlc/extractor/extractors.py", line 58, in <module>
  File "/usr/local/bin/youtube-dlc/youtube_dlc/extractor/anvato.py", line 12, in <module>
ModuleNotFoundError: No module named 'youtube_dlc.extractor.anvato_token_generator'

Description

When trying out the newest master branch to check out if thumbnails would get embedded in opus files, the above error was thrown at me...
Yes, I installed python3-mutagen.
Is this the same issue as https://github.com/animelover1984/youtube-dl/issues/17 ?
And does it even work with Python version 3.6.9?
Previous youtube-dlc version:
youtube-dlc -v
[debug] User config file: /home/nico/.config/yt-dlp/config
[debug] User config: ['--list-formats-as-table', '-i', '-o', '~/Desktop/test-dlc/%(title)s.%(ext)s', '-f', 'bestvideo[height<=1080][ext=mp4]+bestaudio[ext=m4a]/best[ext=mp4]/best', '--no-mtime', '--add-metadata', '--embed-thumbnail', '--force-ipv4']
[debug] Command-line config: ['-v']
[debug] Loading archive file None
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] yt-dlp version 2021.01.24-1
[debug] Python version 3.6.9 (CPython) - Linux-5.4.0-64-generic-x86_64-with-LinuxMint-19.3-tricia
[debug] exe versions: ffmpeg N-100550-gfde5593-Nico-20210104, ffprobe N-100550-gfde5593-Nico-20210104
[debug] Proxy map: {}
Usage: youtube-dlc [OPTIONS] URL [URL...]

youtube-dlc: error: You must provide at least one URL.
Type youtube-dlc --help to see a list of all options.

It works correctly for me. Can you confirm that the token generator (https://github.com/pukkandan/yt-dlp/blob/master/youtube_dlc/extractor/anvato_token_generator/init.py) exists in your source code?

It works correctly for me. Can you confirm that the token generator (https://github.com/pukkandan/yt-dlp/blob/master/youtube_dlc/extractor/anvato_token_generator/init.py) exists in your source code?

They look like the same issue. But it works correctly for me. Can you confirm that the token generator exists in your copy of the source code?
Edit: Also found this: ytdl-org/youtube-dl#27449

Cloned a fresh copy just now to be sure.
The token generator exists (just like yesterday):
./yt-dlp/youtube_dlc/extractor/anvato_token_generator/__init__.py
youtube-dlc -v
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dlc/youtube_dlc/extractor/__init__.py", line 6, in <module>
ModuleNotFoundError: No module named 'youtube_dlc.extractor.lazy_extractors'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/local/bin/youtube-dlc/__main__.py", line 16, in <module>
  File "/usr/local/bin/youtube-dlc/youtube_dlc/__init__.py", line 46, in <module>
  File "/usr/local/bin/youtube-dlc/youtube_dlc/extractor/__init__.py", line 13, in <module>
  File "/usr/local/bin/youtube-dlc/youtube_dlc/extractor/extractors.py", line 58, in <module>
  File "/usr/local/bin/youtube-dlc/youtube_dlc/extractor/anvato.py", line 12, in <module>
ModuleNotFoundError: No module named 'youtube_dlc.extractor.anvato_token_generator'

But when applying the new commit proposed here, it works again!
youtube-dlc -v
[debug] User config file: /home/nico/.config/yt-dlp/config
[debug] User config: ['--list-formats-as-table', '-i', '-o', '~/Desktop/test-dlc/%(title)s.%(ext)s', '-f', 'bestvideo[height<=1080][ext=mp4]+bestaudio[ext=m4a]/best[ext=mp4]/best', '--no-mtime', '--add-metadata', '--embed-thumbnail', '--force-ipv4']
[debug] Command-line config: ['-v']
[debug] Loading archive file None
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] yt-dlp version 2021.01.28
[debug] Python version 3.6.9 (CPython) - Linux-5.4.0-64-generic-x86_64-with-LinuxMint-19.3-tricia
[debug] exe versions: ffmpeg N-100550-gfde5593-Nico-20210104, ffprobe N-100550-gfde5593-Nico-20210104
[debug] Proxy map: {}
Usage: youtube-dlc [OPTIONS] URL [URL...]

youtube-dlc: error: You must provide at least one URL.
Type youtube-dlc --help to see a list of all options.

They look like the same issue. But it works correctly for me. Can you confirm that the token generator exists in your copy of the source code?
Edit: Also found this: ytdl-org/youtube-dl#27449

Cloned a fresh copy just now to be sure.
The token generator exists (just like yesterday):
./yt-dlp/youtube_dlc/extractor/anvato_token_generator/__init__.py
youtube-dlc -v
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dlc/youtube_dlc/extractor/__init__.py", line 6, in <module>
ModuleNotFoundError: No module named 'youtube_dlc.extractor.lazy_extractors'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/local/bin/youtube-dlc/__main__.py", line 16, in <module>
  File "/usr/local/bin/youtube-dlc/youtube_dlc/__init__.py", line 46, in <module>
  File "/usr/local/bin/youtube-dlc/youtube_dlc/extractor/__init__.py", line 13, in <module>
  File "/usr/local/bin/youtube-dlc/youtube_dlc/extractor/extractors.py", line 58, in <module>
  File "/usr/local/bin/youtube-dlc/youtube_dlc/extractor/anvato.py", line 12, in <module>
ModuleNotFoundError: No module named 'youtube_dlc.extractor.anvato_token_generator'

But when applying the new commit proposed here, it works again!
youtube-dlc -v
[debug] User config file: /home/nico/.config/yt-dlp/config
[debug] User config: ['--list-formats-as-table', '-i', '-o', '~/Desktop/test-dlc/%(title)s.%(ext)s', '-f', 'bestvideo[height<=1080][ext=mp4]+bestaudio[ext=m4a]/best[ext=mp4]/best', '--no-mtime', '--add-metadata', '--embed-thumbnail', '--force-ipv4']
[debug] Command-line config: ['-v']
[debug] Loading archive file None
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] yt-dlp version 2021.01.28
[debug] Python version 3.6.9 (CPython) - Linux-5.4.0-64-generic-x86_64-with-LinuxMint-19.3-tricia
[debug] exe versions: ffmpeg N-100550-gfde5593-Nico-20210104, ffprobe N-100550-gfde5593-Nico-20210104
[debug] Proxy map: {}
Usage: youtube-dlc [OPTIONS] URL [URL...]

youtube-dlc: error: You must provide at least one URL.
Type youtube-dlc --help to see a list of all options.

I am trying to identify the root cause of this issue rather than just disabling the token generator all together. But I cant reproduce the issue. I tried python 2.7 and 3.6.9 in addition to 3.8.5 that I normally use. I also tried making a fresh clone. I am not getting the error in any of these cases. If I am unable to find a proper solution, I will just disable the token generator

I am trying to identify the root cause of this issue rather than just disabling the token generator all together. But I cant reproduce the issue. I tried python 2.7 and 3.6.9 in addition to 3.8.5 that I normally use. I also tried making a fresh clone. I am not getting the error in any of these cases. If I am unable to find a proper solution, I will just disable the token generator

Finally found the cause for this. It's an issue in the makefile! same as https://github.com/yt-dlp/yt-dlp/issues/3467


Sprite netsync purge (1st wave)

Going on a crusade soon.
edit: NOW
before:

after:

So on subfloor and items:

Item visibility shouldn't matter because containers + client sets it anyway
Subfloor should be okay because client also sets it too

Subfloor is huge savings, especially on bagel, so is the priority to be converted to visualizer completely.


Fixed correction for && for return without value

Thanks for the awesome work on this gem!
This fixes a correction when a statement ends with return (and no return value).  See the test case for an example.

Nevermind, after further inspection, Rubocop does the correct behavior.  :+1:


reflect: add Value.Equal, Value.Comparable

In Go 1.17 we have introduced a conversion that can panic (#395).  This is the first case in which a conversion can panic.  This means that code that calls reflect.Type.ConvertibleTo and then, if that returns true, calls reflect.Value.Convert, can see an unexpected panic.  (See #46730.)
Separately, for a long time now it has been possible for a comparison to panic, when comparing two interface values that have the same dynamic type but for which the dynamic type is not comparable.  Therefore, for a long time code that calls reflect.Type.Comparable and then, if that returns true, uses the == operator can see an unexpected panic.  (This is a fairly uncommon case as the problem only arises when working with indirectly accessed interface types, such as pointers to interfaces.)
I propose adding two new methods to reflect.Value.
// ConvertibleTo reports whether v can be converted to type t.
// If this reports true then v.Convert(t) will not panic.
func (v Value) ConvertibleTo(t Type) bool

// Comparable reports whether the type of v is comparable.
// If the type of v is an interface, this checks the dynamic type.
// If this reports true then v.Interface() == x will not panic for any x.
func (v Value) Comparable() bool

One very minor observation:

// If this reports true then v.Interface() == x will not panic for any x.

I'm not sure this is quite right. x could be an interface containing a dynamic type that isn't comparable. In the common case, comparing two reflect.Values, you need to call Comparable on both of them. I don't have better wording to suggest.

I think the statement is still true, because if the dynamic types of v.Interface() and x are different, then the comparison is false, and it doesn't matter whether either or both of the dynamic types are not comparable.  In other words, if the dynamic type of v.Interface() is comparable, then either x has a different dynamic type and the result of v.Interface() == x is false, or x has the same dynamic type and the comparison will be run without panicking.

Ah, indeed. Thanks. The relevant sentence from the spec is:

A comparison of two interface values with identical dynamic types causes a run-time panic if values of that type are not comparable.

We have:
func (v Value) Addr() Value
func (v Value) CanAddr() bool

func (v Value) Interface() interface{}
func (v Value) CanInterface() bool

So it sounds like we want to add the second one of these:
func (v Value) Convert(t Type) Value
func (v Value) CanConvert(t Type) bool

And maybe:
func (v Value) Equal(u Value) bool
func (v Value) Comparable(u Value) bool

Comparable seems like a better name than CanEqual here, but Equal seems better than Compare (compare bytes.Compare, bytes.Equal).
We probably want CanConvert at least for Go 1.17.

This proposal has been added to the active column of the proposals project
and will now be reviewed at the weekly proposal review meetings.
— rsc for the proposal review group

Based on the discussion above, this proposal seems like a likely accept.
— rsc for the proposal review group

If a Value is Comparable, does this mean the return from Interface() can be used as a key in a map? I don't think reflect currently has a way to answer this question.

We probably want CanConvert at least for Go 1.17.

Is this still true? The window for doing this is pretty small now.

If a Value is Comparable, does this mean the return from Interface() can be used as a key in a map? I don't think reflect currently has a way to answer this question.

Assuming you have a map[interface{}]T (for some value type T), then yes: if v.Comparable() returns true, you can use v.Interface() as a key value for that map, and no panic will occur.

I sent https://golang.org/cl/334669 in case we do want this in 1.17.

No change in consensus, so accepted. 🎉
This issue now tracks the work of implementing the proposal.
— rsc for the proposal review group

CanConvert has been added for 1.17.  This issue remains open for Equal and Comparable in a later release.

CL 423794 added both Value.{Comparable,Equal}, the issue can now be closed.

Reopen for more discussion about the behavior of Value.Equal for non-comparable. At this moment, the implementation always return false, assuming the two values are valid. The point of Value.Equal is to do the equivalent of ==, so what should we do for non-comparable values? Return false? Panic?
cc @cherrymui @ianlancetaylor

I think it's fine to return false.

Seems a bit counter-intuitive that:
x := reflect.ValueOf([]int{1, 2, 3})
x.Equal(x) // reports false

@dsnet Fair point.  As far as I can tell the only other option is to panic, or to change the signature of Equal.

Given that the language itself panics for equality comparisons on incomparable types, I think it would make sense for Equal to panic for incomparable types, perhaps with a CanEqual method (akin to CanConvert, CanAddr, CanInterface, etc.) that can be used to easily avoid the panic.

Isn't Value.CanEqual more or less identical to Value.Comparable?

Maybe? I don't know: the proposed doc comment is “Comparable reports whether the type of v is comparable”, but for struct types whether Equal panics depends on the (deep) value, not just its (shallow) type.

...which is why Comparable is a method on Value, not Type.

@ianlancetaylor

which is why Comparable is a method on Value, not Type.

It is actually the inverse?

@go101 The Value.Comparable method is new on tip, for 1.20, for #46746.

...which is why Comparable is a method on Value, not Type.

In that case, I think the documentation is confusing — it explicitly states that it reports (emphasis mine) “whether the type of v is comparable”, which on its face seems equivalent to v.Type().Comparable().
(The second sentence does state that “v.Interface() == x will not panic for any x”, but I would prefer that the behavior of the method be described accurately in the first sentence as well.)

We definitely explicitly chose above to call CanEqual Comparable instead (because it matches the language spec term).
If CanConvert returns false and you call Convert anyway, that panics.
(Same for Addr, Set, Float, and so on.)
So if Comparable returns false and you call Equal anyway, it seems like that should panic too.
In any other package panicking would probably not be the answer, but panicking is how reflect signals these kinds of conditions. It would be odd not to panic in this one function.

This proposal has been added to the active column of the proposals project
and will now be reviewed at the weekly proposal review meetings.
— rsc for the proposal review group

Sounds like this function should panic. Moving to likely accept for that decision.

Based on the discussion above, this proposal seems like a likely accept.
— rsc for the proposal review group

Are EqualTo and ComparableWith better method names?

@go101 we already decided the names. This was reopened for the panic behavior.

No change in consensus, so accepted. 🎉
This issue now tracks the work of implementing the proposal.
— rsc for the proposal review group

OK. It is just that Comparable listens like a package-level function name for value comparisons. Not a big matter though.

Everything here has been implemented.


Broken link for "See Email scanning limitations"

The bookmark link is broken in
Email scanning See Email scanning limitations

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 0ede71cb-45c3-0fb4-31e7-3538a0eaffb5
Version Independent ID: 7c295a83-b94a-76ec-4e42-4388c4358170
Content: Configure scanning options for Microsoft Defender AV - Windows security
Content Source: windows/security/threat-protection/microsoft-defender-antivirus/configure-advanced-scan-types-microsoft-defender-antivirus.md
Product: w10
Technology: windows
GitHub Login: @denisebmsft
Microsoft Alias: deniseb

Fixed via community-contributed PR, #8031. Thanks.


[BUG] Too Many Network Interfaces Causes Segfault in chip-tool

Reproduction steps

Build chip-tool, by building Matter. https://github.com/project-chip/connectedhomeip/blob/master/docs/guides/BUILDING.md
Configure multiple network interfaces (50)
Run chip-tool and give it a command to perform  out/host/chip-tool pairing ble-thread 101 hex:0e080000000000010000000300001635060004001fffe002088a4dee6232a203350708fd852c12168e7729051013c250b2ab003e9261ca98546f47739c030f4f70656e5468726561642d623630360102b6060410f2443479159316b89b4dbf67be0e7b230c0402a0f7f8 16544735 1852 --paa-trust-store-path credentials/production/paa-root-certs/

gdb output when hit seg fault:
chip-tool-segfault.txt
Bug prevalence
Every time I have too many network interfaces
GitHub hash of the SDK that was being used
aaa25420f02d353c74677bef6e79abbd46eea463
Platform
other
Platform Version(s)
No response
Anything else?
I was previously working on Android Cuttlefish, and the emulator gave me a whole bunch of extra network interfaces.
I also work remotely so I have to use my company VPN.
If I reboot my laptop (after building chip-tool) and run chip-tool, it will work as expected.
If I then log on to my VPN and try to run chip-tool, I get a segfault error.
If I then disconnect from the VPN, and try again, it will work fine.
I then tried removing the majority of the network interfaces, and just leaving my laptop's built in Network card, docker and company VPN.
I then connected to the VPN, and ran chip-tool, and it ran fine.
So I am assuming there's an error around the network and finding a valid network connection if a user has multiple options?
List if interfaces are included in attached file
list_of_network_interfaces.txt

@luke-ingle When it's crashing, what's the value of watch?

@luke-ingle Also, what does the backtrace look like?  Who is calling StaopWatchingSocket with what I assume is a garbage value (because we do check for null right before that line, so I assume watch is not null).

@bzbarsky-apple
I've attached the backtrace (I think. Haven't had a lot of experience using gdb before)
It appears watch is not null.
gdb_backtrace.txt

@luke-ingle Thank you, that is helpful.  Just to make sure we are looking at the same things, what is line 266 of src/lib/dnssd/minimal_mdns/Server.cpp for you?

No problems, this is what I have:
261 #if !CHIP_DEVICE_LAYER_NONE
262             chip::DeviceLayer::ChipDeviceEvent event{};
263             event.Type = chip::DeviceLayer::DeviceEventType::kDnssdInitialized;
264             chip::DeviceLayer::PlatformMgr().PostEventOrDie(&event);
265 #endif
266             mIsInitialized = true;
267         }
268     }
269
270     return autoShutdown.ReturnSuccess();

OK, thank you.
Does applying this change:
diff --git a/src/inet/UDPEndPointImplSockets.cpp b/src/inet/UDPEndPointImplSockets.cpp
index 5c9748d0cf..98190a0e4d 100644
--- a/src/inet/UDPEndPointImplSockets.cpp
+++ b/src/inet/UDPEndPointImplSockets.cpp
@@ -469,7 +469,13 @@ CHIP_ERROR UDPEndPointImplSockets::GetSocket(IPAddressType addressType)
         {
             return CHIP_ERROR_POSIX(errno);
         }
-        ReturnErrorOnFailure(static_cast<System::LayerSockets *>(&GetSystemLayer())->StartWatchingSocket(mSocket, &mWatch));
+        CHIP_ERROR err = static_cast<System::LayerSockets *>(&GetSystemLayer())->StartWatchingSocket(mSocket, &mWatch);
+        if (err != CHIP_NO_ERROR) {
+            // Our mWatch is not valid; make sure we never use it.
+            close(mSocket);
+            mSocket = kInvalidSocketFd;
+            return err;
+        }

         mAddrType = addressType;

fix the crash for you?

Thanks for the diff, that change doesn't "fix" the crash as such, but at least it now gives a more informative error message.
...
1689580747.101217][12010:12010] CHIP:TS: Last Known Good Time: 2023-07-12T10:24:00
[1689580747.101464][12010:12010] CHIP:ZCL: Using ZAP configuration...
[1689580747.144773][12010:12010] CHIP:-: src/system/SystemLayerImplSelect.cpp:358: CHIP Error 0x000000C1: Endpoint pool full at examples/chip-tool/commands/common/CHIPCommand.cpp:128
[1689580747.144783][12010:12010] CHIP:TOO: Run command failure: src/system/SystemLayerImplSelect.cpp:358: CHIP Error 0x000000C1: Endpoint pool full
[1689580747.154974][12010:12010] CHIP:SPT: VerifyOrDie failure at src/lib/support/Pool.h:337: Allocated() == 0
Aborted (core dumped)

@luke-ingle Thank you for checking that!
Sorry for the lag; I might not be able to get to this until Monday.  But it sounds like there are multiple issues here...

@luke-ingle So I have been trying to reproduce, but setting a low INET_CONFIG_NUM_UDP_ENDPOINTS (6, in this case) on Mac.  I do get failed startup and asserts about it, as somewhat expected, but I do not get the specific "Allocated() == 0" assertion failure you get.  Can you figure out what pool that is, perhaps?  What's the stack to that VerifyOrDie failure at src/lib/support/Pool.h:337 bit?

For now https://github.com/project-chip/connectedhomeip/pull/28245 with the above diff to at least not end up with an invalid memory reference.


REST api GET requests should not modify state

Currently enabling/disabling the firewall is done via HTTP GET requests to the "REST" api.
It is best practice for GET requests to not change the state of the system.  It also has security implications related to cross site request forgery.  I suggest switching to PUT requests for these endpoints.
The PerfMon system also changes state based on GET requests and should be updated to use PUT or POST.

I'm taking a look at the code. Have you run all the unit tests with the changes?

Ran the unit tests, but unless I missed something none of the unit tests cover the rest api. (as an aside the unmodified v1.0 source returns errors for several of the unit tests on my systems)
I tested the patch with a shell script of curl commands to verify there was no change to behavior (other than the GET/POST change).

I have uploaded the script I used for testing as a gist: https://gist.github.com/electricjay/519f7741e8e22b65a073#file-test_rest_firewall-sh
Run the script against patched and unpatched versions of floodlight and diff the results.

You're right. They don't cover the REST API, but I wanted to make sure you ran them in case something else was changed inadvertently.
There is a timing and dependency issue with the unit tests that I haven't had the time to work through yet. They work for me in eclipse but not with ant on one machine of mine. The opposite is true for another machine.
If you are particularly skilled with unit tests and have the time or drive to do so, please feel free to take a look to see if you can spot the issue. I honestly have had higher priorities since they do pass given the right timing/ordering.
Sent from my iPhone
--
Ryan Izard
Graduate Research/Teaching Assistant
306B Fluor Daniel Building
ECE Department, Clemson University
Clemson, SC 29634
<EMAIL_ADDRESS>
On Feb 5, 2015, at 8:34 PM, electricjay<EMAIL_ADDRESS>wrote:
Ran the unit tests, but unless I missed something none of the unit tests cover the rest api. (as an aside the unmodified v1.0 source returns errors for several of the unit tests on my systems)
I tested the patch with a shell script of curl commands to verify there was no change to behavior (other than the GET/POST change).
—
Reply to this email directly or view it on GitHub.

@electricjay I merged your pull request a short while ago, so I'll go ahead and close this now. Thanks again for the valuable contribution!


Offering a helping hand

Firstly, i just want to say i've been looking for a qemu provider for Terraform for some time now and you are a life saver! Now, i've never programmed in golang before so i wouldnt be of much help there, but if you can think of any other way i can help with this project(ie documentation, tutorials etc, by all means let me know. I would be more then happy to help.

Thank you for your interest in the project. I started this to improve my skills in Devops tools and Golang at the same time.
You can make Pull Request with documentation improvements, open issues for features that you really miss from real-life usage (no "it would be cool to..." stuff), contribute examples, and make sure tests, examples and docs are up to date with the documentation. Just make everything via Pull requests.
About code, I am keeping important missing features as open issues, so if you feel brave enough you can try. It is frightening at the beginning but later it is very mechanical (resource, new, delete, modify, etc + tests).

Closing, see you in a future PR!


[Feature Request] support new openai model gpt-4-1106-preview

Is your feature request related to a problem? Please describe.
OpenAI just released a new model "gpt-4-1106-preview", it would be great to have prompt flow support the new model.

+++ please add these models to list:

gpt-3.5-turbo-1106
gpt-4-1106-preview


Saga watcher doesn't catch action

Hello everyone, so here is the problem, when i dispatch action loginAction my saga watcher watchLogin should be able to see it, and then call my saga worker loginWorker, but that doesn't happen, i don't know what i did wrong.
My action works good, but the problem is in watchLogin
// index.js
import RootReducer from './store/reducers/index';
import { Provider } from 'react-redux';
import { createStore, applyMiddleware} from 'redux';
import createSagaMiddleware from 'redux-saga';

import root from './saga/sagas';

const sagaMiddleware = createSagaMiddleware();

const store = createStore(
        rootReducer,
        applyMiddleware(sagaMiddleware)
)

ReactDOM.render(
<Provider store={store} >
        <App />
</Provider> , document.getElementById('root'));
registerServiceWorker();

sagaMiddleware.run(root);

// sagas.js
function* loginWorker(payload) {
    console.log("worker here");
}

function* watchLogin() {
    console.log("watcher here");

    yield takeEvery(LOGIN_REQ, loginWorker)

}

export default function* root() {
    yield all([
        fork(watchLogin)
    ])
}

My action
export function loginAction(email, password) {
    console.log("loginAction here");
    return {
        type: LOGIN_REQ,
        payload: {
            email: email,
            password: password
        }
    }
}

Maybe u dispatch ur action before u run ur saga?
Anyway - issues such as this without runnable example will be closed.


Enable release workflow on PR and upload binaries

Describe your changes
Issue ticket number and link
Checklist

[ ] Is it a bug fix
[ ] Is a typo/documentation fix
[ ] Is a feature enhancement
[ ] It is a refactor
[ ] Created tests that fail without the change (if possible)
[ ] Extended the README / documentation, if necessary

The PR #1946 includes the fix


Write a PHP program to find roots of quadratic equation

Description
Write a PHP program to find roots of quadratic equation
Use the quadratic formula to find the roots of the quadratic equation
x = $(-b &plusmn \sqrt(b^2 - 4ac))/2a$
The input will be the coefficients of $x^2$, $x$, and the constant $c$.
Input  : 1 2 1
Output : -1 -1

Contributed by - @PavanKumarCB

How to contribute

Save the solution in find_roots_of_quadratic_equation.php file
Add find_roots_of_quadratic_equation.php file in program/find-roots-of-quadratic-equation folder

!assign


Save also intermediate values in DORY export

@da-gazzi @spallanzanimatteo this PR saves intermediate values (after CONV/FC, before REQNT) when exporting to DORY. It is very useful for debugging purposes on the accelerator side.
Let me know if you prefer us to change something before merge.


pipenv sync shows misleading error when only Pipfile.lock is present

Issue description
When running pipenv sync with only Pipfile.lock present an error is shown that Pipfile.lock is not present.
Expected result
An error is shown that Pipfile is missing. Or even better pipenv sync should work without a Pipfile being present.
Actual result
An error is shown that Pipfile.lock is missing but it is present.
Steps to replicate
rm Pipfile
pipenv sync

Output:
[pipenv.exceptions.LockfileNotFound]:   File "/usr/local/lib/python3.7/site-packages/pipenv/vendor/click/decorators.py", line 64, in new_func
[pipenv.exceptions.LockfileNotFound]:       return ctx.invoke(f, obj, *args, **kwargs)
[pipenv.exceptions.LockfileNotFound]:   File "/usr/local/lib/python3.7/site-packages/pipenv/vendor/click/core.py", line 555, in invoke
[pipenv.exceptions.LockfileNotFound]:       return callback(*args, **kwargs)
[pipenv.exceptions.LockfileNotFound]:   File "/usr/local/lib/python3.7/site-packages/pipenv/vendor/click/decorators.py", line 17, in new_func
[pipenv.exceptions.LockfileNotFound]:       return f(get_current_context(), *args, **kwargs)
[pipenv.exceptions.LockfileNotFound]:   File "/usr/local/lib/python3.7/site-packages/pipenv/cli/command.py", line 615, in sync
[pipenv.exceptions.LockfileNotFound]:       pypi_mirror=state.pypi_mirror,
[pipenv.exceptions.LockfileNotFound]:   File "/usr/local/lib/python3.7/site-packages/pipenv/core.py", line 2589, in do_sync
[pipenv.exceptions.LockfileNotFound]:       raise exceptions.LockfileNotFound("Pipfile.lock")
ERROR: Pipfile.lock not found! You need to run $ pipenv lock before you can continue.

I believe this is reported somewhere, i am also not sure if it was fixed on master branch, can you have a try?

@frostming Yes. It seems solved
Verification:
I verified by setting up the dev-env according to here and then running:
$ pipenv --version
pipenv, version 2018.11.27.dev0
$ pipenv install
...
$ rm Pipfile
$ ls
Pipfile.lock
$ pipenv sync
Creating a Pipfile for this project…
Installing dependencies from Pipfile.lock (a65489)…
  🐍   ▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉ 0/0 — 00:00:00
All dependencies are now up-to-date!
$ ls
Pipfile  Pipfile.lock

Test Configuration:

Pipenv version: 2018.11.27.dev0
OS: python:3.7 docker container on ubuntu 19.10
python version: 3.7

I thereby think this issue can be marked as solved.

So in the end, this issue is already solved? Can we close this issue if it is?

I don't think so. Urhengulas has shown the part-way result in my opinion - it has not been confirmed the content of the Pipfile. My testing also results in creating Pipfile but it has only basic structure with python version and empty [packages] part;
'check', 'sync', 'install --dev' do not change it.... so if the issue's acceptable solution should be Pipfile as  it was before deleting there is still need for finding it:).
I am a real freshman in programming so few chances to do it myself :) but the pipenv project seems to me really attractive and absolutely worthy of continuation, it is also my first effort in learning how libraries work and how to participate/contribute in open source projects.

I believe this error is no longer present.   We are tracking getting pipenv sync to work properly without the sources from the Pipfile in this ticket:  #5353


Add loadBalancer client config.

Fixes #147
Add a loadBalancer section to the client config where a load balancer can be
specified and configured.  The load balancers that are currently supported are
p2c, ewma, aperture, and heap.

:star: This looks like a useful thing to be able to configure.

lgtm :+1: :star:

:star: rebase


Change the width of the tour steps

This is a follow up ticket to https://github.com/itchysats/itchysats/pull/1961
On large screens the restricted width of the tour steps feels a bit awkward.
We should be able to set the width by modifying the intro.js CSS classes.

There is no more tour in ItchySats :)

There is no more tour in ItchySats :)

why not? 😅 I think something like that would have helped me with my initial questions on the taker ui 🙈

I doubt it 🙈 the library we used was too annoying to use and quite buggy.


Website timing out

Hi,
Sorry this probably isn't the best place for it but your contact page won't send either., in case you aren't aware there seem to be some issues with the site my whole party are getting constant time out errors, if you are lucky the page might load after a dozen attempts.
I love the site and thanks for your work!
Lewis

seems like we are having a massive ammount of users this year. I'm keeping an eye on it now. Thanks for sharing this info


failed to load include fields on production mode by blocks

Hi,
I load blocks with with getResourceObjectFromContext in the getStaticProps
 const [footerContact] = await drupal.getResourceCollectionFromContext<any>(     'block_content--footer',     context,     {       params: getParams({ name: 'block_content--footer' })         .addInclude(['field_form'])         .addFilter('info', 'footer-contact')         .getQueryObject(),     }   );
This is a normal block element and I filter this by his info. The getParams function is a copy of the Umami example from you.
if (name === 'block_content--footer') {     return params.addFields(name, [       'field_headline',       'field_form',       'body',       'field_icon',       'field_link',     ]);   }
My problem is:
In the local environment is no problem to load the form. But if I develop this in production mode, the include field will not return any relationships anymore, so I became a empty form only with the relationship information but no content.

Hmm. Is there any difference, say permissions, on your prod site vs the dev one? If the relationship field_form exists and the Next.js site has access to it, it should behave the same way on both prod and dev.


[Ninja Build] 4 tests failing. no such module 'CxxShim'

Describe the bug
After building the toolchain via Ninja with the command specified here, 4 tests fail, all complaining no such module 'CxxShim'.
Steps To Reproduce
Just run
utils/build-script --skip-build-benchmarks \
  --skip-ios --skip-watchos --skip-tvos --swift-darwin-supported-archs "$(uname -m)" \
  --sccache --release-debuginfo --swift-disable-dead-stripping --test

Expected behaviour
No tests failing (except the ones expected to fail).
Environment (please fill out the following information)

OS: macOS 12.4 on M1 MacBook Air
Xcode Version/Tag/Branch: Xcode 13.4.1 (13F100)

Full output
testsOutput.txt

Hashes: hashes.txt

Just recompiled everything, ran the tests, and everything is looking good now. Good, but weird. 😅 Closing this.


naming advice around inj and ext

I think it's good to codify what has been an implicit naming practice already. I'm fine with merging this. @bryangingechen @robertylewis @digama0 any comments?

I'm happy with merging this too.

I'm not entirely up on the naming conventions but this looks fine to me. I don't think the trailing ###s are necessary.

I don't think the trailing ###s are necessary.

They're just there for consistency with the rest of the file, I think. We can get rid of them in a cleanup pass later on. See #62 as well as the duplicated variable names table in style.md.


Feature request: allow logs to be partitioned per party involved in query runs

Currently Draft mixes logs from RC and 3 helpers, which is convenient to see overall progress. Sometimes, though, I just want to see logs from H1, H2 or RC. The current UI does not allow me to see that. This is a request to add this functionality

added w/ #63


Throughout and latency

How to get throughout and latency information?
Throughout could be get at the latest step(operation), simply log how many data received in a period of time.

Throughput should be logged at each operator step

Spark streaming latency is a little special to test.

Spark throughput could be find in self-implemented UI component of Spark. https://databricks.com/blog/2015/07/08/new-visualizations-for-understanding-spark-streaming-applications.html

Next step is parallel data generator and performance logging statistic


add screenshots to readme

Add and present updated screenshots og the site.

Addressed in:

https://github.com/semanticdata/semanticdata.github.io/commit/c3965b734c861a4ae6a3ba31de227c530349d9fb


Can you let vscode read .vscode/extensions from both global and in project folder?

Sometimes we may want to create extension only for project to share with our team and don't need to have them install extension. It should be easy to just send whole project folder contains .vscode/extensions folder to them

Duplicate of #347


Enhance Result.on_named_selection()

Description of the feature
The Result.on_named_selection() method, see docs could have an additional argument requested_location, similar to the scoping.on_named_selection(), see docs.
This would fix the behavior I am having: I am requesting the displacements on a named selection and I end up with a displacement field that has elemental location. See code below.
from ansys.dpf import core as dpf
from ansys.dpf.core import examples
model = dpf.Model(examples.download_all_kinds_of_complexity())
disp_selection_fc = model.results.displacement.on_named_selection(named_selection="_CM82").eval()
print(disp_selection_fc[0].location)

Again, this could be fix by adding an extra argument as:
disp_selection_fc = model.results.displacement.on_named_selection(named_selection="_CM82", requested_location="nodal").eval()

Steps for implementing the feature
N/A
Useful links and references
N/A

I have found a workaround by doing
from ansys.dpf import core as dpf
from ansys.dpf.core import operators as ops
from ansys.dpf.core import examples
model = dpf.Model(examples.download_all_kinds_of_complexity())
scoping_op = ops.scoping.on_named_selection()
scoping_op.inputs.requested_location.connect("nodal")
scoping_op.inputs.named_selection_name.connect("_CM82")
scoping_op.inputs.data_sources.connect(
    dpf.DataSources(examples.download_all_kinds_of_complexity())
)
mesh_scoping = scoping_op.outputs.mesh_scoping()
disp_selection_fc = model.results.displacement.on_mesh_scoping(mesh_scoping).eval()
print(disp_selection_fc[0].location)

Still, I think it would be nice to add the extra argument requested_location in on_named_selection as initially described in this issue so we don't have to explicitly use the scoping operator.


Breaking Changes PR check not flagging removed property as breaking

The Breaking Changes PR check in the azure-rest-api-specs repo is failing to flag a removed property as breaking and requiring a Breaking Change review.
REST API PR: https://github.com/Azure/azure-rest-api-specs/pull/20009
The Breaking Changes-Cross Version PR check issued a warning for the removed property:

Here is the actual change:

Any property being removed should be flagged as a breaking change even in a new API version.
cc: @JeffreyRichter @srmantha

@mikekistler this is because all the api-versions of the RP are preview and no stable version, so the breaking change are allowed per breaking change policy , then we flag it as warning

Thanks @jianyexi, that's good to know. Could you please update the breaking changes doc in your PR to explain this subtle point? Thx.

@mikekistler it's already described in https://github.com/Azure/azure-rest-api-specs/blob/master/documentation/ci-fix.md#breaking-change-check

Fair enough.

It seems that the situation is not quite as simple as this. The breaking changes check do flag some breaking changes as errors even when there is no prior stable version. PR #8244 is an example:

What is the explanation for why these breaking changes are reported as errors even though there is no prior GA version?

if we can know the last preview is over 1 year (consider the api-version as date ), we will consider it as stable version, it's already described in the documentation

One exception is that some data-plane Api-version follow the pattern like 'preview/v1', so we always treat them as preview version. let me know if you want to have different strategy


Get Dockstore WebService Running Locally

Done: When Dockstore WebService is running locally and curl calls can be made against it.
Natalie, Louise, and Ryan just went through this exercise, so please talk to them if you have questions.
┆Issue is synchronized with this Jira Story
┆Issue Number: DOCK-527

This looks like someone added it int the wrong place.


Use a single file for migration + release notes

we decided to show only the notes for the respective version in the docs, instead of all incremental distro upgrades
this makes backports easier and should avoid merge conflicts in the docs.
needs https://github.com/ros-controls/control.ros.org/pull/324

The CI is giving a strange error message while there are only 2 warnings and no visible error.

The CI is giving a strange error message while there are only 2 warnings and no visible error.

That's normal, the CI job considers warnings as errors and fails if it doesn't find files for example.


Modify NewtonMinimizer so that it forces Hessian to be positive definite

The current Newton's method implementation has no option to force Hessian to be positive definite, which is a common technique to improve convergence.
In the current implementation the algorithm will not converge to the global minimum if the following conditions are met:

Hessian is indefinite
Directional derivative is negative
Initial guess is close to a local maximum and the desired global minimum (too vaguely described to be very useful condition but there are cases where the above two are true and the algorithm still converges so I thought I would mention this anyway)

This may not be a complete description of cases when forcing positive definiteness is helpful but I ran into such a case and can illustrate with the Six Camel Hump Function
Below is a contour plot of this function with areas that satisfy the first two requirements above highlighted in dark blue. I have picked some points out of those areas and confirmed that the NewtonMinimizer implementation does not converge when using those points as initial guesses.

It would be interesting to write a test that iterates through a grid in the domain above to see if those two conditions are necessary/sufficient for non-convergence but I don't currently have the time and it is outside the scope of this issue.
To restate, an option should be added to NewtonMinimzer that forces the Hessian to be Positive Definite.
I will shortly create a pull request with my proposed solution to this issue.
Regards,
Mikhail

Created and linked a pull request to address this issue. The code changes include a unit test which initializes the NewtonMinimizer at point {1, -0.6} (in one of the blue areas above). If no modification of the Hessian is performed then the algorithm converges to the local maximum of {1.109205317132443, -0.76826824818394157}.


[FLINK-28889] Hybrid shuffle supports multiple consumer and broadcast optimization

What is the purpose of the change
Hybrid shuffle does not support multiple consumer for single subpartition data. This will bring some defects, such as the inability to support partition reuse, speculative execution. In particular, it cannot support broadcast optimization, that is, hybrid shuffle writes multiple copies of broadcast data, This will cause a waste of memory and disk space and affect the performance of shuffle write phase. Ideally, for the full spilling strategy, any broadcast data (record or event) should only write one piece of data in the memory, and the same is true for the disk.
Brief change log

full spilling strategy is no long consider consumer offset
supports multiple consumer.
supports broadcast optimize

Verifying this change
This change added unit tests.
Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): no
The public API, i.e., is any changed class annotated with @Public(Evolving): no
The serializers: no
The runtime per-record code paths (performance sensitive): no
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no
The S3 file system connector: no

Documentation

Does this pull request introduce a new feature? no

@flinkbot run azure

@flinkbot run azure

@flinkbot run azure

@flinkbot run azure

@flinkbot run azure

@flinkbot run azure

@flinkbot run azure

@flinkbot run azure


Add Survival TMLE

Add a survival-analysis TMLE. Should be similar to the LTMLE, but need to find a good example

Will incorporate this into LTMLE instead of being a distinct class. From my understanding, you would need to coarsen the data for a survival TMLE (which would become LTMLE)


chore(crypto-icons): deduplicate the crypto icons back into the ui library

📝 Description

copied all the missing icons from live-common to crypto-icons to reunite and align the list of our crypto icons.
removed completely all data/icons of live-common.

the src/react and src/reactNative entry points of live-common are preserved as-is to lower the impact of this PR. Their usages are however deprecated in the general direction of moving React out of live-common. the recommendation will be to directly use the icons from @ledgerhq/crypto-icons-ui library in combination with @ledgerhq/live-common/currencies/cryptoIcons. There is also a small cost of them because we had to polyfill the live-common wrapper them to preserve the behavior of the SVG, which were defaulting on currentColor on live-common where the UI library had the coin color encoded there as a default.

❓ Context

JIRA or GitHub link: https://ledgerhq.atlassian.net/browse/LIVE-8942

✅ Checklist
Pull Requests must pass the CI and be code reviewed. Set as Draft if the PR is not ready.

[ ] npx changeset was attached.
[x] Covered by automatic tests.
[x] Impact of the changes:

LLD and LLM: all icons of currencies and tokens. they should stay as-is. (non regression)

🧐 Checklist for the PR Reviewers

[ ] The code aligns with the requirements described in the linked JIRA or GitHub issue.
[ ] The PR description clearly documents the changes made and explains any technical trade-offs or design decisions.
[ ] There are no undocumented trade-offs, technical debt, or maintainability issues.
[ ] The PR has been tested thoroughly, and any potential edge cases have been considered and handled.
[ ] Any new dependencies have been justified and documented.
[ ] Performance considerations have been taken into account. (changes have been profiled or benchmarked if necessary)

it's unclear why the lib would be considered duplicate now, i think it's a false positive since the bundle decrease.


Humio agent

Mesos framework for forwarding task logs to Humio.
By default it will deploy a Filebeat on all (including public) nodes in the cluster.

@mwl please submit a documentation example PR against this repo: https://github.com/dcos/examples
You can use the templates from other examples there. This is now a requirement for submitting a package to Universe.

@ryadav88 Sure. I've submitted https://github.com/dcos/examples/pull/231

@ryadav88 "Mesosphere repo validation (version-3.x)" validation now seems to be failing. I don't have access to see that build. So maybe you can shed some light on the issue? -Or create me an account on TeamCity?

Never mind.
Seems to have been solved with another build. @ryadav88 What's the next step?

Thank you very much!


autoEffect make ref undefined ?

Hi friend how to use autoEffect with ref ?
example
const Module = () => {
  const lstore = store({ action: false });
  const REF = useRef(null);

  autoEffect(() => {
    if (lstore.action) {
      doSomethingWith(REF.current);
    }
  });

  return
...
;
};

the first consumption work fine, but after REF.current are always undefined.
Am doing something wrong ?

ok i found , need  to put inside store !
store({ action: false, ref: useRef(null), });


Explore working with offer ID's

As PO
I want to improve the way we work with offer ID's
So that it easier to add new offers with a unique offer ID and keeping the sequencing in tact and so that a link shared through the WhatsApp Helpdesk doesn't change when an offer ID is altered.
Input Carry:
Whenever districts add new offers in the excel file, the offer id of the offers that are already in the file changes. This offer ID is in the link, therefore it can be that for example a link that first brought you to information about Wereldhuis wil then later bring you to information about winter shelter. This is not very handy because districts send specific links to organisations that they can use. I don't know if this is clear, I can explain it to you during our call. And maybe you were already aware of this..:)

WIP:

Add feature-flag: useUrlSlugs
deploy step-by-step: dev → demo → staging UKR → staging → production UKR → production
Add demo-content to staging sheets as instructions?
Add initial slugs by hand? Semi-automated via Sheet-formula?
Add data-validation to column?

Also to Q&As? + fix existing data.

start with only Offers? Or also (sub-)categories in 1 big sweep?
add upgrade-redirects for old URL-format. (How?)

New URL-format:

/``$region``/``$category-slug``/``$sub-category-slug``/``$offer-slug``/

?


New Crowdin translations

Enjoy!

Hey @teolemon,
Something went wrong with the build.
TravisCI finished with status errored, which means the build failed because of something unrelated to the tests, such as a problem with a dependency or the build process itself.
View build log
TravisBuddy Request Identifier: f7aecd80-c40c-11e8-8e42-fbce93bf2ec8

Hey @teolemon,
Something went wrong with the build.
TravisCI finished with status errored, which means the build failed because of something unrelated to the tests, such as a problem with a dependency or the build process itself.
View build log
TravisBuddy Request Identifier: c2975010-c40f-11e8-8e42-fbce93bf2ec8

Hey @teolemon,
Something went wrong with the build.
TravisCI finished with status errored, which means the build failed because of something unrelated to the tests, such as a problem with a dependency or the build process itself.
View build log
TravisBuddy Request Identifier: 52aed330-c410-11e8-8e42-fbce93bf2ec8

Hey @teolemon,
Something went wrong with the build.
TravisCI finished with status errored, which means the build failed because of something unrelated to the tests, such as a problem with a dependency or the build process itself.
View build log
TravisBuddy Request Identifier: 347c58e0-c412-11e8-8e42-fbce93bf2ec8


Automated Package Upgrade

:tada: This PR is included in version 25.6.93 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


[CodeComplete] Offer completions for the names: argument of a macro declaration

When completing after names:, completion should offer the different ways you can specify the names, i.e. arbitrary, named, etc.
@attached(member, names: #^COMPLETE^#)

rdar://108535077

@swift-ci Please smoke test

@swift-ci Please smoke test macOS

@swift-ci Please smoke test macOS


WDC-457: Document fetch credential header handling on cross-origin redirects

While we are currently following the fetch spec, I believe it would be helpful to document this behavior.

Context in https://github.com/node-fetch/node-fetch/pull/1449

LGTM, don't think I'm a codeowner though


Game token

Hello as the title says, i get the message that there's no game token, so the server will only function in LAN-mode. I cannot see any where in this guide about the game token.
Thanks

I got it to work by creating a token here: https://steamcommunity.com/dev/managegameservers
And then use that token with CS2_ADDITIONAL_ARGS=+sv_setsteamaccount <yourtoken>
In my mind the token that is created with STEAMCMD should work as well, but I cannot find why that's not the case. Just using STEAMUSER=myusername shows incorrect password on starting the server.

Closed by #9.


Making sure to provide as few NAs as possible for background functional groups

@jhpoelen @Dengaloo
The “osm_param-ltl.csv” file provides estimates for three parameters: “plankton.size.min.plkX”, “plankton.size.max.plkX” and “plankton.TL.plkX”.
The default values of these three parameters (which are specified in “fishbase-mapping.csv”) are problematic.
Indeed, it is impossible to specify a default value for these three parameters for all the fish and invertebrates recorded in FishBase and SeaLifeBase.
To solve this issue, we have two options:
(Option 1) Setting the default value of the “plankton.size.min.plkX”, “plankton.size.max.plkX” and “plankton.TL.plkX” parameters to “NA” (not available) in the “fishbase-mapping.csv” file.
Or
(Option 2) Implementing a rule of thumb in the API such that, if the API is unable to define a value for one parameter (for example “plankton.size.min.plkX”) for a given functional group, it uses information for the other species belonging to the genuses, families and orders considered in the functional group. (These other species can be found anywhere across the globe).
For instance, let’s say that:
(i) We are dealing with the Iceland Shelf/Sea ecosystem and that the bridge between FishBase/SeaLifeBase and OSMOSE defines a functional group called “demersalmollusc” for us.
(ii) We choose to define “demersalmollusc” as a “background” functional group.
(iii) The “demersalmollusc” functional group includes three species: Falcidens thorensis (Aplacophora), Prochaetoderma clenchi (Aplacophora) and Micropilina minuta (Monoplacophora).
(iv) Estimates are not available for Falcidens thorensis, Prochaetoderma clenchi and Micropilina minuta to define a value for the parameter “plankton.size.min.plkX” for the “demersalmollusc” functional group.
(v) Then, the API: identifies the genuses, families and orders to which Falcidens thorensis, Prochaetoderma clenchi and Micropilina minuta belong; and uses the information available for all the species that belong to the genuses, families and orders to which Falcidens thorensis, Prochaetoderma clenchi and Micropilina minuta belong to define a value for the parameter “plankton.size.min.plkX” for the “demersalmollusc” functional group.
Personnally, I prefer Option 2. We do not want to provide a lot of NA’s to the user; this would be frustrating to them.
Plus I am not sure that the API can handle something else than numbers regarding the default values taken from the “Default value” column of the “fishbase-mapping.csv” file.  @jhpoelen Is that correct?
But then, if we choose Option 2, how should the estimates be computed?
I was thinking that the best option in the case presented above would be to: (i) consider all the minimum size estimates available for the species that belong to the genuses, families and orders to which Falcidens thorensis, Prochaetoderma clenchi and Micropilina minuta belong; and (ii) produce a mean estimate from all the available estimates.
Please let me know what you think.
After I have received your input, I will close the present issue and will create new API issues.
Many thanks.

I'd say that option 1 and 2 are not mutually exclusive: explicitly
stating that default for mentioned plankton properties as not available
"NA" does not excluding being able to derive the properties from species
beyond the current functional group species list provided by the UI.
I've implemented option 1. Please see my comment in #115 for discussion
around option 2.

@jhpoelen
This comment is very similar to the last comment I made in #115
Here is what I think we should do.
Let’s say that we are dealing with a background group called “cephalopods” and the parameter “trophic level” or “TL”.
(1) For that “cephalopods” functional group, the UI has identified, say, 20 species.
(2) Before passing information to the API, the UI appends to these 20 species: all the species that belong to the genuses, families and orders of the 20 species. Let’s say that this results in a list of 500 species in total (20 species + 480 appended species).
(3) When the API receives the list of 500 species from the UI, it first considers only the 20 species that belong to the “cephalopods” functional group.
-> (i) Case 1: data are available to derive a value for the parameter “TL” for some of the 20 species that belong to the “cephalopods” functional group. In that case, the “data richness” rule described in #59 is applied to derive a parameter estimate for the parameter “TL” for the “cephalopods” functional group.
-> (ii) Case 2: data are not available to derive a value for the parameter “TL” for none of the 20 species that belong to the “cephalopods” functional group. In that case, the API will consider the 480 appended species to see if it can derive a value for the parameter “TL”.
(4) If we have faced Case 2 above, then:
-> Case 1: data are available to derive a value for the parameter “TL” for some of the 480 appended species. In that case, the “data richness” rule described in #59 is applied to the list of 480 appended species to derive a parameter estimate for the parameter “TL” for the “cephalopods” functional group.
-> (ii) Case 2: data are not available to derive a value for the parameter “TL”  for none of the 480 appended species. In that case, the API will provide the value NA for the parameter “TL” for the “cephalopods” functional group.
Does this sound good to you?
If so, could you please interact with @FIN-casey and @FIN-JBarile to implement what is described above?

See https://github.com/jhpoelen/fb-osmose-bridge/issues/115#issuecomment-306239311 .

@FIN-casey @FIN-JBarile Please implement what is described above; and let me know when you think this issue has been solved so that I can run a new test with the bridge between FishBase/SeaLifeBase and OSMOSE. Many thanks.

I have the same comment in 115.

@FIN-casey @jhpoelen I made the same comments in #115 :
@FIN-casey
Here are my answers to your comments:
(1) I think that it would be better not to have a maximum number of species for the extended list for every functional group; this way, we would maximize the probability to obtain a value for parameters.
However, I guess that, for computional and practical reasons, you may want me to decide of a maximum number of species for the extended list for every functional group. Is this the case? If so, then please let me know and I'll provide you with a maximum number.
(2) You are right that we should think of a way to distinguish between the original list of species and the list of additional species. I think that distinguishing between "taxa" and "othertaxa" is an excellent idea. This way, the API will be able to work first with "taxa" only; and will then consider "othertaxa", if need be.
@jhpoelen Please see my comments above.
Could you please make sure that the "functional_groups.csv" file that is provided in the "osmose_config.zip" file lists only "taxa" (and, therefore, does not provide any information about "othertaxa").

@agruss2 it seems to me that issues #115 and #114 are resolved. The recently discussed topics related to the maximum group length and taxon selection criteria seem related, but probably worthy of their own issue considering the cross posting of comments.

@jhpoelen I am not sure if the present issue is resolved.
I made another test today, where I queried parameter estimates for Iceland Shelf/Sea ecosystem, and I still obtain a lot of NAs for different parameters; please have a look at the files stored in this zip file:
osmose_config.zip
Please let @FIN-casey and me know what you think.
Many thanks.

If seems that the list of extended taxa is not sent from UI to API. See https://github.com/jhpoelen/fb-osmose-bridge/issues/115#issuecomment-322600357 .

See my comment on #115

See my comment in #115. Does not appear to be an API issue. Changing label, and associated assignments.

Same comment in #115.

@FIN-casey @jhpoelen I just ran a test and I can confirm that the implementation is successful; many thanks Casey! Therefore, I am going to close the present issue.
However, please note that I see some potential areas of improvement. Therefore, I will soon create new GitHub issues to address some minor problems.

@jhpoelen @FIN-casey
I am reopening this issue, because I am still having a few NAs here and there for background functional groups.
Therefore, I think that, for each background functional group, we should increase the number of species that the bridge between FishBase/SeaLifeBase and OSMOSE considers in addition to the species making up the background functional groups.
How many additional species does the bridge currently consider for each background functional group?
How much could we increase that number without making the bridge crash?
Many thanks.

@agruss2 there is no restriction on the number of additional species. I cant identify how much is the maximum number that the wizard can handle. Maybe @jhpoelen has an idea.
Same comment on #115.

I haven't done any performance tests to check how long a species list can be. I do imagine the performance depends on the data richness of the species in the list: the more data, the faster the creation of the generation of related osmose configuration will be.
I'd like to suggest two things:

close issues #115 and #114 (this issue) - the issues are the same, as seen in the duplication of comments.
open a new, specific issue for the NAs - the issue describes specifically step-by-step instructions on how to reproduce what @agruss2 is seeing . Also, the issue would include an expected behavior with specific description (e.g., silly example: I expect a value for ear size of fish of functional group with species mickey, donald and minni.).