Redundant rule templates about MFA Rejection/Deny

There are two redundant rule templates for basically the same thing. Please merge them or at least add a deprecation warning to the legacy one.

https://github.com/Azure/Azure-Sentinel/blob/master/Solutions/Microsoft Entra ID/Analytic Rules/ExplicitMFADeny.yaml

https://github.com/Azure/Azure-Sentinel/blob/master/Solutions/Microsoft Entra ID/Analytic Rules/MFARejectedbyUser.yaml

Hi @roniegh, Thanks for flagging this issue, we will investigate this issue and get back to you with some updates by 03-05-2024. Thanks!

Hey @roniegh, Thanks for highlighting the templates. As per the use case description of both templates, they can be used as MFA denies/rejected. but the "MFA Rejected by User" rule is more enhanced to identifying potentially compromised accounts by considering user behavior and risk factors as compared to "Explicit MFA Deny". Sharing doc for more detail's info and reference:-
https://docs.microsoft.com/azure/active-directory/fundamentals/security-operations-user-accounts#monitoring-for-failed-unusual-sign-ins
So, closing this issue. If you still need support for this issue, feel free to re-open it any time. Thank you for your co-operation.

Hey @roniegh, Thanks for highlighting the templates. As per the use case description of both templates, they can be used as MFA denies/rejected. but the "MFA Rejected by User" rule is more enhanced to identifying potentially compromised accounts by considering user behavior and risk factors as compared to "Explicit MFA Deny". Sharing doc for more detail's info and reference:- https://docs.microsoft.com/azure/active-directory/fundamentals/security-operations-user-accounts#monitoring-for-failed-unusual-sign-ins So, closing this issue. If you still need support for this issue, feel free to re-open it any time. Thank you for your co-operation.

@v-sudkharat I didn't find anything on the aforementioned doc in regards to diferences between the redundant rules. The only reference I see is a link to a past version of the MFARejectedbyUser rule.
Both rules query the same table SigninLogs with virtually the same where clause. While the MFARejectedbyUser rule returns more information, the ExplicitMFADeny rule also queries the AADNonInteractiveUserSignInLogs table.
Also, as you can see by @shainw post in https://github.com/Azure/Azure-Sentinel/issues/3516#issuecomment-978033144 the MFARejectedbyUser rule was added without checking if such a rule already existed.
Could you please explain what you mean by "MFA Rejected by User rule is more enhanced to identifying potentially compromised accounts by considering user behavior and risk factors as compared to Explicit MFA Deny" ?

@roniegh, Sure, Happy to reopen this case and share info with you.
Agreed to your comment, both the tables are using same table name and also having same target, but it is having the difference in connector id's they are using. Like "MFA Rejected by User" rule uses BehaviorAnalytics connector, which allows for a more comprehensive analysis by considering behavioral patterns and risk factors associated with user activities. And Explicit MFA Deny uses the MicrosoftThreatProtection one. So completely removing the rule will may affect to other customer if they have configured it with the different sources. Regarding to the deprecation of old one, let us check with @shainw, if they have any plan for it.
Thanks!

@roniegh, Sure, Happy to reopen this case and share info with you. Agreed to your comment, both the tables are using same table name and also having same target, but it is having the difference in connector id's they are using. Like "MFA Rejected by User" rule uses BehaviorAnalytics connector, which allows for a more comprehensive analysis by considering behavioral patterns and risk factors associated with user activities. And Explicit MFA Deny uses the MicrosoftThreatProtection one. So completely removing the rule will may affect to other customer if they have configured it with the different sources. Regarding to the deprecation of old one, let us check with @shainw, if they have any plan for it.
Thanks!

@v-sudkharat Could you please explain how MFARejectedbyUser's current code is doing the "more comprehensive analysis by considering behavioral patterns and risk factors associated with user activities" ?

@ashwin-patil - please have a look at this.


handle map

Overview
This PR makes handles the map for the board member page and the individual members pages.
Notes
Testing Instructions
Move councilmatic/settings_deployment.py.example to councilmatic/settings_deployment.py.
If setting up for the first time.
docker-compose up scrapers
docker-compose run --rm -e DJANGO_MANAGEPY_MIGRATE=off app python manage.py migrate
convert_attachment_text
docker-compose run --rm -e DJANGO_MANAGEPY_MIGRATE=off app python manage.py update_index --batch-size=100
docker-compose up

If you have existing local repo
docker-compose down
docker-compose build app
docker-compose up

Check out the board members page, and ensure that hover on the map and hover on the entry on the table works as expected. For example on the City of LA layer, hovering on Garcetti should highlight the map but that the map should not highlight for anyone else.
Check detail pages.

I don't have insight into the speed issue, I suspect it may be addressed by the caching. Let's wait and see on that?

only the mayor should be highlight.

@fgregg Okey doke, I agree we can wait and see what caching does for us.

responded to your requests.


Change coord to coordinates in compas_fab.robots.robot.to_local_coords & to_world_coords

Change coords to coordinates in compas_fab.robots.robot.to_local_coords & .to_world_coords to use the same convention as compas 0.16.
It's just two methods but they are in a lot of the documentation and examples. Maybe keep *_coords with a deprecation warning?

Tightly related to #171.

#171 covers all the changes needed to bump to 0.16, so I'll close this


telnet drops user into root bash with login prompt

@jbschool @tmadsen4 review or test before merging!?
Telnet drops into root shell, prompts for login and password, also logs successfully to database.

Looks great! Tested and works.

pulling into hs-24 when both hs-24 and hs-17 should be merged with hs-4


feat: add storybook interactions for e2e testing

Changes
Adds storybook-test command, leverages storybook for e2e testing
How to test this PR
yarn storybook
in another tab -> yarn test-storybook

Do we need e2e testing here? I feel like the visual regression testing and the unit testing should cover the testing needs of the component library.

@meissadia I think you're right that e2e testing (a la Cypress) is overkill for this repo. Some light interactive testing would be nice though which I think is what storybook interaction tests provide. For example, with #46 we could write a regression test that hits the tab/esc keys to confirm they behave as expected.


Trigger editor:  add scrollbars in code area

Scrollbars are already here.

The problem comes from Visual Studio Designer / winforms / screen resolution.
Scroll bars are displayed on my laptop dev computer (1920x1080 17") but not on my desktop computer (1280 x 1024 19").
They don't have the same size / screen resolution.


[BUG]: Parameters missing in the state_dict output of ZeroDPP module

🐛 Describe the bug
Hello,
I currently fine-tune the Huggingface GPT2 with ColossalAI. I follow the example with GeminiDPP and ZeroOptimizer. However, I found that there are some keys missing issue when I load the checkpoint stored by the ColossalAI to the GPT2 model.
The following codebase can reproduce the issue:
import colossalai
from colossalai.tensor import ProcessGroup, ShardSpec, ColoParameter
from colossalai.nn.parallel import GeminiDDP
from colossalai.utils import save_checkpoint
from colossalai.utils.model.colo_init_context import ColoInitContext

from transformers import GPT2LMHeadModel
import torch

if __name__ == "__main__":
    device = "cuda:0"
    tp_degree = 1
    shardinit = True
    placement_policy = "cpu"
    path_to_checkpoint = "./test.pth"

    colossalai.launch_from_torch(config={})

    default_pg = ProcessGroup(tp_degree=tp_degree)
    default_dist_spec = ShardSpec([-1], [tp_degree]) if shardinit else None
    with ColoInitContext(
        device,
        dtype=torch.half,
        default_dist_spec=default_dist_spec,
        default_pg=default_pg
    ):
        model = GPT2LMHeadModel.from_pretrained("gpt2")

    model = GeminiDDP(
        model, device=device,
        placement_policy=placement_policy,
        pin_memory=True, hidden_dim=768,
        search_range_mb=64
    )

    save_checkpoint(path_to_checkpoint, epoch=0, model=model)

    original_model = GPT2LMHeadModel.from_pretrained("gpt2")
    checkpoint = torch.load(path_to_checkpoint)
    original_model.load_state_dict(checkpoint["model"])

And the error message is shown as the follow:
RuntimeError: Error(s) in loading state_dict for GPT2LMHeadModel:
        Missing key(s) in state_dict: "lm_head.weight".

Environment
Os:
Ubuntu 22.04
GPU:
NVIDIA GeForce RTX 3090
Package list:
pytorch                      2.0.0_cuda11.6_cudnn8.3.2_0
cuda-toolkit              11.6.1
colossalai                  0.2.0+torch2.0cu11.7

Hi @eric8607242
you can solve this problem by just adding a argument in your load_state_dict function. write like this
    original_model.load_state_dict(checkpoint["model"], strict=False)


[v2]: Add option to skip dependency install when initializing new Docusaurus project

🚀 Feature
When initializing a new Docusaurus project, a user might wish to skip the dependency install and handle it later on their own. This would be done by passing a flag such as npx @docusaurus/init@next init [name] [template] --skip-install . This is supported in other React ecosystem libraries such as Storybook, and there is an open issue on Create React App for this feature, too: https://github.com/facebook/create-react-app/issues/7568
Have you read the Contributing Guidelines on issues?
Yes
Motivation
This feature would be especially useful when installing Docusarus as one of many packages in a project and wanting to install all dependencies at one time at the end to help avoid conflicts and speed up each individual install. A Lerna project or Yarn Workspace comes to mind.
Pitch
Run npx @docusaurus/init@next init [name] [template] --skip-install and get work done faster!

This change would wrap the following lines in a conditional based on the flag: https://github.com/facebook/docusaurus/blob/master/packages/docusaurus-init/src/index.ts#L154-L164

@facultymatt I'm not against, but do you actually plan to use this feature?
I wonder if it's useful to add an option if nobody feels the need for using it right now, as it seems a particularly niche usecase and our userbase is likely smaller than CRA/Storybook. Any option that we provide and is never used is cluttering the project.
If so, as you have a good idea of how to implement it, are you interested to submit a PR?

Hello! Can I try to tackle this issue for the Hacktoberfest2020? If so, can you assign it to me?

Hello, we have a branch what fixes this, just waiting on our company to
address the CLA to open the PR.
I’d suggest tackling something else for the hack event! 👍👍
On Sun, Oct 11, 2020 at 2:35 PM Alexandru Naiman<EMAIL_ADDRESS>wrote:

Hello! Can I try to tackle this issue for the Hacktoberfest2020? If so,
can you assign it to me?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/facebook/docusaurus/issues/3450#issuecomment-706771497,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAKXKMSKZYTCUUDQPT35WMDSKIQINANCNFSM4RMCV33Q
.

Thanks, waiting for your PR @facultymatt
Still interested to know: do you actually need this feature? I'm not 100% sure to understand in which case I'd use it. Do yu often init a new docusaurus project at the same time as you bootstrap a monorepo?

Thanks @kumaraditya303 for the PR. Yes @slorber we do this quite frequently - we always use Docusaurus for the landing page / docs and then create react app for the application. Testing out the new flag now. Thanks again!


apng output

Builds on https://github.com/libjxl/libjxl/pull/923
Removes the lodepng-based codec_png implementation and replaces it with a libpng implementation (codec_apng). This also does animated PNG encoding. Updated djxl to produce animated png output instead of separate frames if it is decoding an animation.

Is there anything else left that blocks removing lodepng from third_party/?

Is there anything else left that blocks removing lodepng from third_party/ and deps.sh?

Probably not. Once the PR this one depends on has landed, I'll rebase this one and try removing lodepng.

How well tested is this?

How well tested is this?

I'll do a roundtrip test on the pngsuite test set to see if that catches any problems.

How well tested is this?

I'll do a roundtrip test on the pngsuite test set to see if that catches any problems.

All the non-corrupt images in the pngsuite test set roundtrip (except for the gamma=2.5 ones, but that's a jxl limitation that is not related to png input/output). I did cjxl -m in.png out.jxl followed by djxl out.jxl out.png and compare -metric pae in.png out.png null: to check for differences. One had an off-by-one in 16-bit caused by having sBIT being set to 13, but I think that's because ImageMagick is rounding differently than we are when discarding the 3 lsb (it's in any case not a png writing issue but an issue of how we interpret the input png, so not related to this PR).

As for animated png output: I've only tested it on two or three animated jxls, and it produced output that looked OK.

Adding CI:full label to see if that reveals any issues.


About Section Heading Misalignment and Responsiveness

Issue: "About" Section Heading Misalignment and Responsiveness
Description:
The heading in the "About" section of the website is not perfectly centered and doesn't adapt well to various screen sizes. The heading appears misaligned on smaller screens and does not scale appropriately to maintain a visually balanced layout across different device widths.
Expected Behavior:

The "About" section heading should be centered horizontally within the section on all screen sizes.
The heading should maintain proper scaling and responsiveness, especially at smaller screen sizes (e.g., below 700px and at 380px width), while maintaining visual clarity and balance.

Actual Behavior:

The heading appears off-center on larger screens.
On smaller screens, the heading size and alignment are not optimized for readability and overall design consistency.

Steps to Reproduce:

Open the website on different devices or resize the browser window to various screen sizes.
Navigate to the "About" section.
Observe the heading's alignment and responsiveness at different screen widths.

Suggested Fix:

Adjust the CSS for the "About" section heading to ensure it is centered and scales properly across all screen sizes.
Ensure the heading size, font, and positioning are optimized for devices with widths below 700px and particularly at 380px.

I am currently working on this issue and will have it resolved soon. I’m still in the process of troubleshooting, so please be patient.

I am currently working on this issue and will have it resolved soon. I’m still in the process of troubleshooting, so please be patient.

Ok


converter JSON

Help to understand what to write in a line converter JSON

from mqtt goes this line:
{"system":{"hostname":"test","uptime":56858,"rssi":-59,"freemem":13264},"sensors":{"dsw1":28.9,"dsw2":28.8,"dsw3":28.1,"dsw4":25.5,"ping":1},"gpio":{"16":0},"pwm":{"0":120}}
is always written null

I don't see how this is related to this project.


Update minimum required version of Java to 17

The guide is on Spring Boot 3.2

Fixed in https://github.com/spring-guides/gs-relational-data-access/commit/8c483f79195febb101e4d187510e57ab2ff411d1
If that doesn't do it, please let me know.


Move PR template out of subdirectory

The title says it all.
The docs are a bit strange (3rd and 4th bullet point in section 3) here, but AFAICT, if you have the template in the subdir, you have to have an URL parameter, otherwise no template will appear.
See also #1274.
Please review.

This just moves a file and the intent was reviewed in #1274, I'll go ahead and merge this once the checks are green.


desktop image preview not working with mobile camera stream

Hi guys, i'm trying to create a app to use mobile camera as a webcam. When i try to send my phone camera stream to desktop app in a p2p call sample, image preview not work on desktop app.
phone to phone working really good

phone to desktop result

any ideia or solution for this problem? thanks.

Same requirement


Fixes UI race conditions, and adds a permanent http client

tcell 2.2.0 contains a bug with exiting that causes a deadlock in the UI
when run under Windows.  This was fixed in 2.2.1, however there is also a
race condition which is fixed in 2.3.1.  This also commits go.sum, which
should be present.  There is no guarantee that a dependency won't be
compromised in future, so this will lock everything to explicit commits.
This also splits how data is retrieved.  You're only meant to edit widgets
from the main tview loop.  This does the http access on the worker routine,
then pushes the updates in to the tview loop.  QueueUpdateDraw is sync
and will wait for the function to complete before resuming.
Finally we add a top level http.Client.  Creating a new client every time
will stop connection re-use.

'
Finally we add a top level http.Client. Creating a new client every time
will stop connection re-use.
'
Actually, since I added multiple plotter support.  I dont want to re-use the same http client.  Can you remove this part as I am fine with the rest of the PR.   Thanks for your contributions.

I could, but what's the concern with sharing a client? A client basically provides settings and connection reuse / pooling.

actually, you are correct.  Let's keep the global http client.

Groovy. Please merge, and I'll start finishing up the next PR.


No beacons from HA app in MQTT presence

Hello,
As per title, I'm unable to pickup the ibeacon from the HA app in MQTT to use for automations. That would be great as the nuki sometimes take too long to auto open the door.
At the moment I'm running ESP presence on another ESP32 and it's much faster, I'd like to just use one if possible.
I just tried 8.29 as the changelog mentions the ibeacons but no change.
Sample mqtt messages below (I have 2 android phones, both not showing):
18:d9:8f:56:95:e7;HONOR Band 5-5E7;-79
54:d2:72:20:58:dd;Nuki_312058DD;-62
7e:e9:87:f1:41:4c;Galaxy Watch4 (6DCD);-98
d8:88:cd:22:b6:b7;Mi Smart Band 4;-83
d8:e0:e1:2a:82:75;[TV]Bedroom;-78
Thank you!

This worked, thank you. Although I have the latest version of the app the minor id was 1.
Unfortunately I have no idea how to make automations out of this long string of devices in mqtt, is there a tutorial available for HA?

Not that I know off. @mundschenk-at @alexdelprete Maybe you can help better from this point.
Other than that maybe ask in the HA forum.

I have not experimented further than https://github.com/technyon/nuki_hub/issues/159#issuecomment-1554358294 with presence detection as I am using iOS and the app is more limited there for beacons (and connection with Apple devices in general is much easier to do in ESPresense). Since this is mostly about HA templating, I'd also refer the question to the forum.

@mundschenk-at @alexdelprete Maybe you can help better from this point.

Sorry, I don't use bluetooth presence detection, it's not reliable, so I can't help much.
In any case, I wouldn't have implemented any of this because there will be a LOT of issues opened because of that not working (like in other BT presence detection projects), and I think Nuki Lock should only focus on its main purpose: managing the Nuki Lock.
Anyway, it seems strange that BT beacons of two mobiles are not being picked up, while other devices are. And that is why I never liked this approach for presence detection: not reliable.

Thank you all for your replies.
@alexdelprete the detection issue was resolved easily, it was just the ble transmitter being configured incorrectly as above.
My only complaint with the lock is the auto unlock speed, most of the time you have to wait outside the door for it to open for several seconds. Not very star trek :) This is probably due to energy savings for the battery.
I have set up a 2nd esp32 with espresence and it has been great, the door opens just as you walk up to it most of the time and really enhances the experience. For this I feel that adding the feature would interest many users.
My problem at the moment is that the data in the presence topic is in CSV form, when I think we would need some sort of JSON like espresence. I have no idea how to match the phone's UUID in the payload so I can use it in an automation.

Hi,
JSON is quite a bloated format, and putting the ESPs capabilities are limited. This is already a problem when publishing the log entries, when I go higher than five, it won't work.
You should keep in mind that beacons are transmitted without any encryption. Anyone close to you can receive them, copy them, and send those same beacons to unlock your door. If that's a realistic scenario is another question, I think in almost all cases they would use force to enter your home if they want to. Just mentioning it so you are aware.

My only complaint with the lock is the auto unlock speed, most of the time you have to wait outside the door for it to open for several seconds. Not very star trek :)

There are better ways to automate the unlock, but remember that the house door (at least for me) is a highly-secure scenario, so I don't trust anything that might have the remote possibility of being hacked. BLE beacons are not encrypted, as Jan said, so I would NEVER rely on something like that.
ESPresence is faster because it ONLY DOES one thing. The Nuki Hub does WiFi+BT+MQTT+Ethernet, and ESP developers wrote in several posts that the ESP32 barely manages to do it, it requires a lot of optimizations and avoiding expensive functions or memory-hungry routines.
It took quite a while to reach a reliable level of the firmware, Jan did a great job and we tested for months until it reached a good maturity level.
If I was Jan, I'd never have implemented any presence functionality, for me it's totally outside the scope of the project, while there are specialized projects for that use-case.

Well you know, as it often is the case I implemented it because I'm using it myself.
I didn't except it to be be that complicated for CSV to be used, considering it's one one of the most simple formats there is ... but the home assistant devs decided to base all the input on json. In iobroker I wrote a simple script that parses the input line by line, then does a string split ";", no big deal.
I think as this is not main feature of the firmware and the limitations mentioned, I won't change this. It's easy enough to run a secondary ESP with a firmware that's more compatible with HA if need be.

It's not that hard in HA either, the comment I linked shows one way to do it. (But there is more tooling for JSON in HA, that is correct.)

All valid points, thank you.
For anyone else interested in such an approach, my automation is:
Wait for HA person tracker to change to home.
Actions:

Turn on ble transmitter of relevant phone.
Wait for ble to be detected (either use espresence for this or Nukihub)
Open door
Turn off ble transmitter.

This maximises battery life on the phone and only allows a small window for the door to be opened for security purposes.
If you have multiple users then make an automation for each but add actions so that the first automation to run successfully stops the automations of the other users for a minute or 2 to  prevent multiple opens when arriving together.
There may be a more elegant way to do this or within a single automation :)


Issue with k8s.io/docs/setup/independent/high-availability/

This is a...

[ ] Feature Request
[x] Bug Report

Problem:
The kubeadm documentation for setting up a HA cluster (https://kubernetes.io/docs/setup/independent/high-availability/) has the following step under the heading "Acquire etcd certs":
Option 1: Copy with scp
Follow the steps in the create ssh access section, but instead of adding to etcd0’s authorized_keys file, add them to master0.
Once you’ve done this, run:
bash scp root@<master0-ip-address>:/etc/kubernetes/pki/* /etc/kubernetes/pki
rm apiserver.*
Firstly, bash scp is incorrect syntax:
[root@ziptester-ha1 ~]# bash scp bla bla bla
/usr/bin/scp: /usr/bin/scp: cannot execute binary file

Secondly, This step is wrong. It needs to be more specific. If you copy all of the content from /etc/kubernetes/pki, you will overwrite some files that are needed to start the other masters.
Proposed Solution:
Update documentation to this:
Option 1: Copy with scp
Follow the steps in the create ssh access section, but instead of adding to etcd0’s authorized_keys file, add them to master0.
Once you’ve done this, run:
scp root@<master0-ip-address>:/etc/kubernetes/pki/ca.crt /etc/kubernetes/pki
scp root@<master0-ip-address>:/etc/kubernetes/pki/ca.key /etc/kubernetes/pki
scp root@<master0-ip-address>:/etc/kubernetes/pki/sa.key /etc/kubernetes/pki
scp root@<master0-ip-address>:/etc/kubernetes/pki/sa.pub /etc/kubernetes/pki
Page to Update:
https://kubernetes.io/docs/setup/independent/high-availability/

the HA and HA-ETC documentation received an overhaul in 1.11:
https://kubernetes.io/docs/setup/independent/high-availability/
https://kubernetes.io/docs/tasks/administer-cluster/setup-ha-etcd-with-kubeadm/
all the new edits were the result of combined SIG efforts and based on existing proposals for improvements.
closing until further notice.
/close


License Issue

I would not recommend the use of the Apache license for artwork. Instead, use one of the licenses specifically designed for creative works: The Creative Commons. I would recommend using CC-BY-SA. Unfortunately, you'll have to get permission from the artwork copyright holder (which, BTW is not referenced in the repository and therefore I cannot contact them).

/cc @caniszczyk


Feature: Specify .clang-tidy location or discover.

We want to use one .clang-tidy file for the whole repository. However, clang-tidy does not detect the file in the root folder.
The .clang-tidy file must be located in the same place as the  .cpp file. From what I have discovered. clang-tidy has --config-file=<string>  could you expose this in UI? Another suggestion would be for the application to discover .clang-tidy files by traversing the path up to the root location and discover .clang-tidy files. Same behavior as clang-format.
We use the root folder behavior of .clang-format but .clang-tidy weirdly does not work the same.

We already detect .clang-tidy file in the root folder
Make sure to have Detect .clang-tidy file active and Use check from Tidy File selected

You can also test with our tool to Export Tidy file config, and make sure that you don't have a typo in your .clang-tidy file
If you still have problems, please send us a test project with .clang-tidy file in it, to reproduce your issue
Best regards,
Marina

Yes, this is correct. The repository-wide .clang-tidy was blocked by a misplaced .clang-tidy in a folder further down. Closing this issue.


Cannot open include file: 'avro.h': No such file or directory

Hi,
when I use “easy_install” to install pyavro on my windows system,error occurred:
creating build\temp.win-amd64-2.7\Release\src     C:\Users\Administrator\AppData\Local\Programs\Common\Microsoft\Visual C++ for Python\9.0\VC\Bin\amd64\cl.exe /c /nologo /Ox /MD /W3 /GS- /DNDEBUG -ID:\python2.7\include -ID:\python2.7\PC /Tcsrc/pyavro.c /Fobuild\temp.win-amd64-2.7\Release\src/pyavro.obj     pyavro.c     c:\users\administrator\appdata\local\temp\pycharm-packaging\pyavroc\src\convert.h(21) : fatal error C1083: Cannot open include file: 'avro.h': No such file or directory     error: command 'C:\\Users\\Administrator\\AppData\\Local\\Programs\\Common\\Microsoft\\Visual C++ for Python\\9.0\\VC\\Bin\\amd64\\cl.exe' failed with exit status 2
How can I solve it ? Thanks.

Hi,
I test use centos6.5,no success。
`[webber@localhost site-packages]$ sudo easy_install pyavroc
Searching for pyavroc
Best match: pyavroc 0.7.2
Processing pyavroc-0.7.2-py2.6-linux-x86_64.egg
Adding pyavroc 0.7.2 to easy-install.pth file
Using /usr/lib/python2.6/site-packages/pyavroc-0.7.2-py2.6-linux-x86_64.egg
Processing dependencies for pyavroc
Finished processing dependencies for pyavroc
[webber@localhost site-packages]$ python
Python 2.6.6 (r266:84292, Jan 22 2014, 09:42:36)
[GCC 4.4.7 20120313 (Red Hat 4.4.7-4)] on linux2
Type "help", "copyright", "credits" or "license" for more information.

import pyavroc
Traceback (most recent call last):
File "", line 1, in
File "/usr/lib/python2.6/site-packages/pyavroc-0.7.2-py2.6-linux-x86_64.egg/pyavroc/init.py", line 16, in
File "/usr/lib/python2.6/site-packages/pyavroc-0.7.2-py2.6-linux-x86_64.egg/pyavroc/_pyavroc.py", line 7, in
File "/usr/lib/python2.6/site-packages/pyavroc-0.7.2-py2.6-linux-x86_64.egg/pyavroc/_pyavroc.py", line 6, in bootstrap
ImportError: liblzma.so.5: cannot open shared object file: No such file or directory
`

I experienced the same problem with Pip. I solved it as follows: clone the repository somewhere and run ./clone_avro_and_build.sh. I had to install a few requirements in a virtualenv too to make it work. Then:
mkdir build
python setup.py bdist_wheel -d build

This will produce a whl file in the build directory, pyavroc-0.7.2-cp27-cp27mu-linux_x86_64.whl in my case. Then in a different project and virtualenv, I was able to install this wheel using pip install /path/too/pyavroc.whl.
I don’t know how this would be handled with Easy install. Also, building Avro from source on Windows will be a lot harder. You’ll need to perform the equivalent steps of those in clone_avro_and_build.sh manually, which requires running CMake to generate a VS solution, then building that solution, retrieving the DLL from there (assuming it compiles at all), ...
@walshb: I think it would help if there would be wheels on Pypi. Would it be possible to upload those?

@bts-webber: on CentOS you will have to install the correct compression libraries:
sudo yum install zlib xz-libs
easy_install pyavroc

Or, as ruuda suggests, you can build from source using clone_avro_and_build.sh.
On Windows, the underlying Avro-C code doesn't build. I can probably make it work but I don't have much time right now.

@ruuda: I'll take a look at building wheels.


Group Type?

I see a lot of articles just going for O365 as group type but this to me seems far too excessive for some of the use cases, as an O365 group will create a lot of uneccesary resources in most cases and should not be the default choice. Or if you could at least expand on why you think an O365 group would be the best candidate in this instance over others.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: e6a568af-159f-5335-e8c3-33cfbb1e9f54
Version Independent ID: 9945d19a-4c7f-a96b-2677-f82479f8e326
Content: Device compliance policies for your Microsoft 365 Enterprise test environment
Content Source: microsoft-365/enterprise/mam-policies-for-your-microsoft-365-enterprise-dev-test-environment.md
Service: o365-solutions
GitHub Login: @JoeDavies-MSFT
Microsoft Alias: josephd

@officedocsbot assign @mypil

@henryphillipsid - Thank you for submitting feedback.
I will get this issue over to the Microsoft 365 writing team for investigation.
Thank you for reporting and making the docs better. Much appreciated.
I made a note to request the team to update this when the work is complete.

@mypil Created PR. I have specified the possibility of using both group types and mentioned the downside of O365 group.
https://github.com/MicrosoftDocs/microsoft-365-docs/pull/350

@henryphillipsid - From our understanding, the issue has been resolved but it may take a few days for the merged content to appear in the article. If you feel it hasn't been resolved, please re-open this issue.
Thank you for your contribution to make the docs better! Much appreciated!

@officedocsbot close


Removed a broken link in index.md

A link referred to CIFAR-10 samples. However, this was a broken link. So, I removed the link and the references to this link.

Can one of the admins verify this patch?

Merged


Clarify references to API keys in-app

Currently, we talk about the API Keys page, but it may not be obvious
how to get there.
Describe the full navigation necessary to get to the API keys page
(Settings page, API keys tab) when referencing it.

This could also probably be unified to avoid copying this text all over the place, but it's not quite the same everywhere (sometimes for a good reason), so I think it's a separate problem.


factory_boy integration out of the box.

See https://github.com/lk-geimfari/mimesis-factory/issues/246

Done!


Unresolved reference: importDidAndKey

Hello, I'm trying to build the storage kit with ./storagekit.sh build   but getting the following error:

The same occurs when building with docker.
Compiling with javac 19.0.1 on Ubuntu 20.04.5 LTS

Fixed in https://github.com/walt-id/waltid-storage-kit/pull/9

Thank you

@philpotisk The previously mentioned issue was fixed but build now throws an error after failing some tests:

Should be fixed since 283875a0


Update Composer dependencies (2021-06-01-00-09)

Visual regression test passed!
View the visual regression test report


feat: implement downloader

This PR implements a downloader that prompts the user to download the Biome CLI if none is found. It is meant to replace the current strategy where we bundle the CLI with the extension with every release.
Testing

pnpm install
F5
Create a new folder with a biome.json file inside
Open that folder
Click on the biome.json file
A notification stating that biome is not installed should appear. click download
When biome is installed, try formatting a file
Click on the biome status bar, downgrade the version, the version should change

does the node version used in the minimum supported vscode version support global fetch? if so we could use it and avoid adding an additional dependency, or use undici's fetch which node uses under the hood

I believe Node's fetch API was released with Node 18. The version of Node used by the minimum supported version in Node 16.
That being said, in reading your comment I realize that I haven't confirmed that it works with 1.80 either, so I'll do that.

As expected, it did not work. I was able to polyfill fetch with ofetch, so we'll keep the dependency anyway for now.

I ended up adding the command for clearing the versions cache if only to be used by us while developing the extension.


tokodon: init at 22.11.2

Description of changes

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[x] Fits CONTRIBUTING.md.

nix builds some bash script that sets some environment variables before the application is execd. The execution of the application itself then segfaults.
If I start the binary directly from the store it works.
Maybe someone with more KDE+nixpkgs knowledge can help me out here?

@ofborg build tokodon

@ofborg build tokodon

It's building but doesn't run for me. Maybe someone else could take a look @SuperSandro2000

it's failing in a similar way for me on sway. 22.09 is out (this PR is for 22.04). i tried updating version = "22.09"; and hash = "sha256-wHE8HPnjXd+5UG5WEMd7+m1hu2G3XHq/eVQNznvS/zc="; -- no dice.
for me it takes a good 2 minutes of hanging after "Loading any accounts from settings" until it segfaults. i don't know if that's just how long it takes to coredump, or if maybe it just needs some accounts file for it to work?

regarding the segfault:
[Switching to Thread 0x7fffe27e2640 (LWP 20544)]
0x00007ffff74bcaa0 in QQmlType::QQmlType(QQmlType const&) () from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
(gdb) bt
#0  0x00007ffff74bcaa0 in QQmlType::QQmlType(QQmlType const&) () from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
#1  0x00007ffff75239bc in ?? () from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
#2  0x00007ffff75265b1 in ?? () from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
#3  0x00007ffff752694c in ?? () from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
#4  0x00007ffff7527174 in ?? () from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
#5  0x00007ffff752206b in ?? () from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
#6  0x00007ffff7471995 in ?? () from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
#7  0x00007ffff74778d7 in ?? () from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
#8  0x00007ffff7465415 in QQmlDataBlob::tryDone() () from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
#9  0x00007ffff74c56e5 in QQmlTypeLoader::setData(QQmlDataBlob*, QQmlDataBlob::SourceCodeData const&) ()
   from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
#10 0x00007ffff74c5e32 in QQmlTypeLoader::setData(QQmlDataBlob*, QString const&) () from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
#11 0x00007ffff74c7200 in QQmlTypeLoader::loadThread(QQmlDataBlob*) () from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
#12 0x00007ffff7480fad in ?? () from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
#13 0x00007ffff75407cf in ?? () from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
#14 0x00007ffff7540f92 in ?? () from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
#15 0x00007ffff691976f in QApplicationPrivate::notify_helper(QObject*, QEvent*) () from /nix/store/hnii4vframpg90xzq0x4l8s7sn4sdm09-qtbase-5.15.6/lib/libQt5Widgets.so.5
#16 0x00007ffff5dc04fa in QCoreApplication::notifyInternal2(QObject*, QEvent*) () from /nix/store/hnii4vframpg90xzq0x4l8s7sn4sdm09-qtbase-5.15.6/lib/libQt5Core.so.5
#17 0x00007ffff5dc3617 in QCoreApplicationPrivate::sendPostedEvents(QObject*, int, QThreadData*) () from /nix/store/hnii4vframpg90xzq0x4l8s7sn4sdm09-qtbase-5.15.6/lib/libQt5Core.so.5
#18 0x00007ffff5e18cf3 in ?? () from /nix/store/hnii4vframpg90xzq0x4l8s7sn4sdm09-qtbase-5.15.6/lib/libQt5Core.so.5
#19 0x00007ffff517496b in g_main_context_dispatch () from /nix/store/52c73s4b53szj1wf9ai43ignvgnq8scz-glib-2.74.0/lib/libglib-2.0.so.0
#20 0x00007ffff5174c18 in g_main_context_iterate.constprop () from /nix/store/52c73s4b53szj1wf9ai43ignvgnq8scz-glib-2.74.0/lib/libglib-2.0.so.0
#21 0x00007ffff5174ccf in g_main_context_iteration () from /nix/store/52c73s4b53szj1wf9ai43ignvgnq8scz-glib-2.74.0/lib/libglib-2.0.so.0
#22 0x00007ffff5e18354 in QEventDispatcherGlib::processEvents(QFlags<QEventLoop::ProcessEventsFlag>) () from /nix/store/hnii4vframpg90xzq0x4l8s7sn4sdm09-qtbase-5.15.6/lib/libQt5Core.so.5
#23 0x00007ffff5dbee7b in QEventLoop::exec(QFlags<QEventLoop::ProcessEventsFlag>) () from /nix/store/hnii4vframpg90xzq0x4l8s7sn4sdm09-qtbase-5.15.6/lib/libQt5Core.so.5
#24 0x00007ffff5bcaacb in QThread::exec() () from /nix/store/hnii4vframpg90xzq0x4l8s7sn4sdm09-qtbase-5.15.6/lib/libQt5Core.so.5
#25 0x00007ffff7540465 in ?? () from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
#26 0x00007ffff5bcbde1 in ?? () from /nix/store/hnii4vframpg90xzq0x4l8s7sn4sdm09-qtbase-5.15.6/lib/libQt5Core.so.5
#27 0x00007ffff5663e86 in start_thread () from /nix/store/g8d5bnh9mh1364x17mjyc731fsi9a61m-glibc-2.35-163/lib/libc.so.6
#28 0x00007ffff56eac60 in clone3 () from /nix/store/g8d5bnh9mh1364x17mjyc731fsi9a61m-glibc-2.35-163/lib/libc.so.6

(gdb) thread 1
(gdb) bt
#0  0x00007ffff56607d5 in __futex_abstimed_wait_common () from /nix/store/g8d5bnh9mh1364x17mjyc731fsi9a61m-glibc-2.35-163/lib/libc.so.6
#1  0x00007ffff5663202 in pthread_cond_wait@@GLIBC_2.3.2 () from /nix/store/g8d5bnh9mh1364x17mjyc731fsi9a61m-glibc-2.35-163/lib/libc.so.6
#2  0x00007ffff5bd1e2b in QWaitCondition::wait(QMutex*, QDeadlineTimer) () from /nix/store/hnii4vframpg90xzq0x4l8s7sn4sdm09-qtbase-5.15.6/lib/libQt5Core.so.5
#3  0x00007ffff7540bac in ?? () from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
#4  0x00007ffff74c75c1 in QQmlTypeLoader::load(QQmlDataBlob*, QQmlTypeLoader::Mode) () from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
#5  0x00007ffff74c7f00 in QQmlTypeLoader::getType(QUrl const&, QQmlTypeLoader::Mode) () from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
#6  0x00007ffff74a057d in QQmlComponentPrivate::loadUrl(QUrl const&, QQmlComponent::CompilationMode) ()
   from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
#7  0x00007ffff7505633 in QQmlApplicationEnginePrivate::startLoad(QUrl const&, QByteArray const&, bool) ()
   from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
#8  0x00007ffff75056fd in QQmlApplicationEngine::load(QUrl const&) () from /nix/store/npf34d0v9za7snrrnsppp2mxvspd2jji-qtdeclarative-5.15.6/lib/libQt5Qml.so.5
#9  0x000000000041099f in main ()

the other 3 threads appear to be event handlers idling in poll or futex_wait.
that line in main which calls QQmlApplicationEngine::load is:
engine.load(QUrl(QStringLiteral("qrc:/content/ui/main.qml")));

stracing the app, i see no fs request for anything close to content/ui/main.qml. QQmlDataBlob::SourceCodeData hints that the resource file was compiled into the app. i don't see any similar upstream issue. but it's hard for me to see what we could do wrong that would cause a segfault here unless the nix wrappers somehow break the embedded resource file?

Updated for the 22.09 release, but the crash still exists.

For me it still segfaults with these.

For me it still segfaults with these.

try clearing ~/.cache/KDE/tokodon (or ~/.config/KDE/tokodon) if it exists. i found that if i launch Tokodon but do not sign in, the app leaves data there that causes a crash-on-launch for future runs.

Now I get at least:
$ ./result/bin/tokodon
Loading any accounts from settings.
Cannot mix incompatible Qt library (5.15.3) with this library (5.15.5)
segfault

I guess we're at a point where we should open issues in their bugtracker, don't you think?

sure, never hurts to reach out

On Nov 5, 2022, at 02:24, Matthias Beyer @.***> wrote:

Now I get at least:
$ ./result/bin/tokodon
Loading any accounts from settings.
Cannot mix incompatible Qt library (5.15.3) with this library (5.15.5)
segfault
I guess we're at a point where we should open issues in their bugtracker, don't you think?
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you commented.

Does still not work, because the build does not find some kirigamiaddons cmake module...

This now builds and starts for me!!! :tada:

https://social.linux.pizza/@musicmatze/109559061639144179
:tada:

@samueldr you should probably have a look at this PR, because this updates kirigami-addons, which you are maintainer of.

@matthiasbeyer see also https://github.com/NixOS/nixpkgs/pull/203865 for the Plasma Mobile gear update, which includes the kirigami-addons update. (I totally forgot to self-merge that after a small while without reviews...)
Though uh... if I had seen this beforehand, I would have reviewed and suggested some things.
This is an app that is part of Plasma Mobile gear, and as such should(?) be packaged with the Plasma Mobile gear. This gives it "free" updates every time Plasma Mobile gear updates.
I hate throwing away work that's been done in genuine earnest. I'll take some time and review more carefully, and see if we can splice your package init within the Plasma Mobile gear package set.

I hate throwing away work that's been done in genuine earnest. I'll take some time and review more carefully, and see if we can splice your package init within the Plasma Mobile gear package set.

:+1: :heart:
Sure, no hard feelings, as long as we get tokodon in nixpkgs and I can use it on my desktop! :laughing:

@matthiasbeyer before somewhat rudely pushing this on top of this PR, here's the equivalent changes:

https://github.com/NixOS/nixpkgs/compare/master...samueldr:nixpkgs:wip/tokodon

Do I have to do something, or is this done and I can close this PR?

Maybe you can create a new PR with the changes mentioned by @samueldr , I would be happy to review :)

@onny I meant because tokodon is in the plasma mobile gear derivation... so there's no point in keeping this PR, as far as I understand.

tokodon is there in the srcs.nix file but missing a derivation. I can't find it in master nor staging yet

Oh, I was waiting for a comment to continue with this. I suppose the :+1: here means it's alright then, right?

Oh, I was waiting for a comment to continue with this. I suppose the :+1: here means it's alright then, right?

Sure, go ahead!

This force push:

Rebases on current nixos-unstable
Changes to the Plasma Mobile Gear owned tokodon build (which is largely as it was)

I'm getting following error while trying to build it with nixpkgs-review
error: undefined variable 'src'

       at /home/onny/.cache/nixpkgs-review/pr-170466/nixpkgs/pkgs/applications/plasma-mobile/tokodon.nix:55:16:

           54|     description = "A Mastodon client for Plasma and Plasma Mobile";
           55|     homepage = src.meta.homepage;
             |                ^
           56|     license = licenses.gpl3Plus;

       … while evaluating the attribute 'homepage'

Right, this was tested on my end with nix-build, and the ofborg check also fails that way. This is one part of why this had to go through the PR lifecycle: it needed to be tested the same way as any other changes.
So this is something I didn't know: there is an implicit homepage on fetchFromGitHub, huh!
nix-repl> (fetchFromGitHub { rev = ""; owner = "samueldr"; repo = "foo"; }).meta.homepage
"https://github.com/samueldr/foo"

Anyway, let's fix it for the actual project page, as listed on their project page.

Thank you @samueldr for fixing this! When I try to run tokodon via nixpkgs-review it runs for a few seconds but then crashes.
[nix-shell:~/.cache/nixpkgs-review/pr-170466-2]$ ./results/libsForQt5.tokodon/bin/tokodon
Loading any accounts from settings.
qrc:/content/ui/main.qml:74: TypeError: Cannot read property 'instanceName' of null
Segmentation fault (core dumped)

Working on it. Explanation is simple: the gear release only has 22.11, this was for 22.11.2. That escaped me initially.

Result of nixpkgs-review pr 170466 run on x86_64-linux 1

1 package built:

libsForQt5.tokodon (plasma5Packages.tokodon)

Thank you know it worked for me! Thank you @matthiasbeyer and @samueldr


Warehouse isn't a product

[Enter feedback here]
In the below paragraph "Azure Warehouse" isn't a product. I'm guessing it should be one of the Synapse products.
Works with all your Azure data
Data Lake Analytics works with Azure Data Lake Storage for the highest performance, throughput, and parallelization and works with Azure Storage blobs, Azure SQL Database, Azure Warehouse.
Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 9ef932d0-c361-107f-aec6-a101609d45d7
Version Independent ID: c0d13e2b-f764-2e15-6630-b305e0209993
Content: Overview of Azure Data Lake Analytics
Content Source: articles/data-lake-analytics/data-lake-analytics-overview.md
Service: data-lake-analytics
GitHub Login: @saveenr
Microsoft Alias: saveenr

@imcdnzl Thanks for your contribution, I've addressed this issue in PR: https://github.com/MicrosoftDocs/azure-docs-pr/pull/120830
The changes should be live EOD or tomorrow. We will now close this issue. In future, if you see any minor bug fixes in the doc, feel free to click on the edit button and submit a PR to update. we love to take community contributions.


MacOS: pycurl ImportError

I am experiencing a pycurl error that appears related to SSL.  When I run libbyfetch.py I immediately get this error:
ImportError: pycurl: libcurl link-time ssl backends (secure-transport, openssl) do not include compile-time ssl backend (none/other)
I attempted to reinstall pycurl and open ssl shows installed and up to date.
Thanks for creating this program.  Hope I can get it to work.

Can you provide more details?  Which OS are you using?  Which version of Python?  Which version  of pyCurl?

Yes, sorry.  I am on a Mac Sonoma 14.6.1.  Python 3.13.0.  pyCurl 7.45.3.  I did a fresh install of python and pycurl via homebrew.  All installed successfully.  I also downgraded blinker as suggested in your instructions.  No errors on install.   But after I updated the config file for the library card data and tried to execute the script, I got that pycurl import error.  The library I am trying to connect to is the King County Library.  Lib abbreviation:  kcls

I'm sorry the program isn't working for you.  I don't have a Mac handy to investigate this.  If you would like to pursue it I can offer that when I used the error message as a search phrase for a web search several results appeared that sounded relevant.  So if you feel like diving in, try entering
ImportError: pycurl: libcurl link-time ssl backends (secure-transport, openssl) do not include compile-time ssl backend (none/other) into your favorite search engine.
Sorry to toss this back to you but I think the problem is the pyCurl installation and not libbyfetch.  I know these kinds of problems are really frustrating.  If you find anything I can help with on the libbyfetch side, let me know.  If I learn anything more I'll add it in the comments.

Yeah, I tried to chat gpt the error before I posted here.  Chat gpt gave me some suggestions, all of which I already tried, including the reinstall of pycurl and open ssl to rebuild the appropriate connections.
No worries, I totally understand.  Thanks for trying.  I'm going to try on my PC and see what happens.

The error:
ImportError: pycurl: libcurl link-time ssl backends (secure-transport, openssl) do not include compile-time ssl backend (none/other)
indicates a mismatch between the SSL backend used by the libcurl library (which pycurl depends on) and what is available on your system. pycurl expects a specific SSL backend, but your system’s libcurl library doesn’t support the required SSL backend properly at compile-time.
Why This Happens:
•The version of libcurl installed on your system may not have been compiled with an SSL backend compatible with pycurl.
•macOS often uses SecureTransport as the default SSL backend, but pycurl expects OpenSSL.
I think I used this command
PYCURL_SSL_LIBRARY=openssl pip3 install --no-cache-dir pycurl
to install pycurl with OpenSSL explicitly.
After that I made sure that openssl was good with:
brew install openssl
Then I set the correct paths for the compiler to find OpenSSL:
export CPPFLAGS="-I$(brew --prefix openssl)/include"
export PKG_CONFIG_PATH="$(brew --prefix openssl)/lib/pkgconfig"

Then check if the curl version installed by Homebrew is using OpenSSL:
curl --version
Uninstall pycurl again and attempt to reinstall it:
PYCURL_SSL_LIBRARY=openssl pip3 install --no-cache-dir pycurl

Good luck! The dependancies are the hardest part of the libbyfetch process in my experience.

@lsixecho Thanks for these helpful instructions.  I think this explains what is causing this issue for people.  I'm sure other Mac users will appreciate your contribution.
Yes, getting the dependencies straightened out is often the crux of installation with Python applications.


«Split multi-valued cells in column address» does not fill the remaining cells

Not sure if this is a bug or a feature, but in many cases it is impossible to use «Fill down» function and you have to write complex expressions for each column. Very tiring...
Input
+------+---------+------------+
| name | address | email      |
+------+---------+------------+
| A    | X       |<EMAIL_ADDRESS>|
+------+---------+------------+
| B    | Y1;Y2   |<EMAIL_ADDRESS>|
+------+---------+------------+
| C    | Z       |            |
+------+---------+------------+

Current Results
+------+---------+------------+
| name | address | email      |
+------+---------+------------+
| A    | X       |<EMAIL_ADDRESS>|
+------+---------+------------+
| B    | Y1      |<EMAIL_ADDRESS>|
+------+---------+------------+
|      | Y2      |            |
+------+---------+------------+
| C    | Z       |            |
+------+---------+------------+

Expected Behavior
+------+---------+------------+
| name | address | email      |
+------+---------+------------+
| A    | X       |<EMAIL_ADDRESS>|
+------+---------+------------+
| B    | Y1      |<EMAIL_ADDRESS>|
+------+---------+------------+
| B    | Y2      |<EMAIL_ADDRESS>|
+------+---------+------------+
| C    | Z       |            |
+------+---------+------------+

Versions

Operating System: Windows Server 2022
Browser Version: Edge 107
JRE or JDK Version: Java 18
OpenRefine:  3.6.2

Hi @n-timofeev, this is the intended behaviour of this function indeed. To obtain the state you want, you should use the Fill down operation on other columns, in records mode, starting with the columns which are not the first one.

Closing since this is a not a bug.


Rewrite /stats_summary/create to Go

I'm submitting an ...
improvement request (usability, performance, tech debt, etc.)
Traffic Control components affected ...

Documentation (possibly)
Traffic Ops

Current behavior:
/stats_summary/create is handled by Perl
Expected / new behavior:
/stats_summary/create should be handled by Go.
Minimum API Version
1.1
Request Methods

[ ] POST

Minimal reproduction of the problem with instructions:
N/A

i think this should not rewritten to Go as-is. Instead rewrite it as POST /stats_summary and add a deprecation notice to POST /stats_summary/create
also, find all usages of POST /stats_summary/create in the codebase and change to POST /stats_summary

the decision to either deprecate and/or rewrite the endpoint can't be made here, but once the decision is made this issue can be closed (if appropriate)

+1 to the deprecation/rewrite idea


Port to Python3

I've done the following changes:

Changed xrange and print to the more general and backward compatible versions of python3.
Some explicit list conversions were added when neccessary.
Reshape of input to scikit StandarScaler to avoid deprecation warning.
As string comparison trick doesn't work correctly with python3 (on self.n_features),  a cleaner way was introduced.

example.py works great on both python2 and python3, on anaconda platform.

@mavillan Sorry but still this error is reported:
C:\Users\Markazi.co\Anaconda3\python.exe D:/mifs-master_2/mifs-master/untitled0.py
Auto selected feature #1 : 3, JMI: 0.008148984893969091
Auto selected feature #2 : 7, JMI: 0.07198617916274075
Auto selected feature #3 : 6, JMI: 0.06854795704997496
Auto selected feature #4 : 4, JMI: 0.0675631030596735
Auto selected feature #5 : 12, JMI: 0.0675631030596735
Auto selected feature #6 : 8, JMI: 0.061790811357387065
Auto selected feature #7 : 10, JMI: 0.061497903971208245
Auto selected feature #8 : 13, JMI: 0.061497903971208245
Auto selected feature #9 : 1, JMI: 0.06046249557951566
Auto selected feature #10 : 5, JMI: 0.06046249557951566
Auto selected feature #11 : 11, JMI: 0.05679281018103577
Auto selected feature #12 : 2, JMI: 0.05527044794988245
Auto selected feature #13 : 0, JMI: 0.05527044794988245
Auto selected feature #14 : 9, JMI: 0.05277413007042542
Traceback (most recent call last):
  File "D:/mifs-master_2/mifs-master/untitled0.py", line 21, in <module>
    feat_selector.fit(X, y)
  File "D:\mifs-master_2\mifs-master\mifs.py", line 137, in fit
    return self._fit(X, y)
  File "D:\mifs-master_2\mifs-master\mifs.py", line 233, in _fit
    selected = F[bn.nanargmax(bn.nansum(fmm, axis=0))]
  File "reduce.pyx", line 2907, in reduce.nanargmax (bottleneck/src/auto_pyx/reduce.c:25633)
  File "reduce.pyx", line 3552, in reduce.reducer (bottleneck/src/auto_pyx/reduce.c:31009)
  File "reduce.pyx", line 2931, in reduce.nanargmax_all_float64 (bottleneck/src/auto_pyx/reduce.c:25831)
ValueError: numpy.nanargmax raises on a.shape[axis]==0; Bottleneck too.

Process finished with exit code 1

The data set used here include 14 features. It selects all features!
Thanks.

Accepted latest pull request that addresses these issues.


Replace standart expanding icon with own custom icon

Hello,
Could I ask you to implement ability to change standart "plus/minus" expanding icon with some another custom icon?

This is now possible. See https://github.com/arnedesmedt/vue-ads-table-tree#3-sort-icon-slot


Size of Datepicker on iPhone (5S)

The datetimepicker can appear too large for the available window, in which case the user is unable to actually pick the date or time.

I'll fix that soon.

I also am struggling with making the date picker fit on iPhone 5 sized screens:

Note how the calendar exceeds the container? I'm using the 2.0.0 release. Perhaps this has been fixed, but this issue hasn't been updated? I'll poke at it, but CSS isn't an area of strength for me.
@T00rk thanks for your contribution to open source with this component! Am I crazy, or are you the only one with a date/time picker for MDL? Seems hard to believe such a basic component isn't being implemented by many...would love to hear your thoughts.

Also, are you developing against master or gh-pages? I was surprised to see these two diffs differ:
Shows many commits since the 2.0.0 release:
https://github.com/T00rk/bootstrap-material-datetimepicker/compare/2.0.0...gh-pages
Shows no commits since the 2.0.0 release:
https://github.com/T00rk/bootstrap-material-datetimepicker/compare/2.0.0...master

I see you made an attempt to address this particular edge case with https://github.com/T00rk/bootstrap-material-datetimepicker/commit/043c7ec44d957975cc7ab8b76d9764fc37431e40 - but it doesn't seem to work for me. It's worth noting I'm use Google's Web Starter kit, which seems to be impacting the styles included in your component:

Thus the issue is likely mine and not with your library.

My issue with selecting the date was resolved by adding this additional dependency:
<link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.2/css/bootstrap.min.css" />
I know bootstrap is in the title, but perhaps we could add some notes to the README here would make things clearer.

I have the same issue of @davidrsim


Initialisation: Application Ticker starts before rendering. Initial Freeze?

Hi!
I am relatively new to Pixi v5 and I find this behavior odd.
Assume the following code:
import { Application, Graphics, Point, Ticker } from 'pixi.js';

function makeRect(color: number, zIndex: number, pos: Point): Graphics {
  const rectangle = new Graphics();
  rectangle.beginFill(color);
  rectangle.drawRoundedRect(0, 0, 50, 50, Math.floor(50 / 2));
  rectangle.endFill();
  rectangle.position = pos;
  rectangle.zIndex = zIndex;
  return rectangle;
}

const app = new Application({ width: 70, height: 360, antialias: true });
document.body.appendChild(app.view);

const start = makeRect(0x00ff00, 1, new Point(10, 10));
const stop = makeRect(0x0000ff, 1, new Point(10, 300));
const tween = makeRect(0xff0000, 2, new Point(10, 10));

app.stage.addChild(start, stop, tween);

let tweenStart;
const begin = 10;
const end = 300;
const duration = 2000;

function tweenUpdate() {
  // start with the first update
  tweenStart = tweenStart || Date.now();

  const now = Date.now();
  const t = Math.min(1, (now - tweenStart) / duration);
  tween.position.y = begin * (1 - t) + end * t;
}

// Listen for animate update.
// app.ticker.add(delta => {
//   tweenUpdate();
// });

const ticker = new Ticker();
ticker.add(() => {
  tweenUpdate();
});

setTimeout(() => {
  ticker.start();
}, 2000);

I wrote a very very simplified time based animation/tweening. On the first call of tweenUpdate() I set the start time of my animation and I know it should last for 2000ms.
Now when I use the Application Ticker to run my animation right after the initialisation, I am missing half of my animation.
That is because the ticker is running and the tweenUpdate() happens before we can actually see anything on our scene.
When using the setTimeout() approach, starting the ticker only after the initial freeze, I can see the full animation.
Even when starting the Ticker in requestAnimationFrame, time passes until the first rendering is visble.
Is there an event I can rely on, to start my ticker after the initial rendering is visible to the user?
Why is pixi freezing up initially?

The Application has a Ticker instance built in and you should use that: app.ticker.add(). I think that a lot of the race condition stuff you’re seeing is because of this. Also the Ticker add method had a priority in case you have something that needs to run before rendering.

Using the Application Ticker (as I stated in my original report) I get the behavior I describe, meaning, I do not see the complete animation, as pixi is freezing up in the beginning!
Hence I am reporting!
I uncommented the app ticker and used my own to delay the start. I could as well put the setTimeout around adding my update function to the app ticker.

"freeze" word associate in my brain with "texture uploading lag". Please search docs for PIXI.prepare. I cant describe it in two words , its a big topic where no ideal solution exist due to relation to both loading resources and starting the stage, and it was discussed many times.

Even using pixi prepare the same behavior occurs.

Maybe its shader compilation? Try render graphics rect once before you start the ticker.


CI failures with GHC 8.8

E.g. https://github.com/ndmitchell/hlint/runs/3707891836?check_suite_focus=true says:
TEST FAILURE (BAD REFACTORING)
SRC: /home/runner/.cabal/store/ghc-8.8.4/hlint-3.3.4-ff2d1f010e79360de5348a757d7f6c211a5c35a3d44832c024922102288aa22b/share/hlint.yaml:1301:0
INPUT: test1196 = map ((,) (+ 1)) "123"
Refactoring failed: exit code 1

/opt/ghc/8.8.4/lib/ghc-8.8.4/settings: openFile: does not exist (No such file or directory)

@zliu41 - any changes that would have caused that?

/opt/ghc/8.8.4/lib/ghc-8.8.4/settings: openFile: does not exist (No such file or directory)

This indicates refactor is probably built on a different machine than the one running it (https://github.com/haskell/haskell-language-server/issues/591).
I'm not sure where the refactor binary used in CI comes from; it is not mentioned in ci.yml. My guess is if we cabal install it from ci.yml, the problem would go away.

#1300 is the fix.

We are now cabal installing it and it still doesn't work - any ideas? The first fix didn't work as it corrupted the cache on subsequent builds, so I moved the install line, and now 8.8 fails once more

I'm not very familiar with actions/cache, but looks like if you put the install after the cache then it was still using the cached, outdated refactor binary. Perhaps we can add the output of ghc --print-libdir to the cache key, so that whenever libdir changes (which would cause the "openFile: does not exist" error) then the cache is invalidated.

Hmm I see that in the subsequent builds, only 8.8 succeeded and all others failed. I don't understand how that could happen, since the cache key includes matrix.ghc and so caches for different GHC versions should be independent.

Thanks for all your work on this @zliu41! Much appreciated :)


nrf52840 and pyocd cannot program at addresses above 512k

Describe the bug
Boards with nrf52840 chip using the pyocd debugger cannot program flash memory above the 512k mark. When using the command west flash --hex-file foo.hex this successfully programs a nrf52840 device using the pyocd runner, provided the contents of the file foo.hex are for addresses below the 512k mark.
Here is an example hex file with content for above the 512k mark (foo.hex) which will fail to program:
:02000002F0000C
:107F0000A22EA1550960457CA4634314B00FCBC2D7
:107F1000DE96C473640F489EBD0007FFFFEFA7E025
:107F20007DF748B8AB3C4425A32C51CBA0C60EEA44
:107F3000D71257B80FA91E9A1F2441F637DC4135D6
:107F4000F86AC04EC3BC9ABC5ECAEE880379B4F02E
:107F500046FC24A2061475110B738A4D21CBEF59F0
:107F6000568CDBED956D8EAAFA14C72924D845509E
:107F7000C09D779DD7504626DEDE9B1148D1ABFBD6
:107F8000FF85FFEBD7642C3E29396D8F68D4A6504E
:107F9000D0ED6DC879F1895366AAF063B53E175BE1
:107FA000FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFE1
:107FB000FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFD1
:107FC000FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFC1
:107FD000314847424834314A584D4E3130353535B5
:107FE00035FFFFFFFFFFFFFFFFFFFFFFFFFFFFFF6B
:107FF0001234567890123456789012345678905540
:00000001FF

To Reproduce
Steps to reproduce the behavior:

west build -b nrf52840_mdk
west flash --hex-file foo.hex

Expected behavior
The contents of foo.hex should be programmed into the device
Impact
This is an annoyance, but can be worked around, the challenge is the workaround is only needed for boards using nrf52840 and pyocd. Other nrf52840 boards using runner nrfjprog do not have this issue
Screenshots or console output
Here is the output in the failure case:
$ west flash --hex-file foo.hex
-- west flash: rebuilding
[3/3] Completed 'project'
-- west flash: using runner pyocd
-- runners.pyocd: Flashing file: foo.hex
0000864:WARNING:file_programmer:Failed to add data chunk: no memory region defined for address 0x000f7f00
0000865:INFO:loader:Erased 0 bytes (0 sectors), programmed 0 bytes (0 pages), skipped 0 bytes (0 pages) at 0.00 kB/s

Environment (please complete the following information):

OS: Linux 19.04
Toolchain Zephyr SDK 0.11.2

Additional context
west flash runs the command pyocd flash -e sector -a 0xc000 -t nrf52 foo.hex which is incorrect, it should run the command pyocd flash -e sector -a 0xc000 -t nrf52840 foo.hex.
there are two possible workarounds:

manually run the pyocd command above to program foo.hex
call west flash with additional parameters west flash --hex-file foo.hex -- --target=nrf52840, however the additional parameters cause issues for boards that do not use pyocd as the runner.

I am not sure if this is a cmake issue, or a west issue.

west flash runs the command pyocd flash -e sector -a 0xc000 -t nrf52 foo.hex which is incorrect, it should run the command pyocd flash -e sector -a 0xc000 -t nrf52840 foo.hex.

FYI: @mbolivar-nordic

This is a bug in the nrf52840_mdk/board.cmake file, not a general issue with nrf52840 boards as reported.


Armada Scheduler Initialization Behavior Can Lead to OOMs

During initialization, the Armada Scheduler pulls the entire lifetime of jobs and job runs from the database in order to build its in-memory state. This leads to a memory consumption behavior that is directly related to the number of jobs and job runs in the database. This is a particularly sneaky issue when doing a rolling deployment of Armada after some stability because the Armada Scheduler ends up crash looping if memory requests/limits are not high enough.
I understand there is a pruning functionality to garbage collect jobs and job runs from the database but the initialization behavior of the Armada Scheduler can be made much more efficient considering that for initialization it only needs to materialize state for non-terminal jobs. Afterwards, the normal sync logic that checks for diffs based on the serial number is adequate. Ideally with improvements to the initialization sync behavior the memory consumption should be much more predictable in most use cases.
Below is an example of repeated OOM Killing until the scheduler's resources have been increased. At that point you can see the memory hump during initialization.

We have made a fix for this internally that I'm happy to upstream.

Yes that would be really useful- it's an issue we've been meaning to fix for a while now but haven't got round to.  I'd be happy to look at a PR for this.

Hey @Sovietaced,
Thanks for raising this issue!
We are looking forward to your PR.
Feel free to reach out if you need any support.

I'll have something up in a few days, gotta polish it up :)


Can you please help me I don't understand what to do.

sorry, making a tutorial soon..

Hi mindsetpro, can you do a complete tutorial on how to edit the already decrypted DBL file?


GO:0007035 ! vacuolar acidification

compare:
[Term]
id: GO:0007035
name: vacuolar acidification
namespace: biological_process
def: "Any process that reduces the pH of the vacuole, measured by the concentration of the hydrogen ion." [GOC:jid]
is_a: GO:0051452 ! intracellular pH reduction
intersection_of: GO:0045851 ! pH reduction
intersection_of: occurs_in GO:0005773 ! vacuole
and:
[Term]
id: GO:0007042
name: lysosomal lumen acidification
namespace: biological_process
def: "Any process that reduces the pH of the lysosomal lumen, measured by the concentration of the hydrogen ion." [GOC:jid]
synonym: "lysosome pH reduction" EXACT [GOC:bf, GOC:rph]
is_a: GO:0035751 ! regulation of lysosomal lumen pH
is_a: GO:0051452 ! intracellular pH reduction
one has a logical def, the other doesn't. One is in the regulation hierarchy, the other isn't. One explicitly mentions the lumen, the other doesn't (the acidification is presumably always in the lumen)
on a side note, should the child terms here not have negative and positive synonyms?
GO:0035751 ! regulation of lysosomal lumen pH
~~~         is_a GO:0035752 ! lysosomal lumen pH elevation

What should the general template for acidification terms be?

One option is to treat them all as regulation terms.

We have to be careful with occurs_in. It is strong, because

participates_in o occurs_in --> part_of (at some time)

This means that if G actively participates in vacuolar acidification, and this occurs in the vacuole (or even more specifically, the lumen) then G is at some time part of the vacuole (or lumen)

The safest thing might be to remove the acidification logical defs from the main GO, bounce them back to bp_xp_cc, and then put them back in later this year when we consider others of the same broad category. It may be safest to use the pattern of very specification relations here (and reference the lumen specifically)

one more thing

[Term]
id: GO:0035751
name: regulation of lysosomal lumen pH
namespace: biological_process
def: "Any process that modulates the pH of the lysosomal lumen, measured by the concentration of the hydrogen ion." [GOC:rph]
is_a: GO:0051453  ! regulation of intracellular pH
relationship: part_of GO:0007040 ! lysosome organization

How do we infer that this process is part of lysosome organization? The organization def template doesn't really mention anything about acidification. Crudely speaking, it seems more about shuffling around of parts (I guess the protons are parts...)

Reported by: cmungall

Original Ticket: [geneontology/ontology-requests/8986](https://sourceforge.net/p/geneontology/ontology-requests/8986)

vacuolar acidification is a slightly weird term,  (phenotype), what do we really mean?

Possibly useful reference for this ticket:
http://mmbr.asm.org/content/70/1/177.full.pdf+html

There are probably too many terms around here, but the problems described in this ticket no longer exist:


[Question] Cups and more secure ciphers

Hi,
I did further cryptographic review of packages which we ship in our operating systems regarding security certifications - e.g. FIPS - and I found out that there are several usages of MD5 algorithm, which is not considered to be safe according to FIPS certification and current security standards. Additionally Fedora and Red Hat Enterprise Linux are moving towards the ability to set the crypto policy on system-wide level [https://fedoraproject.org/wiki/Changes/CryptoPolicy] and MD5 is not allowed in the default settings/profile.
I plan to create a patch for replacing MD5 with a more secure algorithms for cryptographic use cases plus relaxing gnutls for non cryptographic use cases e.g. generating UUID and cookie and I would like to get it to the upstream sources, but I am not completely sure whether this is something that the project could be interested in and potentially accept? Additionaly if you have any guidance or advices to make the patch more acceptable for the project, please let me know.
Using secure and more recent crypto algorithms is beneficial not only for security certifications, but also in general, therefore I hope that you will consider changes that I would like to propose.
Thank you for your time and have a nice day,
Zdenek

@zdohnal What uses of MD5 are you concerned about in CUPS?
AFAIK, none of the remaining uses of MD5 matter:

MD5 for Digest authentication is a requirement unless the server/printer supports SHA2 (which we detect and use automatically)
MD5 for UUID generation is OK because there is no way to do prefix attacks and we don't use a lot of bits anyways
MD5 for showing a digest of a certificate chain to the user is purely informational - the actual validation compares the contents (bytes) of the certificate chain and not the hashes

MD5 is never used with TLS, and MD5 as a hash algorithm for certificates is no longer allowed either.

@zdohnal What uses of MD5 are you concerned about in CUPS?
AFAIK, none of the remaining uses of MD5 matter:
* MD5 for Digest authentication is a requirement unless the server/printer supports SHA2 (which we detect and use automatically)

You're right, I missed the first if block, where SHA2 can be used.

* MD5 for UUID generation is OK because there is no way to do prefix attacks and we don't use a lot of bits anyways

Seems good to me too.

* MD5 for showing a digest of a certificate chain to the user is purely informational - the actual validation compares the contents (bytes) of the certificate chain and not the hashes

You're right - I did not look properly - output of httpCredentialsString() where credentials are hashed is used only for info and for better comparison in httpCredentialsGetTrust().

MD5 is never used with TLS, and MD5 as a hash algorithm for certificates is no longer allowed either.

Unfortunately even those MD5 will not work if more strict crypto policy is set in gnutls, then gnutls_hash_fast() for MD5 will end with failure. This can be prevented with GNUTLS_FIPS140_SET_LAX_MODE(); and GNUTLS_FIPS140_SET_STRICT_MODE(); (more info on gnutls web https://gnutls.org/manual/html_node/FIPS140_002d2-mode.html ), which I plan to use for non-crypto use cases.
Would you be interested in such patch? I can create configure option for it if you would prefer the configuration option instead of putting it directly into the code, please let me know.

Or I can just use the old L. Peter Deutsch code when compiled against GNU TLS...

IMHO having GNU TLS disable a core crypto function rather than disabling it at a higher level is totally the wrong approach to take. They will just break working code without fixing anything...

Or I can just use the old L. Peter Deutsch code when compiled against GNU TLS...

Unfortunately then the project would lose the advantage of crypto library taking care of hash implementation, which in my opinion is more secure than have an internal implementation. And it spares your time for other stuff.

IMHO having GNU TLS disable a core crypto function rather than disabling it at a higher level is totally the wrong approach to take. They will just break working code without fixing anything...

It was just an example - in reality it will be forbidden on kernel level, according which crypto libraries will set up its cipher suites (IIUC).
The patch would cover allowing usage of MD5 for non-crypto cases inside the environment which disables MD5 and it would not lose its coverage of MD5 implementation by GNUTLS, so CUPS can run such systems with GNUTLS coverage. Would you be interested in such patch?

@zdohnal I’ll just need to see how invasive the patch is to say whether we’ll take it. But in the case of MD5 we’ve had L Peter’s code in CUPS forever...

@michaelrsweet Basically I plan to add those two lines mentioned above:
GNUTLS_FIPS140_SET_LAX_MODE(); and GNUTLS_FIPS140_SET_STRICT_MODE();
into functions where MD5 is used for non-crypto purposes:
cgi_set_sid()
httpAssembleUUID()
httpCredentialsString()
I can make it as new stub function, which will be called in those functions and it will take the name of current 'cupsHashData' - it will have the same parameters, so there will be no problem with changing API. The new stub function will call those two lines only when CUPS is linked with gnutls and it will call current cupsHashData function, but renamed to 'cupsHashData2()'.
If you would like me to write in the different way, please let me know.

@zdohnal Seems like the correct solution here would be to add these calls in the cupsHashData function itself.

(with a corresponding configure check, of course)

Hi Mike!
I created pull request for the issue https://github.com/apple/cups/pull/5620 . I tested cookie and UUID creation and it works.
I chose to create new cupsHashNoCryptoData() function as stub over cupsHashData for md5 algorithm, because if I put those relaxing calls into cupsHashData itself, it will allow to use MD5 even for digest auth (if server/printer does not have SHA2). Failing to authenticate against such machines is correct behavior when MD5 is used and GNU TLS forbids to use MD5 (according Nikos Mavrogiannopoulos, our gnutls upstream person).
Next I introduced --enable-gnutls-relax-mode configure option, which will enable MD5 in cupsHashData call for those non-crypto use cases (creation of cookie, UUID, digest of certchain for info). It is disabled by default (since not many distributions have forbidden MD5 yet) and can be applied only when CUPS is built with GNU TLS.
How does it look? Please let me know if I should do differently or what should I enhance.  Would it be acceptable to have it in CUPS?

Ok so we won’t accept a patch like that.
Local or printing is different from usage over the internet. For this reason, all of the cert and cipher suite policies are managed separately by CUPS so that appropriate policies can be assigned for local, “IoT” devices that are different from what you’d use for cloud services and web browsers. Moreover, CUPS always prefers the most secure hash algorithms and cipher suites when communicating with a printer. If a printer supports something better than MD5 or SHA1 we will use it.
If there is an API we can call to obtain specific policy choices for local printing, we will be happy to use it to set the defaults vs the current client.conf file stuff, but we will not break printing to satisfy the whims of someone that is focused solely on internet security.

I see what you mean and understand you point, I'll check it up with our crypto people what can be done.

According our crypto team there is an initiative for a tool which will allow to use specific cipher in specific program... so it can result in the state that we do not have to concern about how strict/relax gnutls is in CUPS and user can set it up in other app.
Until this feature is available, would you mind considering the pull request which is based on what you suggested before.

@zdohnal We will consider the new pull request (#5622) but I'd really like it to just be a configure test - if the function is there then use it, otherwise don't bother.

Changes pushed to 2.2.x and 2.3.x. Please review and post any feedback to the pull request (#5622).

LGTM and it covers the problematic use case. Thank you, Mike!


Append Blob changes are pushed as Put Block without append parameter

Storage Explorer Version: 1.4.1
Platform/OS Version: Windows 10
Repro Steps

I gave myself a SAS that uses an Access Policy with permissions (Read/List/Add). I then created an Append blob as shown:

When I then go to my SAS attached storage and try to append:

It gives this prompt:

After clicking apply on “Upload” results in a 403 failure:{
  "name": "StorageError",
  "message": "This request is not authorized to perform this operation using this permission.\nRequestId:212c2940-601e-0070-50a3-4039da000000\nTime:2018-08-30T20:51:36.5636032Z",
  …
}

Expected Result
From the Fiddler Trace it is doing a put blob opposed to a append blob:
PUT https://shraboinarmstorage.blob.core.windows.net:443/contributorscontainer2/testSharedAcess.txt?sv=2018-03-28&si=test&sr=c&sig=<SIG>&api-version=2018-03-28 HTTP/1.1
x-ms-blob-type: AppendBlob

If it was an append blob it would have ?comp=appendblock added to the end:
https://docs.microsoft.com/en-us/rest/api/storageservices/append-block

Is having the Append Blob operation on the road map?
Info on append: https://docs.microsoft.com/en-us/rest/api/storageservices/constructing-a-service-sas#specifying-permissions

It's likely this is just a bug, as the client library we use should have support for uploading to append blobs. We'll have to investigate how easy this will be.

Verify that this scenario works well with azcopy. Close if it does.

We need to pass the proper options to azcopy to make this work properly.

An workaround has been implemented and should have been released in 1.13.0 and 1.13.1.


Can't convert Banana classifier

Hey there, I'm trying to convert the banana classifier found here:
https://github.com/mrnugget/opencv-haar-classifier-training/blob/master/trained_classifiers/banana_classifier.xml
But I'm receiving:
"Error: Number of rects does not mach number of Nodes"
Any help is much appreciated!

:( my poor banana bro

@leemartin wow, thanks for the ping, i din't see the notification!
hmmm, that's strange. I'd suggest you firstly verifying if this classifier does works on opencv but i'm pretty confident that it works (almost sure that it was generated using opencv ... ). This converter is somewhat a 'port' of what opencv does to convert the old format to the new (https://gist.github.com/cirocosta/8209125570b7a525f64c#file-cascadedetect_convert-cpp-L301-L303 - in the comment, weak == node), so i think the solution might be to take a deeper look at how this is actually handed by the opencv interpreter and not only the opencv converter. (just removing the error won't solve it as trackingjs needs the propert number of rects and nodes)

Hey there, I can definitely confirm that the classifier works on the opencv side:
https://vimeo.com/103969578
I was just hoping to convert to something trackingjs requires to move my logic to the client.
Let me know what I can do!

Hi, if you run "opencv_traincascade" with the "-baseFormatSave" flag, it will save it in the old format, which will allow "gulp-converter-tjs" to convert it successfully.  To save it in the new format, just leave that flag out.
===== Example export to old format =====
opencv_traincascade -data classifier -vec samples.vec -bg negatives.txt
-numStages 20 -minHitRate 0.999 -maxFalseAlarmRate 0.5 -numPos 1000
-numNeg 600 -w 80 -h 40 -mode ALL -precalcValBufSize 1024
-precalcIdxBufSize 1024 -baseFormatSave

Actually the converter should work for both formats (old and new) as it converts ok for some classifiers :(

I'll give it a shot!

:+1: :+1:

Hi, I'm having the same problem. As far as I see it only works with old formats, these ones satisfy #nodes==#rects (i.e. for each node there is a feature and only one), and it is not possible to declare more or less rects, even if they are not going to be used and vice versa (which is the case of the new formats of OpenCV, working properly). They are just referenced by a number.
Here there is a good example from the official OpenCV: http://docs.opencv.org/doc/tutorials/objdetect/cascade_classifier/cascade_classifier.html It does work ok, but when trying to convert the haarcascade_eye_tree_eyeglasses.xml with gulp-converter-tjs it doesn't work.
Even when I commented lines 145, 146 in converter-tjs.js, undefined access errors appear through this piece of code, loop from 177 to 196:
// iterate through nodes
    for (var j = 0; j < stage.nnodes;) {
      // tilted, rectsLength
      var node = stage.nodes[j++];
      var rect = orig.rects[f++];

      results.push(rect.tilted);
      results.push(rect.data.length);

      // iterate through rects
      for (var k = 0, N = rect.data.length; k < N;) {
        // rectLeft, rectTop, rectWidth, rectHeight, rectWeight
        var R = rect.data[k++].split(' ');
        for (var l = 0, M = R.length; l < M; l++)
          results.push(+R[l]);
      }

      results.push(node.threshold);
      results.push(node.left_val);
      results.push(node.right_val);
    }

I think the problem is that as you are parsing the rects inside each node, in the new xml format this is a problem because you may have different amount of nodes and rects, so it tries to access to undefined objects. Of course with the old format it works ok because these numbers are the same.
You think it could be fixed if you use two different loops instead one inside the other? @cirocosta Or how could I fixed it in order to work with new format files?
Cheers! :wink:

+1

+1

+1

+1

+1

Still a dream of mine to see this adjusted.

+1

Hi,
I sure opencv training will create new format classifiers that break this.
if (g !== f)
I have one that has 40 stages.   It works in opencv detectMultiScale fine but wont convert through this.
Are there any docs on the data structure and what the parts are used for.  I'm sure there is a simple solution to this.

I've created a gist that is an attempt where I've modified your converter to support the JSFeat standard.  https://gist.github.com/p0wdrdotcom/d6a145771a391405f445ae91a0c3ae5e
I think that the new opencv xml format tries to save space in the XML file by de-duplicating features.
I assume that this is actually a index pointer to the feature for the node.
node.f = +internalNodes[2];
After the XML parsing is done, I marry them up like so...
haarStruct.complexClassifiers.forEach(function (stage) {
            stage.simpleClassifiers.forEach(function (weakClassifier) {
                var rects = features[weakClassifier.f].rects.map(function (rect) {
                    return rect.split(' ').map(function (numberString) {
                        return +numberString;
                    });
                });
                delete weakClassifier.f;
                weakClassifier.features = rects;
            });
        });

The structure is different but I think it gathers the right feature rects.

Hey @p0wdrdotcom , i really appreciate your efforts! I have literally no time to maintain this right now :/ As you said, i suppose this should not be hard, just a matter of getting the translation from cv to the right translation. By now, can't remember the format (and as i remember there's no real docs on this internals; just went through the code by that time).
@p0wdrdotcom  , if you'd like to give continuity to this, feel free to do so; i can grant you the permissions 😁  It'd be an awesome addition to tracking.js as a whole!
Thx!

Okay, I'll attack it this properly.  I'll get some opencv classifiers and setup some test cases.  I''ll use tracking JS as it seems to be more maintained than JS feat.  I don't have experience with Gulp but I can just work on the ConverterTJS unit

@leemartin @cirocosta  Hi, so did you found solution to your problem, I am stuck with the same problem, using a custom trained Har file (new format) and it gives me the same problem
"Error: Number of rects does not mach number of Nodes"
Any help is highly appreciated.

+1


Detach method ($validator.detach) doesn't update "fields"-property

Versions:

VueJs: 2.4.2
Vee-Validate: v2.0.0-rc.13

Description:
The $validator.detach method doesn't update/trigger the fields/fieldBag property.
Steps To Reproduce:
https://jsfiddle.net/p28e8a95/40/
Removing an input element within this fiddle should update the fields prop accordingly.

Thanks for reporting this, I pushed a small fix for it and it should be up with the next tag, I have a small observation tho, you don't have to detach the field if you are splicing it from the array, detach will be called automatically once the field is spliced from the array.

Perfect!!!! Thanks a lot.


Fix crash on FileSystemDock's tree when trying to collapse or expand folder

This PR fixes a crash when opening a project and starting right-click on a root or any subdirectories (Without selecting any item else) in the file system dock. Then choose collapse or expand. (or when the tree gets updated.)

Thanks!

Thanks!

Cherry-picked for 3.2.4.

Cherry-picked for 3.2.4.


"defaultValue": "i3.xlarge" is not a Azure virtual machine SKU.

[Enter feedback here]
This is an azure databricks cluster policy guidance page, it is not good to mention AWS SKU values in default values.
Please remove "defaultValue": "i3.xlarge" and give a suitable default value.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 004e9b59-4750-9270-652f-ea7ef06e2584
Version Independent ID: 4a5dd4af-4b95-bd03-0ca5-ce0e03ca7b57
Content: Best practices: Cluster policies - Azure Databricks - Workspace
Content Source: databricks/administration-guide/clusters/policies-best-practices.md
Service: azure-databricks
GitHub Login: @mssaperla
Microsoft Alias: saperla

@atul-ram  Thanks for the feedback! I have assigned the issue to the content author to evaluate and update as appropriate.

Thanks for your dedication to our documentation. Unfortunately, we have been unable to review your issue and apologize for the delayed response. The requested updates have not yet been made. The timeline for resolution varies based on resourcing. We've created an internal work item (DOC-7008) to incorporate your suggestions. We are closing this issue for now, but feel free to comment here as necessary.
#please-close

#please-close


Slow performances on query

Hi,
I'd like to migrate from php/laravel to nestjs. I'm doing some tests with node-odbc to check for any perf issue and I'm facing very slow queries.
Every single/simple query is slow vs it's PDO equivalent.
Exemples:
Simple query: 160ms for PDO (same with DBeaver) vs 2.5sec node-odbc
Much larger query (about 5k lines): 2 seconds PDO vs 40 sec node-odbc.
Both are using the same unixODBC source / 64bits ibm-db2 driver. Debian 9 (tried on Debian 10 also). Node 18.
No fancy SQL.
Do you have any idea where I should start digging ? Thank you.
Regards,
Thomas

I also see poor performance vs other connectors (ex: JDBC). Performance seems fine when the code runs on power, but when using odbc on my pc, it's painfully slow. I also see differences of < 1s with jdbc vs > 1 min with odbc.

Are you using the IBM i Access driver? If so, they work on the same protocol so they should have roughly the same performance, though certainly there are different options which can be enabled that could affect it.
I'd need a trace of both to compare.

Yes, my connection string looks like this...
let connectionString = Driver={IBM i Access ODBC Driver}; Naming=1; System=${process.env.dbName}; Uid=${process.env.dbId}; Pwd=${process.env.dbPw};

@kadler Are you asking for a network trace?

@kadler I was able to do an odbc trace following the instructions on the npm site: https://www.npmjs.com/package/odbc
Open up ODBC Data Source Administrator and select the "Tracing" tab. Enter the location where you want the log file to go in "Log File Path", then click "Start Tracing Now".
I've attached the resulting file. Is this what you're looking for?
SQL.LOG

No. Instructions are in my previous post, though I just remembered that if you're on Windows, the commands are different for ODBC. On Windows, run cwbcotrc ON and then find trace files under C:\Users<user>\Documents\IBM\Client Access\Service\Trace Files

Ok, I've attached a trace. I'm running a simple sql statement: "select * from [table] limit 100". When the trace is off, this statement runs in 9-10 seconds. With the trace on, it timed out and never completed.
Thanks for your help with this! Let me know if there is anything else you need on this.
cwbtrace-64-node.exe-18060.log

@snotmare From the trace, I see 3 connections being made. I'm guessing you're using a pool? None of these connections ever do anything though - your statement is never sent to the server.
I did find a driver bug where it's exchanging client/server attributes, but this only wastes half a second.
Each connection takes about 30-40 seconds for each connection to be made, which does seem like it's pretty slow. Part of that is port mapper, which takes 1s each. Each ODBC connection will connect to the as-signon and the as-database, so that's 1s each just to connect to the port mapper and ask what port the servers are on. These ports are almost always left default, so by switching the lookup mode to "use default ports" you can save 2s for each connection. There used to be a GUI to change this in IBM i Navigator, but AFAIK there's no easy way to set this anymore, just through the registry. The registry key is under Computer\HKEY_CURRENT_USER\SOFTWARE\IBM\Client Access Express\CurrentVersion\Environments\My Connections\<system>\Communication\Port lookup mode - setting this to 2 will use the default ports.
But that really isn't that much compared to the whole 30s. I see lots of delays between calls to the server and I'm not sure why. Perhaps the trace is really slowing things down a lot?
If you give me a jdbc trace I could try to compare the performance. Ideally though, we'd have a more complete ODBC trace where a statement actually gets executed (is there a reason it never completes?).

@kadler I was able to get an odbc trace with a call in it. I increased my connection timeout and went to lunch, lol. It took a looooong time, but the sql statement I ran finally finished. I've attached the trace. I'm struggling to get a jdbc trace.
It may not like my connection string or something. I'll post it when I can get it to work.
cwbtrace-64-node.exe-29612.log

@kadler I've got a jdbc trace! One difference between the jdbc and odbc traces is that we are using jdbc to start up our local server. You'll see a couple calls in addition to the one I'm testing. The statement I'm testing is:
select * from gppuser limit 100
For jdbc, that finished in about 400ms.
Thanks again for your help!
jdbcTrace.txt

@kadler We are running both idbc and odbc from a pc and hitting a server remotely. Our current set up is to connect to a db2 database with jdbc from a pc, but when running on our dev or prod server, we use idb. We would like to use odbc for both pc and server.

Ok, I just wanted to make sure this is an apples to apples comparison.
Looks like the JDBC trace was insufficient as I need a datastream trace. Can you please re-run with com.ibm.as400.access.Trace.category=all. FYI, I found a better guide for JDBC tracing here: https://www.ibm.com/support/pages/all-one-toolbox-tracing-guide

Maybe it doesn't matter about the datastream trace. I am seeing massive performance issues with your ODBC trace. It takes about 11 seconds from the start of the trace to the start of the first TCP:connect. On my laptop (Lenovo T470), this takes about 50ms. That's about 200x slower than mine, ouch. Perhaps you have some invasive security software mucking things up that doesn't seem to affect java for some reason?

One thing I did notice is that each row is fetched one at a time. This requires a round-trip to the server for each row fetched, which will impact performance and it's better to use a block fetch instead. While node-odbc doesn't support block fetch, the IBM i Access driver supports internal blocking - it will fetch blocks of rows then hand them back one at a time. However, this is disabled when using scrollable cursors like node-odbc uses (SQL_CURSOR_STATIC). From your JDBC trace I can see that it is set to fetch blocks of 512K (block size = "512") unless FOR UPDATE is specified on the statement (block criteria = "2"). The default behavior for the ODBC driver is to use 256K blocks, so it should be close in performance if the internal blocking wasn't being disabled by the cursor type.
I'm not sure why node-odbc is using a scrollable cursor, since it offers no way to scroll. Likely this should be changed to SQL_CURSOR_FORWARD_ONLY, but that's the default so it shouldn't need to be set anyway. The change to set the cursor type was made in #161 but there was no mention of why the change was made, so I'm checking with @markdirish.

Any updates on this? Just didn't want this to be closed because it's stale.

@snotmare ,
I have remove the explicit setting of CURSOR_TYPE to SQL_CURSOR_STATIC in a beta-tagged release of the package. You should be able to install it with:
npm install odbc@beta

Everything else in the package is completely unchanged, so any difference in performance should be the result of @kadler's suggestion. Hopefully it's a silver bullet!

Love to hear it! I'll try to get an official latest release out later today!

Ope! This should be fixed in the latest version (2.4.7) available on npm!
npm install odbc@latest

@snotmare
How did you get that performance gain, if I may ask? I have an extremely simple query with 100 rows and 3 columns and it takes me ODBC connection a whopping 1.556s  while it's instantaneous through Run SQL Scripts in ACS.

@kadler
Could you please take a look at my odbc trace and perhaps give me a hint what's wrong with my connection? I am querying the a table function to get current active jobs (see image) and it consistently takes 10 times less than through odbc:

cwbtrace-64-node.exe-12932.log

@snotmare
How did you get that performance gain, if I may ask? I have an extremely simple query with 100 rows and 3 columns and it takes me ODBC connection a whopping 1.556s while it's instantaneous through Run SQL Scripts in ACS.

Hello! I simply updated to the version mentioned above. Maybe that will help you?


s1.sentry-cdn.com

Blocking s1.sentry-cdn.com messes up the sign-up process.

yet another try to have sentry unlisted... :roll_eyes:

For what you need such a telemetry service?

I still haven't found out, the web logs !=200  are still sufficient to my needs after like what ~23 years with hosting services


add domain manager support to the client

Many thanks for this contribution!
The changes have gone through CI, and have been uploaded to oss.sonatype.org. The new artifacts should be available soon.


How to manually checkpoint ?

Hello, thank you for your contribution. I would like to ask, how should I write the code to manually checkpoint when enabling WAL mode?
I have already tried db.Exec("PRAGMA wal_checkpoint;"), but it doesn't seem to work.

The API for manual checkpoint is not currently exposed.


How to preprocess data for abstractive summarisation?

You can follow the steps mentioned in the this url. If you have any specific problem, please elaborate.