torch-directml : RuntimeError on nn.BatchNorm2d with affine=False

nn.BatchNorm2d fails when affine parameter is false.
Code
import torch
import torch.nn as nn
import torch_directml

def batch_norm_2d_affine_false():
    device = torch_directml.device()

    channels = 32
    tensor = torch.rand((2, channels, 64, 64), dtype=torch.float32, device=device)

    bn = nn.BatchNorm2d(channels, affine=False, device=device)
    result = bn(tensor)

    print(f'{result.to("cpu")=}')

if __name__ == '__main__':
    batch_norm_2d_affine_false()

Result
Traceback (most recent call last):
  File "path\to\bn_error.py", line 19, in <module>
    batch_norm_2d_affine_false()
  File "path\to\bn_error.py", line 13, in batch_norm_2d_affine_false
    result = bn(tensor)
  File "path\to\venv\lib\site-packages\torch\nn\modules\module.py", line 1194, in _call_impl
    return forward_call(*input, **kwargs)
  File "path\to\venv\lib\site-packages\torch\nn\modules\batchnorm.py", line 171, in forward
    return F.batch_norm(
  File "path\to\venv\lib\site-packages\torch\nn\functional.py", line 2450, in batch_norm
    return torch.batch_norm(
RuntimeError: shape '[1, 32, 1, 1]' is invalid for input of size 0

Testing Environments

OS: Windows11 22H2
Python: 3.10.8
PyTorch: 1.13.1
torch-directml: 0.1.13.dev221216
GPU: Radeon VII
Radeon Driver: 22.Q4

Hi @reid3333, thank you for bringing this up! We added support for affine=False in our newest release of torch-directml <IP_ADDRESS>.dev230301. Give it a shot and let us know if you face any issues.

Thank you! I have confirmed that it works fine.


Update Tags for Packagist

The newest semantic version tag 2.0 is out of date with the current master branch, I'd prefer not to have to use dev-master.  Could the current version be tagged with 2.1?

The tag 2.0 was added on 23/12/2014 so that's over a year without a composer update semver wise.

@gordonbanderson, I have lots of small tweaks of this module locally -- haven't had te time yet to properly update Git. Also, I have yet to take some time to look into SemVer... I've just given you push access, please go ahead and make the changes you require.

Regarding SemVer it took me a little while to get my head into it but it's actually quite simple.
If a version is likes of 2.0.0 then it will change as follows:

2.0.1 - a bug fix has been made on the 2.0.0 version.  No functionality changes
2.1.0 - functionality has been enhanced, but in a backwards compatible non breaking manner (this is the change I was wanting to make which prompted this issue)
3.0.0 - new functionality is added that is not backwards compatible.

I can then do ```composer require "micschk/silverstripe-liveseo:~2" and provided semver is adhered to, whenever I update I know I will be updating to a version that is backwards compatible, i.e. things should not break :)
BTW I do not have rights to

Update packagist for this module https://packagist.org/packages/micschk/silverstripe-liveseo
Add packagist as a service hook in the module


Enhancement: Add Color Support to STL Export and Import

See https://en.wikipedia.org/wiki/STL_(file_format)#Color_in_binary_STL

OpenJSCAD.org 0.5.1 Alpha Release has support for colors when IMPORTING. Export support is still pending.

This issue was moved to jscad/io#11


[Event Request] Codeunit 99000769 "Production BOM-Check" procedure CheckCircularReferencesInProductionBOM

Describe the request
Could we please have a new event OnCheckCircRefInPBOMOnAfterProdBOMLineSetFiltersin procedureCheckCircularReferencesInProductionBOMincodeunit 99000769 "Production BOM-Check"`?
Example:
local procedure CheckCircularReferencesInProductionBOM(var TempProductionBOMHeader: Record "Production BOM Header" temporary; VersionCode: Code[20])
var
      ProductionBOMHeader: Record "Production BOM Header";
      ProductionBOMLine: Record "Production BOM Line";
      ProdItem: Record Item;
      ProductionBOMNo: Code[20];
      NextVersionCode: Code[20];
      CheckNextLevel: Boolean;
begin
      ProductionBOMLine.SetRange("Production BOM No.", TempProductionBOMHeader."No.");
      ProductionBOMLine.SetRange("Version Code", VersionCode);
      ProductionBOMLine.SetFilter("No.", '<>%1', '');
      >>>>>>>>>>>>>>>>>
      OnCheckCircRefInPBOMOnAfterProdBOMLineSetFilters(ProductionBOMLine, TempProductionBOMHeader, VersionCode)
      <<<<<<<<<<<<<<<<<
      if ProductionBOMLine.FindSet() then
            repeat
                  if ProductionBOMLine.Type = ProductionBOMLine.Type::Item then begin
                        ProdItem.SetLoadFields("Production BOM No.");
      ...
end;

>>>>>>>>>>>>>>>>>
[IntegrationEvent(false, false)]
local procedure OnCheckCircRefInPBOMOnAfterProdBOMLineSetFilters(var ProductionBOMLine: Record "Production BOM Line; TempProductionBOMHeader: Record "Production BOM Header" temporary; VersionCode: Code[20])
begin
end;
<<<<<<<<<<<<<<<<<

Additional context
Due to a modification in our software solution, an error occurs when calling up the "Cost Shares" page from the item card. The Microsoft standard assumes in the source code that if the type is not an item, it is a production BOM. Retrieving the BOM header then leads to an error.
To solve this problem, the filter in the production BOM lines needs to be influenced so that, for example, the provided group is no longer available in the production BOM for resolution. For this purpose, we have created this event request. As soon as this event is available, it can be subscribed and commented on with the search term
Internal work item: AB#498591

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. Please do not reply to this, as we do not monitor closed issues. If you have follow-up questions or requests, please create a new issue where you reference this one.
Build ID: 15987.


Windows system headers not indexed

Cquery shows STL types such as vector<>, map<>, etc as undefined/int.

This appears to have been because the Windows STL headers used C++14 features and the project was set to C++11 in the compile_commands.json.


[Event Request] Table 5092 Opportunity - OnBeforeFinishWizard

Please add the event OnBeforeFinishWizard() in Table 5092 Opportunity like this:
procedure FinishWizard()
var
    ActivateFirstStage: Boolean;
begin
    OnBeforeFinishWizard(Rec, OppEntry); // <-- new event
    [...]
end;

The new event:
[IntegrationEvent(false, false)]
local procedure OnBeforeFinishWizard(var Opportunity: Record Opportunity; var OppEntry: Record "Opportunity Entry")
begin
end;

Thanks!

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. Please do not reply to this, as we do not monitor closed issues. If you have follow-up questions or requests, please create a new issue where you reference this one.
Build ID: 40744.


Make sure /users/.../labelImg/ is a valid image file.

hello, everyone.
I have a same issue like #176 or #111 .
When I try to emulate labelImg, and change directory, the error "Make sure /users/.../labelImg/ is a valid image file. " occurs.
In case of me, the error occurs even if I switch python versions to 3.7.
How can I solve this issue?

mac OS
-Python 3.7.0
-pyqt5

I'm sorry I am solved.
The solution was just following README. By following README, I could emulate labelImg correctly.
(Used another approach) The cause of my error is perhaps the blog I used to programming.
I think the information was too old to rely on.


BZ-1281864 - Marshalling error accessing remote EJB services app with…

… Sybase DB - revert this wrapping Date objects as sybase driver is required to be present on client side to ensure correctness of the remote invocation
This reverts commit 78a35ca456c5b6c4afcd6eb1551023147f1cd9da.

+1


Contributing Guide Wanted

Hi, this theme is awesome!
But I am confused about how to contribute to this project.
Is there any Guide for those who want contribute to this project ?

Thx, I will write pull request template file and details the week.

PULL_REQUEST_TEMPLATE.md
ISSUE_TEMPLATE


Where is the reference documentation for TimerInfo?

I'm interested in seeing the reference documentation so I can learn more about the semantics of TimerInfo's properties. However, this documentation currently doesn't appear to exist. Here are the dead ends developers run into due to the current state of things:

Poor results when using search engines to search for TimerInfo
Using "Go to Definition" on TimerInfo in Visual Studio reveals TimerInfo's declaration. However, the doc comments are missing so it doesn't reveal any insights.

This page gives insights about TimerInfo by linking to its source code but that solution isn't ideal for the reasons listed above.
Adam Comella
Microsoft Corp.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: b5527c3b-a5da-c73d-66c2-20d96003ff7c
Version Independent ID: 42154c7b-b0e0-26db-79bc-3f1673c48e40
Content: Timer trigger for Azure Functions
Content Source: articles/azure-functions/functions-bindings-timer.md
Service: azure-functions
GitHub Login: @craigshoemaker
Microsoft Alias: cshoe

Hi @rigdern Thanks for reaching out. We will review and update as appropriate.

@rigdern - looks like the source code comments are filled out pretty well now. What more information would you like to see, or do those comments provide sufficient information now?

@craigshoemaker I filed the GitHub issue because I couldn't find any reference documentation for TimerInfo on docs.microsoft.com. For example, the docs don't describe the meaning of TimerInfo's Schedule or ScheduleStatus properties.
I was expecting the TimerInfo documentation to look similar to the reference documentation for System.Threading.Tasks.Task in that all properties and methods are documented. For example, the Id property of Task is documented here.

Since this is an issue with the API documentation and not the Function binding article, I am moving to #please-close this issue. In the meantime, I'll raise this issue with the team responsible for the API docs.


Add MS Word guidance to Self-assessment Exercise Downloads

Background
In order to minimise user-generated issues with the new SA upload extraction process, we would like to share guidance with SETs so they can lock down their Word document before adding to the Downloads section
Feature(s)

Add link to Word guidance on modal that appears when users click on Add to upload their SA template

Link to this file to open in a new window/download How to restrict access to selected sections of Word documents.pdf

Hey team! Please add your planning poker estimate with Zenhub @drieJAC @HalcyonJAC @tomlovesgithub @warrensearle

The PDF may need to be stored in firebase storage.


issue with static context inside a nested class

Hi all —
It appears that we stumbled upon a bug today.  The problem arises when using extends, nested classes, and the static context.  Consider that following code, that will compile just fine in pre 1.2 coffeescript
class Outer extends Base
  class Inner
    @doStuff()

Now, in CoffeeScript 1.2, this will throw the error Cannot call method "push" of undefined.
Removing either @doStuff() or extends will compile fine, as will "denesting" the classes.

This is a regression that was fixed on master a while back -- we need to cut a new release pronto to get the fix out.


New flush DNS alias

On Yosemite, flush DNS has changed again:
sudo discoveryutil mdnsflushcache; sudo discoveryutil udnsflushcaches;

Very nice. Thanks for this.

Here's an Oct 2014 guide on clearing the local DNS cache in OS X 10.5-10, Linux and Windows


Add unit test exposing potential duplicate webhooks

While reviewing another pull request, I've noticed this anti pattern - filtering by a reverse foreign key without distinct
webhooks = webhooks.filter(
        is_active=True,
        app__is_active=True,
        events__event_type__in=[event_type, WebhookEventAsyncType.ANY],
        **permissions,
)

I'd recommend to either add distinct or to add a comment why is it not needed. It doesn't seem like the createWebhook mutation is protected against it.
The unit test shows en example scenario where _get_webhooks_for_event could return a single webhook twice, since it was configured to be triggered by both event_type and ANY.
>       assert len(webhooks) == 1
E       assert 2 == 1
E        +  where 2 = len(<QuerySet [<Webhook: Simple webhook>, <Webhook: Simple webhook>]>)

Impact

[ ] New migrations
[ ] New/Updated API fields or mutations
[ ] Deprecated API fields or mutations
[ ] Removed API types, fields, or mutations
[ ] Documentation needs to be updated

Pull Request Checklist

[ ] Privileged queries and mutations are guarded by proper permission checks
[ ] Database queries are optimized and the number of queries is constant
[ ] Database migration files are up to date
[ ] The changes are tested
[ ] GraphQL schema and type definitions are up to date
[ ] Changes are mentioned in the changelog

@stnatic Your test is failing. Could you take a look?

@L3str4nge That's the point - it shows how a single webhook is returned twice by that helper function. The code can be easily adjusted by adding distinct but first I want to make sure that it wasn't omitted on purpose (performance reasons? although I think in this case it's negligible)

Why we can't just fix that? :D

I think it should be rewritten with subqueries - a separate query to get active apps, then another to get the right event types, and the third one combining it all together.

I would suggest to consider this together with https://github.com/saleor/saleor/issues/9138 as this is also the piece of code that makes ANY_EVENT apply to sync webhooks


Rhea annotations

Main improvements in this PR:
Associate Rhea ID to some reactions in the model. More information about the mapping process to Rhea can be found here
I hereby confirm that I have:

[X] Tested my code on my own computer for running the model
[X] Selected devel as a target branch

The most recent commit introduced some new associations that include one-to-multiple links between Human-GEM and Rhea. This is completely fine if the links can be verified programmatically or manually. Otherwise, they probably should be leave out.
From the point of view of reviewer, it's alright to have less associations as long as they are accurate.

One-to-many links increase the difficulty of using the annotations as they need to be treated differently in code. If possible, sticking to a single id simplifies the work.

@pecholleyc it's pleasant to go through these Rhea associations, especially the approach via equation mapping that nicely link to the ones with proper reaction direction. While the way through UniProt link to Rhea ids in undefined directions. Could the latter be revised with proper direction by using the equation mapping method?

@pecholleyc were these Rhea IDs with directed reaction updated manually, without the help of equation mapping?


Backtrack Problems

nQueens
Sudoku

Can you show me the output please?

Its ok, but it would be better if under Backtracking you add a readme file where you upload the output along with some description of your code.
You can edit that in this readme only

OK, will do that.Will create a nice documentation.

This PR has been merged. Now write documentation.


refactor: remove explicit dependencies everit-json-schema

Description
The library is only used in gravitee-json-validation so no need to declare it.
Additional context

📚  View the storybook of this branch here

🎉


fuse mount: decide what to do with UID/GID of files/dirs/symlinks

At the moment, restic uses root (UID/GID 0) for all files and directories in the fuse mount. The original authorship information is available in the node, but this data is machine specific. As soon as the repo is mounted on a different machine, it doesn't make sense any more.
Should we leave it that way (using root) for browsing snapshots, or maybe offer a switch to display real ownership?

What do other people do? For example nfs or sshfs etc.?

NFS has a static mapping table, sshfs has:
   -o idmap=TYPE
          user/group ID mapping, possible types are:
           none   no translation of the ID space (default)
           user   only translate UID of connecting user
           file   translate UIDs/GIDs based upon the contents of uidfile  and gidfile

   -o uidfile=FILE
          file containing username:uid mappings for idmap=file

Access modes on fuse filessytems aren't enforced by the Kernel, so I think we should take same approach as sshfs: display the original ownership information.

sounds good to me

In addition we could try to look up the owner's name on the current system. If it is there, use the uid as the owner...

I think this is an enhancement for later.

Agree, I think we should stick to what other systems (sshfs, nfs, rsync, ...) do unless someone explicitly complains about it...


Add bot

What type of PR is this?

/kind feature
What this PR does / why we need it:
Which issue(s) this PR fixes:
Fixes #231
Special notes for your reviewer:
Does this PR introduce a user-facing change?:

/cc @Iceber
PTAL


Unable to connect cluster when specified serviceAccountName but autoMountServiceAccountToken: false

Pre-requisites

[X] I have double-checked my configuration
[X] I can confirm the issues exists when I tested with :latest
[X] I'd like to contribute the fix myself (see contributing guide)

What happened/what you expected to happen?
What happened
Occurred below errors while creating resource via container/script template
create-resources-via-container-template: error: failed to create serviceaccount: Post "http://localhost:8080/api/v1/namespaces/default/serviceaccounts?fieldManager=kubectl-create&fieldValidation=Strict": dia
l tcp <IP_ADDRESS>:8080: connect: connection refused

what you expected to happen?
Able to create resource via container/script template successfully.
Version
latest
Paste a small workflow that reproduces the issue. We must be able to run the workflow; don't enter a workflows that uses private images.
metadata:
  name: create-resources-via-container-template
  namespace: argo
spec:
  executor:
    serviceAccountName: sa-writer
  serviceAccountName: sa-writer
  automountServiceAccountToken: false
  entrypoint: main
  templates:
    - name: main
      container:
        name: main
        image: bitnami/kubectl
        command:
          - sh
        args:
          - -c
          - |
           kubectl create sa test

Logs from the workflow controller
healthy

Logs from in your workflow's wait container
healthy

Would you like to submit a PR to fix it?

@terrytangyuan 👍 Please assign this issue to me.

Per https://github.com/argoproj/argo-workflows/issues/12848#issuecomment-2026546244, this seems to have been incorrectly analyzed; an SA token shouldn't be mounted if automountServiceAccountToken: false -- you have literally instructed it not to. An error trying to reach the k8s API with no SA token would be correct behavior.


Dev

I write a demo for use Tianditu in App.vue
Added an event ‘ready’ to view

thanks
But I need the only the source files and sources/index.js. Please only commit these files. Others are not
necessary. Why do you change useView or View or package-lock.json :)

.


Notification not receive when app is open

My Device is LG V10
When i close app notifications are receive without any problem
But!, Not received when app is open!

Either you need to enable show_in_foreground or you need to present local notification by yourself.

i am sending show_in_foreground: true but it's still not working


Remebering Height/Width across Video Sessions.

Is it possible to Remember Video Size across Various Float Sessions ?
I have a large Screen and it involves me resizing Video after every start to make it right Size. If Plugin could remember last Width or allow it to be Configured in Setting that would be of Great Help.

hi, it may be simpler to change the size for all videos by copying and pasting the following code to your custom.css file, which can be found in the logseq folder of your graph (reference):
/* you can change the height to whatever works best for you */
iframe[id^='youtube-player'] {
  height: 500px !important;
  width: 100% !important;
}

/* for wide mode */
main.ls-wide-mode iframe[id^='youtube-player'] {
  height: 750px !important;
  width: 100% !important;
}

Thanks this worked Perfectly !!
For others trying out, do note edit custom.css can be done from settings as well. However due to a bug currently its not working.
https://github.com/logseq/logseq/issues/9296
Direct File edit works and applies without any reload of Logseq.


New version: OctopusDeploy.Server version 2022.3.10723

Result: Installation Failed

Manifest
Add/Remove Programs

Name
Octopus Deploy Server

Version
2022.3.10723

Publisher
Octopus Deploy Pty. Ltd.

ProductCode

Auto-updated by vedantmgoyal2009/winget-pkgs-automation in workflow run 3644
Microsoft Reviewers: Open in CodeFlow

@wingetbot run


Add dedicated whitelist support for Access-Control-Allow-Credentials header

Currently, there is no option to limit Access-Control-Allow-Credentials header to a specific domain.
Ability to set a whitelist for this header is required to allow a whitelisted SPA to authenticate with cookies, but prevent CSRF from any other site, for example.

PR: #328

Closing due to increased complexity in the PR, as I commented there.


LockoutHealTime: 10 minutes or 2 hours?

[Enter feedback here]
It is INDISPENSABLE that you provide CLEAR and SIMPLE instructions as how to configure the TPM anti-hammering policy on computers that run current versions of Windows.
The page I'm coming from is typical of the rest of your fussy and incoherent documentation about TPM management in Windows.
I'm not sure many care whether some  reg value was 4 and now is 5 or whether the TPM owner password is retained by Windows anymore.

I can't understand this information is not available. Don't you see the problem?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 92fdc530-003f-eb25-15a3-8622502e53d1
Version Independent ID: 4c8edcb5-53c3-3242-6eca-5ac24f3f8c30
Content: Manage TPM lockout (Windows) - Windows security
Content Source: windows/security/information-protection/tpm/manage-tpm-lockout.md
Product: w10
GitHub Login: @DulceMontemayor
Microsoft Alias: dansimp

Hello @jpm-z - Thank you for your feedback. Can you please explain what exact content you are looking for that is missing in the document?
If you are expecting any change in the way TPM works with Windows, I would suggest you use the Rise your Voice portal to send the feedback to the engineering team.
@e0i - Please guide the user on how he can send feedback using Rise your Voice Portal.
Thanks.
Imran.


create playlist parser for m3u, pls, smil and json playlists

#1016

I don't really need this functionality to be part of 'core' and rather see it in a plugin. what you @katspaugh?

Definitely.

ok I'll create it as a plugin


Background/foreground segmentation using depth and color (depth and color not matching well)

Required Info

Camera Model
D435i

Firmware Version
2.17.1

Operating System & Version
Linux (Ubuntu 16.04)

Kernel Version (Linux Only)
4.4.38-tegra

Platform
NVIDIA Jetson Tegra

SDK Version
2.0 }

Language
C++

Segment
Robotics

Issue Description
I am trying to do background/foreground segmentation using the realsense camera and the ROS wrapper (I am currently in origin/development).
I have enabled "align_depth" and "enable_sync". I am using the topics /camera/aligned_depth_to_color/image_raw and /camera/color/image_raw. I can see that both topics have synchronized timestamps. They are both at 640x480.
I  made a ROS node that subscribe to both using message_filters::TimeSynchronizer, meaning that I only receive both images if they are at the exact same timestamp, otherwise the image is rejected.
I made a rudimentary depth filter using OpenCV, in which I check pixel by pixel in the depth map. If the given pixel is beyond a certain threshold, the corresponding RGB pixel in the color image is set to black.
However, it seems that the alignment between the color image and the depth image are not always well aligned, specially when I move the camera. The video below shows this behavior.
https://youtu.be/Il2muRqst5o
Is this expected behavior? Is this mismatch expected when in motion?

I have been able to improve the results by opening realsense-viewer and switching the preset to high accuracy. Still, there seems to be some temporal filtering happening at depth level.
Is it possible to disable it?

[Please Ignore - RealSense system comment]

The post-processing filtering could be enabled. Please try to disable the temporal filter and enable the sync in the wrapper.
https://github.com/intel-ros/realsense#launch-parameters

Thanks for the answer. Still, I am confused as to how to disable the filter.
Checking for the parameter in runtime, this is what I get (empty result):
rosparam get /camera/realsense2_camera/filters
''

BTW, my sync parameter is enabled:
rosparam get /camera/realsense2_camera/enable_sync
true

Looking at the point cloud, there I can also clearly see spatial filtering, which I would desire to disable. Are these features available in Firmware Version | 2.17.1 and realsense ros version 2.1.3?

BTW, the behavior can also be observed by running the RGBD Point Cloud example described here:
roslaunch realsense2_camera rs_camera.launch filters:=pointcloud
rosrun rviz rviz -d ~/catkin_ws/src/realsense/realsense2_camera/rviz/pointcloud.rviz


Create ROADMAP.md

A document about the project roadmap helps users understand

WHAT - future scope and deliverable for the project
WHEN - timelines for delivering these milestones / also helps with GH project visibility
HOW - procedure for users to request & upvote new items into the roadmap

Big +1 from me for using milestones, but I think @danehans' rough outline is pretty good. I think that @skriss point about conformance being a moving target is a good one too, so we should mark a Gateway API release as the first target, and work towards that. (Perhaps v0.4.3, the current release, or v0.5.0, due soon, that will move some resources to v1beta1.)


fixes subpackage issue with loading composer

see #16072

ok to test

Objective-C binary sizes
*****************STATIC******************
  New size                      Old size
 1,976,380      Total (=)      1,976,380

 No significant differences in binary sizes

***************FRAMEWORKS****************
  New size                      Old size
10,770,428      Total (>)     10,770,424

 No significant differences in binary sizes


[CELEBORN-695]Fix UnsupportedOperationException by refactoring WorkerInfo

What changes were proposed in this pull request?
Refactor WorkerInfo

make diskInfos, userResourceConsumption new maps instead of using the passed in reference
remove endpoint from the constructor

Why are the changes needed?
According to the suggestion from https://github.com/apache/incubator-celeborn/pull/1602#issuecomment-1596722991
Does this PR introduce any user-facing change?
Yes, it fixes bug described  in https://github.com/apache/incubator-celeborn/pull/1602
How was this patch tested?
UTs and manual test.

cc @pan3793 @RexXiong

This is not a simple refactor, it fixes bugs, please correct the title and "Does this PR introduce any user-facing change?"

This is not a simple refactor, it fixes bugs, please correct the title and "Does this PR introduce any user-facing change?"

done


Suggestion: Ability to increase buffer size

Thanks again for this library! This might be a bit outside the responsibility of this library, let me know what you think.
Problem: A lot of ruby-openai users need to buffer multiple chunks in memory before writing to the DB/broadcasting/whatever. What do you think about adding the option to have an optional larger buffer size? Something like: EventStreamParser::Parser.new(buffer_size: 50)
Basically to replace this use case:
  BUFFER_SIZE = 20 # String characters.

  def stream_proc(message:)
    buffer = StringIO.new

    proc do |chunk, _bytesize|
      flush = buffer.size >= BUFFER_SIZE
      stop = chunk.dig('choices', 0, 'finish_reason')
      content = chunk.dig('choices', 0, 'delta', 'content')

      buffer.write(content)
      if flush || stop
        current_content = message.content || ""
        updated_content = current_content + buffer.string

        message.update(content: updated_content)
        buffer.reopen # Clear the buffer
      end
    end

That is a nice blog post


Channel close doesn't work

After closing the channel should give an error message if receive is call. It doesn't work
jobs = Channel(Int32).new 3

3.times do |j|
  jobs.send j
end

puts "closed? #{jobs.closed?}"
jobs.close
puts "closed? #{jobs.closed?}"

puts jobs.receive
puts jobs.receive
puts jobs.receive

output
closed? false
closed? true
0
1
2

A buffered channel still allows to receive the items pending, that is intentional. The next receive call after it ran empty will no longer block but raise instead on a closed channel.

thanks :+1:


Fix crash when user click on blue userLocation

MKUserLocation blue userLocation MKAnnotation causes app to crash if inadvertently touched.
This modifications fixe this issue by testing the kind of clicked marker.

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Can you provide a minimal UX example that I can test the defect and fix?

Yes sure, see the comments on the sample code:
<App>
	<StatusBarBackground Dock="Top"/>
	<JavaScript>
	var Observable = require("FuseJS/Observable");
	var GeoLocation = require("FuseJS/GeoLocation");

	/***
     To get the Blue Location Marker (pull request #1122)
     How to reproduce:
     1/ click on the blue button displayed at your location
     => Crash

     With the fix : no crash.
	*/
	var timeoutMs = 5000;
    GeoLocation.getLocation(timeoutMs).then(function(location) {
    }).catch(function(fail) {
        console.log("getLocation fail " + fail);
    });

	module.exports ={

	}

	</JavaScript>
	<Panel>
		<NativeViewHost >

	            <MapView ux:Name="map" ShowCompass="true" ShowMyLocation="true" ShowMyLocationButton="true"   AllowScroll="true" >

	            </MapView>
	    </NativeViewHost>

</Panel>
</App>


Version bump to 3.2.7

This updates the changelog for a new (hypothetical, not planning on it) 3.2.7 patch release. It also adds a note about JSON null-handing in GraphQL requests that had been omitted.

👍


spike (protocol-api): database and infra upgrades for scaling tweet index voume

Problem:
We are seeing a large volume of tweets flowing into the indexing API and have 10's on millions of tweets in the PostgreSQL data base.
Acceptance criteria & questions arising:

[x] Autoscaling the containers that run the app to write to the db
[ ] No alerting on the db service - this would help track the status
[ ] Monitor and track the db - there is no way to check what is happening with vertical scaling of the db
[ ] IO and network is increasing as the volume in tweets scale exponentially
[ ] How big is this going and where do we end up with this?
[ ] Do we save the tweet data to flat files in S3, from there this can be loaded to any DB
[ ] Architecture diagram - feel to Ettore on this
[ ] Whitelist Validator and internal IP addresses for access so the API is secure

The outcome of this ticket is one or more tickets that define a stable system that scales to billions of tweets
added a comment below proposing a path forward that enables us to capture, index, and archive the scale of tweets we envision (billions) in an efficient manner.

One of the bullets is documented here: https://github.com/orgs/masa-finance/projects/7/views/1?pane=issue&itemId=87858771&issue=masa-finance|masa-bittensor|309

Tweet Collection Pipeline: Scale & Migration Proposal
Current State

ECS running Go application collecting tweets
PostgreSQL RDS (t3.small) storing ~50M tweets
Current ingestion rate: Several million tweets/day
Growing storage and query performance concerns

Proposed Architecture
1. Storage Layer

Primary: S3-based data lake

Parquet files (10k tweets/file)
Date-partitioned folders (/YYYY/MM/DD)
Cost-effective for long-term storage
Enables parallel processing
Simplified backup/replication

2. Search Layer

OpenSearch service

Real-time text search capabilities
Index recent tweets (rolling window)
Optimized for quick retrieval
Auto-scaling configuration

3. Analytics Layer

AWS Athena

SQL queries directly on S3 data
Pay-per-query model
Efficient for large-scale analysis
No pre-provisioning required

Migration Strategy
Phase 1: Dual Write (Week 1-2)

Update Go application to write to both PostgreSQL and S3
Deploy OpenSearch cluster
Add real-time indexing to OpenSearch
Validate data consistency

Phase 2: Historical Migration (Week 2-3)

Backfill historical PostgreSQL data to S3
Create Athena tables and partitions
Configure Glue crawler for schema management
Verify data accessibility

Phase 3: Cutover (Week 3-4)

Shift read queries to new services
Scale down PostgreSQL
Implement monitoring and alerts
Document new query patterns

Cost-Benefit Analysis
Benefits

Improved scalability (handles 100M+ tweets)
Reduced operational complexity
Better query performance
Cost optimization for storage/compute
Simplified backup and disaster recovery

Investment Required

Engineering time: ~4 weeks
Infrastructure costs: Initially higher, long-term savings
Training: Team familiarization with new tools

Monitoring & Maintenance

CloudWatch metrics for ingestion rates
S3 lifecycle policies for data retention
OpenSearch performance monitoring
Cost tracking across services

Risks & Mitigation

Migration data loss

Dual write validation
Checksum verification

Query performance

Pre-migration testing
Query optimization guides

Cost overruns

Regular usage monitoring
Clear lifecycle policies

Link to Miro Board with Architectural Diagram of proposed tweet ingest, index, archive pipeline:
https://miro.com/welcomeonboard/TTBvK2hkRzVycEJGcnV2VFFtN05RS3k1L1B0SStWQzJicGx2TzhUc0JzclRWbGovTWpFcXdpRE9GL0NaZnVKV25xMU1kUTRNZXhKazhXbVRaSzZnMXFkQTFqditYSFpUaGhHZWlEUm0vN0NTc0pmeWZUckM0ak9rTmRpL2FIb0IhZQ==?share_link_id=38695797925

@5u6r054 Let me again suggest DuckDB for analytics as opposed to Athena.
If the data is properly stored in S3 (Parquet with Hive Partioning DuckDB is the better V1 option given that it's free and can work across this stack.

@theMultitude: Valid suggestion. DuckDB:
Free vs Athena's pay-per-query
Direct S3 integration
Fast Parquet handling
Local compute flexibility
Works well with partitioned data
I'll make an updated diagram swapping out Athena / Glue with DuckDB

@theMultitude updated miro board, and here's what it looks like:

this is a migration pathway, where we are able to upgrade to this without any downtime or loss of tweets, but ultimately postgres would no longer be involved

@theMultitude we don't need firehose yet, we are getting tweets as POSTs from the validators of batches, so the limiting factor here is the speed of these POSTs, then they go into a table in postgres that uses the tweet id, (which are numeric and chronological) as the primary key. This ensures we are not storing duplicate tweets. we are also storing the metadata about which validator sent which tweet in the tweets_metadata table.
From here, we can query the postgresdb and archive tweets to s3, and at this stage, we figure out the indexing / file partitioning scheme that is optimized for ingestion / querying by duckdb. hive partitioning makes sense, and doing the partitioning key only on the tweet id, which again is chronological, makes sense to me.
But we have problems. We are increasing by 20M rows per day right now. the postgres DB, due to some suboptimal things about its schema, is rapidly getting overwhelmed.

The primary key id, the tweet id, while chronological and numeric, is stored as a varchar instead of a BIGINT and each id has a ton of 0000 padding it.
apart from sorting out dupes and grabbing metadata, do we actually really need postgres, if we're going to be providing 3 things:

storing only new unique / unstored tweets
recording metadata about the validator that submitted the tweets
providing responses to queries for tweets that require them to be keyword indexed, so searches by text can be narrowed by time/date range.

we don't need realtime indexing of tweets, that's what the validators' api's provide.
So if instead of the postgres DB we just had our go app do this:
receives POST from validator
writes POST to s3 as JSONL file named by the first tweet id _ last tweet id to a tweet_bucket/ingest/ path.
then, a separate worker processes triggered to run periodically (period tuned to the tweets per minute we are taking in as compared to the number of tweets in the parquet file we want) batches the ingest/*.jsonl files into larger parquet files of optimal size for ingest by duckdb, storing them in the hive partitioned path structure. re: tuning periodicity, I mean that say we take in 10k tweets per minute and our parquet file batch size holds 100k tweets, we would set our batching script to run about every hour, at which point it would process about six batches in a run.

evolving miro board diagram is now reflected in edited comments above.
tl;dr:
need to cut postgres out of the loop and just write to s3.
a bit longer:
"just write to s3" is still somewhat complex, can either modify the go app to do it, running via ecs, or since it's not that many requests in the grand scheme of things (just 15 validators sending the tweet data), it could be a python lambda instead of ECS go app.
Either way, we still need an archiver process to record metadata (which validator harvested tweets from and when) and batch up the smaller incoming batches into big but optimal for duckdb parquet files, storing them with hive partitioning, whenever the threshold of incoming small batches of tweets is met.


bug in converting a commented out function

geemap version:
geemap.version_info -> (0, 13, 3)

Python version:
Python 3.6.10 :: Anaconda, Inc.

Operating System:
Darwin Kernel Version 19.6.0

Description
Trying to do:
Use js_to_python from geemap.conversion to convert a javascript gee code
Tell us what happened, what went wrong, and what you expected to happen:
bug in converting a commented out function
The js line:
// var s2_cloud = function(image){
gets converted to
def # s2_cloud(image):
See below. for run
What I Did

setup googlesource login to allow pull of earth engine public repos

clone example code

git clone https://earthengine.googlesource.com/users/marcyinfeng/utils
cd utils

example python code: example.py

from pathlib import Path
from geemap.conversion import *

jsfile = 'SIAC_lai_accurate'
infile   = Path(jsfile).absolute().as_posix()
outfile =  Path(jsfile + '.py').absolute().as_posix()
retcode = js_to_python(infile,outfile)

run conversion
python example.py
test result
python SIAC_lai_accurate.py
result:

File "SIAC_lai_accurate.py", line 51
   def # s2_cloud(image):
                        ^
SyntaxError: invalid syntax

@profLewis Thank you for reporting this bug. I just committed code to fix this bug. Please update geemap using geemap.update_package() or pip install git+https://github.com/giswqs/geemap and try your code again.

Here is what it looks like:


add missing 'ushort' built-in type

closes #15

Yes that's right, not sure why it wasn't in there. Thanks a lot


Desktop/stereo pipeline support

Beginning of the Stereoscopic support for Desktop
fixes #660
Hopefully to make this not as painful there are two main parts:

UI for importing multiple cameras and for importing stereosopic left/right.
Managing the imported data internally using the new structure for import/URL displaying/pipelines

More detailed breakdown:

UI for importing stereoscopic and multiCam images

stereoscopic is a locked down set of multiCam also requiring a calibration file
Updated display for icons including stereoscopic and multiCam
UI for image lists can use different folders or glob matching, so there are different input args for each
Video files only use single files so no need for glob matching

MultiCam Import process occurs before regular import process and arranges a cameras object which will include information for each cam in the multiCam setup
Currently there is a primary camera indicated by the display which is used for displaying, being piped into pipelines and other elements
Because transcoding images of two folders could have the same filename the transcoded images are all prefixed with their object key I.E the folder structure is left/stereoImage1.tiff and right/stereoImage1.tiff these will live in the project folder as left_stereoImage1.tiff and right_stereoImage1.tiff  Note it has nothing to do with the folder name but the key name which must be unique.
For serving URLs, transcoding and running pipelines I kick off the to helper multiCamUtils functions to organize the data
Transcoding for videos needed to be changed to support transcoding multiple videos.  We only display one right now but will need to be able to transcode multiple if required.

Minor Fixes:

I changed mediaConvetList to mediaConvertList

Not addressed Yet:

[ ] Exporting stereoscopic
[ ] Displaying other than the display main list
[ ] Updated Stereo pipelines or multiCam pipelines
[ ] Tests

Differences between multi-cam and sterescopic:
stereoscopic has optional calibration matrix
Stereoscopic is limited to left/right datasets
To combine the two I could make stereoscopic a subset of Multi-cam where it is limited to 2 items and requires an optional calibration matrix.
Multicam would allows the user to specify a descriptor and then a list of images either using glob or folder to make it work.  They could add more lists as required and then select a main display below until multi-view is implemented.
So new plan is that stereoscopic is a subset of multi-cam which is locked to left/right image types and requires a calibration matrix.  Multicam can have X number of image sequences that the user labels instead.

Before we get into code, will you humor me on a short thought experiment:
Is there any reason not to just make stereo or multi a new meta.type that defers to the type of an individual camera? In other words, why can't you combine an image sequence and a video for left and right?

The, instead of having separate menus for image-> multi-cam and video -> multi-cam, you'd have one Multi-cam button and then you could choose either an image sequence or video for each camera.

From the display side, I don't see any reason you couldn't have a VideoAnnotator and ImageAnnotator loaded at the same time (out of scope for this PR).

The stereo pipeline explicitly expects two items of the same length.  When importing images it makes that clear.  I don't know if other multicam pipelines will have the same requirement, that is why I didn't implement the ability to intermix video/image-sequences.  I also don't know if we will in the future support intermixed pipeline runs.

What do you think about allowing this from the data schema?  Adding a new meta.type: 'multi' that defers to cameras.[].type that, for now, only allows all cameras of the same type?
Also, what do you think about just having a simple <v-menu><v-list> for the stereo and multi-cam options (like most of the other menus)?  Something about how the dropdown covers the buttons underneath it with an identically shaped button is disorienting to me, like I changed something I didn't mean to change.  It also makes me feel like I have to move my cursor back to the center of the button to click instead of just down below the expand arrow.  You can definitely keep the icons in the v-menu list.
Aside from documentation and that possible schema change, I think this PR is good to go.

Sorry about the size of the last commit, most of it is the testing and then the refactoring for meta.type  === 'multi'.
Some notes that may be helpful:

apispec.ts and Viewer.vue required a minor change to support the TS type.  While 'multi' is never sent to the front-end because of the type declaration is shared between web and desktop-backend it needs to handle the case so I force it to type DatasetType.
In relation to the above comment common.ts loadJsonMetadata function will redirect the meta.type to either image-sequence or video before sending it to the front-end.  The backend needs to know it is multi for pipeline and loading support, but the frontend only supports the base DatasetType (video or image-sequence).
With this change there were some other items in the backend to handle an initial type of 'multi' and then looking into the cameras to see what type should actually be handled from there.
I tried to add TODO where eventually the 'multi' will be incorporated into the DatasetType
Update to make sure that each camera in the multiCam.cameras object now has it's own type.  These are going to be the same for all cameras based on the import function, but there is some structure to eventually support different camera types if needed in the future.
Transcoding (convertMedia()) was modified to handle both videos and images in a list if they happen to be structured that way.  This is used if there are multiple cameras that have mixed types (not supported yet).
I think this is what you were thinking about for the dropdown menu:

I like that the buttons don't match now.  Here's what I originally had in mind though: a more modest dropdown.
I like being able to see that this is a menu and hasn't replaced the content below.  I also feel like, after clicking the dropdown, users will feel like they have to move their cursor over to the text.  Traditional 3 dots menu style.
This is like, super unimportant in the grand scheme of things, but these outlined narrow menus are the norm so far.  (I broke the viewer button menu styles and need to fix them soon)

I didn't think about this until we talked with some people, but the availability of this feature that doesn't actually show the multi-camera view might confuse or frustrate people who see that it's new and try to use it.
It seems like an ankle trap for new users: "Here's this new stuff but don't touch it ".
Is this important?  Should we disable the features?

It seems like an ankle trap for new users: "Here's this new stuff but don't touch it ".
Is this important? Should we disable the features?

That is a great point.  I think I had a bit of tunnel vision.  It should remained disabled as long as there isn't a way to review the results of the stereo pipelines.  I'll add in a flag to remove the dropdown options from the buttons.


performance optimization: lazy sections

davide's idea:
if a section is closed, then its dom elements can be skipped.
there are two angular ways of hiding content, ng-if and ng-show.
one of them does this, i am not sure which we use for sections.
we should define our own that skips the dom elements until the section is open.
once it is open then we might as well keep them dom.

We use ng-show (ng-hide) which keeps the DOM around. We should change to ng-if.

since we do lazy instantiate on visibility, wasn't this done?

The idea here was to not parse the HTML at all if the section is closed. We still parse the HTML in closed sections even though we don't display the output or instantiate CodeMirror.
I don't think doing this will have a big positive impact on performance although it might in extreme cases (tons of closed sections).
I think we should keep this one around but it's a pretty low priority. It's also relatively simple to do, we just need to wrap ng-if into some directive to prevent it from removing the dom once it was parsed.


default memmap parameter to False

based on (and blocked by) https://github.com/asdf-format/asdf/pull/1800
Description

default memmap=False
Checklist:

[ ] pre-commit checks ran successfully
[ ] tests ran successfully
[ ] for a public change, a changelog entry was added
[ ] for a public change, documentation was updated
[ ] for any new features, unit tests were added

Unit test failures are real. It looks like there are more tests that need updated for the new default.

https://github.com/asdf-format/asdf/pull/1852 was merged and introduced the "what's new" page for asdf 4.0. Would you update this PR and add an entry describing the default change:
https://asdf.readthedocs.io/en/latest/asdf/whats_new.html#new-defaults
I'd say let's put this change first in that section given the scope of this change.

I think this PR should be good to go once the lines mentioned in https://github.com/asdf-format/asdf/pull/1801#discussion_r1834830106 are removed.


KAFKA-14018:Support p12 with sha256

Hi, my first PR.
Our partner changed the encryption algorithm of the p12  certificate from SHA1 to SHA256 for some reason. As a result, Kafka reported a connection error due to the wrong password.But we found the root cause is that the keytool of JDK8 does not support this encryption format.
Solve it with BouncyCastle

@gddsop I reviewed this problem and found the following:
As of present, Apache Kafka runs on Java 8 or above. Until 8, Java uses 'JKS' as a default Keystore type and after that, uses pkcs#12 (includes .p12) However, the supported algorithm list of Java 8 (JKS) and Java 11 (pkcs#12) does not include SHA1 or SHA256.
So, I think this feature would be much better for a custom org.apache.kafka.common.security.auth.SecurityProviderCreator.
@showuon How do you think? I think this issue would be rather a documentaton problem.


Update data.json template with TAC-apps v2-0-0

The template contains entries referring to v1 of the TAC applications.
These might need to be changed to contain the related number for v2. (As we have not reached this part of the specification in the workshop, yet. I don't know how valid the template content is at the moment. So first step is to verify that before deciding on required changes.)
E.g.
{
              "uuid": "xx-1-0-0-op-c-bm-ro-1-0-0-000",
						"ltp-direction": "core-model-1-4:TERMINATION_DIRECTION_SINK",
						"client-ltp": [
						],
						"server-ltp": [
							"xx-1-0-0-http-c-bm-ro-1-0-0-000"
						],

The uuids should have ...-ro-2-0-0-...

might need to be changed to contain the related number for v2

v2 only in case operation got an update.

... The uuids should have ...-ro-2-0-0-.... ...

[x] ServiceList Template
[x] ProfileList
[x] ProfileInstanceList
[x] ForwardingList
[x] OAS
[x] DATAfile

@kmohr-soprasteria : could you please double check the already published files and close the issue.


remove problematic deploy verify step from sample job

@bparees PTAL - related to latest discussion in bugzilla 1293859 (new defect most likely coming); also, I believe you and I discussed removing this step before Christmas, but I had put it lower on the to-do list, not realizing the ramifications until seeing the results after 1293859 was resolved.

lgtm


Fix typo of orgWhitelist value

What this PR does / why we need it:
Which issue this PR fixes
(optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close that issue when PR gets merged)

fixes #

Special notes for your reviewer:
Checklist
[Place an '[x]' (no spaces) in all applicable fields. Please remove unrelated fields.]

[ ] DCO signed
[ ] Chart Version bumped
[ ] Variables are documented in the README.md

Sorry I'm just seeing this now. For some reason I didn't get auto-assigned. Thanks for the PR! You'll need to rebase off of master and then you also have to bump the Chart version for the PR to be mergeable.

/assign me

maybe i did't merge correctly.


Missing files for fsqc (after FastSurfer)

Question/Support Request
I would like to apply fsqc to a data set segmented by FastSurfer. For this I have built a wrapper around run_fastsurfer.sh in Python, see code:
import os
import subprocess

import fsqc

### FastSurfer
def fastSurfer(src_path: str, dst_path: str,):
    fastsurferdir = '/home/einspaennere/Documents/GitHub/FastSurfer'
    script_path = os.path.join(fastsurferdir, 'run_fastsurfer.sh')
    command = [script_path, '--t1', src_path, '--sid', 'SubjectX', '--sd', dst_path, '--parallel', '--threads', str(4)]

    with subprocess.Popen(command, stdout=subprocess.PIPE, stderr=subprocess.PIPE, text=True) as proc:
        for line in proc.stdout:
            logger('%s: %s', command[0], line.strip())

        for line in proc.stderr:
            logger('%s (stderr): %s', command[0], line.strip())
    return

datadir = '/tmp/restmp/original/3_dzne_mprage_1iso_pat2.nii.gz'
fastsurferdir = '/tmp/restmp'

# run
fastSurfer(datadir, fastsurferdir)

### fsqc
subject_dir = '/tmp/restmp'

# Run FSQC
fsqc.run_fsqc(subjects_dir=subject_dir, output_dir=subject_dir, subjects=['SubjectX']) #, fastsurfer=True)

Error message
When I now run fsqc on the processed dataset I always get the error messages of missing files, see error message:
[INFO: fsqcMain.py: 2807]: Found output directory /tmp/restmp/subjects
[INFO: fsqcMain.py: 2832]: Starting logging for fsqctools ...
[INFO: fsqcMain.py: 2833]: Logfile: /tmp/restmp/subjects/logfile.txt
[INFO: fsqcMain.py: 2834]: Version: 2.0.1
[INFO: fsqcMain.py: 2835]: Date: 28/11/2023 14:53:16
[INFO: fsqcMain.py: 2838]: Command: /home/einspaennere/.conda/envs/fastsurfer_cpu/lib/python3.8/site-packages/ipykernel_launcher.py --f=/home/einspaennere/.local/share/jupyter/runtime/kernel-v2-12574HXupyIkxgmqb.json
[INFO: fsqcMain.py:  734]: Found subjects directory /tmp/restmp/subjects
[INFO: fsqcMain.py:  875]: Found screenshot orientation set to radiological
[WARNING: warnings.py:  109]: /home/einspaennere/.conda/envs/fastsurfer_cpu/lib/python3.8/site-packages/fsqc/fsqcMain.py:1104: UserWarning: Could not find /tmp/restmp/subjects/SubjectX/stats/aseg.stats for subject SubjectX
  warnings.warn("Could not find " + path_check + " for subject " + subject)

[WARNING: warnings.py:  109]: /home/einspaennere/.conda/envs/fastsurfer_cpu/lib/python3.8/site-packages/fsqc/fsqcMain.py:1112: UserWarning: Could not find /tmp/restmp/subjects/SubjectX/surf/lh.w-g.pct.mgh for subject SubjectX
  warnings.warn("Could not find " + path_check + " for subject " + subject)

[WARNING: warnings.py:  109]: /home/einspaennere/.conda/envs/fastsurfer_cpu/lib/python3.8/site-packages/fsqc/fsqcMain.py:1119: UserWarning: Could not find /tmp/restmp/subjects/SubjectX/surf/rh.w-g.pct.mgh for subject SubjectX
  warnings.warn("Could not find " + path_check + " for subject " + subject)

[WARNING: warnings.py:  109]: /home/einspaennere/.conda/envs/fastsurfer_cpu/lib/python3.8/site-packages/fsqc/fsqcMain.py:1126: UserWarning: Could not find /tmp/restmp/subjects/SubjectX/label/lh.cortex.label for subject SubjectX
  warnings.warn("Could not find " + path_check + " for subject " + subject)

[WARNING: warnings.py:  109]: /home/einspaennere/.conda/envs/fastsurfer_cpu/lib/python3.8/site-packages/fsqc/fsqcMain.py:1133: UserWarning: Could not find /tmp/restmp/subjects/SubjectX/label/rh.cortex.label for subject SubjectX
  warnings.warn("Could not find " + path_check + " for subject " + subject)

[WARNING: warnings.py:  109]: /home/einspaennere/.conda/envs/fastsurfer_cpu/lib/python3.8/site-packages/fsqc/fsqcMain.py:1153: UserWarning: Could not find /tmp/restmp/subjects/SubjectX/mri/aseg.mgz for subject SubjectX
  warnings.warn("Could not find " + path_check + " for subject " + subject)
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
/home/einspaennere/Documents/GitHub/mri_qc_pipeline/tests/test_FastSurfer.ipynb Cell 6 line 8
      [2](vscode-notebook-cell://wsl%2Bubuntu-20.04/home/einspaennere/Documents/GitHub/mri_qc_pipeline/tests/test_FastSurfer.ipynb#W5sdnNjb2RlLXJlbW90ZQ%3D%3D?line=1) subject_dir = '/tmp/restmp/subjects'
      [4](vscode-notebook-cell://wsl%2Bubuntu-20.04/home/einspaennere/Documents/GitHub/mri_qc_pipeline/tests/test_FastSurfer.ipynb#W5sdnNjb2RlLXJlbW90ZQ%3D%3D?line=3) # print(help(fsqc.run_fsqc))
      [5](vscode-notebook-cell://wsl%2Bubuntu-20.04/home/einspaennere/Documents/GitHub/mri_qc_pipeline/tests/test_FastSurfer.ipynb#W5sdnNjb2RlLXJlbW90ZQ%3D%3D?line=4)
      [6](vscode-notebook-cell://wsl%2Bubuntu-20.04/home/einspaennere/Documents/GitHub/mri_qc_pipeline/tests/test_FastSurfer.ipynb#W5sdnNjb2RlLXJlbW90ZQ%3D%3D?line=5) # Run FSQC
      [7](vscode-notebook-cell://wsl%2Bubuntu-20.04/home/einspaennere/Documents/GitHub/mri_qc_pipeline/tests/test_FastSurfer.ipynb#W5sdnNjb2RlLXJlbW90ZQ%3D%3D?line=6) # fsqc.run_fsqc(subjects_dir='/my/subjects/dir', output_dir='/my/output/dir', subject_file='/my/subjects/file.txt', screenshots_html=True, surfaces_html=True, skullstrip_html=True, fornix_html=True, hypothalamus_html=True, hippocampus_html=True, hippocampus_label="T1.v21", shape=True, outlier=True)
----> [8](vscode-notebook-cell://wsl%2Bubuntu-20.04/home/einspaennere/Documents/GitHub/mri_qc_pipeline/tests/test_FastSurfer.ipynb#W5sdnNjb2RlLXJlbW90ZQ%3D%3D?line=7) fsqc.run_fsqc(subjects_dir=subject_dir, output_dir=subject_dir, subjects=['SubjectX'])

File [~/.conda/envs/fastsurfer_cpu/lib/python3.8/site-packages/fsqc/fsqcMain.py:3029](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/einspaennere/Documents/GitHub/mri_qc_pipeline/tests/~/.conda/envs/fastsurfer_cpu/lib/python3.8/site-packages/fsqc/fsqcMain.py:3029), in run_fsqc(subjects_dir, output_dir, argsDict, subjects, subjects_file, shape, screenshots, screenshots_html, screenshots_base, screenshots_overlay, screenshots_surf, screenshots_views, screenshots_layout, screenshots_orientation, surfaces, surfaces_html, surfaces_views, skullstrip, skullstrip_html, fornix, fornix_html, hypothalamus, hypothalamus_html, hippocampus, hippocampus_html, hippocampus_label, outlier, outlier_table, fastsurfer, exit_on_error, logfile)
   [3026](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/einspaennere/Documents/GitHub/mri_qc_pipeline/tests/~/.conda/envs/fastsurfer_cpu/lib/python3.8/site-packages/fsqc/fsqcMain.py:3026) argsDict = _start_logging(argsDict)
   [3028](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/einspaennere/Documents/GitHub/mri_qc_pipeline/tests/~/.conda/envs/fastsurfer_cpu/lib/python3.8/site-packages/fsqc/fsqcMain.py:3028) # check arguments
-> [3029](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/einspaennere/Documents/GitHub/mri_qc_pipeline/tests/~/.conda/envs/fastsurfer_cpu/lib/python3.8/site-packages/fsqc/fsqcMain.py:3029) argsDict = _check_arguments(argsDict)
   [3031](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/einspaennere/Documents/GitHub/mri_qc_pipeline/tests/~/.conda/envs/fastsurfer_cpu/lib/python3.8/site-packages/fsqc/fsqcMain.py:3031) # check packages
   [3032](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/einspaennere/Documents/GitHub/mri_qc_pipeline/tests/~/.conda/envs/fastsurfer_cpu/lib/python3.8/site-packages/fsqc/fsqcMain.py:3032) _check_packages()

File [~/.conda/envs/fastsurfer_cpu/lib/python3.8/site-packages/fsqc/fsqcMain.py:1343](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/einspaennere/Documents/GitHub/mri_qc_pipeline/tests/~/.conda/envs/fastsurfer_cpu/lib/python3.8/site-packages/fsqc/fsqcMain.py:1343), in _check_arguments(argsDict)
   [1341](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/einspaennere/Documents/GitHub/mri_qc_pipeline/tests/~/.conda/envs/fastsurfer_cpu/lib/python3.8/site-packages/fsqc/fsqcMain.py:1341) # check if we have any subjects after all
   [1342](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/einspaennere/Documents/GitHub/mri_qc_pipeline/tests/~/.conda/envs/fastsurfer_cpu/lib/python3.8/site-packages/fsqc/fsqcMain.py:1342) if not argsDict["subjects"]:
-> [1343](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/einspaennere/Documents/GitHub/mri_qc_pipeline/tests/~/.conda/envs/fastsurfer_cpu/lib/python3.8/site-packages/fsqc/fsqcMain.py:1343)     raise ValueError("ERROR: no subjects to process")
   [1345](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/einspaennere/Documents/GitHub/mri_qc_pipeline/tests/~/.conda/envs/fastsurfer_cpu/lib/python3.8/site-packages/fsqc/fsqcMain.py:1345) # now return
   [1346](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/einspaennere/Documents/GitHub/mri_qc_pipeline/tests/~/.conda/envs/fastsurfer_cpu/lib/python3.8/site-packages/fsqc/fsqcMain.py:1346) return argsDict

ValueError: ERROR: no subjects to process

Environment

FastSurfer Version: 2.1.2
FreeSurfer Version: 7.3.2
OS: Ubuntu 20.04 (WSL, Win10)
CPU: i5-8350U
GPU: -

FastSurfer as well as fsqc runs in a conda env (fastsurfer_cpu). I have used pip freeze and attached the txt file.
fastsurfer_cpu.txt

Hi, this is really more a FSQC question, but who knows, what exactly is causing it, also considering this is in WSL.
The first question is, what happens if you run our Fastsurfer (via docker image), does it go through and produce all outputs?
Then what happens if you run fsqc on that output separately without your script? Does it work?
Then the next question is, are those files there? Check and open for example: /tmp/restmp/subjects/SubjectX/stats/aseg.stats

Thank you for your answer.
Unfortunately, I can't easily try Docker due to the restrictions of our research facility. I would have to try it with a test data set on another computer...
When I look at the logs from FastSurfer, I don't see any error messages or warnings that indicate faulty processing. (see attached txt file) log_fastsurfer.txt
Regardless of Docker, I cannot find the file aseg.stats in the folder /tmp/restmp/subjects/SubjectX/stats/, but aseg+DKT.stats. This is the case with several files that +DTK is still attached to the file name.

Are you using our stable version (from stable branch) or the dev version? Another issue with local installs is that you probably have different versions of dependencies installed and that can sometimes break things.
Anyway, the aseg.statsfile should always be there after a successful FastSurfer run. If that is missing something did not work.
The aseg+DKT.stats get output directly after the segmentation, so that step worked, but probably somewhere in the Surface Pipeline, things go wrong. The log_file als stopped somewhere.

I followed the instructions (README) for the native install step by step. I also used the stable branch. Okay, then I'll try to use the Docker container somehow to have a comparison. I'll get back to you ;)

if you only have the aseg+DKT.stats, that likely means you have only run --seg_only of FastSurfer.
aseg.statsonly gets generated with the surface reconstruction, maybe try running run_fastsurfer.sh --surf_only on top of the segmentation?

No, the log file shows that the surface is also running, but probably stops somewhere. Maybe the recon-surf.log would be helpful to look at.

This means you have incompatible versions of the FastSurfer and the Lapy dependency. See also #409 .
In stable we use an older version of Lapy (0.4.1) while the dev branch uses a recent version (1.0.1). So probably you need to revert to an older Lapy package and it should work.
Or use one of our released Docker images which always have the correct versions installed.


Fix build for other contributors

A few tiny things to make the project easier to build. Super excited for this, thank you SO much for putting it together!

oh dang that was fast, sorry was trying to annotate after you approved! thx!


Update translation based on #195

Signed-off-by: TakaoShimizu<EMAIL_ADDRESS>/kind content
/kind translation
/area documentation
What this PR does / why we need it:
Update translation to Japanese based on 'https://github.com/falcosecurity/falco-website/pull/195/files'
/assign @leodido
/assign @fntlnz

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by:
To complete the pull request process, please assign leogr
You can assign the PR to them by writing /assign @leogr in a comment when ready.
The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by:
To complete the pull request process, please assign fntlnz
You can assign the PR to them by writing /assign @fntlnz in a comment when ready.
The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

LGTM label has been added.  Git tree hash: 253b69eff77cab7f99c3c8f2cab2edbda36e2370

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: leodido
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS [leodido]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment


E2E test for workload cluster creation from prev eksa version

Issue #, if available:
E2E test for Creating Management Cluster with current eks-a version and create workload cluster with the previous eks-a version to check for backward workload cluster create support. The change also alters the pre-flight that checks for bundle number to skip the bundle validation during dev build to enable running this test against main.
Description of changes:
Testing (if applicable):
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

/retest

/lgtm

/approve


--trace-skia not getting sent to the engine for iOS simulator

Flutter version: bbc5b9d967449cdf0ba601e20e7662dcf04c886f
If I run flutter with: flutter run --trace-skia
On an engine that has the following patch:
--- a/shell/common/switches.cc
+++ b/shell/common/switches.cc
@@ -271,9 +271,11 @@ Settings SettingsFromCommandLine(const fml::CommandLine& command_line) {

   settings.trace_skia =
       command_line.HasOption(FlagForSwitch(Switch::TraceSkia));
+  FML_LOG(ERROR) << "trace skia:" << settings.trace_skia;

   command_line.GetOptionValue(FlagForSwitch(Switch::TraceWhitelist),
                               &settings.trace_whitelist);

It prints out: [VERBOSE-2:switches.cc(274)] trace skia:0
I supplied the flag --observatory-port 123 and that does get passed through.
Seen on: iOS

It looks like for simulators we pass very few of the args through. Not sure if this is intentional, but at least with the current design it seems like an easy mistake to make. Especially since the android device/emulator are implemented with the same class, while only iOS is split between the physical device and simulator
https://github.com/flutter/flutter/blob/master/packages/flutter_tools/lib/src/ios/simulators.dart#L397

Simulator:
https://github.com/flutter/flutter/blob/d40f6d1e681f17e3b7b7290afb4c9b4175b976e7/packages/flutter_tools/lib/src/ios/simulators.dart#L430-L449
Physical device:
https://github.com/flutter/flutter/blob/d40f6d1e681f17e3b7b7290afb4c9b4175b976e7/packages/flutter_tools/lib/src/ios/devices.dart#L352-L377
Simulator tests:
https://github.com/flutter/flutter/blob/d40f6d1e681f17e3b7b7290afb4c9b4175b976e7/packages/flutter_tools/test/general.shard/ios/simulators_test.dart#L1011-L1025
Physical device tests:
https://github.com/flutter/flutter/blob/d40f6d1e681f17e3b7b7290afb4c9b4175b976e7/packages/flutter_tools/test/general.shard/ios/ios_device_start_prebuilt_test.dart#L282-L300
Simulator does not need --disable-observatory-publication since it's not doing mDNS broadcasting.
In the simulator these options are not being passed:
  '--trace-systrace',
  '--trace-skia',
  '--endless-trace-buffer',
  '--dump-skp-on-shader-compilation',
  '--verbose-logging',
  '--cache-sksl',
  '--purge-persistent-cache',


Not able to compile openssl for aarch64-linux platform

Hi,
I am trying to compile openssl for linux-aarch64 platform, i am using aarch64-poky-linux-gcc cross compiler on ubuntu 16.04. I am getting "/lib/ld-linux-aarch64.so.1: No such file or directory" error. ld-linux-aarch64.so.1 is installed under "/opt/poky/2.1.2/sysroots/aarch64-poky-linux/lib" and has symbolic link to "ld-2.23.so", i tried exporting the __CNF_LDFLAGS environment variable to look in "/opt/poky/2.1.2/sysroots/aarch64-poky-linux/lib" directory, that did not resolve the issue. Any suggestions please, thanks in advance.

dump_output.txt
I have attached output of "perl configdata.pm --dump" command,

What version of OpenSSL are you doing this with? I get different output from perl configdata.pm --dump compared to you when I try your command line (using the latest git OpenSSL sources).

Ah...no...I take that back...it turns out I wasn't sat on the latest master when I tried it.

This doesn't sound like OpenSSL problem. Can you compile main(){}? With compiler in question of course? If not, it's not something we can help with. As we stand for source code, and you stand for working toolchain. If you get this message when trying to execute binary on target system, then toolchain doesn't match the target system. Again, not OpenSSL problem...


Adding words internally to dictionary don't work for accented characters

@amnonma, let's discuss this. Not sure how to handle this. I'm sure you have thought about this but I think it's time to implement it.


[KED-2252] Update Kedro starters for 0.17.0

@lorenabalan yea, will definitely add CI. I just don't think I have the time or the will to do it this week hence I left it out and just tested everything manually.


shut down unexpectly:Shutting down due to unsupported feature activation (15: Activate trading of any token on the distributed exchange)

My Omni wallet version is 0.7.0
debug.log
2020-04-23T06:17:37Z Error: Shutting down due to unsupported feature activation (15: Activate trading of any token on the distributed exchange)
omnicore.log->
2020-04-23T06:17:38Z Expiring alert (from omnicore: type:1 expiry:627250 message:Your client must be updated and will shutdown at block 627250 (unsupported feature 15 ('Activate trading of any token on the distributed exchange') activated)
)

Hi, please see:
https://github.com/OmniLayer/omnicore/wiki/Help,-my-node-shut-down-due-to-unsupported-feature-activation%3F

#1106 related